2024-09-19T08:24:22.593 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T08:24:22.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T08:24:22.725 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911855 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/fsync-tester}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911855' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi007.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMvFhbim9TzpOr3KAeI4RrweHaB0JmcrdY3Mba7Rea0AR+wvLrHDEx3x7l2GkiWt4TD6HBFclKm7GWMu+Zgju64= smithi044.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKVtu9o8fbxeIIBdfpm+fe8/znw8/5csSZJvWB57Hx/ulpqA6eal1Bz4JDpD2oDs6+ZHwDm8WJI0eFfSUwZCxA0= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMSvs91P2WMdNfoyWtx3ylvDGtU4GXgipQspoRprUM2kHIhbxwMg9rN4dDj5EXgmMhMExhaaywcZ9dhEzLEAdm8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - quiescer: null - workunit: clients: all: - suites/fsync-tester.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T08:24:22.726 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T08:24:22.726 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T08:24:22.727 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T08:24:22.728 INFO:teuthology.task.internal:Checking packages... 2024-09-19T08:24:22.749 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T08:24:22.750 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T08:24:22.750 INFO:teuthology.packaging:ref: None 2024-09-19T08:24:22.750 INFO:teuthology.packaging:tag: None 2024-09-19T08:24:22.750 INFO:teuthology.packaging:branch: squid 2024-09-19T08:24:22.750 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:24:22.750 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T08:24:22.968 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T08:24:22.969 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T08:24:22.976 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T08:24:22.977 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T08:24:23.025 INFO:teuthology.task.internal:Saving configuration 2024-09-19T08:24:23.047 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T08:24:23.054 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T08:24:23.080 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911855', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:19:24.141314', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMvFhbim9TzpOr3KAeI4RrweHaB0JmcrdY3Mba7Rea0AR+wvLrHDEx3x7l2GkiWt4TD6HBFclKm7GWMu+Zgju64='} 2024-09-19T08:24:23.100 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911855', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:19:24.143434', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKVtu9o8fbxeIIBdfpm+fe8/znw8/5csSZJvWB57Hx/ulpqA6eal1Bz4JDpD2oDs6+ZHwDm8WJI0eFfSUwZCxA0='} 2024-09-19T08:24:23.123 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911855', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:19:24.144934', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMSvs91P2WMdNfoyWtx3ylvDGtU4GXgipQspoRprUM2kHIhbxwMg9rN4dDj5EXgmMhMExhaaywcZ9dhEzLEAdm8='} 2024-09-19T08:24:23.124 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T08:24:23.130 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T08:24:23.130 INFO:teuthology.task.internal:roles: ubuntu@smithi044.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T08:24:23.130 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T08:24:23.130 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T08:24:23.270 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc4b774b520>, signals=[15]) 2024-09-19T08:24:23.270 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T08:24:23.277 INFO:teuthology.task.internal:Opening connections... 2024-09-19T08:24:23.277 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi007.front.sepia.ceph.com 2024-09-19T08:24:23.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:24:23.360 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi044.front.sepia.ceph.com 2024-09-19T08:24:23.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:24:23.435 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2024-09-19T08:24:23.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:24:23.514 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T08:24:23.520 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2024-09-19T08:24:23.539 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2024-09-19T08:24:23.539 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-09-19T08:24:23.596 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2024-09-19T08:24:23.596 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="9" 2024-09-19T08:24:23.597 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2024-09-19T08:24:23.597 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:24:23.597 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="9" 2024-09-19T08:24:23.597 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:24:23.597 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:24:23.597 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2024-09-19T08:24:23.597 INFO:teuthology.orchestra.run.smithi007.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:24:23.597 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:24:23.597 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:24:23.597 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:24:23.597 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:24:23.597 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:24:23.598 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-09-19T08:24:23.623 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2024-09-19T08:24:23.642 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2024-09-19T08:24:23.642 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-09-19T08:24:23.699 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2024-09-19T08:24:23.699 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2024-09-19T08:24:23.700 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2024-09-19T08:24:23.700 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:24:23.700 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2024-09-19T08:24:23.700 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:24:23.700 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:24:23.700 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2024-09-19T08:24:23.700 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:24:23.700 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:24:23.700 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:24:23.700 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:24:23.700 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:24:23.700 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:24:23.701 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-09-19T08:24:23.724 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-09-19T08:24:23.742 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-09-19T08:24:23.743 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-09-19T08:24:23.801 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-09-19T08:24:23.801 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-09-19T08:24:23.801 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-09-19T08:24:23.801 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:24:23.801 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-09-19T08:24:23.802 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:24:23.802 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:24:23.802 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-09-19T08:24:23.802 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:24:23.802 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:24:23.802 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:24:23.802 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:24:23.802 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:24:23.802 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:24:23.802 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-09-19T08:24:23.824 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T08:24:23.835 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T08:24:23.866 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T08:24:23.867 DEBUG:teuthology.orchestra.run.smithi007:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:24:23.869 DEBUG:teuthology.orchestra.run.smithi044:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:24:23.872 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:24:23.888 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T08:24:23.894 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T08:24:23.895 DEBUG:teuthology.orchestra.run.smithi007:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:24:23.927 DEBUG:teuthology.orchestra.run.smithi044:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:24:23.930 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:24:23.960 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T08:24:24.039 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T08:24:24.053 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-19T08:24:24.053 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-19T08:24:24.053 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-19T08:24:24.054 DEBUG:teuthology.orchestra.run.smithi007:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:24:24.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:24:24.071 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-09-19T08:24:24.128 INFO:teuthology.orchestra.run.smithi007.stdout:5.14.0-503.el9.x86_64 2024-09-19T08:24:24.129 INFO:teuthology.task.kernel:Running kernel on smithi007: 5.14.0-503.el9.x86_64 2024-09-19T08:24:24.129 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum install -y kernel 2024-09-19T08:24:30.768 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - BaseOS 1.7 MB/s | 8.3 MB 00:04 2024-09-19T08:24:35.419 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - AppStream 5.8 MB/s | 20 MB 00:03 2024-09-19T08:24:39.937 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-19T08:24:42.262 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-19T08:24:43.141 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-19T08:24:48.839 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T08:24:50.828 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T08:24:50.828 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T08:24:50.920 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-09-19T08:24:50.926 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-09-19T08:24:50.926 INFO:teuthology.orchestra.run.smithi007.stdout: Package Architecture Version Repository Size 2024-09-19T08:24:50.926 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-09-19T08:24:50.926 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2024-09-19T08:24:50.926 INFO:teuthology.orchestra.run.smithi007.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T08:24:50.927 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2024-09-19T08:24:50.927 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T08:24:50.927 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T08:24:50.927 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T08:24:50.927 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:24:50.927 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2024-09-19T08:24:50.927 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-09-19T08:24:50.927 INFO:teuthology.orchestra.run.smithi007.stdout:Install 4 Packages 2024-09-19T08:24:50.927 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:24:50.928 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 79 M 2024-09-19T08:24:50.928 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 126 M 2024-09-19T08:24:50.928 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2024-09-19T08:24:51.440 INFO:teuthology.orchestra.run.smithi007.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 334 kB/s | 36 kB 00:00 2024-09-19T08:24:51.940 INFO:teuthology.orchestra.run.smithi007.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-19T08:24:52.315 INFO:teuthology.orchestra.run.smithi007.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 33 MB/s | 29 MB 00:00 2024-09-19T08:24:52.641 INFO:teuthology.orchestra.run.smithi007.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 26 MB/s | 35 MB 00:01 2024-09-19T08:24:52.641 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:24:52.641 INFO:teuthology.orchestra.run.smithi007.stdout:Total 46 MB/s | 79 MB 00:01 2024-09-19T08:24:53.354 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2024-09-19T08:24:53.741 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2024-09-19T08:24:53.741 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2024-09-19T08:24:54.769 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2024-09-19T08:24:54.770 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2024-09-19T08:24:57.322 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2024-09-19T08:24:57.987 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:24:58.076 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:25:00.825 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:25:00.977 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:25:06.110 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:25:06.145 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:25:11.279 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:25:50.485 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:25:50.527 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:25:50.901 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:25:50.901 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:25:50.901 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:25:50.901 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:25:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:25:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:25:51.782 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2024-09-19T08:25:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T08:25:51.782 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T08:25:51.783 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T08:25:51.783 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T08:25:51.783 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:25:51.783 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2024-09-19T08:25:52.135 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:25:52.225 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:25:52.225 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:25:52.225 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T08:25:52.226 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T08:25:52.226 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T08:25:52.226 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-19T08:25:52.226 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi007.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T08:25:52.226 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:25:52.285 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:25:52.286 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:25:52.286 DEBUG:teuthology.orchestra.run.smithi007:> sudo rpm -qi grub2-tools 2024-09-19T08:25:52.320 INFO:teuthology.orchestra.run.smithi007.stdout:Name : grub2-tools 2024-09-19T08:25:52.321 INFO:teuthology.orchestra.run.smithi007.stdout:Epoch : 1 2024-09-19T08:25:52.321 INFO:teuthology.orchestra.run.smithi007.stdout:Version : 2.06 2024-09-19T08:25:52.321 INFO:teuthology.orchestra.run.smithi007.stdout:Release : 82.el9 2024-09-19T08:25:52.321 INFO:teuthology.orchestra.run.smithi007.stdout:Architecture: x86_64 2024-09-19T08:25:52.321 INFO:teuthology.orchestra.run.smithi007.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T08:25:52.321 INFO:teuthology.orchestra.run.smithi007.stdout:Group : Unspecified 2024-09-19T08:25:52.321 INFO:teuthology.orchestra.run.smithi007.stdout:Size : 8274670 2024-09-19T08:25:52.321 INFO:teuthology.orchestra.run.smithi007.stdout:License : GPLv3+ 2024-09-19T08:25:52.321 INFO:teuthology.orchestra.run.smithi007.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T08:25:52.321 INFO:teuthology.orchestra.run.smithi007.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T08:25:52.321 INFO:teuthology.orchestra.run.smithi007.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T08:25:52.321 INFO:teuthology.orchestra.run.smithi007.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T08:25:52.322 INFO:teuthology.orchestra.run.smithi007.stdout:Packager : builder@centos.org 2024-09-19T08:25:52.322 INFO:teuthology.orchestra.run.smithi007.stdout:Vendor : CentOS 2024-09-19T08:25:52.322 INFO:teuthology.orchestra.run.smithi007.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T08:25:52.322 INFO:teuthology.orchestra.run.smithi007.stdout:Summary : Support tools for GRUB. 2024-09-19T08:25:52.322 INFO:teuthology.orchestra.run.smithi007.stdout:Description : 2024-09-19T08:25:52.322 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:25:52.322 INFO:teuthology.orchestra.run.smithi007.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T08:25:52.322 INFO:teuthology.orchestra.run.smithi007.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T08:25:52.322 INFO:teuthology.orchestra.run.smithi007.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T08:25:52.322 INFO:teuthology.orchestra.run.smithi007.stdout:hardware devices. 2024-09-19T08:25:52.322 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:25:52.322 INFO:teuthology.orchestra.run.smithi007.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T08:25:52.323 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T08:25:52.323 INFO:teuthology.task.kernel:Updating grub on smithi007 to boot 5.14.0-508.el9.x86_64 2024-09-19T08:25:52.324 DEBUG:teuthology.orchestra.run.smithi007:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T08:25:53.067 INFO:teuthology.orchestra.run.smithi007.stderr:Generating grub configuration file ... 2024-09-19T08:25:54.322 INFO:teuthology.orchestra.run.smithi007.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T08:25:54.362 INFO:teuthology.orchestra.run.smithi007.stderr:done 2024-09-19T08:25:54.364 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2024-09-19T08:25:54.380 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.Rs0oaOrCwq 2024-09-19T08:25:54.380 DEBUG:teuthology.orchestra.run.smithi007:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Rs0oaOrCwq 2024-09-19T08:25:54.446 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.Rs0oaOrCwq 2024-09-19T08:25:54.583 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.Rs0oaOrCwq is 6KB 2024-09-19T08:25:54.631 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.Rs0oaOrCwq 2024-09-19T08:25:54.646 DEBUG:teuthology.orchestra.run.smithi007:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T08:25:54.708 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T08:25:54.709 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T08:25:54.709 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T08:25:54.709 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T08:25:54.710 DEBUG:teuthology.orchestra.run.smithi007:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T08:25:54.865 DEBUG:teuthology.orchestra.run.smithi007:> sudo shutdown -r now 2024-09-19T08:26:24.870 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-19T08:26:24.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-19T08:26:24.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:27:24.875 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T08:27:33.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-19T08:27:33.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:27:34.307 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-09-19T08:27:34.728 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-19T08:27:34.729 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-19T08:27:34.729 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-09-19T08:27:34.744 INFO:teuthology.orchestra.run.smithi007.stdout:5.14.0-508.el9.x86_64 2024-09-19T08:27:34.745 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T08:27:34.745 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T08:27:34.745 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T08:27:35.745 DEBUG:teuthology.parallel:result is None 2024-09-19T08:27:35.746 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T08:27:35.753 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T08:27:35.753 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T08:27:35.756 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T08:27:35.759 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T08:27:35.777 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T08:27:35.836 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T08:27:35.877 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T08:27:35.877 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T08:27:35.879 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T08:27:35.881 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T08:27:35.919 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T08:27:35.926 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T08:27:35.926 DEBUG:teuthology.orchestra.run.smithi044:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:27:35.961 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:27:35.961 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:27:35.979 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:27:35.979 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T08:27:35.982 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T08:27:36.005 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T08:27:36.047 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:27:36.064 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:27:36.065 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:27:36.069 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:27:36.097 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:27:36.099 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:27:36.101 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T08:27:36.108 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T08:27:36.108 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T08:27:36.110 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T08:27:36.112 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T08:27:36.139 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T08:27:36.148 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T08:27:36.149 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T08:27:36.177 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T08:27:36.180 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T08:27:36.196 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:27:36.274 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:27:36.321 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:27:36.405 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:27:36.446 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T08:27:36.446 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T08:27:36.520 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:27:36.564 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:27:36.619 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:27:36.703 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:27:36.746 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-19T08:27:36.747 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T08:27:36.814 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:27:36.859 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:27:36.920 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:27:36.964 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:27:37.007 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-19T08:27:37.007 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T08:27:37.073 DEBUG:teuthology.orchestra.run.smithi007:> sudo service rsyslog restart 2024-09-19T08:27:37.076 DEBUG:teuthology.orchestra.run.smithi044:> sudo service rsyslog restart 2024-09-19T08:27:37.078 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2024-09-19T08:27:37.112 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:27:37.123 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:27:37.150 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:27:37.592 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T08:27:37.604 INFO:teuthology.task.internal:Starting timer... 2024-09-19T08:27:37.605 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T08:27:37.642 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T08:27:37.674 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T08:27:37.675 DEBUG:teuthology.orchestra.run.smithi007:> sudo service auditd rotate 2024-09-19T08:27:37.738 INFO:teuthology.orchestra.run.smithi007.stdout:Rotating logs: 2024-09-19T08:27:37.740 DEBUG:teuthology.orchestra.run.smithi044:> sudo service auditd rotate 2024-09-19T08:27:37.804 INFO:teuthology.orchestra.run.smithi044.stdout:Rotating logs: 2024-09-19T08:27:37.808 DEBUG:teuthology.orchestra.run.smithi175:> sudo service auditd rotate 2024-09-19T08:27:37.862 INFO:teuthology.orchestra.run.smithi175.stdout:Rotating logs: 2024-09-19T08:27:37.864 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T08:27:37.864 DEBUG:teuthology.orchestra.run.smithi007:> /usr/sbin/getenforce 2024-09-19T08:27:37.887 INFO:teuthology.orchestra.run.smithi007.stdout:Permissive 2024-09-19T08:27:37.888 DEBUG:teuthology.orchestra.run.smithi044:> /usr/sbin/getenforce 2024-09-19T08:27:37.915 INFO:teuthology.orchestra.run.smithi044.stdout:Permissive 2024-09-19T08:27:37.916 DEBUG:teuthology.orchestra.run.smithi175:> /usr/sbin/getenforce 2024-09-19T08:27:37.939 INFO:teuthology.orchestra.run.smithi175.stdout:Permissive 2024-09-19T08:27:37.939 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi007.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi044.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi175.front.sepia.ceph.com': 'permissive'} 2024-09-19T08:27:37.939 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:27:37.965 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:27:37.966 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:27:37.993 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:27:37.994 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:27:38.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:27:38.021 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T08:27:38.021 DEBUG:teuthology.orchestra.run.smithi007:> sudo /usr/sbin/setenforce permissive 2024-09-19T08:27:38.159 DEBUG:teuthology.orchestra.run.smithi044:> sudo /usr/sbin/setenforce permissive 2024-09-19T08:27:38.195 DEBUG:teuthology.orchestra.run.smithi175:> sudo /usr/sbin/setenforce permissive 2024-09-19T08:27:38.229 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T08:27:38.239 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-19T08:27:38.242 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-19T08:27:38.358 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T08:27:38.369 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T08:27:38.370 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi007.front.sepia.ceph.com,smithi044.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T08:31:47.541 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi007.front.sepia.ceph.com'), Remote(name='ubuntu@smithi044.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2024-09-19T08:31:47.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-19T08:31:47.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:31:47.633 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-09-19T08:31:47.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-19T08:31:47.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-19T08:31:47.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:31:47.800 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-09-19T08:31:47.875 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-19T08:31:47.875 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-19T08:31:47.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:31:47.951 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-09-19T08:31:48.033 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-09-19T08:31:48.034 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T08:31:48.044 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T08:31:48.045 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T08:31:48.045 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:31:48.048 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T08:31:48.048 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:31:48.050 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T08:31:48.050 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:31:48.077 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T08:31:48.078 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T08:31:48.091 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T08:31:48.093 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T08:31:48.105 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T08:31:48.116 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: ntpd: command not found 2024-09-19T08:31:48.120 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: ntpd: command not found 2024-09-19T08:31:48.121 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T08:31:48.127 INFO:teuthology.orchestra.run.smithi044.stdout:506 Cannot talk to daemon 2024-09-19T08:31:48.131 INFO:teuthology.orchestra.run.smithi007.stdout:506 Cannot talk to daemon 2024-09-19T08:31:48.141 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T08:31:48.146 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T08:31:48.155 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: ntpd: command not found 2024-09-19T08:31:48.155 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T08:31:48.161 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T08:31:48.167 INFO:teuthology.orchestra.run.smithi175.stdout:506 Cannot talk to daemon 2024-09-19T08:31:48.182 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T08:31:48.198 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T08:31:48.211 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:31:48.215 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:31:48.215 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2024-09-19T08:31:48.215 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:31:48.215 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:31:48.215 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:31:48.215 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:31:48.217 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:31:48.220 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:31:48.220 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2024-09-19T08:31:48.220 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:31:48.220 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:31:48.221 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:31:48.221 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:31:48.254 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:31:48.258 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:31:48.258 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-09-19T08:31:48.258 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:31:48.258 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:31:48.258 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:31:48.258 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:31:48.259 INFO:teuthology.run_tasks:Running task install... 2024-09-19T08:31:48.266 DEBUG:teuthology.task.install:project ceph 2024-09-19T08:31:48.267 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T08:31:48.267 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T08:31:48.267 INFO:teuthology.task.install:Using flavor: default 2024-09-19T08:31:48.272 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T08:31:48.273 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T08:31:48.273 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T08:31:48.274 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:31:48.276 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T08:31:48.276 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:31:48.277 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T08:31:48.277 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:31:48.437 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T08:31:48.438 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T08:31:48.441 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T08:31:48.441 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T08:31:48.451 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T08:31:48.451 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T08:31:48.554 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T08:31:48.555 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-19T08:31:48.555 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T08:31:48.560 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T08:31:48.561 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T08:31:48.561 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T08:31:48.568 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T08:31:48.568 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-19T08:31:48.568 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T08:31:48.584 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T08:31:48.584 DEBUG:teuthology.orchestra.run.smithi175:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T08:31:48.589 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T08:31:48.589 DEBUG:teuthology.orchestra.run.smithi007:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T08:31:48.596 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T08:31:48.596 DEBUG:teuthology.orchestra.run.smithi044:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T08:31:48.649 DEBUG:teuthology.orchestra.run.smithi175:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T08:31:48.657 DEBUG:teuthology.orchestra.run.smithi007:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T08:31:48.662 DEBUG:teuthology.orchestra.run.smithi044:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T08:31:48.724 DEBUG:teuthology.orchestra.run.smithi175:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T08:31:48.734 DEBUG:teuthology.orchestra.run.smithi007:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T08:31:48.737 DEBUG:teuthology.orchestra.run.smithi044:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T08:31:48.789 INFO:teuthology.orchestra.run.smithi175.stdout:check_obsoletes = 1 2024-09-19T08:31:48.791 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum clean all 2024-09-19T08:31:48.800 INFO:teuthology.orchestra.run.smithi044.stdout:check_obsoletes = 1 2024-09-19T08:31:48.801 INFO:teuthology.orchestra.run.smithi007.stdout:check_obsoletes = 1 2024-09-19T08:31:48.802 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum clean all 2024-09-19T08:31:48.803 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum clean all 2024-09-19T08:31:49.020 INFO:teuthology.orchestra.run.smithi175.stdout:45 files removed 2024-09-19T08:31:49.035 INFO:teuthology.orchestra.run.smithi044.stdout:45 files removed 2024-09-19T08:31:49.045 INFO:teuthology.orchestra.run.smithi007.stdout:45 files removed 2024-09-19T08:31:49.050 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T08:31:49.063 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T08:31:49.072 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T08:31:49.948 INFO:teuthology.orchestra.run.smithi044.stdout:ceph packages for x86_64 139 kB/s | 84 kB 00:00 2024-09-19T08:31:49.949 INFO:teuthology.orchestra.run.smithi175.stdout:ceph packages for x86_64 139 kB/s | 84 kB 00:00 2024-09-19T08:31:50.023 INFO:teuthology.orchestra.run.smithi007.stdout:ceph packages for x86_64 129 kB/s | 84 kB 00:00 2024-09-19T08:31:50.649 INFO:teuthology.orchestra.run.smithi175.stdout:ceph noarch packages 18 kB/s | 12 kB 00:00 2024-09-19T08:31:50.656 INFO:teuthology.orchestra.run.smithi044.stdout:ceph noarch packages 18 kB/s | 12 kB 00:00 2024-09-19T08:31:50.724 INFO:teuthology.orchestra.run.smithi007.stdout:ceph noarch packages 18 kB/s | 12 kB 00:00 2024-09-19T08:31:51.358 INFO:teuthology.orchestra.run.smithi175.stdout:ceph source packages 2.8 kB/s | 1.9 kB 00:00 2024-09-19T08:31:51.365 INFO:teuthology.orchestra.run.smithi044.stdout:ceph source packages 2.9 kB/s | 1.9 kB 00:00 2024-09-19T08:31:51.423 INFO:teuthology.orchestra.run.smithi007.stdout:ceph source packages 2.9 kB/s | 1.9 kB 00:00 2024-09-19T08:31:51.982 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-19T08:31:51.999 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-19T08:31:55.233 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - AppStream 9.4 MB/s | 20 MB 00:02 2024-09-19T08:31:56.031 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - BaseOS 1.8 MB/s | 8.3 MB 00:04 2024-09-19T08:31:56.791 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 5.6 MB/s | 20 MB 00:03 2024-09-19T08:31:57.807 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-19T08:32:00.817 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.5 MB 00:01 2024-09-19T08:32:01.217 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-19T08:32:02.734 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-19T08:32:03.184 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 19 kB 00:01 2024-09-19T08:32:03.350 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.5 MB 00:01 2024-09-19T08:32:04.338 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-19T08:32:04.480 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-19T08:32:05.117 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-19T08:32:06.092 INFO:teuthology.orchestra.run.smithi044.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-19T08:32:09.869 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-19T08:32:10.153 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T08:32:11.744 INFO:teuthology.orchestra.run.smithi044.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-19T08:32:12.007 INFO:teuthology.orchestra.run.smithi175.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:32:12.008 INFO:teuthology.orchestra.run.smithi175.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:32:12.020 INFO:teuthology.orchestra.run.smithi175.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T08:32:12.025 INFO:teuthology.orchestra.run.smithi175.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T08:32:12.026 INFO:teuthology.orchestra.run.smithi175.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T08:32:12.026 INFO:teuthology.orchestra.run.smithi175.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T08:32:12.026 INFO:teuthology.orchestra.run.smithi175.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T08:32:12.027 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T08:32:12.028 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T08:32:12.091 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-09-19T08:32:12.118 INFO:teuthology.orchestra.run.smithi175.stdout:====================================================================================== 2024-09-19T08:32:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-09-19T08:32:12.118 INFO:teuthology.orchestra.run.smithi175.stdout:====================================================================================== 2024-09-19T08:32:12.118 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-09-19T08:32:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T08:32:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T08:32:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T08:32:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T08:32:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T08:32:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T08:32:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T08:32:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T08:32:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T08:32:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T08:32:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T08:32:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T08:32:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T08:32:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T08:32:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T08:32:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T08:32:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T08:32:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T08:32:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T08:32:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T08:32:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T08:32:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T08:32:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T08:32:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T08:32:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T08:32:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T08:32:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T08:32:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T08:32:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T08:32:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T08:32:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T08:32:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T08:32:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T08:32:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T08:32:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T08:32:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T08:32:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T08:32:12.121 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrading: 2024-09-19T08:32:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T08:32:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T08:32:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T08:32:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T08:32:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T08:32:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T08:32:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T08:32:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T08:32:12.123 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-09-19T08:32:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T08:32:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T08:32:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T08:32:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T08:32:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T08:32:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T08:32:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T08:32:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T08:32:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T08:32:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T08:32:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T08:32:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T08:32:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T08:32:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T08:32:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T08:32:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T08:32:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T08:32:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T08:32:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T08:32:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T08:32:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T08:32:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T08:32:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T08:32:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T08:32:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T08:32:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T08:32:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T08:32:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T08:32:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T08:32:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T08:32:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T08:32:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T08:32:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T08:32:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T08:32:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T08:32:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T08:32:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T08:32:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T08:32:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T08:32:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T08:32:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T08:32:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T08:32:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T08:32:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T08:32:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T08:32:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T08:32:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T08:32:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T08:32:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T08:32:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T08:32:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T08:32:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T08:32:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T08:32:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T08:32:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T08:32:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T08:32:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T08:32:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T08:32:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T08:32:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T08:32:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T08:32:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T08:32:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T08:32:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T08:32:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T08:32:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T08:32:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T08:32:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T08:32:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T08:32:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T08:32:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T08:32:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T08:32:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T08:32:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T08:32:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T08:32:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T08:32:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T08:32:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T08:32:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T08:32:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T08:32:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T08:32:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T08:32:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T08:32:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T08:32:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T08:32:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T08:32:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T08:32:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T08:32:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T08:32:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T08:32:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T08:32:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T08:32:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T08:32:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T08:32:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T08:32:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T08:32:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T08:32:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T08:32:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T08:32:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T08:32:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T08:32:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T08:32:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T08:32:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T08:32:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T08:32:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T08:32:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T08:32:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T08:32:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T08:32:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T08:32:12.132 INFO:teuthology.orchestra.run.smithi175.stdout:Installing weak dependencies: 2024-09-19T08:32:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T08:32:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:32:12.133 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-09-19T08:32:12.133 INFO:teuthology.orchestra.run.smithi175.stdout:====================================================================================== 2024-09-19T08:32:12.133 INFO:teuthology.orchestra.run.smithi175.stdout:Install 148 Packages 2024-09-19T08:32:12.133 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrade 8 Packages 2024-09-19T08:32:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:32:12.134 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 226 M 2024-09-19T08:32:12.134 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-09-19T08:32:12.432 INFO:teuthology.orchestra.run.smithi007.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:32:12.433 INFO:teuthology.orchestra.run.smithi007.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:32:12.447 INFO:teuthology.orchestra.run.smithi007.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T08:32:12.448 INFO:teuthology.orchestra.run.smithi007.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T08:32:12.449 INFO:teuthology.orchestra.run.smithi007.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T08:32:12.450 INFO:teuthology.orchestra.run.smithi007.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T08:32:12.452 INFO:teuthology.orchestra.run.smithi007.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T08:32:12.455 INFO:teuthology.orchestra.run.smithi007.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T08:32:12.456 INFO:teuthology.orchestra.run.smithi007.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T08:32:12.523 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-09-19T08:32:12.539 INFO:teuthology.orchestra.run.smithi007.stdout:====================================================================================== 2024-09-19T08:32:12.539 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2024-09-19T08:32:12.539 INFO:teuthology.orchestra.run.smithi007.stdout:====================================================================================== 2024-09-19T08:32:12.539 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2024-09-19T08:32:12.539 INFO:teuthology.orchestra.run.smithi007.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T08:32:12.539 INFO:teuthology.orchestra.run.smithi007.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T08:32:12.539 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T08:32:12.539 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T08:32:12.539 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T08:32:12.539 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T08:32:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T08:32:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T08:32:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T08:32:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T08:32:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T08:32:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T08:32:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T08:32:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T08:32:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T08:32:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T08:32:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T08:32:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T08:32:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T08:32:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T08:32:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T08:32:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T08:32:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T08:32:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T08:32:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T08:32:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T08:32:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T08:32:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T08:32:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T08:32:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T08:32:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T08:32:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T08:32:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T08:32:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T08:32:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T08:32:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T08:32:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T08:32:12.542 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrading: 2024-09-19T08:32:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T08:32:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T08:32:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T08:32:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T08:32:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T08:32:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T08:32:12.543 INFO:teuthology.orchestra.run.smithi007.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T08:32:12.543 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T08:32:12.543 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2024-09-19T08:32:12.543 INFO:teuthology.orchestra.run.smithi007.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T08:32:12.543 INFO:teuthology.orchestra.run.smithi007.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T08:32:12.543 INFO:teuthology.orchestra.run.smithi007.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T08:32:12.543 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T08:32:12.543 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T08:32:12.543 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T08:32:12.543 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T08:32:12.543 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T08:32:12.543 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T08:32:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T08:32:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T08:32:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T08:32:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T08:32:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T08:32:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T08:32:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T08:32:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T08:32:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T08:32:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T08:32:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T08:32:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T08:32:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T08:32:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T08:32:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T08:32:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T08:32:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T08:32:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T08:32:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T08:32:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T08:32:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T08:32:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T08:32:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T08:32:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T08:32:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T08:32:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T08:32:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T08:32:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T08:32:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T08:32:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T08:32:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T08:32:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T08:32:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T08:32:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T08:32:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T08:32:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T08:32:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T08:32:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T08:32:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T08:32:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T08:32:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T08:32:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T08:32:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T08:32:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T08:32:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T08:32:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T08:32:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T08:32:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T08:32:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T08:32:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T08:32:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T08:32:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T08:32:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T08:32:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T08:32:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T08:32:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T08:32:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T08:32:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T08:32:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T08:32:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T08:32:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T08:32:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T08:32:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T08:32:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T08:32:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T08:32:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T08:32:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T08:32:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T08:32:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T08:32:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T08:32:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T08:32:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T08:32:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T08:32:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T08:32:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T08:32:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T08:32:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T08:32:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T08:32:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T08:32:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T08:32:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T08:32:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T08:32:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T08:32:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T08:32:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T08:32:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T08:32:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T08:32:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T08:32:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T08:32:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T08:32:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T08:32:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T08:32:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T08:32:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T08:32:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T08:32:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T08:32:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T08:32:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T08:32:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T08:32:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T08:32:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T08:32:12.552 INFO:teuthology.orchestra.run.smithi007.stdout:Installing weak dependencies: 2024-09-19T08:32:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T08:32:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:32:12.552 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2024-09-19T08:32:12.553 INFO:teuthology.orchestra.run.smithi007.stdout:====================================================================================== 2024-09-19T08:32:12.553 INFO:teuthology.orchestra.run.smithi007.stdout:Install 148 Packages 2024-09-19T08:32:12.553 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrade 8 Packages 2024-09-19T08:32:12.553 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:32:12.553 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 226 M 2024-09-19T08:32:12.554 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2024-09-19T08:32:12.994 INFO:teuthology.orchestra.run.smithi175.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 18 kB/s | 6.6 kB 00:00 2024-09-19T08:32:13.604 INFO:teuthology.orchestra.run.smithi007.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 20 kB/s | 6.6 kB 00:00 2024-09-19T08:32:13.870 INFO:teuthology.orchestra.run.smithi175.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 1.0 MB/s | 896 kB 00:00 2024-09-19T08:32:14.016 INFO:teuthology.orchestra.run.smithi044.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:32:14.016 INFO:teuthology.orchestra.run.smithi044.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:32:14.030 INFO:teuthology.orchestra.run.smithi044.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T08:32:14.031 INFO:teuthology.orchestra.run.smithi044.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T08:32:14.032 INFO:teuthology.orchestra.run.smithi044.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T08:32:14.033 INFO:teuthology.orchestra.run.smithi044.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T08:32:14.035 INFO:teuthology.orchestra.run.smithi044.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T08:32:14.038 INFO:teuthology.orchestra.run.smithi044.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T08:32:14.039 INFO:teuthology.orchestra.run.smithi044.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T08:32:14.106 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-19T08:32:14.195 INFO:teuthology.orchestra.run.smithi175.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 447 kB/s | 145 kB 00:00 2024-09-19T08:32:14.217 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================== 2024-09-19T08:32:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-09-19T08:32:14.217 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================== 2024-09-19T08:32:14.217 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-19T08:32:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T08:32:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T08:32:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T08:32:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T08:32:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T08:32:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T08:32:14.217 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T08:32:14.218 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T08:32:14.218 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T08:32:14.218 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T08:32:14.218 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T08:32:14.218 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T08:32:14.218 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T08:32:14.218 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T08:32:14.218 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T08:32:14.218 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T08:32:14.218 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T08:32:14.218 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T08:32:14.219 INFO:teuthology.orchestra.run.smithi044.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T08:32:14.219 INFO:teuthology.orchestra.run.smithi044.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T08:32:14.219 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T08:32:14.219 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T08:32:14.219 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T08:32:14.219 INFO:teuthology.orchestra.run.smithi044.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T08:32:14.219 INFO:teuthology.orchestra.run.smithi044.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T08:32:14.219 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T08:32:14.219 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T08:32:14.219 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T08:32:14.219 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T08:32:14.219 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T08:32:14.220 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T08:32:14.220 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T08:32:14.220 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T08:32:14.220 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T08:32:14.220 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T08:32:14.220 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T08:32:14.220 INFO:teuthology.orchestra.run.smithi044.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T08:32:14.220 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrading: 2024-09-19T08:32:14.220 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T08:32:14.220 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T08:32:14.220 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T08:32:14.220 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T08:32:14.221 INFO:teuthology.orchestra.run.smithi044.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T08:32:14.221 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T08:32:14.221 INFO:teuthology.orchestra.run.smithi044.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T08:32:14.221 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T08:32:14.221 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-09-19T08:32:14.221 INFO:teuthology.orchestra.run.smithi044.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T08:32:14.221 INFO:teuthology.orchestra.run.smithi044.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T08:32:14.221 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T08:32:14.221 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T08:32:14.221 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T08:32:14.221 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T08:32:14.222 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T08:32:14.222 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T08:32:14.222 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T08:32:14.222 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T08:32:14.222 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T08:32:14.222 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T08:32:14.222 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T08:32:14.222 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T08:32:14.222 INFO:teuthology.orchestra.run.smithi044.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T08:32:14.222 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T08:32:14.222 INFO:teuthology.orchestra.run.smithi044.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T08:32:14.222 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T08:32:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T08:32:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T08:32:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T08:32:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T08:32:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T08:32:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T08:32:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T08:32:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T08:32:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T08:32:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T08:32:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T08:32:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T08:32:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T08:32:14.223 INFO:teuthology.orchestra.run.smithi044.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T08:32:14.224 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T08:32:14.224 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T08:32:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T08:32:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T08:32:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T08:32:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T08:32:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T08:32:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T08:32:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T08:32:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T08:32:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T08:32:14.227 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T08:32:14.228 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T08:32:14.228 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T08:32:14.228 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T08:32:14.228 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T08:32:14.228 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T08:32:14.228 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T08:32:14.228 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T08:32:14.228 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T08:32:14.228 INFO:teuthology.orchestra.run.smithi044.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T08:32:14.228 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T08:32:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T08:32:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T08:32:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T08:32:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T08:32:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T08:32:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T08:32:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T08:32:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T08:32:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T08:32:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T08:32:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T08:32:14.229 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T08:32:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T08:32:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T08:32:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T08:32:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T08:32:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T08:32:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T08:32:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T08:32:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T08:32:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T08:32:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T08:32:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T08:32:14.230 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T08:32:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T08:32:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T08:32:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T08:32:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T08:32:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T08:32:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T08:32:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T08:32:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T08:32:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T08:32:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T08:32:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T08:32:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T08:32:14.231 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T08:32:14.232 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T08:32:14.232 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T08:32:14.232 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T08:32:14.232 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T08:32:14.232 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T08:32:14.232 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T08:32:14.232 INFO:teuthology.orchestra.run.smithi044.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T08:32:14.232 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T08:32:14.232 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T08:32:14.232 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T08:32:14.232 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T08:32:14.232 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T08:32:14.233 INFO:teuthology.orchestra.run.smithi044.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T08:32:14.233 INFO:teuthology.orchestra.run.smithi044.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T08:32:14.233 INFO:teuthology.orchestra.run.smithi044.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T08:32:14.233 INFO:teuthology.orchestra.run.smithi044.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T08:32:14.233 INFO:teuthology.orchestra.run.smithi044.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T08:32:14.233 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T08:32:14.233 INFO:teuthology.orchestra.run.smithi044.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T08:32:14.233 INFO:teuthology.orchestra.run.smithi044.stdout:Installing weak dependencies: 2024-09-19T08:32:14.233 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T08:32:14.233 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-19T08:32:14.233 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-19T08:32:14.233 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================== 2024-09-19T08:32:14.233 INFO:teuthology.orchestra.run.smithi044.stdout:Install 148 Packages 2024-09-19T08:32:14.234 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrade 8 Packages 2024-09-19T08:32:14.234 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-19T08:32:14.234 INFO:teuthology.orchestra.run.smithi007.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 1.4 MB/s | 896 kB 00:00 2024-09-19T08:32:14.235 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 226 M 2024-09-19T08:32:14.235 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-19T08:32:14.313 INFO:teuthology.orchestra.run.smithi007.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.6 MB/s | 145 kB 00:00 2024-09-19T08:32:14.888 INFO:teuthology.orchestra.run.smithi007.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 3.3 MB/s | 5.4 MB 00:01 2024-09-19T08:32:15.221 INFO:teuthology.orchestra.run.smithi007.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 4.6 MB/s | 1.5 MB 00:00 2024-09-19T08:32:15.245 INFO:teuthology.orchestra.run.smithi044.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 19 kB/s | 6.6 kB 00:00 2024-09-19T08:32:15.263 INFO:teuthology.orchestra.run.smithi007.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 2.5 MB/s | 2.4 MB 00:00 2024-09-19T08:32:15.453 INFO:teuthology.orchestra.run.smithi175.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 1.9 MB/s | 5.4 MB 00:02 2024-09-19T08:32:16.006 INFO:teuthology.orchestra.run.smithi007.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 6.0 MB/s | 4.7 MB 00:00 2024-09-19T08:32:16.137 INFO:teuthology.orchestra.run.smithi044.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 1.0 MB/s | 896 kB 00:00 2024-09-19T08:32:16.165 INFO:teuthology.orchestra.run.smithi175.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 2.1 MB/s | 1.5 MB 00:00 2024-09-19T08:32:16.239 INFO:teuthology.orchestra.run.smithi175.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 1.2 MB/s | 2.4 MB 00:02 2024-09-19T08:32:16.305 INFO:teuthology.orchestra.run.smithi044.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 872 kB/s | 145 kB 00:00 2024-09-19T08:32:17.656 INFO:teuthology.orchestra.run.smithi007.stdout:(8/156): ceph-radosgw-19.1.1-361.g2f599a46.el9. 6.4 MB/s | 11 MB 00:01 2024-09-19T08:32:17.671 INFO:teuthology.orchestra.run.smithi044.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 2.0 MB/s | 5.4 MB 00:02 2024-09-19T08:32:17.722 INFO:teuthology.orchestra.run.smithi007.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 379 kB/s | 25 kB 00:00 2024-09-19T08:32:17.996 INFO:teuthology.orchestra.run.smithi044.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 1.4 MB/s | 2.4 MB 00:01 2024-09-19T08:32:18.196 INFO:teuthology.orchestra.run.smithi044.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 1.5 MB 00:00 2024-09-19T08:32:18.231 INFO:teuthology.orchestra.run.smithi007.stdout:(10/156): ceph-common-19.1.1-361.g2f599a46.el9. 4.3 MB/s | 21 MB 00:04 2024-09-19T08:32:18.398 INFO:teuthology.orchestra.run.smithi007.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 1.3 MB/s | 228 kB 00:00 2024-09-19T08:32:18.490 INFO:teuthology.orchestra.run.smithi007.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 295 kB/s | 27 kB 00:00 2024-09-19T08:32:18.570 INFO:teuthology.orchestra.run.smithi175.stdout:(7/156): ceph-common-19.1.1-361.g2f599a46.el9.x 3.6 MB/s | 21 MB 00:05 2024-09-19T08:32:18.573 INFO:teuthology.orchestra.run.smithi007.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 382 kB/s | 32 kB 00:00 2024-09-19T08:32:18.646 INFO:teuthology.orchestra.run.smithi175.stdout:(8/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 1.9 MB/s | 4.7 MB 00:02 2024-09-19T08:32:18.737 INFO:teuthology.orchestra.run.smithi175.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 275 kB/s | 25 kB 00:00 2024-09-19T08:32:18.824 INFO:teuthology.orchestra.run.smithi007.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 2.9 MB/s | 751 kB 00:00 2024-09-19T08:32:18.924 INFO:teuthology.orchestra.run.smithi007.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.6 MB/s | 163 kB 00:00 2024-09-19T08:32:19.024 INFO:teuthology.orchestra.run.smithi007.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.2 MB/s | 127 kB 00:00 2024-09-19T08:32:19.283 INFO:teuthology.orchestra.run.smithi007.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 1.9 MB/s | 506 kB 00:00 2024-09-19T08:32:19.922 INFO:teuthology.orchestra.run.smithi044.stdout:(7/156): ceph-common-19.1.1-361.g2f599a46.el9.x 4.2 MB/s | 21 MB 00:05 2024-09-19T08:32:20.099 INFO:teuthology.orchestra.run.smithi007.stdout:(18/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 3.5 MB/s | 17 MB 00:04 2024-09-19T08:32:20.191 INFO:teuthology.orchestra.run.smithi007.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 493 kB/s | 45 kB 00:00 2024-09-19T08:32:20.292 INFO:teuthology.orchestra.run.smithi007.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.3 MB/s | 136 kB 00:00 2024-09-19T08:32:20.392 INFO:teuthology.orchestra.run.smithi007.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.6 MB/s | 161 kB 00:00 2024-09-19T08:32:20.567 INFO:teuthology.orchestra.run.smithi007.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 1.8 MB/s | 320 kB 00:00 2024-09-19T08:32:20.751 INFO:teuthology.orchestra.run.smithi007.stdout:(23/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 3.6 MB/s | 5.3 MB 00:01 2024-09-19T08:32:20.776 INFO:teuthology.orchestra.run.smithi007.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 1.4 MB/s | 300 kB 00:00 2024-09-19T08:32:20.843 INFO:teuthology.orchestra.run.smithi007.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.1 MB/s | 99 kB 00:00 2024-09-19T08:32:20.860 INFO:teuthology.orchestra.run.smithi007.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.0 MB/s | 85 kB 00:00 2024-09-19T08:32:20.953 INFO:teuthology.orchestra.run.smithi007.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 1.8 MB/s | 171 kB 00:00 2024-09-19T08:32:21.044 INFO:teuthology.orchestra.run.smithi007.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 346 kB/s | 32 kB 00:00 2024-09-19T08:32:21.072 INFO:teuthology.orchestra.run.smithi044.stdout:(8/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 1.5 MB/s | 4.7 MB 00:03 2024-09-19T08:32:21.128 INFO:teuthology.orchestra.run.smithi007.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.7 MB/s | 146 kB 00:00 2024-09-19T08:32:21.189 INFO:teuthology.orchestra.run.smithi044.stdout:(9/156): ceph-radosgw-19.1.1-361.g2f599a46.el9. 8.4 MB/s | 11 MB 00:01 2024-09-19T08:32:21.232 INFO:teuthology.orchestra.run.smithi044.stdout:(10/156): ceph-selinux-19.1.1-361.g2f599a46.el9 157 kB/s | 25 kB 00:00 2024-09-19T08:32:21.489 INFO:teuthology.orchestra.run.smithi044.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 890 kB/s | 228 kB 00:00 2024-09-19T08:32:21.589 INFO:teuthology.orchestra.run.smithi044.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 270 kB/s | 27 kB 00:00 2024-09-19T08:32:21.669 INFO:teuthology.orchestra.run.smithi007.stdout:(30/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 3.8 MB/s | 3.1 MB 00:00 2024-09-19T08:32:21.681 INFO:teuthology.orchestra.run.smithi044.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 346 kB/s | 32 kB 00:00 2024-09-19T08:32:22.112 INFO:teuthology.orchestra.run.smithi175.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 3.0 MB/s | 11 MB 00:03 2024-09-19T08:32:22.178 INFO:teuthology.orchestra.run.smithi007.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 3.4 MB/s | 3.6 MB 00:01 2024-09-19T08:32:22.221 INFO:teuthology.orchestra.run.smithi175.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 2.1 MB/s | 228 kB 00:00 2024-09-19T08:32:22.231 INFO:teuthology.orchestra.run.smithi044.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 1.3 MB/s | 751 kB 00:00 2024-09-19T08:32:22.278 INFO:teuthology.orchestra.run.smithi007.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.4 MB/s | 249 kB 00:00 2024-09-19T08:32:22.313 INFO:teuthology.orchestra.run.smithi175.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 296 kB/s | 27 kB 00:00 2024-09-19T08:32:22.370 INFO:teuthology.orchestra.run.smithi007.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 538 kB/s | 49 kB 00:00 2024-09-19T08:32:22.413 INFO:teuthology.orchestra.run.smithi175.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 316 kB/s | 32 kB 00:00 2024-09-19T08:32:22.415 INFO:teuthology.orchestra.run.smithi044.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 893 kB/s | 163 kB 00:00 2024-09-19T08:32:22.462 INFO:teuthology.orchestra.run.smithi007.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 179 kB/s | 16 kB 00:00 2024-09-19T08:32:22.590 INFO:teuthology.orchestra.run.smithi044.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 725 kB/s | 127 kB 00:00 2024-09-19T08:32:22.646 INFO:teuthology.orchestra.run.smithi007.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 1.5 MB/s | 285 kB 00:00 2024-09-19T08:32:22.730 INFO:teuthology.orchestra.run.smithi175.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 2.3 MB/s | 751 kB 00:00 2024-09-19T08:32:22.838 INFO:teuthology.orchestra.run.smithi175.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.5 MB/s | 163 kB 00:00 2024-09-19T08:32:22.913 INFO:teuthology.orchestra.run.smithi007.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 2.8 MB/s | 765 kB 00:00 2024-09-19T08:32:22.980 INFO:teuthology.orchestra.run.smithi175.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 895 kB/s | 127 kB 00:00 2024-09-19T08:32:22.990 INFO:teuthology.orchestra.run.smithi044.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 1.2 MB/s | 506 kB 00:00 2024-09-19T08:32:23.005 INFO:teuthology.orchestra.run.smithi007.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 199 kB/s | 18 kB 00:00 2024-09-19T08:32:23.147 INFO:teuthology.orchestra.run.smithi007.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 563 kB/s | 80 kB 00:00 2024-09-19T08:32:23.222 INFO:teuthology.orchestra.run.smithi175.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 2.0 MB/s | 506 kB 00:00 2024-09-19T08:32:23.289 INFO:teuthology.orchestra.run.smithi007.stdout:(39/156): libgfortran-11.5.0-2.el9.x86_64.rpm 5.5 MB/s | 801 kB 00:00 2024-09-19T08:32:23.348 INFO:teuthology.orchestra.run.smithi007.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T08:32:23.366 INFO:teuthology.orchestra.run.smithi044.stdout:(18/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 3.3 MB/s | 17 MB 00:05 2024-09-19T08:32:23.407 INFO:teuthology.orchestra.run.smithi007.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.3 MB/s | 253 kB 00:00 2024-09-19T08:32:23.466 INFO:teuthology.orchestra.run.smithi044.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 451 kB/s | 45 kB 00:00 2024-09-19T08:32:23.498 INFO:teuthology.orchestra.run.smithi007.stdout:(42/156): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.2 MB 00:00 2024-09-19T08:32:23.548 INFO:teuthology.orchestra.run.smithi007.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-19T08:32:23.567 INFO:teuthology.orchestra.run.smithi044.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.3 MB/s | 136 kB 00:00 2024-09-19T08:32:23.649 INFO:teuthology.orchestra.run.smithi007.stdout:(44/156): ceph-mgr-diskprediction-local-19.1.1- 3.7 MB/s | 7.4 MB 00:01 2024-09-19T08:32:23.667 INFO:teuthology.orchestra.run.smithi044.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.6 MB/s | 161 kB 00:00 2024-09-19T08:32:23.757 INFO:teuthology.orchestra.run.smithi007.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 647 kB/s | 135 kB 00:00 2024-09-19T08:32:23.808 INFO:teuthology.orchestra.run.smithi007.stdout:(46/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T08:32:23.833 INFO:teuthology.orchestra.run.smithi007.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 679 kB/s | 125 kB 00:00 2024-09-19T08:32:23.834 INFO:teuthology.orchestra.run.smithi044.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 1.9 MB/s | 320 kB 00:00 2024-09-19T08:32:23.984 INFO:teuthology.orchestra.run.smithi044.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 2.0 MB/s | 300 kB 00:00 2024-09-19T08:32:24.067 INFO:teuthology.orchestra.run.smithi044.stdout:(24/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.2 MB/s | 99 kB 00:00 2024-09-19T08:32:24.152 INFO:teuthology.orchestra.run.smithi044.stdout:(25/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.0 MB/s | 85 kB 00:00 2024-09-19T08:32:24.283 INFO:teuthology.orchestra.run.smithi007.stdout:(48/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 7.4 MB/s | 49 MB 00:06 2024-09-19T08:32:24.417 INFO:teuthology.orchestra.run.smithi007.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 803 kB/s | 107 kB 00:00 2024-09-19T08:32:24.501 INFO:teuthology.orchestra.run.smithi007.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 260 kB/s | 22 kB 00:00 2024-09-19T08:32:24.609 INFO:teuthology.orchestra.run.smithi007.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 860 kB/s | 689 kB 00:00 2024-09-19T08:32:24.634 INFO:teuthology.orchestra.run.smithi007.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-09-19T08:32:24.660 INFO:teuthology.orchestra.run.smithi007.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-09-19T08:32:24.710 INFO:teuthology.orchestra.run.smithi007.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-09-19T08:32:24.731 INFO:teuthology.orchestra.run.smithi175.stdout:(18/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 3.5 MB/s | 5.3 MB 00:01 2024-09-19T08:32:24.760 INFO:teuthology.orchestra.run.smithi007.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-19T08:32:24.786 INFO:teuthology.orchestra.run.smithi007.stdout:(56/156): bison-3.7.4-5.el9.x86_64.rpm 990 kB/s | 943 kB 00:00 2024-09-19T08:32:24.823 INFO:teuthology.orchestra.run.smithi175.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 493 kB/s | 45 kB 00:00 2024-09-19T08:32:24.836 INFO:teuthology.orchestra.run.smithi007.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 908 kB/s | 45 kB 00:00 2024-09-19T08:32:24.861 INFO:teuthology.orchestra.run.smithi007.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-09-19T08:32:24.914 INFO:teuthology.orchestra.run.smithi175.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.5 MB/s | 136 kB 00:00 2024-09-19T08:32:24.993 INFO:teuthology.orchestra.run.smithi044.stdout:(26/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 3.7 MB/s | 3.1 MB 00:00 2024-09-19T08:32:24.998 INFO:teuthology.orchestra.run.smithi175.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.9 MB/s | 161 kB 00:00 2024-09-19T08:32:25.077 INFO:teuthology.orchestra.run.smithi044.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.0 MB/s | 171 kB 00:00 2024-09-19T08:32:25.148 INFO:teuthology.orchestra.run.smithi175.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 2.1 MB/s | 320 kB 00:00 2024-09-19T08:32:25.160 INFO:teuthology.orchestra.run.smithi044.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 381 kB/s | 32 kB 00:00 2024-09-19T08:32:25.161 INFO:teuthology.orchestra.run.smithi007.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 1.9 MB/s | 581 kB 00:00 2024-09-19T08:32:25.252 INFO:teuthology.orchestra.run.smithi044.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.6 MB/s | 146 kB 00:00 2024-09-19T08:32:25.253 INFO:teuthology.orchestra.run.smithi007.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 268 kB/s | 24 kB 00:00 2024-09-19T08:32:25.299 INFO:teuthology.orchestra.run.smithi175.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 2.0 MB/s | 300 kB 00:00 2024-09-19T08:32:25.321 INFO:teuthology.orchestra.run.smithi007.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 1.3 MB/s | 662 kB 00:00 2024-09-19T08:32:25.346 INFO:teuthology.orchestra.run.smithi007.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 516 kB/s | 47 kB 00:00 2024-09-19T08:32:25.382 INFO:teuthology.orchestra.run.smithi175.stdout:(24/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.2 MB/s | 99 kB 00:00 2024-09-19T08:32:25.429 INFO:teuthology.orchestra.run.smithi007.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-19T08:32:25.457 INFO:teuthology.orchestra.run.smithi175.stdout:(25/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-19T08:32:25.488 INFO:teuthology.orchestra.run.smithi007.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-09-19T08:32:25.505 INFO:teuthology.orchestra.run.smithi007.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 511 kB/s | 38 kB 00:00 2024-09-19T08:32:25.847 INFO:teuthology.orchestra.run.smithi007.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.5 MB/s | 3.0 MB 00:01 2024-09-19T08:32:25.861 INFO:teuthology.orchestra.run.smithi044.stdout:(30/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 10 MB/s | 49 MB 00:04 2024-09-19T08:32:25.936 INFO:teuthology.orchestra.run.smithi044.stdout:(31/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 1.8 MB/s | 5.3 MB 00:02 2024-09-19T08:32:25.991 INFO:teuthology.orchestra.run.smithi175.stdout:(26/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 5.8 MB/s | 3.1 MB 00:00 2024-09-19T08:32:26.066 INFO:teuthology.orchestra.run.smithi175.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.2 MB/s | 171 kB 00:00 2024-09-19T08:32:26.112 INFO:teuthology.orchestra.run.smithi044.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 1.4 MB/s | 249 kB 00:00 2024-09-19T08:32:26.133 INFO:teuthology.orchestra.run.smithi175.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 479 kB/s | 32 kB 00:00 2024-09-19T08:32:26.170 INFO:teuthology.orchestra.run.smithi044.stdout:(33/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 3.9 MB/s | 3.6 MB 00:00 2024-09-19T08:32:26.181 INFO:teuthology.orchestra.run.smithi007.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 4.8 MB/s | 1.6 MB 00:00 2024-09-19T08:32:26.192 INFO:teuthology.orchestra.run.smithi175.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.4 MB/s | 146 kB 00:00 2024-09-19T08:32:26.195 INFO:teuthology.orchestra.run.smithi044.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 591 kB/s | 49 kB 00:00 2024-09-19T08:32:26.245 INFO:teuthology.orchestra.run.smithi044.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 219 kB/s | 16 kB 00:00 2024-09-19T08:32:26.313 INFO:teuthology.orchestra.run.smithi044.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 2.4 MB/s | 285 kB 00:00 2024-09-19T08:32:26.365 INFO:teuthology.orchestra.run.smithi007.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 4.8 MB/s | 910 kB 00:00 2024-09-19T08:32:26.454 INFO:teuthology.orchestra.run.smithi044.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 12 MB/s | 7.4 MB 00:00 2024-09-19T08:32:26.456 INFO:teuthology.orchestra.run.smithi007.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.7 MB/s | 4.4 MB 00:00 2024-09-19T08:32:26.479 INFO:teuthology.orchestra.run.smithi044.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 109 kB/s | 18 kB 00:00 2024-09-19T08:32:26.481 INFO:teuthology.orchestra.run.smithi007.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-19T08:32:26.513 INFO:teuthology.orchestra.run.smithi044.stdout:(39/156): cephadm-19.1.1-361.g2f599a46.el9.noar 2.8 MB/s | 765 kB 00:00 2024-09-19T08:32:26.622 INFO:teuthology.orchestra.run.smithi044.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-09-19T08:32:26.647 INFO:teuthology.orchestra.run.smithi044.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-19T08:32:26.656 INFO:teuthology.orchestra.run.smithi007.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 5.8 MB/s | 1.0 MB 00:00 2024-09-19T08:32:26.675 INFO:teuthology.orchestra.run.smithi175.stdout:(30/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 1.6 MB/s | 17 MB 00:10 2024-09-19T08:32:26.689 INFO:teuthology.orchestra.run.smithi044.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 801 kB 00:00 2024-09-19T08:32:26.715 INFO:teuthology.orchestra.run.smithi007.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-19T08:32:26.722 INFO:teuthology.orchestra.run.smithi044.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-09-19T08:32:26.764 INFO:teuthology.orchestra.run.smithi044.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-19T08:32:26.790 INFO:teuthology.orchestra.run.smithi044.stdout:(45/156): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-09-19T08:32:26.815 INFO:teuthology.orchestra.run.smithi044.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-19T08:32:26.817 INFO:teuthology.orchestra.run.smithi175.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 5.7 MB/s | 3.6 MB 00:00 2024-09-19T08:32:26.840 INFO:teuthology.orchestra.run.smithi044.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-19T08:32:26.865 INFO:teuthology.orchestra.run.smithi044.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-19T08:32:26.867 INFO:teuthology.orchestra.run.smithi175.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 4.9 MB/s | 249 kB 00:00 2024-09-19T08:32:26.907 INFO:teuthology.orchestra.run.smithi007.stdout:(73/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.5 MB/s | 4.9 MB 00:01 2024-09-19T08:32:26.917 INFO:teuthology.orchestra.run.smithi175.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 986 kB/s | 49 kB 00:00 2024-09-19T08:32:26.966 INFO:teuthology.orchestra.run.smithi007.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-19T08:32:26.968 INFO:teuthology.orchestra.run.smithi175.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 329 kB/s | 16 kB 00:00 2024-09-19T08:32:27.035 INFO:teuthology.orchestra.run.smithi175.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 4.2 MB/s | 285 kB 00:00 2024-09-19T08:32:27.058 INFO:teuthology.orchestra.run.smithi007.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-19T08:32:27.135 INFO:teuthology.orchestra.run.smithi175.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 7.5 MB/s | 765 kB 00:00 2024-09-19T08:32:27.175 INFO:teuthology.orchestra.run.smithi007.stdout:(76/156): postgresql-server-13.16-1.el9.x86_64. 8.0 MB/s | 5.8 MB 00:00 2024-09-19T08:32:27.177 INFO:teuthology.orchestra.run.smithi175.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 437 kB/s | 18 kB 00:00 2024-09-19T08:32:27.217 INFO:teuthology.orchestra.run.smithi007.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-09-19T08:32:27.242 INFO:teuthology.orchestra.run.smithi007.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 385 kB/s | 26 kB 00:00 2024-09-19T08:32:27.267 INFO:teuthology.orchestra.run.smithi007.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-19T08:32:27.293 INFO:teuthology.orchestra.run.smithi007.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-19T08:32:27.294 INFO:teuthology.orchestra.run.smithi175.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 686 kB/s | 80 kB 00:00 2024-09-19T08:32:27.318 INFO:teuthology.orchestra.run.smithi007.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-09-19T08:32:27.333 INFO:teuthology.orchestra.run.smithi044.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 229 kB/s | 107 kB 00:00 2024-09-19T08:32:27.401 INFO:teuthology.orchestra.run.smithi007.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-19T08:32:27.411 INFO:teuthology.orchestra.run.smithi175.stdout:(39/156): libgfortran-11.5.0-2.el9.x86_64.rpm 6.7 MB/s | 801 kB 00:00 2024-09-19T08:32:27.441 INFO:teuthology.orchestra.run.smithi044.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-19T08:32:27.460 INFO:teuthology.orchestra.run.smithi007.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-19T08:32:27.478 INFO:teuthology.orchestra.run.smithi175.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-19T08:32:27.519 INFO:teuthology.orchestra.run.smithi007.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-19T08:32:27.553 INFO:teuthology.orchestra.run.smithi175.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-19T08:32:27.627 INFO:teuthology.orchestra.run.smithi007.stdout:(85/156): python3-babel-2.9.1-2.el9.noarch.rpm 6.5 MB/s | 6.0 MB 00:00 2024-09-19T08:32:27.637 INFO:teuthology.orchestra.run.smithi175.stdout:(42/156): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-09-19T08:32:27.652 INFO:teuthology.orchestra.run.smithi007.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 316 kB/s | 42 kB 00:00 2024-09-19T08:32:27.686 INFO:teuthology.orchestra.run.smithi007.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-19T08:32:27.711 INFO:teuthology.orchestra.run.smithi007.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-19T08:32:27.745 INFO:teuthology.orchestra.run.smithi007.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-19T08:32:27.758 INFO:teuthology.orchestra.run.smithi044.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-19T08:32:27.762 INFO:teuthology.orchestra.run.smithi175.stdout:(43/156): ceph-mgr-diskprediction-local-19.1.1- 6.8 MB/s | 7.4 MB 00:01 2024-09-19T08:32:27.770 INFO:teuthology.orchestra.run.smithi007.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 871 kB/s | 51 kB 00:00 2024-09-19T08:32:27.788 INFO:teuthology.orchestra.run.smithi175.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 709 kB/s | 106 kB 00:00 2024-09-19T08:32:27.804 INFO:teuthology.orchestra.run.smithi007.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 915 kB/s | 54 kB 00:00 2024-09-19T08:32:27.817 INFO:teuthology.orchestra.run.smithi044.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 835 kB/s | 313 kB 00:00 2024-09-19T08:32:27.846 INFO:teuthology.orchestra.run.smithi175.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-19T08:32:27.858 INFO:teuthology.orchestra.run.smithi044.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 326 kB/s | 33 kB 00:00 2024-09-19T08:32:27.897 INFO:teuthology.orchestra.run.smithi175.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 135 kB 00:00 2024-09-19T08:32:27.904 INFO:teuthology.orchestra.run.smithi007.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.3 MB/s | 5.1 MB 00:00 2024-09-19T08:32:27.922 INFO:teuthology.orchestra.run.smithi175.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-19T08:32:27.929 INFO:teuthology.orchestra.run.smithi007.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 333 kB/s | 42 kB 00:00 2024-09-19T08:32:27.955 INFO:teuthology.orchestra.run.smithi007.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 876 kB/s | 44 kB 00:00 2024-09-19T08:32:27.959 INFO:teuthology.orchestra.run.smithi044.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 182 kB/s | 18 kB 00:00 2024-09-19T08:32:27.980 INFO:teuthology.orchestra.run.smithi007.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-19T08:32:28.005 INFO:teuthology.orchestra.run.smithi007.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-09-19T08:32:28.031 INFO:teuthology.orchestra.run.smithi007.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-19T08:32:28.081 INFO:teuthology.orchestra.run.smithi007.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T08:32:28.109 INFO:teuthology.orchestra.run.smithi044.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 74 kB/s | 11 kB 00:00 2024-09-19T08:32:28.115 INFO:teuthology.orchestra.run.smithi007.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-09-19T08:32:28.140 INFO:teuthology.orchestra.run.smithi007.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-19T08:32:28.173 INFO:teuthology.orchestra.run.smithi007.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-19T08:32:28.199 INFO:teuthology.orchestra.run.smithi007.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 767 kB/s | 45 kB 00:00 2024-09-19T08:32:28.226 INFO:teuthology.orchestra.run.smithi044.stdout:(56/156): automake-1.16.2-8.el9.noarch.rpm 488 kB/s | 689 kB 00:01 2024-09-19T08:32:28.251 INFO:teuthology.orchestra.run.smithi044.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-09-19T08:32:28.307 INFO:teuthology.orchestra.run.smithi007.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-09-19T08:32:28.335 INFO:teuthology.orchestra.run.smithi044.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-19T08:32:28.383 INFO:teuthology.orchestra.run.smithi007.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-19T08:32:28.416 INFO:teuthology.orchestra.run.smithi007.stdout:(105/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.9 MB/s | 863 kB 00:00 2024-09-19T08:32:28.450 INFO:teuthology.orchestra.run.smithi007.stdout:(106/156): gperftools-libs-2.9.1-3.el9.x86_64.r 4.5 MB/s | 308 kB 00:00 2024-09-19T08:32:28.467 INFO:teuthology.orchestra.run.smithi007.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 388 kB/s | 19 kB 00:00 2024-09-19T08:32:28.484 INFO:teuthology.orchestra.run.smithi007.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-19T08:32:28.501 INFO:teuthology.orchestra.run.smithi007.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-19T08:32:28.526 INFO:teuthology.orchestra.run.smithi007.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T08:32:28.552 INFO:teuthology.orchestra.run.smithi044.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.1 MB/s | 3.0 MB 00:00 2024-09-19T08:32:28.555 INFO:teuthology.orchestra.run.smithi175.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 1.0 MB/s | 689 kB 00:00 2024-09-19T08:32:28.560 INFO:teuthology.orchestra.run.smithi007.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-19T08:32:28.577 INFO:teuthology.orchestra.run.smithi044.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.0 MB/s | 662 kB 00:00 2024-09-19T08:32:28.610 INFO:teuthology.orchestra.run.smithi007.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-19T08:32:28.652 INFO:teuthology.orchestra.run.smithi007.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-19T08:32:28.669 INFO:teuthology.orchestra.run.smithi044.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 209 kB/s | 24 kB 00:00 2024-09-19T08:32:28.677 INFO:teuthology.orchestra.run.smithi007.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T08:32:28.689 INFO:teuthology.orchestra.run.smithi175.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 1.2 MB/s | 943 kB 00:00 2024-09-19T08:32:28.694 INFO:teuthology.orchestra.run.smithi044.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 405 kB/s | 47 kB 00:00 2024-09-19T08:32:28.703 INFO:teuthology.orchestra.run.smithi007.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T08:32:28.714 INFO:teuthology.orchestra.run.smithi175.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 675 kB/s | 107 kB 00:00 2024-09-19T08:32:28.728 INFO:teuthology.orchestra.run.smithi007.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-19T08:32:28.756 INFO:teuthology.orchestra.run.smithi175.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 325 kB/s | 22 kB 00:00 2024-09-19T08:32:28.761 INFO:teuthology.orchestra.run.smithi007.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 5.1 MB/s | 172 kB 00:00 2024-09-19T08:32:28.786 INFO:teuthology.orchestra.run.smithi044.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-19T08:32:28.795 INFO:teuthology.orchestra.run.smithi007.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-19T08:32:28.811 INFO:teuthology.orchestra.run.smithi044.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-19T08:32:28.831 INFO:teuthology.orchestra.run.smithi175.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 436 kB/s | 33 kB 00:00 2024-09-19T08:32:28.862 INFO:teuthology.orchestra.run.smithi007.stdout:(119/156): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-19T08:32:28.888 INFO:teuthology.orchestra.run.smithi007.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-09-19T08:32:28.895 INFO:teuthology.orchestra.run.smithi044.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 354 kB/s | 38 kB 00:00 2024-09-19T08:32:28.913 INFO:teuthology.orchestra.run.smithi007.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T08:32:28.940 INFO:teuthology.orchestra.run.smithi175.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 1.4 MB/s | 313 kB 00:00 2024-09-19T08:32:28.947 INFO:teuthology.orchestra.run.smithi007.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-19T08:32:28.972 INFO:teuthology.orchestra.run.smithi007.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-19T08:32:28.997 INFO:teuthology.orchestra.run.smithi007.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-19T08:32:29.023 INFO:teuthology.orchestra.run.smithi007.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 925 kB/s | 23 kB 00:00 2024-09-19T08:32:29.032 INFO:teuthology.orchestra.run.smithi175.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 198 kB/s | 18 kB 00:00 2024-09-19T08:32:29.048 INFO:teuthology.orchestra.run.smithi007.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 783 kB/s | 19 kB 00:00 2024-09-19T08:32:29.073 INFO:teuthology.orchestra.run.smithi007.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 790 kB/s | 20 kB 00:00 2024-09-19T08:32:29.107 INFO:teuthology.orchestra.run.smithi175.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 149 kB/s | 11 kB 00:00 2024-09-19T08:32:29.123 INFO:teuthology.orchestra.run.smithi007.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-09-19T08:32:29.129 INFO:teuthology.orchestra.run.smithi044.stdout:(66/156): libtool-2.4.6-46.el9.x86_64.rpm 732 kB/s | 581 kB 00:00 2024-09-19T08:32:29.149 INFO:teuthology.orchestra.run.smithi007.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T08:32:29.174 INFO:teuthology.orchestra.run.smithi007.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T08:32:29.199 INFO:teuthology.orchestra.run.smithi007.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T08:32:29.232 INFO:teuthology.orchestra.run.smithi175.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-19T08:32:29.233 INFO:teuthology.orchestra.run.smithi007.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-19T08:32:29.267 INFO:teuthology.orchestra.run.smithi007.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-19T08:32:29.292 INFO:teuthology.orchestra.run.smithi007.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-19T08:32:29.307 INFO:teuthology.orchestra.run.smithi175.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 609 kB/s | 45 kB 00:00 2024-09-19T08:32:29.318 INFO:teuthology.orchestra.run.smithi007.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T08:32:29.343 INFO:teuthology.orchestra.run.smithi007.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-19T08:32:29.368 INFO:teuthology.orchestra.run.smithi007.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-19T08:32:29.393 INFO:teuthology.orchestra.run.smithi007.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T08:32:29.419 INFO:teuthology.orchestra.run.smithi007.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-19T08:32:29.444 INFO:teuthology.orchestra.run.smithi007.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-19T08:32:29.469 INFO:teuthology.orchestra.run.smithi007.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-09-19T08:32:29.741 INFO:teuthology.orchestra.run.smithi175.stdout:(58/156): librdkafka-1.6.1-102.el9.x86_64.rpm 1.5 MB/s | 662 kB 00:00 2024-09-19T08:32:29.820 INFO:teuthology.orchestra.run.smithi007.stdout:(142/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.9 MB/s | 16 MB 00:02 2024-09-19T08:32:29.853 INFO:teuthology.orchestra.run.smithi007.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 564 kB/s | 230 kB 00:00 2024-09-19T08:32:29.886 INFO:teuthology.orchestra.run.smithi007.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 219 kB/s | 90 kB 00:00 2024-09-19T08:32:29.912 INFO:teuthology.orchestra.run.smithi007.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 358 kB/s | 20 kB 00:00 2024-09-19T08:32:29.937 INFO:teuthology.orchestra.run.smithi007.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.9 MB/s | 191 kB 00:00 2024-09-19T08:32:29.962 INFO:teuthology.orchestra.run.smithi007.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.0 MB/s | 427 kB 00:00 2024-09-19T08:32:30.024 INFO:teuthology.orchestra.run.smithi007.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T08:32:30.041 INFO:teuthology.orchestra.run.smithi175.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 1.9 MB/s | 581 kB 00:00 2024-09-19T08:32:30.108 INFO:teuthology.orchestra.run.smithi175.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 368 kB/s | 24 kB 00:00 2024-09-19T08:32:30.183 INFO:teuthology.orchestra.run.smithi175.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 633 kB/s | 47 kB 00:00 2024-09-19T08:32:30.242 INFO:teuthology.orchestra.run.smithi175.stdout:(62/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.1 MB/s | 3.0 MB 00:01 2024-09-19T08:32:30.296 INFO:teuthology.orchestra.run.smithi044.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 1.4 MB/s | 1.6 MB 00:01 2024-09-19T08:32:30.297 INFO:teuthology.orchestra.run.smithi007.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 8.4 MB/s | 2.3 MB 00:00 2024-09-19T08:32:30.358 INFO:teuthology.orchestra.run.smithi175.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-09-19T08:32:30.384 INFO:teuthology.orchestra.run.smithi175.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-09-19T08:32:30.406 INFO:teuthology.orchestra.run.smithi007.stdout:(150/156): NetworkManager-libnm-1.51.0-1.el9.x8 17 MB/s | 1.8 MB 00:00 2024-09-19T08:32:30.434 INFO:teuthology.orchestra.run.smithi175.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 511 kB/s | 38 kB 00:00 2024-09-19T08:32:30.447 INFO:teuthology.orchestra.run.smithi007.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 988 kB/s | 41 kB 00:00 2024-09-19T08:32:30.506 INFO:teuthology.orchestra.run.smithi007.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 4.2 MB/s | 249 kB 00:00 2024-09-19T08:32:30.606 INFO:teuthology.orchestra.run.smithi007.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 14 MB/s | 1.4 MB 00:00 2024-09-19T08:32:30.730 INFO:teuthology.orchestra.run.smithi044.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 2.6 MB/s | 4.9 MB 00:01 2024-09-19T08:32:30.748 INFO:teuthology.orchestra.run.smithi007.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 17 MB/s | 2.4 MB 00:00 2024-09-19T08:32:30.763 INFO:teuthology.orchestra.run.smithi044.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 1.9 MB/s | 910 kB 00:00 2024-09-19T08:32:30.798 INFO:teuthology.orchestra.run.smithi007.stdout:(155/156): librados2-19.1.1-361.g2f599a46.el9.x 4.0 MB/s | 3.4 MB 00:00 2024-09-19T08:32:30.847 INFO:teuthology.orchestra.run.smithi044.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-19T08:32:31.065 INFO:teuthology.orchestra.run.smithi007.stdout:(156/156): librbd1-19.1.1-361.g2f599a46.el9.x86 2.9 MB/s | 3.2 MB 00:01 2024-09-19T08:32:31.071 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:32:31.072 INFO:teuthology.orchestra.run.smithi007.stdout:Total 12 MB/s | 226 MB 00:18 2024-09-19T08:32:31.231 INFO:teuthology.orchestra.run.smithi044.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.6 MB/s | 1.0 MB 00:00 2024-09-19T08:32:31.347 INFO:teuthology.orchestra.run.smithi044.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 750 kB/s | 87 kB 00:00 2024-09-19T08:32:31.359 INFO:teuthology.orchestra.run.smithi175.stdout:(66/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 3.9 MB/s | 49 MB 00:12 2024-09-19T08:32:32.134 INFO:teuthology.orchestra.run.smithi175.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.6 MB/s | 4.4 MB 00:01 2024-09-19T08:32:32.281 INFO:teuthology.orchestra.run.smithi044.stdout:(73/156): postgresql-server-13.16-1.el9.x86_64. 3.8 MB/s | 5.8 MB 00:01 2024-09-19T08:32:32.337 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2024-09-19T08:32:32.376 INFO:teuthology.orchestra.run.smithi175.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 2.5 MB/s | 4.9 MB 00:01 2024-09-19T08:32:32.390 INFO:teuthology.orchestra.run.smithi044.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 567 kB/s | 61 kB 00:00 2024-09-19T08:32:32.460 INFO:teuthology.orchestra.run.smithi175.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 2.7 MB/s | 910 kB 00:00 2024-09-19T08:32:32.502 INFO:teuthology.orchestra.run.smithi175.stdout:(70/156): postgresql-13.16-1.el9.x86_64.rpm 1.4 MB/s | 1.6 MB 00:01 2024-09-19T08:32:32.504 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2024-09-19T08:32:32.504 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2024-09-19T08:32:32.506 INFO:teuthology.orchestra.run.smithi044.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-19T08:32:32.527 INFO:teuthology.orchestra.run.smithi175.stdout:(71/156): postgresql-private-libs-13.16-1.el9.x 914 kB/s | 137 kB 00:00 2024-09-19T08:32:32.594 INFO:teuthology.orchestra.run.smithi175.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-19T08:32:32.607 INFO:teuthology.orchestra.run.smithi044.stdout:(76/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.2 MB/s | 4.4 MB 00:03 2024-09-19T08:32:32.632 INFO:teuthology.orchestra.run.smithi044.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-09-19T08:32:32.716 INFO:teuthology.orchestra.run.smithi044.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-09-19T08:32:32.741 INFO:teuthology.orchestra.run.smithi044.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-09-19T08:32:32.850 INFO:teuthology.orchestra.run.smithi044.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 321 kB/s | 35 kB 00:00 2024-09-19T08:32:32.994 INFO:teuthology.orchestra.run.smithi175.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.1 MB/s | 1.0 MB 00:00 2024-09-19T08:32:33.000 INFO:teuthology.orchestra.run.smithi044.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 606 kB/s | 172 kB 00:00 2024-09-19T08:32:33.120 INFO:teuthology.orchestra.run.smithi175.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 489 kB/s | 61 kB 00:00 2024-09-19T08:32:33.209 INFO:teuthology.orchestra.run.smithi044.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.2 MB/s | 6.0 MB 00:01 2024-09-19T08:32:33.303 INFO:teuthology.orchestra.run.smithi175.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.3 MB/s | 245 kB 00:00 2024-09-19T08:32:33.334 INFO:teuthology.orchestra.run.smithi044.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.7 MB/s | 222 kB 00:00 2024-09-19T08:32:33.417 INFO:teuthology.orchestra.run.smithi044.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 600 kB/s | 250 kB 00:00 2024-09-19T08:32:33.459 INFO:teuthology.orchestra.run.smithi044.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 616 kB/s | 77 kB 00:00 2024-09-19T08:32:33.478 INFO:teuthology.orchestra.run.smithi175.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.4 MB/s | 248 kB 00:00 2024-09-19T08:32:33.518 INFO:teuthology.orchestra.run.smithi044.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 422 kB/s | 42 kB 00:00 2024-09-19T08:32:33.553 INFO:teuthology.orchestra.run.smithi175.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 342 kB/s | 26 kB 00:00 2024-09-19T08:32:33.577 INFO:teuthology.orchestra.run.smithi044.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-09-19T08:32:33.621 INFO:teuthology.orchestra.run.smithi175.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 287 kB/s | 19 kB 00:00 2024-09-19T08:32:33.693 INFO:teuthology.orchestra.run.smithi044.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-19T08:32:33.746 INFO:teuthology.orchestra.run.smithi175.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-19T08:32:33.769 INFO:teuthology.orchestra.run.smithi044.stdout:(89/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.5 MB/s | 5.1 MB 00:00 2024-09-19T08:32:33.802 INFO:teuthology.orchestra.run.smithi044.stdout:(90/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 558 kB/s | 159 kB 00:00 2024-09-19T08:32:33.812 INFO:teuthology.orchestra.run.smithi175.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 521 kB/s | 35 kB 00:00 2024-09-19T08:32:33.819 INFO:teuthology.orchestra.run.smithi044.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 406 kB/s | 51 kB 00:00 2024-09-19T08:32:33.869 INFO:teuthology.orchestra.run.smithi044.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 534 kB/s | 54 kB 00:00 2024-09-19T08:32:33.920 INFO:teuthology.orchestra.run.smithi044.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-19T08:32:33.970 INFO:teuthology.orchestra.run.smithi044.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 440 kB/s | 44 kB 00:00 2024-09-19T08:32:34.037 INFO:teuthology.orchestra.run.smithi044.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-19T08:32:34.037 INFO:teuthology.orchestra.run.smithi175.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 3.7 MB/s | 5.8 MB 00:01 2024-09-19T08:32:34.079 INFO:teuthology.orchestra.run.smithi044.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 331 kB/s | 36 kB 00:00 2024-09-19T08:32:34.146 INFO:teuthology.orchestra.run.smithi044.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-09-19T08:32:34.155 INFO:teuthology.orchestra.run.smithi175.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-19T08:32:34.196 INFO:teuthology.orchestra.run.smithi044.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-19T08:32:34.255 INFO:teuthology.orchestra.run.smithi044.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 531 kB/s | 58 kB 00:00 2024-09-19T08:32:34.263 INFO:teuthology.orchestra.run.smithi175.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-09-19T08:32:34.305 INFO:teuthology.orchestra.run.smithi044.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 883 kB/s | 96 kB 00:00 2024-09-19T08:32:34.332 INFO:teuthology.orchestra.run.smithi175.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-09-19T08:32:34.363 INFO:teuthology.orchestra.run.smithi044.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 586 kB/s | 64 kB 00:00 2024-09-19T08:32:34.397 INFO:teuthology.orchestra.run.smithi175.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 636 kB/s | 42 kB 00:00 2024-09-19T08:32:34.414 INFO:teuthology.orchestra.run.smithi044.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 412 kB/s | 45 kB 00:00 2024-09-19T08:32:34.497 INFO:teuthology.orchestra.run.smithi044.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-09-19T08:32:34.514 INFO:teuthology.orchestra.run.smithi175.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-09-19T08:32:34.556 INFO:teuthology.orchestra.run.smithi044.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-19T08:32:34.589 INFO:teuthology.orchestra.run.smithi044.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-19T08:32:34.615 INFO:teuthology.orchestra.run.smithi044.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-19T08:32:34.764 INFO:teuthology.orchestra.run.smithi175.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 636 kB/s | 159 kB 00:00 2024-09-19T08:32:34.766 INFO:teuthology.orchestra.run.smithi044.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.4 MB/s | 863 kB 00:00 2024-09-19T08:32:34.840 INFO:teuthology.orchestra.run.smithi175.stdout:(88/156): python3-babel-2.9.1-2.el9.noarch.rpm 2.7 MB/s | 6.0 MB 00:02 2024-09-19T08:32:34.883 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2024-09-19T08:32:34.883 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2024-09-19T08:32:34.949 INFO:teuthology.orchestra.run.smithi175.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 472 kB/s | 51 kB 00:00 2024-09-19T08:32:34.965 INFO:teuthology.orchestra.run.smithi044.stdout:(108/156): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-19T08:32:34.973 INFO:teuthology.orchestra.run.smithi175.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.3 MB/s | 279 kB 00:00 2024-09-19T08:32:34.991 INFO:teuthology.orchestra.run.smithi044.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-19T08:32:35.016 INFO:teuthology.orchestra.run.smithi044.stdout:(110/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 104 kB/s | 26 kB 00:00 2024-09-19T08:32:35.041 INFO:teuthology.orchestra.run.smithi044.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-19T08:32:35.057 INFO:teuthology.orchestra.run.smithi175.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 495 kB/s | 54 kB 00:00 2024-09-19T08:32:35.067 INFO:teuthology.orchestra.run.smithi044.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-19T08:32:35.100 INFO:teuthology.orchestra.run.smithi044.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-19T08:32:35.124 INFO:teuthology.orchestra.run.smithi175.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 626 kB/s | 42 kB 00:00 2024-09-19T08:32:35.125 INFO:teuthology.orchestra.run.smithi044.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T08:32:35.152 INFO:teuthology.orchestra.run.smithi044.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T08:32:35.184 INFO:teuthology.orchestra.run.smithi044.stdout:(116/156): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-09-19T08:32:35.191 INFO:teuthology.orchestra.run.smithi175.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 663 kB/s | 44 kB 00:00 2024-09-19T08:32:35.210 INFO:teuthology.orchestra.run.smithi044.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 241 kB/s | 14 kB 00:00 2024-09-19T08:32:35.235 INFO:teuthology.orchestra.run.smithi044.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T08:32:35.258 INFO:teuthology.orchestra.run.smithi175.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-19T08:32:35.268 INFO:teuthology.orchestra.run.smithi044.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-19T08:32:35.294 INFO:teuthology.orchestra.run.smithi044.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-19T08:32:35.319 INFO:teuthology.orchestra.run.smithi044.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T08:32:35.325 INFO:teuthology.orchestra.run.smithi175.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 539 kB/s | 36 kB 00:00 2024-09-19T08:32:35.344 INFO:teuthology.orchestra.run.smithi044.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-19T08:32:35.370 INFO:teuthology.orchestra.run.smithi044.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-19T08:32:35.387 INFO:teuthology.orchestra.run.smithi044.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-19T08:32:35.391 INFO:teuthology.orchestra.run.smithi175.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 712 kB/s | 47 kB 00:00 2024-09-19T08:32:35.403 INFO:teuthology.orchestra.run.smithi044.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-19T08:32:35.420 INFO:teuthology.orchestra.run.smithi044.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-19T08:32:35.437 INFO:teuthology.orchestra.run.smithi044.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-19T08:32:35.496 INFO:teuthology.orchestra.run.smithi044.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 10 MB/s | 2.0 MB 00:00 2024-09-19T08:32:35.508 INFO:teuthology.orchestra.run.smithi175.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-19T08:32:35.513 INFO:teuthology.orchestra.run.smithi044.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-19T08:32:35.538 INFO:teuthology.orchestra.run.smithi044.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T08:32:35.572 INFO:teuthology.orchestra.run.smithi044.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-19T08:32:35.597 INFO:teuthology.orchestra.run.smithi044.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 988 kB/s | 58 kB 00:00 2024-09-19T08:32:35.617 INFO:teuthology.orchestra.run.smithi175.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 533 kB/s | 58 kB 00:00 2024-09-19T08:32:35.622 INFO:teuthology.orchestra.run.smithi044.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-19T08:32:35.648 INFO:teuthology.orchestra.run.smithi044.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T08:32:35.673 INFO:teuthology.orchestra.run.smithi044.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-19T08:32:35.676 INFO:teuthology.orchestra.run.smithi175.stdout:(99/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.7 MB/s | 5.1 MB 00:01 2024-09-19T08:32:35.698 INFO:teuthology.orchestra.run.smithi044.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-19T08:32:35.701 INFO:teuthology.orchestra.run.smithi175.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-19T08:32:35.723 INFO:teuthology.orchestra.run.smithi044.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-19T08:32:35.749 INFO:teuthology.orchestra.run.smithi044.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T08:32:35.768 INFO:teuthology.orchestra.run.smithi175.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 673 kB/s | 45 kB 00:00 2024-09-19T08:32:35.774 INFO:teuthology.orchestra.run.smithi044.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-19T08:32:35.793 INFO:teuthology.orchestra.run.smithi175.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 544 kB/s | 64 kB 00:00 2024-09-19T08:32:35.799 INFO:teuthology.orchestra.run.smithi044.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-19T08:32:35.824 INFO:teuthology.orchestra.run.smithi044.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-19T08:32:35.850 INFO:teuthology.orchestra.run.smithi044.stdout:(142/156): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-19T08:32:35.860 INFO:teuthology.orchestra.run.smithi175.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-09-19T08:32:35.875 INFO:teuthology.orchestra.run.smithi044.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T08:32:35.900 INFO:teuthology.orchestra.run.smithi044.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 805 kB/s | 20 kB 00:00 2024-09-19T08:32:35.910 INFO:teuthology.orchestra.run.smithi175.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T08:32:35.926 INFO:teuthology.orchestra.run.smithi044.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-19T08:32:35.953 INFO:teuthology.orchestra.run.smithi175.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-19T08:32:35.959 INFO:teuthology.orchestra.run.smithi044.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-19T08:32:35.978 INFO:teuthology.orchestra.run.smithi175.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-19T08:32:36.011 INFO:teuthology.orchestra.run.smithi175.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.9 MB/s | 863 kB 00:00 2024-09-19T08:32:36.034 INFO:teuthology.orchestra.run.smithi044.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T08:32:36.061 INFO:teuthology.orchestra.run.smithi175.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 520 kB/s | 26 kB 00:00 2024-09-19T08:32:36.095 INFO:teuthology.orchestra.run.smithi175.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-19T08:32:36.129 INFO:teuthology.orchestra.run.smithi175.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-19T08:32:36.196 INFO:teuthology.orchestra.run.smithi175.stdout:(111/156): libarrow-9.0.0-11.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-09-19T08:32:36.221 INFO:teuthology.orchestra.run.smithi175.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-09-19T08:32:36.263 INFO:teuthology.orchestra.run.smithi175.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-19T08:32:36.288 INFO:teuthology.orchestra.run.smithi175.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T08:32:36.313 INFO:teuthology.orchestra.run.smithi175.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T08:32:36.339 INFO:teuthology.orchestra.run.smithi175.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 569 kB/s | 14 kB 00:00 2024-09-19T08:32:36.372 INFO:teuthology.orchestra.run.smithi175.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 3.5 MB/s | 548 kB 00:00 2024-09-19T08:32:36.398 INFO:teuthology.orchestra.run.smithi175.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-19T08:32:36.431 INFO:teuthology.orchestra.run.smithi175.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-19T08:32:36.456 INFO:teuthology.orchestra.run.smithi175.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-19T08:32:36.482 INFO:teuthology.orchestra.run.smithi175.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T08:32:36.507 INFO:teuthology.orchestra.run.smithi175.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-19T08:32:36.524 INFO:teuthology.orchestra.run.smithi175.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 646 kB/s | 11 kB 00:00 2024-09-19T08:32:36.541 INFO:teuthology.orchestra.run.smithi175.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-19T08:32:36.583 INFO:teuthology.orchestra.run.smithi175.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 558 kB/s | 23 kB 00:00 2024-09-19T08:32:36.599 INFO:teuthology.orchestra.run.smithi175.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-19T08:32:36.616 INFO:teuthology.orchestra.run.smithi175.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-19T08:32:36.667 INFO:teuthology.orchestra.run.smithi175.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 9.7 MB/s | 2.0 MB 00:00 2024-09-19T08:32:36.692 INFO:teuthology.orchestra.run.smithi175.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T08:32:36.717 INFO:teuthology.orchestra.run.smithi175.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T08:32:36.751 INFO:teuthology.orchestra.run.smithi175.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-19T08:32:36.776 INFO:teuthology.orchestra.run.smithi175.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 984 kB/s | 58 kB 00:00 2024-09-19T08:32:36.802 INFO:teuthology.orchestra.run.smithi175.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-19T08:32:36.827 INFO:teuthology.orchestra.run.smithi175.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-19T08:32:36.852 INFO:teuthology.orchestra.run.smithi175.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-19T08:32:36.877 INFO:teuthology.orchestra.run.smithi175.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T08:32:36.903 INFO:teuthology.orchestra.run.smithi175.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-19T08:32:36.928 INFO:teuthology.orchestra.run.smithi175.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-19T08:32:36.953 INFO:teuthology.orchestra.run.smithi175.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-19T08:32:36.978 INFO:teuthology.orchestra.run.smithi175.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-19T08:32:37.004 INFO:teuthology.orchestra.run.smithi175.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T08:32:37.029 INFO:teuthology.orchestra.run.smithi175.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T08:32:37.054 INFO:teuthology.orchestra.run.smithi175.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-19T08:32:37.079 INFO:teuthology.orchestra.run.smithi175.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-09-19T08:32:37.113 INFO:teuthology.orchestra.run.smithi175.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-09-19T08:32:37.139 INFO:teuthology.orchestra.run.smithi175.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T08:32:37.200 INFO:teuthology.orchestra.run.smithi175.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-19T08:32:37.201 INFO:teuthology.orchestra.run.smithi044.stdout:(148/156): librbd1-19.1.1-361.g2f599a46.el9.x86 2.7 MB/s | 3.2 MB 00:01 2024-09-19T08:32:37.335 INFO:teuthology.orchestra.run.smithi044.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 17 MB/s | 2.3 MB 00:00 2024-09-19T08:32:37.427 INFO:teuthology.orchestra.run.smithi044.stdout:(150/156): NetworkManager-libnm-1.51.0-1.el9.x8 20 MB/s | 1.8 MB 00:00 2024-09-19T08:32:37.486 INFO:teuthology.orchestra.run.smithi044.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 703 kB/s | 41 kB 00:00 2024-09-19T08:32:37.561 INFO:teuthology.orchestra.run.smithi044.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 3.2 MB/s | 249 kB 00:00 2024-09-19T08:32:37.645 INFO:teuthology.orchestra.run.smithi044.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-09-19T08:32:37.695 INFO:teuthology.orchestra.run.smithi044.stdout:(154/156): librados2-19.1.1-361.g2f599a46.el9.x 2.0 MB/s | 3.4 MB 00:01 2024-09-19T08:32:37.745 INFO:teuthology.orchestra.run.smithi044.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-09-19T08:32:38.147 INFO:teuthology.orchestra.run.smithi175.stdout:(148/156): librbd1-19.1.1-361.g2f599a46.el9.x86 3.3 MB/s | 3.2 MB 00:00 2024-09-19T08:32:38.206 INFO:teuthology.orchestra.run.smithi175.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 3.2 MB/s | 3.4 MB 00:01 2024-09-19T08:32:38.256 INFO:teuthology.orchestra.run.smithi175.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 21 MB/s | 2.3 MB 00:00 2024-09-19T08:32:38.323 INFO:teuthology.orchestra.run.smithi175.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 614 kB/s | 41 kB 00:00 2024-09-19T08:32:38.390 INFO:teuthology.orchestra.run.smithi175.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 3.7 MB/s | 249 kB 00:00 2024-09-19T08:32:38.482 INFO:teuthology.orchestra.run.smithi175.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-09-19T08:32:38.557 INFO:teuthology.orchestra.run.smithi175.stdout:(154/156): NetworkManager-libnm-1.51.0-1.el9.x8 5.1 MB/s | 1.8 MB 00:00 2024-09-19T08:32:38.607 INFO:teuthology.orchestra.run.smithi175.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 19 MB/s | 2.4 MB 00:00 2024-09-19T08:32:41.509 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2024-09-19T08:32:41.623 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T08:32:41.666 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T08:32:41.732 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T08:32:41.782 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T08:32:41.815 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T08:32:42.018 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T08:32:42.468 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T08:32:42.583 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:32:42.708 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:32:42.734 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:32:42.826 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:32:42.863 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:32:43.042 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T08:32:43.094 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T08:32:43.133 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:32:43.236 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:32:43.265 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:32:43.327 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:32:43.357 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:32:43.382 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:32:43.569 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:32:43.750 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:32:43.865 INFO:teuthology.orchestra.run.smithi175.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.8 MB/s | 16 MB 00:08 2024-09-19T08:32:43.871 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:32:43.871 INFO:teuthology.orchestra.run.smithi175.stdout:Total 7.1 MB/s | 226 MB 00:31 2024-09-19T08:32:43.880 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T08:32:44.001 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:32:44.074 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:32:44.316 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:32:44.441 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T08:32:44.547 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T08:32:44.580 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T08:32:44.623 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T08:32:44.698 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T08:32:44.749 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T08:32:44.793 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T08:32:44.842 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T08:32:44.874 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T08:32:44.901 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T08:32:44.973 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T08:32:45.034 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T08:32:45.072 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T08:32:45.103 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-09-19T08:32:45.115 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T08:32:45.194 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T08:32:45.226 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T08:32:45.255 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-09-19T08:32:45.255 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-09-19T08:32:45.271 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T08:32:45.298 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T08:32:45.371 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T08:32:45.413 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T08:32:45.516 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T08:32:45.670 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T08:32:45.734 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T08:32:46.292 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T08:32:46.381 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T08:32:46.424 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T08:32:46.467 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T08:32:46.505 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T08:32:46.548 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T08:32:46.717 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T08:32:46.775 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T08:32:46.831 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T08:32:46.905 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T08:32:46.943 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T08:32:46.987 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T08:32:47.043 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T08:32:47.078 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T08:32:47.121 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T08:32:47.140 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-09-19T08:32:47.141 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-09-19T08:32:47.164 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T08:32:47.309 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T08:32:47.349 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T08:32:47.400 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T08:32:47.508 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T08:32:47.550 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T08:32:47.598 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T08:32:47.631 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T08:32:47.655 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T08:32:47.747 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T08:32:47.883 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T08:32:47.934 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T08:32:47.966 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T08:32:48.005 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T08:32:48.044 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T08:32:48.084 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T08:32:48.113 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T08:32:48.148 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T08:32:48.181 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T08:32:48.224 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T08:32:48.258 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T08:32:48.348 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T08:32:48.406 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T08:32:48.436 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T08:32:48.544 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T08:32:48.597 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T08:32:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T08:32:49.434 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T08:32:49.476 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T08:32:49.587 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T08:32:49.640 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T08:32:49.686 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T08:32:49.776 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T08:32:49.818 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T08:32:50.008 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T08:32:50.058 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T08:32:50.145 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T08:32:50.855 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T08:32:50.976 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T08:32:52.314 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T08:32:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T08:32:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T08:32:52.465 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T08:32:52.792 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T08:32:52.835 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:32:52.919 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:32:52.953 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T08:32:52.998 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T08:32:53.398 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-09-19T08:32:53.502 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T08:32:53.502 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T08:32:53.530 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:32:53.540 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T08:32:53.602 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T08:32:53.602 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:32:53.632 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T08:32:53.644 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T08:32:53.669 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T08:32:53.712 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T08:32:54.033 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T08:32:54.154 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:32:54.275 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:32:54.313 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:32:54.404 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:32:54.434 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:32:54.580 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T08:32:54.655 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T08:32:54.683 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:32:54.787 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:32:54.810 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:32:54.894 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:32:54.919 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:32:54.938 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:32:55.128 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:32:55.264 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:32:55.383 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T08:32:55.486 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:32:55.543 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:32:55.764 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:32:55.872 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T08:32:55.968 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T08:32:56.006 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T08:32:56.041 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T08:32:56.095 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:32:56.104 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T08:32:56.137 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:32:56.150 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T08:32:56.182 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T08:32:56.225 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T08:32:56.257 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T08:32:56.286 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T08:32:56.353 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T08:32:56.408 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T08:32:56.438 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T08:32:56.474 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T08:32:56.549 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T08:32:56.584 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T08:32:56.627 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T08:32:56.656 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T08:32:56.720 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:32:56.725 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T08:32:56.766 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:32:56.774 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T08:32:56.848 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T08:32:56.856 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:32:56.857 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T08:32:56.857 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T08:32:56.857 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:32:56.892 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:32:56.981 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T08:32:57.035 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T08:32:57.557 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T08:32:57.638 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T08:32:57.668 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T08:32:57.677 INFO:teuthology.orchestra.run.smithi044.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 697 kB/s | 16 MB 00:23 2024-09-19T08:32:57.683 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:32:57.683 INFO:teuthology.orchestra.run.smithi044.stdout:Total 5.2 MB/s | 226 MB 00:43 2024-09-19T08:32:57.710 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T08:32:57.748 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T08:32:57.789 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T08:32:57.965 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T08:32:58.018 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T08:32:58.073 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T08:32:58.146 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T08:32:58.177 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T08:32:58.213 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T08:32:58.268 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T08:32:58.304 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T08:32:58.347 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T08:32:58.389 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T08:32:58.524 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T08:32:58.565 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T08:32:58.624 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T08:32:58.726 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T08:32:58.765 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T08:32:58.805 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T08:32:58.831 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T08:32:58.855 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T08:32:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T08:32:58.939 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-19T08:32:59.046 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T08:32:59.086 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T08:32:59.103 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-19T08:32:59.104 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-19T08:32:59.114 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T08:32:59.149 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T08:32:59.188 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T08:32:59.220 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T08:32:59.250 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T08:32:59.284 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T08:32:59.317 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T08:32:59.359 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T08:32:59.393 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T08:32:59.480 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T08:32:59.531 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T08:32:59.579 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T08:32:59.681 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T08:32:59.730 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T08:33:00.443 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T08:33:00.485 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T08:33:00.519 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T08:33:00.616 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T08:33:00.673 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T08:33:00.793 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T08:33:00.995 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-19T08:33:00.995 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-19T08:33:01.059 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T08:33:01.155 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T08:33:01.337 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T08:33:01.369 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T08:33:01.446 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T08:33:02.080 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T08:33:02.198 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T08:33:03.407 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T08:33:03.488 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T08:33:03.507 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T08:33:03.533 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T08:33:03.841 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T08:33:03.887 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:33:03.977 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:33:04.008 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T08:33:04.044 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T08:33:04.523 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T08:33:04.548 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:33:04.619 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:33:04.650 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T08:33:06.941 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:33:06.972 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:33:07.485 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-19T08:33:07.514 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:33:07.559 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:33:07.606 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T08:33:07.645 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T08:33:07.646 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:33:07.646 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T08:33:07.646 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T08:33:07.647 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:33:07.685 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:33:07.698 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T08:33:07.732 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T08:33:07.757 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T08:33:07.801 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T08:33:08.148 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T08:33:08.266 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:33:08.408 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:33:08.434 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:33:08.518 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:33:08.547 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:33:08.706 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T08:33:08.752 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T08:33:08.780 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:33:08.910 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:33:08.939 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:33:09.002 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:33:09.023 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:33:09.048 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:33:09.233 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:33:09.362 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:33:09.479 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T08:33:09.484 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:33:09.484 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /sys 2024-09-19T08:33:09.485 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /proc 2024-09-19T08:33:09.485 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /mnt 2024-09-19T08:33:09.485 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /var/tmp 2024-09-19T08:33:09.485 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /home 2024-09-19T08:33:09.485 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /root 2024-09-19T08:33:09.485 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /tmp 2024-09-19T08:33:09.485 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:33:09.580 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:33:09.656 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:33:09.672 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:33:09.689 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:33:09.690 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:09.690 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T08:33:09.690 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:33:09.878 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:33:09.989 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T08:33:10.086 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T08:33:10.119 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T08:33:10.155 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T08:33:10.230 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T08:33:10.281 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T08:33:10.320 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T08:33:10.365 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T08:33:10.397 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T08:33:10.424 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T08:33:10.496 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T08:33:10.548 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T08:33:10.585 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T08:33:10.621 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T08:33:10.700 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T08:33:10.740 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T08:33:10.783 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T08:33:10.812 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T08:33:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T08:33:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T08:33:11.013 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T08:33:11.155 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T08:33:11.209 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T08:33:11.225 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:33:11.254 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:33:11.254 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:11.254 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T08:33:11.254 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:33:11.254 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:33:11.254 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:33:11.493 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:33:11.517 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:33:11.517 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:11.517 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T08:33:11.518 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:33:11.518 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:33:11.518 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:33:11.773 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T08:33:11.856 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T08:33:11.890 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T08:33:11.933 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T08:33:11.963 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T08:33:11.985 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:33:12.005 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T08:33:12.010 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:33:12.010 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:12.011 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T08:33:12.011 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:33:12.011 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:33:12.011 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:33:12.124 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T08:33:12.175 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T08:33:12.182 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T08:33:12.232 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T08:33:12.246 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T08:33:12.289 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T08:33:12.362 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T08:33:12.400 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T08:33:12.436 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T08:33:12.442 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T08:33:12.483 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T08:33:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T08:33:12.518 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T08:33:12.562 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T08:33:12.575 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T08:33:12.604 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T08:33:12.666 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T08:33:12.747 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T08:33:12.789 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T08:33:12.818 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T08:33:12.856 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T08:33:12.880 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T08:33:12.919 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T08:33:12.946 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T08:33:12.963 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T08:33:12.997 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T08:33:13.037 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T08:33:13.063 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T08:33:13.087 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T08:33:13.165 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T08:33:13.301 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T08:33:13.335 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:33:13.336 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T08:33:13.361 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:33:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T08:33:13.399 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T08:33:13.402 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T08:33:13.438 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T08:33:13.467 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T08:33:13.478 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T08:33:13.493 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:33:13.507 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T08:33:13.542 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T08:33:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T08:33:13.617 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T08:33:13.651 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T08:33:13.740 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T08:33:13.790 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T08:33:13.821 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T08:33:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T08:33:13.990 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T08:33:14.602 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:33:14.670 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:33:14.759 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T08:33:14.802 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T08:33:14.836 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T08:33:14.940 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T08:33:15.000 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T08:33:15.045 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T08:33:15.136 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T08:33:15.182 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T08:33:15.373 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T08:33:15.404 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T08:33:15.484 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T08:33:15.684 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:33:15.712 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:33:15.823 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:33:15.990 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T08:33:16.014 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:33:16.039 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:33:16.040 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:16.040 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T08:33:16.040 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:33:16.040 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:33:16.040 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:33:16.090 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:33:16.102 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:33:16.162 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T08:33:16.209 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T08:33:16.270 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T08:33:16.288 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T08:33:17.249 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T08:33:17.276 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:33:17.301 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:33:17.301 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:17.301 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T08:33:17.301 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:33:17.301 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:33:17.301 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:33:17.343 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:33:17.367 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:33:17.367 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:17.367 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T08:33:17.367 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:33:17.419 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:33:17.444 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:33:17.444 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:17.444 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T08:33:17.444 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:33:17.444 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:33:17.444 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:33:17.588 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T08:33:17.666 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T08:33:17.694 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T08:33:17.735 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T08:33:17.761 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:33:17.786 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:33:17.786 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:17.786 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T08:33:17.786 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:33:17.786 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:33:17.787 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:33:18.061 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T08:33:18.106 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:33:18.198 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:33:18.228 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T08:33:18.264 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T08:33:18.773 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T08:33:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:33:18.880 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:33:18.911 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T08:33:19.399 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:33:19.399 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /sys 2024-09-19T08:33:19.400 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /proc 2024-09-19T08:33:19.400 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /mnt 2024-09-19T08:33:19.400 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /var/tmp 2024-09-19T08:33:19.400 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /home 2024-09-19T08:33:19.400 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /root 2024-09-19T08:33:19.400 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /tmp 2024-09-19T08:33:19.400 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:33:19.569 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:33:19.586 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:33:19.586 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:19.586 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T08:33:19.586 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:33:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:33:21.109 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:33:21.109 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:21.109 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T08:33:21.109 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:33:21.109 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:33:21.109 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:33:21.332 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:33:21.356 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:33:21.356 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:21.356 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T08:33:21.356 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:33:21.356 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:33:21.356 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:33:21.457 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:33:21.492 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:33:21.791 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:33:21.815 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:33:21.815 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:21.815 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T08:33:21.816 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:33:21.816 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:33:21.816 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:33:21.921 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T08:33:21.977 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T08:33:22.033 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T08:33:22.066 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:33:22.104 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:33:22.195 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:33:22.195 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T08:33:22.196 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T08:33:22.196 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-19T08:33:22.219 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T08:33:22.230 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:33:22.275 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T08:33:22.353 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T08:33:22.442 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T08:33:22.580 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T08:33:22.615 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T08:33:22.633 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T08:33:22.665 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T08:33:22.665 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T08:33:22.693 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T08:33:22.707 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T08:33:22.747 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T08:33:22.782 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T08:33:23.004 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T08:33:23.046 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T08:33:23.076 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T08:33:23.079 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:33:23.106 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T08:33:23.116 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:33:23.147 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T08:33:23.152 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T08:33:23.210 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T08:33:23.239 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:33:23.797 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:33:23.833 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:33:23.855 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:33:24.286 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:33:24.332 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:33:24.765 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T08:33:24.847 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T08:33:24.896 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T08:33:24.989 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T08:33:25.025 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T08:33:25.051 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T08:33:25.085 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T08:33:25.085 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:33:25.153 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:33:25.153 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:33:25.245 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:33:25.270 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T08:33:25.276 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:33:25.276 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:33:25.290 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:33:25.316 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:33:25.418 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:33:25.464 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:33:25.464 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:33:25.540 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:33:25.586 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T08:33:25.608 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:33:25.618 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:33:25.642 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:33:25.642 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:25.642 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T08:33:25.642 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:33:25.642 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:33:25.642 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:33:25.694 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:33:25.705 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:33:25.811 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T08:33:25.859 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T08:33:26.780 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T08:33:26.813 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:33:26.836 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:33:26.837 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:26.837 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T08:33:26.837 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:33:26.837 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:33:26.837 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:33:26.880 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:33:26.903 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:33:26.904 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:26.904 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T08:33:26.904 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:33:26.956 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:33:26.979 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:33:26.979 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:26.979 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T08:33:26.980 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:33:26.980 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:33:26.980 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:33:27.290 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:33:27.313 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:33:27.313 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:27.313 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T08:33:27.313 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:33:27.313 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:33:27.314 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:33:31.152 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:33:31.152 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T08:33:31.152 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T08:33:31.153 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T08:33:31.153 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T08:33:31.153 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T08:33:31.153 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T08:33:31.153 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T08:33:31.153 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:33:31.153 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:33:31.154 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:33:31.154 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T08:33:31.154 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T08:33:31.154 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:33:31.154 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T08:33:31.155 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T08:33:31.155 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T08:33:31.155 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T08:33:31.155 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T08:33:31.155 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T08:33:31.155 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T08:33:31.156 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T08:33:31.156 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T08:33:31.156 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T08:33:31.156 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T08:33:31.156 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T08:33:31.157 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T08:33:31.157 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T08:33:31.157 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T08:33:31.157 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T08:33:31.157 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T08:33:31.157 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T08:33:31.158 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T08:33:31.158 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T08:33:31.158 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T08:33:31.158 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T08:33:31.158 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T08:33:31.158 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T08:33:31.159 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T08:33:31.159 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T08:33:31.159 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T08:33:31.159 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T08:33:31.159 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T08:33:31.159 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T08:33:31.159 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T08:33:31.159 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T08:33:31.159 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T08:33:31.159 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T08:33:31.159 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T08:33:31.160 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T08:33:31.160 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T08:33:31.160 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T08:33:31.160 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T08:33:31.160 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T08:33:31.160 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T08:33:31.160 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T08:33:31.160 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T08:33:31.160 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T08:33:31.160 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T08:33:31.160 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T08:33:31.160 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T08:33:31.161 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T08:33:31.161 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T08:33:31.161 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T08:33:31.161 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T08:33:31.161 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T08:33:31.161 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T08:33:31.161 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T08:33:31.161 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T08:33:31.161 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T08:33:31.161 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T08:33:31.161 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T08:33:31.162 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T08:33:31.162 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T08:33:31.162 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T08:33:31.162 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T08:33:31.162 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T08:33:31.162 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T08:33:31.163 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T08:33:31.163 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T08:33:31.163 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T08:33:31.163 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T08:33:31.163 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T08:33:31.163 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T08:33:31.164 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T08:33:31.164 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T08:33:31.164 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T08:33:31.164 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T08:33:31.164 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T08:33:31.164 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T08:33:31.164 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T08:33:31.164 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T08:33:31.164 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T08:33:31.164 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T08:33:31.164 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T08:33:31.164 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T08:33:31.165 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T08:33:31.165 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T08:33:31.165 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T08:33:31.165 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T08:33:31.165 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T08:33:31.165 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T08:33:31.165 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T08:33:31.165 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T08:33:31.165 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T08:33:31.165 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T08:33:31.165 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T08:33:31.165 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T08:33:31.166 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T08:33:31.166 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T08:33:31.166 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T08:33:31.166 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T08:33:31.166 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T08:33:31.166 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T08:33:31.166 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T08:33:31.166 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T08:33:31.166 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T08:33:31.166 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T08:33:31.166 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T08:33:31.166 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T08:33:31.167 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T08:33:31.167 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T08:33:31.167 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T08:33:31.167 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T08:33:31.167 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T08:33:31.167 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T08:33:31.167 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T08:33:31.167 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T08:33:31.167 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T08:33:31.167 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T08:33:31.167 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T08:33:31.167 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T08:33:31.167 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T08:33:31.167 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T08:33:31.167 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T08:33:31.168 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T08:33:31.168 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T08:33:31.168 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T08:33:31.168 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T08:33:31.168 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T08:33:31.168 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T08:33:31.168 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T08:33:31.168 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T08:33:31.168 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T08:33:31.168 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T08:33:31.168 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T08:33:31.168 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T08:33:31.169 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T08:33:31.169 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T08:33:31.169 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T08:33:31.169 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T08:33:31.169 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T08:33:31.169 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T08:33:31.169 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T08:33:31.169 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T08:33:31.169 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T08:33:31.169 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T08:33:31.169 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T08:33:31.169 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T08:33:31.169 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T08:33:31.169 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T08:33:31.170 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T08:33:31.170 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T08:33:31.170 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T08:33:31.843 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T08:33:31.884 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T08:33:31.925 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T08:33:31.957 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T08:33:31.984 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T08:33:32.166 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T08:33:32.214 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T08:33:32.236 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T08:33:32.266 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T08:33:32.312 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T08:33:32.899 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:33:32.943 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:33:32.963 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:33:33.795 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T08:33:33.814 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:33:33.814 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:33:33.814 INFO:teuthology.orchestra.run.smithi007.stdout:Upgraded: 2024-09-19T08:33:33.814 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T08:33:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T08:33:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T08:33:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T08:33:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T08:33:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T08:33:33.815 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2024-09-19T08:33:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T08:33:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T08:33:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T08:33:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:33:33.816 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.816 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.816 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.816 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.816 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:33.816 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.816 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.816 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.816 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:33.816 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:33.816 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:33.816 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T08:33:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T08:33:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:33:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:33:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:33:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T08:33:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:33:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T08:33:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T08:33:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:33:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:33:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:33:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:33:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:33:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:33:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:33:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:33:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T08:33:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:33:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T08:33:33.820 INFO:teuthology.orchestra.run.smithi007.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T08:33:33.820 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:33:33.820 INFO:teuthology.orchestra.run.smithi007.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T08:33:33.820 INFO:teuthology.orchestra.run.smithi007.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T08:33:33.820 INFO:teuthology.orchestra.run.smithi007.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T08:33:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:33:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:33:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T08:33:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:33:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T08:33:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T08:33:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T08:33:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T08:33:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T08:33:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T08:33:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:33:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T08:33:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:33:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:33:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:33:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:33:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:33:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:33:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:33:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T08:33:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T08:33:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:33:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:33:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:33:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T08:33:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T08:33:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:33:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:33:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:33:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:33:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:33:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:33:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:33:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:33:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:33:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:33:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:33:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:33:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:33:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:33:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:33:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:33:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:33:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T08:33:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:33:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:33:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:33:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:33:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T08:33:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:33:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:33:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:33:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:33:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T08:33:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:33:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:33:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:33:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:33:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:33:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:33:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:33:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:33:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:33:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:33:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:33:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T08:33:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:33:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:33:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:33:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:33:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T08:33:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T08:33:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T08:33:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:33:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:33:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:33:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T08:33:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T08:33:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:33:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T08:33:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:33:33.828 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2024-09-19T08:33:33.881 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T08:33:33.921 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T08:33:34.003 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T08:33:34.042 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T08:33:34.067 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T08:33:34.093 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T08:33:34.093 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:33:34.177 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:33:34.177 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:33:34.251 DEBUG:teuthology.parallel:result is None 2024-09-19T08:33:34.261 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:33:34.286 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T08:33:34.291 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:33:34.291 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:33:34.463 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:33:34.463 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:33:34.555 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:33:34.618 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:33:34.750 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:33:34.750 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /sys 2024-09-19T08:33:34.750 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /proc 2024-09-19T08:33:34.751 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /mnt 2024-09-19T08:33:34.751 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /var/tmp 2024-09-19T08:33:34.751 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /home 2024-09-19T08:33:34.751 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /root 2024-09-19T08:33:34.751 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /tmp 2024-09-19T08:33:34.751 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-19T08:33:34.932 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:33:34.949 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:33:34.950 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:34.950 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T08:33:34.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-19T08:33:36.493 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:33:36.520 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:33:36.520 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:36.520 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T08:33:36.520 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:33:36.520 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:33:36.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-19T08:33:36.761 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:33:36.784 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:33:36.785 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:36.785 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T08:33:36.785 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:33:36.785 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:33:36.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-19T08:33:37.245 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:33:37.268 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:33:37.268 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:37.268 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T08:33:37.268 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:33:37.268 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:33:37.268 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-19T08:33:37.384 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T08:33:37.441 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T08:33:37.506 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T08:33:37.699 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T08:33:37.754 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T08:33:37.834 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T08:33:37.925 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T08:33:38.068 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T08:33:38.113 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T08:33:38.153 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T08:33:38.180 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T08:33:38.644 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:33:38.670 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:33:38.702 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T08:33:38.777 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T08:33:38.805 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:33:39.912 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:33:39.953 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:33:40.064 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:33:40.064 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T08:33:40.064 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T08:33:40.064 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T08:33:40.064 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T08:33:40.064 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T08:33:40.064 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T08:33:40.064 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T08:33:40.064 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:33:40.065 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:33:40.065 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:33:40.065 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T08:33:40.065 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T08:33:40.065 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:33:40.065 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T08:33:40.065 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T08:33:40.065 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T08:33:40.065 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T08:33:40.065 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T08:33:40.065 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T08:33:40.065 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T08:33:40.066 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T08:33:40.066 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T08:33:40.066 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T08:33:40.066 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T08:33:40.066 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T08:33:40.066 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T08:33:40.066 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T08:33:40.066 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T08:33:40.066 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T08:33:40.066 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T08:33:40.066 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T08:33:40.066 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T08:33:40.066 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T08:33:40.067 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T08:33:40.067 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T08:33:40.067 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T08:33:40.067 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T08:33:40.067 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T08:33:40.067 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T08:33:40.067 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T08:33:40.067 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T08:33:40.067 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T08:33:40.067 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T08:33:40.067 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T08:33:40.067 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T08:33:40.067 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T08:33:40.068 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T08:33:40.068 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T08:33:40.068 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T08:33:40.068 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T08:33:40.068 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T08:33:40.068 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T08:33:40.068 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T08:33:40.068 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T08:33:40.068 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T08:33:40.068 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T08:33:40.068 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T08:33:40.068 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T08:33:40.068 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T08:33:40.069 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T08:33:40.069 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T08:33:40.069 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T08:33:40.069 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T08:33:40.069 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T08:33:40.069 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T08:33:40.069 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T08:33:40.069 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T08:33:40.069 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T08:33:40.069 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T08:33:40.069 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T08:33:40.069 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T08:33:40.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T08:33:40.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T08:33:40.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T08:33:40.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T08:33:40.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T08:33:40.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T08:33:40.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T08:33:40.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T08:33:40.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T08:33:40.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T08:33:40.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T08:33:40.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T08:33:40.070 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T08:33:40.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T08:33:40.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T08:33:40.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T08:33:40.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T08:33:40.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T08:33:40.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T08:33:40.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T08:33:40.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T08:33:40.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T08:33:40.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T08:33:40.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T08:33:40.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T08:33:40.071 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T08:33:40.072 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T08:33:40.072 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T08:33:40.072 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T08:33:40.072 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T08:33:40.072 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T08:33:40.072 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T08:33:40.072 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T08:33:40.072 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T08:33:40.072 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T08:33:40.072 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T08:33:40.072 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T08:33:40.072 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T08:33:40.072 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T08:33:40.073 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T08:33:40.073 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T08:33:40.073 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T08:33:40.073 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T08:33:40.073 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T08:33:40.073 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T08:33:40.073 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T08:33:40.073 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T08:33:40.073 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T08:33:40.073 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T08:33:40.073 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T08:33:40.073 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T08:33:40.073 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T08:33:40.074 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T08:33:40.074 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T08:33:40.074 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T08:33:40.074 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T08:33:40.074 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T08:33:40.074 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T08:33:40.074 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T08:33:40.074 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T08:33:40.074 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T08:33:40.074 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T08:33:40.075 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T08:33:40.075 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T08:33:40.075 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T08:33:40.075 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T08:33:40.075 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T08:33:40.075 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T08:33:40.075 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T08:33:40.075 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T08:33:40.075 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T08:33:40.075 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T08:33:40.075 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T08:33:40.075 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T08:33:40.075 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T08:33:40.076 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T08:33:40.076 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T08:33:40.076 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T08:33:40.076 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T08:33:40.076 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T08:33:40.076 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T08:33:40.076 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T08:33:40.076 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T08:33:40.076 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T08:33:40.076 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T08:33:40.076 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T08:33:40.076 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T08:33:40.076 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T08:33:40.077 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T08:33:40.077 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T08:33:40.077 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T08:33:40.077 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T08:33:40.970 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:33:41.004 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:33:41.112 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:33:41.281 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T08:33:41.314 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:33:41.338 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:33:41.338 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:41.338 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T08:33:41.338 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:33:41.338 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:33:41.339 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-19T08:33:41.390 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:33:41.401 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:33:41.503 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T08:33:41.548 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T08:33:42.524 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T08:33:42.559 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:33:42.583 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:33:42.583 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:42.583 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T08:33:42.583 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:33:42.583 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:33:42.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-19T08:33:42.626 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:33:42.649 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:33:42.649 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:42.649 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T08:33:42.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-19T08:33:42.696 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:33:42.717 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:33:42.717 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:42.717 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T08:33:42.717 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:33:42.717 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:33:42.717 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-19T08:33:42.846 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:33:42.846 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:33:42.846 INFO:teuthology.orchestra.run.smithi175.stdout:Upgraded: 2024-09-19T08:33:42.846 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T08:33:42.846 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T08:33:42.846 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T08:33:42.846 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T08:33:42.846 INFO:teuthology.orchestra.run.smithi175.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.846 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.846 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T08:33:42.846 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T08:33:42.847 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-09-19T08:33:42.847 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T08:33:42.847 INFO:teuthology.orchestra.run.smithi175.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T08:33:42.847 INFO:teuthology.orchestra.run.smithi175.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T08:33:42.847 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:33:42.847 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.847 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.847 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.847 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.847 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:42.847 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.847 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.847 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.848 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:42.848 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:42.848 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:42.848 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:42.848 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:42.848 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.848 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.848 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:42.848 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.848 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.848 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.848 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:42.849 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:42.849 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.849 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.849 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:42.849 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T08:33:42.849 INFO:teuthology.orchestra.run.smithi175.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T08:33:42.849 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:33:42.849 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:33:42.849 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:33:42.849 INFO:teuthology.orchestra.run.smithi175.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T08:33:42.849 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:33:42.849 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T08:33:42.850 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T08:33:42.850 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:33:42.850 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:33:42.850 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.850 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.850 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.850 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:33:42.850 INFO:teuthology.orchestra.run.smithi175.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:33:42.850 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:33:42.850 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:33:42.850 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:33:42.850 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.851 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.851 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:33:42.851 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.851 INFO:teuthology.orchestra.run.smithi175.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T08:33:42.851 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:33:42.851 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T08:33:42.851 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T08:33:42.851 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:33:42.851 INFO:teuthology.orchestra.run.smithi175.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T08:33:42.851 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T08:33:42.851 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T08:33:42.851 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:33:42.851 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:33:42.851 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T08:33:42.852 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:33:42.852 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T08:33:42.852 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T08:33:42.852 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T08:33:42.852 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T08:33:42.852 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T08:33:42.852 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T08:33:42.852 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:33:42.852 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T08:33:42.852 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:33:42.852 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:33:42.852 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:33:42.853 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.853 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.853 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.853 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:33:42.853 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:33:42.853 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:33:42.853 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:33:42.853 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T08:33:42.853 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T08:33:42.853 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:33:42.853 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:33:42.853 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:33:42.853 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T08:33:42.854 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T08:33:42.854 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:33:42.854 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:33:42.854 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:33:42.854 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:33:42.854 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:33:42.854 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:33:42.854 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:33:42.854 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:33:42.855 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:33:42.855 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:33:42.855 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:33:42.855 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:33:42.855 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:33:42.855 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:33:42.855 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:33:42.855 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:33:42.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:33:42.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T08:33:42.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:33:42.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:33:42.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:33:42.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:33:42.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T08:33:42.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:33:42.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:33:42.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:33:42.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:33:42.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T08:33:42.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:33:42.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:33:42.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:33:42.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:33:42.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:33:42.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:33:42.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:33:42.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:33:42.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:33:42.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:33:42.858 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:33:42.858 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T08:33:42.858 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:33:42.858 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:33:42.858 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:33:42.858 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:33:42.858 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T08:33:42.858 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T08:33:42.858 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T08:33:42.858 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.858 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.858 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:42.859 INFO:teuthology.orchestra.run.smithi175.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:33:42.859 INFO:teuthology.orchestra.run.smithi175.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:33:42.859 INFO:teuthology.orchestra.run.smithi175.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:33:42.859 INFO:teuthology.orchestra.run.smithi175.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T08:33:42.859 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T08:33:42.859 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:33:42.859 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T08:33:42.859 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:33:42.859 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-09-19T08:33:43.036 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:33:43.059 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:33:43.059 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:33:43.060 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T08:33:43.060 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:33:43.060 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:33:43.060 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-19T08:33:43.272 DEBUG:teuthology.parallel:result is None 2024-09-19T08:33:47.873 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T08:33:47.915 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T08:33:47.956 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T08:33:47.988 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T08:33:48.015 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T08:33:48.211 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T08:33:48.253 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T08:33:48.283 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T08:33:48.313 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T08:33:48.351 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T08:33:48.985 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:33:49.024 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:33:49.044 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:33:49.933 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T08:33:50.037 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T08:33:50.079 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T08:33:50.164 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T08:33:50.198 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T08:33:50.223 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T08:33:50.258 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T08:33:50.258 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:33:50.333 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:33:50.333 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:33:50.409 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:33:50.434 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T08:33:50.439 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:33:50.439 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:33:50.619 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:33:50.619 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:33:50.703 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:33:50.778 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:33:56.254 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:33:56.254 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T08:33:56.254 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T08:33:56.254 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T08:33:56.254 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T08:33:56.254 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T08:33:56.255 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T08:33:56.255 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T08:33:56.255 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:33:56.255 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:33:56.255 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:33:56.255 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T08:33:56.255 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T08:33:56.255 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:33:56.255 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T08:33:56.255 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T08:33:56.255 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T08:33:56.255 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T08:33:56.256 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T08:33:56.256 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T08:33:56.256 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T08:33:56.256 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T08:33:56.256 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T08:33:56.256 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T08:33:56.256 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T08:33:56.256 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T08:33:56.256 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T08:33:56.256 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T08:33:56.256 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T08:33:56.256 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T08:33:56.257 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T08:33:56.257 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T08:33:56.257 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T08:33:56.270 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T08:33:56.270 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T08:33:56.270 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T08:33:56.270 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T08:33:56.270 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T08:33:56.270 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T08:33:56.270 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T08:33:56.270 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T08:33:56.270 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T08:33:56.271 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T08:33:56.271 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T08:33:56.271 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T08:33:56.271 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T08:33:56.271 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T08:33:56.271 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T08:33:56.271 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T08:33:56.271 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T08:33:56.271 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T08:33:56.271 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T08:33:56.271 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T08:33:56.272 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T08:33:56.272 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T08:33:56.272 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T08:33:56.272 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T08:33:56.272 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T08:33:56.272 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T08:33:56.272 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T08:33:56.272 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T08:33:56.272 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T08:33:56.272 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T08:33:56.272 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T08:33:56.272 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T08:33:56.273 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T08:33:56.273 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T08:33:56.273 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T08:33:56.273 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T08:33:56.273 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T08:33:56.273 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T08:33:56.273 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T08:33:56.273 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T08:33:56.273 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T08:33:56.273 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T08:33:56.273 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T08:33:56.274 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T08:33:56.274 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T08:33:56.274 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T08:33:56.274 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T08:33:56.274 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T08:33:56.274 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T08:33:56.274 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T08:33:56.274 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T08:33:56.274 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T08:33:56.274 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T08:33:56.274 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T08:33:56.274 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T08:33:56.274 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T08:33:56.275 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T08:33:56.275 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T08:33:56.275 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T08:33:56.275 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T08:33:56.275 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T08:33:56.275 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T08:33:56.275 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T08:33:56.275 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T08:33:56.275 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T08:33:56.275 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T08:33:56.275 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T08:33:56.275 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T08:33:56.275 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T08:33:56.275 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T08:33:56.276 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T08:33:56.276 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T08:33:56.276 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T08:33:56.276 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T08:33:56.276 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T08:33:56.276 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T08:33:56.276 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T08:33:56.276 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T08:33:56.276 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T08:33:56.276 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T08:33:56.276 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T08:33:56.276 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T08:33:56.277 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T08:33:56.277 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T08:33:56.277 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T08:33:56.277 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T08:33:56.277 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T08:33:56.277 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T08:33:56.277 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T08:33:56.277 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T08:33:56.277 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T08:33:56.277 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T08:33:56.277 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T08:33:56.278 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T08:33:56.278 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T08:33:56.278 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T08:33:56.278 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T08:33:56.278 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T08:33:56.278 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T08:33:56.278 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T08:33:56.278 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T08:33:56.278 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T08:33:56.278 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T08:33:56.278 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T08:33:56.278 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T08:33:56.278 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T08:33:56.279 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T08:33:56.279 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T08:33:56.279 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T08:33:56.279 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T08:33:56.279 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T08:33:56.279 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T08:33:56.279 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T08:33:56.279 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T08:33:56.279 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T08:33:56.279 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T08:33:56.279 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T08:33:56.279 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T08:33:56.279 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T08:33:56.280 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T08:33:56.280 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T08:33:56.280 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T08:33:56.280 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T08:33:56.280 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T08:33:56.280 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T08:33:56.280 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T08:33:56.280 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T08:33:56.280 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T08:33:56.280 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T08:33:56.280 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T08:33:56.280 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T08:33:59.051 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:33:59.051 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-19T08:33:59.051 INFO:teuthology.orchestra.run.smithi044.stdout:Upgraded: 2024-09-19T08:33:59.051 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T08:33:59.051 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T08:33:59.051 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T08:33:59.051 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T08:33:59.051 INFO:teuthology.orchestra.run.smithi044.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.051 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.051 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T08:33:59.051 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T08:33:59.052 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-19T08:33:59.052 INFO:teuthology.orchestra.run.smithi044.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T08:33:59.052 INFO:teuthology.orchestra.run.smithi044.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T08:33:59.052 INFO:teuthology.orchestra.run.smithi044.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T08:33:59.052 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:33:59.052 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.052 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.052 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.052 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.052 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:59.052 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.052 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.052 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.053 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:59.053 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:59.053 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:59.053 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:59.053 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:59.053 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.053 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.053 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:59.053 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.053 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.053 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.053 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:59.053 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:59.054 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.054 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.054 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:33:59.054 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T08:33:59.054 INFO:teuthology.orchestra.run.smithi044.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T08:33:59.054 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:33:59.054 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:33:59.054 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:33:59.054 INFO:teuthology.orchestra.run.smithi044.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T08:33:59.054 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:33:59.054 INFO:teuthology.orchestra.run.smithi044.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T08:33:59.054 INFO:teuthology.orchestra.run.smithi044.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T08:33:59.055 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:33:59.055 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:33:59.055 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.055 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.055 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.055 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:33:59.055 INFO:teuthology.orchestra.run.smithi044.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:33:59.055 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:33:59.055 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:33:59.055 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:33:59.055 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.055 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.055 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:33:59.056 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.056 INFO:teuthology.orchestra.run.smithi044.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T08:33:59.056 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:33:59.056 INFO:teuthology.orchestra.run.smithi044.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T08:33:59.056 INFO:teuthology.orchestra.run.smithi044.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T08:33:59.056 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:33:59.056 INFO:teuthology.orchestra.run.smithi044.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T08:33:59.056 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T08:33:59.056 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T08:33:59.056 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:33:59.056 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:33:59.057 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T08:33:59.057 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:33:59.057 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T08:33:59.057 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T08:33:59.057 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T08:33:59.057 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T08:33:59.057 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T08:33:59.057 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T08:33:59.057 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:33:59.057 INFO:teuthology.orchestra.run.smithi044.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T08:33:59.057 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:33:59.057 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:33:59.057 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:33:59.058 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.058 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.058 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.058 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:33:59.058 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:33:59.058 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:33:59.058 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:33:59.058 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T08:33:59.058 INFO:teuthology.orchestra.run.smithi044.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T08:33:59.058 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:33:59.058 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:33:59.058 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:33:59.058 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T08:33:59.058 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T08:33:59.058 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:33:59.059 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:33:59.059 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:33:59.059 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:33:59.059 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:33:59.059 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:33:59.059 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:33:59.059 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:33:59.059 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:33:59.059 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:33:59.059 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:33:59.059 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:33:59.059 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:33:59.059 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:33:59.059 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:33:59.060 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:33:59.060 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:33:59.060 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T08:33:59.060 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:33:59.060 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:33:59.060 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:33:59.060 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:33:59.060 INFO:teuthology.orchestra.run.smithi044.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T08:33:59.060 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:33:59.060 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:33:59.060 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:33:59.060 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:33:59.060 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T08:33:59.060 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:33:59.061 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.061 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.061 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:33:59.061 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:33:59.061 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:33:59.061 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.061 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:33:59.061 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:33:59.061 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:33:59.061 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:33:59.061 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:33:59.061 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:33:59.061 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:33:59.061 INFO:teuthology.orchestra.run.smithi044.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T08:33:59.062 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:33:59.062 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:33:59.062 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:33:59.062 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:33:59.062 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T08:33:59.062 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T08:33:59.062 INFO:teuthology.orchestra.run.smithi044.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T08:33:59.062 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.062 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.062 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:33:59.062 INFO:teuthology.orchestra.run.smithi044.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:33:59.062 INFO:teuthology.orchestra.run.smithi044.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:33:59.062 INFO:teuthology.orchestra.run.smithi044.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:33:59.063 INFO:teuthology.orchestra.run.smithi044.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T08:33:59.063 INFO:teuthology.orchestra.run.smithi044.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T08:33:59.063 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:33:59.063 INFO:teuthology.orchestra.run.smithi044.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T08:33:59.063 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-19T08:33:59.063 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-19T08:33:59.610 DEBUG:teuthology.parallel:result is None 2024-09-19T08:33:59.611 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:33:59.770 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:33:59.798 INFO:teuthology.orchestra.run.smithi007.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:33:59.798 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:33:59.798 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:33:59.800 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:33:59.940 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:33:59.964 INFO:teuthology.orchestra.run.smithi044.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:33:59.964 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:33:59.965 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:33:59.967 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:34:00.109 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:34:00.136 INFO:teuthology.orchestra.run.smithi175.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:34:00.136 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:34:00.136 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:34:00.139 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T08:34:00.139 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T08:34:00.139 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:34:00.173 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-19T08:34:00.173 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:34:00.206 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-19T08:34:00.206 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:34:00.238 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T08:34:00.239 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T08:34:00.239 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:34:00.270 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:34:00.341 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-19T08:34:00.341 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:34:00.371 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:34:00.440 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-19T08:34:00.440 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:34:00.470 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:34:00.539 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T08:34:00.539 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T08:34:00.540 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:34:00.571 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:34:00.639 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-19T08:34:00.639 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:34:00.670 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:34:00.738 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-19T08:34:00.738 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:34:00.763 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:34:00.829 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T08:34:00.830 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T08:34:00.830 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:34:00.856 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:34:00.921 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-19T08:34:00.921 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:34:00.950 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:34:01.019 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-19T08:34:01.019 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:34:01.044 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:34:01.111 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T08:34:01.209 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2}} 2024-09-19T08:34:01.209 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:34:01.210 INFO:tasks.cephadm:Cluster fsid is ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:34:01.210 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T08:34:01.210 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.7', 'mon.b': '172.21.15.44', 'mon.c': '172.21.15.175'} 2024-09-19T08:34:01.210 INFO:tasks.cephadm:First mon is mon.a on smithi007 2024-09-19T08:34:01.210 INFO:tasks.cephadm:First mgr is x 2024-09-19T08:34:01.210 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T08:34:01.211 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname $(hostname -s) 2024-09-19T08:34:01.238 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname $(hostname -s) 2024-09-19T08:34:01.267 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname $(hostname -s) 2024-09-19T08:34:01.292 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T08:34:01.293 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:34:01.438 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T08:34:01.580 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:34:01.582 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T08:34:01.582 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T08:34:01.582 DEBUG:teuthology.orchestra.run.smithi007:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:34:02.613 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 08:34 /home/ubuntu/cephtest/cephadm 2024-09-19T08:34:02.613 DEBUG:teuthology.orchestra.run.smithi044:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:34:03.690 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 08:34 /home/ubuntu/cephtest/cephadm 2024-09-19T08:34:03.690 DEBUG:teuthology.orchestra.run.smithi175:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:34:04.475 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 08:34 /home/ubuntu/cephtest/cephadm 2024-09-19T08:34:04.476 DEBUG:teuthology.orchestra.run.smithi007:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:34:04.496 DEBUG:teuthology.orchestra.run.smithi044:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:34:04.516 DEBUG:teuthology.orchestra.run.smithi175:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:34:04.552 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T08:34:04.552 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T08:34:04.555 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T08:34:04.559 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T08:34:06.095 INFO:teuthology.orchestra.run.smithi044.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:34:06.139 INFO:teuthology.orchestra.run.smithi175.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:34:06.204 INFO:teuthology.orchestra.run.smithi007.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:34:37.061 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-19T08:34:37.061 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:34:37.061 INFO:teuthology.orchestra.run.smithi044.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T08:34:37.062 INFO:teuthology.orchestra.run.smithi044.stdout: "repo_digests": [ 2024-09-19T08:34:37.062 INFO:teuthology.orchestra.run.smithi044.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T08:34:37.062 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-19T08:34:37.062 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-19T08:34:48.713 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:34:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:34:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T08:34:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "repo_digests": [ 2024-09-19T08:34:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T08:34:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-19T08:34:48.714 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:34:53.611 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-19T08:34:53.611 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:34:53.611 INFO:teuthology.orchestra.run.smithi175.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T08:34:53.611 INFO:teuthology.orchestra.run.smithi175.stdout: "repo_digests": [ 2024-09-19T08:34:53.611 INFO:teuthology.orchestra.run.smithi175.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T08:34:53.611 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-09-19T08:34:53.612 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-19T08:34:53.636 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph 2024-09-19T08:34:53.670 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph 2024-09-19T08:34:53.703 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph 2024-09-19T08:34:53.729 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 777 /etc/ceph 2024-09-19T08:34:53.761 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 777 /etc/ceph 2024-09-19T08:34:53.790 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /etc/ceph 2024-09-19T08:34:53.815 INFO:tasks.cephadm:Writing seed config... 2024-09-19T08:34:53.816 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T08:34:53.816 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T08:34:53.816 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T08:34:53.816 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T08:34:53.817 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T08:34:53.817 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-19T08:34:53.817 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T08:34:53.817 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T08:34:53.817 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T08:34:53.817 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T08:34:53.817 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T08:34:53.817 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T08:34:53.817 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T08:34:53.817 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T08:34:53.817 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T08:34:53.817 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T08:34:53.817 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T08:34:53.818 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-19T08:34:53.818 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T08:34:53.818 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T08:34:53.818 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T08:34:53.818 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T08:34:53.818 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-19T08:34:53.818 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T08:34:53.818 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T08:34:53.818 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T08:34:53.818 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T08:34:53.818 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T08:34:53.818 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T08:34:53.818 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T08:34:53.818 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T08:34:53.819 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T08:34:53.819 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-19T08:34:53.819 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-19T08:34:53.819 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-19T08:34:53.819 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T08:34:53.819 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T08:34:53.819 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-19T08:34:53.819 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-19T08:34:53.819 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T08:34:53.819 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T08:34:53.819 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-19T08:34:53.819 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T08:34:53.819 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T08:34:53.819 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T08:34:53.820 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T08:34:53.820 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T08:34:53.820 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T08:34:53.820 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T08:34:53.820 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-19T08:34:53.821 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T08:34:53.821 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T08:34:53.842 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = ebd23124-7661-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T08:34:53.843 DEBUG:teuthology.orchestra.run.smithi007:mon.a> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T08:34:53.885 DEBUG:teuthology.orchestra.run.smithi007:mgr.x> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T08:34:53.928 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T08:34:53.929 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid ebd23124-7661-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.7 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:34:54.145 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:34:54.145 INFO:teuthology.orchestra.run.smithi007.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', 'ebd23124-7661-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.7', '--skip-admin-label'] 2024-09-19T08:34:54.146 INFO:teuthology.orchestra.run.smithi007.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T08:34:54.146 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying podman|docker is present... 2024-09-19T08:34:54.169 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stdout 5.2.2 2024-09-19T08:34:54.169 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying lvm2 is present... 2024-09-19T08:34:54.169 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying time synchronization is in place... 2024-09-19T08:34:54.177 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T08:34:54.177 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T08:34:54.184 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T08:34:54.184 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-19T08:34:54.190 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout enabled 2024-09-19T08:34:54.197 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout active 2024-09-19T08:34:54.197 INFO:teuthology.orchestra.run.smithi007.stdout:Unit chronyd.service is enabled and running 2024-09-19T08:34:54.197 INFO:teuthology.orchestra.run.smithi007.stdout:Repeating the final host check... 2024-09-19T08:34:54.220 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stdout 5.2.2 2024-09-19T08:34:54.220 INFO:teuthology.orchestra.run.smithi007.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T08:34:54.220 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl is present 2024-09-19T08:34:54.220 INFO:teuthology.orchestra.run.smithi007.stdout:lvcreate is present 2024-09-19T08:34:54.227 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T08:34:54.227 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T08:34:54.233 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T08:34:54.234 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-19T08:34:54.240 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout enabled 2024-09-19T08:34:54.247 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout active 2024-09-19T08:34:54.247 INFO:teuthology.orchestra.run.smithi007.stdout:Unit chronyd.service is enabled and running 2024-09-19T08:34:54.247 INFO:teuthology.orchestra.run.smithi007.stdout:Host looks OK 2024-09-19T08:34:54.248 INFO:teuthology.orchestra.run.smithi007.stdout:Cluster fsid: ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:34:54.248 INFO:teuthology.orchestra.run.smithi007.stdout:Acquiring lock 140323970917376 on /run/cephadm/ebd23124-7661-11ef-bceb-c7b262605968.lock 2024-09-19T08:34:54.248 INFO:teuthology.orchestra.run.smithi007.stdout:Lock 140323970917376 acquired on /run/cephadm/ebd23124-7661-11ef-bceb-c7b262605968.lock 2024-09-19T08:34:54.248 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying IP 172.21.15.7 port 3300 ... 2024-09-19T08:34:54.248 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying IP 172.21.15.7 port 6789 ... 2024-09-19T08:34:54.249 INFO:teuthology.orchestra.run.smithi007.stdout:Base mon IP(s) is [172.21.15.7:3300, 172.21.15.7:6789], mon addrv is [v2:172.21.15.7:3300,v1:172.21.15.7:6789] 2024-09-19T08:34:54.251 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.7 metric 100 2024-09-19T08:34:54.251 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.7 metric 100 2024-09-19T08:34:54.254 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T08:34:54.254 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-19T08:34:54.254 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1797sec hoplimit 64 pref medium 2024-09-19T08:34:54.257 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T08:34:54.257 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T08:34:54.257 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T08:34:54.257 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-19T08:34:54.257 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-09-19T08:34:54.257 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T08:34:54.258 INFO:teuthology.orchestra.run.smithi007.stdout:Mon IP `172.21.15.7` is in CIDR network `172.21.0.0/20` 2024-09-19T08:34:54.258 INFO:teuthology.orchestra.run.smithi007.stdout:Mon IP `172.21.15.7` is in CIDR network `172.21.0.0/20` 2024-09-19T08:34:54.258 INFO:teuthology.orchestra.run.smithi007.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T08:34:54.258 INFO:teuthology.orchestra.run.smithi007.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T08:34:54.259 INFO:teuthology.orchestra.run.smithi007.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:34:54.773 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T08:34:54.773 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:34:54.774 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T08:34:54.774 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T08:34:54.774 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T08:34:54.774 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T08:34:54.774 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T08:34:55.687 INFO:teuthology.orchestra.run.smithi007.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T08:34:55.688 INFO:teuthology.orchestra.run.smithi007.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T08:34:55.688 INFO:teuthology.orchestra.run.smithi007.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T08:34:56.517 INFO:teuthology.orchestra.run.smithi007.stdout:stat: stdout 167 167 2024-09-19T08:34:56.518 INFO:teuthology.orchestra.run.smithi007.stdout:Creating initial keys... 2024-09-19T08:34:57.322 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-authtool: stdout AQAw4utmLpw9MRAAF6CjBucydqsLy4eAKK2CIA== 2024-09-19T08:34:58.202 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-authtool: stdout AQAx4utmaSMeJhAAQ+GReo9cmIObLorot8tHYg== 2024-09-19T08:34:59.090 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-authtool: stdout AQAy4utmPG2AHRAAj8Kd4Wi7loV9ZH932JKo7g== 2024-09-19T08:34:59.091 INFO:teuthology.orchestra.run.smithi007.stdout:Creating initial monmap... 2024-09-19T08:34:59.964 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T08:34:59.964 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T08:34:59.964 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:34:59.964 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T08:34:59.964 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool for a [v2:172.21.15.7:3300,v1:172.21.15.7:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T08:34:59.964 INFO:teuthology.orchestra.run.smithi007.stdout:setting min_mon_release = quincy 2024-09-19T08:34:59.964 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: set fsid to ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:34:59.964 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T08:34:59.964 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:34:59.964 INFO:teuthology.orchestra.run.smithi007.stdout:Creating mon... 2024-09-19T08:35:00.835 INFO:teuthology.orchestra.run.smithi007.stdout:create mon.a on 2024-09-19T08:35:01.066 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T08:35:01.217 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T08:35:01.404 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-ebd23124-7661-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-ebd23124-7661-11ef-bceb-c7b262605968.target. 2024-09-19T08:35:01.404 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-ebd23124-7661-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-ebd23124-7661-11ef-bceb-c7b262605968.target. 2024-09-19T08:35:01.645 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ebd23124-7661-11ef-bceb-c7b262605968@mon.a 2024-09-19T08:35:01.645 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ebd23124-7661-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-ebd23124-7661-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T08:35:01.817 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ebd23124-7661-11ef-bceb-c7b262605968.target.wants/ceph-ebd23124-7661-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-ebd23124-7661-11ef-bceb-c7b262605968@.service. 2024-09-19T08:35:02.335 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:35:02.336 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-09-19T08:35:02.344 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:35:02.344 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-19T08:35:02.344 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-09-19T08:35:02.344 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T08:35:02.344 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mon to start... 2024-09-19T08:35:02.344 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mon... 2024-09-19T08:35:03.344 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T08:35:03.344 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout id: ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:35:03.344 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T08:35:03.344 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:03.344 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout services: 2024-09-19T08:35:03.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.514819s) 2024-09-19T08:35:03.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T08:35:03.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T08:35:03.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:03.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout data: 2024-09-19T08:35:03.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T08:35:03.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T08:35:03.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T08:35:03.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T08:35:03.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:03.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.728+0000 7f89e9abf640 1 Processor -- start 2024-09-19T08:35:03.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.729+0000 7f89e9abf640 1 -- start start 2024-09-19T08:35:03.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.729+0000 7f89e9abf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89e41077d0 0x7f89e4107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:03.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.729+0000 7f89e9abf640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f89e41081a0 con 0x7f89e41077d0 2024-09-19T08:35:03.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.729+0000 7f89e37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89e41077d0 0x7f89e4107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:03.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.729+0000 7f89e37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89e41077d0 0x7f89e4107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40628/0 (socket says 172.21.15.7:40628) 2024-09-19T08:35:03.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.729+0000 7f89e37fe640 1 -- 172.21.15.7:0/2940565422 learned_addr learned my addr 172.21.15.7:0/2940565422 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:03.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.730+0000 7f89e37fe640 1 -- 172.21.15.7:0/2940565422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e41089d0 con 0x7f89e41077d0 2024-09-19T08:35:03.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.732+0000 7f89e37fe640 1 --2- 172.21.15.7:0/2940565422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89e41077d0 0x7f89e4107bd0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009820 tx=0x7f89d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280a54805c3a995e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:03.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.732+0000 7f89e27fc640 1 -- 172.21.15.7:0/2940565422 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d4037070 con 0x7f89e41077d0 2024-09-19T08:35:03.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.732+0000 7f89e27fc640 1 -- 172.21.15.7:0/2940565422 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d4032440 con 0x7f89e41077d0 2024-09-19T08:35:03.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.732+0000 7f89e27fc640 1 -- 172.21.15.7:0/2940565422 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d4032740 con 0x7f89e41077d0 2024-09-19T08:35:03.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.732+0000 7f89e9abf640 1 -- 172.21.15.7:0/2940565422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89e41077d0 msgr2=0x7f89e4107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:03.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.732+0000 7f89e9abf640 1 --2- 172.21.15.7:0/2940565422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89e41077d0 0x7f89e4107bd0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009820 tx=0x7f89d402a270 comp rx=0 tx=0).stop 2024-09-19T08:35:03.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.733+0000 7f89e9abf640 1 -- 172.21.15.7:0/2940565422 shutdown_connections 2024-09-19T08:35:03.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.733+0000 7f89e9abf640 1 --2- 172.21.15.7:0/2940565422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89e41077d0 0x7f89e4107bd0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:03.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.733+0000 7f89e9abf640 1 -- 172.21.15.7:0/2940565422 >> 172.21.15.7:0/2940565422 conn(0x7f89e4102f60 msgr2=0x7f89e41053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:03.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.733+0000 7f89e9abf640 1 -- 172.21.15.7:0/2940565422 shutdown_connections 2024-09-19T08:35:03.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.733+0000 7f89e9abf640 1 -- 172.21.15.7:0/2940565422 wait complete. 2024-09-19T08:35:03.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.733+0000 7f89e9abf640 1 Processor -- start 2024-09-19T08:35:03.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.733+0000 7f89e9abf640 1 -- start start 2024-09-19T08:35:03.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.734+0000 7f89e9abf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89e41077d0 0x7f89e419af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:03.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.734+0000 7f89e9abf640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f89e4108f00 con 0x7f89e41077d0 2024-09-19T08:35:03.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.734+0000 7f89e37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89e41077d0 0x7f89e419af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:03.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.734+0000 7f89e37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89e41077d0 0x7f89e419af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40634/0 (socket says 172.21.15.7:40634) 2024-09-19T08:35:03.348 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.734+0000 7f89e37fe640 1 -- 172.21.15.7:0/2225219754 learned_addr learned my addr 172.21.15.7:0/2225219754 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:03.348 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.734+0000 7f89e37fe640 1 -- 172.21.15.7:0/2225219754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e419b490 con 0x7f89e41077d0 2024-09-19T08:35:03.348 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.734+0000 7f89e37fe640 1 --2- 172.21.15.7:0/2225219754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89e41077d0 0x7f89e419af50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f89d40090b0 tx=0x7f89d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:03.348 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.734+0000 7f89e0ff9640 1 -- 172.21.15.7:0/2225219754 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d4041070 con 0x7f89e41077d0 2024-09-19T08:35:03.348 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.734+0000 7f89e0ff9640 1 -- 172.21.15.7:0/2225219754 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d403c7a0 con 0x7f89e41077d0 2024-09-19T08:35:03.348 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.734+0000 7f89e0ff9640 1 -- 172.21.15.7:0/2225219754 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d4037040 con 0x7f89e41077d0 2024-09-19T08:35:03.348 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.734+0000 7f89e9abf640 1 -- 172.21.15.7:0/2225219754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e419b720 con 0x7f89e41077d0 2024-09-19T08:35:03.348 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.735+0000 7f89e9abf640 1 -- 172.21.15.7:0/2225219754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e419e410 con 0x7f89e41077d0 2024-09-19T08:35:03.348 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.735+0000 7f89e0ff9640 1 -- 172.21.15.7:0/2225219754 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f89d4044070 con 0x7f89e41077d0 2024-09-19T08:35:03.348 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.735+0000 7f89e0ff9640 1 -- 172.21.15.7:0/2225219754 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f89d403d3f0 con 0x7f89e41077d0 2024-09-19T08:35:03.348 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.736+0000 7f89e9abf640 1 -- 172.21.15.7:0/2225219754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89e4109550 con 0x7f89e41077d0 2024-09-19T08:35:03.348 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.738+0000 7f89e0ff9640 1 -- 172.21.15.7:0/2225219754 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f89d4046450 con 0x7f89e41077d0 2024-09-19T08:35:03.349 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.800+0000 7f89e9abf640 1 -- 172.21.15.7:0/2225219754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f89e419e960 con 0x7f89e41077d0 2024-09-19T08:35:03.349 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.800+0000 7f89e0ff9640 1 -- 172.21.15.7:0/2225219754 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f89d4046630 con 0x7f89e41077d0 2024-09-19T08:35:03.349 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.801+0000 7f89e9abf640 1 -- 172.21.15.7:0/2225219754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89e41077d0 msgr2=0x7f89e419af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:03.349 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.801+0000 7f89e9abf640 1 --2- 172.21.15.7:0/2225219754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89e41077d0 0x7f89e419af50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f89d40090b0 tx=0x7f89d40046c0 comp rx=0 tx=0).stop 2024-09-19T08:35:03.349 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.801+0000 7f89e9abf640 1 -- 172.21.15.7:0/2225219754 shutdown_connections 2024-09-19T08:35:03.349 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.801+0000 7f89e9abf640 1 --2- 172.21.15.7:0/2225219754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89e41077d0 0x7f89e419af50 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:03.349 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.801+0000 7f89e9abf640 1 -- 172.21.15.7:0/2225219754 >> 172.21.15.7:0/2225219754 conn(0x7f89e4102f60 msgr2=0x7f89e418f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:03.349 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.802+0000 7f89e9abf640 1 -- 172.21.15.7:0/2225219754 shutdown_connections 2024-09-19T08:35:03.349 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:02.802+0000 7f89e9abf640 1 -- 172.21.15.7:0/2225219754 wait complete. 2024-09-19T08:35:03.349 INFO:teuthology.orchestra.run.smithi007.stdout:mon is available 2024-09-19T08:35:03.349 INFO:teuthology.orchestra.run.smithi007.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T08:35:04.316 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:04.316 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T08:35:04.316 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout fsid = ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:35:04.316 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.7:3300,v1:172.21.15.7:6789] 2024-09-19T08:35:04.316 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T08:35:04.317 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T08:35:04.317 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T08:35:04.317 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T08:35:04.317 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:04.317 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T08:35:04.317 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T08:35:04.317 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:04.317 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T08:35:04.317 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T08:35:04.317 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T08:35:04.317 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T08:35:04.317 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T08:35:04.318 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T08:35:04.318 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.744+0000 7f8765808640 1 Processor -- start 2024-09-19T08:35:04.318 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.745+0000 7f8765808640 1 -- start start 2024-09-19T08:35:04.318 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.745+0000 7f8765808640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8760108310 0x7f876010a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:04.318 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.745+0000 7f8765808640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f876007bd70 con 0x7f8760108310 2024-09-19T08:35:04.318 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.745+0000 7f875effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8760108310 0x7f876010a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:04.318 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.745+0000 7f875effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8760108310 0x7f876010a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49146/0 (socket says 172.21.15.7:49146) 2024-09-19T08:35:04.318 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.745+0000 7f875effd640 1 -- 172.21.15.7:0/2396498176 learned_addr learned my addr 172.21.15.7:0/2396498176 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:04.318 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.745+0000 7f875effd640 1 -- 172.21.15.7:0/2396498176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876010ac40 con 0x7f8760108310 2024-09-19T08:35:04.318 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.746+0000 7f875effd640 1 --2- 172.21.15.7:0/2396498176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8760108310 0x7f876010a700 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8750009820 tx=0x7f875002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03b80d7042498d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:04.318 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.746+0000 7f875dffb640 1 -- 172.21.15.7:0/2396498176 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8750037070 con 0x7f8760108310 2024-09-19T08:35:04.318 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.746+0000 7f875dffb640 1 -- 172.21.15.7:0/2396498176 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8750032440 con 0x7f8760108310 2024-09-19T08:35:04.319 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.746+0000 7f875dffb640 1 -- 172.21.15.7:0/2396498176 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8750032740 con 0x7f8760108310 2024-09-19T08:35:04.319 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.746+0000 7f8765808640 1 -- 172.21.15.7:0/2396498176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8760108310 msgr2=0x7f876010a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:04.319 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.746+0000 7f8765808640 1 --2- 172.21.15.7:0/2396498176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8760108310 0x7f876010a700 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8750009820 tx=0x7f875002a270 comp rx=0 tx=0).stop 2024-09-19T08:35:04.319 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.747+0000 7f8765808640 1 -- 172.21.15.7:0/2396498176 shutdown_connections 2024-09-19T08:35:04.319 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.747+0000 7f8765808640 1 --2- 172.21.15.7:0/2396498176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8760108310 0x7f876010a700 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:04.319 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.747+0000 7f8765808640 1 -- 172.21.15.7:0/2396498176 >> 172.21.15.7:0/2396498176 conn(0x7f8760101ed0 msgr2=0x7f87601042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:04.319 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.747+0000 7f8765808640 1 -- 172.21.15.7:0/2396498176 shutdown_connections 2024-09-19T08:35:04.319 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.747+0000 7f8765808640 1 -- 172.21.15.7:0/2396498176 wait complete. 2024-09-19T08:35:04.319 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.747+0000 7f8765808640 1 Processor -- start 2024-09-19T08:35:04.320 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.747+0000 7f8765808640 1 -- start start 2024-09-19T08:35:04.320 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.748+0000 7f8765808640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8760108310 0x7f8760107b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:04.320 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.748+0000 7f8765808640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f876010b050 con 0x7f8760108310 2024-09-19T08:35:04.320 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.748+0000 7f875effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8760108310 0x7f8760107b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:04.320 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.748+0000 7f875effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8760108310 0x7f8760107b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49150/0 (socket says 172.21.15.7:49150) 2024-09-19T08:35:04.320 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.748+0000 7f875effd640 1 -- 172.21.15.7:0/176543804 learned_addr learned my addr 172.21.15.7:0/176543804 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:04.320 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.748+0000 7f875effd640 1 -- 172.21.15.7:0/176543804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87601080d0 con 0x7f8760108310 2024-09-19T08:35:04.320 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.748+0000 7f875effd640 1 --2- 172.21.15.7:0/176543804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8760108310 0x7f8760107b90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f87500090b0 tx=0x7f87500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:04.320 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.748+0000 7f8764806640 1 -- 172.21.15.7:0/176543804 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8750041070 con 0x7f8760108310 2024-09-19T08:35:04.320 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.748+0000 7f8764806640 1 -- 172.21.15.7:0/176543804 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f875003c7a0 con 0x7f8760108310 2024-09-19T08:35:04.320 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.748+0000 7f8765808640 1 -- 172.21.15.7:0/176543804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87601062c0 con 0x7f8760108310 2024-09-19T08:35:04.320 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.748+0000 7f8764806640 1 -- 172.21.15.7:0/176543804 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8750037040 con 0x7f8760108310 2024-09-19T08:35:04.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.748+0000 7f8765808640 1 -- 172.21.15.7:0/176543804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8760106800 con 0x7f8760108310 2024-09-19T08:35:04.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.749+0000 7f8764806640 1 -- 172.21.15.7:0/176543804 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8750044070 con 0x7f8760108310 2024-09-19T08:35:04.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.749+0000 7f8764806640 1 -- 172.21.15.7:0/176543804 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f875003d3f0 con 0x7f8760108310 2024-09-19T08:35:04.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.749+0000 7f8765808640 1 -- 172.21.15.7:0/176543804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8760108770 con 0x7f8760108310 2024-09-19T08:35:04.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.751+0000 7f8764806640 1 -- 172.21.15.7:0/176543804 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8750046450 con 0x7f8760108310 2024-09-19T08:35:04.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.811+0000 7f8765808640 1 -- 172.21.15.7:0/176543804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f87601948e0 con 0x7f8760108310 2024-09-19T08:35:04.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.814+0000 7f8764806640 1 -- 172.21.15.7:0/176543804 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+427 (secure 0 0 0) 0x7f8750046630 con 0x7f8760108310 2024-09-19T08:35:04.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.815+0000 7f8764806640 1 -- 172.21.15.7:0/176543804 <== mon.0 v2:172.21.15.7:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8750056070 con 0x7f8760108310 2024-09-19T08:35:04.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.815+0000 7f8765808640 1 -- 172.21.15.7:0/176543804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8760108310 msgr2=0x7f8760107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:04.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.815+0000 7f8765808640 1 --2- 172.21.15.7:0/176543804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8760108310 0x7f8760107b90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f87500090b0 tx=0x7f87500046c0 comp rx=0 tx=0).stop 2024-09-19T08:35:04.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.815+0000 7f8765808640 1 -- 172.21.15.7:0/176543804 shutdown_connections 2024-09-19T08:35:04.322 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.815+0000 7f8765808640 1 --2- 172.21.15.7:0/176543804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8760108310 0x7f8760107b90 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:04.322 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.815+0000 7f8765808640 1 -- 172.21.15.7:0/176543804 >> 172.21.15.7:0/176543804 conn(0x7f8760101ed0 msgr2=0x7f8760103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:04.322 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.816+0000 7f8765808640 1 -- 172.21.15.7:0/176543804 shutdown_connections 2024-09-19T08:35:04.322 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:03.816+0000 7f8765808640 1 -- 172.21.15.7:0/176543804 wait complete. 2024-09-19T08:35:04.322 INFO:teuthology.orchestra.run.smithi007.stdout:Generating new minimal ceph.conf... 2024-09-19T08:35:05.296 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.690+0000 7f087bf06640 1 Processor -- start 2024-09-19T08:35:05.296 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.690+0000 7f087bf06640 1 -- start start 2024-09-19T08:35:05.296 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.690+0000 7f087bf06640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08741077d0 0x7f0874107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:05.296 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.690+0000 7f087bf06640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f08741081a0 con 0x7f08741077d0 2024-09-19T08:35:05.296 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.690+0000 7f0879ca2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08741077d0 0x7f0874107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:05.296 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.690+0000 7f0879ca2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08741077d0 0x7f0874107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49166/0 (socket says 172.21.15.7:49166) 2024-09-19T08:35:05.296 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.690+0000 7f0879ca2640 1 -- 172.21.15.7:0/745496201 learned_addr learned my addr 172.21.15.7:0/745496201 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:05.296 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.690+0000 7f0879ca2640 1 -- 172.21.15.7:0/745496201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08741089d0 con 0x7f08741077d0 2024-09-19T08:35:05.296 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.691+0000 7f0879ca2640 1 --2- 172.21.15.7:0/745496201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08741077d0 0x7f0874107bd0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0870009820 tx=0x7f087002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a920de46b5410e8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:05.296 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.691+0000 7f0878ca0640 1 -- 172.21.15.7:0/745496201 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0870037070 con 0x7f08741077d0 2024-09-19T08:35:05.296 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.691+0000 7f0878ca0640 1 -- 172.21.15.7:0/745496201 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0870032900 con 0x7f08741077d0 2024-09-19T08:35:05.297 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.691+0000 7f0878ca0640 1 -- 172.21.15.7:0/745496201 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0870030850 con 0x7f08741077d0 2024-09-19T08:35:05.297 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.692+0000 7f087bf06640 1 -- 172.21.15.7:0/745496201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08741077d0 msgr2=0x7f0874107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:05.297 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.692+0000 7f087bf06640 1 --2- 172.21.15.7:0/745496201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08741077d0 0x7f0874107bd0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0870009820 tx=0x7f087002a270 comp rx=0 tx=0).stop 2024-09-19T08:35:05.297 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.692+0000 7f087bf06640 1 -- 172.21.15.7:0/745496201 shutdown_connections 2024-09-19T08:35:05.297 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.692+0000 7f087bf06640 1 --2- 172.21.15.7:0/745496201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08741077d0 0x7f0874107bd0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:05.297 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.692+0000 7f087bf06640 1 -- 172.21.15.7:0/745496201 >> 172.21.15.7:0/745496201 conn(0x7f0874102f60 msgr2=0x7f08741053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:05.297 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.692+0000 7f087bf06640 1 -- 172.21.15.7:0/745496201 shutdown_connections 2024-09-19T08:35:05.297 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.692+0000 7f087bf06640 1 -- 172.21.15.7:0/745496201 wait complete. 2024-09-19T08:35:05.297 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.693+0000 7f087bf06640 1 Processor -- start 2024-09-19T08:35:05.297 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.693+0000 7f087bf06640 1 -- start start 2024-09-19T08:35:05.297 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.693+0000 7f087bf06640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08741077d0 0x7f087407daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:05.297 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.693+0000 7f087bf06640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f087410bd80 con 0x7f08741077d0 2024-09-19T08:35:05.297 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.693+0000 7f0879ca2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08741077d0 0x7f087407daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:05.298 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.693+0000 7f0879ca2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08741077d0 0x7f087407daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49176/0 (socket says 172.21.15.7:49176) 2024-09-19T08:35:05.298 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.693+0000 7f0879ca2640 1 -- 172.21.15.7:0/1804143343 learned_addr learned my addr 172.21.15.7:0/1804143343 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:05.298 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.693+0000 7f0879ca2640 1 -- 172.21.15.7:0/1804143343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f087407e030 con 0x7f08741077d0 2024-09-19T08:35:05.298 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.693+0000 7f0879ca2640 1 --2- 172.21.15.7:0/1804143343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08741077d0 0x7f087407daf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0870009940 tx=0x7f0870032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:05.298 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.694+0000 7f086affd640 1 -- 172.21.15.7:0/1804143343 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0870042070 con 0x7f08741077d0 2024-09-19T08:35:05.298 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.694+0000 7f086affd640 1 -- 172.21.15.7:0/1804143343 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f08700308c0 con 0x7f08741077d0 2024-09-19T08:35:05.298 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.694+0000 7f087bf06640 1 -- 172.21.15.7:0/1804143343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f087407c220 con 0x7f08741077d0 2024-09-19T08:35:05.298 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.694+0000 7f086affd640 1 -- 172.21.15.7:0/1804143343 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0870037040 con 0x7f08741077d0 2024-09-19T08:35:05.298 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.694+0000 7f087bf06640 1 -- 172.21.15.7:0/1804143343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f087407c760 con 0x7f08741077d0 2024-09-19T08:35:05.298 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.694+0000 7f086affd640 1 -- 172.21.15.7:0/1804143343 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0870045070 con 0x7f08741077d0 2024-09-19T08:35:05.298 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.694+0000 7f086affd640 1 -- 172.21.15.7:0/1804143343 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0870047bc0 con 0x7f08741077d0 2024-09-19T08:35:05.298 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.695+0000 7f087bf06640 1 -- 172.21.15.7:0/1804143343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0874107c50 con 0x7f08741077d0 2024-09-19T08:35:05.298 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.697+0000 7f086affd640 1 -- 172.21.15.7:0/1804143343 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f08700327b0 con 0x7f08741077d0 2024-09-19T08:35:05.299 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.757+0000 7f087bf06640 1 -- 172.21.15.7:0/1804143343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f087407caa0 con 0x7f08741077d0 2024-09-19T08:35:05.299 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.757+0000 7f086affd640 1 -- 172.21.15.7:0/1804143343 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+173 (secure 0 0 0) 0x7f087003c870 con 0x7f08741077d0 2024-09-19T08:35:05.299 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.758+0000 7f087bf06640 1 -- 172.21.15.7:0/1804143343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08741077d0 msgr2=0x7f087407daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:05.299 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.758+0000 7f087bf06640 1 --2- 172.21.15.7:0/1804143343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08741077d0 0x7f087407daf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0870009940 tx=0x7f0870032ce0 comp rx=0 tx=0).stop 2024-09-19T08:35:05.299 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.758+0000 7f087bf06640 1 -- 172.21.15.7:0/1804143343 shutdown_connections 2024-09-19T08:35:05.299 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.758+0000 7f087bf06640 1 --2- 172.21.15.7:0/1804143343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08741077d0 0x7f087407daf0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:05.299 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.758+0000 7f087bf06640 1 -- 172.21.15.7:0/1804143343 >> 172.21.15.7:0/1804143343 conn(0x7f0874102f60 msgr2=0x7f0874103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:05.299 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.758+0000 7f087bf06640 1 -- 172.21.15.7:0/1804143343 shutdown_connections 2024-09-19T08:35:05.299 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:04.758+0000 7f087bf06640 1 -- 172.21.15.7:0/1804143343 wait complete. 2024-09-19T08:35:05.299 INFO:teuthology.orchestra.run.smithi007.stdout:Restarting the monitor... 2024-09-19T08:35:05.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:05 smithi007 systemd[1]: Stopping Ceph mon.a for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:35:05.959 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:05 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-a[30846]: 2024-09-19T08:35:05.555+0000 7ff54f1b8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:35:05.959 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:05 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-a[30846]: 2024-09-19T08:35:05.555+0000 7ff54f1b8640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T08:35:05.959 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:05 smithi007 podman[31095]: 2024-09-19 08:35:05.720562177 +0000 UTC m=+0.262173313 container died 80dd3123263aba940ccf5f7e2bbaf4e516673c4eaa24a1f94319b758e9ff6310 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T08:35:06.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 podman[31095]: 2024-09-19 08:35:06.050827989 +0000 UTC m=+0.592439169 container cleanup 80dd3123263aba940ccf5f7e2bbaf4e516673c4eaa24a1f94319b758e9ff6310 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T08:35:06.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 bash[31095]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-a 2024-09-19T08:35:06.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 podman[31108]: 2024-09-19 08:35:06.201498415 +0000 UTC m=+0.475443025 container remove 80dd3123263aba940ccf5f7e2bbaf4e516673c4eaa24a1f94319b758e9ff6310 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T08:35:06.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 systemd[1]: ceph-ebd23124-7661-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T08:35:06.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 systemd[1]: Stopped Ceph mon.a for ebd23124-7661-11ef-bceb-c7b262605968. 2024-09-19T08:35:06.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 systemd[1]: Starting Ceph mon.a for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:35:06.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 podman[31202]: 2024-09-19 08:35:06.542837737 +0000 UTC m=+0.016112494 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:35:06.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 podman[31202]: 2024-09-19 08:35:06.643859429 +0000 UTC m=+0.117134192 container create 282f2e2cd87e7551748477398a68993698d50d8a5eb9305974418709d71535f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T08:35:06.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 podman[31202]: 2024-09-19 08:35:06.855572457 +0000 UTC m=+0.328847213 container init 282f2e2cd87e7551748477398a68993698d50d8a5eb9305974418709d71535f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T08:35:06.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 podman[31202]: 2024-09-19 08:35:06.858729239 +0000 UTC m=+0.332004004 container start 282f2e2cd87e7551748477398a68993698d50d8a5eb9305974418709d71535f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True) 2024-09-19T08:35:06.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T08:35:06.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T08:35:06.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: pidfile_write: ignore empty --pid-file 2024-09-19T08:35:06.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: load: jerasure load: lrc 2024-09-19T08:35:06.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: RocksDB version: 7.9.2 2024-09-19T08:35:06.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Git sha 0 2024-09-19T08:35:06.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T08:35:06.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: DB SUMMARY 2024-09-19T08:35:06.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: DB Session ID: 9X0UJFVHTTV6AD4IN0L5 2024-09-19T08:35:06.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: CURRENT file: CURRENT 2024-09-19T08:35:06.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T08:35:06.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T08:35:06.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T08:35:06.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106598 ; 2024-09-19T08:35:06.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.error_if_exists: 0 2024-09-19T08:35:06.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.create_if_missing: 0 2024-09-19T08:35:06.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.paranoid_checks: 1 2024-09-19T08:35:06.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T08:35:06.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T08:35:06.892 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T08:35:06.892 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.env: 0x55e32a18a940 2024-09-19T08:35:06.892 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T08:35:06.892 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.info_log: 0x55e32b1016e0 2024-09-19T08:35:06.892 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T08:35:06.892 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.statistics: (nil) 2024-09-19T08:35:06.892 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.use_fsync: 0 2024-09-19T08:35:06.892 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_log_file_size: 0 2024-09-19T08:35:06.892 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T08:35:06.892 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T08:35:06.892 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T08:35:06.892 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T08:35:06.892 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.allow_fallocate: 1 2024-09-19T08:35:06.892 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T08:35:06.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T08:35:06.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.use_direct_reads: 0 2024-09-19T08:35:06.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T08:35:06.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T08:35:06.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.db_log_dir: 2024-09-19T08:35:06.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.wal_dir: 2024-09-19T08:35:06.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T08:35:06.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T08:35:06.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T08:35:06.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T08:35:06.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T08:35:06.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T08:35:06.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T08:35:06.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T08:35:06.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.write_buffer_manager: 0x55e32b110dc0 2024-09-19T08:35:06.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T08:35:06.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T08:35:06.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T08:35:06.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T08:35:06.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T08:35:06.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T08:35:06.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T08:35:06.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T08:35:06.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.unordered_write: 0 2024-09-19T08:35:06.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T08:35:06.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T08:35:06.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T08:35:06.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T08:35:06.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.row_cache: None 2024-09-19T08:35:06.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.wal_filter: None 2024-09-19T08:35:06.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T08:35:06.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T08:35:06.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.two_write_queues: 0 2024-09-19T08:35:06.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T08:35:06.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.wal_compression: 0 2024-09-19T08:35:06.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.atomic_flush: 0 2024-09-19T08:35:06.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T08:35:06.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T08:35:06.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T08:35:06.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.log_readahead_size: 0 2024-09-19T08:35:06.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T08:35:06.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T08:35:06.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T08:35:06.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T08:35:06.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T08:35:06.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T08:35:06.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T08:35:06.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_background_jobs: 2 2024-09-19T08:35:06.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_background_compactions: -1 2024-09-19T08:35:06.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_subcompactions: 1 2024-09-19T08:35:06.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T08:35:06.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T08:35:06.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T08:35:06.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T08:35:06.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T08:35:06.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T08:35:06.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T08:35:06.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T08:35:06.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_open_files: -1 2024-09-19T08:35:06.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T08:35:06.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T08:35:06.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T08:35:06.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T08:35:06.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_background_flushes: -1 2024-09-19T08:35:06.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Compression algorithms supported: 2024-09-19T08:35:06.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: kZSTD supported: 0 2024-09-19T08:35:06.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: kXpressCompression supported: 0 2024-09-19T08:35:06.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: kBZip2Compression supported: 0 2024-09-19T08:35:06.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T08:35:06.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: kLZ4Compression supported: 1 2024-09-19T08:35:06.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: kZlibCompression supported: 1 2024-09-19T08:35:06.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T08:35:06.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: kSnappyCompression supported: 1 2024-09-19T08:35:06.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T08:35:06.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T08:35:06.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T08:35:06.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T08:35:06.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T08:35:06.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.merge_operator: 2024-09-19T08:35:06.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compaction_filter: None 2024-09-19T08:35:06.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T08:35:06.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T08:35:06.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T08:35:06.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T08:35:06.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e32b101320) 2024-09-19T08:35:06.900 INFO:journalctl@ceph.mon.a.smithi007.stdout: cache_index_and_filter_blocks: 1 2024-09-19T08:35:06.900 INFO:journalctl@ceph.mon.a.smithi007.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T08:35:06.900 INFO:journalctl@ceph.mon.a.smithi007.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T08:35:06.900 INFO:journalctl@ceph.mon.a.smithi007.stdout: pin_top_level_index_and_filter: 1 2024-09-19T08:35:06.900 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_type: 0 2024-09-19T08:35:06.900 INFO:journalctl@ceph.mon.a.smithi007.stdout: data_block_index_type: 0 2024-09-19T08:35:06.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_shortening: 1 2024-09-19T08:35:06.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T08:35:06.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: checksum: 4 2024-09-19T08:35:06.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: no_block_cache: 0 2024-09-19T08:35:06.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache: 0x55e32b0f51f0 2024-09-19T08:35:06.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_name: BinnedLRUCache 2024-09-19T08:35:06.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_options: 2024-09-19T08:35:06.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: capacity : 536870912 2024-09-19T08:35:06.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: num_shard_bits : 4 2024-09-19T08:35:06.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: strict_capacity_limit : 0 2024-09-19T08:35:06.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: high_pri_pool_ratio: 0.000 2024-09-19T08:35:06.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_compressed: (nil) 2024-09-19T08:35:06.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: persistent_cache: (nil) 2024-09-19T08:35:06.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_size: 4096 2024-09-19T08:35:06.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_size_deviation: 10 2024-09-19T08:35:06.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_restart_interval: 16 2024-09-19T08:35:06.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_block_restart_interval: 1 2024-09-19T08:35:06.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: metadata_block_size: 4096 2024-09-19T08:35:06.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: partition_filters: 0 2024-09-19T08:35:06.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: use_delta_encoding: 1 2024-09-19T08:35:06.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: filter_policy: bloomfilter 2024-09-19T08:35:06.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: whole_key_filtering: 1 2024-09-19T08:35:06.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: verify_compression: 0 2024-09-19T08:35:06.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: read_amp_bytes_per_bit: 0 2024-09-19T08:35:06.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: format_version: 5 2024-09-19T08:35:06.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: enable_index_compression: 1 2024-09-19T08:35:06.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_align: 0 2024-09-19T08:35:06.903 INFO:journalctl@ceph.mon.a.smithi007.stdout: max_auto_readahead_size: 262144 2024-09-19T08:35:06.903 INFO:journalctl@ceph.mon.a.smithi007.stdout: prepopulate_block_cache: 0 2024-09-19T08:35:06.903 INFO:journalctl@ceph.mon.a.smithi007.stdout: initial_auto_readahead_size: 8192 2024-09-19T08:35:06.903 INFO:journalctl@ceph.mon.a.smithi007.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T08:35:06.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T08:35:06.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T08:35:06.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compression: NoCompression 2024-09-19T08:35:06.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T08:35:06.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T08:35:06.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T08:35:06.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.num_levels: 7 2024-09-19T08:35:06.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T08:35:06.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T08:35:06.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T08:35:06.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T08:35:06.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T08:35:06.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T08:35:06.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T08:35:06.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:35:06.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T08:35:06.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T08:35:06.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:35:06.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:35:06.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T08:35:06.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T08:35:06.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T08:35:06.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T08:35:06.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:35:06.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:35:06.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T08:35:06.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T08:35:06.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:35:06.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T08:35:06.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T08:35:06.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T08:35:06.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T08:35:06.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T08:35:06.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T08:35:06.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T08:35:06.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T08:35:06.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T08:35:06.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T08:35:06.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T08:35:06.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T08:35:06.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T08:35:06.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T08:35:06.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T08:35:06.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T08:35:06.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T08:35:06.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T08:35:06.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T08:35:06.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T08:35:06.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T08:35:06.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T08:35:06.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T08:35:06.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T08:35:06.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T08:35:06.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T08:35:06.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T08:35:06.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T08:35:06.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T08:35:06.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T08:35:06.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T08:35:06.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T08:35:06.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T08:35:06.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.inplace_update_support: 0 2024-09-19T08:35:06.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T08:35:06.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T08:35:06.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T08:35:06.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T08:35:06.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.bloom_locality: 0 2024-09-19T08:35:06.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.max_successive_merges: 0 2024-09-19T08:35:06.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T08:35:06.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T08:35:06.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T08:35:06.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T08:35:06.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.ttl: 2592000 2024-09-19T08:35:06.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T08:35:06.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T08:35:06.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T08:35:06.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.enable_blob_files: false 2024-09-19T08:35:06.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.min_blob_size: 0 2024-09-19T08:35:06.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T08:35:06.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T08:35:06.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T08:35:06.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T08:35:06.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T08:35:06.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T08:35:06.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T08:35:06.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T08:35:06.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T08:35:06.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T08:35:06.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6c75ec50-3cc4-4879-9c5f-a25685e2fab1 2024-09-19T08:35:06.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726734906886038, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T08:35:06.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T08:35:06.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726734906887693, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101486, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 334, "table_properties": {"data_size": 99371, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14641, "raw_average_key_size": 49, "raw_value_size": 91502, "raw_average_value_size": 312, "num_data_blocks": 12, "num_entries": 293, "num_filter_entries": 293, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726734906, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6c75ec50-3cc4-4879-9c5f-a25685e2fab1", "db_session_id": "9X0UJFVHTTV6AD4IN0L5", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T08:35:06.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726734906887837, "job": 1, "event": "recovery_finished"} 2024-09-19T08:35:06.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T08:35:06.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T08:35:06.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e32b122e00 2024-09-19T08:35:06.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: DB pointer 0x55e32b21e000 2024-09-19T08:35:06.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T08:35:06.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T08:35:06.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** DB Stats ** 2024-09-19T08:35:06.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:35:06.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T08:35:06.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:35:06.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:35:06.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T08:35:06.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:35:06.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:35:06.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-19T08:35:06.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-09-19T08:35:06.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:35:06.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T08:35:06.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: L0 2/0 100.97 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 96.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:35:06.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: Sum 2/0 100.97 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 96.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:35:06.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 96.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:35:06.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-19T08:35:06.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-09-19T08:35:06.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:35:06.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T08:35:06.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 96.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:35:06.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-19T08:35:06.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T08:35:06.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-19T08:35:06.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:35:06.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T08:35:06.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T08:35:06.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T08:35:06.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T08:35:06.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T08:35:06.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative compaction: 0.00 GB write, 20.07 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:35:06.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval compaction: 0.00 GB write, 20.07 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:35:06.913 INFO:journalctl@ceph.mon.a.smithi007.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T08:35:06.913 INFO:journalctl@ceph.mon.a.smithi007.stdout: Block cache BinnedLRUCache@0x55e32b0f51f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T08:35:06.913 INFO:journalctl@ceph.mon.a.smithi007.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T08:35:06.913 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-19T08:35:06.913 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T08:35:06.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: starting mon.a rank 0 at public addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] at bind addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:35:06.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: mon.a@-1(???) e1 preinit fsid ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:35:06.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: mon.a@-1(???).mds e1 new map 2024-09-19T08:35:06.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: mon.a@-1(???).mds e1 print_map 2024-09-19T08:35:06.913 INFO:journalctl@ceph.mon.a.smithi007.stdout: e1 2024-09-19T08:35:06.913 INFO:journalctl@ceph.mon.a.smithi007.stdout: btime 2024-09-19T08:35:02:287217+0000 2024-09-19T08:35:06.913 INFO:journalctl@ceph.mon.a.smithi007.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:35:06.913 INFO:journalctl@ceph.mon.a.smithi007.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:35:06.913 INFO:journalctl@ceph.mon.a.smithi007.stdout: legacy client fscid: -1 2024-09-19T08:35:06.914 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-19T08:35:06.914 INFO:journalctl@ceph.mon.a.smithi007.stdout: No filesystems configured 2024-09-19T08:35:06.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T08:35:06.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:35:06.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:35:06.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:35:06.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 ceph-mon[31221]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T08:35:06.940 INFO:teuthology.orchestra.run.smithi007.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T08:35:07.144 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 bash[31202]: 282f2e2cd87e7551748477398a68993698d50d8a5eb9305974418709d71535f8 2024-09-19T08:35:07.789 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:06 smithi007 systemd[1]: Started Ceph mon.a for ebd23124-7661-11ef-bceb-c7b262605968. 2024-09-19T08:35:07.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:07 smithi007 ceph-mon[31221]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T08:35:07.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:07 smithi007 ceph-mon[31221]: monmap epoch 1 2024-09-19T08:35:07.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:07 smithi007 ceph-mon[31221]: fsid ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:35:07.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:07 smithi007 ceph-mon[31221]: last_changed 2024-09-19T08:34:59.415913+0000 2024-09-19T08:35:07.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:07 smithi007 ceph-mon[31221]: created 2024-09-19T08:34:59.415913+0000 2024-09-19T08:35:07.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:07 smithi007 ceph-mon[31221]: min_mon_release 19 (squid) 2024-09-19T08:35:07.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:07 smithi007 ceph-mon[31221]: election_strategy: 1 2024-09-19T08:35:07.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:07 smithi007 ceph-mon[31221]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-19T08:35:07.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:07 smithi007 ceph-mon[31221]: fsmap 2024-09-19T08:35:07.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:07 smithi007 ceph-mon[31221]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T08:35:07.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:07 smithi007 ceph-mon[31221]: mgrmap e1: no daemons active 2024-09-19T08:35:07.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:07 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3531201211' entity='client.admin' 2024-09-19T08:35:07.943 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.325+0000 7fc41df13640 1 Processor -- start 2024-09-19T08:35:07.943 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.325+0000 7fc41df13640 1 -- start start 2024-09-19T08:35:07.943 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.325+0000 7fc41df13640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc41807de20 0x7fc41807c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:07.943 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.325+0000 7fc41df13640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc41807c850 con 0x7fc41807de20 2024-09-19T08:35:07.944 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.325+0000 7fc4177fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc41807de20 0x7fc41807c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:07.944 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.325+0000 7fc4177fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc41807de20 0x7fc41807c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49182/0 (socket says 172.21.15.7:49182) 2024-09-19T08:35:07.944 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.325+0000 7fc4177fe640 1 -- 172.21.15.7:0/986601566 learned_addr learned my addr 172.21.15.7:0/986601566 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:07.944 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.326+0000 7fc4177fe640 1 -- 172.21.15.7:0/986601566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41807c9d0 con 0x7fc41807de20 2024-09-19T08:35:07.944 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.328+0000 7fc4177fe640 1 --2- 172.21.15.7:0/986601566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc41807de20 0x7fc41807c280 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc408009820 tx=0x7fc40802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a763fcc30d419242 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:07.944 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.328+0000 7fc4167fc640 1 -- 172.21.15.7:0/986601566 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc408037070 con 0x7fc41807de20 2024-09-19T08:35:07.944 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.328+0000 7fc4167fc640 1 -- 172.21.15.7:0/986601566 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc408032900 con 0x7fc41807de20 2024-09-19T08:35:07.944 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.328+0000 7fc4167fc640 1 -- 172.21.15.7:0/986601566 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc408030850 con 0x7fc41807de20 2024-09-19T08:35:07.944 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.328+0000 7fc41df13640 1 -- 172.21.15.7:0/986601566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc41807de20 msgr2=0x7fc41807c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:07.944 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.328+0000 7fc41df13640 1 --2- 172.21.15.7:0/986601566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc41807de20 0x7fc41807c280 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc408009820 tx=0x7fc40802a270 comp rx=0 tx=0).stop 2024-09-19T08:35:07.944 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.328+0000 7fc41df13640 1 -- 172.21.15.7:0/986601566 shutdown_connections 2024-09-19T08:35:07.944 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.328+0000 7fc41df13640 1 --2- 172.21.15.7:0/986601566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc41807de20 0x7fc41807c280 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:07.945 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.328+0000 7fc41df13640 1 -- 172.21.15.7:0/986601566 >> 172.21.15.7:0/986601566 conn(0x7fc418102f60 msgr2=0x7fc4181053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:07.945 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.329+0000 7fc41df13640 1 -- 172.21.15.7:0/986601566 shutdown_connections 2024-09-19T08:35:07.945 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.329+0000 7fc41df13640 1 -- 172.21.15.7:0/986601566 wait complete. 2024-09-19T08:35:07.945 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.329+0000 7fc41df13640 1 Processor -- start 2024-09-19T08:35:07.945 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.329+0000 7fc41df13640 1 -- start start 2024-09-19T08:35:07.945 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.329+0000 7fc41df13640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc41807de20 0x7fc41819d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:07.945 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.329+0000 7fc41df13640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc41810dde0 con 0x7fc41807de20 2024-09-19T08:35:07.945 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.330+0000 7fc4177fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc41807de20 0x7fc41819d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:07.945 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.330+0000 7fc4177fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc41807de20 0x7fc41819d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49190/0 (socket says 172.21.15.7:49190) 2024-09-19T08:35:07.945 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.330+0000 7fc4177fe640 1 -- 172.21.15.7:0/3531201211 learned_addr learned my addr 172.21.15.7:0/3531201211 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:07.945 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.330+0000 7fc4177fe640 1 -- 172.21.15.7:0/3531201211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41819df10 con 0x7fc41807de20 2024-09-19T08:35:07.946 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.330+0000 7fc4177fe640 1 --2- 172.21.15.7:0/3531201211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc41807de20 0x7fc41819d9d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc4080097f0 tx=0x7fc408030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:07.946 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.330+0000 7fc414ff9640 1 -- 172.21.15.7:0/3531201211 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc408037040 con 0x7fc41807de20 2024-09-19T08:35:07.946 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.330+0000 7fc41df13640 1 -- 172.21.15.7:0/3531201211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc41819e1a0 con 0x7fc41807de20 2024-09-19T08:35:07.946 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.330+0000 7fc414ff9640 1 -- 172.21.15.7:0/3531201211 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc408040070 con 0x7fc41807de20 2024-09-19T08:35:07.946 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.330+0000 7fc414ff9640 1 -- 172.21.15.7:0/3531201211 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc40803a390 con 0x7fc41807de20 2024-09-19T08:35:07.946 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.330+0000 7fc41df13640 1 -- 172.21.15.7:0/3531201211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4181a0e90 con 0x7fc41807de20 2024-09-19T08:35:07.946 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.330+0000 7fc414ff9640 1 -- 172.21.15.7:0/3531201211 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc40803a630 con 0x7fc41807de20 2024-09-19T08:35:07.946 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.330+0000 7fc414ff9640 1 -- 172.21.15.7:0/3531201211 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc4080459a0 con 0x7fc41807de20 2024-09-19T08:35:07.946 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.331+0000 7fc41df13640 1 -- 172.21.15.7:0/3531201211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc41807c300 con 0x7fc41807de20 2024-09-19T08:35:07.946 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.334+0000 7fc414ff9640 1 -- 172.21.15.7:0/3531201211 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc408045460 con 0x7fc41807de20 2024-09-19T08:35:07.946 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.392+0000 7fc41df13640 1 -- 172.21.15.7:0/3531201211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fc41819e620 con 0x7fc41807de20 2024-09-19T08:35:07.946 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.394+0000 7fc414ff9640 1 -- 172.21.15.7:0/3531201211 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fc40803b430 con 0x7fc41807de20 2024-09-19T08:35:07.947 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.395+0000 7fc41df13640 1 -- 172.21.15.7:0/3531201211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc41807de20 msgr2=0x7fc41819d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:07.947 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.395+0000 7fc41df13640 1 --2- 172.21.15.7:0/3531201211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc41807de20 0x7fc41819d9d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc4080097f0 tx=0x7fc408030d80 comp rx=0 tx=0).stop 2024-09-19T08:35:07.947 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.395+0000 7fc41df13640 1 -- 172.21.15.7:0/3531201211 shutdown_connections 2024-09-19T08:35:07.947 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.395+0000 7fc41df13640 1 --2- 172.21.15.7:0/3531201211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc41807de20 0x7fc41819d9d0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:07.947 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.395+0000 7fc41df13640 1 -- 172.21.15.7:0/3531201211 >> 172.21.15.7:0/3531201211 conn(0x7fc418102f60 msgr2=0x7fc418103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:07.947 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.395+0000 7fc41df13640 1 -- 172.21.15.7:0/3531201211 shutdown_connections 2024-09-19T08:35:07.947 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:07.395+0000 7fc41df13640 1 -- 172.21.15.7:0/3531201211 wait complete. 2024-09-19T08:35:07.947 INFO:teuthology.orchestra.run.smithi007.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T08:35:07.969 INFO:teuthology.orchestra.run.smithi007.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:35:07.969 INFO:teuthology.orchestra.run.smithi007.stdout:Creating mgr... 2024-09-19T08:35:07.970 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T08:35:07.970 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T08:35:08.233 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ebd23124-7661-11ef-bceb-c7b262605968@mgr.x 2024-09-19T08:35:08.233 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ebd23124-7661-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-ebd23124-7661-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T08:35:08.404 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ebd23124-7661-11ef-bceb-c7b262605968.target.wants/ceph-ebd23124-7661-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-ebd23124-7661-11ef-bceb-c7b262605968@.service. 2024-09-19T08:35:08.533 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:08 smithi007 systemd[1]: Starting Ceph mgr.x for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:35:08.932 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:08 smithi007 podman[31430]: 2024-09-19 08:35:08.63926161 +0000 UTC m=+0.102434790 container create f5f679817b5bd4e3ff971b1477158dae3f3204c2f12f419db0ed359a64ff8d95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T08:35:08.932 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:08 smithi007 podman[31430]: 2024-09-19 08:35:08.552859668 +0000 UTC m=+0.016032824 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:35:08.932 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:08 smithi007 podman[31430]: 2024-09-19 08:35:08.858149223 +0000 UTC m=+0.321322373 container init f5f679817b5bd4e3ff971b1477158dae3f3204c2f12f419db0ed359a64ff8d95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T08:35:08.932 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:08 smithi007 podman[31430]: 2024-09-19 08:35:08.860865885 +0000 UTC m=+0.324039017 container start f5f679817b5bd4e3ff971b1477158dae3f3204c2f12f419db0ed359a64ff8d95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:35:08.933 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:08 smithi007 bash[31430]: f5f679817b5bd4e3ff971b1477158dae3f3204c2f12f419db0ed359a64ff8d95 2024-09-19T08:35:08.946 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:35:08.946 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-09-19T08:35:08.954 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:35:08.954 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-19T08:35:08.954 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-09-19T08:35:08.954 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T08:35:08.964 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:35:08.964 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-09-19T08:35:08.972 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:35:08.972 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-19T08:35:08.973 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-09-19T08:35:08.973 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T08:35:08.973 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr to start... 2024-09-19T08:35:08.973 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr... 2024-09-19T08:35:09.190 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:08 smithi007 systemd[1]: Started Ceph mgr.x for ebd23124-7661-11ef-bceb-c7b262605968. 2024-09-19T08:35:09.190 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:08 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:08.990+0000 7f7fde3bc040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:35:09.190 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:09 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:09.050+0000 7f7fde3bc040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:35:09.440 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:09 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:09.209+0000 7f7fde3bc040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:35:09.441 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:09 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:09.279+0000 7f7fde3bc040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:35:09.441 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:09 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:09.439+0000 7f7fde3bc040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:35:09.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:09 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/597355425' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:35:09.772 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:09 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:09.588+0000 7f7fde3bc040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:35:10.033 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:09 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:09.921+0000 7f7fde3bc040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:35:10.033 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:09 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:09.985+0000 7f7fde3bc040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:35:10.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:10.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:35:10.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsid": "ebd23124-7661-11ef-bceb-c7b262605968", 2024-09-19T08:35:10.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:35:10.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:35:10.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:35:10.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:35:10.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:10.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:35:10.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:35:10.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:35:10.045 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:35:10.045 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:35:10.045 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T08:35:10.045 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:35:10.045 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T08:35:10.045 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:35:10.045 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:10.045 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T08:35:10.045 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:35:10.045 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:10.045 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:35:10.045 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:10.045 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:35:10.046 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:35:10.046 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:35:10.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:35:10.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:35:10.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:35:10.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:10.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:35:10.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:35:10.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:35:10.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:35:10.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:35:10.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:35:10.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:35:10.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:35:10.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:35:10.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:10.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:35:10.055 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:10.055 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T08:35:02:287217+0000", 2024-09-19T08:35:10.055 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:35:10.055 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:35:10.055 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:10.055 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:35:10.055 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T08:35:10.055 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:35:10.055 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:35:10.055 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:35:10.055 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:35:10.055 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:35:10.055 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:35:10.055 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:35:10.056 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:10.056 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:35:10.056 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:10.056 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:35:02.287871+0000", 2024-09-19T08:35:10.056 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:35:10.056 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:10.056 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:35:10.056 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:35:10.056 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.356+0000 7f8249181640 1 Processor -- start 2024-09-19T08:35:10.056 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.357+0000 7f8249181640 1 -- start start 2024-09-19T08:35:10.056 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.357+0000 7f8249181640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82441066d0 0x7f8244106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:10.056 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.357+0000 7f8249181640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f82441070a0 con 0x7f82441066d0 2024-09-19T08:35:10.057 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.357+0000 7f8242d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82441066d0 0x7f8244106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:10.057 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.357+0000 7f8242d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82441066d0 0x7f8244106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49200/0 (socket says 172.21.15.7:49200) 2024-09-19T08:35:10.057 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.357+0000 7f8242d9d640 1 -- 172.21.15.7:0/385872042 learned_addr learned my addr 172.21.15.7:0/385872042 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:10.057 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.357+0000 7f8242d9d640 1 -- 172.21.15.7:0/385872042 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82441078d0 con 0x7f82441066d0 2024-09-19T08:35:10.057 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.358+0000 7f8242d9d640 1 --2- 172.21.15.7:0/385872042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82441066d0 0x7f8244106ad0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8234009820 tx=0x7f823402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1641ea19a9d95200 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:10.057 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.358+0000 7f824259c640 1 -- 172.21.15.7:0/385872042 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8234037070 con 0x7f82441066d0 2024-09-19T08:35:10.057 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.358+0000 7f824259c640 1 -- 172.21.15.7:0/385872042 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8234032900 con 0x7f82441066d0 2024-09-19T08:35:10.057 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.358+0000 7f824259c640 1 -- 172.21.15.7:0/385872042 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8234030850 con 0x7f82441066d0 2024-09-19T08:35:10.057 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.359+0000 7f8249181640 1 -- 172.21.15.7:0/385872042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82441066d0 msgr2=0x7f8244106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:10.057 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.359+0000 7f8249181640 1 --2- 172.21.15.7:0/385872042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82441066d0 0x7f8244106ad0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8234009820 tx=0x7f823402a270 comp rx=0 tx=0).stop 2024-09-19T08:35:10.057 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.359+0000 7f8249181640 1 -- 172.21.15.7:0/385872042 shutdown_connections 2024-09-19T08:35:10.057 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.359+0000 7f8249181640 1 --2- 172.21.15.7:0/385872042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82441066d0 0x7f8244106ad0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:10.057 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.359+0000 7f8249181640 1 -- 172.21.15.7:0/385872042 >> 172.21.15.7:0/385872042 conn(0x7f8244101e60 msgr2=0x7f82441042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:10.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.359+0000 7f8249181640 1 -- 172.21.15.7:0/385872042 shutdown_connections 2024-09-19T08:35:10.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.359+0000 7f8249181640 1 -- 172.21.15.7:0/385872042 wait complete. 2024-09-19T08:35:10.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.360+0000 7f8249181640 1 Processor -- start 2024-09-19T08:35:10.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.360+0000 7f8249181640 1 -- start start 2024-09-19T08:35:10.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.360+0000 7f8249181640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82441066d0 0x7f824419b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:10.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.360+0000 7f8249181640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f824410ac80 con 0x7f82441066d0 2024-09-19T08:35:10.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.360+0000 7f8242d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82441066d0 0x7f824419b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:10.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.360+0000 7f8242d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82441066d0 0x7f824419b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49206/0 (socket says 172.21.15.7:49206) 2024-09-19T08:35:10.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.360+0000 7f8242d9d640 1 -- 172.21.15.7:0/597355425 learned_addr learned my addr 172.21.15.7:0/597355425 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:10.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.361+0000 7f8242d9d640 1 -- 172.21.15.7:0/597355425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824419bd60 con 0x7f82441066d0 2024-09-19T08:35:10.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.361+0000 7f8242d9d640 1 --2- 172.21.15.7:0/597355425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82441066d0 0x7f824419b820 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f82340097f0 tx=0x7f8234030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:10.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.361+0000 7f8240d99640 1 -- 172.21.15.7:0/597355425 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8234037040 con 0x7f82441066d0 2024-09-19T08:35:10.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.361+0000 7f8240d99640 1 -- 172.21.15.7:0/597355425 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8234040070 con 0x7f82441066d0 2024-09-19T08:35:10.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.361+0000 7f8249181640 1 -- 172.21.15.7:0/597355425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f824419bff0 con 0x7f82441066d0 2024-09-19T08:35:10.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.361+0000 7f8240d99640 1 -- 172.21.15.7:0/597355425 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f823403a390 con 0x7f82441066d0 2024-09-19T08:35:10.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.361+0000 7f8249181640 1 -- 172.21.15.7:0/597355425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f824419ece0 con 0x7f82441066d0 2024-09-19T08:35:10.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.361+0000 7f8240d99640 1 -- 172.21.15.7:0/597355425 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f823403a5e0 con 0x7f82441066d0 2024-09-19T08:35:10.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.361+0000 7f8240d99640 1 -- 172.21.15.7:0/597355425 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8234045d50 con 0x7f82441066d0 2024-09-19T08:35:10.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.362+0000 7f8249181640 1 -- 172.21.15.7:0/597355425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8244106b50 con 0x7f82441066d0 2024-09-19T08:35:10.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.364+0000 7f8240d99640 1 -- 172.21.15.7:0/597355425 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f823403b430 con 0x7f82441066d0 2024-09-19T08:35:10.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.426+0000 7f8249181640 1 -- 172.21.15.7:0/597355425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8244195780 con 0x7f82441066d0 2024-09-19T08:35:10.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.427+0000 7f8240d99640 1 -- 172.21.15.7:0/597355425 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f8244195780 con 0x7f82441066d0 2024-09-19T08:35:10.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.428+0000 7f8249181640 1 -- 172.21.15.7:0/597355425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82441066d0 msgr2=0x7f824419b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:10.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.428+0000 7f8249181640 1 --2- 172.21.15.7:0/597355425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82441066d0 0x7f824419b820 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f82340097f0 tx=0x7f8234030d80 comp rx=0 tx=0).stop 2024-09-19T08:35:10.060 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.428+0000 7f8249181640 1 -- 172.21.15.7:0/597355425 shutdown_connections 2024-09-19T08:35:10.060 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.428+0000 7f8249181640 1 --2- 172.21.15.7:0/597355425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82441066d0 0x7f824419b820 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:10.060 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.428+0000 7f8249181640 1 -- 172.21.15.7:0/597355425 >> 172.21.15.7:0/597355425 conn(0x7f8244101e60 msgr2=0x7f8244102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:10.060 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.428+0000 7f8249181640 1 -- 172.21.15.7:0/597355425 shutdown_connections 2024-09-19T08:35:10.060 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:09.428+0000 7f8249181640 1 -- 172.21.15.7:0/597355425 wait complete. 2024-09-19T08:35:10.060 INFO:teuthology.orchestra.run.smithi007.stdout:mgr not available, waiting (1/15)... 2024-09-19T08:35:10.533 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:10 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:10.179+0000 7f7fde3bc040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:35:11.533 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:11 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:11.100+0000 7f7fde3bc040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:35:11.533 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:11 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:11.170+0000 7f7fde3bc040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:35:12.186 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:11 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:11.925+0000 7f7fde3bc040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:35:12.186 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:12 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:12.045+0000 7f7fde3bc040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:35:12.500 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:12 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:12.197+0000 7f7fde3bc040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:35:12.501 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:12 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:12.261+0000 7f7fde3bc040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:35:12.501 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:12 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:12.419+0000 7f7fde3bc040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:35:12.501 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:12 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:12.499+0000 7f7fde3bc040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:35:12.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:12 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1146169675' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:35:12.783 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:12 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:12.565+0000 7f7fde3bc040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:35:12.783 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:12 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:12.737+0000 7f7fde3bc040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:35:13.089 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:12 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:12.805+0000 7f7fde3bc040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:35:13.089 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:12 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:12.875+0000 7f7fde3bc040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:35:13.089 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:12 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:12.962+0000 7f7fde3bc040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:35:13.089 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:13 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:13.025+0000 7f7fde3bc040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:35:13.089 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:13 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:13.088+0000 7f7fde3bc040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:35:14.283 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:13 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:13.921+0000 7f7fde3bc040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:35:14.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:13 smithi007 ceph-mon[31221]: Activating manager daemon x 2024-09-19T08:35:14.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:13 smithi007 ceph-mon[31221]: mgrmap e2: x(active, starting, since 0.00323709s) 2024-09-19T08:35:14.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:13 smithi007 ceph-mon[31221]: from='mgr.14100 172.21.15.7:0/2790742462' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:35:14.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:13 smithi007 ceph-mon[31221]: from='mgr.14100 172.21.15.7:0/2790742462' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:35:14.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:13 smithi007 ceph-mon[31221]: from='mgr.14100 172.21.15.7:0/2790742462' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:35:14.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:13 smithi007 ceph-mon[31221]: from='mgr.14100 172.21.15.7:0/2790742462' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:35:14.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:13 smithi007 ceph-mon[31221]: from='mgr.14100 172.21.15.7:0/2790742462' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:35:14.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:13 smithi007 ceph-mon[31221]: Manager daemon x is now available 2024-09-19T08:35:14.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:13 smithi007 ceph-mon[31221]: from='mgr.14100 172.21.15.7:0/2790742462' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:35:14.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:13 smithi007 ceph-mon[31221]: from='mgr.14100 172.21.15.7:0/2790742462' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:35:14.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:13 smithi007 ceph-mon[31221]: from='mgr.14100 172.21.15.7:0/2790742462' entity='mgr.x' 2024-09-19T08:35:14.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:13 smithi007 ceph-mon[31221]: from='mgr.14100 172.21.15.7:0/2790742462' entity='mgr.x' 2024-09-19T08:35:14.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:13 smithi007 ceph-mon[31221]: from='mgr.14100 172.21.15.7:0/2790742462' entity='mgr.x' 2024-09-19T08:35:16.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:15 smithi007 ceph-mon[31221]: mgrmap e3: x(active, since 1.00743s) 2024-09-19T08:35:17.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:16 smithi007 ceph-mon[31221]: mgrmap e4: x(active, since 2s) 2024-09-19T08:35:19.523 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:19.523 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:35:19.523 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsid": "ebd23124-7661-11ef-bceb-c7b262605968", 2024-09-19T08:35:19.523 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:35:19.523 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:35:19.523 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:35:19.523 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:35:19.523 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:19.524 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:35:19.524 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:35:19.524 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:35:19.524 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:35:19.524 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:35:19.524 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T08:35:19.524 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:35:19.524 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-19T08:35:19.524 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:35:19.524 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:19.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T08:35:19.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:35:19.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:19.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:35:19.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:19.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:35:19.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:35:19.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:35:19.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:35:19.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:35:19.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:35:19.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:19.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:35:19.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:35:19.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:35:19.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:35:19.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:35:19.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:35:19.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:35:19.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:35:19.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:35:19.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:19.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:35:19.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:19.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T08:35:02:287217+0000", 2024-09-19T08:35:19.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:35:19.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:35:19.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:19.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:35:19.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T08:35:19.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:35:19.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:35:19.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:35:19.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:35:19.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:35:19.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:35:19.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:35:19.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:19.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:35:19.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:19.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:35:02.287871+0000", 2024-09-19T08:35:19.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:35:19.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:19.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:35:19.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:35:19.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.511+0000 7fef4b4fd640 1 Processor -- start 2024-09-19T08:35:19.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.512+0000 7fef4b4fd640 1 -- start start 2024-09-19T08:35:19.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.512+0000 7fef4b4fd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef441066d0 0x7fef44106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:19.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.512+0000 7fef4b4fd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fef441070a0 con 0x7fef441066d0 2024-09-19T08:35:19.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.512+0000 7fef49299640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef441066d0 0x7fef44106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:19.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.512+0000 7fef49299640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef441066d0 0x7fef44106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49220/0 (socket says 172.21.15.7:49220) 2024-09-19T08:35:19.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.512+0000 7fef49299640 1 -- 172.21.15.7:0/855364620 learned_addr learned my addr 172.21.15.7:0/855364620 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:19.529 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.513+0000 7fef49299640 1 -- 172.21.15.7:0/855364620 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef441078d0 con 0x7fef441066d0 2024-09-19T08:35:19.529 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.513+0000 7fef49299640 1 --2- 172.21.15.7:0/855364620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef441066d0 0x7fef44106ad0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fef40009820 tx=0x7fef4002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8504d101ea5a82eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:19.529 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.513+0000 7fef3bfff640 1 -- 172.21.15.7:0/855364620 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef40037070 con 0x7fef441066d0 2024-09-19T08:35:19.529 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.513+0000 7fef3bfff640 1 -- 172.21.15.7:0/855364620 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fef40032900 con 0x7fef441066d0 2024-09-19T08:35:19.529 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.514+0000 7fef3bfff640 1 -- 172.21.15.7:0/855364620 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef40030850 con 0x7fef441066d0 2024-09-19T08:35:19.529 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.514+0000 7fef4b4fd640 1 -- 172.21.15.7:0/855364620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef441066d0 msgr2=0x7fef44106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:19.529 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.514+0000 7fef4b4fd640 1 --2- 172.21.15.7:0/855364620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef441066d0 0x7fef44106ad0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fef40009820 tx=0x7fef4002a270 comp rx=0 tx=0).stop 2024-09-19T08:35:19.529 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.514+0000 7fef4b4fd640 1 -- 172.21.15.7:0/855364620 shutdown_connections 2024-09-19T08:35:19.529 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.514+0000 7fef4b4fd640 1 --2- 172.21.15.7:0/855364620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef441066d0 0x7fef44106ad0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:19.529 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.514+0000 7fef4b4fd640 1 -- 172.21.15.7:0/855364620 >> 172.21.15.7:0/855364620 conn(0x7fef44101e60 msgr2=0x7fef441042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:19.529 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.515+0000 7fef4b4fd640 1 -- 172.21.15.7:0/855364620 shutdown_connections 2024-09-19T08:35:19.529 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.515+0000 7fef4b4fd640 1 -- 172.21.15.7:0/855364620 wait complete. 2024-09-19T08:35:19.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.515+0000 7fef4b4fd640 1 Processor -- start 2024-09-19T08:35:19.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.515+0000 7fef4b4fd640 1 -- start start 2024-09-19T08:35:19.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.515+0000 7fef4b4fd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef441066d0 0x7fef4407b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:19.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.515+0000 7fef4b4fd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fef4410ac80 con 0x7fef441066d0 2024-09-19T08:35:19.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.515+0000 7fef49299640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef441066d0 0x7fef4407b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:19.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.515+0000 7fef49299640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef441066d0 0x7fef4407b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49226/0 (socket says 172.21.15.7:49226) 2024-09-19T08:35:19.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.516+0000 7fef49299640 1 -- 172.21.15.7:0/1146169675 learned_addr learned my addr 172.21.15.7:0/1146169675 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:19.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.516+0000 7fef49299640 1 -- 172.21.15.7:0/1146169675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4419e520 con 0x7fef441066d0 2024-09-19T08:35:19.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.516+0000 7fef49299640 1 --2- 172.21.15.7:0/1146169675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef441066d0 0x7fef4407b9d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fef40009940 tx=0x7fef40032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:19.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.516+0000 7fef3a7fc640 1 -- 172.21.15.7:0/1146169675 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef40042070 con 0x7fef441066d0 2024-09-19T08:35:19.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.516+0000 7fef4b4fd640 1 -- 172.21.15.7:0/1146169675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef4419e6f0 con 0x7fef441066d0 2024-09-19T08:35:19.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.516+0000 7fef3a7fc640 1 -- 172.21.15.7:0/1146169675 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fef400308c0 con 0x7fef441066d0 2024-09-19T08:35:19.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.516+0000 7fef3a7fc640 1 -- 172.21.15.7:0/1146169675 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef40037040 con 0x7fef441066d0 2024-09-19T08:35:19.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.516+0000 7fef4b4fd640 1 -- 172.21.15.7:0/1146169675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef4419ea90 con 0x7fef441066d0 2024-09-19T08:35:19.531 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.517+0000 7fef4b4fd640 1 -- 172.21.15.7:0/1146169675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef44106b50 con 0x7fef441066d0 2024-09-19T08:35:19.531 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.517+0000 7fef3a7fc640 1 -- 172.21.15.7:0/1146169675 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fef40045070 con 0x7fef441066d0 2024-09-19T08:35:19.531 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.517+0000 7fef3a7fc640 1 -- 172.21.15.7:0/1146169675 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fef40047780 con 0x7fef441066d0 2024-09-19T08:35:19.531 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.520+0000 7fef3a7fc640 1 -- 172.21.15.7:0/1146169675 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fef400327b0 con 0x7fef441066d0 2024-09-19T08:35:19.531 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.587+0000 7fef4b4fd640 1 -- 172.21.15.7:0/1146169675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fef4419eec0 con 0x7fef441066d0 2024-09-19T08:35:19.531 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.587+0000 7fef3a7fc640 1 -- 172.21.15.7:0/1146169675 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fef4003c870 con 0x7fef441066d0 2024-09-19T08:35:19.531 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.588+0000 7fef4b4fd640 1 -- 172.21.15.7:0/1146169675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef441066d0 msgr2=0x7fef4407b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:19.531 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.588+0000 7fef4b4fd640 1 --2- 172.21.15.7:0/1146169675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef441066d0 0x7fef4407b9d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fef40009940 tx=0x7fef40032ce0 comp rx=0 tx=0).stop 2024-09-19T08:35:19.531 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.588+0000 7fef4b4fd640 1 -- 172.21.15.7:0/1146169675 shutdown_connections 2024-09-19T08:35:19.531 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.588+0000 7fef4b4fd640 1 --2- 172.21.15.7:0/1146169675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef441066d0 0x7fef4407b9d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:19.531 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.588+0000 7fef4b4fd640 1 -- 172.21.15.7:0/1146169675 >> 172.21.15.7:0/1146169675 conn(0x7fef44101e60 msgr2=0x7fef44102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:19.532 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.588+0000 7fef4b4fd640 1 -- 172.21.15.7:0/1146169675 shutdown_connections 2024-09-19T08:35:19.532 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:12.588+0000 7fef4b4fd640 1 -- 172.21.15.7:0/1146169675 wait complete. 2024-09-19T08:35:19.532 INFO:teuthology.orchestra.run.smithi007.stdout:mgr not available, waiting (2/15)... 2024-09-19T08:35:24.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:23 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3390183085' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:35:24.358 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:24.358 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:35:24.359 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsid": "ebd23124-7661-11ef-bceb-c7b262605968", 2024-09-19T08:35:24.359 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:35:24.359 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:35:24.359 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:35:24.359 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:35:24.359 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:24.359 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:35:24.359 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:35:24.359 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:35:24.359 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:35:24.359 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:35:24.359 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T08:35:24.359 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:35:24.359 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_age": 16, 2024-09-19T08:35:24.360 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:35:24.360 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:24.360 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T08:35:24.360 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:35:24.360 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:24.360 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:35:24.360 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:24.360 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:35:24.360 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:35:24.360 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:35:24.369 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:35:24.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:35:24.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:35:24.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:24.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:35:24.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:35:24.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:35:24.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:35:24.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:35:24.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:35:24.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:35:24.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:35:24.371 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:35:24.371 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:24.371 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:35:24.371 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:24.371 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T08:35:02:287217+0000", 2024-09-19T08:35:24.371 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:35:24.371 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:35:24.371 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:24.371 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:35:24.371 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:35:24.371 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:35:24.371 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:35:24.371 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:35:24.372 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:35:24.372 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:35:24.372 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:35:24.372 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:35:24.372 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:24.372 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:35:24.372 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:35:24.372 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:35:02.287871+0000", 2024-09-19T08:35:24.372 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:35:24.372 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:35:24.372 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:35:24.372 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:35:24.372 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.486+0000 7f6e3d2cc640 1 Processor -- start 2024-09-19T08:35:24.373 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.486+0000 7f6e3d2cc640 1 -- start start 2024-09-19T08:35:24.373 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.486+0000 7f6e3d2cc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e38106030 0x7f6e38106430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:24.373 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.487+0000 7f6e3d2cc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3807be30 con 0x7f6e38106030 2024-09-19T08:35:24.373 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.487+0000 7f6e36ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e38106030 0x7f6e38106430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:24.373 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.487+0000 7f6e36ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e38106030 0x7f6e38106430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34114/0 (socket says 172.21.15.7:34114) 2024-09-19T08:35:24.373 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.487+0000 7f6e36ffd640 1 -- 172.21.15.7:0/586247717 learned_addr learned my addr 172.21.15.7:0/586247717 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:24.373 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.487+0000 7f6e36ffd640 1 -- 172.21.15.7:0/586247717 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e38106970 con 0x7f6e38106030 2024-09-19T08:35:24.373 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.488+0000 7f6e36ffd640 1 --2- 172.21.15.7:0/586247717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e38106030 0x7f6e38106430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6e28009820 tx=0x7f6e2802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6d1da417b99524 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:24.373 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.488+0000 7f6e35ffb640 1 -- 172.21.15.7:0/586247717 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e28037070 con 0x7f6e38106030 2024-09-19T08:35:24.373 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.488+0000 7f6e35ffb640 1 -- 172.21.15.7:0/586247717 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6e28032900 con 0x7f6e38106030 2024-09-19T08:35:24.373 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.488+0000 7f6e35ffb640 1 -- 172.21.15.7:0/586247717 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e28030850 con 0x7f6e38106030 2024-09-19T08:35:24.373 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.489+0000 7f6e3d2cc640 1 -- 172.21.15.7:0/586247717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e38106030 msgr2=0x7f6e38106430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:24.373 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.489+0000 7f6e3d2cc640 1 --2- 172.21.15.7:0/586247717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e38106030 0x7f6e38106430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6e28009820 tx=0x7f6e2802a270 comp rx=0 tx=0).stop 2024-09-19T08:35:24.374 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.489+0000 7f6e3d2cc640 1 -- 172.21.15.7:0/586247717 shutdown_connections 2024-09-19T08:35:24.374 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.489+0000 7f6e3d2cc640 1 --2- 172.21.15.7:0/586247717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e38106030 0x7f6e38106430 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:24.374 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.489+0000 7f6e3d2cc640 1 -- 172.21.15.7:0/586247717 >> 172.21.15.7:0/586247717 conn(0x7f6e38101e60 msgr2=0x7f6e381042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:24.374 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.489+0000 7f6e3d2cc640 1 -- 172.21.15.7:0/586247717 shutdown_connections 2024-09-19T08:35:24.374 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.489+0000 7f6e3d2cc640 1 -- 172.21.15.7:0/586247717 wait complete. 2024-09-19T08:35:24.374 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.490+0000 7f6e3d2cc640 1 Processor -- start 2024-09-19T08:35:24.374 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.490+0000 7f6e3d2cc640 1 -- start start 2024-09-19T08:35:24.374 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.490+0000 7f6e3d2cc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e38106030 0x7f6e3819d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:24.374 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.490+0000 7f6e3d2cc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6e38107a00 con 0x7f6e38106030 2024-09-19T08:35:24.374 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.490+0000 7f6e36ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e38106030 0x7f6e3819d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:24.374 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.490+0000 7f6e36ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e38106030 0x7f6e3819d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34116/0 (socket says 172.21.15.7:34116) 2024-09-19T08:35:24.374 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.490+0000 7f6e36ffd640 1 -- 172.21.15.7:0/3390183085 learned_addr learned my addr 172.21.15.7:0/3390183085 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:24.374 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.490+0000 7f6e36ffd640 1 -- 172.21.15.7:0/3390183085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3819dec0 con 0x7f6e38106030 2024-09-19T08:35:24.375 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.491+0000 7f6e36ffd640 1 --2- 172.21.15.7:0/3390183085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e38106030 0x7f6e3819d980 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6e28032ce0 tx=0x7f6e28032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:24.375 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.491+0000 7f6e1ffff640 1 -- 172.21.15.7:0/3390183085 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e28042070 con 0x7f6e38106030 2024-09-19T08:35:24.375 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.491+0000 7f6e1ffff640 1 -- 172.21.15.7:0/3390183085 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6e280308c0 con 0x7f6e38106030 2024-09-19T08:35:24.375 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.491+0000 7f6e1ffff640 1 -- 172.21.15.7:0/3390183085 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e28037040 con 0x7f6e38106030 2024-09-19T08:35:24.375 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.491+0000 7f6e3d2cc640 1 -- 172.21.15.7:0/3390183085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e3819e150 con 0x7f6e38106030 2024-09-19T08:35:24.375 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.491+0000 7f6e3d2cc640 1 -- 172.21.15.7:0/3390183085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e381a0e40 con 0x7f6e38106030 2024-09-19T08:35:24.375 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.492+0000 7f6e1ffff640 1 -- 172.21.15.7:0/3390183085 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f6e28045070 con 0x7f6e38106030 2024-09-19T08:35:24.375 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.492+0000 7f6e1ffff640 1 --2- 172.21.15.7:0/3390183085 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7f6e200391b0 0x7f6e2003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:24.375 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.492+0000 7f6e1ffff640 1 -- 172.21.15.7:0/3390183085 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6e2806c1e0 con 0x7f6e38106030 2024-09-19T08:35:24.375 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.492+0000 7f6e367fc640 1 --2- 172.21.15.7:0/3390183085 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7f6e200391b0 0x7f6e2003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:24.375 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.492+0000 7f6e3d2cc640 1 -- 172.21.15.7:0/3390183085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e38106430 con 0x7f6e38106030 2024-09-19T08:35:24.375 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.493+0000 7f6e367fc640 1 --2- 172.21.15.7:0/3390183085 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7f6e200391b0 0x7f6e2003b670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0098c0 tx=0x7f6e2c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:24.375 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.497+0000 7f6e1ffff640 1 -- 172.21.15.7:0/3390183085 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6e28045360 con 0x7f6e38106030 2024-09-19T08:35:24.376 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.741+0000 7f6e3d2cc640 1 -- 172.21.15.7:0/3390183085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6e38197450 con 0x7f6e38106030 2024-09-19T08:35:24.376 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.741+0000 7f6e1ffff640 1 -- 172.21.15.7:0/3390183085 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f6e38197450 con 0x7f6e38106030 2024-09-19T08:35:24.376 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.743+0000 7f6e3d2cc640 1 -- 172.21.15.7:0/3390183085 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7f6e200391b0 msgr2=0x7f6e2003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:24.376 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.743+0000 7f6e3d2cc640 1 --2- 172.21.15.7:0/3390183085 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7f6e200391b0 0x7f6e2003b670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0098c0 tx=0x7f6e2c006db0 comp rx=0 tx=0).stop 2024-09-19T08:35:24.376 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.743+0000 7f6e3d2cc640 1 -- 172.21.15.7:0/3390183085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e38106030 msgr2=0x7f6e3819d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:24.376 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.743+0000 7f6e3d2cc640 1 --2- 172.21.15.7:0/3390183085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e38106030 0x7f6e3819d980 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6e28032ce0 tx=0x7f6e28032d10 comp rx=0 tx=0).stop 2024-09-19T08:35:24.376 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.744+0000 7f6e3d2cc640 1 -- 172.21.15.7:0/3390183085 shutdown_connections 2024-09-19T08:35:24.376 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.744+0000 7f6e3d2cc640 1 --2- 172.21.15.7:0/3390183085 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7f6e200391b0 0x7f6e2003b670 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:24.376 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.744+0000 7f6e3d2cc640 1 --2- 172.21.15.7:0/3390183085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e38106030 0x7f6e3819d980 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:24.376 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.744+0000 7f6e3d2cc640 1 -- 172.21.15.7:0/3390183085 >> 172.21.15.7:0/3390183085 conn(0x7f6e38101e60 msgr2=0x7f6e38194620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:24.376 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.744+0000 7f6e3d2cc640 1 -- 172.21.15.7:0/3390183085 shutdown_connections 2024-09-19T08:35:24.376 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:23.744+0000 7f6e3d2cc640 1 -- 172.21.15.7:0/3390183085 wait complete. 2024-09-19T08:35:24.376 INFO:teuthology.orchestra.run.smithi007.stdout:mgr is available 2024-09-19T08:35:25.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:24 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/499982642' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T08:35:25.487 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:25.494 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T08:35:25.494 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout fsid = ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:35:25.494 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.7:3300,v1:172.21.15.7:6789] 2024-09-19T08:35:25.494 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T08:35:25.494 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T08:35:25.494 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T08:35:25.494 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T08:35:25.494 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:25.494 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T08:35:25.494 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T08:35:25.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T08:35:25.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T08:35:25.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T08:35:25.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T08:35:25.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T08:35:25.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T08:35:25.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T08:35:25.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.700+0000 7fcae5790640 1 Processor -- start 2024-09-19T08:35:25.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.700+0000 7fcae5790640 1 -- start start 2024-09-19T08:35:25.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.700+0000 7fcae5790640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcae01066d0 0x7fcae0106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:25.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.700+0000 7fcae5790640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcae01070a0 con 0x7fcae01066d0 2024-09-19T08:35:25.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.701+0000 7fcadeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcae01066d0 0x7fcae0106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:25.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.701+0000 7fcadeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcae01066d0 0x7fcae0106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34126/0 (socket says 172.21.15.7:34126) 2024-09-19T08:35:25.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.701+0000 7fcadeffd640 1 -- 172.21.15.7:0/2349345115 learned_addr learned my addr 172.21.15.7:0/2349345115 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:25.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.701+0000 7fcadeffd640 1 -- 172.21.15.7:0/2349345115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae01078d0 con 0x7fcae01066d0 2024-09-19T08:35:25.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.702+0000 7fcadeffd640 1 --2- 172.21.15.7:0/2349345115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcae01066d0 0x7fcae0106ad0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcad0009e80 tx=0x7fcad002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e4cc86c6cfa2fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:25.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.702+0000 7fcaddffb640 1 -- 172.21.15.7:0/2349345115 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcad0036070 con 0x7fcae01066d0 2024-09-19T08:35:25.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.702+0000 7fcaddffb640 1 -- 172.21.15.7:0/2349345115 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcad00318c0 con 0x7fcae01066d0 2024-09-19T08:35:25.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.702+0000 7fcaddffb640 1 -- 172.21.15.7:0/2349345115 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcad0007ab0 con 0x7fcae01066d0 2024-09-19T08:35:25.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.702+0000 7fcae5790640 1 -- 172.21.15.7:0/2349345115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcae01066d0 msgr2=0x7fcae0106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:25.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.702+0000 7fcae5790640 1 --2- 172.21.15.7:0/2349345115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcae01066d0 0x7fcae0106ad0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcad0009e80 tx=0x7fcad002a7a0 comp rx=0 tx=0).stop 2024-09-19T08:35:25.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.702+0000 7fcae5790640 1 -- 172.21.15.7:0/2349345115 shutdown_connections 2024-09-19T08:35:25.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.702+0000 7fcae5790640 1 --2- 172.21.15.7:0/2349345115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcae01066d0 0x7fcae0106ad0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:25.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.702+0000 7fcae5790640 1 -- 172.21.15.7:0/2349345115 >> 172.21.15.7:0/2349345115 conn(0x7fcae0101e60 msgr2=0x7fcae01042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:25.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.702+0000 7fcae5790640 1 -- 172.21.15.7:0/2349345115 shutdown_connections 2024-09-19T08:35:25.497 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.702+0000 7fcae5790640 1 -- 172.21.15.7:0/2349345115 wait complete. 2024-09-19T08:35:25.497 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.703+0000 7fcae5790640 1 Processor -- start 2024-09-19T08:35:25.497 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.703+0000 7fcae5790640 1 -- start start 2024-09-19T08:35:25.497 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.703+0000 7fcae5790640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcae01066d0 0x7fcae007ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:25.497 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.703+0000 7fcae5790640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcae010ac80 con 0x7fcae01066d0 2024-09-19T08:35:25.497 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.703+0000 7fcadeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcae01066d0 0x7fcae007ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:25.497 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.703+0000 7fcadeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcae01066d0 0x7fcae007ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34138/0 (socket says 172.21.15.7:34138) 2024-09-19T08:35:25.497 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.703+0000 7fcadeffd640 1 -- 172.21.15.7:0/499982642 learned_addr learned my addr 172.21.15.7:0/499982642 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:25.497 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.704+0000 7fcadeffd640 1 -- 172.21.15.7:0/499982642 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae019e4e0 con 0x7fcae01066d0 2024-09-19T08:35:25.497 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.704+0000 7fcadeffd640 1 --2- 172.21.15.7:0/499982642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcae01066d0 0x7fcae007ba10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcad002ad90 tx=0x7fcad0031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:25.497 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.704+0000 7fcac7fff640 1 -- 172.21.15.7:0/499982642 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcad0036050 con 0x7fcae01066d0 2024-09-19T08:35:25.497 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.704+0000 7fcae5790640 1 -- 172.21.15.7:0/499982642 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcae019e6b0 con 0x7fcae01066d0 2024-09-19T08:35:25.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.704+0000 7fcac7fff640 1 -- 172.21.15.7:0/499982642 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcad0042070 con 0x7fcae01066d0 2024-09-19T08:35:25.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.704+0000 7fcac7fff640 1 -- 172.21.15.7:0/499982642 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcad003d7e0 con 0x7fcae01066d0 2024-09-19T08:35:25.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.704+0000 7fcae5790640 1 -- 172.21.15.7:0/499982642 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcae019ead0 con 0x7fcae01066d0 2024-09-19T08:35:25.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.705+0000 7fcac7fff640 1 -- 172.21.15.7:0/499982642 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7fcad003dae0 con 0x7fcae01066d0 2024-09-19T08:35:25.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.705+0000 7fcae5790640 1 -- 172.21.15.7:0/499982642 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcae0106b50 con 0x7fcae01066d0 2024-09-19T08:35:25.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.705+0000 7fcac7fff640 1 --2- 172.21.15.7:0/499982642 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7fcac8039160 0x7fcac803b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:25.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.706+0000 7fcac7fff640 1 -- 172.21.15.7:0/499982642 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcad0007e00 con 0x7fcae01066d0 2024-09-19T08:35:25.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.706+0000 7fcade7fc640 1 --2- 172.21.15.7:0/499982642 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7fcac8039160 0x7fcac803b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:25.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.706+0000 7fcade7fc640 1 --2- 172.21.15.7:0/499982642 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7fcac8039160 0x7fcac803b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcad40098c0 tx=0x7fcad4006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:25.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.710+0000 7fcac7fff640 1 -- 172.21.15.7:0/499982642 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcad0039de0 con 0x7fcae01066d0 2024-09-19T08:35:25.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.884+0000 7fcae5790640 1 -- 172.21.15.7:0/499982642 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fcae01a04e0 con 0x7fcae01066d0 2024-09-19T08:35:25.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.885+0000 7fcac7fff640 1 -- 172.21.15.7:0/499982642 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+427 (secure 0 0 0) 0x7fcad003c9c0 con 0x7fcae01066d0 2024-09-19T08:35:25.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.887+0000 7fcae5790640 1 -- 172.21.15.7:0/499982642 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7fcac8039160 msgr2=0x7fcac803b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:25.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.887+0000 7fcae5790640 1 --2- 172.21.15.7:0/499982642 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7fcac8039160 0x7fcac803b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcad40098c0 tx=0x7fcad4006db0 comp rx=0 tx=0).stop 2024-09-19T08:35:25.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.887+0000 7fcae5790640 1 -- 172.21.15.7:0/499982642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcae01066d0 msgr2=0x7fcae007ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:25.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.887+0000 7fcae5790640 1 --2- 172.21.15.7:0/499982642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcae01066d0 0x7fcae007ba10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcad002ad90 tx=0x7fcad0031ca0 comp rx=0 tx=0).stop 2024-09-19T08:35:25.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.887+0000 7fcae5790640 1 -- 172.21.15.7:0/499982642 shutdown_connections 2024-09-19T08:35:25.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.887+0000 7fcae5790640 1 --2- 172.21.15.7:0/499982642 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7fcac8039160 0x7fcac803b620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:25.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.887+0000 7fcae5790640 1 --2- 172.21.15.7:0/499982642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcae01066d0 0x7fcae007ba10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:25.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.887+0000 7fcae5790640 1 -- 172.21.15.7:0/499982642 >> 172.21.15.7:0/499982642 conn(0x7fcae0101e60 msgr2=0x7fcae0102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:25.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.887+0000 7fcae5790640 1 -- 172.21.15.7:0/499982642 shutdown_connections 2024-09-19T08:35:25.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:24.887+0000 7fcae5790640 1 -- 172.21.15.7:0/499982642 wait complete. 2024-09-19T08:35:25.499 INFO:teuthology.orchestra.run.smithi007.stdout:Enabling cephadm module... 2024-09-19T08:35:26.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:26 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3445231473' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T08:35:26.851 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:26 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: ignoring --setuser ceph since I am not root 2024-09-19T08:35:26.851 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:26 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: ignoring --setgroup ceph since I am not root 2024-09-19T08:35:26.851 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:26 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:26.790+0000 7f0b8eac0040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:35:26.851 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:26 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:26.849+0000 7f0b8eac0040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:35:27.230 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:27 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:27.005+0000 7f0b8eac0040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:35:27.230 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:27 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:27.075+0000 7f0b8eac0040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:35:27.231 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:27 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:27.229+0000 7f0b8eac0040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:35:27.281 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.362+0000 7fd6f3048640 1 Processor -- start 2024-09-19T08:35:27.281 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.362+0000 7fd6f3048640 1 -- start start 2024-09-19T08:35:27.281 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.362+0000 7fd6f3048640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6ec1077d0 0x7fd6ec107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:27.281 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.362+0000 7fd6f3048640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ec1081a0 con 0x7fd6ec1077d0 2024-09-19T08:35:27.281 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.363+0000 7fd6f0de4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6ec1077d0 0x7fd6ec107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:27.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.363+0000 7fd6f0de4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6ec1077d0 0x7fd6ec107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34146/0 (socket says 172.21.15.7:34146) 2024-09-19T08:35:27.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.363+0000 7fd6f0de4640 1 -- 172.21.15.7:0/3955188679 learned_addr learned my addr 172.21.15.7:0/3955188679 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:27.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.363+0000 7fd6f0de4640 1 -- 172.21.15.7:0/3955188679 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6ec1089d0 con 0x7fd6ec1077d0 2024-09-19T08:35:27.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.364+0000 7fd6f0de4640 1 --2- 172.21.15.7:0/3955188679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6ec1077d0 0x7fd6ec107bd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009820 tx=0x7fd6e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5235f47562762d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:27.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.364+0000 7fd6eb7fe640 1 -- 172.21.15.7:0/3955188679 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6e0037070 con 0x7fd6ec1077d0 2024-09-19T08:35:27.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.364+0000 7fd6eb7fe640 1 -- 172.21.15.7:0/3955188679 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd6e0032900 con 0x7fd6ec1077d0 2024-09-19T08:35:27.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.364+0000 7fd6eb7fe640 1 -- 172.21.15.7:0/3955188679 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6e0030850 con 0x7fd6ec1077d0 2024-09-19T08:35:27.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.364+0000 7fd6f3048640 1 -- 172.21.15.7:0/3955188679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6ec1077d0 msgr2=0x7fd6ec107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:27.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.364+0000 7fd6f3048640 1 --2- 172.21.15.7:0/3955188679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6ec1077d0 0x7fd6ec107bd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009820 tx=0x7fd6e002a270 comp rx=0 tx=0).stop 2024-09-19T08:35:27.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.365+0000 7fd6f3048640 1 -- 172.21.15.7:0/3955188679 shutdown_connections 2024-09-19T08:35:27.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.365+0000 7fd6f3048640 1 --2- 172.21.15.7:0/3955188679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6ec1077d0 0x7fd6ec107bd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:27.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.365+0000 7fd6f3048640 1 -- 172.21.15.7:0/3955188679 >> 172.21.15.7:0/3955188679 conn(0x7fd6ec102f60 msgr2=0x7fd6ec1053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:27.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.365+0000 7fd6f3048640 1 -- 172.21.15.7:0/3955188679 shutdown_connections 2024-09-19T08:35:27.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.365+0000 7fd6f3048640 1 -- 172.21.15.7:0/3955188679 wait complete. 2024-09-19T08:35:27.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.365+0000 7fd6f3048640 1 Processor -- start 2024-09-19T08:35:27.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.365+0000 7fd6f3048640 1 -- start start 2024-09-19T08:35:27.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.366+0000 7fd6f3048640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6ec1077d0 0x7fd6ec1995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:27.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.366+0000 7fd6f3048640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ec07c060 con 0x7fd6ec1077d0 2024-09-19T08:35:27.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.366+0000 7fd6f0de4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6ec1077d0 0x7fd6ec1995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:27.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.366+0000 7fd6f0de4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6ec1077d0 0x7fd6ec1995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34150/0 (socket says 172.21.15.7:34150) 2024-09-19T08:35:27.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.366+0000 7fd6f0de4640 1 -- 172.21.15.7:0/3445231473 learned_addr learned my addr 172.21.15.7:0/3445231473 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:27.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.366+0000 7fd6f0de4640 1 -- 172.21.15.7:0/3445231473 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6ec199b00 con 0x7fd6ec1077d0 2024-09-19T08:35:27.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.366+0000 7fd6f0de4640 1 --2- 172.21.15.7:0/3445231473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6ec1077d0 0x7fd6ec1995c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009940 tx=0x7fd6e0032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:27.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.366+0000 7fd6e9ffb640 1 -- 172.21.15.7:0/3445231473 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6e0042070 con 0x7fd6ec1077d0 2024-09-19T08:35:27.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.366+0000 7fd6e9ffb640 1 -- 172.21.15.7:0/3445231473 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd6e00308c0 con 0x7fd6ec1077d0 2024-09-19T08:35:27.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.366+0000 7fd6f3048640 1 -- 172.21.15.7:0/3445231473 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6ec199d90 con 0x7fd6ec1077d0 2024-09-19T08:35:27.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.366+0000 7fd6e9ffb640 1 -- 172.21.15.7:0/3445231473 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6e0037040 con 0x7fd6ec1077d0 2024-09-19T08:35:27.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.367+0000 7fd6f3048640 1 -- 172.21.15.7:0/3445231473 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6ec19ca80 con 0x7fd6ec1077d0 2024-09-19T08:35:27.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.368+0000 7fd6e9ffb640 1 -- 172.21.15.7:0/3445231473 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7fd6e0045070 con 0x7fd6ec1077d0 2024-09-19T08:35:27.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.368+0000 7fd6f3048640 1 -- 172.21.15.7:0/3445231473 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6ec107c50 con 0x7fd6ec1077d0 2024-09-19T08:35:27.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.368+0000 7fd6e9ffb640 1 --2- 172.21.15.7:0/3445231473 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7fd6dc03d610 0x7fd6dc03fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:27.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.368+0000 7fd6e9ffb640 1 -- 172.21.15.7:0/3445231473 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd6e006c140 con 0x7fd6ec1077d0 2024-09-19T08:35:27.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.368+0000 7fd6ebfff640 1 --2- 172.21.15.7:0/3445231473 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7fd6dc03d610 0x7fd6dc03fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:27.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.369+0000 7fd6ebfff640 1 --2- 172.21.15.7:0/3445231473 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7fd6dc03d610 0x7fd6dc03fad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80098c0 tx=0x7fd6d8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:27.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.373+0000 7fd6e9ffb640 1 -- 172.21.15.7:0/3445231473 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd6e004b170 con 0x7fd6ec1077d0 2024-09-19T08:35:27.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.595+0000 7fd6f3048640 1 -- 172.21.15.7:0/3445231473 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fd6ec02da40 con 0x7fd6ec1077d0 2024-09-19T08:35:27.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.647+0000 7fd6e9ffb640 1 -- 172.21.15.7:0/3445231473 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fd6e002fd90 con 0x7fd6ec1077d0 2024-09-19T08:35:27.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.648+0000 7fd6e9ffb640 1 -- 172.21.15.7:0/3445231473 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fd6e00327b0 con 0x7fd6ec1077d0 2024-09-19T08:35:27.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.649+0000 7fd6f3048640 1 -- 172.21.15.7:0/3445231473 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7fd6dc03d610 msgr2=0x7fd6dc03fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:27.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.649+0000 7fd6f3048640 1 --2- 172.21.15.7:0/3445231473 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7fd6dc03d610 0x7fd6dc03fad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80098c0 tx=0x7fd6d8006db0 comp rx=0 tx=0).stop 2024-09-19T08:35:27.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.649+0000 7fd6f3048640 1 -- 172.21.15.7:0/3445231473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6ec1077d0 msgr2=0x7fd6ec1995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:27.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.649+0000 7fd6f3048640 1 --2- 172.21.15.7:0/3445231473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6ec1077d0 0x7fd6ec1995c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009940 tx=0x7fd6e0032ce0 comp rx=0 tx=0).stop 2024-09-19T08:35:27.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.650+0000 7fd6f3048640 1 -- 172.21.15.7:0/3445231473 shutdown_connections 2024-09-19T08:35:27.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.650+0000 7fd6f3048640 1 --2- 172.21.15.7:0/3445231473 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7fd6dc03d610 0x7fd6dc03fad0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:27.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.650+0000 7fd6f3048640 1 --2- 172.21.15.7:0/3445231473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6ec1077d0 0x7fd6ec1995c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:27.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.650+0000 7fd6f3048640 1 -- 172.21.15.7:0/3445231473 >> 172.21.15.7:0/3445231473 conn(0x7fd6ec102f60 msgr2=0x7fd6ec1041f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:27.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.650+0000 7fd6f3048640 1 -- 172.21.15.7:0/3445231473 shutdown_connections 2024-09-19T08:35:27.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:26.650+0000 7fd6f3048640 1 -- 172.21.15.7:0/3445231473 wait complete. 2024-09-19T08:35:27.524 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:27 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:27.386+0000 7f0b8eac0040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:35:27.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:27 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3445231473' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T08:35:27.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:27 smithi007 ceph-mon[31221]: mgrmap e5: x(active, since 12s) 2024-09-19T08:35:27.783 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:27 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:27.721+0000 7f0b8eac0040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:35:28.247 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:27 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:27.785+0000 7f0b8eac0040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:35:28.247 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:27 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:27.983+0000 7f0b8eac0040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:35:28.513 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:35:28.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T08:35:28.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:35:28.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T08:35:28.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T08:35:28.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:35:28.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.706+0000 7fcfa6760640 1 Processor -- start 2024-09-19T08:35:28.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.706+0000 7fcfa6760640 1 -- start start 2024-09-19T08:35:28.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.707+0000 7fcfa6760640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa01066d0 0x7fcfa0106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:28.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.707+0000 7fcfa6760640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa01070a0 con 0x7fcfa01066d0 2024-09-19T08:35:28.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.707+0000 7fcf9ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa01066d0 0x7fcfa0106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:28.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.707+0000 7fcf9ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa01066d0 0x7fcfa0106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34180/0 (socket says 172.21.15.7:34180) 2024-09-19T08:35:28.515 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.707+0000 7fcf9ffff640 1 -- 172.21.15.7:0/2885912011 learned_addr learned my addr 172.21.15.7:0/2885912011 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:28.515 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.707+0000 7fcf9ffff640 1 -- 172.21.15.7:0/2885912011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa01078d0 con 0x7fcfa01066d0 2024-09-19T08:35:28.515 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.708+0000 7fcf9ffff640 1 --2- 172.21.15.7:0/2885912011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa01066d0 0x7fcfa0106ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009820 tx=0x7fcf9002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53dea36aabfc18e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:28.515 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.708+0000 7fcf9f7fe640 1 -- 172.21.15.7:0/2885912011 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf90037070 con 0x7fcfa01066d0 2024-09-19T08:35:28.515 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.708+0000 7fcf9f7fe640 1 -- 172.21.15.7:0/2885912011 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcf90032900 con 0x7fcfa01066d0 2024-09-19T08:35:28.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.708+0000 7fcf9f7fe640 1 -- 172.21.15.7:0/2885912011 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf90030850 con 0x7fcfa01066d0 2024-09-19T08:35:28.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.709+0000 7fcfa6760640 1 -- 172.21.15.7:0/2885912011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa01066d0 msgr2=0x7fcfa0106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:28.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.709+0000 7fcfa6760640 1 --2- 172.21.15.7:0/2885912011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa01066d0 0x7fcfa0106ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009820 tx=0x7fcf9002a270 comp rx=0 tx=0).stop 2024-09-19T08:35:28.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.709+0000 7fcfa6760640 1 -- 172.21.15.7:0/2885912011 shutdown_connections 2024-09-19T08:35:28.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.709+0000 7fcfa6760640 1 --2- 172.21.15.7:0/2885912011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa01066d0 0x7fcfa0106ad0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:28.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.709+0000 7fcfa6760640 1 -- 172.21.15.7:0/2885912011 >> 172.21.15.7:0/2885912011 conn(0x7fcfa0101e60 msgr2=0x7fcfa01042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:28.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.709+0000 7fcfa6760640 1 -- 172.21.15.7:0/2885912011 shutdown_connections 2024-09-19T08:35:28.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.709+0000 7fcfa6760640 1 -- 172.21.15.7:0/2885912011 wait complete. 2024-09-19T08:35:28.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.709+0000 7fcfa6760640 1 Processor -- start 2024-09-19T08:35:28.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.709+0000 7fcfa6760640 1 -- start start 2024-09-19T08:35:28.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.710+0000 7fcfa6760640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa01066d0 0x7fcfa0191890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:28.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.710+0000 7fcfa6760640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa010ac80 con 0x7fcfa01066d0 2024-09-19T08:35:28.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.710+0000 7fcf9ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa01066d0 0x7fcfa0191890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:28.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.710+0000 7fcf9ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa01066d0 0x7fcfa0191890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34184/0 (socket says 172.21.15.7:34184) 2024-09-19T08:35:28.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.710+0000 7fcf9ffff640 1 -- 172.21.15.7:0/3883694384 learned_addr learned my addr 172.21.15.7:0/3883694384 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:28.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.710+0000 7fcf9ffff640 1 -- 172.21.15.7:0/3883694384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa0191dd0 con 0x7fcfa01066d0 2024-09-19T08:35:28.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.710+0000 7fcf9ffff640 1 --2- 172.21.15.7:0/3883694384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa01066d0 0x7fcfa0191890 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009940 tx=0x7fcf90032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:28.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.710+0000 7fcf9dffb640 1 -- 172.21.15.7:0/3883694384 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf90042070 con 0x7fcfa01066d0 2024-09-19T08:35:28.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.710+0000 7fcf9dffb640 1 -- 172.21.15.7:0/3883694384 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcf900308c0 con 0x7fcfa01066d0 2024-09-19T08:35:28.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.710+0000 7fcfa6760640 1 -- 172.21.15.7:0/3883694384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfa018ffc0 con 0x7fcfa01066d0 2024-09-19T08:35:28.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.710+0000 7fcf9dffb640 1 -- 172.21.15.7:0/3883694384 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf90037040 con 0x7fcfa01066d0 2024-09-19T08:35:28.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.710+0000 7fcfa6760640 1 -- 172.21.15.7:0/3883694384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfa0190500 con 0x7fcfa01066d0 2024-09-19T08:35:28.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.711+0000 7fcf9dffb640 1 -- 172.21.15.7:0/3883694384 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fcf90045070 con 0x7fcfa01066d0 2024-09-19T08:35:28.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.711+0000 7fcfa6760640 1 -- 172.21.15.7:0/3883694384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfa0106b50 con 0x7fcfa01066d0 2024-09-19T08:35:28.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.711+0000 7fcf9dffb640 1 --2- 172.21.15.7:0/3883694384 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7fcf8c039200 0x7fcf8c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:28.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.712+0000 7fcf9dffb640 1 -- 172.21.15.7:0/3883694384 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcf9006c490 con 0x7fcfa01066d0 2024-09-19T08:35:28.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.712+0000 7fcf97fff640 1 -- 172.21.15.7:0/3883694384 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7fcf8c039200 msgr2=0x7fcf8c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/1689067491 2024-09-19T08:35:28.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.712+0000 7fcf97fff640 1 --2- 172.21.15.7:0/3883694384 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7fcf8c039200 0x7fcf8c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:35:28.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.716+0000 7fcf9dffb640 1 -- 172.21.15.7:0/3883694384 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcf90045360 con 0x7fcfa01066d0 2024-09-19T08:35:28.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.913+0000 7fcf97fff640 1 -- 172.21.15.7:0/3883694384 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7fcf8c039200 msgr2=0x7fcf8c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/1689067491 2024-09-19T08:35:28.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.913+0000 7fcf97fff640 1 --2- 172.21.15.7:0/3883694384 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7fcf8c039200 0x7fcf8c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:35:28.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.941+0000 7fcfa6760640 1 -- 172.21.15.7:0/3883694384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fcfa0195680 con 0x7fcfa01066d0 2024-09-19T08:35:28.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.942+0000 7fcf9dffb640 1 -- 172.21.15.7:0/3883694384 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fcf9006beb0 con 0x7fcfa01066d0 2024-09-19T08:35:28.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.944+0000 7fcfa6760640 1 -- 172.21.15.7:0/3883694384 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7fcf8c039200 msgr2=0x7fcf8c03b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:35:28.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.944+0000 7fcfa6760640 1 --2- 172.21.15.7:0/3883694384 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7fcf8c039200 0x7fcf8c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:28.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.944+0000 7fcfa6760640 1 -- 172.21.15.7:0/3883694384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa01066d0 msgr2=0x7fcfa0191890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:28.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.944+0000 7fcfa6760640 1 --2- 172.21.15.7:0/3883694384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa01066d0 0x7fcfa0191890 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009940 tx=0x7fcf90032ce0 comp rx=0 tx=0).stop 2024-09-19T08:35:28.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.944+0000 7fcfa6760640 1 -- 172.21.15.7:0/3883694384 shutdown_connections 2024-09-19T08:35:28.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.944+0000 7fcfa6760640 1 --2- 172.21.15.7:0/3883694384 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7fcf8c039200 0x7fcf8c03b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:28.519 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.944+0000 7fcfa6760640 1 --2- 172.21.15.7:0/3883694384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa01066d0 0x7fcfa0191890 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:28.519 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.944+0000 7fcfa6760640 1 -- 172.21.15.7:0/3883694384 >> 172.21.15.7:0/3883694384 conn(0x7fcfa0101e60 msgr2=0x7fcfa0102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:28.519 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.944+0000 7fcfa6760640 1 -- 172.21.15.7:0/3883694384 shutdown_connections 2024-09-19T08:35:28.519 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:27.944+0000 7fcfa6760640 1 -- 172.21.15.7:0/3883694384 wait complete. 2024-09-19T08:35:28.519 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for the mgr to restart... 2024-09-19T08:35:28.519 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr epoch 5... 2024-09-19T08:35:28.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:28 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3883694384' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T08:35:29.145 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:28 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:28.925+0000 7f0b8eac0040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:35:29.145 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:28 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:28.996+0000 7f0b8eac0040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:35:29.868 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:29 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:29.747+0000 7f0b8eac0040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:35:29.868 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:29 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:29.868+0000 7f0b8eac0040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:35:30.238 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:30 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:30.018+0000 7f0b8eac0040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:35:30.238 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:30 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:30.082+0000 7f0b8eac0040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:35:30.238 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:30 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:30.238+0000 7f0b8eac0040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:35:30.533 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:30 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:30.308+0000 7f0b8eac0040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:35:30.533 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:30 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:30.371+0000 7f0b8eac0040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:35:30.821 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:30 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:30.536+0000 7f0b8eac0040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:35:30.821 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:30 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:30.603+0000 7f0b8eac0040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:35:30.821 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:30 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:30.673+0000 7f0b8eac0040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:35:30.821 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:30 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:30.759+0000 7f0b8eac0040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:35:30.821 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:30 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:30.821+0000 7f0b8eac0040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:35:31.283 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:30 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:30.882+0000 7f0b8eac0040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:35:32.033 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:31 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:31.709+0000 7f0b8eac0040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:35:32.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:31 smithi007 ceph-mon[31221]: Active manager daemon x restarted 2024-09-19T08:35:32.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:31 smithi007 ceph-mon[31221]: Activating manager daemon x 2024-09-19T08:35:32.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:31 smithi007 ceph-mon[31221]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T08:35:32.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:31 smithi007 ceph-mon[31221]: mgrmap e6: x(active, starting, since 0.00357726s) 2024-09-19T08:35:32.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:31 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:35:32.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:31 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:35:32.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:31 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:35:32.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:31 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:35:32.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:31 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:35:32.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:31 smithi007 ceph-mon[31221]: Manager daemon x is now available 2024-09-19T08:35:32.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:31 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' 2024-09-19T08:35:32.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:31 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' 2024-09-19T08:35:32.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:31 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:35:32.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:31 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:35:32.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:31 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:35:32.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:31 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:35:33.421 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:35:33.421 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T08:35:33.421 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T08:35:33.421 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:35:33.422 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.938+0000 7f950fb0e640 1 Processor -- start 2024-09-19T08:35:33.422 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.938+0000 7f950fb0e640 1 -- start start 2024-09-19T08:35:33.422 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.939+0000 7f950fb0e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95081066f0 0x7f9508106af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:33.422 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.939+0000 7f950fb0e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f95081070c0 con 0x7f95081066f0 2024-09-19T08:35:33.422 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.939+0000 7f950d8aa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95081066f0 0x7f9508106af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:33.422 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.939+0000 7f950d8aa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95081066f0 0x7f9508106af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34198/0 (socket says 172.21.15.7:34198) 2024-09-19T08:35:33.422 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.939+0000 7f950d8aa640 1 -- 172.21.15.7:0/12994489 learned_addr learned my addr 172.21.15.7:0/12994489 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:33.422 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.939+0000 7f950d8aa640 1 -- 172.21.15.7:0/12994489 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95081078f0 con 0x7f95081066f0 2024-09-19T08:35:33.422 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.940+0000 7f950d8aa640 1 --2- 172.21.15.7:0/12994489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95081066f0 0x7f9508106af0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9504009820 tx=0x7f950402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29eeea4560f1f6e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:33.423 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.940+0000 7f950c8a8640 1 -- 172.21.15.7:0/12994489 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9504037070 con 0x7f95081066f0 2024-09-19T08:35:33.423 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.940+0000 7f950c8a8640 1 -- 172.21.15.7:0/12994489 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9504032900 con 0x7f95081066f0 2024-09-19T08:35:33.423 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.940+0000 7f950c8a8640 1 -- 172.21.15.7:0/12994489 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9504030850 con 0x7f95081066f0 2024-09-19T08:35:33.423 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.941+0000 7f950fb0e640 1 -- 172.21.15.7:0/12994489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95081066f0 msgr2=0x7f9508106af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:33.423 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.941+0000 7f950fb0e640 1 --2- 172.21.15.7:0/12994489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95081066f0 0x7f9508106af0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9504009820 tx=0x7f950402a270 comp rx=0 tx=0).stop 2024-09-19T08:35:33.423 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.941+0000 7f950fb0e640 1 -- 172.21.15.7:0/12994489 shutdown_connections 2024-09-19T08:35:33.423 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.941+0000 7f950fb0e640 1 --2- 172.21.15.7:0/12994489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95081066f0 0x7f9508106af0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:33.423 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.941+0000 7f950fb0e640 1 -- 172.21.15.7:0/12994489 >> 172.21.15.7:0/12994489 conn(0x7f9508101e80 msgr2=0x7f95081042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:33.423 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.941+0000 7f950fb0e640 1 -- 172.21.15.7:0/12994489 shutdown_connections 2024-09-19T08:35:33.423 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.941+0000 7f950fb0e640 1 -- 172.21.15.7:0/12994489 wait complete. 2024-09-19T08:35:33.423 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.941+0000 7f950fb0e640 1 Processor -- start 2024-09-19T08:35:33.423 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.942+0000 7f950fb0e640 1 -- start start 2024-09-19T08:35:33.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.942+0000 7f950fb0e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95081066f0 0x7f950819b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:33.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.942+0000 7f950fb0e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f950810aca0 con 0x7f95081066f0 2024-09-19T08:35:33.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.942+0000 7f950d8aa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95081066f0 0x7f950819b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:33.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.942+0000 7f950d8aa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95081066f0 0x7f950819b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34202/0 (socket says 172.21.15.7:34202) 2024-09-19T08:35:33.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.942+0000 7f950d8aa640 1 -- 172.21.15.7:0/1055599014 learned_addr learned my addr 172.21.15.7:0/1055599014 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:33.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.942+0000 7f950d8aa640 1 -- 172.21.15.7:0/1055599014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f950819bd30 con 0x7f95081066f0 2024-09-19T08:35:33.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.942+0000 7f950d8aa640 1 --2- 172.21.15.7:0/1055599014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95081066f0 0x7f950819b7f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f95040097f0 tx=0x7f9504030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:33.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.942+0000 7f94feffd640 1 -- 172.21.15.7:0/1055599014 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9504037040 con 0x7f95081066f0 2024-09-19T08:35:33.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.943+0000 7f950fb0e640 1 -- 172.21.15.7:0/1055599014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f950819bfc0 con 0x7f95081066f0 2024-09-19T08:35:33.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.943+0000 7f94feffd640 1 -- 172.21.15.7:0/1055599014 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9504040070 con 0x7f95081066f0 2024-09-19T08:35:33.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.943+0000 7f94feffd640 1 -- 172.21.15.7:0/1055599014 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f950403a390 con 0x7f95081066f0 2024-09-19T08:35:33.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.943+0000 7f950fb0e640 1 -- 172.21.15.7:0/1055599014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f950819ecb0 con 0x7f95081066f0 2024-09-19T08:35:33.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.943+0000 7f94feffd640 1 -- 172.21.15.7:0/1055599014 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f950403a630 con 0x7f95081066f0 2024-09-19T08:35:33.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.944+0000 7f94feffd640 1 --2- 172.21.15.7:0/1055599014 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7f94f40391b0 0x7f94f403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:33.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.944+0000 7f94feffd640 1 -- 172.21.15.7:0/1055599014 --> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f94f403bd80 con 0x7f94f40391b0 2024-09-19T08:35:33.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.944+0000 7f94feffd640 1 -- 172.21.15.7:0/1055599014 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f950406c460 con 0x7f95081066f0 2024-09-19T08:35:33.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.944+0000 7f950d0a9640 1 -- 172.21.15.7:0/1055599014 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7f94f40391b0 msgr2=0x7f94f403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/1689067491 2024-09-19T08:35:33.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:28.944+0000 7f950d0a9640 1 --2- 172.21.15.7:0/1055599014 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7f94f40391b0 0x7f94f403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:35:33.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:29.145+0000 7f950d0a9640 1 -- 172.21.15.7:0/1055599014 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7f94f40391b0 msgr2=0x7f94f403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/1689067491 2024-09-19T08:35:33.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:29.145+0000 7f950d0a9640 1 --2- 172.21.15.7:0/1055599014 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7f94f40391b0 0x7f94f403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:35:33.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:29.546+0000 7f950d0a9640 1 -- 172.21.15.7:0/1055599014 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7f94f40391b0 msgr2=0x7f94f403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/1689067491 2024-09-19T08:35:33.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:29.546+0000 7f950d0a9640 1 --2- 172.21.15.7:0/1055599014 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7f94f40391b0 0x7f94f403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T08:35:33.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:30.347+0000 7f950d0a9640 1 -- 172.21.15.7:0/1055599014 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7f94f40391b0 msgr2=0x7f94f403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/1689067491 2024-09-19T08:35:33.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:30.347+0000 7f950d0a9640 1 --2- 172.21.15.7:0/1055599014 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7f94f40391b0 0x7f94f403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T08:35:33.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.713+0000 7f94feffd640 1 -- 172.21.15.7:0/1055599014 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7f950406b260 con 0x7f95081066f0 2024-09-19T08:35:33.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.713+0000 7f94feffd640 1 -- 172.21.15.7:0/1055599014 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7f94f40391b0 msgr2=0x7f94f403b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:35:33.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:31.713+0000 7f94feffd640 1 --2- 172.21.15.7:0/1055599014 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7f94f40391b0 0x7f94f403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:33.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.714+0000 7f94feffd640 1 -- 172.21.15.7:0/1055599014 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f95040457e0 con 0x7f95081066f0 2024-09-19T08:35:33.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.714+0000 7f94feffd640 1 --2- 172.21.15.7:0/1055599014 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f94f403cae0 0x7f94f403eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:33.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.714+0000 7f94feffd640 1 -- 172.21.15.7:0/1055599014 --> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f94f403bd80 con 0x7f94f403cae0 2024-09-19T08:35:33.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.714+0000 7f950d0a9640 1 --2- 172.21.15.7:0/1055599014 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f94f403cae0 0x7f94f403eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:33.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.715+0000 7f950d0a9640 1 --2- 172.21.15.7:0/1055599014 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f94f403cae0 0x7f94f403eed0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f94f8003980 tx=0x7f94f8006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:33.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.716+0000 7f94feffd640 1 -- 172.21.15.7:0/1055599014 <== mgr.14118 v2:172.21.15.7:6800/3071389382 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f94f403bd80 con 0x7f94f403cae0 2024-09-19T08:35:33.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.723+0000 7f950fb0e640 1 -- 172.21.15.7:0/1055599014 --> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f9508106b70 con 0x7f94f403cae0 2024-09-19T08:35:33.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.723+0000 7f94feffd640 1 -- 172.21.15.7:0/1055599014 <== mgr.14118 v2:172.21.15.7:6800/3071389382 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f9508106b70 con 0x7f94f403cae0 2024-09-19T08:35:33.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.723+0000 7f950fb0e640 1 -- 172.21.15.7:0/1055599014 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f94f403cae0 msgr2=0x7f94f403eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:33.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.723+0000 7f950fb0e640 1 --2- 172.21.15.7:0/1055599014 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f94f403cae0 0x7f94f403eed0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f94f8003980 tx=0x7f94f8006e10 comp rx=0 tx=0).stop 2024-09-19T08:35:33.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.723+0000 7f950fb0e640 1 -- 172.21.15.7:0/1055599014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95081066f0 msgr2=0x7f950819b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:33.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.723+0000 7f950fb0e640 1 --2- 172.21.15.7:0/1055599014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95081066f0 0x7f950819b7f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f95040097f0 tx=0x7f9504030d80 comp rx=0 tx=0).stop 2024-09-19T08:35:33.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.723+0000 7f950fb0e640 1 -- 172.21.15.7:0/1055599014 shutdown_connections 2024-09-19T08:35:33.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.723+0000 7f950fb0e640 1 --2- 172.21.15.7:0/1055599014 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f94f403cae0 0x7f94f403eed0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:33.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.723+0000 7f950fb0e640 1 --2- 172.21.15.7:0/1055599014 >> [v2:172.21.15.7:6800/1689067491,v1:172.21.15.7:6801/1689067491] conn(0x7f94f40391b0 0x7f94f403b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:33.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.723+0000 7f950fb0e640 1 --2- 172.21.15.7:0/1055599014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95081066f0 0x7f950819b7f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:33.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.723+0000 7f950fb0e640 1 -- 172.21.15.7:0/1055599014 >> 172.21.15.7:0/1055599014 conn(0x7f9508101e80 msgr2=0x7f9508102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:33.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.724+0000 7f950fb0e640 1 -- 172.21.15.7:0/1055599014 shutdown_connections 2024-09-19T08:35:33.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:32.724+0000 7f950fb0e640 1 -- 172.21.15.7:0/1055599014 wait complete. 2024-09-19T08:35:33.427 INFO:teuthology.orchestra.run.smithi007.stdout:mgr epoch 5 is available 2024-09-19T08:35:33.428 INFO:teuthology.orchestra.run.smithi007.stdout:Setting orchestrator backend to cephadm... 2024-09-19T08:35:33.789 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:33 smithi007 ceph-mon[31221]: Found migration_current of "None". Setting to last migration. 2024-09-19T08:35:33.789 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:33 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' 2024-09-19T08:35:33.789 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:33 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' 2024-09-19T08:35:33.789 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:33 smithi007 ceph-mon[31221]: mgrmap e7: x(active, since 1.00516s) 2024-09-19T08:35:34.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.794+0000 7f6649be0640 1 Processor -- start 2024-09-19T08:35:34.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.794+0000 7f6649be0640 1 -- start start 2024-09-19T08:35:34.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.794+0000 7f6649be0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6644106090 0x7f6644106490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:34.578 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.795+0000 7f6649be0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f664407bdd0 con 0x7f6644106090 2024-09-19T08:35:34.578 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.795+0000 7f66437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6644106090 0x7f6644106490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:34.578 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.795+0000 7f66437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6644106090 0x7f6644106490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56776/0 (socket says 172.21.15.7:56776) 2024-09-19T08:35:34.578 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.795+0000 7f66437fe640 1 -- 172.21.15.7:0/1468821183 learned_addr learned my addr 172.21.15.7:0/1468821183 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:34.578 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.795+0000 7f66437fe640 1 -- 172.21.15.7:0/1468821183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66441069d0 con 0x7f6644106090 2024-09-19T08:35:34.578 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.796+0000 7f66437fe640 1 --2- 172.21.15.7:0/1468821183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6644106090 0x7f6644106490 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6634009820 tx=0x7f663402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc45e2d9ef4c9373 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:34.578 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.796+0000 7f6642ffd640 1 -- 172.21.15.7:0/1468821183 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6634037070 con 0x7f6644106090 2024-09-19T08:35:34.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.796+0000 7f6642ffd640 1 -- 172.21.15.7:0/1468821183 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6634032900 con 0x7f6644106090 2024-09-19T08:35:34.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.796+0000 7f6642ffd640 1 -- 172.21.15.7:0/1468821183 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6634030850 con 0x7f6644106090 2024-09-19T08:35:34.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.796+0000 7f6649be0640 1 -- 172.21.15.7:0/1468821183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6644106090 msgr2=0x7f6644106490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:34.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.796+0000 7f6649be0640 1 --2- 172.21.15.7:0/1468821183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6644106090 0x7f6644106490 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6634009820 tx=0x7f663402a270 comp rx=0 tx=0).stop 2024-09-19T08:35:34.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.797+0000 7f6649be0640 1 -- 172.21.15.7:0/1468821183 shutdown_connections 2024-09-19T08:35:34.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.797+0000 7f6649be0640 1 --2- 172.21.15.7:0/1468821183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6644106090 0x7f6644106490 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:34.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.797+0000 7f6649be0640 1 -- 172.21.15.7:0/1468821183 >> 172.21.15.7:0/1468821183 conn(0x7f6644101e60 msgr2=0x7f66441042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:34.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.797+0000 7f6649be0640 1 -- 172.21.15.7:0/1468821183 shutdown_connections 2024-09-19T08:35:34.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.797+0000 7f6649be0640 1 -- 172.21.15.7:0/1468821183 wait complete. 2024-09-19T08:35:34.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.797+0000 7f6649be0640 1 Processor -- start 2024-09-19T08:35:34.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.797+0000 7f6649be0640 1 -- start start 2024-09-19T08:35:34.580 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.798+0000 7f6649be0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6644106090 0x7f664419d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:34.580 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.798+0000 7f6649be0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6644107a60 con 0x7f6644106090 2024-09-19T08:35:34.580 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.798+0000 7f66437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6644106090 0x7f664419d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:34.580 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.798+0000 7f66437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6644106090 0x7f664419d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56784/0 (socket says 172.21.15.7:56784) 2024-09-19T08:35:34.580 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.798+0000 7f66437fe640 1 -- 172.21.15.7:0/4066314050 learned_addr learned my addr 172.21.15.7:0/4066314050 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:34.580 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.798+0000 7f66437fe640 1 -- 172.21.15.7:0/4066314050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f664419dea0 con 0x7f6644106090 2024-09-19T08:35:34.580 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.798+0000 7f66437fe640 1 --2- 172.21.15.7:0/4066314050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6644106090 0x7f664419d960 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f66340097f0 tx=0x7f6634030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:34.580 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.798+0000 7f66417fa640 1 -- 172.21.15.7:0/4066314050 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6634037040 con 0x7f6644106090 2024-09-19T08:35:34.580 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.798+0000 7f66417fa640 1 -- 172.21.15.7:0/4066314050 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6634040070 con 0x7f6644106090 2024-09-19T08:35:34.580 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.798+0000 7f6649be0640 1 -- 172.21.15.7:0/4066314050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f664419e130 con 0x7f6644106090 2024-09-19T08:35:34.580 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.798+0000 7f66417fa640 1 -- 172.21.15.7:0/4066314050 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f663403a390 con 0x7f6644106090 2024-09-19T08:35:34.581 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.798+0000 7f6649be0640 1 -- 172.21.15.7:0/4066314050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66441a0e20 con 0x7f6644106090 2024-09-19T08:35:34.581 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.799+0000 7f66417fa640 1 -- 172.21.15.7:0/4066314050 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f663403a5e0 con 0x7f6644106090 2024-09-19T08:35:34.581 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.799+0000 7f6649be0640 1 -- 172.21.15.7:0/4066314050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6644106490 con 0x7f6644106090 2024-09-19T08:35:34.581 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.800+0000 7f66417fa640 1 --2- 172.21.15.7:0/4066314050 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f66300390f0 0x7f663003b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:34.581 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.800+0000 7f66417fa640 1 -- 172.21.15.7:0/4066314050 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f663406c6f0 con 0x7f6644106090 2024-09-19T08:35:34.581 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.800+0000 7f663affd640 1 --2- 172.21.15.7:0/4066314050 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f66300390f0 0x7f663003b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:34.582 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.800+0000 7f663affd640 1 --2- 172.21.15.7:0/4066314050 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f66300390f0 0x7f663003b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f662c0098c0 tx=0x7f662c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:34.582 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.805+0000 7f66417fa640 1 -- 172.21.15.7:0/4066314050 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6634043360 con 0x7f6644106090 2024-09-19T08:35:34.582 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.993+0000 7f6649be0640 1 -- 172.21.15.7:0/4066314050 --> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f664402db70 con 0x7f66300390f0 2024-09-19T08:35:34.582 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:33.998+0000 7f66417fa640 1 -- 172.21.15.7:0/4066314050 <== mgr.14118 v2:172.21.15.7:6800/3071389382 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f664402db70 con 0x7f66300390f0 2024-09-19T08:35:34.582 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.000+0000 7f6649be0640 1 -- 172.21.15.7:0/4066314050 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f66300390f0 msgr2=0x7f663003b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:34.582 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.000+0000 7f6649be0640 1 --2- 172.21.15.7:0/4066314050 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f66300390f0 0x7f663003b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f662c0098c0 tx=0x7f662c006db0 comp rx=0 tx=0).stop 2024-09-19T08:35:34.582 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.000+0000 7f6649be0640 1 -- 172.21.15.7:0/4066314050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6644106090 msgr2=0x7f664419d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:34.582 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.000+0000 7f6649be0640 1 --2- 172.21.15.7:0/4066314050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6644106090 0x7f664419d960 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f66340097f0 tx=0x7f6634030d80 comp rx=0 tx=0).stop 2024-09-19T08:35:34.582 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.000+0000 7f6649be0640 1 -- 172.21.15.7:0/4066314050 shutdown_connections 2024-09-19T08:35:34.582 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.000+0000 7f6649be0640 1 --2- 172.21.15.7:0/4066314050 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f66300390f0 0x7f663003b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:34.583 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.000+0000 7f6649be0640 1 --2- 172.21.15.7:0/4066314050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6644106090 0x7f664419d960 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:34.583 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.000+0000 7f6649be0640 1 -- 172.21.15.7:0/4066314050 >> 172.21.15.7:0/4066314050 conn(0x7f6644101e60 msgr2=0x7f6644194640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:34.583 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.000+0000 7f6649be0640 1 -- 172.21.15.7:0/4066314050 shutdown_connections 2024-09-19T08:35:34.583 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.000+0000 7f6649be0640 1 -- 172.21.15.7:0/4066314050 wait complete. 2024-09-19T08:35:34.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:34 smithi007 ceph-mon[31221]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T08:35:34.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:34 smithi007 ceph-mon[31221]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T08:35:34.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:34 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' 2024-09-19T08:35:34.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:34 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:35:35.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-mon[31221]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:35:35.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-mon[31221]: mgrmap e8: x(active, since 2s) 2024-09-19T08:35:35.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:35:35.785 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:35.464+0000 7f0af5dda640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:08:35:35] ENGINE Error in HTTPServer.serve 2024-09-19T08:35:35.785 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: Traceback (most recent call last): 2024-09-19T08:35:35.785 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:35:35.786 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: self._connections.run(self.expiration_interval) 2024-09-19T08:35:35.786 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:35:35.786 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: self._run(expiration_interval) 2024-09-19T08:35:35.786 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:35:35.786 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:35:35.786 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:35:35.786 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:35:35.786 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:35:35.786 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: s = self.context.wrap_socket( 2024-09-19T08:35:35.786 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:35:35.786 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: return self.sslsocket_class._create( 2024-09-19T08:35:35.786 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:35:35.786 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: self.do_handshake() 2024-09-19T08:35:35.787 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:35:35.787 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: self._sslobj.do_handshake() 2024-09-19T08:35:35.787 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:35:35.787 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:35.916 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T08:35:35.916 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.934+0000 7f732fe1a640 1 Processor -- start 2024-09-19T08:35:35.916 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.934+0000 7f732fe1a640 1 -- start start 2024-09-19T08:35:35.917 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.934+0000 7f732fe1a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73281060b0 0x7f73281064b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:35.917 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.934+0000 7f732fe1a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f732807bdd0 con 0x7f73281060b0 2024-09-19T08:35:35.917 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.935+0000 7f732dbb6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73281060b0 0x7f73281064b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:35.917 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.935+0000 7f732dbb6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73281060b0 0x7f73281064b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56792/0 (socket says 172.21.15.7:56792) 2024-09-19T08:35:35.917 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.935+0000 7f732dbb6640 1 -- 172.21.15.7:0/4207083232 learned_addr learned my addr 172.21.15.7:0/4207083232 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:35.917 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.935+0000 7f732dbb6640 1 -- 172.21.15.7:0/4207083232 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73281069f0 con 0x7f73281060b0 2024-09-19T08:35:35.917 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.936+0000 7f732dbb6640 1 --2- 172.21.15.7:0/4207083232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73281060b0 0x7f73281064b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7324009820 tx=0x7f732402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a21bc30d10fe2cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:35.917 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.936+0000 7f732cbb4640 1 -- 172.21.15.7:0/4207083232 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7324037070 con 0x7f73281060b0 2024-09-19T08:35:35.917 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.936+0000 7f732cbb4640 1 -- 172.21.15.7:0/4207083232 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7324032900 con 0x7f73281060b0 2024-09-19T08:35:35.917 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.936+0000 7f732cbb4640 1 -- 172.21.15.7:0/4207083232 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7324030850 con 0x7f73281060b0 2024-09-19T08:35:35.917 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.936+0000 7f732fe1a640 1 -- 172.21.15.7:0/4207083232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73281060b0 msgr2=0x7f73281064b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:35.917 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.936+0000 7f732fe1a640 1 --2- 172.21.15.7:0/4207083232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73281060b0 0x7f73281064b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7324009820 tx=0x7f732402a270 comp rx=0 tx=0).stop 2024-09-19T08:35:35.918 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.936+0000 7f732fe1a640 1 -- 172.21.15.7:0/4207083232 shutdown_connections 2024-09-19T08:35:35.918 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.936+0000 7f732fe1a640 1 --2- 172.21.15.7:0/4207083232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73281060b0 0x7f73281064b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:35.918 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.936+0000 7f732fe1a640 1 -- 172.21.15.7:0/4207083232 >> 172.21.15.7:0/4207083232 conn(0x7f7328101e60 msgr2=0x7f73281042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:35.918 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.936+0000 7f732fe1a640 1 -- 172.21.15.7:0/4207083232 shutdown_connections 2024-09-19T08:35:35.918 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.936+0000 7f732fe1a640 1 -- 172.21.15.7:0/4207083232 wait complete. 2024-09-19T08:35:35.918 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.937+0000 7f732fe1a640 1 Processor -- start 2024-09-19T08:35:35.918 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.937+0000 7f732fe1a640 1 -- start start 2024-09-19T08:35:35.918 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.937+0000 7f732fe1a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73281060b0 0x7f732819d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:35.918 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.937+0000 7f732fe1a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7328107a80 con 0x7f73281060b0 2024-09-19T08:35:35.918 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.937+0000 7f732dbb6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73281060b0 0x7f732819d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:35.918 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.937+0000 7f732dbb6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73281060b0 0x7f732819d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56808/0 (socket says 172.21.15.7:56808) 2024-09-19T08:35:35.918 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.937+0000 7f732dbb6640 1 -- 172.21.15.7:0/2891220683 learned_addr learned my addr 172.21.15.7:0/2891220683 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:35.918 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.938+0000 7f732dbb6640 1 -- 172.21.15.7:0/2891220683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732819dee0 con 0x7f73281060b0 2024-09-19T08:35:35.919 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.938+0000 7f732dbb6640 1 --2- 172.21.15.7:0/2891220683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73281060b0 0x7f732819d9a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7324032ce0 tx=0x7f7324032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:35.919 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.938+0000 7f731effd640 1 -- 172.21.15.7:0/2891220683 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7324042070 con 0x7f73281060b0 2024-09-19T08:35:35.919 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.938+0000 7f731effd640 1 -- 172.21.15.7:0/2891220683 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f73240308c0 con 0x7f73281060b0 2024-09-19T08:35:35.919 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.938+0000 7f731effd640 1 -- 172.21.15.7:0/2891220683 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7324037040 con 0x7f73281060b0 2024-09-19T08:35:35.919 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.938+0000 7f732fe1a640 1 -- 172.21.15.7:0/2891220683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f732819e170 con 0x7f73281060b0 2024-09-19T08:35:35.919 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.938+0000 7f732fe1a640 1 -- 172.21.15.7:0/2891220683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73281a0e60 con 0x7f73281060b0 2024-09-19T08:35:35.919 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.939+0000 7f731effd640 1 -- 172.21.15.7:0/2891220683 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f7324045070 con 0x7f73281060b0 2024-09-19T08:35:35.919 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.939+0000 7f732fe1a640 1 -- 172.21.15.7:0/2891220683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73281064b0 con 0x7f73281060b0 2024-09-19T08:35:35.919 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.939+0000 7f731effd640 1 --2- 172.21.15.7:0/2891220683 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f7314039200 0x7f731403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:35.919 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.939+0000 7f731effd640 1 -- 172.21.15.7:0/2891220683 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f732406c2d0 con 0x7f73281060b0 2024-09-19T08:35:35.919 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.940+0000 7f732d3b5640 1 --2- 172.21.15.7:0/2891220683 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f7314039200 0x7f731403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:35.919 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.940+0000 7f732d3b5640 1 --2- 172.21.15.7:0/2891220683 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f7314039200 0x7f731403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f73180098c0 tx=0x7f7318006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:35.920 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:34.944+0000 7f731effd640 1 -- 172.21.15.7:0/2891220683 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f732403c760 con 0x7f73281060b0 2024-09-19T08:35:35.920 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:35.125+0000 7f732fe1a640 1 -- 172.21.15.7:0/2891220683 --> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f7328074c70 con 0x7f7314039200 2024-09-19T08:35:35.920 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:35.126+0000 7f731effd640 1 -- 172.21.15.7:0/2891220683 <== mgr.14118 v2:172.21.15.7:6800/3071389382 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f7328074c70 con 0x7f7314039200 2024-09-19T08:35:35.920 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:35.128+0000 7f732fe1a640 1 -- 172.21.15.7:0/2891220683 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f7314039200 msgr2=0x7f731403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:35.920 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:35.128+0000 7f732fe1a640 1 --2- 172.21.15.7:0/2891220683 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f7314039200 0x7f731403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f73180098c0 tx=0x7f7318006db0 comp rx=0 tx=0).stop 2024-09-19T08:35:35.920 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:35.128+0000 7f732fe1a640 1 -- 172.21.15.7:0/2891220683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73281060b0 msgr2=0x7f732819d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:35.920 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:35.128+0000 7f732fe1a640 1 --2- 172.21.15.7:0/2891220683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73281060b0 0x7f732819d9a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7324032ce0 tx=0x7f7324032d10 comp rx=0 tx=0).stop 2024-09-19T08:35:35.920 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:35.128+0000 7f732fe1a640 1 -- 172.21.15.7:0/2891220683 shutdown_connections 2024-09-19T08:35:35.920 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:35.128+0000 7f732fe1a640 1 --2- 172.21.15.7:0/2891220683 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f7314039200 0x7f731403b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:35.920 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:35.128+0000 7f732fe1a640 1 --2- 172.21.15.7:0/2891220683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73281060b0 0x7f732819d9a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:35.920 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:35.128+0000 7f732fe1a640 1 -- 172.21.15.7:0/2891220683 >> 172.21.15.7:0/2891220683 conn(0x7f7328101e60 msgr2=0x7f7328191cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:35.920 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:35.129+0000 7f732fe1a640 1 -- 172.21.15.7:0/2891220683 shutdown_connections 2024-09-19T08:35:35.921 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:35.129+0000 7f732fe1a640 1 -- 172.21.15.7:0/2891220683 wait complete. 2024-09-19T08:35:35.921 INFO:teuthology.orchestra.run.smithi007.stdout:Generating ssh key... 2024-09-19T08:35:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-mon[31221]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:35:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-mon[31221]: [19/Sep/2024:08:35:35] ENGINE Bus STARTING 2024-09-19T08:35:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-mon[31221]: [19/Sep/2024:08:35:35] ENGINE Serving on http://172.21.15.7:8765 2024-09-19T08:35:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-mon[31221]: [19/Sep/2024:08:35:35] ENGINE Serving on https://172.21.15.7:7150 2024-09-19T08:35:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-mon[31221]: [19/Sep/2024:08:35:35] ENGINE Bus STARTED 2024-09-19T08:35:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-mon[31221]: [19/Sep/2024:08:35:35] ENGINE Error in HTTPServer.serve 2024-09-19T08:35:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-09-19T08:35:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:35:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:35:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:35:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._run(expiration_interval) 2024-09-19T08:35:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:35:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:35:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:35:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:35:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:35:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout: s = self.context.wrap_socket( 2024-09-19T08:35:36.785 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:35:36.785 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.sslsocket_class._create( 2024-09-19T08:35:36.785 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:35:36.785 INFO:journalctl@ceph.mon.a.smithi007.stdout: self.do_handshake() 2024-09-19T08:35:36.785 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:35:36.785 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._sslobj.do_handshake() 2024-09-19T08:35:36.785 INFO:journalctl@ceph.mon.a.smithi007.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:35:37.141 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: Generating public/private rsa key pair. 2024-09-19T08:35:37.141 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: Your identification has been saved in /tmp/tmpawxxiuxn/key 2024-09-19T08:35:37.141 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: Your public key has been saved in /tmp/tmpawxxiuxn/key.pub 2024-09-19T08:35:37.141 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: The key fingerprint is: 2024-09-19T08:35:37.141 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: SHA256:c7CQAWkWha4sfjhs8HuBaT+ynBZSjZzlenvxOXFVpJc ceph-ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:35:37.141 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: The key's randomart image is: 2024-09-19T08:35:37.141 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: +---[RSA 3072]----+ 2024-09-19T08:35:37.141 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: | o*o .. | 2024-09-19T08:35:37.141 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: | * o ... | 2024-09-19T08:35:37.142 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: | . X o . ..E | 2024-09-19T08:35:37.142 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: | = + . o .. | 2024-09-19T08:35:37.142 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: | o = S .. | 2024-09-19T08:35:37.142 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: |+ O o . .o. | 2024-09-19T08:35:37.142 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: |+=.+ o o + | 2024-09-19T08:35:37.142 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: | B+o= . + | 2024-09-19T08:35:37.142 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: |..B= o . | 2024-09-19T08:35:37.142 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:36 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: +----[SHA256]-----+ 2024-09-19T08:35:37.406 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.291+0000 7f63fe72c640 1 Processor -- start 2024-09-19T08:35:37.406 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.291+0000 7f63fe72c640 1 -- start start 2024-09-19T08:35:37.406 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.291+0000 7f63fe72c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f807de00 0x7f63f807c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:37.406 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.291+0000 7f63fe72c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f63f807c830 con 0x7f63f807de00 2024-09-19T08:35:37.406 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.291+0000 7f63f7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f807de00 0x7f63f807c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:37.406 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.291+0000 7f63f7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f807de00 0x7f63f807c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56822/0 (socket says 172.21.15.7:56822) 2024-09-19T08:35:37.406 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.291+0000 7f63f7fff640 1 -- 172.21.15.7:0/3775831874 learned_addr learned my addr 172.21.15.7:0/3775831874 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:37.406 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.291+0000 7f63f7fff640 1 -- 172.21.15.7:0/3775831874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f807c9b0 con 0x7f63f807de00 2024-09-19T08:35:37.407 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.292+0000 7f63f7fff640 1 --2- 172.21.15.7:0/3775831874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f807de00 0x7f63f807c260 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009820 tx=0x7f63e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9a24caa565f674 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:37.407 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.292+0000 7f63f6ffd640 1 -- 172.21.15.7:0/3775831874 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63e8037070 con 0x7f63f807de00 2024-09-19T08:35:37.407 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.292+0000 7f63f6ffd640 1 -- 172.21.15.7:0/3775831874 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f63e8032900 con 0x7f63f807de00 2024-09-19T08:35:37.407 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.292+0000 7f63f6ffd640 1 -- 172.21.15.7:0/3775831874 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63e8030850 con 0x7f63f807de00 2024-09-19T08:35:37.407 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.293+0000 7f63fe72c640 1 -- 172.21.15.7:0/3775831874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f807de00 msgr2=0x7f63f807c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:37.407 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.293+0000 7f63fe72c640 1 --2- 172.21.15.7:0/3775831874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f807de00 0x7f63f807c260 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009820 tx=0x7f63e802a270 comp rx=0 tx=0).stop 2024-09-19T08:35:37.407 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.293+0000 7f63fe72c640 1 -- 172.21.15.7:0/3775831874 shutdown_connections 2024-09-19T08:35:37.407 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.293+0000 7f63fe72c640 1 --2- 172.21.15.7:0/3775831874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f807de00 0x7f63f807c260 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:37.407 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.293+0000 7f63fe72c640 1 -- 172.21.15.7:0/3775831874 >> 172.21.15.7:0/3775831874 conn(0x7f63f8102f60 msgr2=0x7f63f81053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:37.407 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.293+0000 7f63fe72c640 1 -- 172.21.15.7:0/3775831874 shutdown_connections 2024-09-19T08:35:37.407 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.293+0000 7f63fe72c640 1 -- 172.21.15.7:0/3775831874 wait complete. 2024-09-19T08:35:37.407 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.294+0000 7f63fe72c640 1 Processor -- start 2024-09-19T08:35:37.407 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.294+0000 7f63fe72c640 1 -- start start 2024-09-19T08:35:37.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.294+0000 7f63fe72c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f807de00 0x7f63f819d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:37.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.294+0000 7f63fe72c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f63f810dda0 con 0x7f63f807de00 2024-09-19T08:35:37.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.294+0000 7f63f7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f807de00 0x7f63f819d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:37.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.294+0000 7f63f7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f807de00 0x7f63f819d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56834/0 (socket says 172.21.15.7:56834) 2024-09-19T08:35:37.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.294+0000 7f63f7fff640 1 -- 172.21.15.7:0/3619851729 learned_addr learned my addr 172.21.15.7:0/3619851729 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:37.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.294+0000 7f63f7fff640 1 -- 172.21.15.7:0/3619851729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f819de90 con 0x7f63f807de00 2024-09-19T08:35:37.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.294+0000 7f63f7fff640 1 --2- 172.21.15.7:0/3619851729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f807de00 0x7f63f819d950 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f63e80097f0 tx=0x7f63e8030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:37.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.295+0000 7f63f57fa640 1 -- 172.21.15.7:0/3619851729 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63e8037040 con 0x7f63f807de00 2024-09-19T08:35:37.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.295+0000 7f63f57fa640 1 -- 172.21.15.7:0/3619851729 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f63e8040070 con 0x7f63f807de00 2024-09-19T08:35:37.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.295+0000 7f63fe72c640 1 -- 172.21.15.7:0/3619851729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f819e120 con 0x7f63f807de00 2024-09-19T08:35:37.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.295+0000 7f63f57fa640 1 -- 172.21.15.7:0/3619851729 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63e803a390 con 0x7f63f807de00 2024-09-19T08:35:37.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.295+0000 7f63fe72c640 1 -- 172.21.15.7:0/3619851729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f81a0e10 con 0x7f63f807de00 2024-09-19T08:35:37.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.295+0000 7f63f57fa640 1 -- 172.21.15.7:0/3619851729 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f63e803a5e0 con 0x7f63f807de00 2024-09-19T08:35:37.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.296+0000 7f63f57fa640 1 --2- 172.21.15.7:0/3619851729 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f63e0039200 0x7f63e003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:37.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.296+0000 7f63f57fa640 1 -- 172.21.15.7:0/3619851729 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f63e806c770 con 0x7f63f807de00 2024-09-19T08:35:37.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.296+0000 7f63fe72c640 1 -- 172.21.15.7:0/3619851729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63f807c2e0 con 0x7f63f807de00 2024-09-19T08:35:37.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.296+0000 7f63f77fe640 1 --2- 172.21.15.7:0/3619851729 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f63e0039200 0x7f63e003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:37.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.296+0000 7f63f77fe640 1 --2- 172.21.15.7:0/3619851729 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f63e0039200 0x7f63e003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0098c0 tx=0x7f63ec006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:37.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.301+0000 7f63f57fa640 1 -- 172.21.15.7:0/3619851729 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f63e8043760 con 0x7f63f807de00 2024-09-19T08:35:37.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.478+0000 7f63fe72c640 1 -- 172.21.15.7:0/3619851729 --> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f63f8104250 con 0x7f63e0039200 2024-09-19T08:35:37.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.862+0000 7f63f57fa640 1 -- 172.21.15.7:0/3619851729 <== mgr.14118 v2:172.21.15.7:6800/3071389382 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f63f8104250 con 0x7f63e0039200 2024-09-19T08:35:37.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.864+0000 7f63fe72c640 1 -- 172.21.15.7:0/3619851729 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f63e0039200 msgr2=0x7f63e003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:37.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.864+0000 7f63fe72c640 1 --2- 172.21.15.7:0/3619851729 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f63e0039200 0x7f63e003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0098c0 tx=0x7f63ec006db0 comp rx=0 tx=0).stop 2024-09-19T08:35:37.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.864+0000 7f63fe72c640 1 -- 172.21.15.7:0/3619851729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f807de00 msgr2=0x7f63f819d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:37.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.864+0000 7f63fe72c640 1 --2- 172.21.15.7:0/3619851729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f807de00 0x7f63f819d950 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f63e80097f0 tx=0x7f63e8030d80 comp rx=0 tx=0).stop 2024-09-19T08:35:37.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.865+0000 7f63fe72c640 1 -- 172.21.15.7:0/3619851729 shutdown_connections 2024-09-19T08:35:37.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.865+0000 7f63fe72c640 1 --2- 172.21.15.7:0/3619851729 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f63e0039200 0x7f63e003b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:37.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.865+0000 7f63fe72c640 1 --2- 172.21.15.7:0/3619851729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63f807de00 0x7f63f819d950 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:37.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.865+0000 7f63fe72c640 1 -- 172.21.15.7:0/3619851729 >> 172.21.15.7:0/3619851729 conn(0x7f63f8102f60 msgr2=0x7f63f8103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:37.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.865+0000 7f63fe72c640 1 -- 172.21.15.7:0/3619851729 shutdown_connections 2024-09-19T08:35:37.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:36.865+0000 7f63fe72c640 1 -- 172.21.15.7:0/3619851729 wait complete. 2024-09-19T08:35:37.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:37 smithi007 ceph-mon[31221]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:35:37.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:37 smithi007 ceph-mon[31221]: Generating ssh key... 2024-09-19T08:35:37.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:37 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' 2024-09-19T08:35:37.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:37 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' 2024-09-19T08:35:38.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC09rTL8OHylhd5AwFBsWy+ZXKohfdQMhCtPgSO7vSj2Byzh4oXpNszYsEeNQ9rZ+RYv0u/GRqgA8CkZ+jKkX79YtAd4BdfI6Zbq1I+RlMY26ke/xbWtWinYXZ6CC5ZE4j/xaRyzLJxxEFpcV4HeIDtbiChz5bt3qosyHrnWTqg5mFljZsa52AWnbEIxkSgYqAkCXSAXtnrt1rLZ0SPKPaSW+vorw3ZFckFhFeJJvK9WQmeRt4p1o2RhtGDU3uh2ZErv9P10RzuqlPZrJ4HLhkIfkIpB3Mo0DPcvxkn89pk596kYgjM8ZgUmVz2jjGNP9nuYRgEvJhL6xOksgPzLf3yMKklviAydLVfgIKolezMfcLrdwsEvSKsg3thTQmznf2C+ifYbQWZLKGtzhHWg/EfUkwg/NrN/D/TmLry3lUmCOcbHRTGZ/s5tcNpfyMHLpxq69OjZWjFR3RxuRTBqjpyQI3k4mYeoA2Y1Sfp7WomRnJT4lP0KYX1ZIfCDs5Xa2M= ceph-ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:35:38.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.801+0000 7f42cd18f640 1 Processor -- start 2024-09-19T08:35:38.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.801+0000 7f42cd18f640 1 -- start start 2024-09-19T08:35:38.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.801+0000 7f42cd18f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42c807de00 0x7f42c807c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:38.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.801+0000 7f42cd18f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f42c807c830 con 0x7f42c807de00 2024-09-19T08:35:38.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.801+0000 7f42c6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42c807de00 0x7f42c807c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:38.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.801+0000 7f42c6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42c807de00 0x7f42c807c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56844/0 (socket says 172.21.15.7:56844) 2024-09-19T08:35:38.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.801+0000 7f42c6d9d640 1 -- 172.21.15.7:0/678269836 learned_addr learned my addr 172.21.15.7:0/678269836 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:38.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.802+0000 7f42c6d9d640 1 -- 172.21.15.7:0/678269836 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c807c9b0 con 0x7f42c807de00 2024-09-19T08:35:38.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.802+0000 7f42c6d9d640 1 --2- 172.21.15.7:0/678269836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42c807de00 0x7f42c807c260 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009820 tx=0x7f42b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aab3e01163c7702 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:38.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.803+0000 7f42c5d9b640 1 -- 172.21.15.7:0/678269836 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42b8037070 con 0x7f42c807de00 2024-09-19T08:35:38.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.803+0000 7f42c5d9b640 1 -- 172.21.15.7:0/678269836 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f42b8032900 con 0x7f42c807de00 2024-09-19T08:35:38.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.803+0000 7f42c5d9b640 1 -- 172.21.15.7:0/678269836 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42b8030850 con 0x7f42c807de00 2024-09-19T08:35:38.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.803+0000 7f42cd18f640 1 -- 172.21.15.7:0/678269836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42c807de00 msgr2=0x7f42c807c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:38.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.803+0000 7f42cd18f640 1 --2- 172.21.15.7:0/678269836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42c807de00 0x7f42c807c260 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009820 tx=0x7f42b802a270 comp rx=0 tx=0).stop 2024-09-19T08:35:38.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.803+0000 7f42cd18f640 1 -- 172.21.15.7:0/678269836 shutdown_connections 2024-09-19T08:35:38.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.803+0000 7f42cd18f640 1 --2- 172.21.15.7:0/678269836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42c807de00 0x7f42c807c260 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:38.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.803+0000 7f42cd18f640 1 -- 172.21.15.7:0/678269836 >> 172.21.15.7:0/678269836 conn(0x7f42c8102f60 msgr2=0x7f42c81053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:38.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.803+0000 7f42cd18f640 1 -- 172.21.15.7:0/678269836 shutdown_connections 2024-09-19T08:35:38.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.803+0000 7f42cd18f640 1 -- 172.21.15.7:0/678269836 wait complete. 2024-09-19T08:35:38.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.804+0000 7f42cd18f640 1 Processor -- start 2024-09-19T08:35:38.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.804+0000 7f42cd18f640 1 -- start start 2024-09-19T08:35:38.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.804+0000 7f42cd18f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42c807de00 0x7f42c819d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:38.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.804+0000 7f42cd18f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f42c810dda0 con 0x7f42c807de00 2024-09-19T08:35:38.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.805+0000 7f42c6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42c807de00 0x7f42c819d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:38.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.805+0000 7f42c6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42c807de00 0x7f42c819d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56854/0 (socket says 172.21.15.7:56854) 2024-09-19T08:35:38.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.805+0000 7f42c6d9d640 1 -- 172.21.15.7:0/976550380 learned_addr learned my addr 172.21.15.7:0/976550380 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:38.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.805+0000 7f42c6d9d640 1 -- 172.21.15.7:0/976550380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c819de90 con 0x7f42c807de00 2024-09-19T08:35:38.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.805+0000 7f42c6d9d640 1 --2- 172.21.15.7:0/976550380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42c807de00 0x7f42c819d950 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f42b8032ce0 tx=0x7f42b8032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:38.519 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.805+0000 7f42affff640 1 -- 172.21.15.7:0/976550380 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42b8042070 con 0x7f42c807de00 2024-09-19T08:35:38.519 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.805+0000 7f42cd18f640 1 -- 172.21.15.7:0/976550380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c819e120 con 0x7f42c807de00 2024-09-19T08:35:38.519 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.805+0000 7f42affff640 1 -- 172.21.15.7:0/976550380 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f42b80308c0 con 0x7f42c807de00 2024-09-19T08:35:38.519 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.805+0000 7f42affff640 1 -- 172.21.15.7:0/976550380 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42b8037040 con 0x7f42c807de00 2024-09-19T08:35:38.519 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.805+0000 7f42cd18f640 1 -- 172.21.15.7:0/976550380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c81a0e10 con 0x7f42c807de00 2024-09-19T08:35:38.519 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.806+0000 7f42affff640 1 -- 172.21.15.7:0/976550380 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f42b8045070 con 0x7f42c807de00 2024-09-19T08:35:38.519 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.806+0000 7f42cd18f640 1 -- 172.21.15.7:0/976550380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42c807c2e0 con 0x7f42c807de00 2024-09-19T08:35:38.519 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.806+0000 7f42affff640 1 --2- 172.21.15.7:0/976550380 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f42b00391b0 0x7f42b003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:38.519 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.806+0000 7f42affff640 1 -- 172.21.15.7:0/976550380 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f42b806d3b0 con 0x7f42c807de00 2024-09-19T08:35:38.519 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.806+0000 7f42c659c640 1 --2- 172.21.15.7:0/976550380 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f42b00391b0 0x7f42b003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:38.519 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.807+0000 7f42c659c640 1 --2- 172.21.15.7:0/976550380 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f42b00391b0 0x7f42b003b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0098c0 tx=0x7f42bc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:38.520 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.811+0000 7f42affff640 1 -- 172.21.15.7:0/976550380 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f42b803cd00 con 0x7f42c807de00 2024-09-19T08:35:38.520 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.990+0000 7f42cd18f640 1 -- 172.21.15.7:0/976550380 --> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f42c8104250 con 0x7f42b00391b0 2024-09-19T08:35:38.520 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.991+0000 7f42affff640 1 -- 172.21.15.7:0/976550380 <== mgr.14118 v2:172.21.15.7:6800/3071389382 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f42c8104250 con 0x7f42b00391b0 2024-09-19T08:35:38.520 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.994+0000 7f42cd18f640 1 -- 172.21.15.7:0/976550380 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f42b00391b0 msgr2=0x7f42b003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:38.520 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.994+0000 7f42cd18f640 1 --2- 172.21.15.7:0/976550380 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f42b00391b0 0x7f42b003b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0098c0 tx=0x7f42bc006db0 comp rx=0 tx=0).stop 2024-09-19T08:35:38.520 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.994+0000 7f42cd18f640 1 -- 172.21.15.7:0/976550380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42c807de00 msgr2=0x7f42c819d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:38.520 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.994+0000 7f42cd18f640 1 --2- 172.21.15.7:0/976550380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42c807de00 0x7f42c819d950 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f42b8032ce0 tx=0x7f42b8032d10 comp rx=0 tx=0).stop 2024-09-19T08:35:38.520 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.994+0000 7f42cd18f640 1 -- 172.21.15.7:0/976550380 shutdown_connections 2024-09-19T08:35:38.520 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.994+0000 7f42cd18f640 1 --2- 172.21.15.7:0/976550380 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f42b00391b0 0x7f42b003b670 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:38.521 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.994+0000 7f42cd18f640 1 --2- 172.21.15.7:0/976550380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42c807de00 0x7f42c819d950 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:38.521 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.994+0000 7f42cd18f640 1 -- 172.21.15.7:0/976550380 >> 172.21.15.7:0/976550380 conn(0x7f42c8102f60 msgr2=0x7f42c8103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:38.521 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.994+0000 7f42cd18f640 1 -- 172.21.15.7:0/976550380 shutdown_connections 2024-09-19T08:35:38.521 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:37.995+0000 7f42cd18f640 1 -- 172.21.15.7:0/976550380 wait complete. 2024-09-19T08:35:38.521 INFO:teuthology.orchestra.run.smithi007.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T08:35:38.521 INFO:teuthology.orchestra.run.smithi007.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T08:35:38.521 INFO:teuthology.orchestra.run.smithi007.stdout:Adding host smithi007... 2024-09-19T08:35:38.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:38 smithi007 ceph-mon[31221]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:35:39.818 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:39 smithi007 ceph-mon[31221]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi007", "addr": "172.21.15.7", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:35:41.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:40 smithi007 ceph-mon[31221]: Deploying cephadm binary to smithi007 2024-09-19T08:35:43.538 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Added host 'smithi007' with addr '172.21.15.7' 2024-09-19T08:35:43.538 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.911+0000 7f72172c5640 1 Processor -- start 2024-09-19T08:35:43.539 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.911+0000 7f72172c5640 1 -- start start 2024-09-19T08:35:43.539 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.911+0000 7f72172c5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f721007de20 0x7f721007c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:43.539 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.911+0000 7f72172c5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f721007c850 con 0x7f721007de20 2024-09-19T08:35:43.539 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.911+0000 7f7215061640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f721007de20 0x7f721007c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:43.539 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.911+0000 7f7215061640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f721007de20 0x7f721007c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56862/0 (socket says 172.21.15.7:56862) 2024-09-19T08:35:43.539 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.911+0000 7f7215061640 1 -- 172.21.15.7:0/817528325 learned_addr learned my addr 172.21.15.7:0/817528325 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:43.539 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.912+0000 7f7215061640 1 -- 172.21.15.7:0/817528325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f721007c9d0 con 0x7f721007de20 2024-09-19T08:35:43.539 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.912+0000 7f7215061640 1 --2- 172.21.15.7:0/817528325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f721007de20 0x7f721007c280 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f720c009820 tx=0x7f720c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0516125fc3ef6f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:43.539 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.913+0000 7f7207fff640 1 -- 172.21.15.7:0/817528325 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f720c037070 con 0x7f721007de20 2024-09-19T08:35:43.539 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.913+0000 7f7207fff640 1 -- 172.21.15.7:0/817528325 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f720c032900 con 0x7f721007de20 2024-09-19T08:35:43.539 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.913+0000 7f7207fff640 1 -- 172.21.15.7:0/817528325 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f720c030850 con 0x7f721007de20 2024-09-19T08:35:43.539 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.913+0000 7f72172c5640 1 -- 172.21.15.7:0/817528325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f721007de20 msgr2=0x7f721007c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:43.540 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.913+0000 7f72172c5640 1 --2- 172.21.15.7:0/817528325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f721007de20 0x7f721007c280 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f720c009820 tx=0x7f720c02a270 comp rx=0 tx=0).stop 2024-09-19T08:35:43.540 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.913+0000 7f72172c5640 1 -- 172.21.15.7:0/817528325 shutdown_connections 2024-09-19T08:35:43.540 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.913+0000 7f72172c5640 1 --2- 172.21.15.7:0/817528325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f721007de20 0x7f721007c280 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:43.540 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.913+0000 7f72172c5640 1 -- 172.21.15.7:0/817528325 >> 172.21.15.7:0/817528325 conn(0x7f7210102f60 msgr2=0x7f72101053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:43.540 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.913+0000 7f72172c5640 1 -- 172.21.15.7:0/817528325 shutdown_connections 2024-09-19T08:35:43.540 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.913+0000 7f72172c5640 1 -- 172.21.15.7:0/817528325 wait complete. 2024-09-19T08:35:43.540 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.914+0000 7f72172c5640 1 Processor -- start 2024-09-19T08:35:43.540 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.914+0000 7f72172c5640 1 -- start start 2024-09-19T08:35:43.540 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.914+0000 7f72172c5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f721007de20 0x7f721019d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:43.540 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.914+0000 7f72172c5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f721010dde0 con 0x7f721007de20 2024-09-19T08:35:43.540 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.914+0000 7f7215061640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f721007de20 0x7f721019d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:43.540 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.914+0000 7f7215061640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f721007de20 0x7f721019d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56866/0 (socket says 172.21.15.7:56866) 2024-09-19T08:35:43.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.914+0000 7f7215061640 1 -- 172.21.15.7:0/3774646430 learned_addr learned my addr 172.21.15.7:0/3774646430 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:43.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.915+0000 7f7215061640 1 -- 172.21.15.7:0/3774646430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f721019df10 con 0x7f721007de20 2024-09-19T08:35:43.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.915+0000 7f7215061640 1 --2- 172.21.15.7:0/3774646430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f721007de20 0x7f721019d9d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f720c032ce0 tx=0x7f720c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:43.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.915+0000 7f72067fc640 1 -- 172.21.15.7:0/3774646430 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f720c042070 con 0x7f721007de20 2024-09-19T08:35:43.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.915+0000 7f72067fc640 1 -- 172.21.15.7:0/3774646430 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f720c0308c0 con 0x7f721007de20 2024-09-19T08:35:43.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.915+0000 7f72172c5640 1 -- 172.21.15.7:0/3774646430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f721019e1a0 con 0x7f721007de20 2024-09-19T08:35:43.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.915+0000 7f72067fc640 1 -- 172.21.15.7:0/3774646430 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f720c037040 con 0x7f721007de20 2024-09-19T08:35:43.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.915+0000 7f72172c5640 1 -- 172.21.15.7:0/3774646430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72101a0e90 con 0x7f721007de20 2024-09-19T08:35:43.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.916+0000 7f72067fc640 1 -- 172.21.15.7:0/3774646430 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f720c045070 con 0x7f721007de20 2024-09-19T08:35:43.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.916+0000 7f72172c5640 1 -- 172.21.15.7:0/3774646430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f721007c300 con 0x7f721007de20 2024-09-19T08:35:43.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.916+0000 7f72067fc640 1 --2- 172.21.15.7:0/3774646430 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f71fc039200 0x7f71fc03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:43.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.916+0000 7f72067fc640 1 -- 172.21.15.7:0/3774646430 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f720c06c2c0 con 0x7f721007de20 2024-09-19T08:35:43.541 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.916+0000 7f7214860640 1 --2- 172.21.15.7:0/3774646430 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f71fc039200 0x7f71fc03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:43.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.917+0000 7f7214860640 1 --2- 172.21.15.7:0/3774646430 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f71fc039200 0x7f71fc03b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f72000098c0 tx=0x7f7200006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:43.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:38.921+0000 7f72067fc640 1 -- 172.21.15.7:0/3774646430 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f720c04b170 con 0x7f721007de20 2024-09-19T08:35:43.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:39.099+0000 7f72172c5640 1 -- 172.21.15.7:0/3774646430 --> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi007", "addr": "172.21.15.7", "target": ["mon-mgr", ""]}) -- 0x7f7210104250 con 0x7f71fc039200 2024-09-19T08:35:43.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:42.986+0000 7f72067fc640 1 -- 172.21.15.7:0/3774646430 <== mgr.14118 v2:172.21.15.7:6800/3071389382 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f7210104250 con 0x7f71fc039200 2024-09-19T08:35:43.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:42.989+0000 7f72172c5640 1 -- 172.21.15.7:0/3774646430 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f71fc039200 msgr2=0x7f71fc03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:43.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:42.989+0000 7f72172c5640 1 --2- 172.21.15.7:0/3774646430 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f71fc039200 0x7f71fc03b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f72000098c0 tx=0x7f7200006db0 comp rx=0 tx=0).stop 2024-09-19T08:35:43.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:42.989+0000 7f72172c5640 1 -- 172.21.15.7:0/3774646430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f721007de20 msgr2=0x7f721019d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:43.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:42.989+0000 7f72172c5640 1 --2- 172.21.15.7:0/3774646430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f721007de20 0x7f721019d9d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f720c032ce0 tx=0x7f720c032d10 comp rx=0 tx=0).stop 2024-09-19T08:35:43.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:42.989+0000 7f72172c5640 1 -- 172.21.15.7:0/3774646430 shutdown_connections 2024-09-19T08:35:43.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:42.989+0000 7f72172c5640 1 --2- 172.21.15.7:0/3774646430 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f71fc039200 0x7f71fc03b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:43.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:42.989+0000 7f72172c5640 1 --2- 172.21.15.7:0/3774646430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f721007de20 0x7f721019d9d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:43.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:42.989+0000 7f72172c5640 1 -- 172.21.15.7:0/3774646430 >> 172.21.15.7:0/3774646430 conn(0x7f7210102f60 msgr2=0x7f7210103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:43.542 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:42.989+0000 7f72172c5640 1 -- 172.21.15.7:0/3774646430 shutdown_connections 2024-09-19T08:35:43.543 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:42.989+0000 7f72172c5640 1 -- 172.21.15.7:0/3774646430 wait complete. 2024-09-19T08:35:43.543 INFO:teuthology.orchestra.run.smithi007.stdout:Deploying unmanaged mon service... 2024-09-19T08:35:44.111 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:43 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' 2024-09-19T08:35:44.111 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:43 smithi007 ceph-mon[31221]: Added host smithi007 2024-09-19T08:35:44.111 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:43 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:35:45.724 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:45 smithi007 ceph-mon[31221]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:35:45.724 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:45 smithi007 ceph-mon[31221]: Saving service mon spec with placement count:5 2024-09-19T08:35:45.724 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:45 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' 2024-09-19T08:35:45.970 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T08:35:45.970 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.111+0000 7f069ce40640 1 Processor -- start 2024-09-19T08:35:45.970 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.111+0000 7f069ce40640 1 -- start start 2024-09-19T08:35:45.970 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.111+0000 7f069ce40640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06981066e0 0x7f0698106ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:45.970 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.111+0000 7f069ce40640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f06981070b0 con 0x7f06981066e0 2024-09-19T08:35:45.970 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.112+0000 7f069659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06981066e0 0x7f0698106ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:45.970 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.112+0000 7f069659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06981066e0 0x7f0698106ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38074/0 (socket says 172.21.15.7:38074) 2024-09-19T08:35:45.970 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.112+0000 7f069659c640 1 -- 172.21.15.7:0/465809644 learned_addr learned my addr 172.21.15.7:0/465809644 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:45.970 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.112+0000 7f069659c640 1 -- 172.21.15.7:0/465809644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06981078e0 con 0x7f06981066e0 2024-09-19T08:35:45.971 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.113+0000 7f069659c640 1 --2- 172.21.15.7:0/465809644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06981066e0 0x7f0698106ae0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0688009820 tx=0x7f068802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6706459cfd71284e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:45.971 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.113+0000 7f0695d9b640 1 -- 172.21.15.7:0/465809644 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0688037070 con 0x7f06981066e0 2024-09-19T08:35:45.971 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.113+0000 7f0695d9b640 1 -- 172.21.15.7:0/465809644 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0688032900 con 0x7f06981066e0 2024-09-19T08:35:45.971 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.113+0000 7f0695d9b640 1 -- 172.21.15.7:0/465809644 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0688030850 con 0x7f06981066e0 2024-09-19T08:35:45.971 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.113+0000 7f069ce40640 1 -- 172.21.15.7:0/465809644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06981066e0 msgr2=0x7f0698106ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:45.971 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.113+0000 7f069ce40640 1 --2- 172.21.15.7:0/465809644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06981066e0 0x7f0698106ae0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0688009820 tx=0x7f068802a270 comp rx=0 tx=0).stop 2024-09-19T08:35:45.971 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.114+0000 7f069ce40640 1 -- 172.21.15.7:0/465809644 shutdown_connections 2024-09-19T08:35:45.971 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.114+0000 7f069ce40640 1 --2- 172.21.15.7:0/465809644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06981066e0 0x7f0698106ae0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:45.971 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.114+0000 7f069ce40640 1 -- 172.21.15.7:0/465809644 >> 172.21.15.7:0/465809644 conn(0x7f0698101ed0 msgr2=0x7f06981042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:45.971 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.114+0000 7f069ce40640 1 -- 172.21.15.7:0/465809644 shutdown_connections 2024-09-19T08:35:45.971 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.114+0000 7f069ce40640 1 -- 172.21.15.7:0/465809644 wait complete. 2024-09-19T08:35:45.971 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.114+0000 7f069ce40640 1 Processor -- start 2024-09-19T08:35:45.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.114+0000 7f069ce40640 1 -- start start 2024-09-19T08:35:45.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.114+0000 7f069ce40640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06981066e0 0x7f069819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:45.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.114+0000 7f069ce40640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f069810ac90 con 0x7f06981066e0 2024-09-19T08:35:45.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.115+0000 7f069659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06981066e0 0x7f069819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:45.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.115+0000 7f069659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06981066e0 0x7f069819a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38082/0 (socket says 172.21.15.7:38082) 2024-09-19T08:35:45.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.115+0000 7f069659c640 1 -- 172.21.15.7:0/3726066032 learned_addr learned my addr 172.21.15.7:0/3726066032 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:45.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.115+0000 7f069659c640 1 -- 172.21.15.7:0/3726066032 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f069819abe0 con 0x7f06981066e0 2024-09-19T08:35:45.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.115+0000 7f069659c640 1 --2- 172.21.15.7:0/3726066032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06981066e0 0x7f069819a6a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0688009940 tx=0x7f0688032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:45.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.115+0000 7f068f7fe640 1 -- 172.21.15.7:0/3726066032 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0688042070 con 0x7f06981066e0 2024-09-19T08:35:45.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.115+0000 7f068f7fe640 1 -- 172.21.15.7:0/3726066032 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06880308c0 con 0x7f06981066e0 2024-09-19T08:35:45.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.115+0000 7f068f7fe640 1 -- 172.21.15.7:0/3726066032 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0688037040 con 0x7f06981066e0 2024-09-19T08:35:45.972 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.115+0000 7f069ce40640 1 -- 172.21.15.7:0/3726066032 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f069819ae70 con 0x7f06981066e0 2024-09-19T08:35:45.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.115+0000 7f069ce40640 1 -- 172.21.15.7:0/3726066032 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f069819db60 con 0x7f06981066e0 2024-09-19T08:35:45.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.116+0000 7f068f7fe640 1 -- 172.21.15.7:0/3726066032 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f0688045070 con 0x7f06981066e0 2024-09-19T08:35:45.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.116+0000 7f068f7fe640 1 --2- 172.21.15.7:0/3726066032 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f0684039200 0x7f068403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:45.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.116+0000 7f069ce40640 1 -- 172.21.15.7:0/3726066032 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0698106b60 con 0x7f06981066e0 2024-09-19T08:35:45.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.116+0000 7f068f7fe640 1 -- 172.21.15.7:0/3726066032 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f068806c360 con 0x7f06981066e0 2024-09-19T08:35:45.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.116+0000 7f068ffff640 1 --2- 172.21.15.7:0/3726066032 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f0684039200 0x7f068403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:45.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.117+0000 7f068ffff640 1 --2- 172.21.15.7:0/3726066032 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f0684039200 0x7f068403b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f06800098c0 tx=0x7f0680006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:45.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.121+0000 7f068f7fe640 1 -- 172.21.15.7:0/3726066032 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f068804b170 con 0x7f06981066e0 2024-09-19T08:35:45.974 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.311+0000 7f069ce40640 1 -- 172.21.15.7:0/3726066032 --> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f0698103190 con 0x7f0684039200 2024-09-19T08:35:45.974 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.316+0000 7f068f7fe640 1 -- 172.21.15.7:0/3726066032 <== mgr.14118 v2:172.21.15.7:6800/3071389382 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f0698103190 con 0x7f0684039200 2024-09-19T08:35:45.974 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.318+0000 7f069ce40640 1 -- 172.21.15.7:0/3726066032 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f0684039200 msgr2=0x7f068403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:45.974 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.318+0000 7f069ce40640 1 --2- 172.21.15.7:0/3726066032 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f0684039200 0x7f068403b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f06800098c0 tx=0x7f0680006db0 comp rx=0 tx=0).stop 2024-09-19T08:35:45.974 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.318+0000 7f069ce40640 1 -- 172.21.15.7:0/3726066032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06981066e0 msgr2=0x7f069819a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:45.974 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.318+0000 7f069ce40640 1 --2- 172.21.15.7:0/3726066032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06981066e0 0x7f069819a6a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0688009940 tx=0x7f0688032ce0 comp rx=0 tx=0).stop 2024-09-19T08:35:45.974 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.318+0000 7f069ce40640 1 -- 172.21.15.7:0/3726066032 shutdown_connections 2024-09-19T08:35:45.974 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.318+0000 7f069ce40640 1 --2- 172.21.15.7:0/3726066032 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f0684039200 0x7f068403b6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:45.974 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.318+0000 7f069ce40640 1 --2- 172.21.15.7:0/3726066032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06981066e0 0x7f069819a6a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:45.974 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.318+0000 7f069ce40640 1 -- 172.21.15.7:0/3726066032 >> 172.21.15.7:0/3726066032 conn(0x7f0698101ed0 msgr2=0x7f0698102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:45.975 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.318+0000 7f069ce40640 1 -- 172.21.15.7:0/3726066032 shutdown_connections 2024-09-19T08:35:45.975 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:44.318+0000 7f069ce40640 1 -- 172.21.15.7:0/3726066032 wait complete. 2024-09-19T08:35:45.975 INFO:teuthology.orchestra.run.smithi007.stdout:Deploying unmanaged mgr service... 2024-09-19T08:35:46.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:46 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' 2024-09-19T08:35:46.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:46 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' 2024-09-19T08:35:47.873 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:47 smithi007 ceph-mon[31221]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:35:47.873 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:47 smithi007 ceph-mon[31221]: Saving service mgr spec with placement count:2 2024-09-19T08:35:47.874 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:47 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' 2024-09-19T08:35:47.874 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:47 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' 2024-09-19T08:35:47.881 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T08:35:47.881 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.374+0000 7fce2a476640 1 Processor -- start 2024-09-19T08:35:47.881 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.374+0000 7fce2a476640 1 -- start start 2024-09-19T08:35:47.881 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.374+0000 7fce2a476640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce241077d0 0x7fce24107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:47.882 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.374+0000 7fce2a476640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fce241081a0 con 0x7fce241077d0 2024-09-19T08:35:47.882 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.374+0000 7fce23fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce241077d0 0x7fce24107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:47.882 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.374+0000 7fce23fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce241077d0 0x7fce24107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38096/0 (socket says 172.21.15.7:38096) 2024-09-19T08:35:47.882 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.374+0000 7fce23fff640 1 -- 172.21.15.7:0/4012591964 learned_addr learned my addr 172.21.15.7:0/4012591964 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:47.882 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.374+0000 7fce23fff640 1 -- 172.21.15.7:0/4012591964 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce241089d0 con 0x7fce241077d0 2024-09-19T08:35:47.882 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.375+0000 7fce23fff640 1 --2- 172.21.15.7:0/4012591964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce241077d0 0x7fce24107bd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fce14009820 tx=0x7fce1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62dd54ff567abc5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:47.882 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.376+0000 7fce22ffd640 1 -- 172.21.15.7:0/4012591964 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce14037070 con 0x7fce241077d0 2024-09-19T08:35:47.882 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.376+0000 7fce22ffd640 1 -- 172.21.15.7:0/4012591964 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce14032920 con 0x7fce241077d0 2024-09-19T08:35:47.882 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.376+0000 7fce22ffd640 1 -- 172.21.15.7:0/4012591964 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce14030810 con 0x7fce241077d0 2024-09-19T08:35:47.882 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.376+0000 7fce2a476640 1 -- 172.21.15.7:0/4012591964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce241077d0 msgr2=0x7fce24107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:47.882 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.376+0000 7fce2a476640 1 --2- 172.21.15.7:0/4012591964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce241077d0 0x7fce24107bd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fce14009820 tx=0x7fce1402a270 comp rx=0 tx=0).stop 2024-09-19T08:35:47.883 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.376+0000 7fce2a476640 1 -- 172.21.15.7:0/4012591964 shutdown_connections 2024-09-19T08:35:47.883 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.376+0000 7fce2a476640 1 --2- 172.21.15.7:0/4012591964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce241077d0 0x7fce24107bd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:47.883 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.376+0000 7fce2a476640 1 -- 172.21.15.7:0/4012591964 >> 172.21.15.7:0/4012591964 conn(0x7fce24102f60 msgr2=0x7fce241053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:47.883 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.376+0000 7fce2a476640 1 -- 172.21.15.7:0/4012591964 shutdown_connections 2024-09-19T08:35:47.883 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.376+0000 7fce2a476640 1 -- 172.21.15.7:0/4012591964 wait complete. 2024-09-19T08:35:47.883 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.377+0000 7fce2a476640 1 Processor -- start 2024-09-19T08:35:47.883 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.377+0000 7fce2a476640 1 -- start start 2024-09-19T08:35:47.883 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.377+0000 7fce2a476640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce241077d0 0x7fce2419b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:47.883 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.377+0000 7fce2a476640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fce2410bd80 con 0x7fce241077d0 2024-09-19T08:35:47.883 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.377+0000 7fce23fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce241077d0 0x7fce2419b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:47.883 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.377+0000 7fce23fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce241077d0 0x7fce2419b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38104/0 (socket says 172.21.15.7:38104) 2024-09-19T08:35:47.883 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.377+0000 7fce23fff640 1 -- 172.21.15.7:0/3711189560 learned_addr learned my addr 172.21.15.7:0/3711189560 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:47.883 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.378+0000 7fce23fff640 1 -- 172.21.15.7:0/3711189560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce2419bcf0 con 0x7fce241077d0 2024-09-19T08:35:47.883 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.378+0000 7fce23fff640 1 --2- 172.21.15.7:0/3711189560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce241077d0 0x7fce2419b7b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fce140097f0 tx=0x7fce140327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:47.884 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.378+0000 7fce217fa640 1 -- 172.21.15.7:0/3711189560 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce14037040 con 0x7fce241077d0 2024-09-19T08:35:47.884 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.378+0000 7fce217fa640 1 -- 172.21.15.7:0/3711189560 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce14030cc0 con 0x7fce241077d0 2024-09-19T08:35:47.884 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.378+0000 7fce2a476640 1 -- 172.21.15.7:0/3711189560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce2419bf80 con 0x7fce241077d0 2024-09-19T08:35:47.884 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.378+0000 7fce217fa640 1 -- 172.21.15.7:0/3711189560 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce1403a640 con 0x7fce241077d0 2024-09-19T08:35:47.884 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.378+0000 7fce2a476640 1 -- 172.21.15.7:0/3711189560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce2419ec70 con 0x7fce241077d0 2024-09-19T08:35:47.884 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.379+0000 7fce217fa640 1 -- 172.21.15.7:0/3711189560 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fce1403a940 con 0x7fce241077d0 2024-09-19T08:35:47.884 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.379+0000 7fce2a476640 1 -- 172.21.15.7:0/3711189560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce24107c50 con 0x7fce241077d0 2024-09-19T08:35:47.884 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.379+0000 7fce217fa640 1 --2- 172.21.15.7:0/3711189560 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7fce0c0391b0 0x7fce0c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:47.884 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.379+0000 7fce217fa640 1 -- 172.21.15.7:0/3711189560 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fce1406c9e0 con 0x7fce241077d0 2024-09-19T08:35:47.884 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.379+0000 7fce237fe640 1 --2- 172.21.15.7:0/3711189560 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7fce0c0391b0 0x7fce0c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:47.885 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.380+0000 7fce237fe640 1 --2- 172.21.15.7:0/3711189560 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7fce0c0391b0 0x7fce0c03b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fce180098c0 tx=0x7fce18006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:47.885 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.384+0000 7fce217fa640 1 -- 172.21.15.7:0/3711189560 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fce1403ba40 con 0x7fce241077d0 2024-09-19T08:35:47.885 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.593+0000 7fce2a476640 1 -- 172.21.15.7:0/3711189560 --> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fce24104250 con 0x7fce0c0391b0 2024-09-19T08:35:47.885 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.598+0000 7fce217fa640 1 -- 172.21.15.7:0/3711189560 <== mgr.14118 v2:172.21.15.7:6800/3071389382 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fce24104250 con 0x7fce0c0391b0 2024-09-19T08:35:47.886 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.600+0000 7fce2a476640 1 -- 172.21.15.7:0/3711189560 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7fce0c0391b0 msgr2=0x7fce0c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:47.886 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.600+0000 7fce2a476640 1 --2- 172.21.15.7:0/3711189560 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7fce0c0391b0 0x7fce0c03b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fce180098c0 tx=0x7fce18006db0 comp rx=0 tx=0).stop 2024-09-19T08:35:47.886 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.600+0000 7fce2a476640 1 -- 172.21.15.7:0/3711189560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce241077d0 msgr2=0x7fce2419b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:47.886 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.600+0000 7fce2a476640 1 --2- 172.21.15.7:0/3711189560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce241077d0 0x7fce2419b7b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fce140097f0 tx=0x7fce140327b0 comp rx=0 tx=0).stop 2024-09-19T08:35:47.887 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.600+0000 7fce2a476640 1 -- 172.21.15.7:0/3711189560 shutdown_connections 2024-09-19T08:35:47.887 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.600+0000 7fce2a476640 1 --2- 172.21.15.7:0/3711189560 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7fce0c0391b0 0x7fce0c03b670 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:47.887 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.600+0000 7fce2a476640 1 --2- 172.21.15.7:0/3711189560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce241077d0 0x7fce2419b7b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:47.887 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.600+0000 7fce2a476640 1 -- 172.21.15.7:0/3711189560 >> 172.21.15.7:0/3711189560 conn(0x7fce24102f60 msgr2=0x7fce24103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:47.887 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.600+0000 7fce2a476640 1 -- 172.21.15.7:0/3711189560 shutdown_connections 2024-09-19T08:35:47.887 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:46.600+0000 7fce2a476640 1 -- 172.21.15.7:0/3711189560 wait complete. 2024-09-19T08:35:49.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.280+0000 7f3d153a4640 1 Processor -- start 2024-09-19T08:35:49.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.280+0000 7f3d153a4640 1 -- start start 2024-09-19T08:35:49.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.281+0000 7f3d153a4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d101077d0 0x7f3d10107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:49.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.281+0000 7f3d153a4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3d101081a0 con 0x7f3d101077d0 2024-09-19T08:35:49.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.281+0000 7f3d0effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d101077d0 0x7f3d10107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:49.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.281+0000 7f3d0effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d101077d0 0x7f3d10107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38106/0 (socket says 172.21.15.7:38106) 2024-09-19T08:35:49.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.281+0000 7f3d0effd640 1 -- 172.21.15.7:0/2246757173 learned_addr learned my addr 172.21.15.7:0/2246757173 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:49.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.281+0000 7f3d0effd640 1 -- 172.21.15.7:0/2246757173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d101089d0 con 0x7f3d101077d0 2024-09-19T08:35:49.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.282+0000 7f3d0effd640 1 --2- 172.21.15.7:0/2246757173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d101077d0 0x7f3d10107bd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009820 tx=0x7f3d0002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50275555cc0b05ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:49.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.283+0000 7f3d0dffb640 1 -- 172.21.15.7:0/2246757173 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d00037070 con 0x7f3d101077d0 2024-09-19T08:35:49.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.283+0000 7f3d0dffb640 1 -- 172.21.15.7:0/2246757173 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d00032920 con 0x7f3d101077d0 2024-09-19T08:35:49.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.283+0000 7f3d0dffb640 1 -- 172.21.15.7:0/2246757173 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d00030810 con 0x7f3d101077d0 2024-09-19T08:35:49.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.283+0000 7f3d153a4640 1 -- 172.21.15.7:0/2246757173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d101077d0 msgr2=0x7f3d10107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:49.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.283+0000 7f3d153a4640 1 --2- 172.21.15.7:0/2246757173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d101077d0 0x7f3d10107bd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009820 tx=0x7f3d0002a270 comp rx=0 tx=0).stop 2024-09-19T08:35:49.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.283+0000 7f3d153a4640 1 -- 172.21.15.7:0/2246757173 shutdown_connections 2024-09-19T08:35:49.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.283+0000 7f3d153a4640 1 --2- 172.21.15.7:0/2246757173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d101077d0 0x7f3d10107bd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:49.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.283+0000 7f3d153a4640 1 -- 172.21.15.7:0/2246757173 >> 172.21.15.7:0/2246757173 conn(0x7f3d10103000 msgr2=0x7f3d10105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:49.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.284+0000 7f3d153a4640 1 -- 172.21.15.7:0/2246757173 shutdown_connections 2024-09-19T08:35:49.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.284+0000 7f3d153a4640 1 -- 172.21.15.7:0/2246757173 wait complete. 2024-09-19T08:35:49.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.284+0000 7f3d153a4640 1 Processor -- start 2024-09-19T08:35:49.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.284+0000 7f3d153a4640 1 -- start start 2024-09-19T08:35:49.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.285+0000 7f3d153a4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d101077d0 0x7f3d1007daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:49.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.285+0000 7f3d153a4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1010bd80 con 0x7f3d101077d0 2024-09-19T08:35:49.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.285+0000 7f3d0effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d101077d0 0x7f3d1007daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:49.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.285+0000 7f3d0effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d101077d0 0x7f3d1007daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38110/0 (socket says 172.21.15.7:38110) 2024-09-19T08:35:49.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.285+0000 7f3d0effd640 1 -- 172.21.15.7:0/887851414 learned_addr learned my addr 172.21.15.7:0/887851414 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:49.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.285+0000 7f3d0effd640 1 -- 172.21.15.7:0/887851414 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d1007e030 con 0x7f3d101077d0 2024-09-19T08:35:49.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.285+0000 7f3d0effd640 1 --2- 172.21.15.7:0/887851414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d101077d0 0x7f3d1007daf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3d000097f0 tx=0x7f3d000327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:49.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.286+0000 7f3cf7fff640 1 -- 172.21.15.7:0/887851414 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d00037040 con 0x7f3d101077d0 2024-09-19T08:35:49.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.286+0000 7f3cf7fff640 1 -- 172.21.15.7:0/887851414 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d00030cc0 con 0x7f3d101077d0 2024-09-19T08:35:49.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.286+0000 7f3cf7fff640 1 -- 172.21.15.7:0/887851414 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d0003a640 con 0x7f3d101077d0 2024-09-19T08:35:49.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.286+0000 7f3d153a4640 1 -- 172.21.15.7:0/887851414 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d1007c220 con 0x7f3d101077d0 2024-09-19T08:35:49.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.286+0000 7f3d153a4640 1 -- 172.21.15.7:0/887851414 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d1007c6a0 con 0x7f3d101077d0 2024-09-19T08:35:49.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.287+0000 7f3d153a4640 1 -- 172.21.15.7:0/887851414 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d10107c50 con 0x7f3d101077d0 2024-09-19T08:35:49.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.287+0000 7f3cf7fff640 1 -- 172.21.15.7:0/887851414 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f3d0003b3f0 con 0x7f3d101077d0 2024-09-19T08:35:49.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.287+0000 7f3cf7fff640 1 --2- 172.21.15.7:0/887851414 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f3cf80391b0 0x7f3cf803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:49.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.287+0000 7f3cf7fff640 1 -- 172.21.15.7:0/887851414 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3d0006c7d0 con 0x7f3d101077d0 2024-09-19T08:35:49.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.288+0000 7f3d0e7fc640 1 --2- 172.21.15.7:0/887851414 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f3cf80391b0 0x7f3cf803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:49.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.288+0000 7f3d0e7fc640 1 --2- 172.21.15.7:0/887851414 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f3cf80391b0 0x7f3cf803b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3d040098c0 tx=0x7f3d04006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:49.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.296+0000 7f3cf7fff640 1 -- 172.21.15.7:0/887851414 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3d000328c0 con 0x7f3d101077d0 2024-09-19T08:35:49.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.476+0000 7f3d153a4640 1 -- 172.21.15.7:0/887851414 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f3d1007cf70 con 0x7f3d101077d0 2024-09-19T08:35:49.045 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.479+0000 7f3cf7fff640 1 -- 172.21.15.7:0/887851414 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f3d00042dc0 con 0x7f3d101077d0 2024-09-19T08:35:49.045 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.482+0000 7f3d153a4640 1 -- 172.21.15.7:0/887851414 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f3cf80391b0 msgr2=0x7f3cf803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:49.045 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.482+0000 7f3d153a4640 1 --2- 172.21.15.7:0/887851414 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f3cf80391b0 0x7f3cf803b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3d040098c0 tx=0x7f3d04006db0 comp rx=0 tx=0).stop 2024-09-19T08:35:49.045 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.482+0000 7f3d153a4640 1 -- 172.21.15.7:0/887851414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d101077d0 msgr2=0x7f3d1007daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:49.045 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.482+0000 7f3d153a4640 1 --2- 172.21.15.7:0/887851414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d101077d0 0x7f3d1007daf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3d000097f0 tx=0x7f3d000327b0 comp rx=0 tx=0).stop 2024-09-19T08:35:49.045 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.482+0000 7f3d153a4640 1 -- 172.21.15.7:0/887851414 shutdown_connections 2024-09-19T08:35:49.045 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.482+0000 7f3d153a4640 1 --2- 172.21.15.7:0/887851414 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f3cf80391b0 0x7f3cf803b670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:49.045 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.482+0000 7f3d153a4640 1 --2- 172.21.15.7:0/887851414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d101077d0 0x7f3d1007daf0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:49.045 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.482+0000 7f3d153a4640 1 -- 172.21.15.7:0/887851414 >> 172.21.15.7:0/887851414 conn(0x7f3d10103000 msgr2=0x7f3d10103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:49.046 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.482+0000 7f3d153a4640 1 -- 172.21.15.7:0/887851414 shutdown_connections 2024-09-19T08:35:49.046 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:48.482+0000 7f3d153a4640 1 -- 172.21.15.7:0/887851414 wait complete. 2024-09-19T08:35:49.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:49 smithi007 ceph-mon[31221]: from='mgr.14118 172.21.15.7:0/2690452502' entity='mgr.x' 2024-09-19T08:35:49.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:49 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/887851414' entity='client.admin' 2024-09-19T08:35:50.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:50 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/911309822' entity='client.admin' 2024-09-19T08:35:50.910 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.459+0000 7fd9dc869640 1 Processor -- start 2024-09-19T08:35:50.910 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.459+0000 7fd9dc869640 1 -- start start 2024-09-19T08:35:50.910 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.459+0000 7fd9dc869640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d81082a0 0x7fd9d810a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:50.910 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.459+0000 7fd9dc869640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d807bdd0 con 0x7fd9d81082a0 2024-09-19T08:35:50.910 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.459+0000 7fd9d659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d81082a0 0x7fd9d810a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:50.910 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.459+0000 7fd9d659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d81082a0 0x7fd9d810a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38116/0 (socket says 172.21.15.7:38116) 2024-09-19T08:35:50.910 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.459+0000 7fd9d659c640 1 -- 172.21.15.7:0/2250397345 learned_addr learned my addr 172.21.15.7:0/2250397345 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:50.910 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.459+0000 7fd9d659c640 1 -- 172.21.15.7:0/2250397345 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d810abd0 con 0x7fd9d81082a0 2024-09-19T08:35:50.910 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.460+0000 7fd9d659c640 1 --2- 172.21.15.7:0/2250397345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d81082a0 0x7fd9d810a690 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009e80 tx=0x7fd9c802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926fd6710f12316a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:50.910 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.460+0000 7fd9d559a640 1 -- 172.21.15.7:0/2250397345 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9c8036070 con 0x7fd9d81082a0 2024-09-19T08:35:50.911 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.460+0000 7fd9d559a640 1 -- 172.21.15.7:0/2250397345 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9c80318e0 con 0x7fd9d81082a0 2024-09-19T08:35:50.911 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.460+0000 7fd9d559a640 1 -- 172.21.15.7:0/2250397345 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9c8007a00 con 0x7fd9d81082a0 2024-09-19T08:35:50.911 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.461+0000 7fd9dc869640 1 -- 172.21.15.7:0/2250397345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d81082a0 msgr2=0x7fd9d810a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:50.911 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.461+0000 7fd9dc869640 1 --2- 172.21.15.7:0/2250397345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d81082a0 0x7fd9d810a690 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009e80 tx=0x7fd9c802a7a0 comp rx=0 tx=0).stop 2024-09-19T08:35:50.911 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.461+0000 7fd9dc869640 1 -- 172.21.15.7:0/2250397345 shutdown_connections 2024-09-19T08:35:50.911 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.461+0000 7fd9dc869640 1 --2- 172.21.15.7:0/2250397345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d81082a0 0x7fd9d810a690 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:50.911 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.461+0000 7fd9dc869640 1 -- 172.21.15.7:0/2250397345 >> 172.21.15.7:0/2250397345 conn(0x7fd9d8101e60 msgr2=0x7fd9d81042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:50.911 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.461+0000 7fd9dc869640 1 -- 172.21.15.7:0/2250397345 shutdown_connections 2024-09-19T08:35:50.911 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.461+0000 7fd9dc869640 1 -- 172.21.15.7:0/2250397345 wait complete. 2024-09-19T08:35:50.911 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.462+0000 7fd9dc869640 1 Processor -- start 2024-09-19T08:35:50.911 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.462+0000 7fd9dc869640 1 -- start start 2024-09-19T08:35:50.911 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.462+0000 7fd9dc869640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d81082a0 0x7fd9d819b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:50.911 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.462+0000 7fd9dc869640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d810bbe0 con 0x7fd9d81082a0 2024-09-19T08:35:50.911 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.462+0000 7fd9d659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d81082a0 0x7fd9d819b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:50.912 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.462+0000 7fd9d659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d81082a0 0x7fd9d819b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38132/0 (socket says 172.21.15.7:38132) 2024-09-19T08:35:50.912 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.462+0000 7fd9d659c640 1 -- 172.21.15.7:0/911309822 learned_addr learned my addr 172.21.15.7:0/911309822 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:50.912 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.463+0000 7fd9d659c640 1 -- 172.21.15.7:0/911309822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d819bce0 con 0x7fd9d81082a0 2024-09-19T08:35:50.912 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.463+0000 7fd9d659c640 1 --2- 172.21.15.7:0/911309822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d81082a0 0x7fd9d819b7a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd9c802acc0 tx=0x7fd9c8031cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:50.912 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.463+0000 7fd9cf7fe640 1 -- 172.21.15.7:0/911309822 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9c8036050 con 0x7fd9d81082a0 2024-09-19T08:35:50.912 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.463+0000 7fd9cf7fe640 1 -- 172.21.15.7:0/911309822 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9c8037040 con 0x7fd9d81082a0 2024-09-19T08:35:50.912 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.463+0000 7fd9dc869640 1 -- 172.21.15.7:0/911309822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d819bf70 con 0x7fd9d81082a0 2024-09-19T08:35:50.912 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.463+0000 7fd9cf7fe640 1 -- 172.21.15.7:0/911309822 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9c803d8e0 con 0x7fd9d81082a0 2024-09-19T08:35:50.912 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.463+0000 7fd9dc869640 1 -- 172.21.15.7:0/911309822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d819ec60 con 0x7fd9d81082a0 2024-09-19T08:35:50.912 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.464+0000 7fd9cf7fe640 1 -- 172.21.15.7:0/911309822 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fd9c8044020 con 0x7fd9d81082a0 2024-09-19T08:35:50.912 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.464+0000 7fd9dc869640 1 -- 172.21.15.7:0/911309822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9d8108700 con 0x7fd9d81082a0 2024-09-19T08:35:50.912 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.464+0000 7fd9cf7fe640 1 --2- 172.21.15.7:0/911309822 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7fd9c40391b0 0x7fd9c403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:50.912 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.464+0000 7fd9cf7fe640 1 -- 172.21.15.7:0/911309822 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd9c8042020 con 0x7fd9d81082a0 2024-09-19T08:35:50.913 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.464+0000 7fd9d5d9b640 1 --2- 172.21.15.7:0/911309822 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7fd9c40391b0 0x7fd9c403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:50.913 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.465+0000 7fd9d5d9b640 1 --2- 172.21.15.7:0/911309822 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7fd9c40391b0 0x7fd9c403b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00098c0 tx=0x7fd9c0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:50.913 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.471+0000 7fd9cf7fe640 1 -- 172.21.15.7:0/911309822 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd9c804b020 con 0x7fd9d81082a0 2024-09-19T08:35:50.913 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.652+0000 7fd9dc869640 1 -- 172.21.15.7:0/911309822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fd9d819f2c0 con 0x7fd9d81082a0 2024-09-19T08:35:50.913 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.654+0000 7fd9cf7fe640 1 -- 172.21.15.7:0/911309822 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fd9c804b200 con 0x7fd9d81082a0 2024-09-19T08:35:50.913 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.657+0000 7fd9dc869640 1 -- 172.21.15.7:0/911309822 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7fd9c40391b0 msgr2=0x7fd9c403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:50.913 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.657+0000 7fd9dc869640 1 --2- 172.21.15.7:0/911309822 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7fd9c40391b0 0x7fd9c403b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00098c0 tx=0x7fd9c0006db0 comp rx=0 tx=0).stop 2024-09-19T08:35:50.913 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.657+0000 7fd9dc869640 1 -- 172.21.15.7:0/911309822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d81082a0 msgr2=0x7fd9d819b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:50.914 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.657+0000 7fd9dc869640 1 --2- 172.21.15.7:0/911309822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d81082a0 0x7fd9d819b7a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd9c802acc0 tx=0x7fd9c8031cc0 comp rx=0 tx=0).stop 2024-09-19T08:35:50.914 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.657+0000 7fd9dc869640 1 -- 172.21.15.7:0/911309822 shutdown_connections 2024-09-19T08:35:50.914 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.657+0000 7fd9dc869640 1 --2- 172.21.15.7:0/911309822 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7fd9c40391b0 0x7fd9c403b670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:50.914 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.657+0000 7fd9dc869640 1 --2- 172.21.15.7:0/911309822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d81082a0 0x7fd9d819b7a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:50.914 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.657+0000 7fd9dc869640 1 -- 172.21.15.7:0/911309822 >> 172.21.15.7:0/911309822 conn(0x7fd9d8101e60 msgr2=0x7fd9d8102af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:50.914 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.657+0000 7fd9dc869640 1 -- 172.21.15.7:0/911309822 shutdown_connections 2024-09-19T08:35:50.914 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:49.657+0000 7fd9dc869640 1 -- 172.21.15.7:0/911309822 wait complete. 2024-09-19T08:35:50.914 INFO:teuthology.orchestra.run.smithi007.stdout:Enabling the dashboard module... 2024-09-19T08:35:51.810 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:51 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/539170922' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T08:35:51.810 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:51 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: ignoring --setuser ceph since I am not root 2024-09-19T08:35:51.810 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:51 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: ignoring --setgroup ceph since I am not root 2024-09-19T08:35:51.811 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:51 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:51.810+0000 7f4a13f3e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:35:52.098 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:51 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:51.870+0000 7f4a13f3e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:35:52.098 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:52 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:52.028+0000 7f4a13f3e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:35:52.098 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:52 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:52.097+0000 7f4a13f3e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:35:52.232 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.323+0000 7fc1d2c74640 1 Processor -- start 2024-09-19T08:35:52.232 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.323+0000 7fc1d2c74640 1 -- start start 2024-09-19T08:35:52.232 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.323+0000 7fc1d2c74640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1cc07de00 0x7fc1cc07c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:52.232 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.323+0000 7fc1d2c74640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc07c830 con 0x7fc1cc07de00 2024-09-19T08:35:52.232 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.323+0000 7fc1d0a10640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1cc07de00 0x7fc1cc07c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:52.233 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.323+0000 7fc1d0a10640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1cc07de00 0x7fc1cc07c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38146/0 (socket says 172.21.15.7:38146) 2024-09-19T08:35:52.233 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.323+0000 7fc1d0a10640 1 -- 172.21.15.7:0/1101824372 learned_addr learned my addr 172.21.15.7:0/1101824372 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:52.233 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.323+0000 7fc1d0a10640 1 -- 172.21.15.7:0/1101824372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1cc07c9b0 con 0x7fc1cc07de00 2024-09-19T08:35:52.233 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.324+0000 7fc1d0a10640 1 --2- 172.21.15.7:0/1101824372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1cc07de00 0x7fc1cc07c260 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009820 tx=0x7fc1c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4e10b1151eca45 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:52.233 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.324+0000 7fc1cb7fe640 1 -- 172.21.15.7:0/1101824372 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1c0037070 con 0x7fc1cc07de00 2024-09-19T08:35:52.233 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.324+0000 7fc1cb7fe640 1 -- 172.21.15.7:0/1101824372 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1c0032920 con 0x7fc1cc07de00 2024-09-19T08:35:52.233 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.324+0000 7fc1cb7fe640 1 -- 172.21.15.7:0/1101824372 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1c0030810 con 0x7fc1cc07de00 2024-09-19T08:35:52.233 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.325+0000 7fc1d2c74640 1 -- 172.21.15.7:0/1101824372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1cc07de00 msgr2=0x7fc1cc07c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:52.233 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.325+0000 7fc1d2c74640 1 --2- 172.21.15.7:0/1101824372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1cc07de00 0x7fc1cc07c260 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009820 tx=0x7fc1c002a270 comp rx=0 tx=0).stop 2024-09-19T08:35:52.233 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.325+0000 7fc1d2c74640 1 -- 172.21.15.7:0/1101824372 shutdown_connections 2024-09-19T08:35:52.233 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.325+0000 7fc1d2c74640 1 --2- 172.21.15.7:0/1101824372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1cc07de00 0x7fc1cc07c260 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:52.234 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.325+0000 7fc1d2c74640 1 -- 172.21.15.7:0/1101824372 >> 172.21.15.7:0/1101824372 conn(0x7fc1cc102f60 msgr2=0x7fc1cc1053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:52.234 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.325+0000 7fc1d2c74640 1 -- 172.21.15.7:0/1101824372 shutdown_connections 2024-09-19T08:35:52.234 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.325+0000 7fc1d2c74640 1 -- 172.21.15.7:0/1101824372 wait complete. 2024-09-19T08:35:52.234 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.326+0000 7fc1d2c74640 1 Processor -- start 2024-09-19T08:35:52.234 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.326+0000 7fc1d2c74640 1 -- start start 2024-09-19T08:35:52.234 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.326+0000 7fc1d2c74640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1cc07de00 0x7fc1cc19d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:52.234 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.326+0000 7fc1d2c74640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc10ddf0 con 0x7fc1cc07de00 2024-09-19T08:35:52.234 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.326+0000 7fc1d0a10640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1cc07de00 0x7fc1cc19d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:52.234 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.326+0000 7fc1d0a10640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1cc07de00 0x7fc1cc19d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38154/0 (socket says 172.21.15.7:38154) 2024-09-19T08:35:52.234 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.326+0000 7fc1d0a10640 1 -- 172.21.15.7:0/539170922 learned_addr learned my addr 172.21.15.7:0/539170922 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:52.234 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.326+0000 7fc1d0a10640 1 -- 172.21.15.7:0/539170922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1cc19dec0 con 0x7fc1cc07de00 2024-09-19T08:35:52.234 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.327+0000 7fc1d0a10640 1 --2- 172.21.15.7:0/539170922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1cc07de00 0x7fc1cc19d980 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0030380 tx=0x7fc1c0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:52.234 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.327+0000 7fc1c9ffb640 1 -- 172.21.15.7:0/539170922 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1c0037040 con 0x7fc1cc07de00 2024-09-19T08:35:52.235 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.327+0000 7fc1c9ffb640 1 -- 172.21.15.7:0/539170922 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1c0040070 con 0x7fc1cc07de00 2024-09-19T08:35:52.235 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.327+0000 7fc1d2c74640 1 -- 172.21.15.7:0/539170922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1cc19e150 con 0x7fc1cc07de00 2024-09-19T08:35:52.235 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.327+0000 7fc1c9ffb640 1 -- 172.21.15.7:0/539170922 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1c003a7b0 con 0x7fc1cc07de00 2024-09-19T08:35:52.235 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.327+0000 7fc1d2c74640 1 -- 172.21.15.7:0/539170922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1cc1a0e40 con 0x7fc1cc07de00 2024-09-19T08:35:52.235 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.328+0000 7fc1c9ffb640 1 -- 172.21.15.7:0/539170922 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fc1c003a9e0 con 0x7fc1cc07de00 2024-09-19T08:35:52.235 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.328+0000 7fc1d2c74640 1 -- 172.21.15.7:0/539170922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1cc07c2e0 con 0x7fc1cc07de00 2024-09-19T08:35:52.235 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.328+0000 7fc1c9ffb640 1 --2- 172.21.15.7:0/539170922 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7fc1bc039200 0x7fc1bc03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:52.235 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.328+0000 7fc1c9ffb640 1 -- 172.21.15.7:0/539170922 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc1c006ca20 con 0x7fc1cc07de00 2024-09-19T08:35:52.235 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.328+0000 7fc1cbfff640 1 --2- 172.21.15.7:0/539170922 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7fc1bc039200 0x7fc1bc03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:52.235 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.329+0000 7fc1cbfff640 1 --2- 172.21.15.7:0/539170922 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7fc1bc039200 0x7fc1bc03b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80098c0 tx=0x7fc1b8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:52.235 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.333+0000 7fc1c9ffb640 1 -- 172.21.15.7:0/539170922 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc1c0044c70 con 0x7fc1cc07de00 2024-09-19T08:35:52.235 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.556+0000 7fc1d2c74640 1 -- 172.21.15.7:0/539170922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fc1cc1a13e0 con 0x7fc1cc07de00 2024-09-19T08:35:52.235 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.657+0000 7fc1c9ffb640 1 -- 172.21.15.7:0/539170922 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fc1c003ae20 con 0x7fc1cc07de00 2024-09-19T08:35:52.236 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.658+0000 7fc1c9ffb640 1 -- 172.21.15.7:0/539170922 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fc1c0045980 con 0x7fc1cc07de00 2024-09-19T08:35:52.236 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.659+0000 7fc1d2c74640 1 -- 172.21.15.7:0/539170922 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7fc1bc039200 msgr2=0x7fc1bc03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:52.236 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.659+0000 7fc1d2c74640 1 --2- 172.21.15.7:0/539170922 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7fc1bc039200 0x7fc1bc03b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80098c0 tx=0x7fc1b8006db0 comp rx=0 tx=0).stop 2024-09-19T08:35:52.236 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.659+0000 7fc1d2c74640 1 -- 172.21.15.7:0/539170922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1cc07de00 msgr2=0x7fc1cc19d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:52.236 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.659+0000 7fc1d2c74640 1 --2- 172.21.15.7:0/539170922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1cc07de00 0x7fc1cc19d980 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0030380 tx=0x7fc1c0032670 comp rx=0 tx=0).stop 2024-09-19T08:35:52.236 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.660+0000 7fc1d2c74640 1 -- 172.21.15.7:0/539170922 shutdown_connections 2024-09-19T08:35:52.236 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.660+0000 7fc1d2c74640 1 --2- 172.21.15.7:0/539170922 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7fc1bc039200 0x7fc1bc03b6c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:52.236 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.660+0000 7fc1d2c74640 1 --2- 172.21.15.7:0/539170922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1cc07de00 0x7fc1cc19d980 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:52.236 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.660+0000 7fc1d2c74640 1 -- 172.21.15.7:0/539170922 >> 172.21.15.7:0/539170922 conn(0x7fc1cc102f60 msgr2=0x7fc1cc103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:52.236 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.660+0000 7fc1d2c74640 1 -- 172.21.15.7:0/539170922 shutdown_connections 2024-09-19T08:35:52.236 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:51.660+0000 7fc1d2c74640 1 -- 172.21.15.7:0/539170922 wait complete. 2024-09-19T08:35:52.351 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:52 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:52.255+0000 7f4a13f3e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:35:52.653 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:52 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:52.406+0000 7f4a13f3e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:35:52.905 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:52 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:52.745+0000 7f4a13f3e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:35:52.905 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:52 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:52.810+0000 7f4a13f3e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:35:52.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:52 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/539170922' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T08:35:52.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:52 smithi007 ceph-mon[31221]: mgrmap e9: x(active, since 19s) 2024-09-19T08:35:53.215 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:53 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:53.016+0000 7f4a13f3e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:35:53.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:35:53.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T08:35:53.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:35:53.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T08:35:53.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T08:35:53.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:35:53.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.667+0000 7f76ba0ec640 1 Processor -- start 2024-09-19T08:35:53.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.667+0000 7f76ba0ec640 1 -- start start 2024-09-19T08:35:53.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.667+0000 7f76ba0ec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b41082c0 0x7f76b410a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:53.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.667+0000 7f76ba0ec640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f76b407bdd0 con 0x7f76b41082c0 2024-09-19T08:35:53.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.667+0000 7f76b37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b41082c0 0x7f76b410a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:53.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.667+0000 7f76b37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b41082c0 0x7f76b410a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38184/0 (socket says 172.21.15.7:38184) 2024-09-19T08:35:53.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.667+0000 7f76b37fe640 1 -- 172.21.15.7:0/241563745 learned_addr learned my addr 172.21.15.7:0/241563745 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:53.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.667+0000 7f76b37fe640 1 -- 172.21.15.7:0/241563745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b410abf0 con 0x7f76b41082c0 2024-09-19T08:35:53.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.668+0000 7f76b37fe640 1 --2- 172.21.15.7:0/241563745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b41082c0 0x7f76b410a6b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f76a4009820 tx=0x7f76a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5050f61ca64df9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:53.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.668+0000 7f76b27fc640 1 -- 172.21.15.7:0/241563745 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76a4037070 con 0x7f76b41082c0 2024-09-19T08:35:53.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.668+0000 7f76b27fc640 1 -- 172.21.15.7:0/241563745 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76a4032920 con 0x7f76b41082c0 2024-09-19T08:35:53.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.668+0000 7f76b27fc640 1 -- 172.21.15.7:0/241563745 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76a4030810 con 0x7f76b41082c0 2024-09-19T08:35:53.500 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.669+0000 7f76ba0ec640 1 -- 172.21.15.7:0/241563745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b41082c0 msgr2=0x7f76b410a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:53.500 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.669+0000 7f76ba0ec640 1 --2- 172.21.15.7:0/241563745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b41082c0 0x7f76b410a6b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f76a4009820 tx=0x7f76a402a270 comp rx=0 tx=0).stop 2024-09-19T08:35:53.500 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.669+0000 7f76ba0ec640 1 -- 172.21.15.7:0/241563745 shutdown_connections 2024-09-19T08:35:53.500 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.669+0000 7f76ba0ec640 1 --2- 172.21.15.7:0/241563745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b41082c0 0x7f76b410a6b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:53.500 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.669+0000 7f76ba0ec640 1 -- 172.21.15.7:0/241563745 >> 172.21.15.7:0/241563745 conn(0x7f76b4101e80 msgr2=0x7f76b41042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:53.500 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.669+0000 7f76ba0ec640 1 -- 172.21.15.7:0/241563745 shutdown_connections 2024-09-19T08:35:53.500 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.669+0000 7f76ba0ec640 1 -- 172.21.15.7:0/241563745 wait complete. 2024-09-19T08:35:53.500 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.670+0000 7f76ba0ec640 1 Processor -- start 2024-09-19T08:35:53.500 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.670+0000 7f76ba0ec640 1 -- start start 2024-09-19T08:35:53.500 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.670+0000 7f76ba0ec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b41082c0 0x7f76b4107b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:53.500 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.670+0000 7f76ba0ec640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f76b410bc00 con 0x7f76b41082c0 2024-09-19T08:35:53.501 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.670+0000 7f76b37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b41082c0 0x7f76b4107b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:53.501 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.670+0000 7f76b37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b41082c0 0x7f76b4107b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38194/0 (socket says 172.21.15.7:38194) 2024-09-19T08:35:53.501 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.670+0000 7f76b37fe640 1 -- 172.21.15.7:0/2074400144 learned_addr learned my addr 172.21.15.7:0/2074400144 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:53.501 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.671+0000 7f76b37fe640 1 -- 172.21.15.7:0/2074400144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b4108080 con 0x7f76b41082c0 2024-09-19T08:35:53.501 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.671+0000 7f76b37fe640 1 --2- 172.21.15.7:0/2074400144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b41082c0 0x7f76b4107b40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f76a4030380 tx=0x7f76a4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:53.501 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.671+0000 7f76b0ff9640 1 -- 172.21.15.7:0/2074400144 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76a4037040 con 0x7f76b41082c0 2024-09-19T08:35:53.501 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.671+0000 7f76b0ff9640 1 -- 172.21.15.7:0/2074400144 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76a4040070 con 0x7f76b41082c0 2024-09-19T08:35:53.501 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.671+0000 7f76ba0ec640 1 -- 172.21.15.7:0/2074400144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76b4106270 con 0x7f76b41082c0 2024-09-19T08:35:53.501 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.671+0000 7f76b0ff9640 1 -- 172.21.15.7:0/2074400144 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76a403a7b0 con 0x7f76b41082c0 2024-09-19T08:35:53.501 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.671+0000 7f76ba0ec640 1 -- 172.21.15.7:0/2074400144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76b41067b0 con 0x7f76b41082c0 2024-09-19T08:35:53.501 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.672+0000 7f76b0ff9640 1 -- 172.21.15.7:0/2074400144 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f76a403a9e0 con 0x7f76b41082c0 2024-09-19T08:35:53.501 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.672+0000 7f76b0ff9640 1 --2- 172.21.15.7:0/2074400144 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f769c039260 0x7f769c03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:53.501 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.672+0000 7f76b0ff9640 1 -- 172.21.15.7:0/2074400144 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f76a406c990 con 0x7f76b41082c0 2024-09-19T08:35:53.502 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.672+0000 7f76b2ffd640 1 -- 172.21.15.7:0/2074400144 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f769c039260 msgr2=0x7f769c03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3071389382 2024-09-19T08:35:53.502 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.672+0000 7f76b2ffd640 1 --2- 172.21.15.7:0/2074400144 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f769c039260 0x7f769c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:35:53.502 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.672+0000 7f76ba0ec640 1 -- 172.21.15.7:0/2074400144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76b4108720 con 0x7f76b41082c0 2024-09-19T08:35:53.502 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.677+0000 7f76b0ff9640 1 -- 172.21.15.7:0/2074400144 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f76a4041270 con 0x7f76b41082c0 2024-09-19T08:35:53.502 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.873+0000 7f76b2ffd640 1 -- 172.21.15.7:0/2074400144 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f769c039260 msgr2=0x7f769c03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3071389382 2024-09-19T08:35:53.502 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.873+0000 7f76b2ffd640 1 --2- 172.21.15.7:0/2074400144 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f769c039260 0x7f769c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:35:53.502 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.902+0000 7f76ba0ec640 1 -- 172.21.15.7:0/2074400144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f76b4106e20 con 0x7f76b41082c0 2024-09-19T08:35:53.502 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.902+0000 7f76b0ff9640 1 -- 172.21.15.7:0/2074400144 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f76a403bc00 con 0x7f76b41082c0 2024-09-19T08:35:53.502 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.905+0000 7f76ba0ec640 1 -- 172.21.15.7:0/2074400144 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f769c039260 msgr2=0x7f769c03b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:35:53.502 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.905+0000 7f76ba0ec640 1 --2- 172.21.15.7:0/2074400144 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f769c039260 0x7f769c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:53.502 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.905+0000 7f76ba0ec640 1 -- 172.21.15.7:0/2074400144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b41082c0 msgr2=0x7f76b4107b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:53.503 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.905+0000 7f76ba0ec640 1 --2- 172.21.15.7:0/2074400144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b41082c0 0x7f76b4107b40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f76a4030380 tx=0x7f76a4032670 comp rx=0 tx=0).stop 2024-09-19T08:35:53.503 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.905+0000 7f76ba0ec640 1 -- 172.21.15.7:0/2074400144 shutdown_connections 2024-09-19T08:35:53.503 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.905+0000 7f76ba0ec640 1 --2- 172.21.15.7:0/2074400144 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f769c039260 0x7f769c03b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:53.503 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.905+0000 7f76ba0ec640 1 --2- 172.21.15.7:0/2074400144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b41082c0 0x7f76b4107b40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:53.503 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.905+0000 7f76ba0ec640 1 -- 172.21.15.7:0/2074400144 >> 172.21.15.7:0/2074400144 conn(0x7f76b4101e80 msgr2=0x7f76b4102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:53.503 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.905+0000 7f76ba0ec640 1 -- 172.21.15.7:0/2074400144 shutdown_connections 2024-09-19T08:35:53.503 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:52.905+0000 7f76ba0ec640 1 -- 172.21.15.7:0/2074400144 wait complete. 2024-09-19T08:35:53.503 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for the mgr to restart... 2024-09-19T08:35:53.503 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr epoch 9... 2024-09-19T08:35:53.740 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:53 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2074400144' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T08:35:54.033 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:53 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:53.967+0000 7f4a13f3e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:35:54.515 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:54 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:54.039+0000 7f4a13f3e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:35:55.070 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:54 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:54.797+0000 7f4a13f3e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:35:55.070 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:54 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:54.919+0000 7f4a13f3e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:35:55.364 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:55 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:55.070+0000 7f4a13f3e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:35:55.364 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:55 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:55.135+0000 7f4a13f3e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:35:55.365 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:55 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:55.292+0000 7f4a13f3e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:35:55.365 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:55 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:55.364+0000 7f4a13f3e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:35:55.663 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:55 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:55.428+0000 7f4a13f3e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:35:55.663 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:55 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:55.594+0000 7f4a13f3e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:35:55.663 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:55 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:55.663+0000 7f4a13f3e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:35:55.945 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:55 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:55.733+0000 7f4a13f3e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:35:55.945 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:55 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:55.820+0000 7f4a13f3e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:35:55.945 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:55 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:55.883+0000 7f4a13f3e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:35:55.946 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:55 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:55.945+0000 7f4a13f3e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:35:57.033 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:56 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:56.782+0000 7f4a13f3e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:35:57.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:56 smithi007 ceph-mon[31221]: Active manager daemon x restarted 2024-09-19T08:35:57.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:56 smithi007 ceph-mon[31221]: Activating manager daemon x 2024-09-19T08:35:57.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:56 smithi007 ceph-mon[31221]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T08:35:57.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:56 smithi007 ceph-mon[31221]: mgrmap e10: x(active, starting, since 0.00323107s) 2024-09-19T08:35:57.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:35:57.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:35:57.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:35:57.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:35:57.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:35:57.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:56 smithi007 ceph-mon[31221]: Manager daemon x is now available 2024-09-19T08:35:57.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:35:57.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:35:57.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:35:58.618 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:35:58.618 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T08:35:58.618 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T08:35:58.618 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:35:58.618 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.907+0000 7f4ca91a0640 1 Processor -- start 2024-09-19T08:35:58.618 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.907+0000 7f4ca91a0640 1 -- start start 2024-09-19T08:35:58.618 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.908+0000 7f4ca91a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ca4106500 0x7f4ca4106900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:58.619 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.908+0000 7f4ca91a0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca4106ed0 con 0x7f4ca4106500 2024-09-19T08:35:58.619 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.908+0000 7f4ca3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ca4106500 0x7f4ca4106900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:58.619 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.908+0000 7f4ca3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ca4106500 0x7f4ca4106900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45102/0 (socket says 172.21.15.7:45102) 2024-09-19T08:35:58.619 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.908+0000 7f4ca3fff640 1 -- 172.21.15.7:0/1340310458 learned_addr learned my addr 172.21.15.7:0/1340310458 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:58.619 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.908+0000 7f4ca3fff640 1 -- 172.21.15.7:0/1340310458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca4107700 con 0x7f4ca4106500 2024-09-19T08:35:58.619 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.909+0000 7f4ca3fff640 1 --2- 172.21.15.7:0/1340310458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ca4106500 0x7f4ca4106900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4c94009820 tx=0x7f4c9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df9699d8b25248b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:58.619 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.909+0000 7f4ca37fe640 1 -- 172.21.15.7:0/1340310458 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c94037070 con 0x7f4ca4106500 2024-09-19T08:35:58.619 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.909+0000 7f4ca37fe640 1 -- 172.21.15.7:0/1340310458 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c94032920 con 0x7f4ca4106500 2024-09-19T08:35:58.619 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.909+0000 7f4ca37fe640 1 -- 172.21.15.7:0/1340310458 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c94030810 con 0x7f4ca4106500 2024-09-19T08:35:58.619 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.910+0000 7f4ca91a0640 1 -- 172.21.15.7:0/1340310458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ca4106500 msgr2=0x7f4ca4106900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:58.619 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.910+0000 7f4ca91a0640 1 --2- 172.21.15.7:0/1340310458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ca4106500 0x7f4ca4106900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4c94009820 tx=0x7f4c9402a270 comp rx=0 tx=0).stop 2024-09-19T08:35:58.619 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.910+0000 7f4ca91a0640 1 -- 172.21.15.7:0/1340310458 shutdown_connections 2024-09-19T08:35:58.619 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.910+0000 7f4ca91a0640 1 --2- 172.21.15.7:0/1340310458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ca4106500 0x7f4ca4106900 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:58.620 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.910+0000 7f4ca91a0640 1 -- 172.21.15.7:0/1340310458 >> 172.21.15.7:0/1340310458 conn(0x7f4ca4101cd0 msgr2=0x7f4ca41040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:58.620 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.910+0000 7f4ca91a0640 1 -- 172.21.15.7:0/1340310458 shutdown_connections 2024-09-19T08:35:58.620 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.910+0000 7f4ca91a0640 1 -- 172.21.15.7:0/1340310458 wait complete. 2024-09-19T08:35:58.620 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.911+0000 7f4ca91a0640 1 Processor -- start 2024-09-19T08:35:58.620 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.911+0000 7f4ca91a0640 1 -- start start 2024-09-19T08:35:58.620 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.911+0000 7f4ca91a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ca4106500 0x7f4ca407b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:58.620 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.911+0000 7f4ca91a0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca410aab0 con 0x7f4ca4106500 2024-09-19T08:35:58.620 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.911+0000 7f4ca3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ca4106500 0x7f4ca407b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:58.620 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.911+0000 7f4ca3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ca4106500 0x7f4ca407b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45112/0 (socket says 172.21.15.7:45112) 2024-09-19T08:35:58.620 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.911+0000 7f4ca3fff640 1 -- 172.21.15.7:0/2411322745 learned_addr learned my addr 172.21.15.7:0/2411322745 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:58.620 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.912+0000 7f4ca3fff640 1 -- 172.21.15.7:0/2411322745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca419e380 con 0x7f4ca4106500 2024-09-19T08:35:58.620 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.912+0000 7f4ca3fff640 1 --2- 172.21.15.7:0/2411322745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ca4106500 0x7f4ca407b9d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4c94030560 tx=0x7f4c94032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:58.621 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.912+0000 7f4ca1ffb640 1 -- 172.21.15.7:0/2411322745 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c94037040 con 0x7f4ca4106500 2024-09-19T08:35:58.621 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.912+0000 7f4ca1ffb640 1 -- 172.21.15.7:0/2411322745 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c94040070 con 0x7f4ca4106500 2024-09-19T08:35:58.621 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.912+0000 7f4ca91a0640 1 -- 172.21.15.7:0/2411322745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca419e550 con 0x7f4ca4106500 2024-09-19T08:35:58.621 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.912+0000 7f4ca1ffb640 1 -- 172.21.15.7:0/2411322745 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c9403a740 con 0x7f4ca4106500 2024-09-19T08:35:58.621 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.912+0000 7f4ca91a0640 1 -- 172.21.15.7:0/2411322745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca419e8f0 con 0x7f4ca4106500 2024-09-19T08:35:58.621 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.913+0000 7f4ca1ffb640 1 -- 172.21.15.7:0/2411322745 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f4c9403bb90 con 0x7f4ca4106500 2024-09-19T08:35:58.621 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.913+0000 7f4ca1ffb640 1 --2- 172.21.15.7:0/2411322745 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f4c90039200 0x7f4c9003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:58.621 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.913+0000 7f4ca1ffb640 1 -- 172.21.15.7:0/2411322745 --> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4c9003bdd0 con 0x7f4c90039200 2024-09-19T08:35:58.621 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.913+0000 7f4c9bfff640 1 -- 172.21.15.7:0/2411322745 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f4c90039200 msgr2=0x7f4c9003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3071389382 2024-09-19T08:35:58.621 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.913+0000 7f4ca1ffb640 1 -- 172.21.15.7:0/2411322745 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4c9406c900 con 0x7f4ca4106500 2024-09-19T08:35:58.621 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:53.913+0000 7f4c9bfff640 1 --2- 172.21.15.7:0/2411322745 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f4c90039200 0x7f4c9003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:35:58.622 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.114+0000 7f4c9bfff640 1 -- 172.21.15.7:0/2411322745 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f4c90039200 msgr2=0x7f4c9003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3071389382 2024-09-19T08:35:58.622 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.114+0000 7f4c9bfff640 1 --2- 172.21.15.7:0/2411322745 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f4c90039200 0x7f4c9003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:35:58.622 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.515+0000 7f4c9bfff640 1 -- 172.21.15.7:0/2411322745 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f4c90039200 msgr2=0x7f4c9003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3071389382 2024-09-19T08:35:58.622 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:54.515+0000 7f4c9bfff640 1 --2- 172.21.15.7:0/2411322745 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f4c90039200 0x7f4c9003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T08:35:58.622 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.316+0000 7f4c9bfff640 1 -- 172.21.15.7:0/2411322745 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f4c90039200 msgr2=0x7f4c9003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3071389382 2024-09-19T08:35:58.622 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:55.316+0000 7f4c9bfff640 1 --2- 172.21.15.7:0/2411322745 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f4c90039200 0x7f4c9003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T08:35:58.622 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.785+0000 7f4ca1ffb640 1 -- 172.21.15.7:0/2411322745 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f4c9406b3b0 con 0x7f4ca4106500 2024-09-19T08:35:58.622 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.785+0000 7f4ca1ffb640 1 -- 172.21.15.7:0/2411322745 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f4c90039200 msgr2=0x7f4c9003b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:35:58.622 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:56.785+0000 7f4ca1ffb640 1 --2- 172.21.15.7:0/2411322745 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f4c90039200 0x7f4c9003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:58.622 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.787+0000 7f4ca1ffb640 1 -- 172.21.15.7:0/2411322745 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f4c9403ad30 con 0x7f4ca4106500 2024-09-19T08:35:58.622 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.787+0000 7f4ca1ffb640 1 --2- 172.21.15.7:0/2411322745 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4c9003ccc0 0x7f4c9003f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:58.622 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.787+0000 7f4ca1ffb640 1 -- 172.21.15.7:0/2411322745 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4c9403ee50 con 0x7f4c9003ccc0 2024-09-19T08:35:58.622 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.788+0000 7f4c9bfff640 1 --2- 172.21.15.7:0/2411322745 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4c9003ccc0 0x7f4c9003f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:58.623 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.789+0000 7f4c9bfff640 1 --2- 172.21.15.7:0/2411322745 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4c9003ccc0 0x7f4c9003f0b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c003980 tx=0x7f4c8c006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:58.623 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.789+0000 7f4ca1ffb640 1 -- 172.21.15.7:0/2411322745 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f4c9403ee50 con 0x7f4c9003ccc0 2024-09-19T08:35:58.623 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.802+0000 7f4ca91a0640 1 -- 172.21.15.7:0/2411322745 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f4ca4106980 con 0x7f4c9003ccc0 2024-09-19T08:35:58.623 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.802+0000 7f4ca1ffb640 1 -- 172.21.15.7:0/2411322745 <== mgr.14150 v2:172.21.15.7:6800/3577760109 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f4ca4106980 con 0x7f4c9003ccc0 2024-09-19T08:35:58.623 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.802+0000 7f4ca91a0640 1 -- 172.21.15.7:0/2411322745 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4c9003ccc0 msgr2=0x7f4c9003f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:58.623 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.802+0000 7f4ca91a0640 1 --2- 172.21.15.7:0/2411322745 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4c9003ccc0 0x7f4c9003f0b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c003980 tx=0x7f4c8c006e10 comp rx=0 tx=0).stop 2024-09-19T08:35:58.623 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.802+0000 7f4ca91a0640 1 -- 172.21.15.7:0/2411322745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ca4106500 msgr2=0x7f4ca407b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:58.623 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.802+0000 7f4ca91a0640 1 --2- 172.21.15.7:0/2411322745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ca4106500 0x7f4ca407b9d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4c94030560 tx=0x7f4c94032670 comp rx=0 tx=0).stop 2024-09-19T08:35:58.623 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.802+0000 7f4ca91a0640 1 -- 172.21.15.7:0/2411322745 shutdown_connections 2024-09-19T08:35:58.623 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.802+0000 7f4ca91a0640 1 --2- 172.21.15.7:0/2411322745 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4c9003ccc0 0x7f4c9003f0b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:58.624 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.802+0000 7f4ca91a0640 1 --2- 172.21.15.7:0/2411322745 >> [v2:172.21.15.7:6800/3071389382,v1:172.21.15.7:6801/3071389382] conn(0x7f4c90039200 0x7f4c9003b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:58.624 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.802+0000 7f4ca91a0640 1 --2- 172.21.15.7:0/2411322745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ca4106500 0x7f4ca407b9d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:58.624 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.802+0000 7f4ca91a0640 1 -- 172.21.15.7:0/2411322745 >> 172.21.15.7:0/2411322745 conn(0x7f4ca4101cd0 msgr2=0x7f4ca4102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:58.624 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.802+0000 7f4ca91a0640 1 -- 172.21.15.7:0/2411322745 shutdown_connections 2024-09-19T08:35:58.624 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:57.802+0000 7f4ca91a0640 1 -- 172.21.15.7:0/2411322745 wait complete. 2024-09-19T08:35:58.624 INFO:teuthology.orchestra.run.smithi007.stdout:mgr epoch 9 is available 2024-09-19T08:35:58.624 INFO:teuthology.orchestra.run.smithi007.stdout:Generating a dashboard self-signed certificate... 2024-09-19T08:35:59.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:58 smithi007 ceph-mon[31221]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T08:35:59.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:58 smithi007 ceph-mon[31221]: mgrmap e11: x(active, since 1.00611s) 2024-09-19T08:35:59.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:58 smithi007 ceph-mon[31221]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T08:35:59.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:35:58 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:35:59.737 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:59 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:59.330+0000 7f4979a07640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:08:35:59] ENGINE Error in HTTPServer.serve 2024-09-19T08:35:59.738 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:59 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: Traceback (most recent call last): 2024-09-19T08:35:59.738 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:59 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:35:59.738 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:59 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: self._connections.run(self.expiration_interval) 2024-09-19T08:35:59.738 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:59 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:35:59.738 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:59 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: self._run(expiration_interval) 2024-09-19T08:35:59.738 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:59 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:35:59.738 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:59 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:35:59.738 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:59 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:35:59.738 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:59 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:35:59.738 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:59 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:35:59.738 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:59 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: s = self.context.wrap_socket( 2024-09-19T08:35:59.738 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:59 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:35:59.739 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:59 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: return self.sslsocket_class._create( 2024-09-19T08:35:59.739 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:59 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:35:59.739 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:59 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: self.do_handshake() 2024-09-19T08:35:59.739 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:59 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:35:59.739 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:59 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: self._sslobj.do_handshake() 2024-09-19T08:35:59.739 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:59 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:35:59.739 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:35:59 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:35:59.891 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T08:35:59.891 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.032+0000 7f3c874e1640 1 Processor -- start 2024-09-19T08:35:59.891 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.032+0000 7f3c874e1640 1 -- start start 2024-09-19T08:35:59.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.032+0000 7f3c874e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c801082a0 0x7f3c8010a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:59.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.033+0000 7f3c874e1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8007bdd0 con 0x7f3c801082a0 2024-09-19T08:35:59.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.033+0000 7f3c8527d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c801082a0 0x7f3c8010a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:59.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.033+0000 7f3c8527d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c801082a0 0x7f3c8010a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45196/0 (socket says 172.21.15.7:45196) 2024-09-19T08:35:59.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.033+0000 7f3c8527d640 1 -- 172.21.15.7:0/1127899034 learned_addr learned my addr 172.21.15.7:0/1127899034 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:59.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.033+0000 7f3c8527d640 1 -- 172.21.15.7:0/1127899034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c8010abd0 con 0x7f3c801082a0 2024-09-19T08:35:59.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.034+0000 7f3c8527d640 1 --2- 172.21.15.7:0/1127899034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c801082a0 0x7f3c8010a690 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c009820 tx=0x7f3c7c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b33d3eac2a6830 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:59.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.034+0000 7f3c73fff640 1 -- 172.21.15.7:0/1127899034 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c7c037070 con 0x7f3c801082a0 2024-09-19T08:35:59.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.034+0000 7f3c73fff640 1 -- 172.21.15.7:0/1127899034 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c7c032920 con 0x7f3c801082a0 2024-09-19T08:35:59.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.034+0000 7f3c73fff640 1 -- 172.21.15.7:0/1127899034 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c7c030810 con 0x7f3c801082a0 2024-09-19T08:35:59.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.035+0000 7f3c874e1640 1 -- 172.21.15.7:0/1127899034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c801082a0 msgr2=0x7f3c8010a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:59.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.035+0000 7f3c874e1640 1 --2- 172.21.15.7:0/1127899034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c801082a0 0x7f3c8010a690 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c009820 tx=0x7f3c7c02a270 comp rx=0 tx=0).stop 2024-09-19T08:35:59.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.035+0000 7f3c874e1640 1 -- 172.21.15.7:0/1127899034 shutdown_connections 2024-09-19T08:35:59.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.035+0000 7f3c874e1640 1 --2- 172.21.15.7:0/1127899034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c801082a0 0x7f3c8010a690 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:59.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.035+0000 7f3c874e1640 1 -- 172.21.15.7:0/1127899034 >> 172.21.15.7:0/1127899034 conn(0x7f3c80101e60 msgr2=0x7f3c801042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:59.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.035+0000 7f3c874e1640 1 -- 172.21.15.7:0/1127899034 shutdown_connections 2024-09-19T08:35:59.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.035+0000 7f3c874e1640 1 -- 172.21.15.7:0/1127899034 wait complete. 2024-09-19T08:35:59.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.036+0000 7f3c874e1640 1 Processor -- start 2024-09-19T08:35:59.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.036+0000 7f3c874e1640 1 -- start start 2024-09-19T08:35:59.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.036+0000 7f3c874e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c801082a0 0x7f3c8019b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:59.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.036+0000 7f3c874e1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8010bbe0 con 0x7f3c801082a0 2024-09-19T08:35:59.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.036+0000 7f3c8527d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c801082a0 0x7f3c8019b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:59.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.036+0000 7f3c8527d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c801082a0 0x7f3c8019b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45204/0 (socket says 172.21.15.7:45204) 2024-09-19T08:35:59.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.036+0000 7f3c8527d640 1 -- 172.21.15.7:0/3553992894 learned_addr learned my addr 172.21.15.7:0/3553992894 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:35:59.894 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.036+0000 7f3c8527d640 1 -- 172.21.15.7:0/3553992894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c8019bce0 con 0x7f3c801082a0 2024-09-19T08:35:59.894 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.036+0000 7f3c8527d640 1 --2- 172.21.15.7:0/3553992894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c801082a0 0x7f3c8019b7a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c030380 tx=0x7f3c7c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:59.894 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.036+0000 7f3c727fc640 1 -- 172.21.15.7:0/3553992894 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c7c037040 con 0x7f3c801082a0 2024-09-19T08:35:59.894 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.037+0000 7f3c874e1640 1 -- 172.21.15.7:0/3553992894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c8019bf70 con 0x7f3c801082a0 2024-09-19T08:35:59.894 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.037+0000 7f3c727fc640 1 -- 172.21.15.7:0/3553992894 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c7c040070 con 0x7f3c801082a0 2024-09-19T08:35:59.894 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.037+0000 7f3c727fc640 1 -- 172.21.15.7:0/3553992894 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c7c03a7b0 con 0x7f3c801082a0 2024-09-19T08:35:59.894 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.037+0000 7f3c874e1640 1 -- 172.21.15.7:0/3553992894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c8019ec60 con 0x7f3c801082a0 2024-09-19T08:35:59.894 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.037+0000 7f3c727fc640 1 -- 172.21.15.7:0/3553992894 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f3c7c03aa30 con 0x7f3c801082a0 2024-09-19T08:35:59.894 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.038+0000 7f3c727fc640 1 --2- 172.21.15.7:0/3553992894 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3c6c0390f0 0x7f3c6c03b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:35:59.894 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.038+0000 7f3c727fc640 1 -- 172.21.15.7:0/3553992894 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3c7c06c8b0 con 0x7f3c801082a0 2024-09-19T08:35:59.894 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.038+0000 7f3c874e1640 1 -- 172.21.15.7:0/3553992894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c80108700 con 0x7f3c801082a0 2024-09-19T08:35:59.894 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.038+0000 7f3c84a7c640 1 --2- 172.21.15.7:0/3553992894 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3c6c0390f0 0x7f3c6c03b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:35:59.894 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.038+0000 7f3c84a7c640 1 --2- 172.21.15.7:0/3553992894 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3c6c0390f0 0x7f3c6c03b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3c740098c0 tx=0x7f3c74006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:35:59.895 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.043+0000 7f3c727fc640 1 -- 172.21.15.7:0/3553992894 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3c7c044c70 con 0x7f3c801082a0 2024-09-19T08:35:59.895 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.241+0000 7f3c874e1640 1 -- 172.21.15.7:0/3553992894 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f3c80103200 con 0x7f3c6c0390f0 2024-09-19T08:35:59.895 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.245+0000 7f3c727fc640 1 -- 172.21.15.7:0/3553992894 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f3c7c045980 con 0x7f3c801082a0 2024-09-19T08:35:59.895 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.320+0000 7f3c727fc640 1 -- 172.21.15.7:0/3553992894 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f3c80103200 con 0x7f3c6c0390f0 2024-09-19T08:35:59.895 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.322+0000 7f3c874e1640 1 -- 172.21.15.7:0/3553992894 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3c6c0390f0 msgr2=0x7f3c6c03b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:59.895 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.322+0000 7f3c874e1640 1 --2- 172.21.15.7:0/3553992894 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3c6c0390f0 0x7f3c6c03b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3c740098c0 tx=0x7f3c74006db0 comp rx=0 tx=0).stop 2024-09-19T08:35:59.895 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.322+0000 7f3c874e1640 1 -- 172.21.15.7:0/3553992894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c801082a0 msgr2=0x7f3c8019b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:35:59.895 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.322+0000 7f3c874e1640 1 --2- 172.21.15.7:0/3553992894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c801082a0 0x7f3c8019b7a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c030380 tx=0x7f3c7c032670 comp rx=0 tx=0).stop 2024-09-19T08:35:59.895 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.323+0000 7f3c874e1640 1 -- 172.21.15.7:0/3553992894 shutdown_connections 2024-09-19T08:35:59.895 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.323+0000 7f3c874e1640 1 --2- 172.21.15.7:0/3553992894 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3c6c0390f0 0x7f3c6c03b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:59.895 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.323+0000 7f3c874e1640 1 --2- 172.21.15.7:0/3553992894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c801082a0 0x7f3c8019b7a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:35:59.895 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.323+0000 7f3c874e1640 1 -- 172.21.15.7:0/3553992894 >> 172.21.15.7:0/3553992894 conn(0x7f3c80101e60 msgr2=0x7f3c80102af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:35:59.895 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.323+0000 7f3c874e1640 1 -- 172.21.15.7:0/3553992894 shutdown_connections 2024-09-19T08:35:59.896 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:35:59.323+0000 7f3c874e1640 1 -- 172.21.15.7:0/3553992894 wait complete. 2024-09-19T08:35:59.896 INFO:teuthology.orchestra.run.smithi007.stdout:Creating initial admin user... 2024-09-19T08:36:00.504 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:00 smithi007 ceph-mon[31221]: [19/Sep/2024:08:35:59] ENGINE Bus STARTING 2024-09-19T08:36:00.504 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:00 smithi007 ceph-mon[31221]: [19/Sep/2024:08:35:59] ENGINE Serving on http://172.21.15.7:8765 2024-09-19T08:36:00.504 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:00 smithi007 ceph-mon[31221]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:00.504 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:00 smithi007 ceph-mon[31221]: mgrmap e12: x(active, since 2s) 2024-09-19T08:36:00.504 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:00 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:00.504 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:00 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:00.504 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:00 smithi007 ceph-mon[31221]: [19/Sep/2024:08:35:59] ENGINE Serving on https://172.21.15.7:7150 2024-09-19T08:36:00.504 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:00 smithi007 ceph-mon[31221]: [19/Sep/2024:08:35:59] ENGINE Bus STARTED 2024-09-19T08:36:00.505 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:00 smithi007 ceph-mon[31221]: [19/Sep/2024:08:35:59] ENGINE Error in HTTPServer.serve 2024-09-19T08:36:00.505 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-09-19T08:36:00.505 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:36:00.505 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:36:00.505 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:36:00.505 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._run(expiration_interval) 2024-09-19T08:36:00.505 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:36:00.505 INFO:journalctl@ceph.mon.a.smithi007.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:36:00.505 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:36:00.505 INFO:journalctl@ceph.mon.a.smithi007.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:36:00.505 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:36:00.505 INFO:journalctl@ceph.mon.a.smithi007.stdout: s = self.context.wrap_socket( 2024-09-19T08:36:00.506 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:36:00.506 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.sslsocket_class._create( 2024-09-19T08:36:00.506 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:36:00.506 INFO:journalctl@ceph.mon.a.smithi007.stdout: self.do_handshake() 2024-09-19T08:36:00.506 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:36:00.506 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._sslobj.do_handshake() 2024-09-19T08:36:00.506 INFO:journalctl@ceph.mon.a.smithi007.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:36:00.506 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:00 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:01.377 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$/r09GM8uzvZtAkXcMyFStuaqnsanVJ2LfqDIU0rHo5ai9htBBVpMS", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726734960, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T08:36:01.377 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.244+0000 7f62f4b3e640 1 Processor -- start 2024-09-19T08:36:01.377 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.244+0000 7f62f4b3e640 1 -- start start 2024-09-19T08:36:01.377 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.244+0000 7f62f4b3e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62f01060a0 0x7f62f01064a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:01.377 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.244+0000 7f62f4b3e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f62f007bdd0 con 0x7f62f01060a0 2024-09-19T08:36:01.377 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.245+0000 7f62ee59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62f01060a0 0x7f62f01064a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:01.378 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.245+0000 7f62ee59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62f01060a0 0x7f62f01064a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45218/0 (socket says 172.21.15.7:45218) 2024-09-19T08:36:01.378 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.245+0000 7f62ee59c640 1 -- 172.21.15.7:0/737850323 learned_addr learned my addr 172.21.15.7:0/737850323 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:36:01.378 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.246+0000 7f62ee59c640 1 -- 172.21.15.7:0/737850323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f01069e0 con 0x7f62f01060a0 2024-09-19T08:36:01.378 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.247+0000 7f62ee59c640 1 --2- 172.21.15.7:0/737850323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62f01060a0 0x7f62f01064a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f62e0009820 tx=0x7f62e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde5c3e777ace765 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:01.378 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.247+0000 7f62edd9b640 1 -- 172.21.15.7:0/737850323 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62e0037070 con 0x7f62f01060a0 2024-09-19T08:36:01.378 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.248+0000 7f62edd9b640 1 -- 172.21.15.7:0/737850323 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62e0032920 con 0x7f62f01060a0 2024-09-19T08:36:01.378 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.248+0000 7f62edd9b640 1 -- 172.21.15.7:0/737850323 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62e0030810 con 0x7f62f01060a0 2024-09-19T08:36:01.378 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.248+0000 7f62f4b3e640 1 -- 172.21.15.7:0/737850323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62f01060a0 msgr2=0x7f62f01064a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:01.378 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.248+0000 7f62f4b3e640 1 --2- 172.21.15.7:0/737850323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62f01060a0 0x7f62f01064a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f62e0009820 tx=0x7f62e002a270 comp rx=0 tx=0).stop 2024-09-19T08:36:01.378 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.249+0000 7f62f4b3e640 1 -- 172.21.15.7:0/737850323 shutdown_connections 2024-09-19T08:36:01.378 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.249+0000 7f62f4b3e640 1 --2- 172.21.15.7:0/737850323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62f01060a0 0x7f62f01064a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:01.378 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.249+0000 7f62f4b3e640 1 -- 172.21.15.7:0/737850323 >> 172.21.15.7:0/737850323 conn(0x7f62f0101ed0 msgr2=0x7f62f01042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:01.379 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.249+0000 7f62f4b3e640 1 -- 172.21.15.7:0/737850323 shutdown_connections 2024-09-19T08:36:01.379 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.249+0000 7f62f4b3e640 1 -- 172.21.15.7:0/737850323 wait complete. 2024-09-19T08:36:01.379 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.250+0000 7f62f4b3e640 1 Processor -- start 2024-09-19T08:36:01.379 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.250+0000 7f62f4b3e640 1 -- start start 2024-09-19T08:36:01.379 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.250+0000 7f62f4b3e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62f01060a0 0x7f62f019d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:01.380 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.250+0000 7f62f4b3e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f62f0107ab0 con 0x7f62f01060a0 2024-09-19T08:36:01.380 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.250+0000 7f62ee59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62f01060a0 0x7f62f019d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:01.380 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.250+0000 7f62ee59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62f01060a0 0x7f62f019d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45228/0 (socket says 172.21.15.7:45228) 2024-09-19T08:36:01.380 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.250+0000 7f62ee59c640 1 -- 172.21.15.7:0/3287612132 learned_addr learned my addr 172.21.15.7:0/3287612132 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:36:01.380 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.250+0000 7f62ee59c640 1 -- 172.21.15.7:0/3287612132 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f019dee0 con 0x7f62f01060a0 2024-09-19T08:36:01.380 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.250+0000 7f62ee59c640 1 --2- 172.21.15.7:0/3287612132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62f01060a0 0x7f62f019d9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f62e0030380 tx=0x7f62e0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:01.380 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.251+0000 7f62e77fe640 1 -- 172.21.15.7:0/3287612132 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62e0037040 con 0x7f62f01060a0 2024-09-19T08:36:01.381 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.251+0000 7f62e77fe640 1 -- 172.21.15.7:0/3287612132 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62e0040070 con 0x7f62f01060a0 2024-09-19T08:36:01.381 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.251+0000 7f62f4b3e640 1 -- 172.21.15.7:0/3287612132 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f019e170 con 0x7f62f01060a0 2024-09-19T08:36:01.381 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.251+0000 7f62f4b3e640 1 -- 172.21.15.7:0/3287612132 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f01a0e60 con 0x7f62f01060a0 2024-09-19T08:36:01.381 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.251+0000 7f62e77fe640 1 -- 172.21.15.7:0/3287612132 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62e003a7b0 con 0x7f62f01060a0 2024-09-19T08:36:01.381 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.252+0000 7f62f4b3e640 1 -- 172.21.15.7:0/3287612132 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62d00052c0 con 0x7f62f01060a0 2024-09-19T08:36:01.381 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.252+0000 7f62e77fe640 1 -- 172.21.15.7:0/3287612132 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f62e003a950 con 0x7f62f01060a0 2024-09-19T08:36:01.381 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.252+0000 7f62e77fe640 1 --2- 172.21.15.7:0/3287612132 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f62dc039260 0x7f62dc03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:01.381 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.252+0000 7f62e77fe640 1 -- 172.21.15.7:0/3287612132 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f62e006ca90 con 0x7f62f01060a0 2024-09-19T08:36:01.381 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.252+0000 7f62e7fff640 1 --2- 172.21.15.7:0/3287612132 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f62dc039260 0x7f62dc03b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:01.381 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.253+0000 7f62e7fff640 1 --2- 172.21.15.7:0/3287612132 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f62dc039260 0x7f62dc03b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f62d80098c0 tx=0x7f62d8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:01.381 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.257+0000 7f62e77fe640 1 -- 172.21.15.7:0/3287612132 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f62e0041270 con 0x7f62f01060a0 2024-09-19T08:36:01.381 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.452+0000 7f62f4b3e640 1 -- 172.21.15.7:0/3287612132 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f62d0002420 con 0x7f62dc039260 2024-09-19T08:36:01.382 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.702+0000 7f62e77fe640 1 -- 172.21.15.7:0/3287612132 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f62d0002420 con 0x7f62dc039260 2024-09-19T08:36:01.382 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.704+0000 7f62f4b3e640 1 -- 172.21.15.7:0/3287612132 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f62dc039260 msgr2=0x7f62dc03b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:01.382 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.704+0000 7f62f4b3e640 1 --2- 172.21.15.7:0/3287612132 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f62dc039260 0x7f62dc03b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f62d80098c0 tx=0x7f62d8006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:01.382 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.704+0000 7f62f4b3e640 1 -- 172.21.15.7:0/3287612132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62f01060a0 msgr2=0x7f62f019d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:01.382 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.704+0000 7f62f4b3e640 1 --2- 172.21.15.7:0/3287612132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62f01060a0 0x7f62f019d9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f62e0030380 tx=0x7f62e0032670 comp rx=0 tx=0).stop 2024-09-19T08:36:01.382 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.704+0000 7f62f4b3e640 1 -- 172.21.15.7:0/3287612132 shutdown_connections 2024-09-19T08:36:01.382 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.704+0000 7f62f4b3e640 1 --2- 172.21.15.7:0/3287612132 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f62dc039260 0x7f62dc03b720 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:01.382 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.704+0000 7f62f4b3e640 1 --2- 172.21.15.7:0/3287612132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62f01060a0 0x7f62f019d9a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:01.382 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.704+0000 7f62f4b3e640 1 -- 172.21.15.7:0/3287612132 >> 172.21.15.7:0/3287612132 conn(0x7f62f0101ed0 msgr2=0x7f62f0194640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:01.382 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.704+0000 7f62f4b3e640 1 -- 172.21.15.7:0/3287612132 shutdown_connections 2024-09-19T08:36:01.382 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:00.704+0000 7f62f4b3e640 1 -- 172.21.15.7:0/3287612132 wait complete. 2024-09-19T08:36:01.382 INFO:teuthology.orchestra.run.smithi007.stdout:Fetching dashboard port number... 2024-09-19T08:36:01.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:01 smithi007 ceph-mon[31221]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:01.958 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:01 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:02.803 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T08:36:02.803 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.768+0000 7f3ed3a5f640 1 Processor -- start 2024-09-19T08:36:02.803 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.768+0000 7f3ed3a5f640 1 -- start start 2024-09-19T08:36:02.803 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.768+0000 7f3ed3a5f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ecc1077f0 0x7f3ecc107bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:02.803 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.768+0000 7f3ed3a5f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc1081c0 con 0x7f3ecc1077f0 2024-09-19T08:36:02.803 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.769+0000 7f3ed17fb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ecc1077f0 0x7f3ecc107bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:02.804 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.769+0000 7f3ed17fb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ecc1077f0 0x7f3ecc107bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45234/0 (socket says 172.21.15.7:45234) 2024-09-19T08:36:02.804 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.769+0000 7f3ed17fb640 1 -- 172.21.15.7:0/2860243546 learned_addr learned my addr 172.21.15.7:0/2860243546 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:36:02.804 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.769+0000 7f3ed17fb640 1 -- 172.21.15.7:0/2860243546 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ecc1089f0 con 0x7f3ecc1077f0 2024-09-19T08:36:02.804 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.770+0000 7f3ed17fb640 1 --2- 172.21.15.7:0/2860243546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ecc1077f0 0x7f3ecc107bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8009e80 tx=0x7f3ec802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1512a30ea105a4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:02.804 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.770+0000 7f3ec3fff640 1 -- 172.21.15.7:0/2860243546 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ec8036070 con 0x7f3ecc1077f0 2024-09-19T08:36:02.804 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.770+0000 7f3ec3fff640 1 -- 172.21.15.7:0/2860243546 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ec80318e0 con 0x7f3ecc1077f0 2024-09-19T08:36:02.804 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.770+0000 7f3ec3fff640 1 -- 172.21.15.7:0/2860243546 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ec8007a00 con 0x7f3ecc1077f0 2024-09-19T08:36:02.804 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.771+0000 7f3ed3a5f640 1 -- 172.21.15.7:0/2860243546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ecc1077f0 msgr2=0x7f3ecc107bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:02.804 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.771+0000 7f3ed3a5f640 1 --2- 172.21.15.7:0/2860243546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ecc1077f0 0x7f3ecc107bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8009e80 tx=0x7f3ec802a7a0 comp rx=0 tx=0).stop 2024-09-19T08:36:02.805 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.771+0000 7f3ed3a5f640 1 -- 172.21.15.7:0/2860243546 shutdown_connections 2024-09-19T08:36:02.805 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.771+0000 7f3ed3a5f640 1 --2- 172.21.15.7:0/2860243546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ecc1077f0 0x7f3ecc107bf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:02.805 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.771+0000 7f3ed3a5f640 1 -- 172.21.15.7:0/2860243546 >> 172.21.15.7:0/2860243546 conn(0x7f3ecc103060 msgr2=0x7f3ecc105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:02.805 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.771+0000 7f3ed3a5f640 1 -- 172.21.15.7:0/2860243546 shutdown_connections 2024-09-19T08:36:02.805 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.771+0000 7f3ed3a5f640 1 -- 172.21.15.7:0/2860243546 wait complete. 2024-09-19T08:36:02.805 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.771+0000 7f3ed3a5f640 1 Processor -- start 2024-09-19T08:36:02.805 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.771+0000 7f3ed3a5f640 1 -- start start 2024-09-19T08:36:02.805 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.772+0000 7f3ed3a5f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ecc1077f0 0x7f3ecc19b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:02.805 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.772+0000 7f3ed3a5f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc10bda0 con 0x7f3ecc1077f0 2024-09-19T08:36:02.805 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.772+0000 7f3ed17fb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ecc1077f0 0x7f3ecc19b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:02.805 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.772+0000 7f3ed17fb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ecc1077f0 0x7f3ecc19b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45238/0 (socket says 172.21.15.7:45238) 2024-09-19T08:36:02.806 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.772+0000 7f3ed17fb640 1 -- 172.21.15.7:0/2381931002 learned_addr learned my addr 172.21.15.7:0/2381931002 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:36:02.806 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.772+0000 7f3ed17fb640 1 -- 172.21.15.7:0/2381931002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ecc19bcf0 con 0x7f3ecc1077f0 2024-09-19T08:36:02.806 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.772+0000 7f3ed17fb640 1 --2- 172.21.15.7:0/2381931002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ecc1077f0 0x7f3ecc19b7b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8031cc0 tx=0x7f3ec8031cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:02.806 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.772+0000 7f3ec27fc640 1 -- 172.21.15.7:0/2381931002 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ec8036050 con 0x7f3ecc1077f0 2024-09-19T08:36:02.806 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.772+0000 7f3ec27fc640 1 -- 172.21.15.7:0/2381931002 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ec8042070 con 0x7f3ecc1077f0 2024-09-19T08:36:02.806 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.772+0000 7f3ed3a5f640 1 -- 172.21.15.7:0/2381931002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ecc19bf80 con 0x7f3ecc1077f0 2024-09-19T08:36:02.806 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.772+0000 7f3ec27fc640 1 -- 172.21.15.7:0/2381931002 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ec803d8e0 con 0x7f3ecc1077f0 2024-09-19T08:36:02.806 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.772+0000 7f3ed3a5f640 1 -- 172.21.15.7:0/2381931002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ecc19ec70 con 0x7f3ecc1077f0 2024-09-19T08:36:02.806 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.773+0000 7f3ec27fc640 1 -- 172.21.15.7:0/2381931002 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f3ec803bc80 con 0x7f3ecc1077f0 2024-09-19T08:36:02.806 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.773+0000 7f3ed3a5f640 1 -- 172.21.15.7:0/2381931002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ecc107c70 con 0x7f3ecc1077f0 2024-09-19T08:36:02.807 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.774+0000 7f3ec27fc640 1 --2- 172.21.15.7:0/2381931002 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3eb8039260 0x7f3eb803b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:02.807 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.774+0000 7f3ec27fc640 1 -- 172.21.15.7:0/2381931002 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3ec806d7b0 con 0x7f3ecc1077f0 2024-09-19T08:36:02.807 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.774+0000 7f3ed0ffa640 1 --2- 172.21.15.7:0/2381931002 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3eb8039260 0x7f3eb803b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:02.807 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.774+0000 7f3ed0ffa640 1 --2- 172.21.15.7:0/2381931002 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3eb8039260 0x7f3eb803b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0098c0 tx=0x7f3ebc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:02.807 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.778+0000 7f3ec27fc640 1 -- 172.21.15.7:0/2381931002 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3ec804c200 con 0x7f3ecc1077f0 2024-09-19T08:36:02.807 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.957+0000 7f3ed3a5f640 1 -- 172.21.15.7:0/2381931002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f3ecc19f260 con 0x7f3ecc1077f0 2024-09-19T08:36:02.807 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.958+0000 7f3ec27fc640 1 -- 172.21.15.7:0/2381931002 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f3ec80477e0 con 0x7f3ecc1077f0 2024-09-19T08:36:02.807 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.960+0000 7f3ed3a5f640 1 -- 172.21.15.7:0/2381931002 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3eb8039260 msgr2=0x7f3eb803b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:02.807 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.960+0000 7f3ed3a5f640 1 --2- 172.21.15.7:0/2381931002 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3eb8039260 0x7f3eb803b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0098c0 tx=0x7f3ebc006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:02.807 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.961+0000 7f3ed3a5f640 1 -- 172.21.15.7:0/2381931002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ecc1077f0 msgr2=0x7f3ecc19b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:02.807 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.961+0000 7f3ed3a5f640 1 --2- 172.21.15.7:0/2381931002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ecc1077f0 0x7f3ecc19b7b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8031cc0 tx=0x7f3ec8031cf0 comp rx=0 tx=0).stop 2024-09-19T08:36:02.808 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.961+0000 7f3ed3a5f640 1 -- 172.21.15.7:0/2381931002 shutdown_connections 2024-09-19T08:36:02.808 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.961+0000 7f3ed3a5f640 1 --2- 172.21.15.7:0/2381931002 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3eb8039260 0x7f3eb803b720 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:02.808 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.961+0000 7f3ed3a5f640 1 --2- 172.21.15.7:0/2381931002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ecc1077f0 0x7f3ecc19b7b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:02.808 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.961+0000 7f3ed3a5f640 1 -- 172.21.15.7:0/2381931002 >> 172.21.15.7:0/2381931002 conn(0x7f3ecc103060 msgr2=0x7f3ecc103c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:02.808 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.961+0000 7f3ed3a5f640 1 -- 172.21.15.7:0/2381931002 shutdown_connections 2024-09-19T08:36:02.808 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:01.961+0000 7f3ed3a5f640 1 -- 172.21.15.7:0/2381931002 wait complete. 2024-09-19T08:36:02.811 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:36:02.812 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-09-19T08:36:02.819 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:36:02.820 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-19T08:36:02.820 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-09-19T08:36:02.820 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T08:36:02.822 INFO:teuthology.orchestra.run.smithi007.stdout:Ceph Dashboard is now available at: 2024-09-19T08:36:02.822 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:36:02.822 INFO:teuthology.orchestra.run.smithi007.stdout: URL: https://smithi007.front.sepia.ceph.com:8443/ 2024-09-19T08:36:02.822 INFO:teuthology.orchestra.run.smithi007.stdout: User: admin 2024-09-19T08:36:02.822 INFO:teuthology.orchestra.run.smithi007.stdout: Password: 3395mlvjuu 2024-09-19T08:36:02.822 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:36:02.823 INFO:teuthology.orchestra.run.smithi007.stdout:Saving cluster configuration to /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config directory 2024-09-19T08:36:03.030 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:02 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2381931002' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T08:36:04.101 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.254+0000 7f9f2c0bc640 1 Processor -- start 2024-09-19T08:36:04.101 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.255+0000 7f9f2c0bc640 1 -- start start 2024-09-19T08:36:04.101 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.255+0000 7f9f2c0bc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f241077d0 0x7f9f24107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:04.101 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.255+0000 7f9f2c0bc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9f241081a0 con 0x7f9f241077d0 2024-09-19T08:36:04.101 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.255+0000 7f9f29e58640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f241077d0 0x7f9f24107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:04.101 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.255+0000 7f9f29e58640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f241077d0 0x7f9f24107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45240/0 (socket says 172.21.15.7:45240) 2024-09-19T08:36:04.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.255+0000 7f9f29e58640 1 -- 172.21.15.7:0/2548888604 learned_addr learned my addr 172.21.15.7:0/2548888604 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:36:04.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.255+0000 7f9f29e58640 1 -- 172.21.15.7:0/2548888604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f241089d0 con 0x7f9f241077d0 2024-09-19T08:36:04.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.256+0000 7f9f29e58640 1 --2- 172.21.15.7:0/2548888604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f241077d0 0x7f9f24107bd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9f20009820 tx=0x7f9f2002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9d6194826ff2ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:04.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.256+0000 7f9f28e56640 1 -- 172.21.15.7:0/2548888604 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f20037070 con 0x7f9f241077d0 2024-09-19T08:36:04.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.256+0000 7f9f28e56640 1 -- 172.21.15.7:0/2548888604 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f20032920 con 0x7f9f241077d0 2024-09-19T08:36:04.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.256+0000 7f9f28e56640 1 -- 172.21.15.7:0/2548888604 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f20030810 con 0x7f9f241077d0 2024-09-19T08:36:04.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.257+0000 7f9f2c0bc640 1 -- 172.21.15.7:0/2548888604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f241077d0 msgr2=0x7f9f24107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:04.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.257+0000 7f9f2c0bc640 1 --2- 172.21.15.7:0/2548888604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f241077d0 0x7f9f24107bd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9f20009820 tx=0x7f9f2002a270 comp rx=0 tx=0).stop 2024-09-19T08:36:04.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.257+0000 7f9f2c0bc640 1 -- 172.21.15.7:0/2548888604 shutdown_connections 2024-09-19T08:36:04.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.257+0000 7f9f2c0bc640 1 --2- 172.21.15.7:0/2548888604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f241077d0 0x7f9f24107bd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:04.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.257+0000 7f9f2c0bc640 1 -- 172.21.15.7:0/2548888604 >> 172.21.15.7:0/2548888604 conn(0x7f9f24102f60 msgr2=0x7f9f241053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:04.102 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.257+0000 7f9f2c0bc640 1 -- 172.21.15.7:0/2548888604 shutdown_connections 2024-09-19T08:36:04.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.257+0000 7f9f2c0bc640 1 -- 172.21.15.7:0/2548888604 wait complete. 2024-09-19T08:36:04.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.258+0000 7f9f2c0bc640 1 Processor -- start 2024-09-19T08:36:04.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.258+0000 7f9f2c0bc640 1 -- start start 2024-09-19T08:36:04.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.258+0000 7f9f2c0bc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f241077d0 0x7f9f2419d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:04.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.258+0000 7f9f2c0bc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2410bd80 con 0x7f9f241077d0 2024-09-19T08:36:04.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.258+0000 7f9f29e58640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f241077d0 0x7f9f2419d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:04.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.258+0000 7f9f29e58640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f241077d0 0x7f9f2419d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45256/0 (socket says 172.21.15.7:45256) 2024-09-19T08:36:04.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.258+0000 7f9f29e58640 1 -- 172.21.15.7:0/1235729108 learned_addr learned my addr 172.21.15.7:0/1235729108 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:36:04.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.258+0000 7f9f29e58640 1 -- 172.21.15.7:0/1235729108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2419df20 con 0x7f9f241077d0 2024-09-19T08:36:04.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.259+0000 7f9f29e58640 1 --2- 172.21.15.7:0/1235729108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f241077d0 0x7f9f2419d9e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9f20030560 tx=0x7f9f20032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:04.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.259+0000 7f9f1affd640 1 -- 172.21.15.7:0/1235729108 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f20037040 con 0x7f9f241077d0 2024-09-19T08:36:04.103 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.259+0000 7f9f1affd640 1 -- 172.21.15.7:0/1235729108 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f20040070 con 0x7f9f241077d0 2024-09-19T08:36:04.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.259+0000 7f9f1affd640 1 -- 172.21.15.7:0/1235729108 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f2003a740 con 0x7f9f241077d0 2024-09-19T08:36:04.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.259+0000 7f9f2c0bc640 1 -- 172.21.15.7:0/1235729108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f2419e1b0 con 0x7f9f241077d0 2024-09-19T08:36:04.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.259+0000 7f9f2c0bc640 1 -- 172.21.15.7:0/1235729108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f241a0ea0 con 0x7f9f241077d0 2024-09-19T08:36:04.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.260+0000 7f9f1affd640 1 -- 172.21.15.7:0/1235729108 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f9f2003b420 con 0x7f9f241077d0 2024-09-19T08:36:04.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.260+0000 7f9f1affd640 1 --2- 172.21.15.7:0/1235729108 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9f10039200 0x7f9f1003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:04.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.260+0000 7f9f2c0bc640 1 -- 172.21.15.7:0/1235729108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f24107c50 con 0x7f9f241077d0 2024-09-19T08:36:04.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.260+0000 7f9f1affd640 1 -- 172.21.15.7:0/1235729108 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9f2006c9c0 con 0x7f9f241077d0 2024-09-19T08:36:04.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.260+0000 7f9f29657640 1 --2- 172.21.15.7:0/1235729108 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9f10039200 0x7f9f1003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:04.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.261+0000 7f9f29657640 1 --2- 172.21.15.7:0/1235729108 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9f10039200 0x7f9f1003b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9f140098c0 tx=0x7f9f14006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:04.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.265+0000 7f9f1affd640 1 -- 172.21.15.7:0/1235729108 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9f2004a200 con 0x7f9f241077d0 2024-09-19T08:36:04.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.532+0000 7f9f2c0bc640 1 -- 172.21.15.7:0/1235729108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f9f241a1070 con 0x7f9f241077d0 2024-09-19T08:36:04.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.534+0000 7f9f1affd640 1 -- 172.21.15.7:0/1235729108 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f9f20031e80 con 0x7f9f241077d0 2024-09-19T08:36:04.104 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T08:36:04.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.536+0000 7f9f2c0bc640 1 -- 172.21.15.7:0/1235729108 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9f10039200 msgr2=0x7f9f1003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:04.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.536+0000 7f9f2c0bc640 1 --2- 172.21.15.7:0/1235729108 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9f10039200 0x7f9f1003b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9f140098c0 tx=0x7f9f14006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:04.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.536+0000 7f9f2c0bc640 1 -- 172.21.15.7:0/1235729108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f241077d0 msgr2=0x7f9f2419d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:04.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.536+0000 7f9f2c0bc640 1 --2- 172.21.15.7:0/1235729108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f241077d0 0x7f9f2419d9e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9f20030560 tx=0x7f9f20032670 comp rx=0 tx=0).stop 2024-09-19T08:36:04.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.536+0000 7f9f2c0bc640 1 -- 172.21.15.7:0/1235729108 shutdown_connections 2024-09-19T08:36:04.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.536+0000 7f9f2c0bc640 1 --2- 172.21.15.7:0/1235729108 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9f10039200 0x7f9f1003b6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:04.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.536+0000 7f9f2c0bc640 1 --2- 172.21.15.7:0/1235729108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f241077d0 0x7f9f2419d9e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:04.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.536+0000 7f9f2c0bc640 1 -- 172.21.15.7:0/1235729108 >> 172.21.15.7:0/1235729108 conn(0x7f9f24102f60 msgr2=0x7f9f24103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:04.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.537+0000 7f9f2c0bc640 1 -- 172.21.15.7:0/1235729108 shutdown_connections 2024-09-19T08:36:04.105 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T08:36:03.537+0000 7f9f2c0bc640 1 -- 172.21.15.7:0/1235729108 wait complete. 2024-09-19T08:36:04.105 INFO:teuthology.orchestra.run.smithi007.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T08:36:04.105 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:36:04.106 INFO:teuthology.orchestra.run.smithi007.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:36:04.106 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:36:04.106 INFO:teuthology.orchestra.run.smithi007.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T08:36:04.106 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:36:04.106 INFO:teuthology.orchestra.run.smithi007.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T08:36:04.106 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:36:04.106 INFO:teuthology.orchestra.run.smithi007.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T08:36:04.106 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:36:04.106 INFO:teuthology.orchestra.run.smithi007.stdout: ceph telemetry on 2024-09-19T08:36:04.106 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:36:04.106 INFO:teuthology.orchestra.run.smithi007.stdout:For more information see: 2024-09-19T08:36:04.106 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:36:04.106 INFO:teuthology.orchestra.run.smithi007.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T08:36:04.107 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:36:04.107 INFO:teuthology.orchestra.run.smithi007.stdout:Bootstrap complete. 2024-09-19T08:36:04.145 INFO:tasks.cephadm:Fetching config... 2024-09-19T08:36:04.145 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T08:36:04.145 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T08:36:04.163 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T08:36:04.163 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T08:36:04.163 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T08:36:04.220 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T08:36:04.220 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T08:36:04.221 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T08:36:04.287 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T08:36:04.288 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T08:36:04.288 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T08:36:04.344 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T08:36:04.345 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC09rTL8OHylhd5AwFBsWy+ZXKohfdQMhCtPgSO7vSj2Byzh4oXpNszYsEeNQ9rZ+RYv0u/GRqgA8CkZ+jKkX79YtAd4BdfI6Zbq1I+RlMY26ke/xbWtWinYXZ6CC5ZE4j/xaRyzLJxxEFpcV4HeIDtbiChz5bt3qosyHrnWTqg5mFljZsa52AWnbEIxkSgYqAkCXSAXtnrt1rLZ0SPKPaSW+vorw3ZFckFhFeJJvK9WQmeRt4p1o2RhtGDU3uh2ZErv9P10RzuqlPZrJ4HLhkIfkIpB3Mo0DPcvxkn89pk596kYgjM8ZgUmVz2jjGNP9nuYRgEvJhL6xOksgPzLf3yMKklviAydLVfgIKolezMfcLrdwsEvSKsg3thTQmznf2C+ifYbQWZLKGtzhHWg/EfUkwg/NrN/D/TmLry3lUmCOcbHRTGZ/s5tcNpfyMHLpxq69OjZWjFR3RxuRTBqjpyQI3k4mYeoA2Y1Sfp7WomRnJT4lP0KYX1ZIfCDs5Xa2M= ceph-ebd23124-7661-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:36:04.421 INFO:teuthology.orchestra.run.smithi007.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC09rTL8OHylhd5AwFBsWy+ZXKohfdQMhCtPgSO7vSj2Byzh4oXpNszYsEeNQ9rZ+RYv0u/GRqgA8CkZ+jKkX79YtAd4BdfI6Zbq1I+RlMY26ke/xbWtWinYXZ6CC5ZE4j/xaRyzLJxxEFpcV4HeIDtbiChz5bt3qosyHrnWTqg5mFljZsa52AWnbEIxkSgYqAkCXSAXtnrt1rLZ0SPKPaSW+vorw3ZFckFhFeJJvK9WQmeRt4p1o2RhtGDU3uh2ZErv9P10RzuqlPZrJ4HLhkIfkIpB3Mo0DPcvxkn89pk596kYgjM8ZgUmVz2jjGNP9nuYRgEvJhL6xOksgPzLf3yMKklviAydLVfgIKolezMfcLrdwsEvSKsg3thTQmznf2C+ifYbQWZLKGtzhHWg/EfUkwg/NrN/D/TmLry3lUmCOcbHRTGZ/s5tcNpfyMHLpxq69OjZWjFR3RxuRTBqjpyQI3k4mYeoA2Y1Sfp7WomRnJT4lP0KYX1ZIfCDs5Xa2M= ceph-ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:36:04.434 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC09rTL8OHylhd5AwFBsWy+ZXKohfdQMhCtPgSO7vSj2Byzh4oXpNszYsEeNQ9rZ+RYv0u/GRqgA8CkZ+jKkX79YtAd4BdfI6Zbq1I+RlMY26ke/xbWtWinYXZ6CC5ZE4j/xaRyzLJxxEFpcV4HeIDtbiChz5bt3qosyHrnWTqg5mFljZsa52AWnbEIxkSgYqAkCXSAXtnrt1rLZ0SPKPaSW+vorw3ZFckFhFeJJvK9WQmeRt4p1o2RhtGDU3uh2ZErv9P10RzuqlPZrJ4HLhkIfkIpB3Mo0DPcvxkn89pk596kYgjM8ZgUmVz2jjGNP9nuYRgEvJhL6xOksgPzLf3yMKklviAydLVfgIKolezMfcLrdwsEvSKsg3thTQmznf2C+ifYbQWZLKGtzhHWg/EfUkwg/NrN/D/TmLry3lUmCOcbHRTGZ/s5tcNpfyMHLpxq69OjZWjFR3RxuRTBqjpyQI3k4mYeoA2Y1Sfp7WomRnJT4lP0KYX1ZIfCDs5Xa2M= ceph-ebd23124-7661-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:36:04.476 INFO:teuthology.orchestra.run.smithi044.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC09rTL8OHylhd5AwFBsWy+ZXKohfdQMhCtPgSO7vSj2Byzh4oXpNszYsEeNQ9rZ+RYv0u/GRqgA8CkZ+jKkX79YtAd4BdfI6Zbq1I+RlMY26ke/xbWtWinYXZ6CC5ZE4j/xaRyzLJxxEFpcV4HeIDtbiChz5bt3qosyHrnWTqg5mFljZsa52AWnbEIxkSgYqAkCXSAXtnrt1rLZ0SPKPaSW+vorw3ZFckFhFeJJvK9WQmeRt4p1o2RhtGDU3uh2ZErv9P10RzuqlPZrJ4HLhkIfkIpB3Mo0DPcvxkn89pk596kYgjM8ZgUmVz2jjGNP9nuYRgEvJhL6xOksgPzLf3yMKklviAydLVfgIKolezMfcLrdwsEvSKsg3thTQmznf2C+ifYbQWZLKGtzhHWg/EfUkwg/NrN/D/TmLry3lUmCOcbHRTGZ/s5tcNpfyMHLpxq69OjZWjFR3RxuRTBqjpyQI3k4mYeoA2Y1Sfp7WomRnJT4lP0KYX1ZIfCDs5Xa2M= ceph-ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:36:04.489 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC09rTL8OHylhd5AwFBsWy+ZXKohfdQMhCtPgSO7vSj2Byzh4oXpNszYsEeNQ9rZ+RYv0u/GRqgA8CkZ+jKkX79YtAd4BdfI6Zbq1I+RlMY26ke/xbWtWinYXZ6CC5ZE4j/xaRyzLJxxEFpcV4HeIDtbiChz5bt3qosyHrnWTqg5mFljZsa52AWnbEIxkSgYqAkCXSAXtnrt1rLZ0SPKPaSW+vorw3ZFckFhFeJJvK9WQmeRt4p1o2RhtGDU3uh2ZErv9P10RzuqlPZrJ4HLhkIfkIpB3Mo0DPcvxkn89pk596kYgjM8ZgUmVz2jjGNP9nuYRgEvJhL6xOksgPzLf3yMKklviAydLVfgIKolezMfcLrdwsEvSKsg3thTQmznf2C+ifYbQWZLKGtzhHWg/EfUkwg/NrN/D/TmLry3lUmCOcbHRTGZ/s5tcNpfyMHLpxq69OjZWjFR3RxuRTBqjpyQI3k4mYeoA2Y1Sfp7WomRnJT4lP0KYX1ZIfCDs5Xa2M= ceph-ebd23124-7661-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:36:04.530 INFO:teuthology.orchestra.run.smithi175.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC09rTL8OHylhd5AwFBsWy+ZXKohfdQMhCtPgSO7vSj2Byzh4oXpNszYsEeNQ9rZ+RYv0u/GRqgA8CkZ+jKkX79YtAd4BdfI6Zbq1I+RlMY26ke/xbWtWinYXZ6CC5ZE4j/xaRyzLJxxEFpcV4HeIDtbiChz5bt3qosyHrnWTqg5mFljZsa52AWnbEIxkSgYqAkCXSAXtnrt1rLZ0SPKPaSW+vorw3ZFckFhFeJJvK9WQmeRt4p1o2RhtGDU3uh2ZErv9P10RzuqlPZrJ4HLhkIfkIpB3Mo0DPcvxkn89pk596kYgjM8ZgUmVz2jjGNP9nuYRgEvJhL6xOksgPzLf3yMKklviAydLVfgIKolezMfcLrdwsEvSKsg3thTQmznf2C+ifYbQWZLKGtzhHWg/EfUkwg/NrN/D/TmLry3lUmCOcbHRTGZ/s5tcNpfyMHLpxq69OjZWjFR3RxuRTBqjpyQI3k4mYeoA2Y1Sfp7WomRnJT4lP0KYX1ZIfCDs5Xa2M= ceph-ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:36:04.543 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T08:36:04.800 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:36:04.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:04 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1235729108' entity='client.admin' 2024-09-19T08:36:04.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:04 smithi007 ceph-mon[31221]: mgrmap e13: x(active, since 6s) 2024-09-19T08:36:05.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.287+0000 7f330f20f640 1 -- 172.21.15.7:0/787654629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33081015e0 msgr2=0x7f33081019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:05.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.287+0000 7f330f20f640 1 --2- 172.21.15.7:0/787654629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33081015e0 0x7f33081019e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009880 tx=0x7f32fc02a5d0 comp rx=0 tx=0).stop 2024-09-19T08:36:05.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.287+0000 7f330f20f640 1 -- 172.21.15.7:0/787654629 shutdown_connections 2024-09-19T08:36:05.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.287+0000 7f330f20f640 1 --2- 172.21.15.7:0/787654629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33081015e0 0x7f33081019e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:05.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.287+0000 7f330f20f640 1 -- 172.21.15.7:0/787654629 >> 172.21.15.7:0/787654629 conn(0x7f33080fcd70 msgr2=0x7f33080ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:05.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.287+0000 7f330f20f640 1 -- 172.21.15.7:0/787654629 shutdown_connections 2024-09-19T08:36:05.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.287+0000 7f330f20f640 1 -- 172.21.15.7:0/787654629 wait complete. 2024-09-19T08:36:05.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.288+0000 7f330f20f640 1 Processor -- start 2024-09-19T08:36:05.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.288+0000 7f330f20f640 1 -- start start 2024-09-19T08:36:05.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.288+0000 7f330f20f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33081015e0 0x7f3308196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:05.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.289+0000 7f330f20f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f33081076f0 con 0x7f33081015e0 2024-09-19T08:36:05.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.289+0000 7f330cfab640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33081015e0 0x7f3308196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:05.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.289+0000 7f330cfab640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33081015e0 0x7f3308196da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46336/0 (socket says 172.21.15.7:46336) 2024-09-19T08:36:05.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.289+0000 7f330cfab640 1 -- 172.21.15.7:0/2984732826 learned_addr learned my addr 172.21.15.7:0/2984732826 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:36:05.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.289+0000 7f330cfab640 1 -- 172.21.15.7:0/2984732826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33081972e0 con 0x7f33081015e0 2024-09-19T08:36:05.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.289+0000 7f330cfab640 1 --2- 172.21.15.7:0/2984732826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33081015e0 0x7f3308196da0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f32fc004f60 tx=0x7f32fc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:05.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.289+0000 7f3305ffb640 1 -- 172.21.15.7:0/2984732826 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32fc03f070 con 0x7f33081015e0 2024-09-19T08:36:05.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.289+0000 7f3305ffb640 1 -- 172.21.15.7:0/2984732826 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32fc004cc0 con 0x7f33081015e0 2024-09-19T08:36:05.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.289+0000 7f330f20f640 1 -- 172.21.15.7:0/2984732826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3308197570 con 0x7f33081015e0 2024-09-19T08:36:05.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.289+0000 7f3305ffb640 1 -- 172.21.15.7:0/2984732826 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32fc035030 con 0x7f33081015e0 2024-09-19T08:36:05.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.290+0000 7f330f20f640 1 -- 172.21.15.7:0/2984732826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f330819a260 con 0x7f33081015e0 2024-09-19T08:36:05.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.291+0000 7f330f20f640 1 -- 172.21.15.7:0/2984732826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3308107e70 con 0x7f33081015e0 2024-09-19T08:36:05.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.291+0000 7f3305ffb640 1 -- 172.21.15.7:0/2984732826 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f32fc042070 con 0x7f33081015e0 2024-09-19T08:36:05.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.291+0000 7f3305ffb640 1 --2- 172.21.15.7:0/2984732826 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f32f8039300 0x7f32f803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:05.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.291+0000 7f3305ffb640 1 -- 172.21.15.7:0/2984732826 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f32fc06d060 con 0x7f33081015e0 2024-09-19T08:36:05.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.291+0000 7f3307fff640 1 --2- 172.21.15.7:0/2984732826 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f32f8039300 0x7f32f803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:05.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.292+0000 7f3307fff640 1 --2- 172.21.15.7:0/2984732826 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f32f8039300 0x7f32f803b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f32f40098c0 tx=0x7f32f4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:05.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.296+0000 7f3305ffb640 1 -- 172.21.15.7:0/2984732826 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f32fc0433b0 con 0x7f33081015e0 2024-09-19T08:36:05.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.475+0000 7f330f20f640 1 -- 172.21.15.7:0/2984732826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f330802d830 con 0x7f33081015e0 2024-09-19T08:36:05.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.478+0000 7f3305ffb640 1 -- 172.21.15.7:0/2984732826 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f32fc02f300 con 0x7f33081015e0 2024-09-19T08:36:05.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.480+0000 7f330f20f640 1 -- 172.21.15.7:0/2984732826 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f32f8039300 msgr2=0x7f32f803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:05.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.480+0000 7f330f20f640 1 --2- 172.21.15.7:0/2984732826 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f32f8039300 0x7f32f803b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f32f40098c0 tx=0x7f32f4006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:05.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.480+0000 7f330f20f640 1 -- 172.21.15.7:0/2984732826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33081015e0 msgr2=0x7f3308196da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:05.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.480+0000 7f330f20f640 1 --2- 172.21.15.7:0/2984732826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33081015e0 0x7f3308196da0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f32fc004f60 tx=0x7f32fc0048f0 comp rx=0 tx=0).stop 2024-09-19T08:36:05.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.480+0000 7f330f20f640 1 -- 172.21.15.7:0/2984732826 shutdown_connections 2024-09-19T08:36:05.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.480+0000 7f330f20f640 1 --2- 172.21.15.7:0/2984732826 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f32f8039300 0x7f32f803b7c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:05.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.480+0000 7f330f20f640 1 --2- 172.21.15.7:0/2984732826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33081015e0 0x7f3308196da0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:05.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.480+0000 7f330f20f640 1 -- 172.21.15.7:0/2984732826 >> 172.21.15.7:0/2984732826 conn(0x7f33080fcd70 msgr2=0x7f33080fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:05.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.480+0000 7f330f20f640 1 -- 172.21.15.7:0/2984732826 shutdown_connections 2024-09-19T08:36:05.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:05.480+0000 7f330f20f640 1 -- 172.21.15.7:0/2984732826 wait complete. 2024-09-19T08:36:06.074 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T08:36:06.074 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T08:36:06.565 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:36:06.759 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:06 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2984732826' entity='client.admin' 2024-09-19T08:36:07.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.321+0000 7fa1f57a7640 1 -- 172.21.15.7:0/2540602400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f0100540 msgr2=0x7fa1f0100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:07.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.321+0000 7fa1f57a7640 1 --2- 172.21.15.7:0/2540602400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f0100540 0x7fa1f0100940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009c20 tx=0x7fa1e002aa90 comp rx=0 tx=0).stop 2024-09-19T08:36:07.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.321+0000 7fa1f57a7640 1 -- 172.21.15.7:0/2540602400 shutdown_connections 2024-09-19T08:36:07.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.321+0000 7fa1f57a7640 1 --2- 172.21.15.7:0/2540602400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f0100540 0x7fa1f0100940 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:07.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.321+0000 7fa1f57a7640 1 -- 172.21.15.7:0/2540602400 >> 172.21.15.7:0/2540602400 conn(0x7fa1f00fbcd0 msgr2=0x7fa1f00fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:07.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.321+0000 7fa1f57a7640 1 -- 172.21.15.7:0/2540602400 shutdown_connections 2024-09-19T08:36:07.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.321+0000 7fa1f57a7640 1 -- 172.21.15.7:0/2540602400 wait complete. 2024-09-19T08:36:07.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.322+0000 7fa1f57a7640 1 Processor -- start 2024-09-19T08:36:07.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.322+0000 7fa1f57a7640 1 -- start start 2024-09-19T08:36:07.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.322+0000 7fa1f57a7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f0100540 0x7fa1f0196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:07.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.322+0000 7fa1f57a7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01065f0 con 0x7fa1f0100540 2024-09-19T08:36:07.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.323+0000 7fa1eeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f0100540 0x7fa1f0196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:07.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.323+0000 7fa1eeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f0100540 0x7fa1f0196db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46362/0 (socket says 172.21.15.7:46362) 2024-09-19T08:36:07.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.323+0000 7fa1eeffd640 1 -- 172.21.15.7:0/3671802204 learned_addr learned my addr 172.21.15.7:0/3671802204 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:36:07.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.323+0000 7fa1eeffd640 1 -- 172.21.15.7:0/3671802204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f01972f0 con 0x7fa1f0100540 2024-09-19T08:36:07.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.323+0000 7fa1eeffd640 1 --2- 172.21.15.7:0/3671802204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f0100540 0x7fa1f0196db0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0005cc0 tx=0x7fa1e002fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:07.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.323+0000 7fa1e7fff640 1 -- 172.21.15.7:0/3671802204 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1e0047070 con 0x7fa1f0100540 2024-09-19T08:36:07.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.323+0000 7fa1f57a7640 1 -- 172.21.15.7:0/3671802204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f0197580 con 0x7fa1f0100540 2024-09-19T08:36:07.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.323+0000 7fa1e7fff640 1 -- 172.21.15.7:0/3671802204 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1e0003e50 con 0x7fa1f0100540 2024-09-19T08:36:07.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.323+0000 7fa1e7fff640 1 -- 172.21.15.7:0/3671802204 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1e0033050 con 0x7fa1f0100540 2024-09-19T08:36:07.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.323+0000 7fa1f57a7640 1 -- 172.21.15.7:0/3671802204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f019a230 con 0x7fa1f0100540 2024-09-19T08:36:07.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.324+0000 7fa1e7fff640 1 -- 172.21.15.7:0/3671802204 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fa1e004a070 con 0x7fa1f0100540 2024-09-19T08:36:07.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.324+0000 7fa1f57a7640 1 -- 172.21.15.7:0/3671802204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1f0106d70 con 0x7fa1f0100540 2024-09-19T08:36:07.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.324+0000 7fa1e7fff640 1 --2- 172.21.15.7:0/3671802204 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fa1dc039300 0x7fa1dc03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:07.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.325+0000 7fa1e7fff640 1 -- 172.21.15.7:0/3671802204 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa1e003e030 con 0x7fa1f0100540 2024-09-19T08:36:07.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.325+0000 7fa1ee7fc640 1 --2- 172.21.15.7:0/3671802204 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fa1dc039300 0x7fa1dc03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:07.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.325+0000 7fa1ee7fc640 1 --2- 172.21.15.7:0/3671802204 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fa1dc039300 0x7fa1dc03b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80098c0 tx=0x7fa1d8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:07.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.330+0000 7fa1e7fff640 1 -- 172.21.15.7:0/3671802204 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa1e00373b0 con 0x7fa1f0100540 2024-09-19T08:36:07.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.524+0000 7fa1f57a7640 1 -- 172.21.15.7:0/3671802204 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fa1f002d8a0 con 0x7fa1dc039300 2024-09-19T08:36:07.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.527+0000 7fa1e7fff640 1 -- 172.21.15.7:0/3671802204 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa1f002d8a0 con 0x7fa1dc039300 2024-09-19T08:36:07.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.529+0000 7fa1f57a7640 1 -- 172.21.15.7:0/3671802204 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fa1dc039300 msgr2=0x7fa1dc03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:07.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.529+0000 7fa1f57a7640 1 --2- 172.21.15.7:0/3671802204 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fa1dc039300 0x7fa1dc03b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80098c0 tx=0x7fa1d8006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:07.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.530+0000 7fa1f57a7640 1 -- 172.21.15.7:0/3671802204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f0100540 msgr2=0x7fa1f0196db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:07.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.530+0000 7fa1f57a7640 1 --2- 172.21.15.7:0/3671802204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f0100540 0x7fa1f0196db0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0005cc0 tx=0x7fa1e002fc10 comp rx=0 tx=0).stop 2024-09-19T08:36:07.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.530+0000 7fa1f57a7640 1 -- 172.21.15.7:0/3671802204 shutdown_connections 2024-09-19T08:36:07.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.530+0000 7fa1f57a7640 1 --2- 172.21.15.7:0/3671802204 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fa1dc039300 0x7fa1dc03b7c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:07.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.530+0000 7fa1f57a7640 1 --2- 172.21.15.7:0/3671802204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f0100540 0x7fa1f0196db0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:07.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.530+0000 7fa1f57a7640 1 -- 172.21.15.7:0/3671802204 >> 172.21.15.7:0/3671802204 conn(0x7fa1f00fbcd0 msgr2=0x7fa1f0069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:07.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.530+0000 7fa1f57a7640 1 -- 172.21.15.7:0/3671802204 shutdown_connections 2024-09-19T08:36:07.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:07.530+0000 7fa1f57a7640 1 -- 172.21.15.7:0/3671802204 wait complete. 2024-09-19T08:36:08.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:08 smithi007 ceph-mon[31221]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:08.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:08 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:08.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:08 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:08.782 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:08 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:08.782 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:08 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:36:08.782 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:08 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:08.782 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:08 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:36:08.816 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi044 2024-09-19T08:36:08.816 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-19T08:36:08.816 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/etc/ceph/ceph.conf 2024-09-19T08:36:08.834 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-19T08:36:08.835 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:36:08.893 INFO:tasks.cephadm:Adding host smithi044 to orchestrator... 2024-09-19T08:36:08.893 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph orch host add smithi044 2024-09-19T08:36:09.158 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:36:09.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:09 smithi007 ceph-mon[31221]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-19T08:36:09.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:09 smithi007 ceph-mon[31221]: Updating smithi007:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:36:09.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:09 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:09.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:09 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:09.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:09 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:09.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:09 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:36:09.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:09 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:09.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:09 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:36:09.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:09 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:09.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.646+0000 7f03cf234640 1 -- 172.21.15.7:0/527081266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c8106560 msgr2=0x7f03c8106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:09.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.646+0000 7f03cf234640 1 --2- 172.21.15.7:0/527081266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c8106560 0x7f03c8106940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009880 tx=0x7f03bc02a5d0 comp rx=0 tx=0).stop 2024-09-19T08:36:09.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.646+0000 7f03cf234640 1 -- 172.21.15.7:0/527081266 shutdown_connections 2024-09-19T08:36:09.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.646+0000 7f03cf234640 1 --2- 172.21.15.7:0/527081266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c8106560 0x7f03c8106940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:09.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.646+0000 7f03cf234640 1 -- 172.21.15.7:0/527081266 >> 172.21.15.7:0/527081266 conn(0x7f03c80fc1b0 msgr2=0x7f03c80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:09.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.646+0000 7f03cf234640 1 -- 172.21.15.7:0/527081266 shutdown_connections 2024-09-19T08:36:09.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.646+0000 7f03cf234640 1 -- 172.21.15.7:0/527081266 wait complete. 2024-09-19T08:36:09.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.647+0000 7f03cf234640 1 Processor -- start 2024-09-19T08:36:09.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.647+0000 7f03cf234640 1 -- start start 2024-09-19T08:36:09.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.647+0000 7f03cf234640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c8106560 0x7f03c8197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:09.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.647+0000 7f03cf234640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f03c810ab90 con 0x7f03c8106560 2024-09-19T08:36:09.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.647+0000 7f03ccfd0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c8106560 0x7f03c8197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:09.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.647+0000 7f03ccfd0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c8106560 0x7f03c8197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46382/0 (socket says 172.21.15.7:46382) 2024-09-19T08:36:09.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.647+0000 7f03ccfd0640 1 -- 172.21.15.7:0/144872798 learned_addr learned my addr 172.21.15.7:0/144872798 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:36:09.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.648+0000 7f03ccfd0640 1 -- 172.21.15.7:0/144872798 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c8197640 con 0x7f03c8106560 2024-09-19T08:36:09.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.648+0000 7f03ccfd0640 1 --2- 172.21.15.7:0/144872798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c8106560 0x7f03c8197100 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009230 tx=0x7f03bc003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:09.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.648+0000 7f03c5ffb640 1 -- 172.21.15.7:0/144872798 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03bc03f070 con 0x7f03c8106560 2024-09-19T08:36:09.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.648+0000 7f03c5ffb640 1 -- 172.21.15.7:0/144872798 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03bc03bc80 con 0x7f03c8106560 2024-09-19T08:36:09.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.648+0000 7f03cf234640 1 -- 172.21.15.7:0/144872798 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c81978d0 con 0x7f03c8106560 2024-09-19T08:36:09.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.648+0000 7f03c5ffb640 1 -- 172.21.15.7:0/144872798 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03bc035030 con 0x7f03c8106560 2024-09-19T08:36:09.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.648+0000 7f03cf234640 1 -- 172.21.15.7:0/144872798 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c819b9d0 con 0x7f03c8106560 2024-09-19T08:36:09.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.649+0000 7f03c5ffb640 1 -- 172.21.15.7:0/144872798 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f03bc042070 con 0x7f03c8106560 2024-09-19T08:36:09.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.649+0000 7f03cf234640 1 -- 172.21.15.7:0/144872798 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03c8101bd0 con 0x7f03c8106560 2024-09-19T08:36:09.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.649+0000 7f03c5ffb640 1 --2- 172.21.15.7:0/144872798 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f03b80392a0 0x7f03b803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:09.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.649+0000 7f03c5ffb640 1 -- 172.21.15.7:0/144872798 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f03bc06cf90 con 0x7f03c8106560 2024-09-19T08:36:09.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.649+0000 7f03c7fff640 1 --2- 172.21.15.7:0/144872798 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f03b80392a0 0x7f03b803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:09.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.650+0000 7f03c7fff640 1 --2- 172.21.15.7:0/144872798 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f03b80392a0 0x7f03b803b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f03b40098c0 tx=0x7f03b4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:09.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.654+0000 7f03c5ffb640 1 -- 172.21.15.7:0/144872798 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f03bc04c350 con 0x7f03c8106560 2024-09-19T08:36:09.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:09.834+0000 7f03cf234640 1 -- 172.21.15.7:0/144872798 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi044", "target": ["mon-mgr", ""]}) -- 0x7f03c8198460 con 0x7f03b80392a0 2024-09-19T08:36:10.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:10 smithi007 ceph-mon[31221]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:36:10.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:10 smithi007 ceph-mon[31221]: Updating smithi007:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:36:11.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:11 smithi007 ceph-mon[31221]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi044", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:12.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:12 smithi007 ceph-mon[31221]: Deploying cephadm binary to smithi044 2024-09-19T08:36:13.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:13.660+0000 7f03c5ffb640 1 -- 172.21.15.7:0/144872798 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f03c8198460 con 0x7f03b80392a0 2024-09-19T08:36:13.660 INFO:teuthology.orchestra.run.smithi007.stdout:Added host 'smithi044' with addr '172.21.15.44' 2024-09-19T08:36:13.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:13.662+0000 7f03cf234640 1 -- 172.21.15.7:0/144872798 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f03b80392a0 msgr2=0x7f03b803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:13.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:13.662+0000 7f03cf234640 1 --2- 172.21.15.7:0/144872798 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f03b80392a0 0x7f03b803b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f03b40098c0 tx=0x7f03b4006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:13.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:13.662+0000 7f03cf234640 1 -- 172.21.15.7:0/144872798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c8106560 msgr2=0x7f03c8197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:13.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:13.662+0000 7f03cf234640 1 --2- 172.21.15.7:0/144872798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c8106560 0x7f03c8197100 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009230 tx=0x7f03bc003d40 comp rx=0 tx=0).stop 2024-09-19T08:36:13.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:13.662+0000 7f03cf234640 1 -- 172.21.15.7:0/144872798 shutdown_connections 2024-09-19T08:36:13.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:13.662+0000 7f03cf234640 1 --2- 172.21.15.7:0/144872798 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f03b80392a0 0x7f03b803b760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:13.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:13.662+0000 7f03cf234640 1 --2- 172.21.15.7:0/144872798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c8106560 0x7f03c8197100 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:13.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:13.662+0000 7f03cf234640 1 -- 172.21.15.7:0/144872798 >> 172.21.15.7:0/144872798 conn(0x7f03c80fc1b0 msgr2=0x7f03c8069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:13.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:13.662+0000 7f03cf234640 1 -- 172.21.15.7:0/144872798 shutdown_connections 2024-09-19T08:36:13.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:13.662+0000 7f03cf234640 1 -- 172.21.15.7:0/144872798 wait complete. 2024-09-19T08:36:14.268 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T08:36:14.520 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:36:14.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:14 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:14.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:14 smithi007 ceph-mon[31221]: Added host smithi044 2024-09-19T08:36:14.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:14 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:36:14.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:14 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:14.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:14 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:14.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.976+0000 7f99899f3640 1 -- 172.21.15.7:0/3318721560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9984107660 msgr2=0x7f9984107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:14.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.976+0000 7f99899f3640 1 --2- 172.21.15.7:0/3318721560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9984107660 0x7f9984107a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9974009c20 tx=0x7f997402aa90 comp rx=0 tx=0).stop 2024-09-19T08:36:14.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.976+0000 7f99899f3640 1 -- 172.21.15.7:0/3318721560 shutdown_connections 2024-09-19T08:36:14.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.976+0000 7f99899f3640 1 --2- 172.21.15.7:0/3318721560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9984107660 0x7f9984107a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:14.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.976+0000 7f99899f3640 1 -- 172.21.15.7:0/3318721560 >> 172.21.15.7:0/3318721560 conn(0x7f99840fd290 msgr2=0x7f99840ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:14.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.976+0000 7f99899f3640 1 -- 172.21.15.7:0/3318721560 shutdown_connections 2024-09-19T08:36:14.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.976+0000 7f99899f3640 1 -- 172.21.15.7:0/3318721560 wait complete. 2024-09-19T08:36:14.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.977+0000 7f99899f3640 1 Processor -- start 2024-09-19T08:36:14.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.977+0000 7f99899f3640 1 -- start start 2024-09-19T08:36:14.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.977+0000 7f99899f3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9984107660 0x7f99841970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:14.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.977+0000 7f99899f3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f998410bc90 con 0x7f9984107660 2024-09-19T08:36:14.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.977+0000 7f9982ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9984107660 0x7f99841970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:14.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.978+0000 7f9982ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9984107660 0x7f99841970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59386/0 (socket says 172.21.15.7:59386) 2024-09-19T08:36:14.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.978+0000 7f9982ffd640 1 -- 172.21.15.7:0/1379941738 learned_addr learned my addr 172.21.15.7:0/1379941738 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:36:14.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.978+0000 7f9982ffd640 1 -- 172.21.15.7:0/1379941738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9984197630 con 0x7f9984107660 2024-09-19T08:36:14.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.978+0000 7f9982ffd640 1 --2- 172.21.15.7:0/1379941738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9984107660 0x7f99841970f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9974005e30 tx=0x7f997402fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:14.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.978+0000 7f99889f1640 1 -- 172.21.15.7:0/1379941738 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9974047070 con 0x7f9984107660 2024-09-19T08:36:14.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.978+0000 7f99889f1640 1 -- 172.21.15.7:0/1379941738 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9974003df0 con 0x7f9984107660 2024-09-19T08:36:14.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.978+0000 7f99899f3640 1 -- 172.21.15.7:0/1379941738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99841978c0 con 0x7f9984107660 2024-09-19T08:36:14.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.978+0000 7f99889f1640 1 -- 172.21.15.7:0/1379941738 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9974033050 con 0x7f9984107660 2024-09-19T08:36:14.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.978+0000 7f99899f3640 1 -- 172.21.15.7:0/1379941738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f998419b9c0 con 0x7f9984107660 2024-09-19T08:36:14.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.979+0000 7f99889f1640 1 -- 172.21.15.7:0/1379941738 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f997404a070 con 0x7f9984107660 2024-09-19T08:36:14.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.979+0000 7f99899f3640 1 -- 172.21.15.7:0/1379941738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9984102cd0 con 0x7f9984107660 2024-09-19T08:36:14.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.979+0000 7f99889f1640 1 --2- 172.21.15.7:0/1379941738 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f996c039300 0x7f996c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:14.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.979+0000 7f99889f1640 1 -- 172.21.15.7:0/1379941738 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f997403e030 con 0x7f9984107660 2024-09-19T08:36:14.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.979+0000 7f99827fc640 1 --2- 172.21.15.7:0/1379941738 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f996c039300 0x7f996c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:14.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.980+0000 7f99827fc640 1 --2- 172.21.15.7:0/1379941738 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f996c039300 0x7f996c03b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f99780098c0 tx=0x7f9978006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:14.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:14.984+0000 7f99889f1640 1 -- 172.21.15.7:0/1379941738 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f99740373b0 con 0x7f9984107660 2024-09-19T08:36:15.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:15.165+0000 7f99899f3640 1 -- 172.21.15.7:0/1379941738 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9984107ac0 con 0x7f996c039300 2024-09-19T08:36:15.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:15.166+0000 7f99889f1640 1 -- 172.21.15.7:0/1379941738 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+158 (secure 0 0 0) 0x7f9984107ac0 con 0x7f996c039300 2024-09-19T08:36:15.166 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:36:15.167 INFO:teuthology.orchestra.run.smithi007.stdout:[{"addr": "172.21.15.7", "hostname": "smithi007", "labels": [], "status": ""}, {"addr": "172.21.15.44", "hostname": "smithi044", "labels": [], "status": ""}] 2024-09-19T08:36:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:15.168+0000 7f99899f3640 1 -- 172.21.15.7:0/1379941738 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f996c039300 msgr2=0x7f996c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:15.168+0000 7f99899f3640 1 --2- 172.21.15.7:0/1379941738 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f996c039300 0x7f996c03b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f99780098c0 tx=0x7f9978006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:15.168+0000 7f99899f3640 1 -- 172.21.15.7:0/1379941738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9984107660 msgr2=0x7f99841970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:15.168+0000 7f99899f3640 1 --2- 172.21.15.7:0/1379941738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9984107660 0x7f99841970f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9974005e30 tx=0x7f997402fc10 comp rx=0 tx=0).stop 2024-09-19T08:36:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:15.168+0000 7f99899f3640 1 -- 172.21.15.7:0/1379941738 shutdown_connections 2024-09-19T08:36:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:15.168+0000 7f99899f3640 1 --2- 172.21.15.7:0/1379941738 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f996c039300 0x7f996c03b7c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:15.168+0000 7f99899f3640 1 --2- 172.21.15.7:0/1379941738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9984107660 0x7f99841970f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:15.168+0000 7f99899f3640 1 -- 172.21.15.7:0/1379941738 >> 172.21.15.7:0/1379941738 conn(0x7f99840fd290 msgr2=0x7f99840febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:15.168+0000 7f99899f3640 1 -- 172.21.15.7:0/1379941738 shutdown_connections 2024-09-19T08:36:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:15.168+0000 7f99899f3640 1 -- 172.21.15.7:0/1379941738 wait complete. 2024-09-19T08:36:15.802 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi175 2024-09-19T08:36:15.803 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-19T08:36:15.803 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/etc/ceph/ceph.conf 2024-09-19T08:36:15.822 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-19T08:36:15.822 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:36:15.880 INFO:tasks.cephadm:Adding host smithi175 to orchestrator... 2024-09-19T08:36:15.880 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph orch host add smithi175 2024-09-19T08:36:16.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:16 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:16.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:16 smithi007 ceph-mon[31221]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:36:16.128 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:36:16.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.583+0000 7fd0e479f640 1 -- 172.21.15.7:0/4153042794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0dc106560 msgr2=0x7fd0dc106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:16.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.583+0000 7fd0e479f640 1 --2- 172.21.15.7:0/4153042794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0dc106560 0x7fd0dc106940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8009880 tx=0x7fd0d802a5d0 comp rx=0 tx=0).stop 2024-09-19T08:36:16.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.583+0000 7fd0e479f640 1 -- 172.21.15.7:0/4153042794 shutdown_connections 2024-09-19T08:36:16.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.583+0000 7fd0e479f640 1 --2- 172.21.15.7:0/4153042794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0dc106560 0x7fd0dc106940 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:16.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.583+0000 7fd0e479f640 1 -- 172.21.15.7:0/4153042794 >> 172.21.15.7:0/4153042794 conn(0x7fd0dc0fc1b0 msgr2=0x7fd0dc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:16.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.583+0000 7fd0e479f640 1 -- 172.21.15.7:0/4153042794 shutdown_connections 2024-09-19T08:36:16.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.583+0000 7fd0e479f640 1 -- 172.21.15.7:0/4153042794 wait complete. 2024-09-19T08:36:16.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.584+0000 7fd0e479f640 1 Processor -- start 2024-09-19T08:36:16.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.584+0000 7fd0e479f640 1 -- start start 2024-09-19T08:36:16.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.584+0000 7fd0e479f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0dc106560 0x7fd0dc197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:16.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.584+0000 7fd0e479f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc10ab90 con 0x7fd0dc106560 2024-09-19T08:36:16.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.584+0000 7fd0e253b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0dc106560 0x7fd0dc197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:16.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.584+0000 7fd0e253b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0dc106560 0x7fd0dc197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59410/0 (socket says 172.21.15.7:59410) 2024-09-19T08:36:16.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.584+0000 7fd0e253b640 1 -- 172.21.15.7:0/177871012 learned_addr learned my addr 172.21.15.7:0/177871012 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:36:16.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.584+0000 7fd0e253b640 1 -- 172.21.15.7:0/177871012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0dc197640 con 0x7fd0dc106560 2024-09-19T08:36:16.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.585+0000 7fd0e253b640 1 --2- 172.21.15.7:0/177871012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0dc106560 0x7fd0dc197100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8009230 tx=0x7fd0d8003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:16.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.585+0000 7fd0d37fe640 1 -- 172.21.15.7:0/177871012 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0d803f070 con 0x7fd0dc106560 2024-09-19T08:36:16.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.585+0000 7fd0d37fe640 1 -- 172.21.15.7:0/177871012 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0d803bc80 con 0x7fd0dc106560 2024-09-19T08:36:16.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.585+0000 7fd0e479f640 1 -- 172.21.15.7:0/177871012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0dc1978d0 con 0x7fd0dc106560 2024-09-19T08:36:16.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.585+0000 7fd0d37fe640 1 -- 172.21.15.7:0/177871012 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0d8035030 con 0x7fd0dc106560 2024-09-19T08:36:16.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.585+0000 7fd0e479f640 1 -- 172.21.15.7:0/177871012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0dc19b9d0 con 0x7fd0dc106560 2024-09-19T08:36:16.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.586+0000 7fd0d37fe640 1 -- 172.21.15.7:0/177871012 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fd0d8042070 con 0x7fd0dc106560 2024-09-19T08:36:16.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.586+0000 7fd0e479f640 1 -- 172.21.15.7:0/177871012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0dc101bd0 con 0x7fd0dc106560 2024-09-19T08:36:16.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.586+0000 7fd0d37fe640 1 --2- 172.21.15.7:0/177871012 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd0c80392a0 0x7fd0c803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:16.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.586+0000 7fd0d37fe640 1 -- 172.21.15.7:0/177871012 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd0d806d000 con 0x7fd0dc106560 2024-09-19T08:36:16.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.586+0000 7fd0e1d3a640 1 --2- 172.21.15.7:0/177871012 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd0c80392a0 0x7fd0c803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:16.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.587+0000 7fd0e1d3a640 1 --2- 172.21.15.7:0/177871012 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd0c80392a0 0x7fd0c803b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0098c0 tx=0x7fd0cc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:16.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.591+0000 7fd0d37fe640 1 -- 172.21.15.7:0/177871012 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd0d80372d0 con 0x7fd0dc106560 2024-09-19T08:36:16.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:16.772+0000 7fd0e479f640 1 -- 172.21.15.7:0/177871012 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}) -- 0x7fd0dc198460 con 0x7fd0c80392a0 2024-09-19T08:36:18.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:17 smithi007 ceph-mon[31221]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:18.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:17 smithi007 ceph-mon[31221]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:18.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:18.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:18.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:18.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:18.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi044", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:36:18.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:18.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:36:18.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:18 smithi007 ceph-mon[31221]: Updating smithi044:/etc/ceph/ceph.conf 2024-09-19T08:36:18.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:18 smithi007 ceph-mon[31221]: Deploying cephadm binary to smithi175 2024-09-19T08:36:18.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:18 smithi007 ceph-mon[31221]: Updating smithi044:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:36:18.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:18 smithi007 ceph-mon[31221]: Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:36:18.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:18 smithi007 ceph-mon[31221]: Updating smithi044:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:36:18.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:18.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:18.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:20.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:20.605+0000 7fd0d37fe640 1 -- 172.21.15.7:0/177871012 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fd0dc198460 con 0x7fd0c80392a0 2024-09-19T08:36:20.608 INFO:teuthology.orchestra.run.smithi007.stdout:Added host 'smithi175' with addr '172.21.15.175' 2024-09-19T08:36:20.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:20.608+0000 7fd0e479f640 1 -- 172.21.15.7:0/177871012 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd0c80392a0 msgr2=0x7fd0c803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:20.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:20.608+0000 7fd0e479f640 1 --2- 172.21.15.7:0/177871012 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd0c80392a0 0x7fd0c803b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0098c0 tx=0x7fd0cc006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:20.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:20.608+0000 7fd0e479f640 1 -- 172.21.15.7:0/177871012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0dc106560 msgr2=0x7fd0dc197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:20.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:20.608+0000 7fd0e479f640 1 --2- 172.21.15.7:0/177871012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0dc106560 0x7fd0dc197100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8009230 tx=0x7fd0d8003d40 comp rx=0 tx=0).stop 2024-09-19T08:36:20.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:20.608+0000 7fd0e479f640 1 -- 172.21.15.7:0/177871012 shutdown_connections 2024-09-19T08:36:20.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:20.608+0000 7fd0e479f640 1 --2- 172.21.15.7:0/177871012 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd0c80392a0 0x7fd0c803b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:20.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:20.608+0000 7fd0e479f640 1 --2- 172.21.15.7:0/177871012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0dc106560 0x7fd0dc197100 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:20.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:20.608+0000 7fd0e479f640 1 -- 172.21.15.7:0/177871012 >> 172.21.15.7:0/177871012 conn(0x7fd0dc0fc1b0 msgr2=0x7fd0dc069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:20.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:20.609+0000 7fd0e479f640 1 -- 172.21.15.7:0/177871012 shutdown_connections 2024-09-19T08:36:20.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:20.609+0000 7fd0e479f640 1 -- 172.21.15.7:0/177871012 wait complete. 2024-09-19T08:36:20.886 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:20 smithi007 ceph-mon[31221]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:20.887 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:20 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:20.887 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:20 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:36:21.202 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T08:36:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:36:21.831 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:21 smithi007 ceph-mon[31221]: Added host smithi175 2024-09-19T08:36:21.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:21.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.916+0000 7feaf1e62640 1 -- 172.21.15.7:0/3754538194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feaec112030 msgr2=0x7feaec112410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.916+0000 7feaf1e62640 1 --2- 172.21.15.7:0/3754538194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feaec112030 0x7feaec112410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feadc009880 tx=0x7feadc02a5d0 comp rx=0 tx=0).stop 2024-09-19T08:36:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.916+0000 7feaf1e62640 1 -- 172.21.15.7:0/3754538194 shutdown_connections 2024-09-19T08:36:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.916+0000 7feaf1e62640 1 --2- 172.21.15.7:0/3754538194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feaec112030 0x7feaec112410 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.916+0000 7feaf1e62640 1 -- 172.21.15.7:0/3754538194 >> 172.21.15.7:0/3754538194 conn(0x7feaec06c040 msgr2=0x7feaec06c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.916+0000 7feaf1e62640 1 -- 172.21.15.7:0/3754538194 shutdown_connections 2024-09-19T08:36:21.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.916+0000 7feaf1e62640 1 -- 172.21.15.7:0/3754538194 wait complete. 2024-09-19T08:36:21.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.916+0000 7feaf1e62640 1 Processor -- start 2024-09-19T08:36:21.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.916+0000 7feaf1e62640 1 -- start start 2024-09-19T08:36:21.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.917+0000 7feaf1e62640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feaec112030 0x7feaec1a77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:21.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.917+0000 7feaf1e62640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feaec116640 con 0x7feaec112030 2024-09-19T08:36:21.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.917+0000 7feaeb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feaec112030 0x7feaec1a77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:21.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.917+0000 7feaeb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feaec112030 0x7feaec1a77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59430/0 (socket says 172.21.15.7:59430) 2024-09-19T08:36:21.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.917+0000 7feaeb7fe640 1 -- 172.21.15.7:0/525674173 learned_addr learned my addr 172.21.15.7:0/525674173 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:36:21.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.917+0000 7feaeb7fe640 1 -- 172.21.15.7:0/525674173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaec1a7ce0 con 0x7feaec112030 2024-09-19T08:36:21.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.917+0000 7feaeb7fe640 1 --2- 172.21.15.7:0/525674173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feaec112030 0x7feaec1a77a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feadc009230 tx=0x7feadc003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:21.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.918+0000 7feae97fa640 1 -- 172.21.15.7:0/525674173 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feadc03f070 con 0x7feaec112030 2024-09-19T08:36:21.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.918+0000 7feaf1e62640 1 -- 172.21.15.7:0/525674173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaec1a7fd0 con 0x7feaec112030 2024-09-19T08:36:21.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.918+0000 7feae97fa640 1 -- 172.21.15.7:0/525674173 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feadc03bc80 con 0x7feaec112030 2024-09-19T08:36:21.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.918+0000 7feae97fa640 1 -- 172.21.15.7:0/525674173 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feadc035030 con 0x7feaec112030 2024-09-19T08:36:21.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.918+0000 7feaf1e62640 1 -- 172.21.15.7:0/525674173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaec1a1960 con 0x7feaec112030 2024-09-19T08:36:21.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.918+0000 7feae97fa640 1 -- 172.21.15.7:0/525674173 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7feadc042070 con 0x7feaec112030 2024-09-19T08:36:21.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.919+0000 7feaf1e62640 1 -- 172.21.15.7:0/525674173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaec10d720 con 0x7feaec112030 2024-09-19T08:36:21.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.919+0000 7feae97fa640 1 --2- 172.21.15.7:0/525674173 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fead80392a0 0x7fead803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:21.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.919+0000 7feae97fa640 1 -- 172.21.15.7:0/525674173 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7feadc06cf50 con 0x7feaec112030 2024-09-19T08:36:21.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.919+0000 7feae2ffd640 1 --2- 172.21.15.7:0/525674173 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fead80392a0 0x7fead803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:21.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.919+0000 7feae2ffd640 1 --2- 172.21.15.7:0/525674173 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fead80392a0 0x7fead803b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fead40098c0 tx=0x7fead4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:21.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:21.923+0000 7feae97fa640 1 -- 172.21.15.7:0/525674173 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feadc04c350 con 0x7feaec112030 2024-09-19T08:36:22.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:22.102+0000 7feaf1e62640 1 -- 172.21.15.7:0/525674173 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feaec1a2e90 con 0x7fead80392a0 2024-09-19T08:36:22.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:22.103+0000 7feae97fa640 1 -- 172.21.15.7:0/525674173 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+238 (secure 0 0 0) 0x7feaec1a2e90 con 0x7fead80392a0 2024-09-19T08:36:22.104 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:36:22.104 INFO:teuthology.orchestra.run.smithi007.stdout:[{"addr": "172.21.15.7", "hostname": "smithi007", "labels": [], "status": ""}, {"addr": "172.21.15.44", "hostname": "smithi044", "labels": [], "status": ""}, {"addr": "172.21.15.175", "hostname": "smithi175", "labels": [], "status": ""}] 2024-09-19T08:36:22.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:22.105+0000 7feaf1e62640 1 -- 172.21.15.7:0/525674173 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fead80392a0 msgr2=0x7fead803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:22.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:22.105+0000 7feaf1e62640 1 --2- 172.21.15.7:0/525674173 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fead80392a0 0x7fead803b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fead40098c0 tx=0x7fead4006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:22.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:22.105+0000 7feaf1e62640 1 -- 172.21.15.7:0/525674173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feaec112030 msgr2=0x7feaec1a77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:22.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:22.105+0000 7feaf1e62640 1 --2- 172.21.15.7:0/525674173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feaec112030 0x7feaec1a77a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feadc009230 tx=0x7feadc003d40 comp rx=0 tx=0).stop 2024-09-19T08:36:22.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:22.106+0000 7feaf1e62640 1 -- 172.21.15.7:0/525674173 shutdown_connections 2024-09-19T08:36:22.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:22.106+0000 7feaf1e62640 1 --2- 172.21.15.7:0/525674173 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fead80392a0 0x7fead803b760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:22.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:22.106+0000 7feaf1e62640 1 --2- 172.21.15.7:0/525674173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feaec112030 0x7feaec1a77a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:22.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:22.106+0000 7feaf1e62640 1 -- 172.21.15.7:0/525674173 >> 172.21.15.7:0/525674173 conn(0x7feaec06c040 msgr2=0x7feaec109820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:22.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:22.106+0000 7feaf1e62640 1 -- 172.21.15.7:0/525674173 shutdown_connections 2024-09-19T08:36:22.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:22.106+0000 7feaf1e62640 1 -- 172.21.15.7:0/525674173 wait complete. 2024-09-19T08:36:22.709 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T08:36:22.709 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T08:36:22.959 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:36:23.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:22 smithi007 ceph-mon[31221]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:23.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:22 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.405+0000 7f6d2dc6b640 1 -- 172.21.15.7:0/3626103165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d28106560 msgr2=0x7f6d28106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.405+0000 7f6d2dc6b640 1 --2- 172.21.15.7:0/3626103165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d28106560 0x7f6d28106940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009c20 tx=0x7f6d1802aa90 comp rx=0 tx=0).stop 2024-09-19T08:36:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.405+0000 7f6d2dc6b640 1 -- 172.21.15.7:0/3626103165 shutdown_connections 2024-09-19T08:36:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.405+0000 7f6d2dc6b640 1 --2- 172.21.15.7:0/3626103165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d28106560 0x7f6d28106940 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.405+0000 7f6d2dc6b640 1 -- 172.21.15.7:0/3626103165 >> 172.21.15.7:0/3626103165 conn(0x7f6d280fc1b0 msgr2=0x7f6d280fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.405+0000 7f6d2dc6b640 1 -- 172.21.15.7:0/3626103165 shutdown_connections 2024-09-19T08:36:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.405+0000 7f6d2dc6b640 1 -- 172.21.15.7:0/3626103165 wait complete. 2024-09-19T08:36:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.406+0000 7f6d2dc6b640 1 Processor -- start 2024-09-19T08:36:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.406+0000 7f6d2dc6b640 1 -- start start 2024-09-19T08:36:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.406+0000 7f6d2dc6b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d28106560 0x7f6d28196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.406+0000 7f6d2dc6b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2810ab90 con 0x7f6d28106560 2024-09-19T08:36:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.406+0000 7f6d277fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d28106560 0x7f6d28196050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.406+0000 7f6d277fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d28106560 0x7f6d28196050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49198/0 (socket says 172.21.15.7:49198) 2024-09-19T08:36:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.406+0000 7f6d277fe640 1 -- 172.21.15.7:0/27954820 learned_addr learned my addr 172.21.15.7:0/27954820 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:36:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.406+0000 7f6d277fe640 1 -- 172.21.15.7:0/27954820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d28196590 con 0x7f6d28106560 2024-09-19T08:36:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.407+0000 7f6d277fe640 1 --2- 172.21.15.7:0/27954820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d28106560 0x7f6d28196050 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6d18005e30 tx=0x7f6d1802fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.407+0000 7f6d24ff9640 1 -- 172.21.15.7:0/27954820 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d18047070 con 0x7f6d28106560 2024-09-19T08:36:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.407+0000 7f6d24ff9640 1 -- 172.21.15.7:0/27954820 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d18003df0 con 0x7f6d28106560 2024-09-19T08:36:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.407+0000 7f6d2dc6b640 1 -- 172.21.15.7:0/27954820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d28196820 con 0x7f6d28106560 2024-09-19T08:36:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.407+0000 7f6d24ff9640 1 -- 172.21.15.7:0/27954820 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d18033050 con 0x7f6d28106560 2024-09-19T08:36:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.407+0000 7f6d2dc6b640 1 -- 172.21.15.7:0/27954820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d28196c80 con 0x7f6d28106560 2024-09-19T08:36:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.408+0000 7f6d24ff9640 1 -- 172.21.15.7:0/27954820 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f6d1804a070 con 0x7f6d28106560 2024-09-19T08:36:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.408+0000 7f6d24ff9640 1 --2- 172.21.15.7:0/27954820 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6d100392a0 0x7f6d1003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.408+0000 7f6d2dc6b640 1 -- 172.21.15.7:0/27954820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d28101bd0 con 0x7f6d28106560 2024-09-19T08:36:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.408+0000 7f6d24ff9640 1 -- 172.21.15.7:0/27954820 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6d1803e030 con 0x7f6d28106560 2024-09-19T08:36:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.408+0000 7f6d26ffd640 1 --2- 172.21.15.7:0/27954820 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6d100392a0 0x7f6d1003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.408+0000 7f6d26ffd640 1 --2- 172.21.15.7:0/27954820 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6d100392a0 0x7f6d1003b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c0098c0 tx=0x7f6d1c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:23.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.413+0000 7f6d24ff9640 1 -- 172.21.15.7:0/27954820 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6d18051080 con 0x7f6d28106560 2024-09-19T08:36:23.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.592+0000 7f6d2dc6b640 1 -- 172.21.15.7:0/27954820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f6d281973b0 con 0x7f6d28106560 2024-09-19T08:36:23.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.674+0000 7f6d24ff9640 1 -- 172.21.15.7:0/27954820 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f6d1804a360 con 0x7f6d28106560 2024-09-19T08:36:23.675 INFO:teuthology.orchestra.run.smithi007.stderr:adjusted tunables profile to default 2024-09-19T08:36:23.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.676+0000 7f6d2dc6b640 1 -- 172.21.15.7:0/27954820 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6d100392a0 msgr2=0x7f6d1003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:23.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.676+0000 7f6d2dc6b640 1 --2- 172.21.15.7:0/27954820 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6d100392a0 0x7f6d1003b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c0098c0 tx=0x7f6d1c006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:23.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.676+0000 7f6d2dc6b640 1 -- 172.21.15.7:0/27954820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d28106560 msgr2=0x7f6d28196050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:23.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.676+0000 7f6d2dc6b640 1 --2- 172.21.15.7:0/27954820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d28106560 0x7f6d28196050 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6d18005e30 tx=0x7f6d1802fc10 comp rx=0 tx=0).stop 2024-09-19T08:36:23.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.676+0000 7f6d2dc6b640 1 -- 172.21.15.7:0/27954820 shutdown_connections 2024-09-19T08:36:23.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.676+0000 7f6d2dc6b640 1 --2- 172.21.15.7:0/27954820 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6d100392a0 0x7f6d1003b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:23.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.676+0000 7f6d2dc6b640 1 --2- 172.21.15.7:0/27954820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d28106560 0x7f6d28196050 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:23.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.676+0000 7f6d2dc6b640 1 -- 172.21.15.7:0/27954820 >> 172.21.15.7:0/27954820 conn(0x7f6d280fc1b0 msgr2=0x7f6d280fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:23.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.677+0000 7f6d2dc6b640 1 -- 172.21.15.7:0/27954820 shutdown_connections 2024-09-19T08:36:23.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:23.677+0000 7f6d2dc6b640 1 -- 172.21.15.7:0/27954820 wait complete. 2024-09-19T08:36:24.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:23 smithi007 ceph-mon[31221]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:36:24.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:23 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/27954820' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T08:36:24.247 INFO:tasks.cephadm:Adding mon.a on smithi007 2024-09-19T08:36:24.247 INFO:tasks.cephadm:Adding mon.b on smithi044 2024-09-19T08:36:24.247 INFO:tasks.cephadm:Adding mon.c on smithi175 2024-09-19T08:36:24.248 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi007:172.21.15.7=a;smithi044:172.21.15.44=b;smithi175:172.21.15.175=c' 2024-09-19T08:36:24.588 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:36:24.634 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:36:25.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:24 smithi007 ceph-mon[31221]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:25.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:24 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/27954820' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T08:36:25.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:24 smithi007 ceph-mon[31221]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:36:25.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:24 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:25.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:24 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:25.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:24 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:25.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:24 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:25.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:24 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:36:25.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:24 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:25.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:24 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:36:25.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.130+0000 7fbc066e3640 1 -- 172.21.15.175:0/1713066934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc00102130 msgr2=0x7fbc00104520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:25.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.130+0000 7fbc066e3640 1 --2- 172.21.15.175:0/1713066934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc00102130 0x7fbc00104520 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0009880 tx=0x7fbbf002a5d0 comp rx=0 tx=0).stop 2024-09-19T08:36:25.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.130+0000 7fbc066e3640 1 -- 172.21.15.175:0/1713066934 shutdown_connections 2024-09-19T08:36:25.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.130+0000 7fbc066e3640 1 --2- 172.21.15.175:0/1713066934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc00102130 0x7fbc00104520 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:25.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.130+0000 7fbc066e3640 1 -- 172.21.15.175:0/1713066934 >> 172.21.15.175:0/1713066934 conn(0x7fbc000fbcd0 msgr2=0x7fbc000fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:25.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.130+0000 7fbc066e3640 1 -- 172.21.15.175:0/1713066934 shutdown_connections 2024-09-19T08:36:25.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.130+0000 7fbc066e3640 1 -- 172.21.15.175:0/1713066934 wait complete. 2024-09-19T08:36:25.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.130+0000 7fbc066e3640 1 Processor -- start 2024-09-19T08:36:25.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.131+0000 7fbc066e3640 1 -- start start 2024-09-19T08:36:25.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.131+0000 7fbc066e3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc00102130 0x7fbc001019b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:25.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.131+0000 7fbc066e3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc001076e0 con 0x7fbc00102130 2024-09-19T08:36:25.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.131+0000 7fbbfffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc00102130 0x7fbc001019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:25.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.131+0000 7fbbfffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc00102130 0x7fbc001019b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.175:34564/0 (socket says 172.21.15.175:34564) 2024-09-19T08:36:25.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.131+0000 7fbbfffff640 1 -- 172.21.15.175:0/2352605013 learned_addr learned my addr 172.21.15.175:0/2352605013 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-19T08:36:25.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.131+0000 7fbbfffff640 1 -- 172.21.15.175:0/2352605013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc00101ef0 con 0x7fbc00102130 2024-09-19T08:36:25.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.132+0000 7fbbfffff640 1 --2- 172.21.15.175:0/2352605013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc00102130 0x7fbc001019b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0004f60 tx=0x7fbbf00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:25.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.132+0000 7fbbfd7fa640 1 -- 172.21.15.175:0/2352605013 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbf003f070 con 0x7fbc00102130 2024-09-19T08:36:25.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.132+0000 7fbbfd7fa640 1 -- 172.21.15.175:0/2352605013 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbf0003ad0 con 0x7fbc00102130 2024-09-19T08:36:25.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.132+0000 7fbc066e3640 1 -- 172.21.15.175:0/2352605013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc001000e0 con 0x7fbc00102130 2024-09-19T08:36:25.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.132+0000 7fbbfd7fa640 1 -- 172.21.15.175:0/2352605013 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbf0035030 con 0x7fbc00102130 2024-09-19T08:36:25.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.132+0000 7fbc066e3640 1 -- 172.21.15.175:0/2352605013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc00100620 con 0x7fbc00102130 2024-09-19T08:36:25.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.133+0000 7fbc066e3640 1 -- 172.21.15.175:0/2352605013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc00107e60 con 0x7fbc00102130 2024-09-19T08:36:25.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.133+0000 7fbbfd7fa640 1 -- 172.21.15.175:0/2352605013 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fbbf0042070 con 0x7fbc00102130 2024-09-19T08:36:25.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.133+0000 7fbbfd7fa640 1 --2- 172.21.15.175:0/2352605013 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fbbe80392a0 0x7fbbe803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:25.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.133+0000 7fbbfd7fa640 1 -- 172.21.15.175:0/2352605013 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbbf006d160 con 0x7fbc00102130 2024-09-19T08:36:25.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.134+0000 7fbbff7fe640 1 --2- 172.21.15.175:0/2352605013 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fbbe80392a0 0x7fbbe803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:25.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.134+0000 7fbbff7fe640 1 --2- 172.21.15.175:0/2352605013 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fbbe80392a0 0x7fbbe803b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40098c0 tx=0x7fbbf4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:25.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.138+0000 7fbbfd7fa640 1 -- 172.21.15.175:0/2352605013 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbbf004a260 con 0x7fbc00102130 2024-09-19T08:36:25.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.326+0000 7fbc066e3640 1 -- 172.21.15.175:0/2352605013 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi007:172.21.15.7=a;smithi044:172.21.15.44=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}) -- 0x7fbc001901a0 con 0x7fbbe80392a0 2024-09-19T08:36:25.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.332+0000 7fbbfd7fa640 1 -- 172.21.15.175:0/2352605013 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fbc001901a0 con 0x7fbbe80392a0 2024-09-19T08:36:25.332 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mon update... 2024-09-19T08:36:25.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.334+0000 7fbc066e3640 1 -- 172.21.15.175:0/2352605013 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fbbe80392a0 msgr2=0x7fbbe803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:25.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.334+0000 7fbc066e3640 1 --2- 172.21.15.175:0/2352605013 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fbbe80392a0 0x7fbbe803b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40098c0 tx=0x7fbbf4006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:25.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.334+0000 7fbc066e3640 1 -- 172.21.15.175:0/2352605013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc00102130 msgr2=0x7fbc001019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:25.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.334+0000 7fbc066e3640 1 --2- 172.21.15.175:0/2352605013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc00102130 0x7fbc001019b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0004f60 tx=0x7fbbf00048f0 comp rx=0 tx=0).stop 2024-09-19T08:36:25.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.334+0000 7fbc066e3640 1 -- 172.21.15.175:0/2352605013 shutdown_connections 2024-09-19T08:36:25.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.334+0000 7fbc066e3640 1 --2- 172.21.15.175:0/2352605013 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fbbe80392a0 0x7fbbe803b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:25.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.334+0000 7fbc066e3640 1 --2- 172.21.15.175:0/2352605013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc00102130 0x7fbc001019b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:25.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.334+0000 7fbc066e3640 1 -- 172.21.15.175:0/2352605013 >> 172.21.15.175:0/2352605013 conn(0x7fbc000fbcd0 msgr2=0x7fbc000fc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:25.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.335+0000 7fbc066e3640 1 -- 172.21.15.175:0/2352605013 shutdown_connections 2024-09-19T08:36:25.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:25.335+0000 7fbc066e3640 1 -- 172.21.15.175:0/2352605013 wait complete. 2024-09-19T08:36:25.968 DEBUG:teuthology.orchestra.run.smithi044:mon.b> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T08:36:25.971 DEBUG:teuthology.orchestra.run.smithi175:mon.c> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T08:36:25.973 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:36:25.973 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:36:26.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:25 smithi007 ceph-mon[31221]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-19T08:36:26.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:25 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:26.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:25 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:26.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:25 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:26.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:25 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:26.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:25 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:36:26.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:25 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:26.715 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:36:27.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:26 smithi007 ceph-mon[31221]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:27.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:26 smithi007 ceph-mon[31221]: Updating smithi175:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:36:27.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:26 smithi007 ceph-mon[31221]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:36:27.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:26 smithi007 ceph-mon[31221]: Updating smithi175:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:36:27.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:26 smithi007 ceph-mon[31221]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi007:172.21.15.7=a;smithi044:172.21.15.44=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:27.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:26 smithi007 ceph-mon[31221]: Saving service mon spec with placement smithi007:172.21.15.7=a;smithi044:172.21.15.44=b;smithi175:172.21.15.175=c;count:3 2024-09-19T08:36:27.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:26 smithi007 ceph-mon[31221]: Deploying daemon mon.c on smithi175 2024-09-19T08:36:27.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.118+0000 7ff81a6b6640 1 -- 172.21.15.175:0/4211227399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff814106540 msgr2=0x7ff814106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:27.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.118+0000 7ff81a6b6640 1 --2- 172.21.15.175:0/4211227399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff814106540 0x7ff814106920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff804009810 tx=0x7ff80402a540 comp rx=0 tx=0).stop 2024-09-19T08:36:27.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.118+0000 7ff81a6b6640 1 -- 172.21.15.175:0/4211227399 shutdown_connections 2024-09-19T08:36:27.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.118+0000 7ff81a6b6640 1 --2- 172.21.15.175:0/4211227399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff814106540 0x7ff814106920 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:27.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.118+0000 7ff81a6b6640 1 -- 172.21.15.175:0/4211227399 >> 172.21.15.175:0/4211227399 conn(0x7ff814077310 msgr2=0x7ff8140fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.118+0000 7ff81a6b6640 1 -- 172.21.15.175:0/4211227399 shutdown_connections 2024-09-19T08:36:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.118+0000 7ff81a6b6640 1 -- 172.21.15.175:0/4211227399 wait complete. 2024-09-19T08:36:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.119+0000 7ff81a6b6640 1 Processor -- start 2024-09-19T08:36:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.119+0000 7ff81a6b6640 1 -- start start 2024-09-19T08:36:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.119+0000 7ff81a6b6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff814106540 0x7ff8141970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.119+0000 7ff81a6b6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff81410ab70 con 0x7ff814106540 2024-09-19T08:36:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.120+0000 7ff813fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff814106540 0x7ff8141970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.120+0000 7ff813fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff814106540 0x7ff8141970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.175:34580/0 (socket says 172.21.15.175:34580) 2024-09-19T08:36:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.120+0000 7ff813fff640 1 -- 172.21.15.175:0/2891131914 learned_addr learned my addr 172.21.15.175:0/2891131914 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-19T08:36:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.120+0000 7ff813fff640 1 -- 172.21.15.175:0/2891131914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff814197620 con 0x7ff814106540 2024-09-19T08:36:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.120+0000 7ff813fff640 1 --2- 172.21.15.175:0/2891131914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff814106540 0x7ff8141970e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff804009930 tx=0x7ff804004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:27.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.120+0000 7ff8117fa640 1 -- 172.21.15.175:0/2891131914 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff804031400 con 0x7ff814106540 2024-09-19T08:36:27.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.121+0000 7ff81a6b6640 1 -- 172.21.15.175:0/2891131914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8141978b0 con 0x7ff814106540 2024-09-19T08:36:27.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.121+0000 7ff8117fa640 1 -- 172.21.15.175:0/2891131914 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8040035f0 con 0x7ff814106540 2024-09-19T08:36:27.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.121+0000 7ff8117fa640 1 -- 172.21.15.175:0/2891131914 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff80403c440 con 0x7ff814106540 2024-09-19T08:36:27.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.121+0000 7ff81a6b6640 1 -- 172.21.15.175:0/2891131914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff81419b9b0 con 0x7ff814106540 2024-09-19T08:36:27.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.121+0000 7ff81a6b6640 1 -- 172.21.15.175:0/2891131914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff814101bb0 con 0x7ff814106540 2024-09-19T08:36:27.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.122+0000 7ff8117fa640 1 -- 172.21.15.175:0/2891131914 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7ff804039040 con 0x7ff814106540 2024-09-19T08:36:27.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.122+0000 7ff8117fa640 1 --2- 172.21.15.175:0/2891131914 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff7fc0392a0 0x7ff7fc03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:27.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.122+0000 7ff8117fa640 1 -- 172.21.15.175:0/2891131914 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff80406d540 con 0x7ff814106540 2024-09-19T08:36:27.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.122+0000 7ff8137fe640 1 --2- 172.21.15.175:0/2891131914 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff7fc0392a0 0x7ff7fc03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:27.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.122+0000 7ff8137fe640 1 --2- 172.21.15.175:0/2891131914 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff7fc0392a0 0x7ff7fc03b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff8080098c0 tx=0x7ff808006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:27.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.127+0000 7ff8117fa640 1 -- 172.21.15.175:0/2891131914 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff804040030 con 0x7ff814106540 2024-09-19T08:36:27.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.360+0000 7ff81a6b6640 1 -- 172.21.15.175:0/2891131914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff814198440 con 0x7ff814106540 2024-09-19T08:36:27.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.361+0000 7ff8117fa640 1 -- 172.21.15.175:0/2891131914 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7ff80404a530 con 0x7ff814106540 2024-09-19T08:36:27.365 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:36:27.365 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":1,"fsid":"ebd23124-7661-11ef-bceb-c7b262605968","modified":"2024-09-19T08:34:59.415913Z","created":"2024-09-19T08:34:59.415913Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:36:27.366 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 1 2024-09-19T08:36:27.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.363+0000 7ff81a6b6640 1 -- 172.21.15.175:0/2891131914 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff7fc0392a0 msgr2=0x7ff7fc03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:27.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.363+0000 7ff81a6b6640 1 --2- 172.21.15.175:0/2891131914 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff7fc0392a0 0x7ff7fc03b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff8080098c0 tx=0x7ff808006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:27.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.363+0000 7ff81a6b6640 1 -- 172.21.15.175:0/2891131914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff814106540 msgr2=0x7ff8141970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:27.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.363+0000 7ff81a6b6640 1 --2- 172.21.15.175:0/2891131914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff814106540 0x7ff8141970e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff804009930 tx=0x7ff804004570 comp rx=0 tx=0).stop 2024-09-19T08:36:27.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.363+0000 7ff81a6b6640 1 -- 172.21.15.175:0/2891131914 shutdown_connections 2024-09-19T08:36:27.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.363+0000 7ff81a6b6640 1 --2- 172.21.15.175:0/2891131914 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff7fc0392a0 0x7ff7fc03b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:27.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.363+0000 7ff81a6b6640 1 --2- 172.21.15.175:0/2891131914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff814106540 0x7ff8141970e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:27.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.363+0000 7ff81a6b6640 1 -- 172.21.15.175:0/2891131914 >> 172.21.15.175:0/2891131914 conn(0x7ff814077310 msgr2=0x7ff8140696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:27.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.363+0000 7ff81a6b6640 1 -- 172.21.15.175:0/2891131914 shutdown_connections 2024-09-19T08:36:27.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:27.363+0000 7ff81a6b6640 1 -- 172.21.15.175:0/2891131914 wait complete. 2024-09-19T08:36:28.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:27 smithi007 ceph-mon[31221]: from='client.? 172.21.15.175:0/2891131914' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:36:29.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:28 smithi007 ceph-mon[31221]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:29.050 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:36:29.050 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:36:29.356 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:36:29.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.914+0000 7f420a511640 1 -- 172.21.15.175:0/3992768970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4204106650 msgr2=0x7f4204106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:29.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.914+0000 7f420a511640 1 --2- 172.21.15.175:0/3992768970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4204106650 0x7f4204106a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009880 tx=0x7f41f402a5d0 comp rx=0 tx=0).stop 2024-09-19T08:36:29.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.914+0000 7f420a511640 1 -- 172.21.15.175:0/3992768970 shutdown_connections 2024-09-19T08:36:29.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.914+0000 7f420a511640 1 --2- 172.21.15.175:0/3992768970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4204106650 0x7f4204106a30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:29.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.914+0000 7f420a511640 1 -- 172.21.15.175:0/3992768970 >> 172.21.15.175:0/3992768970 conn(0x7f42040fc280 msgr2=0x7f42040fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:29.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.914+0000 7f420a511640 1 -- 172.21.15.175:0/3992768970 shutdown_connections 2024-09-19T08:36:29.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.914+0000 7f420a511640 1 -- 172.21.15.175:0/3992768970 wait complete. 2024-09-19T08:36:29.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.914+0000 7f420a511640 1 Processor -- start 2024-09-19T08:36:29.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.914+0000 7f420a511640 1 -- start start 2024-09-19T08:36:29.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.915+0000 7f420a511640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4204106650 0x7f4204198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:29.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.915+0000 7f420a511640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f420410ac80 con 0x7f4204106650 2024-09-19T08:36:29.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.915+0000 7f4203fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4204106650 0x7f4204198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:29.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.915+0000 7f4203fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4204106650 0x7f4204198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.175:34982/0 (socket says 172.21.15.175:34982) 2024-09-19T08:36:29.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.915+0000 7f4203fff640 1 -- 172.21.15.175:0/1957415784 learned_addr learned my addr 172.21.15.175:0/1957415784 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-19T08:36:29.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.915+0000 7f4203fff640 1 -- 172.21.15.175:0/1957415784 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42041985d0 con 0x7f4204106650 2024-09-19T08:36:29.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.916+0000 7f4203fff640 1 --2- 172.21.15.175:0/1957415784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4204106650 0x7f4204198090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009230 tx=0x7f41f4003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:29.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.916+0000 7f42017fa640 1 -- 172.21.15.175:0/1957415784 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41f403f070 con 0x7f4204106650 2024-09-19T08:36:29.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.916+0000 7f420a511640 1 -- 172.21.15.175:0/1957415784 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4204198860 con 0x7f4204106650 2024-09-19T08:36:29.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.916+0000 7f42017fa640 1 -- 172.21.15.175:0/1957415784 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41f403bc80 con 0x7f4204106650 2024-09-19T08:36:29.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.916+0000 7f42017fa640 1 -- 172.21.15.175:0/1957415784 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41f4035030 con 0x7f4204106650 2024-09-19T08:36:29.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.916+0000 7f420a511640 1 -- 172.21.15.175:0/1957415784 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4204198cc0 con 0x7f4204106650 2024-09-19T08:36:29.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.917+0000 7f420a511640 1 -- 172.21.15.175:0/1957415784 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4204101cc0 con 0x7f4204106650 2024-09-19T08:36:29.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.917+0000 7f42017fa640 1 -- 172.21.15.175:0/1957415784 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f41f4042070 con 0x7f4204106650 2024-09-19T08:36:29.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.917+0000 7f42017fa640 1 --2- 172.21.15.175:0/1957415784 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f41f00392a0 0x7f41f003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:29.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.917+0000 7f42017fa640 1 -- 172.21.15.175:0/1957415784 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f41f406cff0 con 0x7f4204106650 2024-09-19T08:36:29.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.917+0000 7f42037fe640 1 --2- 172.21.15.175:0/1957415784 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f41f00392a0 0x7f41f003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:29.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.918+0000 7f42037fe640 1 --2- 172.21.15.175:0/1957415784 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f41f00392a0 0x7f41f003b760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f41ec0098c0 tx=0x7f41ec006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:29.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:29.922+0000 7f42017fa640 1 -- 172.21.15.175:0/1957415784 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f41f40372d0 con 0x7f4204106650 2024-09-19T08:36:30.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:30.173+0000 7f420a511640 1 -- 172.21.15.175:0/1957415784 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f4204106ab0 con 0x7f4204106650 2024-09-19T08:36:30.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:30.175+0000 7f42017fa640 1 -- 172.21.15.175:0/1957415784 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7f41f4031570 con 0x7f4204106650 2024-09-19T08:36:30.175 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:36:30.175 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":1,"fsid":"ebd23124-7661-11ef-bceb-c7b262605968","modified":"2024-09-19T08:34:59.415913Z","created":"2024-09-19T08:34:59.415913Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:36:30.175 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 1 2024-09-19T08:36:30.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:30.178+0000 7f420a511640 1 -- 172.21.15.175:0/1957415784 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f41f00392a0 msgr2=0x7f41f003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:30.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:30.178+0000 7f420a511640 1 --2- 172.21.15.175:0/1957415784 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f41f00392a0 0x7f41f003b760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f41ec0098c0 tx=0x7f41ec006db0 comp rx=0 tx=0).stop 2024-09-19T08:36:30.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:30.178+0000 7f420a511640 1 -- 172.21.15.175:0/1957415784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4204106650 msgr2=0x7f4204198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:30.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:30.178+0000 7f420a511640 1 --2- 172.21.15.175:0/1957415784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4204106650 0x7f4204198090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009230 tx=0x7f41f4003d40 comp rx=0 tx=0).stop 2024-09-19T08:36:30.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:30.178+0000 7f420a511640 1 -- 172.21.15.175:0/1957415784 shutdown_connections 2024-09-19T08:36:30.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:30.178+0000 7f420a511640 1 --2- 172.21.15.175:0/1957415784 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f41f00392a0 0x7f41f003b760 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:30.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:30.178+0000 7f420a511640 1 --2- 172.21.15.175:0/1957415784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4204106650 0x7f4204198090 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:30.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:30.178+0000 7f420a511640 1 -- 172.21.15.175:0/1957415784 >> 172.21.15.175:0/1957415784 conn(0x7f42040fc280 msgr2=0x7f42040fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:30.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:30.178+0000 7f420a511640 1 -- 172.21.15.175:0/1957415784 shutdown_connections 2024-09-19T08:36:30.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:30.178+0000 7f420a511640 1 -- 172.21.15.175:0/1957415784 wait complete. 2024-09-19T08:36:31.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:30 smithi007 ceph-mon[31221]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:31.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:30 smithi007 ceph-mon[31221]: from='client.? 172.21.15.175:0/1957415784' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:36:31.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:31 smithi175 systemd[1]: Started Ceph mon.c for ebd23124-7661-11ef-bceb-c7b262605968. 2024-09-19T08:36:31.788 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:36:31.789 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:36:32.052 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:36:36.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:36.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:36:36.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:36.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: mon.a calling monitor election 2024-09-19T08:36:36.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:36.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:36.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:36.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: mon.c calling monitor election 2024-09-19T08:36:36.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:36.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:36.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:36.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:36.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:36:36.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: monmap epoch 2 2024-09-19T08:36:36.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: fsid ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:36:36.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: last_changed 2024-09-19T08:36:31.349002+0000 2024-09-19T08:36:36.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: created 2024-09-19T08:34:59.415913+0000 2024-09-19T08:36:36.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: min_mon_release 19 (squid) 2024-09-19T08:36:36.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: election_strategy: 1 2024-09-19T08:36:36.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-19T08:36:36.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-19T08:36:36.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: fsmap 2024-09-19T08:36:36.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:36:36.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: mgrmap e13: x(active, since 39s) 2024-09-19T08:36:36.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: overall HEALTH_OK 2024-09-19T08:36:36.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:36.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:36.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:36.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:36:36.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:36:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: mon.a calling monitor election 2024-09-19T08:36:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: mon.c calling monitor election 2024-09-19T08:36:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:36:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: monmap epoch 2 2024-09-19T08:36:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: fsid ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:36:36.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: last_changed 2024-09-19T08:36:31.349002+0000 2024-09-19T08:36:36.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: created 2024-09-19T08:34:59.415913+0000 2024-09-19T08:36:36.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: min_mon_release 19 (squid) 2024-09-19T08:36:36.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: election_strategy: 1 2024-09-19T08:36:36.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-19T08:36:36.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-19T08:36:36.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: fsmap 2024-09-19T08:36:36.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:36:36.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: mgrmap e13: x(active, since 39s) 2024-09-19T08:36:36.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: overall HEALTH_OK 2024-09-19T08:36:36.786 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:36.786 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:36.786 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:36.786 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:36:36.786 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:36.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.885+0000 7f2c0da1f640 1 -- 172.21.15.175:0/525271242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bf0005740 msgr2=0x7f2bf0007bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:36.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.885+0000 7f2c0da1f640 1 --2- 172.21.15.175:0/525271242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bf0005740 0x7f2bf0007bd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2c081016a0 tx=0x7f2bf802c490 comp rx=0 tx=0).stop 2024-09-19T08:36:36.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.885+0000 7f2c0da1f640 1 -- 172.21.15.175:0/525271242 shutdown_connections 2024-09-19T08:36:36.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.885+0000 7f2c0da1f640 1 --2- 172.21.15.175:0/525271242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bf0005740 0x7f2bf0007bd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:36.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.885+0000 7f2c0da1f640 1 -- 172.21.15.175:0/525271242 >> 172.21.15.175:0/525271242 conn(0x7f2c080fc220 msgr2=0x7f2c080fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:36.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.885+0000 7f2c0da1f640 1 -- 172.21.15.175:0/525271242 shutdown_connections 2024-09-19T08:36:36.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.885+0000 7f2c0da1f640 1 -- 172.21.15.175:0/525271242 wait complete. 2024-09-19T08:36:36.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.886+0000 7f2c0da1f640 1 Processor -- start 2024-09-19T08:36:36.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.887+0000 7f2c0da1f640 1 -- start start 2024-09-19T08:36:36.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.887+0000 7f2c0da1f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bf0005740 0x7f2c08199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:36.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.887+0000 7f2c0da1f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c08199970 0x7f2c0819dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:36.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.887+0000 7f2c0da1f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2c081075a0 con 0x7f2c08199970 2024-09-19T08:36:36.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.888+0000 7f2c0da1f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2c08107420 con 0x7f2bf0005740 2024-09-19T08:36:36.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.888+0000 7f2c06ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bf0005740 0x7f2c08199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:36.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.888+0000 7f2c06ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bf0005740 0x7f2c08199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52636/0 (socket says 172.21.15.175:52636) 2024-09-19T08:36:36.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.888+0000 7f2c06ffd640 1 -- 172.21.15.175:0/3687477328 learned_addr learned my addr 172.21.15.175:0/3687477328 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-19T08:36:36.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.888+0000 7f2c06ffd640 1 -- 172.21.15.175:0/3687477328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bf0005740 msgr2=0x7f2c08199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T08:36:36.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.888+0000 7f2c06ffd640 1 -- 172.21.15.175:0/3687477328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bf0005740 msgr2=0x7f2c08199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:36:36.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.888+0000 7f2c06ffd640 1 --2- 172.21.15.175:0/3687477328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bf0005740 0x7f2c08199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:36:36.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.888+0000 7f2c067fc640 1 --2- 172.21.15.175:0/3687477328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c08199970 0x7f2c0819dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:36.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.888+0000 7f2c06ffd640 1 --2- 172.21.15.175:0/3687477328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bf0005740 0x7f2c08199430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:36:36.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.888+0000 7f2c067fc640 1 -- 172.21.15.175:0/3687477328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bf0005740 msgr2=0x7f2c08199430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:36:36.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.888+0000 7f2c067fc640 1 --2- 172.21.15.175:0/3687477328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bf0005740 0x7f2c08199430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:36.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.888+0000 7f2c067fc640 1 -- 172.21.15.175:0/3687477328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c08199f90 con 0x7f2c08199970 2024-09-19T08:36:36.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.889+0000 7f2c067fc640 1 --2- 172.21.15.175:0/3687477328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c08199970 0x7f2c0819dd00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00b3d0 tx=0x7f2bfc00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:36.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.889+0000 7f2c0ca1d640 1 -- 172.21.15.175:0/3687477328 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f2bfc011630 con 0x7f2c08199970 2024-09-19T08:36:36.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.889+0000 7f2c0ca1d640 1 -- 172.21.15.175:0/3687477328 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bfc011cb0 con 0x7f2c08199970 2024-09-19T08:36:36.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.889+0000 7f2c0da1f640 1 -- 172.21.15.175:0/3687477328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c0819e240 con 0x7f2c08199970 2024-09-19T08:36:36.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.889+0000 7f2c0ca1d640 1 -- 172.21.15.175:0/3687477328 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f2bfc010df0 con 0x7f2c08199970 2024-09-19T08:36:36.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.889+0000 7f2c0da1f640 1 -- 172.21.15.175:0/3687477328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c0819e800 con 0x7f2c08199970 2024-09-19T08:36:36.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.890+0000 7f2c0ca1d640 1 -- 172.21.15.175:0/3687477328 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f2bfc018020 con 0x7f2c08199970 2024-09-19T08:36:36.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.890+0000 7f2c0ca1d640 1 --2- 172.21.15.175:0/3687477328 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f2bf4039040 0x7f2bf403b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:36.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.890+0000 7f2c0ca1d640 1 -- 172.21.15.175:0/3687477328 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2bfc04cfa0 con 0x7f2c08199970 2024-09-19T08:36:36.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.890+0000 7f2c06ffd640 1 --2- 172.21.15.175:0/3687477328 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f2bf4039040 0x7f2bf403b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:36.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.890+0000 7f2c0da1f640 1 -- 172.21.15.175:0/3687477328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c0819eb10 con 0x7f2c08199970 2024-09-19T08:36:36.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.891+0000 7f2c06ffd640 1 --2- 172.21.15.175:0/3687477328 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f2bf4039040 0x7f2bf403b500 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80129e0 tx=0x7f2bf802c9f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:36.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:36.896+0000 7f2c0ca1d640 1 -- 172.21.15.175:0/3687477328 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2bfc01f020 con 0x7f2c08199970 2024-09-19T08:36:37.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:37.127+0000 7f2c0da1f640 1 -- 172.21.15.175:0/3687477328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f2c0818eda0 con 0x7f2c08199970 2024-09-19T08:36:37.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:37.128+0000 7f2c0ca1d640 1 -- 172.21.15.175:0/3687477328 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f2bfc018310 con 0x7f2c08199970 2024-09-19T08:36:37.128 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:36:37.128 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":2,"fsid":"ebd23124-7661-11ef-bceb-c7b262605968","modified":"2024-09-19T08:36:31.349002Z","created":"2024-09-19T08:34:59.415913Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T08:36:37.128 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 2 2024-09-19T08:36:37.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:37.130+0000 7f2c0da1f640 1 -- 172.21.15.175:0/3687477328 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f2bf4039040 msgr2=0x7f2bf403b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:37.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:37.130+0000 7f2c0da1f640 1 --2- 172.21.15.175:0/3687477328 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f2bf4039040 0x7f2bf403b500 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80129e0 tx=0x7f2bf802c9f0 comp rx=0 tx=0).stop 2024-09-19T08:36:37.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:37.130+0000 7f2c0da1f640 1 -- 172.21.15.175:0/3687477328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c08199970 msgr2=0x7f2c0819dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:37.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:37.130+0000 7f2c0da1f640 1 --2- 172.21.15.175:0/3687477328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c08199970 0x7f2c0819dd00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00b3d0 tx=0x7f2bfc00b890 comp rx=0 tx=0).stop 2024-09-19T08:36:37.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:37.130+0000 7f2c0da1f640 1 -- 172.21.15.175:0/3687477328 shutdown_connections 2024-09-19T08:36:37.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:37.130+0000 7f2c0da1f640 1 --2- 172.21.15.175:0/3687477328 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f2bf4039040 0x7f2bf403b500 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:37.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:37.130+0000 7f2c0da1f640 1 --2- 172.21.15.175:0/3687477328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c08199970 0x7f2c0819dd00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:37.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:37.130+0000 7f2c0da1f640 1 --2- 172.21.15.175:0/3687477328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bf0005740 0x7f2c08199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:37.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:37.130+0000 7f2c0da1f640 1 -- 172.21.15.175:0/3687477328 >> 172.21.15.175:0/3687477328 conn(0x7f2c080fc220 msgr2=0x7f2c080fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:37.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:37.130+0000 7f2c0da1f640 1 -- 172.21.15.175:0/3687477328 shutdown_connections 2024-09-19T08:36:37.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:37.130+0000 7f2c0da1f640 1 -- 172.21.15.175:0/3687477328 wait complete. 2024-09-19T08:36:37.671 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:37 smithi175 ceph-mon[35688]: Deploying daemon mon.b on smithi044 2024-09-19T08:36:37.671 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:37 smithi175 ceph-mon[35688]: from='client.? 172.21.15.175:0/3687477328' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:36:37.672 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:37 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:37.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:37 smithi007 ceph-mon[31221]: Deploying daemon mon.b on smithi044 2024-09-19T08:36:37.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:37 smithi007 ceph-mon[31221]: from='client.? 172.21.15.175:0/3687477328' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:36:37.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:37 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:38.674 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:36:38.675 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:36:38.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:38 smithi175 ceph-mon[35688]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:38.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:38 smithi007 ceph-mon[31221]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:38.926 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:36:39.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.328+0000 7f1cd4a3f640 1 -- 172.21.15.175:0/4036267682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cd0106630 msgr2=0x7f1cd0106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:39.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.328+0000 7f1cd4a3f640 1 --2- 172.21.15.175:0/4036267682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cd0106630 0x7f1cd0106a10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0009880 tx=0x7f1cc002a5d0 comp rx=0 tx=0).stop 2024-09-19T08:36:39.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.328+0000 7f1cd4a3f640 1 -- 172.21.15.175:0/4036267682 shutdown_connections 2024-09-19T08:36:39.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.328+0000 7f1cd4a3f640 1 --2- 172.21.15.175:0/4036267682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cd0106630 0x7f1cd0106a10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:39.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.328+0000 7f1cd4a3f640 1 -- 172.21.15.175:0/4036267682 >> 172.21.15.175:0/4036267682 conn(0x7f1cd00fc220 msgr2=0x7f1cd00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:39.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.328+0000 7f1cd4a3f640 1 -- 172.21.15.175:0/4036267682 shutdown_connections 2024-09-19T08:36:39.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.328+0000 7f1cd4a3f640 1 -- 172.21.15.175:0/4036267682 wait complete. 2024-09-19T08:36:39.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.328+0000 7f1cd4a3f640 1 Processor -- start 2024-09-19T08:36:39.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.329+0000 7f1cd4a3f640 1 -- start start 2024-09-19T08:36:39.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.329+0000 7f1cd4a3f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cd0106630 0x7f1cd0198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:39.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.329+0000 7f1cd4a3f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cd0198750 0x7f1cd0198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:39.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.329+0000 7f1cd4a3f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd010ac60 con 0x7f1cd0106630 2024-09-19T08:36:39.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.329+0000 7f1cd4a3f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd010aae0 con 0x7f1cd0198750 2024-09-19T08:36:39.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.329+0000 7f1cce59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cd0106630 0x7f1cd0198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:39.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.329+0000 7f1ccdd9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cd0198750 0x7f1cd0198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:39.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.329+0000 7f1cce59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cd0106630 0x7f1cd0198210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.175:33130/0 (socket says 172.21.15.175:33130) 2024-09-19T08:36:39.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.329+0000 7f1cce59c640 1 -- 172.21.15.175:0/3858723673 learned_addr learned my addr 172.21.15.175:0/3858723673 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-19T08:36:39.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.329+0000 7f1ccdd9b640 1 -- 172.21.15.175:0/3858723673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cd0198750 msgr2=0x7f1cd0198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T08:36:39.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.329+0000 7f1ccdd9b640 1 -- 172.21.15.175:0/3858723673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cd0198750 msgr2=0x7f1cd0198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:36:39.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.329+0000 7f1ccdd9b640 1 --2- 172.21.15.175:0/3858723673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cd0198750 0x7f1cd0198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:36:39.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.329+0000 7f1ccdd9b640 1 --2- 172.21.15.175:0/3858723673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cd0198750 0x7f1cd0198bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:36:39.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.329+0000 7f1cce59c640 1 -- 172.21.15.175:0/3858723673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cd0198750 msgr2=0x7f1cd0198bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:36:39.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.329+0000 7f1cce59c640 1 --2- 172.21.15.175:0/3858723673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cd0198750 0x7f1cd0198bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:39.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.329+0000 7f1cce59c640 1 -- 172.21.15.175:0/3858723673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd01a1280 con 0x7f1cd0106630 2024-09-19T08:36:39.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.330+0000 7f1cce59c640 1 --2- 172.21.15.175:0/3858723673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cd0106630 0x7f1cd0198210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0004650 tx=0x7f1cc0032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:39.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.330+0000 7f1cbf7fe640 1 -- 172.21.15.175:0/3858723673 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f1cc0035070 con 0x7f1cd0106630 2024-09-19T08:36:39.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.330+0000 7f1cd4a3f640 1 -- 172.21.15.175:0/3858723673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cd01a1450 con 0x7f1cd0106630 2024-09-19T08:36:39.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.330+0000 7f1cbf7fe640 1 -- 172.21.15.175:0/3858723673 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cc0003ce0 con 0x7f1cd0106630 2024-09-19T08:36:39.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.330+0000 7f1cbf7fe640 1 -- 172.21.15.175:0/3858723673 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f1cc003bbd0 con 0x7f1cd0106630 2024-09-19T08:36:39.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.330+0000 7f1cd4a3f640 1 -- 172.21.15.175:0/3858723673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cd01a1930 con 0x7f1cd0106630 2024-09-19T08:36:39.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.331+0000 7f1cbf7fe640 1 -- 172.21.15.175:0/3858723673 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f1cc0042030 con 0x7f1cd0106630 2024-09-19T08:36:39.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.331+0000 7f1cd4a3f640 1 -- 172.21.15.175:0/3858723673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cd0101ca0 con 0x7f1cd0106630 2024-09-19T08:36:39.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.331+0000 7f1cbf7fe640 1 --2- 172.21.15.175:0/3858723673 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1cb8039040 0x7f1cb803b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:39.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.331+0000 7f1cbf7fe640 1 -- 172.21.15.175:0/3858723673 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1cc0040070 con 0x7f1cd0106630 2024-09-19T08:36:39.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.331+0000 7f1ccdd9b640 1 --2- 172.21.15.175:0/3858723673 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1cb8039040 0x7f1cb803b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:39.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.332+0000 7f1ccdd9b640 1 --2- 172.21.15.175:0/3858723673 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1cb8039040 0x7f1cb803b500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4006fd0 tx=0x7f1cc4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:39.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.336+0000 7f1cbf7fe640 1 -- 172.21.15.175:0/3858723673 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1cc003bd70 con 0x7f1cd0106630 2024-09-19T08:36:39.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.563+0000 7f1cd4a3f640 1 -- 172.21.15.175:0/3858723673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f1cd01a1be0 con 0x7f1cd0106630 2024-09-19T08:36:39.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.563+0000 7f1cbf7fe640 1 -- 172.21.15.175:0/3858723673 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f1cc00438e0 con 0x7f1cd0106630 2024-09-19T08:36:39.564 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:36:39.564 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":2,"fsid":"ebd23124-7661-11ef-bceb-c7b262605968","modified":"2024-09-19T08:36:31.349002Z","created":"2024-09-19T08:34:59.415913Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T08:36:39.564 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 2 2024-09-19T08:36:39.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.565+0000 7f1cd4a3f640 1 -- 172.21.15.175:0/3858723673 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1cb8039040 msgr2=0x7f1cb803b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:39.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.565+0000 7f1cd4a3f640 1 --2- 172.21.15.175:0/3858723673 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1cb8039040 0x7f1cb803b500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4006fd0 tx=0x7f1cc4008040 comp rx=0 tx=0).stop 2024-09-19T08:36:39.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.565+0000 7f1cd4a3f640 1 -- 172.21.15.175:0/3858723673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cd0106630 msgr2=0x7f1cd0198210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:39.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.565+0000 7f1cd4a3f640 1 --2- 172.21.15.175:0/3858723673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cd0106630 0x7f1cd0198210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0004650 tx=0x7f1cc0032c50 comp rx=0 tx=0).stop 2024-09-19T08:36:39.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.565+0000 7f1cd4a3f640 1 -- 172.21.15.175:0/3858723673 shutdown_connections 2024-09-19T08:36:39.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.565+0000 7f1cd4a3f640 1 --2- 172.21.15.175:0/3858723673 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1cb8039040 0x7f1cb803b500 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:39.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.565+0000 7f1cd4a3f640 1 --2- 172.21.15.175:0/3858723673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cd0198750 0x7f1cd0198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:39.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.565+0000 7f1cd4a3f640 1 --2- 172.21.15.175:0/3858723673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cd0106630 0x7f1cd0198210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:39.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.565+0000 7f1cd4a3f640 1 -- 172.21.15.175:0/3858723673 >> 172.21.15.175:0/3858723673 conn(0x7f1cd00fc220 msgr2=0x7f1cd00fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:39.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.565+0000 7f1cd4a3f640 1 -- 172.21.15.175:0/3858723673 shutdown_connections 2024-09-19T08:36:39.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:39.565+0000 7f1cd4a3f640 1 -- 172.21.15.175:0/3858723673 wait complete. 2024-09-19T08:36:40.130 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 podman[35053]: 2024-09-19 08:36:40.109265427 +0000 UTC m=+0.362599502 container start 03cb4d59dff28013f947335bb6da51736e8c9d32ed7cb2cda0e4cb064832d362 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-b, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T08:36:40.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T08:36:40.573 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T08:36:40.573 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: pidfile_write: ignore empty --pid-file 2024-09-19T08:36:40.573 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: load: jerasure load: lrc 2024-09-19T08:36:40.573 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: RocksDB version: 7.9.2 2024-09-19T08:36:40.573 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Git sha 0 2024-09-19T08:36:40.573 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T08:36:40.573 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: DB SUMMARY 2024-09-19T08:36:40.574 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: DB Session ID: F703K2Z56JQM0N4O2K2M 2024-09-19T08:36:40.574 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: CURRENT file: CURRENT 2024-09-19T08:36:40.574 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T08:36:40.574 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T08:36:40.574 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-19T08:36:40.574 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-19T08:36:40.574 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.error_if_exists: 0 2024-09-19T08:36:40.574 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.create_if_missing: 0 2024-09-19T08:36:40.574 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.paranoid_checks: 1 2024-09-19T08:36:40.574 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T08:36:40.574 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T08:36:40.574 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T08:36:40.575 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.env: 0x562508d55940 2024-09-19T08:36:40.575 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T08:36:40.575 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.info_log: 0x56250ada96e0 2024-09-19T08:36:40.575 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T08:36:40.575 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.statistics: (nil) 2024-09-19T08:36:40.575 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.use_fsync: 0 2024-09-19T08:36:40.575 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_log_file_size: 0 2024-09-19T08:36:40.575 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T08:36:40.575 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T08:36:40.575 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T08:36:40.576 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T08:36:40.576 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.allow_fallocate: 1 2024-09-19T08:36:40.576 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T08:36:40.576 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T08:36:40.576 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.use_direct_reads: 0 2024-09-19T08:36:40.576 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T08:36:40.576 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T08:36:40.576 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.db_log_dir: 2024-09-19T08:36:40.576 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.wal_dir: 2024-09-19T08:36:40.576 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T08:36:40.576 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T08:36:40.576 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T08:36:40.576 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T08:36:40.577 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T08:36:40.577 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T08:36:40.577 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T08:36:40.577 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T08:36:40.577 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.write_buffer_manager: 0x56250adb8dc0 2024-09-19T08:36:40.577 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T08:36:40.577 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T08:36:40.577 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T08:36:40.577 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T08:36:40.577 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T08:36:40.577 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T08:36:40.577 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T08:36:40.577 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T08:36:40.577 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.unordered_write: 0 2024-09-19T08:36:40.578 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T08:36:40.578 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T08:36:40.578 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T08:36:40.578 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T08:36:40.578 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.row_cache: None 2024-09-19T08:36:40.578 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.wal_filter: None 2024-09-19T08:36:40.578 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T08:36:40.578 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T08:36:40.578 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.two_write_queues: 0 2024-09-19T08:36:40.578 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T08:36:40.578 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.wal_compression: 0 2024-09-19T08:36:40.578 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.atomic_flush: 0 2024-09-19T08:36:40.578 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T08:36:40.578 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T08:36:40.579 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T08:36:40.579 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.log_readahead_size: 0 2024-09-19T08:36:40.579 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T08:36:40.579 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T08:36:40.579 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T08:36:40.579 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T08:36:40.579 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T08:36:40.579 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T08:36:40.579 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T08:36:40.583 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_background_jobs: 2 2024-09-19T08:36:40.583 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_background_compactions: -1 2024-09-19T08:36:40.583 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_subcompactions: 1 2024-09-19T08:36:40.583 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T08:36:40.583 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T08:36:40.583 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T08:36:40.583 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T08:36:40.584 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T08:36:40.584 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T08:36:40.584 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T08:36:40.584 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T08:36:40.584 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_open_files: -1 2024-09-19T08:36:40.584 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T08:36:40.584 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T08:36:40.584 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T08:36:40.584 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T08:36:40.584 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_background_flushes: -1 2024-09-19T08:36:40.584 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Compression algorithms supported: 2024-09-19T08:36:40.584 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: kZSTD supported: 0 2024-09-19T08:36:40.585 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: kXpressCompression supported: 0 2024-09-19T08:36:40.585 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: kBZip2Compression supported: 0 2024-09-19T08:36:40.585 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T08:36:40.585 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: kLZ4Compression supported: 1 2024-09-19T08:36:40.585 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: kZlibCompression supported: 1 2024-09-19T08:36:40.585 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T08:36:40.585 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: kSnappyCompression supported: 1 2024-09-19T08:36:40.585 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T08:36:40.585 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T08:36:40.585 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-19T08:36:40.585 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T08:36:40.585 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T08:36:40.585 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.merge_operator: 2024-09-19T08:36:40.586 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compaction_filter: None 2024-09-19T08:36:40.586 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T08:36:40.586 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T08:36:40.586 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T08:36:40.586 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T08:36:40.586 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56250ada9320) 2024-09-19T08:36:40.586 INFO:journalctl@ceph.mon.b.smithi044.stdout: cache_index_and_filter_blocks: 1 2024-09-19T08:36:40.586 INFO:journalctl@ceph.mon.b.smithi044.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T08:36:40.586 INFO:journalctl@ceph.mon.b.smithi044.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T08:36:40.586 INFO:journalctl@ceph.mon.b.smithi044.stdout: pin_top_level_index_and_filter: 1 2024-09-19T08:36:40.586 INFO:journalctl@ceph.mon.b.smithi044.stdout: index_type: 0 2024-09-19T08:36:40.586 INFO:journalctl@ceph.mon.b.smithi044.stdout: data_block_index_type: 0 2024-09-19T08:36:40.586 INFO:journalctl@ceph.mon.b.smithi044.stdout: index_shortening: 1 2024-09-19T08:36:40.586 INFO:journalctl@ceph.mon.b.smithi044.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T08:36:40.586 INFO:journalctl@ceph.mon.b.smithi044.stdout: checksum: 4 2024-09-19T08:36:40.587 INFO:journalctl@ceph.mon.b.smithi044.stdout: no_block_cache: 0 2024-09-19T08:36:40.587 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_cache: 0x56250ad9d1f0 2024-09-19T08:36:40.587 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_cache_name: BinnedLRUCache 2024-09-19T08:36:40.587 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_cache_options: 2024-09-19T08:36:40.587 INFO:journalctl@ceph.mon.b.smithi044.stdout: capacity : 536870912 2024-09-19T08:36:40.587 INFO:journalctl@ceph.mon.b.smithi044.stdout: num_shard_bits : 4 2024-09-19T08:36:40.587 INFO:journalctl@ceph.mon.b.smithi044.stdout: strict_capacity_limit : 0 2024-09-19T08:36:40.587 INFO:journalctl@ceph.mon.b.smithi044.stdout: high_pri_pool_ratio: 0.000 2024-09-19T08:36:40.587 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_cache_compressed: (nil) 2024-09-19T08:36:40.587 INFO:journalctl@ceph.mon.b.smithi044.stdout: persistent_cache: (nil) 2024-09-19T08:36:40.588 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_size: 4096 2024-09-19T08:36:40.588 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_size_deviation: 10 2024-09-19T08:36:40.588 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_restart_interval: 16 2024-09-19T08:36:40.588 INFO:journalctl@ceph.mon.b.smithi044.stdout: index_block_restart_interval: 1 2024-09-19T08:36:40.588 INFO:journalctl@ceph.mon.b.smithi044.stdout: metadata_block_size: 4096 2024-09-19T08:36:40.588 INFO:journalctl@ceph.mon.b.smithi044.stdout: partition_filters: 0 2024-09-19T08:36:40.588 INFO:journalctl@ceph.mon.b.smithi044.stdout: use_delta_encoding: 1 2024-09-19T08:36:40.588 INFO:journalctl@ceph.mon.b.smithi044.stdout: filter_policy: bloomfilter 2024-09-19T08:36:40.588 INFO:journalctl@ceph.mon.b.smithi044.stdout: whole_key_filtering: 1 2024-09-19T08:36:40.588 INFO:journalctl@ceph.mon.b.smithi044.stdout: verify_compression: 0 2024-09-19T08:36:40.588 INFO:journalctl@ceph.mon.b.smithi044.stdout: read_amp_bytes_per_bit: 0 2024-09-19T08:36:40.588 INFO:journalctl@ceph.mon.b.smithi044.stdout: format_version: 5 2024-09-19T08:36:40.589 INFO:journalctl@ceph.mon.b.smithi044.stdout: enable_index_compression: 1 2024-09-19T08:36:40.589 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_align: 0 2024-09-19T08:36:40.589 INFO:journalctl@ceph.mon.b.smithi044.stdout: max_auto_readahead_size: 262144 2024-09-19T08:36:40.589 INFO:journalctl@ceph.mon.b.smithi044.stdout: prepopulate_block_cache: 0 2024-09-19T08:36:40.589 INFO:journalctl@ceph.mon.b.smithi044.stdout: initial_auto_readahead_size: 8192 2024-09-19T08:36:40.589 INFO:journalctl@ceph.mon.b.smithi044.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T08:36:40.589 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T08:36:40.589 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T08:36:40.589 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compression: NoCompression 2024-09-19T08:36:40.589 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T08:36:40.589 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T08:36:40.589 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T08:36:40.589 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.num_levels: 7 2024-09-19T08:36:40.589 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T08:36:40.590 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T08:36:40.590 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T08:36:40.590 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T08:36:40.590 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T08:36:40.590 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T08:36:40.590 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T08:36:40.590 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:36:40.590 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T08:36:40.590 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T08:36:40.590 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:36:40.591 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:36:40.591 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T08:36:40.591 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T08:36:40.591 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T08:36:40.591 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T08:36:40.591 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:36:40.591 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:36:40.591 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T08:36:40.591 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T08:36:40.591 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:36:40.591 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T08:36:40.591 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T08:36:40.591 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T08:36:40.591 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T08:36:40.592 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T08:36:40.592 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T08:36:40.592 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T08:36:40.592 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T08:36:40.592 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T08:36:40.592 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T08:36:40.592 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T08:36:40.592 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T08:36:40.592 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T08:36:40.592 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T08:36:40.593 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T08:36:40.593 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T08:36:40.593 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T08:36:40.593 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T08:36:40.593 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T08:36:40.593 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T08:36:40.593 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T08:36:40.593 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T08:36:40.593 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T08:36:40.593 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T08:36:40.593 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T08:36:40.594 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T08:36:40.594 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T08:36:40.594 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T08:36:40.594 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T08:36:40.594 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T08:36:40.594 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T08:36:40.594 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T08:36:40.594 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T08:36:40.594 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.inplace_update_support: 0 2024-09-19T08:36:40.594 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T08:36:40.594 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T08:36:40.594 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T08:36:40.594 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T08:36:40.595 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.bloom_locality: 0 2024-09-19T08:36:40.595 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.max_successive_merges: 0 2024-09-19T08:36:40.595 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T08:36:40.595 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T08:36:40.595 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T08:36:40.595 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T08:36:40.595 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.ttl: 2592000 2024-09-19T08:36:40.595 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T08:36:40.595 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T08:36:40.595 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T08:36:40.595 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.enable_blob_files: false 2024-09-19T08:36:40.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.min_blob_size: 0 2024-09-19T08:36:40.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T08:36:40.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T08:36:40.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T08:36:40.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T08:36:40.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T08:36:40.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T08:36:40.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T08:36:40.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T08:36:40.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T08:36:40.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T08:36:40.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f6251196-f338-437a-8a49-670f8cad1746 2024-09-19T08:36:40.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735000136182, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T08:36:40.597 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T08:36:40.597 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735000136580, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726735000, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f6251196-f338-437a-8a49-670f8cad1746", "db_session_id": "F703K2Z56JQM0N4O2K2M", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T08:36:40.597 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735000136676, "job": 1, "event": "recovery_finished"} 2024-09-19T08:36:40.597 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T08:36:40.597 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T08:36:40.597 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56250adcae00 2024-09-19T08:36:40.597 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: DB pointer 0x56250aec6000 2024-09-19T08:36:40.597 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T08:36:40.597 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T08:36:40.597 INFO:journalctl@ceph.mon.b.smithi044.stdout: ** DB Stats ** 2024-09-19T08:36:40.597 INFO:journalctl@ceph.mon.b.smithi044.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:36:40.597 INFO:journalctl@ceph.mon.b.smithi044.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T08:36:40.597 INFO:journalctl@ceph.mon.b.smithi044.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:36:40.598 INFO:journalctl@ceph.mon.b.smithi044.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:36:40.598 INFO:journalctl@ceph.mon.b.smithi044.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T08:36:40.598 INFO:journalctl@ceph.mon.b.smithi044.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:36:40.598 INFO:journalctl@ceph.mon.b.smithi044.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:36:40.598 INFO:journalctl@ceph.mon.b.smithi044.stdout: 2024-09-19T08:36:40.598 INFO:journalctl@ceph.mon.b.smithi044.stdout: ** Compaction Stats [default] ** 2024-09-19T08:36:40.598 INFO:journalctl@ceph.mon.b.smithi044.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:36:40.598 INFO:journalctl@ceph.mon.b.smithi044.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T08:36:40.598 INFO:journalctl@ceph.mon.b.smithi044.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:36:40.598 INFO:journalctl@ceph.mon.b.smithi044.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:36:40.598 INFO:journalctl@ceph.mon.b.smithi044.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:36:40.598 INFO:journalctl@ceph.mon.b.smithi044.stdout: 2024-09-19T08:36:40.598 INFO:journalctl@ceph.mon.b.smithi044.stdout: ** Compaction Stats [default] ** 2024-09-19T08:36:40.598 INFO:journalctl@ceph.mon.b.smithi044.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:36:40.599 INFO:journalctl@ceph.mon.b.smithi044.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T08:36:40.599 INFO:journalctl@ceph.mon.b.smithi044.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:36:40.599 INFO:journalctl@ceph.mon.b.smithi044.stdout: 2024-09-19T08:36:40.599 INFO:journalctl@ceph.mon.b.smithi044.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T08:36:40.599 INFO:journalctl@ceph.mon.b.smithi044.stdout: 2024-09-19T08:36:40.599 INFO:journalctl@ceph.mon.b.smithi044.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:36:40.599 INFO:journalctl@ceph.mon.b.smithi044.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T08:36:40.599 INFO:journalctl@ceph.mon.b.smithi044.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T08:36:40.599 INFO:journalctl@ceph.mon.b.smithi044.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T08:36:40.599 INFO:journalctl@ceph.mon.b.smithi044.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T08:36:40.599 INFO:journalctl@ceph.mon.b.smithi044.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T08:36:40.599 INFO:journalctl@ceph.mon.b.smithi044.stdout: Cumulative compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:36:40.599 INFO:journalctl@ceph.mon.b.smithi044.stdout: Interval compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:36:40.599 INFO:journalctl@ceph.mon.b.smithi044.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T08:36:40.600 INFO:journalctl@ceph.mon.b.smithi044.stdout: Block cache BinnedLRUCache@0x56250ad9d1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T08:36:40.600 INFO:journalctl@ceph.mon.b.smithi044.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T08:36:40.600 INFO:journalctl@ceph.mon.b.smithi044.stdout: 2024-09-19T08:36:40.600 INFO:journalctl@ceph.mon.b.smithi044.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T08:36:40.600 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-19T08:36:40.600 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: using public_addr v2:172.21.15.44:0/0 -> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-19T08:36:40.600 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: starting mon.b rank -1 at public addrs [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] at bind addrs [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:36:40.600 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: mon.b@-1(???) e0 preinit fsid ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:36:40.600 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: mon.b@-1(synchronizing).mds e1 new map 2024-09-19T08:36:40.600 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-19T08:36:40.600 INFO:journalctl@ceph.mon.b.smithi044.stdout: e1 2024-09-19T08:36:40.600 INFO:journalctl@ceph.mon.b.smithi044.stdout: btime 2024-09-19T08:35:02:287217+0000 2024-09-19T08:36:40.600 INFO:journalctl@ceph.mon.b.smithi044.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:36:40.601 INFO:journalctl@ceph.mon.b.smithi044.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:36:40.601 INFO:journalctl@ceph.mon.b.smithi044.stdout: legacy client fscid: -1 2024-09-19T08:36:40.601 INFO:journalctl@ceph.mon.b.smithi044.stdout: 2024-09-19T08:36:40.601 INFO:journalctl@ceph.mon.b.smithi044.stdout: No filesystems configured 2024-09-19T08:36:40.601 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T08:36:40.602 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T08:36:40.602 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T08:36:40.602 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T08:36:40.602 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T08:36:40.602 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T08:36:40.602 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T08:36:40.603 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:36:40.603 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:36:40.603 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:36:40.603 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: Added host smithi175 2024-09-19T08:36:40.603 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:40.603 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:40.604 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:40.604 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:40.604 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:36:40.604 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/27954820' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T08:36:40.604 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:40.604 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/27954820' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T08:36:40.605 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:36:40.605 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:40.605 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:40.605 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:40.605 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:40.605 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:36:40.606 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:40.606 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:36:40.606 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-19T08:36:40.606 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:40.606 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:40.606 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:40.606 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:40.607 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:36:40.607 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:40.607 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:40.607 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: Updating smithi175:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:36:40.607 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:36:40.607 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: Updating smithi175:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:36:40.607 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi007:172.21.15.7=a;smithi044:172.21.15.44=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:40.607 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: Saving service mon spec with placement smithi007:172.21.15.7=a;smithi044:172.21.15.44=b;smithi175:172.21.15.175=c;count:3 2024-09-19T08:36:40.608 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: Deploying daemon mon.c on smithi175 2024-09-19T08:36:40.608 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='client.? 172.21.15.175:0/2891131914' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:36:40.608 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:40.608 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:40.608 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='client.? 172.21.15.175:0/1957415784' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:36:40.608 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:40.608 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:36:40.609 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:40.609 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: mon.a calling monitor election 2024-09-19T08:36:40.609 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:40.609 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:40.609 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:40.609 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: mon.c calling monitor election 2024-09-19T08:36:40.610 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:40.610 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:40.610 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:40.610 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:40.610 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:36:40.610 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: monmap epoch 2 2024-09-19T08:36:40.611 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: fsid ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:36:40.611 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: last_changed 2024-09-19T08:36:31.349002+0000 2024-09-19T08:36:40.611 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: created 2024-09-19T08:34:59.415913+0000 2024-09-19T08:36:40.611 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: min_mon_release 19 (squid) 2024-09-19T08:36:40.611 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: election_strategy: 1 2024-09-19T08:36:40.611 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-19T08:36:40.611 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-19T08:36:40.611 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: fsmap 2024-09-19T08:36:40.612 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:36:40.612 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: mgrmap e13: x(active, since 39s) 2024-09-19T08:36:40.612 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: overall HEALTH_OK 2024-09-19T08:36:40.612 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:40.612 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:40.612 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:40.612 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:36:40.612 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:40.612 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: Deploying daemon mon.b on smithi044 2024-09-19T08:36:40.612 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='client.? 172.21.15.175:0/3687477328' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:36:40.612 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:40.612 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:40.613 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 ceph-mon[35072]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T08:36:40.613 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 bash[35053]: 03cb4d59dff28013f947335bb6da51736e8c9d32ed7cb2cda0e4cb064832d362 2024-09-19T08:36:40.613 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:40 smithi044 systemd[1]: Started Ceph mon.b for ebd23124-7661-11ef-bceb-c7b262605968. 2024-09-19T08:36:41.165 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:36:41.166 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:36:41.414 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:36:45.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.401+0000 7ff6edc2e640 1 -- 172.21.15.175:0/3945124650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d0005740 msgr2=0x7ff6d0007bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:45.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.401+0000 7ff6edc2e640 1 --2- 172.21.15.175:0/3945124650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d0005740 0x7ff6d0007bd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff6e81016a0 tx=0x7ff6d802c3f0 comp rx=0 tx=0).stop 2024-09-19T08:36:45.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.401+0000 7ff6edc2e640 1 -- 172.21.15.175:0/3945124650 shutdown_connections 2024-09-19T08:36:45.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.401+0000 7ff6edc2e640 1 --2- 172.21.15.175:0/3945124650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d0005740 0x7ff6d0007bd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:45.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.401+0000 7ff6edc2e640 1 -- 172.21.15.175:0/3945124650 >> 172.21.15.175:0/3945124650 conn(0x7ff6e80fc220 msgr2=0x7ff6e80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:45.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.401+0000 7ff6edc2e640 1 -- 172.21.15.175:0/3945124650 shutdown_connections 2024-09-19T08:36:45.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.401+0000 7ff6edc2e640 1 -- 172.21.15.175:0/3945124650 wait complete. 2024-09-19T08:36:45.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.402+0000 7ff6edc2e640 1 Processor -- start 2024-09-19T08:36:45.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.402+0000 7ff6edc2e640 1 -- start start 2024-09-19T08:36:45.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.402+0000 7ff6edc2e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6d0005740 0x7ff6e8194eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:45.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.402+0000 7ff6edc2e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6e8198e10 0x7ff6e81953f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:45.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.402+0000 7ff6edc2e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6e8195a90 0x7ff6e81a9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:45.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.403+0000 7ff6edc2e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e81075a0 con 0x7ff6e8198e10 2024-09-19T08:36:45.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.403+0000 7ff6edc2e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e8107420 con 0x7ff6e8195a90 2024-09-19T08:36:45.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.403+0000 7ff6edc2e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e8107720 con 0x7ff6d0005740 2024-09-19T08:36:45.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.403+0000 7ff6e77fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6d0005740 0x7ff6e8194eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:45.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.403+0000 7ff6e77fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6d0005740 0x7ff6e8194eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:56988/0 (socket says 172.21.15.175:56988) 2024-09-19T08:36:45.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.403+0000 7ff6e77fe640 1 -- 172.21.15.175:0/639478417 learned_addr learned my addr 172.21.15.175:0/639478417 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-19T08:36:45.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.403+0000 7ff6e7fff640 1 --2- 172.21.15.175:0/639478417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6e8195a90 0x7ff6e81a9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:45.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.403+0000 7ff6e77fe640 1 -- 172.21.15.175:0/639478417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6d0005740 msgr2=0x7ff6e8194eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T08:36:45.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.403+0000 7ff6e77fe640 1 -- 172.21.15.175:0/639478417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6d0005740 msgr2=0x7ff6e8194eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:36:45.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.403+0000 7ff6e77fe640 1 --2- 172.21.15.175:0/639478417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6d0005740 0x7ff6e8194eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:36:45.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.403+0000 7ff6e77fe640 1 --2- 172.21.15.175:0/639478417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6d0005740 0x7ff6e8194eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:36:45.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.403+0000 7ff6e6ffd640 1 --2- 172.21.15.175:0/639478417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6e8198e10 0x7ff6e81953f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:45.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.403+0000 7ff6e7fff640 1 -- 172.21.15.175:0/639478417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6e8195a90 msgr2=0x7ff6e81a9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-19T08:36:45.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.403+0000 7ff6e7fff640 1 -- 172.21.15.175:0/639478417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6e8195a90 msgr2=0x7ff6e81a9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:36:45.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.403+0000 7ff6e7fff640 1 --2- 172.21.15.175:0/639478417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6e8195a90 0x7ff6e81a9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:36:45.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.403+0000 7ff6e7fff640 1 --2- 172.21.15.175:0/639478417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6e8195a90 0x7ff6e81a9a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:36:45.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.403+0000 7ff6e6ffd640 1 -- 172.21.15.175:0/639478417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6d0005740 msgr2=0x7ff6e8194eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:36:45.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.403+0000 7ff6e6ffd640 1 --2- 172.21.15.175:0/639478417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6d0005740 0x7ff6e8194eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:45.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.403+0000 7ff6e6ffd640 1 -- 172.21.15.175:0/639478417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6e8195a90 msgr2=0x7ff6e81a9a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:36:45.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.403+0000 7ff6e6ffd640 1 --2- 172.21.15.175:0/639478417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6e8195a90 0x7ff6e81a9a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:45.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.403+0000 7ff6e6ffd640 1 -- 172.21.15.175:0/639478417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e81aa2c0 con 0x7ff6e8198e10 2024-09-19T08:36:45.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.403+0000 7ff6e6ffd640 1 --2- 172.21.15.175:0/639478417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6e8198e10 0x7ff6e81953f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00b450 tx=0x7ff6dc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:45.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.404+0000 7ff6e4ff9640 1 -- 172.21.15.175:0/639478417 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc004230 con 0x7ff6e8198e10 2024-09-19T08:36:45.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.404+0000 7ff6e4ff9640 1 -- 172.21.15.175:0/639478417 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6dc0043d0 con 0x7ff6e8198e10 2024-09-19T08:36:45.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.404+0000 7ff6edc2e640 1 -- 172.21.15.175:0/639478417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e81aa5b0 con 0x7ff6e8198e10 2024-09-19T08:36:45.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.404+0000 7ff6e4ff9640 1 -- 172.21.15.175:0/639478417 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc003cb0 con 0x7ff6e8198e10 2024-09-19T08:36:45.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.404+0000 7ff6edc2e640 1 -- 172.21.15.175:0/639478417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e81aab20 con 0x7ff6e8198e10 2024-09-19T08:36:45.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.405+0000 7ff6e4ff9640 1 -- 172.21.15.175:0/639478417 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7ff6dc00f050 con 0x7ff6e8198e10 2024-09-19T08:36:45.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.405+0000 7ff6e4ff9640 1 --2- 172.21.15.175:0/639478417 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff6d4039730 0x7ff6d403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:45.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.405+0000 7ff6e4ff9640 1 -- 172.21.15.175:0/639478417 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff6dc04c180 con 0x7ff6e8198e10 2024-09-19T08:36:45.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.405+0000 7ff6e77fe640 1 --2- 172.21.15.175:0/639478417 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff6d4039730 0x7ff6d403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:45.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.405+0000 7ff6edc2e640 1 -- 172.21.15.175:0/639478417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6e8101ca0 con 0x7ff6e8198e10 2024-09-19T08:36:45.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.406+0000 7ff6e77fe640 1 --2- 172.21.15.175:0/639478417 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff6d4039730 0x7ff6d403bbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8000c00 tx=0x7ff6d80149c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:45.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.410+0000 7ff6e4ff9640 1 -- 172.21.15.175:0/639478417 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff6dc00d040 con 0x7ff6e8198e10 2024-09-19T08:36:45.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: mon.c calling monitor election 2024-09-19T08:36:45.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:36:45.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: mon.a calling monitor election 2024-09-19T08:36:45.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:45.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:45.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:45.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:45.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:45.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:45.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:45.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:45.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:45.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:36:45.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: monmap epoch 3 2024-09-19T08:36:45.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: fsid ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:36:45.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: last_changed 2024-09-19T08:36:40.162825+0000 2024-09-19T08:36:45.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: created 2024-09-19T08:34:59.415913+0000 2024-09-19T08:36:45.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: min_mon_release 19 (squid) 2024-09-19T08:36:45.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: election_strategy: 1 2024-09-19T08:36:45.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-19T08:36:45.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-19T08:36:45.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-19T08:36:45.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: fsmap 2024-09-19T08:36:45.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:36:45.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: mgrmap e13: x(active, since 48s) 2024-09-19T08:36:45.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: overall HEALTH_OK 2024-09-19T08:36:45.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:45.536 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:45.536 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:45.536 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:45 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:45.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.673+0000 7ff6edc2e640 1 -- 172.21.15.175:0/639478417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff6e8196410 con 0x7ff6e8198e10 2024-09-19T08:36:45.674 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: mon.c calling monitor election 2024-09-19T08:36:45.674 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:36:45.674 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: mon.a calling monitor election 2024-09-19T08:36:45.674 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:45.674 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:45.674 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:45.674 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:45.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:45.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:45.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:45.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:45.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:45.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:36:45.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: monmap epoch 3 2024-09-19T08:36:45.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: fsid ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:36:45.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: last_changed 2024-09-19T08:36:40.162825+0000 2024-09-19T08:36:45.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: created 2024-09-19T08:34:59.415913+0000 2024-09-19T08:36:45.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: min_mon_release 19 (squid) 2024-09-19T08:36:45.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: election_strategy: 1 2024-09-19T08:36:45.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-19T08:36:45.676 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-19T08:36:45.676 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-19T08:36:45.676 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: fsmap 2024-09-19T08:36:45.676 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:36:45.676 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: mgrmap e13: x(active, since 48s) 2024-09-19T08:36:45.676 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: overall HEALTH_OK 2024-09-19T08:36:45.676 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:45.676 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:45.676 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:45.676 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:45 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:45.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.674+0000 7ff6e4ff9640 1 -- 172.21.15.175:0/639478417 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1275 (secure 0 0 0) 0x7ff6dc00d540 con 0x7ff6e8198e10 2024-09-19T08:36:45.677 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:36:45.677 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":3,"fsid":"ebd23124-7661-11ef-bceb-c7b262605968","modified":"2024-09-19T08:36:40.162825Z","created":"2024-09-19T08:34:59.415913Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T08:36:45.678 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 3 2024-09-19T08:36:45.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.677+0000 7ff6edc2e640 1 -- 172.21.15.175:0/639478417 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff6d4039730 msgr2=0x7ff6d403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:45.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.677+0000 7ff6edc2e640 1 --2- 172.21.15.175:0/639478417 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff6d4039730 0x7ff6d403bbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8000c00 tx=0x7ff6d80149c0 comp rx=0 tx=0).stop 2024-09-19T08:36:45.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.677+0000 7ff6edc2e640 1 -- 172.21.15.175:0/639478417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6e8198e10 msgr2=0x7ff6e81953f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:45.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.677+0000 7ff6edc2e640 1 --2- 172.21.15.175:0/639478417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6e8198e10 0x7ff6e81953f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00b450 tx=0x7ff6dc00b910 comp rx=0 tx=0).stop 2024-09-19T08:36:45.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.677+0000 7ff6edc2e640 1 -- 172.21.15.175:0/639478417 shutdown_connections 2024-09-19T08:36:45.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.677+0000 7ff6edc2e640 1 --2- 172.21.15.175:0/639478417 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff6d4039730 0x7ff6d403bbf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:45.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.677+0000 7ff6edc2e640 1 --2- 172.21.15.175:0/639478417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6e8195a90 0x7ff6e81a9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:45.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.677+0000 7ff6edc2e640 1 --2- 172.21.15.175:0/639478417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6e8198e10 0x7ff6e81953f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:45.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.677+0000 7ff6edc2e640 1 --2- 172.21.15.175:0/639478417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6d0005740 0x7ff6e8194eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:45.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.677+0000 7ff6edc2e640 1 -- 172.21.15.175:0/639478417 >> 172.21.15.175:0/639478417 conn(0x7ff6e80fc220 msgr2=0x7ff6e80fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:45.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.678+0000 7ff6edc2e640 1 -- 172.21.15.175:0/639478417 shutdown_connections 2024-09-19T08:36:45.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:45.678+0000 7ff6edc2e640 1 -- 172.21.15.175:0/639478417 wait complete. 2024-09-19T08:36:46.257 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:46 smithi175 ceph-mon[35688]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:46.257 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:46 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:36:46.257 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:46 smithi175 ceph-mon[35688]: from='client.? 172.21.15.175:0/639478417' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:36:46.257 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:46 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:46.285 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T08:36:46.285 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T08:36:46.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:46 smithi007 ceph-mon[31221]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:46.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:46 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:36:46.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:46 smithi007 ceph-mon[31221]: from='client.? 172.21.15.175:0/639478417' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:36:46.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:46 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:46.544 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:36:46.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.984+0000 7f350ba93640 1 -- 172.21.15.7:0/3380970283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3504074590 msgr2=0x7f3504074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:46.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.984+0000 7f350ba93640 1 --2- 172.21.15.7:0/3380970283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3504074590 0x7f3504074970 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3500009880 tx=0x7f350002a670 comp rx=0 tx=0).stop 2024-09-19T08:36:46.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.984+0000 7f350ba93640 1 -- 172.21.15.7:0/3380970283 shutdown_connections 2024-09-19T08:36:46.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.984+0000 7f350ba93640 1 --2- 172.21.15.7:0/3380970283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3504074590 0x7f3504074970 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:46.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.984+0000 7f350ba93640 1 -- 172.21.15.7:0/3380970283 >> 172.21.15.7:0/3380970283 conn(0x7f35040fd260 msgr2=0x7f35040ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:46.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.984+0000 7f350ba93640 1 -- 172.21.15.7:0/3380970283 shutdown_connections 2024-09-19T08:36:46.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.984+0000 7f350ba93640 1 -- 172.21.15.7:0/3380970283 wait complete. 2024-09-19T08:36:46.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.985+0000 7f350ba93640 1 Processor -- start 2024-09-19T08:36:46.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.985+0000 7f350ba93640 1 -- start start 2024-09-19T08:36:46.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.985+0000 7f350ba93640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3504074590 0x7f35041a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:46.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.985+0000 7f350ba93640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35041a3be0 0x7f350419d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:46.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.985+0000 7f350ba93640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f350419dda0 0x7f350419e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:46.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.985+0000 7f350ba93640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f35041122a0 con 0x7f350419dda0 2024-09-19T08:36:46.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.985+0000 7f350ba93640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3504112120 con 0x7f3504074590 2024-09-19T08:36:46.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.985+0000 7f350ba93640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3504112420 con 0x7f35041a3be0 2024-09-19T08:36:46.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.985+0000 7f350a030640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f350419dda0 0x7f350419e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:46.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.985+0000 7f350a030640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f350419dda0 0x7f350419e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56346/0 (socket says 172.21.15.7:56346) 2024-09-19T08:36:46.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.985+0000 7f350a030640 1 -- 172.21.15.7:0/1516959109 learned_addr learned my addr 172.21.15.7:0/1516959109 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:36:46.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.985+0000 7f350902e640 1 --2- 172.21.15.7:0/1516959109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35041a3be0 0x7f350419d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:46.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.986+0000 7f350982f640 1 --2- 172.21.15.7:0/1516959109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3504074590 0x7f35041a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:46.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.986+0000 7f350a030640 1 -- 172.21.15.7:0/1516959109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35041a3be0 msgr2=0x7f350419d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:46.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.986+0000 7f350a030640 1 --2- 172.21.15.7:0/1516959109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35041a3be0 0x7f350419d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:46.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.986+0000 7f350a030640 1 -- 172.21.15.7:0/1516959109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3504074590 msgr2=0x7f35041a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:46.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.986+0000 7f350a030640 1 --2- 172.21.15.7:0/1516959109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3504074590 0x7f35041a36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:46.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.986+0000 7f350a030640 1 -- 172.21.15.7:0/1516959109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35041aa570 con 0x7f350419dda0 2024-09-19T08:36:46.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.986+0000 7f350a030640 1 --2- 172.21.15.7:0/1516959109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f350419dda0 0x7f350419e220 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00ba50 tx=0x7f34fc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:46.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.986+0000 7f34faffd640 1 -- 172.21.15.7:0/1516959109 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc019070 con 0x7f350419dda0 2024-09-19T08:36:46.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.986+0000 7f34faffd640 1 -- 172.21.15.7:0/1516959109 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34fc00cbe0 con 0x7f350419dda0 2024-09-19T08:36:46.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.986+0000 7f350ba93640 1 -- 172.21.15.7:0/1516959109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35041aa7a0 con 0x7f350419dda0 2024-09-19T08:36:46.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.986+0000 7f34faffd640 1 -- 172.21.15.7:0/1516959109 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc0076a0 con 0x7f350419dda0 2024-09-19T08:36:46.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.986+0000 7f350ba93640 1 -- 172.21.15.7:0/1516959109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35041aace0 con 0x7f350419dda0 2024-09-19T08:36:46.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.988+0000 7f34faffd640 1 -- 172.21.15.7:0/1516959109 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f34fc01c070 con 0x7f350419dda0 2024-09-19T08:36:46.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.988+0000 7f350ba93640 1 -- 172.21.15.7:0/1516959109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34e8005290 con 0x7f350419dda0 2024-09-19T08:36:46.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.988+0000 7f34faffd640 1 --2- 172.21.15.7:0/1516959109 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f34f0039730 0x7f34f003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:46.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.988+0000 7f34faffd640 1 -- 172.21.15.7:0/1516959109 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f34fc04cdb0 con 0x7f350419dda0 2024-09-19T08:36:46.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.988+0000 7f350982f640 1 --2- 172.21.15.7:0/1516959109 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f34f0039730 0x7f34f003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:46.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.989+0000 7f350982f640 1 --2- 172.21.15.7:0/1516959109 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f34f0039730 0x7f34f003bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3500000c00 tx=0x7f350002ab70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:46.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:46.993+0000 7f34faffd640 1 -- 172.21.15.7:0/1516959109 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f34fc0112a0 con 0x7f350419dda0 2024-09-19T08:36:47.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:47.209+0000 7f350ba93640 1 -- 172.21.15.7:0/1516959109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f34e8005580 con 0x7f350419dda0 2024-09-19T08:36:47.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:47.210+0000 7f34faffd640 1 -- 172.21.15.7:0/1516959109 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+271 (secure 0 0 0) 0x7f34fc00e0a0 con 0x7f350419dda0 2024-09-19T08:36:47.210 INFO:teuthology.orchestra.run.smithi007.stdout:# minimal ceph.conf for ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:36:47.210 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2024-09-19T08:36:47.210 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:36:47.210 INFO:teuthology.orchestra.run.smithi007.stdout: mon_host = [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] 2024-09-19T08:36:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:47.212+0000 7f350ba93640 1 -- 172.21.15.7:0/1516959109 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f34f0039730 msgr2=0x7f34f003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:47.212+0000 7f350ba93640 1 --2- 172.21.15.7:0/1516959109 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f34f0039730 0x7f34f003bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3500000c00 tx=0x7f350002ab70 comp rx=0 tx=0).stop 2024-09-19T08:36:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:47.212+0000 7f350ba93640 1 -- 172.21.15.7:0/1516959109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f350419dda0 msgr2=0x7f350419e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:47.212+0000 7f350ba93640 1 --2- 172.21.15.7:0/1516959109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f350419dda0 0x7f350419e220 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00ba50 tx=0x7f34fc00bf10 comp rx=0 tx=0).stop 2024-09-19T08:36:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:47.212+0000 7f350ba93640 1 -- 172.21.15.7:0/1516959109 shutdown_connections 2024-09-19T08:36:47.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:47.212+0000 7f350ba93640 1 --2- 172.21.15.7:0/1516959109 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f34f0039730 0x7f34f003bbf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:47.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:47.212+0000 7f350ba93640 1 --2- 172.21.15.7:0/1516959109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f350419dda0 0x7f350419e220 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:47.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:47.212+0000 7f350ba93640 1 --2- 172.21.15.7:0/1516959109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35041a3be0 0x7f350419d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:47.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:47.212+0000 7f350ba93640 1 --2- 172.21.15.7:0/1516959109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3504074590 0x7f35041a36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:47.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:47.212+0000 7f350ba93640 1 -- 172.21.15.7:0/1516959109 >> 172.21.15.7:0/1516959109 conn(0x7f35040fd260 msgr2=0x7f35040fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:47.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:47.212+0000 7f350ba93640 1 -- 172.21.15.7:0/1516959109 shutdown_connections 2024-09-19T08:36:47.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:47.212+0000 7f350ba93640 1 -- 172.21.15.7:0/1516959109 wait complete. 2024-09-19T08:36:47.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: mon.c calling monitor election 2024-09-19T08:36:47.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:36:47.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: mon.a calling monitor election 2024-09-19T08:36:47.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:47.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:36:47.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:47.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:47.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:47.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:47.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:47.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:47.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:47.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:36:47.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: monmap epoch 3 2024-09-19T08:36:47.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: fsid ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:36:47.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: last_changed 2024-09-19T08:36:40.162825+0000 2024-09-19T08:36:47.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: created 2024-09-19T08:34:59.415913+0000 2024-09-19T08:36:47.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: min_mon_release 19 (squid) 2024-09-19T08:36:47.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: election_strategy: 1 2024-09-19T08:36:47.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-19T08:36:47.553 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-19T08:36:47.553 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-19T08:36:47.553 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: fsmap 2024-09-19T08:36:47.553 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:36:47.553 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: mgrmap e13: x(active, since 48s) 2024-09-19T08:36:47.553 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: overall HEALTH_OK 2024-09-19T08:36:47.553 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:47.553 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:47.553 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:47.553 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:47.553 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:47.553 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:36:47.553 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: from='client.? 172.21.15.175:0/639478417' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:36:47.554 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:47 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:47.921 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T08:36:47.921 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T08:36:47.921 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:36:47.950 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T08:36:47.950 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:36:48.019 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-19T08:36:48.019 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:36:48.046 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-19T08:36:48.046 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:36:48.110 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-19T08:36:48.110 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:36:48.139 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-19T08:36:48.139 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:36:48.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: mon.b calling monitor election 2024-09-19T08:36:48.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:48.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-19T08:36:48.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: Updating smithi044:/etc/ceph/ceph.conf 2024-09-19T08:36:48.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-19T08:36:48.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: mon.b calling monitor election 2024-09-19T08:36:48.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: mon.c calling monitor election 2024-09-19T08:36:48.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: mon.a calling monitor election 2024-09-19T08:36:48.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T08:36:48.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: monmap epoch 3 2024-09-19T08:36:48.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: fsid ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:36:48.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: last_changed 2024-09-19T08:36:40.162825+0000 2024-09-19T08:36:48.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: created 2024-09-19T08:34:59.415913+0000 2024-09-19T08:36:48.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: min_mon_release 19 (squid) 2024-09-19T08:36:48.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: election_strategy: 1 2024-09-19T08:36:48.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-19T08:36:48.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-19T08:36:48.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-19T08:36:48.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: fsmap 2024-09-19T08:36:48.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:36:48.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: mgrmap e13: x(active, since 50s) 2024-09-19T08:36:48.199 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: overall HEALTH_OK 2024-09-19T08:36:48.199 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1516959109' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:48.199 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: Updating smithi175:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:36:48.199 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: Updating smithi044:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:36:48.199 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: Updating smithi007:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:36:48.199 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.199 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.199 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.199 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.199 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.199 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.199 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.199 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.199 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.200 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.200 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.200 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T08:36:48.200 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:36:48.200 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:36:48.200 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:48.200 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:48 smithi007 ceph-mon[31221]: Reconfiguring daemon mon.a on smithi007 2024-09-19T08:36:48.204 INFO:tasks.cephadm:Adding mgr.x on smithi007 2024-09-19T08:36:48.205 INFO:tasks.cephadm:Adding mgr.y on smithi044 2024-09-19T08:36:48.205 INFO:tasks.cephadm:Adding mgr.z on smithi175 2024-09-19T08:36:48.205 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi007=x;smithi044=y;smithi175=z' 2024-09-19T08:36:48.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: mon.b calling monitor election 2024-09-19T08:36:48.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:48.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-19T08:36:48.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: Updating smithi044:/etc/ceph/ceph.conf 2024-09-19T08:36:48.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-19T08:36:48.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: mon.b calling monitor election 2024-09-19T08:36:48.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: mon.c calling monitor election 2024-09-19T08:36:48.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: mon.a calling monitor election 2024-09-19T08:36:48.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T08:36:48.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: monmap epoch 3 2024-09-19T08:36:48.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: fsid ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:36:48.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: last_changed 2024-09-19T08:36:40.162825+0000 2024-09-19T08:36:48.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: created 2024-09-19T08:34:59.415913+0000 2024-09-19T08:36:48.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: min_mon_release 19 (squid) 2024-09-19T08:36:48.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: election_strategy: 1 2024-09-19T08:36:48.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-19T08:36:48.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-19T08:36:48.303 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-19T08:36:48.303 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: fsmap 2024-09-19T08:36:48.303 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:36:48.303 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: mgrmap e13: x(active, since 50s) 2024-09-19T08:36:48.303 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: overall HEALTH_OK 2024-09-19T08:36:48.303 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1516959109' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:48.303 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: Updating smithi175:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:36:48.303 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: Updating smithi044:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:36:48.303 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: Updating smithi007:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:36:48.303 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.304 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.304 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.304 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.304 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.304 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.304 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.304 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.304 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.304 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.304 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.304 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T08:36:48.304 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:36:48.304 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:36:48.305 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:48.305 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:48 smithi044 ceph-mon[35072]: Reconfiguring daemon mon.a on smithi007 2024-09-19T08:36:48.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: mon.b calling monitor election 2024-09-19T08:36:48.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:48.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-19T08:36:48.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: Updating smithi044:/etc/ceph/ceph.conf 2024-09-19T08:36:48.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-19T08:36:48.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: mon.b calling monitor election 2024-09-19T08:36:48.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: mon.c calling monitor election 2024-09-19T08:36:48.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: mon.a calling monitor election 2024-09-19T08:36:48.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T08:36:48.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: monmap epoch 3 2024-09-19T08:36:48.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: fsid ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:36:48.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: last_changed 2024-09-19T08:36:40.162825+0000 2024-09-19T08:36:48.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: created 2024-09-19T08:34:59.415913+0000 2024-09-19T08:36:48.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: min_mon_release 19 (squid) 2024-09-19T08:36:48.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: election_strategy: 1 2024-09-19T08:36:48.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-19T08:36:48.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-09-19T08:36:48.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-19T08:36:48.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: fsmap 2024-09-19T08:36:48.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:36:48.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: mgrmap e13: x(active, since 50s) 2024-09-19T08:36:48.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: overall HEALTH_OK 2024-09-19T08:36:48.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1516959109' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:48.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: Updating smithi175:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:36:48.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: Updating smithi044:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:36:48.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: Updating smithi007:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:36:48.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:48.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T08:36:48.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:36:48.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:36:48.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:48.432 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:48 smithi175 ceph-mon[35688]: Reconfiguring daemon mon.a on smithi007 2024-09-19T08:36:48.481 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:36:48.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.887+0000 7f2a7a7ae640 1 -- 172.21.15.175:0/2157554190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a741005f0 msgr2=0x7f2a741009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:48.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.887+0000 7f2a7a7ae640 1 --2- 172.21.15.175:0/2157554190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a741005f0 0x7f2a741009f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2a64009880 tx=0x7f2a6402a5d0 comp rx=0 tx=0).stop 2024-09-19T08:36:48.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.887+0000 7f2a7a7ae640 1 -- 172.21.15.175:0/2157554190 shutdown_connections 2024-09-19T08:36:48.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.887+0000 7f2a7a7ae640 1 --2- 172.21.15.175:0/2157554190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a741005f0 0x7f2a741009f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:48.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.887+0000 7f2a7a7ae640 1 -- 172.21.15.175:0/2157554190 >> 172.21.15.175:0/2157554190 conn(0x7f2a740fbda0 msgr2=0x7f2a740fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:48.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.888+0000 7f2a7a7ae640 1 -- 172.21.15.175:0/2157554190 shutdown_connections 2024-09-19T08:36:48.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.888+0000 7f2a7a7ae640 1 -- 172.21.15.175:0/2157554190 wait complete. 2024-09-19T08:36:48.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.888+0000 7f2a7a7ae640 1 Processor -- start 2024-09-19T08:36:48.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.888+0000 7f2a7a7ae640 1 -- start start 2024-09-19T08:36:48.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.888+0000 7f2a7a7ae640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a741005f0 0x7f2a74199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:48.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.889+0000 7f2a7a7ae640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a74199750 0x7f2a7419e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:48.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.889+0000 7f2a7a7ae640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a74199bd0 0x7f2a741a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:48.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.889+0000 7f2a7a7ae640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2a741066e0 con 0x7f2a74199bd0 2024-09-19T08:36:48.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.889+0000 7f2a7a7ae640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2a74106560 con 0x7f2a741005f0 2024-09-19T08:36:48.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.889+0000 7f2a7a7ae640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2a74106860 con 0x7f2a74199750 2024-09-19T08:36:48.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.889+0000 7f2a737fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a74199750 0x7f2a7419e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:48.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.889+0000 7f2a737fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a74199750 0x7f2a7419e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54776/0 (socket says 172.21.15.175:54776) 2024-09-19T08:36:48.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.889+0000 7f2a737fe640 1 -- 172.21.15.175:0/713266768 learned_addr learned my addr 172.21.15.175:0/713266768 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-19T08:36:48.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.889+0000 7f2a78d4b640 1 --2- 172.21.15.175:0/713266768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a74199bd0 0x7f2a741a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:48.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.889+0000 7f2a73fff640 1 --2- 172.21.15.175:0/713266768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a741005f0 0x7f2a74199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:48.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.889+0000 7f2a737fe640 1 -- 172.21.15.175:0/713266768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a741005f0 msgr2=0x7f2a74199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:48.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.889+0000 7f2a737fe640 1 --2- 172.21.15.175:0/713266768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a741005f0 0x7f2a74199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:48.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.889+0000 7f2a737fe640 1 -- 172.21.15.175:0/713266768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a74199bd0 msgr2=0x7f2a741a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:48.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.889+0000 7f2a737fe640 1 --2- 172.21.15.175:0/713266768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a74199bd0 0x7f2a741a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:48.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.889+0000 7f2a737fe640 1 -- 172.21.15.175:0/713266768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a741a1610 con 0x7f2a74199750 2024-09-19T08:36:48.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.889+0000 7f2a737fe640 1 --2- 172.21.15.175:0/713266768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a74199750 0x7f2a7419e7c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00b520 tx=0x7f2a5c00b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:48.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.889+0000 7f2a717fa640 1 -- 172.21.15.175:0/713266768 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c004230 con 0x7f2a74199750 2024-09-19T08:36:48.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.889+0000 7f2a717fa640 1 -- 172.21.15.175:0/713266768 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a5c0043d0 con 0x7f2a74199750 2024-09-19T08:36:48.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.889+0000 7f2a7a7ae640 1 -- 172.21.15.175:0/713266768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a741a1900 con 0x7f2a74199750 2024-09-19T08:36:48.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.889+0000 7f2a717fa640 1 -- 172.21.15.175:0/713266768 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c003d60 con 0x7f2a74199750 2024-09-19T08:36:48.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.889+0000 7f2a7a7ae640 1 -- 172.21.15.175:0/713266768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a741a1ec0 con 0x7f2a74199750 2024-09-19T08:36:48.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.890+0000 7f2a717fa640 1 -- 172.21.15.175:0/713266768 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f2a5c00e070 con 0x7f2a74199750 2024-09-19T08:36:48.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.891+0000 7f2a717fa640 1 --2- 172.21.15.175:0/713266768 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f2a60039730 0x7f2a6003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:48.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.891+0000 7f2a7a7ae640 1 -- 172.21.15.175:0/713266768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a74192fc0 con 0x7f2a74199750 2024-09-19T08:36:48.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.891+0000 7f2a717fa640 1 -- 172.21.15.175:0/713266768 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2a5c04c0a0 con 0x7f2a74199750 2024-09-19T08:36:48.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.891+0000 7f2a73fff640 1 --2- 172.21.15.175:0/713266768 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f2a60039730 0x7f2a6003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:48.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.891+0000 7f2a73fff640 1 --2- 172.21.15.175:0/713266768 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f2a60039730 0x7f2a6003bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2a64000c00 tx=0x7f2a64031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:48.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:48.896+0000 7f2a717fa640 1 -- 172.21.15.175:0/713266768 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2a5c014020 con 0x7f2a74199750 2024-09-19T08:36:49.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:49.072+0000 7f2a7a7ae640 1 -- 172.21.15.175:0/713266768 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi007=x;smithi044=y;smithi175=z", "target": ["mon-mgr", ""]}) -- 0x7f2a740626c0 con 0x7f2a60039730 2024-09-19T08:36:49.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:49.078+0000 7f2a717fa640 1 -- 172.21.15.175:0/713266768 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2a740626c0 con 0x7f2a60039730 2024-09-19T08:36:49.078 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mgr update... 2024-09-19T08:36:49.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:49.080+0000 7f2a7a7ae640 1 -- 172.21.15.175:0/713266768 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f2a60039730 msgr2=0x7f2a6003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:49.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:49.080+0000 7f2a7a7ae640 1 --2- 172.21.15.175:0/713266768 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f2a60039730 0x7f2a6003bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2a64000c00 tx=0x7f2a64031400 comp rx=0 tx=0).stop 2024-09-19T08:36:49.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:49.080+0000 7f2a7a7ae640 1 -- 172.21.15.175:0/713266768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a74199750 msgr2=0x7f2a7419e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:49.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:49.080+0000 7f2a7a7ae640 1 --2- 172.21.15.175:0/713266768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a74199750 0x7f2a7419e7c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00b520 tx=0x7f2a5c00b9e0 comp rx=0 tx=0).stop 2024-09-19T08:36:49.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:49.080+0000 7f2a7a7ae640 1 -- 172.21.15.175:0/713266768 shutdown_connections 2024-09-19T08:36:49.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:49.080+0000 7f2a7a7ae640 1 --2- 172.21.15.175:0/713266768 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f2a60039730 0x7f2a6003bbf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:49.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:49.080+0000 7f2a7a7ae640 1 --2- 172.21.15.175:0/713266768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a74199bd0 0x7f2a741a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:49.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:49.080+0000 7f2a7a7ae640 1 --2- 172.21.15.175:0/713266768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a74199750 0x7f2a7419e7c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:49.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:49.080+0000 7f2a7a7ae640 1 --2- 172.21.15.175:0/713266768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a741005f0 0x7f2a74199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:49.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:49.080+0000 7f2a7a7ae640 1 -- 172.21.15.175:0/713266768 >> 172.21.15.175:0/713266768 conn(0x7f2a740fbda0 msgr2=0x7f2a74190190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:49.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:49.080+0000 7f2a7a7ae640 1 -- 172.21.15.175:0/713266768 shutdown_connections 2024-09-19T08:36:49.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:36:49.080+0000 7f2a7a7ae640 1 -- 172.21.15.175:0/713266768 wait complete. 2024-09-19T08:36:49.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:49 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:49.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:49 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:49.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:49 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:36:49.673 DEBUG:teuthology.orchestra.run.smithi044:mgr.y> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T08:36:49.677 DEBUG:teuthology.orchestra.run.smithi175:mgr.z> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T08:36:49.679 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T08:36:49.679 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T08:36:49.679 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:36:49.695 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:36:49.696 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_1 2024-09-19T08:36:49.751 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:36:49.752 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:36:49.752 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-19T08:36:49.752 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:36:49.752 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:36:49.752 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-19 08:36:07.508112900 +0000 2024-09-19T08:36:49.752 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-19 08:31:10.970017575 +0000 2024-09-19T08:36:49.752 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-19 08:31:10.970017575 +0000 2024-09-19T08:36:49.752 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-19 08:31:10.970017575 +0000 2024-09-19T08:36:49.752 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:36:49.817 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-19T08:36:49.817 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-19T08:36:49.817 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000103033 s, 5.0 MB/s 2024-09-19T08:36:49.818 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:36:49.875 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_2 2024-09-19T08:36:49.931 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:36:49.932 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:36:49.932 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T08:36:49.932 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:36:49.932 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:36:49.932 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-19 08:36:07.545112346 +0000 2024-09-19T08:36:49.932 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-19 08:31:11.324012301 +0000 2024-09-19T08:36:49.932 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-19 08:31:11.324012301 +0000 2024-09-19T08:36:49.932 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-19 08:31:11.324012301 +0000 2024-09-19T08:36:49.932 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:36:49.995 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-19T08:36:49.995 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-19T08:36:49.996 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 9.4479e-05 s, 5.4 MB/s 2024-09-19T08:36:49.997 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:36:50.053 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_3 2024-09-19T08:36:50.109 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:36:50.110 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:36:50.110 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T08:36:50.110 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:36:50.110 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:36:50.110 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-19 08:36:07.583111778 +0000 2024-09-19T08:36:50.110 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-19 08:31:11.641007578 +0000 2024-09-19T08:36:50.110 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-19 08:31:11.641007578 +0000 2024-09-19T08:36:50.110 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-19 08:31:11.641007578 +0000 2024-09-19T08:36:50.110 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:36:50.174 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-19T08:36:50.174 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-19T08:36:50.174 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000130458 s, 3.9 MB/s 2024-09-19T08:36:50.176 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:36:50.233 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_4 2024-09-19T08:36:50.289 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:36:50.289 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:36:50.289 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-19T08:36:50.289 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:36:50.289 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:36:50.289 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-19 08:36:07.617111269 +0000 2024-09-19T08:36:50.290 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-19 08:31:11.956002885 +0000 2024-09-19T08:36:50.290 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-19 08:31:11.956002885 +0000 2024-09-19T08:36:50.290 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-19 08:31:11.956002885 +0000 2024-09-19T08:36:50.290 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:36:50.352 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:50 smithi007 ceph-mon[31221]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:50.352 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:50 smithi007 ceph-mon[31221]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi007=x;smithi044=y;smithi175=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:50.352 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:50 smithi007 ceph-mon[31221]: Saving service mgr spec with placement smithi007=x;smithi044=y;smithi175=z;count:3 2024-09-19T08:36:50.352 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:50 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:50.353 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:50 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:50.353 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:50 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:50.353 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:50 smithi007 ceph-mon[31221]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T08:36:50.353 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:50 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:36:50.353 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:50 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:36:50.354 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:50 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:50.354 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:50 smithi007 ceph-mon[31221]: Reconfiguring daemon mgr.x on smithi007 2024-09-19T08:36:50.356 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-19T08:36:50.356 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-19T08:36:50.356 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000101975 s, 5.0 MB/s 2024-09-19T08:36:50.357 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:36:50.417 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-19T08:36:50.417 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:36:50.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:50 smithi175 ceph-mon[35688]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:50.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:50 smithi175 ceph-mon[35688]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi007=x;smithi044=y;smithi175=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:50.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:50 smithi175 ceph-mon[35688]: Saving service mgr spec with placement smithi007=x;smithi044=y;smithi175=z;count:3 2024-09-19T08:36:50.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:50 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:50.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:50 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:50.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:50 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:50.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:50 smithi175 ceph-mon[35688]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T08:36:50.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:50 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:36:50.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:50 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:36:50.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:50 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:50.431 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:50 smithi175 ceph-mon[35688]: Reconfiguring daemon mgr.x on smithi007 2024-09-19T08:36:50.438 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:36:50.439 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_1 2024-09-19T08:36:50.503 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:36:50.503 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:36:50.503 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-19T08:36:50.503 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:36:50.503 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:36:50.503 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-19 08:36:39.569899125 +0000 2024-09-19T08:36:50.503 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-19 08:31:22.642406811 +0000 2024-09-19T08:36:50.504 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-19 08:31:22.642406811 +0000 2024-09-19T08:36:50.504 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-19 08:31:22.642406811 +0000 2024-09-19T08:36:50.504 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:36:50.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:50 smithi044 ceph-mon[35072]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:50.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:50 smithi044 ceph-mon[35072]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi007=x;smithi044=y;smithi175=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:50.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:50 smithi044 ceph-mon[35072]: Saving service mgr spec with placement smithi007=x;smithi044=y;smithi175=z;count:3 2024-09-19T08:36:50.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:50 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:50.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:50 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:50.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:50 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:50.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:50 smithi044 ceph-mon[35072]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T08:36:50.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:50 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:36:50.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:50 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:36:50.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:50 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:50.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:50 smithi044 ceph-mon[35072]: Reconfiguring daemon mgr.x on smithi007 2024-09-19T08:36:50.571 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-19T08:36:50.572 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-19T08:36:50.572 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000269625 s, 1.9 MB/s 2024-09-19T08:36:50.573 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:36:50.629 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_2 2024-09-19T08:36:50.689 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:36:50.689 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:36:50.689 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T08:36:50.689 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:36:50.689 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:36:50.690 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-19 08:36:39.569899125 +0000 2024-09-19T08:36:50.690 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-19 08:31:22.967401853 +0000 2024-09-19T08:36:50.690 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-19 08:31:22.967401853 +0000 2024-09-19T08:36:50.690 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-19 08:31:22.967401853 +0000 2024-09-19T08:36:50.690 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:36:50.753 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-19T08:36:50.753 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-19T08:36:50.753 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000251653 s, 2.0 MB/s 2024-09-19T08:36:50.754 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:36:50.812 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_3 2024-09-19T08:36:50.869 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:36:50.869 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:36:50.870 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-19T08:36:50.870 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:36:50.870 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:36:50.870 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-19 08:36:39.570899109 +0000 2024-09-19T08:36:50.870 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-19 08:31:23.296396833 +0000 2024-09-19T08:36:50.871 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-19 08:31:23.296396833 +0000 2024-09-19T08:36:50.871 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-19 08:31:23.296396833 +0000 2024-09-19T08:36:50.871 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:36:50.933 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-19T08:36:50.933 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-19T08:36:50.933 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000207687 s, 2.5 MB/s 2024-09-19T08:36:50.934 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:36:50.991 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_4 2024-09-19T08:36:51.046 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:36:51.046 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:36:51.046 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T08:36:51.047 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:36:51.047 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:36:51.047 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-19 08:36:39.570899109 +0000 2024-09-19T08:36:51.047 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-19 08:31:23.628391768 +0000 2024-09-19T08:36:51.047 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-19 08:31:23.628391768 +0000 2024-09-19T08:36:51.047 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-19 08:31:23.628391768 +0000 2024-09-19T08:36:51.047 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:36:51.112 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-19T08:36:51.112 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-19T08:36:51.112 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.00019507 s, 2.6 MB/s 2024-09-19T08:36:51.114 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:36:51.170 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-09-19T08:36:51.170 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:36:51.190 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:36:51.190 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2024-09-19T08:36:51.249 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:36:51.249 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:36:51.249 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T08:36:51.250 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:36:51.250 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:36:51.250 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-19 08:36:30.078611651 +0000 2024-09-19T08:36:51.250 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-19 08:31:26.697666225 +0000 2024-09-19T08:36:51.250 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-19 08:31:26.697666225 +0000 2024-09-19T08:36:51.250 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-19 08:31:26.697666225 +0000 2024-09-19T08:36:51.250 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:36:51.317 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-19T08:36:51.317 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-19T08:36:51.317 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000356707 s, 1.4 MB/s 2024-09-19T08:36:51.319 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:36:51.377 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2024-09-19T08:36:51.436 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:36:51.436 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:36:51.436 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T08:36:51.436 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:36:51.436 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:36:51.437 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-19 08:36:30.078611651 +0000 2024-09-19T08:36:51.437 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-19 08:31:27.027661450 +0000 2024-09-19T08:36:51.437 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-19 08:31:27.027661450 +0000 2024-09-19T08:36:51.437 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-19 08:31:27.027661450 +0000 2024-09-19T08:36:51.437 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:36:51.503 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-19T08:36:51.503 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-19T08:36:51.503 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000191944 s, 2.7 MB/s 2024-09-19T08:36:51.504 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:36:51.561 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2024-09-19T08:36:51.617 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:36:51.617 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:36:51.617 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-19T08:36:51.618 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:36:51.618 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:36:51.618 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-19 08:36:30.079611636 +0000 2024-09-19T08:36:51.618 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-19 08:31:27.350656777 +0000 2024-09-19T08:36:51.618 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-19 08:31:27.350656777 +0000 2024-09-19T08:36:51.618 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-19 08:31:27.350656777 +0000 2024-09-19T08:36:51.619 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:36:51.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:51 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:51.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:51 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:51.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:51 smithi175 ceph-mon[35688]: Reconfiguring mon.b (monmap changed)... 2024-09-19T08:36:51.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:51 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:36:51.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:51 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:36:51.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:51 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:51.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:51 smithi175 ceph-mon[35688]: Reconfiguring daemon mon.b on smithi044 2024-09-19T08:36:51.682 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-19T08:36:51.682 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-19T08:36:51.682 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000168247 s, 3.0 MB/s 2024-09-19T08:36:51.684 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:36:51.741 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2024-09-19T08:36:51.750 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:51 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:51.750 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:51 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:51.750 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:51 smithi044 ceph-mon[35072]: Reconfiguring mon.b (monmap changed)... 2024-09-19T08:36:51.750 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:51 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:36:51.750 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:51 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:36:51.750 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:51 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:51.751 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:51 smithi044 ceph-mon[35072]: Reconfiguring daemon mon.b on smithi044 2024-09-19T08:36:51.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:51 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:51.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:51 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:51.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:51 smithi007 ceph-mon[31221]: Reconfiguring mon.b (monmap changed)... 2024-09-19T08:36:51.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:51 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:36:51.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:51 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:36:51.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:51 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:51.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:51 smithi007 ceph-mon[31221]: Reconfiguring daemon mon.b on smithi044 2024-09-19T08:36:51.796 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:36:51.796 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:36:51.796 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T08:36:51.796 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:36:51.796 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:36:51.796 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-09-19 08:36:30.079611636 +0000 2024-09-19T08:36:51.796 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-09-19 08:31:27.660652292 +0000 2024-09-19T08:36:51.796 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-09-19 08:31:27.660652292 +0000 2024-09-19T08:36:51.797 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-09-19 08:31:27.660652292 +0000 2024-09-19T08:36:51.797 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:36:51.860 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-09-19T08:36:51.860 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-09-19T08:36:51.860 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000190312 s, 2.7 MB/s 2024-09-19T08:36:51.861 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:36:51.918 INFO:tasks.cephadm:Deploying osd.0 on smithi007 with /dev/vg_nvme/lv_4... 2024-09-19T08:36:51.918 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:36:52.186 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:36:52.615 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:52 smithi007 ceph-mon[31221]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:52.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:52 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:52.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:52 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:52.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:52 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:36:52.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:52 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:36:52.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:52 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:52.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:52 smithi044 ceph-mon[35072]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:52.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:52 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:52.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:52 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:52.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:52 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:36:52.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:52 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:36:52.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:52 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:52.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:52 smithi175 ceph-mon[35688]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:52.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:52 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:52.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:52 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:52.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:52 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:36:52.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:52 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:36:52.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:52 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:53.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:53 smithi007 ceph-mon[31221]: Reconfiguring mon.c (monmap changed)... 2024-09-19T08:36:53.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:53 smithi007 ceph-mon[31221]: Reconfiguring daemon mon.c on smithi175 2024-09-19T08:36:53.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:53 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:53.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:53 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:53.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:53 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:36:53.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:53 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:53.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:53 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:36:53.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:53 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:53.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:53 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:36:53.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:53 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:36:53.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:53 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:36:53.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:53 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:53.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:53 smithi175 ceph-mon[35688]: Reconfiguring mon.c (monmap changed)... 2024-09-19T08:36:53.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:53 smithi175 ceph-mon[35688]: Reconfiguring daemon mon.c on smithi175 2024-09-19T08:36:53.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:53 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:53.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:53 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:53.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:53 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:36:53.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:53 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:53.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:53 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:36:53.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:53 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:53.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:53 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:36:53.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:53 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:36:53.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:53 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:36:53.769 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:53 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:53.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:53 smithi044 ceph-mon[35072]: Reconfiguring mon.c (monmap changed)... 2024-09-19T08:36:53.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:53 smithi044 ceph-mon[35072]: Reconfiguring daemon mon.c on smithi175 2024-09-19T08:36:53.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:53 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:53.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:53 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:53.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:53 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:36:53.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:53 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:53.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:53 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:36:53.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:53 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:53.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:53 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:36:53.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:53 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:36:53.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:53 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:36:53.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:53 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:54.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:54 smithi007 ceph-mon[31221]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:54.619 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:54 smithi007 ceph-mon[31221]: Deploying daemon mgr.z on smithi175 2024-09-19T08:36:54.621 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:36:54.651 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_4 2024-09-19T08:36:54.654 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:54 smithi175 ceph-mon[35688]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:54.654 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:54 smithi175 ceph-mon[35688]: Deploying daemon mgr.z on smithi175 2024-09-19T08:36:54.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:54 smithi044 ceph-mon[35072]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:54.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:54 smithi044 ceph-mon[35072]: Deploying daemon mgr.z on smithi175 2024-09-19T08:36:54.905 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:36:54.928 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:54 smithi175 systemd[1]: Starting Ceph mgr.z for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:36:55.288 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:55 smithi175 podman[37479]: 2024-09-19 08:36:55.024900969 +0000 UTC m=+0.105017470 container create fb7cd1055273ca0975b7a459cc14009da5249fb7be33f8066e930be22c33f1b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T08:36:55.288 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:55 smithi175 podman[37479]: 2024-09-19 08:36:54.935340446 +0000 UTC m=+0.015456905 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:36:55.288 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:55 smithi175 podman[37479]: 2024-09-19 08:36:55.260792243 +0000 UTC m=+0.340908702 container init fb7cd1055273ca0975b7a459cc14009da5249fb7be33f8066e930be22c33f1b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:36:55.288 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:55 smithi175 podman[37479]: 2024-09-19 08:36:55.263478362 +0000 UTC m=+0.343594830 container start fb7cd1055273ca0975b7a459cc14009da5249fb7be33f8066e930be22c33f1b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:36:55.289 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:55 smithi175 ceph-mgr[37498]: -- 172.21.15.175:0/3081190657 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56215d9e50e0 con 0x56215d9c3000 2024-09-19T08:36:55.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.340+0000 7f9ca63dd640 1 -- 172.21.15.7:0/3967900886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ca0100ad0 msgr2=0x7f9ca0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:55.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.340+0000 7f9ca63dd640 1 --2- 172.21.15.7:0/3967900886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ca0100ad0 0x7f9ca0100ed0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009900 tx=0x7f9c9002a410 comp rx=0 tx=0).stop 2024-09-19T08:36:55.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.340+0000 7f9ca63dd640 1 -- 172.21.15.7:0/3967900886 shutdown_connections 2024-09-19T08:36:55.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.340+0000 7f9ca63dd640 1 --2- 172.21.15.7:0/3967900886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ca0102690 0x7f9ca0108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:55.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.340+0000 7f9ca63dd640 1 --2- 172.21.15.7:0/3967900886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ca0101cd0 0x7f9ca0102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:55.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.340+0000 7f9ca63dd640 1 --2- 172.21.15.7:0/3967900886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ca0100ad0 0x7f9ca0100ed0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:55.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.340+0000 7f9ca63dd640 1 -- 172.21.15.7:0/3967900886 >> 172.21.15.7:0/3967900886 conn(0x7f9ca00fc280 msgr2=0x7f9ca00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:55.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.340+0000 7f9ca63dd640 1 -- 172.21.15.7:0/3967900886 shutdown_connections 2024-09-19T08:36:55.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.340+0000 7f9ca63dd640 1 -- 172.21.15.7:0/3967900886 wait complete. 2024-09-19T08:36:55.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.340+0000 7f9ca63dd640 1 Processor -- start 2024-09-19T08:36:55.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.341+0000 7f9ca63dd640 1 -- start start 2024-09-19T08:36:55.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.341+0000 7f9ca63dd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ca0100ad0 0x7f9ca0104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:55.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.341+0000 7f9ca63dd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ca0101cd0 0x7f9ca01030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:55.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.341+0000 7f9ca63dd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ca0102690 0x7f9ca01035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:55.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.341+0000 7f9ca63dd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca010c7b0 con 0x7f9ca0100ad0 2024-09-19T08:36:55.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.341+0000 7f9ca63dd640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca010c630 con 0x7f9ca0101cd0 2024-09-19T08:36:55.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.341+0000 7f9ca63dd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca010c930 con 0x7f9ca0102690 2024-09-19T08:36:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.341+0000 7f9c9ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ca0100ad0 0x7f9ca0104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.341+0000 7f9c9ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ca0100ad0 0x7f9ca0104a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39858/0 (socket says 172.21.15.7:39858) 2024-09-19T08:36:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.341+0000 7f9c9ffff640 1 -- 172.21.15.7:0/1402994502 learned_addr learned my addr 172.21.15.7:0/1402994502 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:36:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.341+0000 7f9c97fff640 1 --2- 172.21.15.7:0/1402994502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ca0101cd0 0x7f9ca01030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.341+0000 7f9ca497a640 1 --2- 172.21.15.7:0/1402994502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ca0102690 0x7f9ca01035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.341+0000 7f9c9ffff640 1 -- 172.21.15.7:0/1402994502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ca0102690 msgr2=0x7f9ca01035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.341+0000 7f9c9ffff640 1 --2- 172.21.15.7:0/1402994502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ca0102690 0x7f9ca01035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.341+0000 7f9c9ffff640 1 -- 172.21.15.7:0/1402994502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ca0101cd0 msgr2=0x7f9ca01030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.341+0000 7f9c9ffff640 1 --2- 172.21.15.7:0/1402994502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ca0101cd0 0x7f9ca01030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.341+0000 7f9c9ffff640 1 -- 172.21.15.7:0/1402994502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca0103eb0 con 0x7f9ca0100ad0 2024-09-19T08:36:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.342+0000 7f9c9ffff640 1 --2- 172.21.15.7:0/1402994502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ca0100ad0 0x7f9ca0104a60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9c90031440 tx=0x7f9c90032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.342+0000 7f9c9dffb640 1 -- 172.21.15.7:0/1402994502 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9003f030 con 0x7f9ca0100ad0 2024-09-19T08:36:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.342+0000 7f9c9dffb640 1 -- 172.21.15.7:0/1402994502 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c90003ce0 con 0x7f9ca0100ad0 2024-09-19T08:36:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.342+0000 7f9ca63dd640 1 -- 172.21.15.7:0/1402994502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca01a20f0 con 0x7f9ca0100ad0 2024-09-19T08:36:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.342+0000 7f9c9dffb640 1 -- 172.21.15.7:0/1402994502 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c90035070 con 0x7f9ca0100ad0 2024-09-19T08:36:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.342+0000 7f9ca63dd640 1 -- 172.21.15.7:0/1402994502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca01a25a0 con 0x7f9ca0100ad0 2024-09-19T08:36:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.343+0000 7f9c9dffb640 1 -- 172.21.15.7:0/1402994502 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f9c90042030 con 0x7f9ca0100ad0 2024-09-19T08:36:55.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.343+0000 7f9c9dffb640 1 --2- 172.21.15.7:0/1402994502 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9c8c0394d0 0x7f9c8c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:55.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.343+0000 7f9c9dffb640 1 -- 172.21.15.7:0/1402994502 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9c9006ce70 con 0x7f9ca0100ad0 2024-09-19T08:36:55.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.343+0000 7f9ca63dd640 1 -- 172.21.15.7:0/1402994502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca0100ed0 con 0x7f9ca0100ad0 2024-09-19T08:36:55.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.343+0000 7f9c97fff640 1 --2- 172.21.15.7:0/1402994502 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9c8c0394d0 0x7f9c8c03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:55.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.343+0000 7f9c97fff640 1 --2- 172.21.15.7:0/1402994502 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9c8c0394d0 0x7f9c8c03b990 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9ca01047e0 tx=0x7f9c8800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:55.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.348+0000 7f9c9dffb640 1 -- 172.21.15.7:0/1402994502 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9c9003b460 con 0x7f9ca0100ad0 2024-09-19T08:36:55.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:36:55.551+0000 7f9ca63dd640 1 -- 172.21.15.7:0/1402994502 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9ca006a710 con 0x7f9c8c0394d0 2024-09-19T08:36:55.592 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:55 smithi175 bash[37479]: fb7cd1055273ca0975b7a459cc14009da5249fb7be33f8066e930be22c33f1b2 2024-09-19T08:36:55.592 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:55 smithi175 systemd[1]: Started Ceph mgr.z for ebd23124-7661-11ef-bceb-c7b262605968. 2024-09-19T08:36:55.592 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:55 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:55.385+0000 7fa3a67c7040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:36:55.592 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:55 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:55.444+0000 7fa3a67c7040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:36:55.592 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:55 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:55.592+0000 7fa3a67c7040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:36:55.928 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:55 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:55.657+0000 7fa3a67c7040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:36:55.929 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:55 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:55.803+0000 7fa3a67c7040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:36:56.253 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:55 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:55.940+0000 7fa3a67c7040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:36:56.253 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:56 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:56.252+0000 7fa3a67c7040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:36:56.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:56 smithi007 ceph-mon[31221]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:56.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:56.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:56.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:56.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:36:56.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:36:56.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:36:56.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:56.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:56 smithi007 ceph-mon[31221]: Deploying daemon mgr.y on smithi044 2024-09-19T08:36:56.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:56 smithi007 ceph-mon[31221]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:56.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:36:56.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:36:56.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:56.678 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:56 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:56.312+0000 7fa3a67c7040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:36:56.678 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:56 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:56.494+0000 7fa3a67c7040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:36:56.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:56 smithi175 ceph-mon[35688]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:56.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:56 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:56.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:56 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:56.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:56 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:56.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:56 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:36:56.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:56 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:36:56.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:56 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:36:56.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:56 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:56.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:56 smithi175 ceph-mon[35688]: Deploying daemon mgr.y on smithi044 2024-09-19T08:36:56.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:56 smithi175 ceph-mon[35688]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:56.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:56 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:36:56.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:56 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:36:56.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:56 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:56.739 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:56 smithi044 ceph-mon[35072]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:56.739 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:56 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:56.739 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:56 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:56.739 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:56 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:56.739 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:56 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:36:56.739 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:56 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:36:56.739 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:56 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:36:56.740 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:56 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:56.740 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:56 smithi044 ceph-mon[35072]: Deploying daemon mgr.y on smithi044 2024-09-19T08:36:56.740 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:56 smithi044 ceph-mon[35072]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:36:56.740 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:56 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:36:56.740 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:56 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:36:56.740 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:56 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:36:57.678 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:57 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:57.370+0000 7fa3a67c7040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:36:57.678 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:57 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:57.437+0000 7fa3a67c7040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:36:57.801 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:36:57 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:36:57.678+0000 7f0a727c7040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:36:58.225 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:36:57 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:36:57.835+0000 7f0a727c7040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:36:58.225 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:36:57 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:36:57.905+0000 7f0a727c7040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:36:58.225 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:36:58 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:36:58.070+0000 7f0a727c7040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:36:58.225 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:36:58 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:36:58.225+0000 7f0a727c7040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:36:58.451 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:58 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:58.187+0000 7fa3a67c7040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:36:58.451 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:58 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:58.303+0000 7fa3a67c7040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:36:58.451 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:58 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:58.450+0000 7fa3a67c7040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:36:58.740 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:58 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:58.521+0000 7fa3a67c7040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:36:58.741 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:58 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:58.672+0000 7fa3a67c7040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:36:58.741 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:58 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:58.740+0000 7fa3a67c7040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:36:58.741 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:58 smithi175 ceph-mon[35688]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:58.741 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:58 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:58.741 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:58 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:58.741 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:58 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:58.741 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:58 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:58.741 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:58 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:36:58.741 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:58 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1540343362' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "837e6267-71c7-4f48-9e0b-4e3f124682b5"}]: dispatch 2024-09-19T08:36:58.741 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:58 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1540343362' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "837e6267-71c7-4f48-9e0b-4e3f124682b5"}]': finished 2024-09-19T08:36:58.742 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:58 smithi175 ceph-mon[35688]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T08:36:58.742 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:58 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:36:58.742 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:58 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/139056621' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:36:58.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:58 smithi007 ceph-mon[31221]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:58.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:58 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:58.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:58 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:58.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:58 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:58.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:58 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:58.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:58 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:36:58.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:58 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1540343362' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "837e6267-71c7-4f48-9e0b-4e3f124682b5"}]: dispatch 2024-09-19T08:36:58.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:58 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1540343362' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "837e6267-71c7-4f48-9e0b-4e3f124682b5"}]': finished 2024-09-19T08:36:58.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:58 smithi007 ceph-mon[31221]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T08:36:58.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:58 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:36:58.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:58 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/139056621' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:36:58.824 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:36:58 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:36:58.561+0000 7f0a727c7040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:36:58.824 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:36:58 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:36:58.624+0000 7f0a727c7040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:36:58.825 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:36:58 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:36:58.824+0000 7f0a727c7040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:36:58.825 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:58 smithi044 ceph-mon[35072]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:36:58.825 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:58 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:58.825 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:58 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:58.825 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:58 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:58.825 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:58 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:36:58.825 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:58 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:36:58.825 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:58 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1540343362' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "837e6267-71c7-4f48-9e0b-4e3f124682b5"}]: dispatch 2024-09-19T08:36:58.825 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:58 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1540343362' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "837e6267-71c7-4f48-9e0b-4e3f124682b5"}]': finished 2024-09-19T08:36:58.825 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:58 smithi044 ceph-mon[35072]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T08:36:58.825 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:58 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:36:58.826 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:58 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/139056621' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:36:59.036 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:58 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:58.803+0000 7fa3a67c7040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:36:59.037 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:58 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:58.971+0000 7fa3a67c7040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:36:59.037 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:59 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:59.036+0000 7fa3a67c7040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:36:59.302 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:59 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:59.105+0000 7fa3a67c7040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:36:59.302 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:59 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:59.186+0000 7fa3a67c7040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:36:59.302 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:59 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:59.244+0000 7fa3a67c7040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:36:59.302 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:36:59 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:36:59.302+0000 7fa3a67c7040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:37:00.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:59 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:00.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:59 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:00.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:59 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:00.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:59 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:00.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:59 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:00.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:59 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:00.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:59 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:00.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:59 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:00.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:59 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:00.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:59 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:00.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:36:59 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:00.050 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:36:59 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:36:59.746+0000 7f0a727c7040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:37:00.051 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:36:59 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:36:59.816+0000 7f0a727c7040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:37:00.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:59 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:00.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:59 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:00.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:59 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:00.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:59 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:00.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:59 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:00.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:59 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:00.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:59 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:00.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:59 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:00.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:59 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:00.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:59 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:00.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:36:59 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:00.089 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:59 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:00.089 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:59 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:00.090 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:59 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:00.090 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:59 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:00.090 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:59 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:00.090 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:59 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:00.090 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:59 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:00.090 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:59 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:00.090 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:59 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:00.090 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:59 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:00.090 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:36:59 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:00.428 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:37:00 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:37:00.088+0000 7fa3a67c7040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:37:00.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:37:00.743+0000 7f9c9dffb640 1 -- 172.21.15.7:0/1402994502 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 14) ==== 92407+0+0 (secure 0 0 0) 0x7f9c9003bcd0 con 0x7f9ca0100ad0 2024-09-19T08:37:00.833 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:37:00 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:37:00.564+0000 7f0a727c7040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:37:00.833 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:37:00 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:37:00.683+0000 7f0a727c7040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:37:00.833 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:00 smithi044 ceph-mon[35072]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:00.833 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:00 smithi044 ceph-mon[35072]: Standby manager daemon z started 2024-09-19T08:37:00.834 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:00 smithi044 ceph-mon[35072]: from='mgr.? 172.21.15.175:0/3325027533' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:37:00.834 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:00 smithi044 ceph-mon[35072]: from='mgr.? 172.21.15.175:0/3325027533' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:37:00.834 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:00 smithi044 ceph-mon[35072]: from='mgr.? 172.21.15.175:0/3325027533' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:37:00.834 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:00 smithi044 ceph-mon[35072]: from='mgr.? 172.21.15.175:0/3325027533' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:37:01.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:00 smithi007 ceph-mon[31221]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:01.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:00 smithi007 ceph-mon[31221]: Standby manager daemon z started 2024-09-19T08:37:01.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:00 smithi007 ceph-mon[31221]: from='mgr.? 172.21.15.175:0/3325027533' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:37:01.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:00 smithi007 ceph-mon[31221]: from='mgr.? 172.21.15.175:0/3325027533' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:37:01.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:00 smithi007 ceph-mon[31221]: from='mgr.? 172.21.15.175:0/3325027533' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:37:01.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:00 smithi007 ceph-mon[31221]: from='mgr.? 172.21.15.175:0/3325027533' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:37:01.121 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:37:00 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:37:00.833+0000 7f0a727c7040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:37:01.122 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:37:00 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:37:00.896+0000 7f0a727c7040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:37:01.122 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:37:01 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:37:01.051+0000 7f0a727c7040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:37:01.122 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:37:01 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:37:01.121+0000 7f0a727c7040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:37:01.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:00 smithi175 ceph-mon[35688]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:01.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:00 smithi175 ceph-mon[35688]: Standby manager daemon z started 2024-09-19T08:37:01.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:00 smithi175 ceph-mon[35688]: from='mgr.? 172.21.15.175:0/3325027533' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:37:01.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:00 smithi175 ceph-mon[35688]: from='mgr.? 172.21.15.175:0/3325027533' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:37:01.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:00 smithi175 ceph-mon[35688]: from='mgr.? 172.21.15.175:0/3325027533' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:37:01.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:00 smithi175 ceph-mon[35688]: from='mgr.? 172.21.15.175:0/3325027533' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:37:01.415 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:37:01 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:37:01.183+0000 7f0a727c7040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:37:01.415 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:37:01 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:37:01.348+0000 7f0a727c7040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:37:01.415 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:37:01 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:37:01.415+0000 7f0a727c7040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:37:01.692 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:37:01 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:37:01.484+0000 7f0a727c7040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:37:01.692 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:37:01 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:37:01.569+0000 7f0a727c7040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:37:01.692 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:37:01 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:37:01.631+0000 7f0a727c7040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:37:01.692 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:37:01 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:37:01.692+0000 7f0a727c7040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:37:02.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:01 smithi007 ceph-mon[31221]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-19T08:37:02.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:01 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:37:02.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:01 smithi007 ceph-mon[31221]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:02.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:01 smithi044 ceph-mon[35072]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-19T08:37:02.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:01 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:37:02.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:01 smithi044 ceph-mon[35072]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:02.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:01 smithi175 ceph-mon[35688]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-19T08:37:02.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:01 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:37:02.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:01 smithi175 ceph-mon[35688]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:02.801 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:37:02 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:37:02.514+0000 7f0a727c7040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:37:02.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:37:02.836+0000 7f9c9dffb640 1 -- 172.21.15.7:0/1402994502 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f9c9003aca0 con 0x7f9ca0100ad0 2024-09-19T08:37:03.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:02 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:03.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:02 smithi007 ceph-mon[31221]: Standby manager daemon y started 2024-09-19T08:37:03.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:02 smithi007 ceph-mon[31221]: from='mgr.? 172.21.15.44:0/2676586478' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:37:03.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:02 smithi007 ceph-mon[31221]: from='mgr.? 172.21.15.44:0/2676586478' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:37:03.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:02 smithi007 ceph-mon[31221]: from='mgr.? 172.21.15.44:0/2676586478' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:37:03.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:02 smithi007 ceph-mon[31221]: from='mgr.? 172.21.15.44:0/2676586478' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:37:03.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:02 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:03.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:02 smithi175 ceph-mon[35688]: Standby manager daemon y started 2024-09-19T08:37:03.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:02 smithi175 ceph-mon[35688]: from='mgr.? 172.21.15.44:0/2676586478' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:37:03.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:02 smithi175 ceph-mon[35688]: from='mgr.? 172.21.15.44:0/2676586478' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:37:03.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:02 smithi175 ceph-mon[35688]: from='mgr.? 172.21.15.44:0/2676586478' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:37:03.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:02 smithi175 ceph-mon[35688]: from='mgr.? 172.21.15.44:0/2676586478' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:37:03.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:02 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:03.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:02 smithi044 ceph-mon[35072]: Standby manager daemon y started 2024-09-19T08:37:03.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:02 smithi044 ceph-mon[35072]: from='mgr.? 172.21.15.44:0/2676586478' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:37:03.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:02 smithi044 ceph-mon[35072]: from='mgr.? 172.21.15.44:0/2676586478' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:37:03.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:02 smithi044 ceph-mon[35072]: from='mgr.? 172.21.15.44:0/2676586478' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:37:03.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:02 smithi044 ceph-mon[35072]: from='mgr.? 172.21.15.44:0/2676586478' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:37:04.140 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:03 smithi007 ceph-mon[31221]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:04.140 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:03 smithi007 ceph-mon[31221]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-19T08:37:04.140 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:03 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:37:04.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:03 smithi175 ceph-mon[35688]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:04.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:03 smithi175 ceph-mon[35688]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-19T08:37:04.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:03 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:37:04.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:03 smithi044 ceph-mon[35072]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:04.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:03 smithi044 ceph-mon[35072]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-19T08:37:04.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:03 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:37:06.103 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:05 smithi044 ceph-mon[35072]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:06.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:05 smithi007 ceph-mon[31221]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:06.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:05 smithi175 ceph-mon[35688]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:06.870 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:06 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:37:06.870 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:06 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:06.870 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:06 smithi007 ceph-mon[31221]: Deploying daemon osd.0 on smithi007 2024-09-19T08:37:07.093 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:06 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:37:07.093 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:06 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:07.093 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:06 smithi175 ceph-mon[35688]: Deploying daemon osd.0 on smithi007 2024-09-19T08:37:07.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:06 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:37:07.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:06 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:07.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:06 smithi044 ceph-mon[35072]: Deploying daemon osd.0 on smithi007 2024-09-19T08:37:08.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:07 smithi175 ceph-mon[35688]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:08.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:07 smithi007 ceph-mon[31221]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:08.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:07 smithi044 ceph-mon[35072]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:09.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:09 smithi007 ceph-mon[31221]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:10.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:09 smithi175 ceph-mon[35688]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:10.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:09 smithi044 ceph-mon[35072]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:12.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:11 smithi007 ceph-mon[31221]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:12.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:11 smithi175 ceph-mon[35688]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:12.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:11 smithi044 ceph-mon[35072]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:13.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:12 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:13.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:12 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:13.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:12 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:13.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:12 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:13.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:12 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:13.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:12 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:13.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:12 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:13.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:12 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:13.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:12 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:14.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:14 smithi007 ceph-mon[31221]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:15.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:14 smithi044 ceph-mon[35072]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:15.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:14 smithi175 ceph-mon[35688]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:16.487 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:16 smithi007 ceph-mon[31221]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:16.487 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:16 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:16.487 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:16 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:16.487 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:16 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:16.487 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:16 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:16.487 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:16 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:16.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:37:16.526+0000 7f9c9dffb640 1 -- 172.21.15.7:0/1402994502 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9ca006a710 con 0x7f9c8c0394d0 2024-09-19T08:37:16.526 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 0 on host 'smithi007' 2024-09-19T08:37:16.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:37:16.530+0000 7f9ca63dd640 1 -- 172.21.15.7:0/1402994502 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9c8c0394d0 msgr2=0x7f9c8c03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:16.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:37:16.530+0000 7f9ca63dd640 1 --2- 172.21.15.7:0/1402994502 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9c8c0394d0 0x7f9c8c03b990 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9ca01047e0 tx=0x7f9c8800b390 comp rx=0 tx=0).stop 2024-09-19T08:37:16.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:37:16.530+0000 7f9ca63dd640 1 -- 172.21.15.7:0/1402994502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ca0100ad0 msgr2=0x7f9ca0104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:16.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:37:16.530+0000 7f9ca63dd640 1 --2- 172.21.15.7:0/1402994502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ca0100ad0 0x7f9ca0104a60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9c90031440 tx=0x7f9c90032ce0 comp rx=0 tx=0).stop 2024-09-19T08:37:16.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:37:16.530+0000 7f9ca63dd640 1 -- 172.21.15.7:0/1402994502 shutdown_connections 2024-09-19T08:37:16.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:37:16.530+0000 7f9ca63dd640 1 --2- 172.21.15.7:0/1402994502 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9c8c0394d0 0x7f9c8c03b990 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:16.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:37:16.530+0000 7f9ca63dd640 1 --2- 172.21.15.7:0/1402994502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ca0102690 0x7f9ca01035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:16.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:37:16.530+0000 7f9ca63dd640 1 --2- 172.21.15.7:0/1402994502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ca0101cd0 0x7f9ca01030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:16.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:37:16.530+0000 7f9ca63dd640 1 --2- 172.21.15.7:0/1402994502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ca0100ad0 0x7f9ca0104a60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:16.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:37:16.530+0000 7f9ca63dd640 1 -- 172.21.15.7:0/1402994502 >> 172.21.15.7:0/1402994502 conn(0x7f9ca00fc280 msgr2=0x7f9ca006a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:16.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:37:16.530+0000 7f9ca63dd640 1 -- 172.21.15.7:0/1402994502 shutdown_connections 2024-09-19T08:37:16.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:37:16.530+0000 7f9ca63dd640 1 -- 172.21.15.7:0/1402994502 wait complete. 2024-09-19T08:37:16.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:16 smithi175 ceph-mon[35688]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:16.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:16 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:16.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:16 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:16.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:16 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:16.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:16 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:16.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:16 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:16.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:16 smithi044 ceph-mon[35072]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:16 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:16 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:16 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:16 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:16 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:17.127 DEBUG:teuthology.orchestra.run.smithi007:osd.0> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T08:37:17.130 INFO:tasks.cephadm:Deploying osd.1 on smithi044 with /dev/vg_nvme/lv_4... 2024-09-19T08:37:17.130 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:37:17.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:17 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:17.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:17 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:17.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:17 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:17.382 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:37:17.436 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:17 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:17.436 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:17 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:17.436 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:17 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:17.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:17 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:17.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:17 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:17.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:17 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:18.647 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:18 smithi007 ceph-mon[31221]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:18.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:18 smithi175 ceph-mon[35688]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:18.707 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:18 smithi044 ceph-mon[35072]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:19.284 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:37:19 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-0[44953]: 2024-09-19T08:37:19.039+0000 7efda1110640 -1 osd.0 0 log_to_monitors true 2024-09-19T08:37:19.745 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:19 smithi007 ceph-mon[31221]: from='osd.0 [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:37:19.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:19 smithi044 ceph-mon[35072]: from='osd.0 [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:37:19.804 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-19T08:37:19.829 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi044:vg_nvme/lv_4 2024-09-19T08:37:19.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:19 smithi175 ceph-mon[35688]: from='osd.0 [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:37:20.076 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:37:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.533+0000 7effa907a640 1 -- 172.21.15.44:0/449333904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effa4104fc0 msgr2=0x7effa41073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.533+0000 7effa907a640 1 --2- 172.21.15.44:0/449333904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effa4104fc0 0x7effa41073b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009900 tx=0x7eff8c02a410 comp rx=0 tx=0).stop 2024-09-19T08:37:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.533+0000 7effa907a640 1 -- 172.21.15.44:0/449333904 shutdown_connections 2024-09-19T08:37:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.533+0000 7effa907a640 1 --2- 172.21.15.44:0/449333904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effa41078f0 0x7effa4109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.533+0000 7effa907a640 1 --2- 172.21.15.44:0/449333904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effa4104fc0 0x7effa41073b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.533+0000 7effa907a640 1 --2- 172.21.15.44:0/449333904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effa4102690 0x7effa4104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.533+0000 7effa907a640 1 -- 172.21.15.44:0/449333904 >> 172.21.15.44:0/449333904 conn(0x7effa40fc290 msgr2=0x7effa40fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.533+0000 7effa907a640 1 -- 172.21.15.44:0/449333904 shutdown_connections 2024-09-19T08:37:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.533+0000 7effa907a640 1 -- 172.21.15.44:0/449333904 wait complete. 2024-09-19T08:37:20.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.534+0000 7effa907a640 1 Processor -- start 2024-09-19T08:37:20.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.534+0000 7effa907a640 1 -- start start 2024-09-19T08:37:20.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.535+0000 7effa907a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effa4102690 0x7effa4101ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.535+0000 7effa907a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effa4104fc0 0x7effa4100640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.535+0000 7effa907a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effa41078f0 0x7effa4100b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.535+0000 7effa907a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7effa410d8c0 con 0x7effa4104fc0 2024-09-19T08:37:20.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.535+0000 7effa907a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7effa410d740 con 0x7effa41078f0 2024-09-19T08:37:20.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.535+0000 7effa907a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7effa410da40 con 0x7effa4102690 2024-09-19T08:37:20.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.535+0000 7effa359e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effa41078f0 0x7effa4100b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.535+0000 7effa259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effa4104fc0 0x7effa4100640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.535+0000 7effa359e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effa41078f0 0x7effa4100b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46780/0 (socket says 172.21.15.44:46780) 2024-09-19T08:37:20.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.535+0000 7effa2d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effa4102690 0x7effa4101ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.535+0000 7effa359e640 1 -- 172.21.15.44:0/2229638146 learned_addr learned my addr 172.21.15.44:0/2229638146 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-19T08:37:20.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.535+0000 7effa359e640 1 -- 172.21.15.44:0/2229638146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effa4102690 msgr2=0x7effa4101ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:20.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.535+0000 7effa359e640 1 --2- 172.21.15.44:0/2229638146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effa4102690 0x7effa4101ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.535+0000 7effa359e640 1 -- 172.21.15.44:0/2229638146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effa4104fc0 msgr2=0x7effa4100640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:20.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.535+0000 7effa359e640 1 --2- 172.21.15.44:0/2229638146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effa4104fc0 0x7effa4100640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.535+0000 7effa359e640 1 -- 172.21.15.44:0/2229638146 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa4101440 con 0x7effa41078f0 2024-09-19T08:37:20.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.535+0000 7effa359e640 1 --2- 172.21.15.44:0/2229638146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effa41078f0 0x7effa4100b80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00eb10 tx=0x7eff9c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:20.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.538+0000 7eff9bfff640 1 -- 172.21.15.44:0/2229638146 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c004b20 con 0x7effa41078f0 2024-09-19T08:37:20.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.538+0000 7eff9bfff640 1 -- 172.21.15.44:0/2229638146 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff9c004cc0 con 0x7effa41078f0 2024-09-19T08:37:20.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.538+0000 7eff9bfff640 1 -- 172.21.15.44:0/2229638146 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c010760 con 0x7effa41078f0 2024-09-19T08:37:20.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.538+0000 7effa907a640 1 -- 172.21.15.44:0/2229638146 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa41a20d0 con 0x7effa41078f0 2024-09-19T08:37:20.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.539+0000 7effa907a640 1 -- 172.21.15.44:0/2229638146 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa41a25e0 con 0x7effa41078f0 2024-09-19T08:37:20.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.540+0000 7effa907a640 1 -- 172.21.15.44:0/2229638146 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effa40fdd80 con 0x7effa41078f0 2024-09-19T08:37:20.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.541+0000 7eff9bfff640 1 -- 172.21.15.44:0/2229638146 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7eff9c005020 con 0x7effa41078f0 2024-09-19T08:37:20.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.541+0000 7eff9bfff640 1 --2- 172.21.15.44:0/2229638146 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7eff900a3230 0x7eff900a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.541+0000 7eff9bfff640 1 -- 172.21.15.44:0/2229638146 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7eff9c0ce270 con 0x7effa41078f0 2024-09-19T08:37:20.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.542+0000 7effa2d9d640 1 --2- 172.21.15.44:0/2229638146 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7eff900a3230 0x7eff900a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.542+0000 7effa2d9d640 1 --2- 172.21.15.44:0/2229638146 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7eff900a3230 0x7eff900a56f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7eff9400bbe0 tx=0x7eff9400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:20.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.546+0000 7eff9bfff640 1 -- 172.21.15.44:0/2229638146 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7eff9c09cb20 con 0x7effa41078f0 2024-09-19T08:37:20.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:20.729+0000 7effa907a640 1 -- 172.21.15.44:0/2229638146 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7effa4062630 con 0x7eff900a3230 2024-09-19T08:37:20.729 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:20 smithi044 ceph-mon[35072]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:20.730 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:20 smithi044 ceph-mon[35072]: from='osd.0 [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:37:20.730 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:20 smithi044 ceph-mon[35072]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:37:20.730 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:20 smithi044 ceph-mon[35072]: from='osd.0 [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T08:37:20.730 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:20 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:20.730 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:20 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:20.730 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:20 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:20.730 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:20 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:37:20.730 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:20 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:20.730 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:20 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:20.730 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:20 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:20.730 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:20 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:20.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:20 smithi175 ceph-mon[35688]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:20.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:20 smithi175 ceph-mon[35688]: from='osd.0 [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:37:20.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:20 smithi175 ceph-mon[35688]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:37:20.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:20 smithi175 ceph-mon[35688]: from='osd.0 [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T08:37:20.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:20 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:20.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:20 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:20.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:20 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:20.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:20 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:37:20.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:20 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:20.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:20 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:20.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:20 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:20.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:20 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:21.033 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:37:20 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-0[44953]: 2024-09-19T08:37:20.537+0000 7efd9c870640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T08:37:21.033 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:37:20 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-0[44953]: 2024-09-19T08:37:20.541+0000 7efd98eaa640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:37:21.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:20 smithi007 ceph-mon[31221]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:21.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:20 smithi007 ceph-mon[31221]: from='osd.0 [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:37:21.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:20 smithi007 ceph-mon[31221]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:37:21.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:20 smithi007 ceph-mon[31221]: from='osd.0 [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T08:37:21.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:20 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:21.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:20 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:21.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:20 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:21.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:20 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:37:21.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:20 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:21.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:20 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:21.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:20 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:21.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:20 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:21 smithi044 ceph-mon[35072]: Detected new or changed devices on smithi007 2024-09-19T08:37:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:21 smithi044 ceph-mon[35072]: Adjusting osd_memory_target on smithi007 to 17092M 2024-09-19T08:37:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:21 smithi044 ceph-mon[35072]: from='osd.0 [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T08:37:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:21 smithi044 ceph-mon[35072]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:37:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:21 smithi044 ceph-mon[35072]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:37:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:37:21.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:37:21.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:21.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:21 smithi175 ceph-mon[35688]: Detected new or changed devices on smithi007 2024-09-19T08:37:21.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:21 smithi175 ceph-mon[35688]: Adjusting osd_memory_target on smithi007 to 17092M 2024-09-19T08:37:21.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:21 smithi175 ceph-mon[35688]: from='osd.0 [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T08:37:21.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:21 smithi175 ceph-mon[35688]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:37:21.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:21.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:21.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:21 smithi175 ceph-mon[35688]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:37:21.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:37:21.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:37:21.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:22.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:21 smithi007 ceph-mon[31221]: Detected new or changed devices on smithi007 2024-09-19T08:37:22.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:21 smithi007 ceph-mon[31221]: Adjusting osd_memory_target on smithi007 to 17092M 2024-09-19T08:37:22.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:21 smithi007 ceph-mon[31221]: from='osd.0 [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T08:37:22.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:21 smithi007 ceph-mon[31221]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:37:22.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:22.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:22.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:21 smithi007 ceph-mon[31221]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:37:22.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:37:22.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:37:22.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:22.679 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:22 smithi044 ceph-mon[35072]: purged_snaps scrub starts 2024-09-19T08:37:22.679 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:22 smithi044 ceph-mon[35072]: purged_snaps scrub ok 2024-09-19T08:37:22.679 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:22 smithi044 ceph-mon[35072]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:22.679 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:22 smithi044 ceph-mon[35072]: osd.0 [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717] boot 2024-09-19T08:37:22.680 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:22 smithi044 ceph-mon[35072]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T08:37:22.680 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:22 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:22.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:22 smithi175 ceph-mon[35688]: purged_snaps scrub starts 2024-09-19T08:37:22.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:22 smithi175 ceph-mon[35688]: purged_snaps scrub ok 2024-09-19T08:37:22.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:22 smithi175 ceph-mon[35688]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:22.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:22 smithi175 ceph-mon[35688]: osd.0 [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717] boot 2024-09-19T08:37:22.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:22 smithi175 ceph-mon[35688]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T08:37:22.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:22 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:23.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:22 smithi007 ceph-mon[31221]: purged_snaps scrub starts 2024-09-19T08:37:23.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:22 smithi007 ceph-mon[31221]: purged_snaps scrub ok 2024-09-19T08:37:23.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:22 smithi007 ceph-mon[31221]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:37:23.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:22 smithi007 ceph-mon[31221]: osd.0 [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717] boot 2024-09-19T08:37:23.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:22 smithi007 ceph-mon[31221]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T08:37:23.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:22 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:37:23.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:23 smithi175 ceph-mon[35688]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T08:37:23.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:23 smithi175 ceph-mon[35688]: from='client.? 172.21.15.44:0/2213741924' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "67865372-ac22-4b30-bd02-498e118d6701"}]: dispatch 2024-09-19T08:37:23.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:23 smithi175 ceph-mon[35688]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "67865372-ac22-4b30-bd02-498e118d6701"}]: dispatch 2024-09-19T08:37:23.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:23 smithi175 ceph-mon[35688]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "67865372-ac22-4b30-bd02-498e118d6701"}]': finished 2024-09-19T08:37:23.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:23 smithi175 ceph-mon[35688]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T08:37:23.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:23 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:37:24.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:23 smithi007 ceph-mon[31221]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T08:37:24.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:23 smithi007 ceph-mon[31221]: from='client.? 172.21.15.44:0/2213741924' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "67865372-ac22-4b30-bd02-498e118d6701"}]: dispatch 2024-09-19T08:37:24.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:23 smithi007 ceph-mon[31221]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "67865372-ac22-4b30-bd02-498e118d6701"}]: dispatch 2024-09-19T08:37:24.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:23 smithi007 ceph-mon[31221]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "67865372-ac22-4b30-bd02-498e118d6701"}]': finished 2024-09-19T08:37:24.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:23 smithi007 ceph-mon[31221]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T08:37:24.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:23 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:37:24.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:23 smithi044 ceph-mon[35072]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T08:37:24.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:23 smithi044 ceph-mon[35072]: from='client.? 172.21.15.44:0/2213741924' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "67865372-ac22-4b30-bd02-498e118d6701"}]: dispatch 2024-09-19T08:37:24.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:23 smithi044 ceph-mon[35072]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "67865372-ac22-4b30-bd02-498e118d6701"}]: dispatch 2024-09-19T08:37:24.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:23 smithi044 ceph-mon[35072]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "67865372-ac22-4b30-bd02-498e118d6701"}]': finished 2024-09-19T08:37:24.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:23 smithi044 ceph-mon[35072]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T08:37:24.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:23 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:37:24.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:24 smithi175 ceph-mon[35688]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:24.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:24 smithi175 ceph-mon[35688]: from='client.? 172.21.15.44:0/800648440' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:37:25.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:24 smithi007 ceph-mon[31221]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:25.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:24 smithi007 ceph-mon[31221]: from='client.? 172.21.15.44:0/800648440' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:37:25.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:24 smithi044 ceph-mon[35072]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:25.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:24 smithi044 ceph-mon[35072]: from='client.? 172.21.15.44:0/800648440' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:37:26.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:26 smithi175 ceph-mon[35688]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:27.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:26 smithi007 ceph-mon[31221]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:27.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:26 smithi044 ceph-mon[35072]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:28.737 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:28 smithi044 ceph-mon[35072]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:28.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:28 smithi175 ceph-mon[35688]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:29.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:28 smithi007 ceph-mon[31221]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:30.670 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:30 smithi044 ceph-mon[35072]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:30.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:30 smithi175 ceph-mon[35688]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:31.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:30 smithi007 ceph-mon[31221]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:31.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:31 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:37:31.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:31 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:31.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:31 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:37:31.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:31 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:32.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:31 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:37:32.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:31 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:32.857 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:32 smithi044 ceph-mon[35072]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:32.857 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:32 smithi044 ceph-mon[35072]: Deploying daemon osd.1 on smithi044 2024-09-19T08:37:32.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:32 smithi175 ceph-mon[35688]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:32.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:32 smithi175 ceph-mon[35688]: Deploying daemon osd.1 on smithi044 2024-09-19T08:37:33.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:32 smithi007 ceph-mon[31221]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:33.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:32 smithi007 ceph-mon[31221]: Deploying daemon osd.1 on smithi044 2024-09-19T08:37:34.868 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:34 smithi044 ceph-mon[35072]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:34.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:34 smithi175 ceph-mon[35688]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:35.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:34 smithi007 ceph-mon[31221]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:36.871 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:36 smithi044 ceph-mon[35072]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:36.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:36 smithi175 ceph-mon[35688]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:37.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:36 smithi007 ceph-mon[31221]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:38.740 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:38 smithi044 ceph-mon[35072]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:38.740 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:38 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:38.740 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:38 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:38.740 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:38 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:38.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:38 smithi175 ceph-mon[35688]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:38.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:38 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:38.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:38 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:38.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:38 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:39.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:38 smithi007 ceph-mon[31221]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:39.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:38 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:39.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:38 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:39.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:38 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:40.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:40 smithi175 ceph-mon[35688]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:40.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:40 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:40.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:40 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:40.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:40 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:40.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:40 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:40.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:40 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:41.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:40 smithi007 ceph-mon[31221]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:41.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:40 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:41.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:40 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:41.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:40 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:41.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:40 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:41.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:40 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:41.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:40 smithi044 ceph-mon[35072]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:41.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:41.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:41.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:41.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:41.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:41.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:41.832+0000 7eff9bfff640 1 -- 172.21.15.44:0/2229638146 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7effa4062630 con 0x7eff900a3230 2024-09-19T08:37:41.833 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 1 on host 'smithi044' 2024-09-19T08:37:41.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:41.834+0000 7effa907a640 1 -- 172.21.15.44:0/2229638146 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7eff900a3230 msgr2=0x7eff900a56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:41.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:41.834+0000 7effa907a640 1 --2- 172.21.15.44:0/2229638146 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7eff900a3230 0x7eff900a56f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7eff9400bbe0 tx=0x7eff9400b390 comp rx=0 tx=0).stop 2024-09-19T08:37:41.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:41.834+0000 7effa907a640 1 -- 172.21.15.44:0/2229638146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effa41078f0 msgr2=0x7effa4100b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:41.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:41.834+0000 7effa907a640 1 --2- 172.21.15.44:0/2229638146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effa41078f0 0x7effa4100b80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00eb10 tx=0x7eff9c00c2d0 comp rx=0 tx=0).stop 2024-09-19T08:37:41.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:41.834+0000 7effa907a640 1 -- 172.21.15.44:0/2229638146 shutdown_connections 2024-09-19T08:37:41.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:41.834+0000 7effa907a640 1 --2- 172.21.15.44:0/2229638146 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7eff900a3230 0x7eff900a56f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:41.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:41.834+0000 7effa907a640 1 --2- 172.21.15.44:0/2229638146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effa41078f0 0x7effa4100b80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:41.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:41.834+0000 7effa907a640 1 --2- 172.21.15.44:0/2229638146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effa4104fc0 0x7effa4100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:41.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:41.834+0000 7effa907a640 1 --2- 172.21.15.44:0/2229638146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effa4102690 0x7effa4101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:41.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:41.834+0000 7effa907a640 1 -- 172.21.15.44:0/2229638146 >> 172.21.15.44:0/2229638146 conn(0x7effa40fc290 msgr2=0x7effa4103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:41.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:41.835+0000 7effa907a640 1 -- 172.21.15.44:0/2229638146 shutdown_connections 2024-09-19T08:37:41.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:37:41.835+0000 7effa907a640 1 -- 172.21.15.44:0/2229638146 wait complete. 2024-09-19T08:37:42.432 DEBUG:teuthology.orchestra.run.smithi044:osd.1> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T08:37:42.434 INFO:tasks.cephadm:Deploying osd.2 on smithi175 with /dev/vg_nvme/lv_4... 2024-09-19T08:37:42.435 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:37:42.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:42 smithi044 ceph-mon[35072]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:42.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:42 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:42.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:42 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:42.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:42 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:42.687 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:37:42.807 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:42 smithi175 ceph-mon[35688]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:42.808 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:42 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:42.808 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:42 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:42.808 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:42 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:43.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:42 smithi007 ceph-mon[31221]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:43.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:42 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:37:43.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:42 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:43.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:42 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:44.051 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:37:43 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-1[39565]: 2024-09-19T08:37:43.953+0000 7f59258e4640 -1 osd.1 0 log_to_monitors true 2024-09-19T08:37:44.859 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:44 smithi044 ceph-mon[35072]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:44.859 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:44 smithi044 ceph-mon[35072]: from='osd.1 [v2:172.21.15.44:6800/2213694259,v1:172.21.15.44:6801/2213694259]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:37:44.859 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:44 smithi044 ceph-mon[35072]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:37:44.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:44 smithi175 ceph-mon[35688]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:44.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:44 smithi175 ceph-mon[35688]: from='osd.1 [v2:172.21.15.44:6800/2213694259,v1:172.21.15.44:6801/2213694259]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:37:44.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:44 smithi175 ceph-mon[35688]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:37:44.975 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:37:45.000 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_4 2024-09-19T08:37:45.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:44 smithi007 ceph-mon[31221]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:45.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:44 smithi007 ceph-mon[31221]: from='osd.1 [v2:172.21.15.44:6800/2213694259,v1:172.21.15.44:6801/2213694259]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:37:45.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:44 smithi007 ceph-mon[31221]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:37:45.246 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:37:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.700+0000 7f6bde419640 1 -- 172.21.15.175:0/513571125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bd80fff10 msgr2=0x7f6bd8100310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.700+0000 7f6bde419640 1 --2- 172.21.15.175:0/513571125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bd80fff10 0x7f6bd8100310 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009930 tx=0x7f6bc802a420 comp rx=0 tx=0).stop 2024-09-19T08:37:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.700+0000 7f6bde419640 1 -- 172.21.15.175:0/513571125 shutdown_connections 2024-09-19T08:37:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.700+0000 7f6bde419640 1 --2- 172.21.15.175:0/513571125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6bd81038b0 0x7f6bd810a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:45.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.700+0000 7f6bde419640 1 --2- 172.21.15.175:0/513571125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6bd8102ef0 0x7f6bd8103370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:45.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.700+0000 7f6bde419640 1 --2- 172.21.15.175:0/513571125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bd80fff10 0x7f6bd8100310 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:45.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.700+0000 7f6bde419640 1 -- 172.21.15.175:0/513571125 >> 172.21.15.175:0/513571125 conn(0x7f6bd80fba80 msgr2=0x7f6bd80fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:45.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.700+0000 7f6bde419640 1 -- 172.21.15.175:0/513571125 shutdown_connections 2024-09-19T08:37:45.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.700+0000 7f6bde419640 1 -- 172.21.15.175:0/513571125 wait complete. 2024-09-19T08:37:45.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.701+0000 7f6bde419640 1 Processor -- start 2024-09-19T08:37:45.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.701+0000 7f6bde419640 1 -- start start 2024-09-19T08:37:45.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.701+0000 7f6bde419640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6bd80fff10 0x7f6bd8197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:45.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.701+0000 7f6bde419640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6bd8102ef0 0x7f6bd8198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:45.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.701+0000 7f6bde419640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bd81038b0 0x7f6bd819f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:45.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.701+0000 7f6bde419640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd810d880 con 0x7f6bd80fff10 2024-09-19T08:37:45.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.701+0000 7f6bde419640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd810d700 con 0x7f6bd8102ef0 2024-09-19T08:37:45.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.701+0000 7f6bde419640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd810da00 con 0x7f6bd81038b0 2024-09-19T08:37:45.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.701+0000 7f6bdc9b6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bd81038b0 0x7f6bd819f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:45.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.701+0000 7f6bdc9b6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bd81038b0 0x7f6bd819f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51060/0 (socket says 172.21.15.175:51060) 2024-09-19T08:37:45.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.701+0000 7f6bdc9b6640 1 -- 172.21.15.175:0/4003940403 learned_addr learned my addr 172.21.15.175:0/4003940403 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-19T08:37:45.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.701+0000 7f6bd7fff640 1 --2- 172.21.15.175:0/4003940403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6bd80fff10 0x7f6bd8197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:45.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.701+0000 7f6bcffff640 1 --2- 172.21.15.175:0/4003940403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6bd8102ef0 0x7f6bd8198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:45.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.701+0000 7f6bdc9b6640 1 -- 172.21.15.175:0/4003940403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6bd8102ef0 msgr2=0x7f6bd8198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:45.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.701+0000 7f6bdc9b6640 1 --2- 172.21.15.175:0/4003940403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6bd8102ef0 0x7f6bd8198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:45.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.701+0000 7f6bdc9b6640 1 -- 172.21.15.175:0/4003940403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6bd80fff10 msgr2=0x7f6bd8197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:45.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.701+0000 7f6bdc9b6640 1 --2- 172.21.15.175:0/4003940403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6bd80fff10 0x7f6bd8197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:45.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.701+0000 7f6bdc9b6640 1 -- 172.21.15.175:0/4003940403 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd819fb70 con 0x7f6bd81038b0 2024-09-19T08:37:45.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.702+0000 7f6bdc9b6640 1 --2- 172.21.15.175:0/4003940403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bd81038b0 0x7f6bd819f500 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000eaa0 tx=0x7f6bd000ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:45.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.702+0000 7f6bd5ffb640 1 -- 172.21.15.175:0/4003940403 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd000cdb0 con 0x7f6bd81038b0 2024-09-19T08:37:45.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.702+0000 7f6bd5ffb640 1 -- 172.21.15.175:0/4003940403 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bd0005020 con 0x7f6bd81038b0 2024-09-19T08:37:45.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.702+0000 7f6bde419640 1 -- 172.21.15.175:0/4003940403 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bd8100d40 con 0x7f6bd81038b0 2024-09-19T08:37:45.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.702+0000 7f6bd5ffb640 1 -- 172.21.15.175:0/4003940403 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd00116b0 con 0x7f6bd81038b0 2024-09-19T08:37:45.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.702+0000 7f6bde419640 1 -- 172.21.15.175:0/4003940403 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bd8101280 con 0x7f6bd81038b0 2024-09-19T08:37:45.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.703+0000 7f6bde419640 1 -- 172.21.15.175:0/4003940403 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bd8109110 con 0x7f6bd81038b0 2024-09-19T08:37:45.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.704+0000 7f6bd5ffb640 1 -- 172.21.15.175:0/4003940403 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f6bd0005560 con 0x7f6bd81038b0 2024-09-19T08:37:45.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.705+0000 7f6bd5ffb640 1 --2- 172.21.15.175:0/4003940403 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6bc40a3260 0x7f6bc40a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:45.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.705+0000 7f6bd5ffb640 1 -- 172.21.15.175:0/4003940403 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f6bd00ce060 con 0x7f6bd81038b0 2024-09-19T08:37:45.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.705+0000 7f6bd7fff640 1 --2- 172.21.15.175:0/4003940403 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6bc40a3260 0x7f6bc40a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:45.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.706+0000 7f6bd7fff640 1 --2- 172.21.15.175:0/4003940403 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6bc40a3260 0x7f6bc40a5720 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8031440 tx=0x7f6bc8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:45.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.709+0000 7f6bd5ffb640 1 -- 172.21.15.175:0/4003940403 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6bd0016030 con 0x7f6bd81038b0 2024-09-19T08:37:45.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:45 smithi175 ceph-mon[35688]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:37:45.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:45 smithi175 ceph-mon[35688]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:37:45.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:45 smithi175 ceph-mon[35688]: from='osd.1 [v2:172.21.15.44:6800/2213694259,v1:172.21.15.44:6801/2213694259]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:37:45.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:45 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:37:45.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:45 smithi175 ceph-mon[35688]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:37:45.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:45 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:45.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:45 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:45.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:45 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:37:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:45 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:45 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:45 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:45 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:45.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:45 smithi175 ceph-mon[35688]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-19T08:37:45.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:37:45.887+0000 7f6bde419640 1 -- 172.21.15.175:0/4003940403 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f6bd8102730 con 0x7f6bc40a3260 2024-09-19T08:37:46.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:45 smithi007 ceph-mon[31221]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:37:46.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:45 smithi007 ceph-mon[31221]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:37:46.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:45 smithi007 ceph-mon[31221]: from='osd.1 [v2:172.21.15.44:6800/2213694259,v1:172.21.15.44:6801/2213694259]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:37:46.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:45 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:37:46.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:45 smithi007 ceph-mon[31221]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:37:46.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:45 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:46.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:45 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:46.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:45 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:37:46.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:45 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:46.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:45 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:46.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:45 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:46.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:45 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:46.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:45 smithi007 ceph-mon[31221]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-19T08:37:46.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:45 smithi044 ceph-mon[35072]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:37:46.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:45 smithi044 ceph-mon[35072]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:37:46.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:45 smithi044 ceph-mon[35072]: from='osd.1 [v2:172.21.15.44:6800/2213694259,v1:172.21.15.44:6801/2213694259]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:37:46.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:45 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:37:46.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:45 smithi044 ceph-mon[35072]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:37:46.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:45 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:46.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:45 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:46.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:45 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:37:46.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:45 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:46.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:45 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:46.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:45 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:37:46.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:45 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:37:46.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:45 smithi044 ceph-mon[35072]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-19T08:37:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:46 smithi044 ceph-mon[35072]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:46 smithi044 ceph-mon[35072]: Detected new or changed devices on smithi044 2024-09-19T08:37:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:46 smithi044 ceph-mon[35072]: Adjusting osd_memory_target on smithi044 to 17092M 2024-09-19T08:37:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:46 smithi044 ceph-mon[35072]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T08:37:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:46 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:37:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:46 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:37:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:46 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:37:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:46 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:37:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:46 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:46.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:46 smithi044 ceph-mon[35072]: from='osd.1 ' entity='osd.1' 2024-09-19T08:37:46.802 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:37:46 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-1[39565]: 2024-09-19T08:37:46.372+0000 7f592207b640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T08:37:46.802 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:37:46 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-1[39565]: 2024-09-19T08:37:46.381+0000 7f5919676640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:37:46.864 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:46 smithi175 ceph-mon[35688]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:46.864 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:46 smithi175 ceph-mon[35688]: Detected new or changed devices on smithi044 2024-09-19T08:37:46.864 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:46 smithi175 ceph-mon[35688]: Adjusting osd_memory_target on smithi044 to 17092M 2024-09-19T08:37:46.864 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:46 smithi175 ceph-mon[35688]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T08:37:46.864 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:46 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:37:46.864 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:46 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:37:46.864 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:46 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:37:46.864 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:46 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:37:46.864 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:46 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:46.865 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:46 smithi175 ceph-mon[35688]: from='osd.1 ' entity='osd.1' 2024-09-19T08:37:47.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:46 smithi007 ceph-mon[31221]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:47.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:46 smithi007 ceph-mon[31221]: Detected new or changed devices on smithi044 2024-09-19T08:37:47.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:46 smithi007 ceph-mon[31221]: Adjusting osd_memory_target on smithi044 to 17092M 2024-09-19T08:37:47.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:46 smithi007 ceph-mon[31221]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T08:37:47.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:46 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:37:47.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:46 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:37:47.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:46 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:37:47.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:46 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:37:47.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:46 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:47.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:46 smithi007 ceph-mon[31221]: from='osd.1 ' entity='osd.1' 2024-09-19T08:37:47.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:47 smithi175 ceph-mon[35688]: purged_snaps scrub starts 2024-09-19T08:37:47.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:47 smithi175 ceph-mon[35688]: purged_snaps scrub ok 2024-09-19T08:37:47.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:47 smithi175 ceph-mon[35688]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:37:47.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:47 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:37:47.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:47 smithi175 ceph-mon[35688]: osd.1 [v2:172.21.15.44:6800/2213694259,v1:172.21.15.44:6801/2213694259] boot 2024-09-19T08:37:47.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:47 smithi175 ceph-mon[35688]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T08:37:47.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:47 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:37:47.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:47 smithi044 ceph-mon[35072]: purged_snaps scrub starts 2024-09-19T08:37:47.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:47 smithi044 ceph-mon[35072]: purged_snaps scrub ok 2024-09-19T08:37:47.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:47 smithi044 ceph-mon[35072]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:37:47.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:47 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:37:47.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:47 smithi044 ceph-mon[35072]: osd.1 [v2:172.21.15.44:6800/2213694259,v1:172.21.15.44:6801/2213694259] boot 2024-09-19T08:37:47.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:47 smithi044 ceph-mon[35072]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T08:37:47.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:47 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:37:47.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:47 smithi007 ceph-mon[31221]: purged_snaps scrub starts 2024-09-19T08:37:47.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:47 smithi007 ceph-mon[31221]: purged_snaps scrub ok 2024-09-19T08:37:47.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:47 smithi007 ceph-mon[31221]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:37:47.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:47 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:37:47.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:47 smithi007 ceph-mon[31221]: osd.1 [v2:172.21.15.44:6800/2213694259,v1:172.21.15.44:6801/2213694259] boot 2024-09-19T08:37:47.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:47 smithi007 ceph-mon[31221]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T08:37:47.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:47 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:37:48.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:48 smithi175 ceph-mon[35688]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:48.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:48 smithi175 ceph-mon[35688]: from='client.? 172.21.15.175:0/352307190' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37c1cc2b-60ea-449f-baa7-c65d96c3559c"}]: dispatch 2024-09-19T08:37:48.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:48 smithi175 ceph-mon[35688]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37c1cc2b-60ea-449f-baa7-c65d96c3559c"}]: dispatch 2024-09-19T08:37:48.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:48 smithi175 ceph-mon[35688]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37c1cc2b-60ea-449f-baa7-c65d96c3559c"}]': finished 2024-09-19T08:37:48.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:48 smithi175 ceph-mon[35688]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T08:37:48.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:48 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:37:48.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:48 smithi175 ceph-mon[35688]: from='client.? 172.21.15.175:0/3106150008' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:37:49.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:48 smithi007 ceph-mon[31221]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:49.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:48 smithi007 ceph-mon[31221]: from='client.? 172.21.15.175:0/352307190' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37c1cc2b-60ea-449f-baa7-c65d96c3559c"}]: dispatch 2024-09-19T08:37:49.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:48 smithi007 ceph-mon[31221]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37c1cc2b-60ea-449f-baa7-c65d96c3559c"}]: dispatch 2024-09-19T08:37:49.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:48 smithi007 ceph-mon[31221]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37c1cc2b-60ea-449f-baa7-c65d96c3559c"}]': finished 2024-09-19T08:37:49.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:48 smithi007 ceph-mon[31221]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T08:37:49.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:48 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:37:49.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:48 smithi007 ceph-mon[31221]: from='client.? 172.21.15.175:0/3106150008' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:37:49.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:48 smithi044 ceph-mon[35072]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:37:49.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:48 smithi044 ceph-mon[35072]: from='client.? 172.21.15.175:0/352307190' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37c1cc2b-60ea-449f-baa7-c65d96c3559c"}]: dispatch 2024-09-19T08:37:49.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:48 smithi044 ceph-mon[35072]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37c1cc2b-60ea-449f-baa7-c65d96c3559c"}]: dispatch 2024-09-19T08:37:49.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:48 smithi044 ceph-mon[35072]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37c1cc2b-60ea-449f-baa7-c65d96c3559c"}]': finished 2024-09-19T08:37:49.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:48 smithi044 ceph-mon[35072]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T08:37:49.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:48 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:37:49.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:48 smithi044 ceph-mon[35072]: from='client.? 172.21.15.175:0/3106150008' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:37:50.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:50 smithi175 ceph-mon[35688]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:37:51.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:50 smithi007 ceph-mon[31221]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:37:51.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:50 smithi044 ceph-mon[35072]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:37:52.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:52 smithi175 ceph-mon[35688]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:37:53.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:52 smithi007 ceph-mon[31221]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:37:53.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:52 smithi044 ceph-mon[35072]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:37:54.878 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:54 smithi175 ceph-mon[35688]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:37:55.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:54 smithi007 ceph-mon[31221]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:37:55.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:54 smithi044 ceph-mon[35072]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:37:56.921 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:56 smithi175 ceph-mon[35688]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:37:56.921 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:56 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:37:56.921 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:56 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:57.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:56 smithi007 ceph-mon[31221]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:37:57.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:37:57.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:57.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:56 smithi044 ceph-mon[35072]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:37:57.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:56 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:37:57.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:56 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:37:57.820 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:57 smithi175 ceph-mon[35688]: Deploying daemon osd.2 on smithi175 2024-09-19T08:37:58.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:57 smithi007 ceph-mon[31221]: Deploying daemon osd.2 on smithi175 2024-09-19T08:37:58.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:57 smithi044 ceph-mon[35072]: Deploying daemon osd.2 on smithi175 2024-09-19T08:37:58.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:37:58 smithi175 ceph-mon[35688]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:37:59.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:37:58 smithi007 ceph-mon[31221]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:37:59.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:37:58 smithi044 ceph-mon[35072]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:00.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:00 smithi175 ceph-mon[35688]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:01.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:00 smithi007 ceph-mon[31221]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:01.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:00 smithi044 ceph-mon[35072]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:02.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:02 smithi175 ceph-mon[35688]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:02.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:02 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:02.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:02 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:02.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:02 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:03.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:02 smithi007 ceph-mon[31221]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:03.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:02 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:03.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:02 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:03.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:02 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:03.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:02 smithi044 ceph-mon[35072]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:03.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:02 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:03.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:02 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:03.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:02 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:04.702 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:04 smithi175 ceph-mon[35688]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:04.702 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:04.702 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:04.703 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:04.703 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:04.703 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:05.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:04 smithi007 ceph-mon[31221]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:05.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:05.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:05.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:05.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:05.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:05.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:04 smithi044 ceph-mon[35072]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:05.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:05.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:05.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:05.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:05.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:06.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:38:06.486+0000 7f6bd5ffb640 1 -- 172.21.15.175:0/4003940403 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6bd8102730 con 0x7f6bc40a3260 2024-09-19T08:38:06.486 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 2 on host 'smithi175' 2024-09-19T08:38:06.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:38:06.488+0000 7f6bde419640 1 -- 172.21.15.175:0/4003940403 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6bc40a3260 msgr2=0x7f6bc40a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:06.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:38:06.488+0000 7f6bde419640 1 --2- 172.21.15.175:0/4003940403 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6bc40a3260 0x7f6bc40a5720 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8031440 tx=0x7f6bc8000bc0 comp rx=0 tx=0).stop 2024-09-19T08:38:06.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:38:06.488+0000 7f6bde419640 1 -- 172.21.15.175:0/4003940403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bd81038b0 msgr2=0x7f6bd819f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:06.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:38:06.488+0000 7f6bde419640 1 --2- 172.21.15.175:0/4003940403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bd81038b0 0x7f6bd819f500 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000eaa0 tx=0x7f6bd000ef60 comp rx=0 tx=0).stop 2024-09-19T08:38:06.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:38:06.488+0000 7f6bde419640 1 -- 172.21.15.175:0/4003940403 shutdown_connections 2024-09-19T08:38:06.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:38:06.488+0000 7f6bde419640 1 --2- 172.21.15.175:0/4003940403 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6bc40a3260 0x7f6bc40a5720 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:06.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:38:06.488+0000 7f6bde419640 1 --2- 172.21.15.175:0/4003940403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bd81038b0 0x7f6bd819f500 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:06.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:38:06.488+0000 7f6bde419640 1 --2- 172.21.15.175:0/4003940403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6bd8102ef0 0x7f6bd8198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:06.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:38:06.488+0000 7f6bde419640 1 --2- 172.21.15.175:0/4003940403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6bd80fff10 0x7f6bd8197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:06.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:38:06.488+0000 7f6bde419640 1 -- 172.21.15.175:0/4003940403 >> 172.21.15.175:0/4003940403 conn(0x7f6bd80fba80 msgr2=0x7f6bd81062e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:06.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:38:06.489+0000 7f6bde419640 1 -- 172.21.15.175:0/4003940403 shutdown_connections 2024-09-19T08:38:06.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:38:06.489+0000 7f6bde419640 1 -- 172.21.15.175:0/4003940403 wait complete. 2024-09-19T08:38:06.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:06 smithi175 ceph-mon[35688]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:06.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:06 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:06.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:06 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:06.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:06 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:07.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:06 smithi007 ceph-mon[31221]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:07.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:06 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:07.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:06 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:07.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:06 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:07.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:06 smithi044 ceph-mon[35072]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:07.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:06 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:07.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:06 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:07.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:06 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:07.125 DEBUG:teuthology.orchestra.run.smithi175:osd.2> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T08:38:07.128 INFO:tasks.cephadm:Deploying osd.3 on smithi007 with /dev/vg_nvme/lv_3... 2024-09-19T08:38:07.128 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:38:07.394 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:38:08.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:08 smithi007 ceph-mon[31221]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:08.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:08 smithi175 ceph-mon[35688]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:08.929 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:38:08 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-2[40655]: 2024-09-19T08:38:08.685+0000 7f48a78a5640 -1 osd.2 0 log_to_monitors true 2024-09-19T08:38:09.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:08 smithi044 ceph-mon[35072]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:09.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:09 smithi007 ceph-mon[31221]: from='osd.2 [v2:172.21.15.175:6800/3413002145,v1:172.21.15.175:6801/3413002145]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:38:09.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:09 smithi007 ceph-mon[31221]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:38:09.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:09 smithi175 ceph-mon[35688]: from='osd.2 [v2:172.21.15.175:6800/3413002145,v1:172.21.15.175:6801/3413002145]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:38:09.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:09 smithi175 ceph-mon[35688]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:38:10.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:09 smithi044 ceph-mon[35072]: from='osd.2 [v2:172.21.15.175:6800/3413002145,v1:172.21.15.175:6801/3413002145]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:38:10.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:09 smithi044 ceph-mon[35072]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:38:10.058 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:38:10.084 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_3 2024-09-19T08:38:10.340 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:38:10.743 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:10 smithi007 ceph-mon[31221]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:10.744 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:10 smithi007 ceph-mon[31221]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:38:10.744 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:10 smithi007 ceph-mon[31221]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T08:38:10.744 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:10 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:10.744 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:10 smithi007 ceph-mon[31221]: from='osd.2 [v2:172.21.15.175:6800/3413002145,v1:172.21.15.175:6801/3413002145]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:38:10.744 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:10 smithi007 ceph-mon[31221]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:38:10.744 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:10 smithi007 ceph-mon[31221]: Detected new or changed devices on smithi175 2024-09-19T08:38:10.744 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:10 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:10.744 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:10 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:10.744 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:10 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:38:10.744 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:10 smithi007 ceph-mon[31221]: Adjusting osd_memory_target on smithi175 to 17088M 2024-09-19T08:38:10.744 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:10 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:10.744 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:10 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:10.745 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:10 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:10.745 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:10 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:10.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.755+0000 7f4bd59cc640 1 -- 172.21.15.7:0/1901485682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd01026e0 msgr2=0x7f4bd0104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:10.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.755+0000 7f4bd59cc640 1 --2- 172.21.15.7:0/1901485682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd01026e0 0x7f4bd0104ad0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0009ca0 tx=0x7f4bc002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.755+0000 7f4bd59cc640 1 -- 172.21.15.7:0/1901485682 shutdown_connections 2024-09-19T08:38:10.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.755+0000 7f4bd59cc640 1 --2- 172.21.15.7:0/1901485682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd0107940 0x7f4bd0109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.755+0000 7f4bd59cc640 1 --2- 172.21.15.7:0/1901485682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bd0105010 0x7f4bd0107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.755+0000 7f4bd59cc640 1 --2- 172.21.15.7:0/1901485682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd01026e0 0x7f4bd0104ad0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.755+0000 7f4bd59cc640 1 -- 172.21.15.7:0/1901485682 >> 172.21.15.7:0/1901485682 conn(0x7f4bd00fc280 msgr2=0x7f4bd00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:10.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.755+0000 7f4bd59cc640 1 -- 172.21.15.7:0/1901485682 shutdown_connections 2024-09-19T08:38:10.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.755+0000 7f4bd59cc640 1 -- 172.21.15.7:0/1901485682 wait complete. 2024-09-19T08:38:10.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.755+0000 7f4bd59cc640 1 Processor -- start 2024-09-19T08:38:10.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.756+0000 7f4bd59cc640 1 -- start start 2024-09-19T08:38:10.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.756+0000 7f4bd59cc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd01026e0 0x7f4bd0102040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:10.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.756+0000 7f4bd59cc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bd0105010 0x7f4bd0100690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:10.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.756+0000 7f4bd59cc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd0107940 0x7f4bd0100bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:10.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.756+0000 7f4bd59cc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd010d860 con 0x7f4bd01026e0 2024-09-19T08:38:10.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.756+0000 7f4bd59cc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd010d6e0 con 0x7f4bd0107940 2024-09-19T08:38:10.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.756+0000 7f4bd59cc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd010d9e0 con 0x7f4bd0105010 2024-09-19T08:38:10.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.756+0000 7f4bceffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd01026e0 0x7f4bd0102040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:10.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.756+0000 7f4bceffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd01026e0 0x7f4bd0102040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34130/0 (socket says 172.21.15.7:34130) 2024-09-19T08:38:10.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.756+0000 7f4bceffd640 1 -- 172.21.15.7:0/1805602695 learned_addr learned my addr 172.21.15.7:0/1805602695 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:38:10.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.756+0000 7f4bcf7fe640 1 --2- 172.21.15.7:0/1805602695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd0107940 0x7f4bd0100bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:10.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.756+0000 7f4bce7fc640 1 --2- 172.21.15.7:0/1805602695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bd0105010 0x7f4bd0100690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:10.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.756+0000 7f4bceffd640 1 -- 172.21.15.7:0/1805602695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bd0105010 msgr2=0x7f4bd0100690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:10.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.756+0000 7f4bceffd640 1 --2- 172.21.15.7:0/1805602695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bd0105010 0x7f4bd0100690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.756+0000 7f4bceffd640 1 -- 172.21.15.7:0/1805602695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd0107940 msgr2=0x7f4bd0100bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:10.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.756+0000 7f4bceffd640 1 --2- 172.21.15.7:0/1805602695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd0107940 0x7f4bd0100bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.756+0000 7f4bceffd640 1 -- 172.21.15.7:0/1805602695 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd0101490 con 0x7f4bd01026e0 2024-09-19T08:38:10.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.756+0000 7f4bcf7fe640 1 --2- 172.21.15.7:0/1805602695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd0107940 0x7f4bd0100bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:10.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.756+0000 7f4bceffd640 1 --2- 172.21.15.7:0/1805602695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd01026e0 0x7f4bd0102040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0031a40 tx=0x7f4bc0031ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:10.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.757+0000 7f4bd49ca640 1 -- 172.21.15.7:0/1805602695 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc002faa0 con 0x7f4bd01026e0 2024-09-19T08:38:10.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.757+0000 7f4bd59cc640 1 -- 172.21.15.7:0/1805602695 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd01a2040 con 0x7f4bd01026e0 2024-09-19T08:38:10.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.757+0000 7f4bd49ca640 1 -- 172.21.15.7:0/1805602695 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bc002fc40 con 0x7f4bd01026e0 2024-09-19T08:38:10.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.757+0000 7f4bd49ca640 1 -- 172.21.15.7:0/1805602695 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc003a790 con 0x7f4bd01026e0 2024-09-19T08:38:10.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.757+0000 7f4bd59cc640 1 -- 172.21.15.7:0/1805602695 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd01a2550 con 0x7f4bd01026e0 2024-09-19T08:38:10.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.758+0000 7f4bd59cc640 1 -- 172.21.15.7:0/1805602695 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd00fdd70 con 0x7f4bd01026e0 2024-09-19T08:38:10.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.759+0000 7f4bd49ca640 1 -- 172.21.15.7:0/1805602695 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f4bc0030b30 con 0x7f4bd01026e0 2024-09-19T08:38:10.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.760+0000 7f4bd49ca640 1 --2- 172.21.15.7:0/1805602695 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4bb80a31b0 0x7f4bb80a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:10.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.760+0000 7f4bce7fc640 1 --2- 172.21.15.7:0/1805602695 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4bb80a31b0 0x7f4bb80a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:10.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.760+0000 7f4bd49ca640 1 -- 172.21.15.7:0/1805602695 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7f4bc00ef920 con 0x7f4bd01026e0 2024-09-19T08:38:10.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.761+0000 7f4bce7fc640 1 --2- 172.21.15.7:0/1805602695 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4bb80a31b0 0x7f4bb80a5670 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0101dc0 tx=0x7f4bc400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:10.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.764+0000 7f4bd49ca640 1 -- 172.21.15.7:0/1805602695 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4bc00bdd90 con 0x7f4bd01026e0 2024-09-19T08:38:10.928 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:38:10 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-2[40655]: 2024-09-19T08:38:10.653+0000 7f48a3005640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T08:38:10.928 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:38:10 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-2[40655]: 2024-09-19T08:38:10.657+0000 7f489f63f640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:38:10.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:10 smithi175 ceph-mon[35688]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:10.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:10 smithi175 ceph-mon[35688]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:38:10.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:10 smithi175 ceph-mon[35688]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T08:38:10.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:10 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:10.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:10 smithi175 ceph-mon[35688]: from='osd.2 [v2:172.21.15.175:6800/3413002145,v1:172.21.15.175:6801/3413002145]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:38:10.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:10 smithi175 ceph-mon[35688]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:38:10.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:10 smithi175 ceph-mon[35688]: Detected new or changed devices on smithi175 2024-09-19T08:38:10.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:10 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:10.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:10 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:10.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:10 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:38:10.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:10 smithi175 ceph-mon[35688]: Adjusting osd_memory_target on smithi175 to 17088M 2024-09-19T08:38:10.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:10 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:10.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:10 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:10.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:10 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:10.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:10 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:10.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:10.950+0000 7f4bd59cc640 1 -- 172.21.15.7:0/1805602695 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f4bd0062630 con 0x7f4bb80a31b0 2024-09-19T08:38:11.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:10 smithi044 ceph-mon[35072]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:11.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:10 smithi044 ceph-mon[35072]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:38:11.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:10 smithi044 ceph-mon[35072]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T08:38:11.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:10 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:11.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:10 smithi044 ceph-mon[35072]: from='osd.2 [v2:172.21.15.175:6800/3413002145,v1:172.21.15.175:6801/3413002145]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:38:11.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:10 smithi044 ceph-mon[35072]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:38:11.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:10 smithi044 ceph-mon[35072]: Detected new or changed devices on smithi175 2024-09-19T08:38:11.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:10 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:11.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:10 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:11.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:10 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:38:11.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:10 smithi044 ceph-mon[35072]: Adjusting osd_memory_target on smithi175 to 17088M 2024-09-19T08:38:11.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:10 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:11.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:10 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:11.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:10 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:11.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:10 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:11.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:11 smithi175 ceph-mon[35688]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-19T08:38:11.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:11 smithi175 ceph-mon[35688]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T08:38:11.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:11 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:11.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:11 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:11.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:11 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:38:11.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:11 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:38:11.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:11 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:12.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:11 smithi007 ceph-mon[31221]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-19T08:38:12.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:11 smithi007 ceph-mon[31221]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T08:38:12.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:11 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:12.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:11 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:12.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:11 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:38:12.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:11 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:38:12.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:11 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:12.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:11 smithi044 ceph-mon[35072]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-19T08:38:12.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:11 smithi044 ceph-mon[35072]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T08:38:12.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:11 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:12.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:11 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:12.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:11 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:38:12.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:11 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:38:12.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:11 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:12.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:12 smithi007 ceph-mon[31221]: purged_snaps scrub starts 2024-09-19T08:38:12.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:12 smithi007 ceph-mon[31221]: purged_snaps scrub ok 2024-09-19T08:38:12.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:12 smithi007 ceph-mon[31221]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:12.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:12 smithi007 ceph-mon[31221]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:38:12.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:12 smithi007 ceph-mon[31221]: osd.2 [v2:172.21.15.175:6800/3413002145,v1:172.21.15.175:6801/3413002145] boot 2024-09-19T08:38:12.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:12 smithi007 ceph-mon[31221]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T08:38:12.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:12 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:12.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:12 smithi175 ceph-mon[35688]: purged_snaps scrub starts 2024-09-19T08:38:12.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:12 smithi175 ceph-mon[35688]: purged_snaps scrub ok 2024-09-19T08:38:12.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:12 smithi175 ceph-mon[35688]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:12.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:12 smithi175 ceph-mon[35688]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:38:12.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:12 smithi175 ceph-mon[35688]: osd.2 [v2:172.21.15.175:6800/3413002145,v1:172.21.15.175:6801/3413002145] boot 2024-09-19T08:38:12.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:12 smithi175 ceph-mon[35688]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T08:38:12.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:12 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:13.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:12 smithi044 ceph-mon[35072]: purged_snaps scrub starts 2024-09-19T08:38:13.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:12 smithi044 ceph-mon[35072]: purged_snaps scrub ok 2024-09-19T08:38:13.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:12 smithi044 ceph-mon[35072]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:38:13.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:12 smithi044 ceph-mon[35072]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:38:13.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:12 smithi044 ceph-mon[35072]: osd.2 [v2:172.21.15.175:6800/3413002145,v1:172.21.15.175:6801/3413002145] boot 2024-09-19T08:38:13.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:12 smithi044 ceph-mon[35072]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T08:38:13.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:12 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:38:13.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:13 smithi175 ceph-mon[35688]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T08:38:13.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:13 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:38:13.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:13 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3495721482' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8ffd2ae-4211-492a-a8ac-d4d6cbb4a03d"}]: dispatch 2024-09-19T08:38:13.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:13 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:38:13.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:13 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3495721482' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a8ffd2ae-4211-492a-a8ac-d4d6cbb4a03d"}]': finished 2024-09-19T08:38:13.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:13 smithi175 ceph-mon[35688]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T08:38:13.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:13 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:13.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:13 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:38:14.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:13 smithi007 ceph-mon[31221]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T08:38:14.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:13 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:38:14.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:13 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3495721482' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8ffd2ae-4211-492a-a8ac-d4d6cbb4a03d"}]: dispatch 2024-09-19T08:38:14.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:13 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:38:14.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:13 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3495721482' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a8ffd2ae-4211-492a-a8ac-d4d6cbb4a03d"}]': finished 2024-09-19T08:38:14.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:13 smithi007 ceph-mon[31221]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T08:38:14.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:13 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:14.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:13 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:38:14.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:13 smithi044 ceph-mon[35072]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T08:38:14.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:13 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:38:14.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:13 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3495721482' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8ffd2ae-4211-492a-a8ac-d4d6cbb4a03d"}]: dispatch 2024-09-19T08:38:14.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:13 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:38:14.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:13 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3495721482' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a8ffd2ae-4211-492a-a8ac-d4d6cbb4a03d"}]': finished 2024-09-19T08:38:14.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:13 smithi044 ceph-mon[35072]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T08:38:14.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:13 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:14.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:13 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:38:14.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:14 smithi175 ceph-mon[35688]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:14.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:14 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3531317083' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:38:14.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:14 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:38:14.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:14 smithi175 ceph-mon[35688]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T08:38:14.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:14 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:15.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:14 smithi007 ceph-mon[31221]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:15.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:14 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3531317083' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:38:15.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:14 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:38:15.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:14 smithi007 ceph-mon[31221]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T08:38:15.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:14 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:15.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:14 smithi044 ceph-mon[35072]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:15.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:14 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3531317083' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:38:15.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:14 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:38:15.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:14 smithi044 ceph-mon[35072]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T08:38:15.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:14 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:15.533 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:38:15 smithi007 sudo[49894]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:38:15.533 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:38:15 smithi007 sudo[49894]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:15.534 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:38:15 smithi007 sudo[49894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:15.534 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:38:15 smithi007 sudo[49894]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:15.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:15.678+0000 7f4bd49ca640 1 -- 172.21.15.7:0/1805602695 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f4bc00b9d00 con 0x7f4bd01026e0 2024-09-19T08:38:16.033 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:38:15 smithi007 sudo[50269]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:38:16.033 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:38:15 smithi007 sudo[50269]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:16.033 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:38:15 smithi007 sudo[50269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:16.033 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:38:15 smithi007 sudo[50269]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:16.206 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:38:15 smithi044 sudo[43290]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:38:16.206 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:38:15 smithi044 sudo[43290]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:16.206 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:38:15 smithi044 sudo[43290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:16.206 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:38:15 smithi044 sudo[43290]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:16.488 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:38:16 smithi044 sudo[43293]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:38:16.488 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:38:16 smithi044 sudo[43293]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:16.488 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:38:16 smithi044 sudo[43293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:16.489 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:38:16 smithi044 sudo[43293]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:16.728 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:16 smithi175 ceph-mon[35688]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:16.729 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:16 smithi175 ceph-mon[35688]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T08:38:16.729 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:16 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:16.729 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:16 smithi175 ceph-mon[35688]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T08:38:16.729 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:16 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:16.729 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:16 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:16.729 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:38:16 smithi175 sudo[44311]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:38:16.729 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:38:16 smithi175 sudo[44311]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:16.729 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:38:16 smithi175 sudo[44311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:16.729 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:38:16 smithi175 sudo[44311]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:16.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:16 smithi007 ceph-mon[31221]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:16.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:16 smithi007 ceph-mon[31221]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T08:38:16.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:16 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:16.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:16 smithi007 ceph-mon[31221]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T08:38:16.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:16 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:16.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:16 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:16.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:16 smithi044 ceph-mon[35072]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:16 smithi044 ceph-mon[35072]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T08:38:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:16 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:16 smithi044 ceph-mon[35072]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T08:38:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:16 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:16 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:17.178 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:38:16 smithi175 sudo[44314]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:38:17.178 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:38:16 smithi175 sudo[44314]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:17.178 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:38:16 smithi175 sudo[44314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:17.178 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:38:16 smithi175 sudo[44314]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:17.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:17 smithi007 sudo[50653]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:38:17.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:17 smithi007 sudo[50653]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:17.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:17 smithi007 sudo[50653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:17.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:17 smithi007 sudo[50653]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:18.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:17 smithi007 sudo[50844]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:38:18.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:17 smithi007 sudo[50844]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:18.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:17 smithi007 sudo[50844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:18.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:17 smithi007 sudo[50844]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:18.154 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:17 smithi175 sudo[44317]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:38:18.154 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:17 smithi175 sudo[44317]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:18.154 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:17 smithi175 sudo[44317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:18.154 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:17 smithi175 sudo[44317]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:18.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:18 smithi175 sudo[44320]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:38:18.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:18 smithi175 sudo[44320]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:18.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:18 smithi175 sudo[44320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:18.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:18 smithi175 sudo[44320]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:18.680 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:18 smithi044 sudo[43296]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:38:18.681 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:18 smithi044 sudo[43296]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:18.681 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:18 smithi044 sudo[43296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:18.681 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:18 smithi044 sudo[43296]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:19.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:19.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:18 smithi007 ceph-mon[31221]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:38:19.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:18 smithi007 ceph-mon[31221]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:19.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:18 smithi007 ceph-mon[31221]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:38:19.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:38:19.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:38:19.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:38:19.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:38:19.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:38:19.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:38:19.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:18 smithi044 sudo[43301]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:38:19.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:18 smithi044 sudo[43301]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:38:19.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:18 smithi044 sudo[43301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:38:19.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:18 smithi044 sudo[43301]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:38:19.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:18 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:19.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:18 smithi044 ceph-mon[35072]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:38:19.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:18 smithi044 ceph-mon[35072]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:19.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:18 smithi044 ceph-mon[35072]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:38:19.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:18 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:38:19.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:18 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:38:19.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:18 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:38:19.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:18 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:38:19.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:18 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:38:19.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:18 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:38:19.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:18 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:19.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:18 smithi175 ceph-mon[35688]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:38:19.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:18 smithi175 ceph-mon[35688]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:19.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:18 smithi175 ceph-mon[35688]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:38:19.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:18 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:38:19.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:18 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:38:19.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:18 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:38:19.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:18 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:38:19.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:18 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:38:19.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:18 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:38:19.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:19 smithi007 ceph-mon[31221]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:38:19.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:19 smithi007 ceph-mon[31221]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:38:19.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:19 smithi007 ceph-mon[31221]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:38:19.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:19 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:38:19.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:19 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:38:19.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:19 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:38:19.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:19 smithi007 ceph-mon[31221]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:38:20.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:19 smithi044 ceph-mon[35072]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:38:20.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:19 smithi044 ceph-mon[35072]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:38:20.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:19 smithi044 ceph-mon[35072]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:38:20.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:19 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:38:20.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:19 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:38:20.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:19 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:38:20.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:19 smithi044 ceph-mon[35072]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:38:20.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:19 smithi175 ceph-mon[35688]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:38:20.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:19 smithi175 ceph-mon[35688]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:38:20.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:19 smithi175 ceph-mon[35688]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:38:20.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:19 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:38:20.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:19 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:38:20.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:19 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:38:20.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:19 smithi175 ceph-mon[35688]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:38:21.026 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:20 smithi007 ceph-mon[31221]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:21.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:20 smithi044 ceph-mon[35072]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:21.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:20 smithi175 ceph-mon[35688]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:23.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:22 smithi007 ceph-mon[31221]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:23.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:22 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:38:23.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:22 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:23.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:22 smithi044 ceph-mon[35072]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:23.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:22 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:38:23.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:22 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:23.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:22 smithi175 ceph-mon[35688]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:23.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:22 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:38:23.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:22 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:23.979 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:23 smithi007 ceph-mon[31221]: Deploying daemon osd.3 on smithi007 2024-09-19T08:38:24.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:23 smithi044 ceph-mon[35072]: Deploying daemon osd.3 on smithi007 2024-09-19T08:38:24.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:23 smithi175 ceph-mon[35688]: Deploying daemon osd.3 on smithi007 2024-09-19T08:38:24.711 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:24 smithi007 ceph-mon[31221]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-19T08:38:25.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:24 smithi044 ceph-mon[35072]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-19T08:38:25.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:24 smithi175 ceph-mon[35688]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-19T08:38:26.979 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:26 smithi007 ceph-mon[31221]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T08:38:27.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:26 smithi044 ceph-mon[35072]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T08:38:27.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:26 smithi175 ceph-mon[35688]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T08:38:28.928 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:28 smithi007 ceph-mon[31221]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T08:38:28.928 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:28 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:28.928 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:28 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:28.928 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:28 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:29.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:28 smithi044 ceph-mon[35072]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T08:38:29.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:28 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:29.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:28 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:29.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:28 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:29.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:28 smithi175 ceph-mon[35688]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T08:38:29.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:28 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:29.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:28 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:29.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:28 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:31.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:30 smithi007 ceph-mon[31221]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T08:38:31.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:30 smithi044 ceph-mon[35072]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T08:38:31.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:30 smithi175 ceph-mon[35688]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T08:38:32.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:32 smithi007 ceph-mon[31221]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T08:38:32.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:32 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:32.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:32 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:32.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:32 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:32.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:32 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:32.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:32 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:32.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:32 smithi044 ceph-mon[35072]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T08:38:32.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:32 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:32.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:32 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:32.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:32 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:32.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:32 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:32.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:32 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:32.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:32.377+0000 7f4bd49ca640 1 -- 172.21.15.7:0/1805602695 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4bd0062630 con 0x7f4bb80a31b0 2024-09-19T08:38:32.378 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 3 on host 'smithi007' 2024-09-19T08:38:32.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:32.379+0000 7f4bd59cc640 1 -- 172.21.15.7:0/1805602695 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4bb80a31b0 msgr2=0x7f4bb80a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:32.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:32.379+0000 7f4bd59cc640 1 --2- 172.21.15.7:0/1805602695 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4bb80a31b0 0x7f4bb80a5670 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0101dc0 tx=0x7f4bc400a4c0 comp rx=0 tx=0).stop 2024-09-19T08:38:32.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:32.379+0000 7f4bd59cc640 1 -- 172.21.15.7:0/1805602695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd01026e0 msgr2=0x7f4bd0102040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:32.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:32.379+0000 7f4bd59cc640 1 --2- 172.21.15.7:0/1805602695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd01026e0 0x7f4bd0102040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0031a40 tx=0x7f4bc0031ec0 comp rx=0 tx=0).stop 2024-09-19T08:38:32.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:32.379+0000 7f4bd59cc640 1 -- 172.21.15.7:0/1805602695 shutdown_connections 2024-09-19T08:38:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:32.379+0000 7f4bd59cc640 1 --2- 172.21.15.7:0/1805602695 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4bb80a31b0 0x7f4bb80a5670 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:32.379+0000 7f4bd59cc640 1 --2- 172.21.15.7:0/1805602695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd0107940 0x7f4bd0100bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:32.379+0000 7f4bd59cc640 1 --2- 172.21.15.7:0/1805602695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bd0105010 0x7f4bd0100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:32.379+0000 7f4bd59cc640 1 --2- 172.21.15.7:0/1805602695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd01026e0 0x7f4bd0102040 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:32.379+0000 7f4bd59cc640 1 -- 172.21.15.7:0/1805602695 >> 172.21.15.7:0/1805602695 conn(0x7f4bd00fc280 msgr2=0x7f4bd0103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:32.379+0000 7f4bd59cc640 1 -- 172.21.15.7:0/1805602695 shutdown_connections 2024-09-19T08:38:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:38:32.379+0000 7f4bd59cc640 1 -- 172.21.15.7:0/1805602695 wait complete. 2024-09-19T08:38:32.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:32 smithi175 ceph-mon[35688]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T08:38:32.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:32 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:32.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:32 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:32.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:32 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:32.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:32 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:32.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:32 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:33.060 DEBUG:teuthology.orchestra.run.smithi007:osd.3> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T08:38:33.063 INFO:tasks.cephadm:Deploying osd.4 on smithi044 with /dev/vg_nvme/lv_3... 2024-09-19T08:38:33.064 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:38:33.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:33 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:33.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:33 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:33.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:33 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:33.327 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:38:33.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:33 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:33.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:33 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:33.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:33 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:33.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:33 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:33.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:33 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:33.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:33 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:34.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:34 smithi007 ceph-mon[31221]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T08:38:34.629 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:34 smithi044 ceph-mon[35072]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T08:38:34.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:34 smithi175 ceph-mon[35688]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T08:38:34.784 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 08:38:34 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-3[51872]: 2024-09-19T08:38:34.515+0000 7f3e390df640 -1 osd.3 0 log_to_monitors true 2024-09-19T08:38:35.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:35 smithi007 ceph-mon[31221]: from='osd.3 [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:38:35.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:35 smithi044 ceph-mon[35072]: from='osd.3 [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:38:35.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-19T08:38:35.667 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi044:vg_nvme/lv_3 2024-09-19T08:38:35.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:35 smithi175 ceph-mon[35688]: from='osd.3 [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:38:35.925 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:38:36.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.361+0000 7f5e24f09640 1 -- 172.21.15.44:0/3442676125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e200ffed0 msgr2=0x7f5e201002d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:36.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.361+0000 7f5e24f09640 1 --2- 172.21.15.44:0/3442676125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e200ffed0 0x7f5e201002d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009900 tx=0x7f5e1002a410 comp rx=0 tx=0).stop 2024-09-19T08:38:36.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.362+0000 7f5e24f09640 1 -- 172.21.15.44:0/3442676125 shutdown_connections 2024-09-19T08:38:36.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.362+0000 7f5e24f09640 1 --2- 172.21.15.44:0/3442676125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e20103870 0x7f5e2010a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.362+0000 7f5e24f09640 1 --2- 172.21.15.44:0/3442676125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e20102eb0 0x7f5e20103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.362+0000 7f5e24f09640 1 --2- 172.21.15.44:0/3442676125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e200ffed0 0x7f5e201002d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.362+0000 7f5e24f09640 1 -- 172.21.15.44:0/3442676125 >> 172.21.15.44:0/3442676125 conn(0x7f5e200fba40 msgr2=0x7f5e200fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:36.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.362+0000 7f5e24f09640 1 -- 172.21.15.44:0/3442676125 shutdown_connections 2024-09-19T08:38:36.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.362+0000 7f5e24f09640 1 -- 172.21.15.44:0/3442676125 wait complete. 2024-09-19T08:38:36.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.362+0000 7f5e24f09640 1 Processor -- start 2024-09-19T08:38:36.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.362+0000 7f5e24f09640 1 -- start start 2024-09-19T08:38:36.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.363+0000 7f5e24f09640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e200ffed0 0x7f5e20197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.363+0000 7f5e24f09640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e20102eb0 0x7f5e20198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.363+0000 7f5e24f09640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e20103870 0x7f5e2019f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.363+0000 7f5e24f09640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2010d8b0 con 0x7f5e20103870 2024-09-19T08:38:36.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.363+0000 7f5e24f09640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2010d730 con 0x7f5e200ffed0 2024-09-19T08:38:36.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.363+0000 7f5e24f09640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2010da30 con 0x7f5e20102eb0 2024-09-19T08:38:36.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.363+0000 7f5e1e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e200ffed0 0x7f5e20197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.363+0000 7f5e1e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e200ffed0 0x7f5e20197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36714/0 (socket says 172.21.15.44:36714) 2024-09-19T08:38:36.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.363+0000 7f5e1e59c640 1 -- 172.21.15.44:0/188377832 learned_addr learned my addr 172.21.15.44:0/188377832 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-19T08:38:36.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.363+0000 7f5e1ed9d640 1 --2- 172.21.15.44:0/188377832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e20103870 0x7f5e2019f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.363+0000 7f5e1dd9b640 1 --2- 172.21.15.44:0/188377832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e20102eb0 0x7f5e20198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.363+0000 7f5e1e59c640 1 -- 172.21.15.44:0/188377832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e20102eb0 msgr2=0x7f5e20198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:36.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.363+0000 7f5e1e59c640 1 --2- 172.21.15.44:0/188377832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e20102eb0 0x7f5e20198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.363+0000 7f5e1e59c640 1 -- 172.21.15.44:0/188377832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e20103870 msgr2=0x7f5e2019f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:36.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.363+0000 7f5e1e59c640 1 --2- 172.21.15.44:0/188377832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e20103870 0x7f5e2019f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.363+0000 7f5e1e59c640 1 -- 172.21.15.44:0/188377832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2019fb20 con 0x7f5e200ffed0 2024-09-19T08:38:36.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.363+0000 7f5e1ed9d640 1 --2- 172.21.15.44:0/188377832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e20103870 0x7f5e2019f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:36.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.363+0000 7f5e1e59c640 1 --2- 172.21.15.44:0/188377832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e200ffed0 0x7f5e20197ef0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5e10006010 tx=0x7f5e10032c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:36.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.363+0000 7f5e0f7fe640 1 -- 172.21.15.44:0/188377832 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1003f030 con 0x7f5e200ffed0 2024-09-19T08:38:36.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.363+0000 7f5e24f09640 1 -- 172.21.15.44:0/188377832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e2019fdb0 con 0x7f5e200ffed0 2024-09-19T08:38:36.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.363+0000 7f5e0f7fe640 1 -- 172.21.15.44:0/188377832 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e10003ce0 con 0x7f5e200ffed0 2024-09-19T08:38:36.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.363+0000 7f5e0f7fe640 1 -- 172.21.15.44:0/188377832 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e10035070 con 0x7f5e200ffed0 2024-09-19T08:38:36.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.364+0000 7f5e24f09640 1 -- 172.21.15.44:0/188377832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e201a0200 con 0x7f5e200ffed0 2024-09-19T08:38:36.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.364+0000 7f5e24f09640 1 -- 172.21.15.44:0/188377832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e20109050 con 0x7f5e200ffed0 2024-09-19T08:38:36.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.365+0000 7f5e0f7fe640 1 -- 172.21.15.44:0/188377832 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f5e10042030 con 0x7f5e200ffed0 2024-09-19T08:38:36.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.366+0000 7f5e0f7fe640 1 --2- 172.21.15.44:0/188377832 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f5e080a32f0 0x7f5e080a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.366+0000 7f5e0f7fe640 1 -- 172.21.15.44:0/188377832 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3373+0+0 (secure 0 0 0) 0x7f5e100eed20 con 0x7f5e200ffed0 2024-09-19T08:38:36.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.366+0000 7f5e1dd9b640 1 --2- 172.21.15.44:0/188377832 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f5e080a32f0 0x7f5e080a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.367+0000 7f5e1dd9b640 1 --2- 172.21.15.44:0/188377832 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f5e080a32f0 0x7f5e080a57b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5e14005e10 tx=0x7f5e14005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:36.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.371+0000 7f5e0f7fe640 1 -- 172.21.15.44:0/188377832 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5e100bccf0 con 0x7f5e200ffed0 2024-09-19T08:38:36.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:36 smithi044 ceph-mon[35072]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:36.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:36 smithi044 ceph-mon[35072]: from='osd.3 [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:38:36.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:36 smithi044 ceph-mon[35072]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T08:38:36.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:36 smithi044 ceph-mon[35072]: from='osd.3 [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T08:38:36.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:36 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:36.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:36 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:36.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:36 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:36.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:36 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:38:36.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:36 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:38:36.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:36 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:36.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:36 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:36.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:36 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:36.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:36 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:36.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:36.558+0000 7f5e24f09640 1 -- 172.21.15.44:0/188377832 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f5e20062630 con 0x7f5e080a32f0 2024-09-19T08:38:36.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:36 smithi175 ceph-mon[35688]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:36.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:36 smithi175 ceph-mon[35688]: from='osd.3 [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:38:36.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:36 smithi175 ceph-mon[35688]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T08:38:36.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:36 smithi175 ceph-mon[35688]: from='osd.3 [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T08:38:36.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:36.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:36.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:36.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:38:36.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:38:36.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:36.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:36.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:36.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:36 smithi007 ceph-mon[31221]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:36 smithi007 ceph-mon[31221]: from='osd.3 [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:38:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:36 smithi007 ceph-mon[31221]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T08:38:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:36 smithi007 ceph-mon[31221]: from='osd.3 [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T08:38:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:38:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:38:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:37.397 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 08:38:37 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-3[51872]: 2024-09-19T08:38:37.120+0000 7f3e3483f640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T08:38:37.397 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 08:38:37 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-3[51872]: 2024-09-19T08:38:37.127+0000 7f3e2ce71640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:38:37.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:37 smithi044 ceph-mon[35072]: Detected new or changed devices on smithi007 2024-09-19T08:38:37.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:37 smithi044 ceph-mon[35072]: Adjusting osd_memory_target on smithi007 to 8546M 2024-09-19T08:38:37.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:37 smithi044 ceph-mon[35072]: from='osd.3 [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T08:38:37.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:37 smithi044 ceph-mon[35072]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T08:38:37.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:37 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:37.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:37 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:37.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:37 smithi044 ceph-mon[35072]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:38:37.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:37 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:38:37.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:37 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:38:37.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:37 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:37.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:37 smithi044 ceph-mon[35072]: from='osd.3 [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083]' entity='osd.3' 2024-09-19T08:38:37.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:37 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:37.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:37 smithi175 ceph-mon[35688]: Detected new or changed devices on smithi007 2024-09-19T08:38:37.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:37 smithi175 ceph-mon[35688]: Adjusting osd_memory_target on smithi007 to 8546M 2024-09-19T08:38:37.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:37 smithi175 ceph-mon[35688]: from='osd.3 [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T08:38:37.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:37 smithi175 ceph-mon[35688]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T08:38:37.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:37 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:37.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:37 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:37.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:37 smithi175 ceph-mon[35688]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:38:37.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:37 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:38:37.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:37 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:38:37.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:37 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:37.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:37 smithi175 ceph-mon[35688]: from='osd.3 [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083]' entity='osd.3' 2024-09-19T08:38:37.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:37 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:37.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:37 smithi007 ceph-mon[31221]: Detected new or changed devices on smithi007 2024-09-19T08:38:37.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:37 smithi007 ceph-mon[31221]: Adjusting osd_memory_target on smithi007 to 8546M 2024-09-19T08:38:37.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:37 smithi007 ceph-mon[31221]: from='osd.3 [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T08:38:37.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:37 smithi007 ceph-mon[31221]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T08:38:37.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:37 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:37.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:37 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:37.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:37 smithi007 ceph-mon[31221]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:38:37.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:37 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:38:37.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:37 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:38:37.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:37 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:37.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:37 smithi007 ceph-mon[31221]: from='osd.3 [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083]' entity='osd.3' 2024-09-19T08:38:37.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:37 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:38.516 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:38 smithi044 ceph-mon[35072]: purged_snaps scrub starts 2024-09-19T08:38:38.516 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:38 smithi044 ceph-mon[35072]: purged_snaps scrub ok 2024-09-19T08:38:38.516 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:38 smithi044 ceph-mon[35072]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:38.516 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:38 smithi044 ceph-mon[35072]: osd.3 [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083] boot 2024-09-19T08:38:38.517 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:38 smithi044 ceph-mon[35072]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T08:38:38.517 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:38 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:38.517 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:38 smithi044 ceph-mon[35072]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T08:38:38.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:38 smithi175 ceph-mon[35688]: purged_snaps scrub starts 2024-09-19T08:38:38.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:38 smithi175 ceph-mon[35688]: purged_snaps scrub ok 2024-09-19T08:38:38.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:38 smithi175 ceph-mon[35688]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:38.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:38 smithi175 ceph-mon[35688]: osd.3 [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083] boot 2024-09-19T08:38:38.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:38 smithi175 ceph-mon[35688]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T08:38:38.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:38 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:38.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:38 smithi175 ceph-mon[35688]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T08:38:38.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:38 smithi007 ceph-mon[31221]: purged_snaps scrub starts 2024-09-19T08:38:38.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:38 smithi007 ceph-mon[31221]: purged_snaps scrub ok 2024-09-19T08:38:38.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:38 smithi007 ceph-mon[31221]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:38:38.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:38 smithi007 ceph-mon[31221]: osd.3 [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083] boot 2024-09-19T08:38:38.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:38 smithi007 ceph-mon[31221]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T08:38:38.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:38 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:38:38.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:38 smithi007 ceph-mon[31221]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T08:38:39.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:39 smithi175 ceph-mon[35688]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T08:38:39.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:39 smithi175 ceph-mon[35688]: from='client.? 172.21.15.44:0/2166489732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a67b2ec-1a0a-413e-bd13-9532f24a0155"}]: dispatch 2024-09-19T08:38:39.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:39 smithi175 ceph-mon[35688]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a67b2ec-1a0a-413e-bd13-9532f24a0155"}]: dispatch 2024-09-19T08:38:39.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:39 smithi175 ceph-mon[35688]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a67b2ec-1a0a-413e-bd13-9532f24a0155"}]': finished 2024-09-19T08:38:39.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:39 smithi175 ceph-mon[35688]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T08:38:39.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:39 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:38:39.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:39 smithi175 ceph-mon[35688]: from='client.? 172.21.15.44:0/199818003' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:38:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:39 smithi007 ceph-mon[31221]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T08:38:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:39 smithi007 ceph-mon[31221]: from='client.? 172.21.15.44:0/2166489732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a67b2ec-1a0a-413e-bd13-9532f24a0155"}]: dispatch 2024-09-19T08:38:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:39 smithi007 ceph-mon[31221]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a67b2ec-1a0a-413e-bd13-9532f24a0155"}]: dispatch 2024-09-19T08:38:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:39 smithi007 ceph-mon[31221]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a67b2ec-1a0a-413e-bd13-9532f24a0155"}]': finished 2024-09-19T08:38:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:39 smithi007 ceph-mon[31221]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T08:38:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:39 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:38:40.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:39 smithi007 ceph-mon[31221]: from='client.? 172.21.15.44:0/199818003' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:38:40.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:39 smithi044 ceph-mon[35072]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T08:38:40.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:39 smithi044 ceph-mon[35072]: from='client.? 172.21.15.44:0/2166489732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a67b2ec-1a0a-413e-bd13-9532f24a0155"}]: dispatch 2024-09-19T08:38:40.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:39 smithi044 ceph-mon[35072]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a67b2ec-1a0a-413e-bd13-9532f24a0155"}]: dispatch 2024-09-19T08:38:40.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:39 smithi044 ceph-mon[35072]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a67b2ec-1a0a-413e-bd13-9532f24a0155"}]': finished 2024-09-19T08:38:40.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:39 smithi044 ceph-mon[35072]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T08:38:40.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:39 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:38:40.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:39 smithi044 ceph-mon[35072]: from='client.? 172.21.15.44:0/199818003' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:38:40.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:40 smithi175 ceph-mon[35688]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:38:40.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:40 smithi175 ceph-mon[35688]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T08:38:40.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:40 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:38:41.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:40 smithi007 ceph-mon[31221]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:38:41.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:40 smithi007 ceph-mon[31221]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T08:38:41.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:40 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:38:41.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:40 smithi044 ceph-mon[35072]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:38:41.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:40 smithi044 ceph-mon[35072]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T08:38:41.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:38:42.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:41 smithi175 ceph-mon[35688]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:38:42.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:41 smithi175 ceph-mon[35688]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T08:38:42.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:41 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:38:42.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:41 smithi007 ceph-mon[31221]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:38:42.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:41 smithi007 ceph-mon[31221]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T08:38:42.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:41 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:38:42.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:41 smithi044 ceph-mon[35072]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:38:42.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:41 smithi044 ceph-mon[35072]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T08:38:42.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:41 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:38:44.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:43 smithi175 ceph-mon[35688]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-09-19T08:38:44.240 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:43 smithi044 ceph-mon[35072]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-09-19T08:38:44.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:43 smithi007 ceph-mon[31221]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-09-19T08:38:46.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:45 smithi175 ceph-mon[35688]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:38:46.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:45 smithi007 ceph-mon[31221]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:38:46.288 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:45 smithi044 ceph-mon[35072]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:38:48.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:47 smithi044 ceph-mon[35072]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-19T08:38:48.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:47 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:38:48.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:47 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:48.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:47 smithi044 ceph-mon[35072]: Deploying daemon osd.4 on smithi044 2024-09-19T08:38:48.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:47 smithi175 ceph-mon[35688]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-19T08:38:48.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:47 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:38:48.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:47 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:48.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:47 smithi175 ceph-mon[35688]: Deploying daemon osd.4 on smithi044 2024-09-19T08:38:48.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:47 smithi007 ceph-mon[31221]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-19T08:38:48.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:47 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:38:48.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:47 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:48.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:47 smithi007 ceph-mon[31221]: Deploying daemon osd.4 on smithi044 2024-09-19T08:38:50.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:49 smithi044 ceph-mon[35072]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-19T08:38:50.166 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:49 smithi175 ceph-mon[35688]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-19T08:38:50.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:49 smithi007 ceph-mon[31221]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-19T08:38:52.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:51 smithi175 ceph-mon[35688]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:38:52.185 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:51 smithi044 ceph-mon[35072]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:38:52.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:51 smithi007 ceph-mon[31221]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:38:54.104 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:53 smithi044 ceph-mon[35072]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:38:54.104 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:53 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:54.104 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:53 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:54.105 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:53 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:54.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:53 smithi175 ceph-mon[35688]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:38:54.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:53 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:54.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:53 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:54.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:53 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:54.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:53 smithi007 ceph-mon[31221]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:38:54.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:53 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:54.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:53 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:54.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:53 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:56.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:55 smithi044 ceph-mon[35072]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:38:56.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:55 smithi175 ceph-mon[35688]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:38:56.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:55 smithi007 ceph-mon[31221]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:38:57.209 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:56 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:57.210 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:56 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:57.210 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:56 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:57.210 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:56 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:57.210 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:56 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:57.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:57.252+0000 7f5e0f7fe640 1 -- 172.21.15.44:0/188377832 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5e20062630 con 0x7f5e080a32f0 2024-09-19T08:38:57.253 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 4 on host 'smithi044' 2024-09-19T08:38:57.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:57.255+0000 7f5e24f09640 1 -- 172.21.15.44:0/188377832 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f5e080a32f0 msgr2=0x7f5e080a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:57.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:57.255+0000 7f5e24f09640 1 --2- 172.21.15.44:0/188377832 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f5e080a32f0 0x7f5e080a57b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5e14005e10 tx=0x7f5e14005da0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:57.255+0000 7f5e24f09640 1 -- 172.21.15.44:0/188377832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e200ffed0 msgr2=0x7f5e20197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:57.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:57.255+0000 7f5e24f09640 1 --2- 172.21.15.44:0/188377832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e200ffed0 0x7f5e20197ef0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5e10006010 tx=0x7f5e10032c70 comp rx=0 tx=0).stop 2024-09-19T08:38:57.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:57.255+0000 7f5e24f09640 1 -- 172.21.15.44:0/188377832 shutdown_connections 2024-09-19T08:38:57.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:57.255+0000 7f5e24f09640 1 --2- 172.21.15.44:0/188377832 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f5e080a32f0 0x7f5e080a57b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:57.255+0000 7f5e24f09640 1 --2- 172.21.15.44:0/188377832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e20103870 0x7f5e2019f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:57.255+0000 7f5e24f09640 1 --2- 172.21.15.44:0/188377832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e20102eb0 0x7f5e20198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:57.255+0000 7f5e24f09640 1 --2- 172.21.15.44:0/188377832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e200ffed0 0x7f5e20197ef0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:57.255+0000 7f5e24f09640 1 -- 172.21.15.44:0/188377832 >> 172.21.15.44:0/188377832 conn(0x7f5e200fba40 msgr2=0x7f5e20106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:57.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:57.255+0000 7f5e24f09640 1 -- 172.21.15.44:0/188377832 shutdown_connections 2024-09-19T08:38:57.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:38:57.255+0000 7f5e24f09640 1 -- 172.21.15.44:0/188377832 wait complete. 2024-09-19T08:38:57.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:57.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:57.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:57.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:57.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:56 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:57.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:56 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:57.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:56 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:57.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:56 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:38:57.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:56 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:38:57.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:56 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:57.825 DEBUG:teuthology.orchestra.run.smithi044:osd.4> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T08:38:57.828 INFO:tasks.cephadm:Deploying osd.5 on smithi175 with /dev/vg_nvme/lv_3... 2024-09-19T08:38:57.828 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:38:58.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:57 smithi044 ceph-mon[35072]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:38:58.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:57 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:58.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:57 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:58.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:57 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:58.081 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:38:58.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:57 smithi175 ceph-mon[35688]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:38:58.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:57 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:58.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:57 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:58.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:57 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:58.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:57 smithi007 ceph-mon[31221]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:38:58.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:57 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:38:58.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:57 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:58.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:57 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:38:59.940 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:38:59 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4[46079]: 2024-09-19T08:38:59.686+0000 7fac22d0d640 -1 osd.4 0 log_to_monitors true 2024-09-19T08:39:00.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:59 smithi007 ceph-mon[31221]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:00.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:59 smithi007 ceph-mon[31221]: from='osd.4 [v2:172.21.15.44:6808/3537143774,v1:172.21.15.44:6809/3537143774]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:39:00.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:38:59 smithi007 ceph-mon[31221]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:39:00.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:59 smithi044 ceph-mon[35072]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:00.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:59 smithi044 ceph-mon[35072]: from='osd.4 [v2:172.21.15.44:6808/3537143774,v1:172.21.15.44:6809/3537143774]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:39:00.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:38:59 smithi044 ceph-mon[35072]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:39:00.357 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:59 smithi175 ceph-mon[35688]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:00.358 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:59 smithi175 ceph-mon[35688]: from='osd.4 [v2:172.21.15.44:6808/3537143774,v1:172.21.15.44:6809/3537143774]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:39:00.358 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:38:59 smithi175 ceph-mon[35688]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:39:00.360 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:39:00.388 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_3 2024-09-19T08:39:00.646 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:39:01.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.122+0000 7ff7d1605640 1 -- 172.21.15.175:0/4056225434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7cc1026c0 msgr2=0x7ff7cc108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:01.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.122+0000 7ff7d1605640 1 --2- 172.21.15.175:0/4056225434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7cc1026c0 0x7ff7cc108f50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4009ca0 tx=0x7ff7c402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:39:01.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.122+0000 7ff7d1605640 1 -- 172.21.15.175:0/4056225434 shutdown_connections 2024-09-19T08:39:01.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.122+0000 7ff7d1605640 1 --2- 172.21.15.175:0/4056225434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7cc1026c0 0x7ff7cc108f50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:01.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.122+0000 7ff7d1605640 1 --2- 172.21.15.175:0/4056225434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7cc101d00 0x7ff7cc102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:01.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.122+0000 7ff7d1605640 1 --2- 172.21.15.175:0/4056225434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7cc100b00 0x7ff7cc100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:01.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.122+0000 7ff7d1605640 1 -- 172.21.15.175:0/4056225434 >> 172.21.15.175:0/4056225434 conn(0x7ff7cc0fc290 msgr2=0x7ff7cc0fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:01.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.122+0000 7ff7d1605640 1 -- 172.21.15.175:0/4056225434 shutdown_connections 2024-09-19T08:39:01.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.122+0000 7ff7d1605640 1 -- 172.21.15.175:0/4056225434 wait complete. 2024-09-19T08:39:01.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.123+0000 7ff7d1605640 1 Processor -- start 2024-09-19T08:39:01.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.123+0000 7ff7d1605640 1 -- start start 2024-09-19T08:39:01.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.123+0000 7ff7d1605640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7cc100b00 0x7ff7cc197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:01.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.123+0000 7ff7d1605640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7cc101d00 0x7ff7cc198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:01.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.123+0000 7ff7d1605640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7cc1026c0 0x7ff7cc19f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:01.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.123+0000 7ff7d1605640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff7cc10c780 con 0x7ff7cc100b00 2024-09-19T08:39:01.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.123+0000 7ff7d1605640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff7cc10c600 con 0x7ff7cc1026c0 2024-09-19T08:39:01.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.123+0000 7ff7d1605640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff7cc10c900 con 0x7ff7cc101d00 2024-09-19T08:39:01.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.123+0000 7ff7ca7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7cc101d00 0x7ff7cc198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:01.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.123+0000 7ff7ca7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7cc101d00 0x7ff7cc198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48660/0 (socket says 172.21.15.175:48660) 2024-09-19T08:39:01.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.123+0000 7ff7ca7fc640 1 -- 172.21.15.175:0/1329676043 learned_addr learned my addr 172.21.15.175:0/1329676043 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-19T08:39:01.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.123+0000 7ff7cb7fe640 1 --2- 172.21.15.175:0/1329676043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7cc1026c0 0x7ff7cc19f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:01.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.123+0000 7ff7caffd640 1 --2- 172.21.15.175:0/1329676043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7cc100b00 0x7ff7cc197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:01.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.124+0000 7ff7ca7fc640 1 -- 172.21.15.175:0/1329676043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7cc1026c0 msgr2=0x7ff7cc19f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:01.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.124+0000 7ff7ca7fc640 1 --2- 172.21.15.175:0/1329676043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7cc1026c0 0x7ff7cc19f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:01.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.124+0000 7ff7ca7fc640 1 -- 172.21.15.175:0/1329676043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7cc100b00 msgr2=0x7ff7cc197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:01.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.124+0000 7ff7ca7fc640 1 --2- 172.21.15.175:0/1329676043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7cc100b00 0x7ff7cc197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:01.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.124+0000 7ff7ca7fc640 1 -- 172.21.15.175:0/1329676043 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7cc19fb80 con 0x7ff7cc101d00 2024-09-19T08:39:01.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.124+0000 7ff7ca7fc640 1 --2- 172.21.15.175:0/1329676043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7cc101d00 0x7ff7cc198490 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000e9f0 tx=0x7ff7c000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:01.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.124+0000 7ff7b3fff640 1 -- 172.21.15.175:0/1329676043 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c000cd80 con 0x7ff7cc101d00 2024-09-19T08:39:01.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.124+0000 7ff7b3fff640 1 -- 172.21.15.175:0/1329676043 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7c0005500 con 0x7ff7cc101d00 2024-09-19T08:39:01.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.124+0000 7ff7d1605640 1 -- 172.21.15.175:0/1329676043 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7cc19fe70 con 0x7ff7cc101d00 2024-09-19T08:39:01.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.124+0000 7ff7b3fff640 1 -- 172.21.15.175:0/1329676043 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0010690 con 0x7ff7cc101d00 2024-09-19T08:39:01.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.124+0000 7ff7d1605640 1 -- 172.21.15.175:0/1329676043 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7cc1a02d0 con 0x7ff7cc101d00 2024-09-19T08:39:01.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.125+0000 7ff7d1605640 1 -- 172.21.15.175:0/1329676043 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7cc1a0560 con 0x7ff7cc101d00 2024-09-19T08:39:01.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.126+0000 7ff7b3fff640 1 -- 172.21.15.175:0/1329676043 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7ff7c00046c0 con 0x7ff7cc101d00 2024-09-19T08:39:01.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.127+0000 7ff7b3fff640 1 --2- 172.21.15.175:0/1329676043 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff7b40a3270 0x7ff7b40a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:01.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.127+0000 7ff7b3fff640 1 -- 172.21.15.175:0/1329676043 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 3821+0+0 (secure 0 0 0) 0x7ff7c00cebb0 con 0x7ff7cc101d00 2024-09-19T08:39:01.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.127+0000 7ff7caffd640 1 --2- 172.21.15.175:0/1329676043 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff7b40a3270 0x7ff7b40a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:01.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.128+0000 7ff7caffd640 1 --2- 172.21.15.175:0/1329676043 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff7b40a3270 0x7ff7b40a5730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc101b60 tx=0x7ff7bc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:01.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.132+0000 7ff7b3fff640 1 -- 172.21.15.175:0/1329676043 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff7c009c9c0 con 0x7ff7cc101d00 2024-09-19T08:39:01.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:01 smithi007 ceph-mon[31221]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:39:01.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:01 smithi007 ceph-mon[31221]: from='osd.4 [v2:172.21.15.44:6808/3537143774,v1:172.21.15.44:6809/3537143774]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:39:01.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:01 smithi007 ceph-mon[31221]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T08:39:01.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:01 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:01.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:01 smithi007 ceph-mon[31221]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:39:01.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:01 smithi007 ceph-mon[31221]: Detected new or changed devices on smithi044 2024-09-19T08:39:01.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:01 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:01.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:01 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:01.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:01 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:01.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:01 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:01.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:01 smithi007 ceph-mon[31221]: Adjusting osd_memory_target on smithi044 to 8546M 2024-09-19T08:39:01.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:01 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:01.285 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:01 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:01.285 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:01 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:01.285 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:01 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:01.300 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:39:01 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4[46079]: 2024-09-19T08:39:01.006+0000 7fac1e46d640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T08:39:01.301 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:39:01 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4[46079]: 2024-09-19T08:39:01.012+0000 7fac1aaa7640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:39:01.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:01 smithi044 ceph-mon[35072]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:39:01.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:01 smithi044 ceph-mon[35072]: from='osd.4 [v2:172.21.15.44:6808/3537143774,v1:172.21.15.44:6809/3537143774]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:39:01.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:01 smithi044 ceph-mon[35072]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T08:39:01.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:01 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:01.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:01 smithi044 ceph-mon[35072]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:39:01.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:01 smithi044 ceph-mon[35072]: Detected new or changed devices on smithi044 2024-09-19T08:39:01.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:01 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:01.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:01 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:01.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:01 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:01.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:01 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:01.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:01 smithi044 ceph-mon[35072]: Adjusting osd_memory_target on smithi044 to 8546M 2024-09-19T08:39:01.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:01 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:01.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:01 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:01.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:01 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:01.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:01 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:01.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:01.311+0000 7ff7d1605640 1 -- 172.21.15.175:0/1329676043 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7ff7cc1a0730 con 0x7ff7b40a3270 2024-09-19T08:39:01.312 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:01 smithi175 ceph-mon[35688]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:39:01.312 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:01 smithi175 ceph-mon[35688]: from='osd.4 [v2:172.21.15.44:6808/3537143774,v1:172.21.15.44:6809/3537143774]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:39:01.312 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:01 smithi175 ceph-mon[35688]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T08:39:01.312 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:01 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:01.312 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:01 smithi175 ceph-mon[35688]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:39:01.312 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:01 smithi175 ceph-mon[35688]: Detected new or changed devices on smithi044 2024-09-19T08:39:01.312 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:01 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:01.312 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:01 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:01.313 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:01 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:01.313 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:01 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:01.313 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:01 smithi175 ceph-mon[35688]: Adjusting osd_memory_target on smithi044 to 8546M 2024-09-19T08:39:01.313 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:01 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:01.313 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:01 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:01.313 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:01 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:01.313 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:01 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:02.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:02 smithi007 ceph-mon[31221]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:02.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:02 smithi007 ceph-mon[31221]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-19T08:39:02.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:02 smithi007 ceph-mon[31221]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T08:39:02.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:02 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:02.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:02 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:02.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:02 smithi007 ceph-mon[31221]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:39:02.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:02 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:39:02.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:02 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:39:02.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:02 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:02.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:02 smithi044 ceph-mon[35072]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:02.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:02 smithi044 ceph-mon[35072]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-19T08:39:02.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:02 smithi044 ceph-mon[35072]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T08:39:02.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:02 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:02.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:02 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:02.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:02 smithi044 ceph-mon[35072]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:39:02.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:02 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:39:02.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:02 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:39:02.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:02 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:02.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:02 smithi175 ceph-mon[35688]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:02.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:02 smithi175 ceph-mon[35688]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-19T08:39:02.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:02 smithi175 ceph-mon[35688]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T08:39:02.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:02 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:02.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:02 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:02.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:02 smithi175 ceph-mon[35688]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:39:02.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:02 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:39:02.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:02 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:39:02.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:02 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:03.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:03 smithi175 ceph-mon[35688]: purged_snaps scrub starts 2024-09-19T08:39:03.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:03 smithi175 ceph-mon[35688]: purged_snaps scrub ok 2024-09-19T08:39:03.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:03 smithi175 ceph-mon[35688]: osd.4 [v2:172.21.15.44:6808/3537143774,v1:172.21.15.44:6809/3537143774] boot 2024-09-19T08:39:03.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:03 smithi175 ceph-mon[35688]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T08:39:03.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:03 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:03.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:03 smithi007 ceph-mon[31221]: purged_snaps scrub starts 2024-09-19T08:39:03.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:03 smithi007 ceph-mon[31221]: purged_snaps scrub ok 2024-09-19T08:39:03.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:03 smithi007 ceph-mon[31221]: osd.4 [v2:172.21.15.44:6808/3537143774,v1:172.21.15.44:6809/3537143774] boot 2024-09-19T08:39:03.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:03 smithi007 ceph-mon[31221]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T08:39:03.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:03 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:03.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:03 smithi044 ceph-mon[35072]: purged_snaps scrub starts 2024-09-19T08:39:03.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:03 smithi044 ceph-mon[35072]: purged_snaps scrub ok 2024-09-19T08:39:03.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:03 smithi044 ceph-mon[35072]: osd.4 [v2:172.21.15.44:6808/3537143774,v1:172.21.15.44:6809/3537143774] boot 2024-09-19T08:39:03.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:03 smithi044 ceph-mon[35072]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T08:39:03.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:03 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:39:04.168 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:04 smithi175 ceph-mon[35688]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:04.168 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:04 smithi175 ceph-mon[35688]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T08:39:04.168 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:04 smithi175 ceph-mon[35688]: from='client.? 172.21.15.175:0/422327117' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "436cd596-710b-48e2-8255-8427c93cee1a"}]: dispatch 2024-09-19T08:39:04.168 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:04 smithi175 ceph-mon[35688]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "436cd596-710b-48e2-8255-8427c93cee1a"}]: dispatch 2024-09-19T08:39:04.168 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:04 smithi175 ceph-mon[35688]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "436cd596-710b-48e2-8255-8427c93cee1a"}]': finished 2024-09-19T08:39:04.168 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:04 smithi175 ceph-mon[35688]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T08:39:04.169 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:04.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:04 smithi007 ceph-mon[31221]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:04.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:04 smithi007 ceph-mon[31221]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T08:39:04.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:04 smithi007 ceph-mon[31221]: from='client.? 172.21.15.175:0/422327117' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "436cd596-710b-48e2-8255-8427c93cee1a"}]: dispatch 2024-09-19T08:39:04.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:04 smithi007 ceph-mon[31221]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "436cd596-710b-48e2-8255-8427c93cee1a"}]: dispatch 2024-09-19T08:39:04.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:04 smithi007 ceph-mon[31221]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "436cd596-710b-48e2-8255-8427c93cee1a"}]': finished 2024-09-19T08:39:04.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:04 smithi007 ceph-mon[31221]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T08:39:04.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:04.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:04 smithi044 ceph-mon[35072]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:39:04.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:04 smithi044 ceph-mon[35072]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T08:39:04.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:04 smithi044 ceph-mon[35072]: from='client.? 172.21.15.175:0/422327117' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "436cd596-710b-48e2-8255-8427c93cee1a"}]: dispatch 2024-09-19T08:39:04.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:04 smithi044 ceph-mon[35072]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "436cd596-710b-48e2-8255-8427c93cee1a"}]: dispatch 2024-09-19T08:39:04.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:04 smithi044 ceph-mon[35072]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "436cd596-710b-48e2-8255-8427c93cee1a"}]': finished 2024-09-19T08:39:04.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:04 smithi044 ceph-mon[35072]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T08:39:04.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:05.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:05 smithi007 ceph-mon[31221]: from='client.? 172.21.15.175:0/3059762322' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:39:05.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:05 smithi044 ceph-mon[35072]: from='client.? 172.21.15.175:0/3059762322' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:39:05.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:05 smithi175 ceph-mon[35688]: from='client.? 172.21.15.175:0/3059762322' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:39:06.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:06 smithi007 ceph-mon[31221]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:06.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:06 smithi044 ceph-mon[35072]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:06.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:06 smithi175 ceph-mon[35688]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:08.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:08 smithi044 ceph-mon[35072]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:08.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:08 smithi007 ceph-mon[31221]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:08.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:08 smithi175 ceph-mon[35688]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:10.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:10 smithi007 ceph-mon[31221]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:10.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:10 smithi044 ceph-mon[35072]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:10.302 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:10 smithi175 ceph-mon[35688]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:12.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:12 smithi007 ceph-mon[31221]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:12.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:12 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:39:12.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:12 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:12.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:12 smithi044 ceph-mon[35072]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:12.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:12 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:39:12.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:12 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:12.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:12 smithi175 ceph-mon[35688]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:12.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:12 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:39:12.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:12 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:13.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:13 smithi044 ceph-mon[35072]: Deploying daemon osd.5 on smithi175 2024-09-19T08:39:13.302 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:13 smithi175 ceph-mon[35688]: Deploying daemon osd.5 on smithi175 2024-09-19T08:39:13.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:13 smithi007 ceph-mon[31221]: Deploying daemon osd.5 on smithi175 2024-09-19T08:39:14.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:14 smithi175 ceph-mon[35688]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:14.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:14 smithi044 ceph-mon[35072]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:14.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:14 smithi007 ceph-mon[31221]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:16.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:16 smithi044 ceph-mon[35072]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:16.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:16 smithi175 ceph-mon[35688]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:16.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:16 smithi007 ceph-mon[31221]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:18.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:18 smithi044 ceph-mon[35072]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:18.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:18 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:18.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:18 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:18.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:18 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:18.329 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:18 smithi175 ceph-mon[35688]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:18.330 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:18 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:18.330 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:18 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:18.330 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:18 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:18.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:18 smithi007 ceph-mon[31221]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:18.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:18.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:18.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:20.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:20 smithi175 ceph-mon[35688]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:20.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:20 smithi044 ceph-mon[35072]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:20.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:20 smithi007 ceph-mon[31221]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:21.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:21.405+0000 7ff7b3fff640 1 -- 172.21.15.175:0/1329676043 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff7cc1a0730 con 0x7ff7b40a3270 2024-09-19T08:39:21.406 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 5 on host 'smithi175' 2024-09-19T08:39:21.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:21.407+0000 7ff7d1605640 1 -- 172.21.15.175:0/1329676043 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff7b40a3270 msgr2=0x7ff7b40a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:21.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:21.407+0000 7ff7d1605640 1 --2- 172.21.15.175:0/1329676043 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff7b40a3270 0x7ff7b40a5730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc101b60 tx=0x7ff7bc00b390 comp rx=0 tx=0).stop 2024-09-19T08:39:21.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:21.408+0000 7ff7d1605640 1 -- 172.21.15.175:0/1329676043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7cc101d00 msgr2=0x7ff7cc198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:21.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:21.408+0000 7ff7d1605640 1 --2- 172.21.15.175:0/1329676043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7cc101d00 0x7ff7cc198490 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000e9f0 tx=0x7ff7c000edf0 comp rx=0 tx=0).stop 2024-09-19T08:39:21.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:21.408+0000 7ff7d1605640 1 -- 172.21.15.175:0/1329676043 shutdown_connections 2024-09-19T08:39:21.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:21.408+0000 7ff7d1605640 1 --2- 172.21.15.175:0/1329676043 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff7b40a3270 0x7ff7b40a5730 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:21.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:21.408+0000 7ff7d1605640 1 --2- 172.21.15.175:0/1329676043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7cc1026c0 0x7ff7cc19f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:21.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:21.408+0000 7ff7d1605640 1 --2- 172.21.15.175:0/1329676043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7cc101d00 0x7ff7cc198490 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:21.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:21.408+0000 7ff7d1605640 1 --2- 172.21.15.175:0/1329676043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7cc100b00 0x7ff7cc197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:21.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:21.408+0000 7ff7d1605640 1 -- 172.21.15.175:0/1329676043 >> 172.21.15.175:0/1329676043 conn(0x7ff7cc0fc290 msgr2=0x7ff7cc06a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:21.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:21.408+0000 7ff7d1605640 1 -- 172.21.15.175:0/1329676043 shutdown_connections 2024-09-19T08:39:21.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:39:21.408+0000 7ff7d1605640 1 -- 172.21.15.175:0/1329676043 wait complete. 2024-09-19T08:39:21.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:21.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:21.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:21.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:21.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:21.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:21.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:21.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:21.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:21.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:21.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:21.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:21.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:21.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:21.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:21.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:22.021 DEBUG:teuthology.orchestra.run.smithi175:osd.5> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T08:39:22.023 INFO:tasks.cephadm:Deploying osd.6 on smithi007 with /dev/vg_nvme/lv_2... 2024-09-19T08:39:22.024 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:39:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:39:22.563 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:22 smithi175 ceph-mon[35688]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:22.735 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:22 smithi007 ceph-mon[31221]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:22.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:22 smithi044 ceph-mon[35072]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:24.429 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:39:24 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:39:24.290+0000 7fbaf1264640 -1 osd.5 0 log_to_monitors true 2024-09-19T08:39:24.781 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:24 smithi175 ceph-mon[35688]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:24.781 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:24 smithi175 ceph-mon[35688]: from='osd.5 [v2:172.21.15.175:6808/4001214751,v1:172.21.15.175:6809/4001214751]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:39:24.781 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:24 smithi175 ceph-mon[35688]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:39:24.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:24 smithi007 ceph-mon[31221]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:24.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:24 smithi007 ceph-mon[31221]: from='osd.5 [v2:172.21.15.175:6808/4001214751,v1:172.21.15.175:6809/4001214751]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:39:24.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:24 smithi007 ceph-mon[31221]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:39:24.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:24 smithi044 ceph-mon[35072]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:24.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:24 smithi044 ceph-mon[35072]: from='osd.5 [v2:172.21.15.175:6808/4001214751,v1:172.21.15.175:6809/4001214751]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:39:24.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:24 smithi044 ceph-mon[35072]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:39:24.898 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:39:24.926 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_2 2024-09-19T08:39:25.177 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:39:25.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:25 smithi007 ceph-mon[31221]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:39:25.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:25 smithi007 ceph-mon[31221]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T08:39:25.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:25 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:25.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:25 smithi007 ceph-mon[31221]: from='osd.5 [v2:172.21.15.175:6808/4001214751,v1:172.21.15.175:6809/4001214751]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:39:25.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:25 smithi007 ceph-mon[31221]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:39:25.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:25 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:25.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:25 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:25.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:25 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:25.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:25 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:25.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:25 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:25.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:25 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:25.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:25 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:25.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:25 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:25.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.601+0000 7f4db3e28640 1 -- 172.21.15.7:0/430051484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dac1026d0 msgr2=0x7f4dac108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:25.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.601+0000 7f4db3e28640 1 --2- 172.21.15.7:0/430051484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dac1026d0 0x7f4dac108f60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4da4009ca0 tx=0x7f4da402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:39:25.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.601+0000 7f4db3e28640 1 -- 172.21.15.7:0/430051484 shutdown_connections 2024-09-19T08:39:25.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.601+0000 7f4db3e28640 1 --2- 172.21.15.7:0/430051484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dac1026d0 0x7f4dac108f60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:25.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.601+0000 7f4db3e28640 1 --2- 172.21.15.7:0/430051484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dac101d10 0x7f4dac102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:25.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.601+0000 7f4db3e28640 1 --2- 172.21.15.7:0/430051484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dac100b10 0x7f4dac100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:25.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.601+0000 7f4db3e28640 1 -- 172.21.15.7:0/430051484 >> 172.21.15.7:0/430051484 conn(0x7f4dac0fc2a0 msgr2=0x7f4dac0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:25.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.601+0000 7f4db3e28640 1 -- 172.21.15.7:0/430051484 shutdown_connections 2024-09-19T08:39:25.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.601+0000 7f4db3e28640 1 -- 172.21.15.7:0/430051484 wait complete. 2024-09-19T08:39:25.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.602+0000 7f4db3e28640 1 Processor -- start 2024-09-19T08:39:25.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.602+0000 7f4db3e28640 1 -- start start 2024-09-19T08:39:25.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.602+0000 7f4db3e28640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dac100b10 0x7f4dac06b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:25.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.602+0000 7f4db3e28640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dac101d10 0x7f4dac19eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:25.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.602+0000 7f4db3e28640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dac1026d0 0x7f4dac1a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:25.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.602+0000 7f4db3e28640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4dac10c790 con 0x7f4dac1026d0 2024-09-19T08:39:25.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.602+0000 7f4db3e28640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4dac10c610 con 0x7f4dac101d10 2024-09-19T08:39:25.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.602+0000 7f4db3e28640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4dac10c910 con 0x7f4dac100b10 2024-09-19T08:39:25.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.602+0000 7f4db23c5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dac1026d0 0x7f4dac1a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:25.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.602+0000 7f4db23c5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dac1026d0 0x7f4dac1a1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50802/0 (socket says 172.21.15.7:50802) 2024-09-19T08:39:25.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.602+0000 7f4db23c5640 1 -- 172.21.15.7:0/3424463854 learned_addr learned my addr 172.21.15.7:0/3424463854 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:39:25.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.602+0000 7f4db1bc4640 1 --2- 172.21.15.7:0/3424463854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dac100b10 0x7f4dac06b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:25.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.602+0000 7f4db13c3640 1 --2- 172.21.15.7:0/3424463854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dac101d10 0x7f4dac19eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:25.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.602+0000 7f4db23c5640 1 -- 172.21.15.7:0/3424463854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dac100b10 msgr2=0x7f4dac06b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:25.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.602+0000 7f4db23c5640 1 --2- 172.21.15.7:0/3424463854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dac100b10 0x7f4dac06b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:25.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.602+0000 7f4db23c5640 1 -- 172.21.15.7:0/3424463854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dac101d10 msgr2=0x7f4dac19eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:25.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.602+0000 7f4db23c5640 1 --2- 172.21.15.7:0/3424463854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dac101d10 0x7f4dac19eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:25.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.602+0000 7f4db23c5640 1 -- 172.21.15.7:0/3424463854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dac1a1d30 con 0x7f4dac1026d0 2024-09-19T08:39:25.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.602+0000 7f4db13c3640 1 --2- 172.21.15.7:0/3424463854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dac101d10 0x7f4dac19eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:25.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.602+0000 7f4db23c5640 1 --2- 172.21.15.7:0/3424463854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dac1026d0 0x7f4dac1a1540 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4da4031ae0 tx=0x7f4da4031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:25.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.603+0000 7f4da2ffd640 1 -- 172.21.15.7:0/3424463854 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da4003c30 con 0x7f4dac1026d0 2024-09-19T08:39:25.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.603+0000 7f4da2ffd640 1 -- 172.21.15.7:0/3424463854 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4da4003dd0 con 0x7f4dac1026d0 2024-09-19T08:39:25.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.603+0000 7f4da2ffd640 1 -- 172.21.15.7:0/3424463854 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da402fcb0 con 0x7f4dac1026d0 2024-09-19T08:39:25.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.603+0000 7f4db3e28640 1 -- 172.21.15.7:0/3424463854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dac1a1f60 con 0x7f4dac1026d0 2024-09-19T08:39:25.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.603+0000 7f4db3e28640 1 -- 172.21.15.7:0/3424463854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dac1a2470 con 0x7f4dac1026d0 2024-09-19T08:39:25.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.604+0000 7f4db3e28640 1 -- 172.21.15.7:0/3424463854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dac107ec0 con 0x7f4dac1026d0 2024-09-19T08:39:25.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.606+0000 7f4da2ffd640 1 -- 172.21.15.7:0/3424463854 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f4da4004050 con 0x7f4dac1026d0 2024-09-19T08:39:25.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.606+0000 7f4da2ffd640 1 --2- 172.21.15.7:0/3424463854 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4d980a3270 0x7f4d980a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:25.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.607+0000 7f4db1bc4640 1 --2- 172.21.15.7:0/3424463854 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4d980a3270 0x7f4d980a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:25.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.607+0000 7f4da2ffd640 1 -- 172.21.15.7:0/3424463854 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4253+0+0 (secure 0 0 0) 0x7f4da40efeb0 con 0x7f4dac1026d0 2024-09-19T08:39:25.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.607+0000 7f4db1bc4640 1 --2- 172.21.15.7:0/3424463854 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4d980a3270 0x7f4d980a5730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4dac101b70 tx=0x7f4da8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:25.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.610+0000 7f4da2ffd640 1 -- 172.21.15.7:0/3424463854 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4da40bdb10 con 0x7f4dac1026d0 2024-09-19T08:39:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:25.796+0000 7f4db3e28640 1 -- 172.21.15.7:0/3424463854 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f4dac062630 con 0x7f4d980a3270 2024-09-19T08:39:25.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:25 smithi044 ceph-mon[35072]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:39:25.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:25 smithi044 ceph-mon[35072]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T08:39:25.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:25 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:25.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:25 smithi044 ceph-mon[35072]: from='osd.5 [v2:172.21.15.175:6808/4001214751,v1:172.21.15.175:6809/4001214751]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:39:25.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:25 smithi044 ceph-mon[35072]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:39:25.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:25 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:25.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:25 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:25.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:25 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:25.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:25 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:25.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:25 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:25.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:25 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:25.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:25 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:25.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:25 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:25.928 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:39:25 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:39:25.512+0000 7fbaec9c4640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T08:39:25.929 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:39:25 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:39:25.521+0000 7fbae8ffe640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:39:25.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:25 smithi175 ceph-mon[35688]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:39:25.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:25 smithi175 ceph-mon[35688]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T08:39:25.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:25 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:25.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:25 smithi175 ceph-mon[35688]: from='osd.5 [v2:172.21.15.175:6808/4001214751,v1:172.21.15.175:6809/4001214751]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:39:25.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:25 smithi175 ceph-mon[35688]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:39:25.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:25 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:25.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:25 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:25.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:25 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:25.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:25 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:25.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:25 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:25.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:25 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:25.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:25 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:25.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:25 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:26.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:26 smithi007 ceph-mon[31221]: Detected new or changed devices on smithi175 2024-09-19T08:39:26.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:26 smithi007 ceph-mon[31221]: Adjusting osd_memory_target on smithi175 to 8544M 2024-09-19T08:39:26.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:26 smithi007 ceph-mon[31221]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:26.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:26 smithi007 ceph-mon[31221]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-19T08:39:26.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:26 smithi007 ceph-mon[31221]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T08:39:26.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:26 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:26.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:26 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:26.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:26 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:39:26.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:26 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:39:26.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:26 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:26.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:26 smithi044 ceph-mon[35072]: Detected new or changed devices on smithi175 2024-09-19T08:39:26.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:26 smithi044 ceph-mon[35072]: Adjusting osd_memory_target on smithi175 to 8544M 2024-09-19T08:39:26.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:26 smithi044 ceph-mon[35072]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:26.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:26 smithi044 ceph-mon[35072]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-19T08:39:26.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:26 smithi044 ceph-mon[35072]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T08:39:26.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:26 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:26.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:26 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:26.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:26 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:39:26.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:26 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:39:26.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:26 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:26.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:26 smithi175 ceph-mon[35688]: Detected new or changed devices on smithi175 2024-09-19T08:39:26.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:26 smithi175 ceph-mon[35688]: Adjusting osd_memory_target on smithi175 to 8544M 2024-09-19T08:39:26.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:26 smithi175 ceph-mon[35688]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:39:26.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:26 smithi175 ceph-mon[35688]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-19T08:39:26.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:26 smithi175 ceph-mon[35688]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T08:39:26.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:26 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:26.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:26 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:26.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:26 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:39:26.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:26 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:39:26.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:26 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:27.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:27 smithi007 ceph-mon[31221]: purged_snaps scrub starts 2024-09-19T08:39:27.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:27 smithi007 ceph-mon[31221]: purged_snaps scrub ok 2024-09-19T08:39:27.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:27 smithi007 ceph-mon[31221]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:39:27.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:27 smithi007 ceph-mon[31221]: osd.5 [v2:172.21.15.175:6808/4001214751,v1:172.21.15.175:6809/4001214751] boot 2024-09-19T08:39:27.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:27 smithi007 ceph-mon[31221]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T08:39:27.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:27 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:27.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:27 smithi044 ceph-mon[35072]: purged_snaps scrub starts 2024-09-19T08:39:27.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:27 smithi044 ceph-mon[35072]: purged_snaps scrub ok 2024-09-19T08:39:27.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:27 smithi044 ceph-mon[35072]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:39:27.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:27 smithi044 ceph-mon[35072]: osd.5 [v2:172.21.15.175:6808/4001214751,v1:172.21.15.175:6809/4001214751] boot 2024-09-19T08:39:27.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:27 smithi044 ceph-mon[35072]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T08:39:27.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:27 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:27.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:27 smithi175 ceph-mon[35688]: purged_snaps scrub starts 2024-09-19T08:39:27.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:27 smithi175 ceph-mon[35688]: purged_snaps scrub ok 2024-09-19T08:39:27.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:27 smithi175 ceph-mon[35688]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:39:27.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:27 smithi175 ceph-mon[35688]: osd.5 [v2:172.21.15.175:6808/4001214751,v1:172.21.15.175:6809/4001214751] boot 2024-09-19T08:39:27.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:27 smithi175 ceph-mon[35688]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T08:39:27.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:27 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:39:28.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:28 smithi007 ceph-mon[31221]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:28.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:28 smithi007 ceph-mon[31221]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T08:39:28.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:28 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/4053346533' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5a7ad2b-6b44-4b5a-8af7-f7fb00e7ca68"}]: dispatch 2024-09-19T08:39:28.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:28 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/4053346533' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5a7ad2b-6b44-4b5a-8af7-f7fb00e7ca68"}]': finished 2024-09-19T08:39:28.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:28 smithi007 ceph-mon[31221]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T08:39:28.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:28 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:28.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:28 smithi044 ceph-mon[35072]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:28.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:28 smithi044 ceph-mon[35072]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T08:39:28.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:28 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/4053346533' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5a7ad2b-6b44-4b5a-8af7-f7fb00e7ca68"}]: dispatch 2024-09-19T08:39:28.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:28 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/4053346533' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5a7ad2b-6b44-4b5a-8af7-f7fb00e7ca68"}]': finished 2024-09-19T08:39:28.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:28 smithi044 ceph-mon[35072]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T08:39:28.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:28 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:28.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:28 smithi175 ceph-mon[35688]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:28.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:28 smithi175 ceph-mon[35688]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T08:39:28.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:28 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/4053346533' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5a7ad2b-6b44-4b5a-8af7-f7fb00e7ca68"}]: dispatch 2024-09-19T08:39:28.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:28 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/4053346533' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5a7ad2b-6b44-4b5a-8af7-f7fb00e7ca68"}]': finished 2024-09-19T08:39:28.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:28 smithi175 ceph-mon[35688]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T08:39:28.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:28 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:29.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:29 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/921418067' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:39:29.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:29 smithi007 ceph-mon[31221]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T08:39:29.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:29 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:29.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:29 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/921418067' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:39:29.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:29 smithi044 ceph-mon[35072]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T08:39:29.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:29 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:29.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:29 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/921418067' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:39:29.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:29 smithi175 ceph-mon[35688]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T08:39:29.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:29 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:30.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:30 smithi007 ceph-mon[31221]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:30.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:30 smithi007 ceph-mon[31221]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T08:39:30.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:30 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:30.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:30 smithi044 ceph-mon[35072]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:30.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:30 smithi044 ceph-mon[35072]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T08:39:30.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:30 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:30.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:30 smithi175 ceph-mon[35688]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:30.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:30 smithi175 ceph-mon[35688]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T08:39:30.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:30 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:32.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:32 smithi007 ceph-mon[31221]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:32.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:32 smithi044 ceph-mon[35072]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:32.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:32 smithi175 ceph-mon[35688]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:34.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:34 smithi007 ceph-mon[31221]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-19T08:39:34.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:34 smithi044 ceph-mon[35072]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-19T08:39:34.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:34 smithi175 ceph-mon[35688]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-19T08:39:36.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:36 smithi044 ceph-mon[35072]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-19T08:39:36.870 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:36 smithi007 ceph-mon[31221]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-19T08:39:36.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:36 smithi175 ceph-mon[35688]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-19T08:39:37.648 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:37 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T08:39:37.649 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:37 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:37.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:37 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T08:39:37.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:37 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:37.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:37 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T08:39:37.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:37 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:38.797 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:38 smithi007 ceph-mon[31221]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:39:38.797 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:38 smithi007 ceph-mon[31221]: Deploying daemon osd.6 on smithi007 2024-09-19T08:39:38.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:38 smithi044 ceph-mon[35072]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:39:38.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:38 smithi044 ceph-mon[35072]: Deploying daemon osd.6 on smithi007 2024-09-19T08:39:38.829 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:38 smithi175 ceph-mon[35688]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:39:38.830 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:38 smithi175 ceph-mon[35688]: Deploying daemon osd.6 on smithi007 2024-09-19T08:39:40.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:40 smithi044 ceph-mon[35072]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-19T08:39:40.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:40 smithi175 ceph-mon[35688]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-19T08:39:41.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:40 smithi007 ceph-mon[31221]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-19T08:39:42.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:42 smithi044 ceph-mon[35072]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T08:39:42.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:42 smithi007 ceph-mon[31221]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T08:39:42.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:42 smithi175 ceph-mon[35688]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T08:39:43.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:43 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:43.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:43 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:43.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:43 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:43.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:43 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:43.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:43 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:43.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:43 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:43.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:43 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:43.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:43 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:43.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:43 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:44.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:44 smithi007 ceph-mon[31221]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:39:44.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:44 smithi175 ceph-mon[35688]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:39:45.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:44 smithi044 ceph-mon[35072]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:39:46.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:46.455+0000 7f4da2ffd640 1 -- 172.21.15.7:0/3424463854 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4dac062630 con 0x7f4d980a3270 2024-09-19T08:39:46.456 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 6 on host 'smithi007' 2024-09-19T08:39:46.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:46.457+0000 7f4db3e28640 1 -- 172.21.15.7:0/3424463854 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4d980a3270 msgr2=0x7f4d980a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:46.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:46.457+0000 7f4db3e28640 1 --2- 172.21.15.7:0/3424463854 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4d980a3270 0x7f4d980a5730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4dac101b70 tx=0x7f4da8005f90 comp rx=0 tx=0).stop 2024-09-19T08:39:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:46.457+0000 7f4db3e28640 1 -- 172.21.15.7:0/3424463854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dac1026d0 msgr2=0x7f4dac1a1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:46.457+0000 7f4db3e28640 1 --2- 172.21.15.7:0/3424463854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dac1026d0 0x7f4dac1a1540 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4da4031ae0 tx=0x7f4da4031ee0 comp rx=0 tx=0).stop 2024-09-19T08:39:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:46.458+0000 7f4db3e28640 1 -- 172.21.15.7:0/3424463854 shutdown_connections 2024-09-19T08:39:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:46.458+0000 7f4db3e28640 1 --2- 172.21.15.7:0/3424463854 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4d980a3270 0x7f4d980a5730 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:46.458+0000 7f4db3e28640 1 --2- 172.21.15.7:0/3424463854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dac1026d0 0x7f4dac1a1540 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:46.458+0000 7f4db3e28640 1 --2- 172.21.15.7:0/3424463854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dac101d10 0x7f4dac19eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:46.458+0000 7f4db3e28640 1 --2- 172.21.15.7:0/3424463854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dac100b10 0x7f4dac06b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:46.458+0000 7f4db3e28640 1 -- 172.21.15.7:0/3424463854 >> 172.21.15.7:0/3424463854 conn(0x7f4dac0fc2a0 msgr2=0x7f4dac105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:46.458+0000 7f4db3e28640 1 -- 172.21.15.7:0/3424463854 shutdown_connections 2024-09-19T08:39:46.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:39:46.458+0000 7f4db3e28640 1 -- 172.21.15.7:0/3424463854 wait complete. 2024-09-19T08:39:46.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:46 smithi175 ceph-mon[35688]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:46.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:46 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:46.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:46 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:46.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:46 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:46.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:46 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:46.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:46 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:46.759 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:46 smithi007 ceph-mon[31221]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:46.759 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:46 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:46.759 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:46 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:46.760 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:46 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:46.760 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:46 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:46.760 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:46 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:46 smithi044 ceph-mon[35072]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:46 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:46 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:46 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:46 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:46 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:47.064 DEBUG:teuthology.orchestra.run.smithi007:osd.6> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T08:39:47.066 INFO:tasks.cephadm:Deploying osd.7 on smithi044 with /dev/vg_nvme/lv_2... 2024-09-19T08:39:47.067 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:39:47.327 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:39:47.554 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:47 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:47.554 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:47 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:47.554 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:47 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:47.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:47 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:47.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:47 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:47.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:47 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:47.744 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:47 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:39:47.744 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:47 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:47.744 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:47 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:48.667 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:48 smithi044 ceph-mon[35072]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:48.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:48 smithi007 ceph-mon[31221]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:48.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:48 smithi175 ceph-mon[35688]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:49.034 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:39:48 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:39:48.958+0000 7fddb9725640 -1 osd.6 0 log_to_monitors true 2024-09-19T08:39:49.571 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:49 smithi044 ceph-mon[35072]: from='osd.6 [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T08:39:49.773 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:49 smithi007 ceph-mon[31221]: from='osd.6 [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T08:39:49.924 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-19T08:39:49.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:49 smithi175 ceph-mon[35688]: from='osd.6 [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T08:39:49.950 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi044:vg_nvme/lv_2 2024-09-19T08:39:50.205 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:39:50.636 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:50 smithi044 ceph-mon[35072]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:50.636 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:50 smithi044 ceph-mon[35072]: from='osd.6 [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T08:39:50.637 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:50 smithi044 ceph-mon[35072]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T08:39:50.637 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:50 smithi044 ceph-mon[35072]: from='osd.6 [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T08:39:50.637 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:50 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:50.637 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:50 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:50.637 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:50 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:50.637 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:50 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:50.637 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:50 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:50.637 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:50 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:50.637 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:50 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:50.637 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:50 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:50.637 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:50 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:50.637 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:50 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:50.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.634+0000 7f843b465640 1 -- 172.21.15.44:0/680713077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8434101730 msgr2=0x7f8434101be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:50.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.634+0000 7f843b465640 1 --2- 172.21.15.44:0/680713077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8434101730 0x7f8434101be0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f842c009ca0 tx=0x7f842c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:39:50.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.634+0000 7f843b465640 1 -- 172.21.15.44:0/680713077 shutdown_connections 2024-09-19T08:39:50.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.634+0000 7f843b465640 1 --2- 172.21.15.44:0/680713077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8434101730 0x7f8434101be0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:50.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.634+0000 7f843b465640 1 --2- 172.21.15.44:0/680713077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8434100d90 0x7f84341011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:50.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.634+0000 7f843b465640 1 --2- 172.21.15.44:0/680713077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8434100450 0x7f8434100850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:50.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.634+0000 7f843b465640 1 -- 172.21.15.44:0/680713077 >> 172.21.15.44:0/680713077 conn(0x7f84340fc280 msgr2=0x7f84340fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:50.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.635+0000 7f843b465640 1 -- 172.21.15.44:0/680713077 shutdown_connections 2024-09-19T08:39:50.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.635+0000 7f843b465640 1 -- 172.21.15.44:0/680713077 wait complete. 2024-09-19T08:39:50.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.635+0000 7f843b465640 1 Processor -- start 2024-09-19T08:39:50.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.635+0000 7f843b465640 1 -- start start 2024-09-19T08:39:50.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f843b465640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8434100450 0x7f8434199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:50.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f843b465640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8434100d90 0x7f843419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:50.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f843b465640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8434101730 0x7f84341a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:50.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f843b465640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f843410fa20 con 0x7f8434101730 2024-09-19T08:39:50.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f843b465640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f843410f8a0 con 0x7f8434100450 2024-09-19T08:39:50.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f843b465640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f843410fba0 con 0x7f8434100d90 2024-09-19T08:39:50.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f8439201640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8434100450 0x7f8434199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:50.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f8439201640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8434100450 0x7f8434199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53796/0 (socket says 172.21.15.44:53796) 2024-09-19T08:39:50.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f8439201640 1 -- 172.21.15.44:0/2867589748 learned_addr learned my addr 172.21.15.44:0/2867589748 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-19T08:39:50.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f8439a02640 1 --2- 172.21.15.44:0/2867589748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8434101730 0x7f84341a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:50.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f8438a00640 1 --2- 172.21.15.44:0/2867589748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8434100d90 0x7f843419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:50.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f8439201640 1 -- 172.21.15.44:0/2867589748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8434100d90 msgr2=0x7f843419a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:50.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f8439201640 1 --2- 172.21.15.44:0/2867589748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8434100d90 0x7f843419a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:50.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f8439201640 1 -- 172.21.15.44:0/2867589748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8434101730 msgr2=0x7f84341a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:50.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f8439201640 1 --2- 172.21.15.44:0/2867589748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8434101730 0x7f84341a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:50.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f8439201640 1 -- 172.21.15.44:0/2867589748 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84341a1c00 con 0x7f8434100450 2024-09-19T08:39:50.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f8438a00640 1 --2- 172.21.15.44:0/2867589748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8434100d90 0x7f843419a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:50.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f8439201640 1 --2- 172.21.15.44:0/2867589748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8434100450 0x7f8434199fd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f843000e9f0 tx=0x7f843000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:50.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f842a7fc640 1 -- 172.21.15.44:0/2867589748 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843000cd80 con 0x7f8434100450 2024-09-19T08:39:50.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f842a7fc640 1 -- 172.21.15.44:0/2867589748 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8430010910 con 0x7f8434100450 2024-09-19T08:39:50.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f843b465640 1 -- 172.21.15.44:0/2867589748 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84341a1ef0 con 0x7f8434100450 2024-09-19T08:39:50.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f842a7fc640 1 -- 172.21.15.44:0/2867589748 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8430018990 con 0x7f8434100450 2024-09-19T08:39:50.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.636+0000 7f843b465640 1 -- 172.21.15.44:0/2867589748 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84341a23a0 con 0x7f8434100450 2024-09-19T08:39:50.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.637+0000 7f843b465640 1 -- 172.21.15.44:0/2867589748 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f843410b1a0 con 0x7f8434100450 2024-09-19T08:39:50.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.639+0000 7f842a7fc640 1 -- 172.21.15.44:0/2867589748 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f8430010ac0 con 0x7f8434100450 2024-09-19T08:39:50.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.639+0000 7f842a7fc640 1 --2- 172.21.15.44:0/2867589748 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f84200a32f0 0x7f84200a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:50.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.639+0000 7f842a7fc640 1 -- 172.21.15.44:0/2867589748 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4685+0+0 (secure 0 0 0) 0x7f84300ceda0 con 0x7f8434100450 2024-09-19T08:39:50.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.639+0000 7f8438a00640 1 --2- 172.21.15.44:0/2867589748 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f84200a32f0 0x7f84200a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:50.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.640+0000 7f8438a00640 1 --2- 172.21.15.44:0/2867589748 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f84200a32f0 0x7f84200a57b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f843419b4f0 tx=0x7f842400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:50.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.643+0000 7f842a7fc640 1 -- 172.21.15.44:0/2867589748 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f843009c8f0 con 0x7f8434100450 2024-09-19T08:39:50.783 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:39:50 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:39:50.468+0000 7fddb4e85640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T08:39:50.783 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:39:50 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:39:50.478+0000 7fddb14bf640 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:39:50.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:50 smithi007 ceph-mon[31221]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:50.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:50 smithi007 ceph-mon[31221]: from='osd.6 [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T08:39:50.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:50 smithi007 ceph-mon[31221]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T08:39:50.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:50 smithi007 ceph-mon[31221]: from='osd.6 [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T08:39:50.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:50 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:50.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:50 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:50.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:50 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:50.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:50 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:50.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:50 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:50.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:50 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:50.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:50 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:50.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:50 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:50.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:50 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:50.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:50 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:50.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:39:50.829+0000 7f843b465640 1 -- 172.21.15.44:0/2867589748 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f8434062630 con 0x7f84200a32f0 2024-09-19T08:39:50.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:50 smithi175 ceph-mon[35688]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:50.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:50 smithi175 ceph-mon[35688]: from='osd.6 [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T08:39:50.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:50 smithi175 ceph-mon[35688]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T08:39:50.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:50 smithi175 ceph-mon[35688]: from='osd.6 [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T08:39:50.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:50 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:50.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:50 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:50.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:50 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:50.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:50 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:50.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:50 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:50.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:50 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:39:50.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:50 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:50.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:50 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:50.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:50 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:39:50.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:50 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:39:51.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:51 smithi007 ceph-mon[31221]: Detected new or changed devices on smithi007 2024-09-19T08:39:51.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:51 smithi007 ceph-mon[31221]: Adjusting osd_memory_target on smithi007 to 5697M 2024-09-19T08:39:51.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:51 smithi007 ceph-mon[31221]: from='osd.6 [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T08:39:51.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:51 smithi007 ceph-mon[31221]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T08:39:51.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:51 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:51.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:51 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:51.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:51 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:39:51.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:51 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:39:51.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:51 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:51.788 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:51 smithi044 ceph-mon[35072]: Detected new or changed devices on smithi007 2024-09-19T08:39:51.789 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:51 smithi044 ceph-mon[35072]: Adjusting osd_memory_target on smithi007 to 5697M 2024-09-19T08:39:51.789 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:51 smithi044 ceph-mon[35072]: from='osd.6 [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T08:39:51.789 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:51 smithi044 ceph-mon[35072]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T08:39:51.789 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:51 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:51.789 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:51 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:51.789 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:51 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:39:51.789 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:51 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:39:51.789 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:51 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:51.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:51 smithi175 ceph-mon[35688]: Detected new or changed devices on smithi007 2024-09-19T08:39:51.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:51 smithi175 ceph-mon[35688]: Adjusting osd_memory_target on smithi007 to 5697M 2024-09-19T08:39:51.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:51 smithi175 ceph-mon[35688]: from='osd.6 [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T08:39:51.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:51 smithi175 ceph-mon[35688]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T08:39:51.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:51 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:51.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:51 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:51.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:51 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:39:51.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:51 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:39:51.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:51 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:39:52.729 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:52 smithi044 ceph-mon[35072]: purged_snaps scrub starts 2024-09-19T08:39:52.730 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:52 smithi044 ceph-mon[35072]: purged_snaps scrub ok 2024-09-19T08:39:52.730 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:52 smithi044 ceph-mon[35072]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:52.730 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:52 smithi044 ceph-mon[35072]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:39:52.730 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:52 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:52.730 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:52 smithi044 ceph-mon[35072]: osd.6 [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202] boot 2024-09-19T08:39:52.730 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:52 smithi044 ceph-mon[35072]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T08:39:52.731 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:52 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:52.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:52 smithi007 ceph-mon[31221]: purged_snaps scrub starts 2024-09-19T08:39:52.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:52 smithi007 ceph-mon[31221]: purged_snaps scrub ok 2024-09-19T08:39:52.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:52 smithi007 ceph-mon[31221]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:52.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:52 smithi007 ceph-mon[31221]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:39:52.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:52 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:52.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:52 smithi007 ceph-mon[31221]: osd.6 [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202] boot 2024-09-19T08:39:52.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:52 smithi007 ceph-mon[31221]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T08:39:52.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:52 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:52.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:52 smithi175 ceph-mon[35688]: purged_snaps scrub starts 2024-09-19T08:39:52.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:52 smithi175 ceph-mon[35688]: purged_snaps scrub ok 2024-09-19T08:39:52.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:52 smithi175 ceph-mon[35688]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:39:52.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:52 smithi175 ceph-mon[35688]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:39:52.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:52 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:52.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:52 smithi175 ceph-mon[35688]: osd.6 [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202] boot 2024-09-19T08:39:52.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:52 smithi175 ceph-mon[35688]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T08:39:52.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:52 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:39:53.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:53 smithi044 ceph-mon[35072]: osdmap e45: 7 total, 7 up, 7 in 2024-09-19T08:39:53.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:53 smithi044 ceph-mon[35072]: from='client.? 172.21.15.44:0/1163417135' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa24aee5-6449-4842-8831-1c8e06cde75b"}]: dispatch 2024-09-19T08:39:53.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:53 smithi044 ceph-mon[35072]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa24aee5-6449-4842-8831-1c8e06cde75b"}]: dispatch 2024-09-19T08:39:53.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:53 smithi044 ceph-mon[35072]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa24aee5-6449-4842-8831-1c8e06cde75b"}]': finished 2024-09-19T08:39:53.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:53 smithi044 ceph-mon[35072]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T08:39:53.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:53 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:39:53.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:53 smithi007 ceph-mon[31221]: osdmap e45: 7 total, 7 up, 7 in 2024-09-19T08:39:53.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:53 smithi007 ceph-mon[31221]: from='client.? 172.21.15.44:0/1163417135' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa24aee5-6449-4842-8831-1c8e06cde75b"}]: dispatch 2024-09-19T08:39:53.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:53 smithi007 ceph-mon[31221]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa24aee5-6449-4842-8831-1c8e06cde75b"}]: dispatch 2024-09-19T08:39:53.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:53 smithi007 ceph-mon[31221]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa24aee5-6449-4842-8831-1c8e06cde75b"}]': finished 2024-09-19T08:39:53.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:53 smithi007 ceph-mon[31221]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T08:39:53.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:53 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:39:53.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:53 smithi175 ceph-mon[35688]: osdmap e45: 7 total, 7 up, 7 in 2024-09-19T08:39:53.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:53 smithi175 ceph-mon[35688]: from='client.? 172.21.15.44:0/1163417135' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa24aee5-6449-4842-8831-1c8e06cde75b"}]: dispatch 2024-09-19T08:39:53.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:53 smithi175 ceph-mon[35688]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa24aee5-6449-4842-8831-1c8e06cde75b"}]: dispatch 2024-09-19T08:39:53.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:53 smithi175 ceph-mon[35688]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa24aee5-6449-4842-8831-1c8e06cde75b"}]': finished 2024-09-19T08:39:53.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:53 smithi175 ceph-mon[35688]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T08:39:53.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:53 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:39:54.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:54 smithi007 ceph-mon[31221]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:39:54.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:54 smithi007 ceph-mon[31221]: from='client.? 172.21.15.44:0/4164406761' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:39:54.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:54 smithi044 ceph-mon[35072]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:39:54.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:54 smithi044 ceph-mon[35072]: from='client.? 172.21.15.44:0/4164406761' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:39:54.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:54 smithi175 ceph-mon[35688]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:39:54.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:54 smithi175 ceph-mon[35688]: from='client.? 172.21.15.44:0/4164406761' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:39:56.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:56 smithi007 ceph-mon[31221]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:39:56.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:56 smithi044 ceph-mon[35072]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:39:56.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:56 smithi175 ceph-mon[35688]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:39:58.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:39:58 smithi007 ceph-mon[31221]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:39:58.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:39:58 smithi044 ceph-mon[35072]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:39:58.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:39:58 smithi175 ceph-mon[35688]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:00.620 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:00 smithi044 ceph-mon[35072]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:00.620 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:00 smithi044 ceph-mon[35072]: overall HEALTH_OK 2024-09-19T08:40:00.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:00 smithi007 ceph-mon[31221]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:00.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:00 smithi007 ceph-mon[31221]: overall HEALTH_OK 2024-09-19T08:40:00.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:00 smithi175 ceph-mon[35688]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:00.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:00 smithi175 ceph-mon[35688]: overall HEALTH_OK 2024-09-19T08:40:02.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:02 smithi044 ceph-mon[35072]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:02.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:02 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T08:40:02.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:02 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:02.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:02 smithi044 ceph-mon[35072]: Deploying daemon osd.7 on smithi044 2024-09-19T08:40:02.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:02 smithi007 ceph-mon[31221]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:02.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:02 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T08:40:02.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:02 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:02.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:02 smithi007 ceph-mon[31221]: Deploying daemon osd.7 on smithi044 2024-09-19T08:40:02.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:02 smithi175 ceph-mon[35688]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:02.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:02 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T08:40:02.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:02 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:02.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:02 smithi175 ceph-mon[35688]: Deploying daemon osd.7 on smithi044 2024-09-19T08:40:04.764 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:04 smithi044 ceph-mon[35072]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:04.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:04 smithi007 ceph-mon[31221]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:04.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:04 smithi175 ceph-mon[35688]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:06.640 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:06 smithi044 ceph-mon[35072]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:06.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:06 smithi007 ceph-mon[31221]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:06.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:06 smithi175 ceph-mon[35688]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:08.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:08 smithi007 ceph-mon[31221]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:08.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:08 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:08.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:08 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:08.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:08 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:08.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:08 smithi044 ceph-mon[35072]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:08.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:08 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:08.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:08 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:08.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:08 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:08.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:08 smithi175 ceph-mon[35688]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:08.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:08 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:08.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:08 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:08.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:08 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:10.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:10 smithi007 ceph-mon[31221]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:10.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:10 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:10.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:10 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:10.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:10 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:10.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:10 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:10.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:10 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:10.794 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:10 smithi044 ceph-mon[35072]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:10.794 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:10 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:10.794 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:10 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:10.794 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:10 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:10.794 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:10 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:10.794 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:10 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:10.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:10 smithi175 ceph-mon[35688]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:10.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:10 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:10.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:10 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:10.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:10 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:10.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:10 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:10.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:10 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:11.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:40:11.086+0000 7f842a7fc640 1 -- 172.21.15.44:0/2867589748 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8434062630 con 0x7f84200a32f0 2024-09-19T08:40:11.086 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 7 on host 'smithi044' 2024-09-19T08:40:11.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:40:11.088+0000 7f843b465640 1 -- 172.21.15.44:0/2867589748 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f84200a32f0 msgr2=0x7f84200a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:40:11.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:40:11.088+0000 7f843b465640 1 --2- 172.21.15.44:0/2867589748 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f84200a32f0 0x7f84200a57b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f843419b4f0 tx=0x7f842400a5c0 comp rx=0 tx=0).stop 2024-09-19T08:40:11.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:40:11.088+0000 7f843b465640 1 -- 172.21.15.44:0/2867589748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8434100450 msgr2=0x7f8434199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:40:11.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:40:11.088+0000 7f843b465640 1 --2- 172.21.15.44:0/2867589748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8434100450 0x7f8434199fd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f843000e9f0 tx=0x7f843000eeb0 comp rx=0 tx=0).stop 2024-09-19T08:40:11.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:40:11.088+0000 7f843b465640 1 -- 172.21.15.44:0/2867589748 shutdown_connections 2024-09-19T08:40:11.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:40:11.088+0000 7f843b465640 1 --2- 172.21.15.44:0/2867589748 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f84200a32f0 0x7f84200a57b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:11.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:40:11.088+0000 7f843b465640 1 --2- 172.21.15.44:0/2867589748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8434101730 0x7f84341a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:11.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:40:11.088+0000 7f843b465640 1 --2- 172.21.15.44:0/2867589748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8434100d90 0x7f843419a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:11.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:40:11.088+0000 7f843b465640 1 --2- 172.21.15.44:0/2867589748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8434100450 0x7f8434199fd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:11.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:40:11.088+0000 7f843b465640 1 -- 172.21.15.44:0/2867589748 >> 172.21.15.44:0/2867589748 conn(0x7f84340fc280 msgr2=0x7f84340fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:40:11.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:40:11.088+0000 7f843b465640 1 -- 172.21.15.44:0/2867589748 shutdown_connections 2024-09-19T08:40:11.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:40:11.088+0000 7f843b465640 1 -- 172.21.15.44:0/2867589748 wait complete. 2024-09-19T08:40:11.667 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:11 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:11.667 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:11 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:11.667 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:11 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:11.669 DEBUG:teuthology.orchestra.run.smithi044:osd.7> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T08:40:11.671 INFO:tasks.cephadm:Deploying osd.8 on smithi175 with /dev/vg_nvme/lv_2... 2024-09-19T08:40:11.672 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:40:11.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:11 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:11.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:11 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:11.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:11 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:11.925 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:40:11.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:11 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:11.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:11 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:11.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:11 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:12.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:12 smithi175 ceph-mon[35688]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:12.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:12 smithi007 ceph-mon[31221]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:12.795 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:12 smithi044 ceph-mon[35072]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:14.051 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:40:13 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:40:13.829+0000 7fc0092e5640 -1 osd.7 0 log_to_monitors true 2024-09-19T08:40:14.492 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:40:14.519 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_2 2024-09-19T08:40:14.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:14 smithi175 ceph-mon[35688]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:14.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:14 smithi175 ceph-mon[35688]: from='osd.7 [v2:172.21.15.44:6816/3120822957,v1:172.21.15.44:6817/3120822957]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:40:14.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:14 smithi175 ceph-mon[35688]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:40:14.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:14 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:14.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:14 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:14.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:14 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:14.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:14 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:14.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:14 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:14.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:14 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:14.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:14 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:14.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:14 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:14.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:14 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:14.774 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:40:14.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:14 smithi007 ceph-mon[31221]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:14.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:14 smithi007 ceph-mon[31221]: from='osd.7 [v2:172.21.15.44:6816/3120822957,v1:172.21.15.44:6817/3120822957]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:40:14.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:14 smithi007 ceph-mon[31221]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:40:14.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:14 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:14.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:14 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:14.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:14 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:14.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:14 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:14.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:14 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:14.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:14 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:14.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:14 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:14.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:14 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:14.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:14 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:14 smithi044 ceph-mon[35072]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:14 smithi044 ceph-mon[35072]: from='osd.7 [v2:172.21.15.44:6816/3120822957,v1:172.21.15.44:6817/3120822957]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:40:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:14 smithi044 ceph-mon[35072]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:40:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:14 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:14 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:14 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:14 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:14 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:14 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:14 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:14.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:14 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:14.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:14 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:15.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.193+0000 7f513debc640 1 -- 172.21.15.175:0/1721670559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5138101cd0 msgr2=0x7f5138102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:40:15.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.193+0000 7f513debc640 1 --2- 172.21.15.175:0/1721670559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5138101cd0 0x7f5138102150 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f512c009900 tx=0x7f512c02a410 comp rx=0 tx=0).stop 2024-09-19T08:40:15.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.193+0000 7f513debc640 1 -- 172.21.15.175:0/1721670559 shutdown_connections 2024-09-19T08:40:15.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.193+0000 7f513debc640 1 --2- 172.21.15.175:0/1721670559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5138102690 0x7f5138108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:15.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.193+0000 7f513debc640 1 --2- 172.21.15.175:0/1721670559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5138101cd0 0x7f5138102150 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:15.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.193+0000 7f513debc640 1 --2- 172.21.15.175:0/1721670559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5138100ad0 0x7f5138100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:15.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.193+0000 7f513debc640 1 -- 172.21.15.175:0/1721670559 >> 172.21.15.175:0/1721670559 conn(0x7f51380fc280 msgr2=0x7f51380fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:40:15.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.193+0000 7f513debc640 1 -- 172.21.15.175:0/1721670559 shutdown_connections 2024-09-19T08:40:15.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.193+0000 7f513debc640 1 -- 172.21.15.175:0/1721670559 wait complete. 2024-09-19T08:40:15.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.194+0000 7f513debc640 1 Processor -- start 2024-09-19T08:40:15.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.194+0000 7f513debc640 1 -- start start 2024-09-19T08:40:15.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.194+0000 7f513debc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5138100ad0 0x7f5138197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:40:15.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.194+0000 7f513debc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5138101cd0 0x7f5138198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:40:15.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.194+0000 7f513debc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5138102690 0x7f513819f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:40:15.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.194+0000 7f513debc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f513810c730 con 0x7f5138102690 2024-09-19T08:40:15.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.194+0000 7f513debc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f513810c5b0 con 0x7f5138100ad0 2024-09-19T08:40:15.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.194+0000 7f513debc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f513810c8b0 con 0x7f5138101cd0 2024-09-19T08:40:15.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.194+0000 7f5136ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5138101cd0 0x7f5138198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:40:15.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.194+0000 7f5136ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5138101cd0 0x7f5138198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35090/0 (socket says 172.21.15.175:35090) 2024-09-19T08:40:15.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.194+0000 7f5136ffd640 1 -- 172.21.15.175:0/3981420488 learned_addr learned my addr 172.21.15.175:0/3981420488 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-19T08:40:15.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.194+0000 7f5137fff640 1 --2- 172.21.15.175:0/3981420488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5138102690 0x7f513819f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:40:15.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.194+0000 7f51377fe640 1 --2- 172.21.15.175:0/3981420488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5138100ad0 0x7f5138197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:40:15.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.195+0000 7f5136ffd640 1 -- 172.21.15.175:0/3981420488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5138100ad0 msgr2=0x7f5138197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:40:15.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.195+0000 7f5136ffd640 1 --2- 172.21.15.175:0/3981420488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5138100ad0 0x7f5138197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:15.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.195+0000 7f5136ffd640 1 -- 172.21.15.175:0/3981420488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5138102690 msgr2=0x7f513819f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:40:15.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.195+0000 7f5136ffd640 1 --2- 172.21.15.175:0/3981420488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5138102690 0x7f513819f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:15.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.195+0000 7f5136ffd640 1 -- 172.21.15.175:0/3981420488 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513819fb10 con 0x7f5138101cd0 2024-09-19T08:40:15.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.195+0000 7f51377fe640 1 --2- 172.21.15.175:0/3981420488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5138100ad0 0x7f5138197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:40:15.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.195+0000 7f5136ffd640 1 --2- 172.21.15.175:0/3981420488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5138101cd0 0x7f5138198420 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f512c009230 tx=0x7f512c004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:40:15.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.195+0000 7f5134ff9640 1 -- 172.21.15.175:0/3981420488 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c03f030 con 0x7f5138101cd0 2024-09-19T08:40:15.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.195+0000 7f5134ff9640 1 -- 172.21.15.175:0/3981420488 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f512c003ce0 con 0x7f5138101cd0 2024-09-19T08:40:15.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.195+0000 7f5134ff9640 1 -- 172.21.15.175:0/3981420488 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c035070 con 0x7f5138101cd0 2024-09-19T08:40:15.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.195+0000 7f513debc640 1 -- 172.21.15.175:0/3981420488 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f513819fda0 con 0x7f5138101cd0 2024-09-19T08:40:15.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.195+0000 7f513debc640 1 -- 172.21.15.175:0/3981420488 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51381a0220 con 0x7f5138101cd0 2024-09-19T08:40:15.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.196+0000 7f513debc640 1 -- 172.21.15.175:0/3981420488 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51381a0450 con 0x7f5138101cd0 2024-09-19T08:40:15.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.197+0000 7f5134ff9640 1 -- 172.21.15.175:0/3981420488 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f512c042030 con 0x7f5138101cd0 2024-09-19T08:40:15.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.198+0000 7f5134ff9640 1 --2- 172.21.15.175:0/3981420488 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f51200a3270 0x7f51200a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:40:15.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.198+0000 7f5134ff9640 1 -- 172.21.15.175:0/3981420488 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5101+0+0 (secure 0 0 0) 0x7f512c0ef460 con 0x7f5138101cd0 2024-09-19T08:40:15.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.198+0000 7f51377fe640 1 --2- 172.21.15.175:0/3981420488 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f51200a3270 0x7f51200a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:40:15.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.199+0000 7f51377fe640 1 --2- 172.21.15.175:0/3981420488 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f51200a3270 0x7f51200a5730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5138101b30 tx=0x7f5128005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:40:15.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.202+0000 7f5134ff9640 1 -- 172.21.15.175:0/3981420488 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f512c0bce10 con 0x7f5138101cd0 2024-09-19T08:40:15.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:15.393+0000 7f513debc640 1 -- 172.21.15.175:0/3981420488 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f51381a0620 con 0x7f51200a3270 2024-09-19T08:40:15.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:15 smithi175 ceph-mon[35688]: Detected new or changed devices on smithi044 2024-09-19T08:40:15.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:15 smithi175 ceph-mon[35688]: Adjusting osd_memory_target on smithi044 to 5697M 2024-09-19T08:40:15.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:15 smithi175 ceph-mon[35688]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T08:40:15.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:15 smithi175 ceph-mon[35688]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T08:40:15.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:15 smithi175 ceph-mon[35688]: from='osd.7 [v2:172.21.15.44:6816/3120822957,v1:172.21.15.44:6817/3120822957]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:40:15.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:15 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:15.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:15 smithi175 ceph-mon[35688]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:40:15.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:15 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:40:15.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:15 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:40:15.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:15 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:15.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:15 smithi175 ceph-mon[35688]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-19T08:40:15.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:15 smithi007 ceph-mon[31221]: Detected new or changed devices on smithi044 2024-09-19T08:40:15.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:15 smithi007 ceph-mon[31221]: Adjusting osd_memory_target on smithi044 to 5697M 2024-09-19T08:40:15.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:15 smithi007 ceph-mon[31221]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T08:40:15.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:15 smithi007 ceph-mon[31221]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T08:40:15.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:15 smithi007 ceph-mon[31221]: from='osd.7 [v2:172.21.15.44:6816/3120822957,v1:172.21.15.44:6817/3120822957]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:40:15.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:15 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:15.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:15 smithi007 ceph-mon[31221]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:40:15.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:15 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:40:15.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:15 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:40:15.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:15 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:15.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:15 smithi007 ceph-mon[31221]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-19T08:40:15.800 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:40:15 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:40:15.532+0000 7fc004a45640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T08:40:15.800 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:40:15 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:40:15.543+0000 7fc00107f640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:40:15.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:15 smithi044 ceph-mon[35072]: Detected new or changed devices on smithi044 2024-09-19T08:40:15.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:15 smithi044 ceph-mon[35072]: Adjusting osd_memory_target on smithi044 to 5697M 2024-09-19T08:40:15.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:15 smithi044 ceph-mon[35072]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T08:40:15.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:15 smithi044 ceph-mon[35072]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T08:40:15.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:15 smithi044 ceph-mon[35072]: from='osd.7 [v2:172.21.15.44:6816/3120822957,v1:172.21.15.44:6817/3120822957]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:40:15.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:15 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:15.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:15 smithi044 ceph-mon[35072]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:40:15.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:15 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:40:15.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:15 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:40:15.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:15 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:15.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:15 smithi044 ceph-mon[35072]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-19T08:40:16.623 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:16 smithi175 ceph-mon[35688]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:16.623 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:16 smithi175 ceph-mon[35688]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:40:16.623 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:16 smithi175 ceph-mon[35688]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T08:40:16.623 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:16 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:16.623 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:16 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:16.623 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:16 smithi175 ceph-mon[35688]: osd.7 [v2:172.21.15.44:6816/3120822957,v1:172.21.15.44:6817/3120822957] boot 2024-09-19T08:40:16.623 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:16 smithi175 ceph-mon[35688]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T08:40:16.623 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:16 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:16.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:16 smithi007 ceph-mon[31221]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:16.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:16 smithi007 ceph-mon[31221]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:40:16.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:16 smithi007 ceph-mon[31221]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T08:40:16.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:16 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:16.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:16 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:16.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:16 smithi007 ceph-mon[31221]: osd.7 [v2:172.21.15.44:6816/3120822957,v1:172.21.15.44:6817/3120822957] boot 2024-09-19T08:40:16.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:16 smithi007 ceph-mon[31221]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T08:40:16.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:16 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:16 smithi044 ceph-mon[35072]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:40:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:16 smithi044 ceph-mon[35072]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:40:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:16 smithi044 ceph-mon[35072]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T08:40:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:16 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:16 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:16 smithi044 ceph-mon[35072]: osd.7 [v2:172.21.15.44:6816/3120822957,v1:172.21.15.44:6817/3120822957] boot 2024-09-19T08:40:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:16 smithi044 ceph-mon[35072]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T08:40:16.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:16 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:40:17.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:17 smithi044 ceph-mon[35072]: purged_snaps scrub starts 2024-09-19T08:40:17.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:17 smithi044 ceph-mon[35072]: purged_snaps scrub ok 2024-09-19T08:40:17.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:17 smithi044 ceph-mon[35072]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T08:40:17.827 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:17 smithi175 ceph-mon[35688]: purged_snaps scrub starts 2024-09-19T08:40:17.827 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:17 smithi175 ceph-mon[35688]: purged_snaps scrub ok 2024-09-19T08:40:17.827 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:17 smithi175 ceph-mon[35688]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T08:40:18.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:17 smithi007 ceph-mon[31221]: purged_snaps scrub starts 2024-09-19T08:40:18.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:17 smithi007 ceph-mon[31221]: purged_snaps scrub ok 2024-09-19T08:40:18.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:17 smithi007 ceph-mon[31221]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T08:40:18.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:18 smithi044 ceph-mon[35072]: pgmap v169: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:18.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:18 smithi044 ceph-mon[35072]: from='client.? 172.21.15.175:0/3086274822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d912501a-bb7a-489e-b6ab-e451fb22210d"}]: dispatch 2024-09-19T08:40:18.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:18 smithi044 ceph-mon[35072]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d912501a-bb7a-489e-b6ab-e451fb22210d"}]: dispatch 2024-09-19T08:40:18.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:18 smithi044 ceph-mon[35072]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d912501a-bb7a-489e-b6ab-e451fb22210d"}]': finished 2024-09-19T08:40:18.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:18 smithi044 ceph-mon[35072]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T08:40:18.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:18 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:18.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:18 smithi044 ceph-mon[35072]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T08:40:18.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:18 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:18.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:18 smithi044 ceph-mon[35072]: from='client.? 172.21.15.175:0/2534337742' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:40:18.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:18 smithi175 ceph-mon[35688]: pgmap v169: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:18.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:18 smithi175 ceph-mon[35688]: from='client.? 172.21.15.175:0/3086274822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d912501a-bb7a-489e-b6ab-e451fb22210d"}]: dispatch 2024-09-19T08:40:18.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:18 smithi175 ceph-mon[35688]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d912501a-bb7a-489e-b6ab-e451fb22210d"}]: dispatch 2024-09-19T08:40:18.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:18 smithi175 ceph-mon[35688]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d912501a-bb7a-489e-b6ab-e451fb22210d"}]': finished 2024-09-19T08:40:18.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:18 smithi175 ceph-mon[35688]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T08:40:18.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:18 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:18.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:18 smithi175 ceph-mon[35688]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T08:40:18.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:18 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:18.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:18 smithi175 ceph-mon[35688]: from='client.? 172.21.15.175:0/2534337742' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:40:18.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:18 smithi007 ceph-mon[31221]: pgmap v169: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:18.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:18 smithi007 ceph-mon[31221]: from='client.? 172.21.15.175:0/3086274822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d912501a-bb7a-489e-b6ab-e451fb22210d"}]: dispatch 2024-09-19T08:40:18.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:18 smithi007 ceph-mon[31221]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d912501a-bb7a-489e-b6ab-e451fb22210d"}]: dispatch 2024-09-19T08:40:18.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:18 smithi007 ceph-mon[31221]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d912501a-bb7a-489e-b6ab-e451fb22210d"}]': finished 2024-09-19T08:40:18.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:18 smithi007 ceph-mon[31221]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T08:40:18.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:18.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:18 smithi007 ceph-mon[31221]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T08:40:18.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:18.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:18 smithi007 ceph-mon[31221]: from='client.? 172.21.15.175:0/2534337742' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:40:20.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:19 smithi007 ceph-mon[31221]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T08:40:20.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:19 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:20.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:19 smithi044 ceph-mon[35072]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T08:40:20.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:19 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:20.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:19 smithi175 ceph-mon[35688]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T08:40:20.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:19 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:21.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:20 smithi007 ceph-mon[31221]: pgmap v174: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:21.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:20 smithi044 ceph-mon[35072]: pgmap v174: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:21.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:20 smithi175 ceph-mon[35688]: pgmap v174: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:23.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:22 smithi007 ceph-mon[31221]: pgmap v175: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:23.038 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:22 smithi175 ceph-mon[35688]: pgmap v175: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:23.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:22 smithi044 ceph-mon[35072]: pgmap v175: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:24.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:24 smithi175 ceph-mon[35688]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:25.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:24 smithi007 ceph-mon[31221]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:25.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:24 smithi044 ceph-mon[35072]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:26.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:26 smithi175 ceph-mon[35688]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:26.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:26 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T08:40:26.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:26 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:27.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:26 smithi007 ceph-mon[31221]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:27.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:26 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T08:40:27.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:26 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:27.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:26 smithi044 ceph-mon[35072]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:27.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:26 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T08:40:27.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:26 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:27.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:27 smithi175 ceph-mon[35688]: Deploying daemon osd.8 on smithi175 2024-09-19T08:40:28.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:27 smithi007 ceph-mon[31221]: Deploying daemon osd.8 on smithi175 2024-09-19T08:40:28.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:27 smithi044 ceph-mon[35072]: Deploying daemon osd.8 on smithi175 2024-09-19T08:40:28.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:28 smithi175 ceph-mon[35688]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:29.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:28 smithi007 ceph-mon[31221]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:29.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:28 smithi044 ceph-mon[35072]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:30.888 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:30 smithi175 ceph-mon[35688]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:31.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:30 smithi007 ceph-mon[31221]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:31.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:30 smithi044 ceph-mon[35072]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:32.006 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:31 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:32.006 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:31 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:32.006 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:31 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:32.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:31 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:32.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:31 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:32.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:31 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:32.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:31 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:32.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:31 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:32.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:31 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:32.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:32 smithi175 ceph-mon[35688]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:33.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:32 smithi007 ceph-mon[31221]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:33.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:32 smithi044 ceph-mon[35072]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:35.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:34 smithi175 ceph-mon[35688]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:35.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:34 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:35.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:34 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:35.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:34 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:35.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:34 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:35.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:34 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:35.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:34 smithi007 ceph-mon[31221]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:35.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:34 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:35.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:34 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:35.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:34 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:35.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:34 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:35.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:34 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:35.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:34 smithi044 ceph-mon[35072]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:35.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:34 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:35.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:34 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:35.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:34 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:35.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:34 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:35.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:34 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:35.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:35.071+0000 7f5134ff9640 1 -- 172.21.15.175:0/3981420488 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f51381a0620 con 0x7f51200a3270 2024-09-19T08:40:35.073 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 8 on host 'smithi175' 2024-09-19T08:40:35.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:35.073+0000 7f513debc640 1 -- 172.21.15.175:0/3981420488 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f51200a3270 msgr2=0x7f51200a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:40:35.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:35.073+0000 7f513debc640 1 --2- 172.21.15.175:0/3981420488 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f51200a3270 0x7f51200a5730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5138101b30 tx=0x7f5128005d30 comp rx=0 tx=0).stop 2024-09-19T08:40:35.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:35.073+0000 7f513debc640 1 -- 172.21.15.175:0/3981420488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5138101cd0 msgr2=0x7f5138198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:40:35.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:35.073+0000 7f513debc640 1 --2- 172.21.15.175:0/3981420488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5138101cd0 0x7f5138198420 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f512c009230 tx=0x7f512c004430 comp rx=0 tx=0).stop 2024-09-19T08:40:35.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:35.074+0000 7f513debc640 1 -- 172.21.15.175:0/3981420488 shutdown_connections 2024-09-19T08:40:35.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:35.074+0000 7f513debc640 1 --2- 172.21.15.175:0/3981420488 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f51200a3270 0x7f51200a5730 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:35.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:35.074+0000 7f513debc640 1 --2- 172.21.15.175:0/3981420488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5138102690 0x7f513819f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:35.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:35.074+0000 7f513debc640 1 --2- 172.21.15.175:0/3981420488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5138101cd0 0x7f5138198420 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:35.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:35.074+0000 7f513debc640 1 --2- 172.21.15.175:0/3981420488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5138100ad0 0x7f5138197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:35.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:35.074+0000 7f513debc640 1 -- 172.21.15.175:0/3981420488 >> 172.21.15.175:0/3981420488 conn(0x7f51380fc280 msgr2=0x7f5138069fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:40:35.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:35.074+0000 7f513debc640 1 -- 172.21.15.175:0/3981420488 shutdown_connections 2024-09-19T08:40:35.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:40:35.074+0000 7f513debc640 1 -- 172.21.15.175:0/3981420488 wait complete. 2024-09-19T08:40:35.739 DEBUG:teuthology.orchestra.run.smithi175:osd.8> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T08:40:35.741 INFO:tasks.cephadm:Deploying osd.9 on smithi007 with /dev/vg_nvme/lv_1... 2024-09-19T08:40:35.742 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T08:40:35.989 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:35 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:35.989 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:35 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:35.989 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:35 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:36.011 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:40:36.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:35 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:36.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:35 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:36.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:35 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:36.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:35 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:36.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:35 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:36.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:35 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:36.816 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:36 smithi175 ceph-mon[35688]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:37.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:36 smithi007 ceph-mon[31221]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:37.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:36 smithi044 ceph-mon[35072]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:37.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:37 smithi175 ceph-mon[35688]: from='osd.8 [v2:172.21.15.175:6816/2080374927,v1:172.21.15.175:6817/2080374927]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:40:37.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:37 smithi175 ceph-mon[35688]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:40:37.929 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:40:37 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:40:37.524+0000 7fe188199640 -1 osd.8 0 log_to_monitors true 2024-09-19T08:40:38.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:37 smithi007 ceph-mon[31221]: from='osd.8 [v2:172.21.15.175:6816/2080374927,v1:172.21.15.175:6817/2080374927]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:40:38.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:37 smithi007 ceph-mon[31221]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:40:38.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:37 smithi044 ceph-mon[35072]: from='osd.8 [v2:172.21.15.175:6816/2080374927,v1:172.21.15.175:6817/2080374927]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:40:38.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:37 smithi044 ceph-mon[35072]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:40:38.670 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:40:38.695 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_1 2024-09-19T08:40:38.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:38 smithi175 ceph-mon[35688]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:38.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:38 smithi175 ceph-mon[35688]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T08:40:38.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:38 smithi175 ceph-mon[35688]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T08:40:38.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:38 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:38.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:38 smithi175 ceph-mon[35688]: from='osd.8 [v2:172.21.15.175:6816/2080374927,v1:172.21.15.175:6817/2080374927]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:40:38.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:38 smithi175 ceph-mon[35688]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:40:38.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:38 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:38.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:38 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:38.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:38 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:38.767 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:38 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:38.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:38 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:38.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:38 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:38.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:38 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:38.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:38 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:38.768 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:38 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:38.955 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:40:39.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:38 smithi007 ceph-mon[31221]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:39.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:38 smithi007 ceph-mon[31221]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T08:40:39.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:38 smithi007 ceph-mon[31221]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T08:40:39.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:38 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:39.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:38 smithi007 ceph-mon[31221]: from='osd.8 [v2:172.21.15.175:6816/2080374927,v1:172.21.15.175:6817/2080374927]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:40:39.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:38 smithi007 ceph-mon[31221]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:40:39.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:38 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:39.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:38 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:39.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:38 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:39.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:38 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:39.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:38 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:39.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:38 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:39.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:38 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:39.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:38 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:39.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:38 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:39.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:38 smithi044 ceph-mon[35072]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:39.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:38 smithi044 ceph-mon[35072]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T08:40:39.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:38 smithi044 ceph-mon[35072]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T08:40:39.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:38 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:39.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:38 smithi044 ceph-mon[35072]: from='osd.8 [v2:172.21.15.175:6816/2080374927,v1:172.21.15.175:6817/2080374927]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:40:39.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:38 smithi044 ceph-mon[35072]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:40:39.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:38 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:39.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:38 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:39.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:38 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:39.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:38 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:39.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:38 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:40:39.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:38 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:39.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:38 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:39.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:38 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:40:39.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:38 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:39.178 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:40:38 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:40:38.771+0000 7fe1838f9640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T08:40:39.178 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:40:38 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:40:38.781+0000 7fe17ff33640 -1 osd.8 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:40:39.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.457+0000 7fc2edf16640 1 -- 172.21.15.7:0/3138764708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2e8101cd0 msgr2=0x7fc2e8102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:40:39.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.457+0000 7fc2edf16640 1 --2- 172.21.15.7:0/3138764708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2e8101cd0 0x7fc2e8102150 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009900 tx=0x7fc2d002a410 comp rx=0 tx=0).stop 2024-09-19T08:40:39.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.457+0000 7fc2edf16640 1 -- 172.21.15.7:0/3138764708 shutdown_connections 2024-09-19T08:40:39.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.457+0000 7fc2edf16640 1 --2- 172.21.15.7:0/3138764708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2e8102690 0x7fc2e8108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:39.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.457+0000 7fc2edf16640 1 --2- 172.21.15.7:0/3138764708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2e8101cd0 0x7fc2e8102150 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.457+0000 7fc2edf16640 1 --2- 172.21.15.7:0/3138764708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2e8100ad0 0x7fc2e8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.457+0000 7fc2edf16640 1 -- 172.21.15.7:0/3138764708 >> 172.21.15.7:0/3138764708 conn(0x7fc2e80fc280 msgr2=0x7fc2e80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:40:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.457+0000 7fc2edf16640 1 -- 172.21.15.7:0/3138764708 shutdown_connections 2024-09-19T08:40:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.457+0000 7fc2edf16640 1 -- 172.21.15.7:0/3138764708 wait complete. 2024-09-19T08:40:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.458+0000 7fc2edf16640 1 Processor -- start 2024-09-19T08:40:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.458+0000 7fc2edf16640 1 -- start start 2024-09-19T08:40:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.458+0000 7fc2edf16640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2e8100ad0 0x7fc2e8197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:40:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.458+0000 7fc2edf16640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2e8101cd0 0x7fc2e8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:40:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.458+0000 7fc2edf16640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2e8102690 0x7fc2e819f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:40:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.458+0000 7fc2edf16640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e810c7b0 con 0x7fc2e8101cd0 2024-09-19T08:40:39.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.458+0000 7fc2edf16640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e810c630 con 0x7fc2e8102690 2024-09-19T08:40:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.458+0000 7fc2edf16640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e810c930 con 0x7fc2e8100ad0 2024-09-19T08:40:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.458+0000 7fc2dffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2e8101cd0 0x7fc2e8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:40:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.458+0000 7fc2dffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2e8101cd0 0x7fc2e8198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45584/0 (socket says 172.21.15.7:45584) 2024-09-19T08:40:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.458+0000 7fc2dffff640 1 -- 172.21.15.7:0/2466727609 learned_addr learned my addr 172.21.15.7:0/2466727609 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:40:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.458+0000 7fc2e77fe640 1 --2- 172.21.15.7:0/2466727609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2e8100ad0 0x7fc2e8197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:40:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.458+0000 7fc2e7fff640 1 --2- 172.21.15.7:0/2466727609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2e8102690 0x7fc2e819f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:40:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.458+0000 7fc2dffff640 1 -- 172.21.15.7:0/2466727609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2e8100ad0 msgr2=0x7fc2e8197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:40:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.458+0000 7fc2dffff640 1 --2- 172.21.15.7:0/2466727609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2e8100ad0 0x7fc2e8197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.458+0000 7fc2dffff640 1 -- 172.21.15.7:0/2466727609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2e8102690 msgr2=0x7fc2e819f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:40:39.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.459+0000 7fc2dffff640 1 --2- 172.21.15.7:0/2466727609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2e8102690 0x7fc2e819f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:40:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.459+0000 7fc2dffff640 1 -- 172.21.15.7:0/2466727609 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e819fb50 con 0x7fc2e8101cd0 2024-09-19T08:40:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.459+0000 7fc2e77fe640 1 --2- 172.21.15.7:0/2466727609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2e8100ad0 0x7fc2e8197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:40:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.459+0000 7fc2e7fff640 1 --2- 172.21.15.7:0/2466727609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2e8102690 0x7fc2e819f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:40:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.459+0000 7fc2dffff640 1 --2- 172.21.15.7:0/2466727609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2e8101cd0 0x7fc2e8198460 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009230 tx=0x7fc2d0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:40:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.459+0000 7fc2e57fa640 1 -- 172.21.15.7:0/2466727609 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d003f030 con 0x7fc2e8101cd0 2024-09-19T08:40:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.459+0000 7fc2e57fa640 1 -- 172.21.15.7:0/2466727609 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2d0003ce0 con 0x7fc2e8101cd0 2024-09-19T08:40:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.459+0000 7fc2edf16640 1 -- 172.21.15.7:0/2466727609 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e819fde0 con 0x7fc2e8101cd0 2024-09-19T08:40:39.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.459+0000 7fc2e57fa640 1 -- 172.21.15.7:0/2466727609 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0035070 con 0x7fc2e8101cd0 2024-09-19T08:40:39.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.459+0000 7fc2edf16640 1 -- 172.21.15.7:0/2466727609 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e81a02c0 con 0x7fc2e8101cd0 2024-09-19T08:40:39.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.460+0000 7fc2edf16640 1 -- 172.21.15.7:0/2466727609 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2e81a05b0 con 0x7fc2e8101cd0 2024-09-19T08:40:39.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.461+0000 7fc2e57fa640 1 -- 172.21.15.7:0/2466727609 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fc2d0042030 con 0x7fc2e8101cd0 2024-09-19T08:40:39.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.462+0000 7fc2e57fa640 1 --2- 172.21.15.7:0/2466727609 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc2d40a32f0 0x7fc2d40a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:40:39.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.462+0000 7fc2e77fe640 1 --2- 172.21.15.7:0/2466727609 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc2d40a32f0 0x7fc2d40a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:40:39.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.462+0000 7fc2e57fa640 1 -- 172.21.15.7:0/2466727609 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5549+0+0 (secure 0 0 0) 0x7fc2d00efa20 con 0x7fc2e8101cd0 2024-09-19T08:40:39.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.463+0000 7fc2e77fe640 1 --2- 172.21.15.7:0/2466727609 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc2d40a32f0 0x7fc2d40a57b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8101b30 tx=0x7fc2d800a5e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:40:39.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.466+0000 7fc2e57fa640 1 -- 172.21.15.7:0/2466727609 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc2d00bd170 con 0x7fc2e8101cd0 2024-09-19T08:40:39.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:40:39.666+0000 7fc2edf16640 1 -- 172.21.15.7:0/2466727609 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc2e806a6d0 con 0x7fc2d40a32f0 2024-09-19T08:40:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:39 smithi007 ceph-mon[31221]: Detected new or changed devices on smithi175 2024-09-19T08:40:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:39 smithi007 ceph-mon[31221]: Adjusting osd_memory_target on smithi175 to 5696M 2024-09-19T08:40:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:39 smithi007 ceph-mon[31221]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-19T08:40:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:39 smithi007 ceph-mon[31221]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T08:40:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:39 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:40.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:39 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:40.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:39 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:40:40.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:39 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:40:40.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:39 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:40.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:39 smithi007 ceph-mon[31221]: osd.8 [v2:172.21.15.175:6816/2080374927,v1:172.21.15.175:6817/2080374927] boot 2024-09-19T08:40:40.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:39 smithi007 ceph-mon[31221]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T08:40:40.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:39 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:40.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:39 smithi044 ceph-mon[35072]: Detected new or changed devices on smithi175 2024-09-19T08:40:40.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:39 smithi044 ceph-mon[35072]: Adjusting osd_memory_target on smithi175 to 5696M 2024-09-19T08:40:40.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:39 smithi044 ceph-mon[35072]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-19T08:40:40.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:39 smithi044 ceph-mon[35072]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T08:40:40.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:39 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:40.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:39 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:40.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:39 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:40:40.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:39 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:40:40.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:39 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:40.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:39 smithi044 ceph-mon[35072]: osd.8 [v2:172.21.15.175:6816/2080374927,v1:172.21.15.175:6817/2080374927] boot 2024-09-19T08:40:40.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:39 smithi044 ceph-mon[35072]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T08:40:40.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:39 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:40.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:39 smithi175 ceph-mon[35688]: Detected new or changed devices on smithi175 2024-09-19T08:40:40.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:39 smithi175 ceph-mon[35688]: Adjusting osd_memory_target on smithi175 to 5696M 2024-09-19T08:40:40.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:39 smithi175 ceph-mon[35688]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-19T08:40:40.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:39 smithi175 ceph-mon[35688]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T08:40:40.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:39 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:40.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:39 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:40.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:39 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:40:40.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:39 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:40:40.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:39 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:40.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:39 smithi175 ceph-mon[35688]: osd.8 [v2:172.21.15.175:6816/2080374927,v1:172.21.15.175:6817/2080374927] boot 2024-09-19T08:40:40.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:39 smithi175 ceph-mon[35688]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T08:40:40.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:39 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:40:40.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:40 smithi175 ceph-mon[35688]: purged_snaps scrub starts 2024-09-19T08:40:40.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:40 smithi175 ceph-mon[35688]: purged_snaps scrub ok 2024-09-19T08:40:40.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:40 smithi175 ceph-mon[35688]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:40.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:40 smithi175 ceph-mon[35688]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:40:40.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:40 smithi175 ceph-mon[35688]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T08:40:41.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:40 smithi007 ceph-mon[31221]: purged_snaps scrub starts 2024-09-19T08:40:41.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:40 smithi007 ceph-mon[31221]: purged_snaps scrub ok 2024-09-19T08:40:41.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:40 smithi007 ceph-mon[31221]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:41.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:40 smithi007 ceph-mon[31221]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:40:41.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:40 smithi007 ceph-mon[31221]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T08:40:41.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:40 smithi044 ceph-mon[35072]: purged_snaps scrub starts 2024-09-19T08:40:41.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:40 smithi044 ceph-mon[35072]: purged_snaps scrub ok 2024-09-19T08:40:41.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:40 smithi044 ceph-mon[35072]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:40:41.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:40 smithi044 ceph-mon[35072]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:40:41.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:40 smithi044 ceph-mon[35072]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T08:40:42.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:41 smithi007 ceph-mon[31221]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:40:42.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:41 smithi044 ceph-mon[35072]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:40:42.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:41 smithi175 ceph-mon[35688]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:40:43.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:42 smithi007 ceph-mon[31221]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T08:40:43.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:42 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/4089951244' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d132f5b2-75b9-4d6c-89ec-f52c303e0fd8"}]: dispatch 2024-09-19T08:40:43.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:42 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/4089951244' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d132f5b2-75b9-4d6c-89ec-f52c303e0fd8"}]': finished 2024-09-19T08:40:43.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:42 smithi007 ceph-mon[31221]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T08:40:43.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:42 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:40:43.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:42 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1122377748' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:40:43.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:42 smithi044 ceph-mon[35072]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T08:40:43.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:42 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/4089951244' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d132f5b2-75b9-4d6c-89ec-f52c303e0fd8"}]: dispatch 2024-09-19T08:40:43.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:42 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/4089951244' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d132f5b2-75b9-4d6c-89ec-f52c303e0fd8"}]': finished 2024-09-19T08:40:43.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:42 smithi044 ceph-mon[35072]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T08:40:43.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:42 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:40:43.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:42 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1122377748' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:40:43.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:42 smithi175 ceph-mon[35688]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T08:40:43.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:42 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/4089951244' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d132f5b2-75b9-4d6c-89ec-f52c303e0fd8"}]: dispatch 2024-09-19T08:40:43.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:42 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/4089951244' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d132f5b2-75b9-4d6c-89ec-f52c303e0fd8"}]': finished 2024-09-19T08:40:43.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:42 smithi175 ceph-mon[35688]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T08:40:43.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:42 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:40:43.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:42 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1122377748' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:40:44.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:44 smithi044 ceph-mon[35072]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:40:44.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:44 smithi044 ceph-mon[35072]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T08:40:44.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:44 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:40:44.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:44 smithi175 ceph-mon[35688]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:40:44.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:44 smithi175 ceph-mon[35688]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T08:40:44.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:44 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:40:44.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:44 smithi007 ceph-mon[31221]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:40:44.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:44 smithi007 ceph-mon[31221]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T08:40:44.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:44 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:40:46.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:46 smithi044 ceph-mon[35072]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:40:46.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:46 smithi175 ceph-mon[35688]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:40:46.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:46 smithi007 ceph-mon[31221]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:40:48.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:48 smithi007 ceph-mon[31221]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:40:48.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:48 smithi175 ceph-mon[35688]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:40:48.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:48 smithi044 ceph-mon[35072]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:40:50.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:50 smithi007 ceph-mon[31221]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-19T08:40:50.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:50 smithi175 ceph-mon[35688]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-19T08:40:50.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:50 smithi044 ceph-mon[35072]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-19T08:40:51.356 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:51 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T08:40:51.357 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:51 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:51.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:51 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T08:40:51.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:51 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:51.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:51 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T08:40:51.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:51 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:40:52.420 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:52 smithi007 ceph-mon[31221]: Deploying daemon osd.9 on smithi007 2024-09-19T08:40:52.420 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:52 smithi007 ceph-mon[31221]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T08:40:52.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:52 smithi175 ceph-mon[35688]: Deploying daemon osd.9 on smithi007 2024-09-19T08:40:52.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:52 smithi175 ceph-mon[35688]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T08:40:52.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:52 smithi044 ceph-mon[35072]: Deploying daemon osd.9 on smithi007 2024-09-19T08:40:52.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:52 smithi044 ceph-mon[35072]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T08:40:54.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:54 smithi007 ceph-mon[31221]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:40:54.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:54 smithi175 ceph-mon[35688]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:40:54.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:54 smithi044 ceph-mon[35072]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:40:56.397 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:56 smithi007 ceph-mon[31221]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T08:40:56.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:56 smithi175 ceph-mon[35688]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T08:40:56.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:56 smithi044 ceph-mon[35072]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T08:40:57.343 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:57 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:57.343 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:57 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:57.343 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:57 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:57.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:57 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:57.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:57 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:57.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:57 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:57.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:57 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:40:57.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:57 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:57.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:57 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:40:58.958 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:40:58 smithi007 ceph-mon[31221]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:40:59.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:40:58 smithi044 ceph-mon[35072]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:40:59.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:40:58 smithi175 ceph-mon[35688]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:41:00.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:00.486+0000 7fc2e57fa640 1 -- 172.21.15.7:0/2466727609 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc2e806a6d0 con 0x7fc2d40a32f0 2024-09-19T08:41:00.488 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 9 on host 'smithi007' 2024-09-19T08:41:00.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:00.488+0000 7fc2edf16640 1 -- 172.21.15.7:0/2466727609 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc2d40a32f0 msgr2=0x7fc2d40a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:00.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:00.488+0000 7fc2edf16640 1 --2- 172.21.15.7:0/2466727609 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc2d40a32f0 0x7fc2d40a57b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8101b30 tx=0x7fc2d800a5e0 comp rx=0 tx=0).stop 2024-09-19T08:41:00.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:00.488+0000 7fc2edf16640 1 -- 172.21.15.7:0/2466727609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2e8101cd0 msgr2=0x7fc2e8198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:00.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:00.488+0000 7fc2edf16640 1 --2- 172.21.15.7:0/2466727609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2e8101cd0 0x7fc2e8198460 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009230 tx=0x7fc2d0004430 comp rx=0 tx=0).stop 2024-09-19T08:41:00.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:00.488+0000 7fc2edf16640 1 -- 172.21.15.7:0/2466727609 shutdown_connections 2024-09-19T08:41:00.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:00.488+0000 7fc2edf16640 1 --2- 172.21.15.7:0/2466727609 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc2d40a32f0 0x7fc2d40a57b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:00.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:00.488+0000 7fc2edf16640 1 --2- 172.21.15.7:0/2466727609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2e8102690 0x7fc2e819f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:00.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:00.488+0000 7fc2edf16640 1 --2- 172.21.15.7:0/2466727609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2e8101cd0 0x7fc2e8198460 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:00.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:00.488+0000 7fc2edf16640 1 --2- 172.21.15.7:0/2466727609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2e8100ad0 0x7fc2e8197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:00.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:00.488+0000 7fc2edf16640 1 -- 172.21.15.7:0/2466727609 >> 172.21.15.7:0/2466727609 conn(0x7fc2e80fc280 msgr2=0x7fc2e8069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:41:00.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:00.489+0000 7fc2edf16640 1 -- 172.21.15.7:0/2466727609 shutdown_connections 2024-09-19T08:41:00.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:00.489+0000 7fc2edf16640 1 -- 172.21.15.7:0/2466727609 wait complete. 2024-09-19T08:41:00.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:00 smithi007 ceph-mon[31221]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:00.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:00 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:00.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:00 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:00.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:00 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:00.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:00 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:00.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:00 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:00.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:00 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:00.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:00 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:00.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:00 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:00.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:00 smithi175 ceph-mon[35688]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:00.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:00 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:00.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:00 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:00.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:00 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:00.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:00 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:00.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:00 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:00.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:00 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:00.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:00 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:00.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:00 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:01.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:00 smithi044 ceph-mon[35072]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:01.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:00 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:01.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:00 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:01.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:00 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:01.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:00 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:01.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:00 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:01.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:00 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:01.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:00 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:01.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:00 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:01.116 DEBUG:teuthology.orchestra.run.smithi007:osd.9> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T08:41:01.118 INFO:tasks.cephadm:Deploying osd.10 on smithi044 with /dev/vg_nvme/lv_1... 2024-09-19T08:41:01.119 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T08:41:01.382 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:41:02.652 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:02 smithi007 ceph-mon[31221]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:02.735 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:02 smithi044 ceph-mon[35072]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:02.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:02 smithi175 ceph-mon[35688]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:03.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:41:02 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:41:02.985+0000 7f571c03f640 -1 osd.9 0 log_to_monitors true 2024-09-19T08:41:03.717 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:03 smithi007 ceph-mon[31221]: from='osd.9 [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T08:41:03.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:03 smithi044 ceph-mon[35072]: from='osd.9 [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T08:41:03.809 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-19T08:41:03.834 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi044:vg_nvme/lv_1 2024-09-19T08:41:03.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:03 smithi175 ceph-mon[35688]: from='osd.9 [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T08:41:04.091 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:41:04.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.537+0000 7f12fccfb640 1 -- 172.21.15.44:0/2101428613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f81037c0 msgr2=0x7f12f810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:04.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.537+0000 7f12fccfb640 1 --2- 172.21.15.44:0/2101428613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f81037c0 0x7f12f810a050 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009ca0 tx=0x7f12f002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:41:04.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.538+0000 7f12fccfb640 1 -- 172.21.15.44:0/2101428613 shutdown_connections 2024-09-19T08:41:04.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.538+0000 7f12fccfb640 1 --2- 172.21.15.44:0/2101428613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f81037c0 0x7f12f810a050 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:04.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.538+0000 7f12fccfb640 1 --2- 172.21.15.44:0/2101428613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f8102e00 0x7f12f8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:04.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.538+0000 7f12fccfb640 1 --2- 172.21.15.44:0/2101428613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12f8101c00 0x7f12f8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:04.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.538+0000 7f12fccfb640 1 -- 172.21.15.44:0/2101428613 >> 172.21.15.44:0/2101428613 conn(0x7f12f80fd390 msgr2=0x7f12f80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:41:04.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.538+0000 7f12fccfb640 1 -- 172.21.15.44:0/2101428613 shutdown_connections 2024-09-19T08:41:04.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.538+0000 7f12fccfb640 1 -- 172.21.15.44:0/2101428613 wait complete. 2024-09-19T08:41:04.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.538+0000 7f12fccfb640 1 Processor -- start 2024-09-19T08:41:04.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.538+0000 7f12fccfb640 1 -- start start 2024-09-19T08:41:04.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.539+0000 7f12fccfb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12f8101c00 0x7f12f8075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:04.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.539+0000 7f12fccfb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f8102e00 0x7f12f80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:04.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.539+0000 7f12fccfb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f81037c0 0x7f12f8074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:04.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.539+0000 7f12fccfb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f12f810d860 con 0x7f12f8101c00 2024-09-19T08:41:04.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.539+0000 7f12fccfb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f12f810d6e0 con 0x7f12f81037c0 2024-09-19T08:41:04.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.539+0000 7f12fccfb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f12f810d9e0 con 0x7f12f8102e00 2024-09-19T08:41:04.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.539+0000 7f12f6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f81037c0 0x7f12f8074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:04.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.539+0000 7f12f6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f81037c0 0x7f12f8074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43010/0 (socket says 172.21.15.44:43010) 2024-09-19T08:41:04.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.539+0000 7f12f6d9d640 1 -- 172.21.15.44:0/661758149 learned_addr learned my addr 172.21.15.44:0/661758149 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-19T08:41:04.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.539+0000 7f12f659c640 1 --2- 172.21.15.44:0/661758149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12f8101c00 0x7f12f8075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:04.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.539+0000 7f12f5d9b640 1 --2- 172.21.15.44:0/661758149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f8102e00 0x7f12f80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:04.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.539+0000 7f12f6d9d640 1 -- 172.21.15.44:0/661758149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f8102e00 msgr2=0x7f12f80745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:04.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.539+0000 7f12f6d9d640 1 --2- 172.21.15.44:0/661758149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f8102e00 0x7f12f80745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:04.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.539+0000 7f12f6d9d640 1 -- 172.21.15.44:0/661758149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12f8101c00 msgr2=0x7f12f8075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:04.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.539+0000 7f12f6d9d640 1 --2- 172.21.15.44:0/661758149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12f8101c00 0x7f12f8075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:04.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.539+0000 7f12f6d9d640 1 -- 172.21.15.44:0/661758149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f80753e0 con 0x7f12f81037c0 2024-09-19T08:41:04.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.539+0000 7f12f5d9b640 1 --2- 172.21.15.44:0/661758149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f8102e00 0x7f12f80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:41:04.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.539+0000 7f12f659c640 1 --2- 172.21.15.44:0/661758149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12f8101c00 0x7f12f8075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:41:04.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.539+0000 7f12f6d9d640 1 --2- 172.21.15.44:0/661758149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f81037c0 0x7f12f8074b20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f12f0031ae0 tx=0x7f12f0031ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:41:04.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.540+0000 7f12e77fe640 1 -- 172.21.15.44:0/661758149 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f0003c30 con 0x7f12f81037c0 2024-09-19T08:41:04.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.540+0000 7f12fccfb640 1 -- 172.21.15.44:0/661758149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f81a1fe0 con 0x7f12f81037c0 2024-09-19T08:41:04.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.540+0000 7f12e77fe640 1 -- 172.21.15.44:0/661758149 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12f0003dd0 con 0x7f12f81037c0 2024-09-19T08:41:04.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.540+0000 7f12e77fe640 1 -- 172.21.15.44:0/661758149 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f002fcb0 con 0x7f12f81037c0 2024-09-19T08:41:04.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.540+0000 7f12fccfb640 1 -- 172.21.15.44:0/661758149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f81a2490 con 0x7f12f81037c0 2024-09-19T08:41:04.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.541+0000 7f12fccfb640 1 -- 172.21.15.44:0/661758149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12f8108fd0 con 0x7f12f81037c0 2024-09-19T08:41:04.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.542+0000 7f12e77fe640 1 -- 172.21.15.44:0/661758149 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f12f0004050 con 0x7f12f81037c0 2024-09-19T08:41:04.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.542+0000 7f12e77fe640 1 --2- 172.21.15.44:0/661758149 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f12e00a3240 0x7f12e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:04.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.542+0000 7f12e77fe640 1 -- 172.21.15.44:0/661758149 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5965+0+0 (secure 0 0 0) 0x7f12f00f0570 con 0x7f12f81037c0 2024-09-19T08:41:04.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.543+0000 7f12f659c640 1 --2- 172.21.15.44:0/661758149 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f12e00a3240 0x7f12e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:04.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.543+0000 7f12f659c640 1 --2- 172.21.15.44:0/661758149 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f12e00a3240 0x7f12e00a5700 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f12f8102c60 tx=0x7f12e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:41:04.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.547+0000 7f12e77fe640 1 -- 172.21.15.44:0/661758149 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f12f00bdbc0 con 0x7f12f81037c0 2024-09-19T08:41:04.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:04.735+0000 7f12fccfb640 1 -- 172.21.15.44:0/661758149 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f12f8062630 con 0x7f12e00a3240 2024-09-19T08:41:04.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:04 smithi044 ceph-mon[35072]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:04.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:04 smithi044 ceph-mon[35072]: from='osd.9 [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T08:41:04.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:04 smithi044 ceph-mon[35072]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T08:41:04.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:04 smithi044 ceph-mon[35072]: from='osd.9 [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T08:41:04.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:04.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:04.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:04.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:04.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:04.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:04.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:04.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:04.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:04.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:04.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:04.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:04 smithi175 ceph-mon[35688]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:04.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:04 smithi175 ceph-mon[35688]: from='osd.9 [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T08:41:04.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:04 smithi175 ceph-mon[35688]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T08:41:04.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:04 smithi175 ceph-mon[35688]: from='osd.9 [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T08:41:04.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:04.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:04.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:04.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:04.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:04.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:04.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:04.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:04.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:04.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:04.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:05.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:04 smithi007 ceph-mon[31221]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:05.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:04 smithi007 ceph-mon[31221]: from='osd.9 [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T08:41:05.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:04 smithi007 ceph-mon[31221]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T08:41:05.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:04 smithi007 ceph-mon[31221]: from='osd.9 [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T08:41:05.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:05.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:05.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:05.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:05.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:05.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:05.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:05.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:05.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:05.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:05.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:05.635 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:41:05 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:41:05.330+0000 7f57187d6640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T08:41:05.635 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:41:05 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:41:05.347+0000 7f570fdd1640 -1 osd.9 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:41:05.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:05 smithi044 ceph-mon[35072]: Detected new or changed devices on smithi007 2024-09-19T08:41:05.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:05 smithi044 ceph-mon[35072]: Adjusting osd_memory_target on smithi007 to 4273M 2024-09-19T08:41:05.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:05 smithi044 ceph-mon[35072]: from='osd.9 [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T08:41:05.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:05 smithi044 ceph-mon[35072]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T08:41:05.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:05 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:05.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:05 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:05.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:05 smithi044 ceph-mon[35072]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:41:05.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:05 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:41:05.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:05 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:41:05.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:05 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:05.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:05 smithi044 ceph-mon[35072]: from='osd.9 [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432]' entity='osd.9' 2024-09-19T08:41:05.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:05 smithi175 ceph-mon[35688]: Detected new or changed devices on smithi007 2024-09-19T08:41:05.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:05 smithi175 ceph-mon[35688]: Adjusting osd_memory_target on smithi007 to 4273M 2024-09-19T08:41:05.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:05 smithi175 ceph-mon[35688]: from='osd.9 [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T08:41:05.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:05 smithi175 ceph-mon[35688]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T08:41:05.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:05 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:05.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:05 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:05.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:05 smithi175 ceph-mon[35688]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:41:05.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:05 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:41:05.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:05 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:41:05.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:05 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:05.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:05 smithi175 ceph-mon[35688]: from='osd.9 [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432]' entity='osd.9' 2024-09-19T08:41:06.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:05 smithi007 ceph-mon[31221]: Detected new or changed devices on smithi007 2024-09-19T08:41:06.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:05 smithi007 ceph-mon[31221]: Adjusting osd_memory_target on smithi007 to 4273M 2024-09-19T08:41:06.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:05 smithi007 ceph-mon[31221]: from='osd.9 [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T08:41:06.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:05 smithi007 ceph-mon[31221]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T08:41:06.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:05 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:06.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:05 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:06.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:05 smithi007 ceph-mon[31221]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:41:06.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:05 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:41:06.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:05 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:41:06.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:05 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:06.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:05 smithi007 ceph-mon[31221]: from='osd.9 [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432]' entity='osd.9' 2024-09-19T08:41:06.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:06 smithi175 ceph-mon[35688]: purged_snaps scrub starts 2024-09-19T08:41:06.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:06 smithi175 ceph-mon[35688]: purged_snaps scrub ok 2024-09-19T08:41:06.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:06 smithi175 ceph-mon[35688]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:06.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:06 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:06.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:06 smithi175 ceph-mon[35688]: osd.9 [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432] boot 2024-09-19T08:41:06.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:06 smithi175 ceph-mon[35688]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T08:41:06.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:06 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:07.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:06 smithi007 ceph-mon[31221]: purged_snaps scrub starts 2024-09-19T08:41:07.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:06 smithi007 ceph-mon[31221]: purged_snaps scrub ok 2024-09-19T08:41:07.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:06 smithi007 ceph-mon[31221]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:07.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:06 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:07.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:06 smithi007 ceph-mon[31221]: osd.9 [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432] boot 2024-09-19T08:41:07.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:06 smithi007 ceph-mon[31221]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T08:41:07.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:06 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:07.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:06 smithi044 ceph-mon[35072]: purged_snaps scrub starts 2024-09-19T08:41:07.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:06 smithi044 ceph-mon[35072]: purged_snaps scrub ok 2024-09-19T08:41:07.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:06 smithi044 ceph-mon[35072]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:41:07.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:06 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:07.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:06 smithi044 ceph-mon[35072]: osd.9 [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432] boot 2024-09-19T08:41:07.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:06 smithi044 ceph-mon[35072]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T08:41:07.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:06 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:41:07.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:07 smithi175 ceph-mon[35688]: from='client.? 172.21.15.44:0/1937912179' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6c405d6-a255-4e0e-8528-7bbc16d5e434"}]: dispatch 2024-09-19T08:41:07.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:07 smithi175 ceph-mon[35688]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6c405d6-a255-4e0e-8528-7bbc16d5e434"}]: dispatch 2024-09-19T08:41:07.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:07 smithi175 ceph-mon[35688]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f6c405d6-a255-4e0e-8528-7bbc16d5e434"}]': finished 2024-09-19T08:41:07.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:07 smithi175 ceph-mon[35688]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T08:41:07.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:07 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:07.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:07 smithi175 ceph-mon[35688]: from='client.? 172.21.15.44:0/518163270' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:41:08.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:07 smithi007 ceph-mon[31221]: from='client.? 172.21.15.44:0/1937912179' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6c405d6-a255-4e0e-8528-7bbc16d5e434"}]: dispatch 2024-09-19T08:41:08.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:07 smithi007 ceph-mon[31221]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6c405d6-a255-4e0e-8528-7bbc16d5e434"}]: dispatch 2024-09-19T08:41:08.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:07 smithi007 ceph-mon[31221]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f6c405d6-a255-4e0e-8528-7bbc16d5e434"}]': finished 2024-09-19T08:41:08.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:07 smithi007 ceph-mon[31221]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T08:41:08.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:07 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:08.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:07 smithi007 ceph-mon[31221]: from='client.? 172.21.15.44:0/518163270' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:41:08.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:07 smithi044 ceph-mon[35072]: from='client.? 172.21.15.44:0/1937912179' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6c405d6-a255-4e0e-8528-7bbc16d5e434"}]: dispatch 2024-09-19T08:41:08.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:07 smithi044 ceph-mon[35072]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6c405d6-a255-4e0e-8528-7bbc16d5e434"}]: dispatch 2024-09-19T08:41:08.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:07 smithi044 ceph-mon[35072]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f6c405d6-a255-4e0e-8528-7bbc16d5e434"}]': finished 2024-09-19T08:41:08.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:07 smithi044 ceph-mon[35072]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T08:41:08.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:07 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:08.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:07 smithi044 ceph-mon[35072]: from='client.? 172.21.15.44:0/518163270' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:41:08.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:08 smithi175 ceph-mon[35688]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:09.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:08 smithi007 ceph-mon[31221]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:09.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:08 smithi044 ceph-mon[35072]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:10.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:10 smithi175 ceph-mon[35688]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:11.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:10 smithi007 ceph-mon[31221]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:11.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:10 smithi044 ceph-mon[35072]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:12.775 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:12 smithi044 ceph-mon[35072]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:12.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:12 smithi175 ceph-mon[35688]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:13.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:12 smithi007 ceph-mon[31221]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:14.919 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:14 smithi044 ceph-mon[35072]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:14.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:14 smithi175 ceph-mon[35688]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:15.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:14 smithi007 ceph-mon[31221]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:16.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:16 smithi044 ceph-mon[35072]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:16 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T08:41:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:16 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:16.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:16 smithi175 ceph-mon[35688]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:16.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:16 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T08:41:16.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:16 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:17.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:16 smithi007 ceph-mon[31221]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:17.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:16 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T08:41:17.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:16 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:17.775 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:17 smithi044 ceph-mon[35072]: Deploying daemon osd.10 on smithi044 2024-09-19T08:41:17.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:17 smithi175 ceph-mon[35688]: Deploying daemon osd.10 on smithi044 2024-09-19T08:41:18.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:17 smithi007 ceph-mon[31221]: Deploying daemon osd.10 on smithi044 2024-09-19T08:41:18.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:18 smithi044 ceph-mon[35072]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:18.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:18 smithi175 ceph-mon[35688]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:18.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:18 smithi007 ceph-mon[31221]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:20.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:20 smithi175 ceph-mon[35688]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:20.954 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:20 smithi044 ceph-mon[35072]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:21.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:20 smithi007 ceph-mon[31221]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:21.670 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:21.670 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:21.670 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:21.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:21.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:21.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:22.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:22.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:22.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:22.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:22 smithi175 ceph-mon[35688]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:22.965 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:22 smithi044 ceph-mon[35072]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:23.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:22 smithi007 ceph-mon[31221]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:24.883 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:24 smithi044 ceph-mon[35072]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:24.883 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:24 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:24.883 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:24 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:24.883 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:24 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:24.883 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:24 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:24.883 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:24 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:24.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:24.923+0000 7f12e77fe640 1 -- 172.21.15.44:0/661758149 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f12f8062630 con 0x7f12e00a3240 2024-09-19T08:41:24.924 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 10 on host 'smithi044' 2024-09-19T08:41:24.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:24.925+0000 7f12fccfb640 1 -- 172.21.15.44:0/661758149 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f12e00a3240 msgr2=0x7f12e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:24.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:24.925+0000 7f12fccfb640 1 --2- 172.21.15.44:0/661758149 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f12e00a3240 0x7f12e00a5700 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f12f8102c60 tx=0x7f12e8005f90 comp rx=0 tx=0).stop 2024-09-19T08:41:24.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:24.925+0000 7f12fccfb640 1 -- 172.21.15.44:0/661758149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f81037c0 msgr2=0x7f12f8074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:24.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:24.925+0000 7f12fccfb640 1 --2- 172.21.15.44:0/661758149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f81037c0 0x7f12f8074b20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f12f0031ae0 tx=0x7f12f0031ee0 comp rx=0 tx=0).stop 2024-09-19T08:41:24.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:24.925+0000 7f12fccfb640 1 -- 172.21.15.44:0/661758149 shutdown_connections 2024-09-19T08:41:24.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:24.925+0000 7f12fccfb640 1 --2- 172.21.15.44:0/661758149 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f12e00a3240 0x7f12e00a5700 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:24.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:24.925+0000 7f12fccfb640 1 --2- 172.21.15.44:0/661758149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12f81037c0 0x7f12f8074b20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:24.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:24.926+0000 7f12fccfb640 1 --2- 172.21.15.44:0/661758149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f8102e00 0x7f12f80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:24.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:24.926+0000 7f12fccfb640 1 --2- 172.21.15.44:0/661758149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12f8101c00 0x7f12f8075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:24.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:24.926+0000 7f12fccfb640 1 -- 172.21.15.44:0/661758149 >> 172.21.15.44:0/661758149 conn(0x7f12f80fd390 msgr2=0x7f12f81061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:41:24.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:24.926+0000 7f12fccfb640 1 -- 172.21.15.44:0/661758149 shutdown_connections 2024-09-19T08:41:24.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-19T08:41:24.926+0000 7f12fccfb640 1 -- 172.21.15.44:0/661758149 wait complete. 2024-09-19T08:41:24.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:24 smithi175 ceph-mon[35688]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:24.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:24 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:24.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:24 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:24.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:24 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:24.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:24 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:24.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:24 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:25.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:24 smithi007 ceph-mon[31221]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:25.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:24 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:25.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:24 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:25.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:24 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:25.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:24 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:25.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:24 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:25.605 DEBUG:teuthology.orchestra.run.smithi044:osd.10> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T08:41:25.608 INFO:tasks.cephadm:Deploying osd.11 on smithi175 with /dev/vg_nvme/lv_1... 2024-09-19T08:41:25.608 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T08:41:25.846 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:25 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:25.846 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:25 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:25.846 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:25 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:25.865 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:41:25.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:25 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:25.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:25 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:25.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:25 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:26.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:25 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:26.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:25 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:26.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:25 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:26.980 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:26 smithi044 ceph-mon[35072]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:26.996 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:26 smithi175 ceph-mon[35688]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:27.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:26 smithi007 ceph-mon[31221]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:27.991 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:41:27 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:41:27.783+0000 7effb6890640 -1 osd.10 0 log_to_monitors true 2024-09-19T08:41:28.369 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-09-19T08:41:28.397 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_1 2024-09-19T08:41:28.663 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:41:29.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:28 smithi175 ceph-mon[35688]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:29.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:28 smithi175 ceph-mon[35688]: from='osd.10 [v2:172.21.15.44:6824/4009464689,v1:172.21.15.44:6825/4009464689]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:41:29.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:28 smithi175 ceph-mon[35688]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:41:29.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:28 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:29.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:28 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:29.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:28 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:29.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:28 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:29.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:28 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:29.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:28 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:29.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:28 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:29.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:28 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:29.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:28 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:29.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:28 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:29.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:28 smithi007 ceph-mon[31221]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:29.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:28 smithi007 ceph-mon[31221]: from='osd.10 [v2:172.21.15.44:6824/4009464689,v1:172.21.15.44:6825/4009464689]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:41:29.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:28 smithi007 ceph-mon[31221]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:41:29.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:28 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:29.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:28 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:29.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:28 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:29.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:28 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:29.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:28 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:29.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:28 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:29.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:28 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:29.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:28 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:29.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:28 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:29.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:28 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:29.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:28 smithi044 ceph-mon[35072]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:29.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:28 smithi044 ceph-mon[35072]: from='osd.10 [v2:172.21.15.44:6824/4009464689,v1:172.21.15.44:6825/4009464689]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:41:29.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:28 smithi044 ceph-mon[35072]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:41:29.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:28 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:29.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:28 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:29.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:28 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:29.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:28 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:29.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:28 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:29.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:28 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:29.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:28 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:29.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:28 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:29.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:28 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:29.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:28 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:29.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.096+0000 7f355b89f640 1 -- 172.21.15.175:0/3051570349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3554100ad0 msgr2=0x7f3554100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:29.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.096+0000 7f355b89f640 1 --2- 172.21.15.175:0/3051570349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3554100ad0 0x7f3554100ed0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3550009900 tx=0x7f355002a410 comp rx=0 tx=0).stop 2024-09-19T08:41:29.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.096+0000 7f355b89f640 1 -- 172.21.15.175:0/3051570349 shutdown_connections 2024-09-19T08:41:29.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.096+0000 7f355b89f640 1 --2- 172.21.15.175:0/3051570349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3554102690 0x7f3554108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:29.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.096+0000 7f355b89f640 1 --2- 172.21.15.175:0/3051570349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3554101cd0 0x7f3554102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:29.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.096+0000 7f355b89f640 1 --2- 172.21.15.175:0/3051570349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3554100ad0 0x7f3554100ed0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:29.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.096+0000 7f355b89f640 1 -- 172.21.15.175:0/3051570349 >> 172.21.15.175:0/3051570349 conn(0x7f35540fc280 msgr2=0x7f35540fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:41:29.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.096+0000 7f355b89f640 1 -- 172.21.15.175:0/3051570349 shutdown_connections 2024-09-19T08:41:29.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.096+0000 7f355b89f640 1 -- 172.21.15.175:0/3051570349 wait complete. 2024-09-19T08:41:29.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.097+0000 7f355b89f640 1 Processor -- start 2024-09-19T08:41:29.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.097+0000 7f355b89f640 1 -- start start 2024-09-19T08:41:29.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.097+0000 7f355b89f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3554100ad0 0x7f355419a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:29.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.097+0000 7f355b89f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3554101cd0 0x7f355419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:29.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.097+0000 7f355b89f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3554102690 0x7f35541a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:29.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.097+0000 7f355b89f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f355410c7d0 con 0x7f3554101cd0 2024-09-19T08:41:29.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.097+0000 7f355b89f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f355410c650 con 0x7f3554100ad0 2024-09-19T08:41:29.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.097+0000 7f355b89f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f355410c950 con 0x7f3554102690 2024-09-19T08:41:29.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.097+0000 7f3559e3c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3554102690 0x7f35541a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:29.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.097+0000 7f3559e3c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3554102690 0x7f35541a1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60276/0 (socket says 172.21.15.175:60276) 2024-09-19T08:41:29.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.097+0000 7f3559e3c640 1 -- 172.21.15.175:0/2627066273 learned_addr learned my addr 172.21.15.175:0/2627066273 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-19T08:41:29.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.097+0000 7f3558e3a640 1 --2- 172.21.15.175:0/2627066273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3554101cd0 0x7f355419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:29.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.097+0000 7f355963b640 1 --2- 172.21.15.175:0/2627066273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3554100ad0 0x7f355419a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:29.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.098+0000 7f3559e3c640 1 -- 172.21.15.175:0/2627066273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3554100ad0 msgr2=0x7f355419a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:29.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.098+0000 7f3559e3c640 1 --2- 172.21.15.175:0/2627066273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3554100ad0 0x7f355419a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:29.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.098+0000 7f3559e3c640 1 -- 172.21.15.175:0/2627066273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3554101cd0 msgr2=0x7f355419a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:29.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.098+0000 7f3559e3c640 1 --2- 172.21.15.175:0/2627066273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3554101cd0 0x7f355419a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:29.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.098+0000 7f3559e3c640 1 -- 172.21.15.175:0/2627066273 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35541a1dd0 con 0x7f3554102690 2024-09-19T08:41:29.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.098+0000 7f3558e3a640 1 --2- 172.21.15.175:0/2627066273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3554101cd0 0x7f355419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:41:29.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.098+0000 7f3559e3c640 1 --2- 172.21.15.175:0/2627066273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3554102690 0x7f35541a1760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f354c00b970 tx=0x7f354c00be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:41:29.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.098+0000 7f354a7fc640 1 -- 172.21.15.175:0/2627066273 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c019070 con 0x7f3554102690 2024-09-19T08:41:29.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.098+0000 7f354a7fc640 1 -- 172.21.15.175:0/2627066273 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f354c00cb40 con 0x7f3554102690 2024-09-19T08:41:29.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.098+0000 7f355b89f640 1 -- 172.21.15.175:0/2627066273 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35541a20c0 con 0x7f3554102690 2024-09-19T08:41:29.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.098+0000 7f354a7fc640 1 -- 172.21.15.175:0/2627066273 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c007650 con 0x7f3554102690 2024-09-19T08:41:29.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.098+0000 7f355b89f640 1 -- 172.21.15.175:0/2627066273 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35541a2680 con 0x7f3554102690 2024-09-19T08:41:29.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.099+0000 7f355b89f640 1 -- 172.21.15.175:0/2627066273 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35541a2940 con 0x7f3554102690 2024-09-19T08:41:29.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.101+0000 7f354a7fc640 1 -- 172.21.15.175:0/2627066273 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f354c01c070 con 0x7f3554102690 2024-09-19T08:41:29.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.101+0000 7f354a7fc640 1 --2- 172.21.15.175:0/2627066273 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f35400a32f0 0x7f35400a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:29.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.101+0000 7f354a7fc640 1 -- 172.21.15.175:0/2627066273 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6398+0+0 (secure 0 0 0) 0x7f354c0cec20 con 0x7f3554102690 2024-09-19T08:41:29.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.101+0000 7f355963b640 1 --2- 172.21.15.175:0/2627066273 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f35400a32f0 0x7f35400a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:29.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.102+0000 7f355963b640 1 --2- 172.21.15.175:0/2627066273 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f35400a32f0 0x7f35400a57b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3550006010 tx=0x7f3550000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:41:29.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.109+0000 7f354a7fc640 1 -- 172.21.15.175:0/2627066273 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f354c09c0c0 con 0x7f3554102690 2024-09-19T08:41:29.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:29.288+0000 7f355b89f640 1 -- 172.21.15.175:0/2627066273 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f35541a2b10 con 0x7f35400a32f0 2024-09-19T08:41:29.996 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:29 smithi175 ceph-mon[35688]: Detected new or changed devices on smithi044 2024-09-19T08:41:29.997 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:29 smithi175 ceph-mon[35688]: Adjusting osd_memory_target on smithi044 to 4273M 2024-09-19T08:41:29.997 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:29 smithi175 ceph-mon[35688]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T08:41:29.997 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:29 smithi175 ceph-mon[35688]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T08:41:30.000 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:29 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:30.000 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:29 smithi175 ceph-mon[35688]: from='osd.10 [v2:172.21.15.44:6824/4009464689,v1:172.21.15.44:6825/4009464689]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:41:30.000 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:29 smithi175 ceph-mon[35688]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:41:30.001 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:29 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:41:30.001 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:29 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:41:30.001 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:29 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:30.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:29 smithi007 ceph-mon[31221]: Detected new or changed devices on smithi044 2024-09-19T08:41:30.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:29 smithi007 ceph-mon[31221]: Adjusting osd_memory_target on smithi044 to 4273M 2024-09-19T08:41:30.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:29 smithi007 ceph-mon[31221]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T08:41:30.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:29 smithi007 ceph-mon[31221]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T08:41:30.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:29 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:30.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:29 smithi007 ceph-mon[31221]: from='osd.10 [v2:172.21.15.44:6824/4009464689,v1:172.21.15.44:6825/4009464689]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:41:30.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:29 smithi007 ceph-mon[31221]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:41:30.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:29 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:41:30.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:29 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:41:30.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:29 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:30.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:29 smithi044 ceph-mon[35072]: Detected new or changed devices on smithi044 2024-09-19T08:41:30.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:29 smithi044 ceph-mon[35072]: Adjusting osd_memory_target on smithi044 to 4273M 2024-09-19T08:41:30.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:29 smithi044 ceph-mon[35072]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T08:41:30.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:29 smithi044 ceph-mon[35072]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T08:41:30.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:29 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:30.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:29 smithi044 ceph-mon[35072]: from='osd.10 [v2:172.21.15.44:6824/4009464689,v1:172.21.15.44:6825/4009464689]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:41:30.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:29 smithi044 ceph-mon[35072]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-19T08:41:30.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:29 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:41:30.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:29 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:41:30.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:29 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:30.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:41:30 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:41:30.480+0000 7effb1ff0640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T08:41:30.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:41:30 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:41:30.495+0000 7effaa622640 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:41:30.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:30 smithi044 ceph-mon[35072]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:30.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:30 smithi044 ceph-mon[35072]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:41:30.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:30 smithi044 ceph-mon[35072]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-19T08:41:30.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:30 smithi044 ceph-mon[35072]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T08:41:30.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:30 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:30.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:30 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:30.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:30 smithi044 ceph-mon[35072]: from='osd.10 ' entity='osd.10' 2024-09-19T08:41:30.995 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:30 smithi175 ceph-mon[35688]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:30.995 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:30 smithi175 ceph-mon[35688]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:41:30.995 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:30 smithi175 ceph-mon[35688]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-19T08:41:30.995 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:30 smithi175 ceph-mon[35688]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T08:41:30.996 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:30 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:30.996 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:30 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:30.996 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:30 smithi175 ceph-mon[35688]: from='osd.10 ' entity='osd.10' 2024-09-19T08:41:31.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:30 smithi007 ceph-mon[31221]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:41:31.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:30 smithi007 ceph-mon[31221]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:41:31.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:30 smithi007 ceph-mon[31221]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-19T08:41:31.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:30 smithi007 ceph-mon[31221]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T08:41:31.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:30 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:31.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:30 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:31.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:30 smithi007 ceph-mon[31221]: from='osd.10 ' entity='osd.10' 2024-09-19T08:41:32.005 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:31 smithi175 ceph-mon[35688]: purged_snaps scrub starts 2024-09-19T08:41:32.005 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:31 smithi175 ceph-mon[35688]: purged_snaps scrub ok 2024-09-19T08:41:32.005 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:31 smithi175 ceph-mon[35688]: osd.10 [v2:172.21.15.44:6824/4009464689,v1:172.21.15.44:6825/4009464689] boot 2024-09-19T08:41:32.005 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:31 smithi175 ceph-mon[35688]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T08:41:32.005 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:31 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:32.006 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:31 smithi175 ceph-mon[35688]: from='client.? 172.21.15.175:0/1208921380' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2a046cd-9939-473a-988b-6e0ad28a0233"}]: dispatch 2024-09-19T08:41:32.006 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:31 smithi175 ceph-mon[35688]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2a046cd-9939-473a-988b-6e0ad28a0233"}]: dispatch 2024-09-19T08:41:32.006 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:31 smithi175 ceph-mon[35688]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2a046cd-9939-473a-988b-6e0ad28a0233"}]': finished 2024-09-19T08:41:32.006 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:31 smithi175 ceph-mon[35688]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T08:41:32.006 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:31 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:32.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:31 smithi007 ceph-mon[31221]: purged_snaps scrub starts 2024-09-19T08:41:32.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:31 smithi007 ceph-mon[31221]: purged_snaps scrub ok 2024-09-19T08:41:32.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:31 smithi007 ceph-mon[31221]: osd.10 [v2:172.21.15.44:6824/4009464689,v1:172.21.15.44:6825/4009464689] boot 2024-09-19T08:41:32.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:31 smithi007 ceph-mon[31221]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T08:41:32.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:31 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:32.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:31 smithi007 ceph-mon[31221]: from='client.? 172.21.15.175:0/1208921380' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2a046cd-9939-473a-988b-6e0ad28a0233"}]: dispatch 2024-09-19T08:41:32.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:31 smithi007 ceph-mon[31221]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2a046cd-9939-473a-988b-6e0ad28a0233"}]: dispatch 2024-09-19T08:41:32.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:31 smithi007 ceph-mon[31221]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2a046cd-9939-473a-988b-6e0ad28a0233"}]': finished 2024-09-19T08:41:32.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:31 smithi007 ceph-mon[31221]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T08:41:32.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:31 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:32.053 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:31 smithi044 ceph-mon[35072]: purged_snaps scrub starts 2024-09-19T08:41:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:31 smithi044 ceph-mon[35072]: purged_snaps scrub ok 2024-09-19T08:41:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:31 smithi044 ceph-mon[35072]: osd.10 [v2:172.21.15.44:6824/4009464689,v1:172.21.15.44:6825/4009464689] boot 2024-09-19T08:41:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:31 smithi044 ceph-mon[35072]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T08:41:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:31 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:41:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:31 smithi044 ceph-mon[35072]: from='client.? 172.21.15.175:0/1208921380' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2a046cd-9939-473a-988b-6e0ad28a0233"}]: dispatch 2024-09-19T08:41:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:31 smithi044 ceph-mon[35072]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2a046cd-9939-473a-988b-6e0ad28a0233"}]: dispatch 2024-09-19T08:41:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:31 smithi044 ceph-mon[35072]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2a046cd-9939-473a-988b-6e0ad28a0233"}]': finished 2024-09-19T08:41:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:31 smithi044 ceph-mon[35072]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T08:41:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:31 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:33.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:32 smithi007 ceph-mon[31221]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:33.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:32 smithi007 ceph-mon[31221]: from='client.? 172.21.15.175:0/3583730089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:41:33.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:32 smithi044 ceph-mon[35072]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:33.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:32 smithi044 ceph-mon[35072]: from='client.? 172.21.15.175:0/3583730089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:41:33.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:32 smithi175 ceph-mon[35688]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:33.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:32 smithi175 ceph-mon[35688]: from='client.? 172.21.15.175:0/3583730089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:41:34.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:33 smithi007 ceph-mon[31221]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T08:41:34.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:33 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:34.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:33 smithi044 ceph-mon[35072]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T08:41:34.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:33 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:34.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:33 smithi175 ceph-mon[35688]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T08:41:34.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:33 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:35.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:34 smithi007 ceph-mon[31221]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:35.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:34 smithi007 ceph-mon[31221]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T08:41:35.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:34 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:35.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:34 smithi044 ceph-mon[35072]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:35.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:34 smithi044 ceph-mon[35072]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T08:41:35.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:34 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:35.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:34 smithi175 ceph-mon[35688]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:35.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:34 smithi175 ceph-mon[35688]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T08:41:35.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:34 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:36.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:35 smithi007 ceph-mon[31221]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T08:41:36.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:35 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:36.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:35 smithi044 ceph-mon[35072]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T08:41:36.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:35 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:36.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:35 smithi175 ceph-mon[35688]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T08:41:36.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:35 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:36.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:36 smithi175 ceph-mon[35688]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:37.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:36 smithi007 ceph-mon[31221]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:37.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:36 smithi044 ceph-mon[35072]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:38.995 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:38 smithi175 ceph-mon[35688]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-09-19T08:41:39.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:38 smithi007 ceph-mon[31221]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-09-19T08:41:39.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:38 smithi044 ceph-mon[35072]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-09-19T08:41:41.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:40 smithi007 ceph-mon[31221]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-19T08:41:41.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:40 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T08:41:41.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:40 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:41.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:40 smithi044 ceph-mon[35072]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-19T08:41:41.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T08:41:41.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:41.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:40 smithi175 ceph-mon[35688]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-19T08:41:41.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:40 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T08:41:41.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:40 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:41.883 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:41 smithi175 ceph-mon[35688]: Deploying daemon osd.11 on smithi175 2024-09-19T08:41:42.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:41 smithi044 ceph-mon[35072]: Deploying daemon osd.11 on smithi175 2024-09-19T08:41:42.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:41 smithi007 ceph-mon[31221]: Deploying daemon osd.11 on smithi175 2024-09-19T08:41:43.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:42 smithi044 ceph-mon[35072]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:41:43.133 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:42 smithi175 ceph-mon[35688]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:41:43.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:42 smithi007 ceph-mon[31221]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:41:44.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:43 smithi044 ceph-mon[35072]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-19T08:41:44.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:43 smithi175 ceph-mon[35688]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-19T08:41:44.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:43 smithi007 ceph-mon[31221]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-19T08:41:46.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:45 smithi175 ceph-mon[35688]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-19T08:41:46.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:45 smithi007 ceph-mon[31221]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-19T08:41:46.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:45 smithi044 ceph-mon[35072]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-19T08:41:47.063 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:46 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:47.063 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:46 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:47.063 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:46 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:47.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:46 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:47.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:46 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:47.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:46 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:47.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:46 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:47.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:46 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:47.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:46 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:48.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:47 smithi044 ceph-mon[35072]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:41:48.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:47 smithi007 ceph-mon[31221]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:41:48.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:47 smithi175 ceph-mon[35688]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:41:49.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:49.431+0000 7f354a7fc640 1 -- 172.21.15.175:0/2627066273 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f35541a2b10 con 0x7f35400a32f0 2024-09-19T08:41:49.432 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 11 on host 'smithi175' 2024-09-19T08:41:49.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:49.434+0000 7f355b89f640 1 -- 172.21.15.175:0/2627066273 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f35400a32f0 msgr2=0x7f35400a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:49.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:49.434+0000 7f355b89f640 1 --2- 172.21.15.175:0/2627066273 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f35400a32f0 0x7f35400a57b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3550006010 tx=0x7f3550000bc0 comp rx=0 tx=0).stop 2024-09-19T08:41:49.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:49.434+0000 7f355b89f640 1 -- 172.21.15.175:0/2627066273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3554102690 msgr2=0x7f35541a1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:49.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:49.434+0000 7f355b89f640 1 --2- 172.21.15.175:0/2627066273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3554102690 0x7f35541a1760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f354c00b970 tx=0x7f354c00be30 comp rx=0 tx=0).stop 2024-09-19T08:41:49.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:49.434+0000 7f355b89f640 1 -- 172.21.15.175:0/2627066273 shutdown_connections 2024-09-19T08:41:49.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:49.434+0000 7f355b89f640 1 --2- 172.21.15.175:0/2627066273 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f35400a32f0 0x7f35400a57b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:49.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:49.434+0000 7f355b89f640 1 --2- 172.21.15.175:0/2627066273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3554102690 0x7f35541a1760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:49.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:49.434+0000 7f355b89f640 1 --2- 172.21.15.175:0/2627066273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3554101cd0 0x7f355419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:49.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:49.434+0000 7f355b89f640 1 --2- 172.21.15.175:0/2627066273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3554100ad0 0x7f355419a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:49.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:49.434+0000 7f355b89f640 1 -- 172.21.15.175:0/2627066273 >> 172.21.15.175:0/2627066273 conn(0x7f35540fc280 msgr2=0x7f3554069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:41:49.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:49.434+0000 7f355b89f640 1 -- 172.21.15.175:0/2627066273 shutdown_connections 2024-09-19T08:41:49.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:41:49.434+0000 7f355b89f640 1 -- 172.21.15.175:0/2627066273 wait complete. 2024-09-19T08:41:49.961 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:49 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:49.961 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:49 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:49.961 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:49 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:49.961 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:49 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:49.961 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:49 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:49.961 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:49 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:49.961 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:49 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:49.961 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:49 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:49.986 DEBUG:teuthology.orchestra.run.smithi175:osd.11> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T08:41:49.988 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T08:41:49.988 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T08:41:50.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:49 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:50.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:49 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:50.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:49 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:50.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:49 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:50.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:49 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:50.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:49 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:50.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:49 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:50.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:49 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:50.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:49 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:50.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:49 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:50.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:49 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:50.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:49 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:50.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:49 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:50.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:49 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:41:50.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:49 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:50.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:49 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:50.258 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:41:50.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.759+0000 7f79ebf7c640 1 -- 172.21.15.7:0/1533069551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79e4102e00 msgr2=0x7f79e4103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:50.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.759+0000 7f79ebf7c640 1 --2- 172.21.15.7:0/1533069551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79e4102e00 0x7f79e4103280 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009900 tx=0x7f79e002a410 comp rx=0 tx=0).stop 2024-09-19T08:41:50.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.759+0000 7f79ebf7c640 1 -- 172.21.15.7:0/1533069551 shutdown_connections 2024-09-19T08:41:50.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.759+0000 7f79ebf7c640 1 --2- 172.21.15.7:0/1533069551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79e41037c0 0x7f79e410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:50.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.759+0000 7f79ebf7c640 1 --2- 172.21.15.7:0/1533069551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79e4102e00 0x7f79e4103280 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:50.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.759+0000 7f79ebf7c640 1 --2- 172.21.15.7:0/1533069551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79e4101c00 0x7f79e4102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:50.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.759+0000 7f79ebf7c640 1 -- 172.21.15.7:0/1533069551 >> 172.21.15.7:0/1533069551 conn(0x7f79e40fd390 msgr2=0x7f79e40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:41:50.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.759+0000 7f79ebf7c640 1 -- 172.21.15.7:0/1533069551 shutdown_connections 2024-09-19T08:41:50.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.759+0000 7f79ebf7c640 1 -- 172.21.15.7:0/1533069551 wait complete. 2024-09-19T08:41:50.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.759+0000 7f79ebf7c640 1 Processor -- start 2024-09-19T08:41:50.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.759+0000 7f79ebf7c640 1 -- start start 2024-09-19T08:41:50.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.760+0000 7f79ebf7c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79e4101c00 0x7f79e4197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:50.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.760+0000 7f79ebf7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79e4102e00 0x7f79e4198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:50.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.760+0000 7f79ebf7c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79e41037c0 0x7f79e419f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:50.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.760+0000 7f79ebf7c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f79e410d860 con 0x7f79e4101c00 2024-09-19T08:41:50.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.760+0000 7f79ebf7c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f79e410d6e0 con 0x7f79e4102e00 2024-09-19T08:41:50.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.760+0000 7f79ebf7c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f79e410d9e0 con 0x7f79e41037c0 2024-09-19T08:41:50.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.760+0000 7f79e9d18640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79e4101c00 0x7f79e4197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:50.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.760+0000 7f79e9d18640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79e4101c00 0x7f79e4197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56570/0 (socket says 172.21.15.7:56570) 2024-09-19T08:41:50.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.760+0000 7f79e9d18640 1 -- 172.21.15.7:0/3739869984 learned_addr learned my addr 172.21.15.7:0/3739869984 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:41:50.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.760+0000 7f79e9517640 1 --2- 172.21.15.7:0/3739869984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79e4102e00 0x7f79e4198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:50.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.760+0000 7f79ea519640 1 --2- 172.21.15.7:0/3739869984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79e41037c0 0x7f79e419f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:50.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.760+0000 7f79e9d18640 1 -- 172.21.15.7:0/3739869984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79e41037c0 msgr2=0x7f79e419f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:50.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.760+0000 7f79e9d18640 1 --2- 172.21.15.7:0/3739869984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79e41037c0 0x7f79e419f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:50.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.760+0000 7f79e9d18640 1 -- 172.21.15.7:0/3739869984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79e4102e00 msgr2=0x7f79e4198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:50.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.760+0000 7f79e9d18640 1 --2- 172.21.15.7:0/3739869984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79e4102e00 0x7f79e4198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:50.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.760+0000 7f79e9d18640 1 -- 172.21.15.7:0/3739869984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e419fa80 con 0x7f79e4101c00 2024-09-19T08:41:50.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.760+0000 7f79e9d18640 1 --2- 172.21.15.7:0/3739869984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79e4101c00 0x7f79e4197e50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f79d800c970 tx=0x7f79d800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:41:50.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.760+0000 7f79d6ffd640 1 -- 172.21.15.7:0/3739869984 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d8007c10 con 0x7f79e4101c00 2024-09-19T08:41:50.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.761+0000 7f79ebf7c640 1 -- 172.21.15.7:0/3739869984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e419fd70 con 0x7f79e4101c00 2024-09-19T08:41:50.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.761+0000 7f79d6ffd640 1 -- 172.21.15.7:0/3739869984 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79d8007db0 con 0x7f79e4101c00 2024-09-19T08:41:50.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.761+0000 7f79d6ffd640 1 -- 172.21.15.7:0/3739869984 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d800f8a0 con 0x7f79e4101c00 2024-09-19T08:41:50.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.761+0000 7f79ebf7c640 1 -- 172.21.15.7:0/3739869984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e41a0210 con 0x7f79e4101c00 2024-09-19T08:41:50.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:50 smithi007 ceph-mon[31221]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:50.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.762+0000 7f79ebf7c640 1 -- 172.21.15.7:0/3739869984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79e4108fd0 con 0x7f79e4101c00 2024-09-19T08:41:50.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.764+0000 7f79d6ffd640 1 -- 172.21.15.7:0/3739869984 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f79d800fb00 con 0x7f79e4101c00 2024-09-19T08:41:50.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.764+0000 7f79d6ffd640 1 --2- 172.21.15.7:0/3739869984 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f79d00a32f0 0x7f79d00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:50.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.765+0000 7f79e9517640 1 --2- 172.21.15.7:0/3739869984 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f79d00a32f0 0x7f79d00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:50.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.765+0000 7f79d6ffd640 1 -- 172.21.15.7:0/3739869984 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6809+0+0 (secure 0 0 0) 0x7f79d80cf5e0 con 0x7f79e4101c00 2024-09-19T08:41:50.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.765+0000 7f79e9517640 1 --2- 172.21.15.7:0/3739869984 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f79d00a32f0 0x7f79d00a57b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f79e00314e0 tx=0x7f79e0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:41:50.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.769+0000 7f79d6ffd640 1 -- 172.21.15.7:0/3739869984 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f79d809c8d0 con 0x7f79e4101c00 2024-09-19T08:41:50.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.943+0000 7f79ebf7c640 1 -- 172.21.15.7:0/3739869984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f79e4062e90 con 0x7f79e4101c00 2024-09-19T08:41:50.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.944+0000 7f79d6ffd640 1 -- 172.21.15.7:0/3739869984 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7f79d809c1d0 con 0x7f79e4101c00 2024-09-19T08:41:50.945 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:41:50.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.945+0000 7f79ebf7c640 1 -- 172.21.15.7:0/3739869984 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f79d00a32f0 msgr2=0x7f79d00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:50.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.946+0000 7f79ebf7c640 1 --2- 172.21.15.7:0/3739869984 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f79d00a32f0 0x7f79d00a57b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f79e00314e0 tx=0x7f79e0000bc0 comp rx=0 tx=0).stop 2024-09-19T08:41:50.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.946+0000 7f79ebf7c640 1 -- 172.21.15.7:0/3739869984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79e4101c00 msgr2=0x7f79e4197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:50.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.946+0000 7f79ebf7c640 1 --2- 172.21.15.7:0/3739869984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79e4101c00 0x7f79e4197e50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f79d800c970 tx=0x7f79d800ce30 comp rx=0 tx=0).stop 2024-09-19T08:41:50.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.946+0000 7f79ebf7c640 1 -- 172.21.15.7:0/3739869984 shutdown_connections 2024-09-19T08:41:50.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.946+0000 7f79ebf7c640 1 --2- 172.21.15.7:0/3739869984 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f79d00a32f0 0x7f79d00a57b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:50.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.946+0000 7f79ebf7c640 1 --2- 172.21.15.7:0/3739869984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79e41037c0 0x7f79e419f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:50.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.946+0000 7f79ebf7c640 1 --2- 172.21.15.7:0/3739869984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79e4102e00 0x7f79e4198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:50.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.946+0000 7f79ebf7c640 1 --2- 172.21.15.7:0/3739869984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79e4101c00 0x7f79e4197e50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:50.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.946+0000 7f79ebf7c640 1 -- 172.21.15.7:0/3739869984 >> 172.21.15.7:0/3739869984 conn(0x7f79e40fd390 msgr2=0x7f79e41061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:41:50.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.946+0000 7f79ebf7c640 1 -- 172.21.15.7:0/3739869984 shutdown_connections 2024-09-19T08:41:50.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:50.946+0000 7f79ebf7c640 1 -- 172.21.15.7:0/3739869984 wait complete. 2024-09-19T08:41:51.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:50 smithi044 ceph-mon[35072]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:51.127 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:50 smithi175 ceph-mon[35688]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:51.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:51 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3739869984' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:41:51.972 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1726735290,"num_in_osds":12,"osd_in_since":1726735291,"num_remapped_pgs":0} 2024-09-19T08:41:51.992 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:51 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3739869984' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:41:51.993 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:41:51 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:41:51.842+0000 7fef21cac640 -1 osd.11 0 log_to_monitors true 2024-09-19T08:41:52.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:51 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3739869984' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:41:52.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:52 smithi175 ceph-mon[35688]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:52.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:52 smithi175 ceph-mon[35688]: from='osd.11 [v2:172.21.15.175:6824/4173951310,v1:172.21.15.175:6825/4173951310]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:41:52.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:52 smithi175 ceph-mon[35688]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:41:52.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:52 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:52.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:52 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:52.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:52 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:52.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:52 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:52.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:52 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:52.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:52 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:52.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:52 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:52.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:52 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:52.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:52 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:52.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:52 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:52.974 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T08:41:53.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:52 smithi007 ceph-mon[31221]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:53.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:52 smithi007 ceph-mon[31221]: from='osd.11 [v2:172.21.15.175:6824/4173951310,v1:172.21.15.175:6825/4173951310]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:41:53.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:52 smithi007 ceph-mon[31221]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:41:53.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:52 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:53.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:52 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:53.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:52 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:53.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:52 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:53.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:52 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:53.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:52 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:53.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:52 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:53.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:52 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:53.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:52 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:53.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:52 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:53.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:52 smithi044 ceph-mon[35072]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:53.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:52 smithi044 ceph-mon[35072]: from='osd.11 [v2:172.21.15.175:6824/4173951310,v1:172.21.15.175:6825/4173951310]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:41:53.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:52 smithi044 ceph-mon[35072]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:41:53.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:52 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:53.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:52 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:53.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:52 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:53.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:52 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:53.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:52 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:53.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:52 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:41:53.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:52 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:53.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:52 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:41:53.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:52 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:41:53.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:52 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:41:53.239 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.704+0000 7f2091333640 1 -- 172.21.15.7:0/2933749908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f208c1026c0 msgr2=0x7f208c104ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.704+0000 7f2091333640 1 --2- 172.21.15.7:0/2933749908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f208c1026c0 0x7f208c104ab0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f207c009900 tx=0x7f207c02a410 comp rx=0 tx=0).stop 2024-09-19T08:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.704+0000 7f2091333640 1 -- 172.21.15.7:0/2933749908 shutdown_connections 2024-09-19T08:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.704+0000 7f2091333640 1 --2- 172.21.15.7:0/2933749908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f208c107920 0x7f208c109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.704+0000 7f2091333640 1 --2- 172.21.15.7:0/2933749908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f208c104ff0 0x7f208c1073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.704+0000 7f2091333640 1 --2- 172.21.15.7:0/2933749908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f208c1026c0 0x7f208c104ab0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.704+0000 7f2091333640 1 -- 172.21.15.7:0/2933749908 >> 172.21.15.7:0/2933749908 conn(0x7f208c0fc280 msgr2=0x7f208c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:41:53.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.704+0000 7f2091333640 1 -- 172.21.15.7:0/2933749908 shutdown_connections 2024-09-19T08:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.704+0000 7f2091333640 1 -- 172.21.15.7:0/2933749908 wait complete. 2024-09-19T08:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.705+0000 7f2091333640 1 Processor -- start 2024-09-19T08:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.705+0000 7f2091333640 1 -- start start 2024-09-19T08:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.705+0000 7f2091333640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f208c1026c0 0x7f208c197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.705+0000 7f2091333640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f208c104ff0 0x7f208c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.705+0000 7f2091333640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f208c107920 0x7f208c19f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.705+0000 7f2091333640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f208c10d860 con 0x7f208c1026c0 2024-09-19T08:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.705+0000 7f2091333640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f208c10d6e0 con 0x7f208c104ff0 2024-09-19T08:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.705+0000 7f2091333640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f208c10d9e0 con 0x7f208c107920 2024-09-19T08:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.705+0000 7f208affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f208c1026c0 0x7f208c197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:53.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.705+0000 7f208affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f208c1026c0 0x7f208c197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47010/0 (socket says 172.21.15.7:47010) 2024-09-19T08:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.705+0000 7f208affd640 1 -- 172.21.15.7:0/825286415 learned_addr learned my addr 172.21.15.7:0/825286415 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.705+0000 7f208b7fe640 1 --2- 172.21.15.7:0/825286415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f208c107920 0x7f208c19f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.705+0000 7f208a7fc640 1 --2- 172.21.15.7:0/825286415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f208c104ff0 0x7f208c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.706+0000 7f208affd640 1 -- 172.21.15.7:0/825286415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f208c107920 msgr2=0x7f208c19f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.706+0000 7f208affd640 1 --2- 172.21.15.7:0/825286415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f208c107920 0x7f208c19f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.706+0000 7f208affd640 1 -- 172.21.15.7:0/825286415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f208c104ff0 msgr2=0x7f208c198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.706+0000 7f208affd640 1 --2- 172.21.15.7:0/825286415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f208c104ff0 0x7f208c198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.706+0000 7f208affd640 1 -- 172.21.15.7:0/825286415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f208c19fb40 con 0x7f208c1026c0 2024-09-19T08:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.706+0000 7f208a7fc640 1 --2- 172.21.15.7:0/825286415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f208c104ff0 0x7f208c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.706+0000 7f208affd640 1 --2- 172.21.15.7:0/825286415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f208c1026c0 0x7f208c197f10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f207c009230 tx=0x7f207c004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.706+0000 7f2073fff640 1 -- 172.21.15.7:0/825286415 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c03f030 con 0x7f208c1026c0 2024-09-19T08:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.706+0000 7f2073fff640 1 -- 172.21.15.7:0/825286415 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f207c003ce0 con 0x7f208c1026c0 2024-09-19T08:41:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.706+0000 7f2091333640 1 -- 172.21.15.7:0/825286415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f208c19fdd0 con 0x7f208c1026c0 2024-09-19T08:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.706+0000 7f2073fff640 1 -- 172.21.15.7:0/825286415 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c035070 con 0x7f208c1026c0 2024-09-19T08:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.706+0000 7f2091333640 1 -- 172.21.15.7:0/825286415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f208c1a01f0 con 0x7f208c1026c0 2024-09-19T08:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.707+0000 7f2091333640 1 -- 172.21.15.7:0/825286415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f208c0fdd70 con 0x7f208c1026c0 2024-09-19T08:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.709+0000 7f2073fff640 1 -- 172.21.15.7:0/825286415 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f207c042030 con 0x7f208c1026c0 2024-09-19T08:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.710+0000 7f2073fff640 1 --2- 172.21.15.7:0/825286415 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f20740a3270 0x7f20740a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.710+0000 7f2073fff640 1 -- 172.21.15.7:0/825286415 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6831+0+0 (secure 0 0 0) 0x7f207c0efe50 con 0x7f208c1026c0 2024-09-19T08:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.710+0000 7f208a7fc640 1 --2- 172.21.15.7:0/825286415 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f20740a3270 0x7f20740a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.710+0000 7f208a7fc640 1 --2- 172.21.15.7:0/825286415 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f20740a3270 0x7f20740a5730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f208c199430 tx=0x7f2080005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:41:53.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.713+0000 7f2073fff640 1 -- 172.21.15.7:0/825286415 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f207c0bd0a0 con 0x7f208c1026c0 2024-09-19T08:41:53.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.898+0000 7f2091333640 1 -- 172.21.15.7:0/825286415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f208c062e90 con 0x7f208c1026c0 2024-09-19T08:41:53.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:53 smithi007 ceph-mon[31221]: Detected new or changed devices on smithi175 2024-09-19T08:41:53.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:53 smithi007 ceph-mon[31221]: Adjusting osd_memory_target on smithi175 to 4272M 2024-09-19T08:41:53.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:53 smithi007 ceph-mon[31221]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T08:41:53.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:53 smithi007 ceph-mon[31221]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T08:41:53.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:53 smithi007 ceph-mon[31221]: from='osd.11 [v2:172.21.15.175:6824/4173951310,v1:172.21.15.175:6825/4173951310]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:41:53.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:53 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:53.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:53 smithi007 ceph-mon[31221]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:41:53.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:53 smithi007 ceph-mon[31221]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-19T08:41:53.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.899+0000 7f2073fff640 1 -- 172.21.15.7:0/825286415 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f207c0bc9a0 con 0x7f208c1026c0 2024-09-19T08:41:53.901 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:41:53.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.901+0000 7f2091333640 1 -- 172.21.15.7:0/825286415 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f20740a3270 msgr2=0x7f20740a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:53.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.901+0000 7f2091333640 1 --2- 172.21.15.7:0/825286415 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f20740a3270 0x7f20740a5730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f208c199430 tx=0x7f2080005ec0 comp rx=0 tx=0).stop 2024-09-19T08:41:53.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.901+0000 7f2091333640 1 -- 172.21.15.7:0/825286415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f208c1026c0 msgr2=0x7f208c197f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:53.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.901+0000 7f2091333640 1 --2- 172.21.15.7:0/825286415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f208c1026c0 0x7f208c197f10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f207c009230 tx=0x7f207c004360 comp rx=0 tx=0).stop 2024-09-19T08:41:53.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.901+0000 7f2091333640 1 -- 172.21.15.7:0/825286415 shutdown_connections 2024-09-19T08:41:53.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.901+0000 7f2091333640 1 --2- 172.21.15.7:0/825286415 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f20740a3270 0x7f20740a5730 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:53.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.901+0000 7f2091333640 1 --2- 172.21.15.7:0/825286415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f208c107920 0x7f208c19f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:53.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.901+0000 7f2091333640 1 --2- 172.21.15.7:0/825286415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f208c104ff0 0x7f208c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:53.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.901+0000 7f2091333640 1 --2- 172.21.15.7:0/825286415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f208c1026c0 0x7f208c197f10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:53.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.901+0000 7f2091333640 1 -- 172.21.15.7:0/825286415 >> 172.21.15.7:0/825286415 conn(0x7f208c0fc280 msgr2=0x7f208c1030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:41:53.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.902+0000 7f2091333640 1 -- 172.21.15.7:0/825286415 shutdown_connections 2024-09-19T08:41:53.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:53.902+0000 7f2091333640 1 -- 172.21.15.7:0/825286415 wait complete. 2024-09-19T08:41:54.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:53 smithi044 ceph-mon[35072]: Detected new or changed devices on smithi175 2024-09-19T08:41:54.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:53 smithi044 ceph-mon[35072]: Adjusting osd_memory_target on smithi175 to 4272M 2024-09-19T08:41:54.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:53 smithi044 ceph-mon[35072]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T08:41:54.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:53 smithi044 ceph-mon[35072]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T08:41:54.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:53 smithi044 ceph-mon[35072]: from='osd.11 [v2:172.21.15.175:6824/4173951310,v1:172.21.15.175:6825/4173951310]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:41:54.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:53 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:54.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:53 smithi044 ceph-mon[35072]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:41:54.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:53 smithi044 ceph-mon[35072]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-19T08:41:54.178 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:41:53 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:41:53.737+0000 7fef1d40c640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T08:41:54.178 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:41:53 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:41:53.753+0000 7fef19a46640 -1 osd.11 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:41:54.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:53 smithi175 ceph-mon[35688]: Detected new or changed devices on smithi175 2024-09-19T08:41:54.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:53 smithi175 ceph-mon[35688]: Adjusting osd_memory_target on smithi175 to 4272M 2024-09-19T08:41:54.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:53 smithi175 ceph-mon[35688]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T08:41:54.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:53 smithi175 ceph-mon[35688]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T08:41:54.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:53 smithi175 ceph-mon[35688]: from='osd.11 [v2:172.21.15.175:6824/4173951310,v1:172.21.15.175:6825/4173951310]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:41:54.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:53 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:54.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:53 smithi175 ceph-mon[35688]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-09-19T08:41:54.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:53 smithi175 ceph-mon[35688]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-09-19T08:41:54.739 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1726735290,"num_in_osds":12,"osd_in_since":1726735291,"num_remapped_pgs":0} 2024-09-19T08:41:55.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:54 smithi007 ceph-mon[31221]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:55.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:54 smithi007 ceph-mon[31221]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T08:41:55.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:54 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:55.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:54 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:55.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:54 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/825286415' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:41:55.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:54 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:55.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:54 smithi044 ceph-mon[35072]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:55.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:54 smithi044 ceph-mon[35072]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T08:41:55.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:54 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:55.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:54 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:55.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:54 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/825286415' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:41:55.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:54 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:55.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:54 smithi175 ceph-mon[35688]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:55.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:54 smithi175 ceph-mon[35688]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T08:41:55.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:54 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:55.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:54 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:55.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:54 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/825286415' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:41:55.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:54 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:55.740 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T08:41:56.006 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:41:56.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:55 smithi007 ceph-mon[31221]: purged_snaps scrub starts 2024-09-19T08:41:56.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:55 smithi007 ceph-mon[31221]: purged_snaps scrub ok 2024-09-19T08:41:56.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:55 smithi007 ceph-mon[31221]: osd.11 [v2:172.21.15.175:6824/4173951310,v1:172.21.15.175:6825/4173951310] boot 2024-09-19T08:41:56.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:55 smithi007 ceph-mon[31221]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T08:41:56.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:55 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:56.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:55 smithi044 ceph-mon[35072]: purged_snaps scrub starts 2024-09-19T08:41:56.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:55 smithi044 ceph-mon[35072]: purged_snaps scrub ok 2024-09-19T08:41:56.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:55 smithi044 ceph-mon[35072]: osd.11 [v2:172.21.15.175:6824/4173951310,v1:172.21.15.175:6825/4173951310] boot 2024-09-19T08:41:56.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:55 smithi044 ceph-mon[35072]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T08:41:56.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:55 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:56.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:55 smithi175 ceph-mon[35688]: purged_snaps scrub starts 2024-09-19T08:41:56.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:55 smithi175 ceph-mon[35688]: purged_snaps scrub ok 2024-09-19T08:41:56.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:55 smithi175 ceph-mon[35688]: osd.11 [v2:172.21.15.175:6824/4173951310,v1:172.21.15.175:6825/4173951310] boot 2024-09-19T08:41:56.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:55 smithi175 ceph-mon[35688]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T08:41:56.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:55 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:41:56.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.453+0000 7fe64b0c6640 1 -- 172.21.15.7:0/1934576476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe644101c00 msgr2=0x7fe644102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:56.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.453+0000 7fe64b0c6640 1 --2- 172.21.15.7:0/1934576476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe644101c00 0x7fe644102000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe634009900 tx=0x7fe63402a410 comp rx=0 tx=0).stop 2024-09-19T08:41:56.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.453+0000 7fe64b0c6640 1 -- 172.21.15.7:0/1934576476 shutdown_connections 2024-09-19T08:41:56.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.453+0000 7fe64b0c6640 1 --2- 172.21.15.7:0/1934576476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6441037c0 0x7fe64410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:56.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.453+0000 7fe64b0c6640 1 --2- 172.21.15.7:0/1934576476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe644102e00 0x7fe644103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:56.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.453+0000 7fe64b0c6640 1 --2- 172.21.15.7:0/1934576476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe644101c00 0x7fe644102000 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:56.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.453+0000 7fe64b0c6640 1 -- 172.21.15.7:0/1934576476 >> 172.21.15.7:0/1934576476 conn(0x7fe6440fd390 msgr2=0x7fe6440ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:41:56.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.453+0000 7fe64b0c6640 1 -- 172.21.15.7:0/1934576476 shutdown_connections 2024-09-19T08:41:56.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.453+0000 7fe64b0c6640 1 -- 172.21.15.7:0/1934576476 wait complete. 2024-09-19T08:41:56.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.454+0000 7fe64b0c6640 1 Processor -- start 2024-09-19T08:41:56.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.454+0000 7fe64b0c6640 1 -- start start 2024-09-19T08:41:56.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.454+0000 7fe64b0c6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe644101c00 0x7fe644197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:56.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.454+0000 7fe64b0c6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe644102e00 0x7fe644198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:56.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.454+0000 7fe64b0c6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6441037c0 0x7fe64419f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:56.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.454+0000 7fe64b0c6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe64410d880 con 0x7fe6441037c0 2024-09-19T08:41:56.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.454+0000 7fe64b0c6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe64410d700 con 0x7fe644102e00 2024-09-19T08:41:56.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.454+0000 7fe64b0c6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe64410da00 con 0x7fe644101c00 2024-09-19T08:41:56.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.454+0000 7fe649663640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6441037c0 0x7fe64419f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:56.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.454+0000 7fe649663640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6441037c0 0x7fe64419f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47034/0 (socket says 172.21.15.7:47034) 2024-09-19T08:41:56.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.454+0000 7fe649663640 1 -- 172.21.15.7:0/4038208687 learned_addr learned my addr 172.21.15.7:0/4038208687 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:41:56.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.454+0000 7fe643fff640 1 --2- 172.21.15.7:0/4038208687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe644102e00 0x7fe644198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:56.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.454+0000 7fe648e62640 1 --2- 172.21.15.7:0/4038208687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe644101c00 0x7fe644197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:56.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.455+0000 7fe649663640 1 -- 172.21.15.7:0/4038208687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe644101c00 msgr2=0x7fe644197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:56.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.455+0000 7fe649663640 1 --2- 172.21.15.7:0/4038208687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe644101c00 0x7fe644197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.455+0000 7fe649663640 1 -- 172.21.15.7:0/4038208687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe644102e00 msgr2=0x7fe644198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.455+0000 7fe649663640 1 --2- 172.21.15.7:0/4038208687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe644102e00 0x7fe644198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.455+0000 7fe649663640 1 -- 172.21.15.7:0/4038208687 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64419fb40 con 0x7fe6441037c0 2024-09-19T08:41:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.455+0000 7fe649663640 1 --2- 172.21.15.7:0/4038208687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6441037c0 0x7fe64419f4d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00d950 tx=0x7fe63c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:41:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.455+0000 7fe641ffb640 1 -- 172.21.15.7:0/4038208687 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c017030 con 0x7fe6441037c0 2024-09-19T08:41:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.455+0000 7fe641ffb640 1 -- 172.21.15.7:0/4038208687 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe63c004020 con 0x7fe6441037c0 2024-09-19T08:41:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.455+0000 7fe64b0c6640 1 -- 172.21.15.7:0/4038208687 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe64419fe30 con 0x7fe6441037c0 2024-09-19T08:41:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.455+0000 7fe641ffb640 1 -- 172.21.15.7:0/4038208687 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c003c00 con 0x7fe6441037c0 2024-09-19T08:41:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.455+0000 7fe64b0c6640 1 -- 172.21.15.7:0/4038208687 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6441a0290 con 0x7fe6441037c0 2024-09-19T08:41:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.456+0000 7fe64b0c6640 1 -- 172.21.15.7:0/4038208687 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe644108ff0 con 0x7fe6441037c0 2024-09-19T08:41:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.457+0000 7fe641ffb640 1 -- 172.21.15.7:0/4038208687 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fe63c01a070 con 0x7fe6441037c0 2024-09-19T08:41:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.458+0000 7fe641ffb640 1 --2- 172.21.15.7:0/4038208687 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fe62c0a3270 0x7fe62c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.458+0000 7fe648e62640 1 --2- 172.21.15.7:0/4038208687 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fe62c0a3270 0x7fe62c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:56.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.458+0000 7fe641ffb640 1 -- 172.21.15.7:0/4038208687 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fe63c0ced00 con 0x7fe6441037c0 2024-09-19T08:41:56.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.459+0000 7fe648e62640 1 --2- 172.21.15.7:0/4038208687 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fe62c0a3270 0x7fe62c0a5730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe634006010 tx=0x7fe634000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:41:56.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.462+0000 7fe641ffb640 1 -- 172.21.15.7:0/4038208687 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe63c021070 con 0x7fe6441037c0 2024-09-19T08:41:56.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.641+0000 7fe64b0c6640 1 -- 172.21.15.7:0/4038208687 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe64402da10 con 0x7fe6441037c0 2024-09-19T08:41:56.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.641+0000 7fe641ffb640 1 -- 172.21.15.7:0/4038208687 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7fe63c09bec0 con 0x7fe6441037c0 2024-09-19T08:41:56.642 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:41:56.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.643+0000 7fe64b0c6640 1 -- 172.21.15.7:0/4038208687 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fe62c0a3270 msgr2=0x7fe62c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:56.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.643+0000 7fe64b0c6640 1 --2- 172.21.15.7:0/4038208687 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fe62c0a3270 0x7fe62c0a5730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe634006010 tx=0x7fe634000bc0 comp rx=0 tx=0).stop 2024-09-19T08:41:56.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.643+0000 7fe64b0c6640 1 -- 172.21.15.7:0/4038208687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6441037c0 msgr2=0x7fe64419f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:56.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.643+0000 7fe64b0c6640 1 --2- 172.21.15.7:0/4038208687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6441037c0 0x7fe64419f4d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00d950 tx=0x7fe63c00de10 comp rx=0 tx=0).stop 2024-09-19T08:41:56.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.643+0000 7fe64b0c6640 1 -- 172.21.15.7:0/4038208687 shutdown_connections 2024-09-19T08:41:56.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.643+0000 7fe64b0c6640 1 --2- 172.21.15.7:0/4038208687 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fe62c0a3270 0x7fe62c0a5730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:56.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.643+0000 7fe64b0c6640 1 --2- 172.21.15.7:0/4038208687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6441037c0 0x7fe64419f4d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:56.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.643+0000 7fe64b0c6640 1 --2- 172.21.15.7:0/4038208687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe644102e00 0x7fe644198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:56.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.643+0000 7fe64b0c6640 1 --2- 172.21.15.7:0/4038208687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe644101c00 0x7fe644197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:56.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.643+0000 7fe64b0c6640 1 -- 172.21.15.7:0/4038208687 >> 172.21.15.7:0/4038208687 conn(0x7fe6440fd390 msgr2=0x7fe6441061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:41:56.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.643+0000 7fe64b0c6640 1 -- 172.21.15.7:0/4038208687 shutdown_connections 2024-09-19T08:41:56.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:56.643+0000 7fe64b0c6640 1 -- 172.21.15.7:0/4038208687 wait complete. 2024-09-19T08:41:57.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:56 smithi007 ceph-mon[31221]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:57.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:56 smithi007 ceph-mon[31221]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T08:41:57.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:56 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/4038208687' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:41:57.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:56 smithi044 ceph-mon[35072]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:57.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:56 smithi044 ceph-mon[35072]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T08:41:57.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:56 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/4038208687' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:41:57.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:56 smithi175 ceph-mon[35688]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:41:57.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:56 smithi175 ceph-mon[35688]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T08:41:57.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:56 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/4038208687' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:41:57.347 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":75,"num_osds":12,"num_up_osds":12,"osd_up_since":1726735314,"num_in_osds":12,"osd_in_since":1726735291,"num_remapped_pgs":0} 2024-09-19T08:41:57.348 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:41:57.600 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:41:58.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.212+0000 7f8a2743e640 1 -- 172.21.15.7:0/2926453732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a20101de0 msgr2=0x7f8a201021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:58.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.212+0000 7f8a2743e640 1 --2- 172.21.15.7:0/2926453732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a20101de0 0x7f8a201021c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c009900 tx=0x7f8a1c02a410 comp rx=0 tx=0).stop 2024-09-19T08:41:58.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.212+0000 7f8a2743e640 1 -- 172.21.15.7:0/2926453732 shutdown_connections 2024-09-19T08:41:58.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.212+0000 7f8a2743e640 1 --2- 172.21.15.7:0/2926453732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a20106f10 0x7f8a2010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:58.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.212+0000 7f8a2743e640 1 --2- 172.21.15.7:0/2926453732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a20102790 0x7f8a201067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:58.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.212+0000 7f8a2743e640 1 --2- 172.21.15.7:0/2926453732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a20101de0 0x7f8a201021c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:58.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.212+0000 7f8a2743e640 1 -- 172.21.15.7:0/2926453732 >> 172.21.15.7:0/2926453732 conn(0x7f8a200fd8c0 msgr2=0x7f8a200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:41:58.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.212+0000 7f8a2743e640 1 -- 172.21.15.7:0/2926453732 shutdown_connections 2024-09-19T08:41:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.212+0000 7f8a2743e640 1 -- 172.21.15.7:0/2926453732 wait complete. 2024-09-19T08:41:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.213+0000 7f8a2743e640 1 Processor -- start 2024-09-19T08:41:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.213+0000 7f8a2743e640 1 -- start start 2024-09-19T08:41:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.213+0000 7f8a2743e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a20101de0 0x7f8a20198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.213+0000 7f8a2743e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a20102790 0x7f8a201989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.213+0000 7f8a2743e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a20106f10 0x7f8a2019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.213+0000 7f8a2743e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8a20111f30 con 0x7f8a20106f10 2024-09-19T08:41:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.213+0000 7f8a2743e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8a20111db0 con 0x7f8a20102790 2024-09-19T08:41:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.213+0000 7f8a2743e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8a201120b0 con 0x7f8a20101de0 2024-09-19T08:41:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.213+0000 7f8a259db640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a20106f10 0x7f8a2019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.213+0000 7f8a259db640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a20106f10 0x7f8a2019cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47058/0 (socket says 172.21.15.7:47058) 2024-09-19T08:41:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.213+0000 7f8a259db640 1 -- 172.21.15.7:0/2621356153 learned_addr learned my addr 172.21.15.7:0/2621356153 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:41:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.213+0000 7f8a249d9640 1 --2- 172.21.15.7:0/2621356153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a20102790 0x7f8a201989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.213+0000 7f8a251da640 1 --2- 172.21.15.7:0/2621356153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a20101de0 0x7f8a20198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.214+0000 7f8a259db640 1 -- 172.21.15.7:0/2621356153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a20101de0 msgr2=0x7f8a20198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.214+0000 7f8a259db640 1 --2- 172.21.15.7:0/2621356153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a20101de0 0x7f8a20198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.214+0000 7f8a259db640 1 -- 172.21.15.7:0/2621356153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a20102790 msgr2=0x7f8a201989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.214+0000 7f8a259db640 1 --2- 172.21.15.7:0/2621356153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a20102790 0x7f8a201989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.214+0000 7f8a259db640 1 -- 172.21.15.7:0/2621356153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2019d420 con 0x7f8a20106f10 2024-09-19T08:41:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.214+0000 7f8a259db640 1 --2- 172.21.15.7:0/2621356153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a20106f10 0x7f8a2019cd40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8a1800eaa0 tx=0x7f8a1800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:41:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.214+0000 7f8a167fc640 1 -- 172.21.15.7:0/2621356153 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1800cdb0 con 0x7f8a20106f10 2024-09-19T08:41:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.214+0000 7f8a167fc640 1 -- 172.21.15.7:0/2621356153 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a18005020 con 0x7f8a20106f10 2024-09-19T08:41:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.214+0000 7f8a2743e640 1 -- 172.21.15.7:0/2621356153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a2019d710 con 0x7f8a20106f10 2024-09-19T08:41:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.214+0000 7f8a167fc640 1 -- 172.21.15.7:0/2621356153 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a180116b0 con 0x7f8a20106f10 2024-09-19T08:41:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.214+0000 7f8a2743e640 1 -- 172.21.15.7:0/2621356153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a201a4ff0 con 0x7f8a20106f10 2024-09-19T08:41:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.215+0000 7f8a2743e640 1 -- 172.21.15.7:0/2621356153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a201021c0 con 0x7f8a20106f10 2024-09-19T08:41:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.216+0000 7f8a167fc640 1 -- 172.21.15.7:0/2621356153 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f8a18005560 con 0x7f8a20106f10 2024-09-19T08:41:58.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.217+0000 7f8a167fc640 1 --2- 172.21.15.7:0/2621356153 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f8a0c0a3240 0x7f8a0c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:58.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.217+0000 7f8a251da640 1 --2- 172.21.15.7:0/2621356153 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f8a0c0a3240 0x7f8a0c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:58.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.217+0000 7f8a167fc640 1 -- 172.21.15.7:0/2621356153 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f8a180cfae0 con 0x7f8a20106f10 2024-09-19T08:41:58.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.217+0000 7f8a251da640 1 --2- 172.21.15.7:0/2621356153 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f8a0c0a3240 0x7f8a0c0a5700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c005ab0 tx=0x7f8a1c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:41:58.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.220+0000 7f8a167fc640 1 -- 172.21.15.7:0/2621356153 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8a18016030 con 0x7f8a20106f10 2024-09-19T08:41:58.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.396+0000 7f8a2743e640 1 -- 172.21.15.7:0/2621356153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a201997d0 con 0x7f8a20106f10 2024-09-19T08:41:58.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.397+0000 7f8a167fc640 1 -- 172.21.15.7:0/2621356153 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+18399 (secure 0 0 0) 0x7f8a201997d0 con 0x7f8a20106f10 2024-09-19T08:41:58.398 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:41:58.398 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":75,"fsid":"ebd23124-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:02.287380+0000","modified":"2024-09-19T08:41:55.748831+0000","last_up_change":"2024-09-19T08:41:54.742978+0000","last_in_change":"2024-09-19T08:41:31.685622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:13.285118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"837e6267-71c7-4f48-9e0b-4e3f124682b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6803","nonce":402668717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6805","nonce":402668717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6809","nonce":402668717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6807","nonce":402668717}]},"public_addr":"172.21.15.7:6803/402668717","cluster_addr":"172.21.15.7:6805/402668717","heartbeat_back_addr":"172.21.15.7:6809/402668717","heartbeat_front_addr":"172.21.15.7:6807/402668717","state":["exists","up"]},{"osd":1,"uuid":"67865372-ac22-4b30-bd02-498e118d6701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6801","nonce":2213694259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6803","nonce":2213694259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6807","nonce":2213694259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6805","nonce":2213694259}]},"public_addr":"172.21.15.44:6801/2213694259","cluster_addr":"172.21.15.44:6803/2213694259","heartbeat_back_addr":"172.21.15.44:6807/2213694259","heartbeat_front_addr":"172.21.15.44:6805/2213694259","state":["exists","up"]},{"osd":2,"uuid":"37c1cc2b-60ea-449f-baa7-c65d96c3559c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6801","nonce":3413002145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6803","nonce":3413002145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6807","nonce":3413002145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6805","nonce":3413002145}]},"public_addr":"172.21.15.175:6801/3413002145","cluster_addr":"172.21.15.175:6803/3413002145","heartbeat_back_addr":"172.21.15.175:6807/3413002145","heartbeat_front_addr":"172.21.15.175:6805/3413002145","state":["exists","up"]},{"osd":3,"uuid":"a8ffd2ae-4211-492a-a8ac-d4d6cbb4a03d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6811","nonce":2528867083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6813","nonce":2528867083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6817","nonce":2528867083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6815","nonce":2528867083}]},"public_addr":"172.21.15.7:6811/2528867083","cluster_addr":"172.21.15.7:6813/2528867083","heartbeat_back_addr":"172.21.15.7:6817/2528867083","heartbeat_front_addr":"172.21.15.7:6815/2528867083","state":["exists","up"]},{"osd":4,"uuid":"9a67b2ec-1a0a-413e-bd13-9532f24a0155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6809","nonce":3537143774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537143774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537143774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537143774}]},"public_addr":"172.21.15.44:6809/3537143774","cluster_addr":"172.21.15.44:6811/3537143774","heartbeat_back_addr":"172.21.15.44:6815/3537143774","heartbeat_front_addr":"172.21.15.44:6813/3537143774","state":["exists","up"]},{"osd":5,"uuid":"436cd596-710b-48e2-8255-8427c93cee1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6809","nonce":4001214751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6811","nonce":4001214751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6815","nonce":4001214751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6813","nonce":4001214751}]},"public_addr":"172.21.15.175:6809/4001214751","cluster_addr":"172.21.15.175:6811/4001214751","heartbeat_back_addr":"172.21.15.175:6815/4001214751","heartbeat_front_addr":"172.21.15.175:6813/4001214751","state":["exists","up"]},{"osd":6,"uuid":"f5a7ad2b-6b44-4b5a-8af7-f7fb00e7ca68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6819","nonce":1261079202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6821","nonce":1261079202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6825","nonce":1261079202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6823","nonce":1261079202}]},"public_addr":"172.21.15.7:6819/1261079202","cluster_addr":"172.21.15.7:6821/1261079202","heartbeat_back_addr":"172.21.15.7:6825/1261079202","heartbeat_front_addr":"172.21.15.7:6823/1261079202","state":["exists","up"]},{"osd":7,"uuid":"aa24aee5-6449-4842-8831-1c8e06cde75b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6817","nonce":3120822957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6819","nonce":3120822957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6823","nonce":3120822957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6821","nonce":3120822957}]},"public_addr":"172.21.15.44:6817/3120822957","cluster_addr":"172.21.15.44:6819/3120822957","heartbeat_back_addr":"172.21.15.44:6823/3120822957","heartbeat_front_addr":"172.21.15.44:6821/3120822957","state":["exists","up"]},{"osd":8,"uuid":"d912501a-bb7a-489e-b6ab-e451fb22210d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6817","nonce":2080374927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6819","nonce":2080374927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6823","nonce":2080374927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6821","nonce":2080374927}]},"public_addr":"172.21.15.175:6817/2080374927","cluster_addr":"172.21.15.175:6819/2080374927","heartbeat_back_addr":"172.21.15.175:6823/2080374927","heartbeat_front_addr":"172.21.15.175:6821/2080374927","state":["exists","up"]},{"osd":9,"uuid":"d132f5b2-75b9-4d6c-89ec-f52c303e0fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6827","nonce":3808356432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6829","nonce":3808356432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6833","nonce":3808356432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6831","nonce":3808356432}]},"public_addr":"172.21.15.7:6827/3808356432","cluster_addr":"172.21.15.7:6829/3808356432","heartbeat_back_addr":"172.21.15.7:6833/3808356432","heartbeat_front_addr":"172.21.15.7:6831/3808356432","state":["exists","up"]},{"osd":10,"uuid":"f6c405d6-a255-4e0e-8528-7bbc16d5e434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6825","nonce":4009464689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6827","nonce":4009464689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6831","nonce":4009464689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6829","nonce":4009464689}]},"public_addr":"172.21.15.44:6825/4009464689","cluster_addr":"172.21.15.44:6827/4009464689","heartbeat_back_addr":"172.21.15.44:6831/4009464689","heartbeat_front_addr":"172.21.15.44:6829/4009464689","state":["exists","up"]},{"osd":11,"uuid":"a2a046cd-9939-473a-988b-6e0ad28a0233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6825","nonce":4173951310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6827","nonce":4173951310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6831","nonce":4173951310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6829","nonce":4173951310}]},"public_addr":"172.21.15.175:6825/4173951310","cluster_addr":"172.21.15.175:6827/4173951310","heartbeat_back_addr":"172.21.15.175:6831/4173951310","heartbeat_front_addr":"172.21.15.175:6829/4173951310","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:20.015497+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:44.967046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:09.682080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:35.516899+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:00.705686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:25.276387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:49.927456+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:14.786755+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:38.553913+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.962825+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.812976+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:52.837744+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6800/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/2884903597":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/4058698573":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/1429582340":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6800/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/816886708":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/4277640815":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/2695884066":"2024-09-20T08:35:31.711540+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:41:58.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.399+0000 7f8a2743e640 1 -- 172.21.15.7:0/2621356153 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f8a0c0a3240 msgr2=0x7f8a0c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:58.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.399+0000 7f8a2743e640 1 --2- 172.21.15.7:0/2621356153 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f8a0c0a3240 0x7f8a0c0a5700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c005ab0 tx=0x7f8a1c005a20 comp rx=0 tx=0).stop 2024-09-19T08:41:58.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.399+0000 7f8a2743e640 1 -- 172.21.15.7:0/2621356153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a20106f10 msgr2=0x7f8a2019cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:58.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.399+0000 7f8a2743e640 1 --2- 172.21.15.7:0/2621356153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a20106f10 0x7f8a2019cd40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8a1800eaa0 tx=0x7f8a1800ef60 comp rx=0 tx=0).stop 2024-09-19T08:41:58.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.399+0000 7f8a2743e640 1 -- 172.21.15.7:0/2621356153 shutdown_connections 2024-09-19T08:41:58.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.399+0000 7f8a2743e640 1 --2- 172.21.15.7:0/2621356153 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f8a0c0a3240 0x7f8a0c0a5700 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:58.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.399+0000 7f8a2743e640 1 --2- 172.21.15.7:0/2621356153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a20106f10 0x7f8a2019cd40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:58.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.399+0000 7f8a2743e640 1 --2- 172.21.15.7:0/2621356153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a20102790 0x7f8a201989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:58.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.399+0000 7f8a2743e640 1 --2- 172.21.15.7:0/2621356153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a20101de0 0x7f8a20198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:58.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.399+0000 7f8a2743e640 1 -- 172.21.15.7:0/2621356153 >> 172.21.15.7:0/2621356153 conn(0x7f8a200fd8c0 msgr2=0x7f8a200fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:41:58.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.399+0000 7f8a2743e640 1 -- 172.21.15.7:0/2621356153 shutdown_connections 2024-09-19T08:41:58.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:58.399+0000 7f8a2743e640 1 -- 172.21.15.7:0/2621356153 wait complete. 2024-09-19T08:41:58.960 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:58 smithi007 ceph-mon[31221]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:41:58.961 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:41:58 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2621356153' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:41:58.964 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T08:38:13.285118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T08:41:58.965 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T08:41:59.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:58 smithi044 ceph-mon[35072]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:41:59.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:41:58 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/2621356153' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:41:59.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:58 smithi175 ceph-mon[35688]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:41:59.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:41:58 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/2621356153' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:41:59.215 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:41:59.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.773+0000 7f0d20330640 1 -- 172.21.15.7:0/2231894033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d18106f10 msgr2=0x7f0d1810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:59.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.773+0000 7f0d20330640 1 --2- 172.21.15.7:0/2231894033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d18106f10 0x7f0d1810ea90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009ca0 tx=0x7f0d1002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:41:59.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.774+0000 7f0d20330640 1 -- 172.21.15.7:0/2231894033 shutdown_connections 2024-09-19T08:41:59.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.774+0000 7f0d20330640 1 --2- 172.21.15.7:0/2231894033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d18106f10 0x7f0d1810ea90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:59.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.774+0000 7f0d20330640 1 --2- 172.21.15.7:0/2231894033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d18102790 0x7f0d181067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:59.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.774+0000 7f0d20330640 1 --2- 172.21.15.7:0/2231894033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d18101de0 0x7f0d181021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:59.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.774+0000 7f0d20330640 1 -- 172.21.15.7:0/2231894033 >> 172.21.15.7:0/2231894033 conn(0x7f0d180fd8c0 msgr2=0x7f0d180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:41:59.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.774+0000 7f0d20330640 1 -- 172.21.15.7:0/2231894033 shutdown_connections 2024-09-19T08:41:59.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.774+0000 7f0d20330640 1 -- 172.21.15.7:0/2231894033 wait complete. 2024-09-19T08:41:59.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.774+0000 7f0d20330640 1 Processor -- start 2024-09-19T08:41:59.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.774+0000 7f0d20330640 1 -- start start 2024-09-19T08:41:59.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.774+0000 7f0d20330640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d18101de0 0x7f0d180744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:59.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.774+0000 7f0d20330640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d18102790 0x7f0d18074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:59.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.774+0000 7f0d20330640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d18106f10 0x7f0d18074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:59.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.774+0000 7f0d20330640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0d18111f70 con 0x7f0d18106f10 2024-09-19T08:41:59.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.774+0000 7f0d20330640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0d18111df0 con 0x7f0d18102790 2024-09-19T08:41:59.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.774+0000 7f0d20330640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0d181120f0 con 0x7f0d18101de0 2024-09-19T08:41:59.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.775+0000 7f0d1e8cd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d18106f10 0x7f0d18074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:59.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.775+0000 7f0d1e8cd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d18106f10 0x7f0d18074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47078/0 (socket says 172.21.15.7:47078) 2024-09-19T08:41:59.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.775+0000 7f0d1e8cd640 1 -- 172.21.15.7:0/1783361635 learned_addr learned my addr 172.21.15.7:0/1783361635 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:41:59.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.775+0000 7f0d1e0cc640 1 --2- 172.21.15.7:0/1783361635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d18101de0 0x7f0d180744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:59.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.775+0000 7f0d1d8cb640 1 --2- 172.21.15.7:0/1783361635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d18102790 0x7f0d18074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:59.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.775+0000 7f0d1e8cd640 1 -- 172.21.15.7:0/1783361635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d18101de0 msgr2=0x7f0d180744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:59.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.775+0000 7f0d1e8cd640 1 --2- 172.21.15.7:0/1783361635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d18101de0 0x7f0d180744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:59.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.775+0000 7f0d1e8cd640 1 -- 172.21.15.7:0/1783361635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d18102790 msgr2=0x7f0d18074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:59.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.775+0000 7f0d1e8cd640 1 --2- 172.21.15.7:0/1783361635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d18102790 0x7f0d18074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:59.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.775+0000 7f0d1e8cd640 1 -- 172.21.15.7:0/1783361635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d181a67f0 con 0x7f0d18106f10 2024-09-19T08:41:59.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.775+0000 7f0d1d8cb640 1 --2- 172.21.15.7:0/1783361635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d18102790 0x7f0d18074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:41:59.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.775+0000 7f0d1e8cd640 1 --2- 172.21.15.7:0/1783361635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d18106f10 0x7f0d18074f70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0d10031a20 tx=0x7f0d10031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:41:59.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.775+0000 7f0d0f7fe640 1 -- 172.21.15.7:0/1783361635 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d10003c30 con 0x7f0d18106f10 2024-09-19T08:41:59.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.775+0000 7f0d0f7fe640 1 -- 172.21.15.7:0/1783361635 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d10003dd0 con 0x7f0d18106f10 2024-09-19T08:41:59.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.775+0000 7f0d20330640 1 -- 172.21.15.7:0/1783361635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d181a6a80 con 0x7f0d18106f10 2024-09-19T08:41:59.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.775+0000 7f0d0f7fe640 1 -- 172.21.15.7:0/1783361635 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1002fcf0 con 0x7f0d18106f10 2024-09-19T08:41:59.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.776+0000 7f0d20330640 1 -- 172.21.15.7:0/1783361635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d181a6fc0 con 0x7f0d18106f10 2024-09-19T08:41:59.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.776+0000 7f0d20330640 1 -- 172.21.15.7:0/1783361635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d181021c0 con 0x7f0d18106f10 2024-09-19T08:41:59.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.778+0000 7f0d0f7fe640 1 -- 172.21.15.7:0/1783361635 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f0d10004050 con 0x7f0d18106f10 2024-09-19T08:41:59.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.778+0000 7f0d0f7fe640 1 --2- 172.21.15.7:0/1783361635 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0d040a3240 0x7f0d040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:41:59.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.778+0000 7f0d1e0cc640 1 --2- 172.21.15.7:0/1783361635 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0d040a3240 0x7f0d040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:41:59.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.778+0000 7f0d0f7fe640 1 -- 172.21.15.7:0/1783361635 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f0d100f0a20 con 0x7f0d18106f10 2024-09-19T08:41:59.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.779+0000 7f0d1e0cc640 1 --2- 172.21.15.7:0/1783361635 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0d040a3240 0x7f0d040a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0d14005fd0 tx=0x7f0d1400b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:41:59.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.782+0000 7f0d0f7fe640 1 -- 172.21.15.7:0/1783361635 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0d100bdc70 con 0x7f0d18106f10 2024-09-19T08:41:59.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.956+0000 7f0d20330640 1 -- 172.21.15.7:0/1783361635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0d1802d7c0 con 0x7f0d18106f10 2024-09-19T08:41:59.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.956+0000 7f0d0f7fe640 1 -- 172.21.15.7:0/1783361635 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f0d1002fe90 con 0x7f0d18106f10 2024-09-19T08:41:59.957 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-19T08:41:59.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.958+0000 7f0d20330640 1 -- 172.21.15.7:0/1783361635 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0d040a3240 msgr2=0x7f0d040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:59.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.958+0000 7f0d20330640 1 --2- 172.21.15.7:0/1783361635 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0d040a3240 0x7f0d040a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0d14005fd0 tx=0x7f0d1400b590 comp rx=0 tx=0).stop 2024-09-19T08:41:59.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.958+0000 7f0d20330640 1 -- 172.21.15.7:0/1783361635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d18106f10 msgr2=0x7f0d18074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:41:59.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.958+0000 7f0d20330640 1 --2- 172.21.15.7:0/1783361635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d18106f10 0x7f0d18074f70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0d10031a20 tx=0x7f0d10031a50 comp rx=0 tx=0).stop 2024-09-19T08:41:59.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.958+0000 7f0d20330640 1 -- 172.21.15.7:0/1783361635 shutdown_connections 2024-09-19T08:41:59.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.958+0000 7f0d20330640 1 --2- 172.21.15.7:0/1783361635 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0d040a3240 0x7f0d040a5700 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:59.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.958+0000 7f0d20330640 1 --2- 172.21.15.7:0/1783361635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d18106f10 0x7f0d18074f70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:59.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.958+0000 7f0d20330640 1 --2- 172.21.15.7:0/1783361635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d18102790 0x7f0d18074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:59.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.958+0000 7f0d20330640 1 --2- 172.21.15.7:0/1783361635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d18101de0 0x7f0d180744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:41:59.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.958+0000 7f0d20330640 1 -- 172.21.15.7:0/1783361635 >> 172.21.15.7:0/1783361635 conn(0x7f0d180fd8c0 msgr2=0x7f0d180febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:41:59.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.959+0000 7f0d20330640 1 -- 172.21.15.7:0/1783361635 shutdown_connections 2024-09-19T08:41:59.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:41:59.959+0000 7f0d20330640 1 -- 172.21.15.7:0/1783361635 wait complete. 2024-09-19T08:42:00.527 INFO:tasks.cephadm:Adding mds.a on smithi007 2024-09-19T08:42:00.527 INFO:tasks.cephadm:Adding mds.d on smithi007 2024-09-19T08:42:00.527 INFO:tasks.cephadm:Adding mds.g on smithi007 2024-09-19T08:42:00.527 INFO:tasks.cephadm:Adding mds.j on smithi007 2024-09-19T08:42:00.527 INFO:tasks.cephadm:Adding mds.b on smithi044 2024-09-19T08:42:00.527 INFO:tasks.cephadm:Adding mds.e on smithi044 2024-09-19T08:42:00.527 INFO:tasks.cephadm:Adding mds.h on smithi044 2024-09-19T08:42:00.527 INFO:tasks.cephadm:Adding mds.k on smithi044 2024-09-19T08:42:00.527 INFO:tasks.cephadm:Adding mds.c on smithi175 2024-09-19T08:42:00.527 INFO:tasks.cephadm:Adding mds.f on smithi175 2024-09-19T08:42:00.527 INFO:tasks.cephadm:Adding mds.i on smithi175 2024-09-19T08:42:00.527 INFO:tasks.cephadm:Adding mds.l on smithi175 2024-09-19T08:42:00.528 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l' 2024-09-19T08:42:00.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:00 smithi007 ceph-mon[31221]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:00.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:00 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1783361635' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:42:00.784 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:42:00.904 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:00 smithi175 ceph-mon[35688]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:00.905 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:00 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1783361635' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:42:01.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:00 smithi044 ceph-mon[35072]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:01.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:00 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1783361635' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:42:01.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.192+0000 7f5ef2436640 1 -- 172.21.15.175:0/4250214888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5eec101cd0 msgr2=0x7f5eec102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:01.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.192+0000 7f5ef2436640 1 --2- 172.21.15.175:0/4250214888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5eec101cd0 0x7f5eec102150 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009900 tx=0x7f5ee002a410 comp rx=0 tx=0).stop 2024-09-19T08:42:01.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.192+0000 7f5ef2436640 1 -- 172.21.15.175:0/4250214888 shutdown_connections 2024-09-19T08:42:01.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.192+0000 7f5ef2436640 1 --2- 172.21.15.175:0/4250214888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5eec102690 0x7f5eec108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:01.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.192+0000 7f5ef2436640 1 --2- 172.21.15.175:0/4250214888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5eec101cd0 0x7f5eec102150 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:01.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.192+0000 7f5ef2436640 1 --2- 172.21.15.175:0/4250214888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5eec100ad0 0x7f5eec100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:01.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.192+0000 7f5ef2436640 1 -- 172.21.15.175:0/4250214888 >> 172.21.15.175:0/4250214888 conn(0x7f5eec0fc280 msgr2=0x7f5eec0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:01.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.192+0000 7f5ef2436640 1 -- 172.21.15.175:0/4250214888 shutdown_connections 2024-09-19T08:42:01.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.192+0000 7f5ef2436640 1 -- 172.21.15.175:0/4250214888 wait complete. 2024-09-19T08:42:01.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.192+0000 7f5ef2436640 1 Processor -- start 2024-09-19T08:42:01.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.192+0000 7f5ef2436640 1 -- start start 2024-09-19T08:42:01.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.193+0000 7f5ef2436640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5eec100ad0 0x7f5eec10b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:01.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.193+0000 7f5ef2436640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5eec101cd0 0x7f5eec109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:01.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.193+0000 7f5ef2436640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5eec102690 0x7f5eec109fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:01.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.193+0000 7f5ef2436640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5eec10d8e0 con 0x7f5eec101cd0 2024-09-19T08:42:01.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.193+0000 7f5ef2436640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5eec10d760 con 0x7f5eec100ad0 2024-09-19T08:42:01.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.193+0000 7f5ef2436640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5eec10da60 con 0x7f5eec102690 2024-09-19T08:42:01.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.193+0000 7f5ef09d3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5eec102690 0x7f5eec109fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:01.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.193+0000 7f5ef09d3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5eec102690 0x7f5eec109fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:42154/0 (socket says 172.21.15.175:42154) 2024-09-19T08:42:01.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.193+0000 7f5ef09d3640 1 -- 172.21.15.175:0/3293613971 learned_addr learned my addr 172.21.15.175:0/3293613971 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-09-19T08:42:01.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.193+0000 7f5eeb7fe640 1 --2- 172.21.15.175:0/3293613971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5eec101cd0 0x7f5eec109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:01.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.193+0000 7f5eebfff640 1 --2- 172.21.15.175:0/3293613971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5eec100ad0 0x7f5eec10b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:01.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.193+0000 7f5ef09d3640 1 -- 172.21.15.175:0/3293613971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5eec100ad0 msgr2=0x7f5eec10b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:01.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.193+0000 7f5ef09d3640 1 --2- 172.21.15.175:0/3293613971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5eec100ad0 0x7f5eec10b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:01.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.193+0000 7f5ef09d3640 1 -- 172.21.15.175:0/3293613971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5eec101cd0 msgr2=0x7f5eec109aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:01.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.193+0000 7f5ef09d3640 1 --2- 172.21.15.175:0/3293613971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5eec101cd0 0x7f5eec109aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:01.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.193+0000 7f5ef09d3640 1 -- 172.21.15.175:0/3293613971 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eec10a8a0 con 0x7f5eec102690 2024-09-19T08:42:01.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.193+0000 7f5eebfff640 1 --2- 172.21.15.175:0/3293613971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5eec100ad0 0x7f5eec10b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:42:01.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.193+0000 7f5eeb7fe640 1 --2- 172.21.15.175:0/3293613971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5eec101cd0 0x7f5eec109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:42:01.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.193+0000 7f5ef09d3640 1 --2- 172.21.15.175:0/3293613971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5eec102690 0x7f5eec109fe0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400cce0 tx=0x7f5ee400a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:01.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.193+0000 7f5ee97fa640 1 -- 172.21.15.175:0/3293613971 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee400f450 con 0x7f5eec102690 2024-09-19T08:42:01.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.193+0000 7f5ee97fa640 1 -- 172.21.15.175:0/3293613971 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ee400fad0 con 0x7f5eec102690 2024-09-19T08:42:01.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.194+0000 7f5ef2436640 1 -- 172.21.15.175:0/3293613971 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eec1a20c0 con 0x7f5eec102690 2024-09-19T08:42:01.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.194+0000 7f5ee97fa640 1 -- 172.21.15.175:0/3293613971 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4018c10 con 0x7f5eec102690 2024-09-19T08:42:01.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.194+0000 7f5ef2436640 1 -- 172.21.15.175:0/3293613971 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eec1a2600 con 0x7f5eec102690 2024-09-19T08:42:01.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.195+0000 7f5ef2436640 1 -- 172.21.15.175:0/3293613971 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eec107f20 con 0x7f5eec102690 2024-09-19T08:42:01.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.196+0000 7f5ee97fa640 1 -- 172.21.15.175:0/3293613971 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f5ee400f5f0 con 0x7f5eec102690 2024-09-19T08:42:01.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.196+0000 7f5ee97fa640 1 --2- 172.21.15.175:0/3293613971 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f5ed40a3240 0x7f5ed40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:01.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.196+0000 7f5ee97fa640 1 -- 172.21.15.175:0/3293613971 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f5ee40cfbe0 con 0x7f5eec102690 2024-09-19T08:42:01.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.197+0000 7f5eebfff640 1 --2- 172.21.15.175:0/3293613971 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f5ed40a3240 0x7f5ed40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:01.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.197+0000 7f5eebfff640 1 --2- 172.21.15.175:0/3293613971 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f5ed40a3240 0x7f5ed40a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5edc006fd0 tx=0x7f5edc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:01.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.201+0000 7f5ee97fa640 1 -- 172.21.15.175:0/3293613971 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5ee4014030 con 0x7f5eec102690 2024-09-19T08:42:01.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.375+0000 7f5ef2436640 1 -- 172.21.15.175:0/3293613971 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}) -- 0x7f5eec062730 con 0x7f5ed40a3240 2024-09-19T08:42:01.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.383+0000 7f5ee97fa640 1 -- 172.21.15.175:0/3293613971 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f5eec062730 con 0x7f5ed40a3240 2024-09-19T08:42:01.383 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mds.all update... 2024-09-19T08:42:01.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.385+0000 7f5ef2436640 1 -- 172.21.15.175:0/3293613971 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f5ed40a3240 msgr2=0x7f5ed40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:01.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.385+0000 7f5ef2436640 1 --2- 172.21.15.175:0/3293613971 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f5ed40a3240 0x7f5ed40a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5edc006fd0 tx=0x7f5edc008040 comp rx=0 tx=0).stop 2024-09-19T08:42:01.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.385+0000 7f5ef2436640 1 -- 172.21.15.175:0/3293613971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5eec102690 msgr2=0x7f5eec109fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:01.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.385+0000 7f5ef2436640 1 --2- 172.21.15.175:0/3293613971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5eec102690 0x7f5eec109fe0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400cce0 tx=0x7f5ee400a620 comp rx=0 tx=0).stop 2024-09-19T08:42:01.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.385+0000 7f5ef2436640 1 -- 172.21.15.175:0/3293613971 shutdown_connections 2024-09-19T08:42:01.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.385+0000 7f5ef2436640 1 --2- 172.21.15.175:0/3293613971 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f5ed40a3240 0x7f5ed40a5700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:01.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.385+0000 7f5ef2436640 1 --2- 172.21.15.175:0/3293613971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5eec102690 0x7f5eec109fe0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:01.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.385+0000 7f5ef2436640 1 --2- 172.21.15.175:0/3293613971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5eec101cd0 0x7f5eec109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:01.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.385+0000 7f5ef2436640 1 --2- 172.21.15.175:0/3293613971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5eec100ad0 0x7f5eec10b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:01.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.385+0000 7f5ef2436640 1 -- 172.21.15.175:0/3293613971 >> 172.21.15.175:0/3293613971 conn(0x7f5eec0fc280 msgr2=0x7f5eec1050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:01.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.385+0000 7f5ef2436640 1 -- 172.21.15.175:0/3293613971 shutdown_connections 2024-09-19T08:42:01.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-09-19T08:42:01.385+0000 7f5ef2436640 1 -- 172.21.15.175:0/3293613971 wait complete. 2024-09-19T08:42:02.073 DEBUG:teuthology.orchestra.run.smithi007:mds.a> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T08:42:02.075 DEBUG:teuthology.orchestra.run.smithi007:mds.d> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T08:42:02.119 DEBUG:teuthology.orchestra.run.smithi007:mds.g> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T08:42:02.161 DEBUG:teuthology.orchestra.run.smithi007:mds.j> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T08:42:02.204 DEBUG:teuthology.orchestra.run.smithi044:mds.b> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T08:42:02.207 DEBUG:teuthology.orchestra.run.smithi044:mds.e> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T08:42:02.250 DEBUG:teuthology.orchestra.run.smithi044:mds.h> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T08:42:02.292 DEBUG:teuthology.orchestra.run.smithi044:mds.k> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T08:42:02.335 DEBUG:teuthology.orchestra.run.smithi175:mds.c> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T08:42:02.338 DEBUG:teuthology.orchestra.run.smithi175:mds.f> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T08:42:02.380 DEBUG:teuthology.orchestra.run.smithi175:mds.i> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T08:42:02.423 DEBUG:teuthology.orchestra.run.smithi175:mds.l> sudo journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T08:42:02.467 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T08:42:02.467 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:42:02.487 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:02 smithi175 ceph-mon[35688]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:02.487 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:02 smithi175 ceph-mon[35688]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:42:02.487 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:02 smithi175 ceph-mon[35688]: Saving service mds.all spec with placement smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-09-19T08:42:02.487 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:02 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:02.487 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:02 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:42:02.487 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:02 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:02.488 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:02 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:42:02.488 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:02 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:02.488 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:02 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:02.488 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:02 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:02.488 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:02 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:02.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:02 smithi044 ceph-mon[35072]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:02.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:02 smithi044 ceph-mon[35072]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:42:02.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:02 smithi044 ceph-mon[35072]: Saving service mds.all spec with placement smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-09-19T08:42:02.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:02 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:02.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:02 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:42:02.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:02 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:02.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:02 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:42:02.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:02 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:02.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:02 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:02.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:02 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:02.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:02 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:02.718 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:02.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:02 smithi007 ceph-mon[31221]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:02.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:02 smithi007 ceph-mon[31221]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:42:02.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:02 smithi007 ceph-mon[31221]: Saving service mds.all spec with placement smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-09-19T08:42:02.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:02 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:02.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:02 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:42:02.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:02 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:02.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:02 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:42:02.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:02 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:02.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:02 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:02.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:02 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:02.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:02 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:03.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.198+0000 7f9e914e3640 1 -- 172.21.15.7:0/1965738202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e8c10c170 msgr2=0x7f9e8c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:03.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.198+0000 7f9e914e3640 1 --2- 172.21.15.7:0/1965738202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e8c10c170 0x7f9e8c10e610 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9e84009ca0 tx=0x7f9e8402a950 comp rx=0 tx=0).stop 2024-09-19T08:42:03.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.198+0000 7f9e914e3640 1 -- 172.21.15.7:0/1965738202 shutdown_connections 2024-09-19T08:42:03.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.198+0000 7f9e914e3640 1 --2- 172.21.15.7:0/1965738202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e8c10c170 0x7f9e8c10e610 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:03.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.198+0000 7f9e914e3640 1 --2- 172.21.15.7:0/1965738202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e8c103660 0x7f9e8c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:03.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.198+0000 7f9e914e3640 1 --2- 172.21.15.7:0/1965738202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e8c102d40 0x7f9e8c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:03.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.198+0000 7f9e914e3640 1 -- 172.21.15.7:0/1965738202 >> 172.21.15.7:0/1965738202 conn(0x7f9e8c0fc7a0 msgr2=0x7f9e8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:03.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.198+0000 7f9e914e3640 1 -- 172.21.15.7:0/1965738202 shutdown_connections 2024-09-19T08:42:03.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.198+0000 7f9e914e3640 1 -- 172.21.15.7:0/1965738202 wait complete. 2024-09-19T08:42:03.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.199+0000 7f9e914e3640 1 Processor -- start 2024-09-19T08:42:03.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.199+0000 7f9e914e3640 1 -- start start 2024-09-19T08:42:03.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.199+0000 7f9e914e3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e8c102d40 0x7f9e8c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:03.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.199+0000 7f9e914e3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e8c103660 0x7f9e8c198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:03.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.199+0000 7f9e914e3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e8c10c170 0x7f9e8c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:03.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.199+0000 7f9e914e3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8c111f70 con 0x7f9e8c10c170 2024-09-19T08:42:03.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.199+0000 7f9e914e3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8c111df0 con 0x7f9e8c102d40 2024-09-19T08:42:03.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.199+0000 7f9e914e3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8c1120f0 con 0x7f9e8c103660 2024-09-19T08:42:03.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.199+0000 7f9e8b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e8c10c170 0x7f9e8c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:03.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.200+0000 7f9e8b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e8c10c170 0x7f9e8c19ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47102/0 (socket says 172.21.15.7:47102) 2024-09-19T08:42:03.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.200+0000 7f9e8b7fe640 1 -- 172.21.15.7:0/2446446614 learned_addr learned my addr 172.21.15.7:0/2446446614 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:42:03.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.200+0000 7f9e8a7fc640 1 --2- 172.21.15.7:0/2446446614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e8c103660 0x7f9e8c198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:03.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.200+0000 7f9e8affd640 1 --2- 172.21.15.7:0/2446446614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e8c102d40 0x7f9e8c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:03.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.200+0000 7f9e8b7fe640 1 -- 172.21.15.7:0/2446446614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e8c103660 msgr2=0x7f9e8c198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:03.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.200+0000 7f9e8b7fe640 1 --2- 172.21.15.7:0/2446446614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e8c103660 0x7f9e8c198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:03.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.200+0000 7f9e8b7fe640 1 -- 172.21.15.7:0/2446446614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e8c102d40 msgr2=0x7f9e8c1983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:03.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.200+0000 7f9e8b7fe640 1 --2- 172.21.15.7:0/2446446614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e8c102d40 0x7f9e8c1983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:03.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.200+0000 7f9e8b7fe640 1 -- 172.21.15.7:0/2446446614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8c19d3a0 con 0x7f9e8c10c170 2024-09-19T08:42:03.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.200+0000 7f9e8a7fc640 1 --2- 172.21.15.7:0/2446446614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e8c103660 0x7f9e8c198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:42:03.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.200+0000 7f9e8b7fe640 1 --2- 172.21.15.7:0/2446446614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e8c10c170 0x7f9e8c19ccc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9e84004af0 tx=0x7f9e8402f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:03.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.200+0000 7f9e73fff640 1 -- 172.21.15.7:0/2446446614 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84034040 con 0x7f9e8c10c170 2024-09-19T08:42:03.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.200+0000 7f9e914e3640 1 -- 172.21.15.7:0/2446446614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8c19d630 con 0x7f9e8c10c170 2024-09-19T08:42:03.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.200+0000 7f9e73fff640 1 -- 172.21.15.7:0/2446446614 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e84030920 con 0x7f9e8c10c170 2024-09-19T08:42:03.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.200+0000 7f9e73fff640 1 -- 172.21.15.7:0/2446446614 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84004670 con 0x7f9e8c10c170 2024-09-19T08:42:03.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.200+0000 7f9e914e3640 1 -- 172.21.15.7:0/2446446614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e8c1a4f70 con 0x7f9e8c10c170 2024-09-19T08:42:03.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.201+0000 7f9e914e3640 1 -- 172.21.15.7:0/2446446614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e8c103120 con 0x7f9e8c10c170 2024-09-19T08:42:03.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.203+0000 7f9e73fff640 1 -- 172.21.15.7:0/2446446614 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f9e84037020 con 0x7f9e8c10c170 2024-09-19T08:42:03.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.203+0000 7f9e73fff640 1 --2- 172.21.15.7:0/2446446614 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9e740a3240 0x7f9e740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:03.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.203+0000 7f9e8affd640 1 --2- 172.21.15.7:0/2446446614 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9e740a3240 0x7f9e740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:03.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.203+0000 7f9e73fff640 1 -- 172.21.15.7:0/2446446614 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f9e840f0110 con 0x7f9e8c10c170 2024-09-19T08:42:03.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.204+0000 7f9e8affd640 1 --2- 172.21.15.7:0/2446446614 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9e740a3240 0x7f9e740a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009bd0 tx=0x7f9e7c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:03.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.207+0000 7f9e73fff640 1 -- 172.21.15.7:0/2446446614 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9e840bd2d0 con 0x7f9e8c10c170 2024-09-19T08:42:03.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.422+0000 7f9e914e3640 1 -- 172.21.15.7:0/2446446614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e8c1071e0 con 0x7f9e8c10c170 2024-09-19T08:42:03.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.422+0000 7f9e73fff640 1 -- 172.21.15.7:0/2446446614 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f9e840bcbd0 con 0x7f9e8c10c170 2024-09-19T08:42:03.423 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:42:03.423 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":1,"btime":"2024-09-19T08:35:02:287217+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T08:42:03.424 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 1 2024-09-19T08:42:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.425+0000 7f9e914e3640 1 -- 172.21.15.7:0/2446446614 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9e740a3240 msgr2=0x7f9e740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.425+0000 7f9e914e3640 1 --2- 172.21.15.7:0/2446446614 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9e740a3240 0x7f9e740a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009bd0 tx=0x7f9e7c005f90 comp rx=0 tx=0).stop 2024-09-19T08:42:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.425+0000 7f9e914e3640 1 -- 172.21.15.7:0/2446446614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e8c10c170 msgr2=0x7f9e8c19ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.425+0000 7f9e914e3640 1 --2- 172.21.15.7:0/2446446614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e8c10c170 0x7f9e8c19ccc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9e84004af0 tx=0x7f9e8402f3a0 comp rx=0 tx=0).stop 2024-09-19T08:42:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.425+0000 7f9e914e3640 1 -- 172.21.15.7:0/2446446614 shutdown_connections 2024-09-19T08:42:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.425+0000 7f9e914e3640 1 --2- 172.21.15.7:0/2446446614 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9e740a3240 0x7f9e740a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.425+0000 7f9e914e3640 1 --2- 172.21.15.7:0/2446446614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e8c10c170 0x7f9e8c19ccc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.425+0000 7f9e914e3640 1 --2- 172.21.15.7:0/2446446614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e8c103660 0x7f9e8c198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.425+0000 7f9e914e3640 1 --2- 172.21.15.7:0/2446446614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e8c102d40 0x7f9e8c1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.425+0000 7f9e914e3640 1 -- 172.21.15.7:0/2446446614 >> 172.21.15.7:0/2446446614 conn(0x7f9e8c0fc7a0 msgr2=0x7f9e8c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.425+0000 7f9e914e3640 1 -- 172.21.15.7:0/2446446614 shutdown_connections 2024-09-19T08:42:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:03.425+0000 7f9e914e3640 1 -- 172.21.15.7:0/2446446614 wait complete. 2024-09-19T08:42:03.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:03 smithi175 ceph-mon[35688]: Deploying daemon mds.l on smithi175 2024-09-19T08:42:03.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:03 smithi007 ceph-mon[31221]: Deploying daemon mds.l on smithi175 2024-09-19T08:42:03.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:03 smithi044 ceph-mon[35072]: Deploying daemon mds.l on smithi175 2024-09-19T08:42:03.838 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 19 08:42:03 smithi175 systemd[1]: Starting Ceph mds.l for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:42:04.099 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 19 08:42:03 smithi175 podman[65593]: 2024-09-19 08:42:03.741226873 +0000 UTC m=+0.015423810 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:42:04.099 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 19 08:42:03 smithi175 podman[65593]: 2024-09-19 08:42:03.838782082 +0000 UTC m=+0.112979013 container create c9abc295bb7ec78c5c7f9a2d8301e17d3fe9acbaad9a3c88f36a9aa0426fc712 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-l, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:42:04.099 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 19 08:42:04 smithi175 podman[65593]: 2024-09-19 08:42:04.041126728 +0000 UTC m=+0.315323656 container init c9abc295bb7ec78c5c7f9a2d8301e17d3fe9acbaad9a3c88f36a9aa0426fc712 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-l, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T08:42:04.099 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 19 08:42:04 smithi175 podman[65593]: 2024-09-19 08:42:04.043911212 +0000 UTC m=+0.318108142 container start c9abc295bb7ec78c5c7f9a2d8301e17d3fe9acbaad9a3c88f36a9aa0426fc712 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-l, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T08:42:04.099 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 19 08:42:04 smithi175 ceph-mds[65612]: -- 172.21.15.175:0/3753406504 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f4ab5ab860 con 0x55f4ab588800 2024-09-19T08:42:04.099 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 19 08:42:04 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-l[65608]: starting mds.l at 2024-09-19T08:42:04.099 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 19 08:42:04 smithi175 bash[65593]: c9abc295bb7ec78c5c7f9a2d8301e17d3fe9acbaad9a3c88f36a9aa0426fc712 2024-09-19T08:42:04.388 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 19 08:42:04 smithi175 systemd[1]: Started Ceph mds.l for ebd23124-7661-11ef-bceb-c7b262605968. 2024-09-19T08:42:04.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:04 smithi007 ceph-mon[31221]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:04.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:04 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2446446614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:04.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:04 smithi007 ceph-mon[31221]: mds.? [v2:172.21.15.175:6832/344689321,v1:172.21.15.175:6833/344689321] up:boot 2024-09-19T08:42:04.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:04 smithi007 ceph-mon[31221]: fsmap 1 up:standby 2024-09-19T08:42:04.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:42:04.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:04.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:04.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:04.535 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:04.536 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:04.536 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:04 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:04.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:04 smithi175 ceph-mon[35688]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:04.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:04 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/2446446614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:04.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:04 smithi175 ceph-mon[35688]: mds.? [v2:172.21.15.175:6832/344689321,v1:172.21.15.175:6833/344689321] up:boot 2024-09-19T08:42:04.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:04 smithi175 ceph-mon[35688]: fsmap 1 up:standby 2024-09-19T08:42:04.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:42:04.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:04.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:04.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:04.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:04.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:04.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:04 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:04.704 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:04 smithi044 ceph-mon[35072]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:04.704 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:04 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/2446446614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:04.704 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:04 smithi044 ceph-mon[35072]: mds.? [v2:172.21.15.175:6832/344689321,v1:172.21.15.175:6833/344689321] up:boot 2024-09-19T08:42:04.704 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:04 smithi044 ceph-mon[35072]: fsmap 1 up:standby 2024-09-19T08:42:04.704 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:42:04.704 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:04.704 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:04.705 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:04.705 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:04.705 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:04.705 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:04 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:05.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:05 smithi175 ceph-mon[35688]: Deploying daemon mds.k on smithi044 2024-09-19T08:42:05.724 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:05 smithi044 ceph-mon[35072]: Deploying daemon mds.k on smithi044 2024-09-19T08:42:05.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:05 smithi007 ceph-mon[31221]: Deploying daemon mds.k on smithi044 2024-09-19T08:42:06.212 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:42:06.312 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 19 08:42:06 smithi044 podman[63949]: 2024-09-19 08:42:06.215995558 +0000 UTC m=+0.016062332 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:42:06.477 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:06.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:06 smithi007 ceph-mon[31221]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:06.572 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:06 smithi044 ceph-mon[35072]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:06.572 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 19 08:42:06 smithi044 podman[63949]: 2024-09-19 08:42:06.546234961 +0000 UTC m=+0.346301736 container init b90e1c6dae336dd6a4cf892c3d9dcab1030b611982ce1a29c19f95cd6bc997d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:42:06.572 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 19 08:42:06 smithi044 podman[63949]: 2024-09-19 08:42:06.549011561 +0000 UTC m=+0.349078326 container start b90e1c6dae336dd6a4cf892c3d9dcab1030b611982ce1a29c19f95cd6bc997d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-k, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T08:42:06.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:06 smithi175 ceph-mon[35688]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:06.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.892+0000 7f04dcf15640 1 -- 172.21.15.7:0/3905081870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04d8102570 msgr2=0x7f04d81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:06.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.892+0000 7f04dcf15640 1 --2- 172.21.15.7:0/3905081870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04d8102570 0x7f04d81029b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f04c0009900 tx=0x7f04c002a480 comp rx=0 tx=0).stop 2024-09-19T08:42:06.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.892+0000 7f04dcf15640 1 -- 172.21.15.7:0/3905081870 shutdown_connections 2024-09-19T08:42:06.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.892+0000 7f04dcf15640 1 --2- 172.21.15.7:0/3905081870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04d8102ef0 0x7f04d810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:06.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.892+0000 7f04dcf15640 1 --2- 172.21.15.7:0/3905081870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04d8102570 0x7f04d81029b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:06.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.892+0000 7f04dcf15640 1 --2- 172.21.15.7:0/3905081870 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04d8100e20 0x7f04d8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:06.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.892+0000 7f04dcf15640 1 -- 172.21.15.7:0/3905081870 >> 172.21.15.7:0/3905081870 conn(0x7f04d80fc7d0 msgr2=0x7f04d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:06.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.892+0000 7f04dcf15640 1 -- 172.21.15.7:0/3905081870 shutdown_connections 2024-09-19T08:42:06.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.892+0000 7f04dcf15640 1 -- 172.21.15.7:0/3905081870 wait complete. 2024-09-19T08:42:06.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.893+0000 7f04dcf15640 1 Processor -- start 2024-09-19T08:42:06.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.893+0000 7f04dcf15640 1 -- start start 2024-09-19T08:42:06.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.893+0000 7f04dcf15640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04d8100e20 0x7f04d81962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:06.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.893+0000 7f04dcf15640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04d8102570 0x7f04d8196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:06.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.893+0000 7f04dcf15640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04d8102ef0 0x7f04d819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:06.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.893+0000 7f04dcf15640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f04d810fe40 con 0x7f04d8100e20 2024-09-19T08:42:06.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.893+0000 7f04dcf15640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f04d810fcc0 con 0x7f04d8102ef0 2024-09-19T08:42:06.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.893+0000 7f04dcf15640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f04d810ffc0 con 0x7f04d8102570 2024-09-19T08:42:06.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.893+0000 7f04d659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04d8100e20 0x7f04d81962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:06.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.893+0000 7f04d659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04d8100e20 0x7f04d81962c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59660/0 (socket says 172.21.15.7:59660) 2024-09-19T08:42:06.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.893+0000 7f04d659c640 1 -- 172.21.15.7:0/1099659795 learned_addr learned my addr 172.21.15.7:0/1099659795 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:42:06.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.893+0000 7f04d6d9d640 1 --2- 172.21.15.7:0/1099659795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04d8102ef0 0x7f04d819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:06.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.893+0000 7f04d5d9b640 1 --2- 172.21.15.7:0/1099659795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04d8102570 0x7f04d8196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:06.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.894+0000 7f04d659c640 1 -- 172.21.15.7:0/1099659795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04d8102570 msgr2=0x7f04d8196800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:06.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.894+0000 7f04d659c640 1 --2- 172.21.15.7:0/1099659795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04d8102570 0x7f04d8196800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:06.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.894+0000 7f04d659c640 1 -- 172.21.15.7:0/1099659795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04d8102ef0 msgr2=0x7f04d819ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:06.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.894+0000 7f04d659c640 1 --2- 172.21.15.7:0/1099659795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04d8102ef0 0x7f04d819ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:06.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.894+0000 7f04d659c640 1 -- 172.21.15.7:0/1099659795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d819b270 con 0x7f04d8100e20 2024-09-19T08:42:06.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.894+0000 7f04d659c640 1 --2- 172.21.15.7:0/1099659795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04d8100e20 0x7f04d81962c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f04c800c920 tx=0x7f04c800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:06.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.894+0000 7f04cf7fe640 1 -- 172.21.15.7:0/1099659795 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c8007c70 con 0x7f04d8100e20 2024-09-19T08:42:06.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.894+0000 7f04cf7fe640 1 -- 172.21.15.7:0/1099659795 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04c8007e10 con 0x7f04d8100e20 2024-09-19T08:42:06.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.894+0000 7f04dcf15640 1 -- 172.21.15.7:0/1099659795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d819b560 con 0x7f04d8100e20 2024-09-19T08:42:06.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.894+0000 7f04cf7fe640 1 -- 172.21.15.7:0/1099659795 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c8018890 con 0x7f04d8100e20 2024-09-19T08:42:06.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.894+0000 7f04dcf15640 1 -- 172.21.15.7:0/1099659795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d81a2e40 con 0x7f04d8100e20 2024-09-19T08:42:06.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.895+0000 7f04dcf15640 1 -- 172.21.15.7:0/1099659795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04d8101200 con 0x7f04d8100e20 2024-09-19T08:42:06.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.896+0000 7f04cf7fe640 1 -- 172.21.15.7:0/1099659795 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f04c8018a70 con 0x7f04d8100e20 2024-09-19T08:42:06.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.897+0000 7f04cf7fe640 1 --2- 172.21.15.7:0/1099659795 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f04c40a5450 0x7f04c40a7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:06.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.897+0000 7f04d5d9b640 1 --2- 172.21.15.7:0/1099659795 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f04c40a5450 0x7f04c40a7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:06.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.898+0000 7f04cf7fe640 1 -- 172.21.15.7:0/1099659795 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f04c80cf670 con 0x7f04d8100e20 2024-09-19T08:42:06.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.898+0000 7f04d5d9b640 1 --2- 172.21.15.7:0/1099659795 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f04c40a5450 0x7f04c40a7910 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f04c00096c0 tx=0x7f04c0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:06.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:06.902+0000 7f04cf7fe640 1 -- 172.21.15.7:0/1099659795 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f04c8014030 con 0x7f04d8100e20 2024-09-19T08:42:07.053 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 19 08:42:06 smithi044 ceph-mds[63968]: -- 172.21.15.44:0/2833218628 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562845067860 con 0x562845045000 2024-09-19T08:42:07.053 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 19 08:42:06 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-k[63964]: starting mds.k at 2024-09-19T08:42:07.053 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 19 08:42:06 smithi044 bash[63949]: b90e1c6dae336dd6a4cf892c3d9dcab1030b611982ce1a29c19f95cd6bc997d2 2024-09-19T08:42:07.054 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 19 08:42:06 smithi044 systemd[1]: Started Ceph mds.k for ebd23124-7661-11ef-bceb-c7b262605968. 2024-09-19T08:42:07.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:07.124+0000 7f04dcf15640 1 -- 172.21.15.7:0/1099659795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04d8197620 con 0x7f04d8100e20 2024-09-19T08:42:07.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:07.125+0000 7f04cf7fe640 1 -- 172.21.15.7:0/1099659795 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1435 (secure 0 0 0) 0x7f04c800de20 con 0x7f04d8100e20 2024-09-19T08:42:07.126 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:42:07.126 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":2,"btime":"2024-09-19T08:42:04:071702+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T08:42:07.126 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 2 2024-09-19T08:42:07.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:07.127+0000 7f04dcf15640 1 -- 172.21.15.7:0/1099659795 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f04c40a5450 msgr2=0x7f04c40a7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:07.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:07.127+0000 7f04dcf15640 1 --2- 172.21.15.7:0/1099659795 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f04c40a5450 0x7f04c40a7910 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f04c00096c0 tx=0x7f04c0000bc0 comp rx=0 tx=0).stop 2024-09-19T08:42:07.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:07.127+0000 7f04dcf15640 1 -- 172.21.15.7:0/1099659795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04d8100e20 msgr2=0x7f04d81962c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:07.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:07.127+0000 7f04dcf15640 1 --2- 172.21.15.7:0/1099659795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04d8100e20 0x7f04d81962c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f04c800c920 tx=0x7f04c800cde0 comp rx=0 tx=0).stop 2024-09-19T08:42:07.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:07.127+0000 7f04dcf15640 1 -- 172.21.15.7:0/1099659795 shutdown_connections 2024-09-19T08:42:07.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:07.127+0000 7f04dcf15640 1 --2- 172.21.15.7:0/1099659795 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f04c40a5450 0x7f04c40a7910 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:07.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:07.127+0000 7f04dcf15640 1 --2- 172.21.15.7:0/1099659795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04d8102ef0 0x7f04d819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:07.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:07.127+0000 7f04dcf15640 1 --2- 172.21.15.7:0/1099659795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04d8102570 0x7f04d8196800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:07.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:07.127+0000 7f04dcf15640 1 --2- 172.21.15.7:0/1099659795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04d8100e20 0x7f04d81962c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:07.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:07.127+0000 7f04dcf15640 1 -- 172.21.15.7:0/1099659795 >> 172.21.15.7:0/1099659795 conn(0x7f04d80fc7d0 msgr2=0x7f04d81068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:07.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:07.127+0000 7f04dcf15640 1 -- 172.21.15.7:0/1099659795 shutdown_connections 2024-09-19T08:42:07.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:07.127+0000 7f04dcf15640 1 -- 172.21.15.7:0/1099659795 wait complete. 2024-09-19T08:42:07.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:07 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:07.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:07 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:07.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:07 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:07.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:07 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:07.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:07 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:07.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:07 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:07.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:07 smithi007 ceph-mon[31221]: Deploying daemon mds.j on smithi007 2024-09-19T08:42:07.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:07 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1099659795' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:07.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:07 smithi007 ceph-mon[31221]: mds.? [v2:172.21.15.44:6832/1773724086,v1:172.21.15.44:6833/1773724086] up:boot 2024-09-19T08:42:07.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:07 smithi007 ceph-mon[31221]: fsmap 2 up:standby 2024-09-19T08:42:07.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:07 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T08:42:07.978 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:07 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:07.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:07 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:07.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:07 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:07.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:07 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:07.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:07 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:07.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:07 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:07.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:07 smithi044 ceph-mon[35072]: Deploying daemon mds.j on smithi007 2024-09-19T08:42:07.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:07 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1099659795' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:07.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:07 smithi044 ceph-mon[35072]: mds.? [v2:172.21.15.44:6832/1773724086,v1:172.21.15.44:6833/1773724086] up:boot 2024-09-19T08:42:07.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:07 smithi044 ceph-mon[35072]: fsmap 2 up:standby 2024-09-19T08:42:07.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:07 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T08:42:08.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:07 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:08.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:07 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:08.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:07 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:08.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:07 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:08.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:07 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:08.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:07 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:08.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:07 smithi175 ceph-mon[35688]: Deploying daemon mds.j on smithi007 2024-09-19T08:42:08.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:07 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1099659795' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:08.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:07 smithi175 ceph-mon[35688]: mds.? [v2:172.21.15.44:6832/1773724086,v1:172.21.15.44:6833/1773724086] up:boot 2024-09-19T08:42:08.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:07 smithi175 ceph-mon[35688]: fsmap 2 up:standby 2024-09-19T08:42:08.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:07 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T08:42:08.970 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:08 smithi044 ceph-mon[35072]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:09.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:08 smithi007 ceph-mon[31221]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:09.034 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 08:42:08 smithi007 systemd[1]: Starting Ceph mds.j for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:42:09.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:08 smithi175 ceph-mon[35688]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:09.330 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 08:42:09 smithi007 podman[71234]: 2024-09-19 08:42:09.322774827 +0000 UTC m=+0.104929823 container create a98b391b1177ab20c379c98925c9290a37b5f169e1d75580bea98e8424805254 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T08:42:09.330 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 08:42:09 smithi007 podman[71234]: 2024-09-19 08:42:09.234214355 +0000 UTC m=+0.016369361 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:42:09.585 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 08:42:09 smithi007 podman[71234]: 2024-09-19 08:42:09.558581806 +0000 UTC m=+0.340736812 container init a98b391b1177ab20c379c98925c9290a37b5f169e1d75580bea98e8424805254 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-j, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T08:42:09.585 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 08:42:09 smithi007 podman[71234]: 2024-09-19 08:42:09.561404315 +0000 UTC m=+0.343559312 container start a98b391b1177ab20c379c98925c9290a37b5f169e1d75580bea98e8424805254 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-j, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:42:10.033 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 08:42:09 smithi007 ceph-mds[71253]: -- 172.21.15.7:0/2144952650 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56048c2bd860 con 0x56048c29b000 2024-09-19T08:42:10.033 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 08:42:09 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-j[71249]: starting mds.j at 2024-09-19T08:42:10.033 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 08:42:09 smithi007 bash[71234]: a98b391b1177ab20c379c98925c9290a37b5f169e1d75580bea98e8424805254 2024-09-19T08:42:10.033 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 08:42:09 smithi007 systemd[1]: Started Ceph mds.j for ebd23124-7661-11ef-bceb-c7b262605968. 2024-09-19T08:42:10.712 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:10 smithi007 ceph-mon[31221]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:10.712 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:10 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:10.712 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:10 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:10.712 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:10 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:10.712 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:10 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:10.712 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:10 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:10.713 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:10 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:10.713 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:10 smithi007 ceph-mon[31221]: Deploying daemon mds.d on smithi007 2024-09-19T08:42:10.713 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:10 smithi007 ceph-mon[31221]: mds.? [v2:172.21.15.7:6834/1124869309,v1:172.21.15.7:6835/1124869309] up:boot 2024-09-19T08:42:10.713 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:10 smithi007 ceph-mon[31221]: fsmap 3 up:standby 2024-09-19T08:42:10.713 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:10 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T08:42:10.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:10 smithi175 ceph-mon[35688]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:10.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:10 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:10.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:10 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:10.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:10 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:10.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:10 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:10.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:10 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:10.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:10 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:10.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:10 smithi175 ceph-mon[35688]: Deploying daemon mds.d on smithi007 2024-09-19T08:42:10.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:10 smithi175 ceph-mon[35688]: mds.? [v2:172.21.15.7:6834/1124869309,v1:172.21.15.7:6835/1124869309] up:boot 2024-09-19T08:42:10.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:10 smithi175 ceph-mon[35688]: fsmap 3 up:standby 2024-09-19T08:42:10.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:10 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T08:42:11.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:10 smithi044 ceph-mon[35072]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:11.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:10 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:11.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:10 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:11.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:10 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:11.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:10 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:11.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:10 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:11.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:10 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:11.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:10 smithi044 ceph-mon[35072]: Deploying daemon mds.d on smithi007 2024-09-19T08:42:11.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:10 smithi044 ceph-mon[35072]: mds.? [v2:172.21.15.7:6834/1124869309,v1:172.21.15.7:6835/1124869309] up:boot 2024-09-19T08:42:11.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:10 smithi044 ceph-mon[35072]: fsmap 3 up:standby 2024-09-19T08:42:11.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:10 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T08:42:11.108 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:42:11.588 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:11.712 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 08:42:11 smithi007 systemd[1]: Starting Ceph mds.d for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:42:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.086+0000 7f55e8a35640 1 -- 172.21.15.7:0/2109369236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55e4102ef0 msgr2=0x7f55e410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.086+0000 7f55e8a35640 1 --2- 172.21.15.7:0/2109369236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55e4102ef0 0x7f55e410da40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f55dc009900 tx=0x7f55dc02a480 comp rx=0 tx=0).stop 2024-09-19T08:42:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.086+0000 7f55e8a35640 1 -- 172.21.15.7:0/2109369236 shutdown_connections 2024-09-19T08:42:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.086+0000 7f55e8a35640 1 --2- 172.21.15.7:0/2109369236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55e4102ef0 0x7f55e410da40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.086+0000 7f55e8a35640 1 --2- 172.21.15.7:0/2109369236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55e4102570 0x7f55e41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.086+0000 7f55e8a35640 1 --2- 172.21.15.7:0/2109369236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55e4100e20 0x7f55e4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.086+0000 7f55e8a35640 1 -- 172.21.15.7:0/2109369236 >> 172.21.15.7:0/2109369236 conn(0x7f55e40fc7d0 msgr2=0x7f55e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.086+0000 7f55e8a35640 1 -- 172.21.15.7:0/2109369236 shutdown_connections 2024-09-19T08:42:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.086+0000 7f55e8a35640 1 -- 172.21.15.7:0/2109369236 wait complete. 2024-09-19T08:42:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.087+0000 7f55e8a35640 1 Processor -- start 2024-09-19T08:42:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.087+0000 7f55e8a35640 1 -- start start 2024-09-19T08:42:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.087+0000 7f55e8a35640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55e4100e20 0x7f55e4199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.087+0000 7f55e8a35640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55e4102570 0x7f55e4199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.087+0000 7f55e8a35640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55e4102ef0 0x7f55e41a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.087+0000 7f55e8a35640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f55e4110fa0 con 0x7f55e4102570 2024-09-19T08:42:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.087+0000 7f55e8a35640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f55e4110e20 con 0x7f55e4102ef0 2024-09-19T08:42:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.087+0000 7f55e8a35640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f55e4111120 con 0x7f55e4100e20 2024-09-19T08:42:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.087+0000 7f55e1d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55e4102570 0x7f55e4199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.087+0000 7f55e1d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55e4102570 0x7f55e4199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59704/0 (socket says 172.21.15.7:59704) 2024-09-19T08:42:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.087+0000 7f55e1d9b640 1 -- 172.21.15.7:0/3570060895 learned_addr learned my addr 172.21.15.7:0/3570060895 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:42:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.087+0000 7f55e2d9d640 1 --2- 172.21.15.7:0/3570060895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55e4102ef0 0x7f55e41a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.087+0000 7f55e259c640 1 --2- 172.21.15.7:0/3570060895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55e4100e20 0x7f55e4199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.087+0000 7f55e1d9b640 1 -- 172.21.15.7:0/3570060895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55e4100e20 msgr2=0x7f55e4199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.087+0000 7f55e1d9b640 1 --2- 172.21.15.7:0/3570060895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55e4100e20 0x7f55e4199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.087+0000 7f55e1d9b640 1 -- 172.21.15.7:0/3570060895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55e4102ef0 msgr2=0x7f55e41a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.087+0000 7f55e1d9b640 1 --2- 172.21.15.7:0/3570060895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55e4102ef0 0x7f55e41a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.087+0000 7f55e1d9b640 1 -- 172.21.15.7:0/3570060895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e41a4910 con 0x7f55e4102570 2024-09-19T08:42:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.087+0000 7f55e259c640 1 --2- 172.21.15.7:0/3570060895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55e4100e20 0x7f55e4199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:42:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.087+0000 7f55e1d9b640 1 --2- 172.21.15.7:0/3570060895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55e4102570 0x7f55e4199890 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f55d800d950 tx=0x7f55d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.088+0000 7f55d37fe640 1 -- 172.21.15.7:0/3570060895 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d8017070 con 0x7f55e4102570 2024-09-19T08:42:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.088+0000 7f55d37fe640 1 -- 172.21.15.7:0/3570060895 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55d8009c30 con 0x7f55e4102570 2024-09-19T08:42:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.088+0000 7f55e8a35640 1 -- 172.21.15.7:0/3570060895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e41a4ae0 con 0x7f55e4102570 2024-09-19T08:42:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.088+0000 7f55d37fe640 1 -- 172.21.15.7:0/3570060895 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d800f6b0 con 0x7f55e4102570 2024-09-19T08:42:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.088+0000 7f55e8a35640 1 -- 172.21.15.7:0/3570060895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e41a5020 con 0x7f55e4102570 2024-09-19T08:42:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.089+0000 7f55e8a35640 1 -- 172.21.15.7:0/3570060895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e4101200 con 0x7f55e4102570 2024-09-19T08:42:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.090+0000 7f55d37fe640 1 -- 172.21.15.7:0/3570060895 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f55d80109d0 con 0x7f55e4102570 2024-09-19T08:42:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.090+0000 7f55d37fe640 1 --2- 172.21.15.7:0/3570060895 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f55cc0a32c0 0x7f55cc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.091+0000 7f55e259c640 1 --2- 172.21.15.7:0/3570060895 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f55cc0a32c0 0x7f55cc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.091+0000 7f55d37fe640 1 -- 172.21.15.7:0/3570060895 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f55d80cf000 con 0x7f55e4102570 2024-09-19T08:42:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.091+0000 7f55e259c640 1 --2- 172.21.15.7:0/3570060895 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f55cc0a32c0 0x7f55cc0a5780 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009fa0 tx=0x7f55d4009570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.095+0000 7f55d37fe640 1 -- 172.21.15.7:0/3570060895 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f55d8009de0 con 0x7f55e4102570 2024-09-19T08:42:12.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.314+0000 7f55e8a35640 1 -- 172.21.15.7:0/3570060895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55e41a51f0 con 0x7f55e4102570 2024-09-19T08:42:12.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.314+0000 7f55d37fe640 1 -- 172.21.15.7:0/3570060895 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3082 (secure 0 0 0) 0x7f55d809c1c0 con 0x7f55e4102570 2024-09-19T08:42:12.314 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:42:12.315 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":4,"btime":"2024-09-19T08:42:09:720234+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T08:42:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 4 2024-09-19T08:42:12.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.316+0000 7f55e8a35640 1 -- 172.21.15.7:0/3570060895 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f55cc0a32c0 msgr2=0x7f55cc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:12.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.316+0000 7f55e8a35640 1 --2- 172.21.15.7:0/3570060895 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f55cc0a32c0 0x7f55cc0a5780 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009fa0 tx=0x7f55d4009570 comp rx=0 tx=0).stop 2024-09-19T08:42:12.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.316+0000 7f55e8a35640 1 -- 172.21.15.7:0/3570060895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55e4102570 msgr2=0x7f55e4199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:12.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.316+0000 7f55e8a35640 1 --2- 172.21.15.7:0/3570060895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55e4102570 0x7f55e4199890 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f55d800d950 tx=0x7f55d800de10 comp rx=0 tx=0).stop 2024-09-19T08:42:12.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.316+0000 7f55e8a35640 1 -- 172.21.15.7:0/3570060895 shutdown_connections 2024-09-19T08:42:12.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.316+0000 7f55e8a35640 1 --2- 172.21.15.7:0/3570060895 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f55cc0a32c0 0x7f55cc0a5780 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:12.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.316+0000 7f55e8a35640 1 --2- 172.21.15.7:0/3570060895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55e4102ef0 0x7f55e41a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:12.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.316+0000 7f55e8a35640 1 --2- 172.21.15.7:0/3570060895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55e4102570 0x7f55e4199890 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:12.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.316+0000 7f55e8a35640 1 --2- 172.21.15.7:0/3570060895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55e4100e20 0x7f55e4199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:12.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.316+0000 7f55e8a35640 1 -- 172.21.15.7:0/3570060895 >> 172.21.15.7:0/3570060895 conn(0x7f55e40fc7d0 msgr2=0x7f55e4106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:12.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.317+0000 7f55e8a35640 1 -- 172.21.15.7:0/3570060895 shutdown_connections 2024-09-19T08:42:12.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:12.317+0000 7f55e8a35640 1 -- 172.21.15.7:0/3570060895 wait complete. 2024-09-19T08:42:12.677 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 08:42:12 smithi007 podman[71634]: 2024-09-19 08:42:12.209491613 +0000 UTC m=+0.016655748 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:42:12.677 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 08:42:12 smithi007 podman[71634]: 2024-09-19 08:42:12.321587305 +0000 UTC m=+0.128751431 container create 38b4260d1883a6f62b460b157dc6f0cfb612ca7757daaa478ed10d107551f27a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-d, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:42:12.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:12 smithi175 ceph-mon[35688]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:12.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:12 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3570060895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:13.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:12 smithi007 ceph-mon[31221]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:13.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:12 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3570060895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:13.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:12 smithi044 ceph-mon[35072]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:13.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:12 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3570060895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:13.533 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 08:42:13 smithi007 podman[71634]: 2024-09-19 08:42:13.377435226 +0000 UTC m=+1.184599357 container init 38b4260d1883a6f62b460b157dc6f0cfb612ca7757daaa478ed10d107551f27a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-d, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T08:42:13.534 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 08:42:13 smithi007 podman[71634]: 2024-09-19 08:42:13.381262834 +0000 UTC m=+1.188426955 container start 38b4260d1883a6f62b460b157dc6f0cfb612ca7757daaa478ed10d107551f27a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-d, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T08:42:13.534 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 08:42:13 smithi007 ceph-mds[71670]: -- 172.21.15.7:0/207244858 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5617dc759860 con 0x5617dc737400 2024-09-19T08:42:13.534 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 08:42:13 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-d[71662]: starting mds.d at 2024-09-19T08:42:13.534 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 08:42:13 smithi007 bash[71634]: 38b4260d1883a6f62b460b157dc6f0cfb612ca7757daaa478ed10d107551f27a 2024-09-19T08:42:13.534 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 08:42:13 smithi007 systemd[1]: Started Ceph mds.d for ebd23124-7661-11ef-bceb-c7b262605968. 2024-09-19T08:42:14.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:14 smithi007 ceph-mon[31221]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:14.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:14 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:14.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:14 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:14.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:14 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:14.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:14 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:14.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:14 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:14.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:14 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:14.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:14 smithi007 ceph-mon[31221]: Deploying daemon mds.e on smithi044 2024-09-19T08:42:14.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:14 smithi007 ceph-mon[31221]: mds.? [v2:172.21.15.7:6836/1936828409,v1:172.21.15.7:6837/1936828409] up:boot 2024-09-19T08:42:14.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:14 smithi007 ceph-mon[31221]: fsmap 4 up:standby 2024-09-19T08:42:14.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:14 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T08:42:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:14 smithi044 ceph-mon[35072]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:14 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:14 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:14 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:14 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:14 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:14 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:14 smithi044 ceph-mon[35072]: Deploying daemon mds.e on smithi044 2024-09-19T08:42:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:14 smithi044 ceph-mon[35072]: mds.? [v2:172.21.15.7:6836/1936828409,v1:172.21.15.7:6837/1936828409] up:boot 2024-09-19T08:42:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:14 smithi044 ceph-mon[35072]: fsmap 4 up:standby 2024-09-19T08:42:14.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:14 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T08:42:14.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:14 smithi175 ceph-mon[35688]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:14.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:14 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:14.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:14 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:14.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:14 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:14.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:14 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:14.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:14 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:14.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:14 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:14.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:14 smithi175 ceph-mon[35688]: Deploying daemon mds.e on smithi044 2024-09-19T08:42:14.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:14 smithi175 ceph-mon[35688]: mds.? [v2:172.21.15.7:6836/1936828409,v1:172.21.15.7:6837/1936828409] up:boot 2024-09-19T08:42:14.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:14 smithi175 ceph-mon[35688]: fsmap 4 up:standby 2024-09-19T08:42:14.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:14 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T08:42:15.287 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:42:15.551 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 19 08:42:15 smithi044 systemd[1]: Starting Ceph mds.e for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:42:15.557 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:15.850 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 19 08:42:15 smithi044 podman[64264]: 2024-09-19 08:42:15.483480378 +0000 UTC m=+0.015933738 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:42:15.850 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 19 08:42:15 smithi044 podman[64264]: 2024-09-19 08:42:15.605724662 +0000 UTC m=+0.138178010 container create afff7b1a98923ce756b8593edeb0b1e19cdedd8a8b153c3de6f635597095adf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T08:42:15.851 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 19 08:42:15 smithi044 podman[64264]: 2024-09-19 08:42:15.824619521 +0000 UTC m=+0.357072872 container init afff7b1a98923ce756b8593edeb0b1e19cdedd8a8b153c3de6f635597095adf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:42:15.851 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 19 08:42:15 smithi044 podman[64264]: 2024-09-19 08:42:15.827430295 +0000 UTC m=+0.359883644 container start afff7b1a98923ce756b8593edeb0b1e19cdedd8a8b153c3de6f635597095adf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-e, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:42:15.851 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 19 08:42:15 smithi044 ceph-mds[64284]: -- 172.21.15.44:0/1922332998 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fcf1ceb860 con 0x55fcf1cc9400 2024-09-19T08:42:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.023+0000 7f80bab75640 1 -- 172.21.15.7:0/947330804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80b4100ca0 msgr2=0x7f80b4106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.023+0000 7f80bab75640 1 --2- 172.21.15.7:0/947330804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80b4100ca0 0x7f80b4106840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009930 tx=0x7f80a802a420 comp rx=0 tx=0).stop 2024-09-19T08:42:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.023+0000 7f80bab75640 1 -- 172.21.15.7:0/947330804 shutdown_connections 2024-09-19T08:42:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.023+0000 7f80bab75640 1 --2- 172.21.15.7:0/947330804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80b4106f50 0x7f80b410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:16.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.023+0000 7f80bab75640 1 --2- 172.21.15.7:0/947330804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80b4100ca0 0x7f80b4106840 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:16.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.023+0000 7f80bab75640 1 --2- 172.21.15.7:0/947330804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80b41002f0 0x7f80b41006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:16.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.023+0000 7f80bab75640 1 -- 172.21.15.7:0/947330804 >> 172.21.15.7:0/947330804 conn(0x7f80b4077210 msgr2=0x7f80b40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:16.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.023+0000 7f80bab75640 1 -- 172.21.15.7:0/947330804 shutdown_connections 2024-09-19T08:42:16.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.024+0000 7f80bab75640 1 -- 172.21.15.7:0/947330804 wait complete. 2024-09-19T08:42:16.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.024+0000 7f80bab75640 1 Processor -- start 2024-09-19T08:42:16.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.024+0000 7f80bab75640 1 -- start start 2024-09-19T08:42:16.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.025+0000 7f80bab75640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80b41002f0 0x7f80b4198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:16.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.025+0000 7f80bab75640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80b4100ca0 0x7f80b4198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:16.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.025+0000 7f80bab75640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80b4106f50 0x7f80b419ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:16.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.025+0000 7f80bab75640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f80b4111f60 con 0x7f80b4106f50 2024-09-19T08:42:16.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.025+0000 7f80bab75640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f80b4111de0 con 0x7f80b41002f0 2024-09-19T08:42:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.025+0000 7f80bab75640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f80b41120e0 con 0x7f80b4100ca0 2024-09-19T08:42:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.025+0000 7f80b8911640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80b41002f0 0x7f80b4198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.025+0000 7f80b9112640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80b4106f50 0x7f80b419ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.025+0000 7f80b8911640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80b41002f0 0x7f80b4198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:39372/0 (socket says 172.21.15.7:39372) 2024-09-19T08:42:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.025+0000 7f80b9112640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80b4106f50 0x7f80b419ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57520/0 (socket says 172.21.15.7:57520) 2024-09-19T08:42:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.025+0000 7f80b8911640 1 -- 172.21.15.7:0/150412612 learned_addr learned my addr 172.21.15.7:0/150412612 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:42:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.025+0000 7f80b3fff640 1 --2- 172.21.15.7:0/150412612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80b4100ca0 0x7f80b4198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.025+0000 7f80b9112640 1 -- 172.21.15.7:0/150412612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80b4100ca0 msgr2=0x7f80b4198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.025+0000 7f80b9112640 1 --2- 172.21.15.7:0/150412612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80b4100ca0 0x7f80b4198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.025+0000 7f80b9112640 1 -- 172.21.15.7:0/150412612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80b41002f0 msgr2=0x7f80b4198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.025+0000 7f80b9112640 1 --2- 172.21.15.7:0/150412612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80b41002f0 0x7f80b4198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.025+0000 7f80b9112640 1 -- 172.21.15.7:0/150412612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b419d510 con 0x7f80b4106f50 2024-09-19T08:42:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.025+0000 7f80b9112640 1 --2- 172.21.15.7:0/150412612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80b4106f50 0x7f80b419ce30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00ca30 tx=0x7f80ac00cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.026+0000 7f80b1ffb640 1 -- 172.21.15.7:0/150412612 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac007d90 con 0x7f80b4106f50 2024-09-19T08:42:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.026+0000 7f80b1ffb640 1 -- 172.21.15.7:0/150412612 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80ac005020 con 0x7f80b4106f50 2024-09-19T08:42:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.026+0000 7f80bab75640 1 -- 172.21.15.7:0/150412612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b419d800 con 0x7f80b4106f50 2024-09-19T08:42:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.026+0000 7f80b1ffb640 1 -- 172.21.15.7:0/150412612 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac00f780 con 0x7f80b4106f50 2024-09-19T08:42:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.026+0000 7f80bab75640 1 -- 172.21.15.7:0/150412612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b41a50e0 con 0x7f80b4106f50 2024-09-19T08:42:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.027+0000 7f80bab75640 1 -- 172.21.15.7:0/150412612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80b41006d0 con 0x7f80b4106f50 2024-09-19T08:42:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.028+0000 7f80b1ffb640 1 -- 172.21.15.7:0/150412612 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f80ac0051d0 con 0x7f80b4106f50 2024-09-19T08:42:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.029+0000 7f80b1ffb640 1 --2- 172.21.15.7:0/150412612 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f809c0a32c0 0x7f809c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.029+0000 7f80b8911640 1 --2- 172.21.15.7:0/150412612 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f809c0a32c0 0x7f809c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.029+0000 7f80b1ffb640 1 -- 172.21.15.7:0/150412612 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f80ac0cf5b0 con 0x7f80b4106f50 2024-09-19T08:42:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.029+0000 7f80b8911640 1 --2- 172.21.15.7:0/150412612 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f809c0a32c0 0x7f809c0a5780 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f80a4005fd0 tx=0x7f80a400b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.033+0000 7f80b1ffb640 1 -- 172.21.15.7:0/150412612 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f80ac014070 con 0x7f80b4106f50 2024-09-19T08:42:16.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.247+0000 7f80bab75640 1 -- 172.21.15.7:0/150412612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80b410a120 con 0x7f80b4106f50 2024-09-19T08:42:16.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.248+0000 7f80b1ffb640 1 -- 172.21.15.7:0/150412612 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3904 (secure 0 0 0) 0x7f80ac09c080 con 0x7f80b4106f50 2024-09-19T08:42:16.247 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:42:16.248 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"btime":"2024-09-19T08:42:13:677941+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T08:42:16.248 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 5 2024-09-19T08:42:16.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.250+0000 7f80bab75640 1 -- 172.21.15.7:0/150412612 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f809c0a32c0 msgr2=0x7f809c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:16.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.250+0000 7f80bab75640 1 --2- 172.21.15.7:0/150412612 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f809c0a32c0 0x7f809c0a5780 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f80a4005fd0 tx=0x7f80a400b4a0 comp rx=0 tx=0).stop 2024-09-19T08:42:16.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.250+0000 7f80bab75640 1 -- 172.21.15.7:0/150412612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80b4106f50 msgr2=0x7f80b419ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:16.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.250+0000 7f80bab75640 1 --2- 172.21.15.7:0/150412612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80b4106f50 0x7f80b419ce30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00ca30 tx=0x7f80ac00cef0 comp rx=0 tx=0).stop 2024-09-19T08:42:16.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.250+0000 7f80bab75640 1 -- 172.21.15.7:0/150412612 shutdown_connections 2024-09-19T08:42:16.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.250+0000 7f80bab75640 1 --2- 172.21.15.7:0/150412612 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f809c0a32c0 0x7f809c0a5780 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:16.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.250+0000 7f80bab75640 1 --2- 172.21.15.7:0/150412612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80b4106f50 0x7f80b419ce30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:16.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.250+0000 7f80bab75640 1 --2- 172.21.15.7:0/150412612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80b4100ca0 0x7f80b4198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:16.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.250+0000 7f80bab75640 1 --2- 172.21.15.7:0/150412612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80b41002f0 0x7f80b4198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:16.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.250+0000 7f80bab75640 1 -- 172.21.15.7:0/150412612 >> 172.21.15.7:0/150412612 conn(0x7f80b4077210 msgr2=0x7f80b41052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:16.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.250+0000 7f80bab75640 1 -- 172.21.15.7:0/150412612 shutdown_connections 2024-09-19T08:42:16.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:16.250+0000 7f80bab75640 1 -- 172.21.15.7:0/150412612 wait complete. 2024-09-19T08:42:16.301 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 19 08:42:15 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-e[64280]: starting mds.e at 2024-09-19T08:42:16.301 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 19 08:42:15 smithi044 bash[64264]: afff7b1a98923ce756b8593edeb0b1e19cdedd8a8b153c3de6f635597095adf9 2024-09-19T08:42:16.301 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 19 08:42:15 smithi044 systemd[1]: Started Ceph mds.e for ebd23124-7661-11ef-bceb-c7b262605968. 2024-09-19T08:42:16.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:16 smithi175 ceph-mon[35688]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:16.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:16 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:16.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:16 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:16.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:16 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:16.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:16 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:16.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:16 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:16.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:16 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:16.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:16 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/150412612' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:16.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:16 smithi007 ceph-mon[31221]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:16.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:16 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:16.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:16 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:16.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:16 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:16.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:16 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:16.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:16 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:16.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:16 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:16.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:16 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/150412612' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:16.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:16 smithi044 ceph-mon[35072]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:16 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:16 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:16 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:16 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:16 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:16 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:16 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/150412612' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:17.619 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:17 smithi175 ceph-mon[35688]: Deploying daemon mds.f on smithi175 2024-09-19T08:42:17.619 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:17 smithi175 ceph-mon[35688]: mds.? [v2:172.21.15.44:6834/2261554115,v1:172.21.15.44:6835/2261554115] up:boot 2024-09-19T08:42:17.619 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:17 smithi175 ceph-mon[35688]: fsmap 5 up:standby 2024-09-19T08:42:17.619 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:17 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:42:17.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:17 smithi007 ceph-mon[31221]: Deploying daemon mds.f on smithi175 2024-09-19T08:42:17.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:17 smithi007 ceph-mon[31221]: mds.? [v2:172.21.15.44:6834/2261554115,v1:172.21.15.44:6835/2261554115] up:boot 2024-09-19T08:42:17.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:17 smithi007 ceph-mon[31221]: fsmap 5 up:standby 2024-09-19T08:42:17.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:17 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:42:17.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:17 smithi044 ceph-mon[35072]: Deploying daemon mds.f on smithi175 2024-09-19T08:42:17.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:17 smithi044 ceph-mon[35072]: mds.? [v2:172.21.15.44:6834/2261554115,v1:172.21.15.44:6835/2261554115] up:boot 2024-09-19T08:42:17.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:17 smithi044 ceph-mon[35072]: fsmap 5 up:standby 2024-09-19T08:42:17.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:17 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:42:17.928 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 19 08:42:17 smithi175 systemd[1]: Starting Ceph mds.f for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:42:18.333 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 19 08:42:18 smithi175 podman[65891]: 2024-09-19 08:42:17.925659725 +0000 UTC m=+0.015712518 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:42:18.333 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 19 08:42:18 smithi175 podman[65891]: 2024-09-19 08:42:18.039765867 +0000 UTC m=+0.129818655 container create 8fec6e9e61e055600ae82b2960260498e1c92d3391169f2f2e28dbdc5fc9cbec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-f, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T08:42:18.333 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 19 08:42:18 smithi175 podman[65891]: 2024-09-19 08:42:18.242336499 +0000 UTC m=+0.332389278 container init 8fec6e9e61e055600ae82b2960260498e1c92d3391169f2f2e28dbdc5fc9cbec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T08:42:18.333 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 19 08:42:18 smithi175 podman[65891]: 2024-09-19 08:42:18.24556766 +0000 UTC m=+0.335620446 container start 8fec6e9e61e055600ae82b2960260498e1c92d3391169f2f2e28dbdc5fc9cbec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-19T08:42:18.333 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 19 08:42:18 smithi175 ceph-mds[65910]: -- 172.21.15.175:0/3922396415 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5566f6743860 con 0x5566f6720800 2024-09-19T08:42:18.333 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 19 08:42:18 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-f[65906]: starting mds.f at 2024-09-19T08:42:18.333 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 19 08:42:18 smithi175 bash[65891]: 8fec6e9e61e055600ae82b2960260498e1c92d3391169f2f2e28dbdc5fc9cbec 2024-09-19T08:42:18.678 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 19 08:42:18 smithi175 systemd[1]: Started Ceph mds.f for ebd23124-7661-11ef-bceb-c7b262605968. 2024-09-19T08:42:18.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:18 smithi175 ceph-mon[35688]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:18.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:18 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:18.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:18 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:18.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:18 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:18.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:18 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:18.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:18 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:18.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:18 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:18.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:18 smithi044 ceph-mon[35072]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:18.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:18 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:18.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:18 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:18.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:18 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:18.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:18 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:18.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:18 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:18.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:18 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:18.973 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:18 smithi007 ceph-mon[31221]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:18.973 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:18.973 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:18.973 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:18.973 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:18.973 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:18.973 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:18 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:19.095 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:42:19.357 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:19.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:19 smithi007 ceph-mon[31221]: Deploying daemon mds.c on smithi175 2024-09-19T08:42:19.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:19 smithi007 ceph-mon[31221]: mds.? [v2:172.21.15.175:6834/1285566250,v1:172.21.15.175:6835/1285566250] up:boot 2024-09-19T08:42:19.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:19 smithi007 ceph-mon[31221]: fsmap 6 up:standby 2024-09-19T08:42:19.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:19 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:42:19.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:19 smithi044 ceph-mon[35072]: Deploying daemon mds.c on smithi175 2024-09-19T08:42:19.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:19 smithi044 ceph-mon[35072]: mds.? [v2:172.21.15.175:6834/1285566250,v1:172.21.15.175:6835/1285566250] up:boot 2024-09-19T08:42:19.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:19 smithi044 ceph-mon[35072]: fsmap 6 up:standby 2024-09-19T08:42:19.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:19 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:42:19.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.845+0000 7f77ef46e640 1 -- 172.21.15.7:0/155538071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77e8102570 msgr2=0x7f77e81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:19.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.845+0000 7f77ef46e640 1 --2- 172.21.15.7:0/155538071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77e8102570 0x7f77e81029b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f77d8009900 tx=0x7f77d802a480 comp rx=0 tx=0).stop 2024-09-19T08:42:19.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.845+0000 7f77ef46e640 1 -- 172.21.15.7:0/155538071 shutdown_connections 2024-09-19T08:42:19.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.845+0000 7f77ef46e640 1 --2- 172.21.15.7:0/155538071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77e8102ef0 0x7f77e810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:19.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.845+0000 7f77ef46e640 1 --2- 172.21.15.7:0/155538071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77e8102570 0x7f77e81029b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:19.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.845+0000 7f77ef46e640 1 --2- 172.21.15.7:0/155538071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77e8100e20 0x7f77e8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:19.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.845+0000 7f77ef46e640 1 -- 172.21.15.7:0/155538071 >> 172.21.15.7:0/155538071 conn(0x7f77e80fc7d0 msgr2=0x7f77e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:19.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.845+0000 7f77ef46e640 1 -- 172.21.15.7:0/155538071 shutdown_connections 2024-09-19T08:42:19.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.845+0000 7f77ef46e640 1 -- 172.21.15.7:0/155538071 wait complete. 2024-09-19T08:42:19.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.845+0000 7f77ef46e640 1 Processor -- start 2024-09-19T08:42:19.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.846+0000 7f77ef46e640 1 -- start start 2024-09-19T08:42:19.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.846+0000 7f77ef46e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77e8100e20 0x7f77e8199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.846+0000 7f77ef46e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77e8102570 0x7f77e81997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.846+0000 7f77ef46e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77e8102ef0 0x7f77e81a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.846+0000 7f77ef46e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f77e8110f80 con 0x7f77e8102570 2024-09-19T08:42:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.846+0000 7f77ef46e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f77e8110e00 con 0x7f77e8102ef0 2024-09-19T08:42:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.846+0000 7f77ef46e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f77e8111100 con 0x7f77e8100e20 2024-09-19T08:42:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.846+0000 7f77eca09640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77e8102570 0x7f77e81997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.846+0000 7f77eca09640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77e8102570 0x7f77e81997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57534/0 (socket says 172.21.15.7:57534) 2024-09-19T08:42:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.846+0000 7f77eca09640 1 -- 172.21.15.7:0/3116215791 learned_addr learned my addr 172.21.15.7:0/3116215791 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:42:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.846+0000 7f77ed20a640 1 --2- 172.21.15.7:0/3116215791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77e8100e20 0x7f77e8199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.846+0000 7f77eda0b640 1 --2- 172.21.15.7:0/3116215791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77e8102ef0 0x7f77e81a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.846+0000 7f77eca09640 1 -- 172.21.15.7:0/3116215791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77e8100e20 msgr2=0x7f77e8199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.846+0000 7f77eca09640 1 --2- 172.21.15.7:0/3116215791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77e8100e20 0x7f77e8199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.846+0000 7f77eca09640 1 -- 172.21.15.7:0/3116215791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77e8102ef0 msgr2=0x7f77e81a4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.846+0000 7f77eca09640 1 --2- 172.21.15.7:0/3116215791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77e8102ef0 0x7f77e81a4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.846+0000 7f77eca09640 1 -- 172.21.15.7:0/3116215791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e81a4850 con 0x7f77e8102570 2024-09-19T08:42:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.846+0000 7f77eda0b640 1 --2- 172.21.15.7:0/3116215791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77e8102ef0 0x7f77e81a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:42:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.846+0000 7f77eca09640 1 --2- 172.21.15.7:0/3116215791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77e8102570 0x7f77e81997d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f77d8006010 tx=0x7f77d8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.847+0000 7f77de7fc640 1 -- 172.21.15.7:0/3116215791 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d803f070 con 0x7f77e8102570 2024-09-19T08:42:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.847+0000 7f77de7fc640 1 -- 172.21.15.7:0/3116215791 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77d8031c30 con 0x7f77e8102570 2024-09-19T08:42:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.847+0000 7f77ef46e640 1 -- 172.21.15.7:0/3116215791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e81a4a20 con 0x7f77e8102570 2024-09-19T08:42:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.847+0000 7f77de7fc640 1 -- 172.21.15.7:0/3116215791 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d8035030 con 0x7f77e8102570 2024-09-19T08:42:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.847+0000 7f77ef46e640 1 -- 172.21.15.7:0/3116215791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e81a4ed0 con 0x7f77e8102570 2024-09-19T08:42:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.848+0000 7f77ef46e640 1 -- 172.21.15.7:0/3116215791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77e8101200 con 0x7f77e8102570 2024-09-19T08:42:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.849+0000 7f77de7fc640 1 -- 172.21.15.7:0/3116215791 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f77d8042070 con 0x7f77e8102570 2024-09-19T08:42:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.849+0000 7f77de7fc640 1 --2- 172.21.15.7:0/3116215791 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f77d40a32c0 0x7f77d40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:19.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.850+0000 7f77ed20a640 1 --2- 172.21.15.7:0/3116215791 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f77d40a32c0 0x7f77d40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:19.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.850+0000 7f77de7fc640 1 -- 172.21.15.7:0/3116215791 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f77d80efc50 con 0x7f77e8102570 2024-09-19T08:42:19.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.850+0000 7f77ed20a640 1 --2- 172.21.15.7:0/3116215791 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f77d40a32c0 0x7f77d40a5780 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f77e4005d00 tx=0x7f77e400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:19.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:19.854+0000 7f77de7fc640 1 -- 172.21.15.7:0/3116215791 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f77d80f5020 con 0x7f77e8102570 2024-09-19T08:42:19.927 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:19 smithi175 ceph-mon[35688]: Deploying daemon mds.c on smithi175 2024-09-19T08:42:19.927 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:19 smithi175 ceph-mon[35688]: mds.? [v2:172.21.15.175:6834/1285566250,v1:172.21.15.175:6835/1285566250] up:boot 2024-09-19T08:42:19.927 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:19 smithi175 ceph-mon[35688]: fsmap 6 up:standby 2024-09-19T08:42:19.927 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:19 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:42:20.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:20.069+0000 7f77ef46e640 1 -- 172.21.15.7:0/3116215791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77e8109090 con 0x7f77e8102570 2024-09-19T08:42:20.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:20.070+0000 7f77de7fc640 1 -- 172.21.15.7:0/3116215791 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5557 (secure 0 0 0) 0x7f77d8031de0 con 0x7f77e8102570 2024-09-19T08:42:20.070 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:42:20.070 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":7,"btime":"2024-09-19T08:42:18:530620+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-19T08:42:20.070 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 7 2024-09-19T08:42:20.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:20.072+0000 7f77ef46e640 1 -- 172.21.15.7:0/3116215791 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f77d40a32c0 msgr2=0x7f77d40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:20.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:20.072+0000 7f77ef46e640 1 --2- 172.21.15.7:0/3116215791 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f77d40a32c0 0x7f77d40a5780 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f77e4005d00 tx=0x7f77e400b410 comp rx=0 tx=0).stop 2024-09-19T08:42:20.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:20.072+0000 7f77ef46e640 1 -- 172.21.15.7:0/3116215791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77e8102570 msgr2=0x7f77e81997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:20.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:20.072+0000 7f77ef46e640 1 --2- 172.21.15.7:0/3116215791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77e8102570 0x7f77e81997d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f77d8006010 tx=0x7f77d8003c10 comp rx=0 tx=0).stop 2024-09-19T08:42:20.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:20.072+0000 7f77ef46e640 1 -- 172.21.15.7:0/3116215791 shutdown_connections 2024-09-19T08:42:20.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:20.072+0000 7f77ef46e640 1 --2- 172.21.15.7:0/3116215791 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f77d40a32c0 0x7f77d40a5780 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:20.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:20.072+0000 7f77ef46e640 1 --2- 172.21.15.7:0/3116215791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77e8102ef0 0x7f77e81a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:20.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:20.072+0000 7f77ef46e640 1 --2- 172.21.15.7:0/3116215791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77e8102570 0x7f77e81997d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:20.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:20.072+0000 7f77ef46e640 1 --2- 172.21.15.7:0/3116215791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77e8100e20 0x7f77e8199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:20.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:20.072+0000 7f77ef46e640 1 -- 172.21.15.7:0/3116215791 >> 172.21.15.7:0/3116215791 conn(0x7f77e80fc7d0 msgr2=0x7f77e8105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:20.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:20.072+0000 7f77ef46e640 1 -- 172.21.15.7:0/3116215791 shutdown_connections 2024-09-19T08:42:20.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:20.072+0000 7f77ef46e640 1 -- 172.21.15.7:0/3116215791 wait complete. 2024-09-19T08:42:20.178 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 19 08:42:20 smithi175 systemd[1]: Starting Ceph mds.c for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:42:20.651 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:20 smithi175 ceph-mon[35688]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:20.652 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:20 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3116215791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:20.652 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 19 08:42:20 smithi175 podman[66196]: 2024-09-19 08:42:20.358717754 +0000 UTC m=+0.108818854 container create 29ba581350ccc6448b9776e90bedbc182362e5f7f75cd6a7a97a929939745d6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T08:42:20.652 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 19 08:42:20 smithi175 podman[66196]: 2024-09-19 08:42:20.265380752 +0000 UTC m=+0.015481851 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:42:20.652 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 19 08:42:20 smithi175 podman[66196]: 2024-09-19 08:42:20.560758605 +0000 UTC m=+0.310859706 container init 29ba581350ccc6448b9776e90bedbc182362e5f7f75cd6a7a97a929939745d6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:42:20.652 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 19 08:42:20 smithi175 podman[66196]: 2024-09-19 08:42:20.563748019 +0000 UTC m=+0.313849120 container start 29ba581350ccc6448b9776e90bedbc182362e5f7f75cd6a7a97a929939745d6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T08:42:20.652 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 19 08:42:20 smithi175 ceph-mds[66215]: -- 172.21.15.175:0/1027334178 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560ffcfd1860 con 0x560ffcfaf000 2024-09-19T08:42:20.652 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 19 08:42:20 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-c[66211]: starting mds.c at 2024-09-19T08:42:20.652 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 19 08:42:20 smithi175 bash[66196]: 29ba581350ccc6448b9776e90bedbc182362e5f7f75cd6a7a97a929939745d6b 2024-09-19T08:42:20.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:20 smithi007 ceph-mon[31221]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:20.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:20 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3116215791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:20.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:20 smithi044 ceph-mon[35072]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:20.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:20 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3116215791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:20.928 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 19 08:42:20 smithi175 systemd[1]: Started Ceph mds.c for ebd23124-7661-11ef-bceb-c7b262605968. 2024-09-19T08:42:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:21 smithi044 ceph-mon[35072]: Deploying daemon mds.h on smithi044 2024-09-19T08:42:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:21 smithi044 ceph-mon[35072]: mds.? [v2:172.21.15.175:6836/2128553811,v1:172.21.15.175:6837/2128553811] up:boot 2024-09-19T08:42:21.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:21 smithi044 ceph-mon[35072]: fsmap 7 up:standby 2024-09-19T08:42:21.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:21 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:42:22.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:22.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:22.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:22.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:22.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:22.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:22.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:21 smithi007 ceph-mon[31221]: Deploying daemon mds.h on smithi044 2024-09-19T08:42:22.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:21 smithi007 ceph-mon[31221]: mds.? [v2:172.21.15.175:6836/2128553811,v1:172.21.15.175:6837/2128553811] up:boot 2024-09-19T08:42:22.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:21 smithi007 ceph-mon[31221]: fsmap 7 up:standby 2024-09-19T08:42:22.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:21 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:42:22.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:22.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:22.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:22.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:22.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:22.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:22.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:21 smithi175 ceph-mon[35688]: Deploying daemon mds.h on smithi044 2024-09-19T08:42:22.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:21 smithi175 ceph-mon[35688]: mds.? [v2:172.21.15.175:6836/2128553811,v1:172.21.15.175:6837/2128553811] up:boot 2024-09-19T08:42:22.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:21 smithi175 ceph-mon[35688]: fsmap 7 up:standby 2024-09-19T08:42:22.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:21 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:42:22.717 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 19 08:42:22 smithi044 systemd[1]: Starting Ceph mds.h for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:42:22.787 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:42:23.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:22 smithi007 ceph-mon[31221]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:23.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:22 smithi044 ceph-mon[35072]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:23.051 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 19 08:42:22 smithi044 podman[64569]: 2024-09-19 08:42:22.729429827 +0000 UTC m=+0.016265695 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:42:23.051 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 19 08:42:22 smithi044 podman[64569]: 2024-09-19 08:42:22.967648111 +0000 UTC m=+0.254483999 container create 970b838a85c0af10dca20048d27e240f6a071fb67a00e0c794f8283a569ba094 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T08:42:23.055 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:23.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:22 smithi175 ceph-mon[35688]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:23.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.522+0000 7f759a696640 1 -- 172.21.15.7:0/1623123947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7594103660 msgr2=0x7f759410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:23.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.522+0000 7f759a696640 1 --2- 172.21.15.7:0/1623123947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7594103660 0x7f759410bb50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f757c009900 tx=0x7f757c02a480 comp rx=0 tx=0).stop 2024-09-19T08:42:23.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.522+0000 7f759a696640 1 -- 172.21.15.7:0/1623123947 shutdown_connections 2024-09-19T08:42:23.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.522+0000 7f759a696640 1 --2- 172.21.15.7:0/1623123947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f759410c170 0x7f759410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:23.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.522+0000 7f759a696640 1 --2- 172.21.15.7:0/1623123947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7594103660 0x7f759410bb50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:23.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.522+0000 7f759a696640 1 --2- 172.21.15.7:0/1623123947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7594102d40 0x7f7594103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:23.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.522+0000 7f759a696640 1 -- 172.21.15.7:0/1623123947 >> 172.21.15.7:0/1623123947 conn(0x7f75940fc7a0 msgr2=0x7f75940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:23.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.522+0000 7f759a696640 1 -- 172.21.15.7:0/1623123947 shutdown_connections 2024-09-19T08:42:23.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.522+0000 7f759a696640 1 -- 172.21.15.7:0/1623123947 wait complete. 2024-09-19T08:42:23.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.522+0000 7f759a696640 1 Processor -- start 2024-09-19T08:42:23.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.522+0000 7f759a696640 1 -- start start 2024-09-19T08:42:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.523+0000 7f759a696640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7594102d40 0x7f7594198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.523+0000 7f759a696640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7594103660 0x7f7594198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.523+0000 7f759a696640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f759410c170 0x7f759419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.523+0000 7f759a696640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7594111f70 con 0x7f759410c170 2024-09-19T08:42:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.523+0000 7f759a696640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7594111df0 con 0x7f7594102d40 2024-09-19T08:42:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.523+0000 7f759a696640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f75941120f0 con 0x7f7594103660 2024-09-19T08:42:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.523+0000 7f7598c33640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f759410c170 0x7f759419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.523+0000 7f7593fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7594102d40 0x7f7594198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.523+0000 7f7598c33640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f759410c170 0x7f759419cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52778/0 (socket says 172.21.15.7:52778) 2024-09-19T08:42:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.523+0000 7f7598c33640 1 -- 172.21.15.7:0/3010293419 learned_addr learned my addr 172.21.15.7:0/3010293419 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:42:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.523+0000 7f7593fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7594102d40 0x7f7594198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:57384/0 (socket says 172.21.15.7:57384) 2024-09-19T08:42:23.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.523+0000 7f758bfff640 1 --2- 172.21.15.7:0/3010293419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7594103660 0x7f7594198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:23.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.523+0000 7f7593fff640 1 -- 172.21.15.7:0/3010293419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7594103660 msgr2=0x7f7594198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:23.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.523+0000 7f7593fff640 1 --2- 172.21.15.7:0/3010293419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7594103660 0x7f7594198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:23.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.523+0000 7f7593fff640 1 -- 172.21.15.7:0/3010293419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f759410c170 msgr2=0x7f759419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:23.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.523+0000 7f7593fff640 1 --2- 172.21.15.7:0/3010293419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f759410c170 0x7f759419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:23.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.523+0000 7f7593fff640 1 -- 172.21.15.7:0/3010293419 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759419d400 con 0x7f7594102d40 2024-09-19T08:42:23.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.523+0000 7f7598c33640 1 --2- 172.21.15.7:0/3010293419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f759410c170 0x7f759419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:42:23.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.523+0000 7f7593fff640 1 --2- 172.21.15.7:0/3010293419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7594102d40 0x7f7594198450 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f758400d6d0 tx=0x7f758400db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:23.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.523+0000 7f7591ffb640 1 -- 172.21.15.7:0/3010293419 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7584017070 con 0x7f7594102d40 2024-09-19T08:42:23.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.523+0000 7f7591ffb640 1 -- 172.21.15.7:0/3010293419 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7584009820 con 0x7f7594102d40 2024-09-19T08:42:23.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.523+0000 7f759a696640 1 -- 172.21.15.7:0/3010293419 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f759419d6f0 con 0x7f7594102d40 2024-09-19T08:42:23.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.524+0000 7f7591ffb640 1 -- 172.21.15.7:0/3010293419 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7584004d00 con 0x7f7594102d40 2024-09-19T08:42:23.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.524+0000 7f759a696640 1 -- 172.21.15.7:0/3010293419 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75941a4fd0 con 0x7f7594102d40 2024-09-19T08:42:23.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.524+0000 7f759a696640 1 -- 172.21.15.7:0/3010293419 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7594103120 con 0x7f7594102d40 2024-09-19T08:42:23.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.526+0000 7f7591ffb640 1 -- 172.21.15.7:0/3010293419 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f75840099d0 con 0x7f7594102d40 2024-09-19T08:42:23.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.526+0000 7f7591ffb640 1 --2- 172.21.15.7:0/3010293419 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f75800a3240 0x7f75800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:23.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.526+0000 7f758bfff640 1 --2- 172.21.15.7:0/3010293419 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f75800a3240 0x7f75800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:23.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.526+0000 7f7591ffb640 1 -- 172.21.15.7:0/3010293419 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f75840cefe0 con 0x7f7594102d40 2024-09-19T08:42:23.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.527+0000 7f758bfff640 1 --2- 172.21.15.7:0/3010293419 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f75800a3240 0x7f75800a5700 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f757c009230 tx=0x7f757c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:23.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.530+0000 7f7591ffb640 1 -- 172.21.15.7:0/3010293419 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f758409bb10 con 0x7f7594102d40 2024-09-19T08:42:23.551 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 19 08:42:23 smithi044 podman[64569]: 2024-09-19 08:42:23.19500204 +0000 UTC m=+0.481837887 container init 970b838a85c0af10dca20048d27e240f6a071fb67a00e0c794f8283a569ba094 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-h, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:42:23.551 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 19 08:42:23 smithi044 podman[64569]: 2024-09-19 08:42:23.19776742 +0000 UTC m=+0.484603276 container start 970b838a85c0af10dca20048d27e240f6a071fb67a00e0c794f8283a569ba094 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-h, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T08:42:23.551 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 19 08:42:23 smithi044 ceph-mds[64588]: -- 172.21.15.44:0/164174614 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556dce657c20 con 0x556dce635000 2024-09-19T08:42:23.551 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 19 08:42:23 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-h[64584]: starting mds.h at 2024-09-19T08:42:23.551 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 19 08:42:23 smithi044 bash[64569]: 970b838a85c0af10dca20048d27e240f6a071fb67a00e0c794f8283a569ba094 2024-09-19T08:42:23.551 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 19 08:42:23 smithi044 systemd[1]: Started Ceph mds.h for ebd23124-7661-11ef-bceb-c7b262605968. 2024-09-19T08:42:23.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.743+0000 7f759a696640 1 -- 172.21.15.7:0/3010293419 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75941071e0 con 0x7f7594102d40 2024-09-19T08:42:23.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.744+0000 7f7591ffb640 1 -- 172.21.15.7:0/3010293419 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7210 (secure 0 0 0) 0x7f758409fe10 con 0x7f7594102d40 2024-09-19T08:42:23.744 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:42:23.744 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":9,"btime":"2024-09-19T08:42:23:718196+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-19T08:42:23.744 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 9 2024-09-19T08:42:23.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.747+0000 7f759a696640 1 -- 172.21.15.7:0/3010293419 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f75800a3240 msgr2=0x7f75800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:23.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.747+0000 7f759a696640 1 --2- 172.21.15.7:0/3010293419 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f75800a3240 0x7f75800a5700 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f757c009230 tx=0x7f757c0058d0 comp rx=0 tx=0).stop 2024-09-19T08:42:23.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.747+0000 7f759a696640 1 -- 172.21.15.7:0/3010293419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7594102d40 msgr2=0x7f7594198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:23.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.747+0000 7f759a696640 1 --2- 172.21.15.7:0/3010293419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7594102d40 0x7f7594198450 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f758400d6d0 tx=0x7f758400db90 comp rx=0 tx=0).stop 2024-09-19T08:42:23.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.747+0000 7f759a696640 1 -- 172.21.15.7:0/3010293419 shutdown_connections 2024-09-19T08:42:23.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.747+0000 7f759a696640 1 --2- 172.21.15.7:0/3010293419 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f75800a3240 0x7f75800a5700 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:23.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.747+0000 7f759a696640 1 --2- 172.21.15.7:0/3010293419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f759410c170 0x7f759419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:23.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.747+0000 7f759a696640 1 --2- 172.21.15.7:0/3010293419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7594103660 0x7f7594198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:23.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.747+0000 7f759a696640 1 --2- 172.21.15.7:0/3010293419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7594102d40 0x7f7594198450 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:23.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.747+0000 7f759a696640 1 -- 172.21.15.7:0/3010293419 >> 172.21.15.7:0/3010293419 conn(0x7f75940fc7a0 msgr2=0x7f75940fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:23.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.747+0000 7f759a696640 1 -- 172.21.15.7:0/3010293419 shutdown_connections 2024-09-19T08:42:23.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:23.747+0000 7f759a696640 1 -- 172.21.15.7:0/3010293419 wait complete. 2024-09-19T08:42:24.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:24 smithi007 ceph-mon[31221]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:24.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:24 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:24.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:24 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:24.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:24 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:24.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:24 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:24.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:24 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:24.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:24 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:24.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:24 smithi007 ceph-mon[31221]: Deploying daemon mds.i on smithi175 2024-09-19T08:42:24.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:24 smithi007 ceph-mon[31221]: mds.? [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] up:boot 2024-09-19T08:42:24.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:24 smithi007 ceph-mon[31221]: fsmap 8 up:standby 2024-09-19T08:42:24.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:24 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:42:24.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:24 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3010293419' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:24.616 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:24 smithi175 ceph-mon[35688]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:24.617 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:24 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:24.617 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:24 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:24.617 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:24 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:24.617 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:24 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:24.617 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:24 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:24.617 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:24 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:24.617 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:24 smithi175 ceph-mon[35688]: Deploying daemon mds.i on smithi175 2024-09-19T08:42:24.617 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:24 smithi175 ceph-mon[35688]: mds.? [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] up:boot 2024-09-19T08:42:24.617 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:24 smithi175 ceph-mon[35688]: fsmap 8 up:standby 2024-09-19T08:42:24.617 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:24 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:42:24.617 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:24 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3010293419' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:24.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:24 smithi044 ceph-mon[35072]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:24.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:24 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:24.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:24 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:24.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:24 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:24.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:24 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:24.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:24 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:24.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:24 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:24.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:24 smithi044 ceph-mon[35072]: Deploying daemon mds.i on smithi175 2024-09-19T08:42:24.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:24 smithi044 ceph-mon[35072]: mds.? [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] up:boot 2024-09-19T08:42:24.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:24 smithi044 ceph-mon[35072]: fsmap 8 up:standby 2024-09-19T08:42:24.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:24 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:42:24.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:24 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3010293419' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:25.678 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 19 08:42:25 smithi175 systemd[1]: Started Ceph mds.i for ebd23124-7661-11ef-bceb-c7b262605968. 2024-09-19T08:42:26.393 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:42:26.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:26 smithi175 ceph-mon[35688]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:26.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:26 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:26.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:26 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:26.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:26 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:26.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:26 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:26.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:26 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:26.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:26 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:26.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:26 smithi175 ceph-mon[35688]: Deploying daemon mds.g on smithi007 2024-09-19T08:42:26.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:26 smithi175 ceph-mon[35688]: mds.? [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] up:boot 2024-09-19T08:42:26.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:26 smithi175 ceph-mon[35688]: fsmap 9 up:standby 2024-09-19T08:42:26.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:26 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:42:27.016 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:26 smithi007 ceph-mon[31221]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:27.016 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:26 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:27.016 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:26 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:27.016 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:26 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:27.017 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:26 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:27.017 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:26 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:27.017 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:26 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:27.017 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:26 smithi007 ceph-mon[31221]: Deploying daemon mds.g on smithi007 2024-09-19T08:42:27.017 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:26 smithi007 ceph-mon[31221]: mds.? [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] up:boot 2024-09-19T08:42:27.017 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:26 smithi007 ceph-mon[31221]: fsmap 9 up:standby 2024-09-19T08:42:27.017 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:26 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:42:27.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:26 smithi044 ceph-mon[35072]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:27.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:26 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:27.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:26 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:27.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:26 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:27.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:26 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:27.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:26 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:27.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:26 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:27.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:26 smithi044 ceph-mon[35072]: Deploying daemon mds.g on smithi007 2024-09-19T08:42:27.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:26 smithi044 ceph-mon[35072]: mds.? [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] up:boot 2024-09-19T08:42:27.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:26 smithi044 ceph-mon[35072]: fsmap 9 up:standby 2024-09-19T08:42:27.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:26 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:42:27.080 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:27.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.530+0000 7fc9b84d9640 1 -- 172.21.15.7:0/2034691136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9b0100e20 msgr2=0x7fc9b0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:27.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.530+0000 7fc9b84d9640 1 --2- 172.21.15.7:0/2034691136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9b0100e20 0x7fc9b0101200 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009900 tx=0x7fc9ac02a480 comp rx=0 tx=0).stop 2024-09-19T08:42:27.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.530+0000 7fc9b84d9640 1 -- 172.21.15.7:0/2034691136 shutdown_connections 2024-09-19T08:42:27.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.530+0000 7fc9b84d9640 1 --2- 172.21.15.7:0/2034691136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9b0102ef0 0x7fc9b010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:27.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.530+0000 7fc9b84d9640 1 --2- 172.21.15.7:0/2034691136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9b0102570 0x7fc9b01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:27.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.530+0000 7fc9b84d9640 1 --2- 172.21.15.7:0/2034691136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9b0100e20 0x7fc9b0101200 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:27.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.530+0000 7fc9b84d9640 1 -- 172.21.15.7:0/2034691136 >> 172.21.15.7:0/2034691136 conn(0x7fc9b00fc7d0 msgr2=0x7fc9b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:27.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.530+0000 7fc9b84d9640 1 -- 172.21.15.7:0/2034691136 shutdown_connections 2024-09-19T08:42:27.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.530+0000 7fc9b84d9640 1 -- 172.21.15.7:0/2034691136 wait complete. 2024-09-19T08:42:27.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.531+0000 7fc9b84d9640 1 Processor -- start 2024-09-19T08:42:27.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.531+0000 7fc9b84d9640 1 -- start start 2024-09-19T08:42:27.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.532+0000 7fc9b84d9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9b0100e20 0x7fc9b01987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:27.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.532+0000 7fc9b84d9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9b0102570 0x7fc9b0198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:27.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.532+0000 7fc9b84d9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9b0102ef0 0x7fc9b019ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:27.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.532+0000 7fc9b84d9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b0110f80 con 0x7fc9b0102570 2024-09-19T08:42:27.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.532+0000 7fc9b84d9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b0110e00 con 0x7fc9b0102ef0 2024-09-19T08:42:27.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.532+0000 7fc9b84d9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b0111100 con 0x7fc9b0100e20 2024-09-19T08:42:27.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.532+0000 7fc9b5a74640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9b0102570 0x7fc9b0198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:27.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.532+0000 7fc9b5a74640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9b0102570 0x7fc9b0198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52796/0 (socket says 172.21.15.7:52796) 2024-09-19T08:42:27.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.532+0000 7fc9b5a74640 1 -- 172.21.15.7:0/1779415592 learned_addr learned my addr 172.21.15.7:0/1779415592 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:42:27.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.532+0000 7fc9b6275640 1 --2- 172.21.15.7:0/1779415592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9b0100e20 0x7fc9b01987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:27.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.532+0000 7fc9b6a76640 1 --2- 172.21.15.7:0/1779415592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9b0102ef0 0x7fc9b019ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:27.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.532+0000 7fc9b5a74640 1 -- 172.21.15.7:0/1779415592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9b0100e20 msgr2=0x7fc9b01987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.532+0000 7fc9b5a74640 1 --2- 172.21.15.7:0/1779415592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9b0100e20 0x7fc9b01987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.532+0000 7fc9b5a74640 1 -- 172.21.15.7:0/1779415592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9b0102ef0 msgr2=0x7fc9b019ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.532+0000 7fc9b5a74640 1 --2- 172.21.15.7:0/1779415592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9b0102ef0 0x7fc9b019ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.532+0000 7fc9b5a74640 1 -- 172.21.15.7:0/1779415592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b019d560 con 0x7fc9b0102570 2024-09-19T08:42:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.532+0000 7fc9b6a76640 1 --2- 172.21.15.7:0/1779415592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9b0102ef0 0x7fc9b019ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:42:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.532+0000 7fc9b5a74640 1 --2- 172.21.15.7:0/1779415592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9b0102570 0x7fc9b0198d30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000e9f0 tx=0x7fc9a000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.532+0000 7fc9a77fe640 1 -- 172.21.15.7:0/1779415592 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a000cd80 con 0x7fc9b0102570 2024-09-19T08:42:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.533+0000 7fc9a77fe640 1 -- 172.21.15.7:0/1779415592 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9a0005500 con 0x7fc9b0102570 2024-09-19T08:42:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.533+0000 7fc9b84d9640 1 -- 172.21.15.7:0/1779415592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b019d850 con 0x7fc9b0102570 2024-09-19T08:42:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.533+0000 7fc9a77fe640 1 -- 172.21.15.7:0/1779415592 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0010690 con 0x7fc9b0102570 2024-09-19T08:42:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.533+0000 7fc9b84d9640 1 -- 172.21.15.7:0/1779415592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b01a50a0 con 0x7fc9b0102570 2024-09-19T08:42:27.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.534+0000 7fc9b84d9640 1 -- 172.21.15.7:0/1779415592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9b0101200 con 0x7fc9b0102570 2024-09-19T08:42:27.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.535+0000 7fc9a77fe640 1 -- 172.21.15.7:0/1779415592 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fc9a00046c0 con 0x7fc9b0102570 2024-09-19T08:42:27.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.536+0000 7fc9a77fe640 1 --2- 172.21.15.7:0/1779415592 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc99c0a3240 0x7fc99c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:27.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.536+0000 7fc9b6275640 1 --2- 172.21.15.7:0/1779415592 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc99c0a3240 0x7fc99c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:27.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.536+0000 7fc9a77fe640 1 -- 172.21.15.7:0/1779415592 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fc9a00cf960 con 0x7fc9b0102570 2024-09-19T08:42:27.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.537+0000 7fc9b6275640 1 --2- 172.21.15.7:0/1779415592 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc99c0a3240 0x7fc99c0a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009230 tx=0x7fc9ac0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:27.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.540+0000 7fc9a77fe640 1 -- 172.21.15.7:0/1779415592 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc9a009cac0 con 0x7fc9b0102570 2024-09-19T08:42:27.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.763+0000 7fc9b84d9640 1 -- 172.21.15.7:0/1779415592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9b01a5270 con 0x7fc9b0102570 2024-09-19T08:42:27.764 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 08:42:27 smithi007 systemd[1]: Starting Ceph mds.g for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:42:27.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.764+0000 7fc9a77fe640 1 -- 172.21.15.7:0/1779415592 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8040 (secure 0 0 0) 0x7fc9a009c3c0 con 0x7fc9b0102570 2024-09-19T08:42:27.765 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:42:27.765 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":10,"btime":"2024-09-19T08:42:26:345416+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T08:42:27.766 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 10 2024-09-19T08:42:27.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.767+0000 7fc9b84d9640 1 -- 172.21.15.7:0/1779415592 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc99c0a3240 msgr2=0x7fc99c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:27.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.767+0000 7fc9b84d9640 1 --2- 172.21.15.7:0/1779415592 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc99c0a3240 0x7fc99c0a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009230 tx=0x7fc9ac0058d0 comp rx=0 tx=0).stop 2024-09-19T08:42:27.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.767+0000 7fc9b84d9640 1 -- 172.21.15.7:0/1779415592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9b0102570 msgr2=0x7fc9b0198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:27.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.767+0000 7fc9b84d9640 1 --2- 172.21.15.7:0/1779415592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9b0102570 0x7fc9b0198d30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000e9f0 tx=0x7fc9a000edf0 comp rx=0 tx=0).stop 2024-09-19T08:42:27.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.767+0000 7fc9b84d9640 1 -- 172.21.15.7:0/1779415592 shutdown_connections 2024-09-19T08:42:27.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.767+0000 7fc9b84d9640 1 --2- 172.21.15.7:0/1779415592 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc99c0a3240 0x7fc99c0a5700 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:27.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.767+0000 7fc9b84d9640 1 --2- 172.21.15.7:0/1779415592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9b0102ef0 0x7fc9b019ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:27.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.767+0000 7fc9b84d9640 1 --2- 172.21.15.7:0/1779415592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9b0102570 0x7fc9b0198d30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:27.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.767+0000 7fc9b84d9640 1 --2- 172.21.15.7:0/1779415592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9b0100e20 0x7fc9b01987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:27.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.767+0000 7fc9b84d9640 1 -- 172.21.15.7:0/1779415592 >> 172.21.15.7:0/1779415592 conn(0x7fc9b00fc7d0 msgr2=0x7fc9b00fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:27.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.767+0000 7fc9b84d9640 1 -- 172.21.15.7:0/1779415592 shutdown_connections 2024-09-19T08:42:27.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:27.767+0000 7fc9b84d9640 1 -- 172.21.15.7:0/1779415592 wait complete. 2024-09-19T08:42:28.033 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 08:42:27 smithi007 podman[72413]: 2024-09-19 08:42:27.681230897 +0000 UTC m=+0.017288562 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:42:28.033 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 08:42:27 smithi007 podman[72413]: 2024-09-19 08:42:27.803054926 +0000 UTC m=+0.139112579 container create cbae8757562b671826fa9698eff78b348ce337b9399a46b3a58835387d644678 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T08:42:28.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:28 smithi007 ceph-mon[31221]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:28.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:28 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1779415592' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:28.783 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 08:42:28 smithi007 podman[72413]: 2024-09-19 08:42:28.695616075 +0000 UTC m=+1.031673738 container init cbae8757562b671826fa9698eff78b348ce337b9399a46b3a58835387d644678 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T08:42:28.784 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 08:42:28 smithi007 podman[72413]: 2024-09-19 08:42:28.699571903 +0000 UTC m=+1.035629557 container start cbae8757562b671826fa9698eff78b348ce337b9399a46b3a58835387d644678 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-g, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T08:42:28.784 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 08:42:28 smithi007 ceph-mds[72449]: -- 172.21.15.7:0/1526972721 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c96bbed860 con 0x55c96bbca800 2024-09-19T08:42:28.784 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 08:42:28 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-g[72440]: starting mds.g at 2024-09-19T08:42:28.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:28 smithi175 ceph-mon[35688]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:28.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:28 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1779415592' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:29.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:28 smithi044 ceph-mon[35072]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:29.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:28 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1779415592' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:29.283 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 08:42:28 smithi007 bash[72413]: cbae8757562b671826fa9698eff78b348ce337b9399a46b3a58835387d644678 2024-09-19T08:42:29.283 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 08:42:28 smithi007 systemd[1]: Started Ceph mds.g for ebd23124-7661-11ef-bceb-c7b262605968. 2024-09-19T08:42:30.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:29 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:30.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:29 smithi175 ceph-mon[35688]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:30.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:29 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:30.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:29 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:30.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:29 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:30.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:29 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:30.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:29 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:30.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:29 smithi175 ceph-mon[35688]: Deploying daemon mds.a on smithi007 2024-09-19T08:42:30.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:29 smithi175 ceph-mon[35688]: mds.? [v2:172.21.15.7:6838/2793016476,v1:172.21.15.7:6839/2793016476] up:boot 2024-09-19T08:42:30.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:29 smithi175 ceph-mon[35688]: fsmap 10 up:standby 2024-09-19T08:42:30.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:29 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T08:42:30.235 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:29 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:30.235 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:29 smithi007 ceph-mon[31221]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:30.235 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:29 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:30.235 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:29 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:30.235 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:29 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:30.236 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:29 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:30.236 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:29 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:30.236 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:29 smithi007 ceph-mon[31221]: Deploying daemon mds.a on smithi007 2024-09-19T08:42:30.236 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:29 smithi007 ceph-mon[31221]: mds.? [v2:172.21.15.7:6838/2793016476,v1:172.21.15.7:6839/2793016476] up:boot 2024-09-19T08:42:30.236 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:29 smithi007 ceph-mon[31221]: fsmap 10 up:standby 2024-09-19T08:42:30.236 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:29 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T08:42:30.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:29 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:30.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:29 smithi044 ceph-mon[35072]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:30.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:29 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:30.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:29 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:30.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:29 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:30.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:29 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:30.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:29 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:30.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:29 smithi044 ceph-mon[35072]: Deploying daemon mds.a on smithi007 2024-09-19T08:42:30.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:29 smithi044 ceph-mon[35072]: mds.? [v2:172.21.15.7:6838/2793016476,v1:172.21.15.7:6839/2793016476] up:boot 2024-09-19T08:42:30.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:29 smithi044 ceph-mon[35072]: fsmap 10 up:standby 2024-09-19T08:42:30.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:29 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T08:42:30.541 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:42:30.961 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 08:42:30 smithi007 systemd[1]: Starting Ceph mds.a for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:42:31.283 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 08:42:30 smithi007 podman[72749]: 2024-09-19 08:42:30.864545738 +0000 UTC m=+0.017536996 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:42:31.283 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 08:42:30 smithi007 podman[72749]: 2024-09-19 08:42:30.992536943 +0000 UTC m=+0.145528175 container create 7e66f5d7bf70d18608f137c7582a11074f59182c6a7e4fbaf1df71f7eec7e44f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:42:31.486 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:31.608 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 08:42:31 smithi007 podman[72749]: 2024-09-19 08:42:31.315795507 +0000 UTC m=+0.468786758 container init 7e66f5d7bf70d18608f137c7582a11074f59182c6a7e4fbaf1df71f7eec7e44f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-a, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T08:42:31.608 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 08:42:31 smithi007 podman[72749]: 2024-09-19 08:42:31.31890508 +0000 UTC m=+0.471896314 container start 7e66f5d7bf70d18608f137c7582a11074f59182c6a7e4fbaf1df71f7eec7e44f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-a, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T08:42:31.608 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 08:42:31 smithi007 ceph-mds[72797]: -- 172.21.15.7:0/1686909345 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563cf11fd860 con 0x563cf11db000 2024-09-19T08:42:31.608 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 08:42:31 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-a[72780]: starting mds.a at 2024-09-19T08:42:31.609 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 08:42:31 smithi007 bash[72749]: 7e66f5d7bf70d18608f137c7582a11074f59182c6a7e4fbaf1df71f7eec7e44f 2024-09-19T08:42:31.609 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 08:42:31 smithi007 systemd[1]: Started Ceph mds.a for ebd23124-7661-11ef-bceb-c7b262605968. 2024-09-19T08:42:32.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.961+0000 7fef23f2a640 1 -- 172.21.15.7:0/3820759996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef1c101de0 msgr2=0x7fef1c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:32.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.961+0000 7fef23f2a640 1 --2- 172.21.15.7:0/3820759996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef1c101de0 0x7fef1c1021c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fef18009900 tx=0x7fef1802a410 comp rx=0 tx=0).stop 2024-09-19T08:42:32.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.961+0000 7fef23f2a640 1 -- 172.21.15.7:0/3820759996 shutdown_connections 2024-09-19T08:42:32.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.961+0000 7fef23f2a640 1 --2- 172.21.15.7:0/3820759996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef1c106f10 0x7fef1c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:32.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.961+0000 7fef23f2a640 1 --2- 172.21.15.7:0/3820759996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef1c102790 0x7fef1c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:32.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.961+0000 7fef23f2a640 1 --2- 172.21.15.7:0/3820759996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef1c101de0 0x7fef1c1021c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:32.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.961+0000 7fef23f2a640 1 -- 172.21.15.7:0/3820759996 >> 172.21.15.7:0/3820759996 conn(0x7fef1c0fd8c0 msgr2=0x7fef1c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:32.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.961+0000 7fef23f2a640 1 -- 172.21.15.7:0/3820759996 shutdown_connections 2024-09-19T08:42:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.961+0000 7fef23f2a640 1 -- 172.21.15.7:0/3820759996 wait complete. 2024-09-19T08:42:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.962+0000 7fef23f2a640 1 Processor -- start 2024-09-19T08:42:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.962+0000 7fef23f2a640 1 -- start start 2024-09-19T08:42:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.962+0000 7fef23f2a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef1c101de0 0x7fef1c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.962+0000 7fef23f2a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef1c102790 0x7fef1c198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.962+0000 7fef23f2a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef1c106f10 0x7fef1c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.962+0000 7fef23f2a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fef1c111f70 con 0x7fef1c101de0 2024-09-19T08:42:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.962+0000 7fef23f2a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fef1c111df0 con 0x7fef1c106f10 2024-09-19T08:42:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.962+0000 7fef23f2a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fef1c1120f0 con 0x7fef1c102790 2024-09-19T08:42:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.962+0000 7fef21cc6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef1c101de0 0x7fef1c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.962+0000 7fef21cc6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef1c101de0 0x7fef1c1984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52842/0 (socket says 172.21.15.7:52842) 2024-09-19T08:42:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.962+0000 7fef21cc6640 1 -- 172.21.15.7:0/1916290204 learned_addr learned my addr 172.21.15.7:0/1916290204 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:42:32.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.963+0000 7fef224c7640 1 --2- 172.21.15.7:0/1916290204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef1c106f10 0x7fef1c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:32.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.963+0000 7fef214c5640 1 --2- 172.21.15.7:0/1916290204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef1c102790 0x7fef1c198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:32.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.963+0000 7fef21cc6640 1 -- 172.21.15.7:0/1916290204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef1c102790 msgr2=0x7fef1c198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:32.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.963+0000 7fef21cc6640 1 --2- 172.21.15.7:0/1916290204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef1c102790 0x7fef1c198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:32.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.963+0000 7fef21cc6640 1 -- 172.21.15.7:0/1916290204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef1c106f10 msgr2=0x7fef1c19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:32.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.963+0000 7fef21cc6640 1 --2- 172.21.15.7:0/1916290204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef1c106f10 0x7fef1c19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:32.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.963+0000 7fef21cc6640 1 -- 172.21.15.7:0/1916290204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef1c19d480 con 0x7fef1c101de0 2024-09-19T08:42:32.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.963+0000 7fef21cc6640 1 --2- 172.21.15.7:0/1916290204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef1c101de0 0x7fef1c1984d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fef18006010 tx=0x7fef180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:32.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.963+0000 7fef12ffd640 1 -- 172.21.15.7:0/1916290204 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1803f030 con 0x7fef1c101de0 2024-09-19T08:42:32.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.963+0000 7fef12ffd640 1 -- 172.21.15.7:0/1916290204 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef18003ce0 con 0x7fef1c101de0 2024-09-19T08:42:32.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.963+0000 7fef23f2a640 1 -- 172.21.15.7:0/1916290204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef1c19d710 con 0x7fef1c101de0 2024-09-19T08:42:32.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.963+0000 7fef12ffd640 1 -- 172.21.15.7:0/1916290204 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef18035070 con 0x7fef1c101de0 2024-09-19T08:42:32.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.963+0000 7fef23f2a640 1 -- 172.21.15.7:0/1916290204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef1c1a5050 con 0x7fef1c101de0 2024-09-19T08:42:32.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.964+0000 7fef23f2a640 1 -- 172.21.15.7:0/1916290204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef1c1032c0 con 0x7fef1c101de0 2024-09-19T08:42:32.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.966+0000 7fef12ffd640 1 -- 172.21.15.7:0/1916290204 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fef18042030 con 0x7fef1c101de0 2024-09-19T08:42:32.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.967+0000 7fef12ffd640 1 --2- 172.21.15.7:0/1916290204 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fef080a3240 0x7fef080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:32.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.967+0000 7fef214c5640 1 --2- 172.21.15.7:0/1916290204 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fef080a3240 0x7fef080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:32.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.967+0000 7fef12ffd640 1 -- 172.21.15.7:0/1916290204 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fef180efdc0 con 0x7fef1c101de0 2024-09-19T08:42:32.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.967+0000 7fef214c5640 1 --2- 172.21.15.7:0/1916290204 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fef080a3240 0x7fef080a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fef1c0ff840 tx=0x7fef0c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:32.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:31.970+0000 7fef12ffd640 1 -- 172.21.15.7:0/1916290204 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fef180bc950 con 0x7fef1c101de0 2024-09-19T08:42:32.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:32.182+0000 7fef23f2a640 1 -- 172.21.15.7:0/1916290204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef1c1021c0 con 0x7fef1c101de0 2024-09-19T08:42:32.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:32.183+0000 7fef12ffd640 1 -- 172.21.15.7:0/1916290204 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9686 (secure 0 0 0) 0x7fef180c0c50 con 0x7fef1c101de0 2024-09-19T08:42:32.182 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:42:32.183 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":12,"btime":"2024-09-19T08:42:31:874209+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T08:42:32.183 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 12 2024-09-19T08:42:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:32.185+0000 7fef23f2a640 1 -- 172.21.15.7:0/1916290204 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fef080a3240 msgr2=0x7fef080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:32.185+0000 7fef23f2a640 1 --2- 172.21.15.7:0/1916290204 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fef080a3240 0x7fef080a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fef1c0ff840 tx=0x7fef0c00a2d0 comp rx=0 tx=0).stop 2024-09-19T08:42:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:32.185+0000 7fef23f2a640 1 -- 172.21.15.7:0/1916290204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef1c101de0 msgr2=0x7fef1c1984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:32.185+0000 7fef23f2a640 1 --2- 172.21.15.7:0/1916290204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef1c101de0 0x7fef1c1984d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fef18006010 tx=0x7fef180042f0 comp rx=0 tx=0).stop 2024-09-19T08:42:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:32.185+0000 7fef23f2a640 1 -- 172.21.15.7:0/1916290204 shutdown_connections 2024-09-19T08:42:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:32.185+0000 7fef23f2a640 1 --2- 172.21.15.7:0/1916290204 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fef080a3240 0x7fef080a5700 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:32.185+0000 7fef23f2a640 1 --2- 172.21.15.7:0/1916290204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef1c106f10 0x7fef1c19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:32.185+0000 7fef23f2a640 1 --2- 172.21.15.7:0/1916290204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef1c102790 0x7fef1c198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:32.185+0000 7fef23f2a640 1 --2- 172.21.15.7:0/1916290204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef1c101de0 0x7fef1c1984d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:32.185+0000 7fef23f2a640 1 -- 172.21.15.7:0/1916290204 >> 172.21.15.7:0/1916290204 conn(0x7fef1c0fd8c0 msgr2=0x7fef1c0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:32.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:32.185+0000 7fef23f2a640 1 -- 172.21.15.7:0/1916290204 shutdown_connections 2024-09-19T08:42:32.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:32.185+0000 7fef23f2a640 1 -- 172.21.15.7:0/1916290204 wait complete. 2024-09-19T08:42:32.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:32 smithi007 ceph-mon[31221]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:32.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:32 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:32.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:32 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:32.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:32 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:32.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:32 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:32.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:32 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:32.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:32 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:32.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:32 smithi007 ceph-mon[31221]: Deploying daemon mds.b on smithi044 2024-09-19T08:42:32.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:32 smithi007 ceph-mon[31221]: mds.? [v2:172.21.15.7:6840/1259465331,v1:172.21.15.7:6841/1259465331] up:boot 2024-09-19T08:42:32.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:32 smithi007 ceph-mon[31221]: fsmap 11 up:standby 2024-09-19T08:42:32.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:32 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T08:42:32.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:32 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1916290204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:32.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:32 smithi044 ceph-mon[35072]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:32.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:32 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:32.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:32 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:32.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:32 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:32.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:32 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:32.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:32 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:32.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:32 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:32.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:32 smithi044 ceph-mon[35072]: Deploying daemon mds.b on smithi044 2024-09-19T08:42:32.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:32 smithi044 ceph-mon[35072]: mds.? [v2:172.21.15.7:6840/1259465331,v1:172.21.15.7:6841/1259465331] up:boot 2024-09-19T08:42:32.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:32 smithi044 ceph-mon[35072]: fsmap 11 up:standby 2024-09-19T08:42:32.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:32 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T08:42:32.802 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:32 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1916290204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:32.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:32 smithi175 ceph-mon[35688]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:32.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:32 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:32.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:32 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:32.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:32 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:32.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:32 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:42:32.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:32 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:42:32.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:32 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:32.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:32 smithi175 ceph-mon[35688]: Deploying daemon mds.b on smithi044 2024-09-19T08:42:32.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:32 smithi175 ceph-mon[35688]: mds.? [v2:172.21.15.7:6840/1259465331,v1:172.21.15.7:6841/1259465331] up:boot 2024-09-19T08:42:32.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:32 smithi175 ceph-mon[35688]: fsmap 11 up:standby 2024-09-19T08:42:32.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:32 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T08:42:32.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:32 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1916290204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:33.551 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 19 08:42:33 smithi044 systemd[1]: Starting Ceph mds.b for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:42:33.982 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 19 08:42:33 smithi044 podman[64876]: 2024-09-19 08:42:33.581512539 +0000 UTC m=+0.015889971 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:42:33.982 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 19 08:42:33 smithi044 podman[64876]: 2024-09-19 08:42:33.679666796 +0000 UTC m=+0.114044214 container create 322e2a45ab0fcdcd93a1ada7d039594b4f94cd5d880817bff26bd8a8cd39c79a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T08:42:33.982 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 19 08:42:33 smithi044 podman[64876]: 2024-09-19 08:42:33.882451612 +0000 UTC m=+0.316829030 container init 322e2a45ab0fcdcd93a1ada7d039594b4f94cd5d880817bff26bd8a8cd39c79a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T08:42:33.982 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 19 08:42:33 smithi044 podman[64876]: 2024-09-19 08:42:33.885319169 +0000 UTC m=+0.319696597 container start 322e2a45ab0fcdcd93a1ada7d039594b4f94cd5d880817bff26bd8a8cd39c79a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-b, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T08:42:33.982 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 19 08:42:33 smithi044 ceph-mds[64895]: -- 172.21.15.44:0/3589811049 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fe8f579860 con 0x55fe8f557000 2024-09-19T08:42:33.982 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 19 08:42:33 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-b[64891]: starting mds.b at 2024-09-19T08:42:33.982 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 19 08:42:33 smithi044 bash[64876]: 322e2a45ab0fcdcd93a1ada7d039594b4f94cd5d880817bff26bd8a8cd39c79a 2024-09-19T08:42:34.300 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 19 08:42:33 smithi044 systemd[1]: Started Ceph mds.b for ebd23124-7661-11ef-bceb-c7b262605968. 2024-09-19T08:42:34.758 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:34 smithi175 ceph-mon[35688]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:34.758 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:34 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:34.758 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:34 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:34.758 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:34 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:34.758 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:34 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:34.758 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:34 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:34.758 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:34 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:42:34.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:34 smithi007 ceph-mon[31221]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:34.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:34 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:34.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:34 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:34.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:34 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:34.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:34 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:34.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:34 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:34.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:34 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:42:34.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:34 smithi044 ceph-mon[35072]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:34.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:34 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:34.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:34 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:34.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:34 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:34.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:34 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:34.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:34 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:34.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:34 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:42:34.819 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:42:35.214 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:35.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:35 smithi007 ceph-mon[31221]: mds.? [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] up:boot 2024-09-19T08:42:35.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:35 smithi007 ceph-mon[31221]: fsmap 12 up:standby 2024-09-19T08:42:35.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:35 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:42:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.717+0000 7f7e450be640 1 -- 172.21.15.7:0/119988275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e40102d20 msgr2=0x7f7e40103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.717+0000 7f7e450be640 1 --2- 172.21.15.7:0/119988275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e40102d20 0x7f7e40103100 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7e30009900 tx=0x7f7e3002a480 comp rx=0 tx=0).stop 2024-09-19T08:42:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.717+0000 7f7e450be640 1 -- 172.21.15.7:0/119988275 shutdown_connections 2024-09-19T08:42:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.717+0000 7f7e450be640 1 --2- 172.21.15.7:0/119988275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e4010c150 0x7f7e4010e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.717+0000 7f7e450be640 1 --2- 172.21.15.7:0/119988275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e40103640 0x7f7e4010bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.717+0000 7f7e450be640 1 --2- 172.21.15.7:0/119988275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e40102d20 0x7f7e40103100 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.717+0000 7f7e450be640 1 -- 172.21.15.7:0/119988275 >> 172.21.15.7:0/119988275 conn(0x7f7e400fc780 msgr2=0x7f7e400feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.717+0000 7f7e450be640 1 -- 172.21.15.7:0/119988275 shutdown_connections 2024-09-19T08:42:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.717+0000 7f7e450be640 1 -- 172.21.15.7:0/119988275 wait complete. 2024-09-19T08:42:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.718+0000 7f7e450be640 1 Processor -- start 2024-09-19T08:42:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.718+0000 7f7e450be640 1 -- start start 2024-09-19T08:42:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.718+0000 7f7e450be640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e40102d20 0x7f7e40100980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.718+0000 7f7e450be640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e40103640 0x7f7e40100ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.718+0000 7f7e450be640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e4010c150 0x7f7e40101400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.718+0000 7f7e450be640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7e40111fa0 con 0x7f7e4010c150 2024-09-19T08:42:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.718+0000 7f7e450be640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7e40111e20 con 0x7f7e40102d20 2024-09-19T08:42:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.718+0000 7f7e450be640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7e40112120 con 0x7f7e40103640 2024-09-19T08:42:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.718+0000 7f7e3f59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e4010c150 0x7f7e40101400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.718+0000 7f7e3ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e40102d20 0x7f7e40100980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.718+0000 7f7e3f59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e4010c150 0x7f7e40101400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58508/0 (socket says 172.21.15.7:58508) 2024-09-19T08:42:35.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.718+0000 7f7e3f59e640 1 -- 172.21.15.7:0/1000575508 learned_addr learned my addr 172.21.15.7:0/1000575508 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:42:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.719+0000 7f7e3e59c640 1 --2- 172.21.15.7:0/1000575508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e40103640 0x7f7e40100ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.719+0000 7f7e3f59e640 1 -- 172.21.15.7:0/1000575508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e40103640 msgr2=0x7f7e40100ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.719+0000 7f7e3f59e640 1 --2- 172.21.15.7:0/1000575508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e40103640 0x7f7e40100ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.719+0000 7f7e3f59e640 1 -- 172.21.15.7:0/1000575508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e40102d20 msgr2=0x7f7e40100980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.719+0000 7f7e3f59e640 1 --2- 172.21.15.7:0/1000575508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e40102d20 0x7f7e40100980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.719+0000 7f7e3f59e640 1 -- 172.21.15.7:0/1000575508 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e401a6900 con 0x7f7e4010c150 2024-09-19T08:42:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.719+0000 7f7e3f59e640 1 --2- 172.21.15.7:0/1000575508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e4010c150 0x7f7e40101400 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800eb10 tx=0x7f7e3800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.721+0000 7f7e37fff640 1 -- 172.21.15.7:0/1000575508 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e38004b20 con 0x7f7e4010c150 2024-09-19T08:42:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.722+0000 7f7e450be640 1 -- 172.21.15.7:0/1000575508 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e401a6bf0 con 0x7f7e4010c150 2024-09-19T08:42:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.722+0000 7f7e450be640 1 -- 172.21.15.7:0/1000575508 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e401a7180 con 0x7f7e4010c150 2024-09-19T08:42:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.722+0000 7f7e37fff640 1 -- 172.21.15.7:0/1000575508 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e38004cc0 con 0x7f7e4010c150 2024-09-19T08:42:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.722+0000 7f7e37fff640 1 -- 172.21.15.7:0/1000575508 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e38010690 con 0x7f7e4010c150 2024-09-19T08:42:35.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.723+0000 7f7e450be640 1 -- 172.21.15.7:0/1000575508 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e20005290 con 0x7f7e4010c150 2024-09-19T08:42:35.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.724+0000 7f7e37fff640 1 -- 172.21.15.7:0/1000575508 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f7e38005000 con 0x7f7e4010c150 2024-09-19T08:42:35.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.725+0000 7f7e37fff640 1 --2- 172.21.15.7:0/1000575508 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f7e2c0a3240 0x7f7e2c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:35.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.725+0000 7f7e3ed9d640 1 --2- 172.21.15.7:0/1000575508 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f7e2c0a3240 0x7f7e2c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:35.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.725+0000 7f7e37fff640 1 -- 172.21.15.7:0/1000575508 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f7e380cf840 con 0x7f7e4010c150 2024-09-19T08:42:35.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.725+0000 7f7e3ed9d640 1 --2- 172.21.15.7:0/1000575508 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f7e2c0a3240 0x7f7e2c0a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7e30000c00 tx=0x7f7e30005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:35.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.729+0000 7f7e37fff640 1 -- 172.21.15.7:0/1000575508 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7e3809ca00 con 0x7f7e4010c150 2024-09-19T08:42:35.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:35 smithi044 ceph-mon[35072]: mds.? [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] up:boot 2024-09-19T08:42:35.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:35 smithi044 ceph-mon[35072]: fsmap 12 up:standby 2024-09-19T08:42:35.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:35 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:42:35.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:35 smithi175 ceph-mon[35688]: mds.? [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] up:boot 2024-09-19T08:42:35.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:35 smithi175 ceph-mon[35688]: fsmap 12 up:standby 2024-09-19T08:42:35.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:35 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:42:35.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.972+0000 7f7e450be640 1 -- 172.21.15.7:0/1000575508 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e20005850 con 0x7f7e4010c150 2024-09-19T08:42:35.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.973+0000 7f7e37fff640 1 -- 172.21.15.7:0/1000575508 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10512 (secure 0 0 0) 0x7f7e3809c300 con 0x7f7e4010c150 2024-09-19T08:42:35.973 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:42:35.973 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":13,"btime":"2024-09-19T08:42:34:450528+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24491,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-19T08:42:35.974 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 13 2024-09-19T08:42:35.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.975+0000 7f7e450be640 1 -- 172.21.15.7:0/1000575508 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f7e2c0a3240 msgr2=0x7f7e2c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.975+0000 7f7e450be640 1 --2- 172.21.15.7:0/1000575508 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f7e2c0a3240 0x7f7e2c0a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7e30000c00 tx=0x7f7e30005b50 comp rx=0 tx=0).stop 2024-09-19T08:42:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.975+0000 7f7e450be640 1 -- 172.21.15.7:0/1000575508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e4010c150 msgr2=0x7f7e40101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.975+0000 7f7e450be640 1 --2- 172.21.15.7:0/1000575508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e4010c150 0x7f7e40101400 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800eb10 tx=0x7f7e3800c2d0 comp rx=0 tx=0).stop 2024-09-19T08:42:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.975+0000 7f7e450be640 1 -- 172.21.15.7:0/1000575508 shutdown_connections 2024-09-19T08:42:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.975+0000 7f7e450be640 1 --2- 172.21.15.7:0/1000575508 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f7e2c0a3240 0x7f7e2c0a5700 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.976+0000 7f7e450be640 1 --2- 172.21.15.7:0/1000575508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e4010c150 0x7f7e40101400 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.976+0000 7f7e450be640 1 --2- 172.21.15.7:0/1000575508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e40103640 0x7f7e40100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.976+0000 7f7e450be640 1 --2- 172.21.15.7:0/1000575508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e40102d20 0x7f7e40100980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.976+0000 7f7e450be640 1 -- 172.21.15.7:0/1000575508 >> 172.21.15.7:0/1000575508 conn(0x7f7e400fc780 msgr2=0x7f7e400fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.976+0000 7f7e450be640 1 -- 172.21.15.7:0/1000575508 shutdown_connections 2024-09-19T08:42:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:35.976+0000 7f7e450be640 1 -- 172.21.15.7:0/1000575508 wait complete. 2024-09-19T08:42:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:36 smithi007 ceph-mon[31221]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:36 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:36 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1000575508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:36.879 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T08:42:36.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:36 smithi175 ceph-mon[35688]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:36.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:36.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:36.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:36.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:36 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:36.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:36 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1000575508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:36.989 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:36 smithi044 ceph-mon[35072]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:36.989 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:36 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:36.989 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:36 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:36.989 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:36 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:36.989 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:36 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:36.990 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:36 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1000575508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:42:37.155 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:37.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.610+0000 7f1e4ef3d640 1 -- 172.21.15.7:0/2824416245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e48100a80 msgr2=0x7f1e48100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:37.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.610+0000 7f1e4ef3d640 1 --2- 172.21.15.7:0/2824416245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e48100a80 0x7f1e48100ee0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009930 tx=0x7f1e3402a420 comp rx=0 tx=0).stop 2024-09-19T08:42:37.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.610+0000 7f1e4ef3d640 1 -- 172.21.15.7:0/2824416245 shutdown_connections 2024-09-19T08:42:37.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.610+0000 7f1e4ef3d640 1 --2- 172.21.15.7:0/2824416245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e48101420 0x7f1e4810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:37.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.610+0000 7f1e4ef3d640 1 --2- 172.21.15.7:0/2824416245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e48100a80 0x7f1e48100ee0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:37.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.610+0000 7f1e4ef3d640 1 --2- 172.21.15.7:0/2824416245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e48106a80 0x7f1e48106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:37.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.610+0000 7f1e4ef3d640 1 -- 172.21.15.7:0/2824416245 >> 172.21.15.7:0/2824416245 conn(0x7f1e480fc7a0 msgr2=0x7f1e480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:37.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.610+0000 7f1e4ef3d640 1 -- 172.21.15.7:0/2824416245 shutdown_connections 2024-09-19T08:42:37.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.610+0000 7f1e4ef3d640 1 -- 172.21.15.7:0/2824416245 wait complete. 2024-09-19T08:42:37.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.611+0000 7f1e4ef3d640 1 Processor -- start 2024-09-19T08:42:37.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.611+0000 7f1e4ef3d640 1 -- start start 2024-09-19T08:42:37.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.611+0000 7f1e4ef3d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e48100a80 0x7f1e48198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:37.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.611+0000 7f1e4ef3d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e48101420 0x7f1e481989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:37.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.611+0000 7f1e4ef3d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e48106a80 0x7f1e4819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:37.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.611+0000 7f1e4ef3d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1e48110e80 con 0x7f1e48101420 2024-09-19T08:42:37.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.611+0000 7f1e4ef3d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1e48110d00 con 0x7f1e48100a80 2024-09-19T08:42:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.611+0000 7f1e4ef3d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1e48111000 con 0x7f1e48106a80 2024-09-19T08:42:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.611+0000 7f1e47fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e48101420 0x7f1e481989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.611+0000 7f1e47fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e48101420 0x7f1e481989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58526/0 (socket says 172.21.15.7:58526) 2024-09-19T08:42:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.611+0000 7f1e47fff640 1 -- 172.21.15.7:0/3327085552 learned_addr learned my addr 172.21.15.7:0/3327085552 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:42:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.611+0000 7f1e4ccd9640 1 --2- 172.21.15.7:0/3327085552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e48100a80 0x7f1e48198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.611+0000 7f1e47fff640 1 -- 172.21.15.7:0/3327085552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e48106a80 msgr2=0x7f1e4819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.611+0000 7f1e47fff640 1 --2- 172.21.15.7:0/3327085552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e48106a80 0x7f1e4819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.611+0000 7f1e47fff640 1 -- 172.21.15.7:0/3327085552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e48100a80 msgr2=0x7f1e48198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.611+0000 7f1e47fff640 1 --2- 172.21.15.7:0/3327085552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e48100a80 0x7f1e48198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.611+0000 7f1e47fff640 1 -- 172.21.15.7:0/3327085552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4819d440 con 0x7f1e48101420 2024-09-19T08:42:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.612+0000 7f1e47fff640 1 --2- 172.21.15.7:0/3327085552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e48101420 0x7f1e481989d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009230 tx=0x7f1e34004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.612+0000 7f1e45ffb640 1 -- 172.21.15.7:0/3327085552 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3403f030 con 0x7f1e48101420 2024-09-19T08:42:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.612+0000 7f1e4ef3d640 1 -- 172.21.15.7:0/3327085552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4819d6d0 con 0x7f1e48101420 2024-09-19T08:42:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.612+0000 7f1e45ffb640 1 -- 172.21.15.7:0/3327085552 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e34003ad0 con 0x7f1e48101420 2024-09-19T08:42:37.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.612+0000 7f1e45ffb640 1 -- 172.21.15.7:0/3327085552 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e34035070 con 0x7f1e48101420 2024-09-19T08:42:37.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.612+0000 7f1e4ef3d640 1 -- 172.21.15.7:0/3327085552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e481a5010 con 0x7f1e48101420 2024-09-19T08:42:37.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.613+0000 7f1e4ef3d640 1 -- 172.21.15.7:0/3327085552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e481021c0 con 0x7f1e48101420 2024-09-19T08:42:37.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.615+0000 7f1e45ffb640 1 -- 172.21.15.7:0/3327085552 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f1e34042030 con 0x7f1e48101420 2024-09-19T08:42:37.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.616+0000 7f1e45ffb640 1 --2- 172.21.15.7:0/3327085552 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1e380a3240 0x7f1e380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:37.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.616+0000 7f1e45ffb640 1 -- 172.21.15.7:0/3327085552 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f1e340effd0 con 0x7f1e48101420 2024-09-19T08:42:37.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.616+0000 7f1e4ccd9640 1 --2- 172.21.15.7:0/3327085552 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1e380a3240 0x7f1e380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:37.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.616+0000 7f1e4ccd9640 1 --2- 172.21.15.7:0/3327085552 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1e380a3240 0x7f1e380a5700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00bb60 tx=0x7f1e3c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:37.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.619+0000 7f1e45ffb640 1 -- 172.21.15.7:0/3327085552 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1e340bd0f0 con 0x7f1e48101420 2024-09-19T08:42:37.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.842+0000 7f1e4ef3d640 1 -- 172.21.15.7:0/3327085552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1e48100ee0 con 0x7f1e48101420 2024-09-19T08:42:37.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.843+0000 7f1e45ffb640 1 -- 172.21.15.7:0/3327085552 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) ==== 84+0+65 (secure 0 0 0) 0x7f1e48100ee0 con 0x7f1e48101420 2024-09-19T08:42:37.843 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:42:37.843 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-09-19T08:42:37.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:42:37.843 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-09-19T08:42:37.843 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-09-19T08:42:37.843 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:42:37.843 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-09-19T08:42:37.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.845+0000 7f1e4ef3d640 1 -- 172.21.15.7:0/3327085552 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1e380a3240 msgr2=0x7f1e380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:37.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.845+0000 7f1e4ef3d640 1 --2- 172.21.15.7:0/3327085552 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1e380a3240 0x7f1e380a5700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00bb60 tx=0x7f1e3c00b390 comp rx=0 tx=0).stop 2024-09-19T08:42:37.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.845+0000 7f1e4ef3d640 1 -- 172.21.15.7:0/3327085552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e48101420 msgr2=0x7f1e481989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:37.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.845+0000 7f1e4ef3d640 1 --2- 172.21.15.7:0/3327085552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e48101420 0x7f1e481989d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009230 tx=0x7f1e34004270 comp rx=0 tx=0).stop 2024-09-19T08:42:37.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.845+0000 7f1e4ef3d640 1 -- 172.21.15.7:0/3327085552 shutdown_connections 2024-09-19T08:42:37.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.845+0000 7f1e4ef3d640 1 --2- 172.21.15.7:0/3327085552 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1e380a3240 0x7f1e380a5700 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:37.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.845+0000 7f1e4ef3d640 1 --2- 172.21.15.7:0/3327085552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e48106a80 0x7f1e4819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:37.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.845+0000 7f1e4ef3d640 1 --2- 172.21.15.7:0/3327085552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e48101420 0x7f1e481989d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:37.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.845+0000 7f1e4ef3d640 1 --2- 172.21.15.7:0/3327085552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e48100a80 0x7f1e48198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:37.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.845+0000 7f1e4ef3d640 1 -- 172.21.15.7:0/3327085552 >> 172.21.15.7:0/3327085552 conn(0x7f1e480fc7a0 msgr2=0x7f1e4806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:37.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.845+0000 7f1e4ef3d640 1 -- 172.21.15.7:0/3327085552 shutdown_connections 2024-09-19T08:42:37.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:37.845+0000 7f1e4ef3d640 1 -- 172.21.15.7:0/3327085552 wait complete. 2024-09-19T08:42:37.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:37 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:37.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:37 smithi175 ceph-mon[35688]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:37.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:37 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:37.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:37 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:37.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:37 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:37.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:37 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:42:37.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:37 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:37.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:37 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:42:38.009 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:37 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:38.009 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:37 smithi044 ceph-mon[35072]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:38.009 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:37 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:38.009 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:37 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:38.009 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:37 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:38.009 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:37 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:42:38.009 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:37 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:38.009 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:37 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:42:38.152 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:37 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:38.152 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:37 smithi007 ceph-mon[31221]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:38.152 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:37 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:38.152 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:37 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:38.152 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:37 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:38.152 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:37 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:42:38.152 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:37 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:38.152 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:37 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:42:39.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:38 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3327085552' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T08:42:39.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:38 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:39.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:38 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:39.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:38 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:39.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:38 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:39.051 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T08:42:39.051 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T08:42:39.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:38 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3327085552' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T08:42:39.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:38 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:39.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:38 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:39.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:38 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:39.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:38 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:39.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:38 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3327085552' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T08:42:39.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:38 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:39.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:38 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:39.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:38 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:39.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:38 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:39.332 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:39.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.793+0000 7f410a61c640 1 -- 172.21.15.7:0/3134744596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41041082a0 msgr2=0x7f410410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:39.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.793+0000 7f410a61c640 1 --2- 172.21.15.7:0/3134744596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41041082a0 0x7f410410ec40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f40fc009cd0 tx=0x7f40fc02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:42:39.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.793+0000 7f410a61c640 1 -- 172.21.15.7:0/3134744596 shutdown_connections 2024-09-19T08:42:39.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.793+0000 7f410a61c640 1 --2- 172.21.15.7:0/3134744596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41041082a0 0x7f410410ec40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:39.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.793+0000 7f410a61c640 1 --2- 172.21.15.7:0/3134744596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41041036e0 0x7f4104107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:39.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.793+0000 7f410a61c640 1 --2- 172.21.15.7:0/3134744596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4104102d30 0x7f4104103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:39.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.793+0000 7f410a61c640 1 -- 172.21.15.7:0/3134744596 >> 172.21.15.7:0/3134744596 conn(0x7f41040fc7d0 msgr2=0x7f41040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:39.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.793+0000 7f410a61c640 1 -- 172.21.15.7:0/3134744596 shutdown_connections 2024-09-19T08:42:39.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.793+0000 7f410a61c640 1 -- 172.21.15.7:0/3134744596 wait complete. 2024-09-19T08:42:39.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.794+0000 7f410a61c640 1 Processor -- start 2024-09-19T08:42:39.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.794+0000 7f410a61c640 1 -- start start 2024-09-19T08:42:39.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.794+0000 7f410a61c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4104102d30 0x7f4104198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:39.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.794+0000 7f410a61c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41041036e0 0x7f4104198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:39.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.794+0000 7f410a61c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41041082a0 0x7f410419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:39.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.794+0000 7f410a61c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f41041120a0 con 0x7f41041082a0 2024-09-19T08:42:39.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.794+0000 7f410a61c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4104111f20 con 0x7f41041036e0 2024-09-19T08:42:39.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.794+0000 7f410a61c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4104112220 con 0x7f4104102d30 2024-09-19T08:42:39.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.795+0000 7f4108bb9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41041082a0 0x7f410419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:39.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.795+0000 7f4108bb9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41041082a0 0x7f410419ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58544/0 (socket says 172.21.15.7:58544) 2024-09-19T08:42:39.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.795+0000 7f4108bb9640 1 -- 172.21.15.7:0/1940608064 learned_addr learned my addr 172.21.15.7:0/1940608064 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:42:39.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.795+0000 7f4103fff640 1 --2- 172.21.15.7:0/1940608064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4104102d30 0x7f4104198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:39.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.795+0000 7f41037fe640 1 --2- 172.21.15.7:0/1940608064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41041036e0 0x7f4104198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:39.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.795+0000 7f4108bb9640 1 -- 172.21.15.7:0/1940608064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4104102d30 msgr2=0x7f4104198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:39.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.795+0000 7f4108bb9640 1 --2- 172.21.15.7:0/1940608064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4104102d30 0x7f4104198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:39.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.795+0000 7f4108bb9640 1 -- 172.21.15.7:0/1940608064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41041036e0 msgr2=0x7f4104198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:39.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.795+0000 7f4108bb9640 1 --2- 172.21.15.7:0/1940608064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41041036e0 0x7f4104198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:39.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.795+0000 7f4108bb9640 1 -- 172.21.15.7:0/1940608064 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f410419d520 con 0x7f41041082a0 2024-09-19T08:42:39.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.795+0000 7f4103fff640 1 --2- 172.21.15.7:0/1940608064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4104102d30 0x7f4104198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:42:39.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.795+0000 7f4108bb9640 1 --2- 172.21.15.7:0/1940608064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41041082a0 0x7f410419ce40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f40fc005cc0 tx=0x7f40fc032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:39.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.795+0000 7f41017fa640 1 -- 172.21.15.7:0/1940608064 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40fc004040 con 0x7f41041082a0 2024-09-19T08:42:39.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.795+0000 7f41017fa640 1 -- 172.21.15.7:0/1940608064 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40fc0046c0 con 0x7f41041082a0 2024-09-19T08:42:39.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.795+0000 7f410a61c640 1 -- 172.21.15.7:0/1940608064 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f410419d7b0 con 0x7f41041082a0 2024-09-19T08:42:39.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.795+0000 7f41017fa640 1 -- 172.21.15.7:0/1940608064 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40fc030e00 con 0x7f41041082a0 2024-09-19T08:42:39.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.796+0000 7f410a61c640 1 -- 172.21.15.7:0/1940608064 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41041a50f0 con 0x7f41041082a0 2024-09-19T08:42:39.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.797+0000 7f410a61c640 1 -- 172.21.15.7:0/1940608064 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4104103110 con 0x7f41041082a0 2024-09-19T08:42:39.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.798+0000 7f41017fa640 1 -- 172.21.15.7:0/1940608064 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f40fc0305a0 con 0x7f41041082a0 2024-09-19T08:42:39.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.798+0000 7f41017fa640 1 --2- 172.21.15.7:0/1940608064 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f40ec0a32c0 0x7f40ec0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:39.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.799+0000 7f4103fff640 1 --2- 172.21.15.7:0/1940608064 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f40ec0a32c0 0x7f40ec0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:39.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.799+0000 7f41017fa640 1 -- 172.21.15.7:0/1940608064 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f40fc02e030 con 0x7f41041082a0 2024-09-19T08:42:39.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.799+0000 7f4103fff640 1 --2- 172.21.15.7:0/1940608064 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f40ec0a32c0 0x7f40ec0a5780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f40f400bfd0 tx=0x7f40f400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:39.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.803+0000 7f41017fa640 1 -- 172.21.15.7:0/1940608064 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f40fc04b060 con 0x7f41041082a0 2024-09-19T08:42:39.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:39.992+0000 7f410a61c640 1 -- 172.21.15.7:0/1940608064 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f410410a2b0 con 0x7f41041082a0 2024-09-19T08:42:39.993 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:39 smithi007 ceph-mon[31221]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:40.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:39 smithi175 ceph-mon[35688]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:40.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:39 smithi044 ceph-mon[35072]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:40.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:40.911+0000 7f41017fa640 1 -- 172.21.15.7:0/1940608064 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) ==== 138+0+0 (secure 0 0 0) 0x7f40fc0bdd20 con 0x7f41041082a0 2024-09-19T08:42:40.911 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-09-19T08:42:40.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:40.915+0000 7f410a61c640 1 -- 172.21.15.7:0/1940608064 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f40ec0a32c0 msgr2=0x7f40ec0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:40.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:40.915+0000 7f410a61c640 1 --2- 172.21.15.7:0/1940608064 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f40ec0a32c0 0x7f40ec0a5780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f40f400bfd0 tx=0x7f40f400b390 comp rx=0 tx=0).stop 2024-09-19T08:42:40.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:40.915+0000 7f410a61c640 1 -- 172.21.15.7:0/1940608064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41041082a0 msgr2=0x7f410419ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:40.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:40.915+0000 7f410a61c640 1 --2- 172.21.15.7:0/1940608064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41041082a0 0x7f410419ce40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f40fc005cc0 tx=0x7f40fc032f40 comp rx=0 tx=0).stop 2024-09-19T08:42:40.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:40.915+0000 7f410a61c640 1 -- 172.21.15.7:0/1940608064 shutdown_connections 2024-09-19T08:42:40.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:40.915+0000 7f410a61c640 1 --2- 172.21.15.7:0/1940608064 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f40ec0a32c0 0x7f40ec0a5780 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:40.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:40.915+0000 7f410a61c640 1 --2- 172.21.15.7:0/1940608064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41041082a0 0x7f410419ce40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:40.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:40.915+0000 7f410a61c640 1 --2- 172.21.15.7:0/1940608064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41041036e0 0x7f4104198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:40.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:40.915+0000 7f410a61c640 1 --2- 172.21.15.7:0/1940608064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4104102d30 0x7f4104198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:40.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:40.915+0000 7f410a61c640 1 -- 172.21.15.7:0/1940608064 >> 172.21.15.7:0/1940608064 conn(0x7f41040fc7d0 msgr2=0x7f4104105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:40.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:40.916+0000 7f410a61c640 1 -- 172.21.15.7:0/1940608064 shutdown_connections 2024-09-19T08:42:40.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:40.916+0000 7f410a61c640 1 -- 172.21.15.7:0/1940608064 wait complete. 2024-09-19T08:42:41.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:40 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:41.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:40 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:41.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:40 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:41.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:40 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:42:41.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:40 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:41.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:40 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1940608064' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T08:42:41.252 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:40 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:41.252 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:40 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:41.252 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:40 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:41.252 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:40 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:42:41.252 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:40 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:41.252 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:40 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1940608064' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T08:42:41.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:41.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:41.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:41.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:42:41.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:42:41.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:40 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1940608064' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T08:42:41.546 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T08:42:41.808 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:42.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:41 smithi175 ceph-mon[35688]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:42.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:41 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1940608064' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T08:42:42.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:41 smithi175 ceph-mon[35688]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T08:42:42.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:41 smithi007 ceph-mon[31221]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:42.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:41 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1940608064' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T08:42:42.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:41 smithi007 ceph-mon[31221]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T08:42:42.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:41 smithi044 ceph-mon[35072]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:42.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:41 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1940608064' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T08:42:42.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:41 smithi044 ceph-mon[35072]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T08:42:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.387+0000 7fd0f9fd9640 1 -- 172.21.15.7:0/3697752090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0f41082a0 msgr2=0x7fd0f410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.387+0000 7fd0f9fd9640 1 --2- 172.21.15.7:0/3697752090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0f41082a0 0x7fd0f410ec40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009cd0 tx=0x7fd0ec02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:42:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.387+0000 7fd0f9fd9640 1 -- 172.21.15.7:0/3697752090 shutdown_connections 2024-09-19T08:42:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.387+0000 7fd0f9fd9640 1 --2- 172.21.15.7:0/3697752090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0f41082a0 0x7fd0f410ec40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.387+0000 7fd0f9fd9640 1 --2- 172.21.15.7:0/3697752090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0f41036e0 0x7fd0f4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.387+0000 7fd0f9fd9640 1 --2- 172.21.15.7:0/3697752090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0f4102d30 0x7fd0f4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.387+0000 7fd0f9fd9640 1 -- 172.21.15.7:0/3697752090 >> 172.21.15.7:0/3697752090 conn(0x7fd0f40fc7d0 msgr2=0x7fd0f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.387+0000 7fd0f9fd9640 1 -- 172.21.15.7:0/3697752090 shutdown_connections 2024-09-19T08:42:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.387+0000 7fd0f9fd9640 1 -- 172.21.15.7:0/3697752090 wait complete. 2024-09-19T08:42:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.388+0000 7fd0f9fd9640 1 Processor -- start 2024-09-19T08:42:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.388+0000 7fd0f9fd9640 1 -- start start 2024-09-19T08:42:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.388+0000 7fd0f9fd9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0f4102d30 0x7fd0f4100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.388+0000 7fd0f9fd9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0f41036e0 0x7fd0f4100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.388+0000 7fd0f9fd9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0f41082a0 0x7fd0f4101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.388+0000 7fd0f9fd9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f41120a0 con 0x7fd0f41036e0 2024-09-19T08:42:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.388+0000 7fd0f9fd9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f4111f20 con 0x7fd0f4102d30 2024-09-19T08:42:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.388+0000 7fd0f9fd9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f4112220 con 0x7fd0f41082a0 2024-09-19T08:42:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.388+0000 7fd0eaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0f41036e0 0x7fd0f4100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.388+0000 7fd0eaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0f41036e0 0x7fd0f4100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58568/0 (socket says 172.21.15.7:58568) 2024-09-19T08:42:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.388+0000 7fd0eaffd640 1 -- 172.21.15.7:0/203992785 learned_addr learned my addr 172.21.15.7:0/203992785 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:42:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.388+0000 7fd0f37fe640 1 --2- 172.21.15.7:0/203992785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0f4102d30 0x7fd0f4100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.388+0000 7fd0f3fff640 1 --2- 172.21.15.7:0/203992785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0f41082a0 0x7fd0f4101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.389+0000 7fd0eaffd640 1 -- 172.21.15.7:0/203992785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0f41082a0 msgr2=0x7fd0f4101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.389+0000 7fd0eaffd640 1 --2- 172.21.15.7:0/203992785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0f41082a0 0x7fd0f4101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.389+0000 7fd0eaffd640 1 -- 172.21.15.7:0/203992785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0f4102d30 msgr2=0x7fd0f4100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.389+0000 7fd0eaffd640 1 --2- 172.21.15.7:0/203992785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0f4102d30 0x7fd0f4100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.389+0000 7fd0eaffd640 1 -- 172.21.15.7:0/203992785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0f41a6a60 con 0x7fd0f41036e0 2024-09-19T08:42:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.389+0000 7fd0f3fff640 1 --2- 172.21.15.7:0/203992785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0f41082a0 0x7fd0f4101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:42:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.389+0000 7fd0eaffd640 1 --2- 172.21.15.7:0/203992785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0f41036e0 0x7fd0f4100ed0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00d750 tx=0x7fd0dc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.389+0000 7fd0f17fa640 1 -- 172.21.15.7:0/203992785 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc017070 con 0x7fd0f41036e0 2024-09-19T08:42:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.389+0000 7fd0f9fd9640 1 -- 172.21.15.7:0/203992785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0f41a6d50 con 0x7fd0f41036e0 2024-09-19T08:42:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.389+0000 7fd0f17fa640 1 -- 172.21.15.7:0/203992785 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0dc005500 con 0x7fd0f41036e0 2024-09-19T08:42:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.389+0000 7fd0f17fa640 1 -- 172.21.15.7:0/203992785 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc004e00 con 0x7fd0f41036e0 2024-09-19T08:42:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.389+0000 7fd0f9fd9640 1 -- 172.21.15.7:0/203992785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0f41a71e0 con 0x7fd0f41036e0 2024-09-19T08:42:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.390+0000 7fd0f9fd9640 1 -- 172.21.15.7:0/203992785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0f4103110 con 0x7fd0f41036e0 2024-09-19T08:42:42.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.392+0000 7fd0f17fa640 1 -- 172.21.15.7:0/203992785 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fd0dc004fa0 con 0x7fd0f41036e0 2024-09-19T08:42:42.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.393+0000 7fd0f17fa640 1 --2- 172.21.15.7:0/203992785 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd0e00a3240 0x7fd0e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:42.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.393+0000 7fd0f37fe640 1 --2- 172.21.15.7:0/203992785 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd0e00a3240 0x7fd0e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:42.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.393+0000 7fd0f17fa640 1 -- 172.21.15.7:0/203992785 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7497+0+0 (secure 0 0 0) 0x7fd0dc0cf2b0 con 0x7fd0f41036e0 2024-09-19T08:42:42.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.393+0000 7fd0f37fe640 1 --2- 172.21.15.7:0/203992785 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd0e00a3240 0x7fd0e00a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4009bd0 tx=0x7fd0e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:42.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.396+0000 7fd0f17fa640 1 -- 172.21.15.7:0/203992785 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd0dc09c300 con 0x7fd0f41036e0 2024-09-19T08:42:42.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:42.575+0000 7fd0f9fd9640 1 -- 172.21.15.7:0/203992785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd0f410a2b0 con 0x7fd0f41036e0 2024-09-19T08:42:43.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:43.008+0000 7fd0f17fa640 1 -- 172.21.15.7:0/203992785 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) ==== 170+0+0 (secure 0 0 0) 0x7fd0dc09bc00 con 0x7fd0f41036e0 2024-09-19T08:42:43.009 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-09-19T08:42:43.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:43.011+0000 7fd0f9fd9640 1 -- 172.21.15.7:0/203992785 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd0e00a3240 msgr2=0x7fd0e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:43.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:43.011+0000 7fd0f9fd9640 1 --2- 172.21.15.7:0/203992785 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd0e00a3240 0x7fd0e00a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4009bd0 tx=0x7fd0e4005f90 comp rx=0 tx=0).stop 2024-09-19T08:42:43.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:43.011+0000 7fd0f9fd9640 1 -- 172.21.15.7:0/203992785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0f41036e0 msgr2=0x7fd0f4100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:43.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:43.011+0000 7fd0f9fd9640 1 --2- 172.21.15.7:0/203992785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0f41036e0 0x7fd0f4100ed0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00d750 tx=0x7fd0dc00dc10 comp rx=0 tx=0).stop 2024-09-19T08:42:43.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:43.011+0000 7fd0f9fd9640 1 -- 172.21.15.7:0/203992785 shutdown_connections 2024-09-19T08:42:43.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:43.011+0000 7fd0f9fd9640 1 --2- 172.21.15.7:0/203992785 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd0e00a3240 0x7fd0e00a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:43.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:43.011+0000 7fd0f9fd9640 1 --2- 172.21.15.7:0/203992785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0f41082a0 0x7fd0f4101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:43.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:43.011+0000 7fd0f9fd9640 1 --2- 172.21.15.7:0/203992785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0f41036e0 0x7fd0f4100ed0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:43.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:43.011+0000 7fd0f9fd9640 1 --2- 172.21.15.7:0/203992785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0f4102d30 0x7fd0f4100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:43.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:43.011+0000 7fd0f9fd9640 1 -- 172.21.15.7:0/203992785 >> 172.21.15.7:0/203992785 conn(0x7fd0f40fc7d0 msgr2=0x7fd0f4106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:43.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:43.011+0000 7fd0f9fd9640 1 -- 172.21.15.7:0/203992785 shutdown_connections 2024-09-19T08:42:43.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:43.011+0000 7fd0f9fd9640 1 -- 172.21.15.7:0/203992785 wait complete. 2024-09-19T08:42:43.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:43 smithi007 ceph-mon[31221]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T08:42:43.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:43 smithi044 ceph-mon[35072]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T08:42:43.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:43 smithi175 ceph-mon[35688]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T08:42:43.612 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T08:42:43.867 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:44.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:44 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/203992785' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T08:42:44.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:44 smithi007 ceph-mon[31221]: pgmap v270: 33 pgs: 14 creating+peering, 5 active+clean, 14 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:44.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:44 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/203992785' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T08:42:44.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:44 smithi007 ceph-mon[31221]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T08:42:44.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:44 smithi007 ceph-mon[31221]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T08:42:44.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:44 smithi007 ceph-mon[31221]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T08:42:44.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:44 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/203992785' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T08:42:44.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:44 smithi044 ceph-mon[35072]: pgmap v270: 33 pgs: 14 creating+peering, 5 active+clean, 14 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:44.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:44 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/203992785' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T08:42:44.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:44 smithi044 ceph-mon[35072]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T08:42:44.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:44 smithi044 ceph-mon[35072]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T08:42:44.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:44 smithi044 ceph-mon[35072]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T08:42:44.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.364+0000 7fc8af117640 1 -- 172.21.15.7:0/107624821 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8a8106f20 msgr2=0x7fc8a810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:44.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.364+0000 7fc8af117640 1 --2- 172.21.15.7:0/107624821 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8a8106f20 0x7fc8a810eaa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0009ca0 tx=0x7fc8a002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:42:44.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.364+0000 7fc8af117640 1 -- 172.21.15.7:0/107624821 shutdown_connections 2024-09-19T08:42:44.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.364+0000 7fc8af117640 1 --2- 172.21.15.7:0/107624821 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8a8106f20 0x7fc8a810eaa0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:44.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.364+0000 7fc8af117640 1 --2- 172.21.15.7:0/107624821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8a81027a0 0x7fc8a81067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:44.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.364+0000 7fc8af117640 1 --2- 172.21.15.7:0/107624821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a8101df0 0x7fc8a81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:44.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.364+0000 7fc8af117640 1 -- 172.21.15.7:0/107624821 >> 172.21.15.7:0/107624821 conn(0x7fc8a80fd8b0 msgr2=0x7fc8a80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:44.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.364+0000 7fc8af117640 1 -- 172.21.15.7:0/107624821 shutdown_connections 2024-09-19T08:42:44.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.364+0000 7fc8af117640 1 -- 172.21.15.7:0/107624821 wait complete. 2024-09-19T08:42:44.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.365+0000 7fc8af117640 1 Processor -- start 2024-09-19T08:42:44.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.365+0000 7fc8af117640 1 -- start start 2024-09-19T08:42:44.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.365+0000 7fc8af117640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8a8101df0 0x7fc8a80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:44.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.365+0000 7fc8af117640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a81027a0 0x7fc8a8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:44.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.365+0000 7fc8af117640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8a8106f20 0x7fc8a8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:44.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.365+0000 7fc8af117640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a8111fa0 con 0x7fc8a8106f20 2024-09-19T08:42:44.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.365+0000 7fc8af117640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a8111e20 con 0x7fc8a8101df0 2024-09-19T08:42:44.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.365+0000 7fc8af117640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a8112120 con 0x7fc8a81027a0 2024-09-19T08:42:44.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.365+0000 7fc8ad6b4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8a8106f20 0x7fc8a8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:44.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.365+0000 7fc8ad6b4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8a8106f20 0x7fc8a8074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50422/0 (socket says 172.21.15.7:50422) 2024-09-19T08:42:44.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.365+0000 7fc8ad6b4640 1 -- 172.21.15.7:0/3848897269 learned_addr learned my addr 172.21.15.7:0/3848897269 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:42:44.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.365+0000 7fc8aceb3640 1 --2- 172.21.15.7:0/3848897269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8a8101df0 0x7fc8a80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:44.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.365+0000 7fc89ffff640 1 --2- 172.21.15.7:0/3848897269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a81027a0 0x7fc8a8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:44.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.366+0000 7fc8ad6b4640 1 -- 172.21.15.7:0/3848897269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a81027a0 msgr2=0x7fc8a8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:44.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.366+0000 7fc8ad6b4640 1 --2- 172.21.15.7:0/3848897269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a81027a0 0x7fc8a8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:44.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.366+0000 7fc8ad6b4640 1 -- 172.21.15.7:0/3848897269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8a8101df0 msgr2=0x7fc8a80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:44.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.366+0000 7fc8ad6b4640 1 --2- 172.21.15.7:0/3848897269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8a8101df0 0x7fc8a80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:44.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.366+0000 7fc8ad6b4640 1 -- 172.21.15.7:0/3848897269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a81a68e0 con 0x7fc8a8106f20 2024-09-19T08:42:44.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.366+0000 7fc89ffff640 1 --2- 172.21.15.7:0/3848897269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a81027a0 0x7fc8a8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:42:44.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.366+0000 7fc8ad6b4640 1 --2- 172.21.15.7:0/3848897269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8a8106f20 0x7fc8a8074f70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0031a60 tx=0x7fc8a0031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:44.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.366+0000 7fc89dffb640 1 -- 172.21.15.7:0/3848897269 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0003b70 con 0x7fc8a8106f20 2024-09-19T08:42:44.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.366+0000 7fc89dffb640 1 -- 172.21.15.7:0/3848897269 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8a0003d10 con 0x7fc8a8106f20 2024-09-19T08:42:44.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.366+0000 7fc8af117640 1 -- 172.21.15.7:0/3848897269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8a81a6b70 con 0x7fc8a8106f20 2024-09-19T08:42:44.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.366+0000 7fc89dffb640 1 -- 172.21.15.7:0/3848897269 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0004770 con 0x7fc8a8106f20 2024-09-19T08:42:44.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.366+0000 7fc8af117640 1 -- 172.21.15.7:0/3848897269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8a81a70b0 con 0x7fc8a8106f20 2024-09-19T08:42:44.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.367+0000 7fc8af117640 1 -- 172.21.15.7:0/3848897269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8a81021d0 con 0x7fc8a8106f20 2024-09-19T08:42:44.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.368+0000 7fc89dffb640 1 -- 172.21.15.7:0/3848897269 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fc8a0004b40 con 0x7fc8a8106f20 2024-09-19T08:42:44.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.369+0000 7fc89dffb640 1 --2- 172.21.15.7:0/3848897269 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc8900a3240 0x7fc8900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:44.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.369+0000 7fc89dffb640 1 -- 172.21.15.7:0/3848897269 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7879+0+0 (secure 0 0 0) 0x7fc8a00f0cd0 con 0x7fc8a8106f20 2024-09-19T08:42:44.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.369+0000 7fc8aceb3640 1 --2- 172.21.15.7:0/3848897269 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc8900a3240 0x7fc8900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:44.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.370+0000 7fc8aceb3640 1 --2- 172.21.15.7:0/3848897269 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc8900a3240 0x7fc8900a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009990 tx=0x7fc8a4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:44.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.372+0000 7fc89dffb640 1 -- 172.21.15.7:0/3848897269 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc8a00bdb00 con 0x7fc8a8106f20 2024-09-19T08:42:44.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:44 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/203992785' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T08:42:44.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:44 smithi175 ceph-mon[35688]: pgmap v270: 33 pgs: 14 creating+peering, 5 active+clean, 14 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:44.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:44 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/203992785' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T08:42:44.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:44 smithi175 ceph-mon[35688]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T08:42:44.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:44 smithi175 ceph-mon[35688]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T08:42:44.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:44 smithi175 ceph-mon[35688]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T08:42:44.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:44.585+0000 7fc8af117640 1 -- 172.21.15.7:0/3848897269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc8a8109b70 con 0x7fc8a8106f20 2024-09-19T08:42:45.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:45.031+0000 7fc89dffb640 1 -- 172.21.15.7:0/3848897269 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fc8a00bd400 con 0x7fc8a8106f20 2024-09-19T08:42:45.031 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T08:42:45.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:45.034+0000 7fc8af117640 1 -- 172.21.15.7:0/3848897269 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc8900a3240 msgr2=0x7fc8900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:45.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:45.034+0000 7fc8af117640 1 --2- 172.21.15.7:0/3848897269 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc8900a3240 0x7fc8900a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009990 tx=0x7fc8a4009110 comp rx=0 tx=0).stop 2024-09-19T08:42:45.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:45.034+0000 7fc8af117640 1 -- 172.21.15.7:0/3848897269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8a8106f20 msgr2=0x7fc8a8074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:45.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:45.034+0000 7fc8af117640 1 --2- 172.21.15.7:0/3848897269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8a8106f20 0x7fc8a8074f70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0031a60 tx=0x7fc8a0031a90 comp rx=0 tx=0).stop 2024-09-19T08:42:45.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:45.034+0000 7fc8af117640 1 -- 172.21.15.7:0/3848897269 shutdown_connections 2024-09-19T08:42:45.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:45.034+0000 7fc8af117640 1 --2- 172.21.15.7:0/3848897269 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc8900a3240 0x7fc8900a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:45.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:45.034+0000 7fc8af117640 1 --2- 172.21.15.7:0/3848897269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8a8106f20 0x7fc8a8074f70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:45.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:45.034+0000 7fc8af117640 1 --2- 172.21.15.7:0/3848897269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8a81027a0 0x7fc8a8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:45.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:45.034+0000 7fc8af117640 1 --2- 172.21.15.7:0/3848897269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8a8101df0 0x7fc8a80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:45.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:45.034+0000 7fc8af117640 1 -- 172.21.15.7:0/3848897269 >> 172.21.15.7:0/3848897269 conn(0x7fc8a80fd8b0 msgr2=0x7fc8a80feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:45.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:45.034+0000 7fc8af117640 1 -- 172.21.15.7:0/3848897269 shutdown_connections 2024-09-19T08:42:45.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:45.034+0000 7fc8af117640 1 -- 172.21.15.7:0/3848897269 wait complete. 2024-09-19T08:42:45.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:45 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3848897269' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T08:42:45.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:45 smithi007 ceph-mon[31221]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T08:42:45.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:45 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3848897269' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T08:42:45.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:45 smithi044 ceph-mon[35072]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T08:42:45.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:45 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3848897269' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T08:42:45.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:45 smithi175 ceph-mon[35688]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T08:42:45.677 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:42:45.939 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:46.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:46 smithi007 ceph-mon[31221]: pgmap v273: 97 pgs: 24 creating+peering, 20 active+clean, 53 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:46.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:46 smithi007 ceph-mon[31221]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T08:42:46.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:46 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3848897269' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T08:42:46.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:46 smithi007 ceph-mon[31221]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T08:42:46.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:46 smithi007 ceph-mon[31221]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T08:42:46.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:46 smithi044 ceph-mon[35072]: pgmap v273: 97 pgs: 24 creating+peering, 20 active+clean, 53 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:46.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:46 smithi044 ceph-mon[35072]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T08:42:46.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:46 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3848897269' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T08:42:46.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:46 smithi044 ceph-mon[35072]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T08:42:46.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:46 smithi044 ceph-mon[35072]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T08:42:46.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:46 smithi175 ceph-mon[35688]: pgmap v273: 97 pgs: 24 creating+peering, 20 active+clean, 53 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:42:46.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:46 smithi175 ceph-mon[35688]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T08:42:46.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:46 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3848897269' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T08:42:46.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:46 smithi175 ceph-mon[35688]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T08:42:46.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:46 smithi175 ceph-mon[35688]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T08:42:46.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.443+0000 7f76768bd640 1 -- 172.21.15.7:0/3537455272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7670106a80 msgr2=0x7f7670106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:46.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.443+0000 7f76768bd640 1 --2- 172.21.15.7:0/3537455272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7670106a80 0x7f7670106e60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7660009930 tx=0x7f766002a420 comp rx=0 tx=0).stop 2024-09-19T08:42:46.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.443+0000 7f76768bd640 1 -- 172.21.15.7:0/3537455272 shutdown_connections 2024-09-19T08:42:46.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.443+0000 7f76768bd640 1 --2- 172.21.15.7:0/3537455272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7670101420 0x7f767010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:46.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.443+0000 7f76768bd640 1 --2- 172.21.15.7:0/3537455272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7670100a80 0x7f7670100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:46.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.443+0000 7f76768bd640 1 --2- 172.21.15.7:0/3537455272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7670106a80 0x7f7670106e60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:46.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.443+0000 7f76768bd640 1 -- 172.21.15.7:0/3537455272 >> 172.21.15.7:0/3537455272 conn(0x7f76700fc7a0 msgr2=0x7f76700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:46.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.443+0000 7f76768bd640 1 -- 172.21.15.7:0/3537455272 shutdown_connections 2024-09-19T08:42:46.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.443+0000 7f76768bd640 1 -- 172.21.15.7:0/3537455272 wait complete. 2024-09-19T08:42:46.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.444+0000 7f76768bd640 1 Processor -- start 2024-09-19T08:42:46.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.444+0000 7f76768bd640 1 -- start start 2024-09-19T08:42:46.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.444+0000 7f76768bd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7670100a80 0x7f7670198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:46.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.444+0000 7f76768bd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7670101420 0x7f76701989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:46.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.444+0000 7f76768bd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7670106a80 0x7f767019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:46.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.444+0000 7f76768bd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7670110ea0 con 0x7f7670100a80 2024-09-19T08:42:46.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.444+0000 7f76768bd640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7670110d20 con 0x7f7670101420 2024-09-19T08:42:46.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.444+0000 7f76768bd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7670111020 con 0x7f7670106a80 2024-09-19T08:42:46.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.444+0000 7f766ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7670100a80 0x7f7670198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:46.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.444+0000 7f766ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7670100a80 0x7f7670198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50454/0 (socket says 172.21.15.7:50454) 2024-09-19T08:42:46.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.444+0000 7f766ffff640 1 -- 172.21.15.7:0/288303846 learned_addr learned my addr 172.21.15.7:0/288303846 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:42:46.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.444+0000 7f7667fff640 1 --2- 172.21.15.7:0/288303846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7670101420 0x7f76701989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:46.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.444+0000 7f7674e5a640 1 --2- 172.21.15.7:0/288303846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7670106a80 0x7f767019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:46.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.445+0000 7f766ffff640 1 -- 172.21.15.7:0/288303846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7670106a80 msgr2=0x7f767019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:46.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.445+0000 7f766ffff640 1 --2- 172.21.15.7:0/288303846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7670106a80 0x7f767019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:46.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.445+0000 7f766ffff640 1 -- 172.21.15.7:0/288303846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7670101420 msgr2=0x7f76701989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:46.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.445+0000 7f766ffff640 1 --2- 172.21.15.7:0/288303846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7670101420 0x7f76701989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:46.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.445+0000 7f766ffff640 1 -- 172.21.15.7:0/288303846 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767019d440 con 0x7f7670100a80 2024-09-19T08:42:46.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.445+0000 7f7674e5a640 1 --2- 172.21.15.7:0/288303846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7670106a80 0x7f767019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:42:46.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.445+0000 7f766ffff640 1 --2- 172.21.15.7:0/288303846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7670100a80 0x7f7670198490 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7660009a50 tx=0x7f7660004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:46.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.445+0000 7f766dffb640 1 -- 172.21.15.7:0/288303846 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766003f030 con 0x7f7670100a80 2024-09-19T08:42:46.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.445+0000 7f766dffb640 1 -- 172.21.15.7:0/288303846 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7660003ce0 con 0x7f7670100a80 2024-09-19T08:42:46.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.445+0000 7f76768bd640 1 -- 172.21.15.7:0/288303846 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767019d6d0 con 0x7f7670100a80 2024-09-19T08:42:46.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.445+0000 7f766dffb640 1 -- 172.21.15.7:0/288303846 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7660035070 con 0x7f7670100a80 2024-09-19T08:42:46.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.445+0000 7f76768bd640 1 -- 172.21.15.7:0/288303846 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76701a5010 con 0x7f7670100a80 2024-09-19T08:42:46.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.446+0000 7f76768bd640 1 -- 172.21.15.7:0/288303846 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76701021c0 con 0x7f7670100a80 2024-09-19T08:42:46.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.447+0000 7f766dffb640 1 -- 172.21.15.7:0/288303846 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f7660042030 con 0x7f7670100a80 2024-09-19T08:42:46.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.448+0000 7f766dffb640 1 --2- 172.21.15.7:0/288303846 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f765c0a3240 0x7f765c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:46.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.448+0000 7f7667fff640 1 --2- 172.21.15.7:0/288303846 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f765c0a3240 0x7f765c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:46.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.448+0000 7f766dffb640 1 -- 172.21.15.7:0/288303846 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f76600efaa0 con 0x7f7670100a80 2024-09-19T08:42:46.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.448+0000 7f7667fff640 1 --2- 172.21.15.7:0/288303846 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f765c0a3240 0x7f765c0a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f767006b870 tx=0x7f765800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:46.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.452+0000 7f766dffb640 1 -- 172.21.15.7:0/288303846 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f76600bc870 con 0x7f7670100a80 2024-09-19T08:42:46.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.627+0000 7f76768bd640 1 -- 172.21.15.7:0/288303846 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76701a51e0 con 0x7f7670100a80 2024-09-19T08:42:46.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.629+0000 7f766dffb640 1 -- 172.21.15.7:0/288303846 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22210 (secure 0 0 0) 0x7f76600bc170 con 0x7f7670100a80 2024-09-19T08:42:46.629 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:42:46.629 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":80,"fsid":"ebd23124-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:02.287380+0000","modified":"2024-09-19T08:42:44.586490+0000","last_up_change":"2024-09-19T08:41:54.742978+0000","last_in_change":"2024-09-19T08:41:31.685622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:13.285118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:42:40.425852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:42:43.006548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"837e6267-71c7-4f48-9e0b-4e3f124682b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6803","nonce":402668717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6805","nonce":402668717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6809","nonce":402668717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6807","nonce":402668717}]},"public_addr":"172.21.15.7:6803/402668717","cluster_addr":"172.21.15.7:6805/402668717","heartbeat_back_addr":"172.21.15.7:6809/402668717","heartbeat_front_addr":"172.21.15.7:6807/402668717","state":["exists","up"]},{"osd":1,"uuid":"67865372-ac22-4b30-bd02-498e118d6701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6801","nonce":2213694259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6803","nonce":2213694259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6807","nonce":2213694259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6805","nonce":2213694259}]},"public_addr":"172.21.15.44:6801/2213694259","cluster_addr":"172.21.15.44:6803/2213694259","heartbeat_back_addr":"172.21.15.44:6807/2213694259","heartbeat_front_addr":"172.21.15.44:6805/2213694259","state":["exists","up"]},{"osd":2,"uuid":"37c1cc2b-60ea-449f-baa7-c65d96c3559c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6801","nonce":3413002145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6803","nonce":3413002145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6807","nonce":3413002145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6805","nonce":3413002145}]},"public_addr":"172.21.15.175:6801/3413002145","cluster_addr":"172.21.15.175:6803/3413002145","heartbeat_back_addr":"172.21.15.175:6807/3413002145","heartbeat_front_addr":"172.21.15.175:6805/3413002145","state":["exists","up"]},{"osd":3,"uuid":"a8ffd2ae-4211-492a-a8ac-d4d6cbb4a03d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6811","nonce":2528867083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6813","nonce":2528867083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6817","nonce":2528867083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6815","nonce":2528867083}]},"public_addr":"172.21.15.7:6811/2528867083","cluster_addr":"172.21.15.7:6813/2528867083","heartbeat_back_addr":"172.21.15.7:6817/2528867083","heartbeat_front_addr":"172.21.15.7:6815/2528867083","state":["exists","up"]},{"osd":4,"uuid":"9a67b2ec-1a0a-413e-bd13-9532f24a0155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6809","nonce":3537143774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537143774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537143774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537143774}]},"public_addr":"172.21.15.44:6809/3537143774","cluster_addr":"172.21.15.44:6811/3537143774","heartbeat_back_addr":"172.21.15.44:6815/3537143774","heartbeat_front_addr":"172.21.15.44:6813/3537143774","state":["exists","up"]},{"osd":5,"uuid":"436cd596-710b-48e2-8255-8427c93cee1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6809","nonce":4001214751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6811","nonce":4001214751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6815","nonce":4001214751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6813","nonce":4001214751}]},"public_addr":"172.21.15.175:6809/4001214751","cluster_addr":"172.21.15.175:6811/4001214751","heartbeat_back_addr":"172.21.15.175:6815/4001214751","heartbeat_front_addr":"172.21.15.175:6813/4001214751","state":["exists","up"]},{"osd":6,"uuid":"f5a7ad2b-6b44-4b5a-8af7-f7fb00e7ca68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6819","nonce":1261079202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6821","nonce":1261079202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6825","nonce":1261079202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6823","nonce":1261079202}]},"public_addr":"172.21.15.7:6819/1261079202","cluster_addr":"172.21.15.7:6821/1261079202","heartbeat_back_addr":"172.21.15.7:6825/1261079202","heartbeat_front_addr":"172.21.15.7:6823/1261079202","state":["exists","up"]},{"osd":7,"uuid":"aa24aee5-6449-4842-8831-1c8e06cde75b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6817","nonce":3120822957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6819","nonce":3120822957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6823","nonce":3120822957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6821","nonce":3120822957}]},"public_addr":"172.21.15.44:6817/3120822957","cluster_addr":"172.21.15.44:6819/3120822957","heartbeat_back_addr":"172.21.15.44:6823/3120822957","heartbeat_front_addr":"172.21.15.44:6821/3120822957","state":["exists","up"]},{"osd":8,"uuid":"d912501a-bb7a-489e-b6ab-e451fb22210d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6817","nonce":2080374927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6819","nonce":2080374927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6823","nonce":2080374927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6821","nonce":2080374927}]},"public_addr":"172.21.15.175:6817/2080374927","cluster_addr":"172.21.15.175:6819/2080374927","heartbeat_back_addr":"172.21.15.175:6823/2080374927","heartbeat_front_addr":"172.21.15.175:6821/2080374927","state":["exists","up"]},{"osd":9,"uuid":"d132f5b2-75b9-4d6c-89ec-f52c303e0fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6827","nonce":3808356432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6829","nonce":3808356432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6833","nonce":3808356432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6831","nonce":3808356432}]},"public_addr":"172.21.15.7:6827/3808356432","cluster_addr":"172.21.15.7:6829/3808356432","heartbeat_back_addr":"172.21.15.7:6833/3808356432","heartbeat_front_addr":"172.21.15.7:6831/3808356432","state":["exists","up"]},{"osd":10,"uuid":"f6c405d6-a255-4e0e-8528-7bbc16d5e434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6825","nonce":4009464689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6827","nonce":4009464689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6831","nonce":4009464689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6829","nonce":4009464689}]},"public_addr":"172.21.15.44:6825/4009464689","cluster_addr":"172.21.15.44:6827/4009464689","heartbeat_back_addr":"172.21.15.44:6831/4009464689","heartbeat_front_addr":"172.21.15.44:6829/4009464689","state":["exists","up"]},{"osd":11,"uuid":"a2a046cd-9939-473a-988b-6e0ad28a0233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6825","nonce":4173951310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6827","nonce":4173951310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6831","nonce":4173951310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6829","nonce":4173951310}]},"public_addr":"172.21.15.175:6825/4173951310","cluster_addr":"172.21.15.175:6827/4173951310","heartbeat_back_addr":"172.21.15.175:6831/4173951310","heartbeat_front_addr":"172.21.15.175:6829/4173951310","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:20.015497+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:44.967046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:09.682080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:35.516899+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:00.705686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:25.276387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:49.927456+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:14.786755+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:38.553913+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.962825+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.812976+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:52.837744+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6800/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/2884903597":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/4058698573":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/1429582340":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6800/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/816886708":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/4277640815":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/2695884066":"2024-09-20T08:35:31.711540+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:42:46.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.631+0000 7f76768bd640 1 -- 172.21.15.7:0/288303846 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f765c0a3240 msgr2=0x7f765c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:46.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.631+0000 7f76768bd640 1 --2- 172.21.15.7:0/288303846 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f765c0a3240 0x7f765c0a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f767006b870 tx=0x7f765800a2d0 comp rx=0 tx=0).stop 2024-09-19T08:42:46.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.631+0000 7f76768bd640 1 -- 172.21.15.7:0/288303846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7670100a80 msgr2=0x7f7670198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:46.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.631+0000 7f76768bd640 1 --2- 172.21.15.7:0/288303846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7670100a80 0x7f7670198490 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7660009a50 tx=0x7f7660004270 comp rx=0 tx=0).stop 2024-09-19T08:42:46.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.631+0000 7f76768bd640 1 -- 172.21.15.7:0/288303846 shutdown_connections 2024-09-19T08:42:46.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.631+0000 7f76768bd640 1 --2- 172.21.15.7:0/288303846 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f765c0a3240 0x7f765c0a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:46.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.631+0000 7f76768bd640 1 --2- 172.21.15.7:0/288303846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7670106a80 0x7f767019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:46.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.631+0000 7f76768bd640 1 --2- 172.21.15.7:0/288303846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7670101420 0x7f76701989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:46.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.631+0000 7f76768bd640 1 --2- 172.21.15.7:0/288303846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7670100a80 0x7f7670198490 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:46.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.631+0000 7f76768bd640 1 -- 172.21.15.7:0/288303846 >> 172.21.15.7:0/288303846 conn(0x7f76700fc7a0 msgr2=0x7f7670104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:46.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.631+0000 7f76768bd640 1 -- 172.21.15.7:0/288303846 shutdown_connections 2024-09-19T08:42:46.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:46.631+0000 7f76768bd640 1 -- 172.21.15.7:0/288303846 wait complete. 2024-09-19T08:42:47.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:47 smithi007 ceph-mon[31221]: mds.? [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] up:active 2024-09-19T08:42:47.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:47 smithi007 ceph-mon[31221]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:42:47.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:47 smithi007 ceph-mon[31221]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:42:47.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:47 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/288303846' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:42:47.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:47 smithi044 ceph-mon[35072]: mds.? [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] up:active 2024-09-19T08:42:47.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:47 smithi044 ceph-mon[35072]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:42:47.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:47 smithi044 ceph-mon[35072]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:42:47.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:47 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/288303846' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:42:47.398 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:42:47.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:47 smithi175 ceph-mon[35688]: mds.? [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] up:active 2024-09-19T08:42:47.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:47 smithi175 ceph-mon[35688]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:42:47.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:47 smithi175 ceph-mon[35688]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:42:47.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:47 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/288303846' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:42:47.655 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:48.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.068+0000 7f283a43e640 1 -- 172.21.15.7:0/4121016454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2834101430 msgr2=0x7f283410d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:48.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.068+0000 7f283a43e640 1 --2- 172.21.15.7:0/4121016454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2834101430 0x7f283410d960 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f282c009cd0 tx=0x7f282c02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:42:48.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.069+0000 7f283a43e640 1 -- 172.21.15.7:0/4121016454 shutdown_connections 2024-09-19T08:42:48.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.069+0000 7f283a43e640 1 --2- 172.21.15.7:0/4121016454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2834101430 0x7f283410d960 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:48.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.069+0000 7f283a43e640 1 --2- 172.21.15.7:0/4121016454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2834100a90 0x7f2834100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:48.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.069+0000 7f283a43e640 1 --2- 172.21.15.7:0/4121016454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2834106a90 0x7f2834106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.069+0000 7f283a43e640 1 -- 172.21.15.7:0/4121016454 >> 172.21.15.7:0/4121016454 conn(0x7f28340fc7d0 msgr2=0x7f28340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.069+0000 7f283a43e640 1 -- 172.21.15.7:0/4121016454 shutdown_connections 2024-09-19T08:42:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.069+0000 7f283a43e640 1 -- 172.21.15.7:0/4121016454 wait complete. 2024-09-19T08:42:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.069+0000 7f283a43e640 1 Processor -- start 2024-09-19T08:42:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.070+0000 7f283a43e640 1 -- start start 2024-09-19T08:42:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.070+0000 7f283a43e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2834100a90 0x7f283419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.070+0000 7f283a43e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2834101430 0x7f283419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.070+0000 7f283a43e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2834106a90 0x7f283419ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.070+0000 7f283a43e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2834110e90 con 0x7f2834100a90 2024-09-19T08:42:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.070+0000 7f283a43e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2834110d10 con 0x7f2834101430 2024-09-19T08:42:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.070+0000 7f283a43e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2834111010 con 0x7f2834106a90 2024-09-19T08:42:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.070+0000 7f2833fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2834100a90 0x7f283419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:48.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.070+0000 7f2833fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2834100a90 0x7f283419a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50482/0 (socket says 172.21.15.7:50482) 2024-09-19T08:42:48.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.070+0000 7f2833fff640 1 -- 172.21.15.7:0/491531872 learned_addr learned my addr 172.21.15.7:0/491531872 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:42:48.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.070+0000 7f28337fe640 1 --2- 172.21.15.7:0/491531872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2834101430 0x7f283419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:48.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.070+0000 7f28389db640 1 --2- 172.21.15.7:0/491531872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2834106a90 0x7f283419ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:48.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.071+0000 7f2833fff640 1 -- 172.21.15.7:0/491531872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2834106a90 msgr2=0x7f283419ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:48.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.071+0000 7f2833fff640 1 --2- 172.21.15.7:0/491531872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2834106a90 0x7f283419ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:48.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.071+0000 7f2833fff640 1 -- 172.21.15.7:0/491531872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2834101430 msgr2=0x7f283419aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:48.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.071+0000 7f2833fff640 1 --2- 172.21.15.7:0/491531872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2834101430 0x7f283419aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:48.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.071+0000 7f2833fff640 1 -- 172.21.15.7:0/491531872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283419f4f0 con 0x7f2834100a90 2024-09-19T08:42:48.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.071+0000 7f28389db640 1 --2- 172.21.15.7:0/491531872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2834106a90 0x7f283419ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:42:48.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.071+0000 7f2833fff640 1 --2- 172.21.15.7:0/491531872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2834100a90 0x7f283419a540 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f282400d950 tx=0x7f282400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:48.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.071+0000 7f28317fa640 1 -- 172.21.15.7:0/491531872 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824017070 con 0x7f2834100a90 2024-09-19T08:42:48.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.071+0000 7f283a43e640 1 -- 172.21.15.7:0/491531872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f283419f7e0 con 0x7f2834100a90 2024-09-19T08:42:48.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.071+0000 7f28317fa640 1 -- 172.21.15.7:0/491531872 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f282400de80 con 0x7f2834100a90 2024-09-19T08:42:48.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.071+0000 7f28317fa640 1 -- 172.21.15.7:0/491531872 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282400f620 con 0x7f2834100a90 2024-09-19T08:42:48.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.071+0000 7f283a43e640 1 -- 172.21.15.7:0/491531872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28341a70c0 con 0x7f2834100a90 2024-09-19T08:42:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.072+0000 7f283a43e640 1 -- 172.21.15.7:0/491531872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2834100ef0 con 0x7f2834100a90 2024-09-19T08:42:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.073+0000 7f28317fa640 1 -- 172.21.15.7:0/491531872 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f2824009c30 con 0x7f2834100a90 2024-09-19T08:42:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.074+0000 7f28317fa640 1 --2- 172.21.15.7:0/491531872 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f281c0a3240 0x7f281c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.074+0000 7f28337fe640 1 --2- 172.21.15.7:0/491531872 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f281c0a3240 0x7f281c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.074+0000 7f28317fa640 1 -- 172.21.15.7:0/491531872 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f28240cf450 con 0x7f2834100a90 2024-09-19T08:42:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.075+0000 7f28337fe640 1 --2- 172.21.15.7:0/491531872 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f281c0a3240 0x7f281c0a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f283410bf70 tx=0x7f282800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:48.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.077+0000 7f28317fa640 1 -- 172.21.15.7:0/491531872 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f282409c2c0 con 0x7f2834100a90 2024-09-19T08:42:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.254+0000 7f283a43e640 1 -- 172.21.15.7:0/491531872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2834103710 con 0x7f2834100a90 2024-09-19T08:42:48.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.255+0000 7f28317fa640 1 -- 172.21.15.7:0/491531872 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22210 (secure 0 0 0) 0x7f282409bbc0 con 0x7f2834100a90 2024-09-19T08:42:48.255 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:42:48.256 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":80,"fsid":"ebd23124-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:02.287380+0000","modified":"2024-09-19T08:42:44.586490+0000","last_up_change":"2024-09-19T08:41:54.742978+0000","last_in_change":"2024-09-19T08:41:31.685622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:13.285118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:42:40.425852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:42:43.006548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"837e6267-71c7-4f48-9e0b-4e3f124682b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6803","nonce":402668717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6805","nonce":402668717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6809","nonce":402668717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6807","nonce":402668717}]},"public_addr":"172.21.15.7:6803/402668717","cluster_addr":"172.21.15.7:6805/402668717","heartbeat_back_addr":"172.21.15.7:6809/402668717","heartbeat_front_addr":"172.21.15.7:6807/402668717","state":["exists","up"]},{"osd":1,"uuid":"67865372-ac22-4b30-bd02-498e118d6701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6801","nonce":2213694259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6803","nonce":2213694259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6807","nonce":2213694259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6805","nonce":2213694259}]},"public_addr":"172.21.15.44:6801/2213694259","cluster_addr":"172.21.15.44:6803/2213694259","heartbeat_back_addr":"172.21.15.44:6807/2213694259","heartbeat_front_addr":"172.21.15.44:6805/2213694259","state":["exists","up"]},{"osd":2,"uuid":"37c1cc2b-60ea-449f-baa7-c65d96c3559c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6801","nonce":3413002145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6803","nonce":3413002145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6807","nonce":3413002145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6805","nonce":3413002145}]},"public_addr":"172.21.15.175:6801/3413002145","cluster_addr":"172.21.15.175:6803/3413002145","heartbeat_back_addr":"172.21.15.175:6807/3413002145","heartbeat_front_addr":"172.21.15.175:6805/3413002145","state":["exists","up"]},{"osd":3,"uuid":"a8ffd2ae-4211-492a-a8ac-d4d6cbb4a03d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6811","nonce":2528867083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6813","nonce":2528867083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6817","nonce":2528867083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6815","nonce":2528867083}]},"public_addr":"172.21.15.7:6811/2528867083","cluster_addr":"172.21.15.7:6813/2528867083","heartbeat_back_addr":"172.21.15.7:6817/2528867083","heartbeat_front_addr":"172.21.15.7:6815/2528867083","state":["exists","up"]},{"osd":4,"uuid":"9a67b2ec-1a0a-413e-bd13-9532f24a0155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6809","nonce":3537143774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537143774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537143774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537143774}]},"public_addr":"172.21.15.44:6809/3537143774","cluster_addr":"172.21.15.44:6811/3537143774","heartbeat_back_addr":"172.21.15.44:6815/3537143774","heartbeat_front_addr":"172.21.15.44:6813/3537143774","state":["exists","up"]},{"osd":5,"uuid":"436cd596-710b-48e2-8255-8427c93cee1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6809","nonce":4001214751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6811","nonce":4001214751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6815","nonce":4001214751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6813","nonce":4001214751}]},"public_addr":"172.21.15.175:6809/4001214751","cluster_addr":"172.21.15.175:6811/4001214751","heartbeat_back_addr":"172.21.15.175:6815/4001214751","heartbeat_front_addr":"172.21.15.175:6813/4001214751","state":["exists","up"]},{"osd":6,"uuid":"f5a7ad2b-6b44-4b5a-8af7-f7fb00e7ca68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6819","nonce":1261079202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6821","nonce":1261079202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6825","nonce":1261079202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6823","nonce":1261079202}]},"public_addr":"172.21.15.7:6819/1261079202","cluster_addr":"172.21.15.7:6821/1261079202","heartbeat_back_addr":"172.21.15.7:6825/1261079202","heartbeat_front_addr":"172.21.15.7:6823/1261079202","state":["exists","up"]},{"osd":7,"uuid":"aa24aee5-6449-4842-8831-1c8e06cde75b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6817","nonce":3120822957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6819","nonce":3120822957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6823","nonce":3120822957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6821","nonce":3120822957}]},"public_addr":"172.21.15.44:6817/3120822957","cluster_addr":"172.21.15.44:6819/3120822957","heartbeat_back_addr":"172.21.15.44:6823/3120822957","heartbeat_front_addr":"172.21.15.44:6821/3120822957","state":["exists","up"]},{"osd":8,"uuid":"d912501a-bb7a-489e-b6ab-e451fb22210d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6817","nonce":2080374927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6819","nonce":2080374927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6823","nonce":2080374927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6821","nonce":2080374927}]},"public_addr":"172.21.15.175:6817/2080374927","cluster_addr":"172.21.15.175:6819/2080374927","heartbeat_back_addr":"172.21.15.175:6823/2080374927","heartbeat_front_addr":"172.21.15.175:6821/2080374927","state":["exists","up"]},{"osd":9,"uuid":"d132f5b2-75b9-4d6c-89ec-f52c303e0fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6827","nonce":3808356432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6829","nonce":3808356432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6833","nonce":3808356432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6831","nonce":3808356432}]},"public_addr":"172.21.15.7:6827/3808356432","cluster_addr":"172.21.15.7:6829/3808356432","heartbeat_back_addr":"172.21.15.7:6833/3808356432","heartbeat_front_addr":"172.21.15.7:6831/3808356432","state":["exists","up"]},{"osd":10,"uuid":"f6c405d6-a255-4e0e-8528-7bbc16d5e434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6825","nonce":4009464689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6827","nonce":4009464689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6831","nonce":4009464689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6829","nonce":4009464689}]},"public_addr":"172.21.15.44:6825/4009464689","cluster_addr":"172.21.15.44:6827/4009464689","heartbeat_back_addr":"172.21.15.44:6831/4009464689","heartbeat_front_addr":"172.21.15.44:6829/4009464689","state":["exists","up"]},{"osd":11,"uuid":"a2a046cd-9939-473a-988b-6e0ad28a0233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6825","nonce":4173951310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6827","nonce":4173951310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6831","nonce":4173951310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6829","nonce":4173951310}]},"public_addr":"172.21.15.175:6825/4173951310","cluster_addr":"172.21.15.175:6827/4173951310","heartbeat_back_addr":"172.21.15.175:6831/4173951310","heartbeat_front_addr":"172.21.15.175:6829/4173951310","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:20.015497+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:44.967046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:09.682080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:35.516899+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:00.705686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:25.276387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:49.927456+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:14.786755+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:38.553913+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.962825+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.812976+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:52.837744+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6800/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/2884903597":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/4058698573":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/1429582340":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6800/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/816886708":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/4277640815":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/2695884066":"2024-09-20T08:35:31.711540+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:42:48.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.258+0000 7f283a43e640 1 -- 172.21.15.7:0/491531872 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f281c0a3240 msgr2=0x7f281c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:48.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.258+0000 7f283a43e640 1 --2- 172.21.15.7:0/491531872 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f281c0a3240 0x7f281c0a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f283410bf70 tx=0x7f282800a2d0 comp rx=0 tx=0).stop 2024-09-19T08:42:48.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.258+0000 7f283a43e640 1 -- 172.21.15.7:0/491531872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2834100a90 msgr2=0x7f283419a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:48.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.258+0000 7f283a43e640 1 --2- 172.21.15.7:0/491531872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2834100a90 0x7f283419a540 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f282400d950 tx=0x7f282400dd50 comp rx=0 tx=0).stop 2024-09-19T08:42:48.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.258+0000 7f283a43e640 1 -- 172.21.15.7:0/491531872 shutdown_connections 2024-09-19T08:42:48.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.258+0000 7f283a43e640 1 --2- 172.21.15.7:0/491531872 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f281c0a3240 0x7f281c0a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:48.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.258+0000 7f283a43e640 1 --2- 172.21.15.7:0/491531872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2834106a90 0x7f283419ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:48.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.258+0000 7f283a43e640 1 --2- 172.21.15.7:0/491531872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2834101430 0x7f283419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:48.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.258+0000 7f283a43e640 1 --2- 172.21.15.7:0/491531872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2834100a90 0x7f283419a540 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:48.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.258+0000 7f283a43e640 1 -- 172.21.15.7:0/491531872 >> 172.21.15.7:0/491531872 conn(0x7f28340fc7d0 msgr2=0x7f283406ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:48.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.258+0000 7f283a43e640 1 -- 172.21.15.7:0/491531872 shutdown_connections 2024-09-19T08:42:48.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:48.258+0000 7f283a43e640 1 -- 172.21.15.7:0/491531872 wait complete. 2024-09-19T08:42:48.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:48 smithi007 ceph-mon[31221]: pgmap v275: 97 pgs: 10 creating+peering, 67 active+clean, 20 unknown; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 3 op/s 2024-09-19T08:42:48.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:48 smithi007 ceph-mon[31221]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T08:42:48.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:48 smithi007 ceph-mon[31221]: Cluster is now healthy 2024-09-19T08:42:48.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:48 smithi044 ceph-mon[35072]: pgmap v275: 97 pgs: 10 creating+peering, 67 active+clean, 20 unknown; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 3 op/s 2024-09-19T08:42:48.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:48 smithi044 ceph-mon[35072]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T08:42:48.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:48 smithi044 ceph-mon[35072]: Cluster is now healthy 2024-09-19T08:42:48.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:48 smithi175 ceph-mon[35688]: pgmap v275: 97 pgs: 10 creating+peering, 67 active+clean, 20 unknown; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 3 op/s 2024-09-19T08:42:48.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:48 smithi175 ceph-mon[35688]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T08:42:48.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:48 smithi175 ceph-mon[35688]: Cluster is now healthy 2024-09-19T08:42:48.929 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T08:42:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:49.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:49 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/491531872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:42:49.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:49 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/491531872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:42:49.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:49 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/491531872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:42:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.633+0000 7fb5358d3640 1 -- 172.21.15.7:0/2681244228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb530106a80 msgr2=0x7fb530106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.633+0000 7fb5358d3640 1 --2- 172.21.15.7:0/2681244228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb530106a80 0x7fb530106e60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb520009930 tx=0x7fb52002a420 comp rx=0 tx=0).stop 2024-09-19T08:42:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.633+0000 7fb5358d3640 1 -- 172.21.15.7:0/2681244228 shutdown_connections 2024-09-19T08:42:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.633+0000 7fb5358d3640 1 --2- 172.21.15.7:0/2681244228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb530101420 0x7fb53010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.633+0000 7fb5358d3640 1 --2- 172.21.15.7:0/2681244228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb530100a80 0x7fb530100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.633+0000 7fb5358d3640 1 --2- 172.21.15.7:0/2681244228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb530106a80 0x7fb530106e60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.633+0000 7fb5358d3640 1 -- 172.21.15.7:0/2681244228 >> 172.21.15.7:0/2681244228 conn(0x7fb5300fc7a0 msgr2=0x7fb5300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.633+0000 7fb5358d3640 1 -- 172.21.15.7:0/2681244228 shutdown_connections 2024-09-19T08:42:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.633+0000 7fb5358d3640 1 -- 172.21.15.7:0/2681244228 wait complete. 2024-09-19T08:42:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.633+0000 7fb5358d3640 1 Processor -- start 2024-09-19T08:42:49.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.634+0000 7fb5358d3640 1 -- start start 2024-09-19T08:42:49.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.634+0000 7fb5358d3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb530100a80 0x7fb530197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:49.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.634+0000 7fb5358d3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb530101420 0x7fb530197640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:49.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.634+0000 7fb5358d3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb530106a80 0x7fb530197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:49.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.634+0000 7fb5358d3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb530110e80 con 0x7fb530106a80 2024-09-19T08:42:49.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.634+0000 7fb5358d3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb530110d00 con 0x7fb530100a80 2024-09-19T08:42:49.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.634+0000 7fb5358d3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb530111000 con 0x7fb530101420 2024-09-19T08:42:49.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.634+0000 7fb52f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb530106a80 0x7fb530197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:49.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.634+0000 7fb52f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb530106a80 0x7fb530197b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50498/0 (socket says 172.21.15.7:50498) 2024-09-19T08:42:49.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.634+0000 7fb52f7fe640 1 -- 172.21.15.7:0/683854945 learned_addr learned my addr 172.21.15.7:0/683854945 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:42:49.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.634+0000 7fb52e7fc640 1 --2- 172.21.15.7:0/683854945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb530101420 0x7fb530197640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:49.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.634+0000 7fb52effd640 1 --2- 172.21.15.7:0/683854945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb530100a80 0x7fb530197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:49.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.634+0000 7fb52f7fe640 1 -- 172.21.15.7:0/683854945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb530101420 msgr2=0x7fb530197640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:49.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.634+0000 7fb52f7fe640 1 --2- 172.21.15.7:0/683854945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb530101420 0x7fb530197640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:49.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.634+0000 7fb52f7fe640 1 -- 172.21.15.7:0/683854945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb530100a80 msgr2=0x7fb530197100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:49.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.634+0000 7fb52f7fe640 1 --2- 172.21.15.7:0/683854945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb530100a80 0x7fb530197100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:49.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.634+0000 7fb52f7fe640 1 -- 172.21.15.7:0/683854945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5301a6970 con 0x7fb530106a80 2024-09-19T08:42:49.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.635+0000 7fb52f7fe640 1 --2- 172.21.15.7:0/683854945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb530106a80 0x7fb530197b80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb52800cad0 tx=0x7fb52800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:49.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.635+0000 7fb5348d1640 1 -- 172.21.15.7:0/683854945 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52800ae20 con 0x7fb530106a80 2024-09-19T08:42:49.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.635+0000 7fb5348d1640 1 -- 172.21.15.7:0/683854945 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb528005020 con 0x7fb530106a80 2024-09-19T08:42:49.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.635+0000 7fb5358d3640 1 -- 172.21.15.7:0/683854945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5301a6c60 con 0x7fb530106a80 2024-09-19T08:42:49.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.635+0000 7fb5348d1640 1 -- 172.21.15.7:0/683854945 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52800f6f0 con 0x7fb530106a80 2024-09-19T08:42:49.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.635+0000 7fb5358d3640 1 -- 172.21.15.7:0/683854945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5301a7150 con 0x7fb530106a80 2024-09-19T08:42:49.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.636+0000 7fb5358d3640 1 -- 172.21.15.7:0/683854945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb530100ee0 con 0x7fb530106a80 2024-09-19T08:42:49.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.638+0000 7fb5348d1640 1 -- 172.21.15.7:0/683854945 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fb5280051d0 con 0x7fb530106a80 2024-09-19T08:42:49.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.639+0000 7fb5348d1640 1 --2- 172.21.15.7:0/683854945 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb5180a3240 0x7fb5180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:49.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.639+0000 7fb52effd640 1 --2- 172.21.15.7:0/683854945 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb5180a3240 0x7fb5180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:49.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.639+0000 7fb5348d1640 1 -- 172.21.15.7:0/683854945 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fb5280cfb60 con 0x7fb530106a80 2024-09-19T08:42:49.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.639+0000 7fb52effd640 1 --2- 172.21.15.7:0/683854945 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb5180a3240 0x7fb5180a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb520009900 tx=0x7fb5200058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:49.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.642+0000 7fb5348d1640 1 -- 172.21.15.7:0/683854945 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb528014030 con 0x7fb530106a80 2024-09-19T08:42:49.801 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 19 08:42:49 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-b[64891]: 2024-09-19T08:42:49.459+0000 7f8d614bc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T08:42:49.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:49.856+0000 7fb5358d3640 1 -- 172.21.15.7:0/683854945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb53002d7c0 con 0x7fb530106a80 2024-09-19T08:42:50.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:50.045+0000 7fb5348d1640 1 -- 172.21.15.7:0/683854945 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fb52809c2e0 con 0x7fb530106a80 2024-09-19T08:42:50.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:50.048+0000 7fb5358d3640 1 -- 172.21.15.7:0/683854945 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb5180a3240 msgr2=0x7fb5180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:50.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:50.048+0000 7fb5358d3640 1 --2- 172.21.15.7:0/683854945 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb5180a3240 0x7fb5180a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb520009900 tx=0x7fb5200058d0 comp rx=0 tx=0).stop 2024-09-19T08:42:50.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:50.048+0000 7fb5358d3640 1 -- 172.21.15.7:0/683854945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb530106a80 msgr2=0x7fb530197b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:50.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:50.048+0000 7fb5358d3640 1 --2- 172.21.15.7:0/683854945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb530106a80 0x7fb530197b80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb52800cad0 tx=0x7fb52800cf90 comp rx=0 tx=0).stop 2024-09-19T08:42:50.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:50.048+0000 7fb5358d3640 1 -- 172.21.15.7:0/683854945 shutdown_connections 2024-09-19T08:42:50.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:50.048+0000 7fb5358d3640 1 --2- 172.21.15.7:0/683854945 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb5180a3240 0x7fb5180a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:50.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:50.048+0000 7fb5358d3640 1 --2- 172.21.15.7:0/683854945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb530106a80 0x7fb530197b80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:50.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:50.048+0000 7fb5358d3640 1 --2- 172.21.15.7:0/683854945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb530101420 0x7fb530197640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:50.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:50.048+0000 7fb5358d3640 1 --2- 172.21.15.7:0/683854945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb530100a80 0x7fb530197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:50.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:50.048+0000 7fb5358d3640 1 -- 172.21.15.7:0/683854945 >> 172.21.15.7:0/683854945 conn(0x7fb5300fc7a0 msgr2=0x7fb5300fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:50.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:50.048+0000 7fb5358d3640 1 -- 172.21.15.7:0/683854945 shutdown_connections 2024-09-19T08:42:50.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:50.048+0000 7fb5358d3640 1 -- 172.21.15.7:0/683854945 wait complete. 2024-09-19T08:42:50.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:50 smithi175 ceph-mon[35688]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 4 op/s 2024-09-19T08:42:50.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:50 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/683854945' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T08:42:50.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:50 smithi007 ceph-mon[31221]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 4 op/s 2024-09-19T08:42:50.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:50 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/683854945' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T08:42:50.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:50 smithi044 ceph-mon[35072]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 4 op/s 2024-09-19T08:42:50.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:50 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/683854945' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T08:42:50.718 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-19T08:42:50.718 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-19T08:42:50.976 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:51.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:51 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/683854945' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T08:42:51.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:51 smithi007 ceph-mon[31221]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:42:51.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.402+0000 7f7365266640 1 -- 172.21.15.7:0/841829028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7360100a80 msgr2=0x7f7360100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:51.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.402+0000 7f7365266640 1 --2- 172.21.15.7:0/841829028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7360100a80 0x7f7360100ee0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7348009930 tx=0x7f734802a420 comp rx=0 tx=0).stop 2024-09-19T08:42:51.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.402+0000 7f7365266640 1 -- 172.21.15.7:0/841829028 shutdown_connections 2024-09-19T08:42:51.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.402+0000 7f7365266640 1 --2- 172.21.15.7:0/841829028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7360101420 0x7f736010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:51.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.402+0000 7f7365266640 1 --2- 172.21.15.7:0/841829028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7360100a80 0x7f7360100ee0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:51.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.402+0000 7f7365266640 1 --2- 172.21.15.7:0/841829028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7360106a80 0x7f7360106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:51.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.402+0000 7f7365266640 1 -- 172.21.15.7:0/841829028 >> 172.21.15.7:0/841829028 conn(0x7f73600fc7a0 msgr2=0x7f73600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:51.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.402+0000 7f7365266640 1 -- 172.21.15.7:0/841829028 shutdown_connections 2024-09-19T08:42:51.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.402+0000 7f7365266640 1 -- 172.21.15.7:0/841829028 wait complete. 2024-09-19T08:42:51.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.403+0000 7f7365266640 1 Processor -- start 2024-09-19T08:42:51.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.403+0000 7f7365266640 1 -- start start 2024-09-19T08:42:51.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.403+0000 7f7365266640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7360100a80 0x7f73601984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:51.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.403+0000 7f7365266640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7360101420 0x7f73601989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:51.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.403+0000 7f7365266640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7360106a80 0x7f736019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:51.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.403+0000 7f7365266640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7360110ea0 con 0x7f7360106a80 2024-09-19T08:42:51.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.403+0000 7f7365266640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7360110d20 con 0x7f7360101420 2024-09-19T08:42:51.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.403+0000 7f7365266640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7360111020 con 0x7f7360100a80 2024-09-19T08:42:51.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.404+0000 7f735f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7360106a80 0x7f736019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:51.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.404+0000 7f735f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7360106a80 0x7f736019cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50516/0 (socket says 172.21.15.7:50516) 2024-09-19T08:42:51.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.404+0000 7f735f7fe640 1 -- 172.21.15.7:0/910234580 learned_addr learned my addr 172.21.15.7:0/910234580 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:42:51.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.404+0000 7f735effd640 1 --2- 172.21.15.7:0/910234580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7360100a80 0x7f73601984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:51.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.404+0000 7f73567fc640 1 --2- 172.21.15.7:0/910234580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7360101420 0x7f73601989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:51.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.404+0000 7f735f7fe640 1 -- 172.21.15.7:0/910234580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7360100a80 msgr2=0x7f73601984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:51.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.404+0000 7f735f7fe640 1 --2- 172.21.15.7:0/910234580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7360100a80 0x7f73601984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:51.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.404+0000 7f735f7fe640 1 -- 172.21.15.7:0/910234580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7360101420 msgr2=0x7f73601989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:51.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.404+0000 7f735f7fe640 1 --2- 172.21.15.7:0/910234580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7360101420 0x7f73601989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:51.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.404+0000 7f735f7fe640 1 -- 172.21.15.7:0/910234580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f736019d460 con 0x7f7360106a80 2024-09-19T08:42:51.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.404+0000 7f735f7fe640 1 --2- 172.21.15.7:0/910234580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7360106a80 0x7f736019cd80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f735800b970 tx=0x7f735800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:51.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.404+0000 7f735cff9640 1 -- 172.21.15.7:0/910234580 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358019070 con 0x7f7360106a80 2024-09-19T08:42:51.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.404+0000 7f735cff9640 1 -- 172.21.15.7:0/910234580 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f735800cb40 con 0x7f7360106a80 2024-09-19T08:42:51.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.404+0000 7f7365266640 1 -- 172.21.15.7:0/910234580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f736019d750 con 0x7f7360106a80 2024-09-19T08:42:51.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.404+0000 7f735cff9640 1 -- 172.21.15.7:0/910234580 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358007650 con 0x7f7360106a80 2024-09-19T08:42:51.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.404+0000 7f7365266640 1 -- 172.21.15.7:0/910234580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73601a5030 con 0x7f7360106a80 2024-09-19T08:42:51.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.405+0000 7f7365266640 1 -- 172.21.15.7:0/910234580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73601021c0 con 0x7f7360106a80 2024-09-19T08:42:51.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.407+0000 7f735cff9640 1 -- 172.21.15.7:0/910234580 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f735801c070 con 0x7f7360106a80 2024-09-19T08:42:51.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.407+0000 7f735cff9640 1 --2- 172.21.15.7:0/910234580 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f734c0a3240 0x7f734c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:51.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.407+0000 7f735effd640 1 --2- 172.21.15.7:0/910234580 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f734c0a3240 0x7f734c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:51.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.407+0000 7f735cff9640 1 -- 172.21.15.7:0/910234580 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f73580cf210 con 0x7f7360106a80 2024-09-19T08:42:51.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.408+0000 7f735effd640 1 --2- 172.21.15.7:0/910234580 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f734c0a3240 0x7f734c0a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7350005d00 tx=0x7f735000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:51.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.410+0000 7f735cff9640 1 -- 172.21.15.7:0/910234580 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f735809ba30 con 0x7f7360106a80 2024-09-19T08:42:51.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:51 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/683854945' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T08:42:51.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:51 smithi175 ceph-mon[35688]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:42:51.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:51 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/683854945' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T08:42:51.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:51 smithi044 ceph-mon[35072]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:42:51.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:51.623+0000 7f7365266640 1 -- 172.21.15.7:0/910234580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f73601a5260 con 0x7f7360106a80 2024-09-19T08:42:52.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:52.062+0000 7f735cff9640 1 -- 172.21.15.7:0/910234580 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f735809fd30 con 0x7f7360106a80 2024-09-19T08:42:52.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:52.065+0000 7f7365266640 1 -- 172.21.15.7:0/910234580 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f734c0a3240 msgr2=0x7f734c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:52.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:52.065+0000 7f7365266640 1 --2- 172.21.15.7:0/910234580 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f734c0a3240 0x7f734c0a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7350005d00 tx=0x7f735000b410 comp rx=0 tx=0).stop 2024-09-19T08:42:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:52.065+0000 7f7365266640 1 -- 172.21.15.7:0/910234580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7360106a80 msgr2=0x7f736019cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:52.065+0000 7f7365266640 1 --2- 172.21.15.7:0/910234580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7360106a80 0x7f736019cd80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f735800b970 tx=0x7f735800be30 comp rx=0 tx=0).stop 2024-09-19T08:42:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:52.065+0000 7f7365266640 1 -- 172.21.15.7:0/910234580 shutdown_connections 2024-09-19T08:42:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:52.065+0000 7f7365266640 1 --2- 172.21.15.7:0/910234580 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f734c0a3240 0x7f734c0a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:52.065+0000 7f7365266640 1 --2- 172.21.15.7:0/910234580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7360106a80 0x7f736019cd80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:52.065+0000 7f7365266640 1 --2- 172.21.15.7:0/910234580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7360101420 0x7f73601989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:52.065+0000 7f7365266640 1 --2- 172.21.15.7:0/910234580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7360100a80 0x7f73601984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:52.065+0000 7f7365266640 1 -- 172.21.15.7:0/910234580 >> 172.21.15.7:0/910234580 conn(0x7f73600fc7a0 msgr2=0x7f7360104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:52.065+0000 7f7365266640 1 -- 172.21.15.7:0/910234580 shutdown_connections 2024-09-19T08:42:52.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:52.065+0000 7f7365266640 1 -- 172.21.15.7:0/910234580 wait complete. 2024-09-19T08:42:52.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:52 smithi175 ceph-mon[35688]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T08:42:52.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:52 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/910234580' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T08:42:52.520 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:52 smithi007 ceph-mon[31221]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T08:42:52.521 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:52 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/910234580' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T08:42:52.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:52 smithi044 ceph-mon[35072]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T08:42:52.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:52 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/910234580' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T08:42:52.866 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T08:42:53.135 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:53.257 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:53 smithi007 ceph-mon[31221]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T08:42:53.257 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:53 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/910234580' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T08:42:53.257 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:53 smithi007 ceph-mon[31221]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T08:42:53.257 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:53 smithi007 ceph-mon[31221]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:42:53.257 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:53 smithi007 ceph-mon[31221]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T08:42:53.257 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:53 smithi007 ceph-mon[31221]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T08:42:53.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:53 smithi175 ceph-mon[35688]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T08:42:53.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:53 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/910234580' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T08:42:53.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:53 smithi175 ceph-mon[35688]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T08:42:53.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:53 smithi175 ceph-mon[35688]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:42:53.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:53 smithi175 ceph-mon[35688]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T08:42:53.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:53 smithi175 ceph-mon[35688]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T08:42:53.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:53 smithi044 ceph-mon[35072]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T08:42:53.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:53 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/910234580' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T08:42:53.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:53 smithi044 ceph-mon[35072]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T08:42:53.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:53 smithi044 ceph-mon[35072]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:42:53.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:53 smithi044 ceph-mon[35072]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T08:42:53.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:53 smithi044 ceph-mon[35072]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T08:42:53.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.618+0000 7f58caad1640 1 -- 172.21.15.7:0/1877380017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58c4106f10 msgr2=0x7f58c410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:53.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.618+0000 7f58caad1640 1 --2- 172.21.15.7:0/1877380017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58c4106f10 0x7f58c410ea90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009ca0 tx=0x7f58bc02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:42:53.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.618+0000 7f58caad1640 1 -- 172.21.15.7:0/1877380017 shutdown_connections 2024-09-19T08:42:53.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.618+0000 7f58caad1640 1 --2- 172.21.15.7:0/1877380017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58c4106f10 0x7f58c410ea90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:53.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.618+0000 7f58caad1640 1 --2- 172.21.15.7:0/1877380017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c4102790 0x7f58c41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:53.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.618+0000 7f58caad1640 1 --2- 172.21.15.7:0/1877380017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58c4101de0 0x7f58c41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:53.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.618+0000 7f58caad1640 1 -- 172.21.15.7:0/1877380017 >> 172.21.15.7:0/1877380017 conn(0x7f58c40fd8c0 msgr2=0x7f58c40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:53.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.618+0000 7f58caad1640 1 -- 172.21.15.7:0/1877380017 shutdown_connections 2024-09-19T08:42:53.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.618+0000 7f58caad1640 1 -- 172.21.15.7:0/1877380017 wait complete. 2024-09-19T08:42:53.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.619+0000 7f58caad1640 1 Processor -- start 2024-09-19T08:42:53.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.619+0000 7f58caad1640 1 -- start start 2024-09-19T08:42:53.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.619+0000 7f58caad1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58c4101de0 0x7f58c4198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:53.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.619+0000 7f58caad1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c4102790 0x7f58c4198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:53.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.619+0000 7f58caad1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58c4106f10 0x7f58c419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:53.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.619+0000 7f58caad1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f58c4111f90 con 0x7f58c4106f10 2024-09-19T08:42:53.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.619+0000 7f58caad1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f58c4111e10 con 0x7f58c4101de0 2024-09-19T08:42:53.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.619+0000 7f58caad1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f58c4112110 con 0x7f58c4102790 2024-09-19T08:42:53.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.619+0000 7f58c906e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58c4106f10 0x7f58c419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:53.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.619+0000 7f58c886d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58c4101de0 0x7f58c4198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:53.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.619+0000 7f58c906e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58c4106f10 0x7f58c419ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41772/0 (socket says 172.21.15.7:41772) 2024-09-19T08:42:53.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.619+0000 7f58c886d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58c4101de0 0x7f58c4198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:48678/0 (socket says 172.21.15.7:48678) 2024-09-19T08:42:53.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.619+0000 7f58c906e640 1 -- 172.21.15.7:0/727062170 learned_addr learned my addr 172.21.15.7:0/727062170 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:42:53.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.619+0000 7f58bbfff640 1 --2- 172.21.15.7:0/727062170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c4102790 0x7f58c4198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:53.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.619+0000 7f58c906e640 1 -- 172.21.15.7:0/727062170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c4102790 msgr2=0x7f58c4198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:53.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.619+0000 7f58c906e640 1 --2- 172.21.15.7:0/727062170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c4102790 0x7f58c4198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:53.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.619+0000 7f58c906e640 1 -- 172.21.15.7:0/727062170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58c4101de0 msgr2=0x7f58c4198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:53.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.619+0000 7f58c906e640 1 --2- 172.21.15.7:0/727062170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58c4101de0 0x7f58c4198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:53.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.619+0000 7f58c906e640 1 -- 172.21.15.7:0/727062170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c419d500 con 0x7f58c4106f10 2024-09-19T08:42:53.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.620+0000 7f58c906e640 1 --2- 172.21.15.7:0/727062170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58c4106f10 0x7f58c419ce20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f58bc031a20 tx=0x7f58bc031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:53.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.620+0000 7f58b9ffb640 1 -- 172.21.15.7:0/727062170 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc003b70 con 0x7f58c4106f10 2024-09-19T08:42:53.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.620+0000 7f58b9ffb640 1 -- 172.21.15.7:0/727062170 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58bc003d10 con 0x7f58c4106f10 2024-09-19T08:42:53.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.620+0000 7f58caad1640 1 -- 172.21.15.7:0/727062170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c419d790 con 0x7f58c4106f10 2024-09-19T08:42:53.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.620+0000 7f58b9ffb640 1 -- 172.21.15.7:0/727062170 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc02fc80 con 0x7f58c4106f10 2024-09-19T08:42:53.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.620+0000 7f58caad1640 1 -- 172.21.15.7:0/727062170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c41a50d0 con 0x7f58c4106f10 2024-09-19T08:42:53.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.621+0000 7f58caad1640 1 -- 172.21.15.7:0/727062170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c41021c0 con 0x7f58c4106f10 2024-09-19T08:42:53.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.622+0000 7f58b9ffb640 1 -- 172.21.15.7:0/727062170 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f58bc0046a0 con 0x7f58c4106f10 2024-09-19T08:42:53.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.623+0000 7f58b9ffb640 1 --2- 172.21.15.7:0/727062170 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f58ac0a32c0 0x7f58ac0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:53.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.623+0000 7f58b9ffb640 1 -- 172.21.15.7:0/727062170 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f58bc0f0a70 con 0x7f58c4106f10 2024-09-19T08:42:53.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.623+0000 7f58c886d640 1 --2- 172.21.15.7:0/727062170 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f58ac0a32c0 0x7f58ac0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:53.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.623+0000 7f58c886d640 1 --2- 172.21.15.7:0/727062170 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f58ac0a32c0 0x7f58ac0a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f58c000bbe0 tx=0x7f58c000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:53.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.626+0000 7f58b9ffb640 1 -- 172.21.15.7:0/727062170 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f58bc0bd970 con 0x7f58c4106f10 2024-09-19T08:42:53.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:53.841+0000 7f58caad1640 1 -- 172.21.15.7:0/727062170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f58c410a150 con 0x7f58c4106f10 2024-09-19T08:42:54.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:54.080+0000 7f58b9ffb640 1 -- 172.21.15.7:0/727062170 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f58bc0dbe20 con 0x7f58c4106f10 2024-09-19T08:42:54.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:54.082+0000 7f58caad1640 1 -- 172.21.15.7:0/727062170 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f58ac0a32c0 msgr2=0x7f58ac0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:54.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:54.082+0000 7f58caad1640 1 --2- 172.21.15.7:0/727062170 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f58ac0a32c0 0x7f58ac0a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f58c000bbe0 tx=0x7f58c000b390 comp rx=0 tx=0).stop 2024-09-19T08:42:54.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:54.082+0000 7f58caad1640 1 -- 172.21.15.7:0/727062170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58c4106f10 msgr2=0x7f58c419ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:54.082+0000 7f58caad1640 1 --2- 172.21.15.7:0/727062170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58c4106f10 0x7f58c419ce20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f58bc031a20 tx=0x7f58bc031a50 comp rx=0 tx=0).stop 2024-09-19T08:42:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:54.082+0000 7f58caad1640 1 -- 172.21.15.7:0/727062170 shutdown_connections 2024-09-19T08:42:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:54.082+0000 7f58caad1640 1 --2- 172.21.15.7:0/727062170 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f58ac0a32c0 0x7f58ac0a5780 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:54.082+0000 7f58caad1640 1 --2- 172.21.15.7:0/727062170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58c4106f10 0x7f58c419ce20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:54.082+0000 7f58caad1640 1 --2- 172.21.15.7:0/727062170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c4102790 0x7f58c4198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:54.082+0000 7f58caad1640 1 --2- 172.21.15.7:0/727062170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58c4101de0 0x7f58c4198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:54.082+0000 7f58caad1640 1 -- 172.21.15.7:0/727062170 >> 172.21.15.7:0/727062170 conn(0x7f58c40fd8c0 msgr2=0x7f58c40fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:54.082+0000 7f58caad1640 1 -- 172.21.15.7:0/727062170 shutdown_connections 2024-09-19T08:42:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:54.083+0000 7f58caad1640 1 -- 172.21.15.7:0/727062170 wait complete. 2024-09-19T08:42:54.093 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:54 smithi007 ceph-mon[31221]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-19T08:42:54.093 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:54 smithi007 ceph-mon[31221]: mds.? [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] up:active 2024-09-19T08:42:54.093 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:54 smithi007 ceph-mon[31221]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T08:42:54.093 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:54 smithi007 ceph-mon[31221]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T08:42:54.093 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:54 smithi007 ceph-mon[31221]: Cluster is now healthy 2024-09-19T08:42:54.094 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:54 smithi007 ceph-mon[31221]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T08:42:54.094 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:54 smithi007 ceph-mon[31221]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T08:42:54.094 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:54 smithi007 ceph-mon[31221]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-19T08:42:54.094 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:54 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/727062170' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T08:42:54.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:54 smithi175 ceph-mon[35688]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-19T08:42:54.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:54 smithi175 ceph-mon[35688]: mds.? [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] up:active 2024-09-19T08:42:54.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:54 smithi175 ceph-mon[35688]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T08:42:54.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:54 smithi175 ceph-mon[35688]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T08:42:54.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:54 smithi175 ceph-mon[35688]: Cluster is now healthy 2024-09-19T08:42:54.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:54 smithi175 ceph-mon[35688]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T08:42:54.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:54 smithi175 ceph-mon[35688]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T08:42:54.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:54 smithi175 ceph-mon[35688]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-19T08:42:54.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:54 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/727062170' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T08:42:54.459 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:54 smithi044 ceph-mon[35072]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-19T08:42:54.459 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:54 smithi044 ceph-mon[35072]: mds.? [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] up:active 2024-09-19T08:42:54.459 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:54 smithi044 ceph-mon[35072]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T08:42:54.459 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:54 smithi044 ceph-mon[35072]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T08:42:54.460 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:54 smithi044 ceph-mon[35072]: Cluster is now healthy 2024-09-19T08:42:54.460 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:54 smithi044 ceph-mon[35072]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T08:42:54.460 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:54 smithi044 ceph-mon[35072]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T08:42:54.460 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:54 smithi044 ceph-mon[35072]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-19T08:42:54.460 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:54 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/727062170' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T08:42:54.761 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T08:42:54.800 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 19 08:42:54 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-b[64891]: 2024-09-19T08:42:54.459+0000 7f8d614bc640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-19T08:42:54.801 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 19 08:42:54 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-b[64891]: 2024-09-19T08:42:54.459+0000 7f8d614bc640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-19T08:42:55.021 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:55.390 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:55 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/727062170' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T08:42:55.390 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:55 smithi007 ceph-mon[31221]: mds.? [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] up:active 2024-09-19T08:42:55.390 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:55 smithi007 ceph-mon[31221]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-19T08:42:55.390 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:55 smithi007 ceph-mon[31221]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T08:42:55.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:55 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/727062170' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T08:42:55.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:55 smithi175 ceph-mon[35688]: mds.? [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] up:active 2024-09-19T08:42:55.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:55 smithi175 ceph-mon[35688]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-19T08:42:55.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:55 smithi175 ceph-mon[35688]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T08:42:55.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.475+0000 7f5a04d95640 1 -- 172.21.15.7:0/1580987161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a00112b90 msgr2=0x7f5a00114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.475+0000 7f5a04d95640 1 --2- 172.21.15.7:0/1580987161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a00112b90 0x7f5a00114f80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f59f8009ca0 tx=0x7f59f802a950 comp rx=0 tx=0).stop 2024-09-19T08:42:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.475+0000 7f5a04d95640 1 -- 172.21.15.7:0/1580987161 shutdown_connections 2024-09-19T08:42:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.475+0000 7f5a04d95640 1 --2- 172.21.15.7:0/1580987161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a00112b90 0x7f5a00114f80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.475+0000 7f5a04d95640 1 --2- 172.21.15.7:0/1580987161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a00074eb0 0x7f5a00112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.475+0000 7f5a04d95640 1 --2- 172.21.15.7:0/1580987161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a00074590 0x7f5a00074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.475+0000 7f5a04d95640 1 -- 172.21.15.7:0/1580987161 >> 172.21.15.7:0/1580987161 conn(0x7f5a000fd8c0 msgr2=0x7f5a000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.475+0000 7f5a04d95640 1 -- 172.21.15.7:0/1580987161 shutdown_connections 2024-09-19T08:42:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.475+0000 7f5a04d95640 1 -- 172.21.15.7:0/1580987161 wait complete. 2024-09-19T08:42:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.476+0000 7f5a04d95640 1 Processor -- start 2024-09-19T08:42:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.476+0000 7f5a04d95640 1 -- start start 2024-09-19T08:42:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.476+0000 7f5a04d95640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a00074590 0x7f5a001a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:55.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.476+0000 7f5a04d95640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a00074eb0 0x7f5a001a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:55.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.476+0000 7f5a04d95640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a00112b90 0x7f5a0019e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:55.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.476+0000 7f5a04d95640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5a00118550 con 0x7f5a00074590 2024-09-19T08:42:55.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.476+0000 7f5a04d95640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5a001183d0 con 0x7f5a00074eb0 2024-09-19T08:42:55.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.476+0000 7f5a04d95640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5a001186d0 con 0x7f5a00112b90 2024-09-19T08:42:55.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.476+0000 7f59fe59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a00074590 0x7f5a001a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:55.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.476+0000 7f59fe59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a00074590 0x7f5a001a46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41790/0 (socket says 172.21.15.7:41790) 2024-09-19T08:42:55.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.476+0000 7f59fe59c640 1 -- 172.21.15.7:0/1374355041 learned_addr learned my addr 172.21.15.7:0/1374355041 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:42:55.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.476+0000 7f59fed9d640 1 --2- 172.21.15.7:0/1374355041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a00112b90 0x7f5a0019e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:55.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.476+0000 7f59fdd9b640 1 --2- 172.21.15.7:0/1374355041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a00074eb0 0x7f5a001a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:55.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.476+0000 7f59fe59c640 1 -- 172.21.15.7:0/1374355041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a00112b90 msgr2=0x7f5a0019e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:55.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.476+0000 7f59fe59c640 1 --2- 172.21.15.7:0/1374355041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a00112b90 0x7f5a0019e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:55.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.476+0000 7f59fe59c640 1 -- 172.21.15.7:0/1374355041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a00074eb0 msgr2=0x7f5a001a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:55.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.476+0000 7f59fe59c640 1 --2- 172.21.15.7:0/1374355041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a00074eb0 0x7f5a001a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:55.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.476+0000 7f59fe59c640 1 -- 172.21.15.7:0/1374355041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0019efe0 con 0x7f5a00074590 2024-09-19T08:42:55.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.476+0000 7f59fdd9b640 1 --2- 172.21.15.7:0/1374355041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a00074eb0 0x7f5a001a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:42:55.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.477+0000 7f59fe59c640 1 --2- 172.21.15.7:0/1374355041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a00074590 0x7f5a001a46c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f59f000d950 tx=0x7f59f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:55.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.477+0000 7f59ef7fe640 1 -- 172.21.15.7:0/1374355041 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f0017070 con 0x7f5a00074590 2024-09-19T08:42:55.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.477+0000 7f59ef7fe640 1 -- 172.21.15.7:0/1374355041 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59f0009c30 con 0x7f5a00074590 2024-09-19T08:42:55.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.477+0000 7f5a04d95640 1 -- 172.21.15.7:0/1374355041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a0019f2d0 con 0x7f5a00074590 2024-09-19T08:42:55.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.477+0000 7f59ef7fe640 1 -- 172.21.15.7:0/1374355041 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f000f6b0 con 0x7f5a00074590 2024-09-19T08:42:55.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.477+0000 7f5a04d95640 1 -- 172.21.15.7:0/1374355041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a001ab520 con 0x7f5a00074590 2024-09-19T08:42:55.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.478+0000 7f5a04d95640 1 -- 172.21.15.7:0/1374355041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a00075cd0 con 0x7f5a00074590 2024-09-19T08:42:55.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.479+0000 7f59ef7fe640 1 -- 172.21.15.7:0/1374355041 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f59f00109d0 con 0x7f5a00074590 2024-09-19T08:42:55.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.480+0000 7f59ef7fe640 1 --2- 172.21.15.7:0/1374355041 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f59e80a32c0 0x7f59e80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:55.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.480+0000 7f59fdd9b640 1 --2- 172.21.15.7:0/1374355041 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f59e80a32c0 0x7f59e80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:55.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.480+0000 7f59ef7fe640 1 -- 172.21.15.7:0/1374355041 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f59f00cf400 con 0x7f5a00074590 2024-09-19T08:42:55.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.481+0000 7f59fdd9b640 1 --2- 172.21.15.7:0/1374355041 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f59e80a32c0 0x7f59e80a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5a000ffec0 tx=0x7f59f4005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:55.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.484+0000 7f59ef7fe640 1 -- 172.21.15.7:0/1374355041 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f59f0009de0 con 0x7f5a00074590 2024-09-19T08:42:55.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:55 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/727062170' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T08:42:55.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:55 smithi044 ceph-mon[35072]: mds.? [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] up:active 2024-09-19T08:42:55.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:55 smithi044 ceph-mon[35072]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-19T08:42:55.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:55 smithi044 ceph-mon[35072]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T08:42:55.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:55.694+0000 7f5a04d95640 1 -- 172.21.15.7:0/1374355041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f5a00074970 con 0x7f5a00074590 2024-09-19T08:42:56.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:56.090+0000 7f59ef7fe640 1 -- 172.21.15.7:0/1374355041 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f59f009c270 con 0x7f5a00074590 2024-09-19T08:42:56.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:56.093+0000 7f5a04d95640 1 -- 172.21.15.7:0/1374355041 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f59e80a32c0 msgr2=0x7f59e80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:56.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:56.093+0000 7f5a04d95640 1 --2- 172.21.15.7:0/1374355041 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f59e80a32c0 0x7f59e80a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5a000ffec0 tx=0x7f59f4005d20 comp rx=0 tx=0).stop 2024-09-19T08:42:56.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:56.093+0000 7f5a04d95640 1 -- 172.21.15.7:0/1374355041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a00074590 msgr2=0x7f5a001a46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:56.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:56.093+0000 7f5a04d95640 1 --2- 172.21.15.7:0/1374355041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a00074590 0x7f5a001a46c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f59f000d950 tx=0x7f59f000de10 comp rx=0 tx=0).stop 2024-09-19T08:42:56.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:56.093+0000 7f5a04d95640 1 -- 172.21.15.7:0/1374355041 shutdown_connections 2024-09-19T08:42:56.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:56.093+0000 7f5a04d95640 1 --2- 172.21.15.7:0/1374355041 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f59e80a32c0 0x7f59e80a5780 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:56.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:56.093+0000 7f5a04d95640 1 --2- 172.21.15.7:0/1374355041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a00112b90 0x7f5a0019e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:56.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:56.093+0000 7f5a04d95640 1 --2- 172.21.15.7:0/1374355041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a00074eb0 0x7f5a001a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:56.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:56.093+0000 7f5a04d95640 1 --2- 172.21.15.7:0/1374355041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a00074590 0x7f5a001a46c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:56.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:56.093+0000 7f5a04d95640 1 -- 172.21.15.7:0/1374355041 >> 172.21.15.7:0/1374355041 conn(0x7f5a000fd8c0 msgr2=0x7f5a000fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:56.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:56.093+0000 7f5a04d95640 1 -- 172.21.15.7:0/1374355041 shutdown_connections 2024-09-19T08:42:56.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:56.093+0000 7f5a04d95640 1 -- 172.21.15.7:0/1374355041 wait complete. 2024-09-19T08:42:56.409 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:56 smithi007 ceph-mon[31221]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 3.0 KiB/s wr, 7 op/s 2024-09-19T08:42:56.410 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:56 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1374355041' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T08:42:56.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:56 smithi175 ceph-mon[35688]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 3.0 KiB/s wr, 7 op/s 2024-09-19T08:42:56.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:56 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1374355041' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T08:42:56.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:56 smithi044 ceph-mon[35072]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 3.0 KiB/s wr, 7 op/s 2024-09-19T08:42:56.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:56 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1374355041' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T08:42:56.713 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-19T08:42:56.714 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T08:42:56.976 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:57.355 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:57 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1374355041' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T08:42:57.355 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:57 smithi007 ceph-mon[31221]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T08:42:57.356 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:57 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-19T08:42:57.356 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:57 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-19T08:42:57.356 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:57 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-19T08:42:57.356 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:57 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-19T08:42:57.356 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:57 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-19T08:42:57.356 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:57 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-19T08:42:57.356 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:57 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]: dispatch 2024-09-19T08:42:57.356 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:57 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2024-09-19T08:42:57.356 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:57 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-19T08:42:57.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:57 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1374355041' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T08:42:57.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:57 smithi175 ceph-mon[35688]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T08:42:57.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:57 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-19T08:42:57.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:57 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-19T08:42:57.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:57 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-19T08:42:57.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:57 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-19T08:42:57.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:57 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-19T08:42:57.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:57 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-19T08:42:57.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:57 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]: dispatch 2024-09-19T08:42:57.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:57 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2024-09-19T08:42:57.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:57 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-19T08:42:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.440+0000 7f5fbec4f640 1 -- 172.21.15.7:0/3366708030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fb8101410 msgr2=0x7f5fb810d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.440+0000 7f5fbec4f640 1 --2- 172.21.15.7:0/3366708030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fb8101410 0x7f5fb810d940 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0009cd0 tx=0x7f5fb002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:42:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.440+0000 7f5fbec4f640 1 -- 172.21.15.7:0/3366708030 shutdown_connections 2024-09-19T08:42:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.440+0000 7f5fbec4f640 1 --2- 172.21.15.7:0/3366708030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fb8101410 0x7f5fb810d940 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.440+0000 7f5fbec4f640 1 --2- 172.21.15.7:0/3366708030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fb8100a70 0x7f5fb8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.440+0000 7f5fbec4f640 1 --2- 172.21.15.7:0/3366708030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fb8106a70 0x7f5fb8106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.440+0000 7f5fbec4f640 1 -- 172.21.15.7:0/3366708030 >> 172.21.15.7:0/3366708030 conn(0x7f5fb80fc790 msgr2=0x7f5fb80febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.440+0000 7f5fbec4f640 1 -- 172.21.15.7:0/3366708030 shutdown_connections 2024-09-19T08:42:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.440+0000 7f5fbec4f640 1 -- 172.21.15.7:0/3366708030 wait complete. 2024-09-19T08:42:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.440+0000 7f5fbec4f640 1 Processor -- start 2024-09-19T08:42:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.440+0000 7f5fbec4f640 1 -- start start 2024-09-19T08:42:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.441+0000 7f5fbec4f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fb8100a70 0x7f5fb81984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.441+0000 7f5fbec4f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fb8101410 0x7f5fb81989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.441+0000 7f5fbec4f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fb8106a70 0x7f5fb819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.441+0000 7f5fbec4f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb8110e70 con 0x7f5fb8100a70 2024-09-19T08:42:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.441+0000 7f5fbec4f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb8110cf0 con 0x7f5fb8106a70 2024-09-19T08:42:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.441+0000 7f5fbec4f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb8110ff0 con 0x7f5fb8101410 2024-09-19T08:42:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.441+0000 7f5fbc9eb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fb8100a70 0x7f5fb81984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.441+0000 7f5fbc9eb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fb8100a70 0x7f5fb81984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41822/0 (socket says 172.21.15.7:41822) 2024-09-19T08:42:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.441+0000 7f5fbc9eb640 1 -- 172.21.15.7:0/3689730866 learned_addr learned my addr 172.21.15.7:0/3689730866 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:42:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.441+0000 7f5fb7fff640 1 --2- 172.21.15.7:0/3689730866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fb8101410 0x7f5fb81989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.441+0000 7f5fbd1ec640 1 --2- 172.21.15.7:0/3689730866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fb8106a70 0x7f5fb819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.441+0000 7f5fbc9eb640 1 -- 172.21.15.7:0/3689730866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fb8101410 msgr2=0x7f5fb81989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.441+0000 7f5fbc9eb640 1 --2- 172.21.15.7:0/3689730866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fb8101410 0x7f5fb81989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.441+0000 7f5fbc9eb640 1 -- 172.21.15.7:0/3689730866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fb8106a70 msgr2=0x7f5fb819cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:57.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.441+0000 7f5fbc9eb640 1 --2- 172.21.15.7:0/3689730866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fb8106a70 0x7f5fb819cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.441+0000 7f5fbc9eb640 1 -- 172.21.15.7:0/3689730866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb819d450 con 0x7f5fb8100a70 2024-09-19T08:42:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.441+0000 7f5fbc9eb640 1 --2- 172.21.15.7:0/3689730866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fb8100a70 0x7f5fb81984a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00c890 tx=0x7f5fac00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.441+0000 7f5fb5ffb640 1 -- 172.21.15.7:0/3689730866 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac004220 con 0x7f5fb8100a70 2024-09-19T08:42:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.441+0000 7f5fbec4f640 1 -- 172.21.15.7:0/3689730866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fb819d740 con 0x7f5fb8100a70 2024-09-19T08:42:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.441+0000 7f5fb5ffb640 1 -- 172.21.15.7:0/3689730866 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fac0043c0 con 0x7f5fb8100a70 2024-09-19T08:42:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.442+0000 7f5fb5ffb640 1 -- 172.21.15.7:0/3689730866 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac004a00 con 0x7f5fb8100a70 2024-09-19T08:42:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.442+0000 7f5fbec4f640 1 -- 172.21.15.7:0/3689730866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fb81a5020 con 0x7f5fb8100a70 2024-09-19T08:42:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.443+0000 7f5fbec4f640 1 -- 172.21.15.7:0/3689730866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fb8100ed0 con 0x7f5fb8100a70 2024-09-19T08:42:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.444+0000 7f5fb5ffb640 1 -- 172.21.15.7:0/3689730866 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f5fac0079b0 con 0x7f5fb8100a70 2024-09-19T08:42:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.445+0000 7f5fb5ffb640 1 --2- 172.21.15.7:0/3689730866 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f5fa80a3240 0x7f5fa80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.445+0000 7f5fb7fff640 1 --2- 172.21.15.7:0/3689730866 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f5fa80a3240 0x7f5fa80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.445+0000 7f5fb5ffb640 1 -- 172.21.15.7:0/3689730866 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8240+0+0 (secure 0 0 0) 0x7f5fac0cf5a0 con 0x7f5fb8100a70 2024-09-19T08:42:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.445+0000 7f5fb7fff640 1 --2- 172.21.15.7:0/3689730866 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f5fa80a3240 0x7f5fa80a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5fb80feac0 tx=0x7f5fa400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.449+0000 7f5fb5ffb640 1 -- 172.21.15.7:0/3689730866 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5fac014030 con 0x7f5fb8100a70 2024-09-19T08:42:57.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:57 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1374355041' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T08:42:57.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:57 smithi044 ceph-mon[35072]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T08:42:57.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:57 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-19T08:42:57.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:57 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-19T08:42:57.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:57 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-19T08:42:57.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:57 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-19T08:42:57.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:57 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-19T08:42:57.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:57 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-19T08:42:57.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:57 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]: dispatch 2024-09-19T08:42:57.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:57 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2024-09-19T08:42:57.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:57 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-19T08:42:57.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.648+0000 7f5fbec4f640 1 -- 172.21.15.7:0/3689730866 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f5fb806af60 con 0x7f5fa80a3240 2024-09-19T08:42:57.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.677+0000 7f5fb5ffb640 1 -- 172.21.15.7:0/3689730866 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5fb806af60 con 0x7f5fa80a3240 2024-09-19T08:42:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.679+0000 7f5fbec4f640 1 -- 172.21.15.7:0/3689730866 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f5fa80a3240 msgr2=0x7f5fa80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.679+0000 7f5fbec4f640 1 --2- 172.21.15.7:0/3689730866 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f5fa80a3240 0x7f5fa80a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5fb80feac0 tx=0x7f5fa400b390 comp rx=0 tx=0).stop 2024-09-19T08:42:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.679+0000 7f5fbec4f640 1 -- 172.21.15.7:0/3689730866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fb8100a70 msgr2=0x7f5fb81984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.679+0000 7f5fbec4f640 1 --2- 172.21.15.7:0/3689730866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fb8100a70 0x7f5fb81984a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00c890 tx=0x7f5fac00cd50 comp rx=0 tx=0).stop 2024-09-19T08:42:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.679+0000 7f5fbec4f640 1 -- 172.21.15.7:0/3689730866 shutdown_connections 2024-09-19T08:42:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.679+0000 7f5fbec4f640 1 --2- 172.21.15.7:0/3689730866 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f5fa80a3240 0x7f5fa80a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.679+0000 7f5fbec4f640 1 --2- 172.21.15.7:0/3689730866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fb8106a70 0x7f5fb819cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.679+0000 7f5fbec4f640 1 --2- 172.21.15.7:0/3689730866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fb8101410 0x7f5fb81989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.679+0000 7f5fbec4f640 1 --2- 172.21.15.7:0/3689730866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fb8100a70 0x7f5fb81984a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.679+0000 7f5fbec4f640 1 -- 172.21.15.7:0/3689730866 >> 172.21.15.7:0/3689730866 conn(0x7f5fb80fc790 msgr2=0x7f5fb806a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.679+0000 7f5fbec4f640 1 -- 172.21.15.7:0/3689730866 shutdown_connections 2024-09-19T08:42:57.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:57.679+0000 7f5fbec4f640 1 -- 172.21.15.7:0/3689730866 wait complete. 2024-09-19T08:42:58.033 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:42:57 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:42:57.653+0000 7f497fad3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:42:58.033 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:42:57 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:42:57.653+0000 7f497fad3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:42:58.033 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:42:57 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:42:57.653+0000 7f497fad3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:42:58.033 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:42:57 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:42:57.653+0000 7f497fad3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:42:58.033 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:42:57 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:42:57.653+0000 7f497fad3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:42:58.426 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:58 smithi007 ceph-mon[31221]: pgmap v280: 97 pgs: 97 active+clean; 581 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-09-19T08:42:58.426 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:58 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-19T08:42:58.426 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:58 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-19T08:42:58.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:58 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-19T08:42:58.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:58 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-19T08:42:58.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:58 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-19T08:42:58.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:58 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-19T08:42:58.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:58 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-19T08:42:58.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:58 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-09-19T08:42:58.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:58 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-19T08:42:58.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:58 smithi007 ceph-mon[31221]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T08:42:58.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:58 smithi007 ceph-mon[31221]: from='client.14679 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:42:58.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:58 smithi175 ceph-mon[35688]: pgmap v280: 97 pgs: 97 active+clean; 581 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-09-19T08:42:58.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:58 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-19T08:42:58.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:58 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-19T08:42:58.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:58 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-19T08:42:58.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:58 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-19T08:42:58.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:58 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-19T08:42:58.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:58 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-19T08:42:58.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:58 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-19T08:42:58.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:58 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-09-19T08:42:58.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:58 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-19T08:42:58.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:58 smithi175 ceph-mon[35688]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T08:42:58.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:58 smithi175 ceph-mon[35688]: from='client.14679 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:42:58.458 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T08:42:58.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:58 smithi044 ceph-mon[35072]: pgmap v280: 97 pgs: 97 active+clean; 581 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-09-19T08:42:58.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:58 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-19T08:42:58.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:58 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-19T08:42:58.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:58 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-19T08:42:58.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:58 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-19T08:42:58.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:58 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-19T08:42:58.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:58 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-19T08:42:58.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:58 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-19T08:42:58.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:58 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2024-09-19T08:42:58.553 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:58 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-19T08:42:58.553 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:58 smithi044 ceph-mon[35072]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T08:42:58.553 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:58 smithi044 ceph-mon[35072]: from='client.14679 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:42:58.719 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:42:59.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.181+0000 7f3ce54bb640 1 -- 172.21.15.7:0/365946993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ce0103660 msgr2=0x7f3ce010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:59.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.181+0000 7f3ce54bb640 1 --2- 172.21.15.7:0/365946993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ce0103660 0x7f3ce010bb50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009900 tx=0x7f3cd402a480 comp rx=0 tx=0).stop 2024-09-19T08:42:59.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.181+0000 7f3ce54bb640 1 -- 172.21.15.7:0/365946993 shutdown_connections 2024-09-19T08:42:59.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.181+0000 7f3ce54bb640 1 --2- 172.21.15.7:0/365946993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ce010c170 0x7f3ce010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:59.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.181+0000 7f3ce54bb640 1 --2- 172.21.15.7:0/365946993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ce0103660 0x7f3ce010bb50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:59.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.181+0000 7f3ce54bb640 1 --2- 172.21.15.7:0/365946993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ce0102d40 0x7f3ce0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:59.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.181+0000 7f3ce54bb640 1 -- 172.21.15.7:0/365946993 >> 172.21.15.7:0/365946993 conn(0x7f3ce00fc7a0 msgr2=0x7f3ce00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:59.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.181+0000 7f3ce54bb640 1 -- 172.21.15.7:0/365946993 shutdown_connections 2024-09-19T08:42:59.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.181+0000 7f3ce54bb640 1 -- 172.21.15.7:0/365946993 wait complete. 2024-09-19T08:42:59.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.182+0000 7f3ce54bb640 1 Processor -- start 2024-09-19T08:42:59.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.182+0000 7f3ce54bb640 1 -- start start 2024-09-19T08:42:59.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.182+0000 7f3ce54bb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ce0102d40 0x7f3ce01009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:59.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.182+0000 7f3ce54bb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ce0103660 0x7f3ce0100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:59.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.182+0000 7f3ce54bb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ce010c170 0x7f3ce0101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:59.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.182+0000 7f3ce54bb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce0111f70 con 0x7f3ce010c170 2024-09-19T08:42:59.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.182+0000 7f3ce54bb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce0111df0 con 0x7f3ce0102d40 2024-09-19T08:42:59.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.182+0000 7f3ce54bb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce01120f0 con 0x7f3ce0103660 2024-09-19T08:42:59.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.182+0000 7f3cdf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ce010c170 0x7f3ce0101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:59.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.182+0000 7f3cdf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ce010c170 0x7f3ce0101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41868/0 (socket says 172.21.15.7:41868) 2024-09-19T08:42:59.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.182+0000 7f3cdf7fe640 1 -- 172.21.15.7:0/1565943750 learned_addr learned my addr 172.21.15.7:0/1565943750 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:42:59.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.182+0000 7f3cdeffd640 1 --2- 172.21.15.7:0/1565943750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ce0102d40 0x7f3ce01009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:59.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.182+0000 7f3cde7fc640 1 --2- 172.21.15.7:0/1565943750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ce0103660 0x7f3ce0100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:59.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.182+0000 7f3cdf7fe640 1 -- 172.21.15.7:0/1565943750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ce0103660 msgr2=0x7f3ce0100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:59.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.183+0000 7f3cdf7fe640 1 --2- 172.21.15.7:0/1565943750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ce0103660 0x7f3ce0100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:59.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.183+0000 7f3cdf7fe640 1 -- 172.21.15.7:0/1565943750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ce0102d40 msgr2=0x7f3ce01009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:59.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.183+0000 7f3cdf7fe640 1 --2- 172.21.15.7:0/1565943750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ce0102d40 0x7f3ce01009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:59.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.183+0000 7f3cdf7fe640 1 -- 172.21.15.7:0/1565943750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce01a68d0 con 0x7f3ce010c170 2024-09-19T08:42:59.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.183+0000 7f3cdeffd640 1 --2- 172.21.15.7:0/1565943750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ce0102d40 0x7f3ce01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:42:59.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.183+0000 7f3cde7fc640 1 --2- 172.21.15.7:0/1565943750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ce0103660 0x7f3ce0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:42:59.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.183+0000 7f3cdf7fe640 1 --2- 172.21.15.7:0/1565943750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ce010c170 0x7f3ce0101420 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800cad0 tx=0x7f3cd800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:59.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.183+0000 7f3cc7fff640 1 -- 172.21.15.7:0/1565943750 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd800ae20 con 0x7f3ce010c170 2024-09-19T08:42:59.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.183+0000 7f3cc7fff640 1 -- 172.21.15.7:0/1565943750 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cd8005020 con 0x7f3ce010c170 2024-09-19T08:42:59.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.183+0000 7f3ce54bb640 1 -- 172.21.15.7:0/1565943750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce01a6bc0 con 0x7f3ce010c170 2024-09-19T08:42:59.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.183+0000 7f3cc7fff640 1 -- 172.21.15.7:0/1565943750 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd800f6f0 con 0x7f3ce010c170 2024-09-19T08:42:59.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.183+0000 7f3ce54bb640 1 -- 172.21.15.7:0/1565943750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce01a70b0 con 0x7f3ce010c170 2024-09-19T08:42:59.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.184+0000 7f3ce54bb640 1 -- 172.21.15.7:0/1565943750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ce0103120 con 0x7f3ce010c170 2024-09-19T08:42:59.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.185+0000 7f3cc7fff640 1 -- 172.21.15.7:0/1565943750 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3cd80051d0 con 0x7f3ce010c170 2024-09-19T08:42:59.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.186+0000 7f3cc7fff640 1 --2- 172.21.15.7:0/1565943750 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3cc80a32d0 0x7f3cc80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:59.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.186+0000 7f3cdeffd640 1 --2- 172.21.15.7:0/1565943750 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3cc80a32d0 0x7f3cc80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:59.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.186+0000 7f3cc7fff640 1 -- 172.21.15.7:0/1565943750 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3cd80cff40 con 0x7f3ce010c170 2024-09-19T08:42:59.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.186+0000 7f3cdeffd640 1 --2- 172.21.15.7:0/1565943750 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3cc80a32d0 0x7f3cc80a5790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000abe0 tx=0x7f3cd000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:59.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.189+0000 7f3cc7fff640 1 -- 172.21.15.7:0/1565943750 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3cd8014030 con 0x7f3ce010c170 2024-09-19T08:42:59.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.390+0000 7f3ce54bb640 1 -- 172.21.15.7:0/1565943750 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3ce0062630 con 0x7f3cc80a32d0 2024-09-19T08:42:59.392 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:42:59 smithi007 ceph-mon[31221]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T08:42:59.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.419+0000 7f3cc7fff640 1 -- 172.21.15.7:0/1565943750 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3ce0062630 con 0x7f3cc80a32d0 2024-09-19T08:42:59.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.421+0000 7f3ce54bb640 1 -- 172.21.15.7:0/1565943750 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3cc80a32d0 msgr2=0x7f3cc80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:59.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.421+0000 7f3ce54bb640 1 --2- 172.21.15.7:0/1565943750 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3cc80a32d0 0x7f3cc80a5790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000abe0 tx=0x7f3cd000a5c0 comp rx=0 tx=0).stop 2024-09-19T08:42:59.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.421+0000 7f3ce54bb640 1 -- 172.21.15.7:0/1565943750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ce010c170 msgr2=0x7f3ce0101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:59.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.421+0000 7f3ce54bb640 1 --2- 172.21.15.7:0/1565943750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ce010c170 0x7f3ce0101420 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800cad0 tx=0x7f3cd800cf90 comp rx=0 tx=0).stop 2024-09-19T08:42:59.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.421+0000 7f3ce54bb640 1 -- 172.21.15.7:0/1565943750 shutdown_connections 2024-09-19T08:42:59.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.421+0000 7f3ce54bb640 1 --2- 172.21.15.7:0/1565943750 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3cc80a32d0 0x7f3cc80a5790 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:59.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.421+0000 7f3ce54bb640 1 --2- 172.21.15.7:0/1565943750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ce010c170 0x7f3ce0101420 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:59.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.421+0000 7f3ce54bb640 1 --2- 172.21.15.7:0/1565943750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ce0103660 0x7f3ce0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:59.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.421+0000 7f3ce54bb640 1 --2- 172.21.15.7:0/1565943750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ce0102d40 0x7f3ce01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:59.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.421+0000 7f3ce54bb640 1 -- 172.21.15.7:0/1565943750 >> 172.21.15.7:0/1565943750 conn(0x7f3ce00fc7a0 msgr2=0x7f3ce00fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:59.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.421+0000 7f3ce54bb640 1 -- 172.21.15.7:0/1565943750 shutdown_connections 2024-09-19T08:42:59.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:42:59.422+0000 7f3ce54bb640 1 -- 172.21.15.7:0/1565943750 wait complete. 2024-09-19T08:42:59.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:42:59 smithi175 ceph-mon[35688]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T08:42:59.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:42:59 smithi044 ceph-mon[35072]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T08:43:00.058 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T08:43:00.317 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:00.425 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:00 smithi007 ceph-mon[31221]: pgmap v283: 97 pgs: 3 peering, 94 active+clean; 582 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 3.1 KiB/s wr, 14 op/s 2024-09-19T08:43:00.426 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:00 smithi007 ceph-mon[31221]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T08:43:00.426 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:00 smithi007 ceph-mon[31221]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:00.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:00 smithi175 ceph-mon[35688]: pgmap v283: 97 pgs: 3 peering, 94 active+clean; 582 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 3.1 KiB/s wr, 14 op/s 2024-09-19T08:43:00.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:00 smithi175 ceph-mon[35688]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T08:43:00.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:00 smithi175 ceph-mon[35688]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:00.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:00 smithi044 ceph-mon[35072]: pgmap v283: 97 pgs: 3 peering, 94 active+clean; 582 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 3.1 KiB/s wr, 14 op/s 2024-09-19T08:43:00.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:00 smithi044 ceph-mon[35072]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T08:43:00.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:00 smithi044 ceph-mon[35072]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:00.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.737+0000 7fd5ca139640 1 -- 172.21.15.7:0/647880172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5c4103660 msgr2=0x7fd5c410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:00.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.737+0000 7fd5ca139640 1 --2- 172.21.15.7:0/647880172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5c4103660 0x7fd5c410bb50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8009900 tx=0x7fd5b802a480 comp rx=0 tx=0).stop 2024-09-19T08:43:00.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.737+0000 7fd5ca139640 1 -- 172.21.15.7:0/647880172 shutdown_connections 2024-09-19T08:43:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.737+0000 7fd5ca139640 1 --2- 172.21.15.7:0/647880172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5c410c170 0x7fd5c410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.737+0000 7fd5ca139640 1 --2- 172.21.15.7:0/647880172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5c4103660 0x7fd5c410bb50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.737+0000 7fd5ca139640 1 --2- 172.21.15.7:0/647880172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5c4102d40 0x7fd5c4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.737+0000 7fd5ca139640 1 -- 172.21.15.7:0/647880172 >> 172.21.15.7:0/647880172 conn(0x7fd5c40fc7a0 msgr2=0x7fd5c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.737+0000 7fd5ca139640 1 -- 172.21.15.7:0/647880172 shutdown_connections 2024-09-19T08:43:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.737+0000 7fd5ca139640 1 -- 172.21.15.7:0/647880172 wait complete. 2024-09-19T08:43:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.738+0000 7fd5ca139640 1 Processor -- start 2024-09-19T08:43:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.738+0000 7fd5ca139640 1 -- start start 2024-09-19T08:43:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.738+0000 7fd5ca139640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5c4102d40 0x7fd5c41985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.738+0000 7fd5ca139640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5c4103660 0x7fd5c4198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.738+0000 7fd5ca139640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5c410c170 0x7fd5c419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.738+0000 7fd5ca139640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c4111fb0 con 0x7fd5c4103660 2024-09-19T08:43:00.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.738+0000 7fd5ca139640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c4111e30 con 0x7fd5c410c170 2024-09-19T08:43:00.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.738+0000 7fd5ca139640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c4112130 con 0x7fd5c4102d40 2024-09-19T08:43:00.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.738+0000 7fd5c2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5c4103660 0x7fd5c4198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:00.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.738+0000 7fd5c2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5c4103660 0x7fd5c4198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41874/0 (socket says 172.21.15.7:41874) 2024-09-19T08:43:00.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.738+0000 7fd5c2ffd640 1 -- 172.21.15.7:0/708254998 learned_addr learned my addr 172.21.15.7:0/708254998 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:00.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.738+0000 7fd5c3fff640 1 --2- 172.21.15.7:0/708254998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5c410c170 0x7fd5c419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:00.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.738+0000 7fd5c37fe640 1 --2- 172.21.15.7:0/708254998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5c4102d40 0x7fd5c41985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:00.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.739+0000 7fd5c2ffd640 1 -- 172.21.15.7:0/708254998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5c4102d40 msgr2=0x7fd5c41985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:00.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.739+0000 7fd5c2ffd640 1 --2- 172.21.15.7:0/708254998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5c4102d40 0x7fd5c41985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:00.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.739+0000 7fd5c2ffd640 1 -- 172.21.15.7:0/708254998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5c410c170 msgr2=0x7fd5c419ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:00.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.739+0000 7fd5c2ffd640 1 --2- 172.21.15.7:0/708254998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5c410c170 0x7fd5c419ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:00.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.739+0000 7fd5c2ffd640 1 -- 172.21.15.7:0/708254998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c419d560 con 0x7fd5c4103660 2024-09-19T08:43:00.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.739+0000 7fd5c2ffd640 1 --2- 172.21.15.7:0/708254998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5c4103660 0x7fd5c4198af0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8006010 tx=0x7fd5b80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:00.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.739+0000 7fd5c0ff9640 1 -- 172.21.15.7:0/708254998 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b803f030 con 0x7fd5c4103660 2024-09-19T08:43:00.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.739+0000 7fd5c0ff9640 1 -- 172.21.15.7:0/708254998 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5b8003ce0 con 0x7fd5c4103660 2024-09-19T08:43:00.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.739+0000 7fd5c0ff9640 1 -- 172.21.15.7:0/708254998 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8035070 con 0x7fd5c4103660 2024-09-19T08:43:00.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.739+0000 7fd5ca139640 1 -- 172.21.15.7:0/708254998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5c419d7f0 con 0x7fd5c4103660 2024-09-19T08:43:00.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.739+0000 7fd5ca139640 1 -- 172.21.15.7:0/708254998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5c41a5130 con 0x7fd5c4103660 2024-09-19T08:43:00.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.740+0000 7fd5ca139640 1 -- 172.21.15.7:0/708254998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5c4103120 con 0x7fd5c4103660 2024-09-19T08:43:00.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.741+0000 7fd5c0ff9640 1 -- 172.21.15.7:0/708254998 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fd5b8042030 con 0x7fd5c4103660 2024-09-19T08:43:00.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.742+0000 7fd5c0ff9640 1 --2- 172.21.15.7:0/708254998 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd5ac0a3350 0x7fd5ac0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:00.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.742+0000 7fd5c0ff9640 1 -- 172.21.15.7:0/708254998 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd5b80f00a0 con 0x7fd5c4103660 2024-09-19T08:43:00.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.742+0000 7fd5c37fe640 1 --2- 172.21.15.7:0/708254998 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd5ac0a3350 0x7fd5ac0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:00.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.743+0000 7fd5c37fe640 1 --2- 172.21.15.7:0/708254998 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd5ac0a3350 0x7fd5ac0a5810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4009990 tx=0x7fd5b4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:00.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.746+0000 7fd5c0ff9640 1 -- 172.21.15.7:0/708254998 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd5b80bcc60 con 0x7fd5c4103660 2024-09-19T08:43:00.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.952+0000 7fd5ca139640 1 -- 172.21.15.7:0/708254998 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fd5c4062630 con 0x7fd5ac0a3350 2024-09-19T08:43:00.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.958+0000 7fd5c0ff9640 1 -- 172.21.15.7:0/708254998 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fd5c4062630 con 0x7fd5ac0a3350 2024-09-19T08:43:00.959 INFO:teuthology.orchestra.run.smithi007.stdout:/volumes/qa/sv_0/5acea913-0bbd-4d92-82ab-195b368f0a1d 2024-09-19T08:43:00.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.960+0000 7fd5ca139640 1 -- 172.21.15.7:0/708254998 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd5ac0a3350 msgr2=0x7fd5ac0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:00.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.960+0000 7fd5ca139640 1 --2- 172.21.15.7:0/708254998 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd5ac0a3350 0x7fd5ac0a5810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4009990 tx=0x7fd5b4009110 comp rx=0 tx=0).stop 2024-09-19T08:43:00.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.960+0000 7fd5ca139640 1 -- 172.21.15.7:0/708254998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5c4103660 msgr2=0x7fd5c4198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:00.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.960+0000 7fd5ca139640 1 --2- 172.21.15.7:0/708254998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5c4103660 0x7fd5c4198af0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8006010 tx=0x7fd5b80042f0 comp rx=0 tx=0).stop 2024-09-19T08:43:00.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.960+0000 7fd5ca139640 1 -- 172.21.15.7:0/708254998 shutdown_connections 2024-09-19T08:43:00.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.960+0000 7fd5ca139640 1 --2- 172.21.15.7:0/708254998 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd5ac0a3350 0x7fd5ac0a5810 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:00.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.960+0000 7fd5ca139640 1 --2- 172.21.15.7:0/708254998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5c410c170 0x7fd5c419ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:00.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.960+0000 7fd5ca139640 1 --2- 172.21.15.7:0/708254998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5c4103660 0x7fd5c4198af0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:00.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.960+0000 7fd5ca139640 1 --2- 172.21.15.7:0/708254998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5c4102d40 0x7fd5c41985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:00.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.960+0000 7fd5ca139640 1 -- 172.21.15.7:0/708254998 >> 172.21.15.7:0/708254998 conn(0x7fd5c40fc7a0 msgr2=0x7fd5c40fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:00.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.960+0000 7fd5ca139640 1 -- 172.21.15.7:0/708254998 shutdown_connections 2024-09-19T08:43:00.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:00.960+0000 7fd5ca139640 1 -- 172.21.15.7:0/708254998 wait complete. 2024-09-19T08:43:01.663 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T08:43:01.919 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:02.347 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:02 smithi007 ceph-mon[31221]: pgmap v284: 97 pgs: 3 peering, 94 active+clean; 602 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.0 KiB/s wr, 17 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T08:43:02.347 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:02 smithi007 ceph-mon[31221]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:02.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.346+0000 7fb65040f640 1 -- 172.21.15.7:0/2603526102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb64810c170 msgr2=0x7fb64810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:02.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.346+0000 7fb65040f640 1 --2- 172.21.15.7:0/2603526102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb64810c170 0x7fb64810e610 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb640009ca0 tx=0x7fb64002a950 comp rx=0 tx=0).stop 2024-09-19T08:43:02.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.346+0000 7fb65040f640 1 -- 172.21.15.7:0/2603526102 shutdown_connections 2024-09-19T08:43:02.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.346+0000 7fb65040f640 1 --2- 172.21.15.7:0/2603526102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb64810c170 0x7fb64810e610 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:02.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.346+0000 7fb65040f640 1 --2- 172.21.15.7:0/2603526102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb648103660 0x7fb64810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:02.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.346+0000 7fb65040f640 1 --2- 172.21.15.7:0/2603526102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb648102d40 0x7fb648103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:02.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.346+0000 7fb65040f640 1 -- 172.21.15.7:0/2603526102 >> 172.21.15.7:0/2603526102 conn(0x7fb6480fc7a0 msgr2=0x7fb6480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:02.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.347+0000 7fb65040f640 1 -- 172.21.15.7:0/2603526102 shutdown_connections 2024-09-19T08:43:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.347+0000 7fb65040f640 1 -- 172.21.15.7:0/2603526102 wait complete. 2024-09-19T08:43:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.348+0000 7fb65040f640 1 Processor -- start 2024-09-19T08:43:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.348+0000 7fb65040f640 1 -- start start 2024-09-19T08:43:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.348+0000 7fb65040f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb648102d40 0x7fb648198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.348+0000 7fb65040f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb648103660 0x7fb648198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.348+0000 7fb65040f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb64810c170 0x7fb64819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.348+0000 7fb65040f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb648111f30 con 0x7fb648103660 2024-09-19T08:43:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.348+0000 7fb65040f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb648111db0 con 0x7fb648102d40 2024-09-19T08:43:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.348+0000 7fb65040f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb6481120b0 con 0x7fb64810c170 2024-09-19T08:43:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.348+0000 7fb64d9aa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb648103660 0x7fb648198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.348+0000 7fb64d9aa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb648103660 0x7fb648198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41902/0 (socket says 172.21.15.7:41902) 2024-09-19T08:43:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.348+0000 7fb64d9aa640 1 -- 172.21.15.7:0/2410480937 learned_addr learned my addr 172.21.15.7:0/2410480937 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.348+0000 7fb64e1ab640 1 --2- 172.21.15.7:0/2410480937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb648102d40 0x7fb648198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:02.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.348+0000 7fb64d9aa640 1 -- 172.21.15.7:0/2410480937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb64810c170 msgr2=0x7fb64819cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:02.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.348+0000 7fb64d9aa640 1 --2- 172.21.15.7:0/2410480937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb64810c170 0x7fb64819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:02.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.348+0000 7fb64d9aa640 1 -- 172.21.15.7:0/2410480937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb648102d40 msgr2=0x7fb648198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:02.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.349+0000 7fb64d9aa640 1 --2- 172.21.15.7:0/2410480937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb648102d40 0x7fb648198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:02.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.349+0000 7fb64d9aa640 1 -- 172.21.15.7:0/2410480937 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64819d3f0 con 0x7fb648103660 2024-09-19T08:43:02.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.349+0000 7fb64e1ab640 1 --2- 172.21.15.7:0/2410480937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb648102d40 0x7fb648198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:43:02.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.349+0000 7fb64d9aa640 1 --2- 172.21.15.7:0/2410480937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb648103660 0x7fb648198980 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb64400c940 tx=0x7fb64400ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:02.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.349+0000 7fb63b7fe640 1 -- 172.21.15.7:0/2410480937 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644004220 con 0x7fb648103660 2024-09-19T08:43:02.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.349+0000 7fb63b7fe640 1 -- 172.21.15.7:0/2410480937 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6440043c0 con 0x7fb648103660 2024-09-19T08:43:02.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.349+0000 7fb65040f640 1 -- 172.21.15.7:0/2410480937 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb64819d6e0 con 0x7fb648103660 2024-09-19T08:43:02.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.349+0000 7fb63b7fe640 1 -- 172.21.15.7:0/2410480937 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644004a00 con 0x7fb648103660 2024-09-19T08:43:02.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.349+0000 7fb65040f640 1 -- 172.21.15.7:0/2410480937 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6481a4fc0 con 0x7fb648103660 2024-09-19T08:43:02.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.350+0000 7fb65040f640 1 -- 172.21.15.7:0/2410480937 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb648103120 con 0x7fb648103660 2024-09-19T08:43:02.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.351+0000 7fb63b7fe640 1 -- 172.21.15.7:0/2410480937 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fb6440079b0 con 0x7fb648103660 2024-09-19T08:43:02.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.352+0000 7fb63b7fe640 1 --2- 172.21.15.7:0/2410480937 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb6340a3350 0x7fb6340a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:02.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.352+0000 7fb64e1ab640 1 --2- 172.21.15.7:0/2410480937 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb6340a3350 0x7fb6340a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:02.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.352+0000 7fb63b7fe640 1 -- 172.21.15.7:0/2410480937 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb6440cfa00 con 0x7fb648103660 2024-09-19T08:43:02.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.352+0000 7fb64e1ab640 1 --2- 172.21.15.7:0/2410480937 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb6340a3350 0x7fb6340a5810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb63c005d00 tx=0x7fb63c009550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:02.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.356+0000 7fb63b7fe640 1 -- 172.21.15.7:0/2410480937 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb6440d1e20 con 0x7fb648103660 2024-09-19T08:43:02.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:02 smithi175 ceph-mon[35688]: pgmap v284: 97 pgs: 3 peering, 94 active+clean; 602 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.0 KiB/s wr, 17 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T08:43:02.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:02 smithi175 ceph-mon[35688]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:02.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:02 smithi044 ceph-mon[35072]: pgmap v284: 97 pgs: 3 peering, 94 active+clean; 602 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.0 KiB/s wr, 17 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T08:43:02.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:02 smithi044 ceph-mon[35072]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:02.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.561+0000 7fb65040f640 1 -- 172.21.15.7:0/2410480937 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb648062630 con 0x7fb6340a3350 2024-09-19T08:43:02.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.586+0000 7fb63b7fe640 1 -- 172.21.15.7:0/2410480937 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb648062630 con 0x7fb6340a3350 2024-09-19T08:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.588+0000 7fb65040f640 1 -- 172.21.15.7:0/2410480937 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb6340a3350 msgr2=0x7fb6340a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.588+0000 7fb65040f640 1 --2- 172.21.15.7:0/2410480937 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb6340a3350 0x7fb6340a5810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb63c005d00 tx=0x7fb63c009550 comp rx=0 tx=0).stop 2024-09-19T08:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.588+0000 7fb65040f640 1 -- 172.21.15.7:0/2410480937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb648103660 msgr2=0x7fb648198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.588+0000 7fb65040f640 1 --2- 172.21.15.7:0/2410480937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb648103660 0x7fb648198980 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb64400c940 tx=0x7fb64400ce00 comp rx=0 tx=0).stop 2024-09-19T08:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.588+0000 7fb65040f640 1 -- 172.21.15.7:0/2410480937 shutdown_connections 2024-09-19T08:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.588+0000 7fb65040f640 1 --2- 172.21.15.7:0/2410480937 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb6340a3350 0x7fb6340a5810 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.588+0000 7fb65040f640 1 --2- 172.21.15.7:0/2410480937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb64810c170 0x7fb64819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.588+0000 7fb65040f640 1 --2- 172.21.15.7:0/2410480937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb648103660 0x7fb648198980 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.588+0000 7fb65040f640 1 --2- 172.21.15.7:0/2410480937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb648102d40 0x7fb648198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.588+0000 7fb65040f640 1 -- 172.21.15.7:0/2410480937 >> 172.21.15.7:0/2410480937 conn(0x7fb6480fc7a0 msgr2=0x7fb6480fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.588+0000 7fb65040f640 1 -- 172.21.15.7:0/2410480937 shutdown_connections 2024-09-19T08:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:02.588+0000 7fb65040f640 1 -- 172.21.15.7:0/2410480937 wait complete. 2024-09-19T08:43:03.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:03 smithi007 ceph-mon[31221]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:03.323 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T08:43:03.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:03 smithi175 ceph-mon[35688]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:03.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:03 smithi044 ceph-mon[35072]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:03.582 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:04.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.030+0000 7faeec84f640 1 -- 172.21.15.7:0/1169797222 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee8106a80 msgr2=0x7faee8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:04.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.030+0000 7faeec84f640 1 --2- 172.21.15.7:0/1169797222 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee8106a80 0x7faee8106e60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faed8009930 tx=0x7faed802a420 comp rx=0 tx=0).stop 2024-09-19T08:43:04.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.030+0000 7faeec84f640 1 -- 172.21.15.7:0/1169797222 shutdown_connections 2024-09-19T08:43:04.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.030+0000 7faeec84f640 1 --2- 172.21.15.7:0/1169797222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faee8101420 0x7faee810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:04.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.030+0000 7faeec84f640 1 --2- 172.21.15.7:0/1169797222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faee8100a80 0x7faee8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:04.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.030+0000 7faeec84f640 1 --2- 172.21.15.7:0/1169797222 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee8106a80 0x7faee8106e60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:04.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.030+0000 7faeec84f640 1 -- 172.21.15.7:0/1169797222 >> 172.21.15.7:0/1169797222 conn(0x7faee80fc7a0 msgr2=0x7faee80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:04.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.030+0000 7faeec84f640 1 -- 172.21.15.7:0/1169797222 shutdown_connections 2024-09-19T08:43:04.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.030+0000 7faeec84f640 1 -- 172.21.15.7:0/1169797222 wait complete. 2024-09-19T08:43:04.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.031+0000 7faeec84f640 1 Processor -- start 2024-09-19T08:43:04.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.031+0000 7faeec84f640 1 -- start start 2024-09-19T08:43:04.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.031+0000 7faeec84f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faee8100a80 0x7faee8199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:04.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.031+0000 7faeec84f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee8101420 0x7faee81997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:04.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.031+0000 7faeec84f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faee8106a80 0x7faee81a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:04.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.031+0000 7faeec84f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faee8110ea0 con 0x7faee8101420 2024-09-19T08:43:04.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.031+0000 7faeec84f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faee8110d20 con 0x7faee8100a80 2024-09-19T08:43:04.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.031+0000 7faeec84f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faee8111020 con 0x7faee8106a80 2024-09-19T08:43:04.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.031+0000 7faee5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee8101420 0x7faee81997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:04.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.031+0000 7faee5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee8101420 0x7faee81997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35598/0 (socket says 172.21.15.7:35598) 2024-09-19T08:43:04.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.031+0000 7faee5d9b640 1 -- 172.21.15.7:0/1214077409 learned_addr learned my addr 172.21.15.7:0/1214077409 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:04.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.031+0000 7faee659c640 1 --2- 172.21.15.7:0/1214077409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faee8100a80 0x7faee8199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:04.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.031+0000 7faee5d9b640 1 -- 172.21.15.7:0/1214077409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faee8106a80 msgr2=0x7faee81a4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:04.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.031+0000 7faee6d9d640 1 --2- 172.21.15.7:0/1214077409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faee8106a80 0x7faee81a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:04.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.031+0000 7faee5d9b640 1 --2- 172.21.15.7:0/1214077409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faee8106a80 0x7faee81a4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:04.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.031+0000 7faee5d9b640 1 -- 172.21.15.7:0/1214077409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faee8100a80 msgr2=0x7faee8199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:04.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.031+0000 7faee5d9b640 1 --2- 172.21.15.7:0/1214077409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faee8100a80 0x7faee8199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:04.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.031+0000 7faee5d9b640 1 -- 172.21.15.7:0/1214077409 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee81a4850 con 0x7faee8101420 2024-09-19T08:43:04.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.031+0000 7faee6d9d640 1 --2- 172.21.15.7:0/1214077409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faee8106a80 0x7faee81a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:43:04.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.031+0000 7faee659c640 1 --2- 172.21.15.7:0/1214077409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faee8100a80 0x7faee8199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:43:04.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.032+0000 7faee5d9b640 1 --2- 172.21.15.7:0/1214077409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee8101420 0x7faee81997d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faedc00eab0 tx=0x7faedc00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:04.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.032+0000 7faed77fe640 1 -- 172.21.15.7:0/1214077409 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc00ce40 con 0x7faee8101420 2024-09-19T08:43:04.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.032+0000 7faeec84f640 1 -- 172.21.15.7:0/1214077409 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee81a4a20 con 0x7faee8101420 2024-09-19T08:43:04.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.032+0000 7faed77fe640 1 -- 172.21.15.7:0/1214077409 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faedc011950 con 0x7faee8101420 2024-09-19T08:43:04.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.032+0000 7faed77fe640 1 -- 172.21.15.7:0/1214077409 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc010ae0 con 0x7faee8101420 2024-09-19T08:43:04.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.032+0000 7faeec84f640 1 -- 172.21.15.7:0/1214077409 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee81a4fb0 con 0x7faee8101420 2024-09-19T08:43:04.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.033+0000 7faeec84f640 1 -- 172.21.15.7:0/1214077409 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faee8100ee0 con 0x7faee8101420 2024-09-19T08:43:04.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.034+0000 7faed77fe640 1 -- 172.21.15.7:0/1214077409 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7faedc011b00 con 0x7faee8101420 2024-09-19T08:43:04.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.035+0000 7faed77fe640 1 --2- 172.21.15.7:0/1214077409 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7faed00a32d0 0x7faed00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:04.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.035+0000 7faee659c640 1 --2- 172.21.15.7:0/1214077409 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7faed00a32d0 0x7faed00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:04.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.035+0000 7faed77fe640 1 -- 172.21.15.7:0/1214077409 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7faedc0d0290 con 0x7faee8101420 2024-09-19T08:43:04.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.035+0000 7faee659c640 1 --2- 172.21.15.7:0/1214077409 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7faed00a32d0 0x7faed00a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faed8000c00 tx=0x7faed8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:04.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.039+0000 7faed77fe640 1 -- 172.21.15.7:0/1214077409 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faedc016030 con 0x7faee8101420 2024-09-19T08:43:04.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.245+0000 7faeec84f640 1 -- 172.21.15.7:0/1214077409 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7faee8062630 con 0x7faed00a32d0 2024-09-19T08:43:04.246 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:04 smithi007 ceph-mon[31221]: pgmap v285: 97 pgs: 1 peering, 96 active+clean; 603 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.4 KiB/s wr, 15 op/s; 76 B/s, 1 keys/s, 1 objects/s recovering 2024-09-19T08:43:04.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.250+0000 7faed77fe640 1 -- 172.21.15.7:0/1214077409 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7faee8062630 con 0x7faed00a32d0 2024-09-19T08:43:04.251 INFO:teuthology.orchestra.run.smithi007.stdout:/volumes/qa/sv_1/de5fb11b-dddd-4e15-99ca-dbd7ff6b586c 2024-09-19T08:43:04.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.252+0000 7faeec84f640 1 -- 172.21.15.7:0/1214077409 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7faed00a32d0 msgr2=0x7faed00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:04.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.252+0000 7faeec84f640 1 --2- 172.21.15.7:0/1214077409 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7faed00a32d0 0x7faed00a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faed8000c00 tx=0x7faed8005a20 comp rx=0 tx=0).stop 2024-09-19T08:43:04.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.252+0000 7faeec84f640 1 -- 172.21.15.7:0/1214077409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee8101420 msgr2=0x7faee81997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:04.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.252+0000 7faeec84f640 1 --2- 172.21.15.7:0/1214077409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee8101420 0x7faee81997d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faedc00eab0 tx=0x7faedc00ef70 comp rx=0 tx=0).stop 2024-09-19T08:43:04.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.252+0000 7faeec84f640 1 -- 172.21.15.7:0/1214077409 shutdown_connections 2024-09-19T08:43:04.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.252+0000 7faeec84f640 1 --2- 172.21.15.7:0/1214077409 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7faed00a32d0 0x7faed00a5790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:04.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.252+0000 7faeec84f640 1 --2- 172.21.15.7:0/1214077409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faee8106a80 0x7faee81a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:04.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.252+0000 7faeec84f640 1 --2- 172.21.15.7:0/1214077409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee8101420 0x7faee81997d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:04.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.252+0000 7faeec84f640 1 --2- 172.21.15.7:0/1214077409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faee8100a80 0x7faee8199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:04.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.252+0000 7faeec84f640 1 -- 172.21.15.7:0/1214077409 >> 172.21.15.7:0/1214077409 conn(0x7faee80fc7a0 msgr2=0x7faee80fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:04.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.253+0000 7faeec84f640 1 -- 172.21.15.7:0/1214077409 shutdown_connections 2024-09-19T08:43:04.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:04.253+0000 7faeec84f640 1 -- 172.21.15.7:0/1214077409 wait complete. 2024-09-19T08:43:04.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:04 smithi175 ceph-mon[35688]: pgmap v285: 97 pgs: 1 peering, 96 active+clean; 603 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.4 KiB/s wr, 15 op/s; 76 B/s, 1 keys/s, 1 objects/s recovering 2024-09-19T08:43:04.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:04 smithi044 ceph-mon[35072]: pgmap v285: 97 pgs: 1 peering, 96 active+clean; 603 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.4 KiB/s wr, 15 op/s; 76 B/s, 1 keys/s, 1 objects/s recovering 2024-09-19T08:43:04.901 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:43:05.157 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:05.381 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:05 smithi007 ceph-mon[31221]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:05.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:05 smithi175 ceph-mon[35688]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:05.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:05 smithi044 ceph-mon[35072]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:05.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.596+0000 7f90219b2640 1 -- 172.21.15.7:0/1345901048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f901c106f50 msgr2=0x7f901c10eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:05.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.596+0000 7f90219b2640 1 --2- 172.21.15.7:0/1345901048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f901c106f50 0x7f901c10eaf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9014009cd0 tx=0x7f901402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:43:05.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.596+0000 7f90219b2640 1 -- 172.21.15.7:0/1345901048 shutdown_connections 2024-09-19T08:43:05.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.596+0000 7f90219b2640 1 --2- 172.21.15.7:0/1345901048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f901c106f50 0x7f901c10eaf0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:05.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.596+0000 7f90219b2640 1 --2- 172.21.15.7:0/1345901048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f901c100ca0 0x7f901c106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:05.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.596+0000 7f90219b2640 1 --2- 172.21.15.7:0/1345901048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f901c1002f0 0x7f901c1006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:05.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.596+0000 7f90219b2640 1 -- 172.21.15.7:0/1345901048 >> 172.21.15.7:0/1345901048 conn(0x7f901c077210 msgr2=0x7f901c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:05.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.597+0000 7f90219b2640 1 -- 172.21.15.7:0/1345901048 shutdown_connections 2024-09-19T08:43:05.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.597+0000 7f90219b2640 1 -- 172.21.15.7:0/1345901048 wait complete. 2024-09-19T08:43:05.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.597+0000 7f90219b2640 1 Processor -- start 2024-09-19T08:43:05.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.597+0000 7f90219b2640 1 -- start start 2024-09-19T08:43:05.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.597+0000 7f90219b2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f901c1002f0 0x7f901c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:05.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.597+0000 7f90219b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f901c100ca0 0x7f901c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:05.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.598+0000 7f90219b2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f901c106f50 0x7f901c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:05.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.598+0000 7f90219b2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f901c111fa0 con 0x7f901c100ca0 2024-09-19T08:43:05.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.598+0000 7f90219b2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f901c111e20 con 0x7f901c1002f0 2024-09-19T08:43:05.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.598+0000 7f90219b2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f901c112120 con 0x7f901c106f50 2024-09-19T08:43:05.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.598+0000 7f901a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f901c100ca0 0x7f901c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:05.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.598+0000 7f901a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f901c100ca0 0x7f901c1989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35614/0 (socket says 172.21.15.7:35614) 2024-09-19T08:43:05.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.598+0000 7f901a7fc640 1 -- 172.21.15.7:0/1562156124 learned_addr learned my addr 172.21.15.7:0/1562156124 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:05.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.598+0000 7f901affd640 1 --2- 172.21.15.7:0/1562156124 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f901c1002f0 0x7f901c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:05.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.598+0000 7f901b7fe640 1 --2- 172.21.15.7:0/1562156124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f901c106f50 0x7f901c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:05.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.598+0000 7f901a7fc640 1 -- 172.21.15.7:0/1562156124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f901c106f50 msgr2=0x7f901c19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:05.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.598+0000 7f901a7fc640 1 --2- 172.21.15.7:0/1562156124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f901c106f50 0x7f901c19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:05.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.598+0000 7f901a7fc640 1 -- 172.21.15.7:0/1562156124 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f901c1002f0 msgr2=0x7f901c198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:05.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.598+0000 7f901a7fc640 1 --2- 172.21.15.7:0/1562156124 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f901c1002f0 0x7f901c198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:05.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.598+0000 7f901a7fc640 1 -- 172.21.15.7:0/1562156124 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901c19d410 con 0x7f901c100ca0 2024-09-19T08:43:05.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.598+0000 7f901b7fe640 1 --2- 172.21.15.7:0/1562156124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f901c106f50 0x7f901c19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:43:05.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.598+0000 7f901a7fc640 1 --2- 172.21.15.7:0/1562156124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f901c100ca0 0x7f901c1989a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f900400d770 tx=0x7f900400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:05.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.598+0000 7f90209b0640 1 -- 172.21.15.7:0/1562156124 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9004017070 con 0x7f901c100ca0 2024-09-19T08:43:05.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.598+0000 7f90219b2640 1 -- 172.21.15.7:0/1562156124 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f901c19d700 con 0x7f901c100ca0 2024-09-19T08:43:05.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.598+0000 7f90209b0640 1 -- 172.21.15.7:0/1562156124 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9004009c30 con 0x7f901c100ca0 2024-09-19T08:43:05.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.598+0000 7f90209b0640 1 -- 172.21.15.7:0/1562156124 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900400f620 con 0x7f901c100ca0 2024-09-19T08:43:05.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.598+0000 7f90219b2640 1 -- 172.21.15.7:0/1562156124 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f901c1a4fe0 con 0x7f901c100ca0 2024-09-19T08:43:05.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.599+0000 7f90219b2640 1 -- 172.21.15.7:0/1562156124 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f901c1006d0 con 0x7f901c100ca0 2024-09-19T08:43:05.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.601+0000 7f90209b0640 1 -- 172.21.15.7:0/1562156124 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f900401a070 con 0x7f901c100ca0 2024-09-19T08:43:05.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.602+0000 7f90209b0640 1 --2- 172.21.15.7:0/1562156124 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f90080a3350 0x7f90080a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:05.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.602+0000 7f901affd640 1 --2- 172.21.15.7:0/1562156124 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f90080a3350 0x7f90080a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:05.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.602+0000 7f90209b0640 1 -- 172.21.15.7:0/1562156124 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f90040cf590 con 0x7f901c100ca0 2024-09-19T08:43:05.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.602+0000 7f901affd640 1 --2- 172.21.15.7:0/1562156124 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f90080a3350 0x7f90080a5810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f900c0058c0 tx=0x7f900c00a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:05.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.606+0000 7f90209b0640 1 -- 172.21.15.7:0/1562156124 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9004009de0 con 0x7f901c100ca0 2024-09-19T08:43:05.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.819+0000 7f90219b2640 1 -- 172.21.15.7:0/1562156124 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f901c10a180 con 0x7f901c100ca0 2024-09-19T08:43:05.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.820+0000 7f90209b0640 1 -- 172.21.15.7:0/1562156124 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11899 (secure 0 0 0) 0x7f900409c110 con 0x7f901c100ca0 2024-09-19T08:43:05.821 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:43:05.821 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"btime":"2024-09-19T08:42:56:086840+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:42:55.696739+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24458,24472,24491]},"id":1}]} 2024-09-19T08:43:05.821 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-19T08:43:05.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.822+0000 7f90219b2640 1 -- 172.21.15.7:0/1562156124 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f90080a3350 msgr2=0x7f90080a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:05.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.822+0000 7f90219b2640 1 --2- 172.21.15.7:0/1562156124 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f90080a3350 0x7f90080a5810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f900c0058c0 tx=0x7f900c00a4c0 comp rx=0 tx=0).stop 2024-09-19T08:43:05.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.822+0000 7f90219b2640 1 -- 172.21.15.7:0/1562156124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f901c100ca0 msgr2=0x7f901c1989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:05.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.822+0000 7f90219b2640 1 --2- 172.21.15.7:0/1562156124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f901c100ca0 0x7f901c1989a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f900400d770 tx=0x7f900400dc30 comp rx=0 tx=0).stop 2024-09-19T08:43:05.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.822+0000 7f90219b2640 1 -- 172.21.15.7:0/1562156124 shutdown_connections 2024-09-19T08:43:05.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.822+0000 7f90219b2640 1 --2- 172.21.15.7:0/1562156124 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f90080a3350 0x7f90080a5810 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:05.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.822+0000 7f90219b2640 1 --2- 172.21.15.7:0/1562156124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f901c106f50 0x7f901c19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:05.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.822+0000 7f90219b2640 1 --2- 172.21.15.7:0/1562156124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f901c100ca0 0x7f901c1989a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:05.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.822+0000 7f90219b2640 1 --2- 172.21.15.7:0/1562156124 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f901c1002f0 0x7f901c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:05.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.822+0000 7f90219b2640 1 -- 172.21.15.7:0/1562156124 >> 172.21.15.7:0/1562156124 conn(0x7f901c077210 msgr2=0x7f901c105870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:05.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.822+0000 7f90219b2640 1 -- 172.21.15.7:0/1562156124 shutdown_connections 2024-09-19T08:43:05.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:05.823+0000 7f90219b2640 1 -- 172.21.15.7:0/1562156124 wait complete. 2024-09-19T08:43:06.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:06 smithi175 ceph-mon[35688]: pgmap v286: 97 pgs: 97 active+clean; 603 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.7 KiB/s wr, 8 op/s; 149 B/s, 1 keys/s, 1 objects/s recovering 2024-09-19T08:43:06.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:06 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1562156124' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:43:06.452 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:06 smithi044 ceph-mon[35072]: pgmap v286: 97 pgs: 97 active+clean; 603 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.7 KiB/s wr, 8 op/s; 149 B/s, 1 keys/s, 1 objects/s recovering 2024-09-19T08:43:06.452 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:06 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1562156124' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:43:06.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:06 smithi007 ceph-mon[31221]: pgmap v286: 97 pgs: 97 active+clean; 603 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.7 KiB/s wr, 8 op/s; 149 B/s, 1 keys/s, 1 objects/s recovering 2024-09-19T08:43:06.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:06 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1562156124' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:43:06.567 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:43:06.824 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.305+0000 7f65f9949640 1 -- 172.21.15.7:0/3124983416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f4100e30 msgr2=0x7f65f4104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.305+0000 7f65f9949640 1 --2- 172.21.15.7:0/3124983416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f4100e30 0x7f65f4104e80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00aa10 tx=0x7f65dc02b720 comp rx=0 tx=0).stop 2024-09-19T08:43:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.305+0000 7f65f9949640 1 -- 172.21.15.7:0/3124983416 shutdown_connections 2024-09-19T08:43:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.305+0000 7f65f9949640 1 --2- 172.21.15.7:0/3124983416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65f41055b0 0x7f65f410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.305+0000 7f65f9949640 1 --2- 172.21.15.7:0/3124983416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f4100e30 0x7f65f4104e80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.305+0000 7f65f9949640 1 --2- 172.21.15.7:0/3124983416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65f4100480 0x7f65f4100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.305+0000 7f65f9949640 1 -- 172.21.15.7:0/3124983416 >> 172.21.15.7:0/3124983416 conn(0x7f65f4077210 msgr2=0x7f65f40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.305+0000 7f65f9949640 1 -- 172.21.15.7:0/3124983416 shutdown_connections 2024-09-19T08:43:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.305+0000 7f65f9949640 1 -- 172.21.15.7:0/3124983416 wait complete. 2024-09-19T08:43:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.306+0000 7f65f9949640 1 Processor -- start 2024-09-19T08:43:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.306+0000 7f65f9949640 1 -- start start 2024-09-19T08:43:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.306+0000 7f65f9949640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f4100480 0x7f65f4198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.306+0000 7f65f9949640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65f4100e30 0x7f65f4198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.306+0000 7f65f9949640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65f41055b0 0x7f65f419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.306+0000 7f65f9949640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f65f410fdb0 con 0x7f65f4100480 2024-09-19T08:43:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.306+0000 7f65f9949640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f65f410fc30 con 0x7f65f41055b0 2024-09-19T08:43:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.306+0000 7f65f9949640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f65f410ff30 con 0x7f65f4100e30 2024-09-19T08:43:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.306+0000 7f65f2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f4100480 0x7f65f4198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.306+0000 7f65f2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f4100480 0x7f65f4198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35624/0 (socket says 172.21.15.7:35624) 2024-09-19T08:43:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.306+0000 7f65f2ffd640 1 -- 172.21.15.7:0/3508987400 learned_addr learned my addr 172.21.15.7:0/3508987400 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.306+0000 7f65f27fc640 1 --2- 172.21.15.7:0/3508987400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65f4100e30 0x7f65f4198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.306+0000 7f65f37fe640 1 --2- 172.21.15.7:0/3508987400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65f41055b0 0x7f65f419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.306+0000 7f65f2ffd640 1 -- 172.21.15.7:0/3508987400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65f4100e30 msgr2=0x7f65f4198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:07.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.306+0000 7f65f2ffd640 1 --2- 172.21.15.7:0/3508987400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65f4100e30 0x7f65f4198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:07.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.307+0000 7f65f2ffd640 1 -- 172.21.15.7:0/3508987400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65f41055b0 msgr2=0x7f65f419ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:07.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.307+0000 7f65f2ffd640 1 --2- 172.21.15.7:0/3508987400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65f41055b0 0x7f65f419ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:07.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.307+0000 7f65f2ffd640 1 -- 172.21.15.7:0/3508987400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f419d3d0 con 0x7f65f4100480 2024-09-19T08:43:07.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.307+0000 7f65f37fe640 1 --2- 172.21.15.7:0/3508987400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65f41055b0 0x7f65f419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:43:07.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.307+0000 7f65f2ffd640 1 --2- 172.21.15.7:0/3508987400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f4100480 0x7f65f4198420 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f65e400c920 tx=0x7f65e400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:07.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.307+0000 7f65f8947640 1 -- 172.21.15.7:0/3508987400 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e4007c70 con 0x7f65f4100480 2024-09-19T08:43:07.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.307+0000 7f65f9949640 1 -- 172.21.15.7:0/3508987400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f419d6c0 con 0x7f65f4100480 2024-09-19T08:43:07.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.307+0000 7f65f8947640 1 -- 172.21.15.7:0/3508987400 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65e4007e10 con 0x7f65f4100480 2024-09-19T08:43:07.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.307+0000 7f65f8947640 1 -- 172.21.15.7:0/3508987400 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e4018890 con 0x7f65f4100480 2024-09-19T08:43:07.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.307+0000 7f65f9949640 1 -- 172.21.15.7:0/3508987400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f41a4fa0 con 0x7f65f4100480 2024-09-19T08:43:07.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.308+0000 7f65f9949640 1 -- 172.21.15.7:0/3508987400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65f4100860 con 0x7f65f4100480 2024-09-19T08:43:07.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.309+0000 7f65f8947640 1 -- 172.21.15.7:0/3508987400 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f65e4018a70 con 0x7f65f4100480 2024-09-19T08:43:07.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.310+0000 7f65f8947640 1 --2- 172.21.15.7:0/3508987400 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f65e00a32d0 0x7f65e00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:07.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.310+0000 7f65f27fc640 1 --2- 172.21.15.7:0/3508987400 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f65e00a32d0 0x7f65e00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:07.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.310+0000 7f65f8947640 1 -- 172.21.15.7:0/3508987400 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f65e40cfca0 con 0x7f65f4100480 2024-09-19T08:43:07.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.310+0000 7f65f27fc640 1 --2- 172.21.15.7:0/3508987400 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f65e00a32d0 0x7f65e00a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f65f40ff630 tx=0x7f65dc0305a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:07.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.314+0000 7f65f8947640 1 -- 172.21.15.7:0/3508987400 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f65e4014030 con 0x7f65f4100480 2024-09-19T08:43:07.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.489+0000 7f65f9949640 1 -- 172.21.15.7:0/3508987400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65f4199780 con 0x7f65f4100480 2024-09-19T08:43:07.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.490+0000 7f65f8947640 1 -- 172.21.15.7:0/3508987400 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22634 (secure 0 0 0) 0x7f65e400de20 con 0x7f65f4100480 2024-09-19T08:43:07.491 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:43:07.492 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":82,"fsid":"ebd23124-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:02.287380+0000","modified":"2024-09-19T08:42:58.097469+0000","last_up_change":"2024-09-19T08:41:54.742978+0000","last_in_change":"2024-09-19T08:41:31.685622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:13.285118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:42:40.425852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:42:43.006548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"837e6267-71c7-4f48-9e0b-4e3f124682b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6803","nonce":402668717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6805","nonce":402668717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6809","nonce":402668717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6807","nonce":402668717}]},"public_addr":"172.21.15.7:6803/402668717","cluster_addr":"172.21.15.7:6805/402668717","heartbeat_back_addr":"172.21.15.7:6809/402668717","heartbeat_front_addr":"172.21.15.7:6807/402668717","state":["exists","up"]},{"osd":1,"uuid":"67865372-ac22-4b30-bd02-498e118d6701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6801","nonce":2213694259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6803","nonce":2213694259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6807","nonce":2213694259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6805","nonce":2213694259}]},"public_addr":"172.21.15.44:6801/2213694259","cluster_addr":"172.21.15.44:6803/2213694259","heartbeat_back_addr":"172.21.15.44:6807/2213694259","heartbeat_front_addr":"172.21.15.44:6805/2213694259","state":["exists","up"]},{"osd":2,"uuid":"37c1cc2b-60ea-449f-baa7-c65d96c3559c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6801","nonce":3413002145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6803","nonce":3413002145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6807","nonce":3413002145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6805","nonce":3413002145}]},"public_addr":"172.21.15.175:6801/3413002145","cluster_addr":"172.21.15.175:6803/3413002145","heartbeat_back_addr":"172.21.15.175:6807/3413002145","heartbeat_front_addr":"172.21.15.175:6805/3413002145","state":["exists","up"]},{"osd":3,"uuid":"a8ffd2ae-4211-492a-a8ac-d4d6cbb4a03d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6811","nonce":2528867083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6813","nonce":2528867083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6817","nonce":2528867083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6815","nonce":2528867083}]},"public_addr":"172.21.15.7:6811/2528867083","cluster_addr":"172.21.15.7:6813/2528867083","heartbeat_back_addr":"172.21.15.7:6817/2528867083","heartbeat_front_addr":"172.21.15.7:6815/2528867083","state":["exists","up"]},{"osd":4,"uuid":"9a67b2ec-1a0a-413e-bd13-9532f24a0155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6809","nonce":3537143774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537143774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537143774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537143774}]},"public_addr":"172.21.15.44:6809/3537143774","cluster_addr":"172.21.15.44:6811/3537143774","heartbeat_back_addr":"172.21.15.44:6815/3537143774","heartbeat_front_addr":"172.21.15.44:6813/3537143774","state":["exists","up"]},{"osd":5,"uuid":"436cd596-710b-48e2-8255-8427c93cee1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6809","nonce":4001214751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6811","nonce":4001214751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6815","nonce":4001214751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6813","nonce":4001214751}]},"public_addr":"172.21.15.175:6809/4001214751","cluster_addr":"172.21.15.175:6811/4001214751","heartbeat_back_addr":"172.21.15.175:6815/4001214751","heartbeat_front_addr":"172.21.15.175:6813/4001214751","state":["exists","up"]},{"osd":6,"uuid":"f5a7ad2b-6b44-4b5a-8af7-f7fb00e7ca68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6819","nonce":1261079202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6821","nonce":1261079202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6825","nonce":1261079202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6823","nonce":1261079202}]},"public_addr":"172.21.15.7:6819/1261079202","cluster_addr":"172.21.15.7:6821/1261079202","heartbeat_back_addr":"172.21.15.7:6825/1261079202","heartbeat_front_addr":"172.21.15.7:6823/1261079202","state":["exists","up"]},{"osd":7,"uuid":"aa24aee5-6449-4842-8831-1c8e06cde75b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6817","nonce":3120822957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6819","nonce":3120822957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6823","nonce":3120822957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6821","nonce":3120822957}]},"public_addr":"172.21.15.44:6817/3120822957","cluster_addr":"172.21.15.44:6819/3120822957","heartbeat_back_addr":"172.21.15.44:6823/3120822957","heartbeat_front_addr":"172.21.15.44:6821/3120822957","state":["exists","up"]},{"osd":8,"uuid":"d912501a-bb7a-489e-b6ab-e451fb22210d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6817","nonce":2080374927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6819","nonce":2080374927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6823","nonce":2080374927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6821","nonce":2080374927}]},"public_addr":"172.21.15.175:6817/2080374927","cluster_addr":"172.21.15.175:6819/2080374927","heartbeat_back_addr":"172.21.15.175:6823/2080374927","heartbeat_front_addr":"172.21.15.175:6821/2080374927","state":["exists","up"]},{"osd":9,"uuid":"d132f5b2-75b9-4d6c-89ec-f52c303e0fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6827","nonce":3808356432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6829","nonce":3808356432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6833","nonce":3808356432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6831","nonce":3808356432}]},"public_addr":"172.21.15.7:6827/3808356432","cluster_addr":"172.21.15.7:6829/3808356432","heartbeat_back_addr":"172.21.15.7:6833/3808356432","heartbeat_front_addr":"172.21.15.7:6831/3808356432","state":["exists","up"]},{"osd":10,"uuid":"f6c405d6-a255-4e0e-8528-7bbc16d5e434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6825","nonce":4009464689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6827","nonce":4009464689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6831","nonce":4009464689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6829","nonce":4009464689}]},"public_addr":"172.21.15.44:6825/4009464689","cluster_addr":"172.21.15.44:6827/4009464689","heartbeat_back_addr":"172.21.15.44:6831/4009464689","heartbeat_front_addr":"172.21.15.44:6829/4009464689","state":["exists","up"]},{"osd":11,"uuid":"a2a046cd-9939-473a-988b-6e0ad28a0233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6825","nonce":4173951310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6827","nonce":4173951310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6831","nonce":4173951310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6829","nonce":4173951310}]},"public_addr":"172.21.15.175:6825/4173951310","cluster_addr":"172.21.15.175:6827/4173951310","heartbeat_back_addr":"172.21.15.175:6831/4173951310","heartbeat_front_addr":"172.21.15.175:6829/4173951310","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:20.015497+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:44.967046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:09.682080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:35.516899+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:00.705686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:25.276387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:49.927456+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:14.786755+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:38.553913+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.962825+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.812976+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:52.837744+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6800/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/2884903597":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/4058698573":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/1429582340":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6800/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/816886708":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/4277640815":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/2695884066":"2024-09-20T08:35:31.711540+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:43:07.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.493+0000 7f65f9949640 1 -- 172.21.15.7:0/3508987400 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f65e00a32d0 msgr2=0x7f65e00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:07.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.493+0000 7f65f9949640 1 --2- 172.21.15.7:0/3508987400 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f65e00a32d0 0x7f65e00a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f65f40ff630 tx=0x7f65dc0305a0 comp rx=0 tx=0).stop 2024-09-19T08:43:07.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.493+0000 7f65f9949640 1 -- 172.21.15.7:0/3508987400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f4100480 msgr2=0x7f65f4198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:07.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.493+0000 7f65f9949640 1 --2- 172.21.15.7:0/3508987400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f4100480 0x7f65f4198420 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f65e400c920 tx=0x7f65e400cde0 comp rx=0 tx=0).stop 2024-09-19T08:43:07.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.493+0000 7f65f9949640 1 -- 172.21.15.7:0/3508987400 shutdown_connections 2024-09-19T08:43:07.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.493+0000 7f65f9949640 1 --2- 172.21.15.7:0/3508987400 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f65e00a32d0 0x7f65e00a5790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:07.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.493+0000 7f65f9949640 1 --2- 172.21.15.7:0/3508987400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65f41055b0 0x7f65f419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:07.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.493+0000 7f65f9949640 1 --2- 172.21.15.7:0/3508987400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65f4100e30 0x7f65f4198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:07.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.493+0000 7f65f9949640 1 --2- 172.21.15.7:0/3508987400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65f4100480 0x7f65f4198420 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:07.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.493+0000 7f65f9949640 1 -- 172.21.15.7:0/3508987400 >> 172.21.15.7:0/3508987400 conn(0x7f65f4077210 msgr2=0x7f65f4103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:07.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.493+0000 7f65f9949640 1 -- 172.21.15.7:0/3508987400 shutdown_connections 2024-09-19T08:43:07.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:07.493+0000 7f65f9949640 1 -- 172.21.15.7:0/3508987400 wait complete. 2024-09-19T08:43:08.262 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T08:43:08.263 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:43:08.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:08 smithi175 ceph-mon[35688]: pgmap v287: 97 pgs: 97 active+clean; 627 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.1 KiB/s wr, 10 op/s; 122 B/s, 1 keys/s, 1 objects/s recovering 2024-09-19T08:43:08.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:08 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3508987400' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:08.521 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:08.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:08 smithi007 ceph-mon[31221]: pgmap v287: 97 pgs: 97 active+clean; 627 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.1 KiB/s wr, 10 op/s; 122 B/s, 1 keys/s, 1 objects/s recovering 2024-09-19T08:43:08.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:08 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3508987400' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:08.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:08 smithi044 ceph-mon[35072]: pgmap v287: 97 pgs: 97 active+clean; 627 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.1 KiB/s wr, 10 op/s; 122 B/s, 1 keys/s, 1 objects/s recovering 2024-09-19T08:43:08.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:08 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3508987400' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:08.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.939+0000 7fb596286640 1 -- 172.21.15.7:0/1321384088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb590102d40 msgr2=0x7fb590103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.939+0000 7fb596286640 1 --2- 172.21.15.7:0/1321384088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb590102d40 0x7fb590103120 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb580009900 tx=0x7fb58002a480 comp rx=0 tx=0).stop 2024-09-19T08:43:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.939+0000 7fb596286640 1 -- 172.21.15.7:0/1321384088 shutdown_connections 2024-09-19T08:43:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.939+0000 7fb596286640 1 --2- 172.21.15.7:0/1321384088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb59010c170 0x7fb59010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.939+0000 7fb596286640 1 --2- 172.21.15.7:0/1321384088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb590103660 0x7fb59010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.939+0000 7fb596286640 1 --2- 172.21.15.7:0/1321384088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb590102d40 0x7fb590103120 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.939+0000 7fb596286640 1 -- 172.21.15.7:0/1321384088 >> 172.21.15.7:0/1321384088 conn(0x7fb5900fc7a0 msgr2=0x7fb5900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.939+0000 7fb596286640 1 -- 172.21.15.7:0/1321384088 shutdown_connections 2024-09-19T08:43:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.939+0000 7fb596286640 1 -- 172.21.15.7:0/1321384088 wait complete. 2024-09-19T08:43:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.940+0000 7fb596286640 1 Processor -- start 2024-09-19T08:43:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.940+0000 7fb596286640 1 -- start start 2024-09-19T08:43:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.940+0000 7fb596286640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb590102d40 0x7fb590198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.940+0000 7fb596286640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb590103660 0x7fb590198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.940+0000 7fb596286640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb59010c170 0x7fb59019cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.940+0000 7fb596286640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb590112030 con 0x7fb590103660 2024-09-19T08:43:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.940+0000 7fb596286640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb590111eb0 con 0x7fb59010c170 2024-09-19T08:43:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.940+0000 7fb596286640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb5901121b0 con 0x7fb590102d40 2024-09-19T08:43:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.940+0000 7fb587fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb590103660 0x7fb590198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.940+0000 7fb587fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb590103660 0x7fb590198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35634/0 (socket says 172.21.15.7:35634) 2024-09-19T08:43:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.940+0000 7fb587fff640 1 -- 172.21.15.7:0/2148722574 learned_addr learned my addr 172.21.15.7:0/2148722574 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.940+0000 7fb58ffff640 1 --2- 172.21.15.7:0/2148722574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb590102d40 0x7fb590198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.941+0000 7fb594823640 1 --2- 172.21.15.7:0/2148722574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb59010c170 0x7fb59019cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.941+0000 7fb587fff640 1 -- 172.21.15.7:0/2148722574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb590102d40 msgr2=0x7fb590198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.941+0000 7fb587fff640 1 --2- 172.21.15.7:0/2148722574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb590102d40 0x7fb590198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.941+0000 7fb587fff640 1 -- 172.21.15.7:0/2148722574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb59010c170 msgr2=0x7fb59019cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.941+0000 7fb587fff640 1 --2- 172.21.15.7:0/2148722574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb59010c170 0x7fb59019cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.941+0000 7fb587fff640 1 -- 172.21.15.7:0/2148722574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb59019d5c0 con 0x7fb590103660 2024-09-19T08:43:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.941+0000 7fb587fff640 1 --2- 172.21.15.7:0/2148722574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb590103660 0x7fb590198b50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb57800b3f0 tx=0x7fb57800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.941+0000 7fb58dffb640 1 -- 172.21.15.7:0/2148722574 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb578015020 con 0x7fb590103660 2024-09-19T08:43:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.941+0000 7fb58dffb640 1 -- 172.21.15.7:0/2148722574 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb578011d10 con 0x7fb590103660 2024-09-19T08:43:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.941+0000 7fb596286640 1 -- 172.21.15.7:0/2148722574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb59019d8b0 con 0x7fb590103660 2024-09-19T08:43:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.941+0000 7fb58dffb640 1 -- 172.21.15.7:0/2148722574 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57800f2e0 con 0x7fb590103660 2024-09-19T08:43:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.941+0000 7fb596286640 1 -- 172.21.15.7:0/2148722574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5901a5190 con 0x7fb590103660 2024-09-19T08:43:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.942+0000 7fb596286640 1 -- 172.21.15.7:0/2148722574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5901031a0 con 0x7fb590103660 2024-09-19T08:43:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.943+0000 7fb58dffb640 1 -- 172.21.15.7:0/2148722574 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fb578018020 con 0x7fb590103660 2024-09-19T08:43:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.944+0000 7fb58dffb640 1 --2- 172.21.15.7:0/2148722574 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb57c0a32d0 0x7fb57c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.944+0000 7fb58ffff640 1 --2- 172.21.15.7:0/2148722574 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb57c0a32d0 0x7fb57c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.944+0000 7fb58dffb640 1 -- 172.21.15.7:0/2148722574 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb5780cf1f0 con 0x7fb590103660 2024-09-19T08:43:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.945+0000 7fb58ffff640 1 --2- 172.21.15.7:0/2148722574 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb57c0a32d0 0x7fb57c0a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb580000c00 tx=0x7fb5800058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:08.948+0000 7fb58dffb640 1 -- 172.21.15.7:0/2148722574 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb57801f020 con 0x7fb590103660 2024-09-19T08:43:09.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:09.121+0000 7fb596286640 1 -- 172.21.15.7:0/2148722574 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb590107270 con 0x7fb57c0a32d0 2024-09-19T08:43:09.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:09.127+0000 7fb58dffb640 1 -- 172.21.15.7:0/2148722574 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258719 (secure 0 0 0) 0x7fb590107270 con 0x7fb57c0a32d0 2024-09-19T08:43:09.131 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:43:09.132 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-19T08:43:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:09.130+0000 7fb596286640 1 -- 172.21.15.7:0/2148722574 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb57c0a32d0 msgr2=0x7fb57c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:09.130+0000 7fb596286640 1 --2- 172.21.15.7:0/2148722574 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb57c0a32d0 0x7fb57c0a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb580000c00 tx=0x7fb5800058d0 comp rx=0 tx=0).stop 2024-09-19T08:43:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:09.130+0000 7fb596286640 1 -- 172.21.15.7:0/2148722574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb590103660 msgr2=0x7fb590198b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:09.130+0000 7fb596286640 1 --2- 172.21.15.7:0/2148722574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb590103660 0x7fb590198b50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb57800b3f0 tx=0x7fb57800b8b0 comp rx=0 tx=0).stop 2024-09-19T08:43:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:09.130+0000 7fb596286640 1 -- 172.21.15.7:0/2148722574 shutdown_connections 2024-09-19T08:43:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:09.130+0000 7fb596286640 1 --2- 172.21.15.7:0/2148722574 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb57c0a32d0 0x7fb57c0a5790 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:09.130+0000 7fb596286640 1 --2- 172.21.15.7:0/2148722574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb59010c170 0x7fb59019cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:09.130+0000 7fb596286640 1 --2- 172.21.15.7:0/2148722574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb590103660 0x7fb590198b50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:09.130+0000 7fb596286640 1 --2- 172.21.15.7:0/2148722574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb590102d40 0x7fb590198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:09.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:09.130+0000 7fb596286640 1 -- 172.21.15.7:0/2148722574 >> 172.21.15.7:0/2148722574 conn(0x7fb5900fc7a0 msgr2=0x7fb5900fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:09.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:09.130+0000 7fb596286640 1 -- 172.21.15.7:0/2148722574 shutdown_connections 2024-09-19T08:43:09.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:09.130+0000 7fb596286640 1 -- 172.21.15.7:0/2148722574 wait complete. 2024-09-19T08:43:09.953 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-09-19T08:43:08.870139+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641800,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":236,"num_read_kb":222,"num_write":334,"num_write_kb":3033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1181934,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365976,"kb_used_data":12552,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575848,"statfs":{"total":1151940427776,"available":1151565668352,"internally_reserved":0,"allocated":12853248,"data_stored":7110204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45817,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":-2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":76,"num_write":27,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1198,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.770914"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101626+0000","last_change":"2024-09-19T08:42:44.035697+0000","last_active":"2024-09-19T08:42:58.101626+0000","last_peered":"2024-09-19T08:42:58.101626+0000","last_clean":"2024-09-19T08:42:58.101626+0000","last_became_active":"2024-09-19T08:42:44.035400+0000","last_became_peered":"2024-09-19T08:42:44.035400+0000","last_unstale":"2024-09-19T08:42:58.101626+0000","last_undegraded":"2024-09-19T08:42:58.101626+0000","last_fullsized":"2024-09-19T08:42:58.101626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:56.202947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102854+0000","last_change":"2024-09-19T08:42:44.031393+0000","last_active":"2024-09-19T08:42:58.102854+0000","last_peered":"2024-09-19T08:42:58.102854+0000","last_clean":"2024-09-19T08:42:58.102854+0000","last_became_active":"2024-09-19T08:42:44.031056+0000","last_became_peered":"2024-09-19T08:42:44.031056+0000","last_unstale":"2024-09-19T08:42:58.102854+0000","last_undegraded":"2024-09-19T08:42:58.102854+0000","last_fullsized":"2024-09-19T08:42:58.102854+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:44.694913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102589+0000","last_change":"2024-09-19T08:42:44.029586+0000","last_active":"2024-09-19T08:42:58.102589+0000","last_peered":"2024-09-19T08:42:58.102589+0000","last_clean":"2024-09-19T08:42:58.102589+0000","last_became_active":"2024-09-19T08:42:44.029279+0000","last_became_peered":"2024-09-19T08:42:44.029279+0000","last_unstale":"2024-09-19T08:42:58.102589+0000","last_undegraded":"2024-09-19T08:42:58.102589+0000","last_fullsized":"2024-09-19T08:42:58.102589+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:12.036113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102656+0000","last_change":"2024-09-19T08:42:44.043192+0000","last_active":"2024-09-19T08:42:58.102656+0000","last_peered":"2024-09-19T08:42:58.102656+0000","last_clean":"2024-09-19T08:42:58.102656+0000","last_became_active":"2024-09-19T08:42:44.042838+0000","last_became_peered":"2024-09-19T08:42:44.042838+0000","last_unstale":"2024-09-19T08:42:58.102656+0000","last_undegraded":"2024-09-19T08:42:58.102656+0000","last_fullsized":"2024-09-19T08:42:58.102656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:20.549232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.107892+0000","last_change":"2024-09-19T08:42:44.032231+0000","last_active":"2024-09-19T08:42:58.107892+0000","last_peered":"2024-09-19T08:42:58.107892+0000","last_clean":"2024-09-19T08:42:58.107892+0000","last_became_active":"2024-09-19T08:42:44.031835+0000","last_became_peered":"2024-09-19T08:42:44.031835+0000","last_unstale":"2024-09-19T08:42:58.107892+0000","last_undegraded":"2024-09-19T08:42:58.107892+0000","last_fullsized":"2024-09-19T08:42:58.107892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:49.084085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103663+0000","last_change":"2024-09-19T08:42:44.035487+0000","last_active":"2024-09-19T08:42:58.103663+0000","last_peered":"2024-09-19T08:42:58.103663+0000","last_clean":"2024-09-19T08:42:58.103663+0000","last_became_active":"2024-09-19T08:42:44.035138+0000","last_became_peered":"2024-09-19T08:42:44.035138+0000","last_unstale":"2024-09-19T08:42:58.103663+0000","last_undegraded":"2024-09-19T08:42:58.103663+0000","last_fullsized":"2024-09-19T08:42:58.103663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:43.483397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108910+0000","last_change":"2024-09-19T08:42:44.029052+0000","last_active":"2024-09-19T08:42:58.108910+0000","last_peered":"2024-09-19T08:42:58.108910+0000","last_clean":"2024-09-19T08:42:58.108910+0000","last_became_active":"2024-09-19T08:42:44.028722+0000","last_became_peered":"2024-09-19T08:42:44.028722+0000","last_unstale":"2024-09-19T08:42:58.108910+0000","last_undegraded":"2024-09-19T08:42:58.108910+0000","last_fullsized":"2024-09-19T08:42:58.108910+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:49.226044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104266+0000","last_change":"2024-09-19T08:42:44.031401+0000","last_active":"2024-09-19T08:42:58.104266+0000","last_peered":"2024-09-19T08:42:58.104266+0000","last_clean":"2024-09-19T08:42:58.104266+0000","last_became_active":"2024-09-19T08:42:44.031103+0000","last_became_peered":"2024-09-19T08:42:44.031103+0000","last_unstale":"2024-09-19T08:42:58.104266+0000","last_undegraded":"2024-09-19T08:42:58.104266+0000","last_fullsized":"2024-09-19T08:42:58.104266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:57.406765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110149+0000","last_change":"2024-09-19T08:42:44.033011+0000","last_active":"2024-09-19T08:42:58.110149+0000","last_peered":"2024-09-19T08:42:58.110149+0000","last_clean":"2024-09-19T08:42:58.110149+0000","last_became_active":"2024-09-19T08:42:44.032075+0000","last_became_peered":"2024-09-19T08:42:44.032075+0000","last_unstale":"2024-09-19T08:42:58.110149+0000","last_undegraded":"2024-09-19T08:42:58.110149+0000","last_fullsized":"2024-09-19T08:42:58.110149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:43.701684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103460+0000","last_change":"2024-09-19T08:42:44.037417+0000","last_active":"2024-09-19T08:42:58.103460+0000","last_peered":"2024-09-19T08:42:58.103460+0000","last_clean":"2024-09-19T08:42:58.103460+0000","last_became_active":"2024-09-19T08:42:44.037006+0000","last_became_peered":"2024-09-19T08:42:44.037006+0000","last_unstale":"2024-09-19T08:42:58.103460+0000","last_undegraded":"2024-09-19T08:42:58.103460+0000","last_fullsized":"2024-09-19T08:42:58.103460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:10.952939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110570+0000","last_change":"2024-09-19T08:42:44.034125+0000","last_active":"2024-09-19T08:42:58.110570+0000","last_peered":"2024-09-19T08:42:58.110570+0000","last_clean":"2024-09-19T08:42:58.110570+0000","last_became_active":"2024-09-19T08:42:44.033772+0000","last_became_peered":"2024-09-19T08:42:44.033772+0000","last_unstale":"2024-09-19T08:42:58.110570+0000","last_undegraded":"2024-09-19T08:42:58.110570+0000","last_fullsized":"2024-09-19T08:42:58.110570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:42.854137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102712+0000","last_change":"2024-09-19T08:42:44.043047+0000","last_active":"2024-09-19T08:42:58.102712+0000","last_peered":"2024-09-19T08:42:58.102712+0000","last_clean":"2024-09-19T08:42:58.102712+0000","last_became_active":"2024-09-19T08:42:44.042666+0000","last_became_peered":"2024-09-19T08:42:44.042666+0000","last_unstale":"2024-09-19T08:42:58.102712+0000","last_undegraded":"2024-09-19T08:42:58.102712+0000","last_fullsized":"2024-09-19T08:42:58.102712+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:16.504824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100549+0000","last_change":"2024-09-19T08:42:44.026475+0000","last_active":"2024-09-19T08:42:58.100549+0000","last_peered":"2024-09-19T08:42:58.100549+0000","last_clean":"2024-09-19T08:42:58.100549+0000","last_became_active":"2024-09-19T08:42:44.026169+0000","last_became_peered":"2024-09-19T08:42:44.026169+0000","last_unstale":"2024-09-19T08:42:58.100549+0000","last_undegraded":"2024-09-19T08:42:58.100549+0000","last_fullsized":"2024-09-19T08:42:58.100549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:17.130267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102287+0000","last_change":"2024-09-19T08:42:44.033725+0000","last_active":"2024-09-19T08:42:58.102287+0000","last_peered":"2024-09-19T08:42:58.102287+0000","last_clean":"2024-09-19T08:42:58.102287+0000","last_became_active":"2024-09-19T08:42:44.033304+0000","last_became_peered":"2024-09-19T08:42:44.033304+0000","last_unstale":"2024-09-19T08:42:58.102287+0000","last_undegraded":"2024-09-19T08:42:58.102287+0000","last_fullsized":"2024-09-19T08:42:58.102287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:47.520808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102018+0000","last_change":"2024-09-19T08:42:44.041762+0000","last_active":"2024-09-19T08:42:58.102018+0000","last_peered":"2024-09-19T08:42:58.102018+0000","last_clean":"2024-09-19T08:42:58.102018+0000","last_became_active":"2024-09-19T08:42:44.041433+0000","last_became_peered":"2024-09-19T08:42:44.041433+0000","last_unstale":"2024-09-19T08:42:58.102018+0000","last_undegraded":"2024-09-19T08:42:58.102018+0000","last_fullsized":"2024-09-19T08:42:58.102018+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:05.504873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108993+0000","last_change":"2024-09-19T08:42:44.030316+0000","last_active":"2024-09-19T08:42:58.108993+0000","last_peered":"2024-09-19T08:42:58.108993+0000","last_clean":"2024-09-19T08:42:58.108993+0000","last_became_active":"2024-09-19T08:42:44.029872+0000","last_became_peered":"2024-09-19T08:42:44.029872+0000","last_unstale":"2024-09-19T08:42:58.108993+0000","last_undegraded":"2024-09-19T08:42:58.108993+0000","last_fullsized":"2024-09-19T08:42:58.108993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:18.011019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101626+0000","last_change":"2024-09-19T08:42:44.035523+0000","last_active":"2024-09-19T08:42:58.101626+0000","last_peered":"2024-09-19T08:42:58.101626+0000","last_clean":"2024-09-19T08:42:58.101626+0000","last_became_active":"2024-09-19T08:42:44.035185+0000","last_became_peered":"2024-09-19T08:42:44.035185+0000","last_unstale":"2024-09-19T08:42:58.101626+0000","last_undegraded":"2024-09-19T08:42:58.101626+0000","last_fullsized":"2024-09-19T08:42:58.101626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:03.475458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105867+0000","last_change":"2024-09-19T08:42:44.031803+0000","last_active":"2024-09-19T08:42:58.105867+0000","last_peered":"2024-09-19T08:42:58.105867+0000","last_clean":"2024-09-19T08:42:58.105867+0000","last_became_active":"2024-09-19T08:42:44.031501+0000","last_became_peered":"2024-09-19T08:42:44.031501+0000","last_unstale":"2024-09-19T08:42:58.105867+0000","last_undegraded":"2024-09-19T08:42:58.105867+0000","last_fullsized":"2024-09-19T08:42:58.105867+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:31.780744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104128+0000","last_change":"2024-09-19T08:42:44.036168+0000","last_active":"2024-09-19T08:42:58.104128+0000","last_peered":"2024-09-19T08:42:58.104128+0000","last_clean":"2024-09-19T08:42:58.104128+0000","last_became_active":"2024-09-19T08:42:44.035819+0000","last_became_peered":"2024-09-19T08:42:44.035819+0000","last_unstale":"2024-09-19T08:42:58.104128+0000","last_undegraded":"2024-09-19T08:42:58.104128+0000","last_fullsized":"2024-09-19T08:42:58.104128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:26.478389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101182+0000","last_change":"2024-09-19T08:42:44.037569+0000","last_active":"2024-09-19T08:42:58.101182+0000","last_peered":"2024-09-19T08:42:58.101182+0000","last_clean":"2024-09-19T08:42:58.101182+0000","last_became_active":"2024-09-19T08:42:44.037161+0000","last_became_peered":"2024-09-19T08:42:44.037161+0000","last_unstale":"2024-09-19T08:42:58.101182+0000","last_undegraded":"2024-09-19T08:42:58.101182+0000","last_fullsized":"2024-09-19T08:42:58.101182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:35.316314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100549+0000","last_change":"2024-09-19T08:42:44.023160+0000","last_active":"2024-09-19T08:42:58.100549+0000","last_peered":"2024-09-19T08:42:58.100549+0000","last_clean":"2024-09-19T08:42:58.100549+0000","last_became_active":"2024-09-19T08:42:44.022791+0000","last_became_peered":"2024-09-19T08:42:44.022791+0000","last_unstale":"2024-09-19T08:42:58.100549+0000","last_undegraded":"2024-09-19T08:42:58.100549+0000","last_fullsized":"2024-09-19T08:42:58.100549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:00.174583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109685+0000","last_change":"2024-09-19T08:42:44.035877+0000","last_active":"2024-09-19T08:42:58.109685+0000","last_peered":"2024-09-19T08:42:58.109685+0000","last_clean":"2024-09-19T08:42:58.109685+0000","last_became_active":"2024-09-19T08:42:44.035307+0000","last_became_peered":"2024-09-19T08:42:44.035307+0000","last_unstale":"2024-09-19T08:42:58.109685+0000","last_undegraded":"2024-09-19T08:42:58.109685+0000","last_fullsized":"2024-09-19T08:42:58.109685+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:54.717130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104090+0000","last_change":"2024-09-19T08:42:44.033536+0000","last_active":"2024-09-19T08:42:58.104090+0000","last_peered":"2024-09-19T08:42:58.104090+0000","last_clean":"2024-09-19T08:42:58.104090+0000","last_became_active":"2024-09-19T08:42:44.033179+0000","last_became_peered":"2024-09-19T08:42:44.033179+0000","last_unstale":"2024-09-19T08:42:58.104090+0000","last_undegraded":"2024-09-19T08:42:58.104090+0000","last_fullsized":"2024-09-19T08:42:58.104090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:11.161785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104608+0000","last_change":"2024-09-19T08:42:44.029674+0000","last_active":"2024-09-19T08:42:58.104608+0000","last_peered":"2024-09-19T08:42:58.104608+0000","last_clean":"2024-09-19T08:42:58.104608+0000","last_became_active":"2024-09-19T08:42:44.029368+0000","last_became_peered":"2024-09-19T08:42:44.029368+0000","last_unstale":"2024-09-19T08:42:58.104608+0000","last_undegraded":"2024-09-19T08:42:58.104608+0000","last_fullsized":"2024-09-19T08:42:58.104608+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:34.943363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105011+0000","last_change":"2024-09-19T08:42:44.039780+0000","last_active":"2024-09-19T08:42:58.105011+0000","last_peered":"2024-09-19T08:42:58.105011+0000","last_clean":"2024-09-19T08:42:58.105011+0000","last_became_active":"2024-09-19T08:42:44.039409+0000","last_became_peered":"2024-09-19T08:42:44.039409+0000","last_unstale":"2024-09-19T08:42:58.105011+0000","last_undegraded":"2024-09-19T08:42:58.105011+0000","last_fullsized":"2024-09-19T08:42:58.105011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:59.632132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103863+0000","last_change":"2024-09-19T08:42:44.030881+0000","last_active":"2024-09-19T08:42:58.103863+0000","last_peered":"2024-09-19T08:42:58.103863+0000","last_clean":"2024-09-19T08:42:58.103863+0000","last_became_active":"2024-09-19T08:42:44.030530+0000","last_became_peered":"2024-09-19T08:42:44.030530+0000","last_unstale":"2024-09-19T08:42:58.103863+0000","last_undegraded":"2024-09-19T08:42:58.103863+0000","last_fullsized":"2024-09-19T08:42:58.103863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:16.908450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101414+0000","last_change":"2024-09-19T08:42:44.033056+0000","last_active":"2024-09-19T08:42:58.101414+0000","last_peered":"2024-09-19T08:42:58.101414+0000","last_clean":"2024-09-19T08:42:58.101414+0000","last_became_active":"2024-09-19T08:42:44.032690+0000","last_became_peered":"2024-09-19T08:42:44.032690+0000","last_unstale":"2024-09-19T08:42:58.101414+0000","last_undegraded":"2024-09-19T08:42:58.101414+0000","last_fullsized":"2024-09-19T08:42:58.101414+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:36.497824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106551+0000","last_change":"2024-09-19T08:42:58.106551+0000","last_active":"2024-09-19T08:42:58.106551+0000","last_peered":"2024-09-19T08:42:58.106551+0000","last_clean":"2024-09-19T08:42:58.106551+0000","last_became_active":"2024-09-19T08:42:58.106119+0000","last_became_peered":"2024-09-19T08:42:58.106119+0000","last_unstale":"2024-09-19T08:42:58.106551+0000","last_undegraded":"2024-09-19T08:42:58.106551+0000","last_fullsized":"2024-09-19T08:42:58.106551+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:46.794260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108106+0000","last_change":"2024-09-19T08:42:58.108106+0000","last_active":"2024-09-19T08:42:58.108106+0000","last_peered":"2024-09-19T08:42:58.108106+0000","last_clean":"2024-09-19T08:42:58.108106+0000","last_became_active":"2024-09-19T08:42:58.107532+0000","last_became_peered":"2024-09-19T08:42:58.107532+0000","last_unstale":"2024-09-19T08:42:58.108106+0000","last_undegraded":"2024-09-19T08:42:58.108106+0000","last_fullsized":"2024-09-19T08:42:58.108106+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:29.164983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103606+0000","last_change":"2024-09-19T08:42:44.029822+0000","last_active":"2024-09-19T08:42:58.103606+0000","last_peered":"2024-09-19T08:42:58.103606+0000","last_clean":"2024-09-19T08:42:58.103606+0000","last_became_active":"2024-09-19T08:42:44.029450+0000","last_became_peered":"2024-09-19T08:42:44.029450+0000","last_unstale":"2024-09-19T08:42:58.103606+0000","last_undegraded":"2024-09-19T08:42:58.103606+0000","last_fullsized":"2024-09-19T08:42:58.103606+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:40.826261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105132+0000","last_change":"2024-09-19T08:42:44.041354+0000","last_active":"2024-09-19T08:42:58.105132+0000","last_peered":"2024-09-19T08:42:58.105132+0000","last_clean":"2024-09-19T08:42:58.105132+0000","last_became_active":"2024-09-19T08:42:44.040912+0000","last_became_peered":"2024-09-19T08:42:44.040912+0000","last_unstale":"2024-09-19T08:42:58.105132+0000","last_undegraded":"2024-09-19T08:42:58.105132+0000","last_fullsized":"2024-09-19T08:42:58.105132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:16.543950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101119+0000","last_change":"2024-09-19T08:42:44.027912+0000","last_active":"2024-09-19T08:42:58.101119+0000","last_peered":"2024-09-19T08:42:58.101119+0000","last_clean":"2024-09-19T08:42:58.101119+0000","last_became_active":"2024-09-19T08:42:44.027505+0000","last_became_peered":"2024-09-19T08:42:44.027505+0000","last_unstale":"2024-09-19T08:42:58.101119+0000","last_undegraded":"2024-09-19T08:42:58.101119+0000","last_fullsized":"2024-09-19T08:42:58.101119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:02.552756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.107911+0000","last_change":"2024-09-19T08:42:44.034472+0000","last_active":"2024-09-19T08:42:58.107911+0000","last_peered":"2024-09-19T08:42:58.107911+0000","last_clean":"2024-09-19T08:42:58.107911+0000","last_became_active":"2024-09-19T08:42:44.034026+0000","last_became_peered":"2024-09-19T08:42:44.034026+0000","last_unstale":"2024-09-19T08:42:58.107911+0000","last_undegraded":"2024-09-19T08:42:58.107911+0000","last_fullsized":"2024-09-19T08:42:58.107911+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:10.058882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'6","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:05.110008+0000","last_change":"2024-09-19T08:42:41.927174+0000","last_active":"2024-09-19T08:43:05.110008+0000","last_peered":"2024-09-19T08:43:05.110008+0000","last_clean":"2024-09-19T08:43:05.110008+0000","last_became_active":"2024-09-19T08:42:41.926826+0000","last_became_peered":"2024-09-19T08:42:41.926826+0000","last_unstale":"2024-09-19T08:43:05.110008+0000","last_undegraded":"2024-09-19T08:43:05.110008+0000","last_fullsized":"2024-09-19T08:43:05.110008+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:37.274891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110259+0000","last_change":"2024-09-19T08:42:58.110259+0000","last_active":"2024-09-19T08:42:58.110259+0000","last_peered":"2024-09-19T08:42:58.110259+0000","last_clean":"2024-09-19T08:42:58.110259+0000","last_became_active":"2024-09-19T08:42:58.109803+0000","last_became_peered":"2024-09-19T08:42:58.109803+0000","last_unstale":"2024-09-19T08:42:58.110259+0000","last_undegraded":"2024-09-19T08:42:58.110259+0000","last_fullsized":"2024-09-19T08:42:58.110259+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:31.853404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.114222+0000","last_change":"2024-09-19T08:42:58.114222+0000","last_active":"2024-09-19T08:42:58.114222+0000","last_peered":"2024-09-19T08:42:58.114222+0000","last_clean":"2024-09-19T08:42:58.114222+0000","last_became_active":"2024-09-19T08:42:58.110769+0000","last_became_peered":"2024-09-19T08:42:58.110769+0000","last_unstale":"2024-09-19T08:42:58.114222+0000","last_undegraded":"2024-09-19T08:42:58.114222+0000","last_fullsized":"2024-09-19T08:42:58.114222+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:17.952228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100222+0000","last_change":"2024-09-19T08:42:41.923903+0000","last_active":"2024-09-19T08:42:58.100222+0000","last_peered":"2024-09-19T08:42:58.100222+0000","last_clean":"2024-09-19T08:42:58.100222+0000","last_became_active":"2024-09-19T08:42:41.923583+0000","last_became_peered":"2024-09-19T08:42:41.923583+0000","last_unstale":"2024-09-19T08:42:58.100222+0000","last_undegraded":"2024-09-19T08:42:58.100222+0000","last_fullsized":"2024-09-19T08:42:58.100222+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:48.594343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104302+0000","last_change":"2024-09-19T08:42:44.028972+0000","last_active":"2024-09-19T08:42:58.104302+0000","last_peered":"2024-09-19T08:42:58.104302+0000","last_clean":"2024-09-19T08:42:58.104302+0000","last_became_active":"2024-09-19T08:42:44.028657+0000","last_became_peered":"2024-09-19T08:42:44.028657+0000","last_unstale":"2024-09-19T08:42:58.104302+0000","last_undegraded":"2024-09-19T08:42:58.104302+0000","last_fullsized":"2024-09-19T08:42:58.104302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:43.618010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106455+0000","last_change":"2024-09-19T08:42:41.926558+0000","last_active":"2024-09-19T08:42:58.106455+0000","last_peered":"2024-09-19T08:42:58.106455+0000","last_clean":"2024-09-19T08:42:58.106455+0000","last_became_active":"2024-09-19T08:42:41.926074+0000","last_became_peered":"2024-09-19T08:42:41.926074+0000","last_unstale":"2024-09-19T08:42:58.106455+0000","last_undegraded":"2024-09-19T08:42:58.106455+0000","last_fullsized":"2024-09-19T08:42:58.106455+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:47.563295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105300+0000","last_change":"2024-09-19T08:42:44.029191+0000","last_active":"2024-09-19T08:42:58.105300+0000","last_peered":"2024-09-19T08:42:58.105300+0000","last_clean":"2024-09-19T08:42:58.105300+0000","last_became_active":"2024-09-19T08:42:44.028871+0000","last_became_peered":"2024-09-19T08:42:44.028871+0000","last_unstale":"2024-09-19T08:42:58.105300+0000","last_undegraded":"2024-09-19T08:42:58.105300+0000","last_fullsized":"2024-09-19T08:42:58.105300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:41.262014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:04.108155+0000","last_change":"2024-09-19T08:42:41.930265+0000","last_active":"2024-09-19T08:43:04.108155+0000","last_peered":"2024-09-19T08:43:04.108155+0000","last_clean":"2024-09-19T08:43:04.108155+0000","last_became_active":"2024-09-19T08:42:41.929829+0000","last_became_peered":"2024-09-19T08:42:41.929829+0000","last_unstale":"2024-09-19T08:43:04.108155+0000","last_undegraded":"2024-09-19T08:43:04.108155+0000","last_fullsized":"2024-09-19T08:43:04.108155+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:59.181622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109302+0000","last_change":"2024-09-19T08:42:44.027382+0000","last_active":"2024-09-19T08:42:58.109302+0000","last_peered":"2024-09-19T08:42:58.109302+0000","last_clean":"2024-09-19T08:42:58.109302+0000","last_became_active":"2024-09-19T08:42:44.026824+0000","last_became_peered":"2024-09-19T08:42:44.026824+0000","last_unstale":"2024-09-19T08:42:58.109302+0000","last_undegraded":"2024-09-19T08:42:58.109302+0000","last_fullsized":"2024-09-19T08:42:58.109302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:58.520068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110495+0000","last_change":"2024-09-19T08:42:41.927914+0000","last_active":"2024-09-19T08:42:58.110495+0000","last_peered":"2024-09-19T08:42:58.110495+0000","last_clean":"2024-09-19T08:42:58.110495+0000","last_became_active":"2024-09-19T08:42:41.926566+0000","last_became_peered":"2024-09-19T08:42:41.926566+0000","last_unstale":"2024-09-19T08:42:58.110495+0000","last_undegraded":"2024-09-19T08:42:58.110495+0000","last_fullsized":"2024-09-19T08:42:58.110495+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:52.238352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103155+0000","last_change":"2024-09-19T08:42:44.039899+0000","last_active":"2024-09-19T08:42:58.103155+0000","last_peered":"2024-09-19T08:42:58.103155+0000","last_clean":"2024-09-19T08:42:58.103155+0000","last_became_active":"2024-09-19T08:42:44.039530+0000","last_became_peered":"2024-09-19T08:42:44.039530+0000","last_unstale":"2024-09-19T08:42:58.103155+0000","last_undegraded":"2024-09-19T08:42:58.103155+0000","last_fullsized":"2024-09-19T08:42:58.103155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:20.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105251+0000","last_change":"2024-09-19T08:42:42.410128+0000","last_active":"2024-09-19T08:42:58.105251+0000","last_peered":"2024-09-19T08:42:58.105251+0000","last_clean":"2024-09-19T08:42:58.105251+0000","last_became_active":"2024-09-19T08:42:42.409717+0000","last_became_peered":"2024-09-19T08:42:42.409717+0000","last_unstale":"2024-09-19T08:42:58.105251+0000","last_undegraded":"2024-09-19T08:42:58.105251+0000","last_fullsized":"2024-09-19T08:42:58.105251+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:41.682355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109529+0000","last_change":"2024-09-19T08:42:44.043248+0000","last_active":"2024-09-19T08:42:58.109529+0000","last_peered":"2024-09-19T08:42:58.109529+0000","last_clean":"2024-09-19T08:42:58.109529+0000","last_became_active":"2024-09-19T08:42:44.042849+0000","last_became_peered":"2024-09-19T08:42:44.042849+0000","last_unstale":"2024-09-19T08:42:58.109529+0000","last_undegraded":"2024-09-19T08:42:58.109529+0000","last_fullsized":"2024-09-19T08:42:58.109529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:00.413217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'22","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:05.112109+0000","last_change":"2024-09-19T08:42:41.926582+0000","last_active":"2024-09-19T08:43:05.112109+0000","last_peered":"2024-09-19T08:43:05.112109+0000","last_clean":"2024-09-19T08:43:05.112109+0000","last_became_active":"2024-09-19T08:42:41.926234+0000","last_became_peered":"2024-09-19T08:42:41.926234+0000","last_unstale":"2024-09-19T08:43:05.112109+0000","last_undegraded":"2024-09-19T08:43:05.112109+0000","last_fullsized":"2024-09-19T08:43:05.112109+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:02.498976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":60,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108555+0000","last_change":"2024-09-19T08:42:44.034888+0000","last_active":"2024-09-19T08:42:58.108555+0000","last_peered":"2024-09-19T08:42:58.108555+0000","last_clean":"2024-09-19T08:42:58.108555+0000","last_became_active":"2024-09-19T08:42:44.034553+0000","last_became_peered":"2024-09-19T08:42:44.034553+0000","last_unstale":"2024-09-19T08:42:58.108555+0000","last_undegraded":"2024-09-19T08:42:58.108555+0000","last_fullsized":"2024-09-19T08:42:58.108555+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:06.416289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.118358+0000","last_change":"2024-09-19T08:42:58.117912+0000","last_active":"2024-09-19T08:42:58.118358+0000","last_peered":"2024-09-19T08:42:58.118358+0000","last_clean":"2024-09-19T08:42:58.118358+0000","last_became_active":"2024-09-19T08:42:58.105810+0000","last_became_peered":"2024-09-19T08:42:58.105810+0000","last_unstale":"2024-09-19T08:42:58.118358+0000","last_undegraded":"2024-09-19T08:42:58.118358+0000","last_fullsized":"2024-09-19T08:42:58.118358+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:44.258256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100246+0000","last_change":"2024-09-19T08:42:44.030519+0000","last_active":"2024-09-19T08:42:58.100246+0000","last_peered":"2024-09-19T08:42:58.100246+0000","last_clean":"2024-09-19T08:42:58.100246+0000","last_became_active":"2024-09-19T08:42:44.030190+0000","last_became_peered":"2024-09-19T08:42:44.030190+0000","last_unstale":"2024-09-19T08:42:58.100246+0000","last_undegraded":"2024-09-19T08:42:58.100246+0000","last_fullsized":"2024-09-19T08:42:58.100246+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:20.220642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106393+0000","last_change":"2024-09-19T08:42:41.928124+0000","last_active":"2024-09-19T08:42:58.106393+0000","last_peered":"2024-09-19T08:42:58.106393+0000","last_clean":"2024-09-19T08:42:58.106393+0000","last_became_active":"2024-09-19T08:42:41.927761+0000","last_became_peered":"2024-09-19T08:42:41.927761+0000","last_unstale":"2024-09-19T08:42:58.106393+0000","last_undegraded":"2024-09-19T08:42:58.106393+0000","last_fullsized":"2024-09-19T08:42:58.106393+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:08.591270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108569+0000","last_change":"2024-09-19T08:42:44.038234+0000","last_active":"2024-09-19T08:42:58.108569+0000","last_peered":"2024-09-19T08:42:58.108569+0000","last_clean":"2024-09-19T08:42:58.108569+0000","last_became_active":"2024-09-19T08:42:44.037726+0000","last_became_peered":"2024-09-19T08:42:44.037726+0000","last_unstale":"2024-09-19T08:42:58.108569+0000","last_undegraded":"2024-09-19T08:42:58.108569+0000","last_fullsized":"2024-09-19T08:42:58.108569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:08.865482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:06.110668+0000","last_change":"2024-09-19T08:42:41.926206+0000","last_active":"2024-09-19T08:43:06.110668+0000","last_peered":"2024-09-19T08:43:06.110668+0000","last_clean":"2024-09-19T08:43:06.110668+0000","last_became_active":"2024-09-19T08:42:41.925833+0000","last_became_peered":"2024-09-19T08:42:41.925833+0000","last_unstale":"2024-09-19T08:43:06.110668+0000","last_undegraded":"2024-09-19T08:43:06.110668+0000","last_fullsized":"2024-09-19T08:43:06.110668+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:27.944240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108472+0000","last_change":"2024-09-19T08:42:44.037181+0000","last_active":"2024-09-19T08:42:58.108472+0000","last_peered":"2024-09-19T08:42:58.108472+0000","last_clean":"2024-09-19T08:42:58.108472+0000","last_became_active":"2024-09-19T08:42:44.036865+0000","last_became_peered":"2024-09-19T08:42:44.036865+0000","last_unstale":"2024-09-19T08:42:58.108472+0000","last_undegraded":"2024-09-19T08:42:58.108472+0000","last_fullsized":"2024-09-19T08:42:58.108472+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:20.233309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.107685+0000","last_change":"2024-09-19T08:42:42.408446+0000","last_active":"2024-09-19T08:42:58.107685+0000","last_peered":"2024-09-19T08:42:58.107685+0000","last_clean":"2024-09-19T08:42:58.107685+0000","last_became_active":"2024-09-19T08:42:42.408098+0000","last_became_peered":"2024-09-19T08:42:42.408098+0000","last_unstale":"2024-09-19T08:42:58.107685+0000","last_undegraded":"2024-09-19T08:42:58.107685+0000","last_fullsized":"2024-09-19T08:42:58.107685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:22.603604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106374+0000","last_change":"2024-09-19T08:42:44.039954+0000","last_active":"2024-09-19T08:42:58.106374+0000","last_peered":"2024-09-19T08:42:58.106374+0000","last_clean":"2024-09-19T08:42:58.106374+0000","last_became_active":"2024-09-19T08:42:44.039601+0000","last_became_peered":"2024-09-19T08:42:44.039601+0000","last_unstale":"2024-09-19T08:42:58.106374+0000","last_undegraded":"2024-09-19T08:42:58.106374+0000","last_fullsized":"2024-09-19T08:42:58.106374+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:07.792167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108716+0000","last_change":"2024-09-19T08:42:41.929644+0000","last_active":"2024-09-19T08:42:58.108716+0000","last_peered":"2024-09-19T08:42:58.108716+0000","last_clean":"2024-09-19T08:42:58.108716+0000","last_became_active":"2024-09-19T08:42:41.929308+0000","last_became_peered":"2024-09-19T08:42:41.929308+0000","last_unstale":"2024-09-19T08:42:58.108716+0000","last_undegraded":"2024-09-19T08:42:58.108716+0000","last_fullsized":"2024-09-19T08:42:58.108716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:36.660470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.107555+0000","last_change":"2024-09-19T08:42:58.107555+0000","last_active":"2024-09-19T08:42:58.107555+0000","last_peered":"2024-09-19T08:42:58.107555+0000","last_clean":"2024-09-19T08:42:58.107555+0000","last_became_active":"2024-09-19T08:42:58.107137+0000","last_became_peered":"2024-09-19T08:42:58.107137+0000","last_unstale":"2024-09-19T08:42:58.107555+0000","last_undegraded":"2024-09-19T08:42:58.107555+0000","last_fullsized":"2024-09-19T08:42:58.107555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:13.198911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100493+0000","last_change":"2024-09-19T08:42:41.925195+0000","last_active":"2024-09-19T08:42:58.100493+0000","last_peered":"2024-09-19T08:42:58.100493+0000","last_clean":"2024-09-19T08:42:58.100493+0000","last_became_active":"2024-09-19T08:42:41.924880+0000","last_became_peered":"2024-09-19T08:42:41.924880+0000","last_unstale":"2024-09-19T08:42:58.100493+0000","last_undegraded":"2024-09-19T08:42:58.100493+0000","last_fullsized":"2024-09-19T08:42:58.100493+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:11.256881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110838+0000","last_change":"2024-09-19T08:42:44.036439+0000","last_active":"2024-09-19T08:42:58.110838+0000","last_peered":"2024-09-19T08:42:58.110838+0000","last_clean":"2024-09-19T08:42:58.110838+0000","last_became_active":"2024-09-19T08:42:44.036036+0000","last_became_peered":"2024-09-19T08:42:44.036036+0000","last_unstale":"2024-09-19T08:42:58.110838+0000","last_undegraded":"2024-09-19T08:42:58.110838+0000","last_fullsized":"2024-09-19T08:42:58.110838+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:37.410782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106933+0000","last_change":"2024-09-19T08:42:41.927490+0000","last_active":"2024-09-19T08:42:58.106933+0000","last_peered":"2024-09-19T08:42:58.106933+0000","last_clean":"2024-09-19T08:42:58.106933+0000","last_became_active":"2024-09-19T08:42:41.927163+0000","last_became_peered":"2024-09-19T08:42:41.927163+0000","last_unstale":"2024-09-19T08:42:58.106933+0000","last_undegraded":"2024-09-19T08:42:58.106933+0000","last_fullsized":"2024-09-19T08:42:58.106933+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:20.013661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110644+0000","last_change":"2024-09-19T08:42:44.036960+0000","last_active":"2024-09-19T08:42:58.110644+0000","last_peered":"2024-09-19T08:42:58.110644+0000","last_clean":"2024-09-19T08:42:58.110644+0000","last_became_active":"2024-09-19T08:42:44.036600+0000","last_became_peered":"2024-09-19T08:42:44.036600+0000","last_unstale":"2024-09-19T08:42:58.110644+0000","last_undegraded":"2024-09-19T08:42:58.110644+0000","last_fullsized":"2024-09-19T08:42:58.110644+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:15.621888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.114698+0000","last_change":"2024-09-19T08:42:58.114698+0000","last_active":"2024-09-19T08:42:58.114698+0000","last_peered":"2024-09-19T08:42:58.114698+0000","last_clean":"2024-09-19T08:42:58.114698+0000","last_became_active":"2024-09-19T08:42:58.105488+0000","last_became_peered":"2024-09-19T08:42:58.105488+0000","last_unstale":"2024-09-19T08:42:58.114698+0000","last_undegraded":"2024-09-19T08:42:58.114698+0000","last_fullsized":"2024-09-19T08:42:58.114698+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:12.642715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110688+0000","last_change":"2024-09-19T08:42:44.035569+0000","last_active":"2024-09-19T08:42:58.110688+0000","last_peered":"2024-09-19T08:42:58.110688+0000","last_clean":"2024-09-19T08:42:58.110688+0000","last_became_active":"2024-09-19T08:42:44.035277+0000","last_became_peered":"2024-09-19T08:42:44.035277+0000","last_unstale":"2024-09-19T08:42:58.110688+0000","last_undegraded":"2024-09-19T08:42:58.110688+0000","last_fullsized":"2024-09-19T08:42:58.110688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:57.472721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":345,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108782+0000","last_change":"2024-09-19T08:41:34.769047+0000","last_active":"2024-09-19T08:42:58.108782+0000","last_peered":"2024-09-19T08:42:58.108782+0000","last_clean":"2024-09-19T08:42:58.108782+0000","last_became_active":"2024-09-19T08:41:34.768619+0000","last_became_peered":"2024-09-19T08:41:34.768619+0000","last_unstale":"2024-09-19T08:42:58.108782+0000","last_undegraded":"2024-09-19T08:42:58.108782+0000","last_fullsized":"2024-09-19T08:42:58.108782+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:13.482855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:13.482855+0000","last_clean_scrub_stamp":"2024-09-19T08:38:13.482855+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.390775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102051+0000","last_change":"2024-09-19T08:42:41.925698+0000","last_active":"2024-09-19T08:42:58.102051+0000","last_peered":"2024-09-19T08:42:58.102051+0000","last_clean":"2024-09-19T08:42:58.102051+0000","last_became_active":"2024-09-19T08:42:41.924618+0000","last_became_peered":"2024-09-19T08:42:41.924618+0000","last_unstale":"2024-09-19T08:42:58.102051+0000","last_undegraded":"2024-09-19T08:42:58.102051+0000","last_fullsized":"2024-09-19T08:42:58.102051+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:53.717139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.111536+0000","last_change":"2024-09-19T08:42:58.111206+0000","last_active":"2024-09-19T08:42:58.111536+0000","last_peered":"2024-09-19T08:42:58.111536+0000","last_clean":"2024-09-19T08:42:58.111536+0000","last_became_active":"2024-09-19T08:42:58.110765+0000","last_became_peered":"2024-09-19T08:42:58.110765+0000","last_unstale":"2024-09-19T08:42:58.111536+0000","last_undegraded":"2024-09-19T08:42:58.111536+0000","last_fullsized":"2024-09-19T08:42:58.111536+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:44.783938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108663+0000","last_change":"2024-09-19T08:42:41.928414+0000","last_active":"2024-09-19T08:42:58.108663+0000","last_peered":"2024-09-19T08:42:58.108663+0000","last_clean":"2024-09-19T08:42:58.108663+0000","last_became_active":"2024-09-19T08:42:41.928055+0000","last_became_peered":"2024-09-19T08:42:41.928055+0000","last_unstale":"2024-09-19T08:42:58.108663+0000","last_undegraded":"2024-09-19T08:42:58.108663+0000","last_fullsized":"2024-09-19T08:42:58.108663+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:12.688379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100208+0000","last_change":"2024-09-19T08:42:44.035439+0000","last_active":"2024-09-19T08:42:58.100208+0000","last_peered":"2024-09-19T08:42:58.100208+0000","last_clean":"2024-09-19T08:42:58.100208+0000","last_became_active":"2024-09-19T08:42:44.035150+0000","last_became_peered":"2024-09-19T08:42:44.035150+0000","last_unstale":"2024-09-19T08:42:58.100208+0000","last_undegraded":"2024-09-19T08:42:58.100208+0000","last_fullsized":"2024-09-19T08:42:58.100208+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:15.230660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:06.109987+0000","last_change":"2024-09-19T08:42:42.407784+0000","last_active":"2024-09-19T08:43:06.109987+0000","last_peered":"2024-09-19T08:43:06.109987+0000","last_clean":"2024-09-19T08:43:06.109987+0000","last_became_active":"2024-09-19T08:42:42.407437+0000","last_became_peered":"2024-09-19T08:42:42.407437+0000","last_unstale":"2024-09-19T08:43:06.109987+0000","last_undegraded":"2024-09-19T08:43:06.109987+0000","last_fullsized":"2024-09-19T08:43:06.109987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:44.829338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104733+0000","last_change":"2024-09-19T08:42:44.039780+0000","last_active":"2024-09-19T08:42:58.104733+0000","last_peered":"2024-09-19T08:42:58.104733+0000","last_clean":"2024-09-19T08:42:58.104733+0000","last_became_active":"2024-09-19T08:42:44.039441+0000","last_became_peered":"2024-09-19T08:42:44.039441+0000","last_unstale":"2024-09-19T08:42:58.104733+0000","last_undegraded":"2024-09-19T08:42:58.104733+0000","last_fullsized":"2024-09-19T08:42:58.104733+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:31.013663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109953+0000","last_change":"2024-09-19T08:42:41.926998+0000","last_active":"2024-09-19T08:42:58.109953+0000","last_peered":"2024-09-19T08:42:58.109953+0000","last_clean":"2024-09-19T08:42:58.109953+0000","last_became_active":"2024-09-19T08:42:41.926560+0000","last_became_peered":"2024-09-19T08:42:41.926560+0000","last_unstale":"2024-09-19T08:42:58.109953+0000","last_undegraded":"2024-09-19T08:42:58.109953+0000","last_fullsized":"2024-09-19T08:42:58.109953+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:35.338601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102887+0000","last_change":"2024-09-19T08:42:44.039948+0000","last_active":"2024-09-19T08:42:58.102887+0000","last_peered":"2024-09-19T08:42:58.102887+0000","last_clean":"2024-09-19T08:42:58.102887+0000","last_became_active":"2024-09-19T08:42:44.038797+0000","last_became_peered":"2024-09-19T08:42:44.038797+0000","last_unstale":"2024-09-19T08:42:58.102887+0000","last_undegraded":"2024-09-19T08:42:58.102887+0000","last_fullsized":"2024-09-19T08:42:58.102887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:19.273191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105603+0000","last_change":"2024-09-19T08:42:42.409954+0000","last_active":"2024-09-19T08:42:58.105603+0000","last_peered":"2024-09-19T08:42:58.105603+0000","last_clean":"2024-09-19T08:42:58.105603+0000","last_became_active":"2024-09-19T08:42:42.409388+0000","last_became_peered":"2024-09-19T08:42:42.409388+0000","last_unstale":"2024-09-19T08:42:58.105603+0000","last_undegraded":"2024-09-19T08:42:58.105603+0000","last_fullsized":"2024-09-19T08:42:58.105603+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:58.764877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103241+0000","last_change":"2024-09-19T08:42:44.024360+0000","last_active":"2024-09-19T08:42:58.103241+0000","last_peered":"2024-09-19T08:42:58.103241+0000","last_clean":"2024-09-19T08:42:58.103241+0000","last_became_active":"2024-09-19T08:42:44.023703+0000","last_became_peered":"2024-09-19T08:42:44.023703+0000","last_unstale":"2024-09-19T08:42:58.103241+0000","last_undegraded":"2024-09-19T08:42:58.103241+0000","last_fullsized":"2024-09-19T08:42:58.103241+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:10.852199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108774+0000","last_change":"2024-09-19T08:42:42.408101+0000","last_active":"2024-09-19T08:42:58.108774+0000","last_peered":"2024-09-19T08:42:58.108774+0000","last_clean":"2024-09-19T08:42:58.108774+0000","last_became_active":"2024-09-19T08:42:42.407692+0000","last_became_peered":"2024-09-19T08:42:42.407692+0000","last_unstale":"2024-09-19T08:42:58.108774+0000","last_undegraded":"2024-09-19T08:42:58.108774+0000","last_fullsized":"2024-09-19T08:42:58.108774+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:01.342213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100618+0000","last_change":"2024-09-19T08:42:44.026612+0000","last_active":"2024-09-19T08:42:58.100618+0000","last_peered":"2024-09-19T08:42:58.100618+0000","last_clean":"2024-09-19T08:42:58.100618+0000","last_became_active":"2024-09-19T08:42:44.025408+0000","last_became_peered":"2024-09-19T08:42:44.025408+0000","last_unstale":"2024-09-19T08:42:58.100618+0000","last_undegraded":"2024-09-19T08:42:58.100618+0000","last_fullsized":"2024-09-19T08:42:58.100618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:19.465342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:04.041342+0000","last_change":"2024-09-19T08:42:41.927561+0000","last_active":"2024-09-19T08:43:04.041342+0000","last_peered":"2024-09-19T08:43:04.041342+0000","last_clean":"2024-09-19T08:43:04.041342+0000","last_became_active":"2024-09-19T08:42:41.927159+0000","last_became_peered":"2024-09-19T08:42:41.927159+0000","last_unstale":"2024-09-19T08:43:04.041342+0000","last_undegraded":"2024-09-19T08:43:04.041342+0000","last_fullsized":"2024-09-19T08:43:04.041342+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:13.352727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106277+0000","last_change":"2024-09-19T08:42:44.028129+0000","last_active":"2024-09-19T08:42:58.106277+0000","last_peered":"2024-09-19T08:42:58.106277+0000","last_clean":"2024-09-19T08:42:58.106277+0000","last_became_active":"2024-09-19T08:42:44.027826+0000","last_became_peered":"2024-09-19T08:42:44.027826+0000","last_unstale":"2024-09-19T08:42:58.106277+0000","last_undegraded":"2024-09-19T08:42:58.106277+0000","last_fullsized":"2024-09-19T08:42:58.106277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:03.129404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102523+0000","last_change":"2024-09-19T08:42:41.920264+0000","last_active":"2024-09-19T08:42:58.102523+0000","last_peered":"2024-09-19T08:42:58.102523+0000","last_clean":"2024-09-19T08:42:58.102523+0000","last_became_active":"2024-09-19T08:42:41.919655+0000","last_became_peered":"2024-09-19T08:42:41.919655+0000","last_unstale":"2024-09-19T08:42:58.102523+0000","last_undegraded":"2024-09-19T08:42:58.102523+0000","last_fullsized":"2024-09-19T08:42:58.102523+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:58.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103052+0000","last_change":"2024-09-19T08:42:44.039655+0000","last_active":"2024-09-19T08:42:58.103052+0000","last_peered":"2024-09-19T08:42:58.103052+0000","last_clean":"2024-09-19T08:42:58.103052+0000","last_became_active":"2024-09-19T08:42:44.039317+0000","last_became_peered":"2024-09-19T08:42:44.039317+0000","last_unstale":"2024-09-19T08:42:58.103052+0000","last_undegraded":"2024-09-19T08:42:58.103052+0000","last_fullsized":"2024-09-19T08:42:58.103052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:19.064194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109199+0000","last_change":"2024-09-19T08:42:42.408582+0000","last_active":"2024-09-19T08:42:58.109199+0000","last_peered":"2024-09-19T08:42:58.109199+0000","last_clean":"2024-09-19T08:42:58.109199+0000","last_became_active":"2024-09-19T08:42:42.408143+0000","last_became_peered":"2024-09-19T08:42:42.408143+0000","last_unstale":"2024-09-19T08:42:58.109199+0000","last_undegraded":"2024-09-19T08:42:58.109199+0000","last_fullsized":"2024-09-19T08:42:58.109199+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.526138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.107333+0000","last_change":"2024-09-19T08:42:44.034795+0000","last_active":"2024-09-19T08:42:58.107333+0000","last_peered":"2024-09-19T08:42:58.107333+0000","last_clean":"2024-09-19T08:42:58.107333+0000","last_became_active":"2024-09-19T08:42:44.034440+0000","last_became_peered":"2024-09-19T08:42:44.034440+0000","last_unstale":"2024-09-19T08:42:58.107333+0000","last_undegraded":"2024-09-19T08:42:58.107333+0000","last_fullsized":"2024-09-19T08:42:58.107333+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:50.470240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104200+0000","last_change":"2024-09-19T08:42:41.922621+0000","last_active":"2024-09-19T08:42:58.104200+0000","last_peered":"2024-09-19T08:42:58.104200+0000","last_clean":"2024-09-19T08:42:58.104200+0000","last_became_active":"2024-09-19T08:42:41.922303+0000","last_became_peered":"2024-09-19T08:42:41.922303+0000","last_unstale":"2024-09-19T08:42:58.104200+0000","last_undegraded":"2024-09-19T08:42:58.104200+0000","last_fullsized":"2024-09-19T08:42:58.104200+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:48.017892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101216+0000","last_change":"2024-09-19T08:42:44.028307+0000","last_active":"2024-09-19T08:42:58.101216+0000","last_peered":"2024-09-19T08:42:58.101216+0000","last_clean":"2024-09-19T08:42:58.101216+0000","last_became_active":"2024-09-19T08:42:44.026848+0000","last_became_peered":"2024-09-19T08:42:44.026848+0000","last_unstale":"2024-09-19T08:42:58.101216+0000","last_undegraded":"2024-09-19T08:42:58.101216+0000","last_fullsized":"2024-09-19T08:42:58.101216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:20.768075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103736+0000","last_change":"2024-09-19T08:42:41.929479+0000","last_active":"2024-09-19T08:42:58.103736+0000","last_peered":"2024-09-19T08:42:58.103736+0000","last_clean":"2024-09-19T08:42:58.103736+0000","last_became_active":"2024-09-19T08:42:41.928508+0000","last_became_peered":"2024-09-19T08:42:41.928508+0000","last_unstale":"2024-09-19T08:42:58.103736+0000","last_undegraded":"2024-09-19T08:42:58.103736+0000","last_fullsized":"2024-09-19T08:42:58.103736+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:46.108471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104229+0000","last_change":"2024-09-19T08:42:44.028694+0000","last_active":"2024-09-19T08:42:58.104229+0000","last_peered":"2024-09-19T08:42:58.104229+0000","last_clean":"2024-09-19T08:42:58.104229+0000","last_became_active":"2024-09-19T08:42:44.027382+0000","last_became_peered":"2024-09-19T08:42:44.027382+0000","last_unstale":"2024-09-19T08:42:58.104229+0000","last_undegraded":"2024-09-19T08:42:58.104229+0000","last_fullsized":"2024-09-19T08:42:58.104229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:40.877505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108022+0000","last_change":"2024-09-19T08:42:41.931016+0000","last_active":"2024-09-19T08:42:58.108022+0000","last_peered":"2024-09-19T08:42:58.108022+0000","last_clean":"2024-09-19T08:42:58.108022+0000","last_became_active":"2024-09-19T08:42:41.930648+0000","last_became_peered":"2024-09-19T08:42:41.930648+0000","last_unstale":"2024-09-19T08:42:58.108022+0000","last_undegraded":"2024-09-19T08:42:58.108022+0000","last_fullsized":"2024-09-19T08:42:58.108022+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:32.031025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109744+0000","last_change":"2024-09-19T08:42:44.035288+0000","last_active":"2024-09-19T08:42:58.109744+0000","last_peered":"2024-09-19T08:42:58.109744+0000","last_clean":"2024-09-19T08:42:58.109744+0000","last_became_active":"2024-09-19T08:42:44.034660+0000","last_became_peered":"2024-09-19T08:42:44.034660+0000","last_unstale":"2024-09-19T08:42:58.109744+0000","last_undegraded":"2024-09-19T08:42:58.109744+0000","last_fullsized":"2024-09-19T08:42:58.109744+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:48.703463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105135+0000","last_change":"2024-09-19T08:42:44.040123+0000","last_active":"2024-09-19T08:42:58.105135+0000","last_peered":"2024-09-19T08:42:58.105135+0000","last_clean":"2024-09-19T08:42:58.105135+0000","last_became_active":"2024-09-19T08:42:44.039488+0000","last_became_peered":"2024-09-19T08:42:44.039488+0000","last_unstale":"2024-09-19T08:42:58.105135+0000","last_undegraded":"2024-09-19T08:42:58.105135+0000","last_fullsized":"2024-09-19T08:42:58.105135+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:15.273044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108182+0000","last_change":"2024-09-19T08:42:41.932400+0000","last_active":"2024-09-19T08:42:58.108182+0000","last_peered":"2024-09-19T08:42:58.108182+0000","last_clean":"2024-09-19T08:42:58.108182+0000","last_became_active":"2024-09-19T08:42:41.932020+0000","last_became_peered":"2024-09-19T08:42:41.932020+0000","last_unstale":"2024-09-19T08:42:58.108182+0000","last_undegraded":"2024-09-19T08:42:58.108182+0000","last_fullsized":"2024-09-19T08:42:58.108182+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:08.583287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109186+0000","last_change":"2024-09-19T08:42:44.026173+0000","last_active":"2024-09-19T08:42:58.109186+0000","last_peered":"2024-09-19T08:42:58.109186+0000","last_clean":"2024-09-19T08:42:58.109186+0000","last_became_active":"2024-09-19T08:42:44.024614+0000","last_became_peered":"2024-09-19T08:42:44.024614+0000","last_unstale":"2024-09-19T08:42:58.109186+0000","last_undegraded":"2024-09-19T08:42:58.109186+0000","last_fullsized":"2024-09-19T08:42:58.109186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:42.695660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108660+0000","last_change":"2024-09-19T08:42:41.929576+0000","last_active":"2024-09-19T08:42:58.108660+0000","last_peered":"2024-09-19T08:42:58.108660+0000","last_clean":"2024-09-19T08:42:58.108660+0000","last_became_active":"2024-09-19T08:42:41.929231+0000","last_became_peered":"2024-09-19T08:42:41.929231+0000","last_unstale":"2024-09-19T08:42:58.108660+0000","last_undegraded":"2024-09-19T08:42:58.108660+0000","last_fullsized":"2024-09-19T08:42:58.108660+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:54.492198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103061+0000","last_change":"2024-09-19T08:42:44.028612+0000","last_active":"2024-09-19T08:42:58.103061+0000","last_peered":"2024-09-19T08:42:58.103061+0000","last_clean":"2024-09-19T08:42:58.103061+0000","last_became_active":"2024-09-19T08:42:44.028301+0000","last_became_peered":"2024-09-19T08:42:44.028301+0000","last_unstale":"2024-09-19T08:42:58.103061+0000","last_undegraded":"2024-09-19T08:42:58.103061+0000","last_fullsized":"2024-09-19T08:42:58.103061+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:03:09.539350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106004+0000","last_change":"2024-09-19T08:42:42.407931+0000","last_active":"2024-09-19T08:42:58.106004+0000","last_peered":"2024-09-19T08:42:58.106004+0000","last_clean":"2024-09-19T08:42:58.106004+0000","last_became_active":"2024-09-19T08:42:42.407573+0000","last_became_peered":"2024-09-19T08:42:42.407573+0000","last_unstale":"2024-09-19T08:42:58.106004+0000","last_undegraded":"2024-09-19T08:42:58.106004+0000","last_fullsized":"2024-09-19T08:42:58.106004+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:55.095275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105172+0000","last_change":"2024-09-19T08:42:44.034109+0000","last_active":"2024-09-19T08:42:58.105172+0000","last_peered":"2024-09-19T08:42:58.105172+0000","last_clean":"2024-09-19T08:42:58.105172+0000","last_became_active":"2024-09-19T08:42:44.033753+0000","last_became_peered":"2024-09-19T08:42:44.033753+0000","last_unstale":"2024-09-19T08:42:58.105172+0000","last_undegraded":"2024-09-19T08:42:58.105172+0000","last_fullsized":"2024-09-19T08:42:58.105172+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:08.475476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":48,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.120292+0000","last_change":"2024-09-19T08:42:58.120292+0000","last_active":"2024-09-19T08:42:58.120292+0000","last_peered":"2024-09-19T08:42:58.120292+0000","last_clean":"2024-09-19T08:42:58.120292+0000","last_became_active":"2024-09-19T08:42:58.109929+0000","last_became_peered":"2024-09-19T08:42:58.109929+0000","last_unstale":"2024-09-19T08:42:58.120292+0000","last_undegraded":"2024-09-19T08:42:58.120292+0000","last_fullsized":"2024-09-19T08:42:58.120292+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:56.196868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":51198,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":100,"num_read_kb":103,"num_write":151,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1198,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":153594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579921,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":433265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32724,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712428,"statfs":{"total":95995035648,"available":95961526272,"internally_reserved":0,"allocated":1576960,"data_stored":1071325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939675,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":432885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168607,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":432805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397540,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1024548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561066,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":432274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789997,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1024421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953524,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":433686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215161,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40396,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704756,"statfs":{"total":95995035648,"available":95953670144,"internally_reserved":0,"allocated":913408,"data_stored":432585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444093,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":479996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":478869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":917504,"data_stored":433545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":47929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":48773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:43:09.958 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:43:10.217 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:10.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:10 smithi007 ceph-mon[31221]: pgmap v288: 97 pgs: 97 active+clean; 627 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.2 KiB/s wr, 8 op/s; 111 B/s, 0 keys/s, 1 objects/s recovering 2024-09-19T08:43:10.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:10 smithi007 ceph-mon[31221]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:43:10.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:10 smithi175 ceph-mon[35688]: pgmap v288: 97 pgs: 97 active+clean; 627 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.2 KiB/s wr, 8 op/s; 111 B/s, 0 keys/s, 1 objects/s recovering 2024-09-19T08:43:10.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:10 smithi175 ceph-mon[35688]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:43:10.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:10 smithi044 ceph-mon[35072]: pgmap v288: 97 pgs: 97 active+clean; 627 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.2 KiB/s wr, 8 op/s; 111 B/s, 0 keys/s, 1 objects/s recovering 2024-09-19T08:43:10.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:10 smithi044 ceph-mon[35072]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:43:10.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.662+0000 7fdfa9412640 1 -- 172.21.15.7:0/2031060948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfa4102ef0 msgr2=0x7fdfa410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:10.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.662+0000 7fdfa9412640 1 --2- 172.21.15.7:0/2031060948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfa4102ef0 0x7fdfa410da40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c009900 tx=0x7fdf9c02a480 comp rx=0 tx=0).stop 2024-09-19T08:43:10.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.662+0000 7fdfa9412640 1 -- 172.21.15.7:0/2031060948 shutdown_connections 2024-09-19T08:43:10.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.662+0000 7fdfa9412640 1 --2- 172.21.15.7:0/2031060948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfa4102ef0 0x7fdfa410da40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:10.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.662+0000 7fdfa9412640 1 --2- 172.21.15.7:0/2031060948 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfa4102570 0x7fdfa41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:10.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.662+0000 7fdfa9412640 1 --2- 172.21.15.7:0/2031060948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa4100e20 0x7fdfa4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:10.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.662+0000 7fdfa9412640 1 -- 172.21.15.7:0/2031060948 >> 172.21.15.7:0/2031060948 conn(0x7fdfa40fc7d0 msgr2=0x7fdfa40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:10.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.663+0000 7fdfa9412640 1 -- 172.21.15.7:0/2031060948 shutdown_connections 2024-09-19T08:43:10.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.663+0000 7fdfa9412640 1 -- 172.21.15.7:0/2031060948 wait complete. 2024-09-19T08:43:10.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.664+0000 7fdfa9412640 1 Processor -- start 2024-09-19T08:43:10.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.664+0000 7fdfa9412640 1 -- start start 2024-09-19T08:43:10.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.664+0000 7fdfa9412640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfa4100e20 0x7fdfa410e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:10.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.664+0000 7fdfa9412640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfa4102570 0x7fdfa410ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:10.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.664+0000 7fdfa9412640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa4102ef0 0x7fdfa410ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:10.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.664+0000 7fdfa9412640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa41120a0 con 0x7fdfa4102570 2024-09-19T08:43:10.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.664+0000 7fdfa9412640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa4111f20 con 0x7fdfa4100e20 2024-09-19T08:43:10.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.664+0000 7fdfa9412640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa4112220 con 0x7fdfa4102ef0 2024-09-19T08:43:10.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.664+0000 7fdfa27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfa4102570 0x7fdfa410ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:10.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.664+0000 7fdfa27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfa4102570 0x7fdfa410ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35660/0 (socket says 172.21.15.7:35660) 2024-09-19T08:43:10.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.664+0000 7fdfa27fc640 1 -- 172.21.15.7:0/1073911440 learned_addr learned my addr 172.21.15.7:0/1073911440 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:10.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.664+0000 7fdfa2ffd640 1 --2- 172.21.15.7:0/1073911440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfa4100e20 0x7fdfa410e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:10.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.665+0000 7fdfa37fe640 1 --2- 172.21.15.7:0/1073911440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa4102ef0 0x7fdfa410ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:10.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.665+0000 7fdfa27fc640 1 -- 172.21.15.7:0/1073911440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa4102ef0 msgr2=0x7fdfa410ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:10.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.665+0000 7fdfa27fc640 1 --2- 172.21.15.7:0/1073911440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa4102ef0 0x7fdfa410ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:10.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.665+0000 7fdfa27fc640 1 -- 172.21.15.7:0/1073911440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfa4100e20 msgr2=0x7fdfa410e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:10.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.665+0000 7fdfa27fc640 1 --2- 172.21.15.7:0/1073911440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfa4100e20 0x7fdfa410e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:10.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.665+0000 7fdfa27fc640 1 -- 172.21.15.7:0/1073911440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa41a69a0 con 0x7fdfa4102570 2024-09-19T08:43:10.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.665+0000 7fdfa27fc640 1 --2- 172.21.15.7:0/1073911440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfa4102570 0x7fdfa410ea10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c00d950 tx=0x7fdf8c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:10.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.665+0000 7fdf9bfff640 1 -- 172.21.15.7:0/1073911440 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c017070 con 0x7fdfa4102570 2024-09-19T08:43:10.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.665+0000 7fdfa9412640 1 -- 172.21.15.7:0/1073911440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfa41a6c90 con 0x7fdfa4102570 2024-09-19T08:43:10.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.665+0000 7fdf9bfff640 1 -- 172.21.15.7:0/1073911440 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf8c009c30 con 0x7fdfa4102570 2024-09-19T08:43:10.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.665+0000 7fdf9bfff640 1 -- 172.21.15.7:0/1073911440 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c00f6b0 con 0x7fdfa4102570 2024-09-19T08:43:10.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.665+0000 7fdfa9412640 1 -- 172.21.15.7:0/1073911440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfa41a71c0 con 0x7fdfa4102570 2024-09-19T08:43:10.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.666+0000 7fdfa9412640 1 -- 172.21.15.7:0/1073911440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfa4101200 con 0x7fdfa4102570 2024-09-19T08:43:10.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.668+0000 7fdf9bfff640 1 -- 172.21.15.7:0/1073911440 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fdf8c0109d0 con 0x7fdfa4102570 2024-09-19T08:43:10.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.668+0000 7fdf9bfff640 1 --2- 172.21.15.7:0/1073911440 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fdf900a3350 0x7fdf900a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:10.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.668+0000 7fdfa2ffd640 1 --2- 172.21.15.7:0/1073911440 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fdf900a3350 0x7fdf900a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:10.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.668+0000 7fdf9bfff640 1 -- 172.21.15.7:0/1073911440 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdf8c0cf9a0 con 0x7fdfa4102570 2024-09-19T08:43:10.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.669+0000 7fdfa2ffd640 1 --2- 172.21.15.7:0/1073911440 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fdf900a3350 0x7fdf900a5810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdf9400a400 tx=0x7fdf9400d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:10.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.671+0000 7fdf9bfff640 1 -- 172.21.15.7:0/1073911440 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdf8c009de0 con 0x7fdfa4102570 2024-09-19T08:43:10.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.846+0000 7fdfa9412640 1 -- 172.21.15.7:0/1073911440 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdfa4106f50 con 0x7fdf900a3350 2024-09-19T08:43:10.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.852+0000 7fdf9bfff640 1 -- 172.21.15.7:0/1073911440 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258719 (secure 0 0 0) 0x7fdfa4106f50 con 0x7fdf900a3350 2024-09-19T08:43:10.855 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:43:10.856 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-19T08:43:10.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.855+0000 7fdfa9412640 1 -- 172.21.15.7:0/1073911440 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fdf900a3350 msgr2=0x7fdf900a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.855+0000 7fdfa9412640 1 --2- 172.21.15.7:0/1073911440 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fdf900a3350 0x7fdf900a5810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdf9400a400 tx=0x7fdf9400d040 comp rx=0 tx=0).stop 2024-09-19T08:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.855+0000 7fdfa9412640 1 -- 172.21.15.7:0/1073911440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfa4102570 msgr2=0x7fdfa410ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.855+0000 7fdfa9412640 1 --2- 172.21.15.7:0/1073911440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfa4102570 0x7fdfa410ea10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c00d950 tx=0x7fdf8c00de10 comp rx=0 tx=0).stop 2024-09-19T08:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.855+0000 7fdfa9412640 1 -- 172.21.15.7:0/1073911440 shutdown_connections 2024-09-19T08:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.855+0000 7fdfa9412640 1 --2- 172.21.15.7:0/1073911440 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fdf900a3350 0x7fdf900a5810 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.855+0000 7fdfa9412640 1 --2- 172.21.15.7:0/1073911440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfa4102ef0 0x7fdfa410ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.855+0000 7fdfa9412640 1 --2- 172.21.15.7:0/1073911440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfa4102570 0x7fdfa410ea10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.855+0000 7fdfa9412640 1 --2- 172.21.15.7:0/1073911440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfa4100e20 0x7fdfa410e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.855+0000 7fdfa9412640 1 -- 172.21.15.7:0/1073911440 >> 172.21.15.7:0/1073911440 conn(0x7fdfa40fc7d0 msgr2=0x7fdfa4106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.855+0000 7fdfa9412640 1 -- 172.21.15.7:0/1073911440 shutdown_connections 2024-09-19T08:43:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:10.855+0000 7fdfa9412640 1 -- 172.21.15.7:0/1073911440 wait complete. 2024-09-19T08:43:11.616 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-09-19T08:43:08.870139+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641800,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":236,"num_read_kb":222,"num_write":334,"num_write_kb":3033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1181934,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365976,"kb_used_data":12552,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575848,"statfs":{"total":1151940427776,"available":1151565668352,"internally_reserved":0,"allocated":12853248,"data_stored":7110204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45817,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":-2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":76,"num_write":27,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1198,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.770914"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101626+0000","last_change":"2024-09-19T08:42:44.035697+0000","last_active":"2024-09-19T08:42:58.101626+0000","last_peered":"2024-09-19T08:42:58.101626+0000","last_clean":"2024-09-19T08:42:58.101626+0000","last_became_active":"2024-09-19T08:42:44.035400+0000","last_became_peered":"2024-09-19T08:42:44.035400+0000","last_unstale":"2024-09-19T08:42:58.101626+0000","last_undegraded":"2024-09-19T08:42:58.101626+0000","last_fullsized":"2024-09-19T08:42:58.101626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:56.202947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102854+0000","last_change":"2024-09-19T08:42:44.031393+0000","last_active":"2024-09-19T08:42:58.102854+0000","last_peered":"2024-09-19T08:42:58.102854+0000","last_clean":"2024-09-19T08:42:58.102854+0000","last_became_active":"2024-09-19T08:42:44.031056+0000","last_became_peered":"2024-09-19T08:42:44.031056+0000","last_unstale":"2024-09-19T08:42:58.102854+0000","last_undegraded":"2024-09-19T08:42:58.102854+0000","last_fullsized":"2024-09-19T08:42:58.102854+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:44.694913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102589+0000","last_change":"2024-09-19T08:42:44.029586+0000","last_active":"2024-09-19T08:42:58.102589+0000","last_peered":"2024-09-19T08:42:58.102589+0000","last_clean":"2024-09-19T08:42:58.102589+0000","last_became_active":"2024-09-19T08:42:44.029279+0000","last_became_peered":"2024-09-19T08:42:44.029279+0000","last_unstale":"2024-09-19T08:42:58.102589+0000","last_undegraded":"2024-09-19T08:42:58.102589+0000","last_fullsized":"2024-09-19T08:42:58.102589+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:12.036113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102656+0000","last_change":"2024-09-19T08:42:44.043192+0000","last_active":"2024-09-19T08:42:58.102656+0000","last_peered":"2024-09-19T08:42:58.102656+0000","last_clean":"2024-09-19T08:42:58.102656+0000","last_became_active":"2024-09-19T08:42:44.042838+0000","last_became_peered":"2024-09-19T08:42:44.042838+0000","last_unstale":"2024-09-19T08:42:58.102656+0000","last_undegraded":"2024-09-19T08:42:58.102656+0000","last_fullsized":"2024-09-19T08:42:58.102656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:20.549232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.107892+0000","last_change":"2024-09-19T08:42:44.032231+0000","last_active":"2024-09-19T08:42:58.107892+0000","last_peered":"2024-09-19T08:42:58.107892+0000","last_clean":"2024-09-19T08:42:58.107892+0000","last_became_active":"2024-09-19T08:42:44.031835+0000","last_became_peered":"2024-09-19T08:42:44.031835+0000","last_unstale":"2024-09-19T08:42:58.107892+0000","last_undegraded":"2024-09-19T08:42:58.107892+0000","last_fullsized":"2024-09-19T08:42:58.107892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:49.084085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103663+0000","last_change":"2024-09-19T08:42:44.035487+0000","last_active":"2024-09-19T08:42:58.103663+0000","last_peered":"2024-09-19T08:42:58.103663+0000","last_clean":"2024-09-19T08:42:58.103663+0000","last_became_active":"2024-09-19T08:42:44.035138+0000","last_became_peered":"2024-09-19T08:42:44.035138+0000","last_unstale":"2024-09-19T08:42:58.103663+0000","last_undegraded":"2024-09-19T08:42:58.103663+0000","last_fullsized":"2024-09-19T08:42:58.103663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:43.483397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108910+0000","last_change":"2024-09-19T08:42:44.029052+0000","last_active":"2024-09-19T08:42:58.108910+0000","last_peered":"2024-09-19T08:42:58.108910+0000","last_clean":"2024-09-19T08:42:58.108910+0000","last_became_active":"2024-09-19T08:42:44.028722+0000","last_became_peered":"2024-09-19T08:42:44.028722+0000","last_unstale":"2024-09-19T08:42:58.108910+0000","last_undegraded":"2024-09-19T08:42:58.108910+0000","last_fullsized":"2024-09-19T08:42:58.108910+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:49.226044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104266+0000","last_change":"2024-09-19T08:42:44.031401+0000","last_active":"2024-09-19T08:42:58.104266+0000","last_peered":"2024-09-19T08:42:58.104266+0000","last_clean":"2024-09-19T08:42:58.104266+0000","last_became_active":"2024-09-19T08:42:44.031103+0000","last_became_peered":"2024-09-19T08:42:44.031103+0000","last_unstale":"2024-09-19T08:42:58.104266+0000","last_undegraded":"2024-09-19T08:42:58.104266+0000","last_fullsized":"2024-09-19T08:42:58.104266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:57.406765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110149+0000","last_change":"2024-09-19T08:42:44.033011+0000","last_active":"2024-09-19T08:42:58.110149+0000","last_peered":"2024-09-19T08:42:58.110149+0000","last_clean":"2024-09-19T08:42:58.110149+0000","last_became_active":"2024-09-19T08:42:44.032075+0000","last_became_peered":"2024-09-19T08:42:44.032075+0000","last_unstale":"2024-09-19T08:42:58.110149+0000","last_undegraded":"2024-09-19T08:42:58.110149+0000","last_fullsized":"2024-09-19T08:42:58.110149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:43.701684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103460+0000","last_change":"2024-09-19T08:42:44.037417+0000","last_active":"2024-09-19T08:42:58.103460+0000","last_peered":"2024-09-19T08:42:58.103460+0000","last_clean":"2024-09-19T08:42:58.103460+0000","last_became_active":"2024-09-19T08:42:44.037006+0000","last_became_peered":"2024-09-19T08:42:44.037006+0000","last_unstale":"2024-09-19T08:42:58.103460+0000","last_undegraded":"2024-09-19T08:42:58.103460+0000","last_fullsized":"2024-09-19T08:42:58.103460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:10.952939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110570+0000","last_change":"2024-09-19T08:42:44.034125+0000","last_active":"2024-09-19T08:42:58.110570+0000","last_peered":"2024-09-19T08:42:58.110570+0000","last_clean":"2024-09-19T08:42:58.110570+0000","last_became_active":"2024-09-19T08:42:44.033772+0000","last_became_peered":"2024-09-19T08:42:44.033772+0000","last_unstale":"2024-09-19T08:42:58.110570+0000","last_undegraded":"2024-09-19T08:42:58.110570+0000","last_fullsized":"2024-09-19T08:42:58.110570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:42.854137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102712+0000","last_change":"2024-09-19T08:42:44.043047+0000","last_active":"2024-09-19T08:42:58.102712+0000","last_peered":"2024-09-19T08:42:58.102712+0000","last_clean":"2024-09-19T08:42:58.102712+0000","last_became_active":"2024-09-19T08:42:44.042666+0000","last_became_peered":"2024-09-19T08:42:44.042666+0000","last_unstale":"2024-09-19T08:42:58.102712+0000","last_undegraded":"2024-09-19T08:42:58.102712+0000","last_fullsized":"2024-09-19T08:42:58.102712+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:16.504824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100549+0000","last_change":"2024-09-19T08:42:44.026475+0000","last_active":"2024-09-19T08:42:58.100549+0000","last_peered":"2024-09-19T08:42:58.100549+0000","last_clean":"2024-09-19T08:42:58.100549+0000","last_became_active":"2024-09-19T08:42:44.026169+0000","last_became_peered":"2024-09-19T08:42:44.026169+0000","last_unstale":"2024-09-19T08:42:58.100549+0000","last_undegraded":"2024-09-19T08:42:58.100549+0000","last_fullsized":"2024-09-19T08:42:58.100549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:17.130267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102287+0000","last_change":"2024-09-19T08:42:44.033725+0000","last_active":"2024-09-19T08:42:58.102287+0000","last_peered":"2024-09-19T08:42:58.102287+0000","last_clean":"2024-09-19T08:42:58.102287+0000","last_became_active":"2024-09-19T08:42:44.033304+0000","last_became_peered":"2024-09-19T08:42:44.033304+0000","last_unstale":"2024-09-19T08:42:58.102287+0000","last_undegraded":"2024-09-19T08:42:58.102287+0000","last_fullsized":"2024-09-19T08:42:58.102287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:47.520808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102018+0000","last_change":"2024-09-19T08:42:44.041762+0000","last_active":"2024-09-19T08:42:58.102018+0000","last_peered":"2024-09-19T08:42:58.102018+0000","last_clean":"2024-09-19T08:42:58.102018+0000","last_became_active":"2024-09-19T08:42:44.041433+0000","last_became_peered":"2024-09-19T08:42:44.041433+0000","last_unstale":"2024-09-19T08:42:58.102018+0000","last_undegraded":"2024-09-19T08:42:58.102018+0000","last_fullsized":"2024-09-19T08:42:58.102018+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:05.504873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108993+0000","last_change":"2024-09-19T08:42:44.030316+0000","last_active":"2024-09-19T08:42:58.108993+0000","last_peered":"2024-09-19T08:42:58.108993+0000","last_clean":"2024-09-19T08:42:58.108993+0000","last_became_active":"2024-09-19T08:42:44.029872+0000","last_became_peered":"2024-09-19T08:42:44.029872+0000","last_unstale":"2024-09-19T08:42:58.108993+0000","last_undegraded":"2024-09-19T08:42:58.108993+0000","last_fullsized":"2024-09-19T08:42:58.108993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:18.011019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101626+0000","last_change":"2024-09-19T08:42:44.035523+0000","last_active":"2024-09-19T08:42:58.101626+0000","last_peered":"2024-09-19T08:42:58.101626+0000","last_clean":"2024-09-19T08:42:58.101626+0000","last_became_active":"2024-09-19T08:42:44.035185+0000","last_became_peered":"2024-09-19T08:42:44.035185+0000","last_unstale":"2024-09-19T08:42:58.101626+0000","last_undegraded":"2024-09-19T08:42:58.101626+0000","last_fullsized":"2024-09-19T08:42:58.101626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:03.475458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105867+0000","last_change":"2024-09-19T08:42:44.031803+0000","last_active":"2024-09-19T08:42:58.105867+0000","last_peered":"2024-09-19T08:42:58.105867+0000","last_clean":"2024-09-19T08:42:58.105867+0000","last_became_active":"2024-09-19T08:42:44.031501+0000","last_became_peered":"2024-09-19T08:42:44.031501+0000","last_unstale":"2024-09-19T08:42:58.105867+0000","last_undegraded":"2024-09-19T08:42:58.105867+0000","last_fullsized":"2024-09-19T08:42:58.105867+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:31.780744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104128+0000","last_change":"2024-09-19T08:42:44.036168+0000","last_active":"2024-09-19T08:42:58.104128+0000","last_peered":"2024-09-19T08:42:58.104128+0000","last_clean":"2024-09-19T08:42:58.104128+0000","last_became_active":"2024-09-19T08:42:44.035819+0000","last_became_peered":"2024-09-19T08:42:44.035819+0000","last_unstale":"2024-09-19T08:42:58.104128+0000","last_undegraded":"2024-09-19T08:42:58.104128+0000","last_fullsized":"2024-09-19T08:42:58.104128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:26.478389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101182+0000","last_change":"2024-09-19T08:42:44.037569+0000","last_active":"2024-09-19T08:42:58.101182+0000","last_peered":"2024-09-19T08:42:58.101182+0000","last_clean":"2024-09-19T08:42:58.101182+0000","last_became_active":"2024-09-19T08:42:44.037161+0000","last_became_peered":"2024-09-19T08:42:44.037161+0000","last_unstale":"2024-09-19T08:42:58.101182+0000","last_undegraded":"2024-09-19T08:42:58.101182+0000","last_fullsized":"2024-09-19T08:42:58.101182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:35.316314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100549+0000","last_change":"2024-09-19T08:42:44.023160+0000","last_active":"2024-09-19T08:42:58.100549+0000","last_peered":"2024-09-19T08:42:58.100549+0000","last_clean":"2024-09-19T08:42:58.100549+0000","last_became_active":"2024-09-19T08:42:44.022791+0000","last_became_peered":"2024-09-19T08:42:44.022791+0000","last_unstale":"2024-09-19T08:42:58.100549+0000","last_undegraded":"2024-09-19T08:42:58.100549+0000","last_fullsized":"2024-09-19T08:42:58.100549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:00.174583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109685+0000","last_change":"2024-09-19T08:42:44.035877+0000","last_active":"2024-09-19T08:42:58.109685+0000","last_peered":"2024-09-19T08:42:58.109685+0000","last_clean":"2024-09-19T08:42:58.109685+0000","last_became_active":"2024-09-19T08:42:44.035307+0000","last_became_peered":"2024-09-19T08:42:44.035307+0000","last_unstale":"2024-09-19T08:42:58.109685+0000","last_undegraded":"2024-09-19T08:42:58.109685+0000","last_fullsized":"2024-09-19T08:42:58.109685+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:54.717130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104090+0000","last_change":"2024-09-19T08:42:44.033536+0000","last_active":"2024-09-19T08:42:58.104090+0000","last_peered":"2024-09-19T08:42:58.104090+0000","last_clean":"2024-09-19T08:42:58.104090+0000","last_became_active":"2024-09-19T08:42:44.033179+0000","last_became_peered":"2024-09-19T08:42:44.033179+0000","last_unstale":"2024-09-19T08:42:58.104090+0000","last_undegraded":"2024-09-19T08:42:58.104090+0000","last_fullsized":"2024-09-19T08:42:58.104090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:11.161785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104608+0000","last_change":"2024-09-19T08:42:44.029674+0000","last_active":"2024-09-19T08:42:58.104608+0000","last_peered":"2024-09-19T08:42:58.104608+0000","last_clean":"2024-09-19T08:42:58.104608+0000","last_became_active":"2024-09-19T08:42:44.029368+0000","last_became_peered":"2024-09-19T08:42:44.029368+0000","last_unstale":"2024-09-19T08:42:58.104608+0000","last_undegraded":"2024-09-19T08:42:58.104608+0000","last_fullsized":"2024-09-19T08:42:58.104608+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:34.943363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105011+0000","last_change":"2024-09-19T08:42:44.039780+0000","last_active":"2024-09-19T08:42:58.105011+0000","last_peered":"2024-09-19T08:42:58.105011+0000","last_clean":"2024-09-19T08:42:58.105011+0000","last_became_active":"2024-09-19T08:42:44.039409+0000","last_became_peered":"2024-09-19T08:42:44.039409+0000","last_unstale":"2024-09-19T08:42:58.105011+0000","last_undegraded":"2024-09-19T08:42:58.105011+0000","last_fullsized":"2024-09-19T08:42:58.105011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:59.632132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103863+0000","last_change":"2024-09-19T08:42:44.030881+0000","last_active":"2024-09-19T08:42:58.103863+0000","last_peered":"2024-09-19T08:42:58.103863+0000","last_clean":"2024-09-19T08:42:58.103863+0000","last_became_active":"2024-09-19T08:42:44.030530+0000","last_became_peered":"2024-09-19T08:42:44.030530+0000","last_unstale":"2024-09-19T08:42:58.103863+0000","last_undegraded":"2024-09-19T08:42:58.103863+0000","last_fullsized":"2024-09-19T08:42:58.103863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:16.908450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101414+0000","last_change":"2024-09-19T08:42:44.033056+0000","last_active":"2024-09-19T08:42:58.101414+0000","last_peered":"2024-09-19T08:42:58.101414+0000","last_clean":"2024-09-19T08:42:58.101414+0000","last_became_active":"2024-09-19T08:42:44.032690+0000","last_became_peered":"2024-09-19T08:42:44.032690+0000","last_unstale":"2024-09-19T08:42:58.101414+0000","last_undegraded":"2024-09-19T08:42:58.101414+0000","last_fullsized":"2024-09-19T08:42:58.101414+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:36.497824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106551+0000","last_change":"2024-09-19T08:42:58.106551+0000","last_active":"2024-09-19T08:42:58.106551+0000","last_peered":"2024-09-19T08:42:58.106551+0000","last_clean":"2024-09-19T08:42:58.106551+0000","last_became_active":"2024-09-19T08:42:58.106119+0000","last_became_peered":"2024-09-19T08:42:58.106119+0000","last_unstale":"2024-09-19T08:42:58.106551+0000","last_undegraded":"2024-09-19T08:42:58.106551+0000","last_fullsized":"2024-09-19T08:42:58.106551+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:46.794260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108106+0000","last_change":"2024-09-19T08:42:58.108106+0000","last_active":"2024-09-19T08:42:58.108106+0000","last_peered":"2024-09-19T08:42:58.108106+0000","last_clean":"2024-09-19T08:42:58.108106+0000","last_became_active":"2024-09-19T08:42:58.107532+0000","last_became_peered":"2024-09-19T08:42:58.107532+0000","last_unstale":"2024-09-19T08:42:58.108106+0000","last_undegraded":"2024-09-19T08:42:58.108106+0000","last_fullsized":"2024-09-19T08:42:58.108106+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:29.164983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103606+0000","last_change":"2024-09-19T08:42:44.029822+0000","last_active":"2024-09-19T08:42:58.103606+0000","last_peered":"2024-09-19T08:42:58.103606+0000","last_clean":"2024-09-19T08:42:58.103606+0000","last_became_active":"2024-09-19T08:42:44.029450+0000","last_became_peered":"2024-09-19T08:42:44.029450+0000","last_unstale":"2024-09-19T08:42:58.103606+0000","last_undegraded":"2024-09-19T08:42:58.103606+0000","last_fullsized":"2024-09-19T08:42:58.103606+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:40.826261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105132+0000","last_change":"2024-09-19T08:42:44.041354+0000","last_active":"2024-09-19T08:42:58.105132+0000","last_peered":"2024-09-19T08:42:58.105132+0000","last_clean":"2024-09-19T08:42:58.105132+0000","last_became_active":"2024-09-19T08:42:44.040912+0000","last_became_peered":"2024-09-19T08:42:44.040912+0000","last_unstale":"2024-09-19T08:42:58.105132+0000","last_undegraded":"2024-09-19T08:42:58.105132+0000","last_fullsized":"2024-09-19T08:42:58.105132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:16.543950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101119+0000","last_change":"2024-09-19T08:42:44.027912+0000","last_active":"2024-09-19T08:42:58.101119+0000","last_peered":"2024-09-19T08:42:58.101119+0000","last_clean":"2024-09-19T08:42:58.101119+0000","last_became_active":"2024-09-19T08:42:44.027505+0000","last_became_peered":"2024-09-19T08:42:44.027505+0000","last_unstale":"2024-09-19T08:42:58.101119+0000","last_undegraded":"2024-09-19T08:42:58.101119+0000","last_fullsized":"2024-09-19T08:42:58.101119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:02.552756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.107911+0000","last_change":"2024-09-19T08:42:44.034472+0000","last_active":"2024-09-19T08:42:58.107911+0000","last_peered":"2024-09-19T08:42:58.107911+0000","last_clean":"2024-09-19T08:42:58.107911+0000","last_became_active":"2024-09-19T08:42:44.034026+0000","last_became_peered":"2024-09-19T08:42:44.034026+0000","last_unstale":"2024-09-19T08:42:58.107911+0000","last_undegraded":"2024-09-19T08:42:58.107911+0000","last_fullsized":"2024-09-19T08:42:58.107911+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:10.058882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'6","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:05.110008+0000","last_change":"2024-09-19T08:42:41.927174+0000","last_active":"2024-09-19T08:43:05.110008+0000","last_peered":"2024-09-19T08:43:05.110008+0000","last_clean":"2024-09-19T08:43:05.110008+0000","last_became_active":"2024-09-19T08:42:41.926826+0000","last_became_peered":"2024-09-19T08:42:41.926826+0000","last_unstale":"2024-09-19T08:43:05.110008+0000","last_undegraded":"2024-09-19T08:43:05.110008+0000","last_fullsized":"2024-09-19T08:43:05.110008+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:37.274891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110259+0000","last_change":"2024-09-19T08:42:58.110259+0000","last_active":"2024-09-19T08:42:58.110259+0000","last_peered":"2024-09-19T08:42:58.110259+0000","last_clean":"2024-09-19T08:42:58.110259+0000","last_became_active":"2024-09-19T08:42:58.109803+0000","last_became_peered":"2024-09-19T08:42:58.109803+0000","last_unstale":"2024-09-19T08:42:58.110259+0000","last_undegraded":"2024-09-19T08:42:58.110259+0000","last_fullsized":"2024-09-19T08:42:58.110259+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:31.853404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.114222+0000","last_change":"2024-09-19T08:42:58.114222+0000","last_active":"2024-09-19T08:42:58.114222+0000","last_peered":"2024-09-19T08:42:58.114222+0000","last_clean":"2024-09-19T08:42:58.114222+0000","last_became_active":"2024-09-19T08:42:58.110769+0000","last_became_peered":"2024-09-19T08:42:58.110769+0000","last_unstale":"2024-09-19T08:42:58.114222+0000","last_undegraded":"2024-09-19T08:42:58.114222+0000","last_fullsized":"2024-09-19T08:42:58.114222+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:17.952228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100222+0000","last_change":"2024-09-19T08:42:41.923903+0000","last_active":"2024-09-19T08:42:58.100222+0000","last_peered":"2024-09-19T08:42:58.100222+0000","last_clean":"2024-09-19T08:42:58.100222+0000","last_became_active":"2024-09-19T08:42:41.923583+0000","last_became_peered":"2024-09-19T08:42:41.923583+0000","last_unstale":"2024-09-19T08:42:58.100222+0000","last_undegraded":"2024-09-19T08:42:58.100222+0000","last_fullsized":"2024-09-19T08:42:58.100222+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:48.594343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104302+0000","last_change":"2024-09-19T08:42:44.028972+0000","last_active":"2024-09-19T08:42:58.104302+0000","last_peered":"2024-09-19T08:42:58.104302+0000","last_clean":"2024-09-19T08:42:58.104302+0000","last_became_active":"2024-09-19T08:42:44.028657+0000","last_became_peered":"2024-09-19T08:42:44.028657+0000","last_unstale":"2024-09-19T08:42:58.104302+0000","last_undegraded":"2024-09-19T08:42:58.104302+0000","last_fullsized":"2024-09-19T08:42:58.104302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:43.618010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106455+0000","last_change":"2024-09-19T08:42:41.926558+0000","last_active":"2024-09-19T08:42:58.106455+0000","last_peered":"2024-09-19T08:42:58.106455+0000","last_clean":"2024-09-19T08:42:58.106455+0000","last_became_active":"2024-09-19T08:42:41.926074+0000","last_became_peered":"2024-09-19T08:42:41.926074+0000","last_unstale":"2024-09-19T08:42:58.106455+0000","last_undegraded":"2024-09-19T08:42:58.106455+0000","last_fullsized":"2024-09-19T08:42:58.106455+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:47.563295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105300+0000","last_change":"2024-09-19T08:42:44.029191+0000","last_active":"2024-09-19T08:42:58.105300+0000","last_peered":"2024-09-19T08:42:58.105300+0000","last_clean":"2024-09-19T08:42:58.105300+0000","last_became_active":"2024-09-19T08:42:44.028871+0000","last_became_peered":"2024-09-19T08:42:44.028871+0000","last_unstale":"2024-09-19T08:42:58.105300+0000","last_undegraded":"2024-09-19T08:42:58.105300+0000","last_fullsized":"2024-09-19T08:42:58.105300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:41.262014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:04.108155+0000","last_change":"2024-09-19T08:42:41.930265+0000","last_active":"2024-09-19T08:43:04.108155+0000","last_peered":"2024-09-19T08:43:04.108155+0000","last_clean":"2024-09-19T08:43:04.108155+0000","last_became_active":"2024-09-19T08:42:41.929829+0000","last_became_peered":"2024-09-19T08:42:41.929829+0000","last_unstale":"2024-09-19T08:43:04.108155+0000","last_undegraded":"2024-09-19T08:43:04.108155+0000","last_fullsized":"2024-09-19T08:43:04.108155+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:59.181622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109302+0000","last_change":"2024-09-19T08:42:44.027382+0000","last_active":"2024-09-19T08:42:58.109302+0000","last_peered":"2024-09-19T08:42:58.109302+0000","last_clean":"2024-09-19T08:42:58.109302+0000","last_became_active":"2024-09-19T08:42:44.026824+0000","last_became_peered":"2024-09-19T08:42:44.026824+0000","last_unstale":"2024-09-19T08:42:58.109302+0000","last_undegraded":"2024-09-19T08:42:58.109302+0000","last_fullsized":"2024-09-19T08:42:58.109302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:58.520068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110495+0000","last_change":"2024-09-19T08:42:41.927914+0000","last_active":"2024-09-19T08:42:58.110495+0000","last_peered":"2024-09-19T08:42:58.110495+0000","last_clean":"2024-09-19T08:42:58.110495+0000","last_became_active":"2024-09-19T08:42:41.926566+0000","last_became_peered":"2024-09-19T08:42:41.926566+0000","last_unstale":"2024-09-19T08:42:58.110495+0000","last_undegraded":"2024-09-19T08:42:58.110495+0000","last_fullsized":"2024-09-19T08:42:58.110495+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:52.238352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103155+0000","last_change":"2024-09-19T08:42:44.039899+0000","last_active":"2024-09-19T08:42:58.103155+0000","last_peered":"2024-09-19T08:42:58.103155+0000","last_clean":"2024-09-19T08:42:58.103155+0000","last_became_active":"2024-09-19T08:42:44.039530+0000","last_became_peered":"2024-09-19T08:42:44.039530+0000","last_unstale":"2024-09-19T08:42:58.103155+0000","last_undegraded":"2024-09-19T08:42:58.103155+0000","last_fullsized":"2024-09-19T08:42:58.103155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:20.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105251+0000","last_change":"2024-09-19T08:42:42.410128+0000","last_active":"2024-09-19T08:42:58.105251+0000","last_peered":"2024-09-19T08:42:58.105251+0000","last_clean":"2024-09-19T08:42:58.105251+0000","last_became_active":"2024-09-19T08:42:42.409717+0000","last_became_peered":"2024-09-19T08:42:42.409717+0000","last_unstale":"2024-09-19T08:42:58.105251+0000","last_undegraded":"2024-09-19T08:42:58.105251+0000","last_fullsized":"2024-09-19T08:42:58.105251+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:41.682355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109529+0000","last_change":"2024-09-19T08:42:44.043248+0000","last_active":"2024-09-19T08:42:58.109529+0000","last_peered":"2024-09-19T08:42:58.109529+0000","last_clean":"2024-09-19T08:42:58.109529+0000","last_became_active":"2024-09-19T08:42:44.042849+0000","last_became_peered":"2024-09-19T08:42:44.042849+0000","last_unstale":"2024-09-19T08:42:58.109529+0000","last_undegraded":"2024-09-19T08:42:58.109529+0000","last_fullsized":"2024-09-19T08:42:58.109529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:00.413217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'22","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:05.112109+0000","last_change":"2024-09-19T08:42:41.926582+0000","last_active":"2024-09-19T08:43:05.112109+0000","last_peered":"2024-09-19T08:43:05.112109+0000","last_clean":"2024-09-19T08:43:05.112109+0000","last_became_active":"2024-09-19T08:42:41.926234+0000","last_became_peered":"2024-09-19T08:42:41.926234+0000","last_unstale":"2024-09-19T08:43:05.112109+0000","last_undegraded":"2024-09-19T08:43:05.112109+0000","last_fullsized":"2024-09-19T08:43:05.112109+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:02.498976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":60,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108555+0000","last_change":"2024-09-19T08:42:44.034888+0000","last_active":"2024-09-19T08:42:58.108555+0000","last_peered":"2024-09-19T08:42:58.108555+0000","last_clean":"2024-09-19T08:42:58.108555+0000","last_became_active":"2024-09-19T08:42:44.034553+0000","last_became_peered":"2024-09-19T08:42:44.034553+0000","last_unstale":"2024-09-19T08:42:58.108555+0000","last_undegraded":"2024-09-19T08:42:58.108555+0000","last_fullsized":"2024-09-19T08:42:58.108555+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:06.416289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.118358+0000","last_change":"2024-09-19T08:42:58.117912+0000","last_active":"2024-09-19T08:42:58.118358+0000","last_peered":"2024-09-19T08:42:58.118358+0000","last_clean":"2024-09-19T08:42:58.118358+0000","last_became_active":"2024-09-19T08:42:58.105810+0000","last_became_peered":"2024-09-19T08:42:58.105810+0000","last_unstale":"2024-09-19T08:42:58.118358+0000","last_undegraded":"2024-09-19T08:42:58.118358+0000","last_fullsized":"2024-09-19T08:42:58.118358+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:44.258256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100246+0000","last_change":"2024-09-19T08:42:44.030519+0000","last_active":"2024-09-19T08:42:58.100246+0000","last_peered":"2024-09-19T08:42:58.100246+0000","last_clean":"2024-09-19T08:42:58.100246+0000","last_became_active":"2024-09-19T08:42:44.030190+0000","last_became_peered":"2024-09-19T08:42:44.030190+0000","last_unstale":"2024-09-19T08:42:58.100246+0000","last_undegraded":"2024-09-19T08:42:58.100246+0000","last_fullsized":"2024-09-19T08:42:58.100246+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:20.220642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106393+0000","last_change":"2024-09-19T08:42:41.928124+0000","last_active":"2024-09-19T08:42:58.106393+0000","last_peered":"2024-09-19T08:42:58.106393+0000","last_clean":"2024-09-19T08:42:58.106393+0000","last_became_active":"2024-09-19T08:42:41.927761+0000","last_became_peered":"2024-09-19T08:42:41.927761+0000","last_unstale":"2024-09-19T08:42:58.106393+0000","last_undegraded":"2024-09-19T08:42:58.106393+0000","last_fullsized":"2024-09-19T08:42:58.106393+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:08.591270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108569+0000","last_change":"2024-09-19T08:42:44.038234+0000","last_active":"2024-09-19T08:42:58.108569+0000","last_peered":"2024-09-19T08:42:58.108569+0000","last_clean":"2024-09-19T08:42:58.108569+0000","last_became_active":"2024-09-19T08:42:44.037726+0000","last_became_peered":"2024-09-19T08:42:44.037726+0000","last_unstale":"2024-09-19T08:42:58.108569+0000","last_undegraded":"2024-09-19T08:42:58.108569+0000","last_fullsized":"2024-09-19T08:42:58.108569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:08.865482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:06.110668+0000","last_change":"2024-09-19T08:42:41.926206+0000","last_active":"2024-09-19T08:43:06.110668+0000","last_peered":"2024-09-19T08:43:06.110668+0000","last_clean":"2024-09-19T08:43:06.110668+0000","last_became_active":"2024-09-19T08:42:41.925833+0000","last_became_peered":"2024-09-19T08:42:41.925833+0000","last_unstale":"2024-09-19T08:43:06.110668+0000","last_undegraded":"2024-09-19T08:43:06.110668+0000","last_fullsized":"2024-09-19T08:43:06.110668+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:27.944240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108472+0000","last_change":"2024-09-19T08:42:44.037181+0000","last_active":"2024-09-19T08:42:58.108472+0000","last_peered":"2024-09-19T08:42:58.108472+0000","last_clean":"2024-09-19T08:42:58.108472+0000","last_became_active":"2024-09-19T08:42:44.036865+0000","last_became_peered":"2024-09-19T08:42:44.036865+0000","last_unstale":"2024-09-19T08:42:58.108472+0000","last_undegraded":"2024-09-19T08:42:58.108472+0000","last_fullsized":"2024-09-19T08:42:58.108472+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:20.233309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.107685+0000","last_change":"2024-09-19T08:42:42.408446+0000","last_active":"2024-09-19T08:42:58.107685+0000","last_peered":"2024-09-19T08:42:58.107685+0000","last_clean":"2024-09-19T08:42:58.107685+0000","last_became_active":"2024-09-19T08:42:42.408098+0000","last_became_peered":"2024-09-19T08:42:42.408098+0000","last_unstale":"2024-09-19T08:42:58.107685+0000","last_undegraded":"2024-09-19T08:42:58.107685+0000","last_fullsized":"2024-09-19T08:42:58.107685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:22.603604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106374+0000","last_change":"2024-09-19T08:42:44.039954+0000","last_active":"2024-09-19T08:42:58.106374+0000","last_peered":"2024-09-19T08:42:58.106374+0000","last_clean":"2024-09-19T08:42:58.106374+0000","last_became_active":"2024-09-19T08:42:44.039601+0000","last_became_peered":"2024-09-19T08:42:44.039601+0000","last_unstale":"2024-09-19T08:42:58.106374+0000","last_undegraded":"2024-09-19T08:42:58.106374+0000","last_fullsized":"2024-09-19T08:42:58.106374+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:07.792167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108716+0000","last_change":"2024-09-19T08:42:41.929644+0000","last_active":"2024-09-19T08:42:58.108716+0000","last_peered":"2024-09-19T08:42:58.108716+0000","last_clean":"2024-09-19T08:42:58.108716+0000","last_became_active":"2024-09-19T08:42:41.929308+0000","last_became_peered":"2024-09-19T08:42:41.929308+0000","last_unstale":"2024-09-19T08:42:58.108716+0000","last_undegraded":"2024-09-19T08:42:58.108716+0000","last_fullsized":"2024-09-19T08:42:58.108716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:36.660470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.107555+0000","last_change":"2024-09-19T08:42:58.107555+0000","last_active":"2024-09-19T08:42:58.107555+0000","last_peered":"2024-09-19T08:42:58.107555+0000","last_clean":"2024-09-19T08:42:58.107555+0000","last_became_active":"2024-09-19T08:42:58.107137+0000","last_became_peered":"2024-09-19T08:42:58.107137+0000","last_unstale":"2024-09-19T08:42:58.107555+0000","last_undegraded":"2024-09-19T08:42:58.107555+0000","last_fullsized":"2024-09-19T08:42:58.107555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:13.198911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100493+0000","last_change":"2024-09-19T08:42:41.925195+0000","last_active":"2024-09-19T08:42:58.100493+0000","last_peered":"2024-09-19T08:42:58.100493+0000","last_clean":"2024-09-19T08:42:58.100493+0000","last_became_active":"2024-09-19T08:42:41.924880+0000","last_became_peered":"2024-09-19T08:42:41.924880+0000","last_unstale":"2024-09-19T08:42:58.100493+0000","last_undegraded":"2024-09-19T08:42:58.100493+0000","last_fullsized":"2024-09-19T08:42:58.100493+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:11.256881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110838+0000","last_change":"2024-09-19T08:42:44.036439+0000","last_active":"2024-09-19T08:42:58.110838+0000","last_peered":"2024-09-19T08:42:58.110838+0000","last_clean":"2024-09-19T08:42:58.110838+0000","last_became_active":"2024-09-19T08:42:44.036036+0000","last_became_peered":"2024-09-19T08:42:44.036036+0000","last_unstale":"2024-09-19T08:42:58.110838+0000","last_undegraded":"2024-09-19T08:42:58.110838+0000","last_fullsized":"2024-09-19T08:42:58.110838+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:37.410782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106933+0000","last_change":"2024-09-19T08:42:41.927490+0000","last_active":"2024-09-19T08:42:58.106933+0000","last_peered":"2024-09-19T08:42:58.106933+0000","last_clean":"2024-09-19T08:42:58.106933+0000","last_became_active":"2024-09-19T08:42:41.927163+0000","last_became_peered":"2024-09-19T08:42:41.927163+0000","last_unstale":"2024-09-19T08:42:58.106933+0000","last_undegraded":"2024-09-19T08:42:58.106933+0000","last_fullsized":"2024-09-19T08:42:58.106933+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:20.013661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110644+0000","last_change":"2024-09-19T08:42:44.036960+0000","last_active":"2024-09-19T08:42:58.110644+0000","last_peered":"2024-09-19T08:42:58.110644+0000","last_clean":"2024-09-19T08:42:58.110644+0000","last_became_active":"2024-09-19T08:42:44.036600+0000","last_became_peered":"2024-09-19T08:42:44.036600+0000","last_unstale":"2024-09-19T08:42:58.110644+0000","last_undegraded":"2024-09-19T08:42:58.110644+0000","last_fullsized":"2024-09-19T08:42:58.110644+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:15.621888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.114698+0000","last_change":"2024-09-19T08:42:58.114698+0000","last_active":"2024-09-19T08:42:58.114698+0000","last_peered":"2024-09-19T08:42:58.114698+0000","last_clean":"2024-09-19T08:42:58.114698+0000","last_became_active":"2024-09-19T08:42:58.105488+0000","last_became_peered":"2024-09-19T08:42:58.105488+0000","last_unstale":"2024-09-19T08:42:58.114698+0000","last_undegraded":"2024-09-19T08:42:58.114698+0000","last_fullsized":"2024-09-19T08:42:58.114698+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:12.642715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110688+0000","last_change":"2024-09-19T08:42:44.035569+0000","last_active":"2024-09-19T08:42:58.110688+0000","last_peered":"2024-09-19T08:42:58.110688+0000","last_clean":"2024-09-19T08:42:58.110688+0000","last_became_active":"2024-09-19T08:42:44.035277+0000","last_became_peered":"2024-09-19T08:42:44.035277+0000","last_unstale":"2024-09-19T08:42:58.110688+0000","last_undegraded":"2024-09-19T08:42:58.110688+0000","last_fullsized":"2024-09-19T08:42:58.110688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:57.472721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":345,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108782+0000","last_change":"2024-09-19T08:41:34.769047+0000","last_active":"2024-09-19T08:42:58.108782+0000","last_peered":"2024-09-19T08:42:58.108782+0000","last_clean":"2024-09-19T08:42:58.108782+0000","last_became_active":"2024-09-19T08:41:34.768619+0000","last_became_peered":"2024-09-19T08:41:34.768619+0000","last_unstale":"2024-09-19T08:42:58.108782+0000","last_undegraded":"2024-09-19T08:42:58.108782+0000","last_fullsized":"2024-09-19T08:42:58.108782+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:13.482855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:13.482855+0000","last_clean_scrub_stamp":"2024-09-19T08:38:13.482855+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.390775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102051+0000","last_change":"2024-09-19T08:42:41.925698+0000","last_active":"2024-09-19T08:42:58.102051+0000","last_peered":"2024-09-19T08:42:58.102051+0000","last_clean":"2024-09-19T08:42:58.102051+0000","last_became_active":"2024-09-19T08:42:41.924618+0000","last_became_peered":"2024-09-19T08:42:41.924618+0000","last_unstale":"2024-09-19T08:42:58.102051+0000","last_undegraded":"2024-09-19T08:42:58.102051+0000","last_fullsized":"2024-09-19T08:42:58.102051+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:53.717139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.111536+0000","last_change":"2024-09-19T08:42:58.111206+0000","last_active":"2024-09-19T08:42:58.111536+0000","last_peered":"2024-09-19T08:42:58.111536+0000","last_clean":"2024-09-19T08:42:58.111536+0000","last_became_active":"2024-09-19T08:42:58.110765+0000","last_became_peered":"2024-09-19T08:42:58.110765+0000","last_unstale":"2024-09-19T08:42:58.111536+0000","last_undegraded":"2024-09-19T08:42:58.111536+0000","last_fullsized":"2024-09-19T08:42:58.111536+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:44.783938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108663+0000","last_change":"2024-09-19T08:42:41.928414+0000","last_active":"2024-09-19T08:42:58.108663+0000","last_peered":"2024-09-19T08:42:58.108663+0000","last_clean":"2024-09-19T08:42:58.108663+0000","last_became_active":"2024-09-19T08:42:41.928055+0000","last_became_peered":"2024-09-19T08:42:41.928055+0000","last_unstale":"2024-09-19T08:42:58.108663+0000","last_undegraded":"2024-09-19T08:42:58.108663+0000","last_fullsized":"2024-09-19T08:42:58.108663+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:12.688379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100208+0000","last_change":"2024-09-19T08:42:44.035439+0000","last_active":"2024-09-19T08:42:58.100208+0000","last_peered":"2024-09-19T08:42:58.100208+0000","last_clean":"2024-09-19T08:42:58.100208+0000","last_became_active":"2024-09-19T08:42:44.035150+0000","last_became_peered":"2024-09-19T08:42:44.035150+0000","last_unstale":"2024-09-19T08:42:58.100208+0000","last_undegraded":"2024-09-19T08:42:58.100208+0000","last_fullsized":"2024-09-19T08:42:58.100208+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:15.230660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:06.109987+0000","last_change":"2024-09-19T08:42:42.407784+0000","last_active":"2024-09-19T08:43:06.109987+0000","last_peered":"2024-09-19T08:43:06.109987+0000","last_clean":"2024-09-19T08:43:06.109987+0000","last_became_active":"2024-09-19T08:42:42.407437+0000","last_became_peered":"2024-09-19T08:42:42.407437+0000","last_unstale":"2024-09-19T08:43:06.109987+0000","last_undegraded":"2024-09-19T08:43:06.109987+0000","last_fullsized":"2024-09-19T08:43:06.109987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:44.829338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104733+0000","last_change":"2024-09-19T08:42:44.039780+0000","last_active":"2024-09-19T08:42:58.104733+0000","last_peered":"2024-09-19T08:42:58.104733+0000","last_clean":"2024-09-19T08:42:58.104733+0000","last_became_active":"2024-09-19T08:42:44.039441+0000","last_became_peered":"2024-09-19T08:42:44.039441+0000","last_unstale":"2024-09-19T08:42:58.104733+0000","last_undegraded":"2024-09-19T08:42:58.104733+0000","last_fullsized":"2024-09-19T08:42:58.104733+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:31.013663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109953+0000","last_change":"2024-09-19T08:42:41.926998+0000","last_active":"2024-09-19T08:42:58.109953+0000","last_peered":"2024-09-19T08:42:58.109953+0000","last_clean":"2024-09-19T08:42:58.109953+0000","last_became_active":"2024-09-19T08:42:41.926560+0000","last_became_peered":"2024-09-19T08:42:41.926560+0000","last_unstale":"2024-09-19T08:42:58.109953+0000","last_undegraded":"2024-09-19T08:42:58.109953+0000","last_fullsized":"2024-09-19T08:42:58.109953+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:35.338601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102887+0000","last_change":"2024-09-19T08:42:44.039948+0000","last_active":"2024-09-19T08:42:58.102887+0000","last_peered":"2024-09-19T08:42:58.102887+0000","last_clean":"2024-09-19T08:42:58.102887+0000","last_became_active":"2024-09-19T08:42:44.038797+0000","last_became_peered":"2024-09-19T08:42:44.038797+0000","last_unstale":"2024-09-19T08:42:58.102887+0000","last_undegraded":"2024-09-19T08:42:58.102887+0000","last_fullsized":"2024-09-19T08:42:58.102887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:19.273191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105603+0000","last_change":"2024-09-19T08:42:42.409954+0000","last_active":"2024-09-19T08:42:58.105603+0000","last_peered":"2024-09-19T08:42:58.105603+0000","last_clean":"2024-09-19T08:42:58.105603+0000","last_became_active":"2024-09-19T08:42:42.409388+0000","last_became_peered":"2024-09-19T08:42:42.409388+0000","last_unstale":"2024-09-19T08:42:58.105603+0000","last_undegraded":"2024-09-19T08:42:58.105603+0000","last_fullsized":"2024-09-19T08:42:58.105603+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:58.764877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103241+0000","last_change":"2024-09-19T08:42:44.024360+0000","last_active":"2024-09-19T08:42:58.103241+0000","last_peered":"2024-09-19T08:42:58.103241+0000","last_clean":"2024-09-19T08:42:58.103241+0000","last_became_active":"2024-09-19T08:42:44.023703+0000","last_became_peered":"2024-09-19T08:42:44.023703+0000","last_unstale":"2024-09-19T08:42:58.103241+0000","last_undegraded":"2024-09-19T08:42:58.103241+0000","last_fullsized":"2024-09-19T08:42:58.103241+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:10.852199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108774+0000","last_change":"2024-09-19T08:42:42.408101+0000","last_active":"2024-09-19T08:42:58.108774+0000","last_peered":"2024-09-19T08:42:58.108774+0000","last_clean":"2024-09-19T08:42:58.108774+0000","last_became_active":"2024-09-19T08:42:42.407692+0000","last_became_peered":"2024-09-19T08:42:42.407692+0000","last_unstale":"2024-09-19T08:42:58.108774+0000","last_undegraded":"2024-09-19T08:42:58.108774+0000","last_fullsized":"2024-09-19T08:42:58.108774+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:01.342213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100618+0000","last_change":"2024-09-19T08:42:44.026612+0000","last_active":"2024-09-19T08:42:58.100618+0000","last_peered":"2024-09-19T08:42:58.100618+0000","last_clean":"2024-09-19T08:42:58.100618+0000","last_became_active":"2024-09-19T08:42:44.025408+0000","last_became_peered":"2024-09-19T08:42:44.025408+0000","last_unstale":"2024-09-19T08:42:58.100618+0000","last_undegraded":"2024-09-19T08:42:58.100618+0000","last_fullsized":"2024-09-19T08:42:58.100618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:19.465342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:04.041342+0000","last_change":"2024-09-19T08:42:41.927561+0000","last_active":"2024-09-19T08:43:04.041342+0000","last_peered":"2024-09-19T08:43:04.041342+0000","last_clean":"2024-09-19T08:43:04.041342+0000","last_became_active":"2024-09-19T08:42:41.927159+0000","last_became_peered":"2024-09-19T08:42:41.927159+0000","last_unstale":"2024-09-19T08:43:04.041342+0000","last_undegraded":"2024-09-19T08:43:04.041342+0000","last_fullsized":"2024-09-19T08:43:04.041342+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:13.352727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106277+0000","last_change":"2024-09-19T08:42:44.028129+0000","last_active":"2024-09-19T08:42:58.106277+0000","last_peered":"2024-09-19T08:42:58.106277+0000","last_clean":"2024-09-19T08:42:58.106277+0000","last_became_active":"2024-09-19T08:42:44.027826+0000","last_became_peered":"2024-09-19T08:42:44.027826+0000","last_unstale":"2024-09-19T08:42:58.106277+0000","last_undegraded":"2024-09-19T08:42:58.106277+0000","last_fullsized":"2024-09-19T08:42:58.106277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:03.129404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102523+0000","last_change":"2024-09-19T08:42:41.920264+0000","last_active":"2024-09-19T08:42:58.102523+0000","last_peered":"2024-09-19T08:42:58.102523+0000","last_clean":"2024-09-19T08:42:58.102523+0000","last_became_active":"2024-09-19T08:42:41.919655+0000","last_became_peered":"2024-09-19T08:42:41.919655+0000","last_unstale":"2024-09-19T08:42:58.102523+0000","last_undegraded":"2024-09-19T08:42:58.102523+0000","last_fullsized":"2024-09-19T08:42:58.102523+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:58.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103052+0000","last_change":"2024-09-19T08:42:44.039655+0000","last_active":"2024-09-19T08:42:58.103052+0000","last_peered":"2024-09-19T08:42:58.103052+0000","last_clean":"2024-09-19T08:42:58.103052+0000","last_became_active":"2024-09-19T08:42:44.039317+0000","last_became_peered":"2024-09-19T08:42:44.039317+0000","last_unstale":"2024-09-19T08:42:58.103052+0000","last_undegraded":"2024-09-19T08:42:58.103052+0000","last_fullsized":"2024-09-19T08:42:58.103052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:19.064194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109199+0000","last_change":"2024-09-19T08:42:42.408582+0000","last_active":"2024-09-19T08:42:58.109199+0000","last_peered":"2024-09-19T08:42:58.109199+0000","last_clean":"2024-09-19T08:42:58.109199+0000","last_became_active":"2024-09-19T08:42:42.408143+0000","last_became_peered":"2024-09-19T08:42:42.408143+0000","last_unstale":"2024-09-19T08:42:58.109199+0000","last_undegraded":"2024-09-19T08:42:58.109199+0000","last_fullsized":"2024-09-19T08:42:58.109199+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.526138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.107333+0000","last_change":"2024-09-19T08:42:44.034795+0000","last_active":"2024-09-19T08:42:58.107333+0000","last_peered":"2024-09-19T08:42:58.107333+0000","last_clean":"2024-09-19T08:42:58.107333+0000","last_became_active":"2024-09-19T08:42:44.034440+0000","last_became_peered":"2024-09-19T08:42:44.034440+0000","last_unstale":"2024-09-19T08:42:58.107333+0000","last_undegraded":"2024-09-19T08:42:58.107333+0000","last_fullsized":"2024-09-19T08:42:58.107333+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:50.470240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104200+0000","last_change":"2024-09-19T08:42:41.922621+0000","last_active":"2024-09-19T08:42:58.104200+0000","last_peered":"2024-09-19T08:42:58.104200+0000","last_clean":"2024-09-19T08:42:58.104200+0000","last_became_active":"2024-09-19T08:42:41.922303+0000","last_became_peered":"2024-09-19T08:42:41.922303+0000","last_unstale":"2024-09-19T08:42:58.104200+0000","last_undegraded":"2024-09-19T08:42:58.104200+0000","last_fullsized":"2024-09-19T08:42:58.104200+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:48.017892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101216+0000","last_change":"2024-09-19T08:42:44.028307+0000","last_active":"2024-09-19T08:42:58.101216+0000","last_peered":"2024-09-19T08:42:58.101216+0000","last_clean":"2024-09-19T08:42:58.101216+0000","last_became_active":"2024-09-19T08:42:44.026848+0000","last_became_peered":"2024-09-19T08:42:44.026848+0000","last_unstale":"2024-09-19T08:42:58.101216+0000","last_undegraded":"2024-09-19T08:42:58.101216+0000","last_fullsized":"2024-09-19T08:42:58.101216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:20.768075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103736+0000","last_change":"2024-09-19T08:42:41.929479+0000","last_active":"2024-09-19T08:42:58.103736+0000","last_peered":"2024-09-19T08:42:58.103736+0000","last_clean":"2024-09-19T08:42:58.103736+0000","last_became_active":"2024-09-19T08:42:41.928508+0000","last_became_peered":"2024-09-19T08:42:41.928508+0000","last_unstale":"2024-09-19T08:42:58.103736+0000","last_undegraded":"2024-09-19T08:42:58.103736+0000","last_fullsized":"2024-09-19T08:42:58.103736+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:46.108471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104229+0000","last_change":"2024-09-19T08:42:44.028694+0000","last_active":"2024-09-19T08:42:58.104229+0000","last_peered":"2024-09-19T08:42:58.104229+0000","last_clean":"2024-09-19T08:42:58.104229+0000","last_became_active":"2024-09-19T08:42:44.027382+0000","last_became_peered":"2024-09-19T08:42:44.027382+0000","last_unstale":"2024-09-19T08:42:58.104229+0000","last_undegraded":"2024-09-19T08:42:58.104229+0000","last_fullsized":"2024-09-19T08:42:58.104229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:40.877505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108022+0000","last_change":"2024-09-19T08:42:41.931016+0000","last_active":"2024-09-19T08:42:58.108022+0000","last_peered":"2024-09-19T08:42:58.108022+0000","last_clean":"2024-09-19T08:42:58.108022+0000","last_became_active":"2024-09-19T08:42:41.930648+0000","last_became_peered":"2024-09-19T08:42:41.930648+0000","last_unstale":"2024-09-19T08:42:58.108022+0000","last_undegraded":"2024-09-19T08:42:58.108022+0000","last_fullsized":"2024-09-19T08:42:58.108022+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:32.031025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109744+0000","last_change":"2024-09-19T08:42:44.035288+0000","last_active":"2024-09-19T08:42:58.109744+0000","last_peered":"2024-09-19T08:42:58.109744+0000","last_clean":"2024-09-19T08:42:58.109744+0000","last_became_active":"2024-09-19T08:42:44.034660+0000","last_became_peered":"2024-09-19T08:42:44.034660+0000","last_unstale":"2024-09-19T08:42:58.109744+0000","last_undegraded":"2024-09-19T08:42:58.109744+0000","last_fullsized":"2024-09-19T08:42:58.109744+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:48.703463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105135+0000","last_change":"2024-09-19T08:42:44.040123+0000","last_active":"2024-09-19T08:42:58.105135+0000","last_peered":"2024-09-19T08:42:58.105135+0000","last_clean":"2024-09-19T08:42:58.105135+0000","last_became_active":"2024-09-19T08:42:44.039488+0000","last_became_peered":"2024-09-19T08:42:44.039488+0000","last_unstale":"2024-09-19T08:42:58.105135+0000","last_undegraded":"2024-09-19T08:42:58.105135+0000","last_fullsized":"2024-09-19T08:42:58.105135+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:15.273044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108182+0000","last_change":"2024-09-19T08:42:41.932400+0000","last_active":"2024-09-19T08:42:58.108182+0000","last_peered":"2024-09-19T08:42:58.108182+0000","last_clean":"2024-09-19T08:42:58.108182+0000","last_became_active":"2024-09-19T08:42:41.932020+0000","last_became_peered":"2024-09-19T08:42:41.932020+0000","last_unstale":"2024-09-19T08:42:58.108182+0000","last_undegraded":"2024-09-19T08:42:58.108182+0000","last_fullsized":"2024-09-19T08:42:58.108182+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:08.583287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109186+0000","last_change":"2024-09-19T08:42:44.026173+0000","last_active":"2024-09-19T08:42:58.109186+0000","last_peered":"2024-09-19T08:42:58.109186+0000","last_clean":"2024-09-19T08:42:58.109186+0000","last_became_active":"2024-09-19T08:42:44.024614+0000","last_became_peered":"2024-09-19T08:42:44.024614+0000","last_unstale":"2024-09-19T08:42:58.109186+0000","last_undegraded":"2024-09-19T08:42:58.109186+0000","last_fullsized":"2024-09-19T08:42:58.109186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:42.695660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108660+0000","last_change":"2024-09-19T08:42:41.929576+0000","last_active":"2024-09-19T08:42:58.108660+0000","last_peered":"2024-09-19T08:42:58.108660+0000","last_clean":"2024-09-19T08:42:58.108660+0000","last_became_active":"2024-09-19T08:42:41.929231+0000","last_became_peered":"2024-09-19T08:42:41.929231+0000","last_unstale":"2024-09-19T08:42:58.108660+0000","last_undegraded":"2024-09-19T08:42:58.108660+0000","last_fullsized":"2024-09-19T08:42:58.108660+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:54.492198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103061+0000","last_change":"2024-09-19T08:42:44.028612+0000","last_active":"2024-09-19T08:42:58.103061+0000","last_peered":"2024-09-19T08:42:58.103061+0000","last_clean":"2024-09-19T08:42:58.103061+0000","last_became_active":"2024-09-19T08:42:44.028301+0000","last_became_peered":"2024-09-19T08:42:44.028301+0000","last_unstale":"2024-09-19T08:42:58.103061+0000","last_undegraded":"2024-09-19T08:42:58.103061+0000","last_fullsized":"2024-09-19T08:42:58.103061+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:03:09.539350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106004+0000","last_change":"2024-09-19T08:42:42.407931+0000","last_active":"2024-09-19T08:42:58.106004+0000","last_peered":"2024-09-19T08:42:58.106004+0000","last_clean":"2024-09-19T08:42:58.106004+0000","last_became_active":"2024-09-19T08:42:42.407573+0000","last_became_peered":"2024-09-19T08:42:42.407573+0000","last_unstale":"2024-09-19T08:42:58.106004+0000","last_undegraded":"2024-09-19T08:42:58.106004+0000","last_fullsized":"2024-09-19T08:42:58.106004+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:55.095275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105172+0000","last_change":"2024-09-19T08:42:44.034109+0000","last_active":"2024-09-19T08:42:58.105172+0000","last_peered":"2024-09-19T08:42:58.105172+0000","last_clean":"2024-09-19T08:42:58.105172+0000","last_became_active":"2024-09-19T08:42:44.033753+0000","last_became_peered":"2024-09-19T08:42:44.033753+0000","last_unstale":"2024-09-19T08:42:58.105172+0000","last_undegraded":"2024-09-19T08:42:58.105172+0000","last_fullsized":"2024-09-19T08:42:58.105172+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:08.475476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":48,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.120292+0000","last_change":"2024-09-19T08:42:58.120292+0000","last_active":"2024-09-19T08:42:58.120292+0000","last_peered":"2024-09-19T08:42:58.120292+0000","last_clean":"2024-09-19T08:42:58.120292+0000","last_became_active":"2024-09-19T08:42:58.109929+0000","last_became_peered":"2024-09-19T08:42:58.109929+0000","last_unstale":"2024-09-19T08:42:58.120292+0000","last_undegraded":"2024-09-19T08:42:58.120292+0000","last_fullsized":"2024-09-19T08:42:58.120292+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:56.196868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":51198,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":100,"num_read_kb":103,"num_write":151,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1198,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":153594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579921,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":433265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32724,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712428,"statfs":{"total":95995035648,"available":95961526272,"internally_reserved":0,"allocated":1576960,"data_stored":1071325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939675,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":432885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168607,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":432805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397540,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1024548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561066,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":432274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789997,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1024421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953524,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":433686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215161,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40396,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704756,"statfs":{"total":95995035648,"available":95953670144,"internally_reserved":0,"allocated":913408,"data_stored":432585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444093,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":479996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":478869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":917504,"data_stored":433545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":47929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":48773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:43:11.620 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T08:43:11.620 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T08:43:11.621 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T08:43:11.876 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:12.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:12 smithi007 ceph-mon[31221]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:43:12.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:12 smithi007 ceph-mon[31221]: pgmap v289: 97 pgs: 97 active+clean; 635 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.5 KiB/s wr, 9 op/s; 99 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T08:43:12.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.312+0000 7fbb2770c640 1 -- 172.21.15.7:0/656448127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb20109a80 msgr2=0x7fbb2010bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:12.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.312+0000 7fbb2770c640 1 --2- 172.21.15.7:0/656448127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb20109a80 0x7fbb2010bf40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009ca0 tx=0x7fbb1802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:43:12.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.312+0000 7fbb2770c640 1 -- 172.21.15.7:0/656448127 shutdown_connections 2024-09-19T08:43:12.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.312+0000 7fbb2770c640 1 --2- 172.21.15.7:0/656448127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb20109a80 0x7fbb2010bf40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:12.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.312+0000 7fbb2770c640 1 --2- 172.21.15.7:0/656448127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb20074c50 0x7fbb200750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:12.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.312+0000 7fbb2770c640 1 --2- 172.21.15.7:0/656448127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb20076220 0x7fbb20074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:12.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.312+0000 7fbb2770c640 1 -- 172.21.15.7:0/656448127 >> 172.21.15.7:0/656448127 conn(0x7fbb200fd390 msgr2=0x7fbb200ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:12.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.312+0000 7fbb2770c640 1 -- 172.21.15.7:0/656448127 shutdown_connections 2024-09-19T08:43:12.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.312+0000 7fbb2770c640 1 -- 172.21.15.7:0/656448127 wait complete. 2024-09-19T08:43:12.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.313+0000 7fbb2770c640 1 Processor -- start 2024-09-19T08:43:12.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.313+0000 7fbb2770c640 1 -- start start 2024-09-19T08:43:12.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.313+0000 7fbb2770c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb20074c50 0x7fbb2019a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:12.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.313+0000 7fbb2770c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb20076220 0x7fbb2019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:12.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.313+0000 7fbb2770c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb20109a80 0x7fbb201a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:12.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.313+0000 7fbb2770c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2010fb00 con 0x7fbb20109a80 2024-09-19T08:43:12.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.313+0000 7fbb2770c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2010f980 con 0x7fbb20074c50 2024-09-19T08:43:12.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.313+0000 7fbb2770c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2010fc80 con 0x7fbb20076220 2024-09-19T08:43:12.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.313+0000 7fbb25ca9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb20109a80 0x7fbb201a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:12.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.313+0000 7fbb25ca9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb20109a80 0x7fbb201a16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35674/0 (socket says 172.21.15.7:35674) 2024-09-19T08:43:12.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.313+0000 7fbb25ca9640 1 -- 172.21.15.7:0/289210752 learned_addr learned my addr 172.21.15.7:0/289210752 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:12.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.313+0000 7fbb254a8640 1 --2- 172.21.15.7:0/289210752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb20074c50 0x7fbb2019a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:12.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.314+0000 7fbb24ca7640 1 --2- 172.21.15.7:0/289210752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb20076220 0x7fbb2019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:12.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.314+0000 7fbb25ca9640 1 -- 172.21.15.7:0/289210752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb20076220 msgr2=0x7fbb2019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:12.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.314+0000 7fbb25ca9640 1 --2- 172.21.15.7:0/289210752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb20076220 0x7fbb2019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:12.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.314+0000 7fbb25ca9640 1 -- 172.21.15.7:0/289210752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb20074c50 msgr2=0x7fbb2019a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:12.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.314+0000 7fbb25ca9640 1 --2- 172.21.15.7:0/289210752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb20074c50 0x7fbb2019a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:12.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.314+0000 7fbb25ca9640 1 -- 172.21.15.7:0/289210752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb201a1d50 con 0x7fbb20109a80 2024-09-19T08:43:12.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.314+0000 7fbb25ca9640 1 --2- 172.21.15.7:0/289210752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb20109a80 0x7fbb201a16e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbb180098d0 tx=0x7fbb1802f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:12.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.314+0000 7fbb167fc640 1 -- 172.21.15.7:0/289210752 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1802fc30 con 0x7fbb20109a80 2024-09-19T08:43:12.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.314+0000 7fbb167fc640 1 -- 172.21.15.7:0/289210752 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb18003e50 con 0x7fbb20109a80 2024-09-19T08:43:12.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.314+0000 7fbb2770c640 1 -- 172.21.15.7:0/289210752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb201a1fe0 con 0x7fbb20109a80 2024-09-19T08:43:12.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.314+0000 7fbb167fc640 1 -- 172.21.15.7:0/289210752 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb180305c0 con 0x7fbb20109a80 2024-09-19T08:43:12.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.314+0000 7fbb2770c640 1 -- 172.21.15.7:0/289210752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb201a2510 con 0x7fbb20109a80 2024-09-19T08:43:12.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.315+0000 7fbb2770c640 1 -- 172.21.15.7:0/289210752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb20108800 con 0x7fbb20109a80 2024-09-19T08:43:12.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.316+0000 7fbb167fc640 1 -- 172.21.15.7:0/289210752 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fbb18004b40 con 0x7fbb20109a80 2024-09-19T08:43:12.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.317+0000 7fbb167fc640 1 --2- 172.21.15.7:0/289210752 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fbb0c0a3300 0x7fbb0c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:12.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.317+0000 7fbb254a8640 1 --2- 172.21.15.7:0/289210752 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fbb0c0a3300 0x7fbb0c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:12.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.317+0000 7fbb167fc640 1 -- 172.21.15.7:0/289210752 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fbb180f0f30 con 0x7fbb20109a80 2024-09-19T08:43:12.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.317+0000 7fbb254a8640 1 --2- 172.21.15.7:0/289210752 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fbb0c0a3300 0x7fbb0c0a57c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbb20076600 tx=0x7fbb1c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:12.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.320+0000 7fbb167fc640 1 -- 172.21.15.7:0/289210752 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbb180433d0 con 0x7fbb20109a80 2024-09-19T08:43:12.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:12 smithi175 ceph-mon[35688]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:43:12.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:12 smithi175 ceph-mon[35688]: pgmap v289: 97 pgs: 97 active+clean; 635 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.5 KiB/s wr, 9 op/s; 99 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T08:43:12.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:12 smithi044 ceph-mon[35072]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:43:12.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:12 smithi044 ceph-mon[35072]: pgmap v289: 97 pgs: 97 active+clean; 635 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.5 KiB/s wr, 9 op/s; 99 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T08:43:12.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.564+0000 7fbb2770c640 1 -- 172.21.15.7:0/289210752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fbb2002d7c0 con 0x7fbb20109a80 2024-09-19T08:43:12.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.567+0000 7fbb167fc640 1 -- 172.21.15.7:0/289210752 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fbb180bdc00 con 0x7fbb20109a80 2024-09-19T08:43:12.567 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-09-19T08:43:12.567 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAg5OtmBK3EIRAAbmBCKh7O5vWyTGctWdx4ig== 2024-09-19T08:43:12.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.569+0000 7fbb2770c640 1 -- 172.21.15.7:0/289210752 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fbb0c0a3300 msgr2=0x7fbb0c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:12.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.569+0000 7fbb2770c640 1 --2- 172.21.15.7:0/289210752 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fbb0c0a3300 0x7fbb0c0a57c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbb20076600 tx=0x7fbb1c008040 comp rx=0 tx=0).stop 2024-09-19T08:43:12.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.569+0000 7fbb2770c640 1 -- 172.21.15.7:0/289210752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb20109a80 msgr2=0x7fbb201a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:12.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.569+0000 7fbb2770c640 1 --2- 172.21.15.7:0/289210752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb20109a80 0x7fbb201a16e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbb180098d0 tx=0x7fbb1802f840 comp rx=0 tx=0).stop 2024-09-19T08:43:12.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.569+0000 7fbb2770c640 1 -- 172.21.15.7:0/289210752 shutdown_connections 2024-09-19T08:43:12.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.569+0000 7fbb2770c640 1 --2- 172.21.15.7:0/289210752 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fbb0c0a3300 0x7fbb0c0a57c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:12.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.569+0000 7fbb2770c640 1 --2- 172.21.15.7:0/289210752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb20109a80 0x7fbb201a16e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:12.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.569+0000 7fbb2770c640 1 --2- 172.21.15.7:0/289210752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb20076220 0x7fbb2019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:12.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.569+0000 7fbb2770c640 1 --2- 172.21.15.7:0/289210752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb20074c50 0x7fbb2019a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:12.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.569+0000 7fbb2770c640 1 -- 172.21.15.7:0/289210752 >> 172.21.15.7:0/289210752 conn(0x7fbb200fd390 msgr2=0x7fbb201059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:12.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.569+0000 7fbb2770c640 1 -- 172.21.15.7:0/289210752 shutdown_connections 2024-09-19T08:43:12.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:12.569+0000 7fbb2770c640 1 -- 172.21.15.7:0/289210752 wait complete. 2024-09-19T08:43:13.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:13 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/289210752' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T08:43:13.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:13 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/289210752' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T08:43:13.222 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T08:43:13.222 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T08:43:13.222 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T08:43:13.261 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T08:43:13.262 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T08:43:13.262 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T08:43:13.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:13 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/289210752' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T08:43:13.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:13 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/289210752' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T08:43:13.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:13 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/289210752' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T08:43:13.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:13 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/289210752' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T08:43:13.555 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:14.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.995+0000 7f9c2a90b640 1 -- 172.21.15.7:0/3439220537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c24101de0 msgr2=0x7f9c241021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:14.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.995+0000 7f9c2a90b640 1 --2- 172.21.15.7:0/3439220537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c24101de0 0x7f9c241021c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9c14009900 tx=0x7f9c1402a410 comp rx=0 tx=0).stop 2024-09-19T08:43:14.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.995+0000 7f9c2a90b640 1 -- 172.21.15.7:0/3439220537 shutdown_connections 2024-09-19T08:43:14.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.995+0000 7f9c2a90b640 1 --2- 172.21.15.7:0/3439220537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c24106f10 0x7f9c2410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:14.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.995+0000 7f9c2a90b640 1 --2- 172.21.15.7:0/3439220537 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c24102790 0x7f9c241067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:14.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.995+0000 7f9c2a90b640 1 --2- 172.21.15.7:0/3439220537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c24101de0 0x7f9c241021c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:14.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.995+0000 7f9c2a90b640 1 -- 172.21.15.7:0/3439220537 >> 172.21.15.7:0/3439220537 conn(0x7f9c240fd8c0 msgr2=0x7f9c240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:14.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.995+0000 7f9c2a90b640 1 -- 172.21.15.7:0/3439220537 shutdown_connections 2024-09-19T08:43:14.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.995+0000 7f9c2a90b640 1 -- 172.21.15.7:0/3439220537 wait complete. 2024-09-19T08:43:14.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.996+0000 7f9c2a90b640 1 Processor -- start 2024-09-19T08:43:14.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.996+0000 7f9c2a90b640 1 -- start start 2024-09-19T08:43:14.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.996+0000 7f9c2a90b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c24101de0 0x7f9c240744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:14.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.996+0000 7f9c2a90b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c24102790 0x7f9c24074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:14.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.996+0000 7f9c2a90b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c24106f10 0x7f9c24074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:14.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.996+0000 7f9c2a90b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9c24111f90 con 0x7f9c24102790 2024-09-19T08:43:14.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.996+0000 7f9c2a90b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9c24111e10 con 0x7f9c24106f10 2024-09-19T08:43:14.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.996+0000 7f9c2a90b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9c24112110 con 0x7f9c24101de0 2024-09-19T08:43:14.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.996+0000 7f9c237fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c24102790 0x7f9c24074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:14.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.996+0000 7f9c237fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c24102790 0x7f9c24074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39716/0 (socket says 172.21.15.7:39716) 2024-09-19T08:43:14.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.996+0000 7f9c237fe640 1 -- 172.21.15.7:0/3110521729 learned_addr learned my addr 172.21.15.7:0/3110521729 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:14.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.997+0000 7f9c28ea8640 1 --2- 172.21.15.7:0/3110521729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c24106f10 0x7f9c24074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:14.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.997+0000 7f9c23fff640 1 --2- 172.21.15.7:0/3110521729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c24101de0 0x7f9c240744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:14.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.997+0000 7f9c237fe640 1 -- 172.21.15.7:0/3110521729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c24101de0 msgr2=0x7f9c240744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:14.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.997+0000 7f9c237fe640 1 --2- 172.21.15.7:0/3110521729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c24101de0 0x7f9c240744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:14.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.997+0000 7f9c237fe640 1 -- 172.21.15.7:0/3110521729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c24106f10 msgr2=0x7f9c24074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:14.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.997+0000 7f9c237fe640 1 --2- 172.21.15.7:0/3110521729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c24106f10 0x7f9c24074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:14.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.997+0000 7f9c237fe640 1 -- 172.21.15.7:0/3110521729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c241a6950 con 0x7f9c24102790 2024-09-19T08:43:14.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.997+0000 7f9c237fe640 1 --2- 172.21.15.7:0/3110521729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c24102790 0x7f9c24074a30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800d950 tx=0x7f9c1800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:14.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.997+0000 7f9c217fa640 1 -- 172.21.15.7:0/3110521729 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18017070 con 0x7f9c24102790 2024-09-19T08:43:14.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.997+0000 7f9c2a90b640 1 -- 172.21.15.7:0/3110521729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c241a6c40 con 0x7f9c24102790 2024-09-19T08:43:14.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.997+0000 7f9c217fa640 1 -- 172.21.15.7:0/3110521729 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c18009c30 con 0x7f9c24102790 2024-09-19T08:43:14.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.997+0000 7f9c217fa640 1 -- 172.21.15.7:0/3110521729 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1800f6b0 con 0x7f9c24102790 2024-09-19T08:43:14.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.997+0000 7f9c2a90b640 1 -- 172.21.15.7:0/3110521729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c241a7180 con 0x7f9c24102790 2024-09-19T08:43:14.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:13.998+0000 7f9c2a90b640 1 -- 172.21.15.7:0/3110521729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c241021c0 con 0x7f9c24102790 2024-09-19T08:43:14.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:14.000+0000 7f9c217fa640 1 -- 172.21.15.7:0/3110521729 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f9c180109d0 con 0x7f9c24102790 2024-09-19T08:43:14.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:14.000+0000 7f9c217fa640 1 --2- 172.21.15.7:0/3110521729 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9c0c0a32d0 0x7f9c0c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:14.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:14.000+0000 7f9c23fff640 1 --2- 172.21.15.7:0/3110521729 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9c0c0a32d0 0x7f9c0c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:14.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:14.000+0000 7f9c217fa640 1 -- 172.21.15.7:0/3110521729 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9c180cf6b0 con 0x7f9c24102790 2024-09-19T08:43:14.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:14.001+0000 7f9c23fff640 1 --2- 172.21.15.7:0/3110521729 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9c0c0a32d0 0x7f9c0c0a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9c14005ab0 tx=0x7f9c14005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:14.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:14.005+0000 7f9c217fa640 1 -- 172.21.15.7:0/3110521729 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9c18009de0 con 0x7f9c24102790 2024-09-19T08:43:14.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:14.234+0000 7f9c2a90b640 1 -- 172.21.15.7:0/3110521729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f9c2402d7c0 con 0x7f9c24102790 2024-09-19T08:43:14.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:14.238+0000 7f9c217fa640 1 -- 172.21.15.7:0/3110521729 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264039 (secure 0 0 0) 0x7f9c1809c270 con 0x7f9c24102790 2024-09-19T08:43:14.243 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:43:14.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:14.241+0000 7f9c2a90b640 1 -- 172.21.15.7:0/3110521729 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9c0c0a32d0 msgr2=0x7f9c0c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:14.241+0000 7f9c2a90b640 1 --2- 172.21.15.7:0/3110521729 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9c0c0a32d0 0x7f9c0c0a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9c14005ab0 tx=0x7f9c14005a20 comp rx=0 tx=0).stop 2024-09-19T08:43:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:14.241+0000 7f9c2a90b640 1 -- 172.21.15.7:0/3110521729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c24102790 msgr2=0x7f9c24074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:14.241+0000 7f9c2a90b640 1 --2- 172.21.15.7:0/3110521729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c24102790 0x7f9c24074a30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800d950 tx=0x7f9c1800de10 comp rx=0 tx=0).stop 2024-09-19T08:43:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:14.241+0000 7f9c2a90b640 1 -- 172.21.15.7:0/3110521729 shutdown_connections 2024-09-19T08:43:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:14.241+0000 7f9c2a90b640 1 --2- 172.21.15.7:0/3110521729 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9c0c0a32d0 0x7f9c0c0a5790 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:14.241+0000 7f9c2a90b640 1 --2- 172.21.15.7:0/3110521729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c24106f10 0x7f9c24074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:14.241+0000 7f9c2a90b640 1 --2- 172.21.15.7:0/3110521729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c24102790 0x7f9c24074a30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:14.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:14.241+0000 7f9c2a90b640 1 --2- 172.21.15.7:0/3110521729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c24101de0 0x7f9c240744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:14.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:14.241+0000 7f9c2a90b640 1 -- 172.21.15.7:0/3110521729 >> 172.21.15.7:0/3110521729 conn(0x7f9c240fd8c0 msgr2=0x7f9c240fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:14.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:14.241+0000 7f9c2a90b640 1 -- 172.21.15.7:0/3110521729 shutdown_connections 2024-09-19T08:43:14.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:14.241+0000 7f9c2a90b640 1 -- 172.21.15.7:0/3110521729 wait complete. 2024-09-19T08:43:14.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:14 smithi175 ceph-mon[35688]: pgmap v290: 97 pgs: 97 active+clean; 635 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.6 KiB/s wr, 8 op/s; 96 B/s, 0 objects/s recovering 2024-09-19T08:43:14.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:14 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3110521729' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T08:43:15.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:14 smithi007 ceph-mon[31221]: pgmap v290: 97 pgs: 97 active+clean; 635 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.6 KiB/s wr, 8 op/s; 96 B/s, 0 objects/s recovering 2024-09-19T08:43:15.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:14 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3110521729' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T08:43:15.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:14 smithi044 ceph-mon[35072]: pgmap v290: 97 pgs: 97 active+clean; 635 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.6 KiB/s wr, 8 op/s; 96 B/s, 0 objects/s recovering 2024-09-19T08:43:15.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:14 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3110521729' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T08:43:15.053 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3577760109},{"type":"v1","addr":"172.21.15.7:6801","nonce":3577760109}]},"active_addr":"172.21.15.7:6801/3577760109","active_change":"2024-09-19T08:35:56.784468+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.7:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":1800852158}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":2008302629}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":499611189}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":973276283}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":2457209252}]}]} 2024-09-19T08:43:15.059 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T08:43:15.059 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T08:43:15.059 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:43:15.321 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:15.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.754+0000 7f67ae4e1640 1 -- 172.21.15.7:0/813520694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67a8100e20 msgr2=0x7f67a8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:15.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.754+0000 7f67ae4e1640 1 --2- 172.21.15.7:0/813520694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67a8100e20 0x7f67a8101200 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6798009900 tx=0x7f679802a480 comp rx=0 tx=0).stop 2024-09-19T08:43:15.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.754+0000 7f67ae4e1640 1 -- 172.21.15.7:0/813520694 shutdown_connections 2024-09-19T08:43:15.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.754+0000 7f67ae4e1640 1 --2- 172.21.15.7:0/813520694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67a8102ef0 0x7f67a810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:15.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.754+0000 7f67ae4e1640 1 --2- 172.21.15.7:0/813520694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67a8102570 0x7f67a81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:15.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.754+0000 7f67ae4e1640 1 --2- 172.21.15.7:0/813520694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67a8100e20 0x7f67a8101200 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:15.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.754+0000 7f67ae4e1640 1 -- 172.21.15.7:0/813520694 >> 172.21.15.7:0/813520694 conn(0x7f67a80fc7d0 msgr2=0x7f67a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:15.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.754+0000 7f67ae4e1640 1 -- 172.21.15.7:0/813520694 shutdown_connections 2024-09-19T08:43:15.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.754+0000 7f67ae4e1640 1 -- 172.21.15.7:0/813520694 wait complete. 2024-09-19T08:43:15.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.755+0000 7f67ae4e1640 1 Processor -- start 2024-09-19T08:43:15.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.755+0000 7f67ae4e1640 1 -- start start 2024-09-19T08:43:15.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.755+0000 7f67ae4e1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67a8100e20 0x7f67a81992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:15.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.755+0000 7f67ae4e1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67a8102570 0x7f67a8199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:15.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.755+0000 7f67ae4e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67a8102ef0 0x7f67a81a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:15.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.755+0000 7f67ae4e1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f67a8110f80 con 0x7f67a8102ef0 2024-09-19T08:43:15.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.755+0000 7f67ae4e1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f67a8110e00 con 0x7f67a8102570 2024-09-19T08:43:15.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.755+0000 7f67ae4e1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f67a8111100 con 0x7f67a8100e20 2024-09-19T08:43:15.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.755+0000 7f67aca7e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67a8102ef0 0x7f67a81a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.755+0000 7f67aca7e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67a8102ef0 0x7f67a81a4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39728/0 (socket says 172.21.15.7:39728) 2024-09-19T08:43:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.755+0000 7f679ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67a8102570 0x7f67a8199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.755+0000 7f67aca7e640 1 -- 172.21.15.7:0/2549585856 learned_addr learned my addr 172.21.15.7:0/2549585856 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.755+0000 7f67a7fff640 1 --2- 172.21.15.7:0/2549585856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67a8100e20 0x7f67a81992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.755+0000 7f67aca7e640 1 -- 172.21.15.7:0/2549585856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67a8100e20 msgr2=0x7f67a81992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.755+0000 7f67aca7e640 1 --2- 172.21.15.7:0/2549585856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67a8100e20 0x7f67a81992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.755+0000 7f67aca7e640 1 -- 172.21.15.7:0/2549585856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67a8102570 msgr2=0x7f67a8199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.755+0000 7f67aca7e640 1 --2- 172.21.15.7:0/2549585856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67a8102570 0x7f67a8199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.755+0000 7f67aca7e640 1 -- 172.21.15.7:0/2549585856 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a81a4890 con 0x7f67a8102ef0 2024-09-19T08:43:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.756+0000 7f679ffff640 1 --2- 172.21.15.7:0/2549585856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67a8102570 0x7f67a8199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:43:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.756+0000 7f67aca7e640 1 --2- 172.21.15.7:0/2549585856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67a8102ef0 0x7f67a81a4350 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f67a000cad0 tx=0x7f67a000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.756+0000 7f67a5ffb640 1 -- 172.21.15.7:0/2549585856 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a000ad60 con 0x7f67a8102ef0 2024-09-19T08:43:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.756+0000 7f67ae4e1640 1 -- 172.21.15.7:0/2549585856 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67a81a4a60 con 0x7f67a8102ef0 2024-09-19T08:43:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.756+0000 7f67a5ffb640 1 -- 172.21.15.7:0/2549585856 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67a0005020 con 0x7f67a8102ef0 2024-09-19T08:43:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.756+0000 7f67a5ffb640 1 -- 172.21.15.7:0/2549585856 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a000f6b0 con 0x7f67a8102ef0 2024-09-19T08:43:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.756+0000 7f67ae4e1640 1 -- 172.21.15.7:0/2549585856 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67a81a4f70 con 0x7f67a8102ef0 2024-09-19T08:43:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.757+0000 7f67ae4e1640 1 -- 172.21.15.7:0/2549585856 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67a8101200 con 0x7f67a8102ef0 2024-09-19T08:43:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.758+0000 7f67a5ffb640 1 -- 172.21.15.7:0/2549585856 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f67a0005560 con 0x7f67a8102ef0 2024-09-19T08:43:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.759+0000 7f67a5ffb640 1 --2- 172.21.15.7:0/2549585856 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f67940a32d0 0x7f67940a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.759+0000 7f67a7fff640 1 --2- 172.21.15.7:0/2549585856 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f67940a32d0 0x7f67940a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.759+0000 7f67a5ffb640 1 -- 172.21.15.7:0/2549585856 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f67a00cf9e0 con 0x7f67a8102ef0 2024-09-19T08:43:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.760+0000 7f67a7fff640 1 --2- 172.21.15.7:0/2549585856 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f67940a32d0 0x7f67940a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6798000c00 tx=0x7f67980058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:15.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.763+0000 7f67a5ffb640 1 -- 172.21.15.7:0/2549585856 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f67a0014030 con 0x7f67a8102ef0 2024-09-19T08:43:15.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.940+0000 7f67ae4e1640 1 -- 172.21.15.7:0/2549585856 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67a81a5260 con 0x7f67a8102ef0 2024-09-19T08:43:15.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.941+0000 7f67a5ffb640 1 -- 172.21.15.7:0/2549585856 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22634 (secure 0 0 0) 0x7f67a0086020 con 0x7f67a8102ef0 2024-09-19T08:43:15.945 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:43:15.945 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":82,"fsid":"ebd23124-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:02.287380+0000","modified":"2024-09-19T08:42:58.097469+0000","last_up_change":"2024-09-19T08:41:54.742978+0000","last_in_change":"2024-09-19T08:41:31.685622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:13.285118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:42:40.425852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:42:43.006548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"837e6267-71c7-4f48-9e0b-4e3f124682b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6803","nonce":402668717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6805","nonce":402668717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6809","nonce":402668717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6807","nonce":402668717}]},"public_addr":"172.21.15.7:6803/402668717","cluster_addr":"172.21.15.7:6805/402668717","heartbeat_back_addr":"172.21.15.7:6809/402668717","heartbeat_front_addr":"172.21.15.7:6807/402668717","state":["exists","up"]},{"osd":1,"uuid":"67865372-ac22-4b30-bd02-498e118d6701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6801","nonce":2213694259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6803","nonce":2213694259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6807","nonce":2213694259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6805","nonce":2213694259}]},"public_addr":"172.21.15.44:6801/2213694259","cluster_addr":"172.21.15.44:6803/2213694259","heartbeat_back_addr":"172.21.15.44:6807/2213694259","heartbeat_front_addr":"172.21.15.44:6805/2213694259","state":["exists","up"]},{"osd":2,"uuid":"37c1cc2b-60ea-449f-baa7-c65d96c3559c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6801","nonce":3413002145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6803","nonce":3413002145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6807","nonce":3413002145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6805","nonce":3413002145}]},"public_addr":"172.21.15.175:6801/3413002145","cluster_addr":"172.21.15.175:6803/3413002145","heartbeat_back_addr":"172.21.15.175:6807/3413002145","heartbeat_front_addr":"172.21.15.175:6805/3413002145","state":["exists","up"]},{"osd":3,"uuid":"a8ffd2ae-4211-492a-a8ac-d4d6cbb4a03d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6811","nonce":2528867083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6813","nonce":2528867083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6817","nonce":2528867083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6815","nonce":2528867083}]},"public_addr":"172.21.15.7:6811/2528867083","cluster_addr":"172.21.15.7:6813/2528867083","heartbeat_back_addr":"172.21.15.7:6817/2528867083","heartbeat_front_addr":"172.21.15.7:6815/2528867083","state":["exists","up"]},{"osd":4,"uuid":"9a67b2ec-1a0a-413e-bd13-9532f24a0155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6809","nonce":3537143774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537143774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537143774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537143774}]},"public_addr":"172.21.15.44:6809/3537143774","cluster_addr":"172.21.15.44:6811/3537143774","heartbeat_back_addr":"172.21.15.44:6815/3537143774","heartbeat_front_addr":"172.21.15.44:6813/3537143774","state":["exists","up"]},{"osd":5,"uuid":"436cd596-710b-48e2-8255-8427c93cee1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6809","nonce":4001214751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6811","nonce":4001214751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6815","nonce":4001214751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6813","nonce":4001214751}]},"public_addr":"172.21.15.175:6809/4001214751","cluster_addr":"172.21.15.175:6811/4001214751","heartbeat_back_addr":"172.21.15.175:6815/4001214751","heartbeat_front_addr":"172.21.15.175:6813/4001214751","state":["exists","up"]},{"osd":6,"uuid":"f5a7ad2b-6b44-4b5a-8af7-f7fb00e7ca68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6819","nonce":1261079202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6821","nonce":1261079202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6825","nonce":1261079202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6823","nonce":1261079202}]},"public_addr":"172.21.15.7:6819/1261079202","cluster_addr":"172.21.15.7:6821/1261079202","heartbeat_back_addr":"172.21.15.7:6825/1261079202","heartbeat_front_addr":"172.21.15.7:6823/1261079202","state":["exists","up"]},{"osd":7,"uuid":"aa24aee5-6449-4842-8831-1c8e06cde75b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6817","nonce":3120822957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6819","nonce":3120822957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6823","nonce":3120822957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6821","nonce":3120822957}]},"public_addr":"172.21.15.44:6817/3120822957","cluster_addr":"172.21.15.44:6819/3120822957","heartbeat_back_addr":"172.21.15.44:6823/3120822957","heartbeat_front_addr":"172.21.15.44:6821/3120822957","state":["exists","up"]},{"osd":8,"uuid":"d912501a-bb7a-489e-b6ab-e451fb22210d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6817","nonce":2080374927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6819","nonce":2080374927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6823","nonce":2080374927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6821","nonce":2080374927}]},"public_addr":"172.21.15.175:6817/2080374927","cluster_addr":"172.21.15.175:6819/2080374927","heartbeat_back_addr":"172.21.15.175:6823/2080374927","heartbeat_front_addr":"172.21.15.175:6821/2080374927","state":["exists","up"]},{"osd":9,"uuid":"d132f5b2-75b9-4d6c-89ec-f52c303e0fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6827","nonce":3808356432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6829","nonce":3808356432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6833","nonce":3808356432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6831","nonce":3808356432}]},"public_addr":"172.21.15.7:6827/3808356432","cluster_addr":"172.21.15.7:6829/3808356432","heartbeat_back_addr":"172.21.15.7:6833/3808356432","heartbeat_front_addr":"172.21.15.7:6831/3808356432","state":["exists","up"]},{"osd":10,"uuid":"f6c405d6-a255-4e0e-8528-7bbc16d5e434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6825","nonce":4009464689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6827","nonce":4009464689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6831","nonce":4009464689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6829","nonce":4009464689}]},"public_addr":"172.21.15.44:6825/4009464689","cluster_addr":"172.21.15.44:6827/4009464689","heartbeat_back_addr":"172.21.15.44:6831/4009464689","heartbeat_front_addr":"172.21.15.44:6829/4009464689","state":["exists","up"]},{"osd":11,"uuid":"a2a046cd-9939-473a-988b-6e0ad28a0233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6825","nonce":4173951310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6827","nonce":4173951310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6831","nonce":4173951310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6829","nonce":4173951310}]},"public_addr":"172.21.15.175:6825/4173951310","cluster_addr":"172.21.15.175:6827/4173951310","heartbeat_back_addr":"172.21.15.175:6831/4173951310","heartbeat_front_addr":"172.21.15.175:6829/4173951310","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:20.015497+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:44.967046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:09.682080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:35.516899+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:00.705686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:25.276387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:49.927456+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:14.786755+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:38.553913+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.962825+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.812976+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:52.837744+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6800/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/2884903597":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/4058698573":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/1429582340":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6800/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/816886708":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/4277640815":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/2695884066":"2024-09-20T08:35:31.711540+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:43:15.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.944+0000 7f67ae4e1640 1 -- 172.21.15.7:0/2549585856 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f67940a32d0 msgr2=0x7f67940a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:15.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.944+0000 7f67ae4e1640 1 --2- 172.21.15.7:0/2549585856 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f67940a32d0 0x7f67940a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6798000c00 tx=0x7f67980058d0 comp rx=0 tx=0).stop 2024-09-19T08:43:15.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.944+0000 7f67ae4e1640 1 -- 172.21.15.7:0/2549585856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67a8102ef0 msgr2=0x7f67a81a4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:15.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.944+0000 7f67ae4e1640 1 --2- 172.21.15.7:0/2549585856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67a8102ef0 0x7f67a81a4350 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f67a000cad0 tx=0x7f67a000ced0 comp rx=0 tx=0).stop 2024-09-19T08:43:15.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.944+0000 7f67ae4e1640 1 -- 172.21.15.7:0/2549585856 shutdown_connections 2024-09-19T08:43:15.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.944+0000 7f67ae4e1640 1 --2- 172.21.15.7:0/2549585856 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f67940a32d0 0x7f67940a5790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:15.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.944+0000 7f67ae4e1640 1 --2- 172.21.15.7:0/2549585856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67a8102ef0 0x7f67a81a4350 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:15.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.944+0000 7f67ae4e1640 1 --2- 172.21.15.7:0/2549585856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67a8102570 0x7f67a8199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:15.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.944+0000 7f67ae4e1640 1 --2- 172.21.15.7:0/2549585856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67a8100e20 0x7f67a81992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:15.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.944+0000 7f67ae4e1640 1 -- 172.21.15.7:0/2549585856 >> 172.21.15.7:0/2549585856 conn(0x7f67a80fc7d0 msgr2=0x7f67a8106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.944+0000 7f67ae4e1640 1 -- 172.21.15.7:0/2549585856 shutdown_connections 2024-09-19T08:43:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:15.944+0000 7f67ae4e1640 1 -- 172.21.15.7:0/2549585856 wait complete. 2024-09-19T08:43:16.607 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T08:43:16.607 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:43:16.864 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:16.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:16 smithi175 ceph-mon[35688]: pgmap v291: 97 pgs: 97 active+clean; 635 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.3 KiB/s wr, 7 op/s; 48 B/s, 0 objects/s recovering 2024-09-19T08:43:16.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:16 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/2549585856' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:16.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:16 smithi007 ceph-mon[31221]: pgmap v291: 97 pgs: 97 active+clean; 635 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.3 KiB/s wr, 7 op/s; 48 B/s, 0 objects/s recovering 2024-09-19T08:43:16.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:16 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2549585856' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:17.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:16 smithi044 ceph-mon[35072]: pgmap v291: 97 pgs: 97 active+clean; 635 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.3 KiB/s wr, 7 op/s; 48 B/s, 0 objects/s recovering 2024-09-19T08:43:17.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:16 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/2549585856' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:17.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.344+0000 7f83aa9b3640 1 -- 172.21.15.7:0/759662236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83a4106f10 msgr2=0x7f83a410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:17.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.344+0000 7f83aa9b3640 1 --2- 172.21.15.7:0/759662236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83a4106f10 0x7f83a410ea90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f839c009ca0 tx=0x7f839c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:43:17.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.344+0000 7f83aa9b3640 1 -- 172.21.15.7:0/759662236 shutdown_connections 2024-09-19T08:43:17.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.344+0000 7f83aa9b3640 1 --2- 172.21.15.7:0/759662236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83a4106f10 0x7f83a410ea90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:17.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.344+0000 7f83aa9b3640 1 --2- 172.21.15.7:0/759662236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83a4102790 0x7f83a41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:17.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.344+0000 7f83aa9b3640 1 --2- 172.21.15.7:0/759662236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83a4101de0 0x7f83a41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:17.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.344+0000 7f83aa9b3640 1 -- 172.21.15.7:0/759662236 >> 172.21.15.7:0/759662236 conn(0x7f83a40fd8c0 msgr2=0x7f83a40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:17.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.344+0000 7f83aa9b3640 1 -- 172.21.15.7:0/759662236 shutdown_connections 2024-09-19T08:43:17.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.344+0000 7f83aa9b3640 1 -- 172.21.15.7:0/759662236 wait complete. 2024-09-19T08:43:17.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.345+0000 7f83aa9b3640 1 Processor -- start 2024-09-19T08:43:17.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.345+0000 7f83aa9b3640 1 -- start start 2024-09-19T08:43:17.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.345+0000 7f83aa9b3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83a4101de0 0x7f83a4198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:17.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.345+0000 7f83aa9b3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83a4102790 0x7f83a41989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:17.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.345+0000 7f83aa9b3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83a4106f10 0x7f83a419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:17.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.345+0000 7f83aa9b3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f83a4111f70 con 0x7f83a4106f10 2024-09-19T08:43:17.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.345+0000 7f83aa9b3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f83a4111df0 con 0x7f83a4101de0 2024-09-19T08:43:17.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.345+0000 7f83aa9b3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f83a41120f0 con 0x7f83a4102790 2024-09-19T08:43:17.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.345+0000 7f83a8f50640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83a4106f10 0x7f83a419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:17.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.345+0000 7f83a8f50640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83a4106f10 0x7f83a419cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39746/0 (socket says 172.21.15.7:39746) 2024-09-19T08:43:17.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.345+0000 7f83a8f50640 1 -- 172.21.15.7:0/2321362666 learned_addr learned my addr 172.21.15.7:0/2321362666 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:17.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.345+0000 7f83a3fff640 1 --2- 172.21.15.7:0/2321362666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83a4101de0 0x7f83a4198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:17.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.345+0000 7f839bfff640 1 --2- 172.21.15.7:0/2321362666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83a4102790 0x7f83a41989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:17.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.345+0000 7f83a8f50640 1 -- 172.21.15.7:0/2321362666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83a4102790 msgr2=0x7f83a41989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:17.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.345+0000 7f83a8f50640 1 --2- 172.21.15.7:0/2321362666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83a4102790 0x7f83a41989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:17.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.345+0000 7f83a8f50640 1 -- 172.21.15.7:0/2321362666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83a4101de0 msgr2=0x7f83a4198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:17.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.345+0000 7f83a8f50640 1 --2- 172.21.15.7:0/2321362666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83a4101de0 0x7f83a4198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:17.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.345+0000 7f83a8f50640 1 -- 172.21.15.7:0/2321362666 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a419d420 con 0x7f83a4106f10 2024-09-19T08:43:17.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.346+0000 7f83a8f50640 1 --2- 172.21.15.7:0/2321362666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83a4106f10 0x7f83a419cd40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f839c031a20 tx=0x7f839c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:17.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.346+0000 7f83a1ffb640 1 -- 172.21.15.7:0/2321362666 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c003c30 con 0x7f83a4106f10 2024-09-19T08:43:17.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.346+0000 7f83a1ffb640 1 -- 172.21.15.7:0/2321362666 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f839c003dd0 con 0x7f83a4106f10 2024-09-19T08:43:17.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.346+0000 7f83aa9b3640 1 -- 172.21.15.7:0/2321362666 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a419d6b0 con 0x7f83a4106f10 2024-09-19T08:43:17.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.346+0000 7f83a1ffb640 1 -- 172.21.15.7:0/2321362666 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c02fc40 con 0x7f83a4106f10 2024-09-19T08:43:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.346+0000 7f83aa9b3640 1 -- 172.21.15.7:0/2321362666 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a41a4ff0 con 0x7f83a4106f10 2024-09-19T08:43:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.347+0000 7f83aa9b3640 1 -- 172.21.15.7:0/2321362666 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83a41021c0 con 0x7f83a4106f10 2024-09-19T08:43:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.348+0000 7f83a1ffb640 1 -- 172.21.15.7:0/2321362666 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f839c004050 con 0x7f83a4106f10 2024-09-19T08:43:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.349+0000 7f83a1ffb640 1 --2- 172.21.15.7:0/2321362666 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f83900a32d0 0x7f83900a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.349+0000 7f83a3fff640 1 --2- 172.21.15.7:0/2321362666 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f83900a32d0 0x7f83900a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.349+0000 7f83a1ffb640 1 -- 172.21.15.7:0/2321362666 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f839c0f0b20 con 0x7f83a4106f10 2024-09-19T08:43:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.349+0000 7f83a3fff640 1 --2- 172.21.15.7:0/2321362666 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f83900a32d0 0x7f83900a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8394009bd0 tx=0x7f8394005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.353+0000 7f83a1ffb640 1 -- 172.21.15.7:0/2321362666 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f839c0bd9a0 con 0x7f83a4106f10 2024-09-19T08:43:17.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.531+0000 7f83aa9b3640 1 -- 172.21.15.7:0/2321362666 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83a410a150 con 0x7f83a4106f10 2024-09-19T08:43:17.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.533+0000 7f83a1ffb640 1 -- 172.21.15.7:0/2321362666 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22634 (secure 0 0 0) 0x7f839c0bd2a0 con 0x7f83a4106f10 2024-09-19T08:43:17.533 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:43:17.533 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":82,"fsid":"ebd23124-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:02.287380+0000","modified":"2024-09-19T08:42:58.097469+0000","last_up_change":"2024-09-19T08:41:54.742978+0000","last_in_change":"2024-09-19T08:41:31.685622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:13.285118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:42:40.425852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:42:43.006548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"837e6267-71c7-4f48-9e0b-4e3f124682b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6803","nonce":402668717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6805","nonce":402668717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6809","nonce":402668717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6807","nonce":402668717}]},"public_addr":"172.21.15.7:6803/402668717","cluster_addr":"172.21.15.7:6805/402668717","heartbeat_back_addr":"172.21.15.7:6809/402668717","heartbeat_front_addr":"172.21.15.7:6807/402668717","state":["exists","up"]},{"osd":1,"uuid":"67865372-ac22-4b30-bd02-498e118d6701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6801","nonce":2213694259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6803","nonce":2213694259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6807","nonce":2213694259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6805","nonce":2213694259}]},"public_addr":"172.21.15.44:6801/2213694259","cluster_addr":"172.21.15.44:6803/2213694259","heartbeat_back_addr":"172.21.15.44:6807/2213694259","heartbeat_front_addr":"172.21.15.44:6805/2213694259","state":["exists","up"]},{"osd":2,"uuid":"37c1cc2b-60ea-449f-baa7-c65d96c3559c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6801","nonce":3413002145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6803","nonce":3413002145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6807","nonce":3413002145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6805","nonce":3413002145}]},"public_addr":"172.21.15.175:6801/3413002145","cluster_addr":"172.21.15.175:6803/3413002145","heartbeat_back_addr":"172.21.15.175:6807/3413002145","heartbeat_front_addr":"172.21.15.175:6805/3413002145","state":["exists","up"]},{"osd":3,"uuid":"a8ffd2ae-4211-492a-a8ac-d4d6cbb4a03d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6811","nonce":2528867083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6813","nonce":2528867083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6817","nonce":2528867083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6815","nonce":2528867083}]},"public_addr":"172.21.15.7:6811/2528867083","cluster_addr":"172.21.15.7:6813/2528867083","heartbeat_back_addr":"172.21.15.7:6817/2528867083","heartbeat_front_addr":"172.21.15.7:6815/2528867083","state":["exists","up"]},{"osd":4,"uuid":"9a67b2ec-1a0a-413e-bd13-9532f24a0155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6809","nonce":3537143774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537143774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537143774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537143774}]},"public_addr":"172.21.15.44:6809/3537143774","cluster_addr":"172.21.15.44:6811/3537143774","heartbeat_back_addr":"172.21.15.44:6815/3537143774","heartbeat_front_addr":"172.21.15.44:6813/3537143774","state":["exists","up"]},{"osd":5,"uuid":"436cd596-710b-48e2-8255-8427c93cee1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6809","nonce":4001214751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6811","nonce":4001214751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6815","nonce":4001214751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6813","nonce":4001214751}]},"public_addr":"172.21.15.175:6809/4001214751","cluster_addr":"172.21.15.175:6811/4001214751","heartbeat_back_addr":"172.21.15.175:6815/4001214751","heartbeat_front_addr":"172.21.15.175:6813/4001214751","state":["exists","up"]},{"osd":6,"uuid":"f5a7ad2b-6b44-4b5a-8af7-f7fb00e7ca68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6819","nonce":1261079202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6821","nonce":1261079202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6825","nonce":1261079202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6823","nonce":1261079202}]},"public_addr":"172.21.15.7:6819/1261079202","cluster_addr":"172.21.15.7:6821/1261079202","heartbeat_back_addr":"172.21.15.7:6825/1261079202","heartbeat_front_addr":"172.21.15.7:6823/1261079202","state":["exists","up"]},{"osd":7,"uuid":"aa24aee5-6449-4842-8831-1c8e06cde75b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6817","nonce":3120822957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6819","nonce":3120822957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6823","nonce":3120822957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6821","nonce":3120822957}]},"public_addr":"172.21.15.44:6817/3120822957","cluster_addr":"172.21.15.44:6819/3120822957","heartbeat_back_addr":"172.21.15.44:6823/3120822957","heartbeat_front_addr":"172.21.15.44:6821/3120822957","state":["exists","up"]},{"osd":8,"uuid":"d912501a-bb7a-489e-b6ab-e451fb22210d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6817","nonce":2080374927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6819","nonce":2080374927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6823","nonce":2080374927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6821","nonce":2080374927}]},"public_addr":"172.21.15.175:6817/2080374927","cluster_addr":"172.21.15.175:6819/2080374927","heartbeat_back_addr":"172.21.15.175:6823/2080374927","heartbeat_front_addr":"172.21.15.175:6821/2080374927","state":["exists","up"]},{"osd":9,"uuid":"d132f5b2-75b9-4d6c-89ec-f52c303e0fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6827","nonce":3808356432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6829","nonce":3808356432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6833","nonce":3808356432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6831","nonce":3808356432}]},"public_addr":"172.21.15.7:6827/3808356432","cluster_addr":"172.21.15.7:6829/3808356432","heartbeat_back_addr":"172.21.15.7:6833/3808356432","heartbeat_front_addr":"172.21.15.7:6831/3808356432","state":["exists","up"]},{"osd":10,"uuid":"f6c405d6-a255-4e0e-8528-7bbc16d5e434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6825","nonce":4009464689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6827","nonce":4009464689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6831","nonce":4009464689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6829","nonce":4009464689}]},"public_addr":"172.21.15.44:6825/4009464689","cluster_addr":"172.21.15.44:6827/4009464689","heartbeat_back_addr":"172.21.15.44:6831/4009464689","heartbeat_front_addr":"172.21.15.44:6829/4009464689","state":["exists","up"]},{"osd":11,"uuid":"a2a046cd-9939-473a-988b-6e0ad28a0233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6825","nonce":4173951310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6827","nonce":4173951310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6831","nonce":4173951310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6829","nonce":4173951310}]},"public_addr":"172.21.15.175:6825/4173951310","cluster_addr":"172.21.15.175:6827/4173951310","heartbeat_back_addr":"172.21.15.175:6831/4173951310","heartbeat_front_addr":"172.21.15.175:6829/4173951310","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:20.015497+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:44.967046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:09.682080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:35.516899+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:00.705686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:25.276387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:49.927456+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:14.786755+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:38.553913+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.962825+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.812976+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:52.837744+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6800/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/2884903597":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/4058698573":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/1429582340":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6800/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/816886708":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/4277640815":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/2695884066":"2024-09-20T08:35:31.711540+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:43:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.535+0000 7f83aa9b3640 1 -- 172.21.15.7:0/2321362666 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f83900a32d0 msgr2=0x7f83900a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.535+0000 7f83aa9b3640 1 --2- 172.21.15.7:0/2321362666 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f83900a32d0 0x7f83900a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8394009bd0 tx=0x7f8394005f90 comp rx=0 tx=0).stop 2024-09-19T08:43:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.535+0000 7f83aa9b3640 1 -- 172.21.15.7:0/2321362666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83a4106f10 msgr2=0x7f83a419cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.535+0000 7f83aa9b3640 1 --2- 172.21.15.7:0/2321362666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83a4106f10 0x7f83a419cd40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f839c031a20 tx=0x7f839c031a50 comp rx=0 tx=0).stop 2024-09-19T08:43:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.535+0000 7f83aa9b3640 1 -- 172.21.15.7:0/2321362666 shutdown_connections 2024-09-19T08:43:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.535+0000 7f83aa9b3640 1 --2- 172.21.15.7:0/2321362666 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f83900a32d0 0x7f83900a5790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.535+0000 7f83aa9b3640 1 --2- 172.21.15.7:0/2321362666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83a4106f10 0x7f83a419cd40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.535+0000 7f83aa9b3640 1 --2- 172.21.15.7:0/2321362666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83a4102790 0x7f83a41989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:17.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.535+0000 7f83aa9b3640 1 --2- 172.21.15.7:0/2321362666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83a4101de0 0x7f83a4198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:17.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.535+0000 7f83aa9b3640 1 -- 172.21.15.7:0/2321362666 >> 172.21.15.7:0/2321362666 conn(0x7f83a40fd8c0 msgr2=0x7f83a40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:17.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.535+0000 7f83aa9b3640 1 -- 172.21.15.7:0/2321362666 shutdown_connections 2024-09-19T08:43:17.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:17.535+0000 7f83aa9b3640 1 -- 172.21.15.7:0/2321362666 wait complete. 2024-09-19T08:43:17.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:17 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2321362666' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:17.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:17 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/2321362666' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:18.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:17 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/2321362666' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:18.086 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T08:43:18.086 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T08:43:18.087 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T08:43:18.087 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T08:43:18.087 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T08:43:18.088 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T08:43:18.088 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T08:43:18.089 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T08:43:18.090 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T08:43:18.090 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T08:43:18.091 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T08:43:18.091 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T08:43:18.735 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:18.803 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:18.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:18 smithi175 ceph-mon[35688]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.7 KiB/s wr, 8 op/s 2024-09-19T08:43:18.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:18 smithi007 ceph-mon[31221]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.7 KiB/s wr, 8 op/s 2024-09-19T08:43:19.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:18 smithi044 ceph-mon[35072]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.7 KiB/s wr, 8 op/s 2024-09-19T08:43:19.140 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:19.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.466+0000 7f4fd533d640 1 -- 172.21.15.7:0/147225998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fd0106a90 msgr2=0x7f4fd0106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:19.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.466+0000 7f4fd533d640 1 --2- 172.21.15.7:0/147225998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fd0106a90 0x7f4fd0106e70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009930 tx=0x7f4fc002a420 comp rx=0 tx=0).stop 2024-09-19T08:43:19.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.466+0000 7f4fd533d640 1 -- 172.21.15.7:0/147225998 shutdown_connections 2024-09-19T08:43:19.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.466+0000 7f4fd533d640 1 --2- 172.21.15.7:0/147225998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fd0101430 0x7f4fd010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:19.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.466+0000 7f4fd533d640 1 --2- 172.21.15.7:0/147225998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4fd0100a90 0x7f4fd0100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:19.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.466+0000 7f4fd533d640 1 --2- 172.21.15.7:0/147225998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fd0106a90 0x7f4fd0106e70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:19.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.466+0000 7f4fd533d640 1 -- 172.21.15.7:0/147225998 >> 172.21.15.7:0/147225998 conn(0x7f4fd00fc7d0 msgr2=0x7f4fd00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.466+0000 7f4fd533d640 1 -- 172.21.15.7:0/147225998 shutdown_connections 2024-09-19T08:43:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.466+0000 7f4fd533d640 1 -- 172.21.15.7:0/147225998 wait complete. 2024-09-19T08:43:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.466+0000 7f4fd533d640 1 Processor -- start 2024-09-19T08:43:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.467+0000 7f4fd533d640 1 -- start start 2024-09-19T08:43:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.467+0000 7f4fd533d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fd0100a90 0x7f4fd01984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.467+0000 7f4fd533d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fd0101430 0x7f4fd0198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.467+0000 7f4fd533d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4fd0106a90 0x7f4fd019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.467+0000 7f4fd533d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd0110eb0 con 0x7f4fd0101430 2024-09-19T08:43:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.467+0000 7f4fd533d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd0110d30 con 0x7f4fd0106a90 2024-09-19T08:43:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.467+0000 7f4fd533d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd0111030 con 0x7f4fd0100a90 2024-09-19T08:43:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.467+0000 7f4fce7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fd0101430 0x7f4fd0198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.467+0000 7f4fce7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fd0101430 0x7f4fd0198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39752/0 (socket says 172.21.15.7:39752) 2024-09-19T08:43:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.467+0000 7f4fce7fc640 1 -- 172.21.15.7:0/1785431076 learned_addr learned my addr 172.21.15.7:0/1785431076 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.467+0000 7f4fcf7fe640 1 --2- 172.21.15.7:0/1785431076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4fd0106a90 0x7f4fd019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.467+0000 7f4fceffd640 1 --2- 172.21.15.7:0/1785431076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fd0100a90 0x7f4fd01984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.467+0000 7f4fce7fc640 1 -- 172.21.15.7:0/1785431076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fd0100a90 msgr2=0x7f4fd01984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.467+0000 7f4fce7fc640 1 --2- 172.21.15.7:0/1785431076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fd0100a90 0x7f4fd01984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.467+0000 7f4fce7fc640 1 -- 172.21.15.7:0/1785431076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4fd0106a90 msgr2=0x7f4fd019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.467+0000 7f4fce7fc640 1 --2- 172.21.15.7:0/1785431076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4fd0106a90 0x7f4fd019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.467+0000 7f4fce7fc640 1 -- 172.21.15.7:0/1785431076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd019d480 con 0x7f4fd0101430 2024-09-19T08:43:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.468+0000 7f4fce7fc640 1 --2- 172.21.15.7:0/1785431076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fd0101430 0x7f4fd0198a10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800eab0 tx=0x7f4fb800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.468+0000 7f4fc7fff640 1 -- 172.21.15.7:0/1785431076 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb800ce40 con 0x7f4fd0101430 2024-09-19T08:43:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.468+0000 7f4fc7fff640 1 -- 172.21.15.7:0/1785431076 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fb8011950 con 0x7f4fd0101430 2024-09-19T08:43:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.468+0000 7f4fd533d640 1 -- 172.21.15.7:0/1785431076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd019d770 con 0x7f4fd0101430 2024-09-19T08:43:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.468+0000 7f4fc7fff640 1 -- 172.21.15.7:0/1785431076 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8010ae0 con 0x7f4fd0101430 2024-09-19T08:43:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.468+0000 7f4fd533d640 1 -- 172.21.15.7:0/1785431076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd01a5050 con 0x7f4fd0101430 2024-09-19T08:43:19.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.469+0000 7f4fd533d640 1 -- 172.21.15.7:0/1785431076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4fd0062980 con 0x7f4fd0101430 2024-09-19T08:43:19.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.470+0000 7f4fc7fff640 1 -- 172.21.15.7:0/1785431076 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f4fb8011b00 con 0x7f4fd0101430 2024-09-19T08:43:19.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.471+0000 7f4fc7fff640 1 --2- 172.21.15.7:0/1785431076 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4fbc0a32d0 0x7f4fbc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:19.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.471+0000 7f4fc7fff640 1 -- 172.21.15.7:0/1785431076 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4fb80d00b0 con 0x7f4fd0101430 2024-09-19T08:43:19.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.471+0000 7f4fceffd640 1 --2- 172.21.15.7:0/1785431076 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4fbc0a32d0 0x7f4fbc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:19.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.471+0000 7f4fc7fff640 1 --2- 172.21.15.7:0/1785431076 >> [v2:172.21.15.175:6800/3413002145,v1:172.21.15.175:6801/3413002145] conn(0x7f4fbc0acf00 0x7f4fbc0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:19.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.471+0000 7f4fc7fff640 1 -- 172.21.15.7:0/1785431076 --> [v2:172.21.15.175:6800/3413002145,v1:172.21.15.175:6801/3413002145] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4fb8014ec0 con 0x7f4fbc0acf00 2024-09-19T08:43:19.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.471+0000 7f4fc7fff640 1 -- 172.21.15.7:0/1785431076 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f4fb80d04e0 con 0x7f4fd0101430 2024-09-19T08:43:19.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.472+0000 7f4fceffd640 1 --2- 172.21.15.7:0/1785431076 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4fbc0a32d0 0x7f4fbc0a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009900 tx=0x7f4fc00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:19.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.472+0000 7f4fcf7fe640 1 --2- 172.21.15.7:0/1785431076 >> [v2:172.21.15.175:6800/3413002145,v1:172.21.15.175:6801/3413002145] conn(0x7f4fbc0acf00 0x7f4fbc0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:19.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.472+0000 7f4fcf7fe640 1 --2- 172.21.15.7:0/1785431076 >> [v2:172.21.15.175:6800/3413002145,v1:172.21.15.175:6801/3413002145] conn(0x7f4fbc0acf00 0x7f4fbc0af3a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:19.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.473+0000 7f4fc7fff640 1 -- 172.21.15.7:0/1785431076 <== osd.2 v2:172.21.15.175:6800/3413002145 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4fb8014ec0 con 0x7f4fbc0acf00 2024-09-19T08:43:19.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.487+0000 7f4fd533d640 1 -- 172.21.15.7:0/1785431076 --> [v2:172.21.15.175:6800/3413002145,v1:172.21.15.175:6801/3413002145] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4fd0062e00 con 0x7f4fbc0acf00 2024-09-19T08:43:19.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.487+0000 7f4fc7fff640 1 -- 172.21.15.7:0/1785431076 <== osd.2 v2:172.21.15.175:6800/3413002145 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4fd0062e00 con 0x7f4fbc0acf00 2024-09-19T08:43:19.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.488+0000 7f4fd533d640 1 -- 172.21.15.7:0/1785431076 >> [v2:172.21.15.175:6800/3413002145,v1:172.21.15.175:6801/3413002145] conn(0x7f4fbc0acf00 msgr2=0x7f4fbc0af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:19.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.488+0000 7f4fd533d640 1 --2- 172.21.15.7:0/1785431076 >> [v2:172.21.15.175:6800/3413002145,v1:172.21.15.175:6801/3413002145] conn(0x7f4fbc0acf00 0x7f4fbc0af3a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:19.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.488+0000 7f4fd533d640 1 -- 172.21.15.7:0/1785431076 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4fbc0a32d0 msgr2=0x7f4fbc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:19.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.488+0000 7f4fd533d640 1 --2- 172.21.15.7:0/1785431076 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f4fbc0a32d0 0x7f4fbc0a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009900 tx=0x7f4fc00058d0 comp rx=0 tx=0).stop 2024-09-19T08:43:19.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.488+0000 7f4fd533d640 1 -- 172.21.15.7:0/1785431076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fd0101430 msgr2=0x7f4fd0198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:19.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.488+0000 7f4fd533d640 1 --2- 172.21.15.7:0/1785431076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fd0101430 0x7f4fd0198a10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800eab0 tx=0x7f4fb800ef70 comp rx=0 tx=0).stop 2024-09-19T08:43:19.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.488+0000 7f4fcf7fe640 1 -- 172.21.15.7:0/1785431076 reap_dead start 2024-09-19T08:43:19.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.488+0000 7f4fd533d640 1 -- 172.21.15.7:0/1785431076 shutdown_connections 2024-09-19T08:43:19.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.488+0000 7f4fd533d640 1 -- 172.21.15.7:0/1785431076 >> 172.21.15.7:0/1785431076 conn(0x7f4fd00fc7d0 msgr2=0x7f4fd006aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:19.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.488+0000 7f4fd533d640 1 -- 172.21.15.7:0/1785431076 shutdown_connections 2024-09-19T08:43:19.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:19.488+0000 7f4fd533d640 1 -- 172.21.15.7:0/1785431076 wait complete. 2024-09-19T08:43:19.878 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:19.878 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:19.879 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:20.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.421+0000 7f39a6263640 1 -- 172.21.15.7:0/2901464113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39a0100e20 msgr2=0x7f39a0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:20.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.421+0000 7f39a6263640 1 --2- 172.21.15.7:0/2901464113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39a0100e20 0x7f39a0101200 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3990009900 tx=0x7f399002a480 comp rx=0 tx=0).stop 2024-09-19T08:43:20.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.421+0000 7f39a6263640 1 -- 172.21.15.7:0/2901464113 shutdown_connections 2024-09-19T08:43:20.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.421+0000 7f39a6263640 1 --2- 172.21.15.7:0/2901464113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a0102ef0 0x7f39a010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:20.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.421+0000 7f39a6263640 1 --2- 172.21.15.7:0/2901464113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39a0102570 0x7f39a01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:20.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.421+0000 7f39a6263640 1 --2- 172.21.15.7:0/2901464113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39a0100e20 0x7f39a0101200 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:20.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.421+0000 7f39a6263640 1 -- 172.21.15.7:0/2901464113 >> 172.21.15.7:0/2901464113 conn(0x7f39a00fc7d0 msgr2=0x7f39a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:20.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.421+0000 7f39a6263640 1 -- 172.21.15.7:0/2901464113 shutdown_connections 2024-09-19T08:43:20.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.421+0000 7f39a6263640 1 -- 172.21.15.7:0/2901464113 wait complete. 2024-09-19T08:43:20.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.422+0000 7f39a6263640 1 Processor -- start 2024-09-19T08:43:20.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.422+0000 7f39a6263640 1 -- start start 2024-09-19T08:43:20.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.422+0000 7f39a6263640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a0100e20 0x7f39a0198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:20.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.422+0000 7f39a6263640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39a0102570 0x7f39a0198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:20.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.422+0000 7f39a6263640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39a0102ef0 0x7f39a019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:20.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.422+0000 7f39a6263640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f39a01120a0 con 0x7f39a0102570 2024-09-19T08:43:20.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.422+0000 7f39a6263640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f39a0111f20 con 0x7f39a0100e20 2024-09-19T08:43:20.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.422+0000 7f39a6263640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f39a0112220 con 0x7f39a0102ef0 2024-09-19T08:43:20.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.423+0000 7f399f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39a0102570 0x7f39a0198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:20.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.423+0000 7f399f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39a0102570 0x7f39a0198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39770/0 (socket says 172.21.15.7:39770) 2024-09-19T08:43:20.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.423+0000 7f399f7fe640 1 -- 172.21.15.7:0/922302677 learned_addr learned my addr 172.21.15.7:0/922302677 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:20.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.423+0000 7f399ffff640 1 --2- 172.21.15.7:0/922302677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a0100e20 0x7f39a0198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:20.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.423+0000 7f39a4800640 1 --2- 172.21.15.7:0/922302677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39a0102ef0 0x7f39a019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:20.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.423+0000 7f399f7fe640 1 -- 172.21.15.7:0/922302677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39a0102ef0 msgr2=0x7f39a019ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:20.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.423+0000 7f399f7fe640 1 --2- 172.21.15.7:0/922302677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39a0102ef0 0x7f39a019ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:20.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.423+0000 7f399f7fe640 1 -- 172.21.15.7:0/922302677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a0100e20 msgr2=0x7f39a0198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:20.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.423+0000 7f399f7fe640 1 --2- 172.21.15.7:0/922302677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a0100e20 0x7f39a0198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:20.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.423+0000 7f399f7fe640 1 -- 172.21.15.7:0/922302677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a019d5b0 con 0x7f39a0102570 2024-09-19T08:43:20.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.423+0000 7f399f7fe640 1 --2- 172.21.15.7:0/922302677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39a0102570 0x7f39a0198b40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f398800d770 tx=0x7f398800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:20.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.423+0000 7f399d7fa640 1 -- 172.21.15.7:0/922302677 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3988017070 con 0x7f39a0102570 2024-09-19T08:43:20.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.423+0000 7f399d7fa640 1 -- 172.21.15.7:0/922302677 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3988005500 con 0x7f39a0102570 2024-09-19T08:43:20.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.423+0000 7f399d7fa640 1 -- 172.21.15.7:0/922302677 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3988004e00 con 0x7f39a0102570 2024-09-19T08:43:20.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.423+0000 7f39a6263640 1 -- 172.21.15.7:0/922302677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a019d8a0 con 0x7f39a0102570 2024-09-19T08:43:20.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.423+0000 7f39a6263640 1 -- 172.21.15.7:0/922302677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a01a5180 con 0x7f39a0102570 2024-09-19T08:43:20.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.424+0000 7f39a6263640 1 -- 172.21.15.7:0/922302677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f39a0062900 con 0x7f39a0102570 2024-09-19T08:43:20.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.426+0000 7f399d7fa640 1 -- 172.21.15.7:0/922302677 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3988004fa0 con 0x7f39a0102570 2024-09-19T08:43:20.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.426+0000 7f399d7fa640 1 --2- 172.21.15.7:0/922302677 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f398c0a32d0 0x7f398c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:20.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.427+0000 7f399ffff640 1 --2- 172.21.15.7:0/922302677 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f398c0a32d0 0x7f398c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:20.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.427+0000 7f399d7fa640 1 -- 172.21.15.7:0/922302677 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f39880cf470 con 0x7f39a0102570 2024-09-19T08:43:20.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.427+0000 7f399d7fa640 1 --2- 172.21.15.7:0/922302677 >> [v2:172.21.15.44:6808/3537143774,v1:172.21.15.44:6809/3537143774] conn(0x7f398c0acf00 0x7f398c0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:20.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.427+0000 7f399d7fa640 1 -- 172.21.15.7:0/922302677 --> [v2:172.21.15.44:6808/3537143774,v1:172.21.15.44:6809/3537143774] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f398801ee50 con 0x7f398c0acf00 2024-09-19T08:43:20.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.427+0000 7f399d7fa640 1 -- 172.21.15.7:0/922302677 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f39880d6050 con 0x7f39a0102570 2024-09-19T08:43:20.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.427+0000 7f39a4800640 1 --2- 172.21.15.7:0/922302677 >> [v2:172.21.15.44:6808/3537143774,v1:172.21.15.44:6809/3537143774] conn(0x7f398c0acf00 0x7f398c0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:20.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.427+0000 7f399ffff640 1 --2- 172.21.15.7:0/922302677 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f398c0a32d0 0x7f398c0a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3990009230 tx=0x7f39900058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:20.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.428+0000 7f39a4800640 1 --2- 172.21.15.7:0/922302677 >> [v2:172.21.15.44:6808/3537143774,v1:172.21.15.44:6809/3537143774] conn(0x7f398c0acf00 0x7f398c0af3a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:20.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.428+0000 7f399d7fa640 1 -- 172.21.15.7:0/922302677 <== osd.4 v2:172.21.15.44:6808/3537143774 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f398801ee50 con 0x7f398c0acf00 2024-09-19T08:43:20.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.454+0000 7f39a6263640 1 -- 172.21.15.7:0/922302677 --> [v2:172.21.15.44:6808/3537143774,v1:172.21.15.44:6809/3537143774] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f39a0062d80 con 0x7f398c0acf00 2024-09-19T08:43:20.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.455+0000 7f399d7fa640 1 -- 172.21.15.7:0/922302677 <== osd.4 v2:172.21.15.44:6808/3537143774 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f39a0062d80 con 0x7f398c0acf00 2024-09-19T08:43:20.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.455+0000 7f39a6263640 1 -- 172.21.15.7:0/922302677 >> [v2:172.21.15.44:6808/3537143774,v1:172.21.15.44:6809/3537143774] conn(0x7f398c0acf00 msgr2=0x7f398c0af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:20.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.455+0000 7f39a6263640 1 --2- 172.21.15.7:0/922302677 >> [v2:172.21.15.44:6808/3537143774,v1:172.21.15.44:6809/3537143774] conn(0x7f398c0acf00 0x7f398c0af3a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:20.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.455+0000 7f39a6263640 1 -- 172.21.15.7:0/922302677 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f398c0a32d0 msgr2=0x7f398c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:20.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.455+0000 7f39a6263640 1 --2- 172.21.15.7:0/922302677 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f398c0a32d0 0x7f398c0a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3990009230 tx=0x7f39900058d0 comp rx=0 tx=0).stop 2024-09-19T08:43:20.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.455+0000 7f39a6263640 1 -- 172.21.15.7:0/922302677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39a0102570 msgr2=0x7f39a0198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:20.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.455+0000 7f39a6263640 1 --2- 172.21.15.7:0/922302677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39a0102570 0x7f39a0198b40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f398800d770 tx=0x7f398800dc30 comp rx=0 tx=0).stop 2024-09-19T08:43:20.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.455+0000 7f39a4800640 1 -- 172.21.15.7:0/922302677 reap_dead start 2024-09-19T08:43:20.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.455+0000 7f39a6263640 1 -- 172.21.15.7:0/922302677 shutdown_connections 2024-09-19T08:43:20.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.455+0000 7f39a6263640 1 -- 172.21.15.7:0/922302677 >> 172.21.15.7:0/922302677 conn(0x7f39a00fc7d0 msgr2=0x7f39a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:20.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.455+0000 7f39a6263640 1 -- 172.21.15.7:0/922302677 shutdown_connections 2024-09-19T08:43:20.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:20.455+0000 7f39a6263640 1 -- 172.21.15.7:0/922302677 wait complete. 2024-09-19T08:43:20.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:20 smithi175 ceph-mon[35688]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T08:43:21.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:20 smithi007 ceph-mon[31221]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T08:43:21.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:20 smithi044 ceph-mon[35072]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T08:43:21.434 INFO:teuthology.orchestra.run.smithi007.stdout:137438953527 2024-09-19T08:43:21.434 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T08:43:21.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.621+0000 7f0e782c5640 1 -- 172.21.15.7:0/2491987729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e70102ef0 msgr2=0x7f0e7010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:21.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.621+0000 7f0e782c5640 1 --2- 172.21.15.7:0/2491987729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e70102ef0 0x7f0e7010da40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0e68009ca0 tx=0x7f0e6802a950 comp rx=0 tx=0).stop 2024-09-19T08:43:21.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.621+0000 7f0e782c5640 1 -- 172.21.15.7:0/2491987729 shutdown_connections 2024-09-19T08:43:21.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.621+0000 7f0e782c5640 1 --2- 172.21.15.7:0/2491987729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e70102ef0 0x7f0e7010da40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:21.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.621+0000 7f0e782c5640 1 --2- 172.21.15.7:0/2491987729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e70102570 0x7f0e701029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:21.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.621+0000 7f0e782c5640 1 --2- 172.21.15.7:0/2491987729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e70100e20 0x7f0e70101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:21.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.621+0000 7f0e782c5640 1 -- 172.21.15.7:0/2491987729 >> 172.21.15.7:0/2491987729 conn(0x7f0e700fc7d0 msgr2=0x7f0e700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:21.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.621+0000 7f0e782c5640 1 -- 172.21.15.7:0/2491987729 shutdown_connections 2024-09-19T08:43:21.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.621+0000 7f0e782c5640 1 -- 172.21.15.7:0/2491987729 wait complete. 2024-09-19T08:43:21.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.621+0000 7f0e782c5640 1 Processor -- start 2024-09-19T08:43:21.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.622+0000 7f0e782c5640 1 -- start start 2024-09-19T08:43:21.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.622+0000 7f0e782c5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e70100e20 0x7f0e700fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:21.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.622+0000 7f0e782c5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e70102570 0x7f0e700fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:21.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.622+0000 7f0e782c5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e70102ef0 0x7f0e700fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:21.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.622+0000 7f0e782c5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0e70110f80 con 0x7f0e70102570 2024-09-19T08:43:21.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.622+0000 7f0e782c5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0e70110e00 con 0x7f0e70102ef0 2024-09-19T08:43:21.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.622+0000 7f0e782c5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0e70111100 con 0x7f0e70100e20 2024-09-19T08:43:21.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.622+0000 7f0e75860640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e70102570 0x7f0e700fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:21.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.622+0000 7f0e75860640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e70102570 0x7f0e700fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39796/0 (socket says 172.21.15.7:39796) 2024-09-19T08:43:21.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.622+0000 7f0e75860640 1 -- 172.21.15.7:0/3458089021 learned_addr learned my addr 172.21.15.7:0/3458089021 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:21.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.622+0000 7f0e76862640 1 --2- 172.21.15.7:0/3458089021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e70102ef0 0x7f0e700fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:21.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.622+0000 7f0e76061640 1 --2- 172.21.15.7:0/3458089021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e70100e20 0x7f0e700fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:21.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.622+0000 7f0e75860640 1 -- 172.21.15.7:0/3458089021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e70100e20 msgr2=0x7f0e700fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:21.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.622+0000 7f0e75860640 1 --2- 172.21.15.7:0/3458089021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e70100e20 0x7f0e700fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:21.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.622+0000 7f0e75860640 1 -- 172.21.15.7:0/3458089021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e70102ef0 msgr2=0x7f0e700fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:21.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.622+0000 7f0e75860640 1 --2- 172.21.15.7:0/3458089021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e70102ef0 0x7f0e700fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:21.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.622+0000 7f0e75860640 1 -- 172.21.15.7:0/3458089021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e701a6920 con 0x7f0e70102570 2024-09-19T08:43:21.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.622+0000 7f0e76862640 1 --2- 172.21.15.7:0/3458089021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e70102ef0 0x7f0e700fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:43:21.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.623+0000 7f0e75860640 1 --2- 172.21.15.7:0/3458089021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e70102570 0x7f0e700fd1c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000e9f0 tx=0x7f0e6000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:21.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.623+0000 7f0e677fe640 1 -- 172.21.15.7:0/3458089021 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6000cd80 con 0x7f0e70102570 2024-09-19T08:43:21.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.623+0000 7f0e782c5640 1 -- 172.21.15.7:0/3458089021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e701a6c10 con 0x7f0e70102570 2024-09-19T08:43:21.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.623+0000 7f0e677fe640 1 -- 172.21.15.7:0/3458089021 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e60010910 con 0x7f0e70102570 2024-09-19T08:43:21.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.623+0000 7f0e677fe640 1 -- 172.21.15.7:0/3458089021 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e600188f0 con 0x7f0e70102570 2024-09-19T08:43:21.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.623+0000 7f0e782c5640 1 -- 172.21.15.7:0/3458089021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e701a71a0 con 0x7f0e70102570 2024-09-19T08:43:21.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.624+0000 7f0e782c5640 1 -- 172.21.15.7:0/3458089021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0e70062940 con 0x7f0e70102570 2024-09-19T08:43:21.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.625+0000 7f0e677fe640 1 -- 172.21.15.7:0/3458089021 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f0e60010430 con 0x7f0e70102570 2024-09-19T08:43:21.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.626+0000 7f0e677fe640 1 --2- 172.21.15.7:0/3458089021 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0e5c0a32d0 0x7f0e5c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:21.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.626+0000 7f0e677fe640 1 -- 172.21.15.7:0/3458089021 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0e600d0930 con 0x7f0e70102570 2024-09-19T08:43:21.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.626+0000 7f0e76061640 1 --2- 172.21.15.7:0/3458089021 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0e5c0a32d0 0x7f0e5c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:21.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.626+0000 7f0e677fe640 1 --2- 172.21.15.7:0/3458089021 >> [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717] conn(0x7f0e5c0acf00 0x7f0e5c0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:21.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.626+0000 7f0e677fe640 1 -- 172.21.15.7:0/3458089021 --> [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e6001bec0 con 0x7f0e5c0acf00 2024-09-19T08:43:21.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.626+0000 7f0e677fe640 1 -- 172.21.15.7:0/3458089021 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f0e600d0ce0 con 0x7f0e70102570 2024-09-19T08:43:21.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.626+0000 7f0e76862640 1 --2- 172.21.15.7:0/3458089021 >> [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717] conn(0x7f0e5c0acf00 0x7f0e5c0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:21.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.626+0000 7f0e76061640 1 --2- 172.21.15.7:0/3458089021 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0e5c0a32d0 0x7f0e5c0a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c0058c0 tx=0x7f0e6c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:21.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.627+0000 7f0e76862640 1 --2- 172.21.15.7:0/3458089021 >> [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717] conn(0x7f0e5c0acf00 0x7f0e5c0af3a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:21.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.627+0000 7f0e677fe640 1 -- 172.21.15.7:0/3458089021 <== osd.0 v2:172.21.15.7:6802/402668717 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0e6001bec0 con 0x7f0e5c0acf00 2024-09-19T08:43:21.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.642+0000 7f0e782c5640 1 -- 172.21.15.7:0/3458089021 --> [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0e70062d40 con 0x7f0e5c0acf00 2024-09-19T08:43:21.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.643+0000 7f0e677fe640 1 -- 172.21.15.7:0/3458089021 <== osd.0 v2:172.21.15.7:6802/402668717 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0e70062d40 con 0x7f0e5c0acf00 2024-09-19T08:43:21.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.643+0000 7f0e782c5640 1 -- 172.21.15.7:0/3458089021 >> [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717] conn(0x7f0e5c0acf00 msgr2=0x7f0e5c0af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:21.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.643+0000 7f0e782c5640 1 --2- 172.21.15.7:0/3458089021 >> [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717] conn(0x7f0e5c0acf00 0x7f0e5c0af3a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:21.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.644+0000 7f0e782c5640 1 -- 172.21.15.7:0/3458089021 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0e5c0a32d0 msgr2=0x7f0e5c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:21.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.644+0000 7f0e782c5640 1 --2- 172.21.15.7:0/3458089021 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0e5c0a32d0 0x7f0e5c0a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c0058c0 tx=0x7f0e6c00a2d0 comp rx=0 tx=0).stop 2024-09-19T08:43:21.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.644+0000 7f0e782c5640 1 -- 172.21.15.7:0/3458089021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e70102570 msgr2=0x7f0e700fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:21.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.644+0000 7f0e782c5640 1 --2- 172.21.15.7:0/3458089021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e70102570 0x7f0e700fd1c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000e9f0 tx=0x7f0e6000eeb0 comp rx=0 tx=0).stop 2024-09-19T08:43:21.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.644+0000 7f0e76862640 1 -- 172.21.15.7:0/3458089021 reap_dead start 2024-09-19T08:43:21.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.644+0000 7f0e782c5640 1 -- 172.21.15.7:0/3458089021 shutdown_connections 2024-09-19T08:43:21.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.644+0000 7f0e782c5640 1 -- 172.21.15.7:0/3458089021 >> 172.21.15.7:0/3458089021 conn(0x7f0e700fc7d0 msgr2=0x7f0e7006a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:21.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.644+0000 7f0e782c5640 1 -- 172.21.15.7:0/3458089021 shutdown_connections 2024-09-19T08:43:21.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:21.644+0000 7f0e782c5640 1 -- 172.21.15.7:0/3458089021 wait complete. 2024-09-19T08:43:22.490 INFO:teuthology.orchestra.run.smithi007.stdout:34359738443 2024-09-19T08:43:22.490 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T08:43:22.740 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:22 smithi007 ceph-mon[31221]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-19T08:43:22.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:22 smithi175 ceph-mon[35688]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-19T08:43:23.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:22 smithi044 ceph-mon[35072]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-19T08:43:23.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.070+0000 7f9575051640 1 -- 172.21.15.7:0/3175340669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9570103780 msgr2=0x7f9570107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:23.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.070+0000 7f9575051640 1 --2- 172.21.15.7:0/3175340669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9570103780 0x7f9570107bc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9564009930 tx=0x7f956402a420 comp rx=0 tx=0).stop 2024-09-19T08:43:23.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.071+0000 7f9575051640 1 -- 172.21.15.7:0/3175340669 shutdown_connections 2024-09-19T08:43:23.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.071+0000 7f9575051640 1 --2- 172.21.15.7:0/3175340669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9570108300 0x7f957010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.071+0000 7f9575051640 1 --2- 172.21.15.7:0/3175340669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9570103780 0x7f9570107bc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.071+0000 7f9575051640 1 --2- 172.21.15.7:0/3175340669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9570102dd0 0x7f95701031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.071+0000 7f9575051640 1 -- 172.21.15.7:0/3175340669 >> 172.21.15.7:0/3175340669 conn(0x7f95700fc7d0 msgr2=0x7f95700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:23.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.071+0000 7f9575051640 1 -- 172.21.15.7:0/3175340669 shutdown_connections 2024-09-19T08:43:23.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.071+0000 7f9575051640 1 -- 172.21.15.7:0/3175340669 wait complete. 2024-09-19T08:43:23.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.071+0000 7f9575051640 1 Processor -- start 2024-09-19T08:43:23.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.072+0000 7f9575051640 1 -- start start 2024-09-19T08:43:23.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.072+0000 7f9575051640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9570102dd0 0x7f9570100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:23.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.072+0000 7f9575051640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9570103780 0x7f9570100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:23.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.072+0000 7f9575051640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9570108300 0x7f95701014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:23.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.072+0000 7f9575051640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9570112070 con 0x7f9570103780 2024-09-19T08:43:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.072+0000 7f9575051640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9570111ef0 con 0x7f9570108300 2024-09-19T08:43:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.072+0000 7f9575051640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f95701121f0 con 0x7f9570102dd0 2024-09-19T08:43:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.072+0000 7f956e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9570103780 0x7f9570100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.072+0000 7f956e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9570103780 0x7f9570100f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39812/0 (socket says 172.21.15.7:39812) 2024-09-19T08:43:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.072+0000 7f956e59c640 1 -- 172.21.15.7:0/25601002 learned_addr learned my addr 172.21.15.7:0/25601002 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.072+0000 7f956ed9d640 1 --2- 172.21.15.7:0/25601002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9570102dd0 0x7f9570100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.072+0000 7f956f59e640 1 --2- 172.21.15.7:0/25601002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9570108300 0x7f95701014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.072+0000 7f956e59c640 1 -- 172.21.15.7:0/25601002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9570102dd0 msgr2=0x7f9570100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.072+0000 7f956e59c640 1 --2- 172.21.15.7:0/25601002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9570102dd0 0x7f9570100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.072+0000 7f956e59c640 1 -- 172.21.15.7:0/25601002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9570108300 msgr2=0x7f95701014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:23.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.072+0000 7f956e59c640 1 --2- 172.21.15.7:0/25601002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9570108300 0x7f95701014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.072+0000 7f956e59c640 1 -- 172.21.15.7:0/25601002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95701a6ab0 con 0x7f9570103780 2024-09-19T08:43:23.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.073+0000 7f956e59c640 1 --2- 172.21.15.7:0/25601002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9570103780 0x7f9570100f70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9564005940 tx=0x7f95640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:23.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.073+0000 7f9557fff640 1 -- 172.21.15.7:0/25601002 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956403f030 con 0x7f9570103780 2024-09-19T08:43:23.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.073+0000 7f9575051640 1 -- 172.21.15.7:0/25601002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95701a6d40 con 0x7f9570103780 2024-09-19T08:43:23.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.073+0000 7f9557fff640 1 -- 172.21.15.7:0/25601002 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9564003ce0 con 0x7f9570103780 2024-09-19T08:43:23.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.073+0000 7f9557fff640 1 -- 172.21.15.7:0/25601002 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9564035070 con 0x7f9570103780 2024-09-19T08:43:23.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.073+0000 7f9575051640 1 -- 172.21.15.7:0/25601002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95701a71c0 con 0x7f9570103780 2024-09-19T08:43:23.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.074+0000 7f9575051640 1 -- 172.21.15.7:0/25601002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9570062880 con 0x7f9570103780 2024-09-19T08:43:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.075+0000 7f9557fff640 1 -- 172.21.15.7:0/25601002 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f9564042030 con 0x7f9570103780 2024-09-19T08:43:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.076+0000 7f9557fff640 1 --2- 172.21.15.7:0/25601002 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f95580a32d0 0x7f95580a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.076+0000 7f956ed9d640 1 --2- 172.21.15.7:0/25601002 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f95580a32d0 0x7f95580a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.076+0000 7f9557fff640 1 -- 172.21.15.7:0/25601002 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f95640f0530 con 0x7f9570103780 2024-09-19T08:43:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.076+0000 7f9557fff640 1 --2- 172.21.15.7:0/25601002 >> [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202] conn(0x7f95580acf00 0x7f95580af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.076+0000 7f9557fff640 1 -- 172.21.15.7:0/25601002 --> [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f95580afa70 con 0x7f95580acf00 2024-09-19T08:43:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.076+0000 7f9557fff640 1 -- 172.21.15.7:0/25601002 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f95640f08e0 con 0x7f9570103780 2024-09-19T08:43:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.076+0000 7f956f59e640 1 --2- 172.21.15.7:0/25601002 >> [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202] conn(0x7f95580acf00 0x7f95580af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.076+0000 7f956ed9d640 1 --2- 172.21.15.7:0/25601002 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f95580a32d0 0x7f95580a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9560005fd0 tx=0x7f9560009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.077+0000 7f956f59e640 1 --2- 172.21.15.7:0/25601002 >> [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202] conn(0x7f95580acf00 0x7f95580af3a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.077+0000 7f9557fff640 1 -- 172.21.15.7:0/25601002 <== osd.6 v2:172.21.15.7:6818/1261079202 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f95580afa70 con 0x7f95580acf00 2024-09-19T08:43:23.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.092+0000 7f9575051640 1 -- 172.21.15.7:0/25601002 --> [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9570062d00 con 0x7f95580acf00 2024-09-19T08:43:23.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.092+0000 7f9557fff640 1 -- 172.21.15.7:0/25601002 <== osd.6 v2:172.21.15.7:6818/1261079202 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9570062d00 con 0x7f95580acf00 2024-09-19T08:43:23.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.093+0000 7f9575051640 1 -- 172.21.15.7:0/25601002 >> [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202] conn(0x7f95580acf00 msgr2=0x7f95580af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:23.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.093+0000 7f9575051640 1 --2- 172.21.15.7:0/25601002 >> [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202] conn(0x7f95580acf00 0x7f95580af3a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.093+0000 7f9575051640 1 -- 172.21.15.7:0/25601002 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f95580a32d0 msgr2=0x7f95580a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:23.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.093+0000 7f9575051640 1 --2- 172.21.15.7:0/25601002 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f95580a32d0 0x7f95580a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9560005fd0 tx=0x7f9560009680 comp rx=0 tx=0).stop 2024-09-19T08:43:23.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.093+0000 7f9575051640 1 -- 172.21.15.7:0/25601002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9570103780 msgr2=0x7f9570100f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:23.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.093+0000 7f9575051640 1 --2- 172.21.15.7:0/25601002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9570103780 0x7f9570100f70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9564005940 tx=0x7f95640042f0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.093+0000 7f956f59e640 1 -- 172.21.15.7:0/25601002 reap_dead start 2024-09-19T08:43:23.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.093+0000 7f9575051640 1 -- 172.21.15.7:0/25601002 shutdown_connections 2024-09-19T08:43:23.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.093+0000 7f9575051640 1 -- 172.21.15.7:0/25601002 >> 172.21.15.7:0/25601002 conn(0x7f95700fc7d0 msgr2=0x7f9570105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:23.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.093+0000 7f9575051640 1 -- 172.21.15.7:0/25601002 shutdown_connections 2024-09-19T08:43:23.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.093+0000 7f9575051640 1 -- 172.21.15.7:0/25601002 wait complete. 2024-09-19T08:43:23.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.897+0000 7f0559a1f640 1 -- 172.21.15.7:0/1190077686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0554101de0 msgr2=0x7f05541021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:23.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.897+0000 7f0559a1f640 1 --2- 172.21.15.7:0/1190077686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0554101de0 0x7f05541021c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0544009900 tx=0x7f054402a410 comp rx=0 tx=0).stop 2024-09-19T08:43:23.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.897+0000 7f0559a1f640 1 -- 172.21.15.7:0/1190077686 shutdown_connections 2024-09-19T08:43:23.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.897+0000 7f0559a1f640 1 --2- 172.21.15.7:0/1190077686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0554106f10 0x7f055410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.897+0000 7f0559a1f640 1 --2- 172.21.15.7:0/1190077686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0554102790 0x7f05541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.897+0000 7f0559a1f640 1 --2- 172.21.15.7:0/1190077686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0554101de0 0x7f05541021c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.897+0000 7f0559a1f640 1 -- 172.21.15.7:0/1190077686 >> 172.21.15.7:0/1190077686 conn(0x7f05540fd8c0 msgr2=0x7f05540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:23.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.897+0000 7f0559a1f640 1 -- 172.21.15.7:0/1190077686 shutdown_connections 2024-09-19T08:43:23.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.897+0000 7f0559a1f640 1 -- 172.21.15.7:0/1190077686 wait complete. 2024-09-19T08:43:23.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.897+0000 7f0559a1f640 1 Processor -- start 2024-09-19T08:43:23.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.898+0000 7f0559a1f640 1 -- start start 2024-09-19T08:43:23.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.898+0000 7f0559a1f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0554101de0 0x7f0554198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:23.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.898+0000 7f0559a1f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0554102790 0x7f0554198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:23.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.898+0000 7f0559a1f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0554106f10 0x7f055419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:23.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.898+0000 7f0559a1f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0554111f90 con 0x7f0554106f10 2024-09-19T08:43:23.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.898+0000 7f0559a1f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0554111e10 con 0x7f0554101de0 2024-09-19T08:43:23.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.898+0000 7f0559a1f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0554112110 con 0x7f0554102790 2024-09-19T08:43:23.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.898+0000 7f05537fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0554106f10 0x7f055419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:23.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.898+0000 7f05537fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0554106f10 0x7f055419ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44256/0 (socket says 172.21.15.7:44256) 2024-09-19T08:43:23.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.898+0000 7f05537fe640 1 -- 172.21.15.7:0/1838114877 learned_addr learned my addr 172.21.15.7:0/1838114877 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:23.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.898+0000 7f0552ffd640 1 --2- 172.21.15.7:0/1838114877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0554101de0 0x7f0554198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:23.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.898+0000 7f05527fc640 1 --2- 172.21.15.7:0/1838114877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0554102790 0x7f0554198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:23.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.898+0000 7f05537fe640 1 -- 172.21.15.7:0/1838114877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0554102790 msgr2=0x7f0554198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:23.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.898+0000 7f05537fe640 1 --2- 172.21.15.7:0/1838114877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0554102790 0x7f0554198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.898+0000 7f05537fe640 1 -- 172.21.15.7:0/1838114877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0554101de0 msgr2=0x7f0554198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:23.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.898+0000 7f05537fe640 1 --2- 172.21.15.7:0/1838114877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0554101de0 0x7f0554198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.898+0000 7f05537fe640 1 -- 172.21.15.7:0/1838114877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055419d4e0 con 0x7f0554106f10 2024-09-19T08:43:23.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.898+0000 7f05527fc640 1 --2- 172.21.15.7:0/1838114877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0554102790 0x7f0554198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:43:23.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.899+0000 7f05537fe640 1 --2- 172.21.15.7:0/1838114877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0554106f10 0x7f055419ce00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f054c009fd0 tx=0x7f054c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:23.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.899+0000 7f0558a1d640 1 -- 172.21.15.7:0/1838114877 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c017070 con 0x7f0554106f10 2024-09-19T08:43:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.899+0000 7f0558a1d640 1 -- 172.21.15.7:0/1838114877 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f054c003e50 con 0x7f0554106f10 2024-09-19T08:43:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.899+0000 7f0559a1f640 1 -- 172.21.15.7:0/1838114877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f055419d7d0 con 0x7f0554106f10 2024-09-19T08:43:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.899+0000 7f0558a1d640 1 -- 172.21.15.7:0/1838114877 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c0106c0 con 0x7f0554106f10 2024-09-19T08:43:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.899+0000 7f0559a1f640 1 -- 172.21.15.7:0/1838114877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05541a50b0 con 0x7f0554106f10 2024-09-19T08:43:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.900+0000 7f0559a1f640 1 -- 172.21.15.7:0/1838114877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0554062980 con 0x7f0554106f10 2024-09-19T08:43:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.901+0000 7f0558a1d640 1 -- 172.21.15.7:0/1838114877 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f054c003970 con 0x7f0554106f10 2024-09-19T08:43:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.902+0000 7f0558a1d640 1 --2- 172.21.15.7:0/1838114877 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f053c0a3350 0x7f053c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.902+0000 7f0552ffd640 1 --2- 172.21.15.7:0/1838114877 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f053c0a3350 0x7f053c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.902+0000 7f0558a1d640 1 -- 172.21.15.7:0/1838114877 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f054c0cfbd0 con 0x7f0554106f10 2024-09-19T08:43:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.902+0000 7f0558a1d640 1 --2- 172.21.15.7:0/1838114877 >> [v2:172.21.15.44:6800/2213694259,v1:172.21.15.44:6801/2213694259] conn(0x7f053c0acf80 0x7f053c0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.902+0000 7f0558a1d640 1 -- 172.21.15.7:0/1838114877 --> [v2:172.21.15.44:6800/2213694259,v1:172.21.15.44:6801/2213694259] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f054c0090b0 con 0x7f053c0acf80 2024-09-19T08:43:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.902+0000 7f0558a1d640 1 -- 172.21.15.7:0/1838114877 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f054c0cff80 con 0x7f0554106f10 2024-09-19T08:43:23.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.902+0000 7f0552ffd640 1 --2- 172.21.15.7:0/1838114877 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f053c0a3350 0x7f053c0a5810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0544009230 tx=0x7f05440058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:23.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.902+0000 7f05527fc640 1 --2- 172.21.15.7:0/1838114877 >> [v2:172.21.15.44:6800/2213694259,v1:172.21.15.44:6801/2213694259] conn(0x7f053c0acf80 0x7f053c0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:23.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.903+0000 7f05527fc640 1 --2- 172.21.15.7:0/1838114877 >> [v2:172.21.15.44:6800/2213694259,v1:172.21.15.44:6801/2213694259] conn(0x7f053c0acf80 0x7f053c0af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:23.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.904+0000 7f0558a1d640 1 -- 172.21.15.7:0/1838114877 <== osd.1 v2:172.21.15.44:6800/2213694259 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f054c0090b0 con 0x7f053c0acf80 2024-09-19T08:43:23.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.917+0000 7f0559a1f640 1 -- 172.21.15.7:0/1838114877 --> [v2:172.21.15.44:6800/2213694259,v1:172.21.15.44:6801/2213694259] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0554062e00 con 0x7f053c0acf80 2024-09-19T08:43:23.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.918+0000 7f0558a1d640 1 -- 172.21.15.7:0/1838114877 <== osd.1 v2:172.21.15.44:6800/2213694259 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0554062e00 con 0x7f053c0acf80 2024-09-19T08:43:23.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.918+0000 7f0559a1f640 1 -- 172.21.15.7:0/1838114877 >> [v2:172.21.15.44:6800/2213694259,v1:172.21.15.44:6801/2213694259] conn(0x7f053c0acf80 msgr2=0x7f053c0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:23.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.918+0000 7f0559a1f640 1 --2- 172.21.15.7:0/1838114877 >> [v2:172.21.15.44:6800/2213694259,v1:172.21.15.44:6801/2213694259] conn(0x7f053c0acf80 0x7f053c0af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.918+0000 7f0559a1f640 1 -- 172.21.15.7:0/1838114877 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f053c0a3350 msgr2=0x7f053c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:23.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.918+0000 7f0559a1f640 1 --2- 172.21.15.7:0/1838114877 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f053c0a3350 0x7f053c0a5810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0544009230 tx=0x7f05440058d0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.918+0000 7f0559a1f640 1 -- 172.21.15.7:0/1838114877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0554106f10 msgr2=0x7f055419ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:23.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.918+0000 7f0559a1f640 1 --2- 172.21.15.7:0/1838114877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0554106f10 0x7f055419ce00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f054c009fd0 tx=0x7f054c00b260 comp rx=0 tx=0).stop 2024-09-19T08:43:23.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.918+0000 7f05537fe640 1 -- 172.21.15.7:0/1838114877 reap_dead start 2024-09-19T08:43:23.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.918+0000 7f0559a1f640 1 -- 172.21.15.7:0/1838114877 shutdown_connections 2024-09-19T08:43:23.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.918+0000 7f0559a1f640 1 -- 172.21.15.7:0/1838114877 >> 172.21.15.7:0/1838114877 conn(0x7f05540fd8c0 msgr2=0x7f05540fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:23.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.919+0000 7f0559a1f640 1 -- 172.21.15.7:0/1838114877 shutdown_connections 2024-09-19T08:43:23.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.919+0000 7f0559a1f640 1 -- 172.21.15.7:0/1838114877 wait complete. 2024-09-19T08:43:24.438 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:24.438 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:24.439 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:24.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.790+0000 7f229ec68640 1 -- 172.21.15.7:0/3703227911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2298106f10 msgr2=0x7f229810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.790+0000 7f229ec68640 1 --2- 172.21.15.7:0/3703227911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2298106f10 0x7f229810ea90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2290009ca0 tx=0x7f229002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:43:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.791+0000 7f229ec68640 1 -- 172.21.15.7:0/3703227911 shutdown_connections 2024-09-19T08:43:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.791+0000 7f229ec68640 1 --2- 172.21.15.7:0/3703227911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2298106f10 0x7f229810ea90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.791+0000 7f229ec68640 1 --2- 172.21.15.7:0/3703227911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2298102790 0x7f22981067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.791+0000 7f229ec68640 1 --2- 172.21.15.7:0/3703227911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2298101de0 0x7f22981021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.791+0000 7f229ec68640 1 -- 172.21.15.7:0/3703227911 >> 172.21.15.7:0/3703227911 conn(0x7f22980fd8c0 msgr2=0x7f22980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.791+0000 7f229ec68640 1 -- 172.21.15.7:0/3703227911 shutdown_connections 2024-09-19T08:43:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.791+0000 7f229ec68640 1 -- 172.21.15.7:0/3703227911 wait complete. 2024-09-19T08:43:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.791+0000 7f229ec68640 1 Processor -- start 2024-09-19T08:43:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.791+0000 7f229ec68640 1 -- start start 2024-09-19T08:43:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.791+0000 7f229ec68640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2298101de0 0x7f22981983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.791+0000 7f229ec68640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2298102790 0x7f2298198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.791+0000 7f229ec68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2298106f10 0x7f229819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.791+0000 7f229ec68640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2298111f70 con 0x7f2298102790 2024-09-19T08:43:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.791+0000 7f229ec68640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2298111df0 con 0x7f2298106f10 2024-09-19T08:43:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.791+0000 7f229ec68640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f22981120f0 con 0x7f2298101de0 2024-09-19T08:43:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.792+0000 7f2297fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2298102790 0x7f2298198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.792+0000 7f2297fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2298102790 0x7f2298198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44240/0 (socket says 172.21.15.7:44240) 2024-09-19T08:43:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.792+0000 7f2297fff640 1 -- 172.21.15.7:0/1210230691 learned_addr learned my addr 172.21.15.7:0/1210230691 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.792+0000 7f229d205640 1 --2- 172.21.15.7:0/1210230691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2298106f10 0x7f229819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.792+0000 7f229ca04640 1 --2- 172.21.15.7:0/1210230691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2298101de0 0x7f22981983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.792+0000 7f2297fff640 1 -- 172.21.15.7:0/1210230691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2298101de0 msgr2=0x7f22981983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.792+0000 7f2297fff640 1 --2- 172.21.15.7:0/1210230691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2298101de0 0x7f22981983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.792+0000 7f2297fff640 1 -- 172.21.15.7:0/1210230691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2298106f10 msgr2=0x7f229819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.792+0000 7f2297fff640 1 --2- 172.21.15.7:0/1210230691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2298106f10 0x7f229819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.792+0000 7f2297fff640 1 -- 172.21.15.7:0/1210230691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f229819d380 con 0x7f2298102790 2024-09-19T08:43:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.792+0000 7f229ca04640 1 --2- 172.21.15.7:0/1210230691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2298101de0 0x7f22981983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:43:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.792+0000 7f2297fff640 1 --2- 172.21.15.7:0/1210230691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2298102790 0x7f2298198910 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f228c00d950 tx=0x7f228c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.792+0000 7f2295ffb640 1 -- 172.21.15.7:0/1210230691 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c017070 con 0x7f2298102790 2024-09-19T08:43:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.792+0000 7f2295ffb640 1 -- 172.21.15.7:0/1210230691 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f228c009c30 con 0x7f2298102790 2024-09-19T08:43:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.792+0000 7f229ec68640 1 -- 172.21.15.7:0/1210230691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f229819d670 con 0x7f2298102790 2024-09-19T08:43:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.792+0000 7f2295ffb640 1 -- 172.21.15.7:0/1210230691 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c00f6b0 con 0x7f2298102790 2024-09-19T08:43:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.793+0000 7f229ec68640 1 -- 172.21.15.7:0/1210230691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22981a4f50 con 0x7f2298102790 2024-09-19T08:43:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.793+0000 7f229ec68640 1 -- 172.21.15.7:0/1210230691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2298062940 con 0x7f2298102790 2024-09-19T08:43:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.795+0000 7f2295ffb640 1 -- 172.21.15.7:0/1210230691 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f228c0109d0 con 0x7f2298102790 2024-09-19T08:43:24.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.795+0000 7f2295ffb640 1 --2- 172.21.15.7:0/1210230691 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f22800a32d0 0x7f22800a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:24.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.795+0000 7f229ca04640 1 --2- 172.21.15.7:0/1210230691 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f22800a32d0 0x7f22800a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:24.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.795+0000 7f2295ffb640 1 -- 172.21.15.7:0/1210230691 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f228c0cf6e0 con 0x7f2298102790 2024-09-19T08:43:24.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.795+0000 7f2295ffb640 1 --2- 172.21.15.7:0/1210230691 >> [v2:172.21.15.175:6824/4173951310,v1:172.21.15.175:6825/4173951310] conn(0x7f22800acf00 0x7f22800af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:24.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.795+0000 7f2295ffb640 1 -- 172.21.15.7:0/1210230691 --> [v2:172.21.15.175:6824/4173951310,v1:172.21.15.175:6825/4173951310] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f22800afa70 con 0x7f22800acf00 2024-09-19T08:43:24.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.795+0000 7f2295ffb640 1 -- 172.21.15.7:0/1210230691 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f228c0d6050 con 0x7f2298102790 2024-09-19T08:43:24.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.796+0000 7f229ca04640 1 --2- 172.21.15.7:0/1210230691 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f22800a32d0 0x7f22800a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f22880058c0 tx=0x7f2288005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:24.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.796+0000 7f229d205640 1 --2- 172.21.15.7:0/1210230691 >> [v2:172.21.15.175:6824/4173951310,v1:172.21.15.175:6825/4173951310] conn(0x7f22800acf00 0x7f22800af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:24.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.796+0000 7f229d205640 1 --2- 172.21.15.7:0/1210230691 >> [v2:172.21.15.175:6824/4173951310,v1:172.21.15.175:6825/4173951310] conn(0x7f22800acf00 0x7f22800af3a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:24.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.797+0000 7f2295ffb640 1 -- 172.21.15.7:0/1210230691 <== osd.11 v2:172.21.15.175:6824/4173951310 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f22800afa70 con 0x7f22800acf00 2024-09-19T08:43:24.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.811+0000 7f229ec68640 1 -- 172.21.15.7:0/1210230691 --> [v2:172.21.15.175:6824/4173951310,v1:172.21.15.175:6825/4173951310] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2298062dc0 con 0x7f22800acf00 2024-09-19T08:43:24.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.812+0000 7f2295ffb640 1 -- 172.21.15.7:0/1210230691 <== osd.11 v2:172.21.15.175:6824/4173951310 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2298062dc0 con 0x7f22800acf00 2024-09-19T08:43:24.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.812+0000 7f229ec68640 1 -- 172.21.15.7:0/1210230691 >> [v2:172.21.15.175:6824/4173951310,v1:172.21.15.175:6825/4173951310] conn(0x7f22800acf00 msgr2=0x7f22800af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:24.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.812+0000 7f229ec68640 1 --2- 172.21.15.7:0/1210230691 >> [v2:172.21.15.175:6824/4173951310,v1:172.21.15.175:6825/4173951310] conn(0x7f22800acf00 0x7f22800af3a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:24.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.812+0000 7f229ec68640 1 -- 172.21.15.7:0/1210230691 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f22800a32d0 msgr2=0x7f22800a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:24.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.812+0000 7f229ec68640 1 --2- 172.21.15.7:0/1210230691 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f22800a32d0 0x7f22800a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f22880058c0 tx=0x7f2288005d30 comp rx=0 tx=0).stop 2024-09-19T08:43:24.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.812+0000 7f229ec68640 1 -- 172.21.15.7:0/1210230691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2298102790 msgr2=0x7f2298198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:24.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.812+0000 7f229ec68640 1 --2- 172.21.15.7:0/1210230691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2298102790 0x7f2298198910 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f228c00d950 tx=0x7f228c00de10 comp rx=0 tx=0).stop 2024-09-19T08:43:24.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.812+0000 7f229d205640 1 -- 172.21.15.7:0/1210230691 reap_dead start 2024-09-19T08:43:24.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.813+0000 7f229ec68640 1 -- 172.21.15.7:0/1210230691 shutdown_connections 2024-09-19T08:43:24.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.813+0000 7f229ec68640 1 -- 172.21.15.7:0/1210230691 >> 172.21.15.7:0/1210230691 conn(0x7f22980fd8c0 msgr2=0x7f22980fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:24.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.813+0000 7f229ec68640 1 -- 172.21.15.7:0/1210230691 shutdown_connections 2024-09-19T08:43:24.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:23.813+0000 7f229ec68640 1 -- 172.21.15.7:0/1210230691 wait complete. 2024-09-19T08:43:24.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:24 smithi175 ceph-mon[35688]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T08:43:25.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:24 smithi007 ceph-mon[31221]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T08:43:25.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:24 smithi044 ceph-mon[35072]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T08:43:25.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.565+0000 7fc25875e640 1 -- 172.21.15.7:0/1411929174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc25010c170 msgr2=0x7fc25010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:25.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.565+0000 7fc25875e640 1 --2- 172.21.15.7:0/1411929174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc25010c170 0x7fc25010e610 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc248009ca0 tx=0x7fc24802a950 comp rx=0 tx=0).stop 2024-09-19T08:43:25.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.565+0000 7fc25875e640 1 -- 172.21.15.7:0/1411929174 shutdown_connections 2024-09-19T08:43:25.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.565+0000 7fc25875e640 1 --2- 172.21.15.7:0/1411929174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc25010c170 0x7fc25010e610 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:25.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.565+0000 7fc25875e640 1 --2- 172.21.15.7:0/1411929174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc250103660 0x7fc25010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:25.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.565+0000 7fc25875e640 1 --2- 172.21.15.7:0/1411929174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc250102d40 0x7fc250103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:25.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.565+0000 7fc25875e640 1 -- 172.21.15.7:0/1411929174 >> 172.21.15.7:0/1411929174 conn(0x7fc2500fc7a0 msgr2=0x7fc2500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:25.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.565+0000 7fc25875e640 1 -- 172.21.15.7:0/1411929174 shutdown_connections 2024-09-19T08:43:25.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.565+0000 7fc25875e640 1 -- 172.21.15.7:0/1411929174 wait complete. 2024-09-19T08:43:25.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.565+0000 7fc25875e640 1 Processor -- start 2024-09-19T08:43:25.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.565+0000 7fc25875e640 1 -- start start 2024-09-19T08:43:25.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc25875e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc250102d40 0x7fc2501983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:25.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc25875e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc250103660 0x7fc2501988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:25.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc25875e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc25010c170 0x7fc25019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:25.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc25875e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc250111f30 con 0x7fc250102d40 2024-09-19T08:43:25.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc25875e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc250111db0 con 0x7fc250103660 2024-09-19T08:43:25.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc25875e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc2501120b0 con 0x7fc25010c170 2024-09-19T08:43:25.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc2564fa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc250102d40 0x7fc2501983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:25.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc2564fa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc250102d40 0x7fc2501983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44282/0 (socket says 172.21.15.7:44282) 2024-09-19T08:43:25.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc2564fa640 1 -- 172.21.15.7:0/1987767746 learned_addr learned my addr 172.21.15.7:0/1987767746 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:25.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc255cf9640 1 --2- 172.21.15.7:0/1987767746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc250103660 0x7fc2501988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:25.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc256cfb640 1 --2- 172.21.15.7:0/1987767746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc25010c170 0x7fc25019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:25.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc2564fa640 1 -- 172.21.15.7:0/1987767746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc25010c170 msgr2=0x7fc25019cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:25.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc2564fa640 1 --2- 172.21.15.7:0/1987767746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc25010c170 0x7fc25019cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:25.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc2564fa640 1 -- 172.21.15.7:0/1987767746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc250103660 msgr2=0x7fc2501988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:25.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc2564fa640 1 --2- 172.21.15.7:0/1987767746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc250103660 0x7fc2501988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:25.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc2564fa640 1 -- 172.21.15.7:0/1987767746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25019d360 con 0x7fc250102d40 2024-09-19T08:43:25.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc256cfb640 1 --2- 172.21.15.7:0/1987767746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc25010c170 0x7fc25019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:43:25.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc2564fa640 1 --2- 172.21.15.7:0/1987767746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc250102d40 0x7fc2501983b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00c920 tx=0x7fc24c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:25.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc2477fe640 1 -- 172.21.15.7:0/1987767746 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c007c70 con 0x7fc250102d40 2024-09-19T08:43:25.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc2477fe640 1 -- 172.21.15.7:0/1987767746 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc24c007e10 con 0x7fc250102d40 2024-09-19T08:43:25.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc25875e640 1 -- 172.21.15.7:0/1987767746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc25019d650 con 0x7fc250102d40 2024-09-19T08:43:25.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc2477fe640 1 -- 172.21.15.7:0/1987767746 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c018890 con 0x7fc250102d40 2024-09-19T08:43:25.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.566+0000 7fc25875e640 1 -- 172.21.15.7:0/1987767746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2501a4f30 con 0x7fc250102d40 2024-09-19T08:43:25.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.567+0000 7fc25875e640 1 -- 172.21.15.7:0/1987767746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc2500fed50 con 0x7fc250102d40 2024-09-19T08:43:25.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.569+0000 7fc2477fe640 1 -- 172.21.15.7:0/1987767746 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc24c018a30 con 0x7fc250102d40 2024-09-19T08:43:25.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.569+0000 7fc2477fe640 1 --2- 172.21.15.7:0/1987767746 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc23c0a32d0 0x7fc23c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:25.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.569+0000 7fc255cf9640 1 --2- 172.21.15.7:0/1987767746 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc23c0a32d0 0x7fc23c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:25.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.569+0000 7fc2477fe640 1 -- 172.21.15.7:0/1987767746 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc24c0d00b0 con 0x7fc250102d40 2024-09-19T08:43:25.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.569+0000 7fc2477fe640 1 --2- 172.21.15.7:0/1987767746 >> [v2:172.21.15.175:6808/4001214751,v1:172.21.15.175:6809/4001214751] conn(0x7fc23c0acf00 0x7fc23c0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:25.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.570+0000 7fc2477fe640 1 -- 172.21.15.7:0/1987767746 --> [v2:172.21.15.175:6808/4001214751,v1:172.21.15.175:6809/4001214751] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc23c0afa70 con 0x7fc23c0acf00 2024-09-19T08:43:25.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.570+0000 7fc2477fe640 1 -- 172.21.15.7:0/1987767746 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fc24c0d04e0 con 0x7fc250102d40 2024-09-19T08:43:25.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.570+0000 7fc255cf9640 1 --2- 172.21.15.7:0/1987767746 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc23c0a32d0 0x7fc23c0a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc2400058c0 tx=0x7fc240005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:25.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.570+0000 7fc256cfb640 1 --2- 172.21.15.7:0/1987767746 >> [v2:172.21.15.175:6808/4001214751,v1:172.21.15.175:6809/4001214751] conn(0x7fc23c0acf00 0x7fc23c0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:25.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.570+0000 7fc256cfb640 1 --2- 172.21.15.7:0/1987767746 >> [v2:172.21.15.175:6808/4001214751,v1:172.21.15.175:6809/4001214751] conn(0x7fc23c0acf00 0x7fc23c0af3a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:25.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.571+0000 7fc2477fe640 1 -- 172.21.15.7:0/1987767746 <== osd.5 v2:172.21.15.175:6808/4001214751 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc23c0afa70 con 0x7fc23c0acf00 2024-09-19T08:43:25.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.585+0000 7fc25875e640 1 -- 172.21.15.7:0/1987767746 --> [v2:172.21.15.175:6808/4001214751,v1:172.21.15.175:6809/4001214751] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc25006b070 con 0x7fc23c0acf00 2024-09-19T08:43:25.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.585+0000 7fc2477fe640 1 -- 172.21.15.7:0/1987767746 <== osd.5 v2:172.21.15.175:6808/4001214751 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc25006b070 con 0x7fc23c0acf00 2024-09-19T08:43:25.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.586+0000 7fc25875e640 1 -- 172.21.15.7:0/1987767746 >> [v2:172.21.15.175:6808/4001214751,v1:172.21.15.175:6809/4001214751] conn(0x7fc23c0acf00 msgr2=0x7fc23c0af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:25.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.586+0000 7fc25875e640 1 --2- 172.21.15.7:0/1987767746 >> [v2:172.21.15.175:6808/4001214751,v1:172.21.15.175:6809/4001214751] conn(0x7fc23c0acf00 0x7fc23c0af3a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:25.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.586+0000 7fc25875e640 1 -- 172.21.15.7:0/1987767746 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc23c0a32d0 msgr2=0x7fc23c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:25.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.586+0000 7fc25875e640 1 --2- 172.21.15.7:0/1987767746 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fc23c0a32d0 0x7fc23c0a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc2400058c0 tx=0x7fc240005850 comp rx=0 tx=0).stop 2024-09-19T08:43:25.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.586+0000 7fc25875e640 1 -- 172.21.15.7:0/1987767746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc250102d40 msgr2=0x7fc2501983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:25.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.586+0000 7fc25875e640 1 --2- 172.21.15.7:0/1987767746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc250102d40 0x7fc2501983b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00c920 tx=0x7fc24c00cde0 comp rx=0 tx=0).stop 2024-09-19T08:43:25.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.586+0000 7fc256cfb640 1 -- 172.21.15.7:0/1987767746 reap_dead start 2024-09-19T08:43:25.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.586+0000 7fc25875e640 1 -- 172.21.15.7:0/1987767746 shutdown_connections 2024-09-19T08:43:25.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.586+0000 7fc25875e640 1 -- 172.21.15.7:0/1987767746 >> 172.21.15.7:0/1987767746 conn(0x7fc2500fc7a0 msgr2=0x7fc2500fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:25.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.586+0000 7fc25875e640 1 -- 172.21.15.7:0/1987767746 shutdown_connections 2024-09-19T08:43:25.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:25.586+0000 7fc25875e640 1 -- 172.21.15.7:0/1987767746 wait complete. 2024-09-19T08:43:26.154 INFO:teuthology.orchestra.run.smithi007.stdout:55834574919 2024-09-19T08:43:26.154 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T08:43:26.761 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:26 smithi007 ceph-mon[31221]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-19T08:43:26.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.762+0000 7f345fe3e640 1 -- 172.21.15.7:0/102328614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3458102d40 msgr2=0x7f3458103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:26.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.762+0000 7f345fe3e640 1 --2- 172.21.15.7:0/102328614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3458102d40 0x7f3458103120 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3454009900 tx=0x7f345402a480 comp rx=0 tx=0).stop 2024-09-19T08:43:26.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.762+0000 7f345fe3e640 1 -- 172.21.15.7:0/102328614 shutdown_connections 2024-09-19T08:43:26.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.762+0000 7f345fe3e640 1 --2- 172.21.15.7:0/102328614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f345810c170 0x7f345810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.762+0000 7f345fe3e640 1 --2- 172.21.15.7:0/102328614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3458103660 0x7f345810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.762+0000 7f345fe3e640 1 --2- 172.21.15.7:0/102328614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3458102d40 0x7f3458103120 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.762+0000 7f345fe3e640 1 -- 172.21.15.7:0/102328614 >> 172.21.15.7:0/102328614 conn(0x7f34580fc7a0 msgr2=0x7f34580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:26.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.762+0000 7f345fe3e640 1 -- 172.21.15.7:0/102328614 shutdown_connections 2024-09-19T08:43:26.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.762+0000 7f345fe3e640 1 -- 172.21.15.7:0/102328614 wait complete. 2024-09-19T08:43:26.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.763+0000 7f345fe3e640 1 Processor -- start 2024-09-19T08:43:26.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.763+0000 7f345fe3e640 1 -- start start 2024-09-19T08:43:26.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.763+0000 7f345fe3e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3458102d40 0x7f34581984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:26.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.763+0000 7f345fe3e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3458103660 0x7f3458198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:26.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.763+0000 7f345fe3e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f345810c170 0x7f345819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:26.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.763+0000 7f345fe3e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3458112000 con 0x7f345810c170 2024-09-19T08:43:26.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.763+0000 7f345fe3e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3458111e80 con 0x7f3458102d40 2024-09-19T08:43:26.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.763+0000 7f345fe3e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3458112180 con 0x7f3458103660 2024-09-19T08:43:26.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.763+0000 7f345e3db640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f345810c170 0x7f345819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:26.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.763+0000 7f345e3db640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f345810c170 0x7f345819cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44286/0 (socket says 172.21.15.7:44286) 2024-09-19T08:43:26.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.763+0000 7f345e3db640 1 -- 172.21.15.7:0/3330303242 learned_addr learned my addr 172.21.15.7:0/3330303242 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:26.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.763+0000 7f345d3d9640 1 --2- 172.21.15.7:0/3330303242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3458103660 0x7f3458198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:26.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.763+0000 7f345dbda640 1 --2- 172.21.15.7:0/3330303242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3458102d40 0x7f34581984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:26.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.763+0000 7f345e3db640 1 -- 172.21.15.7:0/3330303242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3458103660 msgr2=0x7f3458198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:26.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.763+0000 7f345e3db640 1 --2- 172.21.15.7:0/3330303242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3458103660 0x7f3458198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.763+0000 7f345e3db640 1 -- 172.21.15.7:0/3330303242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3458102d40 msgr2=0x7f34581984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:26.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.763+0000 7f345e3db640 1 --2- 172.21.15.7:0/3330303242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3458102d40 0x7f34581984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.763+0000 7f345e3db640 1 -- 172.21.15.7:0/3330303242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345819d470 con 0x7f345810c170 2024-09-19T08:43:26.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.764+0000 7f345e3db640 1 --2- 172.21.15.7:0/3330303242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f345810c170 0x7f345819cd90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f345000cad0 tx=0x7f345000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:26.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.764+0000 7f344effd640 1 -- 172.21.15.7:0/3330303242 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345000ae20 con 0x7f345810c170 2024-09-19T08:43:26.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.764+0000 7f345fe3e640 1 -- 172.21.15.7:0/3330303242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f345819d760 con 0x7f345810c170 2024-09-19T08:43:26.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.764+0000 7f344effd640 1 -- 172.21.15.7:0/3330303242 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3450005020 con 0x7f345810c170 2024-09-19T08:43:26.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.764+0000 7f344effd640 1 -- 172.21.15.7:0/3330303242 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345000f6f0 con 0x7f345810c170 2024-09-19T08:43:26.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.764+0000 7f345fe3e640 1 -- 172.21.15.7:0/3330303242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34581a5040 con 0x7f345810c170 2024-09-19T08:43:26.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.765+0000 7f345fe3e640 1 -- 172.21.15.7:0/3330303242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3458062980 con 0x7f345810c170 2024-09-19T08:43:26.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.766+0000 7f344effd640 1 -- 172.21.15.7:0/3330303242 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f34500051d0 con 0x7f345810c170 2024-09-19T08:43:26.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.767+0000 7f344effd640 1 --2- 172.21.15.7:0/3330303242 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f34440a32d0 0x7f34440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:26.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.767+0000 7f345dbda640 1 --2- 172.21.15.7:0/3330303242 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f34440a32d0 0x7f34440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:26.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.767+0000 7f344effd640 1 -- 172.21.15.7:0/3330303242 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f34500cfe10 con 0x7f345810c170 2024-09-19T08:43:26.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.767+0000 7f344effd640 1 --2- 172.21.15.7:0/3330303242 >> [v2:172.21.15.44:6824/4009464689,v1:172.21.15.44:6825/4009464689] conn(0x7f34440acf00 0x7f34440af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:26.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.767+0000 7f344effd640 1 -- 172.21.15.7:0/3330303242 --> [v2:172.21.15.44:6824/4009464689,v1:172.21.15.44:6825/4009464689] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f34440afa70 con 0x7f34440acf00 2024-09-19T08:43:26.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.767+0000 7f344effd640 1 -- 172.21.15.7:0/3330303242 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f34500d0240 con 0x7f345810c170 2024-09-19T08:43:26.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.767+0000 7f345dbda640 1 --2- 172.21.15.7:0/3330303242 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f34440a32d0 0x7f34440a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3454000c00 tx=0x7f3454005df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:26.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.767+0000 7f345d3d9640 1 --2- 172.21.15.7:0/3330303242 >> [v2:172.21.15.44:6824/4009464689,v1:172.21.15.44:6825/4009464689] conn(0x7f34440acf00 0x7f34440af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:26.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.768+0000 7f345d3d9640 1 --2- 172.21.15.7:0/3330303242 >> [v2:172.21.15.44:6824/4009464689,v1:172.21.15.44:6825/4009464689] conn(0x7f34440acf00 0x7f34440af3a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:26.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.769+0000 7f344effd640 1 -- 172.21.15.7:0/3330303242 <== osd.10 v2:172.21.15.44:6824/4009464689 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f34440afa70 con 0x7f34440acf00 2024-09-19T08:43:26.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.782+0000 7f345fe3e640 1 -- 172.21.15.7:0/3330303242 --> [v2:172.21.15.44:6824/4009464689,v1:172.21.15.44:6825/4009464689] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3458062e00 con 0x7f34440acf00 2024-09-19T08:43:26.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.783+0000 7f344effd640 1 -- 172.21.15.7:0/3330303242 <== osd.10 v2:172.21.15.44:6824/4009464689 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3458062e00 con 0x7f34440acf00 2024-09-19T08:43:26.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.783+0000 7f345fe3e640 1 -- 172.21.15.7:0/3330303242 >> [v2:172.21.15.44:6824/4009464689,v1:172.21.15.44:6825/4009464689] conn(0x7f34440acf00 msgr2=0x7f34440af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:26.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.783+0000 7f345fe3e640 1 --2- 172.21.15.7:0/3330303242 >> [v2:172.21.15.44:6824/4009464689,v1:172.21.15.44:6825/4009464689] conn(0x7f34440acf00 0x7f34440af3a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.783+0000 7f345fe3e640 1 -- 172.21.15.7:0/3330303242 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f34440a32d0 msgr2=0x7f34440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:26.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.783+0000 7f345fe3e640 1 --2- 172.21.15.7:0/3330303242 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f34440a32d0 0x7f34440a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3454000c00 tx=0x7f3454005df0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.783+0000 7f345fe3e640 1 -- 172.21.15.7:0/3330303242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f345810c170 msgr2=0x7f345819cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:26.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.783+0000 7f345fe3e640 1 --2- 172.21.15.7:0/3330303242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f345810c170 0x7f345819cd90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f345000cad0 tx=0x7f345000cf90 comp rx=0 tx=0).stop 2024-09-19T08:43:26.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.783+0000 7f345e3db640 1 -- 172.21.15.7:0/3330303242 reap_dead start 2024-09-19T08:43:26.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.783+0000 7f345fe3e640 1 -- 172.21.15.7:0/3330303242 shutdown_connections 2024-09-19T08:43:26.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.783+0000 7f345fe3e640 1 -- 172.21.15.7:0/3330303242 >> 172.21.15.7:0/3330303242 conn(0x7f34580fc7a0 msgr2=0x7f34580fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:26.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.783+0000 7f345fe3e640 1 -- 172.21.15.7:0/3330303242 shutdown_connections 2024-09-19T08:43:26.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.783+0000 7f345fe3e640 1 -- 172.21.15.7:0/3330303242 wait complete. 2024-09-19T08:43:26.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:26 smithi175 ceph-mon[35688]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-19T08:43:26.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.969+0000 7f4879388640 1 -- 172.21.15.7:0/1484746047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f487410c170 msgr2=0x7f487410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:26.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.969+0000 7f4879388640 1 --2- 172.21.15.7:0/1484746047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f487410c170 0x7f487410e610 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f486c009ca0 tx=0x7f486c02a950 comp rx=0 tx=0).stop 2024-09-19T08:43:26.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.969+0000 7f4879388640 1 -- 172.21.15.7:0/1484746047 shutdown_connections 2024-09-19T08:43:26.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.969+0000 7f4879388640 1 --2- 172.21.15.7:0/1484746047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f487410c170 0x7f487410e610 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.969+0000 7f4879388640 1 --2- 172.21.15.7:0/1484746047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4874103660 0x7f487410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.969+0000 7f4879388640 1 --2- 172.21.15.7:0/1484746047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4874102d40 0x7f4874103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.969+0000 7f4879388640 1 -- 172.21.15.7:0/1484746047 >> 172.21.15.7:0/1484746047 conn(0x7f48740fc7a0 msgr2=0x7f48740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:26.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.969+0000 7f4879388640 1 -- 172.21.15.7:0/1484746047 shutdown_connections 2024-09-19T08:43:26.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.969+0000 7f4879388640 1 -- 172.21.15.7:0/1484746047 wait complete. 2024-09-19T08:43:26.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.970+0000 7f4879388640 1 Processor -- start 2024-09-19T08:43:26.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.970+0000 7f4879388640 1 -- start start 2024-09-19T08:43:26.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.970+0000 7f4879388640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4874102d40 0x7f48741983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:26.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.970+0000 7f4879388640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4874103660 0x7f4874198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:26.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.970+0000 7f4879388640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f487410c170 0x7f487419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:26.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.970+0000 7f4879388640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4874111f70 con 0x7f487410c170 2024-09-19T08:43:26.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.970+0000 7f4879388640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4874111df0 con 0x7f4874102d40 2024-09-19T08:43:26.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.970+0000 7f4879388640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f48741120f0 con 0x7f4874103660 2024-09-19T08:43:26.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.970+0000 7f48737fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f487410c170 0x7f487419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:26.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.971+0000 7f48737fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f487410c170 0x7f487419ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44306/0 (socket says 172.21.15.7:44306) 2024-09-19T08:43:26.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.971+0000 7f48737fe640 1 -- 172.21.15.7:0/1524769877 learned_addr learned my addr 172.21.15.7:0/1524769877 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:26.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.971+0000 7f4872ffd640 1 --2- 172.21.15.7:0/1524769877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4874102d40 0x7f48741983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:26.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.971+0000 7f48727fc640 1 --2- 172.21.15.7:0/1524769877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4874103660 0x7f4874198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:26.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.971+0000 7f48737fe640 1 -- 172.21.15.7:0/1524769877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4874103660 msgr2=0x7f4874198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:26.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.971+0000 7f48737fe640 1 --2- 172.21.15.7:0/1524769877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4874103660 0x7f4874198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.971+0000 7f48737fe640 1 -- 172.21.15.7:0/1524769877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4874102d40 msgr2=0x7f48741983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:26.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.971+0000 7f48737fe640 1 --2- 172.21.15.7:0/1524769877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4874102d40 0x7f48741983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.971+0000 7f48737fe640 1 -- 172.21.15.7:0/1524769877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487419d3a0 con 0x7f487410c170 2024-09-19T08:43:26.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.971+0000 7f48727fc640 1 --2- 172.21.15.7:0/1524769877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4874103660 0x7f4874198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:43:26.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.971+0000 7f48737fe640 1 --2- 172.21.15.7:0/1524769877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f487410c170 0x7f487419ccc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f486c02ae70 tx=0x7f486c02f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:26.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.971+0000 7f485bfff640 1 -- 172.21.15.7:0/1524769877 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486c034040 con 0x7f487410c170 2024-09-19T08:43:26.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.971+0000 7f485bfff640 1 -- 172.21.15.7:0/1524769877 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f486c030920 con 0x7f487410c170 2024-09-19T08:43:26.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.971+0000 7f4879388640 1 -- 172.21.15.7:0/1524769877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f487419d630 con 0x7f487410c170 2024-09-19T08:43:26.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.971+0000 7f485bfff640 1 -- 172.21.15.7:0/1524769877 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486c045480 con 0x7f487410c170 2024-09-19T08:43:26.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.971+0000 7f4879388640 1 -- 172.21.15.7:0/1524769877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48741a4f70 con 0x7f487410c170 2024-09-19T08:43:26.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.972+0000 7f4879388640 1 -- 172.21.15.7:0/1524769877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f48740fe790 con 0x7f487410c170 2024-09-19T08:43:26.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.974+0000 7f485bfff640 1 -- 172.21.15.7:0/1524769877 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f486c037020 con 0x7f487410c170 2024-09-19T08:43:27.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.974+0000 7f485bfff640 1 --2- 172.21.15.7:0/1524769877 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f485c0a32d0 0x7f485c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:27.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.974+0000 7f4872ffd640 1 --2- 172.21.15.7:0/1524769877 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f485c0a32d0 0x7f485c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:27.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.974+0000 7f485bfff640 1 -- 172.21.15.7:0/1524769877 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f486c0f0d60 con 0x7f487410c170 2024-09-19T08:43:27.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.975+0000 7f485bfff640 1 --2- 172.21.15.7:0/1524769877 >> [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432] conn(0x7f485c0acf00 0x7f485c0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:27.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.975+0000 7f485bfff640 1 -- 172.21.15.7:0/1524769877 --> [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f486c044ec0 con 0x7f485c0acf00 2024-09-19T08:43:27.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.975+0000 7f485bfff640 1 -- 172.21.15.7:0/1524769877 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f486c0f1190 con 0x7f487410c170 2024-09-19T08:43:27.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.975+0000 7f48727fc640 1 --2- 172.21.15.7:0/1524769877 >> [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432] conn(0x7f485c0acf00 0x7f485c0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:27.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.975+0000 7f4872ffd640 1 --2- 172.21.15.7:0/1524769877 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f485c0a32d0 0x7f485c0a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4864005fd0 tx=0x7f4864005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:27.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.975+0000 7f48727fc640 1 --2- 172.21.15.7:0/1524769877 >> [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432] conn(0x7f485c0acf00 0x7f485c0af3a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:27.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.976+0000 7f485bfff640 1 -- 172.21.15.7:0/1524769877 <== osd.9 v2:172.21.15.7:6826/3808356432 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f486c044ec0 con 0x7f485c0acf00 2024-09-19T08:43:27.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.989+0000 7f4879388640 1 -- 172.21.15.7:0/1524769877 --> [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f487406b070 con 0x7f485c0acf00 2024-09-19T08:43:27.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.990+0000 7f485bfff640 1 -- 172.21.15.7:0/1524769877 <== osd.9 v2:172.21.15.7:6826/3808356432 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f487406b070 con 0x7f485c0acf00 2024-09-19T08:43:27.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.990+0000 7f4879388640 1 -- 172.21.15.7:0/1524769877 >> [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432] conn(0x7f485c0acf00 msgr2=0x7f485c0af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:27.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.990+0000 7f4879388640 1 --2- 172.21.15.7:0/1524769877 >> [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432] conn(0x7f485c0acf00 0x7f485c0af3a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:27.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.990+0000 7f4879388640 1 -- 172.21.15.7:0/1524769877 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f485c0a32d0 msgr2=0x7f485c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:27.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.990+0000 7f4879388640 1 --2- 172.21.15.7:0/1524769877 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f485c0a32d0 0x7f485c0a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4864005fd0 tx=0x7f4864005850 comp rx=0 tx=0).stop 2024-09-19T08:43:27.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.990+0000 7f4879388640 1 -- 172.21.15.7:0/1524769877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f487410c170 msgr2=0x7f487419ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:27.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.990+0000 7f4879388640 1 --2- 172.21.15.7:0/1524769877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f487410c170 0x7f487419ccc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f486c02ae70 tx=0x7f486c02f5b0 comp rx=0 tx=0).stop 2024-09-19T08:43:27.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.990+0000 7f48737fe640 1 -- 172.21.15.7:0/1524769877 reap_dead start 2024-09-19T08:43:27.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.990+0000 7f4879388640 1 -- 172.21.15.7:0/1524769877 shutdown_connections 2024-09-19T08:43:27.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.990+0000 7f4879388640 1 -- 172.21.15.7:0/1524769877 >> 172.21.15.7:0/1524769877 conn(0x7f48740fc7a0 msgr2=0x7f48740fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:27.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.990+0000 7f4879388640 1 -- 172.21.15.7:0/1524769877 shutdown_connections 2024-09-19T08:43:27.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:26.990+0000 7f4879388640 1 -- 172.21.15.7:0/1524769877 wait complete. 2024-09-19T08:43:27.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:26 smithi044 ceph-mon[35072]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-19T08:43:27.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.598+0000 7faa9d9bb640 1 -- 172.21.15.7:0/1617472002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa981049a0 msgr2=0x7faa981089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:27.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.598+0000 7faa9d9bb640 1 --2- 172.21.15.7:0/1617472002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa981049a0 0x7faa981089f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faa8c009900 tx=0x7faa8c02a410 comp rx=0 tx=0).stop 2024-09-19T08:43:27.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.598+0000 7faa9d9bb640 1 -- 172.21.15.7:0/1617472002 shutdown_connections 2024-09-19T08:43:27.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.598+0000 7faa9d9bb640 1 --2- 172.21.15.7:0/1617472002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa98109120 0x7faa98110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:27.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.598+0000 7faa9d9bb640 1 --2- 172.21.15.7:0/1617472002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa981049a0 0x7faa981089f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:27.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.598+0000 7faa9d9bb640 1 --2- 172.21.15.7:0/1617472002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa98103ff0 0x7faa981043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:27.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.598+0000 7faa9d9bb640 1 -- 172.21.15.7:0/1617472002 >> 172.21.15.7:0/1617472002 conn(0x7faa980ffa90 msgr2=0x7faa98101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:27.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.598+0000 7faa9d9bb640 1 -- 172.21.15.7:0/1617472002 shutdown_connections 2024-09-19T08:43:27.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.598+0000 7faa9d9bb640 1 -- 172.21.15.7:0/1617472002 wait complete. 2024-09-19T08:43:27.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.599+0000 7faa9d9bb640 1 Processor -- start 2024-09-19T08:43:27.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.599+0000 7faa9d9bb640 1 -- start start 2024-09-19T08:43:27.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.600+0000 7faa9d9bb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa98103ff0 0x7faa9819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:27.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.600+0000 7faa9d9bb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa981049a0 0x7faa9819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:27.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.600+0000 7faa9d9bb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa98109120 0x7faa9819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:27.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.600+0000 7faa9d9bb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faa98114140 con 0x7faa98109120 2024-09-19T08:43:27.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.600+0000 7faa9d9bb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faa98113fc0 con 0x7faa981049a0 2024-09-19T08:43:27.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.600+0000 7faa9d9bb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faa981142c0 con 0x7faa98103ff0 2024-09-19T08:43:27.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.600+0000 7faa967fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa981049a0 0x7faa9819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:27.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.600+0000 7faa977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa98109120 0x7faa9819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:27.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.600+0000 7faa977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa98109120 0x7faa9819eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44324/0 (socket says 172.21.15.7:44324) 2024-09-19T08:43:27.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.600+0000 7faa977fe640 1 -- 172.21.15.7:0/3799753866 learned_addr learned my addr 172.21.15.7:0/3799753866 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:27.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.600+0000 7faa96ffd640 1 --2- 172.21.15.7:0/3799753866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa98103ff0 0x7faa9819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:27.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.600+0000 7faa977fe640 1 -- 172.21.15.7:0/3799753866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa98103ff0 msgr2=0x7faa9819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:27.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.600+0000 7faa977fe640 1 --2- 172.21.15.7:0/3799753866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa98103ff0 0x7faa9819a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:27.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.600+0000 7faa977fe640 1 -- 172.21.15.7:0/3799753866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa981049a0 msgr2=0x7faa9819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:27.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.600+0000 7faa977fe640 1 --2- 172.21.15.7:0/3799753866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa981049a0 0x7faa9819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:27.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.600+0000 7faa977fe640 1 -- 172.21.15.7:0/3799753866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9819f5d0 con 0x7faa98109120 2024-09-19T08:43:27.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.600+0000 7faa96ffd640 1 --2- 172.21.15.7:0/3799753866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa98103ff0 0x7faa9819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:43:27.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.600+0000 7faa967fc640 1 --2- 172.21.15.7:0/3799753866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa981049a0 0x7faa9819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:43:27.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.601+0000 7faa977fe640 1 --2- 172.21.15.7:0/3799753866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa98109120 0x7faa9819eef0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faa9000eb10 tx=0x7faa9000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:27.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.603+0000 7faa9c9b9640 1 -- 172.21.15.7:0/3799753866 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa90004b20 con 0x7faa98109120 2024-09-19T08:43:27.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.603+0000 7faa9c9b9640 1 -- 172.21.15.7:0/3799753866 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa90004cc0 con 0x7faa98109120 2024-09-19T08:43:27.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.603+0000 7faa9c9b9640 1 -- 172.21.15.7:0/3799753866 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa90010760 con 0x7faa98109120 2024-09-19T08:43:27.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.603+0000 7faa9d9bb640 1 -- 172.21.15.7:0/3799753866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa9819f8c0 con 0x7faa98109120 2024-09-19T08:43:27.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.603+0000 7faa9d9bb640 1 -- 172.21.15.7:0/3799753866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa981a71a0 con 0x7faa98109120 2024-09-19T08:43:27.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.605+0000 7faa9d9bb640 1 -- 172.21.15.7:0/3799753866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa98062980 con 0x7faa98109120 2024-09-19T08:43:27.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.606+0000 7faa9c9b9640 1 -- 172.21.15.7:0/3799753866 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7faa90005020 con 0x7faa98109120 2024-09-19T08:43:27.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.607+0000 7faa9c9b9640 1 --2- 172.21.15.7:0/3799753866 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7faa800a3350 0x7faa800a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:27.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.607+0000 7faa9c9b9640 1 -- 172.21.15.7:0/3799753866 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7faa900d0400 con 0x7faa98109120 2024-09-19T08:43:27.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.607+0000 7faa96ffd640 1 --2- 172.21.15.7:0/3799753866 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7faa800a3350 0x7faa800a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:27.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.607+0000 7faa9c9b9640 1 --2- 172.21.15.7:0/3799753866 >> [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083] conn(0x7faa800acf80 0x7faa800af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:27.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.607+0000 7faa9c9b9640 1 -- 172.21.15.7:0/3799753866 --> [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa800afaf0 con 0x7faa800acf80 2024-09-19T08:43:27.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.607+0000 7faa9c9b9640 1 -- 172.21.15.7:0/3799753866 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7faa900d0830 con 0x7faa98109120 2024-09-19T08:43:27.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.607+0000 7faa967fc640 1 --2- 172.21.15.7:0/3799753866 >> [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083] conn(0x7faa800acf80 0x7faa800af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:27.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.607+0000 7faa96ffd640 1 --2- 172.21.15.7:0/3799753866 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7faa800a3350 0x7faa800a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faa88005fd0 tx=0x7faa8800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:27.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.608+0000 7faa967fc640 1 --2- 172.21.15.7:0/3799753866 >> [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083] conn(0x7faa800acf80 0x7faa800af420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:27.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.608+0000 7faa9c9b9640 1 -- 172.21.15.7:0/3799753866 <== osd.3 v2:172.21.15.7:6810/2528867083 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faa800afaf0 con 0x7faa800acf80 2024-09-19T08:43:27.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.624+0000 7faa9d9bb640 1 -- 172.21.15.7:0/3799753866 --> [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faa98062e00 con 0x7faa800acf80 2024-09-19T08:43:27.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.625+0000 7faa9c9b9640 1 -- 172.21.15.7:0/3799753866 <== osd.3 v2:172.21.15.7:6810/2528867083 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7faa98062e00 con 0x7faa800acf80 2024-09-19T08:43:27.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.625+0000 7faa9d9bb640 1 -- 172.21.15.7:0/3799753866 >> [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083] conn(0x7faa800acf80 msgr2=0x7faa800af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:27.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.625+0000 7faa9d9bb640 1 --2- 172.21.15.7:0/3799753866 >> [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083] conn(0x7faa800acf80 0x7faa800af420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:27.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.625+0000 7faa9d9bb640 1 -- 172.21.15.7:0/3799753866 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7faa800a3350 msgr2=0x7faa800a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:27.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.625+0000 7faa9d9bb640 1 --2- 172.21.15.7:0/3799753866 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7faa800a3350 0x7faa800a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faa88005fd0 tx=0x7faa8800b390 comp rx=0 tx=0).stop 2024-09-19T08:43:27.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.625+0000 7faa9d9bb640 1 -- 172.21.15.7:0/3799753866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa98109120 msgr2=0x7faa9819eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:27.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.625+0000 7faa9d9bb640 1 --2- 172.21.15.7:0/3799753866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa98109120 0x7faa9819eef0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faa9000eb10 tx=0x7faa9000c2d0 comp rx=0 tx=0).stop 2024-09-19T08:43:27.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.625+0000 7faa977fe640 1 -- 172.21.15.7:0/3799753866 reap_dead start 2024-09-19T08:43:27.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.625+0000 7faa9d9bb640 1 -- 172.21.15.7:0/3799753866 shutdown_connections 2024-09-19T08:43:27.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.625+0000 7faa9d9bb640 1 -- 172.21.15.7:0/3799753866 >> 172.21.15.7:0/3799753866 conn(0x7faa980ffa90 msgr2=0x7faa98100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:27.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.625+0000 7faa9d9bb640 1 -- 172.21.15.7:0/3799753866 shutdown_connections 2024-09-19T08:43:27.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:27.626+0000 7faa9d9bb640 1 -- 172.21.15.7:0/3799753866 wait complete. 2024-09-19T08:43:28.341 INFO:teuthology.orchestra.run.smithi007.stdout:317827579925 2024-09-19T08:43:28.342 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T08:43:28.768 INFO:teuthology.orchestra.run.smithi007.stdout:73014444096 2024-09-19T08:43:28.769 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T08:43:28.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:28 smithi007 ceph-mon[31221]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-19T08:43:28.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:28 smithi175 ceph-mon[35688]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-19T08:43:29.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:28 smithi044 ceph-mon[35072]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-19T08:43:29.531 INFO:teuthology.orchestra.run.smithi007.stdout:270582939680 2024-09-19T08:43:29.531 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T08:43:29.931 INFO:teuthology.orchestra.run.smithi007.stdout:158913790001 2024-09-19T08:43:29.932 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T08:43:30.338 INFO:teuthology.orchestra.run.smithi007.stdout:287762808858 2024-09-19T08:43:30.338 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T08:43:30.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:30 smithi007 ceph-mon[31221]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T08:43:30.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.897+0000 7f9a39964640 1 -- 172.21.15.7:0/1194169856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a34106f10 msgr2=0x7f9a3410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:30.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.897+0000 7f9a39964640 1 --2- 172.21.15.7:0/1194169856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a34106f10 0x7f9a3410ea90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c009900 tx=0x7f9a2c02a410 comp rx=0 tx=0).stop 2024-09-19T08:43:30.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.897+0000 7f9a39964640 1 -- 172.21.15.7:0/1194169856 shutdown_connections 2024-09-19T08:43:30.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.897+0000 7f9a39964640 1 --2- 172.21.15.7:0/1194169856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a34106f10 0x7f9a3410ea90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:30.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.897+0000 7f9a39964640 1 --2- 172.21.15.7:0/1194169856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a34102790 0x7f9a341067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:30.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.897+0000 7f9a39964640 1 --2- 172.21.15.7:0/1194169856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a34101de0 0x7f9a341021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:30.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.897+0000 7f9a39964640 1 -- 172.21.15.7:0/1194169856 >> 172.21.15.7:0/1194169856 conn(0x7f9a340fd8c0 msgr2=0x7f9a340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:30.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.897+0000 7f9a39964640 1 -- 172.21.15.7:0/1194169856 shutdown_connections 2024-09-19T08:43:30.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.897+0000 7f9a39964640 1 -- 172.21.15.7:0/1194169856 wait complete. 2024-09-19T08:43:30.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.897+0000 7f9a39964640 1 Processor -- start 2024-09-19T08:43:30.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.897+0000 7f9a39964640 1 -- start start 2024-09-19T08:43:30.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.898+0000 7f9a39964640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a34101de0 0x7f9a3419a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:30.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.898+0000 7f9a39964640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a34102790 0x7f9a3419ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:30.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.898+0000 7f9a39964640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a34106f10 0x7f9a3419efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:30.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.898+0000 7f9a39964640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9a34111f90 con 0x7f9a34102790 2024-09-19T08:43:30.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.898+0000 7f9a39964640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9a34111e10 con 0x7f9a34106f10 2024-09-19T08:43:30.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.898+0000 7f9a39964640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9a34112110 con 0x7f9a34101de0 2024-09-19T08:43:30.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.898+0000 7f9a327fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a34102790 0x7f9a3419ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:30.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.898+0000 7f9a327fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a34102790 0x7f9a3419ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44334/0 (socket says 172.21.15.7:44334) 2024-09-19T08:43:30.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.898+0000 7f9a327fc640 1 -- 172.21.15.7:0/2716232886 learned_addr learned my addr 172.21.15.7:0/2716232886 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:30.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.898+0000 7f9a32ffd640 1 --2- 172.21.15.7:0/2716232886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a34101de0 0x7f9a3419a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:30.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.898+0000 7f9a337fe640 1 --2- 172.21.15.7:0/2716232886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a34106f10 0x7f9a3419efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:30.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.898+0000 7f9a327fc640 1 -- 172.21.15.7:0/2716232886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a34101de0 msgr2=0x7f9a3419a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:30.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.898+0000 7f9a327fc640 1 --2- 172.21.15.7:0/2716232886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a34101de0 0x7f9a3419a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:30.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.898+0000 7f9a327fc640 1 -- 172.21.15.7:0/2716232886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a34106f10 msgr2=0x7f9a3419efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:30.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.898+0000 7f9a327fc640 1 --2- 172.21.15.7:0/2716232886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a34106f10 0x7f9a3419efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:30.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.898+0000 7f9a327fc640 1 -- 172.21.15.7:0/2716232886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3419f680 con 0x7f9a34102790 2024-09-19T08:43:30.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.898+0000 7f9a337fe640 1 --2- 172.21.15.7:0/2716232886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a34106f10 0x7f9a3419efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:43:30.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.898+0000 7f9a327fc640 1 --2- 172.21.15.7:0/2716232886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a34102790 0x7f9a3419ac10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800d950 tx=0x7f9a2800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:30.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.899+0000 7f9a38962640 1 -- 172.21.15.7:0/2716232886 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a28017070 con 0x7f9a34102790 2024-09-19T08:43:30.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.899+0000 7f9a38962640 1 -- 172.21.15.7:0/2716232886 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a28009c30 con 0x7f9a34102790 2024-09-19T08:43:30.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.899+0000 7f9a39964640 1 -- 172.21.15.7:0/2716232886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a3419f970 con 0x7f9a34102790 2024-09-19T08:43:30.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.899+0000 7f9a38962640 1 -- 172.21.15.7:0/2716232886 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2800f6b0 con 0x7f9a34102790 2024-09-19T08:43:30.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.899+0000 7f9a39964640 1 -- 172.21.15.7:0/2716232886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a341a7250 con 0x7f9a34102790 2024-09-19T08:43:30.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.899+0000 7f9a39964640 1 -- 172.21.15.7:0/2716232886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9a340756c0 con 0x7f9a34102790 2024-09-19T08:43:30.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.901+0000 7f9a38962640 1 -- 172.21.15.7:0/2716232886 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f9a280109d0 con 0x7f9a34102790 2024-09-19T08:43:30.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.901+0000 7f9a38962640 1 --2- 172.21.15.7:0/2716232886 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9a1c0a3350 0x7f9a1c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:30.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.902+0000 7f9a32ffd640 1 --2- 172.21.15.7:0/2716232886 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9a1c0a3350 0x7f9a1c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:30.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.902+0000 7f9a38962640 1 -- 172.21.15.7:0/2716232886 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9a280cf600 con 0x7f9a34102790 2024-09-19T08:43:30.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.902+0000 7f9a38962640 1 --2- 172.21.15.7:0/2716232886 >> [v2:172.21.15.175:6816/2080374927,v1:172.21.15.175:6817/2080374927] conn(0x7f9a1c0acf80 0x7f9a1c0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:30.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.902+0000 7f9a38962640 1 -- 172.21.15.7:0/2716232886 --> [v2:172.21.15.175:6816/2080374927,v1:172.21.15.175:6817/2080374927] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a1c0afaf0 con 0x7f9a1c0acf80 2024-09-19T08:43:30.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.902+0000 7f9a38962640 1 -- 172.21.15.7:0/2716232886 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f9a280cfa30 con 0x7f9a34102790 2024-09-19T08:43:30.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.902+0000 7f9a32ffd640 1 --2- 172.21.15.7:0/2716232886 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9a1c0a3350 0x7f9a1c0a5810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400a400 tx=0x7f9a2400d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:30.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.902+0000 7f9a337fe640 1 --2- 172.21.15.7:0/2716232886 >> [v2:172.21.15.175:6816/2080374927,v1:172.21.15.175:6817/2080374927] conn(0x7f9a1c0acf80 0x7f9a1c0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:30.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.903+0000 7f9a337fe640 1 --2- 172.21.15.7:0/2716232886 >> [v2:172.21.15.175:6816/2080374927,v1:172.21.15.175:6817/2080374927] conn(0x7f9a1c0acf80 0x7f9a1c0af420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:30.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.903+0000 7f9a38962640 1 -- 172.21.15.7:0/2716232886 <== osd.8 v2:172.21.15.175:6816/2080374927 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9a1c0afaf0 con 0x7f9a1c0acf80 2024-09-19T08:43:30.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.917+0000 7f9a39964640 1 -- 172.21.15.7:0/2716232886 --> [v2:172.21.15.175:6816/2080374927,v1:172.21.15.175:6817/2080374927] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9a341032c0 con 0x7f9a1c0acf80 2024-09-19T08:43:30.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.917+0000 7f9a38962640 1 -- 172.21.15.7:0/2716232886 <== osd.8 v2:172.21.15.175:6816/2080374927 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9a341032c0 con 0x7f9a1c0acf80 2024-09-19T08:43:30.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.918+0000 7f9a39964640 1 -- 172.21.15.7:0/2716232886 >> [v2:172.21.15.175:6816/2080374927,v1:172.21.15.175:6817/2080374927] conn(0x7f9a1c0acf80 msgr2=0x7f9a1c0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:30.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.918+0000 7f9a39964640 1 --2- 172.21.15.7:0/2716232886 >> [v2:172.21.15.175:6816/2080374927,v1:172.21.15.175:6817/2080374927] conn(0x7f9a1c0acf80 0x7f9a1c0af420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:30.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.918+0000 7f9a39964640 1 -- 172.21.15.7:0/2716232886 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9a1c0a3350 msgr2=0x7f9a1c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:30.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.918+0000 7f9a39964640 1 --2- 172.21.15.7:0/2716232886 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f9a1c0a3350 0x7f9a1c0a5810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400a400 tx=0x7f9a2400d040 comp rx=0 tx=0).stop 2024-09-19T08:43:30.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.918+0000 7f9a39964640 1 -- 172.21.15.7:0/2716232886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a34102790 msgr2=0x7f9a3419ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:30.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.918+0000 7f9a39964640 1 --2- 172.21.15.7:0/2716232886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a34102790 0x7f9a3419ac10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800d950 tx=0x7f9a2800de10 comp rx=0 tx=0).stop 2024-09-19T08:43:30.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.918+0000 7f9a337fe640 1 -- 172.21.15.7:0/2716232886 reap_dead start 2024-09-19T08:43:30.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.918+0000 7f9a39964640 1 -- 172.21.15.7:0/2716232886 shutdown_connections 2024-09-19T08:43:30.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.918+0000 7f9a39964640 1 -- 172.21.15.7:0/2716232886 >> 172.21.15.7:0/2716232886 conn(0x7f9a340fd8c0 msgr2=0x7f9a340feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:30.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.918+0000 7f9a39964640 1 -- 172.21.15.7:0/2716232886 shutdown_connections 2024-09-19T08:43:30.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:30.918+0000 7f9a39964640 1 -- 172.21.15.7:0/2716232886 wait complete. 2024-09-19T08:43:30.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:30 smithi175 ceph-mon[35688]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T08:43:31.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:30 smithi044 ceph-mon[35072]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T08:43:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.105+0000 7fd83b4ea640 1 -- 172.21.15.7:0/3457852328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd834102b50 msgr2=0x7fd834100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.105+0000 7fd83b4ea640 1 --2- 172.21.15.7:0/3457852328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd834102b50 0x7fd834100090 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd830009900 tx=0x7fd83002a3e0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.105+0000 7fd83b4ea640 1 -- 172.21.15.7:0/3457852328 shutdown_connections 2024-09-19T08:43:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.105+0000 7fd83b4ea640 1 --2- 172.21.15.7:0/3457852328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd83410e810 0x7fd834110c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.106+0000 7fd83b4ea640 1 --2- 172.21.15.7:0/3457852328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd834102fc0 0x7fd8341005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.106+0000 7fd83b4ea640 1 --2- 172.21.15.7:0/3457852328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd834102b50 0x7fd834100090 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.106+0000 7fd83b4ea640 1 -- 172.21.15.7:0/3457852328 >> 172.21.15.7:0/3457852328 conn(0x7fd834077210 msgr2=0x7fd8340fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.106+0000 7fd83b4ea640 1 -- 172.21.15.7:0/3457852328 shutdown_connections 2024-09-19T08:43:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.106+0000 7fd83b4ea640 1 -- 172.21.15.7:0/3457852328 wait complete. 2024-09-19T08:43:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.106+0000 7fd83b4ea640 1 Processor -- start 2024-09-19T08:43:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.106+0000 7fd83b4ea640 1 -- start start 2024-09-19T08:43:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.106+0000 7fd83b4ea640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd834102b50 0x7fd83419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.106+0000 7fd83b4ea640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd83410e810 0x7fd83419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.106+0000 7fd83b4ea640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd83419ee70 0x7fd83419f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.106+0000 7fd83b4ea640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd8341141c0 con 0x7fd83410e810 2024-09-19T08:43:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.106+0000 7fd83b4ea640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd834114040 con 0x7fd83419ee70 2024-09-19T08:43:31.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.106+0000 7fd83b4ea640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd834114340 con 0x7fd834102b50 2024-09-19T08:43:31.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.107+0000 7fd838a85640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd83410e810 0x7fd83419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:31.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.107+0000 7fd838a85640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd83410e810 0x7fd83419aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44352/0 (socket says 172.21.15.7:44352) 2024-09-19T08:43:31.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.107+0000 7fd838a85640 1 -- 172.21.15.7:0/2367092976 learned_addr learned my addr 172.21.15.7:0/2367092976 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:31.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.107+0000 7fd839a87640 1 --2- 172.21.15.7:0/2367092976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd83419ee70 0x7fd83419f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:31.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.107+0000 7fd838a85640 1 -- 172.21.15.7:0/2367092976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd834102b50 msgr2=0x7fd83419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.107+0000 7fd838a85640 1 --2- 172.21.15.7:0/2367092976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd834102b50 0x7fd83419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.107+0000 7fd838a85640 1 -- 172.21.15.7:0/2367092976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd83419ee70 msgr2=0x7fd83419f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.107+0000 7fd838a85640 1 --2- 172.21.15.7:0/2367092976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd83419ee70 0x7fd83419f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.107+0000 7fd838a85640 1 -- 172.21.15.7:0/2367092976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83419f930 con 0x7fd83410e810 2024-09-19T08:43:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.107+0000 7fd839a87640 1 --2- 172.21.15.7:0/2367092976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd83419ee70 0x7fd83419f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:43:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.107+0000 7fd838a85640 1 --2- 172.21.15.7:0/2367092976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd83410e810 0x7fd83419aae0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd82400c8c0 tx=0x7fd82400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.107+0000 7fd82a7fc640 1 -- 172.21.15.7:0/2367092976 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824007bb0 con 0x7fd83410e810 2024-09-19T08:43:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.107+0000 7fd82a7fc640 1 -- 172.21.15.7:0/2367092976 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd824007d50 con 0x7fd83410e810 2024-09-19T08:43:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.107+0000 7fd83b4ea640 1 -- 172.21.15.7:0/2367092976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd83419fc20 con 0x7fd83410e810 2024-09-19T08:43:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.107+0000 7fd82a7fc640 1 -- 172.21.15.7:0/2367092976 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824018830 con 0x7fd83410e810 2024-09-19T08:43:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.107+0000 7fd83b4ea640 1 -- 172.21.15.7:0/2367092976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8341a7450 con 0x7fd83410e810 2024-09-19T08:43:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.108+0000 7fd83b4ea640 1 -- 172.21.15.7:0/2367092976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd8341012b0 con 0x7fd83410e810 2024-09-19T08:43:31.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.109+0000 7fd82a7fc640 1 -- 172.21.15.7:0/2367092976 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fd8240189d0 con 0x7fd83410e810 2024-09-19T08:43:31.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.110+0000 7fd82a7fc640 1 --2- 172.21.15.7:0/2367092976 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd8200a3350 0x7fd8200a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:31.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.110+0000 7fd839286640 1 --2- 172.21.15.7:0/2367092976 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd8200a3350 0x7fd8200a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:31.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.110+0000 7fd82a7fc640 1 -- 172.21.15.7:0/2367092976 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd8240cfff0 con 0x7fd83410e810 2024-09-19T08:43:31.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.110+0000 7fd82a7fc640 1 --2- 172.21.15.7:0/2367092976 >> [v2:172.21.15.44:6816/3120822957,v1:172.21.15.44:6817/3120822957] conn(0x7fd8200acf80 0x7fd8200af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:31.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.110+0000 7fd82a7fc640 1 -- 172.21.15.7:0/2367092976 --> [v2:172.21.15.44:6816/3120822957,v1:172.21.15.44:6817/3120822957] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd8200afaf0 con 0x7fd8200acf80 2024-09-19T08:43:31.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.110+0000 7fd82a7fc640 1 -- 172.21.15.7:0/2367092976 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fd8240d0420 con 0x7fd83410e810 2024-09-19T08:43:31.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.111+0000 7fd839286640 1 --2- 172.21.15.7:0/2367092976 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd8200a3350 0x7fd8200a5810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd83002a900 tx=0x7fd830000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:31.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.111+0000 7fd839a87640 1 --2- 172.21.15.7:0/2367092976 >> [v2:172.21.15.44:6816/3120822957,v1:172.21.15.44:6817/3120822957] conn(0x7fd8200acf80 0x7fd8200af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:31.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.111+0000 7fd839a87640 1 --2- 172.21.15.7:0/2367092976 >> [v2:172.21.15.44:6816/3120822957,v1:172.21.15.44:6817/3120822957] conn(0x7fd8200acf80 0x7fd8200af420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:31.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.112+0000 7fd82a7fc640 1 -- 172.21.15.7:0/2367092976 <== osd.7 v2:172.21.15.44:6816/3120822957 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd8200afaf0 con 0x7fd8200acf80 2024-09-19T08:43:31.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.126+0000 7fd83b4ea640 1 -- 172.21.15.7:0/2367092976 --> [v2:172.21.15.44:6816/3120822957,v1:172.21.15.44:6817/3120822957] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd834110620 con 0x7fd8200acf80 2024-09-19T08:43:31.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.126+0000 7fd82a7fc640 1 -- 172.21.15.7:0/2367092976 <== osd.7 v2:172.21.15.44:6816/3120822957 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd834110620 con 0x7fd8200acf80 2024-09-19T08:43:31.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.126+0000 7fd83b4ea640 1 -- 172.21.15.7:0/2367092976 >> [v2:172.21.15.44:6816/3120822957,v1:172.21.15.44:6817/3120822957] conn(0x7fd8200acf80 msgr2=0x7fd8200af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:31.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.126+0000 7fd83b4ea640 1 --2- 172.21.15.7:0/2367092976 >> [v2:172.21.15.44:6816/3120822957,v1:172.21.15.44:6817/3120822957] conn(0x7fd8200acf80 0x7fd8200af420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.127+0000 7fd83b4ea640 1 -- 172.21.15.7:0/2367092976 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd8200a3350 msgr2=0x7fd8200a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:31.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.127+0000 7fd83b4ea640 1 --2- 172.21.15.7:0/2367092976 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fd8200a3350 0x7fd8200a5810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd83002a900 tx=0x7fd830000bc0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.127+0000 7fd83b4ea640 1 -- 172.21.15.7:0/2367092976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd83410e810 msgr2=0x7fd83419aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:31.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.127+0000 7fd83b4ea640 1 --2- 172.21.15.7:0/2367092976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd83410e810 0x7fd83419aae0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd82400c8c0 tx=0x7fd82400cd80 comp rx=0 tx=0).stop 2024-09-19T08:43:31.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.127+0000 7fd839a87640 1 -- 172.21.15.7:0/2367092976 reap_dead start 2024-09-19T08:43:31.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.127+0000 7fd83b4ea640 1 -- 172.21.15.7:0/2367092976 shutdown_connections 2024-09-19T08:43:31.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.127+0000 7fd83b4ea640 1 -- 172.21.15.7:0/2367092976 >> 172.21.15.7:0/2367092976 conn(0x7fd834077210 msgr2=0x7fd83410fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:31.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.127+0000 7fd83b4ea640 1 -- 172.21.15.7:0/2367092976 shutdown_connections 2024-09-19T08:43:31.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:31.127+0000 7fd83b4ea640 1 -- 172.21.15.7:0/2367092976 wait complete. 2024-09-19T08:43:31.934 INFO:teuthology.orchestra.run.smithi007.stdout:210453397545 2024-09-19T08:43:31.935 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T08:43:32.673 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:32 smithi007 ceph-mon[31221]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T08:43:32.704 INFO:teuthology.orchestra.run.smithi007.stdout:240518168613 2024-09-19T08:43:32.704 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T08:43:32.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:32 smithi175 ceph-mon[35688]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T08:43:33.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:32 smithi044 ceph-mon[35072]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T08:43:33.153 INFO:teuthology.orchestra.run.smithi007.stdout:188978561070 2024-09-19T08:43:33.154 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T08:43:33.317 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:33.318 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:33.864 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:33.871 INFO:teuthology.orchestra.run.smithi007.stdout:103079215165 2024-09-19T08:43:33.872 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T08:43:33.903 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:34.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:34 smithi007 ceph-mon[31221]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:43:34.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.721+0000 7f3cf66cc640 1 -- 172.21.15.7:0/3857847038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cf0101410 msgr2=0x7f3cf010d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:34.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.721+0000 7f3cf66cc640 1 --2- 172.21.15.7:0/3857847038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cf0101410 0x7f3cf010d940 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8009cd0 tx=0x7f3ce802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:43:34.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.722+0000 7f3cf66cc640 1 -- 172.21.15.7:0/3857847038 shutdown_connections 2024-09-19T08:43:34.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.722+0000 7f3cf66cc640 1 --2- 172.21.15.7:0/3857847038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cf0101410 0x7f3cf010d940 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:34.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.722+0000 7f3cf66cc640 1 --2- 172.21.15.7:0/3857847038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf0100a70 0x7f3cf0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:34.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.722+0000 7f3cf66cc640 1 --2- 172.21.15.7:0/3857847038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cf0106a70 0x7f3cf0106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:34.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.722+0000 7f3cf66cc640 1 -- 172.21.15.7:0/3857847038 >> 172.21.15.7:0/3857847038 conn(0x7f3cf00fc790 msgr2=0x7f3cf00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:34.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.722+0000 7f3cf66cc640 1 -- 172.21.15.7:0/3857847038 shutdown_connections 2024-09-19T08:43:34.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.722+0000 7f3cf66cc640 1 -- 172.21.15.7:0/3857847038 wait complete. 2024-09-19T08:43:34.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.722+0000 7f3cf66cc640 1 Processor -- start 2024-09-19T08:43:34.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.722+0000 7f3cf66cc640 1 -- start start 2024-09-19T08:43:34.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.722+0000 7f3cf66cc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cf0100a70 0x7f3cf01984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:34.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.722+0000 7f3cf66cc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cf0101410 0x7f3cf0198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:34.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.722+0000 7f3cf66cc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf0106a70 0x7f3cf019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:34.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.723+0000 7f3cf66cc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf0110e70 con 0x7f3cf0101410 2024-09-19T08:43:34.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.723+0000 7f3cf66cc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf0110cf0 con 0x7f3cf0100a70 2024-09-19T08:43:34.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.723+0000 7f3cf66cc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf0110ff0 con 0x7f3cf0106a70 2024-09-19T08:43:34.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.723+0000 7f3ce7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cf0101410 0x7f3cf0198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:34.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.723+0000 7f3ce7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cf0101410 0x7f3cf0198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58612/0 (socket says 172.21.15.7:58612) 2024-09-19T08:43:34.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.723+0000 7f3ce7fff640 1 -- 172.21.15.7:0/1799392322 learned_addr learned my addr 172.21.15.7:0/1799392322 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:34.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.723+0000 7f3ceffff640 1 --2- 172.21.15.7:0/1799392322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cf0100a70 0x7f3cf01984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:34.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.723+0000 7f3cf4c69640 1 --2- 172.21.15.7:0/1799392322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf0106a70 0x7f3cf019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:34.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.723+0000 7f3ce7fff640 1 -- 172.21.15.7:0/1799392322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf0106a70 msgr2=0x7f3cf019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:34.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.723+0000 7f3ce7fff640 1 --2- 172.21.15.7:0/1799392322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf0106a70 0x7f3cf019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:34.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.723+0000 7f3ce7fff640 1 -- 172.21.15.7:0/1799392322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cf0100a70 msgr2=0x7f3cf01984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:34.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.723+0000 7f3ce7fff640 1 --2- 172.21.15.7:0/1799392322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cf0100a70 0x7f3cf01984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:34.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.723+0000 7f3ce7fff640 1 -- 172.21.15.7:0/1799392322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf019d470 con 0x7f3cf0101410 2024-09-19T08:43:34.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.723+0000 7f3cf4c69640 1 --2- 172.21.15.7:0/1799392322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf0106a70 0x7f3cf019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:43:34.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.723+0000 7f3ce7fff640 1 --2- 172.21.15.7:0/1799392322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cf0101410 0x7f3cf0198a00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800d770 tx=0x7f3cd800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:34.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.723+0000 7f3cedffb640 1 -- 172.21.15.7:0/1799392322 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8017070 con 0x7f3cf0101410 2024-09-19T08:43:34.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.723+0000 7f3cf66cc640 1 -- 172.21.15.7:0/1799392322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cf019d760 con 0x7f3cf0101410 2024-09-19T08:43:34.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.723+0000 7f3cedffb640 1 -- 172.21.15.7:0/1799392322 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cd8005500 con 0x7f3cf0101410 2024-09-19T08:43:34.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.723+0000 7f3cedffb640 1 -- 172.21.15.7:0/1799392322 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8004e00 con 0x7f3cf0101410 2024-09-19T08:43:34.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.724+0000 7f3cf66cc640 1 -- 172.21.15.7:0/1799392322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cf01a5040 con 0x7f3cf0101410 2024-09-19T08:43:34.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.724+0000 7f3cf66cc640 1 -- 172.21.15.7:0/1799392322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cf0100ed0 con 0x7f3cf0101410 2024-09-19T08:43:34.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.726+0000 7f3cedffb640 1 -- 172.21.15.7:0/1799392322 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3cd8004fa0 con 0x7f3cf0101410 2024-09-19T08:43:34.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.727+0000 7f3cedffb640 1 --2- 172.21.15.7:0/1799392322 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3cdc0a32d0 0x7f3cdc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:34.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.727+0000 7f3ceffff640 1 --2- 172.21.15.7:0/1799392322 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3cdc0a32d0 0x7f3cdc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:34.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.727+0000 7f3cedffb640 1 -- 172.21.15.7:0/1799392322 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3cd80cf960 con 0x7f3cf0101410 2024-09-19T08:43:34.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.727+0000 7f3ceffff640 1 --2- 172.21.15.7:0/1799392322 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3cdc0a32d0 0x7f3cdc0a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00095f0 tx=0x7f3ce0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:34.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.734+0000 7f3cedffb640 1 -- 172.21.15.7:0/1799392322 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3cd809c520 con 0x7f3cf0101410 2024-09-19T08:43:34.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.915+0000 7f3cf66cc640 1 -- 172.21.15.7:0/1799392322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f3cf010a010 con 0x7f3cf0101410 2024-09-19T08:43:34.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.916+0000 7f3cedffb640 1 -- 172.21.15.7:0/1799392322 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f3cd809be20 con 0x7f3cf0101410 2024-09-19T08:43:34.916 INFO:teuthology.orchestra.run.smithi007.stdout:287762808859 2024-09-19T08:43:34.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.918+0000 7f3cf66cc640 1 -- 172.21.15.7:0/1799392322 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3cdc0a32d0 msgr2=0x7f3cdc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:34.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.918+0000 7f3cf66cc640 1 --2- 172.21.15.7:0/1799392322 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3cdc0a32d0 0x7f3cdc0a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00095f0 tx=0x7f3ce0005f90 comp rx=0 tx=0).stop 2024-09-19T08:43:34.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.918+0000 7f3cf66cc640 1 -- 172.21.15.7:0/1799392322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cf0101410 msgr2=0x7f3cf0198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:34.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.918+0000 7f3cf66cc640 1 --2- 172.21.15.7:0/1799392322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cf0101410 0x7f3cf0198a00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800d770 tx=0x7f3cd800dc30 comp rx=0 tx=0).stop 2024-09-19T08:43:34.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.918+0000 7f3cf66cc640 1 -- 172.21.15.7:0/1799392322 shutdown_connections 2024-09-19T08:43:34.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.918+0000 7f3cf66cc640 1 --2- 172.21.15.7:0/1799392322 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f3cdc0a32d0 0x7f3cdc0a5790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:34.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.918+0000 7f3cf66cc640 1 --2- 172.21.15.7:0/1799392322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf0106a70 0x7f3cf019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:34.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.918+0000 7f3cf66cc640 1 --2- 172.21.15.7:0/1799392322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cf0101410 0x7f3cf0198a00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:34.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.918+0000 7f3cf66cc640 1 --2- 172.21.15.7:0/1799392322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cf0100a70 0x7f3cf01984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:34.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.918+0000 7f3cf66cc640 1 -- 172.21.15.7:0/1799392322 >> 172.21.15.7:0/1799392322 conn(0x7f3cf00fc790 msgr2=0x7f3cf006aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:34.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.918+0000 7f3cf66cc640 1 -- 172.21.15.7:0/1799392322 shutdown_connections 2024-09-19T08:43:34.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.918+0000 7f3cf66cc640 1 -- 172.21.15.7:0/1799392322 wait complete. 2024-09-19T08:43:34.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:34 smithi175 ceph-mon[35688]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:43:35.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:34 smithi044 ceph-mon[35072]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:43:35.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.385+0000 7f2a3fe4f640 1 -- 172.21.15.7:0/391003680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a381037a0 msgr2=0x7f2a3810bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:35.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.385+0000 7f2a3fe4f640 1 --2- 172.21.15.7:0/391003680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a381037a0 0x7f2a3810bc00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009900 tx=0x7f2a2802a410 comp rx=0 tx=0).stop 2024-09-19T08:43:35.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.385+0000 7f2a3fe4f640 1 -- 172.21.15.7:0/391003680 shutdown_connections 2024-09-19T08:43:35.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.385+0000 7f2a3fe4f640 1 --2- 172.21.15.7:0/391003680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a3810c2f0 0x7f2a3810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:35.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.385+0000 7f2a3fe4f640 1 --2- 172.21.15.7:0/391003680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a381037a0 0x7f2a3810bc00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:35.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.385+0000 7f2a3fe4f640 1 --2- 172.21.15.7:0/391003680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a38102df0 0x7f2a381031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:35.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.385+0000 7f2a3fe4f640 1 -- 172.21.15.7:0/391003680 >> 172.21.15.7:0/391003680 conn(0x7f2a380fc7d0 msgr2=0x7f2a380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:35.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.385+0000 7f2a3fe4f640 1 -- 172.21.15.7:0/391003680 shutdown_connections 2024-09-19T08:43:35.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.385+0000 7f2a3fe4f640 1 -- 172.21.15.7:0/391003680 wait complete. 2024-09-19T08:43:35.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.385+0000 7f2a3fe4f640 1 Processor -- start 2024-09-19T08:43:35.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.386+0000 7f2a3fe4f640 1 -- start start 2024-09-19T08:43:35.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.386+0000 7f2a3fe4f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a38102df0 0x7f2a38198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:35.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.386+0000 7f2a3fe4f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a381037a0 0x7f2a38198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:35.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.386+0000 7f2a3fe4f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a3810c2f0 0x7f2a3819cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:35.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.386+0000 7f2a3fe4f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2a38112120 con 0x7f2a381037a0 2024-09-19T08:43:35.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.386+0000 7f2a3fe4f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2a38111fa0 con 0x7f2a38102df0 2024-09-19T08:43:35.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.386+0000 7f2a3fe4f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2a381122a0 con 0x7f2a3810c2f0 2024-09-19T08:43:35.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.386+0000 7f2a3d3ea640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a381037a0 0x7f2a38198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:35.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.386+0000 7f2a3d3ea640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a381037a0 0x7f2a38198b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58620/0 (socket says 172.21.15.7:58620) 2024-09-19T08:43:35.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.386+0000 7f2a3d3ea640 1 -- 172.21.15.7:0/2302557181 learned_addr learned my addr 172.21.15.7:0/2302557181 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:35.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.386+0000 7f2a3dbeb640 1 --2- 172.21.15.7:0/2302557181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a38102df0 0x7f2a38198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.386+0000 7f2a3e3ec640 1 --2- 172.21.15.7:0/2302557181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a3810c2f0 0x7f2a3819cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.386+0000 7f2a3d3ea640 1 -- 172.21.15.7:0/2302557181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a3810c2f0 msgr2=0x7f2a3819cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.386+0000 7f2a3d3ea640 1 --2- 172.21.15.7:0/2302557181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a3810c2f0 0x7f2a3819cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.386+0000 7f2a3d3ea640 1 -- 172.21.15.7:0/2302557181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a38102df0 msgr2=0x7f2a38198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.386+0000 7f2a3d3ea640 1 --2- 172.21.15.7:0/2302557181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a38102df0 0x7f2a38198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.386+0000 7f2a3d3ea640 1 -- 172.21.15.7:0/2302557181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3819d5d0 con 0x7f2a381037a0 2024-09-19T08:43:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.387+0000 7f2a3d3ea640 1 --2- 172.21.15.7:0/2302557181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a381037a0 0x7f2a38198b60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2a2802a930 tx=0x7f2a28003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.387+0000 7f2a2effd640 1 -- 172.21.15.7:0/2302557181 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a2803f070 con 0x7f2a381037a0 2024-09-19T08:43:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.387+0000 7f2a2effd640 1 -- 172.21.15.7:0/2302557181 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a28031c90 con 0x7f2a381037a0 2024-09-19T08:43:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.387+0000 7f2a3fe4f640 1 -- 172.21.15.7:0/2302557181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a3819d860 con 0x7f2a381037a0 2024-09-19T08:43:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.387+0000 7f2a2effd640 1 -- 172.21.15.7:0/2302557181 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a28035030 con 0x7f2a381037a0 2024-09-19T08:43:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.387+0000 7f2a3fe4f640 1 -- 172.21.15.7:0/2302557181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a381a51a0 con 0x7f2a381037a0 2024-09-19T08:43:35.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.388+0000 7f2a3fe4f640 1 -- 172.21.15.7:0/2302557181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a381031d0 con 0x7f2a381037a0 2024-09-19T08:43:35.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.389+0000 7f2a2effd640 1 -- 172.21.15.7:0/2302557181 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f2a28042070 con 0x7f2a381037a0 2024-09-19T08:43:35.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.390+0000 7f2a2effd640 1 --2- 172.21.15.7:0/2302557181 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f2a240a3350 0x7f2a240a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:35.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.390+0000 7f2a3dbeb640 1 --2- 172.21.15.7:0/2302557181 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f2a240a3350 0x7f2a240a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:35.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.390+0000 7f2a2effd640 1 -- 172.21.15.7:0/2302557181 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2a280efe50 con 0x7f2a381037a0 2024-09-19T08:43:35.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.390+0000 7f2a3dbeb640 1 --2- 172.21.15.7:0/2302557181 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f2a240a3350 0x7f2a240a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2a34009bd0 tx=0x7f2a34005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:35.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.394+0000 7f2a2effd640 1 -- 172.21.15.7:0/2302557181 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2a280bc9d0 con 0x7f2a381037a0 2024-09-19T08:43:35.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.637+0000 7fb1513db640 1 -- 172.21.15.7:0/2890409797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb14c102d30 msgr2=0x7fb14c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:35.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.637+0000 7fb1513db640 1 --2- 172.21.15.7:0/2890409797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb14c102d30 0x7fb14c103110 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009cd0 tx=0x7fb13c02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:43:35.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.637+0000 7fb1513db640 1 -- 172.21.15.7:0/2890409797 shutdown_connections 2024-09-19T08:43:35.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.637+0000 7fb1513db640 1 --2- 172.21.15.7:0/2890409797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb14c1082a0 0x7fb14c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:35.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.637+0000 7fb1513db640 1 --2- 172.21.15.7:0/2890409797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb14c1036e0 0x7fb14c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:35.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.637+0000 7fb1513db640 1 --2- 172.21.15.7:0/2890409797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb14c102d30 0x7fb14c103110 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:35.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.637+0000 7fb1513db640 1 -- 172.21.15.7:0/2890409797 >> 172.21.15.7:0/2890409797 conn(0x7fb14c0fc7d0 msgr2=0x7fb14c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:35.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.637+0000 7fb1513db640 1 -- 172.21.15.7:0/2890409797 shutdown_connections 2024-09-19T08:43:35.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.637+0000 7fb1513db640 1 -- 172.21.15.7:0/2890409797 wait complete. 2024-09-19T08:43:35.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.638+0000 7fb1513db640 1 Processor -- start 2024-09-19T08:43:35.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.638+0000 7fb1513db640 1 -- start start 2024-09-19T08:43:35.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.638+0000 7fb1513db640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb14c102d30 0x7fb14c1a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:35.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.638+0000 7fb1513db640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb14c1036e0 0x7fb14c1a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:35.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.638+0000 7fb1513db640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb14c1082a0 0x7fb14c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:35.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.638+0000 7fb1513db640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c1120a0 con 0x7fb14c1082a0 2024-09-19T08:43:35.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.638+0000 7fb1513db640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c111f20 con 0x7fb14c102d30 2024-09-19T08:43:35.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.638+0000 7fb1513db640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c112220 con 0x7fb14c1036e0 2024-09-19T08:43:35.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.639+0000 7fb14b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb14c1082a0 0x7fb14c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:35.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.639+0000 7fb14b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb14c1082a0 0x7fb14c19a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58590/0 (socket says 172.21.15.7:58590) 2024-09-19T08:43:35.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.639+0000 7fb14b7fe640 1 -- 172.21.15.7:0/2919270108 learned_addr learned my addr 172.21.15.7:0/2919270108 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:35.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.639+0000 7fb14affd640 1 --2- 172.21.15.7:0/2919270108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb14c102d30 0x7fb14c1a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:35.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.639+0000 7fb14a7fc640 1 --2- 172.21.15.7:0/2919270108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb14c1036e0 0x7fb14c1a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:35.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.639+0000 7fb14b7fe640 1 -- 172.21.15.7:0/2919270108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb14c1036e0 msgr2=0x7fb14c1a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:35.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.639+0000 7fb14b7fe640 1 --2- 172.21.15.7:0/2919270108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb14c1036e0 0x7fb14c1a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:35.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.639+0000 7fb14b7fe640 1 -- 172.21.15.7:0/2919270108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb14c102d30 msgr2=0x7fb14c1a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:35.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.639+0000 7fb14b7fe640 1 --2- 172.21.15.7:0/2919270108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb14c102d30 0x7fb14c1a0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:35.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.639+0000 7fb14b7fe640 1 -- 172.21.15.7:0/2919270108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14c19ad40 con 0x7fb14c1082a0 2024-09-19T08:43:35.486 INFO:teuthology.orchestra.run.smithi007.stdout:137438953529 2024-09-19T08:43:35.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.639+0000 7fb14b7fe640 1 --2- 172.21.15.7:0/2919270108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb14c1082a0 0x7fb14c19a610 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb14400c970 tx=0x7fb14400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:35.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.640+0000 7fb133fff640 1 -- 172.21.15.7:0/2919270108 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb144007bb0 con 0x7fb14c1082a0 2024-09-19T08:43:35.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.640+0000 7fb133fff640 1 -- 172.21.15.7:0/2919270108 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb144007d50 con 0x7fb14c1082a0 2024-09-19T08:43:35.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.640+0000 7fb1513db640 1 -- 172.21.15.7:0/2919270108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb14c19b030 con 0x7fb14c1082a0 2024-09-19T08:43:35.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.640+0000 7fb133fff640 1 -- 172.21.15.7:0/2919270108 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb144018800 con 0x7fb14c1082a0 2024-09-19T08:43:35.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.640+0000 7fb1513db640 1 -- 172.21.15.7:0/2919270108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb14c1a7320 con 0x7fb14c1082a0 2024-09-19T08:43:35.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.641+0000 7fb1513db640 1 -- 172.21.15.7:0/2919270108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb14c06a850 con 0x7fb14c1082a0 2024-09-19T08:43:35.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.642+0000 7fb133fff640 1 -- 172.21.15.7:0/2919270108 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fb14400fa50 con 0x7fb14c1082a0 2024-09-19T08:43:35.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.643+0000 7fb133fff640 1 --2- 172.21.15.7:0/2919270108 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb1340a3350 0x7fb1340a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:35.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.643+0000 7fb133fff640 1 -- 172.21.15.7:0/2919270108 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb1440cfe10 con 0x7fb14c1082a0 2024-09-19T08:43:35.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.643+0000 7fb14affd640 1 --2- 172.21.15.7:0/2919270108 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb1340a3350 0x7fb1340a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:35.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.643+0000 7fb14affd640 1 --2- 172.21.15.7:0/2919270108 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb1340a3350 0x7fb1340a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb13c006010 tx=0x7fb13c009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:35.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.646+0000 7fb133fff640 1 -- 172.21.15.7:0/2919270108 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb144014030 con 0x7fb14c1082a0 2024-09-19T08:43:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.835+0000 7fb1513db640 1 -- 172.21.15.7:0/2919270108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb14c103110 con 0x7fb14c1082a0 2024-09-19T08:43:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.835+0000 7fb133fff640 1 -- 172.21.15.7:0/2919270108 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb14409ca50 con 0x7fb14c1082a0 2024-09-19T08:43:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.838+0000 7fb1513db640 1 -- 172.21.15.7:0/2919270108 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb1340a3350 msgr2=0x7fb1340a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.838+0000 7fb1513db640 1 --2- 172.21.15.7:0/2919270108 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb1340a3350 0x7fb1340a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb13c006010 tx=0x7fb13c009360 comp rx=0 tx=0).stop 2024-09-19T08:43:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.838+0000 7fb1513db640 1 -- 172.21.15.7:0/2919270108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb14c1082a0 msgr2=0x7fb14c19a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.838+0000 7fb1513db640 1 --2- 172.21.15.7:0/2919270108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb14c1082a0 0x7fb14c19a610 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb14400c970 tx=0x7fb14400ce30 comp rx=0 tx=0).stop 2024-09-19T08:43:35.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.838+0000 7fb1513db640 1 -- 172.21.15.7:0/2919270108 shutdown_connections 2024-09-19T08:43:35.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.838+0000 7fb1513db640 1 --2- 172.21.15.7:0/2919270108 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb1340a3350 0x7fb1340a5810 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:35.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.838+0000 7fb1513db640 1 --2- 172.21.15.7:0/2919270108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb14c1082a0 0x7fb14c19a610 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:35.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.838+0000 7fb1513db640 1 --2- 172.21.15.7:0/2919270108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb14c1036e0 0x7fb14c1a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:35.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.838+0000 7fb1513db640 1 --2- 172.21.15.7:0/2919270108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb14c102d30 0x7fb14c1a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:35.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.838+0000 7fb1513db640 1 -- 172.21.15.7:0/2919270108 >> 172.21.15.7:0/2919270108 conn(0x7fb14c0fc7d0 msgr2=0x7fb14c0fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:35.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.838+0000 7fb1513db640 1 -- 172.21.15.7:0/2919270108 shutdown_connections 2024-09-19T08:43:35.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:34.838+0000 7fb1513db640 1 -- 172.21.15.7:0/2919270108 wait complete. 2024-09-19T08:43:35.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.572+0000 7f2a3fe4f640 1 -- 172.21.15.7:0/2302557181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f2a381072c0 con 0x7f2a381037a0 2024-09-19T08:43:35.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.572+0000 7f2a2effd640 1 -- 172.21.15.7:0/2302557181 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f2a280bc2d0 con 0x7f2a381037a0 2024-09-19T08:43:35.572 INFO:teuthology.orchestra.run.smithi007.stdout:317827579927 2024-09-19T08:43:35.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.574+0000 7f2a3fe4f640 1 -- 172.21.15.7:0/2302557181 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f2a240a3350 msgr2=0x7f2a240a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:35.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.574+0000 7f2a3fe4f640 1 --2- 172.21.15.7:0/2302557181 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f2a240a3350 0x7f2a240a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2a34009bd0 tx=0x7f2a34005f90 comp rx=0 tx=0).stop 2024-09-19T08:43:35.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.574+0000 7f2a3fe4f640 1 -- 172.21.15.7:0/2302557181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a381037a0 msgr2=0x7f2a38198b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:35.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.574+0000 7f2a3fe4f640 1 --2- 172.21.15.7:0/2302557181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a381037a0 0x7f2a38198b60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2a2802a930 tx=0x7f2a28003b90 comp rx=0 tx=0).stop 2024-09-19T08:43:35.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.574+0000 7f2a3fe4f640 1 -- 172.21.15.7:0/2302557181 shutdown_connections 2024-09-19T08:43:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.574+0000 7f2a3fe4f640 1 --2- 172.21.15.7:0/2302557181 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f2a240a3350 0x7f2a240a5810 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.574+0000 7f2a3fe4f640 1 --2- 172.21.15.7:0/2302557181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a3810c2f0 0x7f2a3819cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.574+0000 7f2a3fe4f640 1 --2- 172.21.15.7:0/2302557181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a381037a0 0x7f2a38198b60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.574+0000 7f2a3fe4f640 1 --2- 172.21.15.7:0/2302557181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a38102df0 0x7f2a38198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.574+0000 7f2a3fe4f640 1 -- 172.21.15.7:0/2302557181 >> 172.21.15.7:0/2302557181 conn(0x7f2a380fc7d0 msgr2=0x7f2a380fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.574+0000 7f2a3fe4f640 1 -- 172.21.15.7:0/2302557181 shutdown_connections 2024-09-19T08:43:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:35.574+0000 7f2a3fe4f640 1 -- 172.21.15.7:0/2302557181 wait complete. 2024-09-19T08:43:35.830 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:35 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2919270108' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T08:43:35.830 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:35 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1799392322' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T08:43:35.830 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:35 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2302557181' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T08:43:35.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:35 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/2919270108' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T08:43:35.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:35 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1799392322' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T08:43:35.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:35 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/2302557181' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T08:43:36.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:35 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/2919270108' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T08:43:36.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:35 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1799392322' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T08:43:36.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:35 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/2302557181' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T08:43:36.553 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:36.575 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808858 got 287762808859 for osd.10 2024-09-19T08:43:36.575 DEBUG:teuthology.parallel:result is None 2024-09-19T08:43:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:36 smithi007 ceph-mon[31221]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T08:43:36.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.880+0000 7f566e239640 1 -- 172.21.15.7:0/2636951980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56681082a0 msgr2=0x7f566810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:36.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.880+0000 7f566e239640 1 --2- 172.21.15.7:0/2636951980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56681082a0 0x7f566810ec40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5660009cd0 tx=0x7f566002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:43:36.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.880+0000 7f566e239640 1 -- 172.21.15.7:0/2636951980 shutdown_connections 2024-09-19T08:43:36.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.880+0000 7f566e239640 1 --2- 172.21.15.7:0/2636951980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56681082a0 0x7f566810ec40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:36.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.880+0000 7f566e239640 1 --2- 172.21.15.7:0/2636951980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56681036e0 0x7f5668107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:36.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.880+0000 7f566e239640 1 --2- 172.21.15.7:0/2636951980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5668102d30 0x7f5668103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:36.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.880+0000 7f566e239640 1 -- 172.21.15.7:0/2636951980 >> 172.21.15.7:0/2636951980 conn(0x7f56680fc7d0 msgr2=0x7f56680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:36.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.880+0000 7f566e239640 1 -- 172.21.15.7:0/2636951980 shutdown_connections 2024-09-19T08:43:36.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.880+0000 7f566e239640 1 -- 172.21.15.7:0/2636951980 wait complete. 2024-09-19T08:43:36.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.880+0000 7f566e239640 1 Processor -- start 2024-09-19T08:43:36.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.880+0000 7f566e239640 1 -- start start 2024-09-19T08:43:36.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.881+0000 7f566e239640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5668102d30 0x7f5668198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:36.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.881+0000 7f566e239640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56681036e0 0x7f5668198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:36.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.881+0000 7f566e239640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56681082a0 0x7f566819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:36.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.881+0000 7f566e239640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5668112100 con 0x7f56681036e0 2024-09-19T08:43:36.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.881+0000 7f566e239640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5668111f80 con 0x7f56681082a0 2024-09-19T08:43:36.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.881+0000 7f566e239640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5668112280 con 0x7f5668102d30 2024-09-19T08:43:36.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.881+0000 7f5666ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56681036e0 0x7f5668198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:36.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.881+0000 7f5666ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56681036e0 0x7f5668198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58642/0 (socket says 172.21.15.7:58642) 2024-09-19T08:43:36.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.881+0000 7f5666ffd640 1 -- 172.21.15.7:0/4138413342 learned_addr learned my addr 172.21.15.7:0/4138413342 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:36.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.881+0000 7f56677fe640 1 --2- 172.21.15.7:0/4138413342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5668102d30 0x7f5668198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:36.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.881+0000 7f5667fff640 1 --2- 172.21.15.7:0/4138413342 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56681082a0 0x7f566819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:36.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.881+0000 7f5666ffd640 1 -- 172.21.15.7:0/4138413342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5668102d30 msgr2=0x7f5668198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:36.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.881+0000 7f5666ffd640 1 --2- 172.21.15.7:0/4138413342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5668102d30 0x7f5668198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:36.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.881+0000 7f5666ffd640 1 -- 172.21.15.7:0/4138413342 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56681082a0 msgr2=0x7f566819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:36.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.881+0000 7f5666ffd640 1 --2- 172.21.15.7:0/4138413342 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56681082a0 0x7f566819ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:36.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.881+0000 7f5666ffd640 1 -- 172.21.15.7:0/4138413342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f566819d500 con 0x7f56681036e0 2024-09-19T08:43:36.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.881+0000 7f5667fff640 1 --2- 172.21.15.7:0/4138413342 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56681082a0 0x7f566819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:43:36.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.881+0000 7f5666ffd640 1 --2- 172.21.15.7:0/4138413342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56681036e0 0x7f5668198a90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f565c00c8c0 tx=0x7f565c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:36.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.882+0000 7f5664ff9640 1 -- 172.21.15.7:0/4138413342 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c007bb0 con 0x7f56681036e0 2024-09-19T08:43:36.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.882+0000 7f566e239640 1 -- 172.21.15.7:0/4138413342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f566819d7f0 con 0x7f56681036e0 2024-09-19T08:43:36.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.882+0000 7f5664ff9640 1 -- 172.21.15.7:0/4138413342 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f565c007d50 con 0x7f56681036e0 2024-09-19T08:43:36.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.882+0000 7f5664ff9640 1 -- 172.21.15.7:0/4138413342 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c018770 con 0x7f56681036e0 2024-09-19T08:43:36.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.882+0000 7f566e239640 1 -- 172.21.15.7:0/4138413342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56681a50d0 con 0x7f56681036e0 2024-09-19T08:43:36.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.883+0000 7f566e239640 1 -- 172.21.15.7:0/4138413342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5668103110 con 0x7f56681036e0 2024-09-19T08:43:36.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.884+0000 7f5664ff9640 1 -- 172.21.15.7:0/4138413342 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f565c018930 con 0x7f56681036e0 2024-09-19T08:43:36.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.884+0000 7f5664ff9640 1 --2- 172.21.15.7:0/4138413342 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f56500a32d0 0x7f56500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:36.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.885+0000 7f56677fe640 1 --2- 172.21.15.7:0/4138413342 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f56500a32d0 0x7f56500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:36.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.885+0000 7f5664ff9640 1 -- 172.21.15.7:0/4138413342 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f565c0cff90 con 0x7f56681036e0 2024-09-19T08:43:36.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.885+0000 7f56677fe640 1 --2- 172.21.15.7:0/4138413342 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f56500a32d0 0x7f56500a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5658009990 tx=0x7f5658009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:36.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:36.888+0000 7f5664ff9640 1 -- 172.21.15.7:0/4138413342 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f565c014030 con 0x7f56681036e0 2024-09-19T08:43:36.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:36 smithi175 ceph-mon[35688]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T08:43:36.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:36 smithi044 ceph-mon[35072]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T08:43:37.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:37.066+0000 7f566e239640 1 -- 172.21.15.7:0/4138413342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f56681998b0 con 0x7f56681036e0 2024-09-19T08:43:37.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:37.066+0000 7f5664ff9640 1 -- 172.21.15.7:0/4138413342 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f56681998b0 con 0x7f56681036e0 2024-09-19T08:43:37.066 INFO:teuthology.orchestra.run.smithi007.stdout:34359738446 2024-09-19T08:43:37.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:37.068+0000 7f566e239640 1 -- 172.21.15.7:0/4138413342 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f56500a32d0 msgr2=0x7f56500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:37.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:37.068+0000 7f566e239640 1 --2- 172.21.15.7:0/4138413342 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f56500a32d0 0x7f56500a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5658009990 tx=0x7f5658009110 comp rx=0 tx=0).stop 2024-09-19T08:43:37.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:37.068+0000 7f566e239640 1 -- 172.21.15.7:0/4138413342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56681036e0 msgr2=0x7f5668198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:37.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:37.068+0000 7f566e239640 1 --2- 172.21.15.7:0/4138413342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56681036e0 0x7f5668198a90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f565c00c8c0 tx=0x7f565c00ccc0 comp rx=0 tx=0).stop 2024-09-19T08:43:37.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:37.068+0000 7f566e239640 1 -- 172.21.15.7:0/4138413342 shutdown_connections 2024-09-19T08:43:37.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:37.068+0000 7f566e239640 1 --2- 172.21.15.7:0/4138413342 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f56500a32d0 0x7f56500a5790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:37.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:37.069+0000 7f566e239640 1 --2- 172.21.15.7:0/4138413342 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56681082a0 0x7f566819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:37.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:37.069+0000 7f566e239640 1 --2- 172.21.15.7:0/4138413342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56681036e0 0x7f5668198a90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:37.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:37.069+0000 7f566e239640 1 --2- 172.21.15.7:0/4138413342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5668102d30 0x7f5668198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:37.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:37.069+0000 7f566e239640 1 -- 172.21.15.7:0/4138413342 >> 172.21.15.7:0/4138413342 conn(0x7f56680fc7d0 msgr2=0x7f5668106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:37.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:37.069+0000 7f566e239640 1 -- 172.21.15.7:0/4138413342 shutdown_connections 2024-09-19T08:43:37.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:37.069+0000 7f566e239640 1 -- 172.21.15.7:0/4138413342 wait complete. 2024-09-19T08:43:37.710 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:37 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/4138413342' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T08:43:37.747 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738443 got 34359738446 for osd.0 2024-09-19T08:43:37.747 DEBUG:teuthology.parallel:result is None 2024-09-19T08:43:37.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:37 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/4138413342' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T08:43:37.941 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:38.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:37 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/4138413342' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T08:43:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.240+0000 7f473eda0640 1 -- 172.21.15.7:0/2604193504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4738102ef0 msgr2=0x7f473810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.240+0000 7f473eda0640 1 --2- 172.21.15.7:0/2604193504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4738102ef0 0x7f473810da40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4730009900 tx=0x7f473002a480 comp rx=0 tx=0).stop 2024-09-19T08:43:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.240+0000 7f473eda0640 1 -- 172.21.15.7:0/2604193504 shutdown_connections 2024-09-19T08:43:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.240+0000 7f473eda0640 1 --2- 172.21.15.7:0/2604193504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4738102ef0 0x7f473810da40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.240+0000 7f473eda0640 1 --2- 172.21.15.7:0/2604193504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4738102570 0x7f47381029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.240+0000 7f473eda0640 1 --2- 172.21.15.7:0/2604193504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4738100e20 0x7f4738101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.240+0000 7f473eda0640 1 -- 172.21.15.7:0/2604193504 >> 172.21.15.7:0/2604193504 conn(0x7f47380fc7d0 msgr2=0x7f47380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.240+0000 7f473eda0640 1 -- 172.21.15.7:0/2604193504 shutdown_connections 2024-09-19T08:43:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.240+0000 7f473eda0640 1 -- 172.21.15.7:0/2604193504 wait complete. 2024-09-19T08:43:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.240+0000 7f473eda0640 1 Processor -- start 2024-09-19T08:43:38.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.241+0000 7f473eda0640 1 -- start start 2024-09-19T08:43:38.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.241+0000 7f473eda0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4738100e20 0x7f47380fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:38.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.241+0000 7f473eda0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4738102570 0x7f47380fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:38.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.241+0000 7f473eda0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4738102ef0 0x7f47380fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:38.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.241+0000 7f473eda0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4738110fa0 con 0x7f4738102570 2024-09-19T08:43:38.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.241+0000 7f473eda0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4738110e20 con 0x7f4738102ef0 2024-09-19T08:43:38.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.241+0000 7f473eda0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4738111120 con 0x7f4738100e20 2024-09-19T08:43:38.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.241+0000 7f4737fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4738102570 0x7f47380fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:38.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.241+0000 7f4737fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4738102570 0x7f47380fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58666/0 (socket says 172.21.15.7:58666) 2024-09-19T08:43:38.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.241+0000 7f4737fff640 1 -- 172.21.15.7:0/245888207 learned_addr learned my addr 172.21.15.7:0/245888207 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:38.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.241+0000 7f473d33d640 1 --2- 172.21.15.7:0/245888207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4738102ef0 0x7f47380fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:38.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.241+0000 7f4737fff640 1 -- 172.21.15.7:0/245888207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4738100e20 msgr2=0x7f47380fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.241+0000 7f473cb3c640 1 --2- 172.21.15.7:0/245888207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4738100e20 0x7f47380fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.241+0000 7f4737fff640 1 --2- 172.21.15.7:0/245888207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4738100e20 0x7f47380fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.241+0000 7f4737fff640 1 -- 172.21.15.7:0/245888207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4738102ef0 msgr2=0x7f47380fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.241+0000 7f4737fff640 1 --2- 172.21.15.7:0/245888207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4738102ef0 0x7f47380fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.241+0000 7f4737fff640 1 -- 172.21.15.7:0/245888207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47381a69a0 con 0x7f4738102570 2024-09-19T08:43:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.241+0000 7f4737fff640 1 --2- 172.21.15.7:0/245888207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4738102570 0x7f47380fd1c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f472000b4a0 tx=0x7f472000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.242+0000 7f4735ffb640 1 -- 172.21.15.7:0/245888207 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720014070 con 0x7f4738102570 2024-09-19T08:43:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.242+0000 7f4735ffb640 1 -- 172.21.15.7:0/245888207 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4720010af0 con 0x7f4738102570 2024-09-19T08:43:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.242+0000 7f473eda0640 1 -- 172.21.15.7:0/245888207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47381a6c90 con 0x7f4738102570 2024-09-19T08:43:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.242+0000 7f4735ffb640 1 -- 172.21.15.7:0/245888207 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720017d10 con 0x7f4738102570 2024-09-19T08:43:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.242+0000 7f473eda0640 1 -- 172.21.15.7:0/245888207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47381a7180 con 0x7f4738102570 2024-09-19T08:43:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.243+0000 7f473eda0640 1 -- 172.21.15.7:0/245888207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4738101200 con 0x7f4738102570 2024-09-19T08:43:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.244+0000 7f4735ffb640 1 -- 172.21.15.7:0/245888207 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f4720017070 con 0x7f4738102570 2024-09-19T08:43:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.245+0000 7f4735ffb640 1 --2- 172.21.15.7:0/245888207 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f47240a32d0 0x7f47240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.245+0000 7f473cb3c640 1 --2- 172.21.15.7:0/245888207 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f47240a32d0 0x7f47240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.245+0000 7f4735ffb640 1 -- 172.21.15.7:0/245888207 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f47200ced60 con 0x7f4738102570 2024-09-19T08:43:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.246+0000 7f473cb3c640 1 --2- 172.21.15.7:0/245888207 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f47240a32d0 0x7f47240a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4728005c40 tx=0x7f4728008230 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.250+0000 7f4735ffb640 1 -- 172.21.15.7:0/245888207 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f472009ba30 con 0x7f4738102570 2024-09-19T08:43:38.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.428+0000 7f473eda0640 1 -- 172.21.15.7:0/245888207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f473810a0d0 con 0x7f4738102570 2024-09-19T08:43:38.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.429+0000 7f4735ffb640 1 -- 172.21.15.7:0/245888207 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f472009b330 con 0x7f4738102570 2024-09-19T08:43:38.429 INFO:teuthology.orchestra.run.smithi007.stdout:210453397547 2024-09-19T08:43:38.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.431+0000 7f473eda0640 1 -- 172.21.15.7:0/245888207 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f47240a32d0 msgr2=0x7f47240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:38.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.431+0000 7f473eda0640 1 --2- 172.21.15.7:0/245888207 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f47240a32d0 0x7f47240a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4728005c40 tx=0x7f4728008230 comp rx=0 tx=0).stop 2024-09-19T08:43:38.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.431+0000 7f473eda0640 1 -- 172.21.15.7:0/245888207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4738102570 msgr2=0x7f47380fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:38.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.431+0000 7f473eda0640 1 --2- 172.21.15.7:0/245888207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4738102570 0x7f47380fd1c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f472000b4a0 tx=0x7f472000b960 comp rx=0 tx=0).stop 2024-09-19T08:43:38.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.431+0000 7f473eda0640 1 -- 172.21.15.7:0/245888207 shutdown_connections 2024-09-19T08:43:38.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.431+0000 7f473eda0640 1 --2- 172.21.15.7:0/245888207 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f47240a32d0 0x7f47240a5790 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:38.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.431+0000 7f473eda0640 1 --2- 172.21.15.7:0/245888207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4738102ef0 0x7f47380fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:38.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.431+0000 7f473eda0640 1 --2- 172.21.15.7:0/245888207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4738102570 0x7f47380fd1c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:38.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.431+0000 7f473eda0640 1 --2- 172.21.15.7:0/245888207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4738100e20 0x7f47380fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:38.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.431+0000 7f473eda0640 1 -- 172.21.15.7:0/245888207 >> 172.21.15.7:0/245888207 conn(0x7f47380fc7d0 msgr2=0x7f473806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:38.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.431+0000 7f473eda0640 1 -- 172.21.15.7:0/245888207 shutdown_connections 2024-09-19T08:43:38.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:38.431+0000 7f473eda0640 1 -- 172.21.15.7:0/245888207 wait complete. 2024-09-19T08:43:38.715 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:38 smithi007 ceph-mon[31221]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:43:38.716 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:38 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/245888207' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T08:43:38.743 INFO:tasks.cephadm.ceph_manager.ceph:need seq 317827579925 got 317827579927 for osd.11 2024-09-19T08:43:38.743 DEBUG:teuthology.parallel:result is None 2024-09-19T08:43:38.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:38 smithi175 ceph-mon[35688]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:43:38.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:38 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/245888207' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T08:43:39.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:38 smithi044 ceph-mon[35072]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:43:39.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:38 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/245888207' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T08:43:39.411 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397545 got 210453397547 for osd.7 2024-09-19T08:43:39.412 DEBUG:teuthology.parallel:result is None 2024-09-19T08:43:39.739 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:39.741 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:39.742 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:39.782 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953527 got 137438953529 for osd.4 2024-09-19T08:43:39.782 DEBUG:teuthology.parallel:result is None 2024-09-19T08:43:40.873 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:40 smithi007 ceph-mon[31221]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:43:40.874 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:40 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:43:40.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:40 smithi175 ceph-mon[35688]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:43:40.889 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:40 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:43:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.958+0000 7fa0d829d640 1 -- 172.21.15.7:0/1854605936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0d0106a80 msgr2=0x7fa0d0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.958+0000 7fa0d829d640 1 --2- 172.21.15.7:0/1854605936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0d0106a80 0x7fa0d0106e60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8009930 tx=0x7fa0c802a420 comp rx=0 tx=0).stop 2024-09-19T08:43:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.958+0000 7fa0d829d640 1 -- 172.21.15.7:0/1854605936 shutdown_connections 2024-09-19T08:43:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.958+0000 7fa0d829d640 1 --2- 172.21.15.7:0/1854605936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0d0101420 0x7fa0d010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.958+0000 7fa0d829d640 1 --2- 172.21.15.7:0/1854605936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d0100a80 0x7fa0d0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.958+0000 7fa0d829d640 1 --2- 172.21.15.7:0/1854605936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0d0106a80 0x7fa0d0106e60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.958+0000 7fa0d829d640 1 -- 172.21.15.7:0/1854605936 >> 172.21.15.7:0/1854605936 conn(0x7fa0d00fc7a0 msgr2=0x7fa0d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.958+0000 7fa0d829d640 1 -- 172.21.15.7:0/1854605936 shutdown_connections 2024-09-19T08:43:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.958+0000 7fa0d829d640 1 -- 172.21.15.7:0/1854605936 wait complete. 2024-09-19T08:43:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.959+0000 7fa0d829d640 1 Processor -- start 2024-09-19T08:43:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.959+0000 7fa0d829d640 1 -- start start 2024-09-19T08:43:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.959+0000 7fa0d829d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d0100a80 0x7fa0d019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.959+0000 7fa0d829d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0d0101420 0x7fa0d019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.959+0000 7fa0d829d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0d0106a80 0x7fa0d019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.959+0000 7fa0d829d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d0110e40 con 0x7fa0d0106a80 2024-09-19T08:43:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.959+0000 7fa0d829d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d0110cc0 con 0x7fa0d0101420 2024-09-19T08:43:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.959+0000 7fa0d829d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d0110fc0 con 0x7fa0d0100a80 2024-09-19T08:43:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.959+0000 7fa0d683a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0d0106a80 0x7fa0d019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.959+0000 7fa0d683a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0d0106a80 0x7fa0d019ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58692/0 (socket says 172.21.15.7:58692) 2024-09-19T08:43:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.959+0000 7fa0d6039640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d0100a80 0x7fa0d019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.960+0000 7fa0d683a640 1 -- 172.21.15.7:0/2705932379 learned_addr learned my addr 172.21.15.7:0/2705932379 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.960+0000 7fa0d5838640 1 --2- 172.21.15.7:0/2705932379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0d0101420 0x7fa0d019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.960+0000 7fa0d683a640 1 -- 172.21.15.7:0/2705932379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d0100a80 msgr2=0x7fa0d019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.960+0000 7fa0d683a640 1 --2- 172.21.15.7:0/2705932379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d0100a80 0x7fa0d019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.960+0000 7fa0d683a640 1 -- 172.21.15.7:0/2705932379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0d0101420 msgr2=0x7fa0d019aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.960+0000 7fa0d683a640 1 --2- 172.21.15.7:0/2705932379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0d0101420 0x7fa0d019aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.960+0000 7fa0d683a640 1 -- 172.21.15.7:0/2705932379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d019f610 con 0x7fa0d0106a80 2024-09-19T08:43:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.960+0000 7fa0d5838640 1 --2- 172.21.15.7:0/2705932379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0d0101420 0x7fa0d019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:43:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.960+0000 7fa0d683a640 1 --2- 172.21.15.7:0/2705932379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0d0106a80 0x7fa0d019ef30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000eaa0 tx=0x7fa0c000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.960+0000 7fa0cf7fe640 1 -- 172.21.15.7:0/2705932379 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c000cdb0 con 0x7fa0d0106a80 2024-09-19T08:43:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.960+0000 7fa0d829d640 1 -- 172.21.15.7:0/2705932379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0d019f900 con 0x7fa0d0106a80 2024-09-19T08:43:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.960+0000 7fa0cf7fe640 1 -- 172.21.15.7:0/2705932379 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0c0005020 con 0x7fa0d0106a80 2024-09-19T08:43:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.960+0000 7fa0cf7fe640 1 -- 172.21.15.7:0/2705932379 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c00116b0 con 0x7fa0d0106a80 2024-09-19T08:43:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.960+0000 7fa0d829d640 1 -- 172.21.15.7:0/2705932379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0d01a71e0 con 0x7fa0d0106a80 2024-09-19T08:43:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.961+0000 7fa0d829d640 1 -- 172.21.15.7:0/2705932379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0d0100ee0 con 0x7fa0d0106a80 2024-09-19T08:43:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.963+0000 7fa0cf7fe640 1 -- 172.21.15.7:0/2705932379 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fa0c0005560 con 0x7fa0d0106a80 2024-09-19T08:43:40.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.963+0000 7fa0cf7fe640 1 --2- 172.21.15.7:0/2705932379 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fa0b80a32d0 0x7fa0b80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:40.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.963+0000 7fa0d6039640 1 --2- 172.21.15.7:0/2705932379 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fa0b80a32d0 0x7fa0b80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:40.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.963+0000 7fa0cf7fe640 1 -- 172.21.15.7:0/2705932379 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa0c00cfc90 con 0x7fa0d0106a80 2024-09-19T08:43:40.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.964+0000 7fa0d6039640 1 --2- 172.21.15.7:0/2705932379 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fa0b80a32d0 0x7fa0b80a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8009900 tx=0x7fa0c80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:40.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:40.967+0000 7fa0cf7fe640 1 -- 172.21.15.7:0/2705932379 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa0c00d5020 con 0x7fa0d0106a80 2024-09-19T08:43:40.989 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:40.991 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:41.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:40 smithi044 ceph-mon[35072]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:43:41.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:40 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:43:41.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.154+0000 7fa0d829d640 1 -- 172.21.15.7:0/2705932379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fa0d01a74c0 con 0x7fa0d0106a80 2024-09-19T08:43:41.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.155+0000 7fa0cf7fe640 1 -- 172.21.15.7:0/2705932379 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa0c0016030 con 0x7fa0d0106a80 2024-09-19T08:43:41.155 INFO:teuthology.orchestra.run.smithi007.stdout:270582939682 2024-09-19T08:43:41.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.157+0000 7fa0d829d640 1 -- 172.21.15.7:0/2705932379 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fa0b80a32d0 msgr2=0x7fa0b80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:41.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.157+0000 7fa0d829d640 1 --2- 172.21.15.7:0/2705932379 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fa0b80a32d0 0x7fa0b80a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8009900 tx=0x7fa0c80058d0 comp rx=0 tx=0).stop 2024-09-19T08:43:41.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.157+0000 7fa0d829d640 1 -- 172.21.15.7:0/2705932379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0d0106a80 msgr2=0x7fa0d019ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:41.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.157+0000 7fa0d829d640 1 --2- 172.21.15.7:0/2705932379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0d0106a80 0x7fa0d019ef30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000eaa0 tx=0x7fa0c000ef60 comp rx=0 tx=0).stop 2024-09-19T08:43:41.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.157+0000 7fa0d829d640 1 -- 172.21.15.7:0/2705932379 shutdown_connections 2024-09-19T08:43:41.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.157+0000 7fa0d829d640 1 --2- 172.21.15.7:0/2705932379 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fa0b80a32d0 0x7fa0b80a5790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:41.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.157+0000 7fa0d829d640 1 --2- 172.21.15.7:0/2705932379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0d0106a80 0x7fa0d019ef30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:41.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.157+0000 7fa0d829d640 1 --2- 172.21.15.7:0/2705932379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0d0101420 0x7fa0d019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:41.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.157+0000 7fa0d829d640 1 --2- 172.21.15.7:0/2705932379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d0100a80 0x7fa0d019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:41.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.157+0000 7fa0d829d640 1 -- 172.21.15.7:0/2705932379 >> 172.21.15.7:0/2705932379 conn(0x7fa0d00fc7a0 msgr2=0x7fa0d010c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:41.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.157+0000 7fa0d829d640 1 -- 172.21.15.7:0/2705932379 shutdown_connections 2024-09-19T08:43:41.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.157+0000 7fa0d829d640 1 -- 172.21.15.7:0/2705932379 wait complete. 2024-09-19T08:43:41.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.158+0000 7f0ef73cd640 1 -- 172.21.15.7:0/3777711418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ef010a560 msgr2=0x7f0ef010a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:41.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.158+0000 7f0ef73cd640 1 --2- 172.21.15.7:0/3777711418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ef010a560 0x7f0ef010a940 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009900 tx=0x7f0eec02a410 comp rx=0 tx=0).stop 2024-09-19T08:43:41.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.158+0000 7f0ef73cd640 1 -- 172.21.15.7:0/3777711418 shutdown_connections 2024-09-19T08:43:41.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.158+0000 7f0ef73cd640 1 --2- 172.21.15.7:0/3777711418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ef0113940 0x7f0ef0115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:41.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.158+0000 7f0ef73cd640 1 --2- 172.21.15.7:0/3777711418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ef010ae80 0x7f0ef0113370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:41.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.158+0000 7f0ef73cd640 1 --2- 172.21.15.7:0/3777711418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ef010a560 0x7f0ef010a940 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:41.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.158+0000 7f0ef73cd640 1 -- 172.21.15.7:0/3777711418 >> 172.21.15.7:0/3777711418 conn(0x7f0ef006e140 msgr2=0x7f0ef006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:41.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.158+0000 7f0ef73cd640 1 -- 172.21.15.7:0/3777711418 shutdown_connections 2024-09-19T08:43:41.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.158+0000 7f0ef73cd640 1 -- 172.21.15.7:0/3777711418 wait complete. 2024-09-19T08:43:41.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.159+0000 7f0ef73cd640 1 Processor -- start 2024-09-19T08:43:41.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.159+0000 7f0ef73cd640 1 -- start start 2024-09-19T08:43:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.159+0000 7f0ef73cd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ef010a560 0x7f0ef01a6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.159+0000 7f0ef73cd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ef010ae80 0x7f0ef01a6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.159+0000 7f0ef73cd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ef0113940 0x7f0ef01a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.159+0000 7f0ef73cd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef0119660 con 0x7f0ef010a560 2024-09-19T08:43:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.159+0000 7f0ef73cd640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef01194e0 con 0x7f0ef010ae80 2024-09-19T08:43:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.159+0000 7f0ef73cd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef01197e0 con 0x7f0ef0113940 2024-09-19T08:43:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.159+0000 7f0ef5169640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ef010a560 0x7f0ef01a6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.159+0000 7f0ef5169640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ef010a560 0x7f0ef01a6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58712/0 (socket says 172.21.15.7:58712) 2024-09-19T08:43:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.159+0000 7f0ef5169640 1 -- 172.21.15.7:0/3964442292 learned_addr learned my addr 172.21.15.7:0/3964442292 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.160+0000 7f0ef4968640 1 --2- 172.21.15.7:0/3964442292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ef010ae80 0x7f0ef01a6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.160+0000 7f0ef596a640 1 --2- 172.21.15.7:0/3964442292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ef0113940 0x7f0ef01a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.160+0000 7f0ef5169640 1 -- 172.21.15.7:0/3964442292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ef0113940 msgr2=0x7f0ef01a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.160+0000 7f0ef5169640 1 --2- 172.21.15.7:0/3964442292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ef0113940 0x7f0ef01a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:41.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.160+0000 7f0ef5169640 1 -- 172.21.15.7:0/3964442292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ef010ae80 msgr2=0x7f0ef01a6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:41.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.160+0000 7f0ef5169640 1 --2- 172.21.15.7:0/3964442292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ef010ae80 0x7f0ef01a6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:41.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.160+0000 7f0ef5169640 1 -- 172.21.15.7:0/3964442292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef01a1230 con 0x7f0ef010a560 2024-09-19T08:43:41.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.160+0000 7f0ef5169640 1 --2- 172.21.15.7:0/3964442292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ef010a560 0x7f0ef01a6940 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0eec006010 tx=0x7f0eec004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:41.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.160+0000 7f0ee67fc640 1 -- 172.21.15.7:0/3964442292 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec03f030 con 0x7f0ef010a560 2024-09-19T08:43:41.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.160+0000 7f0ef73cd640 1 -- 172.21.15.7:0/3964442292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef01a14c0 con 0x7f0ef010a560 2024-09-19T08:43:41.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.160+0000 7f0ee67fc640 1 -- 172.21.15.7:0/3964442292 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0eec004440 con 0x7f0ef010a560 2024-09-19T08:43:41.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.160+0000 7f0ee67fc640 1 -- 172.21.15.7:0/3964442292 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec035070 con 0x7f0ef010a560 2024-09-19T08:43:41.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.160+0000 7f0ef73cd640 1 -- 172.21.15.7:0/3964442292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef01ad810 con 0x7f0ef010a560 2024-09-19T08:43:41.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.161+0000 7f0ef73cd640 1 -- 172.21.15.7:0/3964442292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ef010a940 con 0x7f0ef010a560 2024-09-19T08:43:41.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.163+0000 7f0ee67fc640 1 -- 172.21.15.7:0/3964442292 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f0eec042030 con 0x7f0ef010a560 2024-09-19T08:43:41.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.164+0000 7f0ee67fc640 1 --2- 172.21.15.7:0/3964442292 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0edc0a32d0 0x7f0edc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:41.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.164+0000 7f0ef4968640 1 --2- 172.21.15.7:0/3964442292 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0edc0a32d0 0x7f0edc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:41.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.164+0000 7f0ee67fc640 1 -- 172.21.15.7:0/3964442292 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0eec0f0100 con 0x7f0ef010a560 2024-09-19T08:43:41.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.165+0000 7f0ef4968640 1 --2- 172.21.15.7:0/3964442292 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0edc0a32d0 0x7f0edc0a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0073470 tx=0x7f0ee0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:41.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.168+0000 7f0ee67fc640 1 -- 172.21.15.7:0/3964442292 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0eec0bcc80 con 0x7f0ef010a560 2024-09-19T08:43:41.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.346+0000 7f0ef73cd640 1 -- 172.21.15.7:0/3964442292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f0ef010f9e0 con 0x7f0ef010a560 2024-09-19T08:43:41.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.346+0000 7f0ee67fc640 1 -- 172.21.15.7:0/3964442292 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0eec0bc580 con 0x7f0ef010a560 2024-09-19T08:43:41.347 INFO:teuthology.orchestra.run.smithi007.stdout:158913790004 2024-09-19T08:43:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.348+0000 7f0ef73cd640 1 -- 172.21.15.7:0/3964442292 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0edc0a32d0 msgr2=0x7f0edc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.348+0000 7f0ef73cd640 1 --2- 172.21.15.7:0/3964442292 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0edc0a32d0 0x7f0edc0a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0073470 tx=0x7f0ee0005f90 comp rx=0 tx=0).stop 2024-09-19T08:43:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.348+0000 7f0ef73cd640 1 -- 172.21.15.7:0/3964442292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ef010a560 msgr2=0x7f0ef01a6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.348+0000 7f0ef73cd640 1 --2- 172.21.15.7:0/3964442292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ef010a560 0x7f0ef01a6940 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0eec006010 tx=0x7f0eec004040 comp rx=0 tx=0).stop 2024-09-19T08:43:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.349+0000 7f0ef73cd640 1 -- 172.21.15.7:0/3964442292 shutdown_connections 2024-09-19T08:43:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.349+0000 7f0ef73cd640 1 --2- 172.21.15.7:0/3964442292 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0edc0a32d0 0x7f0edc0a5790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.349+0000 7f0ef73cd640 1 --2- 172.21.15.7:0/3964442292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ef0113940 0x7f0ef01a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.349+0000 7f0ef73cd640 1 --2- 172.21.15.7:0/3964442292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ef010ae80 0x7f0ef01a6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.349+0000 7f0ef73cd640 1 --2- 172.21.15.7:0/3964442292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ef010a560 0x7f0ef01a6940 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.349+0000 7f0ef73cd640 1 -- 172.21.15.7:0/3964442292 >> 172.21.15.7:0/3964442292 conn(0x7f0ef006e140 msgr2=0x7f0ef0109530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.349+0000 7f0ef73cd640 1 -- 172.21.15.7:0/3964442292 shutdown_connections 2024-09-19T08:43:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:41.349+0000 7f0ef73cd640 1 -- 172.21.15.7:0/3964442292 wait complete. 2024-09-19T08:43:41.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:41 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/2705932379' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T08:43:41.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:41 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3964442292' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T08:43:41.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:41 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:43:41.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:41 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:43:41.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:41 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:43:41.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:41 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:43:41.990 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:41 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2705932379' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T08:43:41.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:41 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3964442292' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T08:43:41.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:41 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:43:41.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:41 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:43:41.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:41 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:43:41.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:41 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:43:42.017 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790001 got 158913790004 for osd.5 2024-09-19T08:43:42.017 DEBUG:teuthology.parallel:result is None 2024-09-19T08:43:42.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:41 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/2705932379' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T08:43:42.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:41 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3964442292' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T08:43:42.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:41 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:43:42.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:41 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:43:42.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:41 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:43:42.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:41 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:43:42.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.242+0000 7f7b3f5ba640 1 -- 172.21.15.7:0/2335851535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b38101de0 msgr2=0x7f7b381021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:42.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.242+0000 7f7b3f5ba640 1 --2- 172.21.15.7:0/2335851535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b38101de0 0x7f7b381021c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009900 tx=0x7f7b3402a410 comp rx=0 tx=0).stop 2024-09-19T08:43:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.243+0000 7f7b3f5ba640 1 -- 172.21.15.7:0/2335851535 shutdown_connections 2024-09-19T08:43:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.243+0000 7f7b3f5ba640 1 --2- 172.21.15.7:0/2335851535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b38106f10 0x7f7b3810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.243+0000 7f7b3f5ba640 1 --2- 172.21.15.7:0/2335851535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b38102790 0x7f7b381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.243+0000 7f7b3f5ba640 1 --2- 172.21.15.7:0/2335851535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b38101de0 0x7f7b381021c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.243+0000 7f7b3f5ba640 1 -- 172.21.15.7:0/2335851535 >> 172.21.15.7:0/2335851535 conn(0x7f7b380fd8c0 msgr2=0x7f7b380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.243+0000 7f7b3f5ba640 1 -- 172.21.15.7:0/2335851535 shutdown_connections 2024-09-19T08:43:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.243+0000 7f7b3f5ba640 1 -- 172.21.15.7:0/2335851535 wait complete. 2024-09-19T08:43:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.244+0000 7f7b3f5ba640 1 Processor -- start 2024-09-19T08:43:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.244+0000 7f7b3f5ba640 1 -- start start 2024-09-19T08:43:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.244+0000 7f7b3f5ba640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b38101de0 0x7f7b380744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.244+0000 7f7b3f5ba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b38102790 0x7f7b38074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.244+0000 7f7b3f5ba640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b38106f10 0x7f7b38074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.244+0000 7f7b3f5ba640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7b38111fb0 con 0x7f7b38106f10 2024-09-19T08:43:42.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.244+0000 7f7b3f5ba640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7b38111e30 con 0x7f7b38102790 2024-09-19T08:43:42.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.244+0000 7f7b3f5ba640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7b38112130 con 0x7f7b38101de0 2024-09-19T08:43:42.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.244+0000 7f7b3db57640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b38106f10 0x7f7b38074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:42.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.244+0000 7f7b3db57640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b38106f10 0x7f7b38074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58742/0 (socket says 172.21.15.7:58742) 2024-09-19T08:43:42.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.244+0000 7f7b3db57640 1 -- 172.21.15.7:0/2512139269 learned_addr learned my addr 172.21.15.7:0/2512139269 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:42.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.244+0000 7f7b3cb55640 1 --2- 172.21.15.7:0/2512139269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b38102790 0x7f7b38074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:42.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.244+0000 7f7b3db57640 1 -- 172.21.15.7:0/2512139269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b38101de0 msgr2=0x7f7b380744f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T08:43:42.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.244+0000 7f7b3db57640 1 --2- 172.21.15.7:0/2512139269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b38101de0 0x7f7b380744f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:42.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.245+0000 7f7b3db57640 1 -- 172.21.15.7:0/2512139269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b38102790 msgr2=0x7f7b38074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:42.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.245+0000 7f7b3db57640 1 --2- 172.21.15.7:0/2512139269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b38102790 0x7f7b38074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:42.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.245+0000 7f7b3db57640 1 -- 172.21.15.7:0/2512139269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b381a6a10 con 0x7f7b38106f10 2024-09-19T08:43:42.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.245+0000 7f7b3cb55640 1 --2- 172.21.15.7:0/2512139269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b38102790 0x7f7b38074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:43:42.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.245+0000 7f7b3db57640 1 --2- 172.21.15.7:0/2512139269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b38106f10 0x7f7b38074f70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000cad0 tx=0x7f7b3000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:42.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.245+0000 7f7b2e7fc640 1 -- 172.21.15.7:0/2512139269 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3000ae20 con 0x7f7b38106f10 2024-09-19T08:43:42.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.245+0000 7f7b2e7fc640 1 -- 172.21.15.7:0/2512139269 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b30005020 con 0x7f7b38106f10 2024-09-19T08:43:42.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.245+0000 7f7b3f5ba640 1 -- 172.21.15.7:0/2512139269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b381a6d00 con 0x7f7b38106f10 2024-09-19T08:43:42.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.245+0000 7f7b2e7fc640 1 -- 172.21.15.7:0/2512139269 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3000f6f0 con 0x7f7b38106f10 2024-09-19T08:43:42.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.245+0000 7f7b3f5ba640 1 -- 172.21.15.7:0/2512139269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b381a71f0 con 0x7f7b38106f10 2024-09-19T08:43:42.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.246+0000 7f7b3f5ba640 1 -- 172.21.15.7:0/2512139269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b381021c0 con 0x7f7b38106f10 2024-09-19T08:43:42.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.247+0000 7f7b2e7fc640 1 -- 172.21.15.7:0/2512139269 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f7b300051d0 con 0x7f7b38106f10 2024-09-19T08:43:42.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.248+0000 7f7b2e7fc640 1 --2- 172.21.15.7:0/2512139269 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f7b240a32d0 0x7f7b240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:42.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.248+0000 7f7b3d356640 1 --2- 172.21.15.7:0/2512139269 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f7b240a32d0 0x7f7b240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:42.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.248+0000 7f7b2e7fc640 1 -- 172.21.15.7:0/2512139269 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7b300cff90 con 0x7f7b38106f10 2024-09-19T08:43:42.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.248+0000 7f7b3d356640 1 --2- 172.21.15.7:0/2512139269 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f7b240a32d0 0x7f7b240a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7b3402a930 tx=0x7f7b34000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:42.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.251+0000 7f7b2e7fc640 1 -- 172.21.15.7:0/2512139269 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7b30014030 con 0x7f7b38106f10 2024-09-19T08:43:42.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.429+0000 7f7b3f5ba640 1 -- 172.21.15.7:0/2512139269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7b38075a20 con 0x7f7b38106f10 2024-09-19T08:43:42.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.429+0000 7f7b2e7fc640 1 -- 172.21.15.7:0/2512139269 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7b3009cb50 con 0x7f7b38106f10 2024-09-19T08:43:42.429 INFO:teuthology.orchestra.run.smithi007.stdout:55834574922 2024-09-19T08:43:42.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.431+0000 7f7b3f5ba640 1 -- 172.21.15.7:0/2512139269 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f7b240a32d0 msgr2=0x7f7b240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:42.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.431+0000 7f7b3f5ba640 1 --2- 172.21.15.7:0/2512139269 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f7b240a32d0 0x7f7b240a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7b3402a930 tx=0x7f7b34000bc0 comp rx=0 tx=0).stop 2024-09-19T08:43:42.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.431+0000 7f7b3f5ba640 1 -- 172.21.15.7:0/2512139269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b38106f10 msgr2=0x7f7b38074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:42.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.431+0000 7f7b3f5ba640 1 --2- 172.21.15.7:0/2512139269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b38106f10 0x7f7b38074f70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000cad0 tx=0x7f7b3000cf90 comp rx=0 tx=0).stop 2024-09-19T08:43:42.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.431+0000 7f7b3f5ba640 1 -- 172.21.15.7:0/2512139269 shutdown_connections 2024-09-19T08:43:42.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.431+0000 7f7b3f5ba640 1 --2- 172.21.15.7:0/2512139269 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f7b240a32d0 0x7f7b240a5790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:42.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.431+0000 7f7b3f5ba640 1 --2- 172.21.15.7:0/2512139269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b38106f10 0x7f7b38074f70 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:42.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.431+0000 7f7b3f5ba640 1 --2- 172.21.15.7:0/2512139269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b38102790 0x7f7b38074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:42.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.431+0000 7f7b3f5ba640 1 --2- 172.21.15.7:0/2512139269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b38101de0 0x7f7b380744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:42.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.431+0000 7f7b3f5ba640 1 -- 172.21.15.7:0/2512139269 >> 172.21.15.7:0/2512139269 conn(0x7f7b380fd8c0 msgr2=0x7f7b380fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:42.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.431+0000 7f7b3f5ba640 1 -- 172.21.15.7:0/2512139269 shutdown_connections 2024-09-19T08:43:42.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:42.431+0000 7f7b3f5ba640 1 -- 172.21.15.7:0/2512139269 wait complete. 2024-09-19T08:43:42.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:42 smithi007 ceph-mon[31221]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-09-19T08:43:42.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:42 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2512139269' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T08:43:42.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:42 smithi175 ceph-mon[35688]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-09-19T08:43:42.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:42 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/2512139269' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T08:43:43.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:42 smithi044 ceph-mon[35072]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-09-19T08:43:43.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:42 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/2512139269' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T08:43:43.087 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574919 got 55834574922 for osd.1 2024-09-19T08:43:43.088 DEBUG:teuthology.parallel:result is None 2024-09-19T08:43:43.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.520+0000 7fdf535fd640 1 -- 172.21.15.7:0/2146944702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf4c101420 msgr2=0x7fdf4c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:43.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.520+0000 7fdf535fd640 1 --2- 172.21.15.7:0/2146944702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf4c101420 0x7fdf4c10d950 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009930 tx=0x7fdf4402a420 comp rx=0 tx=0).stop 2024-09-19T08:43:43.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.520+0000 7fdf535fd640 1 -- 172.21.15.7:0/2146944702 shutdown_connections 2024-09-19T08:43:43.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.520+0000 7fdf535fd640 1 --2- 172.21.15.7:0/2146944702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf4c101420 0x7fdf4c10d950 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:43.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.520+0000 7fdf535fd640 1 --2- 172.21.15.7:0/2146944702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf4c100a80 0x7fdf4c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:43.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.520+0000 7fdf535fd640 1 --2- 172.21.15.7:0/2146944702 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf4c106a80 0x7fdf4c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:43.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.520+0000 7fdf535fd640 1 -- 172.21.15.7:0/2146944702 >> 172.21.15.7:0/2146944702 conn(0x7fdf4c0fc7a0 msgr2=0x7fdf4c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:43.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.520+0000 7fdf535fd640 1 -- 172.21.15.7:0/2146944702 shutdown_connections 2024-09-19T08:43:43.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.520+0000 7fdf535fd640 1 -- 172.21.15.7:0/2146944702 wait complete. 2024-09-19T08:43:43.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.521+0000 7fdf535fd640 1 Processor -- start 2024-09-19T08:43:43.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.521+0000 7fdf535fd640 1 -- start start 2024-09-19T08:43:43.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.521+0000 7fdf535fd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf4c100a80 0x7fdf4c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:43.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.521+0000 7fdf535fd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf4c101420 0x7fdf4c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:43.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.521+0000 7fdf535fd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf4c106a80 0x7fdf4c19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:43.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.521+0000 7fdf535fd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c110ea0 con 0x7fdf4c106a80 2024-09-19T08:43:43.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.521+0000 7fdf535fd640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c110d20 con 0x7fdf4c101420 2024-09-19T08:43:43.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.521+0000 7fdf535fd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4c111020 con 0x7fdf4c100a80 2024-09-19T08:43:43.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.521+0000 7fdf51b9a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf4c106a80 0x7fdf4c19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:43.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.521+0000 7fdf51b9a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf4c106a80 0x7fdf4c19cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54960/0 (socket says 172.21.15.7:54960) 2024-09-19T08:43:43.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.521+0000 7fdf51b9a640 1 -- 172.21.15.7:0/1671641980 learned_addr learned my addr 172.21.15.7:0/1671641980 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:43.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.521+0000 7fdf51399640 1 --2- 172.21.15.7:0/1671641980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf4c100a80 0x7fdf4c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:43.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.521+0000 7fdf50b98640 1 --2- 172.21.15.7:0/1671641980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf4c101420 0x7fdf4c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:43.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.521+0000 7fdf51b9a640 1 -- 172.21.15.7:0/1671641980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf4c100a80 msgr2=0x7fdf4c198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:43.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.521+0000 7fdf51b9a640 1 --2- 172.21.15.7:0/1671641980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf4c100a80 0x7fdf4c198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:43.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.521+0000 7fdf51b9a640 1 -- 172.21.15.7:0/1671641980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf4c101420 msgr2=0x7fdf4c198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:43.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.521+0000 7fdf51b9a640 1 --2- 172.21.15.7:0/1671641980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf4c101420 0x7fdf4c198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:43.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.521+0000 7fdf51b9a640 1 -- 172.21.15.7:0/1671641980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf4c19d3f0 con 0x7fdf4c106a80 2024-09-19T08:43:43.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.522+0000 7fdf51b9a640 1 --2- 172.21.15.7:0/1671641980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf4c106a80 0x7fdf4c19cd10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdf44005ab0 tx=0x7fdf440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:43.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.522+0000 7fdf4a7fc640 1 -- 172.21.15.7:0/1671641980 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4403f030 con 0x7fdf4c106a80 2024-09-19T08:43:43.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.522+0000 7fdf4a7fc640 1 -- 172.21.15.7:0/1671641980 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf44003ce0 con 0x7fdf4c106a80 2024-09-19T08:43:43.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.522+0000 7fdf535fd640 1 -- 172.21.15.7:0/1671641980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf4c19d680 con 0x7fdf4c106a80 2024-09-19T08:43:43.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.522+0000 7fdf4a7fc640 1 -- 172.21.15.7:0/1671641980 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf44035070 con 0x7fdf4c106a80 2024-09-19T08:43:43.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.522+0000 7fdf535fd640 1 -- 172.21.15.7:0/1671641980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf4c1a4fc0 con 0x7fdf4c106a80 2024-09-19T08:43:43.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.523+0000 7fdf535fd640 1 -- 172.21.15.7:0/1671641980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf4c100ee0 con 0x7fdf4c106a80 2024-09-19T08:43:43.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.524+0000 7fdf4a7fc640 1 -- 172.21.15.7:0/1671641980 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fdf44042030 con 0x7fdf4c106a80 2024-09-19T08:43:43.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.525+0000 7fdf4a7fc640 1 --2- 172.21.15.7:0/1671641980 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fdf340a32d0 0x7fdf340a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:43.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.525+0000 7fdf51399640 1 --2- 172.21.15.7:0/1671641980 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fdf340a32d0 0x7fdf340a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:43.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.525+0000 7fdf4a7fc640 1 -- 172.21.15.7:0/1671641980 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdf440f0420 con 0x7fdf4c106a80 2024-09-19T08:43:43.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.525+0000 7fdf51399640 1 --2- 172.21.15.7:0/1671641980 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fdf340a32d0 0x7fdf340a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c005fd0 tx=0x7fdf3c00b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:43.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.528+0000 7fdf4a7fc640 1 -- 172.21.15.7:0/1671641980 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdf440bcfa0 con 0x7fdf4c106a80 2024-09-19T08:43:43.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.710+0000 7fdf535fd640 1 -- 172.21.15.7:0/1671641980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fdf4c10a020 con 0x7fdf4c106a80 2024-09-19T08:43:43.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.710+0000 7fdf4a7fc640 1 -- 172.21.15.7:0/1671641980 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdf440bc8a0 con 0x7fdf4c106a80 2024-09-19T08:43:43.710 INFO:teuthology.orchestra.run.smithi007.stdout:188978561074 2024-09-19T08:43:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.712+0000 7fdf535fd640 1 -- 172.21.15.7:0/1671641980 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fdf340a32d0 msgr2=0x7fdf340a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.712+0000 7fdf535fd640 1 --2- 172.21.15.7:0/1671641980 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fdf340a32d0 0x7fdf340a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c005fd0 tx=0x7fdf3c00b590 comp rx=0 tx=0).stop 2024-09-19T08:43:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.712+0000 7fdf535fd640 1 -- 172.21.15.7:0/1671641980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf4c106a80 msgr2=0x7fdf4c19cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.712+0000 7fdf535fd640 1 --2- 172.21.15.7:0/1671641980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf4c106a80 0x7fdf4c19cd10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdf44005ab0 tx=0x7fdf440042f0 comp rx=0 tx=0).stop 2024-09-19T08:43:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.712+0000 7fdf535fd640 1 -- 172.21.15.7:0/1671641980 shutdown_connections 2024-09-19T08:43:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.712+0000 7fdf535fd640 1 --2- 172.21.15.7:0/1671641980 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fdf340a32d0 0x7fdf340a5790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.712+0000 7fdf535fd640 1 --2- 172.21.15.7:0/1671641980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf4c106a80 0x7fdf4c19cd10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.712+0000 7fdf535fd640 1 --2- 172.21.15.7:0/1671641980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf4c101420 0x7fdf4c198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.712+0000 7fdf535fd640 1 --2- 172.21.15.7:0/1671641980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf4c100a80 0x7fdf4c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.712+0000 7fdf535fd640 1 -- 172.21.15.7:0/1671641980 >> 172.21.15.7:0/1671641980 conn(0x7fdf4c0fc7a0 msgr2=0x7fdf4c06aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.712+0000 7fdf535fd640 1 -- 172.21.15.7:0/1671641980 shutdown_connections 2024-09-19T08:43:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.713+0000 7fdf535fd640 1 -- 172.21.15.7:0/1671641980 wait complete. 2024-09-19T08:43:43.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.740+0000 7ff94a0f8640 1 -- 172.21.15.7:0/2089358953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9441036e0 msgr2=0x7ff944107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:43.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.740+0000 7ff94a0f8640 1 --2- 172.21.15.7:0/2089358953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9441036e0 0x7ff944107b90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff938009930 tx=0x7ff93802a420 comp rx=0 tx=0).stop 2024-09-19T08:43:43.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.740+0000 7ff94a0f8640 1 -- 172.21.15.7:0/2089358953 shutdown_connections 2024-09-19T08:43:43.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.740+0000 7ff94a0f8640 1 --2- 172.21.15.7:0/2089358953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9441082a0 0x7ff94410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.740+0000 7ff94a0f8640 1 --2- 172.21.15.7:0/2089358953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9441036e0 0x7ff944107b90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.740+0000 7ff94a0f8640 1 --2- 172.21.15.7:0/2089358953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff944102d30 0x7ff944103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.740+0000 7ff94a0f8640 1 -- 172.21.15.7:0/2089358953 >> 172.21.15.7:0/2089358953 conn(0x7ff9440fc7d0 msgr2=0x7ff9440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.740+0000 7ff94a0f8640 1 -- 172.21.15.7:0/2089358953 shutdown_connections 2024-09-19T08:43:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.740+0000 7ff94a0f8640 1 -- 172.21.15.7:0/2089358953 wait complete. 2024-09-19T08:43:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.741+0000 7ff94a0f8640 1 Processor -- start 2024-09-19T08:43:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.741+0000 7ff94a0f8640 1 -- start start 2024-09-19T08:43:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.742+0000 7ff94a0f8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff944102d30 0x7ff944198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.742+0000 7ff94a0f8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9441036e0 0x7ff944198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.742+0000 7ff94a0f8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9441082a0 0x7ff94419cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.742+0000 7ff94a0f8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff9441120c0 con 0x7ff944102d30 2024-09-19T08:43:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.742+0000 7ff9437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff944102d30 0x7ff944198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.742+0000 7ff94a0f8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff944111f40 con 0x7ff9441082a0 2024-09-19T08:43:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.742+0000 7ff9437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff944102d30 0x7ff944198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54978/0 (socket says 172.21.15.7:54978) 2024-09-19T08:43:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.742+0000 7ff9437fe640 1 -- 172.21.15.7:0/2902177361 learned_addr learned my addr 172.21.15.7:0/2902177361 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.742+0000 7ff94a0f8640 1 -- 172.21.15.7:0/2902177361 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff944112240 con 0x7ff9441036e0 2024-09-19T08:43:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.742+0000 7ff942ffd640 1 --2- 172.21.15.7:0/2902177361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9441036e0 0x7ff944198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.742+0000 7ff943fff640 1 --2- 172.21.15.7:0/2902177361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9441082a0 0x7ff94419cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.742+0000 7ff9437fe640 1 -- 172.21.15.7:0/2902177361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9441036e0 msgr2=0x7ff944198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.742+0000 7ff9437fe640 1 --2- 172.21.15.7:0/2902177361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9441036e0 0x7ff944198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.742+0000 7ff9437fe640 1 -- 172.21.15.7:0/2902177361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9441082a0 msgr2=0x7ff94419cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.742+0000 7ff9437fe640 1 --2- 172.21.15.7:0/2902177361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9441082a0 0x7ff94419cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.742+0000 7ff9437fe640 1 -- 172.21.15.7:0/2902177361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94419d630 con 0x7ff944102d30 2024-09-19T08:43:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.742+0000 7ff9437fe640 1 --2- 172.21.15.7:0/2902177361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff944102d30 0x7ff944198680 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff93400b4a0 tx=0x7ff93400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:43.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.743+0000 7ff940ff9640 1 -- 172.21.15.7:0/2902177361 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff934014070 con 0x7ff944102d30 2024-09-19T08:43:43.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.743+0000 7ff940ff9640 1 -- 172.21.15.7:0/2902177361 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff934010af0 con 0x7ff944102d30 2024-09-19T08:43:43.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.743+0000 7ff94a0f8640 1 -- 172.21.15.7:0/2902177361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff94419d920 con 0x7ff944102d30 2024-09-19T08:43:43.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.743+0000 7ff940ff9640 1 -- 172.21.15.7:0/2902177361 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff934017d10 con 0x7ff944102d30 2024-09-19T08:43:43.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.743+0000 7ff94a0f8640 1 -- 172.21.15.7:0/2902177361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9441a5200 con 0x7ff944102d30 2024-09-19T08:43:43.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.744+0000 7ff94a0f8640 1 -- 172.21.15.7:0/2902177361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff94406a850 con 0x7ff944102d30 2024-09-19T08:43:43.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.745+0000 7ff940ff9640 1 -- 172.21.15.7:0/2902177361 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ff934017070 con 0x7ff944102d30 2024-09-19T08:43:43.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.746+0000 7ff940ff9640 1 --2- 172.21.15.7:0/2902177361 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff92c0a32d0 0x7ff92c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:43.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.746+0000 7ff942ffd640 1 --2- 172.21.15.7:0/2902177361 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff92c0a32d0 0x7ff92c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:43.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.746+0000 7ff940ff9640 1 -- 172.21.15.7:0/2902177361 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff9340cf0c0 con 0x7ff944102d30 2024-09-19T08:43:43.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.746+0000 7ff942ffd640 1 --2- 172.21.15.7:0/2902177361 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff92c0a32d0 0x7ff92c0a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff938005940 tx=0x7ff9380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:43.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.749+0000 7ff940ff9640 1 -- 172.21.15.7:0/2902177361 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff93409b740 con 0x7ff944102d30 2024-09-19T08:43:43.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.928+0000 7ff94a0f8640 1 -- 172.21.15.7:0/2902177361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff944103110 con 0x7ff944102d30 2024-09-19T08:43:43.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.928+0000 7ff940ff9640 1 -- 172.21.15.7:0/2902177361 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff944103110 con 0x7ff944102d30 2024-09-19T08:43:43.928 INFO:teuthology.orchestra.run.smithi007.stdout:73014444101 2024-09-19T08:43:43.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.930+0000 7ff94a0f8640 1 -- 172.21.15.7:0/2902177361 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff92c0a32d0 msgr2=0x7ff92c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:43.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.930+0000 7ff94a0f8640 1 --2- 172.21.15.7:0/2902177361 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff92c0a32d0 0x7ff92c0a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff938005940 tx=0x7ff9380058d0 comp rx=0 tx=0).stop 2024-09-19T08:43:43.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.930+0000 7ff94a0f8640 1 -- 172.21.15.7:0/2902177361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff944102d30 msgr2=0x7ff944198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:43.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.930+0000 7ff94a0f8640 1 --2- 172.21.15.7:0/2902177361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff944102d30 0x7ff944198680 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff93400b4a0 tx=0x7ff93400b960 comp rx=0 tx=0).stop 2024-09-19T08:43:43.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.930+0000 7ff94a0f8640 1 -- 172.21.15.7:0/2902177361 shutdown_connections 2024-09-19T08:43:43.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.930+0000 7ff94a0f8640 1 --2- 172.21.15.7:0/2902177361 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff92c0a32d0 0x7ff92c0a5790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:43.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.930+0000 7ff94a0f8640 1 --2- 172.21.15.7:0/2902177361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9441082a0 0x7ff94419cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:43.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.930+0000 7ff94a0f8640 1 --2- 172.21.15.7:0/2902177361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9441036e0 0x7ff944198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:43.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.930+0000 7ff94a0f8640 1 --2- 172.21.15.7:0/2902177361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff944102d30 0x7ff944198680 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:43.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.930+0000 7ff94a0f8640 1 -- 172.21.15.7:0/2902177361 >> 172.21.15.7:0/2902177361 conn(0x7ff9440fc7d0 msgr2=0x7ff944105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:43.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.931+0000 7ff94a0f8640 1 -- 172.21.15.7:0/2902177361 shutdown_connections 2024-09-19T08:43:43.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:43.931+0000 7ff94a0f8640 1 -- 172.21.15.7:0/2902177361 wait complete. 2024-09-19T08:43:44.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.240+0000 7f503b4d6640 1 -- 172.21.15.7:0/27594153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5034101200 msgr2=0x7f5034101660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:44.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.240+0000 7f503b4d6640 1 --2- 172.21.15.7:0/27594153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5034101200 0x7f5034101660 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5024009900 tx=0x7f502402a410 comp rx=0 tx=0).stop 2024-09-19T08:43:44.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.240+0000 7f503b4d6640 1 -- 172.21.15.7:0/27594153 shutdown_connections 2024-09-19T08:43:44.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.240+0000 7f503b4d6640 1 --2- 172.21.15.7:0/27594153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5034101ba0 0x7f503410d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:44.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.240+0000 7f503b4d6640 1 --2- 172.21.15.7:0/27594153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5034101200 0x7f5034101660 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:44.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.240+0000 7f503b4d6640 1 --2- 172.21.15.7:0/27594153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5034105ad0 0x7f5034105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:44.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.240+0000 7f503b4d6640 1 -- 172.21.15.7:0/27594153 >> 172.21.15.7:0/27594153 conn(0x7f5034077210 msgr2=0x7f50340fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:44.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.240+0000 7f503b4d6640 1 -- 172.21.15.7:0/27594153 shutdown_connections 2024-09-19T08:43:44.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.240+0000 7f503b4d6640 1 -- 172.21.15.7:0/27594153 wait complete. 2024-09-19T08:43:44.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.241+0000 7f503b4d6640 1 Processor -- start 2024-09-19T08:43:44.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.241+0000 7f503b4d6640 1 -- start start 2024-09-19T08:43:44.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.241+0000 7f503b4d6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5034101200 0x7f50340fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:44.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.241+0000 7f503b4d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5034101ba0 0x7f50340fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:44.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.241+0000 7f503b4d6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5034105ad0 0x7f50340fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:44.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.241+0000 7f503b4d6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5034110f70 con 0x7f5034105ad0 2024-09-19T08:43:44.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.241+0000 7f503b4d6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5034110df0 con 0x7f5034101ba0 2024-09-19T08:43:44.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.241+0000 7f503b4d6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f50341110f0 con 0x7f5034101200 2024-09-19T08:43:44.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.241+0000 7f5039a73640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5034105ad0 0x7f50340fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:44.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.241+0000 7f5039a73640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5034105ad0 0x7f50340fd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54996/0 (socket says 172.21.15.7:54996) 2024-09-19T08:43:44.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.241+0000 7f5039a73640 1 -- 172.21.15.7:0/2293117716 learned_addr learned my addr 172.21.15.7:0/2293117716 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:44.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.242+0000 7f5038a71640 1 --2- 172.21.15.7:0/2293117716 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5034101ba0 0x7f50340fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:44.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.242+0000 7f5039a73640 1 -- 172.21.15.7:0/2293117716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5034101200 msgr2=0x7f50340fc690 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T08:43:44.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.242+0000 7f5039a73640 1 --2- 172.21.15.7:0/2293117716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5034101200 0x7f50340fc690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:44.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.242+0000 7f5039a73640 1 -- 172.21.15.7:0/2293117716 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5034101ba0 msgr2=0x7f50340fcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:44.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.242+0000 7f5039a73640 1 --2- 172.21.15.7:0/2293117716 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5034101ba0 0x7f50340fcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:44.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.242+0000 7f5039a73640 1 -- 172.21.15.7:0/2293117716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50341a6a30 con 0x7f5034105ad0 2024-09-19T08:43:44.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.242+0000 7f5039a73640 1 --2- 172.21.15.7:0/2293117716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5034105ad0 0x7f50340fd110 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f502c00b9e0 tx=0x7f502c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:44.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.242+0000 7f502a7fc640 1 -- 172.21.15.7:0/2293117716 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502c019070 con 0x7f5034105ad0 2024-09-19T08:43:44.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.242+0000 7f502a7fc640 1 -- 172.21.15.7:0/2293117716 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f502c014440 con 0x7f5034105ad0 2024-09-19T08:43:44.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.242+0000 7f503b4d6640 1 -- 172.21.15.7:0/2293117716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50341a6d20 con 0x7f5034105ad0 2024-09-19T08:43:44.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.242+0000 7f502a7fc640 1 -- 172.21.15.7:0/2293117716 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502c0125c0 con 0x7f5034105ad0 2024-09-19T08:43:44.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.242+0000 7f503b4d6640 1 -- 172.21.15.7:0/2293117716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50341a7200 con 0x7f5034105ad0 2024-09-19T08:43:44.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.243+0000 7f503b4d6640 1 -- 172.21.15.7:0/2293117716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50341016e0 con 0x7f5034105ad0 2024-09-19T08:43:44.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.244+0000 7f502a7fc640 1 -- 172.21.15.7:0/2293117716 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f502c01c070 con 0x7f5034105ad0 2024-09-19T08:43:44.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.245+0000 7f502a7fc640 1 --2- 172.21.15.7:0/2293117716 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f50200a32d0 0x7f50200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:44.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.245+0000 7f5039272640 1 --2- 172.21.15.7:0/2293117716 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f50200a32d0 0x7f50200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:44.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.245+0000 7f502a7fc640 1 -- 172.21.15.7:0/2293117716 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f502c0cf510 con 0x7f5034105ad0 2024-09-19T08:43:44.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.245+0000 7f5039272640 1 --2- 172.21.15.7:0/2293117716 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f50200a32d0 0x7f50200a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f50300096b0 tx=0x7f5030006c20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:44.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.248+0000 7f502a7fc640 1 -- 172.21.15.7:0/2293117716 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f502c09c1e0 con 0x7f5034105ad0 2024-09-19T08:43:44.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.427+0000 7f503b4d6640 1 -- 172.21.15.7:0/2293117716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f50340fdbc0 con 0x7f5034105ad0 2024-09-19T08:43:44.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.427+0000 7f502a7fc640 1 -- 172.21.15.7:0/2293117716 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f50340fdbc0 con 0x7f5034105ad0 2024-09-19T08:43:44.427 INFO:teuthology.orchestra.run.smithi007.stdout:240518168615 2024-09-19T08:43:44.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.429+0000 7f503b4d6640 1 -- 172.21.15.7:0/2293117716 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f50200a32d0 msgr2=0x7f50200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:44.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.429+0000 7f503b4d6640 1 --2- 172.21.15.7:0/2293117716 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f50200a32d0 0x7f50200a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f50300096b0 tx=0x7f5030006c20 comp rx=0 tx=0).stop 2024-09-19T08:43:44.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.429+0000 7f503b4d6640 1 -- 172.21.15.7:0/2293117716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5034105ad0 msgr2=0x7f50340fd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:44.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.429+0000 7f503b4d6640 1 --2- 172.21.15.7:0/2293117716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5034105ad0 0x7f50340fd110 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f502c00b9e0 tx=0x7f502c00bea0 comp rx=0 tx=0).stop 2024-09-19T08:43:44.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.429+0000 7f503b4d6640 1 -- 172.21.15.7:0/2293117716 shutdown_connections 2024-09-19T08:43:44.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.429+0000 7f503b4d6640 1 --2- 172.21.15.7:0/2293117716 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f50200a32d0 0x7f50200a5790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:44.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.429+0000 7f503b4d6640 1 --2- 172.21.15.7:0/2293117716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5034105ad0 0x7f50340fd110 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:44.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.429+0000 7f503b4d6640 1 --2- 172.21.15.7:0/2293117716 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5034101ba0 0x7f50340fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:44.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.429+0000 7f503b4d6640 1 --2- 172.21.15.7:0/2293117716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5034101200 0x7f50340fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:44.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.429+0000 7f503b4d6640 1 -- 172.21.15.7:0/2293117716 >> 172.21.15.7:0/2293117716 conn(0x7f5034077210 msgr2=0x7f50341006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:44.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.429+0000 7f503b4d6640 1 -- 172.21.15.7:0/2293117716 shutdown_connections 2024-09-19T08:43:44.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:44.430+0000 7f503b4d6640 1 -- 172.21.15.7:0/2293117716 wait complete. 2024-09-19T08:43:44.798 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561070 got 188978561074 for osd.6 2024-09-19T08:43:44.798 DEBUG:teuthology.parallel:result is None 2024-09-19T08:43:44.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:44 smithi175 ceph-mon[35688]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:43:44.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:44 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1671641980' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T08:43:44.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:44 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/2902177361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T08:43:44.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:44 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/2293117716' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T08:43:45.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:44 smithi007 ceph-mon[31221]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:43:45.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:44 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1671641980' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T08:43:45.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:44 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2902177361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T08:43:45.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:44 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2293117716' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T08:43:45.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:44 smithi044 ceph-mon[35072]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:43:45.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:44 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1671641980' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T08:43:45.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:44 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/2902177361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T08:43:45.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:44 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/2293117716' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T08:43:45.540 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444096 got 73014444101 for osd.2 2024-09-19T08:43:45.540 DEBUG:teuthology.parallel:result is None 2024-09-19T08:43:45.771 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:46.190 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168613 got 240518168615 for osd.8 2024-09-19T08:43:46.191 DEBUG:teuthology.parallel:result is None 2024-09-19T08:43:46.633 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939680 got 270582939682 for osd.9 2024-09-19T08:43:46.633 DEBUG:teuthology.parallel:result is None 2024-09-19T08:43:46.871 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:46 smithi007 ceph-mon[31221]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T08:43:46.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:46 smithi175 ceph-mon[35688]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T08:43:47.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:46 smithi044 ceph-mon[35072]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T08:43:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.119+0000 7ff568858640 1 -- 172.21.15.7:0/2043870706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff564106f10 msgr2=0x7ff56410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.119+0000 7ff568858640 1 --2- 172.21.15.7:0/2043870706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff564106f10 0x7ff56410ea90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009900 tx=0x7ff55c02a410 comp rx=0 tx=0).stop 2024-09-19T08:43:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.119+0000 7ff568858640 1 -- 172.21.15.7:0/2043870706 shutdown_connections 2024-09-19T08:43:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.119+0000 7ff568858640 1 --2- 172.21.15.7:0/2043870706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff564106f10 0x7ff56410ea90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.119+0000 7ff568858640 1 --2- 172.21.15.7:0/2043870706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff564102790 0x7ff5641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.119+0000 7ff568858640 1 --2- 172.21.15.7:0/2043870706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff564101de0 0x7ff5641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.119+0000 7ff568858640 1 -- 172.21.15.7:0/2043870706 >> 172.21.15.7:0/2043870706 conn(0x7ff5640fd8c0 msgr2=0x7ff5640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.119+0000 7ff568858640 1 -- 172.21.15.7:0/2043870706 shutdown_connections 2024-09-19T08:43:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.119+0000 7ff568858640 1 -- 172.21.15.7:0/2043870706 wait complete. 2024-09-19T08:43:47.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.120+0000 7ff568858640 1 Processor -- start 2024-09-19T08:43:47.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.120+0000 7ff568858640 1 -- start start 2024-09-19T08:43:47.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.120+0000 7ff568858640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff564101de0 0x7ff56419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:47.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.120+0000 7ff568858640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff564102790 0x7ff56419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:47.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.120+0000 7ff568858640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff564106f10 0x7ff56419eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:47.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.120+0000 7ff568858640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff564111f70 con 0x7ff564106f10 2024-09-19T08:43:47.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.120+0000 7ff568858640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff564111df0 con 0x7ff564101de0 2024-09-19T08:43:47.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.120+0000 7ff568858640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5641120f0 con 0x7ff564102790 2024-09-19T08:43:47.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.120+0000 7ff562d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff564106f10 0x7ff56419eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:47.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.120+0000 7ff56259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff564101de0 0x7ff56419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:47.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.120+0000 7ff562d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff564106f10 0x7ff56419eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55018/0 (socket says 172.21.15.7:55018) 2024-09-19T08:43:47.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.120+0000 7ff562d9d640 1 -- 172.21.15.7:0/2143275017 learned_addr learned my addr 172.21.15.7:0/2143275017 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:47.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.120+0000 7ff561d9b640 1 --2- 172.21.15.7:0/2143275017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff564102790 0x7ff56419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:47.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.120+0000 7ff562d9d640 1 -- 172.21.15.7:0/2143275017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff564102790 msgr2=0x7ff56419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:47.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.120+0000 7ff562d9d640 1 --2- 172.21.15.7:0/2143275017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff564102790 0x7ff56419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:47.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.120+0000 7ff562d9d640 1 -- 172.21.15.7:0/2143275017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff564101de0 msgr2=0x7ff56419a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:47.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.120+0000 7ff562d9d640 1 --2- 172.21.15.7:0/2143275017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff564101de0 0x7ff56419a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:47.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.120+0000 7ff562d9d640 1 -- 172.21.15.7:0/2143275017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff56419f580 con 0x7ff564106f10 2024-09-19T08:43:47.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.120+0000 7ff56259c640 1 --2- 172.21.15.7:0/2143275017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff564101de0 0x7ff56419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:43:47.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.121+0000 7ff562d9d640 1 --2- 172.21.15.7:0/2143275017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff564106f10 0x7ff56419eea0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff55c005ab0 tx=0x7ff55c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:47.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.121+0000 7ff5537fe640 1 -- 172.21.15.7:0/2143275017 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c03f030 con 0x7ff564106f10 2024-09-19T08:43:47.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.121+0000 7ff5537fe640 1 -- 172.21.15.7:0/2143275017 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff55c003ce0 con 0x7ff564106f10 2024-09-19T08:43:47.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.121+0000 7ff568858640 1 -- 172.21.15.7:0/2143275017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff56419f810 con 0x7ff564106f10 2024-09-19T08:43:47.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.121+0000 7ff5537fe640 1 -- 172.21.15.7:0/2143275017 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c035070 con 0x7ff564106f10 2024-09-19T08:43:47.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.121+0000 7ff568858640 1 -- 172.21.15.7:0/2143275017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5641a7150 con 0x7ff564106f10 2024-09-19T08:43:47.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.122+0000 7ff568858640 1 -- 172.21.15.7:0/2143275017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5641021c0 con 0x7ff564106f10 2024-09-19T08:43:47.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.124+0000 7ff5537fe640 1 -- 172.21.15.7:0/2143275017 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ff55c042030 con 0x7ff564106f10 2024-09-19T08:43:47.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.125+0000 7ff5537fe640 1 --2- 172.21.15.7:0/2143275017 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff54c0a3350 0x7ff54c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:47.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.125+0000 7ff56259c640 1 --2- 172.21.15.7:0/2143275017 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff54c0a3350 0x7ff54c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:47.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.125+0000 7ff5537fe640 1 -- 172.21.15.7:0/2143275017 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff55c0f0490 con 0x7ff564106f10 2024-09-19T08:43:47.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.125+0000 7ff56259c640 1 --2- 172.21.15.7:0/2143275017 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff54c0a3350 0x7ff54c0a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff554009fd0 tx=0x7ff554009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:47.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.128+0000 7ff5537fe640 1 -- 172.21.15.7:0/2143275017 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff55c0bca00 con 0x7ff564106f10 2024-09-19T08:43:47.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.306+0000 7ff568858640 1 -- 172.21.15.7:0/2143275017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff5641a7380 con 0x7ff564106f10 2024-09-19T08:43:47.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.306+0000 7ff5537fe640 1 -- 172.21.15.7:0/2143275017 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff55c0c0d00 con 0x7ff564106f10 2024-09-19T08:43:47.306 INFO:teuthology.orchestra.run.smithi007.stdout:103079215169 2024-09-19T08:43:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.309+0000 7ff568858640 1 -- 172.21.15.7:0/2143275017 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff54c0a3350 msgr2=0x7ff54c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.309+0000 7ff568858640 1 --2- 172.21.15.7:0/2143275017 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff54c0a3350 0x7ff54c0a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff554009fd0 tx=0x7ff554009760 comp rx=0 tx=0).stop 2024-09-19T08:43:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.309+0000 7ff568858640 1 -- 172.21.15.7:0/2143275017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff564106f10 msgr2=0x7ff56419eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.309+0000 7ff568858640 1 --2- 172.21.15.7:0/2143275017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff564106f10 0x7ff56419eea0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff55c005ab0 tx=0x7ff55c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:43:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.309+0000 7ff568858640 1 -- 172.21.15.7:0/2143275017 shutdown_connections 2024-09-19T08:43:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.309+0000 7ff568858640 1 --2- 172.21.15.7:0/2143275017 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff54c0a3350 0x7ff54c0a5810 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.309+0000 7ff568858640 1 --2- 172.21.15.7:0/2143275017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff564106f10 0x7ff56419eea0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.309+0000 7ff568858640 1 --2- 172.21.15.7:0/2143275017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff564102790 0x7ff56419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.309+0000 7ff568858640 1 --2- 172.21.15.7:0/2143275017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff564101de0 0x7ff56419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.309+0000 7ff568858640 1 -- 172.21.15.7:0/2143275017 >> 172.21.15.7:0/2143275017 conn(0x7ff5640fd8c0 msgr2=0x7ff5640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:47.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.309+0000 7ff568858640 1 -- 172.21.15.7:0/2143275017 shutdown_connections 2024-09-19T08:43:47.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:47.309+0000 7ff568858640 1 -- 172.21.15.7:0/2143275017 wait complete. 2024-09-19T08:43:47.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:47 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2143275017' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T08:43:47.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:47 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/2143275017' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T08:43:48.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:47 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/2143275017' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T08:43:48.533 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215165 got 103079215169 for osd.3 2024-09-19T08:43:48.533 DEBUG:teuthology.parallel:result is None 2024-09-19T08:43:48.534 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T08:43:48.534 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:43:48.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:48 smithi007 ceph-mon[31221]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:43:48.826 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:48.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:48 smithi175 ceph-mon[35688]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:43:49.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:48 smithi044 ceph-mon[35072]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:43:49.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.378+0000 7f6d7607f640 1 -- 172.21.15.7:0/1239106315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d701036e0 msgr2=0x7f6d7010bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:49.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.378+0000 7f6d7607f640 1 --2- 172.21.15.7:0/1239106315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d701036e0 0x7f6d7010bbd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009900 tx=0x7f6d5802a480 comp rx=0 tx=0).stop 2024-09-19T08:43:49.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.378+0000 7f6d7607f640 1 -- 172.21.15.7:0/1239106315 shutdown_connections 2024-09-19T08:43:49.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.378+0000 7f6d7607f640 1 --2- 172.21.15.7:0/1239106315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d7010c160 0x7f6d7010e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:49.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.378+0000 7f6d7607f640 1 --2- 172.21.15.7:0/1239106315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d701036e0 0x7f6d7010bbd0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:49.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.378+0000 7f6d7607f640 1 --2- 172.21.15.7:0/1239106315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d70102dc0 0x7f6d701031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:49.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.378+0000 7f6d7607f640 1 -- 172.21.15.7:0/1239106315 >> 172.21.15.7:0/1239106315 conn(0x7f6d700fc780 msgr2=0x7f6d700feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:49.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.378+0000 7f6d7607f640 1 -- 172.21.15.7:0/1239106315 shutdown_connections 2024-09-19T08:43:49.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.378+0000 7f6d7607f640 1 -- 172.21.15.7:0/1239106315 wait complete. 2024-09-19T08:43:49.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.379+0000 7f6d7607f640 1 Processor -- start 2024-09-19T08:43:49.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.379+0000 7f6d7607f640 1 -- start start 2024-09-19T08:43:49.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.379+0000 7f6d7607f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d70102dc0 0x7f6d70198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.379+0000 7f6d7607f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d701036e0 0x7f6d70198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.379+0000 7f6d7607f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d7010c160 0x7f6d7019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.379+0000 7f6d7607f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6d70111f10 con 0x7f6d7010c160 2024-09-19T08:43:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.379+0000 7f6d7607f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6d70111d90 con 0x7f6d70102dc0 2024-09-19T08:43:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.379+0000 7f6d7607f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6d70112090 con 0x7f6d701036e0 2024-09-19T08:43:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.379+0000 7f6d6ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d7010c160 0x7f6d7019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.379+0000 7f6d6f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d70102dc0 0x7f6d70198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.379+0000 7f6d6ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d7010c160 0x7f6d7019cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55042/0 (socket says 172.21.15.7:55042) 2024-09-19T08:43:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.379+0000 7f6d6ffff640 1 -- 172.21.15.7:0/241934161 learned_addr learned my addr 172.21.15.7:0/241934161 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.379+0000 7f6d66ffd640 1 --2- 172.21.15.7:0/241934161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d701036e0 0x7f6d70198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:49.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.380+0000 7f6d6ffff640 1 -- 172.21.15.7:0/241934161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d701036e0 msgr2=0x7f6d70198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:49.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.380+0000 7f6d6ffff640 1 --2- 172.21.15.7:0/241934161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d701036e0 0x7f6d70198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:49.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.380+0000 7f6d6ffff640 1 -- 172.21.15.7:0/241934161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d70102dc0 msgr2=0x7f6d70198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:49.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.380+0000 7f6d6ffff640 1 --2- 172.21.15.7:0/241934161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d70102dc0 0x7f6d70198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:49.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.380+0000 7f6d6ffff640 1 -- 172.21.15.7:0/241934161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d7019d3c0 con 0x7f6d7010c160 2024-09-19T08:43:49.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.380+0000 7f6d66ffd640 1 --2- 172.21.15.7:0/241934161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d701036e0 0x7f6d70198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:43:49.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.380+0000 7f6d6ffff640 1 --2- 172.21.15.7:0/241934161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d7010c160 0x7f6d7019cce0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800eb10 tx=0x7f6d6800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:49.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.380+0000 7f6d6d7fa640 1 -- 172.21.15.7:0/241934161 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6800ce20 con 0x7f6d7010c160 2024-09-19T08:43:49.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.380+0000 7f6d7607f640 1 -- 172.21.15.7:0/241934161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d7019d6b0 con 0x7f6d7010c160 2024-09-19T08:43:49.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.380+0000 7f6d6d7fa640 1 -- 172.21.15.7:0/241934161 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d68005020 con 0x7f6d7010c160 2024-09-19T08:43:49.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.380+0000 7f6d6d7fa640 1 -- 172.21.15.7:0/241934161 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d68010690 con 0x7f6d7010c160 2024-09-19T08:43:49.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.380+0000 7f6d7607f640 1 -- 172.21.15.7:0/241934161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d701a4f90 con 0x7f6d7010c160 2024-09-19T08:43:49.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.381+0000 7f6d7607f640 1 -- 172.21.15.7:0/241934161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d701031a0 con 0x7f6d7010c160 2024-09-19T08:43:49.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.382+0000 7f6d6d7fa640 1 -- 172.21.15.7:0/241934161 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f6d68005540 con 0x7f6d7010c160 2024-09-19T08:43:49.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.383+0000 7f6d6d7fa640 1 --2- 172.21.15.7:0/241934161 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6d5c0a32d0 0x7f6d5c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:49.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.383+0000 7f6d6d7fa640 1 -- 172.21.15.7:0/241934161 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6d680d0070 con 0x7f6d7010c160 2024-09-19T08:43:49.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.383+0000 7f6d6f7fe640 1 --2- 172.21.15.7:0/241934161 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6d5c0a32d0 0x7f6d5c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:49.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.384+0000 7f6d6f7fe640 1 --2- 172.21.15.7:0/241934161 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6d5c0a32d0 0x7f6d5c0a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000abe0 tx=0x7f6d6000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:49.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.388+0000 7f6d6d7fa640 1 -- 172.21.15.7:0/241934161 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6d6809cc30 con 0x7f6d7010c160 2024-09-19T08:43:49.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.561+0000 7f6d7607f640 1 -- 172.21.15.7:0/241934161 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6d70062630 con 0x7f6d5c0a32d0 2024-09-19T08:43:49.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.567+0000 7f6d6d7fa640 1 -- 172.21.15.7:0/241934161 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258715 (secure 0 0 0) 0x7f6d70062630 con 0x7f6d5c0a32d0 2024-09-19T08:43:49.570 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:43:49.571 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-19T08:43:49.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.570+0000 7f6d7607f640 1 -- 172.21.15.7:0/241934161 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6d5c0a32d0 msgr2=0x7f6d5c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:49.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.570+0000 7f6d7607f640 1 --2- 172.21.15.7:0/241934161 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6d5c0a32d0 0x7f6d5c0a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000abe0 tx=0x7f6d6000a2d0 comp rx=0 tx=0).stop 2024-09-19T08:43:49.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.570+0000 7f6d7607f640 1 -- 172.21.15.7:0/241934161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d7010c160 msgr2=0x7f6d7019cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:49.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.570+0000 7f6d7607f640 1 --2- 172.21.15.7:0/241934161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d7010c160 0x7f6d7019cce0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800eb10 tx=0x7f6d6800ef10 comp rx=0 tx=0).stop 2024-09-19T08:43:49.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.571+0000 7f6d7607f640 1 -- 172.21.15.7:0/241934161 shutdown_connections 2024-09-19T08:43:49.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.571+0000 7f6d7607f640 1 --2- 172.21.15.7:0/241934161 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6d5c0a32d0 0x7f6d5c0a5790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:49.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.571+0000 7f6d7607f640 1 --2- 172.21.15.7:0/241934161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d7010c160 0x7f6d7019cce0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:49.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.571+0000 7f6d7607f640 1 --2- 172.21.15.7:0/241934161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d701036e0 0x7f6d70198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:49.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.571+0000 7f6d7607f640 1 --2- 172.21.15.7:0/241934161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d70102dc0 0x7f6d70198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:49.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.571+0000 7f6d7607f640 1 -- 172.21.15.7:0/241934161 >> 172.21.15.7:0/241934161 conn(0x7f6d700fc780 msgr2=0x7f6d700fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:49.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.571+0000 7f6d7607f640 1 -- 172.21.15.7:0/241934161 shutdown_connections 2024-09-19T08:43:49.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:49.571+0000 7f6d7607f640 1 -- 172.21.15.7:0/241934161 wait complete. 2024-09-19T08:43:50.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:49 smithi175 ceph-mon[35688]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:43:50.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:49 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:43:50.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:49 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:43:50.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:49 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:43:50.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:49 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:43:50.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:49 smithi175 ceph-mon[35688]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:43:50.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:49 smithi175 ceph-mon[35688]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:43:50.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:49 smithi007 ceph-mon[31221]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:43:50.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:49 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:43:50.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:49 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:43:50.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:49 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:43:50.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:49 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:43:50.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:49 smithi007 ceph-mon[31221]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:43:50.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:49 smithi007 ceph-mon[31221]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:43:50.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:49 smithi044 ceph-mon[35072]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:43:50.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:49 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:43:50.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:49 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:43:50.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:49 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:43:50.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:49 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:43:50.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:49 smithi044 ceph-mon[35072]: from='mgr.14150 172.21.15.7:0/2711822051' entity='mgr.x' 2024-09-19T08:43:50.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:49 smithi044 ceph-mon[35072]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:43:50.338 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2024-09-19T08:43:48.880156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654762,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":479,"num_read_kb":356,"num_write":346,"num_write_kb":3050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1181934,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366012,"kb_used_data":12588,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575812,"statfs":{"total":1151940427776,"available":1151565631488,"internally_reserved":0,"allocated":12890112,"data_stored":7149090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002970"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101626+0000","last_change":"2024-09-19T08:42:44.035697+0000","last_active":"2024-09-19T08:42:58.101626+0000","last_peered":"2024-09-19T08:42:58.101626+0000","last_clean":"2024-09-19T08:42:58.101626+0000","last_became_active":"2024-09-19T08:42:44.035400+0000","last_became_peered":"2024-09-19T08:42:44.035400+0000","last_unstale":"2024-09-19T08:42:58.101626+0000","last_undegraded":"2024-09-19T08:42:58.101626+0000","last_fullsized":"2024-09-19T08:42:58.101626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:56.202947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102854+0000","last_change":"2024-09-19T08:42:44.031393+0000","last_active":"2024-09-19T08:42:58.102854+0000","last_peered":"2024-09-19T08:42:58.102854+0000","last_clean":"2024-09-19T08:42:58.102854+0000","last_became_active":"2024-09-19T08:42:44.031056+0000","last_became_peered":"2024-09-19T08:42:44.031056+0000","last_unstale":"2024-09-19T08:42:58.102854+0000","last_undegraded":"2024-09-19T08:42:58.102854+0000","last_fullsized":"2024-09-19T08:42:58.102854+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:44.694913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102589+0000","last_change":"2024-09-19T08:42:44.029586+0000","last_active":"2024-09-19T08:42:58.102589+0000","last_peered":"2024-09-19T08:42:58.102589+0000","last_clean":"2024-09-19T08:42:58.102589+0000","last_became_active":"2024-09-19T08:42:44.029279+0000","last_became_peered":"2024-09-19T08:42:44.029279+0000","last_unstale":"2024-09-19T08:42:58.102589+0000","last_undegraded":"2024-09-19T08:42:58.102589+0000","last_fullsized":"2024-09-19T08:42:58.102589+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:12.036113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102656+0000","last_change":"2024-09-19T08:42:44.043192+0000","last_active":"2024-09-19T08:42:58.102656+0000","last_peered":"2024-09-19T08:42:58.102656+0000","last_clean":"2024-09-19T08:42:58.102656+0000","last_became_active":"2024-09-19T08:42:44.042838+0000","last_became_peered":"2024-09-19T08:42:44.042838+0000","last_unstale":"2024-09-19T08:42:58.102656+0000","last_undegraded":"2024-09-19T08:42:58.102656+0000","last_fullsized":"2024-09-19T08:42:58.102656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:20.549232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.107892+0000","last_change":"2024-09-19T08:42:44.032231+0000","last_active":"2024-09-19T08:42:58.107892+0000","last_peered":"2024-09-19T08:42:58.107892+0000","last_clean":"2024-09-19T08:42:58.107892+0000","last_became_active":"2024-09-19T08:42:44.031835+0000","last_became_peered":"2024-09-19T08:42:44.031835+0000","last_unstale":"2024-09-19T08:42:58.107892+0000","last_undegraded":"2024-09-19T08:42:58.107892+0000","last_fullsized":"2024-09-19T08:42:58.107892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:49.084085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103663+0000","last_change":"2024-09-19T08:42:44.035487+0000","last_active":"2024-09-19T08:42:58.103663+0000","last_peered":"2024-09-19T08:42:58.103663+0000","last_clean":"2024-09-19T08:42:58.103663+0000","last_became_active":"2024-09-19T08:42:44.035138+0000","last_became_peered":"2024-09-19T08:42:44.035138+0000","last_unstale":"2024-09-19T08:42:58.103663+0000","last_undegraded":"2024-09-19T08:42:58.103663+0000","last_fullsized":"2024-09-19T08:42:58.103663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:43.483397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108910+0000","last_change":"2024-09-19T08:42:44.029052+0000","last_active":"2024-09-19T08:42:58.108910+0000","last_peered":"2024-09-19T08:42:58.108910+0000","last_clean":"2024-09-19T08:42:58.108910+0000","last_became_active":"2024-09-19T08:42:44.028722+0000","last_became_peered":"2024-09-19T08:42:44.028722+0000","last_unstale":"2024-09-19T08:42:58.108910+0000","last_undegraded":"2024-09-19T08:42:58.108910+0000","last_fullsized":"2024-09-19T08:42:58.108910+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:49.226044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104266+0000","last_change":"2024-09-19T08:42:44.031401+0000","last_active":"2024-09-19T08:42:58.104266+0000","last_peered":"2024-09-19T08:42:58.104266+0000","last_clean":"2024-09-19T08:42:58.104266+0000","last_became_active":"2024-09-19T08:42:44.031103+0000","last_became_peered":"2024-09-19T08:42:44.031103+0000","last_unstale":"2024-09-19T08:42:58.104266+0000","last_undegraded":"2024-09-19T08:42:58.104266+0000","last_fullsized":"2024-09-19T08:42:58.104266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:57.406765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110149+0000","last_change":"2024-09-19T08:42:44.033011+0000","last_active":"2024-09-19T08:42:58.110149+0000","last_peered":"2024-09-19T08:42:58.110149+0000","last_clean":"2024-09-19T08:42:58.110149+0000","last_became_active":"2024-09-19T08:42:44.032075+0000","last_became_peered":"2024-09-19T08:42:44.032075+0000","last_unstale":"2024-09-19T08:42:58.110149+0000","last_undegraded":"2024-09-19T08:42:58.110149+0000","last_fullsized":"2024-09-19T08:42:58.110149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:43.701684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103460+0000","last_change":"2024-09-19T08:42:44.037417+0000","last_active":"2024-09-19T08:42:58.103460+0000","last_peered":"2024-09-19T08:42:58.103460+0000","last_clean":"2024-09-19T08:42:58.103460+0000","last_became_active":"2024-09-19T08:42:44.037006+0000","last_became_peered":"2024-09-19T08:42:44.037006+0000","last_unstale":"2024-09-19T08:42:58.103460+0000","last_undegraded":"2024-09-19T08:42:58.103460+0000","last_fullsized":"2024-09-19T08:42:58.103460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:10.952939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110570+0000","last_change":"2024-09-19T08:42:44.034125+0000","last_active":"2024-09-19T08:42:58.110570+0000","last_peered":"2024-09-19T08:42:58.110570+0000","last_clean":"2024-09-19T08:42:58.110570+0000","last_became_active":"2024-09-19T08:42:44.033772+0000","last_became_peered":"2024-09-19T08:42:44.033772+0000","last_unstale":"2024-09-19T08:42:58.110570+0000","last_undegraded":"2024-09-19T08:42:58.110570+0000","last_fullsized":"2024-09-19T08:42:58.110570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:42.854137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102712+0000","last_change":"2024-09-19T08:42:44.043047+0000","last_active":"2024-09-19T08:42:58.102712+0000","last_peered":"2024-09-19T08:42:58.102712+0000","last_clean":"2024-09-19T08:42:58.102712+0000","last_became_active":"2024-09-19T08:42:44.042666+0000","last_became_peered":"2024-09-19T08:42:44.042666+0000","last_unstale":"2024-09-19T08:42:58.102712+0000","last_undegraded":"2024-09-19T08:42:58.102712+0000","last_fullsized":"2024-09-19T08:42:58.102712+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:16.504824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100549+0000","last_change":"2024-09-19T08:42:44.026475+0000","last_active":"2024-09-19T08:42:58.100549+0000","last_peered":"2024-09-19T08:42:58.100549+0000","last_clean":"2024-09-19T08:42:58.100549+0000","last_became_active":"2024-09-19T08:42:44.026169+0000","last_became_peered":"2024-09-19T08:42:44.026169+0000","last_unstale":"2024-09-19T08:42:58.100549+0000","last_undegraded":"2024-09-19T08:42:58.100549+0000","last_fullsized":"2024-09-19T08:42:58.100549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:17.130267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102287+0000","last_change":"2024-09-19T08:42:44.033725+0000","last_active":"2024-09-19T08:42:58.102287+0000","last_peered":"2024-09-19T08:42:58.102287+0000","last_clean":"2024-09-19T08:42:58.102287+0000","last_became_active":"2024-09-19T08:42:44.033304+0000","last_became_peered":"2024-09-19T08:42:44.033304+0000","last_unstale":"2024-09-19T08:42:58.102287+0000","last_undegraded":"2024-09-19T08:42:58.102287+0000","last_fullsized":"2024-09-19T08:42:58.102287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:47.520808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102018+0000","last_change":"2024-09-19T08:42:44.041762+0000","last_active":"2024-09-19T08:42:58.102018+0000","last_peered":"2024-09-19T08:42:58.102018+0000","last_clean":"2024-09-19T08:42:58.102018+0000","last_became_active":"2024-09-19T08:42:44.041433+0000","last_became_peered":"2024-09-19T08:42:44.041433+0000","last_unstale":"2024-09-19T08:42:58.102018+0000","last_undegraded":"2024-09-19T08:42:58.102018+0000","last_fullsized":"2024-09-19T08:42:58.102018+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:05.504873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108993+0000","last_change":"2024-09-19T08:42:44.030316+0000","last_active":"2024-09-19T08:42:58.108993+0000","last_peered":"2024-09-19T08:42:58.108993+0000","last_clean":"2024-09-19T08:42:58.108993+0000","last_became_active":"2024-09-19T08:42:44.029872+0000","last_became_peered":"2024-09-19T08:42:44.029872+0000","last_unstale":"2024-09-19T08:42:58.108993+0000","last_undegraded":"2024-09-19T08:42:58.108993+0000","last_fullsized":"2024-09-19T08:42:58.108993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:18.011019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101626+0000","last_change":"2024-09-19T08:42:44.035523+0000","last_active":"2024-09-19T08:42:58.101626+0000","last_peered":"2024-09-19T08:42:58.101626+0000","last_clean":"2024-09-19T08:42:58.101626+0000","last_became_active":"2024-09-19T08:42:44.035185+0000","last_became_peered":"2024-09-19T08:42:44.035185+0000","last_unstale":"2024-09-19T08:42:58.101626+0000","last_undegraded":"2024-09-19T08:42:58.101626+0000","last_fullsized":"2024-09-19T08:42:58.101626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:03.475458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105867+0000","last_change":"2024-09-19T08:42:44.031803+0000","last_active":"2024-09-19T08:42:58.105867+0000","last_peered":"2024-09-19T08:42:58.105867+0000","last_clean":"2024-09-19T08:42:58.105867+0000","last_became_active":"2024-09-19T08:42:44.031501+0000","last_became_peered":"2024-09-19T08:42:44.031501+0000","last_unstale":"2024-09-19T08:42:58.105867+0000","last_undegraded":"2024-09-19T08:42:58.105867+0000","last_fullsized":"2024-09-19T08:42:58.105867+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:31.780744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104128+0000","last_change":"2024-09-19T08:42:44.036168+0000","last_active":"2024-09-19T08:42:58.104128+0000","last_peered":"2024-09-19T08:42:58.104128+0000","last_clean":"2024-09-19T08:42:58.104128+0000","last_became_active":"2024-09-19T08:42:44.035819+0000","last_became_peered":"2024-09-19T08:42:44.035819+0000","last_unstale":"2024-09-19T08:42:58.104128+0000","last_undegraded":"2024-09-19T08:42:58.104128+0000","last_fullsized":"2024-09-19T08:42:58.104128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:26.478389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101182+0000","last_change":"2024-09-19T08:42:44.037569+0000","last_active":"2024-09-19T08:42:58.101182+0000","last_peered":"2024-09-19T08:42:58.101182+0000","last_clean":"2024-09-19T08:42:58.101182+0000","last_became_active":"2024-09-19T08:42:44.037161+0000","last_became_peered":"2024-09-19T08:42:44.037161+0000","last_unstale":"2024-09-19T08:42:58.101182+0000","last_undegraded":"2024-09-19T08:42:58.101182+0000","last_fullsized":"2024-09-19T08:42:58.101182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:35.316314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100549+0000","last_change":"2024-09-19T08:42:44.023160+0000","last_active":"2024-09-19T08:42:58.100549+0000","last_peered":"2024-09-19T08:42:58.100549+0000","last_clean":"2024-09-19T08:42:58.100549+0000","last_became_active":"2024-09-19T08:42:44.022791+0000","last_became_peered":"2024-09-19T08:42:44.022791+0000","last_unstale":"2024-09-19T08:42:58.100549+0000","last_undegraded":"2024-09-19T08:42:58.100549+0000","last_fullsized":"2024-09-19T08:42:58.100549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:00.174583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109685+0000","last_change":"2024-09-19T08:42:44.035877+0000","last_active":"2024-09-19T08:42:58.109685+0000","last_peered":"2024-09-19T08:42:58.109685+0000","last_clean":"2024-09-19T08:42:58.109685+0000","last_became_active":"2024-09-19T08:42:44.035307+0000","last_became_peered":"2024-09-19T08:42:44.035307+0000","last_unstale":"2024-09-19T08:42:58.109685+0000","last_undegraded":"2024-09-19T08:42:58.109685+0000","last_fullsized":"2024-09-19T08:42:58.109685+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:54.717130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104090+0000","last_change":"2024-09-19T08:42:44.033536+0000","last_active":"2024-09-19T08:42:58.104090+0000","last_peered":"2024-09-19T08:42:58.104090+0000","last_clean":"2024-09-19T08:42:58.104090+0000","last_became_active":"2024-09-19T08:42:44.033179+0000","last_became_peered":"2024-09-19T08:42:44.033179+0000","last_unstale":"2024-09-19T08:42:58.104090+0000","last_undegraded":"2024-09-19T08:42:58.104090+0000","last_fullsized":"2024-09-19T08:42:58.104090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:11.161785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104608+0000","last_change":"2024-09-19T08:42:44.029674+0000","last_active":"2024-09-19T08:42:58.104608+0000","last_peered":"2024-09-19T08:42:58.104608+0000","last_clean":"2024-09-19T08:42:58.104608+0000","last_became_active":"2024-09-19T08:42:44.029368+0000","last_became_peered":"2024-09-19T08:42:44.029368+0000","last_unstale":"2024-09-19T08:42:58.104608+0000","last_undegraded":"2024-09-19T08:42:58.104608+0000","last_fullsized":"2024-09-19T08:42:58.104608+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:34.943363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105011+0000","last_change":"2024-09-19T08:42:44.039780+0000","last_active":"2024-09-19T08:42:58.105011+0000","last_peered":"2024-09-19T08:42:58.105011+0000","last_clean":"2024-09-19T08:42:58.105011+0000","last_became_active":"2024-09-19T08:42:44.039409+0000","last_became_peered":"2024-09-19T08:42:44.039409+0000","last_unstale":"2024-09-19T08:42:58.105011+0000","last_undegraded":"2024-09-19T08:42:58.105011+0000","last_fullsized":"2024-09-19T08:42:58.105011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:59.632132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103863+0000","last_change":"2024-09-19T08:42:44.030881+0000","last_active":"2024-09-19T08:42:58.103863+0000","last_peered":"2024-09-19T08:42:58.103863+0000","last_clean":"2024-09-19T08:42:58.103863+0000","last_became_active":"2024-09-19T08:42:44.030530+0000","last_became_peered":"2024-09-19T08:42:44.030530+0000","last_unstale":"2024-09-19T08:42:58.103863+0000","last_undegraded":"2024-09-19T08:42:58.103863+0000","last_fullsized":"2024-09-19T08:42:58.103863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:16.908450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101414+0000","last_change":"2024-09-19T08:42:44.033056+0000","last_active":"2024-09-19T08:42:58.101414+0000","last_peered":"2024-09-19T08:42:58.101414+0000","last_clean":"2024-09-19T08:42:58.101414+0000","last_became_active":"2024-09-19T08:42:44.032690+0000","last_became_peered":"2024-09-19T08:42:44.032690+0000","last_unstale":"2024-09-19T08:42:58.101414+0000","last_undegraded":"2024-09-19T08:42:58.101414+0000","last_fullsized":"2024-09-19T08:42:58.101414+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:36.497824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106551+0000","last_change":"2024-09-19T08:42:58.106551+0000","last_active":"2024-09-19T08:42:58.106551+0000","last_peered":"2024-09-19T08:42:58.106551+0000","last_clean":"2024-09-19T08:42:58.106551+0000","last_became_active":"2024-09-19T08:42:58.106119+0000","last_became_peered":"2024-09-19T08:42:58.106119+0000","last_unstale":"2024-09-19T08:42:58.106551+0000","last_undegraded":"2024-09-19T08:42:58.106551+0000","last_fullsized":"2024-09-19T08:42:58.106551+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:46.794260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108106+0000","last_change":"2024-09-19T08:42:58.108106+0000","last_active":"2024-09-19T08:42:58.108106+0000","last_peered":"2024-09-19T08:42:58.108106+0000","last_clean":"2024-09-19T08:42:58.108106+0000","last_became_active":"2024-09-19T08:42:58.107532+0000","last_became_peered":"2024-09-19T08:42:58.107532+0000","last_unstale":"2024-09-19T08:42:58.108106+0000","last_undegraded":"2024-09-19T08:42:58.108106+0000","last_fullsized":"2024-09-19T08:42:58.108106+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:29.164983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103606+0000","last_change":"2024-09-19T08:42:44.029822+0000","last_active":"2024-09-19T08:42:58.103606+0000","last_peered":"2024-09-19T08:42:58.103606+0000","last_clean":"2024-09-19T08:42:58.103606+0000","last_became_active":"2024-09-19T08:42:44.029450+0000","last_became_peered":"2024-09-19T08:42:44.029450+0000","last_unstale":"2024-09-19T08:42:58.103606+0000","last_undegraded":"2024-09-19T08:42:58.103606+0000","last_fullsized":"2024-09-19T08:42:58.103606+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:40.826261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105132+0000","last_change":"2024-09-19T08:42:44.041354+0000","last_active":"2024-09-19T08:42:58.105132+0000","last_peered":"2024-09-19T08:42:58.105132+0000","last_clean":"2024-09-19T08:42:58.105132+0000","last_became_active":"2024-09-19T08:42:44.040912+0000","last_became_peered":"2024-09-19T08:42:44.040912+0000","last_unstale":"2024-09-19T08:42:58.105132+0000","last_undegraded":"2024-09-19T08:42:58.105132+0000","last_fullsized":"2024-09-19T08:42:58.105132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:16.543950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101119+0000","last_change":"2024-09-19T08:42:44.027912+0000","last_active":"2024-09-19T08:42:58.101119+0000","last_peered":"2024-09-19T08:42:58.101119+0000","last_clean":"2024-09-19T08:42:58.101119+0000","last_became_active":"2024-09-19T08:42:44.027505+0000","last_became_peered":"2024-09-19T08:42:44.027505+0000","last_unstale":"2024-09-19T08:42:58.101119+0000","last_undegraded":"2024-09-19T08:42:58.101119+0000","last_fullsized":"2024-09-19T08:42:58.101119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:02.552756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.107911+0000","last_change":"2024-09-19T08:42:44.034472+0000","last_active":"2024-09-19T08:42:58.107911+0000","last_peered":"2024-09-19T08:42:58.107911+0000","last_clean":"2024-09-19T08:42:58.107911+0000","last_became_active":"2024-09-19T08:42:44.034026+0000","last_became_peered":"2024-09-19T08:42:44.034026+0000","last_unstale":"2024-09-19T08:42:58.107911+0000","last_undegraded":"2024-09-19T08:42:58.107911+0000","last_fullsized":"2024-09-19T08:42:58.107911+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:10.058882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'6","reported_seq":84,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:45.171906+0000","last_change":"2024-09-19T08:42:41.927174+0000","last_active":"2024-09-19T08:43:45.171906+0000","last_peered":"2024-09-19T08:43:45.171906+0000","last_clean":"2024-09-19T08:43:45.171906+0000","last_became_active":"2024-09-19T08:42:41.926826+0000","last_became_peered":"2024-09-19T08:42:41.926826+0000","last_unstale":"2024-09-19T08:43:45.171906+0000","last_undegraded":"2024-09-19T08:43:45.171906+0000","last_fullsized":"2024-09-19T08:43:45.171906+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:37.274891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110259+0000","last_change":"2024-09-19T08:42:58.110259+0000","last_active":"2024-09-19T08:42:58.110259+0000","last_peered":"2024-09-19T08:42:58.110259+0000","last_clean":"2024-09-19T08:42:58.110259+0000","last_became_active":"2024-09-19T08:42:58.109803+0000","last_became_peered":"2024-09-19T08:42:58.109803+0000","last_unstale":"2024-09-19T08:42:58.110259+0000","last_undegraded":"2024-09-19T08:42:58.110259+0000","last_fullsized":"2024-09-19T08:42:58.110259+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:31.853404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.114222+0000","last_change":"2024-09-19T08:42:58.114222+0000","last_active":"2024-09-19T08:42:58.114222+0000","last_peered":"2024-09-19T08:42:58.114222+0000","last_clean":"2024-09-19T08:42:58.114222+0000","last_became_active":"2024-09-19T08:42:58.110769+0000","last_became_peered":"2024-09-19T08:42:58.110769+0000","last_unstale":"2024-09-19T08:42:58.114222+0000","last_undegraded":"2024-09-19T08:42:58.114222+0000","last_fullsized":"2024-09-19T08:42:58.114222+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:17.952228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100222+0000","last_change":"2024-09-19T08:42:41.923903+0000","last_active":"2024-09-19T08:42:58.100222+0000","last_peered":"2024-09-19T08:42:58.100222+0000","last_clean":"2024-09-19T08:42:58.100222+0000","last_became_active":"2024-09-19T08:42:41.923583+0000","last_became_peered":"2024-09-19T08:42:41.923583+0000","last_unstale":"2024-09-19T08:42:58.100222+0000","last_undegraded":"2024-09-19T08:42:58.100222+0000","last_fullsized":"2024-09-19T08:42:58.100222+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:48.594343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104302+0000","last_change":"2024-09-19T08:42:44.028972+0000","last_active":"2024-09-19T08:42:58.104302+0000","last_peered":"2024-09-19T08:42:58.104302+0000","last_clean":"2024-09-19T08:42:58.104302+0000","last_became_active":"2024-09-19T08:42:44.028657+0000","last_became_peered":"2024-09-19T08:42:44.028657+0000","last_unstale":"2024-09-19T08:42:58.104302+0000","last_undegraded":"2024-09-19T08:42:58.104302+0000","last_fullsized":"2024-09-19T08:42:58.104302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:43.618010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106455+0000","last_change":"2024-09-19T08:42:41.926558+0000","last_active":"2024-09-19T08:42:58.106455+0000","last_peered":"2024-09-19T08:42:58.106455+0000","last_clean":"2024-09-19T08:42:58.106455+0000","last_became_active":"2024-09-19T08:42:41.926074+0000","last_became_peered":"2024-09-19T08:42:41.926074+0000","last_unstale":"2024-09-19T08:42:58.106455+0000","last_undegraded":"2024-09-19T08:42:58.106455+0000","last_fullsized":"2024-09-19T08:42:58.106455+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:47.563295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105300+0000","last_change":"2024-09-19T08:42:44.029191+0000","last_active":"2024-09-19T08:42:58.105300+0000","last_peered":"2024-09-19T08:42:58.105300+0000","last_clean":"2024-09-19T08:42:58.105300+0000","last_became_active":"2024-09-19T08:42:44.028871+0000","last_became_peered":"2024-09-19T08:42:44.028871+0000","last_unstale":"2024-09-19T08:42:58.105300+0000","last_undegraded":"2024-09-19T08:42:58.105300+0000","last_fullsized":"2024-09-19T08:42:58.105300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:41.262014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:44.169404+0000","last_change":"2024-09-19T08:42:41.930265+0000","last_active":"2024-09-19T08:43:44.169404+0000","last_peered":"2024-09-19T08:43:44.169404+0000","last_clean":"2024-09-19T08:43:44.169404+0000","last_became_active":"2024-09-19T08:42:41.929829+0000","last_became_peered":"2024-09-19T08:42:41.929829+0000","last_unstale":"2024-09-19T08:43:44.169404+0000","last_undegraded":"2024-09-19T08:43:44.169404+0000","last_fullsized":"2024-09-19T08:43:44.169404+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:59.181622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109302+0000","last_change":"2024-09-19T08:42:44.027382+0000","last_active":"2024-09-19T08:42:58.109302+0000","last_peered":"2024-09-19T08:42:58.109302+0000","last_clean":"2024-09-19T08:42:58.109302+0000","last_became_active":"2024-09-19T08:42:44.026824+0000","last_became_peered":"2024-09-19T08:42:44.026824+0000","last_unstale":"2024-09-19T08:42:58.109302+0000","last_undegraded":"2024-09-19T08:42:58.109302+0000","last_fullsized":"2024-09-19T08:42:58.109302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:58.520068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110495+0000","last_change":"2024-09-19T08:42:41.927914+0000","last_active":"2024-09-19T08:42:58.110495+0000","last_peered":"2024-09-19T08:42:58.110495+0000","last_clean":"2024-09-19T08:42:58.110495+0000","last_became_active":"2024-09-19T08:42:41.926566+0000","last_became_peered":"2024-09-19T08:42:41.926566+0000","last_unstale":"2024-09-19T08:42:58.110495+0000","last_undegraded":"2024-09-19T08:42:58.110495+0000","last_fullsized":"2024-09-19T08:42:58.110495+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:52.238352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103155+0000","last_change":"2024-09-19T08:42:44.039899+0000","last_active":"2024-09-19T08:42:58.103155+0000","last_peered":"2024-09-19T08:42:58.103155+0000","last_clean":"2024-09-19T08:42:58.103155+0000","last_became_active":"2024-09-19T08:42:44.039530+0000","last_became_peered":"2024-09-19T08:42:44.039530+0000","last_unstale":"2024-09-19T08:42:58.103155+0000","last_undegraded":"2024-09-19T08:42:58.103155+0000","last_fullsized":"2024-09-19T08:42:58.103155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:20.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105251+0000","last_change":"2024-09-19T08:42:42.410128+0000","last_active":"2024-09-19T08:42:58.105251+0000","last_peered":"2024-09-19T08:42:58.105251+0000","last_clean":"2024-09-19T08:42:58.105251+0000","last_became_active":"2024-09-19T08:42:42.409717+0000","last_became_peered":"2024-09-19T08:42:42.409717+0000","last_unstale":"2024-09-19T08:42:58.105251+0000","last_undegraded":"2024-09-19T08:42:58.105251+0000","last_fullsized":"2024-09-19T08:42:58.105251+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:41.682355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109529+0000","last_change":"2024-09-19T08:42:44.043248+0000","last_active":"2024-09-19T08:42:58.109529+0000","last_peered":"2024-09-19T08:42:58.109529+0000","last_clean":"2024-09-19T08:42:58.109529+0000","last_became_active":"2024-09-19T08:42:44.042849+0000","last_became_peered":"2024-09-19T08:42:44.042849+0000","last_unstale":"2024-09-19T08:42:58.109529+0000","last_undegraded":"2024-09-19T08:42:58.109529+0000","last_fullsized":"2024-09-19T08:42:58.109529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:00.413217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'28","reported_seq":163,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:45.171092+0000","last_change":"2024-09-19T08:42:41.926582+0000","last_active":"2024-09-19T08:43:45.171092+0000","last_peered":"2024-09-19T08:43:45.171092+0000","last_clean":"2024-09-19T08:43:45.171092+0000","last_became_active":"2024-09-19T08:42:41.926234+0000","last_became_peered":"2024-09-19T08:42:41.926234+0000","last_unstale":"2024-09-19T08:43:45.171092+0000","last_undegraded":"2024-09-19T08:43:45.171092+0000","last_fullsized":"2024-09-19T08:43:45.171092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:02.498976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":114,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108555+0000","last_change":"2024-09-19T08:42:44.034888+0000","last_active":"2024-09-19T08:42:58.108555+0000","last_peered":"2024-09-19T08:42:58.108555+0000","last_clean":"2024-09-19T08:42:58.108555+0000","last_became_active":"2024-09-19T08:42:44.034553+0000","last_became_peered":"2024-09-19T08:42:44.034553+0000","last_unstale":"2024-09-19T08:42:58.108555+0000","last_undegraded":"2024-09-19T08:42:58.108555+0000","last_fullsized":"2024-09-19T08:42:58.108555+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:06.416289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.118358+0000","last_change":"2024-09-19T08:42:58.117912+0000","last_active":"2024-09-19T08:42:58.118358+0000","last_peered":"2024-09-19T08:42:58.118358+0000","last_clean":"2024-09-19T08:42:58.118358+0000","last_became_active":"2024-09-19T08:42:58.105810+0000","last_became_peered":"2024-09-19T08:42:58.105810+0000","last_unstale":"2024-09-19T08:42:58.118358+0000","last_undegraded":"2024-09-19T08:42:58.118358+0000","last_fullsized":"2024-09-19T08:42:58.118358+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:44.258256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100246+0000","last_change":"2024-09-19T08:42:44.030519+0000","last_active":"2024-09-19T08:42:58.100246+0000","last_peered":"2024-09-19T08:42:58.100246+0000","last_clean":"2024-09-19T08:42:58.100246+0000","last_became_active":"2024-09-19T08:42:44.030190+0000","last_became_peered":"2024-09-19T08:42:44.030190+0000","last_unstale":"2024-09-19T08:42:58.100246+0000","last_undegraded":"2024-09-19T08:42:58.100246+0000","last_fullsized":"2024-09-19T08:42:58.100246+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:20.220642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106393+0000","last_change":"2024-09-19T08:42:41.928124+0000","last_active":"2024-09-19T08:42:58.106393+0000","last_peered":"2024-09-19T08:42:58.106393+0000","last_clean":"2024-09-19T08:42:58.106393+0000","last_became_active":"2024-09-19T08:42:41.927761+0000","last_became_peered":"2024-09-19T08:42:41.927761+0000","last_unstale":"2024-09-19T08:42:58.106393+0000","last_undegraded":"2024-09-19T08:42:58.106393+0000","last_fullsized":"2024-09-19T08:42:58.106393+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:08.591270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108569+0000","last_change":"2024-09-19T08:42:44.038234+0000","last_active":"2024-09-19T08:42:58.108569+0000","last_peered":"2024-09-19T08:42:58.108569+0000","last_clean":"2024-09-19T08:42:58.108569+0000","last_became_active":"2024-09-19T08:42:44.037726+0000","last_became_peered":"2024-09-19T08:42:44.037726+0000","last_unstale":"2024-09-19T08:42:58.108569+0000","last_undegraded":"2024-09-19T08:42:58.108569+0000","last_fullsized":"2024-09-19T08:42:58.108569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:08.865482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:46.175083+0000","last_change":"2024-09-19T08:42:41.926206+0000","last_active":"2024-09-19T08:43:46.175083+0000","last_peered":"2024-09-19T08:43:46.175083+0000","last_clean":"2024-09-19T08:43:46.175083+0000","last_became_active":"2024-09-19T08:42:41.925833+0000","last_became_peered":"2024-09-19T08:42:41.925833+0000","last_unstale":"2024-09-19T08:43:46.175083+0000","last_undegraded":"2024-09-19T08:43:46.175083+0000","last_fullsized":"2024-09-19T08:43:46.175083+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:27.944240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108472+0000","last_change":"2024-09-19T08:42:44.037181+0000","last_active":"2024-09-19T08:42:58.108472+0000","last_peered":"2024-09-19T08:42:58.108472+0000","last_clean":"2024-09-19T08:42:58.108472+0000","last_became_active":"2024-09-19T08:42:44.036865+0000","last_became_peered":"2024-09-19T08:42:44.036865+0000","last_unstale":"2024-09-19T08:42:58.108472+0000","last_undegraded":"2024-09-19T08:42:58.108472+0000","last_fullsized":"2024-09-19T08:42:58.108472+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:20.233309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.107685+0000","last_change":"2024-09-19T08:42:42.408446+0000","last_active":"2024-09-19T08:42:58.107685+0000","last_peered":"2024-09-19T08:42:58.107685+0000","last_clean":"2024-09-19T08:42:58.107685+0000","last_became_active":"2024-09-19T08:42:42.408098+0000","last_became_peered":"2024-09-19T08:42:42.408098+0000","last_unstale":"2024-09-19T08:42:58.107685+0000","last_undegraded":"2024-09-19T08:42:58.107685+0000","last_fullsized":"2024-09-19T08:42:58.107685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:22.603604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106374+0000","last_change":"2024-09-19T08:42:44.039954+0000","last_active":"2024-09-19T08:42:58.106374+0000","last_peered":"2024-09-19T08:42:58.106374+0000","last_clean":"2024-09-19T08:42:58.106374+0000","last_became_active":"2024-09-19T08:42:44.039601+0000","last_became_peered":"2024-09-19T08:42:44.039601+0000","last_unstale":"2024-09-19T08:42:58.106374+0000","last_undegraded":"2024-09-19T08:42:58.106374+0000","last_fullsized":"2024-09-19T08:42:58.106374+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:07.792167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108716+0000","last_change":"2024-09-19T08:42:41.929644+0000","last_active":"2024-09-19T08:42:58.108716+0000","last_peered":"2024-09-19T08:42:58.108716+0000","last_clean":"2024-09-19T08:42:58.108716+0000","last_became_active":"2024-09-19T08:42:41.929308+0000","last_became_peered":"2024-09-19T08:42:41.929308+0000","last_unstale":"2024-09-19T08:42:58.108716+0000","last_undegraded":"2024-09-19T08:42:58.108716+0000","last_fullsized":"2024-09-19T08:42:58.108716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:36.660470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.107555+0000","last_change":"2024-09-19T08:42:58.107555+0000","last_active":"2024-09-19T08:42:58.107555+0000","last_peered":"2024-09-19T08:42:58.107555+0000","last_clean":"2024-09-19T08:42:58.107555+0000","last_became_active":"2024-09-19T08:42:58.107137+0000","last_became_peered":"2024-09-19T08:42:58.107137+0000","last_unstale":"2024-09-19T08:42:58.107555+0000","last_undegraded":"2024-09-19T08:42:58.107555+0000","last_fullsized":"2024-09-19T08:42:58.107555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:13.198911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100493+0000","last_change":"2024-09-19T08:42:41.925195+0000","last_active":"2024-09-19T08:42:58.100493+0000","last_peered":"2024-09-19T08:42:58.100493+0000","last_clean":"2024-09-19T08:42:58.100493+0000","last_became_active":"2024-09-19T08:42:41.924880+0000","last_became_peered":"2024-09-19T08:42:41.924880+0000","last_unstale":"2024-09-19T08:42:58.100493+0000","last_undegraded":"2024-09-19T08:42:58.100493+0000","last_fullsized":"2024-09-19T08:42:58.100493+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:11.256881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110838+0000","last_change":"2024-09-19T08:42:44.036439+0000","last_active":"2024-09-19T08:42:58.110838+0000","last_peered":"2024-09-19T08:42:58.110838+0000","last_clean":"2024-09-19T08:42:58.110838+0000","last_became_active":"2024-09-19T08:42:44.036036+0000","last_became_peered":"2024-09-19T08:42:44.036036+0000","last_unstale":"2024-09-19T08:42:58.110838+0000","last_undegraded":"2024-09-19T08:42:58.110838+0000","last_fullsized":"2024-09-19T08:42:58.110838+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:37.410782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106933+0000","last_change":"2024-09-19T08:42:41.927490+0000","last_active":"2024-09-19T08:42:58.106933+0000","last_peered":"2024-09-19T08:42:58.106933+0000","last_clean":"2024-09-19T08:42:58.106933+0000","last_became_active":"2024-09-19T08:42:41.927163+0000","last_became_peered":"2024-09-19T08:42:41.927163+0000","last_unstale":"2024-09-19T08:42:58.106933+0000","last_undegraded":"2024-09-19T08:42:58.106933+0000","last_fullsized":"2024-09-19T08:42:58.106933+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:20.013661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110644+0000","last_change":"2024-09-19T08:42:44.036960+0000","last_active":"2024-09-19T08:42:58.110644+0000","last_peered":"2024-09-19T08:42:58.110644+0000","last_clean":"2024-09-19T08:42:58.110644+0000","last_became_active":"2024-09-19T08:42:44.036600+0000","last_became_peered":"2024-09-19T08:42:44.036600+0000","last_unstale":"2024-09-19T08:42:58.110644+0000","last_undegraded":"2024-09-19T08:42:58.110644+0000","last_fullsized":"2024-09-19T08:42:58.110644+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:15.621888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.114698+0000","last_change":"2024-09-19T08:42:58.114698+0000","last_active":"2024-09-19T08:42:58.114698+0000","last_peered":"2024-09-19T08:42:58.114698+0000","last_clean":"2024-09-19T08:42:58.114698+0000","last_became_active":"2024-09-19T08:42:58.105488+0000","last_became_peered":"2024-09-19T08:42:58.105488+0000","last_unstale":"2024-09-19T08:42:58.114698+0000","last_undegraded":"2024-09-19T08:42:58.114698+0000","last_fullsized":"2024-09-19T08:42:58.114698+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:12.642715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110688+0000","last_change":"2024-09-19T08:42:44.035569+0000","last_active":"2024-09-19T08:42:58.110688+0000","last_peered":"2024-09-19T08:42:58.110688+0000","last_clean":"2024-09-19T08:42:58.110688+0000","last_became_active":"2024-09-19T08:42:44.035277+0000","last_became_peered":"2024-09-19T08:42:44.035277+0000","last_unstale":"2024-09-19T08:42:58.110688+0000","last_undegraded":"2024-09-19T08:42:58.110688+0000","last_fullsized":"2024-09-19T08:42:58.110688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:57.472721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":345,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108782+0000","last_change":"2024-09-19T08:41:34.769047+0000","last_active":"2024-09-19T08:42:58.108782+0000","last_peered":"2024-09-19T08:42:58.108782+0000","last_clean":"2024-09-19T08:42:58.108782+0000","last_became_active":"2024-09-19T08:41:34.768619+0000","last_became_peered":"2024-09-19T08:41:34.768619+0000","last_unstale":"2024-09-19T08:42:58.108782+0000","last_undegraded":"2024-09-19T08:42:58.108782+0000","last_fullsized":"2024-09-19T08:42:58.108782+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:13.482855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:13.482855+0000","last_clean_scrub_stamp":"2024-09-19T08:38:13.482855+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.390775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102051+0000","last_change":"2024-09-19T08:42:41.925698+0000","last_active":"2024-09-19T08:42:58.102051+0000","last_peered":"2024-09-19T08:42:58.102051+0000","last_clean":"2024-09-19T08:42:58.102051+0000","last_became_active":"2024-09-19T08:42:41.924618+0000","last_became_peered":"2024-09-19T08:42:41.924618+0000","last_unstale":"2024-09-19T08:42:58.102051+0000","last_undegraded":"2024-09-19T08:42:58.102051+0000","last_fullsized":"2024-09-19T08:42:58.102051+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:53.717139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.111536+0000","last_change":"2024-09-19T08:42:58.111206+0000","last_active":"2024-09-19T08:42:58.111536+0000","last_peered":"2024-09-19T08:42:58.111536+0000","last_clean":"2024-09-19T08:42:58.111536+0000","last_became_active":"2024-09-19T08:42:58.110765+0000","last_became_peered":"2024-09-19T08:42:58.110765+0000","last_unstale":"2024-09-19T08:42:58.111536+0000","last_undegraded":"2024-09-19T08:42:58.111536+0000","last_fullsized":"2024-09-19T08:42:58.111536+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:44.783938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108663+0000","last_change":"2024-09-19T08:42:41.928414+0000","last_active":"2024-09-19T08:42:58.108663+0000","last_peered":"2024-09-19T08:42:58.108663+0000","last_clean":"2024-09-19T08:42:58.108663+0000","last_became_active":"2024-09-19T08:42:41.928055+0000","last_became_peered":"2024-09-19T08:42:41.928055+0000","last_unstale":"2024-09-19T08:42:58.108663+0000","last_undegraded":"2024-09-19T08:42:58.108663+0000","last_fullsized":"2024-09-19T08:42:58.108663+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:12.688379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100208+0000","last_change":"2024-09-19T08:42:44.035439+0000","last_active":"2024-09-19T08:42:58.100208+0000","last_peered":"2024-09-19T08:42:58.100208+0000","last_clean":"2024-09-19T08:42:58.100208+0000","last_became_active":"2024-09-19T08:42:44.035150+0000","last_became_peered":"2024-09-19T08:42:44.035150+0000","last_unstale":"2024-09-19T08:42:58.100208+0000","last_undegraded":"2024-09-19T08:42:58.100208+0000","last_fullsized":"2024-09-19T08:42:58.100208+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:15.230660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:46.174531+0000","last_change":"2024-09-19T08:42:42.407784+0000","last_active":"2024-09-19T08:43:46.174531+0000","last_peered":"2024-09-19T08:43:46.174531+0000","last_clean":"2024-09-19T08:43:46.174531+0000","last_became_active":"2024-09-19T08:42:42.407437+0000","last_became_peered":"2024-09-19T08:42:42.407437+0000","last_unstale":"2024-09-19T08:43:46.174531+0000","last_undegraded":"2024-09-19T08:43:46.174531+0000","last_fullsized":"2024-09-19T08:43:46.174531+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:44.829338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104733+0000","last_change":"2024-09-19T08:42:44.039780+0000","last_active":"2024-09-19T08:42:58.104733+0000","last_peered":"2024-09-19T08:42:58.104733+0000","last_clean":"2024-09-19T08:42:58.104733+0000","last_became_active":"2024-09-19T08:42:44.039441+0000","last_became_peered":"2024-09-19T08:42:44.039441+0000","last_unstale":"2024-09-19T08:42:58.104733+0000","last_undegraded":"2024-09-19T08:42:58.104733+0000","last_fullsized":"2024-09-19T08:42:58.104733+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:31.013663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109953+0000","last_change":"2024-09-19T08:42:41.926998+0000","last_active":"2024-09-19T08:42:58.109953+0000","last_peered":"2024-09-19T08:42:58.109953+0000","last_clean":"2024-09-19T08:42:58.109953+0000","last_became_active":"2024-09-19T08:42:41.926560+0000","last_became_peered":"2024-09-19T08:42:41.926560+0000","last_unstale":"2024-09-19T08:42:58.109953+0000","last_undegraded":"2024-09-19T08:42:58.109953+0000","last_fullsized":"2024-09-19T08:42:58.109953+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:35.338601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102887+0000","last_change":"2024-09-19T08:42:44.039948+0000","last_active":"2024-09-19T08:42:58.102887+0000","last_peered":"2024-09-19T08:42:58.102887+0000","last_clean":"2024-09-19T08:42:58.102887+0000","last_became_active":"2024-09-19T08:42:44.038797+0000","last_became_peered":"2024-09-19T08:42:44.038797+0000","last_unstale":"2024-09-19T08:42:58.102887+0000","last_undegraded":"2024-09-19T08:42:58.102887+0000","last_fullsized":"2024-09-19T08:42:58.102887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:19.273191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105603+0000","last_change":"2024-09-19T08:42:42.409954+0000","last_active":"2024-09-19T08:42:58.105603+0000","last_peered":"2024-09-19T08:42:58.105603+0000","last_clean":"2024-09-19T08:42:58.105603+0000","last_became_active":"2024-09-19T08:42:42.409388+0000","last_became_peered":"2024-09-19T08:42:42.409388+0000","last_unstale":"2024-09-19T08:42:58.105603+0000","last_undegraded":"2024-09-19T08:42:58.105603+0000","last_fullsized":"2024-09-19T08:42:58.105603+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:58.764877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103241+0000","last_change":"2024-09-19T08:42:44.024360+0000","last_active":"2024-09-19T08:42:58.103241+0000","last_peered":"2024-09-19T08:42:58.103241+0000","last_clean":"2024-09-19T08:42:58.103241+0000","last_became_active":"2024-09-19T08:42:44.023703+0000","last_became_peered":"2024-09-19T08:42:44.023703+0000","last_unstale":"2024-09-19T08:42:58.103241+0000","last_undegraded":"2024-09-19T08:42:58.103241+0000","last_fullsized":"2024-09-19T08:42:58.103241+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:10.852199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108774+0000","last_change":"2024-09-19T08:42:42.408101+0000","last_active":"2024-09-19T08:42:58.108774+0000","last_peered":"2024-09-19T08:42:58.108774+0000","last_clean":"2024-09-19T08:42:58.108774+0000","last_became_active":"2024-09-19T08:42:42.407692+0000","last_became_peered":"2024-09-19T08:42:42.407692+0000","last_unstale":"2024-09-19T08:42:58.108774+0000","last_undegraded":"2024-09-19T08:42:58.108774+0000","last_fullsized":"2024-09-19T08:42:58.108774+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:01.342213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100618+0000","last_change":"2024-09-19T08:42:44.026612+0000","last_active":"2024-09-19T08:42:58.100618+0000","last_peered":"2024-09-19T08:42:58.100618+0000","last_clean":"2024-09-19T08:42:58.100618+0000","last_became_active":"2024-09-19T08:42:44.025408+0000","last_became_peered":"2024-09-19T08:42:44.025408+0000","last_unstale":"2024-09-19T08:42:58.100618+0000","last_undegraded":"2024-09-19T08:42:58.100618+0000","last_fullsized":"2024-09-19T08:42:58.100618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:19.465342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:08.041763+0000","last_change":"2024-09-19T08:42:41.927561+0000","last_active":"2024-09-19T08:43:08.041763+0000","last_peered":"2024-09-19T08:43:08.041763+0000","last_clean":"2024-09-19T08:43:08.041763+0000","last_became_active":"2024-09-19T08:42:41.927159+0000","last_became_peered":"2024-09-19T08:42:41.927159+0000","last_unstale":"2024-09-19T08:43:08.041763+0000","last_undegraded":"2024-09-19T08:43:08.041763+0000","last_fullsized":"2024-09-19T08:43:08.041763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:13.352727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106277+0000","last_change":"2024-09-19T08:42:44.028129+0000","last_active":"2024-09-19T08:42:58.106277+0000","last_peered":"2024-09-19T08:42:58.106277+0000","last_clean":"2024-09-19T08:42:58.106277+0000","last_became_active":"2024-09-19T08:42:44.027826+0000","last_became_peered":"2024-09-19T08:42:44.027826+0000","last_unstale":"2024-09-19T08:42:58.106277+0000","last_undegraded":"2024-09-19T08:42:58.106277+0000","last_fullsized":"2024-09-19T08:42:58.106277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:03.129404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102523+0000","last_change":"2024-09-19T08:42:41.920264+0000","last_active":"2024-09-19T08:42:58.102523+0000","last_peered":"2024-09-19T08:42:58.102523+0000","last_clean":"2024-09-19T08:42:58.102523+0000","last_became_active":"2024-09-19T08:42:41.919655+0000","last_became_peered":"2024-09-19T08:42:41.919655+0000","last_unstale":"2024-09-19T08:42:58.102523+0000","last_undegraded":"2024-09-19T08:42:58.102523+0000","last_fullsized":"2024-09-19T08:42:58.102523+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:58.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103052+0000","last_change":"2024-09-19T08:42:44.039655+0000","last_active":"2024-09-19T08:42:58.103052+0000","last_peered":"2024-09-19T08:42:58.103052+0000","last_clean":"2024-09-19T08:42:58.103052+0000","last_became_active":"2024-09-19T08:42:44.039317+0000","last_became_peered":"2024-09-19T08:42:44.039317+0000","last_unstale":"2024-09-19T08:42:58.103052+0000","last_undegraded":"2024-09-19T08:42:58.103052+0000","last_fullsized":"2024-09-19T08:42:58.103052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:19.064194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109199+0000","last_change":"2024-09-19T08:42:42.408582+0000","last_active":"2024-09-19T08:42:58.109199+0000","last_peered":"2024-09-19T08:42:58.109199+0000","last_clean":"2024-09-19T08:42:58.109199+0000","last_became_active":"2024-09-19T08:42:42.408143+0000","last_became_peered":"2024-09-19T08:42:42.408143+0000","last_unstale":"2024-09-19T08:42:58.109199+0000","last_undegraded":"2024-09-19T08:42:58.109199+0000","last_fullsized":"2024-09-19T08:42:58.109199+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.526138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.107333+0000","last_change":"2024-09-19T08:42:44.034795+0000","last_active":"2024-09-19T08:42:58.107333+0000","last_peered":"2024-09-19T08:42:58.107333+0000","last_clean":"2024-09-19T08:42:58.107333+0000","last_became_active":"2024-09-19T08:42:44.034440+0000","last_became_peered":"2024-09-19T08:42:44.034440+0000","last_unstale":"2024-09-19T08:42:58.107333+0000","last_undegraded":"2024-09-19T08:42:58.107333+0000","last_fullsized":"2024-09-19T08:42:58.107333+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:50.470240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104200+0000","last_change":"2024-09-19T08:42:41.922621+0000","last_active":"2024-09-19T08:42:58.104200+0000","last_peered":"2024-09-19T08:42:58.104200+0000","last_clean":"2024-09-19T08:42:58.104200+0000","last_became_active":"2024-09-19T08:42:41.922303+0000","last_became_peered":"2024-09-19T08:42:41.922303+0000","last_unstale":"2024-09-19T08:42:58.104200+0000","last_undegraded":"2024-09-19T08:42:58.104200+0000","last_fullsized":"2024-09-19T08:42:58.104200+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:48.017892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101216+0000","last_change":"2024-09-19T08:42:44.028307+0000","last_active":"2024-09-19T08:42:58.101216+0000","last_peered":"2024-09-19T08:42:58.101216+0000","last_clean":"2024-09-19T08:42:58.101216+0000","last_became_active":"2024-09-19T08:42:44.026848+0000","last_became_peered":"2024-09-19T08:42:44.026848+0000","last_unstale":"2024-09-19T08:42:58.101216+0000","last_undegraded":"2024-09-19T08:42:58.101216+0000","last_fullsized":"2024-09-19T08:42:58.101216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:20.768075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103736+0000","last_change":"2024-09-19T08:42:41.929479+0000","last_active":"2024-09-19T08:42:58.103736+0000","last_peered":"2024-09-19T08:42:58.103736+0000","last_clean":"2024-09-19T08:42:58.103736+0000","last_became_active":"2024-09-19T08:42:41.928508+0000","last_became_peered":"2024-09-19T08:42:41.928508+0000","last_unstale":"2024-09-19T08:42:58.103736+0000","last_undegraded":"2024-09-19T08:42:58.103736+0000","last_fullsized":"2024-09-19T08:42:58.103736+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:46.108471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104229+0000","last_change":"2024-09-19T08:42:44.028694+0000","last_active":"2024-09-19T08:42:58.104229+0000","last_peered":"2024-09-19T08:42:58.104229+0000","last_clean":"2024-09-19T08:42:58.104229+0000","last_became_active":"2024-09-19T08:42:44.027382+0000","last_became_peered":"2024-09-19T08:42:44.027382+0000","last_unstale":"2024-09-19T08:42:58.104229+0000","last_undegraded":"2024-09-19T08:42:58.104229+0000","last_fullsized":"2024-09-19T08:42:58.104229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:40.877505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108022+0000","last_change":"2024-09-19T08:42:41.931016+0000","last_active":"2024-09-19T08:42:58.108022+0000","last_peered":"2024-09-19T08:42:58.108022+0000","last_clean":"2024-09-19T08:42:58.108022+0000","last_became_active":"2024-09-19T08:42:41.930648+0000","last_became_peered":"2024-09-19T08:42:41.930648+0000","last_unstale":"2024-09-19T08:42:58.108022+0000","last_undegraded":"2024-09-19T08:42:58.108022+0000","last_fullsized":"2024-09-19T08:42:58.108022+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:32.031025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109744+0000","last_change":"2024-09-19T08:42:44.035288+0000","last_active":"2024-09-19T08:42:58.109744+0000","last_peered":"2024-09-19T08:42:58.109744+0000","last_clean":"2024-09-19T08:42:58.109744+0000","last_became_active":"2024-09-19T08:42:44.034660+0000","last_became_peered":"2024-09-19T08:42:44.034660+0000","last_unstale":"2024-09-19T08:42:58.109744+0000","last_undegraded":"2024-09-19T08:42:58.109744+0000","last_fullsized":"2024-09-19T08:42:58.109744+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:48.703463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105135+0000","last_change":"2024-09-19T08:42:44.040123+0000","last_active":"2024-09-19T08:42:58.105135+0000","last_peered":"2024-09-19T08:42:58.105135+0000","last_clean":"2024-09-19T08:42:58.105135+0000","last_became_active":"2024-09-19T08:42:44.039488+0000","last_became_peered":"2024-09-19T08:42:44.039488+0000","last_unstale":"2024-09-19T08:42:58.105135+0000","last_undegraded":"2024-09-19T08:42:58.105135+0000","last_fullsized":"2024-09-19T08:42:58.105135+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:15.273044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108182+0000","last_change":"2024-09-19T08:42:41.932400+0000","last_active":"2024-09-19T08:42:58.108182+0000","last_peered":"2024-09-19T08:42:58.108182+0000","last_clean":"2024-09-19T08:42:58.108182+0000","last_became_active":"2024-09-19T08:42:41.932020+0000","last_became_peered":"2024-09-19T08:42:41.932020+0000","last_unstale":"2024-09-19T08:42:58.108182+0000","last_undegraded":"2024-09-19T08:42:58.108182+0000","last_fullsized":"2024-09-19T08:42:58.108182+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:08.583287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109186+0000","last_change":"2024-09-19T08:42:44.026173+0000","last_active":"2024-09-19T08:42:58.109186+0000","last_peered":"2024-09-19T08:42:58.109186+0000","last_clean":"2024-09-19T08:42:58.109186+0000","last_became_active":"2024-09-19T08:42:44.024614+0000","last_became_peered":"2024-09-19T08:42:44.024614+0000","last_unstale":"2024-09-19T08:42:58.109186+0000","last_undegraded":"2024-09-19T08:42:58.109186+0000","last_fullsized":"2024-09-19T08:42:58.109186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:42.695660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108660+0000","last_change":"2024-09-19T08:42:41.929576+0000","last_active":"2024-09-19T08:42:58.108660+0000","last_peered":"2024-09-19T08:42:58.108660+0000","last_clean":"2024-09-19T08:42:58.108660+0000","last_became_active":"2024-09-19T08:42:41.929231+0000","last_became_peered":"2024-09-19T08:42:41.929231+0000","last_unstale":"2024-09-19T08:42:58.108660+0000","last_undegraded":"2024-09-19T08:42:58.108660+0000","last_fullsized":"2024-09-19T08:42:58.108660+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:54.492198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103061+0000","last_change":"2024-09-19T08:42:44.028612+0000","last_active":"2024-09-19T08:42:58.103061+0000","last_peered":"2024-09-19T08:42:58.103061+0000","last_clean":"2024-09-19T08:42:58.103061+0000","last_became_active":"2024-09-19T08:42:44.028301+0000","last_became_peered":"2024-09-19T08:42:44.028301+0000","last_unstale":"2024-09-19T08:42:58.103061+0000","last_undegraded":"2024-09-19T08:42:58.103061+0000","last_fullsized":"2024-09-19T08:42:58.103061+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:03:09.539350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106004+0000","last_change":"2024-09-19T08:42:42.407931+0000","last_active":"2024-09-19T08:42:58.106004+0000","last_peered":"2024-09-19T08:42:58.106004+0000","last_clean":"2024-09-19T08:42:58.106004+0000","last_became_active":"2024-09-19T08:42:42.407573+0000","last_became_peered":"2024-09-19T08:42:42.407573+0000","last_unstale":"2024-09-19T08:42:58.106004+0000","last_undegraded":"2024-09-19T08:42:58.106004+0000","last_fullsized":"2024-09-19T08:42:58.106004+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:55.095275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105172+0000","last_change":"2024-09-19T08:42:44.034109+0000","last_active":"2024-09-19T08:42:58.105172+0000","last_peered":"2024-09-19T08:42:58.105172+0000","last_clean":"2024-09-19T08:42:58.105172+0000","last_became_active":"2024-09-19T08:42:44.033753+0000","last_became_peered":"2024-09-19T08:42:44.033753+0000","last_unstale":"2024-09-19T08:42:58.105172+0000","last_undegraded":"2024-09-19T08:42:58.105172+0000","last_fullsized":"2024-09-19T08:42:58.105172+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:08.475476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":48,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.120292+0000","last_change":"2024-09-19T08:42:58.120292+0000","last_active":"2024-09-19T08:42:58.120292+0000","last_peered":"2024-09-19T08:42:58.120292+0000","last_clean":"2024-09-19T08:42:58.120292+0000","last_became_active":"2024-09-19T08:42:58.109929+0000","last_became_peered":"2024-09-19T08:42:58.109929+0000","last_unstale":"2024-09-19T08:42:58.120292+0000","last_undegraded":"2024-09-19T08:42:58.120292+0000","last_fullsized":"2024-09-19T08:42:58.120292+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:56.196868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":343,"num_read_kb":237,"num_write":163,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1198,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":192480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579930,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":433265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808862,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32736,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712416,"statfs":{"total":95995035648,"available":95961513984,"internally_reserved":0,"allocated":1589248,"data_stored":1084287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939684,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":432885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168616,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":432805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397549,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1024548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561075,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":432274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790006,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1024421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953533,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":433686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215170,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40396,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704756,"statfs":{"total":95995035648,"available":95953670144,"internally_reserved":0,"allocated":913408,"data_stored":432585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444102,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":492958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":491831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":917504,"data_stored":433545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":60891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:43:50.343 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:43:50.600 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:51.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.118+0000 7fcc61798640 1 -- 172.21.15.7:0/1693910522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc5c100e30 msgr2=0x7fcc5c104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:51.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.118+0000 7fcc61798640 1 --2- 172.21.15.7:0/1693910522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc5c100e30 0x7fcc5c104e80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000adb0 tx=0x7fcc5002b7a0 comp rx=0 tx=0).stop 2024-09-19T08:43:51.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.118+0000 7fcc61798640 1 -- 172.21.15.7:0/1693910522 shutdown_connections 2024-09-19T08:43:51.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.118+0000 7fcc61798640 1 --2- 172.21.15.7:0/1693910522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc5c1055b0 0x7fcc5c10d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:51.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.118+0000 7fcc61798640 1 --2- 172.21.15.7:0/1693910522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc5c100e30 0x7fcc5c104e80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:51.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.118+0000 7fcc61798640 1 --2- 172.21.15.7:0/1693910522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc5c100480 0x7fcc5c100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:51.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.118+0000 7fcc61798640 1 -- 172.21.15.7:0/1693910522 >> 172.21.15.7:0/1693910522 conn(0x7fcc5c077210 msgr2=0x7fcc5c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:51.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.118+0000 7fcc61798640 1 -- 172.21.15.7:0/1693910522 shutdown_connections 2024-09-19T08:43:51.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.118+0000 7fcc61798640 1 -- 172.21.15.7:0/1693910522 wait complete. 2024-09-19T08:43:51.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.119+0000 7fcc61798640 1 Processor -- start 2024-09-19T08:43:51.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.119+0000 7fcc61798640 1 -- start start 2024-09-19T08:43:51.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.119+0000 7fcc61798640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc5c100480 0x7fcc5c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:51.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.119+0000 7fcc61798640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc5c100e30 0x7fcc5c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:51.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.119+0000 7fcc61798640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc5c1055b0 0x7fcc5c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:51.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.119+0000 7fcc61798640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5c10fd90 con 0x7fcc5c1055b0 2024-09-19T08:43:51.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.119+0000 7fcc61798640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5c10fc10 con 0x7fcc5c100e30 2024-09-19T08:43:51.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.119+0000 7fcc61798640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5c10ff10 con 0x7fcc5c100480 2024-09-19T08:43:51.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.119+0000 7fcc5b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc5c1055b0 0x7fcc5c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:51.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.119+0000 7fcc5b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc5c1055b0 0x7fcc5c19cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55062/0 (socket says 172.21.15.7:55062) 2024-09-19T08:43:51.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.119+0000 7fcc5b7fe640 1 -- 172.21.15.7:0/3078865298 learned_addr learned my addr 172.21.15.7:0/3078865298 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:51.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.119+0000 7fcc5affd640 1 --2- 172.21.15.7:0/3078865298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc5c100480 0x7fcc5c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:51.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.119+0000 7fcc5a7fc640 1 --2- 172.21.15.7:0/3078865298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc5c100e30 0x7fcc5c1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:51.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.119+0000 7fcc5b7fe640 1 -- 172.21.15.7:0/3078865298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc5c100480 msgr2=0x7fcc5c198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:51.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.119+0000 7fcc5b7fe640 1 --2- 172.21.15.7:0/3078865298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc5c100480 0x7fcc5c198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:51.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.119+0000 7fcc5b7fe640 1 -- 172.21.15.7:0/3078865298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc5c100e30 msgr2=0x7fcc5c1989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:51.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.119+0000 7fcc5b7fe640 1 --2- 172.21.15.7:0/3078865298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc5c100e30 0x7fcc5c1989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:51.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.119+0000 7fcc5b7fe640 1 -- 172.21.15.7:0/3078865298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc5c19d430 con 0x7fcc5c1055b0 2024-09-19T08:43:51.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.119+0000 7fcc5a7fc640 1 --2- 172.21.15.7:0/3078865298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc5c100e30 0x7fcc5c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:43:51.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.120+0000 7fcc5b7fe640 1 --2- 172.21.15.7:0/3078865298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc5c1055b0 0x7fcc5c19cd50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400e970 tx=0x7fcc5400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:51.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.120+0000 7fcc43fff640 1 -- 172.21.15.7:0/3078865298 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5400ccc0 con 0x7fcc5c1055b0 2024-09-19T08:43:51.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.120+0000 7fcc43fff640 1 -- 172.21.15.7:0/3078865298 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc5400ce60 con 0x7fcc5c1055b0 2024-09-19T08:43:51.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.120+0000 7fcc61798640 1 -- 172.21.15.7:0/3078865298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc5c19d720 con 0x7fcc5c1055b0 2024-09-19T08:43:51.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.120+0000 7fcc43fff640 1 -- 172.21.15.7:0/3078865298 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc54010490 con 0x7fcc5c1055b0 2024-09-19T08:43:51.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.120+0000 7fcc61798640 1 -- 172.21.15.7:0/3078865298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc5c1a5000 con 0x7fcc5c1055b0 2024-09-19T08:43:51.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.121+0000 7fcc61798640 1 -- 172.21.15.7:0/3078865298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc5c100860 con 0x7fcc5c1055b0 2024-09-19T08:43:51.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.122+0000 7fcc43fff640 1 -- 172.21.15.7:0/3078865298 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fcc54005020 con 0x7fcc5c1055b0 2024-09-19T08:43:51.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.123+0000 7fcc43fff640 1 --2- 172.21.15.7:0/3078865298 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fcc440a32d0 0x7fcc440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:51.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.123+0000 7fcc5affd640 1 --2- 172.21.15.7:0/3078865298 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fcc440a32d0 0x7fcc440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:51.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.123+0000 7fcc43fff640 1 -- 172.21.15.7:0/3078865298 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcc540cff50 con 0x7fcc5c1055b0 2024-09-19T08:43:51.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.123+0000 7fcc5affd640 1 --2- 172.21.15.7:0/3078865298 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fcc440a32d0 0x7fcc440a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c009bd0 tx=0x7fcc4c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:51.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.127+0000 7fcc43fff640 1 -- 172.21.15.7:0/3078865298 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcc5409cb10 con 0x7fcc5c1055b0 2024-09-19T08:43:51.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.302+0000 7fcc61798640 1 -- 172.21.15.7:0/3078865298 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcc5c062630 con 0x7fcc440a32d0 2024-09-19T08:43:51.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.308+0000 7fcc43fff640 1 -- 172.21.15.7:0/3078865298 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258715 (secure 0 0 0) 0x7fcc5c062630 con 0x7fcc440a32d0 2024-09-19T08:43:51.313 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:43:51.314 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-19T08:43:51.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.311+0000 7fcc61798640 1 -- 172.21.15.7:0/3078865298 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fcc440a32d0 msgr2=0x7fcc440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:51.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.311+0000 7fcc61798640 1 --2- 172.21.15.7:0/3078865298 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fcc440a32d0 0x7fcc440a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c009bd0 tx=0x7fcc4c005f90 comp rx=0 tx=0).stop 2024-09-19T08:43:51.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.311+0000 7fcc61798640 1 -- 172.21.15.7:0/3078865298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc5c1055b0 msgr2=0x7fcc5c19cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:51.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.311+0000 7fcc61798640 1 --2- 172.21.15.7:0/3078865298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc5c1055b0 0x7fcc5c19cd50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400e970 tx=0x7fcc5400ed70 comp rx=0 tx=0).stop 2024-09-19T08:43:51.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.311+0000 7fcc61798640 1 -- 172.21.15.7:0/3078865298 shutdown_connections 2024-09-19T08:43:51.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.311+0000 7fcc61798640 1 --2- 172.21.15.7:0/3078865298 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fcc440a32d0 0x7fcc440a5790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:51.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.311+0000 7fcc61798640 1 --2- 172.21.15.7:0/3078865298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc5c1055b0 0x7fcc5c19cd50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:51.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.311+0000 7fcc61798640 1 --2- 172.21.15.7:0/3078865298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc5c100e30 0x7fcc5c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:51.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.311+0000 7fcc61798640 1 --2- 172.21.15.7:0/3078865298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc5c100480 0x7fcc5c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:51.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.311+0000 7fcc61798640 1 -- 172.21.15.7:0/3078865298 >> 172.21.15.7:0/3078865298 conn(0x7fcc5c077210 msgr2=0x7fcc5c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:51.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.311+0000 7fcc61798640 1 -- 172.21.15.7:0/3078865298 shutdown_connections 2024-09-19T08:43:51.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:51.311+0000 7fcc61798640 1 -- 172.21.15.7:0/3078865298 wait complete. 2024-09-19T08:43:51.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:51 smithi007 ceph-mon[31221]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:43:51.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:51 smithi007 ceph-mon[31221]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:43:52.019 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-09-19T08:43:50.880742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654762,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":494,"num_read_kb":366,"num_write":346,"num_write_kb":3050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1181934,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366012,"kb_used_data":12588,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575812,"statfs":{"total":1151940427776,"available":1151565631488,"internally_reserved":0,"allocated":12890112,"data_stored":7149090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003041"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101626+0000","last_change":"2024-09-19T08:42:44.035697+0000","last_active":"2024-09-19T08:42:58.101626+0000","last_peered":"2024-09-19T08:42:58.101626+0000","last_clean":"2024-09-19T08:42:58.101626+0000","last_became_active":"2024-09-19T08:42:44.035400+0000","last_became_peered":"2024-09-19T08:42:44.035400+0000","last_unstale":"2024-09-19T08:42:58.101626+0000","last_undegraded":"2024-09-19T08:42:58.101626+0000","last_fullsized":"2024-09-19T08:42:58.101626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:56.202947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102854+0000","last_change":"2024-09-19T08:42:44.031393+0000","last_active":"2024-09-19T08:42:58.102854+0000","last_peered":"2024-09-19T08:42:58.102854+0000","last_clean":"2024-09-19T08:42:58.102854+0000","last_became_active":"2024-09-19T08:42:44.031056+0000","last_became_peered":"2024-09-19T08:42:44.031056+0000","last_unstale":"2024-09-19T08:42:58.102854+0000","last_undegraded":"2024-09-19T08:42:58.102854+0000","last_fullsized":"2024-09-19T08:42:58.102854+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:44.694913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102589+0000","last_change":"2024-09-19T08:42:44.029586+0000","last_active":"2024-09-19T08:42:58.102589+0000","last_peered":"2024-09-19T08:42:58.102589+0000","last_clean":"2024-09-19T08:42:58.102589+0000","last_became_active":"2024-09-19T08:42:44.029279+0000","last_became_peered":"2024-09-19T08:42:44.029279+0000","last_unstale":"2024-09-19T08:42:58.102589+0000","last_undegraded":"2024-09-19T08:42:58.102589+0000","last_fullsized":"2024-09-19T08:42:58.102589+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:12.036113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102656+0000","last_change":"2024-09-19T08:42:44.043192+0000","last_active":"2024-09-19T08:42:58.102656+0000","last_peered":"2024-09-19T08:42:58.102656+0000","last_clean":"2024-09-19T08:42:58.102656+0000","last_became_active":"2024-09-19T08:42:44.042838+0000","last_became_peered":"2024-09-19T08:42:44.042838+0000","last_unstale":"2024-09-19T08:42:58.102656+0000","last_undegraded":"2024-09-19T08:42:58.102656+0000","last_fullsized":"2024-09-19T08:42:58.102656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:20.549232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.107892+0000","last_change":"2024-09-19T08:42:44.032231+0000","last_active":"2024-09-19T08:42:58.107892+0000","last_peered":"2024-09-19T08:42:58.107892+0000","last_clean":"2024-09-19T08:42:58.107892+0000","last_became_active":"2024-09-19T08:42:44.031835+0000","last_became_peered":"2024-09-19T08:42:44.031835+0000","last_unstale":"2024-09-19T08:42:58.107892+0000","last_undegraded":"2024-09-19T08:42:58.107892+0000","last_fullsized":"2024-09-19T08:42:58.107892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:49.084085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103663+0000","last_change":"2024-09-19T08:42:44.035487+0000","last_active":"2024-09-19T08:42:58.103663+0000","last_peered":"2024-09-19T08:42:58.103663+0000","last_clean":"2024-09-19T08:42:58.103663+0000","last_became_active":"2024-09-19T08:42:44.035138+0000","last_became_peered":"2024-09-19T08:42:44.035138+0000","last_unstale":"2024-09-19T08:42:58.103663+0000","last_undegraded":"2024-09-19T08:42:58.103663+0000","last_fullsized":"2024-09-19T08:42:58.103663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:43.483397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108910+0000","last_change":"2024-09-19T08:42:44.029052+0000","last_active":"2024-09-19T08:42:58.108910+0000","last_peered":"2024-09-19T08:42:58.108910+0000","last_clean":"2024-09-19T08:42:58.108910+0000","last_became_active":"2024-09-19T08:42:44.028722+0000","last_became_peered":"2024-09-19T08:42:44.028722+0000","last_unstale":"2024-09-19T08:42:58.108910+0000","last_undegraded":"2024-09-19T08:42:58.108910+0000","last_fullsized":"2024-09-19T08:42:58.108910+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:49.226044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104266+0000","last_change":"2024-09-19T08:42:44.031401+0000","last_active":"2024-09-19T08:42:58.104266+0000","last_peered":"2024-09-19T08:42:58.104266+0000","last_clean":"2024-09-19T08:42:58.104266+0000","last_became_active":"2024-09-19T08:42:44.031103+0000","last_became_peered":"2024-09-19T08:42:44.031103+0000","last_unstale":"2024-09-19T08:42:58.104266+0000","last_undegraded":"2024-09-19T08:42:58.104266+0000","last_fullsized":"2024-09-19T08:42:58.104266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:57.406765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110149+0000","last_change":"2024-09-19T08:42:44.033011+0000","last_active":"2024-09-19T08:42:58.110149+0000","last_peered":"2024-09-19T08:42:58.110149+0000","last_clean":"2024-09-19T08:42:58.110149+0000","last_became_active":"2024-09-19T08:42:44.032075+0000","last_became_peered":"2024-09-19T08:42:44.032075+0000","last_unstale":"2024-09-19T08:42:58.110149+0000","last_undegraded":"2024-09-19T08:42:58.110149+0000","last_fullsized":"2024-09-19T08:42:58.110149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:43.701684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103460+0000","last_change":"2024-09-19T08:42:44.037417+0000","last_active":"2024-09-19T08:42:58.103460+0000","last_peered":"2024-09-19T08:42:58.103460+0000","last_clean":"2024-09-19T08:42:58.103460+0000","last_became_active":"2024-09-19T08:42:44.037006+0000","last_became_peered":"2024-09-19T08:42:44.037006+0000","last_unstale":"2024-09-19T08:42:58.103460+0000","last_undegraded":"2024-09-19T08:42:58.103460+0000","last_fullsized":"2024-09-19T08:42:58.103460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:10.952939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110570+0000","last_change":"2024-09-19T08:42:44.034125+0000","last_active":"2024-09-19T08:42:58.110570+0000","last_peered":"2024-09-19T08:42:58.110570+0000","last_clean":"2024-09-19T08:42:58.110570+0000","last_became_active":"2024-09-19T08:42:44.033772+0000","last_became_peered":"2024-09-19T08:42:44.033772+0000","last_unstale":"2024-09-19T08:42:58.110570+0000","last_undegraded":"2024-09-19T08:42:58.110570+0000","last_fullsized":"2024-09-19T08:42:58.110570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:42.854137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102712+0000","last_change":"2024-09-19T08:42:44.043047+0000","last_active":"2024-09-19T08:42:58.102712+0000","last_peered":"2024-09-19T08:42:58.102712+0000","last_clean":"2024-09-19T08:42:58.102712+0000","last_became_active":"2024-09-19T08:42:44.042666+0000","last_became_peered":"2024-09-19T08:42:44.042666+0000","last_unstale":"2024-09-19T08:42:58.102712+0000","last_undegraded":"2024-09-19T08:42:58.102712+0000","last_fullsized":"2024-09-19T08:42:58.102712+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:16.504824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100549+0000","last_change":"2024-09-19T08:42:44.026475+0000","last_active":"2024-09-19T08:42:58.100549+0000","last_peered":"2024-09-19T08:42:58.100549+0000","last_clean":"2024-09-19T08:42:58.100549+0000","last_became_active":"2024-09-19T08:42:44.026169+0000","last_became_peered":"2024-09-19T08:42:44.026169+0000","last_unstale":"2024-09-19T08:42:58.100549+0000","last_undegraded":"2024-09-19T08:42:58.100549+0000","last_fullsized":"2024-09-19T08:42:58.100549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:17.130267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102287+0000","last_change":"2024-09-19T08:42:44.033725+0000","last_active":"2024-09-19T08:42:58.102287+0000","last_peered":"2024-09-19T08:42:58.102287+0000","last_clean":"2024-09-19T08:42:58.102287+0000","last_became_active":"2024-09-19T08:42:44.033304+0000","last_became_peered":"2024-09-19T08:42:44.033304+0000","last_unstale":"2024-09-19T08:42:58.102287+0000","last_undegraded":"2024-09-19T08:42:58.102287+0000","last_fullsized":"2024-09-19T08:42:58.102287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:47.520808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102018+0000","last_change":"2024-09-19T08:42:44.041762+0000","last_active":"2024-09-19T08:42:58.102018+0000","last_peered":"2024-09-19T08:42:58.102018+0000","last_clean":"2024-09-19T08:42:58.102018+0000","last_became_active":"2024-09-19T08:42:44.041433+0000","last_became_peered":"2024-09-19T08:42:44.041433+0000","last_unstale":"2024-09-19T08:42:58.102018+0000","last_undegraded":"2024-09-19T08:42:58.102018+0000","last_fullsized":"2024-09-19T08:42:58.102018+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:05.504873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108993+0000","last_change":"2024-09-19T08:42:44.030316+0000","last_active":"2024-09-19T08:42:58.108993+0000","last_peered":"2024-09-19T08:42:58.108993+0000","last_clean":"2024-09-19T08:42:58.108993+0000","last_became_active":"2024-09-19T08:42:44.029872+0000","last_became_peered":"2024-09-19T08:42:44.029872+0000","last_unstale":"2024-09-19T08:42:58.108993+0000","last_undegraded":"2024-09-19T08:42:58.108993+0000","last_fullsized":"2024-09-19T08:42:58.108993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:18.011019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101626+0000","last_change":"2024-09-19T08:42:44.035523+0000","last_active":"2024-09-19T08:42:58.101626+0000","last_peered":"2024-09-19T08:42:58.101626+0000","last_clean":"2024-09-19T08:42:58.101626+0000","last_became_active":"2024-09-19T08:42:44.035185+0000","last_became_peered":"2024-09-19T08:42:44.035185+0000","last_unstale":"2024-09-19T08:42:58.101626+0000","last_undegraded":"2024-09-19T08:42:58.101626+0000","last_fullsized":"2024-09-19T08:42:58.101626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:03.475458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105867+0000","last_change":"2024-09-19T08:42:44.031803+0000","last_active":"2024-09-19T08:42:58.105867+0000","last_peered":"2024-09-19T08:42:58.105867+0000","last_clean":"2024-09-19T08:42:58.105867+0000","last_became_active":"2024-09-19T08:42:44.031501+0000","last_became_peered":"2024-09-19T08:42:44.031501+0000","last_unstale":"2024-09-19T08:42:58.105867+0000","last_undegraded":"2024-09-19T08:42:58.105867+0000","last_fullsized":"2024-09-19T08:42:58.105867+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:31.780744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104128+0000","last_change":"2024-09-19T08:42:44.036168+0000","last_active":"2024-09-19T08:42:58.104128+0000","last_peered":"2024-09-19T08:42:58.104128+0000","last_clean":"2024-09-19T08:42:58.104128+0000","last_became_active":"2024-09-19T08:42:44.035819+0000","last_became_peered":"2024-09-19T08:42:44.035819+0000","last_unstale":"2024-09-19T08:42:58.104128+0000","last_undegraded":"2024-09-19T08:42:58.104128+0000","last_fullsized":"2024-09-19T08:42:58.104128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:26.478389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101182+0000","last_change":"2024-09-19T08:42:44.037569+0000","last_active":"2024-09-19T08:42:58.101182+0000","last_peered":"2024-09-19T08:42:58.101182+0000","last_clean":"2024-09-19T08:42:58.101182+0000","last_became_active":"2024-09-19T08:42:44.037161+0000","last_became_peered":"2024-09-19T08:42:44.037161+0000","last_unstale":"2024-09-19T08:42:58.101182+0000","last_undegraded":"2024-09-19T08:42:58.101182+0000","last_fullsized":"2024-09-19T08:42:58.101182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:35.316314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100549+0000","last_change":"2024-09-19T08:42:44.023160+0000","last_active":"2024-09-19T08:42:58.100549+0000","last_peered":"2024-09-19T08:42:58.100549+0000","last_clean":"2024-09-19T08:42:58.100549+0000","last_became_active":"2024-09-19T08:42:44.022791+0000","last_became_peered":"2024-09-19T08:42:44.022791+0000","last_unstale":"2024-09-19T08:42:58.100549+0000","last_undegraded":"2024-09-19T08:42:58.100549+0000","last_fullsized":"2024-09-19T08:42:58.100549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:00.174583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109685+0000","last_change":"2024-09-19T08:42:44.035877+0000","last_active":"2024-09-19T08:42:58.109685+0000","last_peered":"2024-09-19T08:42:58.109685+0000","last_clean":"2024-09-19T08:42:58.109685+0000","last_became_active":"2024-09-19T08:42:44.035307+0000","last_became_peered":"2024-09-19T08:42:44.035307+0000","last_unstale":"2024-09-19T08:42:58.109685+0000","last_undegraded":"2024-09-19T08:42:58.109685+0000","last_fullsized":"2024-09-19T08:42:58.109685+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:54.717130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104090+0000","last_change":"2024-09-19T08:42:44.033536+0000","last_active":"2024-09-19T08:42:58.104090+0000","last_peered":"2024-09-19T08:42:58.104090+0000","last_clean":"2024-09-19T08:42:58.104090+0000","last_became_active":"2024-09-19T08:42:44.033179+0000","last_became_peered":"2024-09-19T08:42:44.033179+0000","last_unstale":"2024-09-19T08:42:58.104090+0000","last_undegraded":"2024-09-19T08:42:58.104090+0000","last_fullsized":"2024-09-19T08:42:58.104090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:11.161785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104608+0000","last_change":"2024-09-19T08:42:44.029674+0000","last_active":"2024-09-19T08:42:58.104608+0000","last_peered":"2024-09-19T08:42:58.104608+0000","last_clean":"2024-09-19T08:42:58.104608+0000","last_became_active":"2024-09-19T08:42:44.029368+0000","last_became_peered":"2024-09-19T08:42:44.029368+0000","last_unstale":"2024-09-19T08:42:58.104608+0000","last_undegraded":"2024-09-19T08:42:58.104608+0000","last_fullsized":"2024-09-19T08:42:58.104608+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:34.943363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105011+0000","last_change":"2024-09-19T08:42:44.039780+0000","last_active":"2024-09-19T08:42:58.105011+0000","last_peered":"2024-09-19T08:42:58.105011+0000","last_clean":"2024-09-19T08:42:58.105011+0000","last_became_active":"2024-09-19T08:42:44.039409+0000","last_became_peered":"2024-09-19T08:42:44.039409+0000","last_unstale":"2024-09-19T08:42:58.105011+0000","last_undegraded":"2024-09-19T08:42:58.105011+0000","last_fullsized":"2024-09-19T08:42:58.105011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:59.632132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103863+0000","last_change":"2024-09-19T08:42:44.030881+0000","last_active":"2024-09-19T08:42:58.103863+0000","last_peered":"2024-09-19T08:42:58.103863+0000","last_clean":"2024-09-19T08:42:58.103863+0000","last_became_active":"2024-09-19T08:42:44.030530+0000","last_became_peered":"2024-09-19T08:42:44.030530+0000","last_unstale":"2024-09-19T08:42:58.103863+0000","last_undegraded":"2024-09-19T08:42:58.103863+0000","last_fullsized":"2024-09-19T08:42:58.103863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:16.908450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101414+0000","last_change":"2024-09-19T08:42:44.033056+0000","last_active":"2024-09-19T08:42:58.101414+0000","last_peered":"2024-09-19T08:42:58.101414+0000","last_clean":"2024-09-19T08:42:58.101414+0000","last_became_active":"2024-09-19T08:42:44.032690+0000","last_became_peered":"2024-09-19T08:42:44.032690+0000","last_unstale":"2024-09-19T08:42:58.101414+0000","last_undegraded":"2024-09-19T08:42:58.101414+0000","last_fullsized":"2024-09-19T08:42:58.101414+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:36.497824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106551+0000","last_change":"2024-09-19T08:42:58.106551+0000","last_active":"2024-09-19T08:42:58.106551+0000","last_peered":"2024-09-19T08:42:58.106551+0000","last_clean":"2024-09-19T08:42:58.106551+0000","last_became_active":"2024-09-19T08:42:58.106119+0000","last_became_peered":"2024-09-19T08:42:58.106119+0000","last_unstale":"2024-09-19T08:42:58.106551+0000","last_undegraded":"2024-09-19T08:42:58.106551+0000","last_fullsized":"2024-09-19T08:42:58.106551+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:46.794260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108106+0000","last_change":"2024-09-19T08:42:58.108106+0000","last_active":"2024-09-19T08:42:58.108106+0000","last_peered":"2024-09-19T08:42:58.108106+0000","last_clean":"2024-09-19T08:42:58.108106+0000","last_became_active":"2024-09-19T08:42:58.107532+0000","last_became_peered":"2024-09-19T08:42:58.107532+0000","last_unstale":"2024-09-19T08:42:58.108106+0000","last_undegraded":"2024-09-19T08:42:58.108106+0000","last_fullsized":"2024-09-19T08:42:58.108106+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:29.164983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103606+0000","last_change":"2024-09-19T08:42:44.029822+0000","last_active":"2024-09-19T08:42:58.103606+0000","last_peered":"2024-09-19T08:42:58.103606+0000","last_clean":"2024-09-19T08:42:58.103606+0000","last_became_active":"2024-09-19T08:42:44.029450+0000","last_became_peered":"2024-09-19T08:42:44.029450+0000","last_unstale":"2024-09-19T08:42:58.103606+0000","last_undegraded":"2024-09-19T08:42:58.103606+0000","last_fullsized":"2024-09-19T08:42:58.103606+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:40.826261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105132+0000","last_change":"2024-09-19T08:42:44.041354+0000","last_active":"2024-09-19T08:42:58.105132+0000","last_peered":"2024-09-19T08:42:58.105132+0000","last_clean":"2024-09-19T08:42:58.105132+0000","last_became_active":"2024-09-19T08:42:44.040912+0000","last_became_peered":"2024-09-19T08:42:44.040912+0000","last_unstale":"2024-09-19T08:42:58.105132+0000","last_undegraded":"2024-09-19T08:42:58.105132+0000","last_fullsized":"2024-09-19T08:42:58.105132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:16.543950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101119+0000","last_change":"2024-09-19T08:42:44.027912+0000","last_active":"2024-09-19T08:42:58.101119+0000","last_peered":"2024-09-19T08:42:58.101119+0000","last_clean":"2024-09-19T08:42:58.101119+0000","last_became_active":"2024-09-19T08:42:44.027505+0000","last_became_peered":"2024-09-19T08:42:44.027505+0000","last_unstale":"2024-09-19T08:42:58.101119+0000","last_undegraded":"2024-09-19T08:42:58.101119+0000","last_fullsized":"2024-09-19T08:42:58.101119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:02.552756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.107911+0000","last_change":"2024-09-19T08:42:44.034472+0000","last_active":"2024-09-19T08:42:58.107911+0000","last_peered":"2024-09-19T08:42:58.107911+0000","last_clean":"2024-09-19T08:42:58.107911+0000","last_became_active":"2024-09-19T08:42:44.034026+0000","last_became_peered":"2024-09-19T08:42:44.034026+0000","last_unstale":"2024-09-19T08:42:58.107911+0000","last_undegraded":"2024-09-19T08:42:58.107911+0000","last_fullsized":"2024-09-19T08:42:58.107911+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:10.058882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'6","reported_seq":84,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:45.171906+0000","last_change":"2024-09-19T08:42:41.927174+0000","last_active":"2024-09-19T08:43:45.171906+0000","last_peered":"2024-09-19T08:43:45.171906+0000","last_clean":"2024-09-19T08:43:45.171906+0000","last_became_active":"2024-09-19T08:42:41.926826+0000","last_became_peered":"2024-09-19T08:42:41.926826+0000","last_unstale":"2024-09-19T08:43:45.171906+0000","last_undegraded":"2024-09-19T08:43:45.171906+0000","last_fullsized":"2024-09-19T08:43:45.171906+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:37.274891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110259+0000","last_change":"2024-09-19T08:42:58.110259+0000","last_active":"2024-09-19T08:42:58.110259+0000","last_peered":"2024-09-19T08:42:58.110259+0000","last_clean":"2024-09-19T08:42:58.110259+0000","last_became_active":"2024-09-19T08:42:58.109803+0000","last_became_peered":"2024-09-19T08:42:58.109803+0000","last_unstale":"2024-09-19T08:42:58.110259+0000","last_undegraded":"2024-09-19T08:42:58.110259+0000","last_fullsized":"2024-09-19T08:42:58.110259+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:31.853404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.114222+0000","last_change":"2024-09-19T08:42:58.114222+0000","last_active":"2024-09-19T08:42:58.114222+0000","last_peered":"2024-09-19T08:42:58.114222+0000","last_clean":"2024-09-19T08:42:58.114222+0000","last_became_active":"2024-09-19T08:42:58.110769+0000","last_became_peered":"2024-09-19T08:42:58.110769+0000","last_unstale":"2024-09-19T08:42:58.114222+0000","last_undegraded":"2024-09-19T08:42:58.114222+0000","last_fullsized":"2024-09-19T08:42:58.114222+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:17.952228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100222+0000","last_change":"2024-09-19T08:42:41.923903+0000","last_active":"2024-09-19T08:42:58.100222+0000","last_peered":"2024-09-19T08:42:58.100222+0000","last_clean":"2024-09-19T08:42:58.100222+0000","last_became_active":"2024-09-19T08:42:41.923583+0000","last_became_peered":"2024-09-19T08:42:41.923583+0000","last_unstale":"2024-09-19T08:42:58.100222+0000","last_undegraded":"2024-09-19T08:42:58.100222+0000","last_fullsized":"2024-09-19T08:42:58.100222+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:48.594343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104302+0000","last_change":"2024-09-19T08:42:44.028972+0000","last_active":"2024-09-19T08:42:58.104302+0000","last_peered":"2024-09-19T08:42:58.104302+0000","last_clean":"2024-09-19T08:42:58.104302+0000","last_became_active":"2024-09-19T08:42:44.028657+0000","last_became_peered":"2024-09-19T08:42:44.028657+0000","last_unstale":"2024-09-19T08:42:58.104302+0000","last_undegraded":"2024-09-19T08:42:58.104302+0000","last_fullsized":"2024-09-19T08:42:58.104302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:43.618010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106455+0000","last_change":"2024-09-19T08:42:41.926558+0000","last_active":"2024-09-19T08:42:58.106455+0000","last_peered":"2024-09-19T08:42:58.106455+0000","last_clean":"2024-09-19T08:42:58.106455+0000","last_became_active":"2024-09-19T08:42:41.926074+0000","last_became_peered":"2024-09-19T08:42:41.926074+0000","last_unstale":"2024-09-19T08:42:58.106455+0000","last_undegraded":"2024-09-19T08:42:58.106455+0000","last_fullsized":"2024-09-19T08:42:58.106455+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:47.563295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105300+0000","last_change":"2024-09-19T08:42:44.029191+0000","last_active":"2024-09-19T08:42:58.105300+0000","last_peered":"2024-09-19T08:42:58.105300+0000","last_clean":"2024-09-19T08:42:58.105300+0000","last_became_active":"2024-09-19T08:42:44.028871+0000","last_became_peered":"2024-09-19T08:42:44.028871+0000","last_unstale":"2024-09-19T08:42:58.105300+0000","last_undegraded":"2024-09-19T08:42:58.105300+0000","last_fullsized":"2024-09-19T08:42:58.105300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:41.262014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:49.177786+0000","last_change":"2024-09-19T08:42:41.930265+0000","last_active":"2024-09-19T08:43:49.177786+0000","last_peered":"2024-09-19T08:43:49.177786+0000","last_clean":"2024-09-19T08:43:49.177786+0000","last_became_active":"2024-09-19T08:42:41.929829+0000","last_became_peered":"2024-09-19T08:42:41.929829+0000","last_unstale":"2024-09-19T08:43:49.177786+0000","last_undegraded":"2024-09-19T08:43:49.177786+0000","last_fullsized":"2024-09-19T08:43:49.177786+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:59.181622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109302+0000","last_change":"2024-09-19T08:42:44.027382+0000","last_active":"2024-09-19T08:42:58.109302+0000","last_peered":"2024-09-19T08:42:58.109302+0000","last_clean":"2024-09-19T08:42:58.109302+0000","last_became_active":"2024-09-19T08:42:44.026824+0000","last_became_peered":"2024-09-19T08:42:44.026824+0000","last_unstale":"2024-09-19T08:42:58.109302+0000","last_undegraded":"2024-09-19T08:42:58.109302+0000","last_fullsized":"2024-09-19T08:42:58.109302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:58.520068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110495+0000","last_change":"2024-09-19T08:42:41.927914+0000","last_active":"2024-09-19T08:42:58.110495+0000","last_peered":"2024-09-19T08:42:58.110495+0000","last_clean":"2024-09-19T08:42:58.110495+0000","last_became_active":"2024-09-19T08:42:41.926566+0000","last_became_peered":"2024-09-19T08:42:41.926566+0000","last_unstale":"2024-09-19T08:42:58.110495+0000","last_undegraded":"2024-09-19T08:42:58.110495+0000","last_fullsized":"2024-09-19T08:42:58.110495+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:52.238352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103155+0000","last_change":"2024-09-19T08:42:44.039899+0000","last_active":"2024-09-19T08:42:58.103155+0000","last_peered":"2024-09-19T08:42:58.103155+0000","last_clean":"2024-09-19T08:42:58.103155+0000","last_became_active":"2024-09-19T08:42:44.039530+0000","last_became_peered":"2024-09-19T08:42:44.039530+0000","last_unstale":"2024-09-19T08:42:58.103155+0000","last_undegraded":"2024-09-19T08:42:58.103155+0000","last_fullsized":"2024-09-19T08:42:58.103155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:20.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105251+0000","last_change":"2024-09-19T08:42:42.410128+0000","last_active":"2024-09-19T08:42:58.105251+0000","last_peered":"2024-09-19T08:42:58.105251+0000","last_clean":"2024-09-19T08:42:58.105251+0000","last_became_active":"2024-09-19T08:42:42.409717+0000","last_became_peered":"2024-09-19T08:42:42.409717+0000","last_unstale":"2024-09-19T08:42:58.105251+0000","last_undegraded":"2024-09-19T08:42:58.105251+0000","last_fullsized":"2024-09-19T08:42:58.105251+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:41.682355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109529+0000","last_change":"2024-09-19T08:42:44.043248+0000","last_active":"2024-09-19T08:42:58.109529+0000","last_peered":"2024-09-19T08:42:58.109529+0000","last_clean":"2024-09-19T08:42:58.109529+0000","last_became_active":"2024-09-19T08:42:44.042849+0000","last_became_peered":"2024-09-19T08:42:44.042849+0000","last_unstale":"2024-09-19T08:42:58.109529+0000","last_undegraded":"2024-09-19T08:42:58.109529+0000","last_fullsized":"2024-09-19T08:42:58.109529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:00.413217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'28","reported_seq":173,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:50.179730+0000","last_change":"2024-09-19T08:42:41.926582+0000","last_active":"2024-09-19T08:43:50.179730+0000","last_peered":"2024-09-19T08:43:50.179730+0000","last_clean":"2024-09-19T08:43:50.179730+0000","last_became_active":"2024-09-19T08:42:41.926234+0000","last_became_peered":"2024-09-19T08:42:41.926234+0000","last_unstale":"2024-09-19T08:43:50.179730+0000","last_undegraded":"2024-09-19T08:43:50.179730+0000","last_fullsized":"2024-09-19T08:43:50.179730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:02.498976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":119,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108555+0000","last_change":"2024-09-19T08:42:44.034888+0000","last_active":"2024-09-19T08:42:58.108555+0000","last_peered":"2024-09-19T08:42:58.108555+0000","last_clean":"2024-09-19T08:42:58.108555+0000","last_became_active":"2024-09-19T08:42:44.034553+0000","last_became_peered":"2024-09-19T08:42:44.034553+0000","last_unstale":"2024-09-19T08:42:58.108555+0000","last_undegraded":"2024-09-19T08:42:58.108555+0000","last_fullsized":"2024-09-19T08:42:58.108555+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:06.416289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.118358+0000","last_change":"2024-09-19T08:42:58.117912+0000","last_active":"2024-09-19T08:42:58.118358+0000","last_peered":"2024-09-19T08:42:58.118358+0000","last_clean":"2024-09-19T08:42:58.118358+0000","last_became_active":"2024-09-19T08:42:58.105810+0000","last_became_peered":"2024-09-19T08:42:58.105810+0000","last_unstale":"2024-09-19T08:42:58.118358+0000","last_undegraded":"2024-09-19T08:42:58.118358+0000","last_fullsized":"2024-09-19T08:42:58.118358+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:44.258256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100246+0000","last_change":"2024-09-19T08:42:44.030519+0000","last_active":"2024-09-19T08:42:58.100246+0000","last_peered":"2024-09-19T08:42:58.100246+0000","last_clean":"2024-09-19T08:42:58.100246+0000","last_became_active":"2024-09-19T08:42:44.030190+0000","last_became_peered":"2024-09-19T08:42:44.030190+0000","last_unstale":"2024-09-19T08:42:58.100246+0000","last_undegraded":"2024-09-19T08:42:58.100246+0000","last_fullsized":"2024-09-19T08:42:58.100246+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:20.220642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106393+0000","last_change":"2024-09-19T08:42:41.928124+0000","last_active":"2024-09-19T08:42:58.106393+0000","last_peered":"2024-09-19T08:42:58.106393+0000","last_clean":"2024-09-19T08:42:58.106393+0000","last_became_active":"2024-09-19T08:42:41.927761+0000","last_became_peered":"2024-09-19T08:42:41.927761+0000","last_unstale":"2024-09-19T08:42:58.106393+0000","last_undegraded":"2024-09-19T08:42:58.106393+0000","last_fullsized":"2024-09-19T08:42:58.106393+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:08.591270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108569+0000","last_change":"2024-09-19T08:42:44.038234+0000","last_active":"2024-09-19T08:42:58.108569+0000","last_peered":"2024-09-19T08:42:58.108569+0000","last_clean":"2024-09-19T08:42:58.108569+0000","last_became_active":"2024-09-19T08:42:44.037726+0000","last_became_peered":"2024-09-19T08:42:44.037726+0000","last_unstale":"2024-09-19T08:42:58.108569+0000","last_undegraded":"2024-09-19T08:42:58.108569+0000","last_fullsized":"2024-09-19T08:42:58.108569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:08.865482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:46.175083+0000","last_change":"2024-09-19T08:42:41.926206+0000","last_active":"2024-09-19T08:43:46.175083+0000","last_peered":"2024-09-19T08:43:46.175083+0000","last_clean":"2024-09-19T08:43:46.175083+0000","last_became_active":"2024-09-19T08:42:41.925833+0000","last_became_peered":"2024-09-19T08:42:41.925833+0000","last_unstale":"2024-09-19T08:43:46.175083+0000","last_undegraded":"2024-09-19T08:43:46.175083+0000","last_fullsized":"2024-09-19T08:43:46.175083+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:27.944240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108472+0000","last_change":"2024-09-19T08:42:44.037181+0000","last_active":"2024-09-19T08:42:58.108472+0000","last_peered":"2024-09-19T08:42:58.108472+0000","last_clean":"2024-09-19T08:42:58.108472+0000","last_became_active":"2024-09-19T08:42:44.036865+0000","last_became_peered":"2024-09-19T08:42:44.036865+0000","last_unstale":"2024-09-19T08:42:58.108472+0000","last_undegraded":"2024-09-19T08:42:58.108472+0000","last_fullsized":"2024-09-19T08:42:58.108472+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:20.233309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.107685+0000","last_change":"2024-09-19T08:42:42.408446+0000","last_active":"2024-09-19T08:42:58.107685+0000","last_peered":"2024-09-19T08:42:58.107685+0000","last_clean":"2024-09-19T08:42:58.107685+0000","last_became_active":"2024-09-19T08:42:42.408098+0000","last_became_peered":"2024-09-19T08:42:42.408098+0000","last_unstale":"2024-09-19T08:42:58.107685+0000","last_undegraded":"2024-09-19T08:42:58.107685+0000","last_fullsized":"2024-09-19T08:42:58.107685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:22.603604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106374+0000","last_change":"2024-09-19T08:42:44.039954+0000","last_active":"2024-09-19T08:42:58.106374+0000","last_peered":"2024-09-19T08:42:58.106374+0000","last_clean":"2024-09-19T08:42:58.106374+0000","last_became_active":"2024-09-19T08:42:44.039601+0000","last_became_peered":"2024-09-19T08:42:44.039601+0000","last_unstale":"2024-09-19T08:42:58.106374+0000","last_undegraded":"2024-09-19T08:42:58.106374+0000","last_fullsized":"2024-09-19T08:42:58.106374+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:07.792167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108716+0000","last_change":"2024-09-19T08:42:41.929644+0000","last_active":"2024-09-19T08:42:58.108716+0000","last_peered":"2024-09-19T08:42:58.108716+0000","last_clean":"2024-09-19T08:42:58.108716+0000","last_became_active":"2024-09-19T08:42:41.929308+0000","last_became_peered":"2024-09-19T08:42:41.929308+0000","last_unstale":"2024-09-19T08:42:58.108716+0000","last_undegraded":"2024-09-19T08:42:58.108716+0000","last_fullsized":"2024-09-19T08:42:58.108716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:36.660470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.107555+0000","last_change":"2024-09-19T08:42:58.107555+0000","last_active":"2024-09-19T08:42:58.107555+0000","last_peered":"2024-09-19T08:42:58.107555+0000","last_clean":"2024-09-19T08:42:58.107555+0000","last_became_active":"2024-09-19T08:42:58.107137+0000","last_became_peered":"2024-09-19T08:42:58.107137+0000","last_unstale":"2024-09-19T08:42:58.107555+0000","last_undegraded":"2024-09-19T08:42:58.107555+0000","last_fullsized":"2024-09-19T08:42:58.107555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:13.198911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100493+0000","last_change":"2024-09-19T08:42:41.925195+0000","last_active":"2024-09-19T08:42:58.100493+0000","last_peered":"2024-09-19T08:42:58.100493+0000","last_clean":"2024-09-19T08:42:58.100493+0000","last_became_active":"2024-09-19T08:42:41.924880+0000","last_became_peered":"2024-09-19T08:42:41.924880+0000","last_unstale":"2024-09-19T08:42:58.100493+0000","last_undegraded":"2024-09-19T08:42:58.100493+0000","last_fullsized":"2024-09-19T08:42:58.100493+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:11.256881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110838+0000","last_change":"2024-09-19T08:42:44.036439+0000","last_active":"2024-09-19T08:42:58.110838+0000","last_peered":"2024-09-19T08:42:58.110838+0000","last_clean":"2024-09-19T08:42:58.110838+0000","last_became_active":"2024-09-19T08:42:44.036036+0000","last_became_peered":"2024-09-19T08:42:44.036036+0000","last_unstale":"2024-09-19T08:42:58.110838+0000","last_undegraded":"2024-09-19T08:42:58.110838+0000","last_fullsized":"2024-09-19T08:42:58.110838+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:37.410782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106933+0000","last_change":"2024-09-19T08:42:41.927490+0000","last_active":"2024-09-19T08:42:58.106933+0000","last_peered":"2024-09-19T08:42:58.106933+0000","last_clean":"2024-09-19T08:42:58.106933+0000","last_became_active":"2024-09-19T08:42:41.927163+0000","last_became_peered":"2024-09-19T08:42:41.927163+0000","last_unstale":"2024-09-19T08:42:58.106933+0000","last_undegraded":"2024-09-19T08:42:58.106933+0000","last_fullsized":"2024-09-19T08:42:58.106933+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:20.013661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110644+0000","last_change":"2024-09-19T08:42:44.036960+0000","last_active":"2024-09-19T08:42:58.110644+0000","last_peered":"2024-09-19T08:42:58.110644+0000","last_clean":"2024-09-19T08:42:58.110644+0000","last_became_active":"2024-09-19T08:42:44.036600+0000","last_became_peered":"2024-09-19T08:42:44.036600+0000","last_unstale":"2024-09-19T08:42:58.110644+0000","last_undegraded":"2024-09-19T08:42:58.110644+0000","last_fullsized":"2024-09-19T08:42:58.110644+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:15.621888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.114698+0000","last_change":"2024-09-19T08:42:58.114698+0000","last_active":"2024-09-19T08:42:58.114698+0000","last_peered":"2024-09-19T08:42:58.114698+0000","last_clean":"2024-09-19T08:42:58.114698+0000","last_became_active":"2024-09-19T08:42:58.105488+0000","last_became_peered":"2024-09-19T08:42:58.105488+0000","last_unstale":"2024-09-19T08:42:58.114698+0000","last_undegraded":"2024-09-19T08:42:58.114698+0000","last_fullsized":"2024-09-19T08:42:58.114698+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:12.642715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.110688+0000","last_change":"2024-09-19T08:42:44.035569+0000","last_active":"2024-09-19T08:42:58.110688+0000","last_peered":"2024-09-19T08:42:58.110688+0000","last_clean":"2024-09-19T08:42:58.110688+0000","last_became_active":"2024-09-19T08:42:44.035277+0000","last_became_peered":"2024-09-19T08:42:44.035277+0000","last_unstale":"2024-09-19T08:42:58.110688+0000","last_undegraded":"2024-09-19T08:42:58.110688+0000","last_fullsized":"2024-09-19T08:42:58.110688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:57.472721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":345,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108782+0000","last_change":"2024-09-19T08:41:34.769047+0000","last_active":"2024-09-19T08:42:58.108782+0000","last_peered":"2024-09-19T08:42:58.108782+0000","last_clean":"2024-09-19T08:42:58.108782+0000","last_became_active":"2024-09-19T08:41:34.768619+0000","last_became_peered":"2024-09-19T08:41:34.768619+0000","last_unstale":"2024-09-19T08:42:58.108782+0000","last_undegraded":"2024-09-19T08:42:58.108782+0000","last_fullsized":"2024-09-19T08:42:58.108782+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:13.482855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:13.482855+0000","last_clean_scrub_stamp":"2024-09-19T08:38:13.482855+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.390775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102051+0000","last_change":"2024-09-19T08:42:41.925698+0000","last_active":"2024-09-19T08:42:58.102051+0000","last_peered":"2024-09-19T08:42:58.102051+0000","last_clean":"2024-09-19T08:42:58.102051+0000","last_became_active":"2024-09-19T08:42:41.924618+0000","last_became_peered":"2024-09-19T08:42:41.924618+0000","last_unstale":"2024-09-19T08:42:58.102051+0000","last_undegraded":"2024-09-19T08:42:58.102051+0000","last_fullsized":"2024-09-19T08:42:58.102051+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:53.717139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.111536+0000","last_change":"2024-09-19T08:42:58.111206+0000","last_active":"2024-09-19T08:42:58.111536+0000","last_peered":"2024-09-19T08:42:58.111536+0000","last_clean":"2024-09-19T08:42:58.111536+0000","last_became_active":"2024-09-19T08:42:58.110765+0000","last_became_peered":"2024-09-19T08:42:58.110765+0000","last_unstale":"2024-09-19T08:42:58.111536+0000","last_undegraded":"2024-09-19T08:42:58.111536+0000","last_fullsized":"2024-09-19T08:42:58.111536+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:44.783938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108663+0000","last_change":"2024-09-19T08:42:41.928414+0000","last_active":"2024-09-19T08:42:58.108663+0000","last_peered":"2024-09-19T08:42:58.108663+0000","last_clean":"2024-09-19T08:42:58.108663+0000","last_became_active":"2024-09-19T08:42:41.928055+0000","last_became_peered":"2024-09-19T08:42:41.928055+0000","last_unstale":"2024-09-19T08:42:58.108663+0000","last_undegraded":"2024-09-19T08:42:58.108663+0000","last_fullsized":"2024-09-19T08:42:58.108663+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:12.688379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100208+0000","last_change":"2024-09-19T08:42:44.035439+0000","last_active":"2024-09-19T08:42:58.100208+0000","last_peered":"2024-09-19T08:42:58.100208+0000","last_clean":"2024-09-19T08:42:58.100208+0000","last_became_active":"2024-09-19T08:42:44.035150+0000","last_became_peered":"2024-09-19T08:42:44.035150+0000","last_unstale":"2024-09-19T08:42:58.100208+0000","last_undegraded":"2024-09-19T08:42:58.100208+0000","last_fullsized":"2024-09-19T08:42:58.100208+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:15.230660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:46.174531+0000","last_change":"2024-09-19T08:42:42.407784+0000","last_active":"2024-09-19T08:43:46.174531+0000","last_peered":"2024-09-19T08:43:46.174531+0000","last_clean":"2024-09-19T08:43:46.174531+0000","last_became_active":"2024-09-19T08:42:42.407437+0000","last_became_peered":"2024-09-19T08:42:42.407437+0000","last_unstale":"2024-09-19T08:43:46.174531+0000","last_undegraded":"2024-09-19T08:43:46.174531+0000","last_fullsized":"2024-09-19T08:43:46.174531+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:44.829338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104733+0000","last_change":"2024-09-19T08:42:44.039780+0000","last_active":"2024-09-19T08:42:58.104733+0000","last_peered":"2024-09-19T08:42:58.104733+0000","last_clean":"2024-09-19T08:42:58.104733+0000","last_became_active":"2024-09-19T08:42:44.039441+0000","last_became_peered":"2024-09-19T08:42:44.039441+0000","last_unstale":"2024-09-19T08:42:58.104733+0000","last_undegraded":"2024-09-19T08:42:58.104733+0000","last_fullsized":"2024-09-19T08:42:58.104733+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:31.013663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109953+0000","last_change":"2024-09-19T08:42:41.926998+0000","last_active":"2024-09-19T08:42:58.109953+0000","last_peered":"2024-09-19T08:42:58.109953+0000","last_clean":"2024-09-19T08:42:58.109953+0000","last_became_active":"2024-09-19T08:42:41.926560+0000","last_became_peered":"2024-09-19T08:42:41.926560+0000","last_unstale":"2024-09-19T08:42:58.109953+0000","last_undegraded":"2024-09-19T08:42:58.109953+0000","last_fullsized":"2024-09-19T08:42:58.109953+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:35.338601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102887+0000","last_change":"2024-09-19T08:42:44.039948+0000","last_active":"2024-09-19T08:42:58.102887+0000","last_peered":"2024-09-19T08:42:58.102887+0000","last_clean":"2024-09-19T08:42:58.102887+0000","last_became_active":"2024-09-19T08:42:44.038797+0000","last_became_peered":"2024-09-19T08:42:44.038797+0000","last_unstale":"2024-09-19T08:42:58.102887+0000","last_undegraded":"2024-09-19T08:42:58.102887+0000","last_fullsized":"2024-09-19T08:42:58.102887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:19.273191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105603+0000","last_change":"2024-09-19T08:42:42.409954+0000","last_active":"2024-09-19T08:42:58.105603+0000","last_peered":"2024-09-19T08:42:58.105603+0000","last_clean":"2024-09-19T08:42:58.105603+0000","last_became_active":"2024-09-19T08:42:42.409388+0000","last_became_peered":"2024-09-19T08:42:42.409388+0000","last_unstale":"2024-09-19T08:42:58.105603+0000","last_undegraded":"2024-09-19T08:42:58.105603+0000","last_fullsized":"2024-09-19T08:42:58.105603+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:58.764877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103241+0000","last_change":"2024-09-19T08:42:44.024360+0000","last_active":"2024-09-19T08:42:58.103241+0000","last_peered":"2024-09-19T08:42:58.103241+0000","last_clean":"2024-09-19T08:42:58.103241+0000","last_became_active":"2024-09-19T08:42:44.023703+0000","last_became_peered":"2024-09-19T08:42:44.023703+0000","last_unstale":"2024-09-19T08:42:58.103241+0000","last_undegraded":"2024-09-19T08:42:58.103241+0000","last_fullsized":"2024-09-19T08:42:58.103241+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:10.852199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108774+0000","last_change":"2024-09-19T08:42:42.408101+0000","last_active":"2024-09-19T08:42:58.108774+0000","last_peered":"2024-09-19T08:42:58.108774+0000","last_clean":"2024-09-19T08:42:58.108774+0000","last_became_active":"2024-09-19T08:42:42.407692+0000","last_became_peered":"2024-09-19T08:42:42.407692+0000","last_unstale":"2024-09-19T08:42:58.108774+0000","last_undegraded":"2024-09-19T08:42:58.108774+0000","last_fullsized":"2024-09-19T08:42:58.108774+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:01.342213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.100618+0000","last_change":"2024-09-19T08:42:44.026612+0000","last_active":"2024-09-19T08:42:58.100618+0000","last_peered":"2024-09-19T08:42:58.100618+0000","last_clean":"2024-09-19T08:42:58.100618+0000","last_became_active":"2024-09-19T08:42:44.025408+0000","last_became_peered":"2024-09-19T08:42:44.025408+0000","last_unstale":"2024-09-19T08:42:58.100618+0000","last_undegraded":"2024-09-19T08:42:58.100618+0000","last_fullsized":"2024-09-19T08:42:58.100618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:19.465342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:43:08.041763+0000","last_change":"2024-09-19T08:42:41.927561+0000","last_active":"2024-09-19T08:43:08.041763+0000","last_peered":"2024-09-19T08:43:08.041763+0000","last_clean":"2024-09-19T08:43:08.041763+0000","last_became_active":"2024-09-19T08:42:41.927159+0000","last_became_peered":"2024-09-19T08:42:41.927159+0000","last_unstale":"2024-09-19T08:43:08.041763+0000","last_undegraded":"2024-09-19T08:43:08.041763+0000","last_fullsized":"2024-09-19T08:43:08.041763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:13.352727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106277+0000","last_change":"2024-09-19T08:42:44.028129+0000","last_active":"2024-09-19T08:42:58.106277+0000","last_peered":"2024-09-19T08:42:58.106277+0000","last_clean":"2024-09-19T08:42:58.106277+0000","last_became_active":"2024-09-19T08:42:44.027826+0000","last_became_peered":"2024-09-19T08:42:44.027826+0000","last_unstale":"2024-09-19T08:42:58.106277+0000","last_undegraded":"2024-09-19T08:42:58.106277+0000","last_fullsized":"2024-09-19T08:42:58.106277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:03.129404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.102523+0000","last_change":"2024-09-19T08:42:41.920264+0000","last_active":"2024-09-19T08:42:58.102523+0000","last_peered":"2024-09-19T08:42:58.102523+0000","last_clean":"2024-09-19T08:42:58.102523+0000","last_became_active":"2024-09-19T08:42:41.919655+0000","last_became_peered":"2024-09-19T08:42:41.919655+0000","last_unstale":"2024-09-19T08:42:58.102523+0000","last_undegraded":"2024-09-19T08:42:58.102523+0000","last_fullsized":"2024-09-19T08:42:58.102523+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:58.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103052+0000","last_change":"2024-09-19T08:42:44.039655+0000","last_active":"2024-09-19T08:42:58.103052+0000","last_peered":"2024-09-19T08:42:58.103052+0000","last_clean":"2024-09-19T08:42:58.103052+0000","last_became_active":"2024-09-19T08:42:44.039317+0000","last_became_peered":"2024-09-19T08:42:44.039317+0000","last_unstale":"2024-09-19T08:42:58.103052+0000","last_undegraded":"2024-09-19T08:42:58.103052+0000","last_fullsized":"2024-09-19T08:42:58.103052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:19.064194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109199+0000","last_change":"2024-09-19T08:42:42.408582+0000","last_active":"2024-09-19T08:42:58.109199+0000","last_peered":"2024-09-19T08:42:58.109199+0000","last_clean":"2024-09-19T08:42:58.109199+0000","last_became_active":"2024-09-19T08:42:42.408143+0000","last_became_peered":"2024-09-19T08:42:42.408143+0000","last_unstale":"2024-09-19T08:42:58.109199+0000","last_undegraded":"2024-09-19T08:42:58.109199+0000","last_fullsized":"2024-09-19T08:42:58.109199+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.526138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.107333+0000","last_change":"2024-09-19T08:42:44.034795+0000","last_active":"2024-09-19T08:42:58.107333+0000","last_peered":"2024-09-19T08:42:58.107333+0000","last_clean":"2024-09-19T08:42:58.107333+0000","last_became_active":"2024-09-19T08:42:44.034440+0000","last_became_peered":"2024-09-19T08:42:44.034440+0000","last_unstale":"2024-09-19T08:42:58.107333+0000","last_undegraded":"2024-09-19T08:42:58.107333+0000","last_fullsized":"2024-09-19T08:42:58.107333+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:50.470240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104200+0000","last_change":"2024-09-19T08:42:41.922621+0000","last_active":"2024-09-19T08:42:58.104200+0000","last_peered":"2024-09-19T08:42:58.104200+0000","last_clean":"2024-09-19T08:42:58.104200+0000","last_became_active":"2024-09-19T08:42:41.922303+0000","last_became_peered":"2024-09-19T08:42:41.922303+0000","last_unstale":"2024-09-19T08:42:58.104200+0000","last_undegraded":"2024-09-19T08:42:58.104200+0000","last_fullsized":"2024-09-19T08:42:58.104200+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:48.017892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.101216+0000","last_change":"2024-09-19T08:42:44.028307+0000","last_active":"2024-09-19T08:42:58.101216+0000","last_peered":"2024-09-19T08:42:58.101216+0000","last_clean":"2024-09-19T08:42:58.101216+0000","last_became_active":"2024-09-19T08:42:44.026848+0000","last_became_peered":"2024-09-19T08:42:44.026848+0000","last_unstale":"2024-09-19T08:42:58.101216+0000","last_undegraded":"2024-09-19T08:42:58.101216+0000","last_fullsized":"2024-09-19T08:42:58.101216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:20.768075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103736+0000","last_change":"2024-09-19T08:42:41.929479+0000","last_active":"2024-09-19T08:42:58.103736+0000","last_peered":"2024-09-19T08:42:58.103736+0000","last_clean":"2024-09-19T08:42:58.103736+0000","last_became_active":"2024-09-19T08:42:41.928508+0000","last_became_peered":"2024-09-19T08:42:41.928508+0000","last_unstale":"2024-09-19T08:42:58.103736+0000","last_undegraded":"2024-09-19T08:42:58.103736+0000","last_fullsized":"2024-09-19T08:42:58.103736+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:46.108471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.104229+0000","last_change":"2024-09-19T08:42:44.028694+0000","last_active":"2024-09-19T08:42:58.104229+0000","last_peered":"2024-09-19T08:42:58.104229+0000","last_clean":"2024-09-19T08:42:58.104229+0000","last_became_active":"2024-09-19T08:42:44.027382+0000","last_became_peered":"2024-09-19T08:42:44.027382+0000","last_unstale":"2024-09-19T08:42:58.104229+0000","last_undegraded":"2024-09-19T08:42:58.104229+0000","last_fullsized":"2024-09-19T08:42:58.104229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:40.877505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108022+0000","last_change":"2024-09-19T08:42:41.931016+0000","last_active":"2024-09-19T08:42:58.108022+0000","last_peered":"2024-09-19T08:42:58.108022+0000","last_clean":"2024-09-19T08:42:58.108022+0000","last_became_active":"2024-09-19T08:42:41.930648+0000","last_became_peered":"2024-09-19T08:42:41.930648+0000","last_unstale":"2024-09-19T08:42:58.108022+0000","last_undegraded":"2024-09-19T08:42:58.108022+0000","last_fullsized":"2024-09-19T08:42:58.108022+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:32.031025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109744+0000","last_change":"2024-09-19T08:42:44.035288+0000","last_active":"2024-09-19T08:42:58.109744+0000","last_peered":"2024-09-19T08:42:58.109744+0000","last_clean":"2024-09-19T08:42:58.109744+0000","last_became_active":"2024-09-19T08:42:44.034660+0000","last_became_peered":"2024-09-19T08:42:44.034660+0000","last_unstale":"2024-09-19T08:42:58.109744+0000","last_undegraded":"2024-09-19T08:42:58.109744+0000","last_fullsized":"2024-09-19T08:42:58.109744+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:48.703463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105135+0000","last_change":"2024-09-19T08:42:44.040123+0000","last_active":"2024-09-19T08:42:58.105135+0000","last_peered":"2024-09-19T08:42:58.105135+0000","last_clean":"2024-09-19T08:42:58.105135+0000","last_became_active":"2024-09-19T08:42:44.039488+0000","last_became_peered":"2024-09-19T08:42:44.039488+0000","last_unstale":"2024-09-19T08:42:58.105135+0000","last_undegraded":"2024-09-19T08:42:58.105135+0000","last_fullsized":"2024-09-19T08:42:58.105135+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:15.273044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108182+0000","last_change":"2024-09-19T08:42:41.932400+0000","last_active":"2024-09-19T08:42:58.108182+0000","last_peered":"2024-09-19T08:42:58.108182+0000","last_clean":"2024-09-19T08:42:58.108182+0000","last_became_active":"2024-09-19T08:42:41.932020+0000","last_became_peered":"2024-09-19T08:42:41.932020+0000","last_unstale":"2024-09-19T08:42:58.108182+0000","last_undegraded":"2024-09-19T08:42:58.108182+0000","last_fullsized":"2024-09-19T08:42:58.108182+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:08.583287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.109186+0000","last_change":"2024-09-19T08:42:44.026173+0000","last_active":"2024-09-19T08:42:58.109186+0000","last_peered":"2024-09-19T08:42:58.109186+0000","last_clean":"2024-09-19T08:42:58.109186+0000","last_became_active":"2024-09-19T08:42:44.024614+0000","last_became_peered":"2024-09-19T08:42:44.024614+0000","last_unstale":"2024-09-19T08:42:58.109186+0000","last_undegraded":"2024-09-19T08:42:58.109186+0000","last_fullsized":"2024-09-19T08:42:58.109186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:42.695660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.108660+0000","last_change":"2024-09-19T08:42:41.929576+0000","last_active":"2024-09-19T08:42:58.108660+0000","last_peered":"2024-09-19T08:42:58.108660+0000","last_clean":"2024-09-19T08:42:58.108660+0000","last_became_active":"2024-09-19T08:42:41.929231+0000","last_became_peered":"2024-09-19T08:42:41.929231+0000","last_unstale":"2024-09-19T08:42:58.108660+0000","last_undegraded":"2024-09-19T08:42:58.108660+0000","last_fullsized":"2024-09-19T08:42:58.108660+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:54.492198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.103061+0000","last_change":"2024-09-19T08:42:44.028612+0000","last_active":"2024-09-19T08:42:58.103061+0000","last_peered":"2024-09-19T08:42:58.103061+0000","last_clean":"2024-09-19T08:42:58.103061+0000","last_became_active":"2024-09-19T08:42:44.028301+0000","last_became_peered":"2024-09-19T08:42:44.028301+0000","last_unstale":"2024-09-19T08:42:58.103061+0000","last_undegraded":"2024-09-19T08:42:58.103061+0000","last_fullsized":"2024-09-19T08:42:58.103061+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:03:09.539350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.106004+0000","last_change":"2024-09-19T08:42:42.407931+0000","last_active":"2024-09-19T08:42:58.106004+0000","last_peered":"2024-09-19T08:42:58.106004+0000","last_clean":"2024-09-19T08:42:58.106004+0000","last_became_active":"2024-09-19T08:42:42.407573+0000","last_became_peered":"2024-09-19T08:42:42.407573+0000","last_unstale":"2024-09-19T08:42:58.106004+0000","last_undegraded":"2024-09-19T08:42:58.106004+0000","last_fullsized":"2024-09-19T08:42:58.106004+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:55.095275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.105172+0000","last_change":"2024-09-19T08:42:44.034109+0000","last_active":"2024-09-19T08:42:58.105172+0000","last_peered":"2024-09-19T08:42:58.105172+0000","last_clean":"2024-09-19T08:42:58.105172+0000","last_became_active":"2024-09-19T08:42:44.033753+0000","last_became_peered":"2024-09-19T08:42:44.033753+0000","last_unstale":"2024-09-19T08:42:58.105172+0000","last_undegraded":"2024-09-19T08:42:58.105172+0000","last_fullsized":"2024-09-19T08:42:58.105172+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:08.475476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":48,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:42:58.120292+0000","last_change":"2024-09-19T08:42:58.120292+0000","last_active":"2024-09-19T08:42:58.120292+0000","last_peered":"2024-09-19T08:42:58.120292+0000","last_clean":"2024-09-19T08:42:58.120292+0000","last_became_active":"2024-09-19T08:42:58.109929+0000","last_became_peered":"2024-09-19T08:42:58.109929+0000","last_unstale":"2024-09-19T08:42:58.120292+0000","last_undegraded":"2024-09-19T08:42:58.120292+0000","last_fullsized":"2024-09-19T08:42:58.120292+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:56.196868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":358,"num_read_kb":247,"num_write":163,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1198,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":192480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579931,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":433265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808863,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32736,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712416,"statfs":{"total":95995035648,"available":95961513984,"internally_reserved":0,"allocated":1589248,"data_stored":1084287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939684,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":432885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168617,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":432805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397549,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1024548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561075,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":432274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790006,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1024421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953533,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":433686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215170,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40396,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704756,"statfs":{"total":95995035648,"available":95953670144,"internally_reserved":0,"allocated":913408,"data_stored":432585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444102,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":492958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":491831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":917504,"data_stored":433545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":60891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:43:52.023 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T08:43:52.023 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T08:43:52.023 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T08:43:52.023 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T08:43:52.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:51 smithi175 ceph-mon[35688]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:43:52.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:51 smithi175 ceph-mon[35688]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:43:52.295 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:52.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:51 smithi044 ceph-mon[35072]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:43:52.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:51 smithi044 ceph-mon[35072]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:43:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.770+0000 7feef7ab3640 1 -- 172.21.15.7:0/2958111667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feef01036e0 msgr2=0x7feef0107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.770+0000 7feef7ab3640 1 --2- 172.21.15.7:0/2958111667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feef01036e0 0x7feef0107b90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7feee0009930 tx=0x7feee002a420 comp rx=0 tx=0).stop 2024-09-19T08:43:52.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.770+0000 7feef7ab3640 1 -- 172.21.15.7:0/2958111667 shutdown_connections 2024-09-19T08:43:52.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.770+0000 7feef7ab3640 1 --2- 172.21.15.7:0/2958111667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feef01082a0 0x7feef010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:52.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.770+0000 7feef7ab3640 1 --2- 172.21.15.7:0/2958111667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feef01036e0 0x7feef0107b90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:52.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.770+0000 7feef7ab3640 1 --2- 172.21.15.7:0/2958111667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef0102d30 0x7feef0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:52.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.770+0000 7feef7ab3640 1 -- 172.21.15.7:0/2958111667 >> 172.21.15.7:0/2958111667 conn(0x7feef00fc7d0 msgr2=0x7feef00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:52.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.770+0000 7feef7ab3640 1 -- 172.21.15.7:0/2958111667 shutdown_connections 2024-09-19T08:43:52.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.770+0000 7feef7ab3640 1 -- 172.21.15.7:0/2958111667 wait complete. 2024-09-19T08:43:52.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.770+0000 7feef7ab3640 1 Processor -- start 2024-09-19T08:43:52.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.770+0000 7feef7ab3640 1 -- start start 2024-09-19T08:43:52.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.771+0000 7feef7ab3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feef0102d30 0x7feef0198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:52.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.771+0000 7feef7ab3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feef01036e0 0x7feef0198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:52.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.771+0000 7feef7ab3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef01082a0 0x7feef019cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:52.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.771+0000 7feef7ab3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feef01120c0 con 0x7feef0102d30 2024-09-19T08:43:52.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.771+0000 7feef7ab3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feef0111f40 con 0x7feef01082a0 2024-09-19T08:43:52.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.771+0000 7feef7ab3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feef0112240 con 0x7feef01036e0 2024-09-19T08:43:52.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.771+0000 7feef584f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feef0102d30 0x7feef0198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:52.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.771+0000 7feef584f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feef0102d30 0x7feef0198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55082/0 (socket says 172.21.15.7:55082) 2024-09-19T08:43:52.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.771+0000 7feef584f640 1 -- 172.21.15.7:0/1983967909 learned_addr learned my addr 172.21.15.7:0/1983967909 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:52.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.771+0000 7feef6050640 1 --2- 172.21.15.7:0/1983967909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef01082a0 0x7feef019cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:52.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.771+0000 7feef584f640 1 -- 172.21.15.7:0/1983967909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feef01036e0 msgr2=0x7feef0198b60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T08:43:52.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.771+0000 7feef584f640 1 --2- 172.21.15.7:0/1983967909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feef01036e0 0x7feef0198b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:52.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.771+0000 7feef584f640 1 -- 172.21.15.7:0/1983967909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef01082a0 msgr2=0x7feef019cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:52.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.771+0000 7feef584f640 1 --2- 172.21.15.7:0/1983967909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef01082a0 0x7feef019cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:52.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.771+0000 7feef584f640 1 -- 172.21.15.7:0/1983967909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef019d5d0 con 0x7feef0102d30 2024-09-19T08:43:52.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.771+0000 7feef6050640 1 --2- 172.21.15.7:0/1983967909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef01082a0 0x7feef019cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:43:52.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.771+0000 7feef584f640 1 --2- 172.21.15.7:0/1983967909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feef0102d30 0x7feef0198620 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7feeec00c890 tx=0x7feeec00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.771+0000 7feee6ffd640 1 -- 172.21.15.7:0/1983967909 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec004220 con 0x7feef0102d30 2024-09-19T08:43:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.771+0000 7feee6ffd640 1 -- 172.21.15.7:0/1983967909 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feeec0043c0 con 0x7feef0102d30 2024-09-19T08:43:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.771+0000 7feef7ab3640 1 -- 172.21.15.7:0/1983967909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feef019d8c0 con 0x7feef0102d30 2024-09-19T08:43:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.771+0000 7feee6ffd640 1 -- 172.21.15.7:0/1983967909 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec004a00 con 0x7feef0102d30 2024-09-19T08:43:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.771+0000 7feef7ab3640 1 -- 172.21.15.7:0/1983967909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feef01a51a0 con 0x7feef0102d30 2024-09-19T08:43:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.773+0000 7feef7ab3640 1 -- 172.21.15.7:0/1983967909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feef0103110 con 0x7feef0102d30 2024-09-19T08:43:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.774+0000 7feee6ffd640 1 -- 172.21.15.7:0/1983967909 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7feeec0079b0 con 0x7feef0102d30 2024-09-19T08:43:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.775+0000 7feee6ffd640 1 --2- 172.21.15.7:0/1983967909 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7feedc0a32d0 0x7feedc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.775+0000 7feef504e640 1 --2- 172.21.15.7:0/1983967909 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7feedc0a32d0 0x7feedc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.775+0000 7feee6ffd640 1 -- 172.21.15.7:0/1983967909 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7feeec0cfc90 con 0x7feef0102d30 2024-09-19T08:43:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.775+0000 7feef504e640 1 --2- 172.21.15.7:0/1983967909 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7feedc0a32d0 0x7feedc0a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feee002a940 tx=0x7feee0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:52.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.778+0000 7feee6ffd640 1 -- 172.21.15.7:0/1983967909 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feeec014030 con 0x7feef0102d30 2024-09-19T08:43:52.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.993+0000 7feef7ab3640 1 -- 172.21.15.7:0/1983967909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7feef0199980 con 0x7feef0102d30 2024-09-19T08:43:52.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.993+0000 7feee6ffd640 1 -- 172.21.15.7:0/1983967909 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7feeec09c810 con 0x7feef0102d30 2024-09-19T08:43:52.993 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:43:52.993 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T08:43:52.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.995+0000 7feef7ab3640 1 -- 172.21.15.7:0/1983967909 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7feedc0a32d0 msgr2=0x7feedc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:52.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.995+0000 7feef7ab3640 1 --2- 172.21.15.7:0/1983967909 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7feedc0a32d0 0x7feedc0a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feee002a940 tx=0x7feee0000bc0 comp rx=0 tx=0).stop 2024-09-19T08:43:52.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.995+0000 7feef7ab3640 1 -- 172.21.15.7:0/1983967909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feef0102d30 msgr2=0x7feef0198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:52.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.995+0000 7feef7ab3640 1 --2- 172.21.15.7:0/1983967909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feef0102d30 0x7feef0198620 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7feeec00c890 tx=0x7feeec00cd50 comp rx=0 tx=0).stop 2024-09-19T08:43:52.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.996+0000 7feef7ab3640 1 -- 172.21.15.7:0/1983967909 shutdown_connections 2024-09-19T08:43:52.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.996+0000 7feef7ab3640 1 --2- 172.21.15.7:0/1983967909 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7feedc0a32d0 0x7feedc0a5790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:52.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.996+0000 7feef7ab3640 1 --2- 172.21.15.7:0/1983967909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feef01082a0 0x7feef019cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:52.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.996+0000 7feef7ab3640 1 --2- 172.21.15.7:0/1983967909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feef01036e0 0x7feef0198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:52.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.996+0000 7feef7ab3640 1 --2- 172.21.15.7:0/1983967909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feef0102d30 0x7feef0198620 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:52.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.996+0000 7feef7ab3640 1 -- 172.21.15.7:0/1983967909 >> 172.21.15.7:0/1983967909 conn(0x7feef00fc7d0 msgr2=0x7feef0105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:52.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.996+0000 7feef7ab3640 1 -- 172.21.15.7:0/1983967909 shutdown_connections 2024-09-19T08:43:52.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:52.996+0000 7feef7ab3640 1 -- 172.21.15.7:0/1983967909 wait complete. 2024-09-19T08:43:53.580 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T08:43:53.581 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:43:53.836 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:54.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:53 smithi175 ceph-mon[35688]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:43:54.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:53 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1983967909' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T08:43:54.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:53 smithi007 ceph-mon[31221]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:43:54.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:53 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1983967909' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T08:43:54.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.270+0000 7fe087469640 1 -- 172.21.15.7:0/890787036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe080106f10 msgr2=0x7fe08010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:54.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.270+0000 7fe087469640 1 --2- 172.21.15.7:0/890787036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe080106f10 0x7fe08010ea90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe078009ca0 tx=0x7fe07802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.271+0000 7fe087469640 1 -- 172.21.15.7:0/890787036 shutdown_connections 2024-09-19T08:43:54.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.271+0000 7fe087469640 1 --2- 172.21.15.7:0/890787036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe080106f10 0x7fe08010ea90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.271+0000 7fe087469640 1 --2- 172.21.15.7:0/890787036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe080102790 0x7fe0801067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.271+0000 7fe087469640 1 --2- 172.21.15.7:0/890787036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe080101de0 0x7fe0801021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.271+0000 7fe087469640 1 -- 172.21.15.7:0/890787036 >> 172.21.15.7:0/890787036 conn(0x7fe0800fd8c0 msgr2=0x7fe0800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:54.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.271+0000 7fe087469640 1 -- 172.21.15.7:0/890787036 shutdown_connections 2024-09-19T08:43:54.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.271+0000 7fe087469640 1 -- 172.21.15.7:0/890787036 wait complete. 2024-09-19T08:43:54.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.271+0000 7fe087469640 1 Processor -- start 2024-09-19T08:43:54.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.271+0000 7fe087469640 1 -- start start 2024-09-19T08:43:54.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.271+0000 7fe087469640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe080101de0 0x7fe0800744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:54.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.271+0000 7fe087469640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe080102790 0x7fe080074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:54.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.271+0000 7fe087469640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe080106f10 0x7fe080074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:54.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.271+0000 7fe087469640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe080111f90 con 0x7fe080101de0 2024-09-19T08:43:54.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.271+0000 7fe087469640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe080111e10 con 0x7fe080106f10 2024-09-19T08:43:54.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.271+0000 7fe087469640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe080112110 con 0x7fe080102790 2024-09-19T08:43:54.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.272+0000 7fe085205640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe080101de0 0x7fe0800744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:54.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.272+0000 7fe085205640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe080101de0 0x7fe0800744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36990/0 (socket says 172.21.15.7:36990) 2024-09-19T08:43:54.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.272+0000 7fe085205640 1 -- 172.21.15.7:0/3887604103 learned_addr learned my addr 172.21.15.7:0/3887604103 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:54.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.272+0000 7fe085a06640 1 --2- 172.21.15.7:0/3887604103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe080106f10 0x7fe080074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:54.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.272+0000 7fe085205640 1 -- 172.21.15.7:0/3887604103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe080102790 msgr2=0x7fe080074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:54.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.272+0000 7fe085205640 1 --2- 172.21.15.7:0/3887604103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe080102790 0x7fe080074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.272+0000 7fe085205640 1 -- 172.21.15.7:0/3887604103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe080106f10 msgr2=0x7fe080074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:54.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.272+0000 7fe085205640 1 --2- 172.21.15.7:0/3887604103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe080106f10 0x7fe080074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.272+0000 7fe085205640 1 -- 172.21.15.7:0/3887604103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0801a6920 con 0x7fe080101de0 2024-09-19T08:43:54.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.272+0000 7fe085205640 1 --2- 172.21.15.7:0/3887604103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe080101de0 0x7fe0800744f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe07000b4a0 tx=0x7fe07000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:54.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.272+0000 7fe0767fc640 1 -- 172.21.15.7:0/3887604103 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe070014070 con 0x7fe080101de0 2024-09-19T08:43:54.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.272+0000 7fe087469640 1 -- 172.21.15.7:0/3887604103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0801a6c10 con 0x7fe080101de0 2024-09-19T08:43:54.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.272+0000 7fe0767fc640 1 -- 172.21.15.7:0/3887604103 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe070010af0 con 0x7fe080101de0 2024-09-19T08:43:54.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.272+0000 7fe0767fc640 1 -- 172.21.15.7:0/3887604103 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe070017d10 con 0x7fe080101de0 2024-09-19T08:43:54.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.272+0000 7fe087469640 1 -- 172.21.15.7:0/3887604103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0801a7100 con 0x7fe080101de0 2024-09-19T08:43:54.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.273+0000 7fe087469640 1 -- 172.21.15.7:0/3887604103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0801021c0 con 0x7fe080101de0 2024-09-19T08:43:54.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.275+0000 7fe0767fc640 1 -- 172.21.15.7:0/3887604103 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe070017070 con 0x7fe080101de0 2024-09-19T08:43:54.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.276+0000 7fe0767fc640 1 --2- 172.21.15.7:0/3887604103 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fe06c0a32d0 0x7fe06c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:54.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.276+0000 7fe084a04640 1 --2- 172.21.15.7:0/3887604103 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fe06c0a32d0 0x7fe06c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:54.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.276+0000 7fe0767fc640 1 -- 172.21.15.7:0/3887604103 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe0700ced60 con 0x7fe080101de0 2024-09-19T08:43:54.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.276+0000 7fe084a04640 1 --2- 172.21.15.7:0/3887604103 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fe06c0a32d0 0x7fe06c0a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe07c005fd0 tx=0x7fe07c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:54.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.280+0000 7fe0767fc640 1 -- 172.21.15.7:0/3887604103 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe07009ba30 con 0x7fe080101de0 2024-09-19T08:43:54.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:53 smithi044 ceph-mon[35072]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:43:54.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:53 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1983967909' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T08:43:54.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.496+0000 7fe087469640 1 -- 172.21.15.7:0/3887604103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe080075a20 con 0x7fe080101de0 2024-09-19T08:43:54.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.496+0000 7fe0767fc640 1 -- 172.21.15.7:0/3887604103 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11899 (secure 0 0 0) 0x7fe07009b330 con 0x7fe080101de0 2024-09-19T08:43:54.496 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:43:54.496 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"btime":"2024-09-19T08:42:56:086840+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:42:55.696739+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24458,24472,24491]},"id":1}]} 2024-09-19T08:43:54.497 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-19T08:43:54.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.498+0000 7fe087469640 1 -- 172.21.15.7:0/3887604103 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fe06c0a32d0 msgr2=0x7fe06c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:54.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.498+0000 7fe087469640 1 --2- 172.21.15.7:0/3887604103 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fe06c0a32d0 0x7fe06c0a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe07c005fd0 tx=0x7fe07c005850 comp rx=0 tx=0).stop 2024-09-19T08:43:54.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.498+0000 7fe087469640 1 -- 172.21.15.7:0/3887604103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe080101de0 msgr2=0x7fe0800744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:54.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.498+0000 7fe087469640 1 --2- 172.21.15.7:0/3887604103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe080101de0 0x7fe0800744f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe07000b4a0 tx=0x7fe07000b960 comp rx=0 tx=0).stop 2024-09-19T08:43:54.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.498+0000 7fe087469640 1 -- 172.21.15.7:0/3887604103 shutdown_connections 2024-09-19T08:43:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.498+0000 7fe087469640 1 --2- 172.21.15.7:0/3887604103 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fe06c0a32d0 0x7fe06c0a5790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.498+0000 7fe087469640 1 --2- 172.21.15.7:0/3887604103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe080106f10 0x7fe080074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.498+0000 7fe087469640 1 --2- 172.21.15.7:0/3887604103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe080102790 0x7fe080074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.498+0000 7fe087469640 1 --2- 172.21.15.7:0/3887604103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe080101de0 0x7fe0800744f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.498+0000 7fe087469640 1 -- 172.21.15.7:0/3887604103 >> 172.21.15.7:0/3887604103 conn(0x7fe0800fd8c0 msgr2=0x7fe0800fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:54.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.499+0000 7fe087469640 1 -- 172.21.15.7:0/3887604103 shutdown_connections 2024-09-19T08:43:54.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:54.499+0000 7fe087469640 1 -- 172.21.15.7:0/3887604103 wait complete. 2024-09-19T08:43:55.151 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:54 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3887604103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:43:55.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:54 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3887604103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:43:55.181 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:43:55.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:54 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3887604103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:43:55.438 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:55.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.904+0000 7fe30553c640 1 -- 172.21.15.7:0/613901785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe300102790 msgr2=0x7fe3001067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:55.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.904+0000 7fe30553c640 1 --2- 172.21.15.7:0/613901785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe300102790 0x7fe3001067e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009900 tx=0x7fe2e802a410 comp rx=0 tx=0).stop 2024-09-19T08:43:55.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.904+0000 7fe30553c640 1 -- 172.21.15.7:0/613901785 shutdown_connections 2024-09-19T08:43:55.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.904+0000 7fe30553c640 1 --2- 172.21.15.7:0/613901785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe300106f10 0x7fe30010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:55.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.904+0000 7fe30553c640 1 --2- 172.21.15.7:0/613901785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe300102790 0x7fe3001067e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:55.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.904+0000 7fe30553c640 1 --2- 172.21.15.7:0/613901785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe300101de0 0x7fe3001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:55.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.904+0000 7fe30553c640 1 -- 172.21.15.7:0/613901785 >> 172.21.15.7:0/613901785 conn(0x7fe3000fd8c0 msgr2=0x7fe3000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:55.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.905+0000 7fe30553c640 1 -- 172.21.15.7:0/613901785 shutdown_connections 2024-09-19T08:43:55.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.905+0000 7fe30553c640 1 -- 172.21.15.7:0/613901785 wait complete. 2024-09-19T08:43:55.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.906+0000 7fe30553c640 1 Processor -- start 2024-09-19T08:43:55.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.906+0000 7fe30553c640 1 -- start start 2024-09-19T08:43:55.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.906+0000 7fe30553c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe300101de0 0x7fe300198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.906+0000 7fe30553c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe300102790 0x7fe300198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.906+0000 7fe30553c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe300106f10 0x7fe30019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.906+0000 7fe30553c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe300111f70 con 0x7fe300106f10 2024-09-19T08:43:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.906+0000 7fe30553c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe300111df0 con 0x7fe300101de0 2024-09-19T08:43:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.906+0000 7fe30553c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe3001120f0 con 0x7fe300102790 2024-09-19T08:43:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.906+0000 7fe2ff7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe300106f10 0x7fe30019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.906+0000 7fe2feffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe300101de0 0x7fe300198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.906+0000 7fe2ff7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe300106f10 0x7fe30019cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37000/0 (socket says 172.21.15.7:37000) 2024-09-19T08:43:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.907+0000 7fe2feffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe300101de0 0x7fe300198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:48452/0 (socket says 172.21.15.7:48452) 2024-09-19T08:43:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.907+0000 7fe2ff7fe640 1 -- 172.21.15.7:0/3258589727 learned_addr learned my addr 172.21.15.7:0/3258589727 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.907+0000 7fe2f7fff640 1 --2- 172.21.15.7:0/3258589727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe300102790 0x7fe300198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.907+0000 7fe2ff7fe640 1 -- 172.21.15.7:0/3258589727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe300102790 msgr2=0x7fe300198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.907+0000 7fe2ff7fe640 1 --2- 172.21.15.7:0/3258589727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe300102790 0x7fe300198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.907+0000 7fe2ff7fe640 1 -- 172.21.15.7:0/3258589727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe300101de0 msgr2=0x7fe300198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.907+0000 7fe2ff7fe640 1 --2- 172.21.15.7:0/3258589727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe300101de0 0x7fe300198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.907+0000 7fe2ff7fe640 1 -- 172.21.15.7:0/3258589727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30019d400 con 0x7fe300106f10 2024-09-19T08:43:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.907+0000 7fe2f7fff640 1 --2- 172.21.15.7:0/3258589727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe300102790 0x7fe300198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:43:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.907+0000 7fe2ff7fe640 1 --2- 172.21.15.7:0/3258589727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe300106f10 0x7fe30019cd20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800cad0 tx=0x7fe2f800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.908+0000 7fe2fcff9640 1 -- 172.21.15.7:0/3258589727 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f800ad60 con 0x7fe300106f10 2024-09-19T08:43:55.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.908+0000 7fe2fcff9640 1 -- 172.21.15.7:0/3258589727 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2f8005020 con 0x7fe300106f10 2024-09-19T08:43:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.908+0000 7fe2fcff9640 1 -- 172.21.15.7:0/3258589727 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f800f6b0 con 0x7fe300106f10 2024-09-19T08:43:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.909+0000 7fe30553c640 1 -- 172.21.15.7:0/3258589727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30019d6f0 con 0x7fe300106f10 2024-09-19T08:43:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.909+0000 7fe30553c640 1 -- 172.21.15.7:0/3258589727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3001a4fd0 con 0x7fe300106f10 2024-09-19T08:43:55.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.910+0000 7fe30553c640 1 -- 172.21.15.7:0/3258589727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3001021c0 con 0x7fe300106f10 2024-09-19T08:43:55.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.911+0000 7fe2fcff9640 1 -- 172.21.15.7:0/3258589727 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe2f8005560 con 0x7fe300106f10 2024-09-19T08:43:55.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.911+0000 7fe2fcff9640 1 --2- 172.21.15.7:0/3258589727 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fe2ec0a3350 0x7fe2ec0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:55.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.911+0000 7fe2fcff9640 1 -- 172.21.15.7:0/3258589727 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe2f80cf9d0 con 0x7fe300106f10 2024-09-19T08:43:55.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.911+0000 7fe2feffd640 1 --2- 172.21.15.7:0/3258589727 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fe2ec0a3350 0x7fe2ec0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:55.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.912+0000 7fe2feffd640 1 --2- 172.21.15.7:0/3258589727 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fe2ec0a3350 0x7fe2ec0a5810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000abe0 tx=0x7fe2f000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:55.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:55.916+0000 7fe2fcff9640 1 -- 172.21.15.7:0/3258589727 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe2f8014030 con 0x7fe300106f10 2024-09-19T08:43:56.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:56.129+0000 7fe30553c640 1 -- 172.21.15.7:0/3258589727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe30002d7c0 con 0x7fe300106f10 2024-09-19T08:43:56.130 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:55 smithi007 ceph-mon[31221]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T08:43:56.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:56.130+0000 7fe2fcff9640 1 -- 172.21.15.7:0/3258589727 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11899 (secure 0 0 0) 0x7fe2f809c590 con 0x7fe300106f10 2024-09-19T08:43:56.130 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:43:56.131 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"btime":"2024-09-19T08:42:56:086840+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:42:55.696739+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24458,24472,24491]},"id":1}]} 2024-09-19T08:43:56.131 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-19T08:43:56.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:56.132+0000 7fe30553c640 1 -- 172.21.15.7:0/3258589727 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fe2ec0a3350 msgr2=0x7fe2ec0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:56.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:56.132+0000 7fe30553c640 1 --2- 172.21.15.7:0/3258589727 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fe2ec0a3350 0x7fe2ec0a5810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000abe0 tx=0x7fe2f000a2d0 comp rx=0 tx=0).stop 2024-09-19T08:43:56.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:56.132+0000 7fe30553c640 1 -- 172.21.15.7:0/3258589727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe300106f10 msgr2=0x7fe30019cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:56.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:56.132+0000 7fe30553c640 1 --2- 172.21.15.7:0/3258589727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe300106f10 0x7fe30019cd20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800cad0 tx=0x7fe2f800ced0 comp rx=0 tx=0).stop 2024-09-19T08:43:56.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:56.132+0000 7fe30553c640 1 -- 172.21.15.7:0/3258589727 shutdown_connections 2024-09-19T08:43:56.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:56.132+0000 7fe30553c640 1 --2- 172.21.15.7:0/3258589727 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fe2ec0a3350 0x7fe2ec0a5810 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:56.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:56.132+0000 7fe30553c640 1 --2- 172.21.15.7:0/3258589727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe300106f10 0x7fe30019cd20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:56.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:56.132+0000 7fe30553c640 1 --2- 172.21.15.7:0/3258589727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe300102790 0x7fe300198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:56.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:56.132+0000 7fe30553c640 1 --2- 172.21.15.7:0/3258589727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe300101de0 0x7fe300198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:56.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:56.132+0000 7fe30553c640 1 -- 172.21.15.7:0/3258589727 >> 172.21.15.7:0/3258589727 conn(0x7fe3000fd8c0 msgr2=0x7fe3000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:56.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:56.132+0000 7fe30553c640 1 -- 172.21.15.7:0/3258589727 shutdown_connections 2024-09-19T08:43:56.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:56.132+0000 7fe30553c640 1 -- 172.21.15.7:0/3258589727 wait complete. 2024-09-19T08:43:56.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:55 smithi175 ceph-mon[35688]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T08:43:56.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:55 smithi044 ceph-mon[35072]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T08:43:56.826 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:43:57.085 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:57.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:56 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3258589727' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:43:57.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:56 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3258589727' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:43:57.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:56 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3258589727' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:43:57.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.552+0000 7f02e090c640 1 -- 172.21.15.7:0/3457200287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02dc10c180 msgr2=0x7f02dc10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:57.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.552+0000 7f02e090c640 1 --2- 172.21.15.7:0/3457200287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02dc10c180 0x7f02dc10e610 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f02d4009900 tx=0x7f02d402a480 comp rx=0 tx=0).stop 2024-09-19T08:43:57.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.552+0000 7f02e090c640 1 -- 172.21.15.7:0/3457200287 shutdown_connections 2024-09-19T08:43:57.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.552+0000 7f02e090c640 1 --2- 172.21.15.7:0/3457200287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02dc10c180 0x7f02dc10e610 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:57.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.552+0000 7f02e090c640 1 --2- 172.21.15.7:0/3457200287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02dc103700 0x7f02dc10bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:57.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.552+0000 7f02e090c640 1 --2- 172.21.15.7:0/3457200287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02dc102de0 0x7f02dc1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:57.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.552+0000 7f02e090c640 1 -- 172.21.15.7:0/3457200287 >> 172.21.15.7:0/3457200287 conn(0x7f02dc0fc7a0 msgr2=0x7f02dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.552+0000 7f02e090c640 1 -- 172.21.15.7:0/3457200287 shutdown_connections 2024-09-19T08:43:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.552+0000 7f02e090c640 1 -- 172.21.15.7:0/3457200287 wait complete. 2024-09-19T08:43:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.553+0000 7f02e090c640 1 Processor -- start 2024-09-19T08:43:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.553+0000 7f02e090c640 1 -- start start 2024-09-19T08:43:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.553+0000 7f02e090c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02dc102de0 0x7f02dc198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.553+0000 7f02e090c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02dc103700 0x7f02dc198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.553+0000 7f02e090c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02dc10c180 0x7f02dc19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.553+0000 7f02e090c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc111fb0 con 0x7f02dc103700 2024-09-19T08:43:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.553+0000 7f02e090c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc111e30 con 0x7f02dc102de0 2024-09-19T08:43:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.553+0000 7f02e090c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc112130 con 0x7f02dc10c180 2024-09-19T08:43:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.553+0000 7f02d9d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02dc103700 0x7f02dc198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.554+0000 7f02d9d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02dc103700 0x7f02dc198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37018/0 (socket says 172.21.15.7:37018) 2024-09-19T08:43:57.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.554+0000 7f02d9d9b640 1 -- 172.21.15.7:0/1469163311 learned_addr learned my addr 172.21.15.7:0/1469163311 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:57.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.554+0000 7f02da59c640 1 --2- 172.21.15.7:0/1469163311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02dc102de0 0x7f02dc198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:57.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.554+0000 7f02d9d9b640 1 -- 172.21.15.7:0/1469163311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02dc10c180 msgr2=0x7f02dc19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:57.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.554+0000 7f02d9d9b640 1 --2- 172.21.15.7:0/1469163311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02dc10c180 0x7f02dc19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:57.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.554+0000 7f02d9d9b640 1 -- 172.21.15.7:0/1469163311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02dc102de0 msgr2=0x7f02dc198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:57.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.554+0000 7f02d9d9b640 1 --2- 172.21.15.7:0/1469163311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02dc102de0 0x7f02dc198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:57.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.554+0000 7f02d9d9b640 1 -- 172.21.15.7:0/1469163311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02dc19d400 con 0x7f02dc103700 2024-09-19T08:43:57.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.554+0000 7f02d9d9b640 1 --2- 172.21.15.7:0/1469163311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02dc103700 0x7f02dc198990 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f02d000b4a0 tx=0x7f02d000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:57.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.554+0000 7f02cb7fe640 1 -- 172.21.15.7:0/1469163311 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0014070 con 0x7f02dc103700 2024-09-19T08:43:57.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.554+0000 7f02cb7fe640 1 -- 172.21.15.7:0/1469163311 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02d0010af0 con 0x7f02dc103700 2024-09-19T08:43:57.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.554+0000 7f02e090c640 1 -- 172.21.15.7:0/1469163311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02dc19d6f0 con 0x7f02dc103700 2024-09-19T08:43:57.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.554+0000 7f02cb7fe640 1 -- 172.21.15.7:0/1469163311 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0017d10 con 0x7f02dc103700 2024-09-19T08:43:57.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.554+0000 7f02e090c640 1 -- 172.21.15.7:0/1469163311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02dc1a4fd0 con 0x7f02dc103700 2024-09-19T08:43:57.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.555+0000 7f02e090c640 1 -- 172.21.15.7:0/1469163311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02dc1031c0 con 0x7f02dc103700 2024-09-19T08:43:57.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.556+0000 7f02cb7fe640 1 -- 172.21.15.7:0/1469163311 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f02d0017070 con 0x7f02dc103700 2024-09-19T08:43:57.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.557+0000 7f02cb7fe640 1 --2- 172.21.15.7:0/1469163311 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f02c40a32d0 0x7f02c40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:57.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.557+0000 7f02da59c640 1 --2- 172.21.15.7:0/1469163311 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f02c40a32d0 0x7f02c40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:57.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.557+0000 7f02cb7fe640 1 -- 172.21.15.7:0/1469163311 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f02d00ceda0 con 0x7f02dc103700 2024-09-19T08:43:57.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.558+0000 7f02da59c640 1 --2- 172.21.15.7:0/1469163311 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f02c40a32d0 0x7f02c40a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f02cc005fd0 tx=0x7f02cc009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:57.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.561+0000 7f02cb7fe640 1 -- 172.21.15.7:0/1469163311 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f02d009ba30 con 0x7f02dc103700 2024-09-19T08:43:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.738+0000 7f02e090c640 1 -- 172.21.15.7:0/1469163311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02dc02d7c0 con 0x7f02dc103700 2024-09-19T08:43:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.739+0000 7f02cb7fe640 1 -- 172.21.15.7:0/1469163311 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22634 (secure 0 0 0) 0x7f02d009b330 con 0x7f02dc103700 2024-09-19T08:43:57.739 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:43:57.739 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":82,"fsid":"ebd23124-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:02.287380+0000","modified":"2024-09-19T08:42:58.097469+0000","last_up_change":"2024-09-19T08:41:54.742978+0000","last_in_change":"2024-09-19T08:41:31.685622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:13.285118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:42:40.425852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:42:43.006548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"837e6267-71c7-4f48-9e0b-4e3f124682b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6803","nonce":402668717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6805","nonce":402668717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6809","nonce":402668717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6807","nonce":402668717}]},"public_addr":"172.21.15.7:6803/402668717","cluster_addr":"172.21.15.7:6805/402668717","heartbeat_back_addr":"172.21.15.7:6809/402668717","heartbeat_front_addr":"172.21.15.7:6807/402668717","state":["exists","up"]},{"osd":1,"uuid":"67865372-ac22-4b30-bd02-498e118d6701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6801","nonce":2213694259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6803","nonce":2213694259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6807","nonce":2213694259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6805","nonce":2213694259}]},"public_addr":"172.21.15.44:6801/2213694259","cluster_addr":"172.21.15.44:6803/2213694259","heartbeat_back_addr":"172.21.15.44:6807/2213694259","heartbeat_front_addr":"172.21.15.44:6805/2213694259","state":["exists","up"]},{"osd":2,"uuid":"37c1cc2b-60ea-449f-baa7-c65d96c3559c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6801","nonce":3413002145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6803","nonce":3413002145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6807","nonce":3413002145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6805","nonce":3413002145}]},"public_addr":"172.21.15.175:6801/3413002145","cluster_addr":"172.21.15.175:6803/3413002145","heartbeat_back_addr":"172.21.15.175:6807/3413002145","heartbeat_front_addr":"172.21.15.175:6805/3413002145","state":["exists","up"]},{"osd":3,"uuid":"a8ffd2ae-4211-492a-a8ac-d4d6cbb4a03d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6811","nonce":2528867083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6813","nonce":2528867083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6817","nonce":2528867083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6815","nonce":2528867083}]},"public_addr":"172.21.15.7:6811/2528867083","cluster_addr":"172.21.15.7:6813/2528867083","heartbeat_back_addr":"172.21.15.7:6817/2528867083","heartbeat_front_addr":"172.21.15.7:6815/2528867083","state":["exists","up"]},{"osd":4,"uuid":"9a67b2ec-1a0a-413e-bd13-9532f24a0155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6809","nonce":3537143774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537143774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537143774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537143774}]},"public_addr":"172.21.15.44:6809/3537143774","cluster_addr":"172.21.15.44:6811/3537143774","heartbeat_back_addr":"172.21.15.44:6815/3537143774","heartbeat_front_addr":"172.21.15.44:6813/3537143774","state":["exists","up"]},{"osd":5,"uuid":"436cd596-710b-48e2-8255-8427c93cee1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6809","nonce":4001214751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6811","nonce":4001214751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6815","nonce":4001214751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6813","nonce":4001214751}]},"public_addr":"172.21.15.175:6809/4001214751","cluster_addr":"172.21.15.175:6811/4001214751","heartbeat_back_addr":"172.21.15.175:6815/4001214751","heartbeat_front_addr":"172.21.15.175:6813/4001214751","state":["exists","up"]},{"osd":6,"uuid":"f5a7ad2b-6b44-4b5a-8af7-f7fb00e7ca68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6819","nonce":1261079202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6821","nonce":1261079202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6825","nonce":1261079202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6823","nonce":1261079202}]},"public_addr":"172.21.15.7:6819/1261079202","cluster_addr":"172.21.15.7:6821/1261079202","heartbeat_back_addr":"172.21.15.7:6825/1261079202","heartbeat_front_addr":"172.21.15.7:6823/1261079202","state":["exists","up"]},{"osd":7,"uuid":"aa24aee5-6449-4842-8831-1c8e06cde75b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6817","nonce":3120822957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6819","nonce":3120822957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6823","nonce":3120822957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6821","nonce":3120822957}]},"public_addr":"172.21.15.44:6817/3120822957","cluster_addr":"172.21.15.44:6819/3120822957","heartbeat_back_addr":"172.21.15.44:6823/3120822957","heartbeat_front_addr":"172.21.15.44:6821/3120822957","state":["exists","up"]},{"osd":8,"uuid":"d912501a-bb7a-489e-b6ab-e451fb22210d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6817","nonce":2080374927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6819","nonce":2080374927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6823","nonce":2080374927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6821","nonce":2080374927}]},"public_addr":"172.21.15.175:6817/2080374927","cluster_addr":"172.21.15.175:6819/2080374927","heartbeat_back_addr":"172.21.15.175:6823/2080374927","heartbeat_front_addr":"172.21.15.175:6821/2080374927","state":["exists","up"]},{"osd":9,"uuid":"d132f5b2-75b9-4d6c-89ec-f52c303e0fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6827","nonce":3808356432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6829","nonce":3808356432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6833","nonce":3808356432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6831","nonce":3808356432}]},"public_addr":"172.21.15.7:6827/3808356432","cluster_addr":"172.21.15.7:6829/3808356432","heartbeat_back_addr":"172.21.15.7:6833/3808356432","heartbeat_front_addr":"172.21.15.7:6831/3808356432","state":["exists","up"]},{"osd":10,"uuid":"f6c405d6-a255-4e0e-8528-7bbc16d5e434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6825","nonce":4009464689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6827","nonce":4009464689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6831","nonce":4009464689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6829","nonce":4009464689}]},"public_addr":"172.21.15.44:6825/4009464689","cluster_addr":"172.21.15.44:6827/4009464689","heartbeat_back_addr":"172.21.15.44:6831/4009464689","heartbeat_front_addr":"172.21.15.44:6829/4009464689","state":["exists","up"]},{"osd":11,"uuid":"a2a046cd-9939-473a-988b-6e0ad28a0233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6825","nonce":4173951310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6827","nonce":4173951310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6831","nonce":4173951310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6829","nonce":4173951310}]},"public_addr":"172.21.15.175:6825/4173951310","cluster_addr":"172.21.15.175:6827/4173951310","heartbeat_back_addr":"172.21.15.175:6831/4173951310","heartbeat_front_addr":"172.21.15.175:6829/4173951310","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:20.015497+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:44.967046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:09.682080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:35.516899+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:00.705686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:25.276387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:49.927456+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:14.786755+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:38.553913+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.962825+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.812976+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:52.837744+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6800/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/2884903597":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/4058698573":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/1429582340":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6800/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/816886708":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/4277640815":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/2695884066":"2024-09-20T08:35:31.711540+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:43:57.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.742+0000 7f02e090c640 1 -- 172.21.15.7:0/1469163311 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f02c40a32d0 msgr2=0x7f02c40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:57.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.742+0000 7f02e090c640 1 --2- 172.21.15.7:0/1469163311 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f02c40a32d0 0x7f02c40a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f02cc005fd0 tx=0x7f02cc009680 comp rx=0 tx=0).stop 2024-09-19T08:43:57.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.742+0000 7f02e090c640 1 -- 172.21.15.7:0/1469163311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02dc103700 msgr2=0x7f02dc198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:57.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.742+0000 7f02e090c640 1 --2- 172.21.15.7:0/1469163311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02dc103700 0x7f02dc198990 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f02d000b4a0 tx=0x7f02d000b960 comp rx=0 tx=0).stop 2024-09-19T08:43:57.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.742+0000 7f02e090c640 1 -- 172.21.15.7:0/1469163311 shutdown_connections 2024-09-19T08:43:57.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.742+0000 7f02e090c640 1 --2- 172.21.15.7:0/1469163311 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f02c40a32d0 0x7f02c40a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:57.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.742+0000 7f02e090c640 1 --2- 172.21.15.7:0/1469163311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02dc10c180 0x7f02dc19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:57.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.742+0000 7f02e090c640 1 --2- 172.21.15.7:0/1469163311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02dc103700 0x7f02dc198990 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:57.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.742+0000 7f02e090c640 1 --2- 172.21.15.7:0/1469163311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02dc102de0 0x7f02dc198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:57.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.742+0000 7f02e090c640 1 -- 172.21.15.7:0/1469163311 >> 172.21.15.7:0/1469163311 conn(0x7f02dc0fc7a0 msgr2=0x7f02dc0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:57.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.742+0000 7f02e090c640 1 -- 172.21.15.7:0/1469163311 shutdown_connections 2024-09-19T08:43:57.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:57.742+0000 7f02e090c640 1 -- 172.21.15.7:0/1469163311 wait complete. 2024-09-19T08:43:58.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:57 smithi007 ceph-mon[31221]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:43:58.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:57 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1469163311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:58.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:57 smithi175 ceph-mon[35688]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:43:58.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:57 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1469163311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:58.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:57 smithi044 ceph-mon[35072]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:43:58.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:57 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1469163311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:43:58.365 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:43:58.621 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:59.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.117+0000 7fa336aa1640 1 -- 172.21.15.7:0/428617035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa330101de0 msgr2=0x7fa3301021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:59.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.117+0000 7fa336aa1640 1 --2- 172.21.15.7:0/428617035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa330101de0 0x7fa3301021c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009900 tx=0x7fa32c02a410 comp rx=0 tx=0).stop 2024-09-19T08:43:59.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.117+0000 7fa336aa1640 1 -- 172.21.15.7:0/428617035 shutdown_connections 2024-09-19T08:43:59.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.117+0000 7fa336aa1640 1 --2- 172.21.15.7:0/428617035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa330106f10 0x7fa33010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:59.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.117+0000 7fa336aa1640 1 --2- 172.21.15.7:0/428617035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa330102790 0x7fa3301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:59.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.117+0000 7fa336aa1640 1 --2- 172.21.15.7:0/428617035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa330101de0 0x7fa3301021c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:59.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.117+0000 7fa336aa1640 1 -- 172.21.15.7:0/428617035 >> 172.21.15.7:0/428617035 conn(0x7fa3300fd8c0 msgr2=0x7fa3300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:59.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.117+0000 7fa336aa1640 1 -- 172.21.15.7:0/428617035 shutdown_connections 2024-09-19T08:43:59.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.117+0000 7fa336aa1640 1 -- 172.21.15.7:0/428617035 wait complete. 2024-09-19T08:43:59.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.118+0000 7fa336aa1640 1 Processor -- start 2024-09-19T08:43:59.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.118+0000 7fa336aa1640 1 -- start start 2024-09-19T08:43:59.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.118+0000 7fa336aa1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa330101de0 0x7fa3301984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:59.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.118+0000 7fa336aa1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa330102790 0x7fa3301989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:59.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.118+0000 7fa336aa1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa330106f10 0x7fa33019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:59.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.118+0000 7fa336aa1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa330111f70 con 0x7fa330101de0 2024-09-19T08:43:59.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.118+0000 7fa336aa1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa330111df0 con 0x7fa330106f10 2024-09-19T08:43:59.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.118+0000 7fa336aa1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa3301120f0 con 0x7fa330102790 2024-09-19T08:43:59.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.118+0000 7fa33483d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa330101de0 0x7fa3301984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:59.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.118+0000 7fa33483d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa330101de0 0x7fa3301984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37028/0 (socket says 172.21.15.7:37028) 2024-09-19T08:43:59.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.118+0000 7fa33483d640 1 -- 172.21.15.7:0/110441273 learned_addr learned my addr 172.21.15.7:0/110441273 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:43:59.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.118+0000 7fa33503e640 1 --2- 172.21.15.7:0/110441273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa330106f10 0x7fa33019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:59.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.118+0000 7fa327fff640 1 --2- 172.21.15.7:0/110441273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa330102790 0x7fa3301989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:59.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.119+0000 7fa33483d640 1 -- 172.21.15.7:0/110441273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa330102790 msgr2=0x7fa3301989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:59.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.119+0000 7fa33483d640 1 --2- 172.21.15.7:0/110441273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa330102790 0x7fa3301989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:59.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.119+0000 7fa33483d640 1 -- 172.21.15.7:0/110441273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa330106f10 msgr2=0x7fa33019cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:59.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.119+0000 7fa33483d640 1 --2- 172.21.15.7:0/110441273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa330106f10 0x7fa33019cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:59.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.119+0000 7fa33483d640 1 -- 172.21.15.7:0/110441273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33019d460 con 0x7fa330101de0 2024-09-19T08:43:59.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.119+0000 7fa33503e640 1 --2- 172.21.15.7:0/110441273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa330106f10 0x7fa33019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:43:59.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.119+0000 7fa33483d640 1 --2- 172.21.15.7:0/110441273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa330101de0 0x7fa3301984b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa32c006010 tx=0x7fa32c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:59.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.119+0000 7fa325ffb640 1 -- 172.21.15.7:0/110441273 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c03f030 con 0x7fa330101de0 2024-09-19T08:43:59.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.119+0000 7fa325ffb640 1 -- 172.21.15.7:0/110441273 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa32c004440 con 0x7fa330101de0 2024-09-19T08:43:59.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.119+0000 7fa336aa1640 1 -- 172.21.15.7:0/110441273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa33019d6f0 con 0x7fa330101de0 2024-09-19T08:43:59.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.119+0000 7fa325ffb640 1 -- 172.21.15.7:0/110441273 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c035070 con 0x7fa330101de0 2024-09-19T08:43:59.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.119+0000 7fa336aa1640 1 -- 172.21.15.7:0/110441273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3301a5030 con 0x7fa330101de0 2024-09-19T08:43:59.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.120+0000 7fa336aa1640 1 -- 172.21.15.7:0/110441273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3301021c0 con 0x7fa330101de0 2024-09-19T08:43:59.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.121+0000 7fa325ffb640 1 -- 172.21.15.7:0/110441273 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fa32c042030 con 0x7fa330101de0 2024-09-19T08:43:59.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.122+0000 7fa325ffb640 1 --2- 172.21.15.7:0/110441273 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fa3180a3350 0x7fa3180a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:59.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.122+0000 7fa327fff640 1 --2- 172.21.15.7:0/110441273 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fa3180a3350 0x7fa3180a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:59.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.122+0000 7fa325ffb640 1 -- 172.21.15.7:0/110441273 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa32c0efed0 con 0x7fa330101de0 2024-09-19T08:43:59.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.122+0000 7fa327fff640 1 --2- 172.21.15.7:0/110441273 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fa3180a3350 0x7fa3180a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa3300fdd00 tx=0x7fa320005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:59.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.126+0000 7fa325ffb640 1 -- 172.21.15.7:0/110441273 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa32c0bca90 con 0x7fa330101de0 2024-09-19T08:43:59.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.340+0000 7fa336aa1640 1 -- 172.21.15.7:0/110441273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa33010a0f0 con 0x7fa330101de0 2024-09-19T08:43:59.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.341+0000 7fa325ffb640 1 -- 172.21.15.7:0/110441273 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11899 (secure 0 0 0) 0x7fa32c0bc390 con 0x7fa330101de0 2024-09-19T08:43:59.341 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:43:59.341 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"btime":"2024-09-19T08:42:56:086840+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:42:55.696739+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24458,24472,24491]},"id":1}]} 2024-09-19T08:43:59.341 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-19T08:43:59.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.343+0000 7fa336aa1640 1 -- 172.21.15.7:0/110441273 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fa3180a3350 msgr2=0x7fa3180a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:59.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.343+0000 7fa336aa1640 1 --2- 172.21.15.7:0/110441273 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fa3180a3350 0x7fa3180a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa3300fdd00 tx=0x7fa320005f90 comp rx=0 tx=0).stop 2024-09-19T08:43:59.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.343+0000 7fa336aa1640 1 -- 172.21.15.7:0/110441273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa330101de0 msgr2=0x7fa3301984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:59.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.343+0000 7fa336aa1640 1 --2- 172.21.15.7:0/110441273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa330101de0 0x7fa3301984b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa32c006010 tx=0x7fa32c004040 comp rx=0 tx=0).stop 2024-09-19T08:43:59.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.343+0000 7fa336aa1640 1 -- 172.21.15.7:0/110441273 shutdown_connections 2024-09-19T08:43:59.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.343+0000 7fa336aa1640 1 --2- 172.21.15.7:0/110441273 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fa3180a3350 0x7fa3180a5810 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:59.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.343+0000 7fa336aa1640 1 --2- 172.21.15.7:0/110441273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa330106f10 0x7fa33019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:59.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.343+0000 7fa336aa1640 1 --2- 172.21.15.7:0/110441273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa330102790 0x7fa3301989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:59.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.343+0000 7fa336aa1640 1 --2- 172.21.15.7:0/110441273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa330101de0 0x7fa3301984b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:59.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.343+0000 7fa336aa1640 1 -- 172.21.15.7:0/110441273 >> 172.21.15.7:0/110441273 conn(0x7fa3300fd8c0 msgr2=0x7fa3300fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:59.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.343+0000 7fa336aa1640 1 -- 172.21.15.7:0/110441273 shutdown_connections 2024-09-19T08:43:59.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:43:59.343+0000 7fa336aa1640 1 -- 172.21.15.7:0/110441273 wait complete. 2024-09-19T08:43:59.990 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:59 smithi007 ceph-mon[31221]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:43:59.990 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:43:59 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/110441273' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:00.019 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T08:42:44.586692+0000', 'modified': '2024-09-19T08:42:55.696739+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24491, 'mds_1': 24472, 'mds_2': 24458}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24443': {'gid': 24443, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6835/2261554115', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 2261554115}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 2261554115}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24445': {'gid': 24445, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6835/1285566250', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 1285566250}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 1285566250}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6837/2128553811', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 2128553811}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 2128553811}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24458': {'gid': 24458, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.44:6837/1232834466', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6836', 'nonce': 1232834466}, {'type': 'v1', 'addr': '172.21.15.44:6837', 'nonce': 1232834466}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.175:6839/3928264317', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6838', 'nonce': 3928264317}, {'type': 'v1', 'addr': '172.21.15.175:6839', 'nonce': 3928264317}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24491': {'gid': 24491, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.44:6839/1737549475', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6838', 'nonce': 1737549475}, {'type': 'v1', 'addr': '172.21.15.44:6839', 'nonce': 1737549475}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24491, 'qdb_cluster': [24458, 24472, 24491]} 2024-09-19T08:44:00.020 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T08:44:00.020 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T08:44:00.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:59 smithi175 ceph-mon[35688]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:44:00.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:43:59 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/110441273' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:00.275 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:00.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:59 smithi044 ceph-mon[35072]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:44:00.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:43:59 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/110441273' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:00.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.735+0000 7f926a91c640 1 -- 172.21.15.7:0/3341108149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f926410c170 msgr2=0x7f926410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:00.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.735+0000 7f926a91c640 1 --2- 172.21.15.7:0/3341108149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f926410c170 0x7f926410e610 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f925c009ca0 tx=0x7f925c02a950 comp rx=0 tx=0).stop 2024-09-19T08:44:00.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.735+0000 7f926a91c640 1 -- 172.21.15.7:0/3341108149 shutdown_connections 2024-09-19T08:44:00.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.735+0000 7f926a91c640 1 --2- 172.21.15.7:0/3341108149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f926410c170 0x7f926410e610 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.735+0000 7f926a91c640 1 --2- 172.21.15.7:0/3341108149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9264103660 0x7f926410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.735+0000 7f926a91c640 1 --2- 172.21.15.7:0/3341108149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9264102d40 0x7f9264103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.735+0000 7f926a91c640 1 -- 172.21.15.7:0/3341108149 >> 172.21.15.7:0/3341108149 conn(0x7f92640fc7a0 msgr2=0x7f92640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:00.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.735+0000 7f926a91c640 1 -- 172.21.15.7:0/3341108149 shutdown_connections 2024-09-19T08:44:00.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.735+0000 7f926a91c640 1 -- 172.21.15.7:0/3341108149 wait complete. 2024-09-19T08:44:00.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.735+0000 7f926a91c640 1 Processor -- start 2024-09-19T08:44:00.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.735+0000 7f926a91c640 1 -- start start 2024-09-19T08:44:00.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.736+0000 7f926a91c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9264102d40 0x7f92641009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:00.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.736+0000 7f926a91c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9264103660 0x7f9264100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:00.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.736+0000 7f926a91c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f926410c170 0x7f9264101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:00.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.736+0000 7f926a91c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9264111f30 con 0x7f926410c170 2024-09-19T08:44:00.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.736+0000 7f926a91c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9264111db0 con 0x7f9264103660 2024-09-19T08:44:00.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.736+0000 7f926a91c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f92641120b0 con 0x7f9264102d40 2024-09-19T08:44:00.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.736+0000 7f9268eb9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f926410c170 0x7f9264101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:00.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.736+0000 7f9268eb9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f926410c170 0x7f9264101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37050/0 (socket says 172.21.15.7:37050) 2024-09-19T08:44:00.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.736+0000 7f9268eb9640 1 -- 172.21.15.7:0/1841559276 learned_addr learned my addr 172.21.15.7:0/1841559276 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:00.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.736+0000 7f925bfff640 1 --2- 172.21.15.7:0/1841559276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9264103660 0x7f9264100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:00.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.736+0000 7f9263fff640 1 --2- 172.21.15.7:0/1841559276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9264102d40 0x7f92641009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:00.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.736+0000 7f9268eb9640 1 -- 172.21.15.7:0/1841559276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9264102d40 msgr2=0x7f92641009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:00.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.736+0000 7f9268eb9640 1 --2- 172.21.15.7:0/1841559276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9264102d40 0x7f92641009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.736+0000 7f9268eb9640 1 -- 172.21.15.7:0/1841559276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9264103660 msgr2=0x7f9264100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:00.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.736+0000 7f9268eb9640 1 --2- 172.21.15.7:0/1841559276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9264103660 0x7f9264100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.736+0000 7f9268eb9640 1 -- 172.21.15.7:0/1841559276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92641a68a0 con 0x7f926410c170 2024-09-19T08:44:00.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.736+0000 7f9268eb9640 1 --2- 172.21.15.7:0/1841559276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f926410c170 0x7f9264101420 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f925c02ae70 tx=0x7f925c02f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:00.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.736+0000 7f9261ffb640 1 -- 172.21.15.7:0/1841559276 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c034040 con 0x7f926410c170 2024-09-19T08:44:00.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.737+0000 7f9261ffb640 1 -- 172.21.15.7:0/1841559276 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f925c030920 con 0x7f926410c170 2024-09-19T08:44:00.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.737+0000 7f9261ffb640 1 -- 172.21.15.7:0/1841559276 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c045480 con 0x7f926410c170 2024-09-19T08:44:00.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.737+0000 7f926a91c640 1 -- 172.21.15.7:0/1841559276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92641a6b30 con 0x7f926410c170 2024-09-19T08:44:00.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.737+0000 7f926a91c640 1 -- 172.21.15.7:0/1841559276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92641a7060 con 0x7f926410c170 2024-09-19T08:44:00.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.739+0000 7f9261ffb640 1 -- 172.21.15.7:0/1841559276 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f925c037020 con 0x7f926410c170 2024-09-19T08:44:00.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.739+0000 7f926ccf5740 1 Processor -- start 2024-09-19T08:44:00.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.739+0000 7f926ccf5740 1 -- start start 2024-09-19T08:44:00.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.739+0000 7f926ccf5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594c46b29d0 0x5594c46b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:00.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.739+0000 7f926ccf5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594c46b32f0 0x5594c46bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:00.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.739+0000 7f926ccf5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46bdbb0 0x5594c46bffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:00.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.739+0000 7f926ccf5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5594c4619090 con 0x5594c46bdbb0 2024-09-19T08:44:00.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.739+0000 7f926ccf5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5594c45c0a70 con 0x5594c46b29d0 2024-09-19T08:44:00.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.739+0000 7f926ccf5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5594c4615050 con 0x5594c46b32f0 2024-09-19T08:44:00.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.740+0000 7f9261ffb640 1 --2- 172.21.15.7:0/1841559276 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f92500a3350 0x7f92500a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:00.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.740+0000 7f925bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46bdbb0 0x5594c46bffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:00.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.740+0000 7f925bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46bdbb0 0x5594c46bffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37056/0 (socket says 172.21.15.7:37056) 2024-09-19T08:44:00.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.740+0000 7f925bfff640 1 -- 172.21.15.7:0/241327477 learned_addr learned my addr 172.21.15.7:0/241327477 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:00.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.740+0000 7f9268eb9640 1 --2- 172.21.15.7:0/1841559276 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f92500a3350 0x7f92500a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:00.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.740+0000 7f925bfff640 1 --2- 172.21.15.7:0/241327477 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594c46b29d0 0x5594c46b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:00.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.740+0000 7f9263fff640 1 --2- 172.21.15.7:0/241327477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594c46b32f0 0x5594c46bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:00.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.740+0000 7f9261ffb640 1 -- 172.21.15.7:0/1841559276 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f925c0f0890 con 0x7f926410c170 2024-09-19T08:44:00.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.740+0000 7f925bfff640 1 -- 172.21.15.7:0/241327477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594c46b32f0 msgr2=0x5594c46bd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:00.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.740+0000 7f925bfff640 1 --2- 172.21.15.7:0/241327477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594c46b32f0 0x5594c46bd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.740+0000 7f925bfff640 1 -- 172.21.15.7:0/241327477 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594c46b29d0 msgr2=0x5594c46b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:00.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.740+0000 7f925bfff640 1 --2- 172.21.15.7:0/241327477 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594c46b29d0 0x5594c46b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.740+0000 7f925bfff640 1 -- 172.21.15.7:0/241327477 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594c45cd130 con 0x5594c46bdbb0 2024-09-19T08:44:00.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.740+0000 7f9268eb9640 1 --2- 172.21.15.7:0/1841559276 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f92500a3350 0x7f92500a5810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f925c0b9830 tx=0x7f925c0dd040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:00.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.740+0000 7f925bfff640 1 --2- 172.21.15.7:0/241327477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46bdbb0 0x5594c46bffa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f924c00bfa0 tx=0x7f924c00b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a30da2231c028ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:00.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.740+0000 7f925a7fc640 1 -- 172.21.15.7:0/241327477 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924c01d5f0 con 0x5594c46bdbb0 2024-09-19T08:44:00.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.740+0000 7f925a7fc640 1 -- 172.21.15.7:0/241327477 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f924c010910 con 0x5594c46bdbb0 2024-09-19T08:44:00.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.740+0000 7f925a7fc640 1 -- 172.21.15.7:0/241327477 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924c01c800 con 0x5594c46bdbb0 2024-09-19T08:44:00.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.741+0000 7f926ccf5740 1 -- 172.21.15.7:0/241327477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46bdbb0 msgr2=0x5594c46bffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:00.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.741+0000 7f926ccf5740 1 --2- 172.21.15.7:0/241327477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46bdbb0 0x5594c46bffa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f924c00bfa0 tx=0x7f924c00b7a0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.741+0000 7f926ccf5740 1 -- 172.21.15.7:0/241327477 shutdown_connections 2024-09-19T08:44:00.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.741+0000 7f926ccf5740 1 --2- 172.21.15.7:0/241327477 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46bdbb0 0x5594c46bffa0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.741+0000 7f926ccf5740 1 --2- 172.21.15.7:0/241327477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594c46b32f0 0x5594c46bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.741+0000 7f926ccf5740 1 --2- 172.21.15.7:0/241327477 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594c46b29d0 0x5594c46b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.741+0000 7f926ccf5740 1 -- 172.21.15.7:0/241327477 >> 172.21.15.7:0/241327477 conn(0x5594c46aef60 msgr2=0x5594c46af340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:00.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.741+0000 7f926ccf5740 1 -- 172.21.15.7:0/241327477 shutdown_connections 2024-09-19T08:44:00.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.741+0000 7f926ccf5740 1 -- 172.21.15.7:0/241327477 wait complete. 2024-09-19T08:44:00.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.741+0000 7f926ccf5740 1 -- start start 2024-09-19T08:44:00.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.742+0000 7f926ccf5740 1 Processor -- start 2024-09-19T08:44:00.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.742+0000 7f926ccf5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46b29d0 0x5594c46bd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:00.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.742+0000 7f926ccf5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594c46b32f0 0x5594c46ba780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:00.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.742+0000 7f926ccf5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594c46bdbb0 0x5594c46bacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:00.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.742+0000 7f926ccf5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5594c46c0780 con 0x5594c46b29d0 2024-09-19T08:44:00.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.742+0000 7f926ccf5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5594c45d3f20 con 0x5594c46b32f0 2024-09-19T08:44:00.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.742+0000 7f926ccf5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5594c46c0900 con 0x5594c46bdbb0 2024-09-19T08:44:00.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.742+0000 7f926ccf5740 10 client.0 _ll_register_callbacks cb 0x5594c459d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:44:00.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.742+0000 7f925bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46b29d0 0x5594c46bd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:00.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.742+0000 7f925bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46b29d0 0x5594c46bd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37072/0 (socket says 172.21.15.7:37072) 2024-09-19T08:44:00.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.742+0000 7f925bfff640 1 -- 172.21.15.7:0/2806685372 learned_addr learned my addr 172.21.15.7:0/2806685372 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:00.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.742+0000 7f9263fff640 1 --2- 172.21.15.7:0/2806685372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594c46b32f0 0x5594c46ba780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:00.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.742+0000 7f925bfff640 1 -- 172.21.15.7:0/2806685372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594c46bdbb0 msgr2=0x5594c46bacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:00.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.742+0000 7f925bfff640 1 --2- 172.21.15.7:0/2806685372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594c46bdbb0 0x5594c46bacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.742+0000 7f925bfff640 1 -- 172.21.15.7:0/2806685372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594c46b32f0 msgr2=0x5594c46ba780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:00.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.742+0000 7f925bfff640 1 --2- 172.21.15.7:0/2806685372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594c46b32f0 0x5594c46ba780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.742+0000 7f925bfff640 1 -- 172.21.15.7:0/2806685372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594c438a2b0 con 0x5594c46b29d0 2024-09-19T08:44:00.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.743+0000 7f925bfff640 1 --2- 172.21.15.7:0/2806685372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46b29d0 0x5594c46bd430 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f924c012fd0 tx=0x7f924c010b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e10ef635b77f48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:00.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.743+0000 7f92437fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:44:00.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.743+0000 7f92437fe640 1 -- 172.21.15.7:0/2806685372 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924c02a020 con 0x5594c46b29d0 2024-09-19T08:44:00.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.743+0000 7f92437fe640 1 -- 172.21.15.7:0/2806685372 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f924c010430 con 0x5594c46b29d0 2024-09-19T08:44:00.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.743+0000 7f926ccf5740 1 -- 172.21.15.7:0/2806685372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f924c010910 con 0x5594c46b29d0 2024-09-19T08:44:00.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.743+0000 7f92437fe640 1 -- 172.21.15.7:0/2806685372 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f924c010630 con 0x5594c46b29d0 2024-09-19T08:44:00.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.743+0000 7f926ccf5740 10 client.14955 fetch_fsmap learned FSMap version 24 2024-09-19T08:44:00.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.743+0000 7f926ccf5740 1 -- 172.21.15.7:0/2806685372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5594c46cc0f0 con 0x5594c46b29d0 2024-09-19T08:44:00.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.743+0000 7f92437fe640 1 -- 172.21.15.7:0/2806685372 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f924c010910 con 0x5594c46b29d0 2024-09-19T08:44:00.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.743+0000 7f92437fe640 1 -- 172.21.15.7:0/2806685372 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f924c01c070 con 0x5594c46b29d0 2024-09-19T08:44:00.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.743+0000 7f926ccf5740 10 client.14955 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T08:44:00.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.743+0000 7f926ccf5740 10 client.14955 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T08:44:00.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.744+0000 7f926ccf5740 20 client.14955 populate_metadata read hostname 'smithi007' 2024-09-19T08:44:00.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.744+0000 7f926ccf5740 1 --2- 172.21.15.7:0/2806685372 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5594c46ce4b0 0x5594c46cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:00.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.744+0000 7f926ccf5740 4 client.14955 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:44:00.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.744+0000 7f926ccf5740 1 -- 172.21.15.7:0/2806685372 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594c4626600 con 0x5594c46ce4b0 2024-09-19T08:44:00.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.744+0000 7f9263fff640 1 --2- 172.21.15.7:0/2806685372 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5594c46ce4b0 0x5594c46cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:00.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.744+0000 7f9263fff640 1 --2- 172.21.15.7:0/2806685372 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5594c46ce4b0 0x5594c46cf920 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4b4043c423423671 server_cookie=53e0fe22e116bbc1 in_seq=0 out_seq=0 2024-09-19T08:44:00.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.744+0000 7f92437fe640 10 client.14955 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:44:00.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.745+0000 7f92437fe640 1 -- 172.21.15.7:0/2806685372 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5594c4626600 con 0x5594c46ce4b0 2024-09-19T08:44:00.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.745+0000 7f92437fe640 10 client.14955 handle_command_reply: tid=0 2024-09-19T08:44:00.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.745+0000 7f926ccf5740 1 client.14955 shutdown 2024-09-19T08:44:00.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.745+0000 7f926ccf5740 1 -- 172.21.15.7:0/2806685372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46b29d0 msgr2=0x5594c46bd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:00.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.745+0000 7f926ccf5740 1 --2- 172.21.15.7:0/2806685372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46b29d0 0x5594c46bd430 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f924c012fd0 tx=0x7f924c010b50 comp rx=0 tx=0).stop 2024-09-19T08:44:00.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.746+0000 7f926ccf5740 1 -- 172.21.15.7:0/2806685372 shutdown_connections 2024-09-19T08:44:00.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.746+0000 7f926ccf5740 1 --2- 172.21.15.7:0/2806685372 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5594c46ce4b0 0x5594c46cf920 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.746+0000 7f926ccf5740 1 --2- 172.21.15.7:0/2806685372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594c46bdbb0 0x5594c46bacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.746+0000 7f926ccf5740 1 --2- 172.21.15.7:0/2806685372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594c46b32f0 0x5594c46ba780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.746+0000 7f926ccf5740 1 --2- 172.21.15.7:0/2806685372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46b29d0 0x5594c46bd430 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.746+0000 7f92437fe640 0 client.14955 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:44:00.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.746+0000 7f926ccf5740 1 -- 172.21.15.7:0/2806685372 >> 172.21.15.7:0/2806685372 conn(0x5594c46aef60 msgr2=0x5594c46b4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:00.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.746+0000 7f926ccf5740 1 -- 172.21.15.7:0/2806685372 shutdown_connections 2024-09-19T08:44:00.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.746+0000 7f926ccf5740 1 -- 172.21.15.7:0/2806685372 wait complete. 2024-09-19T08:44:00.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.746+0000 7f926ccf5740 20 client.14955 trim_cache size 0 max 16384 2024-09-19T08:44:00.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.763+0000 7f926ccf5740 1 Processor -- start 2024-09-19T08:44:00.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.764+0000 7f926ccf5740 1 -- start start 2024-09-19T08:44:00.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.764+0000 7f926ccf5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594c46b29d0 0x5594c46cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:00.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.764+0000 7f926ccf5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46b32f0 0x5594c46ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:00.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.764+0000 7f926ccf5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594c46bdbb0 0x5594c46ba040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:00.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.764+0000 7f926ccf5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5594c46cdc60 con 0x5594c46b32f0 2024-09-19T08:44:00.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.764+0000 7f926ccf5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5594c46ce330 con 0x5594c46bdbb0 2024-09-19T08:44:00.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.764+0000 7f926ccf5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5594c46cea00 con 0x5594c46b29d0 2024-09-19T08:44:00.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.764+0000 7f9263fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46b32f0 0x5594c46ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:00.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.764+0000 7f9263fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46b32f0 0x5594c46ceb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37086/0 (socket says 172.21.15.7:37086) 2024-09-19T08:44:00.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.764+0000 7f9263fff640 1 -- 172.21.15.7:0/3266128154 learned_addr learned my addr 172.21.15.7:0/3266128154 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:00.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.764+0000 7f925bfff640 1 --2- 172.21.15.7:0/3266128154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594c46bdbb0 0x5594c46ba040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:00.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.764+0000 7f9263fff640 1 -- 172.21.15.7:0/3266128154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594c46b29d0 msgr2=0x5594c46cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:00.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.764+0000 7f9263fff640 1 --2- 172.21.15.7:0/3266128154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594c46b29d0 0x5594c46cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.764+0000 7f9263fff640 1 -- 172.21.15.7:0/3266128154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594c46bdbb0 msgr2=0x5594c46ba040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:00.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.764+0000 7f9263fff640 1 --2- 172.21.15.7:0/3266128154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594c46bdbb0 0x5594c46ba040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.764+0000 7f9263fff640 1 -- 172.21.15.7:0/3266128154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594c46ca410 con 0x5594c46b32f0 2024-09-19T08:44:00.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.764+0000 7f925bfff640 1 --2- 172.21.15.7:0/3266128154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594c46bdbb0 0x5594c46ba040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:44:00.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.764+0000 7f9263fff640 1 --2- 172.21.15.7:0/3266128154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46b32f0 0x5594c46ceb80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x5594c46ba010 tx=0x7f9254014840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835908d2074254fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:00.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.764+0000 7f9259ffb640 1 -- 172.21.15.7:0/3266128154 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9254004030 con 0x5594c46b32f0 2024-09-19T08:44:00.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.765+0000 7f9259ffb640 1 -- 172.21.15.7:0/3266128154 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92540041d0 con 0x5594c46b32f0 2024-09-19T08:44:00.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.765+0000 7f9259ffb640 1 -- 172.21.15.7:0/3266128154 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925401c5f0 con 0x5594c46b32f0 2024-09-19T08:44:00.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.765+0000 7f926ccf5740 1 -- 172.21.15.7:0/3266128154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46b32f0 msgr2=0x5594c46ceb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:00.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.765+0000 7f926ccf5740 1 --2- 172.21.15.7:0/3266128154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46b32f0 0x5594c46ceb80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x5594c46ba010 tx=0x7f9254014840 comp rx=0 tx=0).stop 2024-09-19T08:44:00.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.765+0000 7f926ccf5740 1 -- 172.21.15.7:0/3266128154 shutdown_connections 2024-09-19T08:44:00.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.765+0000 7f926ccf5740 1 --2- 172.21.15.7:0/3266128154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594c46bdbb0 0x5594c46ba040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.765+0000 7f926ccf5740 1 --2- 172.21.15.7:0/3266128154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46b32f0 0x5594c46ceb80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.765+0000 7f926ccf5740 1 --2- 172.21.15.7:0/3266128154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594c46b29d0 0x5594c46cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.765+0000 7f926ccf5740 1 -- 172.21.15.7:0/3266128154 >> 172.21.15.7:0/3266128154 conn(0x5594c46aef60 msgr2=0x5594c46af340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:00.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.765+0000 7f926ccf5740 1 -- 172.21.15.7:0/3266128154 shutdown_connections 2024-09-19T08:44:00.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.765+0000 7f926ccf5740 1 -- 172.21.15.7:0/3266128154 wait complete. 2024-09-19T08:44:00.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.766+0000 7f926ccf5740 1 -- start start 2024-09-19T08:44:00.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.766+0000 7f926ccf5740 1 Processor -- start 2024-09-19T08:44:00.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.766+0000 7f926ccf5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594c46b29d0 0x5594c46d6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:00.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.766+0000 7f926ccf5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594c46b32f0 0x5594c46d6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:00.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.766+0000 7f926ccf5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46bdbb0 0x5594c46d0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:00.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.766+0000 7f926ccf5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5594c46cf7a0 con 0x5594c46bdbb0 2024-09-19T08:44:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.766+0000 7f926ccf5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5594c46cf0d0 con 0x5594c46b32f0 2024-09-19T08:44:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.766+0000 7f926ccf5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5594c46cfe70 con 0x5594c46b29d0 2024-09-19T08:44:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.766+0000 7f926ccf5740 10 client.0 _ll_register_callbacks cb 0x7f924c0123f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:44:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.766+0000 7f925bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46bdbb0 0x5594c46d0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.766+0000 7f925bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46bdbb0 0x5594c46d0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37088/0 (socket says 172.21.15.7:37088) 2024-09-19T08:44:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.766+0000 7f925bfff640 1 -- 172.21.15.7:0/3541585877 learned_addr learned my addr 172.21.15.7:0/3541585877 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.766+0000 7f9263fff640 1 --2- 172.21.15.7:0/3541585877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594c46b32f0 0x5594c46d6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.767+0000 7f925bfff640 1 --2- 172.21.15.7:0/3541585877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594c46b29d0 0x5594c46d6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.767+0000 7f925bfff640 1 -- 172.21.15.7:0/3541585877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594c46b29d0 msgr2=0x5594c46d6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.767+0000 7f925bfff640 1 --2- 172.21.15.7:0/3541585877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594c46b29d0 0x5594c46d6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.767+0000 7f925bfff640 1 -- 172.21.15.7:0/3541585877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594c46b32f0 msgr2=0x5594c46d6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.767+0000 7f925bfff640 1 --2- 172.21.15.7:0/3541585877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594c46b32f0 0x5594c46d6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.767+0000 7f925bfff640 1 -- 172.21.15.7:0/3541585877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594c46d70d0 con 0x5594c46bdbb0 2024-09-19T08:44:00.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.767+0000 7f925bfff640 1 --2- 172.21.15.7:0/3541585877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46bdbb0 0x5594c46d0b90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f924c026930 tx=0x7f924c00b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d917ec2c7ec87989 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:00.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.767+0000 7f92437fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:44:00.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.767+0000 7f92437fe640 1 -- 172.21.15.7:0/3541585877 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924c02a040 con 0x5594c46bdbb0 2024-09-19T08:44:00.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.767+0000 7f92437fe640 1 -- 172.21.15.7:0/3541585877 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f924c010430 con 0x5594c46bdbb0 2024-09-19T08:44:00.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.767+0000 7f926ccf5740 1 -- 172.21.15.7:0/3541585877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92540041d0 con 0x5594c46bdbb0 2024-09-19T08:44:00.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.767+0000 7f92437fe640 1 -- 172.21.15.7:0/3541585877 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f924c00bc90 con 0x5594c46bdbb0 2024-09-19T08:44:00.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.767+0000 7f926ccf5740 10 client.14961 fetch_fsmap learned FSMap version 24 2024-09-19T08:44:00.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.767+0000 7f926ccf5740 1 -- 172.21.15.7:0/3541585877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5594c46d5620 con 0x5594c46bdbb0 2024-09-19T08:44:00.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.767+0000 7f92437fe640 1 -- 172.21.15.7:0/3541585877 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92540041d0 con 0x5594c46bdbb0 2024-09-19T08:44:00.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.768+0000 7f92437fe640 1 -- 172.21.15.7:0/3541585877 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f924c0035f0 con 0x5594c46bdbb0 2024-09-19T08:44:00.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.768+0000 7f926ccf5740 10 client.14961 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T08:44:00.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.768+0000 7f926ccf5740 10 client.14961 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T08:44:00.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.768+0000 7f926ccf5740 20 client.14961 populate_metadata read hostname 'smithi007' 2024-09-19T08:44:00.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.768+0000 7f926ccf5740 1 --2- 172.21.15.7:0/3541585877 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5594c473caa0 0x5594c473b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:00.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.768+0000 7f926ccf5740 4 client.14961 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:44:00.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.768+0000 7f926ccf5740 1 -- 172.21.15.7:0/3541585877 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "status"}) -- 0x5594c4620b10 con 0x5594c473caa0 2024-09-19T08:44:00.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.768+0000 7f9263fff640 1 --2- 172.21.15.7:0/3541585877 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5594c473caa0 0x5594c473b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:00.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.768+0000 7f9263fff640 1 --2- 172.21.15.7:0/3541585877 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5594c473caa0 0x5594c473b7b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1ad83867675da19b server_cookie=13b29d2f98111416 in_seq=0 out_seq=0 2024-09-19T08:44:00.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.768+0000 7f92437fe640 10 client.14961 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:44:00.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.769+0000 7f92437fe640 1 -- 172.21.15.7:0/3541585877 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5594c4620b10 con 0x5594c473caa0 2024-09-19T08:44:00.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.769+0000 7f92437fe640 10 client.14961 handle_command_reply: tid=0 2024-09-19T08:44:00.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.769+0000 7f926ccf5740 1 client.14961 shutdown 2024-09-19T08:44:00.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.769+0000 7f926ccf5740 1 -- 172.21.15.7:0/3541585877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46bdbb0 msgr2=0x5594c46d0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:00.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.769+0000 7f926ccf5740 1 --2- 172.21.15.7:0/3541585877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46bdbb0 0x5594c46d0b90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f924c026930 tx=0x7f924c00b2e0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.769+0000 7f926ccf5740 1 -- 172.21.15.7:0/3541585877 shutdown_connections 2024-09-19T08:44:00.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.769+0000 7f926ccf5740 1 --2- 172.21.15.7:0/3541585877 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5594c473caa0 0x5594c473b7b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.769+0000 7f926ccf5740 1 --2- 172.21.15.7:0/3541585877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5594c46bdbb0 0x5594c46d0b90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.769+0000 7f926ccf5740 1 --2- 172.21.15.7:0/3541585877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594c46b32f0 0x5594c46d6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.769+0000 7f926ccf5740 1 --2- 172.21.15.7:0/3541585877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594c46b29d0 0x5594c46d6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.769+0000 7f926ccf5740 1 -- 172.21.15.7:0/3541585877 >> 172.21.15.7:0/3541585877 conn(0x5594c46aef60 msgr2=0x5594c46b9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:00.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.769+0000 7f92437fe640 0 client.14961 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:44:00.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.769+0000 7f926ccf5740 1 -- 172.21.15.7:0/3541585877 shutdown_connections 2024-09-19T08:44:00.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.769+0000 7f926ccf5740 1 -- 172.21.15.7:0/3541585877 wait complete. 2024-09-19T08:44:00.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.769+0000 7f926ccf5740 20 client.14961 trim_cache size 0 max 16384 2024-09-19T08:44:00.780 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:44:00.780 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "ebd23124-7661-11ef-bceb-c7b262605968", 2024-09-19T08:44:00.780 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 2, 2024-09-19T08:44:00.781 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24458, 2024-09-19T08:44:00.781 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T08:44:00.781 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T08:44:00.781 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T08:44:00.781 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 67.687581390999995, 2024-09-19T08:44:00.781 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 24, 2024-09-19T08:44:00.781 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 82, 2024-09-19T08:44:00.781 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T08:44:00.781 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 97.545651477000007 2024-09-19T08:44:00.781 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:44:00.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.770+0000 7f926a91c640 1 -- 172.21.15.7:0/1841559276 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f92500a3350 msgr2=0x7f92500a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:00.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.770+0000 7f926a91c640 1 --2- 172.21.15.7:0/1841559276 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f92500a3350 0x7f92500a5810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f925c0b9830 tx=0x7f925c0dd040 comp rx=0 tx=0).stop 2024-09-19T08:44:00.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.770+0000 7f926a91c640 1 -- 172.21.15.7:0/1841559276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f926410c170 msgr2=0x7f9264101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:00.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.770+0000 7f926a91c640 1 --2- 172.21.15.7:0/1841559276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f926410c170 0x7f9264101420 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f925c02ae70 tx=0x7f925c02f5b0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.770+0000 7f926a91c640 1 -- 172.21.15.7:0/1841559276 shutdown_connections 2024-09-19T08:44:00.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.770+0000 7f926a91c640 1 --2- 172.21.15.7:0/1841559276 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f92500a3350 0x7f92500a5810 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.770+0000 7f926a91c640 1 --2- 172.21.15.7:0/1841559276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f926410c170 0x7f9264101420 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.770+0000 7f926a91c640 1 --2- 172.21.15.7:0/1841559276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9264103660 0x7f9264100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.770+0000 7f926a91c640 1 --2- 172.21.15.7:0/1841559276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9264102d40 0x7f92641009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:00.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.770+0000 7f926a91c640 1 -- 172.21.15.7:0/1841559276 >> 172.21.15.7:0/1841559276 conn(0x7f92640fc7a0 msgr2=0x7f92640fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:00.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.770+0000 7f926a91c640 1 -- 172.21.15.7:0/1841559276 shutdown_connections 2024-09-19T08:44:00.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:00.770+0000 7f926a91c640 1 -- 172.21.15.7:0/1841559276 wait complete. 2024-09-19T08:44:01.495 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T08:44:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:02.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:01 smithi175 ceph-mon[35688]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:44:02.209 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:01 smithi007 ceph-mon[31221]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:44:02.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:01 smithi044 ceph-mon[35072]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:44:02.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.291+0000 7f0cef2e9640 1 -- 172.21.15.7:0/2060196515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ce8101420 msgr2=0x7f0ce810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:02.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.291+0000 7f0cef2e9640 1 --2- 172.21.15.7:0/2060196515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ce8101420 0x7f0ce810d950 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009cd0 tx=0x7f0ce002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.291+0000 7f0cef2e9640 1 -- 172.21.15.7:0/2060196515 shutdown_connections 2024-09-19T08:44:02.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.291+0000 7f0cef2e9640 1 --2- 172.21.15.7:0/2060196515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ce8101420 0x7f0ce810d950 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.291+0000 7f0cef2e9640 1 --2- 172.21.15.7:0/2060196515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ce8100a80 0x7f0ce8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.291+0000 7f0cef2e9640 1 --2- 172.21.15.7:0/2060196515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ce8106a80 0x7f0ce8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.291+0000 7f0cef2e9640 1 -- 172.21.15.7:0/2060196515 >> 172.21.15.7:0/2060196515 conn(0x7f0ce80fc7a0 msgr2=0x7f0ce80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:02.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.292+0000 7f0cef2e9640 1 -- 172.21.15.7:0/2060196515 shutdown_connections 2024-09-19T08:44:02.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.292+0000 7f0cef2e9640 1 -- 172.21.15.7:0/2060196515 wait complete. 2024-09-19T08:44:02.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.292+0000 7f0cef2e9640 1 Processor -- start 2024-09-19T08:44:02.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.292+0000 7f0cef2e9640 1 -- start start 2024-09-19T08:44:02.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.292+0000 7f0cef2e9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ce8100a80 0x7f0ce8102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:02.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.292+0000 7f0cef2e9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ce8101420 0x7f0ce8102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:02.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.292+0000 7f0cef2e9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ce8106a80 0x7f0ce81030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:02.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.292+0000 7f0cef2e9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce8110e80 con 0x7f0ce8101420 2024-09-19T08:44:02.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.292+0000 7f0cef2e9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce8110d00 con 0x7f0ce8100a80 2024-09-19T08:44:02.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.292+0000 7f0cef2e9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce8111000 con 0x7f0ce8106a80 2024-09-19T08:44:02.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.292+0000 7f0cec884640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ce8101420 0x7f0ce8102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:02.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.293+0000 7f0cec884640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ce8101420 0x7f0ce8102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37104/0 (socket says 172.21.15.7:37104) 2024-09-19T08:44:02.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.293+0000 7f0cec884640 1 -- 172.21.15.7:0/1626062107 learned_addr learned my addr 172.21.15.7:0/1626062107 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:02.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.293+0000 7f0ced085640 1 --2- 172.21.15.7:0/1626062107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ce8100a80 0x7f0ce8102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:02.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.293+0000 7f0ced886640 1 --2- 172.21.15.7:0/1626062107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ce8106a80 0x7f0ce81030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:02.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.293+0000 7f0cec884640 1 -- 172.21.15.7:0/1626062107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ce8106a80 msgr2=0x7f0ce81030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:02.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.293+0000 7f0cec884640 1 --2- 172.21.15.7:0/1626062107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ce8106a80 0x7f0ce81030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.293+0000 7f0cec884640 1 -- 172.21.15.7:0/1626062107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ce8100a80 msgr2=0x7f0ce8102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:02.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.293+0000 7f0cec884640 1 --2- 172.21.15.7:0/1626062107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ce8100a80 0x7f0ce8102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.293+0000 7f0cec884640 1 -- 172.21.15.7:0/1626062107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce81a67d0 con 0x7f0ce8101420 2024-09-19T08:44:02.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.293+0000 7f0cec884640 1 --2- 172.21.15.7:0/1626062107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ce8101420 0x7f0ce8102b90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800c920 tx=0x7f0cd800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:02.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.293+0000 7f0cde7fc640 1 -- 172.21.15.7:0/1626062107 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8007c70 con 0x7f0ce8101420 2024-09-19T08:44:02.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.293+0000 7f0cef2e9640 1 -- 172.21.15.7:0/1626062107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce81a6ac0 con 0x7f0ce8101420 2024-09-19T08:44:02.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.293+0000 7f0cde7fc640 1 -- 172.21.15.7:0/1626062107 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cd8007e10 con 0x7f0ce8101420 2024-09-19T08:44:02.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.293+0000 7f0cde7fc640 1 -- 172.21.15.7:0/1626062107 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8018890 con 0x7f0ce8101420 2024-09-19T08:44:02.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.293+0000 7f0cef2e9640 1 -- 172.21.15.7:0/1626062107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce81a7000 con 0x7f0ce8101420 2024-09-19T08:44:02.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.296+0000 7f0cde7fc640 1 -- 172.21.15.7:0/1626062107 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f0cd8018a70 con 0x7f0ce8101420 2024-09-19T08:44:02.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.296+0000 7f0cf16c2740 1 Processor -- start 2024-09-19T08:44:02.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.296+0000 7f0cf16c2740 1 -- start start 2024-09-19T08:44:02.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.296+0000 7f0cf16c2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3ecf6c9d0 0x55f3ecf6cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:02.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.296+0000 7f0cf16c2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3ecf6d2f0 0x55f3ecf77670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:02.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.296+0000 7f0cf16c2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf77bb0 0x55f3ecf79fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:02.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.296+0000 7f0cf16c2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f3eced3090 con 0x55f3ecf77bb0 2024-09-19T08:44:02.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.296+0000 7f0cf16c2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f3ece7aa70 con 0x55f3ecf6d2f0 2024-09-19T08:44:02.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.296+0000 7f0cf16c2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f3ececf050 con 0x55f3ecf6c9d0 2024-09-19T08:44:02.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.296+0000 7f0cec884640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf77bb0 0x55f3ecf79fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:02.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.297+0000 7f0cec884640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf77bb0 0x55f3ecf79fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37118/0 (socket says 172.21.15.7:37118) 2024-09-19T08:44:02.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.297+0000 7f0cec884640 1 -- 172.21.15.7:0/3378570093 learned_addr learned my addr 172.21.15.7:0/3378570093 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:02.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.297+0000 7f0ced886640 1 --2- 172.21.15.7:0/3378570093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3ecf6c9d0 0x55f3ecf6cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:02.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.297+0000 7f0cde7fc640 1 --2- 172.21.15.7:0/1626062107 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0cd40a32d0 0x7f0cd40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:02.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.297+0000 7f0ced085640 1 --2- 172.21.15.7:0/3378570093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3ecf6d2f0 0x55f3ecf77670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:02.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.297+0000 7f0ced886640 1 --2- 172.21.15.7:0/1626062107 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0cd40a32d0 0x7f0cd40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:02.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.297+0000 7f0cde7fc640 1 -- 172.21.15.7:0/1626062107 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0cd80cfca0 con 0x7f0ce8101420 2024-09-19T08:44:02.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.297+0000 7f0cec884640 1 -- 172.21.15.7:0/3378570093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3ecf6c9d0 msgr2=0x55f3ecf6cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:02.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.297+0000 7f0cec884640 1 --2- 172.21.15.7:0/3378570093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3ecf6c9d0 0x55f3ecf6cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.297+0000 7f0cec884640 1 -- 172.21.15.7:0/3378570093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3ecf6d2f0 msgr2=0x55f3ecf77670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:02.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.297+0000 7f0cec884640 1 --2- 172.21.15.7:0/3378570093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3ecf6d2f0 0x55f3ecf77670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.297+0000 7f0cec884640 1 -- 172.21.15.7:0/3378570093 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3ece87130 con 0x55f3ecf77bb0 2024-09-19T08:44:02.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.297+0000 7f0ced085640 1 --2- 172.21.15.7:0/3378570093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3ecf6d2f0 0x55f3ecf77670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:02.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.297+0000 7f0ced886640 1 --2- 172.21.15.7:0/3378570093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3ecf6c9d0 0x55f3ecf6cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:44:02.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.297+0000 7f0cec884640 1 --2- 172.21.15.7:0/3378570093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf77bb0 0x55f3ecf79fa0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80cd5c0 tx=0x7f0cd8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef3a2275e69e6fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:02.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.297+0000 7f0cd37fe640 1 -- 172.21.15.7:0/3378570093 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd800de20 con 0x55f3ecf77bb0 2024-09-19T08:44:02.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.297+0000 7f0ced886640 1 --2- 172.21.15.7:0/1626062107 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0cd40a32d0 0x7f0cd40a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0005cc0 tx=0x7f0ce002a8e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:02.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.297+0000 7f0cd37fe640 1 -- 172.21.15.7:0/3378570093 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cd809c160 con 0x55f3ecf77bb0 2024-09-19T08:44:02.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.297+0000 7f0cd37fe640 1 -- 172.21.15.7:0/3378570093 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd80bc110 con 0x55f3ecf77bb0 2024-09-19T08:44:02.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.298+0000 7f0cf16c2740 1 -- 172.21.15.7:0/3378570093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf77bb0 msgr2=0x55f3ecf79fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:02.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.298+0000 7f0cf16c2740 1 --2- 172.21.15.7:0/3378570093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf77bb0 0x55f3ecf79fa0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80cd5c0 tx=0x7f0cd8000bc0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.298+0000 7f0cf16c2740 1 -- 172.21.15.7:0/3378570093 shutdown_connections 2024-09-19T08:44:02.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.298+0000 7f0cf16c2740 1 --2- 172.21.15.7:0/3378570093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf77bb0 0x55f3ecf79fa0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.298+0000 7f0cf16c2740 1 --2- 172.21.15.7:0/3378570093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3ecf6d2f0 0x55f3ecf77670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.298+0000 7f0cf16c2740 1 --2- 172.21.15.7:0/3378570093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3ecf6c9d0 0x55f3ecf6cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.298+0000 7f0cf16c2740 1 -- 172.21.15.7:0/3378570093 >> 172.21.15.7:0/3378570093 conn(0x55f3ecf68f60 msgr2=0x55f3ecf69340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:02.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.298+0000 7f0cf16c2740 1 -- 172.21.15.7:0/3378570093 shutdown_connections 2024-09-19T08:44:02.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.298+0000 7f0cf16c2740 1 -- 172.21.15.7:0/3378570093 wait complete. 2024-09-19T08:44:02.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.298+0000 7f0cf16c2740 1 -- start start 2024-09-19T08:44:02.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.299+0000 7f0cf16c2740 1 Processor -- start 2024-09-19T08:44:02.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.299+0000 7f0cf16c2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3ecf6c9d0 0x55f3ecf774c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:02.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.299+0000 7f0cf16c2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3ecf6d2f0 0x55f3ecf74810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:02.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.299+0000 7f0cf16c2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf77bb0 0x55f3ecf74d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:02.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.299+0000 7f0cf16c2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f3ecf7a780 con 0x55f3ecf77bb0 2024-09-19T08:44:02.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.299+0000 7f0cf16c2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f3ece8df20 con 0x55f3ecf6d2f0 2024-09-19T08:44:02.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.299+0000 7f0cf16c2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f3ecf7a900 con 0x55f3ecf6c9d0 2024-09-19T08:44:02.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.299+0000 7f0cf16c2740 10 client.0 _ll_register_callbacks cb 0x55f3ece57030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:44:02.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.299+0000 7f0ced886640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf77bb0 0x55f3ecf74d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:02.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.299+0000 7f0ced886640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf77bb0 0x55f3ecf74d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37134/0 (socket says 172.21.15.7:37134) 2024-09-19T08:44:02.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.299+0000 7f0ced886640 1 -- 172.21.15.7:0/265676268 learned_addr learned my addr 172.21.15.7:0/265676268 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:02.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.299+0000 7f0ced085640 1 --2- 172.21.15.7:0/265676268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3ecf6c9d0 0x55f3ecf774c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:02.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.299+0000 7f0cec884640 1 --2- 172.21.15.7:0/265676268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3ecf6d2f0 0x55f3ecf74810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:02.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.299+0000 7f0ced886640 1 -- 172.21.15.7:0/265676268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3ecf6c9d0 msgr2=0x55f3ecf774c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:02.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.299+0000 7f0ced886640 1 --2- 172.21.15.7:0/265676268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3ecf6c9d0 0x55f3ecf774c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.299+0000 7f0ced886640 1 -- 172.21.15.7:0/265676268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3ecf6d2f0 msgr2=0x55f3ecf74810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:02.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.299+0000 7f0ced886640 1 --2- 172.21.15.7:0/265676268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3ecf6d2f0 0x55f3ecf74810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.299+0000 7f0ced886640 1 -- 172.21.15.7:0/265676268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3ecc442b0 con 0x55f3ecf77bb0 2024-09-19T08:44:02.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.299+0000 7f0cec884640 1 --2- 172.21.15.7:0/265676268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3ecf6d2f0 0x55f3ecf74810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.300+0000 7f0ced886640 1 --2- 172.21.15.7:0/265676268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf77bb0 0x55f3ecf74d50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009cd0 tx=0x7f0ce00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8329201bfa60b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.300+0000 7f0cd0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:44:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.300+0000 7f0cd0ff9640 1 -- 172.21.15.7:0/265676268 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce004e070 con 0x55f3ecf77bb0 2024-09-19T08:44:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.300+0000 7f0cf16c2740 1 -- 172.21.15.7:0/265676268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cd809c160 con 0x55f3ecf77bb0 2024-09-19T08:44:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.300+0000 7f0cd0ff9640 1 -- 172.21.15.7:0/265676268 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0ce0004690 con 0x55f3ecf77bb0 2024-09-19T08:44:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.300+0000 7f0cd0ff9640 1 -- 172.21.15.7:0/265676268 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0ce00305a0 con 0x55f3ecf77bb0 2024-09-19T08:44:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.300+0000 7f0cf16c2740 10 client.14973 fetch_fsmap learned FSMap version 24 2024-09-19T08:44:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.300+0000 7f0cf16c2740 1 -- 172.21.15.7:0/265676268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f3ecf86180 con 0x55f3ecf77bb0 2024-09-19T08:44:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.300+0000 7f0cd0ff9640 1 -- 172.21.15.7:0/265676268 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cd809c160 con 0x55f3ecf77bb0 2024-09-19T08:44:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.300+0000 7f0cd0ff9640 1 -- 172.21.15.7:0/265676268 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0ce0030070 con 0x55f3ecf77bb0 2024-09-19T08:44:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.300+0000 7f0cf16c2740 10 client.14973 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T08:44:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.300+0000 7f0cf16c2740 10 client.14973 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T08:44:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.300+0000 7f0cf16c2740 20 client.14973 populate_metadata read hostname 'smithi007' 2024-09-19T08:44:02.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.301+0000 7f0cf16c2740 1 --2- 172.21.15.7:0/265676268 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f3ecf88770 0x55f3ecf89be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:02.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.301+0000 7f0cf16c2740 4 client.14973 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:44:02.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.301+0000 7f0cf16c2740 1 -- 172.21.15.7:0/265676268 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3ecee0600 con 0x55f3ecf88770 2024-09-19T08:44:02.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.301+0000 7f0ced085640 1 --2- 172.21.15.7:0/265676268 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f3ecf88770 0x55f3ecf89be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:02.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.301+0000 7f0cd0ff9640 10 client.14973 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:44:02.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.301+0000 7f0ced085640 1 --2- 172.21.15.7:0/265676268 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f3ecf88770 0x55f3ecf89be0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=544bbe0fa0283c0b server_cookie=39bd14c6724a5367 in_seq=0 out_seq=0 2024-09-19T08:44:02.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.302+0000 7f0cd0ff9640 1 -- 172.21.15.7:0/265676268 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f3ecee0600 con 0x55f3ecf88770 2024-09-19T08:44:02.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.302+0000 7f0cd0ff9640 10 client.14973 handle_command_reply: tid=0 2024-09-19T08:44:02.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.302+0000 7f0cf16c2740 1 client.14973 shutdown 2024-09-19T08:44:02.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.302+0000 7f0cf16c2740 1 -- 172.21.15.7:0/265676268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf77bb0 msgr2=0x55f3ecf74d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:02.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.302+0000 7f0cf16c2740 1 --2- 172.21.15.7:0/265676268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf77bb0 0x55f3ecf74d50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009cd0 tx=0x7f0ce00095c0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.302+0000 7f0cf16c2740 1 -- 172.21.15.7:0/265676268 shutdown_connections 2024-09-19T08:44:02.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.302+0000 7f0cf16c2740 1 --2- 172.21.15.7:0/265676268 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f3ecf88770 0x55f3ecf89be0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.302+0000 7f0cf16c2740 1 --2- 172.21.15.7:0/265676268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf77bb0 0x55f3ecf74d50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.302+0000 7f0cf16c2740 1 --2- 172.21.15.7:0/265676268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3ecf6d2f0 0x55f3ecf74810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.302+0000 7f0cf16c2740 1 --2- 172.21.15.7:0/265676268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3ecf6c9d0 0x55f3ecf774c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.302+0000 7f0cd0ff9640 0 client.14973 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:44:02.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.302+0000 7f0cf16c2740 1 -- 172.21.15.7:0/265676268 >> 172.21.15.7:0/265676268 conn(0x55f3ecf68f60 msgr2=0x55f3ecf6ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:02.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.302+0000 7f0cf16c2740 1 -- 172.21.15.7:0/265676268 shutdown_connections 2024-09-19T08:44:02.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.302+0000 7f0cf16c2740 1 -- 172.21.15.7:0/265676268 wait complete. 2024-09-19T08:44:02.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.302+0000 7f0cf16c2740 20 client.14973 trim_cache size 0 max 16384 2024-09-19T08:44:02.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.320+0000 7f0cf16c2740 1 Processor -- start 2024-09-19T08:44:02.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.321+0000 7f0cf16c2740 1 -- start start 2024-09-19T08:44:02.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.321+0000 7f0cf16c2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3ecf6c9d0 0x55f3ecf687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:02.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.321+0000 7f0cf16c2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf6d2f0 0x55f3ecf740d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:02.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.321+0000 7f0cf16c2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3ecf77bb0 0x55f3ecf71a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:02.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.321+0000 7f0cf16c2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f3ecf87f20 con 0x55f3ecf6d2f0 2024-09-19T08:44:02.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.321+0000 7f0cf16c2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f3ecf885f0 con 0x55f3ecf6c9d0 2024-09-19T08:44:02.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.321+0000 7f0cf16c2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f3ecf88cc0 con 0x55f3ecf77bb0 2024-09-19T08:44:02.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.321+0000 7f0cec884640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf6d2f0 0x55f3ecf740d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:02.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.321+0000 7f0cec884640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf6d2f0 0x55f3ecf740d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37144/0 (socket says 172.21.15.7:37144) 2024-09-19T08:44:02.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.321+0000 7f0cec884640 1 -- 172.21.15.7:0/2847796694 learned_addr learned my addr 172.21.15.7:0/2847796694 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:02.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.321+0000 7f0ced085640 1 --2- 172.21.15.7:0/2847796694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3ecf6c9d0 0x55f3ecf687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:02.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.321+0000 7f0cec884640 1 -- 172.21.15.7:0/2847796694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3ecf77bb0 msgr2=0x55f3ecf71a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:02.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.321+0000 7f0cec884640 1 --2- 172.21.15.7:0/2847796694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3ecf77bb0 0x55f3ecf71a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.321+0000 7f0cec884640 1 -- 172.21.15.7:0/2847796694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3ecf6c9d0 msgr2=0x55f3ecf687f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:02.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.321+0000 7f0cec884640 1 --2- 172.21.15.7:0/2847796694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3ecf6c9d0 0x55f3ecf687f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.321+0000 7f0cec884640 1 -- 172.21.15.7:0/2847796694 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3ecf69aa0 con 0x55f3ecf6d2f0 2024-09-19T08:44:02.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.321+0000 7f0cec884640 1 --2- 172.21.15.7:0/2847796694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf6d2f0 0x55f3ecf740d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8098b30 tx=0x7f0cd80cd5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f44423df7a34ed5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:02.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.321+0000 7f0cd2ffd640 1 -- 172.21.15.7:0/2847796694 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd80b4070 con 0x55f3ecf6d2f0 2024-09-19T08:44:02.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.322+0000 7f0cd2ffd640 1 -- 172.21.15.7:0/2847796694 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cd809c160 con 0x55f3ecf6d2f0 2024-09-19T08:44:02.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.322+0000 7f0cd2ffd640 1 -- 172.21.15.7:0/2847796694 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd80d2040 con 0x55f3ecf6d2f0 2024-09-19T08:44:02.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.322+0000 7f0cf16c2740 1 -- 172.21.15.7:0/2847796694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf6d2f0 msgr2=0x55f3ecf740d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:02.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.322+0000 7f0cf16c2740 1 --2- 172.21.15.7:0/2847796694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf6d2f0 0x55f3ecf740d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8098b30 tx=0x7f0cd80cd5f0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.322+0000 7f0cf16c2740 1 -- 172.21.15.7:0/2847796694 shutdown_connections 2024-09-19T08:44:02.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.322+0000 7f0cf16c2740 1 --2- 172.21.15.7:0/2847796694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3ecf77bb0 0x55f3ecf71a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.322+0000 7f0cf16c2740 1 --2- 172.21.15.7:0/2847796694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf6d2f0 0x55f3ecf740d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.322+0000 7f0cf16c2740 1 --2- 172.21.15.7:0/2847796694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3ecf6c9d0 0x55f3ecf687f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.322+0000 7f0cf16c2740 1 -- 172.21.15.7:0/2847796694 >> 172.21.15.7:0/2847796694 conn(0x55f3ecf68f60 msgr2=0x55f3ecf730e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.322+0000 7f0cf16c2740 1 -- 172.21.15.7:0/2847796694 shutdown_connections 2024-09-19T08:44:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.322+0000 7f0cf16c2740 1 -- 172.21.15.7:0/2847796694 wait complete. 2024-09-19T08:44:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.323+0000 7f0cf16c2740 1 -- start start 2024-09-19T08:44:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.323+0000 7f0cf16c2740 1 Processor -- start 2024-09-19T08:44:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.323+0000 7f0cf16c2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf6c9d0 0x55f3ecf926e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.323+0000 7f0cf16c2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3ecf6d2f0 0x55f3ecf8ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.323+0000 7f0cf16c2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3ecf77bb0 0x55f3ecf8c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.323+0000 7f0cf16c2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f3ecf89a60 con 0x55f3ecf6c9d0 2024-09-19T08:44:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.323+0000 7f0cf16c2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f3ecf89390 con 0x55f3ecf77bb0 2024-09-19T08:44:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.323+0000 7f0cf16c2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f3ecf8a130 con 0x55f3ecf6d2f0 2024-09-19T08:44:02.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.323+0000 7f0cf16c2740 10 client.0 _ll_register_callbacks cb 0x7f0ce0003d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:44:02.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.323+0000 7f0ced085640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf6c9d0 0x55f3ecf926e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:02.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.323+0000 7f0ced085640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf6c9d0 0x55f3ecf926e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37160/0 (socket says 172.21.15.7:37160) 2024-09-19T08:44:02.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.323+0000 7f0ced085640 1 -- 172.21.15.7:0/3813043864 learned_addr learned my addr 172.21.15.7:0/3813043864 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:02.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.323+0000 7f0ced886640 1 --2- 172.21.15.7:0/3813043864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3ecf77bb0 0x55f3ecf8c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:02.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.324+0000 7f0ced085640 1 -- 172.21.15.7:0/3813043864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3ecf6d2f0 msgr2=0x55f3ecf8ba60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:44:02.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.324+0000 7f0ced085640 1 --2- 172.21.15.7:0/3813043864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3ecf6d2f0 0x55f3ecf8ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.324+0000 7f0ced085640 1 -- 172.21.15.7:0/3813043864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3ecf77bb0 msgr2=0x55f3ecf8c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:02.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.324+0000 7f0ced085640 1 --2- 172.21.15.7:0/3813043864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3ecf77bb0 0x55f3ecf8c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.324+0000 7f0ced085640 1 -- 172.21.15.7:0/3813043864 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3ecf6c800 con 0x55f3ecf6c9d0 2024-09-19T08:44:02.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.324+0000 7f0ced085640 1 --2- 172.21.15.7:0/3813043864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf6c9d0 0x55f3ecf926e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55f3ecf8a410 tx=0x7f0ce40039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe579daddb3abf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:02.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.324+0000 7f0cd0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:44:02.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.324+0000 7f0cd0ff9640 1 -- 172.21.15.7:0/3813043864 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4029060 con 0x55f3ecf6c9d0 2024-09-19T08:44:02.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.324+0000 7f0cd0ff9640 1 -- 172.21.15.7:0/3813043864 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0ce401d600 con 0x55f3ecf6c9d0 2024-09-19T08:44:02.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.324+0000 7f0cf16c2740 1 -- 172.21.15.7:0/3813043864 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cd809c160 con 0x55f3ecf6c9d0 2024-09-19T08:44:02.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.324+0000 7f0cd0ff9640 1 -- 172.21.15.7:0/3813043864 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0ce401d800 con 0x55f3ecf6c9d0 2024-09-19T08:44:02.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.324+0000 7f0cf16c2740 10 client.14979 fetch_fsmap learned FSMap version 24 2024-09-19T08:44:02.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.324+0000 7f0cf16c2740 1 -- 172.21.15.7:0/3813043864 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f3ecff2e80 con 0x55f3ecf6c9d0 2024-09-19T08:44:02.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.324+0000 7f0cd0ff9640 1 -- 172.21.15.7:0/3813043864 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cd809c160 con 0x55f3ecf6c9d0 2024-09-19T08:44:02.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.324+0000 7f0cd0ff9640 1 -- 172.21.15.7:0/3813043864 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0ce402e070 con 0x55f3ecf6c9d0 2024-09-19T08:44:02.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.325+0000 7f0cf16c2740 10 client.14979 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T08:44:02.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.325+0000 7f0cf16c2740 10 client.14979 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T08:44:02.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.325+0000 7f0cf16c2740 20 client.14979 populate_metadata read hostname 'smithi007' 2024-09-19T08:44:02.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.325+0000 7f0cf16c2740 1 --2- 172.21.15.7:0/3813043864 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f3ecff79b0 0x55f3ecff66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:02.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.325+0000 7f0cf16c2740 4 client.14979 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:44:02.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.325+0000 7f0cf16c2740 1 -- 172.21.15.7:0/3813043864 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "status"}) -- 0x55f3ecedab10 con 0x55f3ecff79b0 2024-09-19T08:44:02.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.326+0000 7f0cec884640 1 --2- 172.21.15.7:0/3813043864 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f3ecff79b0 0x55f3ecff66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:02.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.327+0000 7f0cec884640 1 --2- 172.21.15.7:0/3813043864 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f3ecff79b0 0x55f3ecff66c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=156a176c7aa7a27b server_cookie=5179d0fa6327f215 in_seq=0 out_seq=0 2024-09-19T08:44:02.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.327+0000 7f0cd0ff9640 10 client.14979 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:44:02.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.327+0000 7f0cd0ff9640 1 -- 172.21.15.7:0/3813043864 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f3ecedab10 con 0x55f3ecff79b0 2024-09-19T08:44:02.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.327+0000 7f0cd0ff9640 10 client.14979 handle_command_reply: tid=0 2024-09-19T08:44:02.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.327+0000 7f0cf16c2740 1 client.14979 shutdown 2024-09-19T08:44:02.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.327+0000 7f0cf16c2740 1 -- 172.21.15.7:0/3813043864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf6c9d0 msgr2=0x55f3ecf926e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:02.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.327+0000 7f0cf16c2740 1 --2- 172.21.15.7:0/3813043864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf6c9d0 0x55f3ecf926e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55f3ecf8a410 tx=0x7f0ce40039c0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.327+0000 7f0cf16c2740 1 -- 172.21.15.7:0/3813043864 shutdown_connections 2024-09-19T08:44:02.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.327+0000 7f0cf16c2740 1 --2- 172.21.15.7:0/3813043864 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f3ecff79b0 0x55f3ecff66c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.327+0000 7f0cf16c2740 1 --2- 172.21.15.7:0/3813043864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3ecf77bb0 0x55f3ecf8c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.327+0000 7f0cf16c2740 1 --2- 172.21.15.7:0/3813043864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3ecf6d2f0 0x55f3ecf8ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.327+0000 7f0cf16c2740 1 --2- 172.21.15.7:0/3813043864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3ecf6c9d0 0x55f3ecf926e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.327+0000 7f0cd0ff9640 0 client.14979 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:44:02.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.327+0000 7f0cf16c2740 1 -- 172.21.15.7:0/3813043864 >> 172.21.15.7:0/3813043864 conn(0x55f3ecf68f60 msgr2=0x55f3ecf73500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:02.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.328+0000 7f0cf16c2740 1 -- 172.21.15.7:0/3813043864 shutdown_connections 2024-09-19T08:44:02.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.328+0000 7f0cf16c2740 1 -- 172.21.15.7:0/3813043864 wait complete. 2024-09-19T08:44:02.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.328+0000 7f0cf16c2740 20 client.14979 trim_cache size 0 max 16384 2024-09-19T08:44:02.341 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:44:02.341 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "ebd23124-7661-11ef-bceb-c7b262605968", 2024-09-19T08:44:02.341 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 1, 2024-09-19T08:44:02.341 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24472, 2024-09-19T08:44:02.341 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T08:44:02.342 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T08:44:02.342 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T08:44:02.342 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 70.257782532999997, 2024-09-19T08:44:02.342 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 24, 2024-09-19T08:44:02.342 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 82, 2024-09-19T08:44:02.342 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T08:44:02.342 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 96.850446567000006 2024-09-19T08:44:02.342 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:44:02.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.328+0000 7f0cef2e9640 1 -- 172.21.15.7:0/1626062107 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0cd40a32d0 msgr2=0x7f0cd40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:02.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.328+0000 7f0cef2e9640 1 --2- 172.21.15.7:0/1626062107 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0cd40a32d0 0x7f0cd40a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0005cc0 tx=0x7f0ce002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.328+0000 7f0cef2e9640 1 -- 172.21.15.7:0/1626062107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ce8101420 msgr2=0x7f0ce8102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:02.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.328+0000 7f0cef2e9640 1 --2- 172.21.15.7:0/1626062107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ce8101420 0x7f0ce8102b90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800c920 tx=0x7f0cd800cde0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.328+0000 7f0cef2e9640 1 -- 172.21.15.7:0/1626062107 shutdown_connections 2024-09-19T08:44:02.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.328+0000 7f0cef2e9640 1 --2- 172.21.15.7:0/1626062107 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f0cd40a32d0 0x7f0cd40a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.328+0000 7f0cef2e9640 1 --2- 172.21.15.7:0/1626062107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ce8106a80 0x7f0ce81030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.328+0000 7f0cef2e9640 1 --2- 172.21.15.7:0/1626062107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ce8101420 0x7f0ce8102b90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.328+0000 7f0cef2e9640 1 --2- 172.21.15.7:0/1626062107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ce8100a80 0x7f0ce8102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:02.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.328+0000 7f0cef2e9640 1 -- 172.21.15.7:0/1626062107 >> 172.21.15.7:0/1626062107 conn(0x7f0ce80fc7a0 msgr2=0x7f0ce8104790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:02.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.329+0000 7f0cef2e9640 1 -- 172.21.15.7:0/1626062107 shutdown_connections 2024-09-19T08:44:02.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:02.329+0000 7f0cef2e9640 1 -- 172.21.15.7:0/1626062107 wait complete. 2024-09-19T08:44:03.046 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T08:44:03.303 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:03.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.806+0000 7fcce3790640 1 -- 172.21.15.7:0/2657884703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccdc106f10 msgr2=0x7fccdc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:03.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.806+0000 7fcce3790640 1 --2- 172.21.15.7:0/2657884703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccdc106f10 0x7fccdc10ea90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fccd4009ca0 tx=0x7fccd402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.806+0000 7fcce3790640 1 -- 172.21.15.7:0/2657884703 shutdown_connections 2024-09-19T08:44:03.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.806+0000 7fcce3790640 1 --2- 172.21.15.7:0/2657884703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccdc106f10 0x7fccdc10ea90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.806+0000 7fcce3790640 1 --2- 172.21.15.7:0/2657884703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccdc102790 0x7fccdc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.806+0000 7fcce3790640 1 --2- 172.21.15.7:0/2657884703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccdc101de0 0x7fccdc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.806+0000 7fcce3790640 1 -- 172.21.15.7:0/2657884703 >> 172.21.15.7:0/2657884703 conn(0x7fccdc0fd8c0 msgr2=0x7fccdc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.806+0000 7fcce3790640 1 -- 172.21.15.7:0/2657884703 shutdown_connections 2024-09-19T08:44:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.806+0000 7fcce3790640 1 -- 172.21.15.7:0/2657884703 wait complete. 2024-09-19T08:44:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.807+0000 7fcce3790640 1 Processor -- start 2024-09-19T08:44:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.807+0000 7fcce3790640 1 -- start start 2024-09-19T08:44:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.807+0000 7fcce3790640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccdc101de0 0x7fccdc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.807+0000 7fcce3790640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccdc102790 0x7fccdc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.807+0000 7fcce3790640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccdc106f10 0x7fccdc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.807+0000 7fcce3790640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc111fb0 con 0x7fccdc102790 2024-09-19T08:44:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.807+0000 7fcce3790640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc111e30 con 0x7fccdc106f10 2024-09-19T08:44:03.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.807+0000 7fcce3790640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc112130 con 0x7fccdc101de0 2024-09-19T08:44:03.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.807+0000 7fcce0d2b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccdc102790 0x7fccdc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:03.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.807+0000 7fcce0d2b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccdc102790 0x7fccdc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55114/0 (socket says 172.21.15.7:55114) 2024-09-19T08:44:03.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.807+0000 7fcce0d2b640 1 -- 172.21.15.7:0/2840525205 learned_addr learned my addr 172.21.15.7:0/2840525205 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:03.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.808+0000 7fcce152c640 1 --2- 172.21.15.7:0/2840525205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccdc101de0 0x7fccdc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:03.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.808+0000 7fcce1d2d640 1 --2- 172.21.15.7:0/2840525205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccdc106f10 0x7fccdc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:03.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.808+0000 7fcce0d2b640 1 -- 172.21.15.7:0/2840525205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccdc101de0 msgr2=0x7fccdc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:03.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.808+0000 7fcce0d2b640 1 --2- 172.21.15.7:0/2840525205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccdc101de0 0x7fccdc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.808+0000 7fcce0d2b640 1 -- 172.21.15.7:0/2840525205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccdc106f10 msgr2=0x7fccdc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:03.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.808+0000 7fcce0d2b640 1 --2- 172.21.15.7:0/2840525205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccdc106f10 0x7fccdc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.808+0000 7fcce0d2b640 1 -- 172.21.15.7:0/2840525205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccdc1a69e0 con 0x7fccdc102790 2024-09-19T08:44:03.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.808+0000 7fcce1d2d640 1 --2- 172.21.15.7:0/2840525205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccdc106f10 0x7fccdc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:44:03.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.808+0000 7fcce0d2b640 1 --2- 172.21.15.7:0/2840525205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccdc102790 0x7fccdc074a30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fccd800b4a0 tx=0x7fccd800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:03.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.808+0000 7fccce7fc640 1 -- 172.21.15.7:0/2840525205 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd8014070 con 0x7fccdc102790 2024-09-19T08:44:03.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.808+0000 7fccce7fc640 1 -- 172.21.15.7:0/2840525205 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccd8010af0 con 0x7fccdc102790 2024-09-19T08:44:03.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.808+0000 7fcce3790640 1 -- 172.21.15.7:0/2840525205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccdc1a6cd0 con 0x7fccdc102790 2024-09-19T08:44:03.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.808+0000 7fccce7fc640 1 -- 172.21.15.7:0/2840525205 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd8017d10 con 0x7fccdc102790 2024-09-19T08:44:03.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.808+0000 7fcce3790640 1 -- 172.21.15.7:0/2840525205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccdc1a7200 con 0x7fccdc102790 2024-09-19T08:44:03.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.810+0000 7fccce7fc640 1 -- 172.21.15.7:0/2840525205 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fccd8017070 con 0x7fccdc102790 2024-09-19T08:44:03.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.811+0000 7fcce5b69740 1 Processor -- start 2024-09-19T08:44:03.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.811+0000 7fcce5b69740 1 -- start start 2024-09-19T08:44:03.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.811+0000 7fcce5b69740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d20ff9d0 0x55e3d20ffdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:03.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.811+0000 7fcce5b69740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d21002f0 0x55e3d210a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:03.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.811+0000 7fcce5b69740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3d210abb0 0x55e3d210cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:03.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.811+0000 7fcce5b69740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e3d2066090 con 0x55e3d21002f0 2024-09-19T08:44:03.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.811+0000 7fcce5b69740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e3d200da70 con 0x55e3d210abb0 2024-09-19T08:44:03.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.811+0000 7fcce5b69740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e3d2062050 con 0x55e3d20ff9d0 2024-09-19T08:44:03.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.811+0000 7fcce152c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d21002f0 0x55e3d210a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:03.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.811+0000 7fcce152c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d21002f0 0x55e3d210a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55130/0 (socket says 172.21.15.7:55130) 2024-09-19T08:44:03.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.811+0000 7fcce152c640 1 -- 172.21.15.7:0/2324866385 learned_addr learned my addr 172.21.15.7:0/2324866385 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:03.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.811+0000 7fcce0d2b640 1 --2- 172.21.15.7:0/2324866385 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3d210abb0 0x55e3d210cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:03.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.811+0000 7fcce1d2d640 1 --2- 172.21.15.7:0/2324866385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d20ff9d0 0x55e3d20ffdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:03.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.811+0000 7fcce152c640 1 -- 172.21.15.7:0/2324866385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d20ff9d0 msgr2=0x55e3d20ffdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:03.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.811+0000 7fcce152c640 1 --2- 172.21.15.7:0/2324866385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d20ff9d0 0x55e3d20ffdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.811+0000 7fcce152c640 1 -- 172.21.15.7:0/2324866385 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3d210abb0 msgr2=0x55e3d210cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:03.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.811+0000 7fcce152c640 1 --2- 172.21.15.7:0/2324866385 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3d210abb0 0x55e3d210cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.811+0000 7fcce152c640 1 -- 172.21.15.7:0/2324866385 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3d201a130 con 0x55e3d21002f0 2024-09-19T08:44:03.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.811+0000 7fcce0d2b640 1 --2- 172.21.15.7:0/2324866385 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3d210abb0 0x55e3d210cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:03.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.811+0000 7fccce7fc640 1 --2- 172.21.15.7:0/2840525205 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fccc80a3350 0x7fccc80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:03.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.812+0000 7fcce152c640 1 --2- 172.21.15.7:0/2324866385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d21002f0 0x55e3d210a670 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fccd000bcf0 tx=0x7fccd000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6c948a11683c8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:03.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.812+0000 7fcce1d2d640 1 --2- 172.21.15.7:0/2840525205 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fccc80a3350 0x7fccc80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:03.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.812+0000 7fccce7fc640 1 -- 172.21.15.7:0/2840525205 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fccd80ced70 con 0x7fccdc102790 2024-09-19T08:44:03.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.812+0000 7fccc77fe640 1 -- 172.21.15.7:0/2324866385 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd0015070 con 0x55e3d21002f0 2024-09-19T08:44:03.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.812+0000 7fccc77fe640 1 -- 172.21.15.7:0/2324866385 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccd001a940 con 0x55e3d21002f0 2024-09-19T08:44:03.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.812+0000 7fccc77fe640 1 -- 172.21.15.7:0/2324866385 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd0011a10 con 0x55e3d21002f0 2024-09-19T08:44:03.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.813+0000 7fcce5b69740 1 -- 172.21.15.7:0/2324866385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d21002f0 msgr2=0x55e3d210a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:03.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.813+0000 7fcce1d2d640 1 --2- 172.21.15.7:0/2840525205 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fccc80a3350 0x7fccc80a5810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fccd402f540 tx=0x7fccd402f310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:03.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.813+0000 7fcce5b69740 1 --2- 172.21.15.7:0/2324866385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d21002f0 0x55e3d210a670 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fccd000bcf0 tx=0x7fccd000f730 comp rx=0 tx=0).stop 2024-09-19T08:44:03.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.813+0000 7fcce5b69740 1 -- 172.21.15.7:0/2324866385 shutdown_connections 2024-09-19T08:44:03.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.813+0000 7fcce5b69740 1 --2- 172.21.15.7:0/2324866385 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3d210abb0 0x55e3d210cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.813+0000 7fcce5b69740 1 --2- 172.21.15.7:0/2324866385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d21002f0 0x55e3d210a670 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.813+0000 7fcce5b69740 1 --2- 172.21.15.7:0/2324866385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d20ff9d0 0x55e3d20ffdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.813+0000 7fcce5b69740 1 -- 172.21.15.7:0/2324866385 >> 172.21.15.7:0/2324866385 conn(0x55e3d20fbf60 msgr2=0x55e3d20fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:03.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.813+0000 7fcce5b69740 1 -- 172.21.15.7:0/2324866385 shutdown_connections 2024-09-19T08:44:03.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.813+0000 7fcce5b69740 1 -- 172.21.15.7:0/2324866385 wait complete. 2024-09-19T08:44:03.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.813+0000 7fcce5b69740 1 -- start start 2024-09-19T08:44:03.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.813+0000 7fcce5b69740 1 Processor -- start 2024-09-19T08:44:03.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.814+0000 7fcce5b69740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d20ff9d0 0x55e3d210a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:03.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.814+0000 7fcce5b69740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d21002f0 0x55e3d2107780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:03.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.814+0000 7fcce5b69740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3d210abb0 0x55e3d2107cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:03.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.814+0000 7fcce5b69740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e3d210d780 con 0x55e3d20ff9d0 2024-09-19T08:44:03.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.814+0000 7fcce5b69740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e3d2020f20 con 0x55e3d210abb0 2024-09-19T08:44:03.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.814+0000 7fcce5b69740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e3d210d900 con 0x55e3d21002f0 2024-09-19T08:44:03.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.814+0000 7fcce152c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d20ff9d0 0x55e3d210a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:03.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.814+0000 7fcce152c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d20ff9d0 0x55e3d210a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55134/0 (socket says 172.21.15.7:55134) 2024-09-19T08:44:03.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.814+0000 7fcce152c640 1 -- 172.21.15.7:0/2786055199 learned_addr learned my addr 172.21.15.7:0/2786055199 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:03.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.814+0000 7fcce5b69740 10 client.0 _ll_register_callbacks cb 0x55e3d1fea030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:44:03.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.814+0000 7fcce0d2b640 1 --2- 172.21.15.7:0/2786055199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d21002f0 0x55e3d2107780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:03.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.814+0000 7fcce1d2d640 1 --2- 172.21.15.7:0/2786055199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3d210abb0 0x55e3d2107cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:03.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.814+0000 7fcce152c640 1 -- 172.21.15.7:0/2786055199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d21002f0 msgr2=0x55e3d2107780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:03.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.814+0000 7fcce152c640 1 --2- 172.21.15.7:0/2786055199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d21002f0 0x55e3d2107780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.814+0000 7fcce152c640 1 -- 172.21.15.7:0/2786055199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3d210abb0 msgr2=0x55e3d2107cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:03.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.814+0000 7fcce152c640 1 --2- 172.21.15.7:0/2786055199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3d210abb0 0x55e3d2107cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.814+0000 7fcce152c640 1 -- 172.21.15.7:0/2786055199 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3d1dd72b0 con 0x55e3d20ff9d0 2024-09-19T08:44:03.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.814+0000 7fcce152c640 1 --2- 172.21.15.7:0/2786055199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d20ff9d0 0x55e3d210a430 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fccd0006010 tx=0x7fccd000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192129983bdf6b03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:03.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.814+0000 7fccc4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:44:03.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.814+0000 7fccc4ff9640 1 -- 172.21.15.7:0/2786055199 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd0028060 con 0x55e3d20ff9d0 2024-09-19T08:44:03.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.814+0000 7fccc4ff9640 1 -- 172.21.15.7:0/2786055199 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fccd001aaf0 con 0x55e3d20ff9d0 2024-09-19T08:44:03.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.814+0000 7fcce5b69740 1 -- 172.21.15.7:0/2786055199 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccd001a940 con 0x55e3d20ff9d0 2024-09-19T08:44:03.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.815+0000 7fccc4ff9640 1 -- 172.21.15.7:0/2786055199 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fccd0015070 con 0x55e3d20ff9d0 2024-09-19T08:44:03.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.815+0000 7fcce5b69740 10 client.14991 fetch_fsmap learned FSMap version 24 2024-09-19T08:44:03.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.815+0000 7fcce5b69740 1 -- 172.21.15.7:0/2786055199 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e3d21190a0 con 0x55e3d20ff9d0 2024-09-19T08:44:03.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.815+0000 7fccc4ff9640 1 -- 172.21.15.7:0/2786055199 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccd001a940 con 0x55e3d20ff9d0 2024-09-19T08:44:03.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.815+0000 7fccc4ff9640 1 -- 172.21.15.7:0/2786055199 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fccd002d070 con 0x55e3d20ff9d0 2024-09-19T08:44:03.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.815+0000 7fcce5b69740 10 client.14991 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T08:44:03.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.815+0000 7fcce5b69740 10 client.14991 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:44:03.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.815+0000 7fcce5b69740 20 client.14991 populate_metadata read hostname 'smithi007' 2024-09-19T08:44:03.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.815+0000 7fcce5b69740 1 --2- 172.21.15.7:0/2786055199 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e3d211b3c0 0x55e3d211c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:03.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.815+0000 7fcce5b69740 4 client.14991 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:44:03.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.815+0000 7fcce5b69740 1 -- 172.21.15.7:0/2786055199 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3d2073600 con 0x55e3d211b3c0 2024-09-19T08:44:03.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.815+0000 7fcce0d2b640 1 --2- 172.21.15.7:0/2786055199 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e3d211b3c0 0x55e3d211c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:03.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.816+0000 7fcce0d2b640 1 --2- 172.21.15.7:0/2786055199 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e3d211b3c0 0x55e3d211c830 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61baff2f70a47d13 server_cookie=bbd2fe49431feb99 in_seq=0 out_seq=0 2024-09-19T08:44:03.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.816+0000 7fccc4ff9640 10 client.14991 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:44:03.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.817+0000 7fccc4ff9640 1 -- 172.21.15.7:0/2786055199 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e3d2073600 con 0x55e3d211b3c0 2024-09-19T08:44:03.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.817+0000 7fccc4ff9640 10 client.14991 handle_command_reply: tid=0 2024-09-19T08:44:03.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.817+0000 7fcce5b69740 1 client.14991 shutdown 2024-09-19T08:44:03.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.817+0000 7fcce5b69740 1 -- 172.21.15.7:0/2786055199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d20ff9d0 msgr2=0x55e3d210a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:03.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.817+0000 7fcce5b69740 1 --2- 172.21.15.7:0/2786055199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d20ff9d0 0x55e3d210a430 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fccd0006010 tx=0x7fccd000b990 comp rx=0 tx=0).stop 2024-09-19T08:44:03.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.817+0000 7fcce5b69740 1 -- 172.21.15.7:0/2786055199 shutdown_connections 2024-09-19T08:44:03.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.817+0000 7fcce5b69740 1 --2- 172.21.15.7:0/2786055199 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e3d211b3c0 0x55e3d211c830 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.817+0000 7fcce5b69740 1 --2- 172.21.15.7:0/2786055199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3d210abb0 0x55e3d2107cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.817+0000 7fcce5b69740 1 --2- 172.21.15.7:0/2786055199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d21002f0 0x55e3d2107780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.817+0000 7fcce5b69740 1 --2- 172.21.15.7:0/2786055199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d20ff9d0 0x55e3d210a430 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.817+0000 7fcce5b69740 1 -- 172.21.15.7:0/2786055199 >> 172.21.15.7:0/2786055199 conn(0x55e3d20fbf60 msgr2=0x55e3d2101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:03.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.817+0000 7fccc4ff9640 0 client.14991 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:44:03.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.817+0000 7fcce5b69740 1 -- 172.21.15.7:0/2786055199 shutdown_connections 2024-09-19T08:44:03.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.817+0000 7fcce5b69740 1 -- 172.21.15.7:0/2786055199 wait complete. 2024-09-19T08:44:03.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.817+0000 7fcce5b69740 20 client.14991 trim_cache size 0 max 16384 2024-09-19T08:44:03.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.835+0000 7fcce5b69740 1 Processor -- start 2024-09-19T08:44:03.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.835+0000 7fcce5b69740 1 -- start start 2024-09-19T08:44:03.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.836+0000 7fcce5b69740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d20ff9d0 0x55e3d211b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:03.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.836+0000 7fcce5b69740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d21002f0 0x55e3d21049e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:03.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.836+0000 7fcce5b69740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3d210abb0 0x55e3d2104f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:03.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.836+0000 7fcce5b69740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e3d211ab70 con 0x55e3d20ff9d0 2024-09-19T08:44:03.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.836+0000 7fcce5b69740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e3d211b240 con 0x55e3d210abb0 2024-09-19T08:44:03.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.836+0000 7fcce5b69740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e3d211b910 con 0x55e3d21002f0 2024-09-19T08:44:03.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.836+0000 7fcce152c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d20ff9d0 0x55e3d211b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:03.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.836+0000 7fcce152c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d20ff9d0 0x55e3d211b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55148/0 (socket says 172.21.15.7:55148) 2024-09-19T08:44:03.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.836+0000 7fcce152c640 1 -- 172.21.15.7:0/3109974916 learned_addr learned my addr 172.21.15.7:0/3109974916 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:03.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.836+0000 7fcce0d2b640 1 --2- 172.21.15.7:0/3109974916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d21002f0 0x55e3d21049e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:03.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.836+0000 7fcce1d2d640 1 --2- 172.21.15.7:0/3109974916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3d210abb0 0x55e3d2104f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:03.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.836+0000 7fcce152c640 1 -- 172.21.15.7:0/3109974916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d21002f0 msgr2=0x55e3d21049e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:03.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.836+0000 7fcce152c640 1 --2- 172.21.15.7:0/3109974916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d21002f0 0x55e3d21049e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.836+0000 7fcce152c640 1 -- 172.21.15.7:0/3109974916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3d210abb0 msgr2=0x55e3d2104f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:03.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.836+0000 7fcce152c640 1 --2- 172.21.15.7:0/3109974916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3d210abb0 0x55e3d2104f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.836+0000 7fcce152c640 1 -- 172.21.15.7:0/3109974916 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3d20ff750 con 0x55e3d20ff9d0 2024-09-19T08:44:03.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.836+0000 7fcce0d2b640 1 --2- 172.21.15.7:0/3109974916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d21002f0 0x55e3d21049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:44:03.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.836+0000 7fcce152c640 1 --2- 172.21.15.7:0/3109974916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d20ff9d0 0x55e3d211b3c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fccd00046e0 tx=0x7fccd0005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a6b631e16c5ac42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:03.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.836+0000 7fccc6ffd640 1 -- 172.21.15.7:0/3109974916 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd0033020 con 0x55e3d20ff9d0 2024-09-19T08:44:03.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.836+0000 7fccc6ffd640 1 -- 172.21.15.7:0/3109974916 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccd0005e50 con 0x55e3d20ff9d0 2024-09-19T08:44:03.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.836+0000 7fccc6ffd640 1 -- 172.21.15.7:0/3109974916 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd002f460 con 0x55e3d20ff9d0 2024-09-19T08:44:03.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.837+0000 7fcce5b69740 1 -- 172.21.15.7:0/3109974916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d20ff9d0 msgr2=0x55e3d211b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:03.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.837+0000 7fcce5b69740 1 --2- 172.21.15.7:0/3109974916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d20ff9d0 0x55e3d211b3c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fccd00046e0 tx=0x7fccd0005970 comp rx=0 tx=0).stop 2024-09-19T08:44:03.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.837+0000 7fcce5b69740 1 -- 172.21.15.7:0/3109974916 shutdown_connections 2024-09-19T08:44:03.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.837+0000 7fcce5b69740 1 --2- 172.21.15.7:0/3109974916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3d210abb0 0x55e3d2104f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.837+0000 7fcce5b69740 1 --2- 172.21.15.7:0/3109974916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d21002f0 0x55e3d21049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.837+0000 7fcce5b69740 1 --2- 172.21.15.7:0/3109974916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d20ff9d0 0x55e3d211b3c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.837+0000 7fcce5b69740 1 -- 172.21.15.7:0/3109974916 >> 172.21.15.7:0/3109974916 conn(0x55e3d20fbf60 msgr2=0x55e3d2106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:03.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.837+0000 7fcce5b69740 1 -- 172.21.15.7:0/3109974916 shutdown_connections 2024-09-19T08:44:03.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.837+0000 7fcce5b69740 1 -- 172.21.15.7:0/3109974916 wait complete. 2024-09-19T08:44:03.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.837+0000 7fcce5b69740 1 -- start start 2024-09-19T08:44:03.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.837+0000 7fcce5b69740 1 Processor -- start 2024-09-19T08:44:03.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.838+0000 7fcce5b69740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d20ff9d0 0x55e3d211df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:03.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.838+0000 7fcce5b69740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d21002f0 0x55e3d211e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:03.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.838+0000 7fcce5b69740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3d210abb0 0x55e3d2183ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:03.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.838+0000 7fcce5b69740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e3d211c6b0 con 0x55e3d21002f0 2024-09-19T08:44:03.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.838+0000 7fcce5b69740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e3d211bfe0 con 0x55e3d210abb0 2024-09-19T08:44:03.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.838+0000 7fcce5b69740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e3d211cd80 con 0x55e3d20ff9d0 2024-09-19T08:44:03.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.838+0000 7fcce5b69740 10 client.0 _ll_register_callbacks cb 0x7fccd000bb40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:44:03.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.838+0000 7fcce0d2b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d21002f0 0x55e3d211e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:03.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.838+0000 7fcce0d2b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d21002f0 0x55e3d211e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55156/0 (socket says 172.21.15.7:55156) 2024-09-19T08:44:03.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.838+0000 7fcce0d2b640 1 -- 172.21.15.7:0/859487612 learned_addr learned my addr 172.21.15.7:0/859487612 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:03.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.838+0000 7fcce152c640 1 --2- 172.21.15.7:0/859487612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d20ff9d0 0x55e3d211df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:03.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.838+0000 7fcce1d2d640 1 --2- 172.21.15.7:0/859487612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3d210abb0 0x55e3d2183ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:03.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.838+0000 7fcce0d2b640 1 -- 172.21.15.7:0/859487612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d20ff9d0 msgr2=0x55e3d211df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:03.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.838+0000 7fcce0d2b640 1 --2- 172.21.15.7:0/859487612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d20ff9d0 0x55e3d211df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.838+0000 7fcce0d2b640 1 -- 172.21.15.7:0/859487612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3d210abb0 msgr2=0x55e3d2183ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:03.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.838+0000 7fcce0d2b640 1 --2- 172.21.15.7:0/859487612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3d210abb0 0x55e3d2183ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.838+0000 7fcce0d2b640 1 -- 172.21.15.7:0/859487612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3d2184000 con 0x55e3d21002f0 2024-09-19T08:44:03.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.838+0000 7fcce0d2b640 1 --2- 172.21.15.7:0/859487612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d21002f0 0x55e3d211e440 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fccd809b000 tx=0x7fccd8017730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7521f43cbbcd9107 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:03.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.838+0000 7fccc4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:44:03.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.839+0000 7fccc4ff9640 1 -- 172.21.15.7:0/859487612 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd801e040 con 0x55e3d21002f0 2024-09-19T08:44:03.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.839+0000 7fccc4ff9640 1 -- 172.21.15.7:0/859487612 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fccd8010ca0 con 0x55e3d21002f0 2024-09-19T08:44:03.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.839+0000 7fcce5b69740 1 -- 172.21.15.7:0/859487612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e3d206db10 con 0x55e3d21002f0 2024-09-19T08:44:03.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.839+0000 7fccc4ff9640 1 -- 172.21.15.7:0/859487612 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fccd809f6b0 con 0x55e3d21002f0 2024-09-19T08:44:03.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.839+0000 7fcce5b69740 10 client.14997 fetch_fsmap learned FSMap version 24 2024-09-19T08:44:03.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.839+0000 7fcce5b69740 1 -- 172.21.15.7:0/859487612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e3d2185230 con 0x55e3d21002f0 2024-09-19T08:44:03.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.839+0000 7fccc4ff9640 1 -- 172.21.15.7:0/859487612 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55e3d206db10 con 0x55e3d21002f0 2024-09-19T08:44:03.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.839+0000 7fccc4ff9640 1 -- 172.21.15.7:0/859487612 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fccd80cc930 con 0x55e3d21002f0 2024-09-19T08:44:03.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.839+0000 7fcce5b69740 10 client.14997 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T08:44:03.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.839+0000 7fcce5b69740 10 client.14997 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:44:03.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.839+0000 7fcce5b69740 20 client.14997 populate_metadata read hostname 'smithi007' 2024-09-19T08:44:03.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.839+0000 7fcce5b69740 1 --2- 172.21.15.7:0/859487612 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e3d2189e30 0x55e3d2188b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:03.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.839+0000 7fcce5b69740 4 client.14997 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:44:03.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.839+0000 7fcce5b69740 1 -- 172.21.15.7:0/859487612 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "status"}) -- 0x55e3d1fea0e0 con 0x55e3d2189e30 2024-09-19T08:44:03.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.840+0000 7fcce152c640 1 --2- 172.21.15.7:0/859487612 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e3d2189e30 0x55e3d2188b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:03.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.840+0000 7fccc4ff9640 10 client.14997 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:44:03.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.840+0000 7fcce152c640 1 --2- 172.21.15.7:0/859487612 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e3d2189e30 0x55e3d2188b40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ec2938315bd6d6 server_cookie=a007e5b14cd4a981 in_seq=0 out_seq=0 2024-09-19T08:44:03.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.840+0000 7fccc4ff9640 1 -- 172.21.15.7:0/859487612 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55e3d1fea0e0 con 0x55e3d2189e30 2024-09-19T08:44:03.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.840+0000 7fccc4ff9640 10 client.14997 handle_command_reply: tid=0 2024-09-19T08:44:03.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.840+0000 7fcce5b69740 1 client.14997 shutdown 2024-09-19T08:44:03.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.840+0000 7fcce5b69740 1 -- 172.21.15.7:0/859487612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d21002f0 msgr2=0x55e3d211e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:03.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.840+0000 7fcce5b69740 1 --2- 172.21.15.7:0/859487612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d21002f0 0x55e3d211e440 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fccd809b000 tx=0x7fccd8017730 comp rx=0 tx=0).stop 2024-09-19T08:44:03.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.841+0000 7fcce5b69740 1 -- 172.21.15.7:0/859487612 shutdown_connections 2024-09-19T08:44:03.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.841+0000 7fcce5b69740 1 --2- 172.21.15.7:0/859487612 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e3d2189e30 0x55e3d2188b40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.841+0000 7fcce5b69740 1 --2- 172.21.15.7:0/859487612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3d210abb0 0x55e3d2183ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.841+0000 7fcce5b69740 1 --2- 172.21.15.7:0/859487612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3d21002f0 0x55e3d211e440 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.841+0000 7fcce5b69740 1 --2- 172.21.15.7:0/859487612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3d20ff9d0 0x55e3d211df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.841+0000 7fcce5b69740 1 -- 172.21.15.7:0/859487612 >> 172.21.15.7:0/859487612 conn(0x55e3d20fbf60 msgr2=0x55e3d20fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:03.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.841+0000 7fccc4ff9640 0 client.14997 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:44:03.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.841+0000 7fcce5b69740 1 -- 172.21.15.7:0/859487612 shutdown_connections 2024-09-19T08:44:03.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.841+0000 7fcce5b69740 1 -- 172.21.15.7:0/859487612 wait complete. 2024-09-19T08:44:03.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.841+0000 7fcce5b69740 20 client.14997 trim_cache size 0 max 16384 2024-09-19T08:44:03.847 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:44:03.848 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "ebd23124-7661-11ef-bceb-c7b262605968", 2024-09-19T08:44:03.848 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-09-19T08:44:03.848 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24491, 2024-09-19T08:44:03.848 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T08:44:03.848 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T08:44:03.848 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T08:44:03.848 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 78.808292073000004, 2024-09-19T08:44:03.848 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 24, 2024-09-19T08:44:03.848 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 82, 2024-09-19T08:44:03.848 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T08:44:03.849 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 89.931225929999997 2024-09-19T08:44:03.849 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:44:03.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.841+0000 7fcce3790640 1 -- 172.21.15.7:0/2840525205 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fccc80a3350 msgr2=0x7fccc80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:03.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.841+0000 7fcce3790640 1 --2- 172.21.15.7:0/2840525205 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fccc80a3350 0x7fccc80a5810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fccd402f540 tx=0x7fccd402f310 comp rx=0 tx=0).stop 2024-09-19T08:44:03.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.841+0000 7fcce3790640 1 -- 172.21.15.7:0/2840525205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccdc102790 msgr2=0x7fccdc074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:03.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.841+0000 7fcce3790640 1 --2- 172.21.15.7:0/2840525205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccdc102790 0x7fccdc074a30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fccd800b4a0 tx=0x7fccd800b960 comp rx=0 tx=0).stop 2024-09-19T08:44:03.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.841+0000 7fcce3790640 1 -- 172.21.15.7:0/2840525205 shutdown_connections 2024-09-19T08:44:03.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.841+0000 7fcce3790640 1 --2- 172.21.15.7:0/2840525205 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fccc80a3350 0x7fccc80a5810 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.841+0000 7fcce3790640 1 --2- 172.21.15.7:0/2840525205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccdc106f10 0x7fccdc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.841+0000 7fcce3790640 1 --2- 172.21.15.7:0/2840525205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccdc102790 0x7fccdc074a30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.841+0000 7fcce3790640 1 --2- 172.21.15.7:0/2840525205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccdc101de0 0x7fccdc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:03.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.841+0000 7fcce3790640 1 -- 172.21.15.7:0/2840525205 >> 172.21.15.7:0/2840525205 conn(0x7fccdc0fd8c0 msgr2=0x7fccdc0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:03.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.842+0000 7fcce3790640 1 -- 172.21.15.7:0/2840525205 shutdown_connections 2024-09-19T08:44:03.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:03.842+0000 7fcce3790640 1 -- 172.21.15.7:0/2840525205 wait complete. 2024-09-19T08:44:04.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:03 smithi007 ceph-mon[31221]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:44:04.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:03 smithi175 ceph-mon[35688]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:44:04.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:03 smithi044 ceph-mon[35072]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:44:04.485 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T08:44:04.485 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T08:44:04.501 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-19T08:44:04.501 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T08:44:04.760 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.243+0000 7ff93bcc3640 1 -- 172.21.15.7:0/3797670211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff934102e20 msgr2=0x7ff9341032a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.243+0000 7ff93bcc3640 1 --2- 172.21.15.7:0/3797670211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff934102e20 0x7ff9341032a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff924009900 tx=0x7ff92402a410 comp rx=0 tx=0).stop 2024-09-19T08:44:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.243+0000 7ff93bcc3640 1 -- 172.21.15.7:0/3797670211 shutdown_connections 2024-09-19T08:44:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.243+0000 7ff93bcc3640 1 --2- 172.21.15.7:0/3797670211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9341037e0 0x7ff93410a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.243+0000 7ff93bcc3640 1 --2- 172.21.15.7:0/3797670211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff934102e20 0x7ff9341032a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.243+0000 7ff93bcc3640 1 --2- 172.21.15.7:0/3797670211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff934101c20 0x7ff934102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.243+0000 7ff93bcc3640 1 -- 172.21.15.7:0/3797670211 >> 172.21.15.7:0/3797670211 conn(0x7ff9340fd3b0 msgr2=0x7ff9340ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.243+0000 7ff93bcc3640 1 -- 172.21.15.7:0/3797670211 shutdown_connections 2024-09-19T08:44:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.243+0000 7ff93bcc3640 1 -- 172.21.15.7:0/3797670211 wait complete. 2024-09-19T08:44:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.243+0000 7ff93bcc3640 1 Processor -- start 2024-09-19T08:44:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.243+0000 7ff93bcc3640 1 -- start start 2024-09-19T08:44:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.244+0000 7ff93bcc3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff934101c20 0x7ff934197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.244+0000 7ff93bcc3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff934102e20 0x7ff934198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.244+0000 7ff93bcc3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9341037e0 0x7ff93419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.244+0000 7ff93bcc3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff93410d8a0 con 0x7ff934101c20 2024-09-19T08:44:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.244+0000 7ff93bcc3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff93410d720 con 0x7ff934102e20 2024-09-19T08:44:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.244+0000 7ff93bcc3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff93410da20 con 0x7ff9341037e0 2024-09-19T08:44:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.244+0000 7ff939a5f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff934101c20 0x7ff934197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.244+0000 7ff939a5f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff934101c20 0x7ff934197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55180/0 (socket says 172.21.15.7:55180) 2024-09-19T08:44:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.244+0000 7ff939a5f640 1 -- 172.21.15.7:0/2279502957 learned_addr learned my addr 172.21.15.7:0/2279502957 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.244+0000 7ff93925e640 1 --2- 172.21.15.7:0/2279502957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff934102e20 0x7ff934198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.244+0000 7ff93a260640 1 --2- 172.21.15.7:0/2279502957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9341037e0 0x7ff93419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.244+0000 7ff939a5f640 1 -- 172.21.15.7:0/2279502957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9341037e0 msgr2=0x7ff93419f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.244+0000 7ff939a5f640 1 --2- 172.21.15.7:0/2279502957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9341037e0 0x7ff93419f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.244+0000 7ff939a5f640 1 -- 172.21.15.7:0/2279502957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff934102e20 msgr2=0x7ff934198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.244+0000 7ff939a5f640 1 --2- 172.21.15.7:0/2279502957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff934102e20 0x7ff934198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.244+0000 7ff939a5f640 1 -- 172.21.15.7:0/2279502957 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff93419fb60 con 0x7ff934101c20 2024-09-19T08:44:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.244+0000 7ff93925e640 1 --2- 172.21.15.7:0/2279502957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff934102e20 0x7ff934198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:44:05.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.244+0000 7ff939a5f640 1 --2- 172.21.15.7:0/2279502957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff934101c20 0x7ff934197f30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff93000c970 tx=0x7ff93000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.245+0000 7ff92affd640 1 -- 172.21.15.7:0/2279502957 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff930004220 con 0x7ff934101c20 2024-09-19T08:44:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.245+0000 7ff92affd640 1 -- 172.21.15.7:0/2279502957 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9300043c0 con 0x7ff934101c20 2024-09-19T08:44:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.245+0000 7ff93bcc3640 1 -- 172.21.15.7:0/2279502957 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff93419fe50 con 0x7ff934101c20 2024-09-19T08:44:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.245+0000 7ff92affd640 1 -- 172.21.15.7:0/2279502957 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff930004a00 con 0x7ff934101c20 2024-09-19T08:44:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.245+0000 7ff93bcc3640 1 -- 172.21.15.7:0/2279502957 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9341a0250 con 0x7ff934101c20 2024-09-19T08:44:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.246+0000 7ff93bcc3640 1 -- 172.21.15.7:0/2279502957 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff934109070 con 0x7ff934101c20 2024-09-19T08:44:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.248+0000 7ff92affd640 1 -- 172.21.15.7:0/2279502957 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ff9300079b0 con 0x7ff934101c20 2024-09-19T08:44:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.248+0000 7ff92affd640 1 --2- 172.21.15.7:0/2279502957 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff9200a3300 0x7ff9200a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.249+0000 7ff92affd640 1 -- 172.21.15.7:0/2279502957 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff9300cfb20 con 0x7ff934101c20 2024-09-19T08:44:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.249+0000 7ff93925e640 1 --2- 172.21.15.7:0/2279502957 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff9200a3300 0x7ff9200a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.249+0000 7ff93925e640 1 --2- 172.21.15.7:0/2279502957 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff9200a3300 0x7ff9200a57c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff9240314e0 tx=0x7ff924000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.251+0000 7ff92affd640 1 -- 172.21.15.7:0/2279502957 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff930014030 con 0x7ff934101c20 2024-09-19T08:44:05.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.445+0000 7ff93bcc3640 1 -- 172.21.15.7:0/2279502957 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7ff934062630 con 0x7ff9200a3300 2024-09-19T08:44:05.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.447+0000 7ff92affd640 1 -- 172.21.15.7:0/2279502957 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7ff934062630 con 0x7ff9200a3300 2024-09-19T08:44:05.447 INFO:teuthology.orchestra.run.smithi007.stdout:Backend: cephadm 2024-09-19T08:44:05.447 INFO:teuthology.orchestra.run.smithi007.stdout:Available: Yes 2024-09-19T08:44:05.447 INFO:teuthology.orchestra.run.smithi007.stdout:Paused: No 2024-09-19T08:44:05.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.449+0000 7ff93bcc3640 1 -- 172.21.15.7:0/2279502957 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff9200a3300 msgr2=0x7ff9200a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:05.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.449+0000 7ff93bcc3640 1 --2- 172.21.15.7:0/2279502957 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff9200a3300 0x7ff9200a57c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff9240314e0 tx=0x7ff924000bc0 comp rx=0 tx=0).stop 2024-09-19T08:44:05.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.449+0000 7ff93bcc3640 1 -- 172.21.15.7:0/2279502957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff934101c20 msgr2=0x7ff934197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:05.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.449+0000 7ff93bcc3640 1 --2- 172.21.15.7:0/2279502957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff934101c20 0x7ff934197f30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff93000c970 tx=0x7ff93000ce30 comp rx=0 tx=0).stop 2024-09-19T08:44:05.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.449+0000 7ff93bcc3640 1 -- 172.21.15.7:0/2279502957 shutdown_connections 2024-09-19T08:44:05.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.449+0000 7ff93bcc3640 1 --2- 172.21.15.7:0/2279502957 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff9200a3300 0x7ff9200a57c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:05.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.449+0000 7ff93bcc3640 1 --2- 172.21.15.7:0/2279502957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9341037e0 0x7ff93419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:05.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.449+0000 7ff93bcc3640 1 --2- 172.21.15.7:0/2279502957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff934102e20 0x7ff934198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:05.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.449+0000 7ff93bcc3640 1 --2- 172.21.15.7:0/2279502957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff934101c20 0x7ff934197f30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:05.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.449+0000 7ff93bcc3640 1 -- 172.21.15.7:0/2279502957 >> 172.21.15.7:0/2279502957 conn(0x7ff9340fd3b0 msgr2=0x7ff934106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:05.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.449+0000 7ff93bcc3640 1 -- 172.21.15.7:0/2279502957 shutdown_connections 2024-09-19T08:44:05.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:05.449+0000 7ff93bcc3640 1 -- 172.21.15.7:0/2279502957 wait complete. 2024-09-19T08:44:06.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:05 smithi007 ceph-mon[31221]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T08:44:06.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:05 smithi007 ceph-mon[31221]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:06.109 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T08:44:06.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:05 smithi175 ceph-mon[35688]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T08:44:06.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:05 smithi175 ceph-mon[35688]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:06.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:05 smithi044 ceph-mon[35072]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T08:44:06.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:05 smithi044 ceph-mon[35072]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:06.366 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:06.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.854+0000 7fbbfea27640 1 -- 172.21.15.7:0/636248812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbf8102f70 msgr2=0x7fbbf81033f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:06.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.854+0000 7fbbfea27640 1 --2- 172.21.15.7:0/636248812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbf8102f70 0x7fbbf81033f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0009930 tx=0x7fbbe002a420 comp rx=0 tx=0).stop 2024-09-19T08:44:06.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.854+0000 7fbbfea27640 1 -- 172.21.15.7:0/636248812 shutdown_connections 2024-09-19T08:44:06.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.854+0000 7fbbfea27640 1 --2- 172.21.15.7:0/636248812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbf8103930 0x7fbbf810a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:06.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.855+0000 7fbbfea27640 1 --2- 172.21.15.7:0/636248812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbf8102f70 0x7fbbf81033f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:06.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.855+0000 7fbbfea27640 1 --2- 172.21.15.7:0/636248812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbf80ffef0 0x7fbbf81002f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:06.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.855+0000 7fbbfea27640 1 -- 172.21.15.7:0/636248812 >> 172.21.15.7:0/636248812 conn(0x7fbbf80fba40 msgr2=0x7fbbf80fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:06.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.855+0000 7fbbfea27640 1 -- 172.21.15.7:0/636248812 shutdown_connections 2024-09-19T08:44:06.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.855+0000 7fbbfea27640 1 -- 172.21.15.7:0/636248812 wait complete. 2024-09-19T08:44:06.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.855+0000 7fbbfea27640 1 Processor -- start 2024-09-19T08:44:06.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.855+0000 7fbbfea27640 1 -- start start 2024-09-19T08:44:06.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.855+0000 7fbbfea27640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbf80ffef0 0x7fbbf81028d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:06.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.855+0000 7fbbfea27640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbf8102f70 0x7fbbf8100f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:06.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.855+0000 7fbbfea27640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbf8103930 0x7fbbf8101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:06.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.855+0000 7fbbfea27640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf810d890 con 0x7fbbf80ffef0 2024-09-19T08:44:06.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.855+0000 7fbbfea27640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf810d710 con 0x7fbbf8103930 2024-09-19T08:44:06.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.855+0000 7fbbfea27640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf810da10 con 0x7fbbf8102f70 2024-09-19T08:44:06.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.855+0000 7fbbf7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbf80ffef0 0x7fbbf81028d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:06.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.855+0000 7fbbf7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbf80ffef0 0x7fbbf81028d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55192/0 (socket says 172.21.15.7:55192) 2024-09-19T08:44:06.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.855+0000 7fbbf7fff640 1 -- 172.21.15.7:0/1786409616 learned_addr learned my addr 172.21.15.7:0/1786409616 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:06.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.856+0000 7fbbfcfc4640 1 --2- 172.21.15.7:0/1786409616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbf8103930 0x7fbbf8101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:06.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.856+0000 7fbbeffff640 1 --2- 172.21.15.7:0/1786409616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbf8102f70 0x7fbbf8100f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:06.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.856+0000 7fbbf7fff640 1 -- 172.21.15.7:0/1786409616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbf8102f70 msgr2=0x7fbbf8100f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:06.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.856+0000 7fbbf7fff640 1 --2- 172.21.15.7:0/1786409616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbf8102f70 0x7fbbf8100f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:06.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.856+0000 7fbbf7fff640 1 -- 172.21.15.7:0/1786409616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbf8103930 msgr2=0x7fbbf8101460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:06.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.856+0000 7fbbf7fff640 1 --2- 172.21.15.7:0/1786409616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbf8103930 0x7fbbf8101460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:06.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.856+0000 7fbbf7fff640 1 -- 172.21.15.7:0/1786409616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf8101d20 con 0x7fbbf80ffef0 2024-09-19T08:44:06.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.856+0000 7fbbf7fff640 1 --2- 172.21.15.7:0/1786409616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbf80ffef0 0x7fbbf81028d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800d770 tx=0x7fbbe800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:06.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.856+0000 7fbbf5ffb640 1 -- 172.21.15.7:0/1786409616 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8017070 con 0x7fbbf80ffef0 2024-09-19T08:44:06.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.856+0000 7fbbf5ffb640 1 -- 172.21.15.7:0/1786409616 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbe8009c30 con 0x7fbbf80ffef0 2024-09-19T08:44:06.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.856+0000 7fbbfea27640 1 -- 172.21.15.7:0/1786409616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf81a2110 con 0x7fbbf80ffef0 2024-09-19T08:44:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.856+0000 7fbbf5ffb640 1 -- 172.21.15.7:0/1786409616 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8003dd0 con 0x7fbbf80ffef0 2024-09-19T08:44:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.856+0000 7fbbfea27640 1 -- 172.21.15.7:0/1786409616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf81a2620 con 0x7fbbf80ffef0 2024-09-19T08:44:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.857+0000 7fbbfea27640 1 -- 172.21.15.7:0/1786409616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbf8109210 con 0x7fbbf80ffef0 2024-09-19T08:44:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.858+0000 7fbbf5ffb640 1 -- 172.21.15.7:0/1786409616 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fbbe8003fb0 con 0x7fbbf80ffef0 2024-09-19T08:44:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.859+0000 7fbbf5ffb640 1 --2- 172.21.15.7:0/1786409616 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fbbe40a32d0 0x7fbbe40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.859+0000 7fbbf5ffb640 1 -- 172.21.15.7:0/1786409616 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fbbe80cf380 con 0x7fbbf80ffef0 2024-09-19T08:44:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.859+0000 7fbbeffff640 1 --2- 172.21.15.7:0/1786409616 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fbbe40a32d0 0x7fbbe40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.859+0000 7fbbeffff640 1 --2- 172.21.15.7:0/1786409616 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fbbe40a32d0 0x7fbbe40a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0006010 tx=0x7fbbe00315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:06.863+0000 7fbbf5ffb640 1 -- 172.21.15.7:0/1786409616 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbbe8009de0 con 0x7fbbf80ffef0 2024-09-19T08:44:07.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:07.049+0000 7fbbfea27640 1 -- 172.21.15.7:0/1786409616 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fbbf8062630 con 0x7fbbe40a32d0 2024-09-19T08:44:07.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:07.061+0000 7fbbf5ffb640 1 -- 172.21.15.7:0/1786409616 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7fbbf8062630 con 0x7fbbe40a32d0 2024-09-19T08:44:07.066 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T08:44:07.066 INFO:teuthology.orchestra.run.smithi007.stdout:mds.a smithi007 running (96s) 18s ago 95s 16.6M - 19.1.1-361-g2f599a46 d2baa855c067 7e66f5d7bf70 2024-09-19T08:44:07.066 INFO:teuthology.orchestra.run.smithi007.stdout:mds.b smithi044 running (93s) 25s ago 93s 26.5M - 19.1.1-361-g2f599a46 d2baa855c067 322e2a45ab0f 2024-09-19T08:44:07.066 INFO:teuthology.orchestra.run.smithi007.stdout:mds.c smithi175 running (106s) 25s ago 106s 20.2M - 19.1.1-361-g2f599a46 d2baa855c067 29ba581350cc 2024-09-19T08:44:07.066 INFO:teuthology.orchestra.run.smithi007.stdout:mds.d smithi007 running (114s) 18s ago 113s 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 38b4260d1883 2024-09-19T08:44:07.067 INFO:teuthology.orchestra.run.smithi007.stdout:mds.e smithi044 running (111s) 25s ago 111s 16.1M - 19.1.1-361-g2f599a46 d2baa855c067 afff7b1a9892 2024-09-19T08:44:07.067 INFO:teuthology.orchestra.run.smithi007.stdout:mds.f smithi175 running (109s) 25s ago 108s 17.1M - 19.1.1-361-g2f599a46 d2baa855c067 8fec6e9e61e0 2024-09-19T08:44:07.067 INFO:teuthology.orchestra.run.smithi007.stdout:mds.g smithi007 running (99s) 18s ago 98s 16.6M - 19.1.1-361-g2f599a46 d2baa855c067 cbae8757562b 2024-09-19T08:44:07.067 INFO:teuthology.orchestra.run.smithi007.stdout:mds.h smithi044 running (104s) 25s ago 103s 17.9M - 19.1.1-361-g2f599a46 d2baa855c067 970b838a85c0 2024-09-19T08:44:07.067 INFO:teuthology.orchestra.run.smithi007.stdout:mds.i smithi175 running (101s) 25s ago 101s 20.6M - 19.1.1-361-g2f599a46 d2baa855c067 ce369a8c0e5e 2024-09-19T08:44:07.067 INFO:teuthology.orchestra.run.smithi007.stdout:mds.j smithi007 running (117s) 18s ago 117s 15.9M - 19.1.1-361-g2f599a46 d2baa855c067 a98b391b1177 2024-09-19T08:44:07.068 INFO:teuthology.orchestra.run.smithi007.stdout:mds.k smithi044 running (2m) 25s ago 2m 16.2M - 19.1.1-361-g2f599a46 d2baa855c067 b90e1c6dae33 2024-09-19T08:44:07.068 INFO:teuthology.orchestra.run.smithi007.stdout:mds.l smithi175 running (2m) 25s ago 2m 14.5M - 19.1.1-361-g2f599a46 d2baa855c067 c9abc295bb7e 2024-09-19T08:44:07.068 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi007 *:9283,8765 running (8m) 18s ago 8m 507M - 19.1.1-361-g2f599a46 d2baa855c067 f5f679817b5b 2024-09-19T08:44:07.068 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi044 *:8443,8765 running (7m) 25s ago 7m 442M - 19.1.1-361-g2f599a46 d2baa855c067 eff015c1c817 2024-09-19T08:44:07.068 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.z smithi175 *:8443,8765 running (7m) 25s ago 7m 444M - 19.1.1-361-g2f599a46 d2baa855c067 fb7cd1055273 2024-09-19T08:44:07.069 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (9m) 18s ago 9m 51.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 282f2e2cd87e 2024-09-19T08:44:07.069 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi044 running (7m) 25s ago 7m 43.1M 2048M 19.1.1-361-g2f599a46 d2baa855c067 03cb4d59dff2 2024-09-19T08:44:07.069 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi175 running (7m) 25s ago 7m 43.0M 2048M 19.1.1-361-g2f599a46 d2baa855c067 80c98532c4cd 2024-09-19T08:44:07.069 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (6m) 18s ago 6m 48.4M 4273M 19.1.1-361-g2f599a46 d2baa855c067 a0a4f44768a9 2024-09-19T08:44:07.069 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi044 running (6m) 25s ago 6m 56.2M 4273M 19.1.1-361-g2f599a46 d2baa855c067 a516a1e21856 2024-09-19T08:44:07.069 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi175 running (6m) 25s ago 6m 52.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 f556c6382f8b 2024-09-19T08:44:07.070 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (5m) 18s ago 5m 57.1M 4273M 19.1.1-361-g2f599a46 d2baa855c067 20a9fc83f591 2024-09-19T08:44:07.070 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi044 running (5m) 25s ago 5m 47.8M 4273M 19.1.1-361-g2f599a46 d2baa855c067 ef37d3632926 2024-09-19T08:44:07.070 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi175 running (4m) 25s ago 4m 46.8M 4272M 19.1.1-361-g2f599a46 d2baa855c067 23ead13e058e 2024-09-19T08:44:07.070 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi007 running (4m) 18s ago 4m 45.1M 4273M 19.1.1-361-g2f599a46 d2baa855c067 b1015be946fa 2024-09-19T08:44:07.070 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi044 running (3m) 25s ago 3m 46.4M 4273M 19.1.1-361-g2f599a46 d2baa855c067 d3762a5e1b2b 2024-09-19T08:44:07.070 INFO:teuthology.orchestra.run.smithi007.stdout:osd.8 smithi175 running (3m) 25s ago 3m 45.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 77296f382927 2024-09-19T08:44:07.071 INFO:teuthology.orchestra.run.smithi007.stdout:osd.9 smithi007 running (3m) 18s ago 3m 51.5M 4273M 19.1.1-361-g2f599a46 d2baa855c067 91c64266f783 2024-09-19T08:44:07.071 INFO:teuthology.orchestra.run.smithi007.stdout:osd.10 smithi044 running (2m) 25s ago 2m 55.1M 4273M 19.1.1-361-g2f599a46 d2baa855c067 69faeb319085 2024-09-19T08:44:07.071 INFO:teuthology.orchestra.run.smithi007.stdout:osd.11 smithi175 running (2m) 25s ago 2m 43.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 ba03899e44af 2024-09-19T08:44:07.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:07.063+0000 7fbbfea27640 1 -- 172.21.15.7:0/1786409616 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fbbe40a32d0 msgr2=0x7fbbe40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:07.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:07.063+0000 7fbbfea27640 1 --2- 172.21.15.7:0/1786409616 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fbbe40a32d0 0x7fbbe40a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0006010 tx=0x7fbbe00315b0 comp rx=0 tx=0).stop 2024-09-19T08:44:07.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:07.063+0000 7fbbfea27640 1 -- 172.21.15.7:0/1786409616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbf80ffef0 msgr2=0x7fbbf81028d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:07.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:07.063+0000 7fbbfea27640 1 --2- 172.21.15.7:0/1786409616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbf80ffef0 0x7fbbf81028d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800d770 tx=0x7fbbe800dc30 comp rx=0 tx=0).stop 2024-09-19T08:44:07.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:07.064+0000 7fbbfea27640 1 -- 172.21.15.7:0/1786409616 shutdown_connections 2024-09-19T08:44:07.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:07.064+0000 7fbbfea27640 1 --2- 172.21.15.7:0/1786409616 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fbbe40a32d0 0x7fbbe40a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:07.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:07.064+0000 7fbbfea27640 1 --2- 172.21.15.7:0/1786409616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbf8103930 0x7fbbf8101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:07.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:07.064+0000 7fbbfea27640 1 --2- 172.21.15.7:0/1786409616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbf8102f70 0x7fbbf8100f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:07.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:07.064+0000 7fbbfea27640 1 --2- 172.21.15.7:0/1786409616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbbf80ffef0 0x7fbbf81028d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:07.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:07.064+0000 7fbbfea27640 1 -- 172.21.15.7:0/1786409616 >> 172.21.15.7:0/1786409616 conn(0x7fbbf80fba40 msgr2=0x7fbbf81063e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:07.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:07.064+0000 7fbbfea27640 1 -- 172.21.15.7:0/1786409616 shutdown_connections 2024-09-19T08:44:07.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:07.064+0000 7fbbfea27640 1 -- 172.21.15.7:0/1786409616 wait complete. 2024-09-19T08:44:07.758 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T08:44:08.016 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:08.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:07 smithi007 ceph-mon[31221]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:44:08.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:07 smithi007 ceph-mon[31221]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:08.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:07 smithi175 ceph-mon[35688]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:44:08.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:07 smithi175 ceph-mon[35688]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:08.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:07 smithi044 ceph-mon[35072]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:44:08.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:07 smithi044 ceph-mon[35072]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:08.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.487+0000 7f7177146640 1 -- 172.21.15.7:0/2919236387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71701026d0 msgr2=0x7f7170108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:08.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.487+0000 7f7177146640 1 --2- 172.21.15.7:0/2919236387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71701026d0 0x7f7170108f60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7168009ca0 tx=0x7f716802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:44:08.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.487+0000 7f7177146640 1 -- 172.21.15.7:0/2919236387 shutdown_connections 2024-09-19T08:44:08.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.487+0000 7f7177146640 1 --2- 172.21.15.7:0/2919236387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71701026d0 0x7f7170108f60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:08.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.487+0000 7f7177146640 1 --2- 172.21.15.7:0/2919236387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7170101d10 0x7f7170102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.487+0000 7f7177146640 1 --2- 172.21.15.7:0/2919236387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7170100b10 0x7f7170100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.487+0000 7f7177146640 1 -- 172.21.15.7:0/2919236387 >> 172.21.15.7:0/2919236387 conn(0x7f71700fc2a0 msgr2=0x7f71700fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.487+0000 7f7177146640 1 -- 172.21.15.7:0/2919236387 shutdown_connections 2024-09-19T08:44:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.487+0000 7f7177146640 1 -- 172.21.15.7:0/2919236387 wait complete. 2024-09-19T08:44:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.487+0000 7f7177146640 1 Processor -- start 2024-09-19T08:44:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.487+0000 7f7177146640 1 -- start start 2024-09-19T08:44:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.488+0000 7f7177146640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7170100b10 0x7f7170197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.488+0000 7f7177146640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7170101d10 0x7f7170198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.488+0000 7f7177146640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71701026d0 0x7f717019f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.488+0000 7f7177146640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f717010c790 con 0x7f7170100b10 2024-09-19T08:44:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.488+0000 7f7177146640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f717010c610 con 0x7f7170101d10 2024-09-19T08:44:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.488+0000 7f7177146640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f717010c910 con 0x7f71701026d0 2024-09-19T08:44:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.488+0000 7f7174ee2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7170100b10 0x7f7170197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.488+0000 7f7174ee2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7170100b10 0x7f7170197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55208/0 (socket says 172.21.15.7:55208) 2024-09-19T08:44:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.488+0000 7f7174ee2640 1 -- 172.21.15.7:0/3212171133 learned_addr learned my addr 172.21.15.7:0/3212171133 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.488+0000 7f716ffff640 1 --2- 172.21.15.7:0/3212171133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7170101d10 0x7f7170198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.488+0000 7f71756e3640 1 --2- 172.21.15.7:0/3212171133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71701026d0 0x7f717019f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.488+0000 7f7174ee2640 1 -- 172.21.15.7:0/3212171133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71701026d0 msgr2=0x7f717019f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.488+0000 7f7174ee2640 1 --2- 172.21.15.7:0/3212171133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71701026d0 0x7f717019f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.488+0000 7f7174ee2640 1 -- 172.21.15.7:0/3212171133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7170101d10 msgr2=0x7f7170198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.488+0000 7f7174ee2640 1 --2- 172.21.15.7:0/3212171133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7170101d10 0x7f7170198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.488+0000 7f7174ee2640 1 -- 172.21.15.7:0/3212171133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717019fb10 con 0x7f7170100b10 2024-09-19T08:44:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.488+0000 7f71756e3640 1 --2- 172.21.15.7:0/3212171133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71701026d0 0x7f717019f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.488+0000 7f7174ee2640 1 --2- 172.21.15.7:0/3212171133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7170100b10 0x7f7170197ee0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f716400c970 tx=0x7f716400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.488+0000 7f716dffb640 1 -- 172.21.15.7:0/3212171133 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7164004220 con 0x7f7170100b10 2024-09-19T08:44:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.488+0000 7f716dffb640 1 -- 172.21.15.7:0/3212171133 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71640043c0 con 0x7f7170100b10 2024-09-19T08:44:08.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.488+0000 7f7177146640 1 -- 172.21.15.7:0/3212171133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f717019fe00 con 0x7f7170100b10 2024-09-19T08:44:08.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.488+0000 7f716dffb640 1 -- 172.21.15.7:0/3212171133 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7164004a00 con 0x7f7170100b10 2024-09-19T08:44:08.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.489+0000 7f7177146640 1 -- 172.21.15.7:0/3212171133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71701a0200 con 0x7f7170100b10 2024-09-19T08:44:08.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.490+0000 7f7177146640 1 -- 172.21.15.7:0/3212171133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71701a04c0 con 0x7f7170100b10 2024-09-19T08:44:08.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.491+0000 7f716dffb640 1 -- 172.21.15.7:0/3212171133 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f71640079b0 con 0x7f7170100b10 2024-09-19T08:44:08.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.491+0000 7f716dffb640 1 --2- 172.21.15.7:0/3212171133 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f71600a3300 0x7f71600a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:08.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.492+0000 7f716ffff640 1 --2- 172.21.15.7:0/3212171133 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f71600a3300 0x7f71600a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:08.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.492+0000 7f716dffb640 1 -- 172.21.15.7:0/3212171133 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f71640cf7d0 con 0x7f7170100b10 2024-09-19T08:44:08.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.492+0000 7f716ffff640 1 --2- 172.21.15.7:0/3212171133 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f71600a3300 0x7f71600a57c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7170199400 tx=0x7f715c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:08.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.496+0000 7f716dffb640 1 -- 172.21.15.7:0/3212171133 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7164014030 con 0x7f7170100b10 2024-09-19T08:44:08.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.679+0000 7f7177146640 1 -- 172.21.15.7:0/3212171133 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f71700fe4e0 con 0x7f71600a3300 2024-09-19T08:44:08.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.686+0000 7f716dffb640 1 -- 172.21.15.7:0/3212171133 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f71700fe4e0 con 0x7f71600a3300 2024-09-19T08:44:08.687 INFO:teuthology.orchestra.run.smithi007.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T08:44:08.687 INFO:teuthology.orchestra.run.smithi007.stdout:mds.all 12/12 27s ago 2m smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-09-19T08:44:08.687 INFO:teuthology.orchestra.run.smithi007.stdout:mgr 3/3 27s ago 7m smithi007=x;smithi044=y;smithi175=z;count:3 2024-09-19T08:44:08.687 INFO:teuthology.orchestra.run.smithi007.stdout:mon 3/3 27s ago 7m smithi007:172.21.15.7=a;smithi044:172.21.15.44=b;smithi175:172.21.15.175=c;count:3 2024-09-19T08:44:08.687 INFO:teuthology.orchestra.run.smithi007.stdout:osd 12 27s ago - 2024-09-19T08:44:08.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.688+0000 7f7177146640 1 -- 172.21.15.7:0/3212171133 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f71600a3300 msgr2=0x7f71600a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:08.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.688+0000 7f7177146640 1 --2- 172.21.15.7:0/3212171133 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f71600a3300 0x7f71600a57c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7170199400 tx=0x7f715c00b410 comp rx=0 tx=0).stop 2024-09-19T08:44:08.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.688+0000 7f7177146640 1 -- 172.21.15.7:0/3212171133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7170100b10 msgr2=0x7f7170197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:08.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.688+0000 7f7177146640 1 --2- 172.21.15.7:0/3212171133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7170100b10 0x7f7170197ee0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f716400c970 tx=0x7f716400ce30 comp rx=0 tx=0).stop 2024-09-19T08:44:08.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.688+0000 7f7177146640 1 -- 172.21.15.7:0/3212171133 shutdown_connections 2024-09-19T08:44:08.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.688+0000 7f7177146640 1 --2- 172.21.15.7:0/3212171133 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f71600a3300 0x7f71600a57c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:08.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.688+0000 7f7177146640 1 --2- 172.21.15.7:0/3212171133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71701026d0 0x7f717019f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:08.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.688+0000 7f7177146640 1 --2- 172.21.15.7:0/3212171133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7170101d10 0x7f7170198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:08.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.688+0000 7f7177146640 1 --2- 172.21.15.7:0/3212171133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7170100b10 0x7f7170197ee0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:08.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.688+0000 7f7177146640 1 -- 172.21.15.7:0/3212171133 >> 172.21.15.7:0/3212171133 conn(0x7f71700fc2a0 msgr2=0x7f71700fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:08.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.689+0000 7f7177146640 1 -- 172.21.15.7:0/3212171133 shutdown_connections 2024-09-19T08:44:08.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:08.689+0000 7f7177146640 1 -- 172.21.15.7:0/3212171133 wait complete. 2024-09-19T08:44:09.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:08 smithi007 ceph-mon[31221]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:09.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:08 smithi044 ceph-mon[35072]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:09.359 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T08:44:09.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:08 smithi175 ceph-mon[35688]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:10.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:09 smithi007 ceph-mon[31221]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:44:10.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.102+0000 7ff937bc3640 1 -- 172.21.15.7:0/348924567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff930101d10 msgr2=0x7ff930102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:10.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.102+0000 7ff937bc3640 1 --2- 172.21.15.7:0/348924567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff930101d10 0x7ff930102190 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff92c009900 tx=0x7ff92c02a410 comp rx=0 tx=0).stop 2024-09-19T08:44:10.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.102+0000 7ff937bc3640 1 -- 172.21.15.7:0/348924567 shutdown_connections 2024-09-19T08:44:10.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.102+0000 7ff937bc3640 1 --2- 172.21.15.7:0/348924567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9301026d0 0x7ff930108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:10.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.102+0000 7ff937bc3640 1 --2- 172.21.15.7:0/348924567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff930101d10 0x7ff930102190 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:10.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.102+0000 7ff937bc3640 1 --2- 172.21.15.7:0/348924567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff930100b10 0x7ff930100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:10.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.102+0000 7ff937bc3640 1 -- 172.21.15.7:0/348924567 >> 172.21.15.7:0/348924567 conn(0x7ff9300fc2a0 msgr2=0x7ff9300fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:10.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.102+0000 7ff937bc3640 1 -- 172.21.15.7:0/348924567 shutdown_connections 2024-09-19T08:44:10.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.102+0000 7ff937bc3640 1 -- 172.21.15.7:0/348924567 wait complete. 2024-09-19T08:44:10.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.103+0000 7ff937bc3640 1 Processor -- start 2024-09-19T08:44:10.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.103+0000 7ff937bc3640 1 -- start start 2024-09-19T08:44:10.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.103+0000 7ff937bc3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff930100b10 0x7ff93006b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:10.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.103+0000 7ff937bc3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff930101d10 0x7ff93019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:10.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.103+0000 7ff937bc3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9301026d0 0x7ff93019f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:10.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.103+0000 7ff937bc3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff93010c810 con 0x7ff9301026d0 2024-09-19T08:44:10.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.103+0000 7ff937bc3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff93010c690 con 0x7ff930100b10 2024-09-19T08:44:10.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.103+0000 7ff937bc3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff93010c990 con 0x7ff930101d10 2024-09-19T08:44:10.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.103+0000 7ff936160640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9301026d0 0x7ff93019f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:10.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.103+0000 7ff936160640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9301026d0 0x7ff93019f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55232/0 (socket says 172.21.15.7:55232) 2024-09-19T08:44:10.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.103+0000 7ff936160640 1 -- 172.21.15.7:0/100777701 learned_addr learned my addr 172.21.15.7:0/100777701 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:10.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.103+0000 7ff93595f640 1 --2- 172.21.15.7:0/100777701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff930100b10 0x7ff93006b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:10.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.103+0000 7ff93515e640 1 --2- 172.21.15.7:0/100777701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff930101d10 0x7ff93019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:10.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.103+0000 7ff936160640 1 -- 172.21.15.7:0/100777701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff930101d10 msgr2=0x7ff93019cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:10.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.103+0000 7ff936160640 1 --2- 172.21.15.7:0/100777701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff930101d10 0x7ff93019cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:10.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.103+0000 7ff936160640 1 -- 172.21.15.7:0/100777701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff930100b10 msgr2=0x7ff93006b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:10.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.103+0000 7ff936160640 1 --2- 172.21.15.7:0/100777701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff930100b10 0x7ff93006b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:10.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.103+0000 7ff936160640 1 -- 172.21.15.7:0/100777701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff93019fb90 con 0x7ff9301026d0 2024-09-19T08:44:10.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.103+0000 7ff936160640 1 --2- 172.21.15.7:0/100777701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9301026d0 0x7ff93019f2d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff92800cce0 tx=0x7ff92800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:10.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.104+0000 7ff926ffd640 1 -- 172.21.15.7:0/100777701 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92800f450 con 0x7ff9301026d0 2024-09-19T08:44:10.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.104+0000 7ff926ffd640 1 -- 172.21.15.7:0/100777701 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff92800fad0 con 0x7ff9301026d0 2024-09-19T08:44:10.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.104+0000 7ff937bc3640 1 -- 172.21.15.7:0/100777701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff93019fe80 con 0x7ff9301026d0 2024-09-19T08:44:10.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.104+0000 7ff926ffd640 1 -- 172.21.15.7:0/100777701 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff928018b60 con 0x7ff9301026d0 2024-09-19T08:44:10.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.104+0000 7ff937bc3640 1 -- 172.21.15.7:0/100777701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9301a0360 con 0x7ff9301026d0 2024-09-19T08:44:10.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.105+0000 7ff937bc3640 1 -- 172.21.15.7:0/100777701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff930107f10 con 0x7ff9301026d0 2024-09-19T08:44:10.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.106+0000 7ff926ffd640 1 -- 172.21.15.7:0/100777701 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ff92800fc80 con 0x7ff9301026d0 2024-09-19T08:44:10.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.107+0000 7ff926ffd640 1 --2- 172.21.15.7:0/100777701 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff91c0a3350 0x7ff91c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:10.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.107+0000 7ff93595f640 1 --2- 172.21.15.7:0/100777701 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff91c0a3350 0x7ff91c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:10.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.107+0000 7ff926ffd640 1 -- 172.21.15.7:0/100777701 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff9280cff60 con 0x7ff9301026d0 2024-09-19T08:44:10.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.108+0000 7ff93595f640 1 --2- 172.21.15.7:0/100777701 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff91c0a3350 0x7ff91c0a5810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff93006b870 tx=0x7ff920009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:10.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.112+0000 7ff926ffd640 1 -- 172.21.15.7:0/100777701 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff928014030 con 0x7ff9301026d0 2024-09-19T08:44:10.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.295+0000 7ff937bc3640 1 -- 172.21.15.7:0/100777701 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7ff930062630 con 0x7ff91c0a3350 2024-09-19T08:44:10.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.296+0000 7ff926ffd640 1 -- 172.21.15.7:0/100777701 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7ff930062630 con 0x7ff91c0a3350 2024-09-19T08:44:10.297 INFO:teuthology.orchestra.run.smithi007.stdout:HOST ADDR LABELS STATUS 2024-09-19T08:44:10.297 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007 172.21.15.7 2024-09-19T08:44:10.297 INFO:teuthology.orchestra.run.smithi007.stdout:smithi044 172.21.15.44 2024-09-19T08:44:10.297 INFO:teuthology.orchestra.run.smithi007.stdout:smithi175 172.21.15.175 2024-09-19T08:44:10.297 INFO:teuthology.orchestra.run.smithi007.stdout:3 hosts in cluster 2024-09-19T08:44:10.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.299+0000 7ff937bc3640 1 -- 172.21.15.7:0/100777701 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff91c0a3350 msgr2=0x7ff91c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:10.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.299+0000 7ff937bc3640 1 --2- 172.21.15.7:0/100777701 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff91c0a3350 0x7ff91c0a5810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff93006b870 tx=0x7ff920009110 comp rx=0 tx=0).stop 2024-09-19T08:44:10.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.299+0000 7ff937bc3640 1 -- 172.21.15.7:0/100777701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9301026d0 msgr2=0x7ff93019f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:10.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.299+0000 7ff937bc3640 1 --2- 172.21.15.7:0/100777701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9301026d0 0x7ff93019f2d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff92800cce0 tx=0x7ff92800a620 comp rx=0 tx=0).stop 2024-09-19T08:44:10.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.299+0000 7ff937bc3640 1 -- 172.21.15.7:0/100777701 shutdown_connections 2024-09-19T08:44:10.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.299+0000 7ff937bc3640 1 --2- 172.21.15.7:0/100777701 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7ff91c0a3350 0x7ff91c0a5810 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:10.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.299+0000 7ff937bc3640 1 --2- 172.21.15.7:0/100777701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9301026d0 0x7ff93019f2d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:10.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.299+0000 7ff937bc3640 1 --2- 172.21.15.7:0/100777701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff930101d10 0x7ff93019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:10.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.299+0000 7ff937bc3640 1 --2- 172.21.15.7:0/100777701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff930100b10 0x7ff93006b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:10.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.299+0000 7ff937bc3640 1 -- 172.21.15.7:0/100777701 >> 172.21.15.7:0/100777701 conn(0x7ff9300fc2a0 msgr2=0x7ff9301050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:10.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.299+0000 7ff937bc3640 1 -- 172.21.15.7:0/100777701 shutdown_connections 2024-09-19T08:44:10.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:10.299+0000 7ff937bc3640 1 -- 172.21.15.7:0/100777701 wait complete. 2024-09-19T08:44:10.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:09 smithi044 ceph-mon[35072]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:44:10.329 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:09 smithi175 ceph-mon[35688]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:44:10.975 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T08:44:11.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:10 smithi007 ceph-mon[31221]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:11.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:10 smithi044 ceph-mon[35072]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:11.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:10 smithi175 ceph-mon[35688]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:11.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.666+0000 7fef07084640 1 -- 172.21.15.7:0/1412753530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef00105030 msgr2=0x7fef00107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:11.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.666+0000 7fef07084640 1 --2- 172.21.15.7:0/1412753530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef00105030 0x7fef00107420 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7feeec009900 tx=0x7feeec02a410 comp rx=0 tx=0).stop 2024-09-19T08:44:11.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.666+0000 7fef07084640 1 -- 172.21.15.7:0/1412753530 shutdown_connections 2024-09-19T08:44:11.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.666+0000 7fef07084640 1 --2- 172.21.15.7:0/1412753530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef00107960 0x7fef00109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:11.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.666+0000 7fef07084640 1 --2- 172.21.15.7:0/1412753530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef00105030 0x7fef00107420 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:11.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.666+0000 7fef07084640 1 --2- 172.21.15.7:0/1412753530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef00102700 0x7fef00104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:11.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.666+0000 7fef07084640 1 -- 172.21.15.7:0/1412753530 >> 172.21.15.7:0/1412753530 conn(0x7fef000fc2a0 msgr2=0x7fef000fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:11.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.666+0000 7fef07084640 1 -- 172.21.15.7:0/1412753530 shutdown_connections 2024-09-19T08:44:11.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.666+0000 7fef07084640 1 -- 172.21.15.7:0/1412753530 wait complete. 2024-09-19T08:44:11.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.667+0000 7fef07084640 1 Processor -- start 2024-09-19T08:44:11.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.667+0000 7fef07084640 1 -- start start 2024-09-19T08:44:11.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.667+0000 7fef07084640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef00102700 0x7fef00197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:11.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.667+0000 7fef07084640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef00105030 0x7fef00198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:11.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.667+0000 7fef07084640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef00107960 0x7fef0019f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:11.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.667+0000 7fef07084640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fef0010d940 con 0x7fef00102700 2024-09-19T08:44:11.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.667+0000 7fef07084640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fef0010d7c0 con 0x7fef00107960 2024-09-19T08:44:11.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.667+0000 7fef07084640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fef0010dac0 con 0x7fef00105030 2024-09-19T08:44:11.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.667+0000 7fef04e20640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef00102700 0x7fef00197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:11.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.667+0000 7feefffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef00105030 0x7fef00198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:11.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.667+0000 7fef04e20640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef00102700 0x7fef00197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55242/0 (socket says 172.21.15.7:55242) 2024-09-19T08:44:11.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.667+0000 7fef04e20640 1 -- 172.21.15.7:0/2042266781 learned_addr learned my addr 172.21.15.7:0/2042266781 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.667+0000 7fef05621640 1 --2- 172.21.15.7:0/2042266781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef00107960 0x7fef0019f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.668+0000 7fef04e20640 1 -- 172.21.15.7:0/2042266781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef00105030 msgr2=0x7fef00198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.668+0000 7fef04e20640 1 --2- 172.21.15.7:0/2042266781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef00105030 0x7fef00198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.668+0000 7fef04e20640 1 -- 172.21.15.7:0/2042266781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef00107960 msgr2=0x7fef0019f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.668+0000 7fef04e20640 1 --2- 172.21.15.7:0/2042266781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef00107960 0x7fef0019f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.668+0000 7fef04e20640 1 -- 172.21.15.7:0/2042266781 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef0019fc00 con 0x7fef00102700 2024-09-19T08:44:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.668+0000 7feefffff640 1 --2- 172.21.15.7:0/2042266781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef00105030 0x7fef00198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:44:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.668+0000 7fef04e20640 1 --2- 172.21.15.7:0/2042266781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef00102700 0x7fef00197fd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7feef400d950 tx=0x7feef400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.668+0000 7feefdffb640 1 -- 172.21.15.7:0/2042266781 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef4017070 con 0x7fef00102700 2024-09-19T08:44:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.668+0000 7feefdffb640 1 -- 172.21.15.7:0/2042266781 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feef4009c30 con 0x7fef00102700 2024-09-19T08:44:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.668+0000 7fef07084640 1 -- 172.21.15.7:0/2042266781 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef0019fef0 con 0x7fef00102700 2024-09-19T08:44:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.668+0000 7feefdffb640 1 -- 172.21.15.7:0/2042266781 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef400f6b0 con 0x7fef00102700 2024-09-19T08:44:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.668+0000 7fef07084640 1 -- 172.21.15.7:0/2042266781 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef001a03c0 con 0x7fef00102700 2024-09-19T08:44:11.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.670+0000 7fef07084640 1 -- 172.21.15.7:0/2042266781 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef000fdd90 con 0x7fef00102700 2024-09-19T08:44:11.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.671+0000 7feefdffb640 1 -- 172.21.15.7:0/2042266781 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7feef40109d0 con 0x7fef00102700 2024-09-19T08:44:11.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.671+0000 7feefdffb640 1 --2- 172.21.15.7:0/2042266781 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7feef00a3300 0x7feef00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:11.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.671+0000 7feefffff640 1 --2- 172.21.15.7:0/2042266781 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7feef00a3300 0x7feef00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:11.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.671+0000 7feefdffb640 1 -- 172.21.15.7:0/2042266781 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7feef40cf930 con 0x7fef00102700 2024-09-19T08:44:11.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.672+0000 7feefffff640 1 --2- 172.21.15.7:0/2042266781 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7feef00a3300 0x7feef00a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7feeec02aa00 tx=0x7feeec0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:11.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.676+0000 7feefdffb640 1 -- 172.21.15.7:0/2042266781 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feef409bea0 con 0x7fef00102700 2024-09-19T08:44:11.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.858+0000 7fef07084640 1 -- 172.21.15.7:0/2042266781 --> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fef00062630 con 0x7feef00a3300 2024-09-19T08:44:11.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.860+0000 7feefdffb640 1 -- 172.21.15.7:0/2042266781 <== mgr.14150 v2:172.21.15.7:6800/3577760109 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fef00062630 con 0x7feef00a3300 2024-09-19T08:44:11.860 INFO:teuthology.orchestra.run.smithi007.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T08:44:11.860 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300GE480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-19T08:44:11.861 INFO:teuthology.orchestra.run.smithi007.stdout:smithi044 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331001K400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T08:44:11.861 INFO:teuthology.orchestra.run.smithi007.stdout:smithi175 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300M0400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T08:44:11.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.861+0000 7fef07084640 1 -- 172.21.15.7:0/2042266781 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7feef00a3300 msgr2=0x7feef00a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:11.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.862+0000 7fef07084640 1 --2- 172.21.15.7:0/2042266781 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7feef00a3300 0x7feef00a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7feeec02aa00 tx=0x7feeec0315b0 comp rx=0 tx=0).stop 2024-09-19T08:44:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.862+0000 7fef07084640 1 -- 172.21.15.7:0/2042266781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef00102700 msgr2=0x7fef00197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.862+0000 7fef07084640 1 --2- 172.21.15.7:0/2042266781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef00102700 0x7fef00197fd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7feef400d950 tx=0x7feef400de10 comp rx=0 tx=0).stop 2024-09-19T08:44:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.862+0000 7fef07084640 1 -- 172.21.15.7:0/2042266781 shutdown_connections 2024-09-19T08:44:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.862+0000 7fef07084640 1 --2- 172.21.15.7:0/2042266781 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7feef00a3300 0x7feef00a57c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.862+0000 7fef07084640 1 --2- 172.21.15.7:0/2042266781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef00107960 0x7fef0019f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.862+0000 7fef07084640 1 --2- 172.21.15.7:0/2042266781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef00105030 0x7fef00198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.862+0000 7fef07084640 1 --2- 172.21.15.7:0/2042266781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef00102700 0x7fef00197fd0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.862+0000 7fef07084640 1 -- 172.21.15.7:0/2042266781 >> 172.21.15.7:0/2042266781 conn(0x7fef000fc2a0 msgr2=0x7fef00102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.862+0000 7fef07084640 1 -- 172.21.15.7:0/2042266781 shutdown_connections 2024-09-19T08:44:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:11.862+0000 7fef07084640 1 -- 172.21.15.7:0/2042266781 wait complete. 2024-09-19T08:44:12.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:11 smithi007 ceph-mon[31221]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:44:12.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:11 smithi044 ceph-mon[35072]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:44:12.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:11 smithi175 ceph-mon[35688]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:44:12.628 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T08:44:12.637 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-19T08:44:12.637 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T08:44:12.894 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:13.266 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:12 smithi007 ceph-mon[31221]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:13.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:12 smithi044 ceph-mon[35072]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:13.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.349+0000 7fb93fc0f640 1 -- 172.21.15.7:0/2257568297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb938102690 msgr2=0x7fb938108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:13.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.349+0000 7fb93fc0f640 1 --2- 172.21.15.7:0/2257568297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb938102690 0x7fb938108f20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb930009ca0 tx=0x7fb93002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.349+0000 7fb93fc0f640 1 -- 172.21.15.7:0/2257568297 shutdown_connections 2024-09-19T08:44:13.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.349+0000 7fb93fc0f640 1 --2- 172.21.15.7:0/2257568297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb938102690 0x7fb938108f20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.349+0000 7fb93fc0f640 1 --2- 172.21.15.7:0/2257568297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb938101cd0 0x7fb938102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.349+0000 7fb93fc0f640 1 --2- 172.21.15.7:0/2257568297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb938100ad0 0x7fb938100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.349+0000 7fb93fc0f640 1 -- 172.21.15.7:0/2257568297 >> 172.21.15.7:0/2257568297 conn(0x7fb9380fc280 msgr2=0x7fb9380fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:13.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.349+0000 7fb93fc0f640 1 -- 172.21.15.7:0/2257568297 shutdown_connections 2024-09-19T08:44:13.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.349+0000 7fb93fc0f640 1 -- 172.21.15.7:0/2257568297 wait complete. 2024-09-19T08:44:13.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.350+0000 7fb93fc0f640 1 Processor -- start 2024-09-19T08:44:13.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.350+0000 7fb93fc0f640 1 -- start start 2024-09-19T08:44:13.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.350+0000 7fb93fc0f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb938100ad0 0x7fb93806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:13.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.350+0000 7fb93fc0f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb938101cd0 0x7fb93819c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:13.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.350+0000 7fb93fc0f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb938102690 0x7fb93819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:13.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.350+0000 7fb93fc0f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb93810c730 con 0x7fb938100ad0 2024-09-19T08:44:13.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.350+0000 7fb93fc0f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb93810c5b0 con 0x7fb938102690 2024-09-19T08:44:13.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.350+0000 7fb93fc0f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb93810c8b0 con 0x7fb938101cd0 2024-09-19T08:44:13.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.350+0000 7fb93d9ab640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb938100ad0 0x7fb93806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:13.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.350+0000 7fb93d9ab640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb938100ad0 0x7fb93806ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45252/0 (socket says 172.21.15.7:45252) 2024-09-19T08:44:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.350+0000 7fb93d9ab640 1 -- 172.21.15.7:0/4076665989 learned_addr learned my addr 172.21.15.7:0/4076665989 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.350+0000 7fb93d1aa640 1 --2- 172.21.15.7:0/4076665989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb938101cd0 0x7fb93819c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.350+0000 7fb93e1ac640 1 --2- 172.21.15.7:0/4076665989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb938102690 0x7fb93819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.351+0000 7fb93d9ab640 1 -- 172.21.15.7:0/4076665989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb938101cd0 msgr2=0x7fb93819c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.351+0000 7fb93d9ab640 1 --2- 172.21.15.7:0/4076665989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb938101cd0 0x7fb93819c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.351+0000 7fb93d9ab640 1 -- 172.21.15.7:0/4076665989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb938102690 msgr2=0x7fb93819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.351+0000 7fb93d9ab640 1 --2- 172.21.15.7:0/4076665989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb938102690 0x7fb93819ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.351+0000 7fb93d9ab640 1 -- 172.21.15.7:0/4076665989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93819f830 con 0x7fb938100ad0 2024-09-19T08:44:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.351+0000 7fb93e1ac640 1 --2- 172.21.15.7:0/4076665989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb938102690 0x7fb93819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.351+0000 7fb93d9ab640 1 --2- 172.21.15.7:0/4076665989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb938100ad0 0x7fb93806ab10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb93400c970 tx=0x7fb93400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.351+0000 7fb92effd640 1 -- 172.21.15.7:0/4076665989 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb934007c10 con 0x7fb938100ad0 2024-09-19T08:44:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.351+0000 7fb93fc0f640 1 -- 172.21.15.7:0/4076665989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb93819fb20 con 0x7fb938100ad0 2024-09-19T08:44:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.351+0000 7fb92effd640 1 -- 172.21.15.7:0/4076665989 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb934007db0 con 0x7fb938100ad0 2024-09-19T08:44:13.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.351+0000 7fb92effd640 1 -- 172.21.15.7:0/4076665989 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93400f8a0 con 0x7fb938100ad0 2024-09-19T08:44:13.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.351+0000 7fb93fc0f640 1 -- 172.21.15.7:0/4076665989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9381a0060 con 0x7fb938100ad0 2024-09-19T08:44:13.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.352+0000 7fb93fc0f640 1 -- 172.21.15.7:0/4076665989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb938106900 con 0x7fb938100ad0 2024-09-19T08:44:13.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.354+0000 7fb92effd640 1 -- 172.21.15.7:0/4076665989 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fb93400fa40 con 0x7fb938100ad0 2024-09-19T08:44:13.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.354+0000 7fb92effd640 1 --2- 172.21.15.7:0/4076665989 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb9240a32d0 0x7fb9240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:13.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.354+0000 7fb93d1aa640 1 --2- 172.21.15.7:0/4076665989 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb9240a32d0 0x7fb9240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:13.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.354+0000 7fb92effd640 1 -- 172.21.15.7:0/4076665989 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb9340d0030 con 0x7fb938100ad0 2024-09-19T08:44:13.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.355+0000 7fb93d1aa640 1 --2- 172.21.15.7:0/4076665989 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb9240a32d0 0x7fb9240a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb93806a890 tx=0x7fb92800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:13.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.358+0000 7fb92effd640 1 -- 172.21.15.7:0/4076665989 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb93409cd10 con 0x7fb938100ad0 2024-09-19T08:44:13.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:12 smithi175 ceph-mon[35688]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:13.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.574+0000 7fb93fc0f640 1 -- 172.21.15.7:0/4076665989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb938106d40 con 0x7fb938100ad0 2024-09-19T08:44:13.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.574+0000 7fb92effd640 1 -- 172.21.15.7:0/4076665989 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3078 (secure 0 0 0) 0x7fb93409c610 con 0x7fb938100ad0 2024-09-19T08:44:13.575 INFO:teuthology.orchestra.run.smithi007.stdout:e24 2024-09-19T08:44:13.575 INFO:teuthology.orchestra.run.smithi007.stdout:btime 2024-09-19T08:42:56:086840+0000 2024-09-19T08:44:13.575 INFO:teuthology.orchestra.run.smithi007.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:44:13.575 INFO:teuthology.orchestra.run.smithi007.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:44:13.576 INFO:teuthology.orchestra.run.smithi007.stdout:legacy client fscid: 1 2024-09-19T08:44:13.576 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:44:13.576 INFO:teuthology.orchestra.run.smithi007.stdout:Filesystem 'cephfs' (1) 2024-09-19T08:44:13.576 INFO:teuthology.orchestra.run.smithi007.stdout:fs_name cephfs 2024-09-19T08:44:13.576 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 24 2024-09-19T08:44:13.576 INFO:teuthology.orchestra.run.smithi007.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T08:44:13.576 INFO:teuthology.orchestra.run.smithi007.stdout:created 2024-09-19T08:42:44.586692+0000 2024-09-19T08:44:13.576 INFO:teuthology.orchestra.run.smithi007.stdout:modified 2024-09-19T08:42:55.696739+0000 2024-09-19T08:44:13.576 INFO:teuthology.orchestra.run.smithi007.stdout:tableserver 0 2024-09-19T08:44:13.576 INFO:teuthology.orchestra.run.smithi007.stdout:root 0 2024-09-19T08:44:13.576 INFO:teuthology.orchestra.run.smithi007.stdout:session_timeout 300 2024-09-19T08:44:13.576 INFO:teuthology.orchestra.run.smithi007.stdout:session_autoclose 300 2024-09-19T08:44:13.576 INFO:teuthology.orchestra.run.smithi007.stdout:max_file_size 1099511627776 2024-09-19T08:44:13.577 INFO:teuthology.orchestra.run.smithi007.stdout:max_xattr_size 65536 2024-09-19T08:44:13.577 INFO:teuthology.orchestra.run.smithi007.stdout:required_client_features {} 2024-09-19T08:44:13.577 INFO:teuthology.orchestra.run.smithi007.stdout:last_failure 0 2024-09-19T08:44:13.577 INFO:teuthology.orchestra.run.smithi007.stdout:last_failure_osd_epoch 0 2024-09-19T08:44:13.577 INFO:teuthology.orchestra.run.smithi007.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:44:13.577 INFO:teuthology.orchestra.run.smithi007.stdout:max_mds 3 2024-09-19T08:44:13.577 INFO:teuthology.orchestra.run.smithi007.stdout:in 0,1,2 2024-09-19T08:44:13.577 INFO:teuthology.orchestra.run.smithi007.stdout:up {0=24491,1=24472,2=24458} 2024-09-19T08:44:13.577 INFO:teuthology.orchestra.run.smithi007.stdout:failed 2024-09-19T08:44:13.577 INFO:teuthology.orchestra.run.smithi007.stdout:damaged 2024-09-19T08:44:13.577 INFO:teuthology.orchestra.run.smithi007.stdout:stopped 2024-09-19T08:44:13.577 INFO:teuthology.orchestra.run.smithi007.stdout:data_pools [3] 2024-09-19T08:44:13.577 INFO:teuthology.orchestra.run.smithi007.stdout:metadata_pool 2 2024-09-19T08:44:13.578 INFO:teuthology.orchestra.run.smithi007.stdout:inline_data disabled 2024-09-19T08:44:13.578 INFO:teuthology.orchestra.run.smithi007.stdout:balancer 2024-09-19T08:44:13.578 INFO:teuthology.orchestra.run.smithi007.stdout:bal_rank_mask -1 2024-09-19T08:44:13.578 INFO:teuthology.orchestra.run.smithi007.stdout:standby_count_wanted 0 2024-09-19T08:44:13.578 INFO:teuthology.orchestra.run.smithi007.stdout:qdb_cluster leader: 24491 members: 24458,24472,24491 2024-09-19T08:44:13.578 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b{0:24491} state up:active seq 4 addr [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:44:13.578 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c{0:24457} state up:standby-replay seq 1 addr [v2:172.21.15.175:6836/2128553811,v1:172.21.15.175:6837/2128553811] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:44:13.579 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.i{1:24472} state up:active seq 8 addr [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:44:13.579 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.f{1:24445} state up:standby-replay seq 1 addr [v2:172.21.15.175:6834/1285566250,v1:172.21.15.175:6835/1285566250] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:44:13.579 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.h{2:24458} state up:active seq 9 addr [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:44:13.579 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.e{2:24443} state up:standby-replay seq 1 addr [v2:172.21.15.44:6834/2261554115,v1:172.21.15.44:6835/2261554115] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:44:13.579 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:44:13.579 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:44:13.579 INFO:teuthology.orchestra.run.smithi007.stdout:Standby daemons: 2024-09-19T08:44:13.579 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:44:13.579 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.j{-1:14541} state up:standby seq 1 addr [v2:172.21.15.7:6834/1124869309,v1:172.21.15.7:6835/1124869309] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:44:13.579 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.d{-1:14553} state up:standby seq 1 addr [v2:172.21.15.7:6836/1936828409,v1:172.21.15.7:6837/1936828409] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:44:13.580 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.g{-1:14592} state up:standby seq 1 addr [v2:172.21.15.7:6838/2793016476,v1:172.21.15.7:6839/2793016476] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:44:13.580 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a{-1:14598} state up:standby seq 1 addr [v2:172.21.15.7:6840/1259465331,v1:172.21.15.7:6841/1259465331] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:44:13.580 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.l{-1:24415} state up:standby seq 1 addr [v2:172.21.15.175:6832/344689321,v1:172.21.15.175:6833/344689321] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:44:13.580 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.k{-1:24416} state up:standby seq 1 addr [v2:172.21.15.44:6832/1773724086,v1:172.21.15.44:6833/1773724086] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:44:13.581 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-19T08:44:13.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.577+0000 7fb93fc0f640 1 -- 172.21.15.7:0/4076665989 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb9240a32d0 msgr2=0x7fb9240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:13.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.577+0000 7fb93fc0f640 1 --2- 172.21.15.7:0/4076665989 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb9240a32d0 0x7fb9240a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb93806a890 tx=0x7fb92800b390 comp rx=0 tx=0).stop 2024-09-19T08:44:13.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.577+0000 7fb93fc0f640 1 -- 172.21.15.7:0/4076665989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb938100ad0 msgr2=0x7fb93806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:13.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.577+0000 7fb93fc0f640 1 --2- 172.21.15.7:0/4076665989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb938100ad0 0x7fb93806ab10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb93400c970 tx=0x7fb93400ce30 comp rx=0 tx=0).stop 2024-09-19T08:44:13.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.577+0000 7fb93fc0f640 1 -- 172.21.15.7:0/4076665989 shutdown_connections 2024-09-19T08:44:13.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.577+0000 7fb93fc0f640 1 --2- 172.21.15.7:0/4076665989 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fb9240a32d0 0x7fb9240a5790 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.577+0000 7fb93fc0f640 1 --2- 172.21.15.7:0/4076665989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb938102690 0x7fb93819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.577+0000 7fb93fc0f640 1 --2- 172.21.15.7:0/4076665989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb938101cd0 0x7fb93819c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.577+0000 7fb93fc0f640 1 --2- 172.21.15.7:0/4076665989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb938100ad0 0x7fb93806ab10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.577+0000 7fb93fc0f640 1 -- 172.21.15.7:0/4076665989 >> 172.21.15.7:0/4076665989 conn(0x7fb9380fc280 msgr2=0x7fb9380fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:13.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.577+0000 7fb93fc0f640 1 -- 172.21.15.7:0/4076665989 shutdown_connections 2024-09-19T08:44:13.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:13.578+0000 7fb93fc0f640 1 -- 172.21.15.7:0/4076665989 wait complete. 2024-09-19T08:44:14.212 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:13 smithi007 ceph-mon[31221]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:44:14.212 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:13 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/4076665989' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T08:44:14.241 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T08:44:14.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:13 smithi044 ceph-mon[35072]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:44:14.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:13 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/4076665989' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T08:44:14.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:13 smithi175 ceph-mon[35688]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:44:14.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:13 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/4076665989' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T08:44:14.494 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.989+0000 7f1a5082d640 1 -- 172.21.15.7:0/4293076579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a4c100b10 msgr2=0x7f1a4c100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.989+0000 7f1a5082d640 1 --2- 172.21.15.7:0/4293076579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a4c100b10 0x7f1a4c100f10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c009900 tx=0x7f1a3c02a410 comp rx=0 tx=0).stop 2024-09-19T08:44:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.989+0000 7f1a5082d640 1 -- 172.21.15.7:0/4293076579 shutdown_connections 2024-09-19T08:44:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.989+0000 7f1a5082d640 1 --2- 172.21.15.7:0/4293076579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a4c1026d0 0x7f1a4c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.989+0000 7f1a5082d640 1 --2- 172.21.15.7:0/4293076579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a4c101d10 0x7f1a4c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.989+0000 7f1a5082d640 1 --2- 172.21.15.7:0/4293076579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a4c100b10 0x7f1a4c100f10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.989+0000 7f1a5082d640 1 -- 172.21.15.7:0/4293076579 >> 172.21.15.7:0/4293076579 conn(0x7f1a4c0fc2a0 msgr2=0x7f1a4c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.989+0000 7f1a5082d640 1 -- 172.21.15.7:0/4293076579 shutdown_connections 2024-09-19T08:44:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.989+0000 7f1a5082d640 1 -- 172.21.15.7:0/4293076579 wait complete. 2024-09-19T08:44:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.990+0000 7f1a5082d640 1 Processor -- start 2024-09-19T08:44:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.990+0000 7f1a5082d640 1 -- start start 2024-09-19T08:44:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.990+0000 7f1a5082d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a4c100b10 0x7f1a4c197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.990+0000 7f1a5082d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a4c101d10 0x7f1a4c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.990+0000 7f1a5082d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a4c1026d0 0x7f1a4c19f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.990+0000 7f1a5082d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c10d920 con 0x7f1a4c1026d0 2024-09-19T08:44:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.990+0000 7f1a5082d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c10d7a0 con 0x7f1a4c101d10 2024-09-19T08:44:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.990+0000 7f1a5082d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c10daa0 con 0x7f1a4c100b10 2024-09-19T08:44:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.990+0000 7f1a4ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a4c1026d0 0x7f1a4c19f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.990+0000 7f1a4ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a4c1026d0 0x7f1a4c19f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45276/0 (socket says 172.21.15.7:45276) 2024-09-19T08:44:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.990+0000 7f1a4ad9d640 1 -- 172.21.15.7:0/846127379 learned_addr learned my addr 172.21.15.7:0/846127379 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.991+0000 7f1a4a59c640 1 --2- 172.21.15.7:0/846127379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a4c100b10 0x7f1a4c197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.991+0000 7f1a49d9b640 1 --2- 172.21.15.7:0/846127379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a4c101d10 0x7f1a4c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.991+0000 7f1a4ad9d640 1 -- 172.21.15.7:0/846127379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a4c100b10 msgr2=0x7f1a4c197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.991+0000 7f1a4ad9d640 1 --2- 172.21.15.7:0/846127379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a4c100b10 0x7f1a4c197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.991+0000 7f1a4ad9d640 1 -- 172.21.15.7:0/846127379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a4c101d10 msgr2=0x7f1a4c1984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.991+0000 7f1a4ad9d640 1 --2- 172.21.15.7:0/846127379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a4c101d10 0x7f1a4c1984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.991+0000 7f1a4ad9d640 1 -- 172.21.15.7:0/846127379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4c19fbd0 con 0x7f1a4c1026d0 2024-09-19T08:44:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.991+0000 7f1a4ad9d640 1 --2- 172.21.15.7:0/846127379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a4c1026d0 0x7f1a4c19f560 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400b970 tx=0x7f1a4400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.991+0000 7f1a3b7fe640 1 -- 172.21.15.7:0/846127379 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44019070 con 0x7f1a4c1026d0 2024-09-19T08:44:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.991+0000 7f1a3b7fe640 1 -- 172.21.15.7:0/846127379 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a4400cb40 con 0x7f1a4c1026d0 2024-09-19T08:44:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.991+0000 7f1a5082d640 1 -- 172.21.15.7:0/846127379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a4c19fec0 con 0x7f1a4c1026d0 2024-09-19T08:44:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.991+0000 7f1a3b7fe640 1 -- 172.21.15.7:0/846127379 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44007650 con 0x7f1a4c1026d0 2024-09-19T08:44:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.991+0000 7f1a5082d640 1 -- 172.21.15.7:0/846127379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a4c1a03a0 con 0x7f1a4c1026d0 2024-09-19T08:44:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.992+0000 7f1a5082d640 1 -- 172.21.15.7:0/846127379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a4c107f60 con 0x7f1a4c1026d0 2024-09-19T08:44:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.994+0000 7f1a3b7fe640 1 -- 172.21.15.7:0/846127379 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f1a4401c070 con 0x7f1a4c1026d0 2024-09-19T08:44:15.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.994+0000 7f1a3b7fe640 1 --2- 172.21.15.7:0/846127379 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1a340a3300 0x7f1a340a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:15.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.994+0000 7f1a4a59c640 1 --2- 172.21.15.7:0/846127379 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1a340a3300 0x7f1a340a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:15.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.994+0000 7f1a3b7fe640 1 -- 172.21.15.7:0/846127379 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1a440cef20 con 0x7f1a4c1026d0 2024-09-19T08:44:15.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.995+0000 7f1a4a59c640 1 --2- 172.21.15.7:0/846127379 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1a340a3300 0x7f1a340a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c005ab0 tx=0x7f1a3c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:15.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:14.998+0000 7f1a3b7fe640 1 -- 172.21.15.7:0/846127379 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1a4409b5a0 con 0x7f1a4c1026d0 2024-09-19T08:44:15.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:15.177+0000 7f1a5082d640 1 -- 172.21.15.7:0/846127379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f1a4c02d990 con 0x7f1a4c1026d0 2024-09-19T08:44:15.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:15.178+0000 7f1a3b7fe640 1 -- 172.21.15.7:0/846127379 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v82) ==== 56+0+5276 (secure 0 0 0) 0x7f1a4409f8a0 con 0x7f1a4c1026d0 2024-09-19T08:44:15.178 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 82 2024-09-19T08:44:15.179 INFO:teuthology.orchestra.run.smithi007.stdout:fsid ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:44:15.179 INFO:teuthology.orchestra.run.smithi007.stdout:created 2024-09-19T08:35:02.287380+0000 2024-09-19T08:44:15.179 INFO:teuthology.orchestra.run.smithi007.stdout:modified 2024-09-19T08:42:58.097469+0000 2024-09-19T08:44:15.179 INFO:teuthology.orchestra.run.smithi007.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T08:44:15.179 INFO:teuthology.orchestra.run.smithi007.stdout:crush_version 26 2024-09-19T08:44:15.179 INFO:teuthology.orchestra.run.smithi007.stdout:full_ratio 0.95 2024-09-19T08:44:15.179 INFO:teuthology.orchestra.run.smithi007.stdout:backfillfull_ratio 0.9 2024-09-19T08:44:15.179 INFO:teuthology.orchestra.run.smithi007.stdout:nearfull_ratio 0.85 2024-09-19T08:44:15.179 INFO:teuthology.orchestra.run.smithi007.stdout:require_min_compat_client luminous 2024-09-19T08:44:15.179 INFO:teuthology.orchestra.run.smithi007.stdout:min_compat_client luminous 2024-09-19T08:44:15.179 INFO:teuthology.orchestra.run.smithi007.stdout:require_osd_release squid 2024-09-19T08:44:15.179 INFO:teuthology.orchestra.run.smithi007.stdout:stretch_mode_enabled false 2024-09-19T08:44:15.180 INFO:teuthology.orchestra.run.smithi007.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T08:44:15.180 INFO:teuthology.orchestra.run.smithi007.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-19T08:44:15.180 INFO:teuthology.orchestra.run.smithi007.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-19T08:44:15.180 INFO:teuthology.orchestra.run.smithi007.stdout:max_osd 12 2024-09-19T08:44:15.180 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 up in weight 1 up_from 8 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6802/402668717,v1:172.21.15.7:6803/402668717] [v2:172.21.15.7:6804/402668717,v1:172.21.15.7:6805/402668717] exists,up 837e6267-71c7-4f48-9e0b-4e3f124682b5 2024-09-19T08:44:15.180 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 up in weight 1 up_from 13 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6800/2213694259,v1:172.21.15.44:6801/2213694259] [v2:172.21.15.44:6802/2213694259,v1:172.21.15.44:6803/2213694259] exists,up 67865372-ac22-4b30-bd02-498e118d6701 2024-09-19T08:44:15.180 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 up in weight 1 up_from 17 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6800/3413002145,v1:172.21.15.175:6801/3413002145] [v2:172.21.15.175:6802/3413002145,v1:172.21.15.175:6803/3413002145] exists,up 37c1cc2b-60ea-449f-baa7-c65d96c3559c 2024-09-19T08:44:15.180 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 up in weight 1 up_from 24 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6810/2528867083,v1:172.21.15.7:6811/2528867083] [v2:172.21.15.7:6812/2528867083,v1:172.21.15.7:6813/2528867083] exists,up a8ffd2ae-4211-492a-a8ac-d4d6cbb4a03d 2024-09-19T08:44:15.180 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 up in weight 1 up_from 32 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6808/3537143774,v1:172.21.15.44:6809/3537143774] [v2:172.21.15.44:6810/3537143774,v1:172.21.15.44:6811/3537143774] exists,up 9a67b2ec-1a0a-413e-bd13-9532f24a0155 2024-09-19T08:44:15.180 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 up in weight 1 up_from 37 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6808/4001214751,v1:172.21.15.175:6809/4001214751] [v2:172.21.15.175:6810/4001214751,v1:172.21.15.175:6811/4001214751] exists,up 436cd596-710b-48e2-8255-8427c93cee1a 2024-09-19T08:44:15.180 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 up in weight 1 up_from 44 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6818/1261079202,v1:172.21.15.7:6819/1261079202] [v2:172.21.15.7:6820/1261079202,v1:172.21.15.7:6821/1261079202] exists,up f5a7ad2b-6b44-4b5a-8af7-f7fb00e7ca68 2024-09-19T08:44:15.180 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 up in weight 1 up_from 49 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6816/3120822957,v1:172.21.15.44:6817/3120822957] [v2:172.21.15.44:6818/3120822957,v1:172.21.15.44:6819/3120822957] exists,up aa24aee5-6449-4842-8831-1c8e06cde75b 2024-09-19T08:44:15.181 INFO:teuthology.orchestra.run.smithi007.stdout:osd.8 up in weight 1 up_from 56 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6816/2080374927,v1:172.21.15.175:6817/2080374927] [v2:172.21.15.175:6818/2080374927,v1:172.21.15.175:6819/2080374927] exists,up d912501a-bb7a-489e-b6ab-e451fb22210d 2024-09-19T08:44:15.181 INFO:teuthology.orchestra.run.smithi007.stdout:osd.9 up in weight 1 up_from 63 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6826/3808356432,v1:172.21.15.7:6827/3808356432] [v2:172.21.15.7:6828/3808356432,v1:172.21.15.7:6829/3808356432] exists,up d132f5b2-75b9-4d6c-89ec-f52c303e0fd8 2024-09-19T08:44:15.181 INFO:teuthology.orchestra.run.smithi007.stdout:osd.10 up in weight 1 up_from 67 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6824/4009464689,v1:172.21.15.44:6825/4009464689] [v2:172.21.15.44:6826/4009464689,v1:172.21.15.44:6827/4009464689] exists,up f6c405d6-a255-4e0e-8528-7bbc16d5e434 2024-09-19T08:44:15.181 INFO:teuthology.orchestra.run.smithi007.stdout:osd.11 up in weight 1 up_from 74 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6824/4173951310,v1:172.21.15.175:6825/4173951310] [v2:172.21.15.175:6826/4173951310,v1:172.21.15.175:6827/4173951310] exists,up a2a046cd-9939-473a-988b-6e0ad28a0233 2024-09-19T08:44:15.181 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 2.c [2,4] 2024-09-19T08:44:15.181 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 2.13 [2,11] 2024-09-19T08:44:15.181 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 2.1a [8,1] 2024-09-19T08:44:15.181 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 2.1f [7,11] 2024-09-19T08:44:15.181 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.2 [3,9] 2024-09-19T08:44:15.181 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.e [5,9] 2024-09-19T08:44:15.182 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.1b [4,6] 2024-09-19T08:44:15.182 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.23 [4,8] 2024-09-19T08:44:15.182 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.24 [4,9] 2024-09-19T08:44:15.182 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6800/3071389382 expires 2024-09-20T08:35:56.784361+0000 2024-09-19T08:44:15.182 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6801/3071389382 expires 2024-09-20T08:35:56.784361+0000 2024-09-19T08:44:15.182 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/2884903597 expires 2024-09-20T08:35:56.784361+0000 2024-09-19T08:44:15.182 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/4058698573 expires 2024-09-20T08:35:56.784361+0000 2024-09-19T08:44:15.182 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6801/1689067491 expires 2024-09-20T08:35:31.711540+0000 2024-09-19T08:44:15.182 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/1429582340 expires 2024-09-20T08:35:56.784361+0000 2024-09-19T08:44:15.183 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6800/1689067491 expires 2024-09-20T08:35:31.711540+0000 2024-09-19T08:44:15.183 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/816886708 expires 2024-09-20T08:35:31.711540+0000 2024-09-19T08:44:15.183 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/4277640815 expires 2024-09-20T08:35:31.711540+0000 2024-09-19T08:44:15.183 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/2695884066 expires 2024-09-20T08:35:31.711540+0000 2024-09-19T08:44:15.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:15.180+0000 7f1a5082d640 1 -- 172.21.15.7:0/846127379 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1a340a3300 msgr2=0x7f1a340a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:15.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:15.180+0000 7f1a5082d640 1 --2- 172.21.15.7:0/846127379 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1a340a3300 0x7f1a340a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c005ab0 tx=0x7f1a3c000bc0 comp rx=0 tx=0).stop 2024-09-19T08:44:15.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:15.180+0000 7f1a5082d640 1 -- 172.21.15.7:0/846127379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a4c1026d0 msgr2=0x7f1a4c19f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:15.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:15.180+0000 7f1a5082d640 1 --2- 172.21.15.7:0/846127379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a4c1026d0 0x7f1a4c19f560 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400b970 tx=0x7f1a4400be30 comp rx=0 tx=0).stop 2024-09-19T08:44:15.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:15.180+0000 7f1a5082d640 1 -- 172.21.15.7:0/846127379 shutdown_connections 2024-09-19T08:44:15.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:15.180+0000 7f1a5082d640 1 --2- 172.21.15.7:0/846127379 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1a340a3300 0x7f1a340a57c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:15.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:15.180+0000 7f1a5082d640 1 --2- 172.21.15.7:0/846127379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a4c1026d0 0x7f1a4c19f560 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:15.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:15.180+0000 7f1a5082d640 1 --2- 172.21.15.7:0/846127379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a4c101d10 0x7f1a4c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:15.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:15.180+0000 7f1a5082d640 1 --2- 172.21.15.7:0/846127379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a4c100b10 0x7f1a4c197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:15.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:15.180+0000 7f1a5082d640 1 -- 172.21.15.7:0/846127379 >> 172.21.15.7:0/846127379 conn(0x7f1a4c0fc2a0 msgr2=0x7f1a4c105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:15.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:15.180+0000 7f1a5082d640 1 -- 172.21.15.7:0/846127379 shutdown_connections 2024-09-19T08:44:15.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:15.180+0000 7f1a5082d640 1 -- 172.21.15.7:0/846127379 wait complete. 2024-09-19T08:44:15.808 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T08:44:15.819 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:44:16.076 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:16.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:15 smithi007 ceph-mon[31221]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T08:44:16.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:15 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/846127379' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T08:44:16.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:15 smithi044 ceph-mon[35072]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T08:44:16.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:15 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/846127379' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T08:44:16.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:15 smithi175 ceph-mon[35688]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T08:44:16.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:15 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/846127379' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T08:44:16.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.560+0000 7fdadcf93640 1 -- 172.21.15.7:0/2555567046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad810c170 msgr2=0x7fdad810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:16.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.560+0000 7fdadcf93640 1 --2- 172.21.15.7:0/2555567046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad810c170 0x7fdad810e610 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdad0009ca0 tx=0x7fdad002a950 comp rx=0 tx=0).stop 2024-09-19T08:44:16.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.560+0000 7fdadcf93640 1 -- 172.21.15.7:0/2555567046 shutdown_connections 2024-09-19T08:44:16.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.560+0000 7fdadcf93640 1 --2- 172.21.15.7:0/2555567046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad810c170 0x7fdad810e610 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:16.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.560+0000 7fdadcf93640 1 --2- 172.21.15.7:0/2555567046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdad8103660 0x7fdad810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:16.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.560+0000 7fdadcf93640 1 --2- 172.21.15.7:0/2555567046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdad8102d40 0x7fdad8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:16.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.560+0000 7fdadcf93640 1 -- 172.21.15.7:0/2555567046 >> 172.21.15.7:0/2555567046 conn(0x7fdad80fc7a0 msgr2=0x7fdad80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:16.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.560+0000 7fdadcf93640 1 -- 172.21.15.7:0/2555567046 shutdown_connections 2024-09-19T08:44:16.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.561+0000 7fdadcf93640 1 -- 172.21.15.7:0/2555567046 wait complete. 2024-09-19T08:44:16.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.561+0000 7fdadcf93640 1 Processor -- start 2024-09-19T08:44:16.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.561+0000 7fdadcf93640 1 -- start start 2024-09-19T08:44:16.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.561+0000 7fdadcf93640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdad8102d40 0x7fdad81983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:16.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.561+0000 7fdadcf93640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdad8103660 0x7fdad8198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:16.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.561+0000 7fdadcf93640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad810c170 0x7fdad819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:16.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.561+0000 7fdadcf93640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdad8111fc0 con 0x7fdad810c170 2024-09-19T08:44:16.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.561+0000 7fdadcf93640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdad8111e40 con 0x7fdad8103660 2024-09-19T08:44:16.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.561+0000 7fdadcf93640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdad8112140 con 0x7fdad8102d40 2024-09-19T08:44:16.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.562+0000 7fdad6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad810c170 0x7fdad819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:16.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.562+0000 7fdad6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad810c170 0x7fdad819ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45294/0 (socket says 172.21.15.7:45294) 2024-09-19T08:44:16.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.562+0000 7fdad6d9d640 1 -- 172.21.15.7:0/1444459041 learned_addr learned my addr 172.21.15.7:0/1444459041 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:16.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.562+0000 7fdad659c640 1 --2- 172.21.15.7:0/1444459041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdad8102d40 0x7fdad81983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:16.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.562+0000 7fdacffff640 1 --2- 172.21.15.7:0/1444459041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdad8103660 0x7fdad8198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:16.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.562+0000 7fdad6d9d640 1 -- 172.21.15.7:0/1444459041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdad8102d40 msgr2=0x7fdad81983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:16.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.562+0000 7fdad6d9d640 1 --2- 172.21.15.7:0/1444459041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdad8102d40 0x7fdad81983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:16.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.562+0000 7fdad6d9d640 1 -- 172.21.15.7:0/1444459041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdad8103660 msgr2=0x7fdad8198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:16.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.562+0000 7fdad6d9d640 1 --2- 172.21.15.7:0/1444459041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdad8103660 0x7fdad8198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:16.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.562+0000 7fdad6d9d640 1 -- 172.21.15.7:0/1444459041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdad819d390 con 0x7fdad810c170 2024-09-19T08:44:16.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.562+0000 7fdad6d9d640 1 --2- 172.21.15.7:0/1444459041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad810c170 0x7fdad819ccb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdad0009dc0 tx=0x7fdad0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:16.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.562+0000 7fdacf7fe640 1 -- 172.21.15.7:0/1444459041 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad0034040 con 0x7fdad810c170 2024-09-19T08:44:16.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.562+0000 7fdacf7fe640 1 -- 172.21.15.7:0/1444459041 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdad002fe20 con 0x7fdad810c170 2024-09-19T08:44:16.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.562+0000 7fdadcf93640 1 -- 172.21.15.7:0/1444459041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdad819d620 con 0x7fdad810c170 2024-09-19T08:44:16.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.562+0000 7fdacf7fe640 1 -- 172.21.15.7:0/1444459041 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad00047f0 con 0x7fdad810c170 2024-09-19T08:44:16.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.562+0000 7fdadcf93640 1 -- 172.21.15.7:0/1444459041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdad81a4f60 con 0x7fdad810c170 2024-09-19T08:44:16.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.563+0000 7fdadcf93640 1 -- 172.21.15.7:0/1444459041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdad8103120 con 0x7fdad810c170 2024-09-19T08:44:16.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.564+0000 7fdacf7fe640 1 -- 172.21.15.7:0/1444459041 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fdad0037020 con 0x7fdad810c170 2024-09-19T08:44:16.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.565+0000 7fdacf7fe640 1 --2- 172.21.15.7:0/1444459041 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fdac40a32d0 0x7fdac40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:16.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.565+0000 7fdad659c640 1 --2- 172.21.15.7:0/1444459041 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fdac40a32d0 0x7fdac40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:16.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.565+0000 7fdacf7fe640 1 -- 172.21.15.7:0/1444459041 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdad00f0910 con 0x7fdad810c170 2024-09-19T08:44:16.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.566+0000 7fdad659c640 1 --2- 172.21.15.7:0/1444459041 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fdac40a32d0 0x7fdac40a5790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdac8005d00 tx=0x7fdac800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:16.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.569+0000 7fdacf7fe640 1 -- 172.21.15.7:0/1444459041 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdad00bd5e0 con 0x7fdad810c170 2024-09-19T08:44:16.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.782+0000 7fdadcf93640 1 -- 172.21.15.7:0/1444459041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdad81071e0 con 0x7fdad810c170 2024-09-19T08:44:16.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.783+0000 7fdacf7fe640 1 -- 172.21.15.7:0/1444459041 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11899 (secure 0 0 0) 0x7fdad00bcee0 con 0x7fdad810c170 2024-09-19T08:44:16.784 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:44:16.784 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"btime":"2024-09-19T08:42:56:086840+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:42:55.696739+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24458,24472,24491]},"id":1}]} 2024-09-19T08:44:16.784 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-19T08:44:16.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.785+0000 7fdadcf93640 1 -- 172.21.15.7:0/1444459041 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fdac40a32d0 msgr2=0x7fdac40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:16.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.785+0000 7fdadcf93640 1 --2- 172.21.15.7:0/1444459041 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fdac40a32d0 0x7fdac40a5790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdac8005d00 tx=0x7fdac800b410 comp rx=0 tx=0).stop 2024-09-19T08:44:16.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.785+0000 7fdadcf93640 1 -- 172.21.15.7:0/1444459041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad810c170 msgr2=0x7fdad819ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:16.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.785+0000 7fdadcf93640 1 --2- 172.21.15.7:0/1444459041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad810c170 0x7fdad819ccb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdad0009dc0 tx=0x7fdad0003f10 comp rx=0 tx=0).stop 2024-09-19T08:44:16.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.785+0000 7fdadcf93640 1 -- 172.21.15.7:0/1444459041 shutdown_connections 2024-09-19T08:44:16.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.785+0000 7fdadcf93640 1 --2- 172.21.15.7:0/1444459041 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fdac40a32d0 0x7fdac40a5790 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:16.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.785+0000 7fdadcf93640 1 --2- 172.21.15.7:0/1444459041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad810c170 0x7fdad819ccb0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:16.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.785+0000 7fdadcf93640 1 --2- 172.21.15.7:0/1444459041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdad8103660 0x7fdad8198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:16.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.785+0000 7fdadcf93640 1 --2- 172.21.15.7:0/1444459041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdad8102d40 0x7fdad81983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:16.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.785+0000 7fdadcf93640 1 -- 172.21.15.7:0/1444459041 >> 172.21.15.7:0/1444459041 conn(0x7fdad80fc7a0 msgr2=0x7fdad80fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:16.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.786+0000 7fdadcf93640 1 -- 172.21.15.7:0/1444459041 shutdown_connections 2024-09-19T08:44:16.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:16.786+0000 7fdadcf93640 1 -- 172.21.15.7:0/1444459041 wait complete. 2024-09-19T08:44:17.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:16 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1444459041' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:17.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:16 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1444459041' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:17.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:16 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1444459041' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:17.439 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:44:17.694 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:18.065 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:17 smithi007 ceph-mon[31221]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:44:18.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.145+0000 7f5219cfb640 1 -- 172.21.15.7:0/9136772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5214108290 msgr2=0x7f521410ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:18.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.145+0000 7f5219cfb640 1 --2- 172.21.15.7:0/9136772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5214108290 0x7f521410ec30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f520c009cd0 tx=0x7f520c02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:44:18.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.145+0000 7f5219cfb640 1 -- 172.21.15.7:0/9136772 shutdown_connections 2024-09-19T08:44:18.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.145+0000 7f5219cfb640 1 --2- 172.21.15.7:0/9136772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5214108290 0x7f521410ec30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:18.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.145+0000 7f5219cfb640 1 --2- 172.21.15.7:0/9136772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5214103740 0x7f5214107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:18.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.145+0000 7f5219cfb640 1 --2- 172.21.15.7:0/9136772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5214102d90 0x7f5214103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:18.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.145+0000 7f5219cfb640 1 -- 172.21.15.7:0/9136772 >> 172.21.15.7:0/9136772 conn(0x7f52140fc7d0 msgr2=0x7f52140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:18.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.145+0000 7f5219cfb640 1 -- 172.21.15.7:0/9136772 shutdown_connections 2024-09-19T08:44:18.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.145+0000 7f5219cfb640 1 -- 172.21.15.7:0/9136772 wait complete. 2024-09-19T08:44:18.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.145+0000 7f5219cfb640 1 Processor -- start 2024-09-19T08:44:18.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.146+0000 7f5219cfb640 1 -- start start 2024-09-19T08:44:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.146+0000 7f5219cfb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5214102d90 0x7f5214198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.146+0000 7f5219cfb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5214103740 0x7f5214198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.146+0000 7f5219cfb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5214108290 0x7f521419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.146+0000 7f5219cfb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5214112090 con 0x7f5214103740 2024-09-19T08:44:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.146+0000 7f5219cfb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5214111f10 con 0x7f5214102d90 2024-09-19T08:44:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.146+0000 7f5219cfb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5214112210 con 0x7f5214108290 2024-09-19T08:44:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.146+0000 7f5212ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5214103740 0x7f5214198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.146+0000 7f5212ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5214103740 0x7f5214198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45314/0 (socket says 172.21.15.7:45314) 2024-09-19T08:44:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.146+0000 7f5212ffd640 1 -- 172.21.15.7:0/37045448 learned_addr learned my addr 172.21.15.7:0/37045448 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.146+0000 7f52137fe640 1 --2- 172.21.15.7:0/37045448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5214102d90 0x7f5214198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.146+0000 7f5213fff640 1 --2- 172.21.15.7:0/37045448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5214108290 0x7f521419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.146+0000 7f5212ffd640 1 -- 172.21.15.7:0/37045448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5214108290 msgr2=0x7f521419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.146+0000 7f5212ffd640 1 --2- 172.21.15.7:0/37045448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5214108290 0x7f521419ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.146+0000 7f5212ffd640 1 -- 172.21.15.7:0/37045448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5214102d90 msgr2=0x7f5214198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.146+0000 7f5212ffd640 1 --2- 172.21.15.7:0/37045448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5214102d90 0x7f5214198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.146+0000 7f5212ffd640 1 -- 172.21.15.7:0/37045448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521419d500 con 0x7f5214103740 2024-09-19T08:44:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.147+0000 7f5212ffd640 1 --2- 172.21.15.7:0/37045448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5214103740 0x7f5214198a90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f520400e9f0 tx=0x7f520400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.147+0000 7f5210ff9640 1 -- 172.21.15.7:0/37045448 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520400ccc0 con 0x7f5214103740 2024-09-19T08:44:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.147+0000 7f5219cfb640 1 -- 172.21.15.7:0/37045448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f521419d7f0 con 0x7f5214103740 2024-09-19T08:44:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.147+0000 7f5210ff9640 1 -- 172.21.15.7:0/37045448 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5204005500 con 0x7f5214103740 2024-09-19T08:44:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.147+0000 7f5210ff9640 1 -- 172.21.15.7:0/37045448 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5204010690 con 0x7f5214103740 2024-09-19T08:44:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.147+0000 7f5219cfb640 1 -- 172.21.15.7:0/37045448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5214100920 con 0x7f5214103740 2024-09-19T08:44:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.148+0000 7f5219cfb640 1 -- 172.21.15.7:0/37045448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f521406a7f0 con 0x7f5214103740 2024-09-19T08:44:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.150+0000 7f5210ff9640 1 -- 172.21.15.7:0/37045448 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f52040046c0 con 0x7f5214103740 2024-09-19T08:44:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.151+0000 7f5210ff9640 1 --2- 172.21.15.7:0/37045448 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f52000a32d0 0x7f52000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.151+0000 7f52137fe640 1 --2- 172.21.15.7:0/37045448 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f52000a32d0 0x7f52000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.151+0000 7f5210ff9640 1 -- 172.21.15.7:0/37045448 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f52040cff90 con 0x7f5214103740 2024-09-19T08:44:18.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.151+0000 7f52137fe640 1 --2- 172.21.15.7:0/37045448 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f52000a32d0 0x7f52000a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f51fc009bd0 tx=0x7f51fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:18.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.153+0000 7f5210ff9640 1 -- 172.21.15.7:0/37045448 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5204054210 con 0x7f5214103740 2024-09-19T08:44:18.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:17 smithi044 ceph-mon[35072]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:44:18.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.370+0000 7f5219cfb640 1 -- 172.21.15.7:0/37045448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5214103170 con 0x7f5214103740 2024-09-19T08:44:18.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.371+0000 7f5210ff9640 1 -- 172.21.15.7:0/37045448 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11899 (secure 0 0 0) 0x7f5214103170 con 0x7f5214103740 2024-09-19T08:44:18.372 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:44:18.372 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"btime":"2024-09-19T08:42:56:086840+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:42:55.696739+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24458,24472,24491]},"id":1}]} 2024-09-19T08:44:18.372 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-19T08:44:18.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.373+0000 7f5219cfb640 1 -- 172.21.15.7:0/37045448 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f52000a32d0 msgr2=0x7f52000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:18.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.373+0000 7f5219cfb640 1 --2- 172.21.15.7:0/37045448 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f52000a32d0 0x7f52000a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f51fc009bd0 tx=0x7f51fc005f90 comp rx=0 tx=0).stop 2024-09-19T08:44:18.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.373+0000 7f5219cfb640 1 -- 172.21.15.7:0/37045448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5214103740 msgr2=0x7f5214198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:18.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.373+0000 7f5219cfb640 1 --2- 172.21.15.7:0/37045448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5214103740 0x7f5214198a90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f520400e9f0 tx=0x7f520400eeb0 comp rx=0 tx=0).stop 2024-09-19T08:44:18.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.373+0000 7f5219cfb640 1 -- 172.21.15.7:0/37045448 shutdown_connections 2024-09-19T08:44:18.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.373+0000 7f5219cfb640 1 --2- 172.21.15.7:0/37045448 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f52000a32d0 0x7f52000a5790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:18.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.373+0000 7f5219cfb640 1 --2- 172.21.15.7:0/37045448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5214108290 0x7f521419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:18.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.373+0000 7f5219cfb640 1 --2- 172.21.15.7:0/37045448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5214103740 0x7f5214198a90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:18.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.373+0000 7f5219cfb640 1 --2- 172.21.15.7:0/37045448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5214102d90 0x7f5214198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:18.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.373+0000 7f5219cfb640 1 -- 172.21.15.7:0/37045448 >> 172.21.15.7:0/37045448 conn(0x7f52140fc7d0 msgr2=0x7f5214106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:18.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.373+0000 7f5219cfb640 1 -- 172.21.15.7:0/37045448 shutdown_connections 2024-09-19T08:44:18.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:18.373+0000 7f5219cfb640 1 -- 172.21.15.7:0/37045448 wait complete. 2024-09-19T08:44:18.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:17 smithi175 ceph-mon[35688]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:44:19.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:18 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/37045448' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:19.028 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:44:19.287 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:19.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:18 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/37045448' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:19.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:18 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/37045448' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:19.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.811+0000 7f72b07d5640 1 -- 172.21.15.7:0/1079834495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72a8101de0 msgr2=0x7f72a81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:19.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.811+0000 7f72b07d5640 1 --2- 172.21.15.7:0/1079834495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72a8101de0 0x7f72a81021c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009900 tx=0x7f72a402a410 comp rx=0 tx=0).stop 2024-09-19T08:44:19.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.811+0000 7f72b07d5640 1 -- 172.21.15.7:0/1079834495 shutdown_connections 2024-09-19T08:44:19.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.811+0000 7f72b07d5640 1 --2- 172.21.15.7:0/1079834495 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72a8106f10 0x7f72a810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:19.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.811+0000 7f72b07d5640 1 --2- 172.21.15.7:0/1079834495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72a8102790 0x7f72a81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:19.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.811+0000 7f72b07d5640 1 --2- 172.21.15.7:0/1079834495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72a8101de0 0x7f72a81021c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:19.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.811+0000 7f72b07d5640 1 -- 172.21.15.7:0/1079834495 >> 172.21.15.7:0/1079834495 conn(0x7f72a80fd8c0 msgr2=0x7f72a80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:19.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.811+0000 7f72b07d5640 1 -- 172.21.15.7:0/1079834495 shutdown_connections 2024-09-19T08:44:19.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.811+0000 7f72b07d5640 1 -- 172.21.15.7:0/1079834495 wait complete. 2024-09-19T08:44:19.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.812+0000 7f72b07d5640 1 Processor -- start 2024-09-19T08:44:19.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.812+0000 7f72b07d5640 1 -- start start 2024-09-19T08:44:19.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.812+0000 7f72b07d5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72a8101de0 0x7f72a8198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:19.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.812+0000 7f72b07d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72a8102790 0x7f72a81989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:19.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.812+0000 7f72b07d5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72a8106f10 0x7f72a819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:19.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.812+0000 7f72b07d5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f72a8111f90 con 0x7f72a8102790 2024-09-19T08:44:19.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.812+0000 7f72b07d5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f72a8111e10 con 0x7f72a8101de0 2024-09-19T08:44:19.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.812+0000 7f72b07d5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f72a8112110 con 0x7f72a8106f10 2024-09-19T08:44:19.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.812+0000 7f72add70640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72a8102790 0x7f72a81989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:19.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.812+0000 7f72add70640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72a8102790 0x7f72a81989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45332/0 (socket says 172.21.15.7:45332) 2024-09-19T08:44:19.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.812+0000 7f72add70640 1 -- 172.21.15.7:0/1479437589 learned_addr learned my addr 172.21.15.7:0/1479437589 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:19.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.812+0000 7f72ae571640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72a8101de0 0x7f72a8198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:19.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.812+0000 7f72aed72640 1 --2- 172.21.15.7:0/1479437589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72a8106f10 0x7f72a819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:19.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.812+0000 7f72add70640 1 -- 172.21.15.7:0/1479437589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72a8106f10 msgr2=0x7f72a819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:19.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.812+0000 7f72add70640 1 --2- 172.21.15.7:0/1479437589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72a8106f10 0x7f72a819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:19.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.812+0000 7f72add70640 1 -- 172.21.15.7:0/1479437589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72a8101de0 msgr2=0x7f72a8198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:19.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.812+0000 7f72add70640 1 --2- 172.21.15.7:0/1479437589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72a8101de0 0x7f72a8198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:19.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.812+0000 7f72add70640 1 -- 172.21.15.7:0/1479437589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a819d440 con 0x7f72a8102790 2024-09-19T08:44:19.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.812+0000 7f72add70640 1 --2- 172.21.15.7:0/1479437589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72a8102790 0x7f72a81989d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f729800b4a0 tx=0x7f729800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:19.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.813+0000 7f729f7fe640 1 -- 172.21.15.7:0/1479437589 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7298014070 con 0x7f72a8102790 2024-09-19T08:44:19.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.813+0000 7f729f7fe640 1 -- 172.21.15.7:0/1479437589 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7298010af0 con 0x7f72a8102790 2024-09-19T08:44:19.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.813+0000 7f72b07d5640 1 -- 172.21.15.7:0/1479437589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72a819d730 con 0x7f72a8102790 2024-09-19T08:44:19.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.813+0000 7f729f7fe640 1 -- 172.21.15.7:0/1479437589 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7298017d10 con 0x7f72a8102790 2024-09-19T08:44:19.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.813+0000 7f72b07d5640 1 -- 172.21.15.7:0/1479437589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72a81a5010 con 0x7f72a8102790 2024-09-19T08:44:19.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.814+0000 7f72b07d5640 1 -- 172.21.15.7:0/1479437589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72a81021c0 con 0x7f72a8102790 2024-09-19T08:44:19.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.815+0000 7f729f7fe640 1 -- 172.21.15.7:0/1479437589 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f7298017070 con 0x7f72a8102790 2024-09-19T08:44:19.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.815+0000 7f729f7fe640 1 --2- 172.21.15.7:0/1479437589 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f72940a3350 0x7f72940a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:19.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.816+0000 7f72ae571640 1 --2- 172.21.15.7:0/1479437589 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f72940a3350 0x7f72940a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:19.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.816+0000 7f729f7fe640 1 -- 172.21.15.7:0/1479437589 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f72980cecf0 con 0x7f72a8102790 2024-09-19T08:44:19.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.816+0000 7f72ae571640 1 --2- 172.21.15.7:0/1479437589 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f72940a3350 0x7f72940a5810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009230 tx=0x7f72a40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:19.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.820+0000 7f729f7fe640 1 -- 172.21.15.7:0/1479437589 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f729809b9c0 con 0x7f72a8102790 2024-09-19T08:44:19.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.997+0000 7f72b07d5640 1 -- 172.21.15.7:0/1479437589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72a810a150 con 0x7f72a8102790 2024-09-19T08:44:19.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:19 smithi007 ceph-mon[31221]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:44:19.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:19.999+0000 7f729f7fe640 1 -- 172.21.15.7:0/1479437589 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22634 (secure 0 0 0) 0x7f729809b2c0 con 0x7f72a8102790 2024-09-19T08:44:20.000 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:44:20.000 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":82,"fsid":"ebd23124-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:02.287380+0000","modified":"2024-09-19T08:42:58.097469+0000","last_up_change":"2024-09-19T08:41:54.742978+0000","last_in_change":"2024-09-19T08:41:31.685622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:13.285118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:42:40.425852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:42:43.006548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"837e6267-71c7-4f48-9e0b-4e3f124682b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6803","nonce":402668717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6805","nonce":402668717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6809","nonce":402668717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6807","nonce":402668717}]},"public_addr":"172.21.15.7:6803/402668717","cluster_addr":"172.21.15.7:6805/402668717","heartbeat_back_addr":"172.21.15.7:6809/402668717","heartbeat_front_addr":"172.21.15.7:6807/402668717","state":["exists","up"]},{"osd":1,"uuid":"67865372-ac22-4b30-bd02-498e118d6701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6801","nonce":2213694259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6803","nonce":2213694259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6807","nonce":2213694259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6805","nonce":2213694259}]},"public_addr":"172.21.15.44:6801/2213694259","cluster_addr":"172.21.15.44:6803/2213694259","heartbeat_back_addr":"172.21.15.44:6807/2213694259","heartbeat_front_addr":"172.21.15.44:6805/2213694259","state":["exists","up"]},{"osd":2,"uuid":"37c1cc2b-60ea-449f-baa7-c65d96c3559c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6801","nonce":3413002145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6803","nonce":3413002145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6807","nonce":3413002145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6805","nonce":3413002145}]},"public_addr":"172.21.15.175:6801/3413002145","cluster_addr":"172.21.15.175:6803/3413002145","heartbeat_back_addr":"172.21.15.175:6807/3413002145","heartbeat_front_addr":"172.21.15.175:6805/3413002145","state":["exists","up"]},{"osd":3,"uuid":"a8ffd2ae-4211-492a-a8ac-d4d6cbb4a03d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6811","nonce":2528867083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6813","nonce":2528867083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6817","nonce":2528867083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6815","nonce":2528867083}]},"public_addr":"172.21.15.7:6811/2528867083","cluster_addr":"172.21.15.7:6813/2528867083","heartbeat_back_addr":"172.21.15.7:6817/2528867083","heartbeat_front_addr":"172.21.15.7:6815/2528867083","state":["exists","up"]},{"osd":4,"uuid":"9a67b2ec-1a0a-413e-bd13-9532f24a0155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6809","nonce":3537143774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537143774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537143774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537143774}]},"public_addr":"172.21.15.44:6809/3537143774","cluster_addr":"172.21.15.44:6811/3537143774","heartbeat_back_addr":"172.21.15.44:6815/3537143774","heartbeat_front_addr":"172.21.15.44:6813/3537143774","state":["exists","up"]},{"osd":5,"uuid":"436cd596-710b-48e2-8255-8427c93cee1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6809","nonce":4001214751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6811","nonce":4001214751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6815","nonce":4001214751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6813","nonce":4001214751}]},"public_addr":"172.21.15.175:6809/4001214751","cluster_addr":"172.21.15.175:6811/4001214751","heartbeat_back_addr":"172.21.15.175:6815/4001214751","heartbeat_front_addr":"172.21.15.175:6813/4001214751","state":["exists","up"]},{"osd":6,"uuid":"f5a7ad2b-6b44-4b5a-8af7-f7fb00e7ca68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6819","nonce":1261079202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6821","nonce":1261079202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6825","nonce":1261079202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6823","nonce":1261079202}]},"public_addr":"172.21.15.7:6819/1261079202","cluster_addr":"172.21.15.7:6821/1261079202","heartbeat_back_addr":"172.21.15.7:6825/1261079202","heartbeat_front_addr":"172.21.15.7:6823/1261079202","state":["exists","up"]},{"osd":7,"uuid":"aa24aee5-6449-4842-8831-1c8e06cde75b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6817","nonce":3120822957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6819","nonce":3120822957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6823","nonce":3120822957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6821","nonce":3120822957}]},"public_addr":"172.21.15.44:6817/3120822957","cluster_addr":"172.21.15.44:6819/3120822957","heartbeat_back_addr":"172.21.15.44:6823/3120822957","heartbeat_front_addr":"172.21.15.44:6821/3120822957","state":["exists","up"]},{"osd":8,"uuid":"d912501a-bb7a-489e-b6ab-e451fb22210d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6817","nonce":2080374927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6819","nonce":2080374927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6823","nonce":2080374927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6821","nonce":2080374927}]},"public_addr":"172.21.15.175:6817/2080374927","cluster_addr":"172.21.15.175:6819/2080374927","heartbeat_back_addr":"172.21.15.175:6823/2080374927","heartbeat_front_addr":"172.21.15.175:6821/2080374927","state":["exists","up"]},{"osd":9,"uuid":"d132f5b2-75b9-4d6c-89ec-f52c303e0fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6827","nonce":3808356432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6829","nonce":3808356432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6833","nonce":3808356432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6831","nonce":3808356432}]},"public_addr":"172.21.15.7:6827/3808356432","cluster_addr":"172.21.15.7:6829/3808356432","heartbeat_back_addr":"172.21.15.7:6833/3808356432","heartbeat_front_addr":"172.21.15.7:6831/3808356432","state":["exists","up"]},{"osd":10,"uuid":"f6c405d6-a255-4e0e-8528-7bbc16d5e434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6825","nonce":4009464689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6827","nonce":4009464689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6831","nonce":4009464689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6829","nonce":4009464689}]},"public_addr":"172.21.15.44:6825/4009464689","cluster_addr":"172.21.15.44:6827/4009464689","heartbeat_back_addr":"172.21.15.44:6831/4009464689","heartbeat_front_addr":"172.21.15.44:6829/4009464689","state":["exists","up"]},{"osd":11,"uuid":"a2a046cd-9939-473a-988b-6e0ad28a0233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6825","nonce":4173951310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6827","nonce":4173951310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6831","nonce":4173951310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6829","nonce":4173951310}]},"public_addr":"172.21.15.175:6825/4173951310","cluster_addr":"172.21.15.175:6827/4173951310","heartbeat_back_addr":"172.21.15.175:6831/4173951310","heartbeat_front_addr":"172.21.15.175:6829/4173951310","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:20.015497+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:44.967046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:09.682080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:35.516899+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:00.705686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:25.276387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:49.927456+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:14.786755+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:38.553913+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.962825+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.812976+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:52.837744+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6800/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/2884903597":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/4058698573":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/1429582340":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6800/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/816886708":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/4277640815":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/2695884066":"2024-09-20T08:35:31.711540+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:44:20.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:20.001+0000 7f72b07d5640 1 -- 172.21.15.7:0/1479437589 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f72940a3350 msgr2=0x7f72940a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:20.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:20.001+0000 7f72b07d5640 1 --2- 172.21.15.7:0/1479437589 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f72940a3350 0x7f72940a5810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009230 tx=0x7f72a40058d0 comp rx=0 tx=0).stop 2024-09-19T08:44:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:20.001+0000 7f72b07d5640 1 -- 172.21.15.7:0/1479437589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72a8102790 msgr2=0x7f72a81989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:20.001+0000 7f72b07d5640 1 --2- 172.21.15.7:0/1479437589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72a8102790 0x7f72a81989d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f729800b4a0 tx=0x7f729800b960 comp rx=0 tx=0).stop 2024-09-19T08:44:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:20.001+0000 7f72b07d5640 1 -- 172.21.15.7:0/1479437589 shutdown_connections 2024-09-19T08:44:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:20.002+0000 7f72b07d5640 1 --2- 172.21.15.7:0/1479437589 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f72940a3350 0x7f72940a5810 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:20.002+0000 7f72b07d5640 1 --2- 172.21.15.7:0/1479437589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72a8106f10 0x7f72a819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:20.002+0000 7f72b07d5640 1 --2- 172.21.15.7:0/1479437589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72a8102790 0x7f72a81989d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:20.002+0000 7f72b07d5640 1 --2- 172.21.15.7:0/1479437589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72a8101de0 0x7f72a8198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:20.002+0000 7f72b07d5640 1 -- 172.21.15.7:0/1479437589 >> 172.21.15.7:0/1479437589 conn(0x7f72a80fd8c0 msgr2=0x7f72a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:20.002+0000 7f72b07d5640 1 -- 172.21.15.7:0/1479437589 shutdown_connections 2024-09-19T08:44:20.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:20.002+0000 7f72b07d5640 1 -- 172.21.15.7:0/1479437589 wait complete. 2024-09-19T08:44:20.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:19 smithi044 ceph-mon[35072]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:44:20.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:19 smithi175 ceph-mon[35688]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:44:20.719 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T08:42:44.586692+0000', 'modified': '2024-09-19T08:42:55.696739+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24491, 'mds_1': 24472, 'mds_2': 24458}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24443': {'gid': 24443, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6835/2261554115', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 2261554115}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 2261554115}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24445': {'gid': 24445, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6835/1285566250', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 1285566250}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 1285566250}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6837/2128553811', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 2128553811}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 2128553811}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24458': {'gid': 24458, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.44:6837/1232834466', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6836', 'nonce': 1232834466}, {'type': 'v1', 'addr': '172.21.15.44:6837', 'nonce': 1232834466}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.175:6839/3928264317', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6838', 'nonce': 3928264317}, {'type': 'v1', 'addr': '172.21.15.175:6839', 'nonce': 3928264317}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24491': {'gid': 24491, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.44:6839/1737549475', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6838', 'nonce': 1737549475}, {'type': 'v1', 'addr': '172.21.15.44:6839', 'nonce': 1737549475}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24491, 'qdb_cluster': [24458, 24472, 24491]} 2024-09-19T08:44:20.720 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T08:44:20.720 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T08:44:20.980 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:21.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:20 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1479437589' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:21.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:20 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1479437589' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:21.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:20 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1479437589' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:21.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.436+0000 7fcaf3ac3640 1 -- 172.21.15.7:0/2186992396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaec106f10 msgr2=0x7fcaec10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:21.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.436+0000 7fcaf3ac3640 1 --2- 172.21.15.7:0/2186992396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaec106f10 0x7fcaec10ea90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcae4009900 tx=0x7fcae402a410 comp rx=0 tx=0).stop 2024-09-19T08:44:21.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.436+0000 7fcaf3ac3640 1 -- 172.21.15.7:0/2186992396 shutdown_connections 2024-09-19T08:44:21.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.436+0000 7fcaf3ac3640 1 --2- 172.21.15.7:0/2186992396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaec106f10 0x7fcaec10ea90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.436+0000 7fcaf3ac3640 1 --2- 172.21.15.7:0/2186992396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcaec102790 0x7fcaec1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.436+0000 7fcaf3ac3640 1 --2- 172.21.15.7:0/2186992396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcaec101de0 0x7fcaec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.436+0000 7fcaf3ac3640 1 -- 172.21.15.7:0/2186992396 >> 172.21.15.7:0/2186992396 conn(0x7fcaec0fd8c0 msgr2=0x7fcaec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:21.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.436+0000 7fcaf3ac3640 1 -- 172.21.15.7:0/2186992396 shutdown_connections 2024-09-19T08:44:21.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.436+0000 7fcaf3ac3640 1 -- 172.21.15.7:0/2186992396 wait complete. 2024-09-19T08:44:21.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.437+0000 7fcaf3ac3640 1 Processor -- start 2024-09-19T08:44:21.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.437+0000 7fcaf3ac3640 1 -- start start 2024-09-19T08:44:21.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.437+0000 7fcaf3ac3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcaec101de0 0x7fcaec1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.437+0000 7fcaf3ac3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaec102790 0x7fcaec198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.437+0000 7fcaf3ac3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcaec106f10 0x7fcaec19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.437+0000 7fcaf3ac3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcaec111f70 con 0x7fcaec102790 2024-09-19T08:44:21.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.437+0000 7fcaf3ac3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcaec111df0 con 0x7fcaec101de0 2024-09-19T08:44:21.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.437+0000 7fcaf3ac3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcaec1120f0 con 0x7fcaec106f10 2024-09-19T08:44:21.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.437+0000 7fcaf105e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaec102790 0x7fcaec198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:21.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.437+0000 7fcaf105e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaec102790 0x7fcaec198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45348/0 (socket says 172.21.15.7:45348) 2024-09-19T08:44:21.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.437+0000 7fcaf105e640 1 -- 172.21.15.7:0/2572473226 learned_addr learned my addr 172.21.15.7:0/2572473226 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:21.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.437+0000 7fcaf185f640 1 --2- 172.21.15.7:0/2572473226 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcaec101de0 0x7fcaec1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:21.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.437+0000 7fcaf2060640 1 --2- 172.21.15.7:0/2572473226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcaec106f10 0x7fcaec19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:21.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.437+0000 7fcaf105e640 1 -- 172.21.15.7:0/2572473226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcaec106f10 msgr2=0x7fcaec19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:21.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.437+0000 7fcaf105e640 1 --2- 172.21.15.7:0/2572473226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcaec106f10 0x7fcaec19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.437+0000 7fcaf105e640 1 -- 172.21.15.7:0/2572473226 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcaec101de0 msgr2=0x7fcaec1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:21.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.437+0000 7fcaf105e640 1 --2- 172.21.15.7:0/2572473226 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcaec101de0 0x7fcaec1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.437+0000 7fcaf105e640 1 -- 172.21.15.7:0/2572473226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaec19d480 con 0x7fcaec102790 2024-09-19T08:44:21.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.438+0000 7fcaf105e640 1 --2- 172.21.15.7:0/2572473226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaec102790 0x7fcaec198a10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcae000e9f0 tx=0x7fcae000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:21.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.438+0000 7fcaeaffd640 1 -- 172.21.15.7:0/2572473226 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae000cd80 con 0x7fcaec102790 2024-09-19T08:44:21.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.438+0000 7fcaeaffd640 1 -- 172.21.15.7:0/2572473226 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcae0005500 con 0x7fcaec102790 2024-09-19T08:44:21.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.438+0000 7fcaf3ac3640 1 -- 172.21.15.7:0/2572473226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaec19d770 con 0x7fcaec102790 2024-09-19T08:44:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.438+0000 7fcaeaffd640 1 -- 172.21.15.7:0/2572473226 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0010690 con 0x7fcaec102790 2024-09-19T08:44:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.438+0000 7fcaf3ac3640 1 -- 172.21.15.7:0/2572473226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaec1a5050 con 0x7fcaec102790 2024-09-19T08:44:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.440+0000 7fcaeaffd640 1 -- 172.21.15.7:0/2572473226 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fcae00046c0 con 0x7fcaec102790 2024-09-19T08:44:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.440+0000 7fcaf5e9c740 1 Processor -- start 2024-09-19T08:44:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.441+0000 7fcaf5e9c740 1 -- start start 2024-09-19T08:44:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.441+0000 7fcaf5e9c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598092229d0 0x559809222db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.441+0000 7fcaf5e9c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598092232f0 0x55980922d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.441+0000 7fcaf5e9c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55980922dbb0 0x55980922ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.441+0000 7fcaf5e9c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559809189090 con 0x55980922dbb0 2024-09-19T08:44:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.441+0000 7fcaf5e9c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559809130a70 con 0x5598092229d0 2024-09-19T08:44:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.441+0000 7fcaf5e9c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559809185050 con 0x5598092232f0 2024-09-19T08:44:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.441+0000 7fcaf105e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55980922dbb0 0x55980922ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.441+0000 7fcaeaffd640 1 --2- 172.21.15.7:0/2572473226 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fcad40a3350 0x7fcad40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.441+0000 7fcaf105e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55980922dbb0 0x55980922ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45350/0 (socket says 172.21.15.7:45350) 2024-09-19T08:44:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.441+0000 7fcaf105e640 1 -- 172.21.15.7:0/2164059328 learned_addr learned my addr 172.21.15.7:0/2164059328 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.441+0000 7fcaf2060640 1 --2- 172.21.15.7:0/2164059328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598092229d0 0x559809222db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.441+0000 7fcaf185f640 1 --2- 172.21.15.7:0/2164059328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598092232f0 0x55980922d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.441+0000 7fcaf2060640 1 --2- 172.21.15.7:0/2572473226 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fcad40a3350 0x7fcad40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.441+0000 7fcaeaffd640 1 -- 172.21.15.7:0/2572473226 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcae00cfea0 con 0x7fcaec102790 2024-09-19T08:44:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.442+0000 7fcaf105e640 1 -- 172.21.15.7:0/2164059328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598092232f0 msgr2=0x55980922d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.442+0000 7fcaf105e640 1 --2- 172.21.15.7:0/2164059328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598092232f0 0x55980922d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.442+0000 7fcaf105e640 1 -- 172.21.15.7:0/2164059328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598092229d0 msgr2=0x559809222db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:21.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.442+0000 7fcaf105e640 1 --2- 172.21.15.7:0/2164059328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598092229d0 0x559809222db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.442+0000 7fcaf105e640 1 -- 172.21.15.7:0/2164059328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55980913d130 con 0x55980922dbb0 2024-09-19T08:44:21.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.442+0000 7fcaf105e640 1 --2- 172.21.15.7:0/2164059328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55980922dbb0 0x55980922ffa0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcae00cd7c0 tx=0x7fcae009c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce9a3229a04120e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:21.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.442+0000 7fcaf2060640 1 --2- 172.21.15.7:0/2572473226 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fcad40a3350 0x7fcad40a5810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcae40096c0 tx=0x7fcae4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:21.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.442+0000 7fcad3fff640 1 -- 172.21.15.7:0/2164059328 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae00cde60 con 0x55980922dbb0 2024-09-19T08:44:21.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.442+0000 7fcad3fff640 1 -- 172.21.15.7:0/2164059328 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcae009ca60 con 0x55980922dbb0 2024-09-19T08:44:21.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.442+0000 7fcad3fff640 1 -- 172.21.15.7:0/2164059328 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae00a4b40 con 0x55980922dbb0 2024-09-19T08:44:21.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.443+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/2164059328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55980922dbb0 msgr2=0x55980922ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:21.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.443+0000 7fcaf5e9c740 1 --2- 172.21.15.7:0/2164059328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55980922dbb0 0x55980922ffa0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcae00cd7c0 tx=0x7fcae009c260 comp rx=0 tx=0).stop 2024-09-19T08:44:21.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.443+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/2164059328 shutdown_connections 2024-09-19T08:44:21.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.443+0000 7fcaf5e9c740 1 --2- 172.21.15.7:0/2164059328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55980922dbb0 0x55980922ffa0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.443+0000 7fcaf5e9c740 1 --2- 172.21.15.7:0/2164059328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598092232f0 0x55980922d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.443+0000 7fcaf5e9c740 1 --2- 172.21.15.7:0/2164059328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598092229d0 0x559809222db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.443+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/2164059328 >> 172.21.15.7:0/2164059328 conn(0x55980921ef60 msgr2=0x55980921f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:21.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.443+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/2164059328 shutdown_connections 2024-09-19T08:44:21.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.443+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/2164059328 wait complete. 2024-09-19T08:44:21.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.443+0000 7fcaf5e9c740 1 -- start start 2024-09-19T08:44:21.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.443+0000 7fcaf5e9c740 1 Processor -- start 2024-09-19T08:44:21.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcaf5e9c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598092229d0 0x55980922d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcaf5e9c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598092232f0 0x55980922a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcaf5e9c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55980922dbb0 0x55980922acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcaf5e9c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559809230780 con 0x55980922dbb0 2024-09-19T08:44:21.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcaf5e9c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559809143f20 con 0x5598092232f0 2024-09-19T08:44:21.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcaf5e9c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559809230900 con 0x5598092229d0 2024-09-19T08:44:21.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcaf5e9c740 10 client.0 _ll_register_callbacks cb 0x55980910d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:44:21.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcaf2060640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55980922dbb0 0x55980922acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:21.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcaf2060640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55980922dbb0 0x55980922acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45366/0 (socket says 172.21.15.7:45366) 2024-09-19T08:44:21.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcaf2060640 1 -- 172.21.15.7:0/3110688606 learned_addr learned my addr 172.21.15.7:0/3110688606 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:21.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcaf185f640 1 --2- 172.21.15.7:0/3110688606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598092229d0 0x55980922d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:21.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcaf105e640 1 --2- 172.21.15.7:0/3110688606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598092232f0 0x55980922a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:21.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcaf2060640 1 -- 172.21.15.7:0/3110688606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598092229d0 msgr2=0x55980922d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:21.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcaf2060640 1 --2- 172.21.15.7:0/3110688606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598092229d0 0x55980922d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcaf2060640 1 -- 172.21.15.7:0/3110688606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598092232f0 msgr2=0x55980922a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:21.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcaf2060640 1 --2- 172.21.15.7:0/3110688606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598092232f0 0x55980922a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcaf2060640 1 -- 172.21.15.7:0/3110688606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559808efa2b0 con 0x55980922dbb0 2024-09-19T08:44:21.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcaf185f640 1 --2- 172.21.15.7:0/3110688606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598092229d0 0x55980922d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:21.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcaf2060640 1 --2- 172.21.15.7:0/3110688606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55980922dbb0 0x55980922acb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcae4033000 tx=0x7fcae402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1710608d8c24aab6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:21.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcad17fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:44:21.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcad17fa640 1 -- 172.21.15.7:0/3110688606 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae4035040 con 0x55980922dbb0 2024-09-19T08:44:21.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcad17fa640 1 -- 172.21.15.7:0/3110688606 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcae40037f0 con 0x55980922dbb0 2024-09-19T08:44:21.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.444+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/3110688606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcae009ca60 con 0x55980922dbb0 2024-09-19T08:44:21.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.445+0000 7fcad17fa640 1 -- 172.21.15.7:0/3110688606 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcae4009520 con 0x55980922dbb0 2024-09-19T08:44:21.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.445+0000 7fcaf5e9c740 10 client.15069 fetch_fsmap learned FSMap version 24 2024-09-19T08:44:21.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.445+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/3110688606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55980923c070 con 0x55980922dbb0 2024-09-19T08:44:21.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.445+0000 7fcad17fa640 1 -- 172.21.15.7:0/3110688606 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcae009ca60 con 0x55980922dbb0 2024-09-19T08:44:21.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.445+0000 7fcad17fa640 1 -- 172.21.15.7:0/3110688606 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcae403a040 con 0x55980922dbb0 2024-09-19T08:44:21.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.445+0000 7fcaf5e9c740 10 client.15069 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T08:44:21.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.445+0000 7fcaf5e9c740 10 client.15069 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T08:44:21.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.445+0000 7fcaf5e9c740 20 client.15069 populate_metadata read hostname 'smithi007' 2024-09-19T08:44:21.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.445+0000 7fcaf5e9c740 1 --2- 172.21.15.7:0/3110688606 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55980923e700 0x55980923fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.445+0000 7fcaf5e9c740 4 client.15069 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:44:21.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.445+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/3110688606 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559809196600 con 0x55980923e700 2024-09-19T08:44:21.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.446+0000 7fcaf185f640 1 --2- 172.21.15.7:0/3110688606 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55980923e700 0x55980923fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:21.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.446+0000 7fcaf185f640 1 --2- 172.21.15.7:0/3110688606 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55980923e700 0x55980923fb70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8f6e58886d35cfa0 server_cookie=e035b7834c72ccfc in_seq=0 out_seq=0 2024-09-19T08:44:21.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.446+0000 7fcad17fa640 10 client.15069 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:44:21.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.447+0000 7fcad17fa640 1 -- 172.21.15.7:0/3110688606 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559809196600 con 0x55980923e700 2024-09-19T08:44:21.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.447+0000 7fcad17fa640 10 client.15069 handle_command_reply: tid=0 2024-09-19T08:44:21.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.447+0000 7fcaf5e9c740 1 client.15069 shutdown 2024-09-19T08:44:21.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.447+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/3110688606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55980922dbb0 msgr2=0x55980922acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:21.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.447+0000 7fcaf5e9c740 1 --2- 172.21.15.7:0/3110688606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55980922dbb0 0x55980922acb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcae4033000 tx=0x7fcae402a410 comp rx=0 tx=0).stop 2024-09-19T08:44:21.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.447+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/3110688606 shutdown_connections 2024-09-19T08:44:21.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.447+0000 7fcaf5e9c740 1 --2- 172.21.15.7:0/3110688606 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55980923e700 0x55980923fb70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.447+0000 7fcaf5e9c740 1 --2- 172.21.15.7:0/3110688606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55980922dbb0 0x55980922acb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.447+0000 7fcaf5e9c740 1 --2- 172.21.15.7:0/3110688606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598092232f0 0x55980922a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.447+0000 7fcaf5e9c740 1 --2- 172.21.15.7:0/3110688606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598092229d0 0x55980922d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.447+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/3110688606 >> 172.21.15.7:0/3110688606 conn(0x55980921ef60 msgr2=0x559809224c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:21.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.447+0000 7fcad17fa640 0 client.15069 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:44:21.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.447+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/3110688606 shutdown_connections 2024-09-19T08:44:21.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.447+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/3110688606 wait complete. 2024-09-19T08:44:21.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.447+0000 7fcaf5e9c740 20 client.15069 trim_cache size 0 max 16384 2024-09-19T08:44:21.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.465+0000 7fcaf5e9c740 1 Processor -- start 2024-09-19T08:44:21.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.465+0000 7fcaf5e9c740 1 -- start start 2024-09-19T08:44:21.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.466+0000 7fcaf5e9c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5598092229d0 0x55980923e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.466+0000 7fcaf5e9c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598092232f0 0x55980923d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.466+0000 7fcaf5e9c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55980922dbb0 0x559809229040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.466+0000 7fcaf5e9c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55980923deb0 con 0x5598092229d0 2024-09-19T08:44:21.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.466+0000 7fcaf5e9c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55980923e580 con 0x55980922dbb0 2024-09-19T08:44:21.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.466+0000 7fcaf5e9c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55980923ec50 con 0x5598092232f0 2024-09-19T08:44:21.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.466+0000 7fcaf185f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5598092229d0 0x55980923e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:21.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.466+0000 7fcaf185f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5598092229d0 0x55980923e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45372/0 (socket says 172.21.15.7:45372) 2024-09-19T08:44:21.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.466+0000 7fcaf185f640 1 -- 172.21.15.7:0/2878070887 learned_addr learned my addr 172.21.15.7:0/2878070887 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:21.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.466+0000 7fcaf2060640 1 --2- 172.21.15.7:0/2878070887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55980922dbb0 0x559809229040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:21.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.466+0000 7fcaf105e640 1 --2- 172.21.15.7:0/2878070887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598092232f0 0x55980923d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:21.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.466+0000 7fcaf185f640 1 -- 172.21.15.7:0/2878070887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598092232f0 msgr2=0x55980923d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:21.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.466+0000 7fcaf185f640 1 --2- 172.21.15.7:0/2878070887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598092232f0 0x55980923d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.466+0000 7fcaf185f640 1 -- 172.21.15.7:0/2878070887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55980922dbb0 msgr2=0x559809229040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:21.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.466+0000 7fcaf185f640 1 --2- 172.21.15.7:0/2878070887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55980922dbb0 0x559809229040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.466+0000 7fcaf185f640 1 -- 172.21.15.7:0/2878070887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55980922d040 con 0x5598092229d0 2024-09-19T08:44:21.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.466+0000 7fcaf185f640 1 --2- 172.21.15.7:0/2878070887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5598092229d0 0x55980923e700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcadc011900 tx=0x7fcadc009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84c370c6636ad0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:21.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.466+0000 7fcad37fe640 1 -- 172.21.15.7:0/2878070887 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc004d20 con 0x5598092229d0 2024-09-19T08:44:21.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.467+0000 7fcad37fe640 1 -- 172.21.15.7:0/2878070887 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcadc003e50 con 0x5598092229d0 2024-09-19T08:44:21.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.467+0000 7fcad37fe640 1 -- 172.21.15.7:0/2878070887 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc0044f0 con 0x5598092229d0 2024-09-19T08:44:21.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.467+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/2878070887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5598092229d0 msgr2=0x55980923e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:21.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.467+0000 7fcaf5e9c740 1 --2- 172.21.15.7:0/2878070887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5598092229d0 0x55980923e700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcadc011900 tx=0x7fcadc009500 comp rx=0 tx=0).stop 2024-09-19T08:44:21.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.467+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/2878070887 shutdown_connections 2024-09-19T08:44:21.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.467+0000 7fcaf5e9c740 1 --2- 172.21.15.7:0/2878070887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55980922dbb0 0x559809229040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.467+0000 7fcaf5e9c740 1 --2- 172.21.15.7:0/2878070887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5598092232f0 0x55980923d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.467+0000 7fcaf5e9c740 1 --2- 172.21.15.7:0/2878070887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5598092229d0 0x55980923e700 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.467+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/2878070887 >> 172.21.15.7:0/2878070887 conn(0x55980921ef60 msgr2=0x55980922a730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:21.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.467+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/2878070887 shutdown_connections 2024-09-19T08:44:21.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.467+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/2878070887 wait complete. 2024-09-19T08:44:21.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.468+0000 7fcaf5e9c740 1 -- start start 2024-09-19T08:44:21.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.468+0000 7fcaf5e9c740 1 Processor -- start 2024-09-19T08:44:21.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.468+0000 7fcaf5e9c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5598092229d0 0x559809246b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.468+0000 7fcaf5e9c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598092232f0 0x559809247090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.468+0000 7fcaf5e9c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55980922dbb0 0x5598092a6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.468+0000 7fcaf5e9c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55980923f9f0 con 0x5598092229d0 2024-09-19T08:44:21.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.468+0000 7fcaf5e9c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55980923f320 con 0x5598092232f0 2024-09-19T08:44:21.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.468+0000 7fcaf5e9c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5598092400c0 con 0x55980922dbb0 2024-09-19T08:44:21.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.468+0000 7fcaf5e9c740 10 client.0 _ll_register_callbacks cb 0x7fcae0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:44:21.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.468+0000 7fcaf185f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5598092229d0 0x559809246b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:21.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.468+0000 7fcaf185f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5598092229d0 0x559809246b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45374/0 (socket says 172.21.15.7:45374) 2024-09-19T08:44:21.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.468+0000 7fcaf185f640 1 -- 172.21.15.7:0/726167599 learned_addr learned my addr 172.21.15.7:0/726167599 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:21.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.468+0000 7fcaf105e640 1 --2- 172.21.15.7:0/726167599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598092232f0 0x559809247090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:21.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.469+0000 7fcaf185f640 1 -- 172.21.15.7:0/726167599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55980922dbb0 msgr2=0x5598092a6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:21.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.469+0000 7fcaf185f640 1 --2- 172.21.15.7:0/726167599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55980922dbb0 0x5598092a6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.469+0000 7fcaf185f640 1 -- 172.21.15.7:0/726167599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598092232f0 msgr2=0x559809247090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:21.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.469+0000 7fcaf185f640 1 --2- 172.21.15.7:0/726167599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598092232f0 0x559809247090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.469+0000 7fcaf185f640 1 -- 172.21.15.7:0/726167599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598092a7340 con 0x5598092229d0 2024-09-19T08:44:21.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.469+0000 7fcaf185f640 1 --2- 172.21.15.7:0/726167599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5598092229d0 0x559809246b50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcadc006010 tx=0x7fcadc0039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b452a30e6a9723 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:21.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.469+0000 7fcad17fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:44:21.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.469+0000 7fcad17fa640 1 -- 172.21.15.7:0/726167599 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc02a040 con 0x5598092229d0 2024-09-19T08:44:21.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.469+0000 7fcad17fa640 1 -- 172.21.15.7:0/726167599 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcadc004cb0 con 0x5598092229d0 2024-09-19T08:44:21.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.469+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/726167599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcadc003e50 con 0x5598092229d0 2024-09-19T08:44:21.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.469+0000 7fcad17fa640 1 -- 172.21.15.7:0/726167599 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcadc003ca0 con 0x5598092229d0 2024-09-19T08:44:21.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.469+0000 7fcaf5e9c740 10 client.15075 fetch_fsmap learned FSMap version 24 2024-09-19T08:44:21.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.469+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/726167599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5598092a85f0 con 0x5598092229d0 2024-09-19T08:44:21.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.469+0000 7fcad17fa640 1 -- 172.21.15.7:0/726167599 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcadc003e50 con 0x5598092229d0 2024-09-19T08:44:21.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.469+0000 7fcad17fa640 1 -- 172.21.15.7:0/726167599 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcadc02d070 con 0x5598092229d0 2024-09-19T08:44:21.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.469+0000 7fcaf5e9c740 10 client.15075 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T08:44:21.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.470+0000 7fcaf5e9c740 10 client.15075 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T08:44:21.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.470+0000 7fcaf5e9c740 20 client.15075 populate_metadata read hostname 'smithi007' 2024-09-19T08:44:21.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.470+0000 7fcaf5e9c740 1 --2- 172.21.15.7:0/726167599 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5598092acf60 0x5598092abc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.470+0000 7fcaf5e9c740 4 client.15075 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:44:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.470+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/726167599 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "status"}) -- 0x559809190b10 con 0x5598092acf60 2024-09-19T08:44:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.470+0000 7fcaf105e640 1 --2- 172.21.15.7:0/726167599 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5598092acf60 0x5598092abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.470+0000 7fcaf105e640 1 --2- 172.21.15.7:0/726167599 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5598092acf60 0x5598092abc70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7f13e79beb4791b0 server_cookie=70d5cde9862dbdfb in_seq=0 out_seq=0 2024-09-19T08:44:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.470+0000 7fcad17fa640 10 client.15075 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:44:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.470+0000 7fcad17fa640 1 -- 172.21.15.7:0/726167599 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x559809190b10 con 0x5598092acf60 2024-09-19T08:44:21.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.470+0000 7fcad17fa640 10 client.15075 handle_command_reply: tid=0 2024-09-19T08:44:21.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.470+0000 7fcaf5e9c740 1 client.15075 shutdown 2024-09-19T08:44:21.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.471+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/726167599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5598092229d0 msgr2=0x559809246b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:21.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.471+0000 7fcaf5e9c740 1 --2- 172.21.15.7:0/726167599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5598092229d0 0x559809246b50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcadc006010 tx=0x7fcadc0039f0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.471+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/726167599 shutdown_connections 2024-09-19T08:44:21.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.471+0000 7fcaf5e9c740 1 --2- 172.21.15.7:0/726167599 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5598092acf60 0x5598092abc70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.471+0000 7fcaf5e9c740 1 --2- 172.21.15.7:0/726167599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55980922dbb0 0x5598092a6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.471+0000 7fcaf5e9c740 1 --2- 172.21.15.7:0/726167599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598092232f0 0x559809247090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.471+0000 7fcad17fa640 0 client.15075 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:44:21.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.471+0000 7fcaf5e9c740 1 --2- 172.21.15.7:0/726167599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5598092229d0 0x559809246b50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.471+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/726167599 >> 172.21.15.7:0/726167599 conn(0x55980921ef60 msgr2=0x5598092255c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:21.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.471+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/726167599 shutdown_connections 2024-09-19T08:44:21.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.471+0000 7fcaf5e9c740 1 -- 172.21.15.7:0/726167599 wait complete. 2024-09-19T08:44:21.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.471+0000 7fcaf5e9c740 20 client.15075 trim_cache size 0 max 16384 2024-09-19T08:44:21.479 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:44:21.479 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "ebd23124-7661-11ef-bceb-c7b262605968", 2024-09-19T08:44:21.479 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 2, 2024-09-19T08:44:21.479 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24458, 2024-09-19T08:44:21.480 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T08:44:21.480 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T08:44:21.480 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T08:44:21.480 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 88.389406104000003, 2024-09-19T08:44:21.480 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 24, 2024-09-19T08:44:21.480 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 82, 2024-09-19T08:44:21.480 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T08:44:21.480 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 118.247476533 2024-09-19T08:44:21.480 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:44:21.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.471+0000 7fcaf3ac3640 1 -- 172.21.15.7:0/2572473226 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fcad40a3350 msgr2=0x7fcad40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:21.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.471+0000 7fcaf3ac3640 1 --2- 172.21.15.7:0/2572473226 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fcad40a3350 0x7fcad40a5810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcae40096c0 tx=0x7fcae4009260 comp rx=0 tx=0).stop 2024-09-19T08:44:21.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.471+0000 7fcaf3ac3640 1 -- 172.21.15.7:0/2572473226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaec102790 msgr2=0x7fcaec198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:21.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.471+0000 7fcaf3ac3640 1 --2- 172.21.15.7:0/2572473226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaec102790 0x7fcaec198a10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcae000e9f0 tx=0x7fcae000edf0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.471+0000 7fcaf3ac3640 1 -- 172.21.15.7:0/2572473226 shutdown_connections 2024-09-19T08:44:21.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.471+0000 7fcaf3ac3640 1 --2- 172.21.15.7:0/2572473226 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7fcad40a3350 0x7fcad40a5810 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.471+0000 7fcaf3ac3640 1 --2- 172.21.15.7:0/2572473226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcaec106f10 0x7fcaec19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.471+0000 7fcaf3ac3640 1 --2- 172.21.15.7:0/2572473226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcaec102790 0x7fcaec198a10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.471+0000 7fcaf3ac3640 1 --2- 172.21.15.7:0/2572473226 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcaec101de0 0x7fcaec1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:21.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.472+0000 7fcaf3ac3640 1 -- 172.21.15.7:0/2572473226 >> 172.21.15.7:0/2572473226 conn(0x7fcaec0fd8c0 msgr2=0x7fcaec0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:21.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.472+0000 7fcaf3ac3640 1 -- 172.21.15.7:0/2572473226 shutdown_connections 2024-09-19T08:44:21.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:21.472+0000 7fcaf3ac3640 1 -- 172.21.15.7:0/2572473226 wait complete. 2024-09-19T08:44:22.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:21 smithi007 ceph-mon[31221]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:44:22.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:21 smithi044 ceph-mon[35072]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:44:22.329 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T08:44:22.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:21 smithi175 ceph-mon[35688]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:44:22.588 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.068+0000 7f6687057640 1 -- 172.21.15.7:0/778275093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6680106f10 msgr2=0x7f668010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.068+0000 7f6687057640 1 --2- 172.21.15.7:0/778275093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6680106f10 0x7f668010ea90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6678009ca0 tx=0x7f667802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.068+0000 7f6687057640 1 -- 172.21.15.7:0/778275093 shutdown_connections 2024-09-19T08:44:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.068+0000 7f6687057640 1 --2- 172.21.15.7:0/778275093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6680106f10 0x7f668010ea90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.068+0000 7f6687057640 1 --2- 172.21.15.7:0/778275093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6680102790 0x7f66801067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.068+0000 7f6687057640 1 --2- 172.21.15.7:0/778275093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6680101de0 0x7f66801021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.068+0000 7f6687057640 1 -- 172.21.15.7:0/778275093 >> 172.21.15.7:0/778275093 conn(0x7f66800fd8c0 msgr2=0x7f66800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.068+0000 7f6687057640 1 -- 172.21.15.7:0/778275093 shutdown_connections 2024-09-19T08:44:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.068+0000 7f6687057640 1 -- 172.21.15.7:0/778275093 wait complete. 2024-09-19T08:44:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.068+0000 7f6687057640 1 Processor -- start 2024-09-19T08:44:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.068+0000 7f6687057640 1 -- start start 2024-09-19T08:44:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.069+0000 7f6687057640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6680101de0 0x7f66800744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.069+0000 7f6687057640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6680102790 0x7f6680074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.069+0000 7f6687057640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6680106f10 0x7f6680074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.069+0000 7f6687057640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6680111f70 con 0x7f6680101de0 2024-09-19T08:44:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.069+0000 7f6687057640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6680111df0 con 0x7f6680106f10 2024-09-19T08:44:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.069+0000 7f6687057640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f66801120f0 con 0x7f6680102790 2024-09-19T08:44:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.069+0000 7f6684df3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6680101de0 0x7f66800744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.069+0000 7f6684df3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6680101de0 0x7f66800744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45404/0 (socket says 172.21.15.7:45404) 2024-09-19T08:44:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.069+0000 7f6684df3640 1 -- 172.21.15.7:0/2831102854 learned_addr learned my addr 172.21.15.7:0/2831102854 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.069+0000 7f66855f4640 1 --2- 172.21.15.7:0/2831102854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6680106f10 0x7f6680074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.069+0000 7f667ffff640 1 --2- 172.21.15.7:0/2831102854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6680102790 0x7f6680074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.069+0000 7f6684df3640 1 -- 172.21.15.7:0/2831102854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6680102790 msgr2=0x7f6680074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.069+0000 7f6684df3640 1 --2- 172.21.15.7:0/2831102854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6680102790 0x7f6680074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.069+0000 7f6684df3640 1 -- 172.21.15.7:0/2831102854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6680106f10 msgr2=0x7f6680074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.069+0000 7f6684df3640 1 --2- 172.21.15.7:0/2831102854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6680106f10 0x7f6680074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.069+0000 7f6684df3640 1 -- 172.21.15.7:0/2831102854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66801a6870 con 0x7f6680101de0 2024-09-19T08:44:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.069+0000 7f6684df3640 1 --2- 172.21.15.7:0/2831102854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6680101de0 0x7f66800744f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f667400d770 tx=0x7f667400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.069+0000 7f667dffb640 1 -- 172.21.15.7:0/2831102854 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6674017070 con 0x7f6680101de0 2024-09-19T08:44:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.069+0000 7f6687057640 1 -- 172.21.15.7:0/2831102854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66801a6b60 con 0x7f6680101de0 2024-09-19T08:44:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.069+0000 7f667dffb640 1 -- 172.21.15.7:0/2831102854 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6674005500 con 0x7f6680101de0 2024-09-19T08:44:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.069+0000 7f667dffb640 1 -- 172.21.15.7:0/2831102854 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6674004e00 con 0x7f6680101de0 2024-09-19T08:44:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.070+0000 7f6687057640 1 -- 172.21.15.7:0/2831102854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66801a70a0 con 0x7f6680101de0 2024-09-19T08:44:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.072+0000 7f667dffb640 1 -- 172.21.15.7:0/2831102854 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f6674004fa0 con 0x7f6680101de0 2024-09-19T08:44:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.072+0000 7f6689430740 1 Processor -- start 2024-09-19T08:44:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.072+0000 7f6689430740 1 -- start start 2024-09-19T08:44:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.072+0000 7f6689430740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5562d1d059d0 0x5562d1d05db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.072+0000 7f6689430740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d062f0 0x5562d1d10670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.072+0000 7f667dffb640 1 --2- 172.21.15.7:0/2831102854 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f66700a32d0 0x7f66700a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.072+0000 7f6689430740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d10bb0 0x5562d1d12fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.072+0000 7f6689430740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5562d1c6c090 con 0x5562d1d062f0 2024-09-19T08:44:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.072+0000 7f6689430740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5562d1c13a70 con 0x5562d1d10bb0 2024-09-19T08:44:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.072+0000 7f6689430740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5562d1c68050 con 0x5562d1d059d0 2024-09-19T08:44:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.072+0000 7f6684df3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d062f0 0x5562d1d10670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.072+0000 7f667ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d10bb0 0x5562d1d12fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.072+0000 7f66855f4640 1 --2- 172.21.15.7:0/2831102854 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f66700a32d0 0x7f66700a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.073+0000 7f667ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d10bb0 0x5562d1d12fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:37324/0 (socket says 172.21.15.7:37324) 2024-09-19T08:44:23.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.073+0000 7f667ffff640 1 -- 172.21.15.7:0/3485906771 learned_addr learned my addr 172.21.15.7:0/3485906771 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:23.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.073+0000 7f6684df3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d062f0 0x5562d1d10670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45414/0 (socket says 172.21.15.7:45414) 2024-09-19T08:44:23.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.073+0000 7f66855f4640 1 --2- 172.21.15.7:0/3485906771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5562d1d059d0 0x5562d1d05db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.073+0000 7f667dffb640 1 -- 172.21.15.7:0/2831102854 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f66740cf4e0 con 0x7f6680101de0 2024-09-19T08:44:23.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.073+0000 7f6684df3640 1 -- 172.21.15.7:0/3485906771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5562d1d059d0 msgr2=0x5562d1d05db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:23.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.073+0000 7f6684df3640 1 --2- 172.21.15.7:0/3485906771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5562d1d059d0 0x5562d1d05db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.073+0000 7f6684df3640 1 -- 172.21.15.7:0/3485906771 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d10bb0 msgr2=0x5562d1d12fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:23.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.073+0000 7f6684df3640 1 --2- 172.21.15.7:0/3485906771 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d10bb0 0x5562d1d12fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.073+0000 7f6684df3640 1 -- 172.21.15.7:0/3485906771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562d1c20130 con 0x5562d1d062f0 2024-09-19T08:44:23.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.073+0000 7f667ffff640 1 --2- 172.21.15.7:0/3485906771 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d10bb0 0x5562d1d12fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:44:23.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.073+0000 7f66855f4640 1 --2- 172.21.15.7:0/2831102854 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f66700a32d0 0x7f66700a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6678004af0 tx=0x7f667802f500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:23.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.073+0000 7f6684df3640 1 --2- 172.21.15.7:0/3485906771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d062f0 0x5562d1d10670 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f66740cce90 tx=0x7f667406e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2718cb11007bf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:23.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.073+0000 7f666affd640 1 -- 172.21.15.7:0/3485906771 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6674020040 con 0x5562d1d062f0 2024-09-19T08:44:23.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.073+0000 7f666affd640 1 -- 172.21.15.7:0/3485906771 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f667409b9a0 con 0x5562d1d062f0 2024-09-19T08:44:23.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.073+0000 7f666affd640 1 -- 172.21.15.7:0/3485906771 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66740cd0e0 con 0x5562d1d062f0 2024-09-19T08:44:23.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.074+0000 7f6689430740 1 -- 172.21.15.7:0/3485906771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d062f0 msgr2=0x5562d1d10670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:23.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.074+0000 7f6689430740 1 --2- 172.21.15.7:0/3485906771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d062f0 0x5562d1d10670 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f66740cce90 tx=0x7f667406e820 comp rx=0 tx=0).stop 2024-09-19T08:44:23.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.074+0000 7f6689430740 1 -- 172.21.15.7:0/3485906771 shutdown_connections 2024-09-19T08:44:23.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.074+0000 7f6689430740 1 --2- 172.21.15.7:0/3485906771 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d10bb0 0x5562d1d12fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.074+0000 7f6689430740 1 --2- 172.21.15.7:0/3485906771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d062f0 0x5562d1d10670 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.074+0000 7f6689430740 1 --2- 172.21.15.7:0/3485906771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5562d1d059d0 0x5562d1d05db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.074+0000 7f6689430740 1 -- 172.21.15.7:0/3485906771 >> 172.21.15.7:0/3485906771 conn(0x5562d1d01f60 msgr2=0x5562d1d02340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:23.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.074+0000 7f6689430740 1 -- 172.21.15.7:0/3485906771 shutdown_connections 2024-09-19T08:44:23.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.074+0000 7f6689430740 1 -- 172.21.15.7:0/3485906771 wait complete. 2024-09-19T08:44:23.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.074+0000 7f6689430740 1 -- start start 2024-09-19T08:44:23.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.074+0000 7f6689430740 1 Processor -- start 2024-09-19T08:44:23.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.075+0000 7f6689430740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d059d0 0x5562d1d10400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.075+0000 7f6689430740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5562d1d062f0 0x5562d1d0d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.075+0000 7f6689430740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d10bb0 0x5562d1d0dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.075+0000 7f6689430740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5562d1d13720 con 0x5562d1d059d0 2024-09-19T08:44:23.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.075+0000 7f6689430740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5562d1c26f20 con 0x5562d1d10bb0 2024-09-19T08:44:23.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.075+0000 7f6689430740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5562d1d138a0 con 0x5562d1d062f0 2024-09-19T08:44:23.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.075+0000 7f6689430740 10 client.0 _ll_register_callbacks cb 0x5562d1bf0030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:44:23.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.075+0000 7f6684df3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d059d0 0x5562d1d10400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.075+0000 7f6684df3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d059d0 0x5562d1d10400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45416/0 (socket says 172.21.15.7:45416) 2024-09-19T08:44:23.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.075+0000 7f6684df3640 1 -- 172.21.15.7:0/3241031887 learned_addr learned my addr 172.21.15.7:0/3241031887 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.075+0000 7f66855f4640 1 --2- 172.21.15.7:0/3241031887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d10bb0 0x5562d1d0dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.075+0000 7f667ffff640 1 --2- 172.21.15.7:0/3241031887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5562d1d062f0 0x5562d1d0d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.075+0000 7f6684df3640 1 -- 172.21.15.7:0/3241031887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5562d1d062f0 msgr2=0x5562d1d0d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.075+0000 7f6684df3640 1 --2- 172.21.15.7:0/3241031887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5562d1d062f0 0x5562d1d0d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.075+0000 7f6684df3640 1 -- 172.21.15.7:0/3241031887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d10bb0 msgr2=0x5562d1d0dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.075+0000 7f6684df3640 1 --2- 172.21.15.7:0/3241031887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d10bb0 0x5562d1d0dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.075+0000 7f6684df3640 1 -- 172.21.15.7:0/3241031887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562d19dd2b0 con 0x5562d1d059d0 2024-09-19T08:44:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.075+0000 7f6684df3640 1 --2- 172.21.15.7:0/3241031887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d059d0 0x5562d1d10400 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f66740cd410 tx=0x7f667409c160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe50be9ad4e440ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.075+0000 7f665ffff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:44:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.076+0000 7f665ffff640 1 -- 172.21.15.7:0/3241031887 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6674020070 con 0x5562d1d059d0 2024-09-19T08:44:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.076+0000 7f665ffff640 1 -- 172.21.15.7:0/3241031887 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6674009cc0 con 0x5562d1d059d0 2024-09-19T08:44:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.076+0000 7f6689430740 1 -- 172.21.15.7:0/3241031887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f667409b9a0 con 0x5562d1d059d0 2024-09-19T08:44:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.076+0000 7f665ffff640 1 -- 172.21.15.7:0/3241031887 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f66740a4610 con 0x5562d1d059d0 2024-09-19T08:44:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.076+0000 7f6689430740 10 client.15087 fetch_fsmap learned FSMap version 24 2024-09-19T08:44:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.076+0000 7f6689430740 1 -- 172.21.15.7:0/3241031887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5562d1d1eff0 con 0x5562d1d059d0 2024-09-19T08:44:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.076+0000 7f665ffff640 1 -- 172.21.15.7:0/3241031887 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f667409b9a0 con 0x5562d1d059d0 2024-09-19T08:44:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.076+0000 7f665ffff640 1 -- 172.21.15.7:0/3241031887 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f66740a4180 con 0x5562d1d059d0 2024-09-19T08:44:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.076+0000 7f6689430740 10 client.15087 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T08:44:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.076+0000 7f6689430740 10 client.15087 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T08:44:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.076+0000 7f6689430740 20 client.15087 populate_metadata read hostname 'smithi007' 2024-09-19T08:44:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.076+0000 7f6689430740 1 --2- 172.21.15.7:0/3241031887 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5562d1d21220 0x5562d1d22690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.076+0000 7f6689430740 4 client.15087 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:44:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.076+0000 7f6689430740 1 -- 172.21.15.7:0/3241031887 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562d1c79600 con 0x5562d1d21220 2024-09-19T08:44:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.076+0000 7f667ffff640 1 --2- 172.21.15.7:0/3241031887 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5562d1d21220 0x5562d1d22690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.077+0000 7f667ffff640 1 --2- 172.21.15.7:0/3241031887 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5562d1d21220 0x5562d1d22690 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f85cec9657f137e6 server_cookie=7abb92f1766bd472 in_seq=0 out_seq=0 2024-09-19T08:44:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.077+0000 7f665ffff640 10 client.15087 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:44:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.078+0000 7f665ffff640 1 -- 172.21.15.7:0/3241031887 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5562d1c79600 con 0x5562d1d21220 2024-09-19T08:44:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.078+0000 7f665ffff640 10 client.15087 handle_command_reply: tid=0 2024-09-19T08:44:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.078+0000 7f6689430740 1 client.15087 shutdown 2024-09-19T08:44:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.078+0000 7f6689430740 1 -- 172.21.15.7:0/3241031887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d059d0 msgr2=0x5562d1d10400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.078+0000 7f6689430740 1 --2- 172.21.15.7:0/3241031887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d059d0 0x5562d1d10400 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f66740cd410 tx=0x7f667409c160 comp rx=0 tx=0).stop 2024-09-19T08:44:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.078+0000 7f6689430740 1 -- 172.21.15.7:0/3241031887 shutdown_connections 2024-09-19T08:44:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.078+0000 7f6689430740 1 --2- 172.21.15.7:0/3241031887 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5562d1d21220 0x5562d1d22690 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.078+0000 7f6689430740 1 --2- 172.21.15.7:0/3241031887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d10bb0 0x5562d1d0dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.078+0000 7f665ffff640 0 client.15087 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:44:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.078+0000 7f6689430740 1 --2- 172.21.15.7:0/3241031887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5562d1d062f0 0x5562d1d0d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.078+0000 7f6689430740 1 --2- 172.21.15.7:0/3241031887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d059d0 0x5562d1d10400 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.078+0000 7f6689430740 1 -- 172.21.15.7:0/3241031887 >> 172.21.15.7:0/3241031887 conn(0x5562d1d01f60 msgr2=0x5562d1d07c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:23.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.078+0000 7f6689430740 1 -- 172.21.15.7:0/3241031887 shutdown_connections 2024-09-19T08:44:23.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.078+0000 7f6689430740 1 -- 172.21.15.7:0/3241031887 wait complete. 2024-09-19T08:44:23.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.078+0000 7f6689430740 20 client.15087 trim_cache size 0 max 16384 2024-09-19T08:44:23.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.096+0000 7f6689430740 1 Processor -- start 2024-09-19T08:44:23.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.096+0000 7f6689430740 1 -- start start 2024-09-19T08:44:23.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.096+0000 7f6689430740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5562d1d059d0 0x5562d1d22690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.096+0000 7f6689430740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d062f0 0x5562d1d08610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.096+0000 7f6689430740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d10bb0 0x5562d1d08b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.096+0000 7f6689430740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5562d1d209d0 con 0x5562d1d10bb0 2024-09-19T08:44:23.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.096+0000 7f6689430740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5562d1d210a0 con 0x5562d1d062f0 2024-09-19T08:44:23.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.096+0000 7f6689430740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5562d1d21770 con 0x5562d1d059d0 2024-09-19T08:44:23.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.096+0000 7f66855f4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d10bb0 0x5562d1d08b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.096+0000 7f66855f4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d10bb0 0x5562d1d08b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45420/0 (socket says 172.21.15.7:45420) 2024-09-19T08:44:23.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.096+0000 7f66855f4640 1 -- 172.21.15.7:0/4100304305 learned_addr learned my addr 172.21.15.7:0/4100304305 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:23.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.096+0000 7f667ffff640 1 --2- 172.21.15.7:0/4100304305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d062f0 0x5562d1d08610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.097+0000 7f6684df3640 1 --2- 172.21.15.7:0/4100304305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5562d1d059d0 0x5562d1d22690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.097+0000 7f66855f4640 1 -- 172.21.15.7:0/4100304305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5562d1d059d0 msgr2=0x5562d1d22690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:23.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.097+0000 7f66855f4640 1 --2- 172.21.15.7:0/4100304305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5562d1d059d0 0x5562d1d22690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.097+0000 7f66855f4640 1 -- 172.21.15.7:0/4100304305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d062f0 msgr2=0x5562d1d08610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:23.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.097+0000 7f66855f4640 1 --2- 172.21.15.7:0/4100304305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d062f0 0x5562d1d08610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.097+0000 7f66855f4640 1 -- 172.21.15.7:0/4100304305 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562d1d06120 con 0x5562d1d10bb0 2024-09-19T08:44:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.097+0000 7f667ffff640 1 --2- 172.21.15.7:0/4100304305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d062f0 0x5562d1d08610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:44:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.097+0000 7f66855f4640 1 --2- 172.21.15.7:0/4100304305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d10bb0 0x5562d1d08b50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6678035000 tx=0x7f667804b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3148a2446a46787 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.097+0000 7f666a7fc640 1 -- 172.21.15.7:0/4100304305 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6678004030 con 0x5562d1d10bb0 2024-09-19T08:44:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.097+0000 7f666a7fc640 1 -- 172.21.15.7:0/4100304305 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66780046b0 con 0x5562d1d10bb0 2024-09-19T08:44:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.097+0000 7f666a7fc640 1 -- 172.21.15.7:0/4100304305 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f667802feb0 con 0x5562d1d10bb0 2024-09-19T08:44:23.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.098+0000 7f6689430740 1 -- 172.21.15.7:0/4100304305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d10bb0 msgr2=0x5562d1d08b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:23.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.098+0000 7f6689430740 1 --2- 172.21.15.7:0/4100304305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d10bb0 0x5562d1d08b50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6678035000 tx=0x7f667804b000 comp rx=0 tx=0).stop 2024-09-19T08:44:23.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.098+0000 7f6689430740 1 -- 172.21.15.7:0/4100304305 shutdown_connections 2024-09-19T08:44:23.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.098+0000 7f6689430740 1 --2- 172.21.15.7:0/4100304305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d10bb0 0x5562d1d08b50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.098+0000 7f6689430740 1 --2- 172.21.15.7:0/4100304305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d062f0 0x5562d1d08610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.098+0000 7f6689430740 1 --2- 172.21.15.7:0/4100304305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5562d1d059d0 0x5562d1d22690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.098+0000 7f6689430740 1 -- 172.21.15.7:0/4100304305 >> 172.21.15.7:0/4100304305 conn(0x5562d1d01f60 msgr2=0x5562d1cfcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.098+0000 7f6689430740 1 -- 172.21.15.7:0/4100304305 shutdown_connections 2024-09-19T08:44:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.098+0000 7f6689430740 1 -- 172.21.15.7:0/4100304305 wait complete. 2024-09-19T08:44:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.098+0000 7f6689430740 1 -- start start 2024-09-19T08:44:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.098+0000 7f6689430740 1 Processor -- start 2024-09-19T08:44:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.099+0000 7f6689430740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d059d0 0x5562d1d2ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.099+0000 7f6689430740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d062f0 0x5562d1d2b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.099+0000 7f6689430740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5562d1d10bb0 0x5562d1d23ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.099+0000 7f6689430740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5562d1d22510 con 0x5562d1d062f0 2024-09-19T08:44:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.099+0000 7f6689430740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5562d1d21e40 con 0x5562d1d059d0 2024-09-19T08:44:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.099+0000 7f6689430740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5562d1d22be0 con 0x5562d1d10bb0 2024-09-19T08:44:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.099+0000 7f6689430740 10 client.0 _ll_register_callbacks cb 0x7f666c00c350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:44:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.099+0000 7f667ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d062f0 0x5562d1d2b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.099+0000 7f6684df3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d059d0 0x5562d1d2ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.099+0000 7f667ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d062f0 0x5562d1d2b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45430/0 (socket says 172.21.15.7:45430) 2024-09-19T08:44:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.099+0000 7f667ffff640 1 -- 172.21.15.7:0/928495089 learned_addr learned my addr 172.21.15.7:0/928495089 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.099+0000 7f66855f4640 1 --2- 172.21.15.7:0/928495089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5562d1d10bb0 0x5562d1d23ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.099+0000 7f667ffff640 1 -- 172.21.15.7:0/928495089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5562d1d10bb0 msgr2=0x5562d1d23ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.099+0000 7f667ffff640 1 --2- 172.21.15.7:0/928495089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5562d1d10bb0 0x5562d1d23ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.099+0000 7f667ffff640 1 -- 172.21.15.7:0/928495089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d059d0 msgr2=0x5562d1d2ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.099+0000 7f667ffff640 1 --2- 172.21.15.7:0/928495089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d059d0 0x5562d1d2ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.099+0000 7f667ffff640 1 -- 172.21.15.7:0/928495089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562d1d24720 con 0x5562d1d062f0 2024-09-19T08:44:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.099+0000 7f667ffff640 1 --2- 172.21.15.7:0/928495089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d062f0 0x5562d1d2b0b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f666c00ccf0 tx=0x7f666c012b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88cdbe3ed410cfe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.099+0000 7f665ffff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:44:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.099+0000 7f665ffff640 1 -- 172.21.15.7:0/928495089 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666c005020 con 0x5562d1d062f0 2024-09-19T08:44:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.099+0000 7f665ffff640 1 -- 172.21.15.7:0/928495089 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f666c0051c0 con 0x5562d1d062f0 2024-09-19T08:44:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.099+0000 7f6689430740 1 -- 172.21.15.7:0/928495089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66780046b0 con 0x5562d1d062f0 2024-09-19T08:44:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.100+0000 7f665ffff640 1 -- 172.21.15.7:0/928495089 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f666c0053c0 con 0x5562d1d062f0 2024-09-19T08:44:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.100+0000 7f6689430740 10 client.15093 fetch_fsmap learned FSMap version 24 2024-09-19T08:44:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.100+0000 7f6689430740 1 -- 172.21.15.7:0/928495089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5562d1d29170 con 0x5562d1d062f0 2024-09-19T08:44:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.100+0000 7f665ffff640 1 -- 172.21.15.7:0/928495089 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66780046b0 con 0x5562d1d062f0 2024-09-19T08:44:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.100+0000 7f665ffff640 1 -- 172.21.15.7:0/928495089 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f666c004940 con 0x5562d1d062f0 2024-09-19T08:44:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.100+0000 7f6689430740 10 client.15093 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T08:44:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.100+0000 7f6689430740 10 client.15093 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T08:44:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.100+0000 7f6689430740 20 client.15093 populate_metadata read hostname 'smithi007' 2024-09-19T08:44:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.100+0000 7f6689430740 1 --2- 172.21.15.7:0/928495089 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5562d1d8ffa0 0x5562d1d8ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.100+0000 7f6689430740 4 client.15093 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:44:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.100+0000 7f6689430740 1 -- 172.21.15.7:0/928495089 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "status"}) -- 0x5562d1c73b10 con 0x5562d1d8ffa0 2024-09-19T08:44:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.100+0000 7f6684df3640 1 --2- 172.21.15.7:0/928495089 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5562d1d8ffa0 0x5562d1d8ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:23.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.101+0000 7f665ffff640 10 client.15093 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:44:23.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.101+0000 7f6684df3640 1 --2- 172.21.15.7:0/928495089 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5562d1d8ffa0 0x5562d1d8ecb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8808981f38562d0a server_cookie=f8e44cec455f134d in_seq=0 out_seq=0 2024-09-19T08:44:23.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.101+0000 7f665ffff640 1 -- 172.21.15.7:0/928495089 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5562d1c73b10 con 0x5562d1d8ffa0 2024-09-19T08:44:23.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.101+0000 7f665ffff640 10 client.15093 handle_command_reply: tid=0 2024-09-19T08:44:23.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.101+0000 7f6689430740 1 client.15093 shutdown 2024-09-19T08:44:23.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.101+0000 7f6689430740 1 -- 172.21.15.7:0/928495089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d062f0 msgr2=0x5562d1d2b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:23.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.101+0000 7f6689430740 1 --2- 172.21.15.7:0/928495089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d062f0 0x5562d1d2b0b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f666c00ccf0 tx=0x7f666c012b10 comp rx=0 tx=0).stop 2024-09-19T08:44:23.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.101+0000 7f6689430740 1 -- 172.21.15.7:0/928495089 shutdown_connections 2024-09-19T08:44:23.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.101+0000 7f6689430740 1 --2- 172.21.15.7:0/928495089 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5562d1d8ffa0 0x5562d1d8ecb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.101+0000 7f6689430740 1 --2- 172.21.15.7:0/928495089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5562d1d10bb0 0x5562d1d23ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.101+0000 7f665ffff640 0 client.15093 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:44:23.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.101+0000 7f6689430740 1 --2- 172.21.15.7:0/928495089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5562d1d062f0 0x5562d1d2b0b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.101+0000 7f6689430740 1 --2- 172.21.15.7:0/928495089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562d1d059d0 0x5562d1d2ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.101+0000 7f6689430740 1 -- 172.21.15.7:0/928495089 >> 172.21.15.7:0/928495089 conn(0x5562d1d01f60 msgr2=0x5562d1d08510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:23.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.101+0000 7f6689430740 1 -- 172.21.15.7:0/928495089 shutdown_connections 2024-09-19T08:44:23.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.101+0000 7f6689430740 1 -- 172.21.15.7:0/928495089 wait complete. 2024-09-19T08:44:23.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.102+0000 7f6689430740 20 client.15093 trim_cache size 0 max 16384 2024-09-19T08:44:23.108 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:44:23.108 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "ebd23124-7661-11ef-bceb-c7b262605968", 2024-09-19T08:44:23.108 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 1, 2024-09-19T08:44:23.108 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24472, 2024-09-19T08:44:23.108 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T08:44:23.108 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T08:44:23.108 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T08:44:23.109 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 91.030621535999998, 2024-09-19T08:44:23.109 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 24, 2024-09-19T08:44:23.109 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 82, 2024-09-19T08:44:23.109 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T08:44:23.109 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 117.62328496799999 2024-09-19T08:44:23.109 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:44:23.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.102+0000 7f6687057640 1 -- 172.21.15.7:0/2831102854 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f66700a32d0 msgr2=0x7f66700a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:23.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.102+0000 7f6687057640 1 --2- 172.21.15.7:0/2831102854 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f66700a32d0 0x7f66700a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6678004af0 tx=0x7f667802f500 comp rx=0 tx=0).stop 2024-09-19T08:44:23.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.102+0000 7f6687057640 1 -- 172.21.15.7:0/2831102854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6680101de0 msgr2=0x7f66800744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:23.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.102+0000 7f6687057640 1 --2- 172.21.15.7:0/2831102854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6680101de0 0x7f66800744f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f667400d770 tx=0x7f667400dc30 comp rx=0 tx=0).stop 2024-09-19T08:44:23.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.102+0000 7f6687057640 1 -- 172.21.15.7:0/2831102854 shutdown_connections 2024-09-19T08:44:23.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.102+0000 7f6687057640 1 --2- 172.21.15.7:0/2831102854 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f66700a32d0 0x7f66700a5790 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.102+0000 7f6687057640 1 --2- 172.21.15.7:0/2831102854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6680106f10 0x7f6680074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.102+0000 7f6687057640 1 --2- 172.21.15.7:0/2831102854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6680102790 0x7f6680074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.102+0000 7f6687057640 1 --2- 172.21.15.7:0/2831102854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6680101de0 0x7f66800744f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:23.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.102+0000 7f6687057640 1 -- 172.21.15.7:0/2831102854 >> 172.21.15.7:0/2831102854 conn(0x7f66800fd8c0 msgr2=0x7f66800ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:23.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.102+0000 7f6687057640 1 -- 172.21.15.7:0/2831102854 shutdown_connections 2024-09-19T08:44:23.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:23.102+0000 7f6687057640 1 -- 172.21.15.7:0/2831102854 wait complete. 2024-09-19T08:44:23.758 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T08:44:24.012 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:24.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:23 smithi007 ceph-mon[31221]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:44:24.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:23 smithi044 ceph-mon[35072]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:44:24.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:23 smithi175 ceph-mon[35688]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:44:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.474+0000 7f6b4e1c8640 1 -- 172.21.15.7:0/4238497512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b4810c170 msgr2=0x7f6b4810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.474+0000 7f6b4e1c8640 1 --2- 172.21.15.7:0/4238497512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b4810c170 0x7f6b4810e610 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009ca0 tx=0x7f6b4002a950 comp rx=0 tx=0).stop 2024-09-19T08:44:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.474+0000 7f6b4e1c8640 1 -- 172.21.15.7:0/4238497512 shutdown_connections 2024-09-19T08:44:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.474+0000 7f6b4e1c8640 1 --2- 172.21.15.7:0/4238497512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b4810c170 0x7f6b4810e610 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.474+0000 7f6b4e1c8640 1 --2- 172.21.15.7:0/4238497512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b48103660 0x7f6b4810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.474+0000 7f6b4e1c8640 1 --2- 172.21.15.7:0/4238497512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b48102d40 0x7f6b48103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.474+0000 7f6b4e1c8640 1 -- 172.21.15.7:0/4238497512 >> 172.21.15.7:0/4238497512 conn(0x7f6b480fc7a0 msgr2=0x7f6b480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.474+0000 7f6b4e1c8640 1 -- 172.21.15.7:0/4238497512 shutdown_connections 2024-09-19T08:44:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.475+0000 7f6b4e1c8640 1 -- 172.21.15.7:0/4238497512 wait complete. 2024-09-19T08:44:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.475+0000 7f6b4e1c8640 1 Processor -- start 2024-09-19T08:44:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.475+0000 7f6b4e1c8640 1 -- start start 2024-09-19T08:44:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.475+0000 7f6b4e1c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b48102d40 0x7f6b481984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.475+0000 7f6b4e1c8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b48103660 0x7f6b48198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.475+0000 7f6b4e1c8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b4810c170 0x7f6b4819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.475+0000 7f6b4e1c8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6b48111fb0 con 0x7f6b4810c170 2024-09-19T08:44:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.475+0000 7f6b4e1c8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6b48111e30 con 0x7f6b48103660 2024-09-19T08:44:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.475+0000 7f6b4e1c8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6b48112130 con 0x7f6b48102d40 2024-09-19T08:44:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.476+0000 7f6b47fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b4810c170 0x7f6b4819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.476+0000 7f6b47fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b4810c170 0x7f6b4819cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34726/0 (socket says 172.21.15.7:34726) 2024-09-19T08:44:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.476+0000 7f6b47fff640 1 -- 172.21.15.7:0/236959459 learned_addr learned my addr 172.21.15.7:0/236959459 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.476+0000 7f6b46ffd640 1 --2- 172.21.15.7:0/236959459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b48103660 0x7f6b48198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.476+0000 7f6b47fff640 1 -- 172.21.15.7:0/236959459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b48102d40 msgr2=0x7f6b481984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.476+0000 7f6b47fff640 1 --2- 172.21.15.7:0/236959459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b48102d40 0x7f6b481984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.476+0000 7f6b47fff640 1 -- 172.21.15.7:0/236959459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b48103660 msgr2=0x7f6b48198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.476+0000 7f6b47fff640 1 --2- 172.21.15.7:0/236959459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b48103660 0x7f6b48198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.476+0000 7f6b47fff640 1 -- 172.21.15.7:0/236959459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4819d490 con 0x7f6b4810c170 2024-09-19T08:44:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.476+0000 7f6b46ffd640 1 --2- 172.21.15.7:0/236959459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b48103660 0x7f6b48198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:44:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.476+0000 7f6b47fff640 1 --2- 172.21.15.7:0/236959459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b4810c170 0x7f6b4819cdb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6b4002ae70 tx=0x7f6b4002f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.476+0000 7f6b44ff9640 1 -- 172.21.15.7:0/236959459 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40034040 con 0x7f6b4810c170 2024-09-19T08:44:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.476+0000 7f6b4e1c8640 1 -- 172.21.15.7:0/236959459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4819d720 con 0x7f6b4810c170 2024-09-19T08:44:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.476+0000 7f6b44ff9640 1 -- 172.21.15.7:0/236959459 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b40030920 con 0x7f6b4810c170 2024-09-19T08:44:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.476+0000 7f6b44ff9640 1 -- 172.21.15.7:0/236959459 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40045480 con 0x7f6b4810c170 2024-09-19T08:44:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.476+0000 7f6b4e1c8640 1 -- 172.21.15.7:0/236959459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b481a5060 con 0x7f6b4810c170 2024-09-19T08:44:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.479+0000 7f6b44ff9640 1 -- 172.21.15.7:0/236959459 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f6b40037020 con 0x7f6b4810c170 2024-09-19T08:44:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.479+0000 7f6b505a1740 1 Processor -- start 2024-09-19T08:44:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.479+0000 7f6b505a1740 1 -- start start 2024-09-19T08:44:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.479+0000 7f6b505a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a67e50d9d0 0x55a67e50ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.479+0000 7f6b505a1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a67e50e2f0 0x55a67e518670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.479+0000 7f6b505a1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e518bb0 0x55a67e51afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.479+0000 7f6b505a1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a67e474090 con 0x55a67e518bb0 2024-09-19T08:44:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.479+0000 7f6b505a1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a67e41ba70 con 0x55a67e50e2f0 2024-09-19T08:44:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.479+0000 7f6b505a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a67e470050 con 0x55a67e50d9d0 2024-09-19T08:44:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.479+0000 7f6b46ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e518bb0 0x55a67e51afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.479+0000 7f6b46ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e518bb0 0x55a67e51afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34732/0 (socket says 172.21.15.7:34732) 2024-09-19T08:44:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.479+0000 7f6b46ffd640 1 -- 172.21.15.7:0/1316943400 learned_addr learned my addr 172.21.15.7:0/1316943400 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.479+0000 7f6b46ffd640 1 --2- 172.21.15.7:0/1316943400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a67e50d9d0 0x55a67e50ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.479+0000 7f6b477fe640 1 --2- 172.21.15.7:0/1316943400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a67e50e2f0 0x55a67e518670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.480+0000 7f6b44ff9640 1 --2- 172.21.15.7:0/236959459 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6b340a32d0 0x7f6b340a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.480+0000 7f6b46ffd640 1 -- 172.21.15.7:0/1316943400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a67e50d9d0 msgr2=0x55a67e50ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.480+0000 7f6b46ffd640 1 --2- 172.21.15.7:0/1316943400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a67e50d9d0 0x55a67e50ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.480+0000 7f6b46ffd640 1 -- 172.21.15.7:0/1316943400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a67e50e2f0 msgr2=0x55a67e518670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.480+0000 7f6b46ffd640 1 --2- 172.21.15.7:0/1316943400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a67e50e2f0 0x55a67e518670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.480+0000 7f6b46ffd640 1 -- 172.21.15.7:0/1316943400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a67e428130 con 0x55a67e518bb0 2024-09-19T08:44:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.480+0000 7f6b47fff640 1 --2- 172.21.15.7:0/236959459 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6b340a32d0 0x7f6b340a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.480+0000 7f6b46ffd640 1 --2- 172.21.15.7:0/1316943400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e518bb0 0x55a67e51afa0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6b30013890 tx=0x7f6b3000b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d003960876d31dd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.480+0000 7f6b44ff9640 1 -- 172.21.15.7:0/236959459 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6b400f0980 con 0x7f6b4810c170 2024-09-19T08:44:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.480+0000 7f6b3dffb640 1 -- 172.21.15.7:0/1316943400 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3000e970 con 0x55a67e518bb0 2024-09-19T08:44:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.480+0000 7f6b3dffb640 1 -- 172.21.15.7:0/1316943400 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b3001e430 con 0x55a67e518bb0 2024-09-19T08:44:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.480+0000 7f6b3dffb640 1 -- 172.21.15.7:0/1316943400 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b30011640 con 0x55a67e518bb0 2024-09-19T08:44:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.481+0000 7f6b505a1740 1 -- 172.21.15.7:0/1316943400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e518bb0 msgr2=0x55a67e51afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.481+0000 7f6b47fff640 1 --2- 172.21.15.7:0/236959459 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6b340a32d0 0x7f6b340a5790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6b400bcee0 tx=0x7f6b4008bc90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.481+0000 7f6b505a1740 1 --2- 172.21.15.7:0/1316943400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e518bb0 0x55a67e51afa0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6b30013890 tx=0x7f6b3000b550 comp rx=0 tx=0).stop 2024-09-19T08:44:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.481+0000 7f6b505a1740 1 -- 172.21.15.7:0/1316943400 shutdown_connections 2024-09-19T08:44:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.481+0000 7f6b505a1740 1 --2- 172.21.15.7:0/1316943400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e518bb0 0x55a67e51afa0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.481+0000 7f6b505a1740 1 --2- 172.21.15.7:0/1316943400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a67e50e2f0 0x55a67e518670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.481+0000 7f6b505a1740 1 --2- 172.21.15.7:0/1316943400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a67e50d9d0 0x55a67e50ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.481+0000 7f6b505a1740 1 -- 172.21.15.7:0/1316943400 >> 172.21.15.7:0/1316943400 conn(0x55a67e509f60 msgr2=0x55a67e50a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.481+0000 7f6b505a1740 1 -- 172.21.15.7:0/1316943400 shutdown_connections 2024-09-19T08:44:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.481+0000 7f6b505a1740 1 -- 172.21.15.7:0/1316943400 wait complete. 2024-09-19T08:44:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.481+0000 7f6b505a1740 1 -- start start 2024-09-19T08:44:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.481+0000 7f6b505a1740 1 Processor -- start 2024-09-19T08:44:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.482+0000 7f6b505a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a67e50d9d0 0x55a67e518480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.482+0000 7f6b505a1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a67e50e2f0 0x55a67e5157d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.482+0000 7f6b505a1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e518bb0 0x55a67e515d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.482+0000 7f6b505a1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a67e51b780 con 0x55a67e518bb0 2024-09-19T08:44:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.482+0000 7f6b505a1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a67e42ef20 con 0x55a67e50e2f0 2024-09-19T08:44:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.482+0000 7f6b505a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a67e51b900 con 0x55a67e50d9d0 2024-09-19T08:44:24.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.482+0000 7f6b505a1740 10 client.0 _ll_register_callbacks cb 0x55a67e3f8030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:44:24.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.482+0000 7f6b46ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e518bb0 0x55a67e515d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:24.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.482+0000 7f6b46ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e518bb0 0x55a67e515d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34746/0 (socket says 172.21.15.7:34746) 2024-09-19T08:44:24.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.482+0000 7f6b46ffd640 1 -- 172.21.15.7:0/2546378147 learned_addr learned my addr 172.21.15.7:0/2546378147 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:24.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.482+0000 7f6b46ffd640 1 --2- 172.21.15.7:0/2546378147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a67e50d9d0 0x55a67e518480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:24.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.482+0000 7f6b477fe640 1 --2- 172.21.15.7:0/2546378147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a67e50e2f0 0x55a67e5157d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:24.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.482+0000 7f6b46ffd640 1 -- 172.21.15.7:0/2546378147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a67e50d9d0 msgr2=0x55a67e518480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:24.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.482+0000 7f6b46ffd640 1 --2- 172.21.15.7:0/2546378147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a67e50d9d0 0x55a67e518480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.482+0000 7f6b46ffd640 1 -- 172.21.15.7:0/2546378147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a67e50e2f0 msgr2=0x55a67e5157d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:24.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.482+0000 7f6b46ffd640 1 --2- 172.21.15.7:0/2546378147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a67e50e2f0 0x55a67e5157d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.482+0000 7f6b46ffd640 1 -- 172.21.15.7:0/2546378147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a67e1e52b0 con 0x55a67e518bb0 2024-09-19T08:44:24.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.482+0000 7f6b46ffd640 1 --2- 172.21.15.7:0/2546378147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e518bb0 0x55a67e515d10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000b300 tx=0x7f6b30022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9adc7497950076 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:24.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.482+0000 7f6b26ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:44:24.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.483+0000 7f6b26ffd640 1 -- 172.21.15.7:0/2546378147 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b30013500 con 0x55a67e518bb0 2024-09-19T08:44:24.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.483+0000 7f6b26ffd640 1 -- 172.21.15.7:0/2546378147 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6b30029040 con 0x55a67e518bb0 2024-09-19T08:44:24.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.483+0000 7f6b505a1740 1 -- 172.21.15.7:0/2546378147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b3001e430 con 0x55a67e518bb0 2024-09-19T08:44:24.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.483+0000 7f6b26ffd640 1 -- 172.21.15.7:0/2546378147 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6b30035050 con 0x55a67e518bb0 2024-09-19T08:44:24.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.483+0000 7f6b505a1740 10 client.15105 fetch_fsmap learned FSMap version 24 2024-09-19T08:44:24.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.483+0000 7f6b505a1740 1 -- 172.21.15.7:0/2546378147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a67e5270d0 con 0x55a67e518bb0 2024-09-19T08:44:24.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.483+0000 7f6b26ffd640 1 -- 172.21.15.7:0/2546378147 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b3001e430 con 0x55a67e518bb0 2024-09-19T08:44:24.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.483+0000 7f6b26ffd640 1 -- 172.21.15.7:0/2546378147 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6b3000f040 con 0x55a67e518bb0 2024-09-19T08:44:24.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.483+0000 7f6b505a1740 10 client.15105 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T08:44:24.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.483+0000 7f6b505a1740 10 client.15105 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:44:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.483+0000 7f6b505a1740 20 client.15105 populate_metadata read hostname 'smithi007' 2024-09-19T08:44:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.483+0000 7f6b505a1740 1 --2- 172.21.15.7:0/2546378147 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a67e5293d0 0x55a67e52a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.483+0000 7f6b505a1740 4 client.15105 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:44:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.483+0000 7f6b505a1740 1 -- 172.21.15.7:0/2546378147 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a67e481600 con 0x55a67e5293d0 2024-09-19T08:44:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.484+0000 7f6b477fe640 1 --2- 172.21.15.7:0/2546378147 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a67e5293d0 0x55a67e52a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.484+0000 7f6b477fe640 1 --2- 172.21.15.7:0/2546378147 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a67e5293d0 0x55a67e52a840 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5517447f80c8693c server_cookie=8255e2159f86abf3 in_seq=0 out_seq=0 2024-09-19T08:44:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.484+0000 7f6b26ffd640 10 client.15105 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:44:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.485+0000 7f6b26ffd640 1 -- 172.21.15.7:0/2546378147 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a67e481600 con 0x55a67e5293d0 2024-09-19T08:44:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.485+0000 7f6b26ffd640 10 client.15105 handle_command_reply: tid=0 2024-09-19T08:44:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.485+0000 7f6b505a1740 1 client.15105 shutdown 2024-09-19T08:44:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.485+0000 7f6b505a1740 1 -- 172.21.15.7:0/2546378147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e518bb0 msgr2=0x55a67e515d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.485+0000 7f6b505a1740 1 --2- 172.21.15.7:0/2546378147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e518bb0 0x55a67e515d10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000b300 tx=0x7f6b30022040 comp rx=0 tx=0).stop 2024-09-19T08:44:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.485+0000 7f6b505a1740 1 -- 172.21.15.7:0/2546378147 shutdown_connections 2024-09-19T08:44:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.485+0000 7f6b505a1740 1 --2- 172.21.15.7:0/2546378147 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a67e5293d0 0x55a67e52a840 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.485+0000 7f6b505a1740 1 --2- 172.21.15.7:0/2546378147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e518bb0 0x55a67e515d10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.485+0000 7f6b505a1740 1 --2- 172.21.15.7:0/2546378147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a67e50e2f0 0x55a67e5157d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.485+0000 7f6b26ffd640 0 client.15105 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:44:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.485+0000 7f6b505a1740 1 --2- 172.21.15.7:0/2546378147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a67e50d9d0 0x55a67e518480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.485+0000 7f6b505a1740 1 -- 172.21.15.7:0/2546378147 >> 172.21.15.7:0/2546378147 conn(0x55a67e509f60 msgr2=0x55a67e50fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.485+0000 7f6b505a1740 1 -- 172.21.15.7:0/2546378147 shutdown_connections 2024-09-19T08:44:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.485+0000 7f6b505a1740 1 -- 172.21.15.7:0/2546378147 wait complete. 2024-09-19T08:44:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.485+0000 7f6b505a1740 20 client.15105 trim_cache size 0 max 16384 2024-09-19T08:44:24.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.503+0000 7f6b505a1740 1 Processor -- start 2024-09-19T08:44:24.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.503+0000 7f6b505a1740 1 -- start start 2024-09-19T08:44:24.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.503+0000 7f6b505a1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a67e50d9d0 0x55a67e528d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.503+0000 7f6b505a1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e50e2f0 0x55a67e52a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.503+0000 7f6b505a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a67e518bb0 0x55a67e515090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.503+0000 7f6b505a1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a67e528b80 con 0x55a67e50e2f0 2024-09-19T08:44:24.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.503+0000 7f6b505a1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a67e529250 con 0x55a67e50d9d0 2024-09-19T08:44:24.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.503+0000 7f6b505a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a67e529920 con 0x55a67e518bb0 2024-09-19T08:44:24.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.504+0000 7f6b477fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e50e2f0 0x55a67e52a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:24.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.504+0000 7f6b477fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e50e2f0 0x55a67e52a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34748/0 (socket says 172.21.15.7:34748) 2024-09-19T08:44:24.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.504+0000 7f6b477fe640 1 -- 172.21.15.7:0/715664016 learned_addr learned my addr 172.21.15.7:0/715664016 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:24.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.504+0000 7f6b46ffd640 1 --2- 172.21.15.7:0/715664016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a67e50d9d0 0x55a67e528d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:24.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.504+0000 7f6b46ffd640 1 --2- 172.21.15.7:0/715664016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a67e518bb0 0x55a67e515090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:24.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.504+0000 7f6b477fe640 1 -- 172.21.15.7:0/715664016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a67e518bb0 msgr2=0x55a67e515090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:24.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.504+0000 7f6b477fe640 1 --2- 172.21.15.7:0/715664016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a67e518bb0 0x55a67e515090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.504+0000 7f6b477fe640 1 -- 172.21.15.7:0/715664016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a67e50d9d0 msgr2=0x55a67e528d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:24.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.504+0000 7f6b477fe640 1 --2- 172.21.15.7:0/715664016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a67e50d9d0 0x55a67e528d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.504+0000 7f6b477fe640 1 -- 172.21.15.7:0/715664016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a67e51b890 con 0x55a67e50e2f0 2024-09-19T08:44:24.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.504+0000 7f6b477fe640 1 --2- 172.21.15.7:0/715664016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e50e2f0 0x55a67e52a840 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55a67e516e10 tx=0x7f6b3800b3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222e71af259a0ff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:24.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.504+0000 7f6b3d7fa640 1 -- 172.21.15.7:0/715664016 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38015600 con 0x55a67e50e2f0 2024-09-19T08:44:24.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.504+0000 7f6b3d7fa640 1 -- 172.21.15.7:0/715664016 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b38015c80 con 0x55a67e50e2f0 2024-09-19T08:44:24.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.505+0000 7f6b3d7fa640 1 -- 172.21.15.7:0/715664016 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38013d00 con 0x55a67e50e2f0 2024-09-19T08:44:24.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.505+0000 7f6b505a1740 1 -- 172.21.15.7:0/715664016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e50e2f0 msgr2=0x55a67e52a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:24.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.505+0000 7f6b505a1740 1 --2- 172.21.15.7:0/715664016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e50e2f0 0x55a67e52a840 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55a67e516e10 tx=0x7f6b3800b3f0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.505+0000 7f6b505a1740 1 -- 172.21.15.7:0/715664016 shutdown_connections 2024-09-19T08:44:24.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.505+0000 7f6b505a1740 1 --2- 172.21.15.7:0/715664016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a67e518bb0 0x55a67e515090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.505+0000 7f6b505a1740 1 --2- 172.21.15.7:0/715664016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e50e2f0 0x55a67e52a840 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.505+0000 7f6b505a1740 1 --2- 172.21.15.7:0/715664016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a67e50d9d0 0x55a67e528d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.505+0000 7f6b505a1740 1 -- 172.21.15.7:0/715664016 >> 172.21.15.7:0/715664016 conn(0x55a67e509f60 msgr2=0x55a67e50a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:24.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.505+0000 7f6b505a1740 1 -- 172.21.15.7:0/715664016 shutdown_connections 2024-09-19T08:44:24.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.505+0000 7f6b505a1740 1 -- 172.21.15.7:0/715664016 wait complete. 2024-09-19T08:44:24.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.506+0000 7f6b505a1740 1 -- start start 2024-09-19T08:44:24.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.506+0000 7f6b505a1740 1 Processor -- start 2024-09-19T08:44:24.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.506+0000 7f6b505a1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e50d9d0 0x55a67e532ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.506+0000 7f6b505a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a67e50e2f0 0x55a67e533430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.506+0000 7f6b505a1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a67e518bb0 0x55a67e52e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.506+0000 7f6b505a1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a67e52a6c0 con 0x55a67e50d9d0 2024-09-19T08:44:24.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.506+0000 7f6b505a1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a67e529ff0 con 0x55a67e518bb0 2024-09-19T08:44:24.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.506+0000 7f6b505a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a67e52ad90 con 0x55a67e50e2f0 2024-09-19T08:44:24.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.506+0000 7f6b505a1740 10 client.0 _ll_register_callbacks cb 0x7f6b3000bec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:44:24.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.506+0000 7f6b46ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e50d9d0 0x55a67e532ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:24.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.506+0000 7f6b46ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e50d9d0 0x55a67e532ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34750/0 (socket says 172.21.15.7:34750) 2024-09-19T08:44:24.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.506+0000 7f6b46ffd640 1 -- 172.21.15.7:0/3944966532 learned_addr learned my addr 172.21.15.7:0/3944966532 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:24.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.507+0000 7f6b477fe640 1 --2- 172.21.15.7:0/3944966532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a67e50e2f0 0x55a67e533430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:24.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.507+0000 7f6b46ffd640 1 -- 172.21.15.7:0/3944966532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a67e50e2f0 msgr2=0x55a67e533430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:24.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.507+0000 7f6b46ffd640 1 --2- 172.21.15.7:0/3944966532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a67e50e2f0 0x55a67e533430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.507+0000 7f6b46ffd640 1 -- 172.21.15.7:0/3944966532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a67e518bb0 msgr2=0x55a67e52e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:24.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.507+0000 7f6b46ffd640 1 --2- 172.21.15.7:0/3944966532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a67e518bb0 0x55a67e52e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.507+0000 7f6b46ffd640 1 -- 172.21.15.7:0/3944966532 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a67e52eca0 con 0x55a67e50d9d0 2024-09-19T08:44:24.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.507+0000 7f6b46ffd640 1 --2- 172.21.15.7:0/3944966532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e50d9d0 0x55a67e532ef0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000b2d0 tx=0x7f6b30005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5b8a724a4f5dcf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:24.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.507+0000 7f6b26ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:44:24.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.507+0000 7f6b26ffd640 1 -- 172.21.15.7:0/3944966532 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3001e430 con 0x55a67e50d9d0 2024-09-19T08:44:24.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.507+0000 7f6b26ffd640 1 -- 172.21.15.7:0/3944966532 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6b30026070 con 0x55a67e50d9d0 2024-09-19T08:44:24.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.507+0000 7f6b505a1740 1 -- 172.21.15.7:0/3944966532 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b38015c80 con 0x55a67e50d9d0 2024-09-19T08:44:24.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.507+0000 7f6b26ffd640 1 -- 172.21.15.7:0/3944966532 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6b3000b410 con 0x55a67e50d9d0 2024-09-19T08:44:24.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.507+0000 7f6b505a1740 10 client.15111 fetch_fsmap learned FSMap version 24 2024-09-19T08:44:24.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.507+0000 7f6b505a1740 1 -- 172.21.15.7:0/3944966532 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a67e593790 con 0x55a67e50d9d0 2024-09-19T08:44:24.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.507+0000 7f6b26ffd640 1 -- 172.21.15.7:0/3944966532 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b38015c80 con 0x55a67e50d9d0 2024-09-19T08:44:24.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.508+0000 7f6b26ffd640 1 -- 172.21.15.7:0/3944966532 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6b30043030 con 0x55a67e50d9d0 2024-09-19T08:44:24.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.508+0000 7f6b505a1740 10 client.15111 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T08:44:24.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.508+0000 7f6b505a1740 10 client.15111 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:44:24.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.508+0000 7f6b505a1740 20 client.15111 populate_metadata read hostname 'smithi007' 2024-09-19T08:44:24.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.508+0000 7f6b505a1740 1 --2- 172.21.15.7:0/3944966532 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a67e598370 0x55a67e597080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:24.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.508+0000 7f6b505a1740 4 client.15111 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:44:24.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.508+0000 7f6b505a1740 1 -- 172.21.15.7:0/3944966532 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "status"}) -- 0x55a67e47bb10 con 0x55a67e598370 2024-09-19T08:44:24.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.508+0000 7f6b477fe640 1 --2- 172.21.15.7:0/3944966532 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a67e598370 0x55a67e597080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:24.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.508+0000 7f6b477fe640 1 --2- 172.21.15.7:0/3944966532 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a67e598370 0x55a67e597080 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c648002828e9696 server_cookie=110fe38d9009828e in_seq=0 out_seq=0 2024-09-19T08:44:24.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.508+0000 7f6b26ffd640 10 client.15111 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:44:24.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.509+0000 7f6b26ffd640 1 -- 172.21.15.7:0/3944966532 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a67e47bb10 con 0x55a67e598370 2024-09-19T08:44:24.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.509+0000 7f6b26ffd640 10 client.15111 handle_command_reply: tid=0 2024-09-19T08:44:24.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.509+0000 7f6b505a1740 1 client.15111 shutdown 2024-09-19T08:44:24.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.509+0000 7f6b505a1740 1 -- 172.21.15.7:0/3944966532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e50d9d0 msgr2=0x55a67e532ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:24.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.509+0000 7f6b505a1740 1 --2- 172.21.15.7:0/3944966532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e50d9d0 0x55a67e532ef0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000b2d0 tx=0x7f6b30005e70 comp rx=0 tx=0).stop 2024-09-19T08:44:24.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.509+0000 7f6b505a1740 1 -- 172.21.15.7:0/3944966532 shutdown_connections 2024-09-19T08:44:24.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.509+0000 7f6b505a1740 1 --2- 172.21.15.7:0/3944966532 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a67e598370 0x55a67e597080 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.509+0000 7f6b505a1740 1 --2- 172.21.15.7:0/3944966532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a67e518bb0 0x55a67e52e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.509+0000 7f6b505a1740 1 --2- 172.21.15.7:0/3944966532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a67e50e2f0 0x55a67e533430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.509+0000 7f6b505a1740 1 --2- 172.21.15.7:0/3944966532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a67e50d9d0 0x55a67e532ef0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.509+0000 7f6b26ffd640 0 client.15111 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:44:24.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.509+0000 7f6b505a1740 1 -- 172.21.15.7:0/3944966532 >> 172.21.15.7:0/3944966532 conn(0x55a67e509f60 msgr2=0x55a67e516e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:24.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.509+0000 7f6b505a1740 1 -- 172.21.15.7:0/3944966532 shutdown_connections 2024-09-19T08:44:24.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.509+0000 7f6b505a1740 1 -- 172.21.15.7:0/3944966532 wait complete. 2024-09-19T08:44:24.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.509+0000 7f6b505a1740 20 client.15111 trim_cache size 0 max 16384 2024-09-19T08:44:24.514 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:44:24.514 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "ebd23124-7661-11ef-bceb-c7b262605968", 2024-09-19T08:44:24.514 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-09-19T08:44:24.514 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24491, 2024-09-19T08:44:24.514 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T08:44:24.514 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T08:44:24.514 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T08:44:24.515 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 99.475513023000005, 2024-09-19T08:44:24.515 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 24, 2024-09-19T08:44:24.515 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 82, 2024-09-19T08:44:24.515 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T08:44:24.515 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 110.59845557200001 2024-09-19T08:44:24.515 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:44:24.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.510+0000 7f6b4e1c8640 1 -- 172.21.15.7:0/236959459 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6b340a32d0 msgr2=0x7f6b340a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:24.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.510+0000 7f6b4e1c8640 1 --2- 172.21.15.7:0/236959459 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6b340a32d0 0x7f6b340a5790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6b400bcee0 tx=0x7f6b4008bc90 comp rx=0 tx=0).stop 2024-09-19T08:44:24.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.510+0000 7f6b4e1c8640 1 -- 172.21.15.7:0/236959459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b4810c170 msgr2=0x7f6b4819cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:24.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.510+0000 7f6b4e1c8640 1 --2- 172.21.15.7:0/236959459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b4810c170 0x7f6b4819cdb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6b4002ae70 tx=0x7f6b4002f5b0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.510+0000 7f6b4e1c8640 1 -- 172.21.15.7:0/236959459 shutdown_connections 2024-09-19T08:44:24.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.510+0000 7f6b4e1c8640 1 --2- 172.21.15.7:0/236959459 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f6b340a32d0 0x7f6b340a5790 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.510+0000 7f6b4e1c8640 1 --2- 172.21.15.7:0/236959459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b4810c170 0x7f6b4819cdb0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.510+0000 7f6b4e1c8640 1 --2- 172.21.15.7:0/236959459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b48103660 0x7f6b48198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.510+0000 7f6b4e1c8640 1 --2- 172.21.15.7:0/236959459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b48102d40 0x7f6b481984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:24.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.510+0000 7f6b4e1c8640 1 -- 172.21.15.7:0/236959459 >> 172.21.15.7:0/236959459 conn(0x7f6b480fc7a0 msgr2=0x7f6b480fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:24.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.510+0000 7f6b4e1c8640 1 -- 172.21.15.7:0/236959459 shutdown_connections 2024-09-19T08:44:24.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:24.510+0000 7f6b4e1c8640 1 -- 172.21.15.7:0/236959459 wait complete. 2024-09-19T08:44:25.360 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T08:44:25.370 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T08:44:25.370 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T08:44:25.371 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T08:44:25.371 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-19T08:44:25.372 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T08:44:25.372 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-19T08:44:25.372 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-19T08:44:25.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.479+0000 7f96dbed7640 1 -- 172.21.15.7:0/2657313518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96d4101c60 msgr2=0x7f96d41020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:25.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.479+0000 7f96dbed7640 1 --2- 172.21.15.7:0/2657313518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96d4101c60 0x7f96d41020e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f96c4009900 tx=0x7f96c402a410 comp rx=0 tx=0).stop 2024-09-19T08:44:25.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.479+0000 7f96dbed7640 1 -- 172.21.15.7:0/2657313518 shutdown_connections 2024-09-19T08:44:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.479+0000 7f96dbed7640 1 --2- 172.21.15.7:0/2657313518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96d4102620 0x7f96d4108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.479+0000 7f96dbed7640 1 --2- 172.21.15.7:0/2657313518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96d4101c60 0x7f96d41020e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.479+0000 7f96dbed7640 1 --2- 172.21.15.7:0/2657313518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96d4100a70 0x7f96d4100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.479+0000 7f96dbed7640 1 -- 172.21.15.7:0/2657313518 >> 172.21.15.7:0/2657313518 conn(0x7f96d40fc1f0 msgr2=0x7f96d40fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.479+0000 7f96dbed7640 1 -- 172.21.15.7:0/2657313518 shutdown_connections 2024-09-19T08:44:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.479+0000 7f96dbed7640 1 -- 172.21.15.7:0/2657313518 wait complete. 2024-09-19T08:44:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.480+0000 7f96dbed7640 1 Processor -- start 2024-09-19T08:44:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.480+0000 7f96dbed7640 1 -- start start 2024-09-19T08:44:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.480+0000 7f96dbed7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96d4100a70 0x7f96d419a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.480+0000 7f96dbed7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96d4101c60 0x7f96d419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.480+0000 7f96dbed7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96d4102620 0x7f96d41a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.480+0000 7f96dbed7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f96d410c6f0 con 0x7f96d4101c60 2024-09-19T08:44:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.480+0000 7f96dbed7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f96d410c570 con 0x7f96d4102620 2024-09-19T08:44:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.480+0000 7f96dbed7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f96d410c870 con 0x7f96d4100a70 2024-09-19T08:44:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.480+0000 7f96d9472640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96d4101c60 0x7f96d419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.480+0000 7f96d9472640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96d4101c60 0x7f96d419a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34762/0 (socket says 172.21.15.7:34762) 2024-09-19T08:44:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.480+0000 7f96d9472640 1 -- 172.21.15.7:0/3596586854 learned_addr learned my addr 172.21.15.7:0/3596586854 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.480+0000 7f96da474640 1 --2- 172.21.15.7:0/3596586854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96d4102620 0x7f96d41a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.480+0000 7f96d9472640 1 -- 172.21.15.7:0/3596586854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96d4100a70 msgr2=0x7f96d419a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.480+0000 7f96d9c73640 1 --2- 172.21.15.7:0/3596586854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96d4100a70 0x7f96d419a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.481+0000 7f96d9472640 1 --2- 172.21.15.7:0/3596586854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96d4100a70 0x7f96d419a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.481+0000 7f96d9472640 1 -- 172.21.15.7:0/3596586854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96d4102620 msgr2=0x7f96d41a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.481+0000 7f96d9472640 1 --2- 172.21.15.7:0/3596586854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96d4102620 0x7f96d41a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.481+0000 7f96d9472640 1 -- 172.21.15.7:0/3596586854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d41a1d10 con 0x7f96d4101c60 2024-09-19T08:44:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.481+0000 7f96d9c73640 1 --2- 172.21.15.7:0/3596586854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96d4100a70 0x7f96d419a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:44:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.481+0000 7f96d9472640 1 --2- 172.21.15.7:0/3596586854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96d4101c60 0x7f96d419a630 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f96c4005940 tx=0x7f96c4004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.481+0000 7f96caffd640 1 -- 172.21.15.7:0/3596586854 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c403f030 con 0x7f96d4101c60 2024-09-19T08:44:25.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.481+0000 7f96caffd640 1 -- 172.21.15.7:0/3596586854 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96c4003ce0 con 0x7f96d4101c60 2024-09-19T08:44:25.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.481+0000 7f96caffd640 1 -- 172.21.15.7:0/3596586854 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4035070 con 0x7f96d4101c60 2024-09-19T08:44:25.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.481+0000 7f96dbed7640 1 -- 172.21.15.7:0/3596586854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d41a1fa0 con 0x7f96d4101c60 2024-09-19T08:44:25.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.481+0000 7f96dbed7640 1 -- 172.21.15.7:0/3596586854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d41a2410 con 0x7f96d4101c60 2024-09-19T08:44:25.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.482+0000 7f96dbed7640 1 -- 172.21.15.7:0/3596586854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d41a2640 con 0x7f96d4101c60 2024-09-19T08:44:25.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.483+0000 7f96caffd640 1 -- 172.21.15.7:0/3596586854 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f96c4042030 con 0x7f96d4101c60 2024-09-19T08:44:25.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.484+0000 7f96caffd640 1 --2- 172.21.15.7:0/3596586854 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f96c00a3350 0x7f96c00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:25.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.484+0000 7f96d9c73640 1 --2- 172.21.15.7:0/3596586854 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f96c00a3350 0x7f96c00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:25.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.484+0000 7f96caffd640 1 -- 172.21.15.7:0/3596586854 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f96c40f0400 con 0x7f96d4101c60 2024-09-19T08:44:25.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.484+0000 7f96d9c73640 1 --2- 172.21.15.7:0/3596586854 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f96c00a3350 0x7f96c00a5810 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f96d4101ac0 tx=0x7f96d0005e70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:25.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.488+0000 7f96caffd640 1 -- 172.21.15.7:0/3596586854 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f96c40bcf80 con 0x7f96d4101c60 2024-09-19T08:44:25.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.712+0000 7f96dbed7640 1 -- 172.21.15.7:0/3596586854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f96d41a29d0 con 0x7f96d4101c60 2024-09-19T08:44:25.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.976+0000 7f96caffd640 1 -- 172.21.15.7:0/3596586854 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v18) ==== 92+0+0 (secure 0 0 0) 0x7f96c40bc880 con 0x7f96d4101c60 2024-09-19T08:44:25.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.981+0000 7f96dbed7640 1 -- 172.21.15.7:0/3596586854 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f96c00a3350 msgr2=0x7f96c00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:25.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.981+0000 7f96dbed7640 1 --2- 172.21.15.7:0/3596586854 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f96c00a3350 0x7f96c00a5810 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f96d4101ac0 tx=0x7f96d0005e70 comp rx=0 tx=0).stop 2024-09-19T08:44:25.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.981+0000 7f96dbed7640 1 -- 172.21.15.7:0/3596586854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96d4101c60 msgr2=0x7f96d419a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:25.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.981+0000 7f96dbed7640 1 --2- 172.21.15.7:0/3596586854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96d4101c60 0x7f96d419a630 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f96c4005940 tx=0x7f96c4004360 comp rx=0 tx=0).stop 2024-09-19T08:44:25.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.981+0000 7f96dbed7640 1 -- 172.21.15.7:0/3596586854 shutdown_connections 2024-09-19T08:44:25.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.981+0000 7f96dbed7640 1 --2- 172.21.15.7:0/3596586854 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f96c00a3350 0x7f96c00a5810 secure :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f96d4101ac0 tx=0x7f96d0005e70 comp rx=0 tx=0).stop 2024-09-19T08:44:25.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.981+0000 7f96dbed7640 1 --2- 172.21.15.7:0/3596586854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96d4102620 0x7f96d41a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:25.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.981+0000 7f96dbed7640 1 --2- 172.21.15.7:0/3596586854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96d4101c60 0x7f96d419a630 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:25.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.981+0000 7f96dbed7640 1 --2- 172.21.15.7:0/3596586854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96d4100a70 0x7f96d419a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:25.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.981+0000 7f96dbed7640 1 -- 172.21.15.7:0/3596586854 >> 172.21.15.7:0/3596586854 conn(0x7f96d40fc1f0 msgr2=0x7f96d406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:25.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.981+0000 7f96dbed7640 1 -- 172.21.15.7:0/3596586854 shutdown_connections 2024-09-19T08:44:25.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:25.981+0000 7f96dbed7640 1 -- 172.21.15.7:0/3596586854 wait complete. 2024-09-19T08:44:25.996 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T08:44:26.023 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T08:44:26.023 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-19T08:44:26.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:44:26.023 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-09-19T08:44:26.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:44:26.041 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2024-09-19T08:44:26.109 INFO:teuthology.orchestra.run.smithi007.stderr:Cannot find device "ceph-brx" 2024-09-19T08:44:26.111 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:44:26.111 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-19T08:44:26.112 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T08:44:26.112 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T08:44:26.112 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T08:44:26.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:25 smithi007 ceph-mon[31221]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T08:44:26.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:25 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3596586854' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T08:44:26.284 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:26 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: ignoring --setuser ceph since I am not root 2024-09-19T08:44:26.284 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:26 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: ignoring --setgroup ceph since I am not root 2024-09-19T08:44:26.284 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:26 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:26.134+0000 7fccb7422040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:44:26.284 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:26 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:26.195+0000 7fccb7422040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:44:26.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:25 smithi044 ceph-mon[35072]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T08:44:26.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:25 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3596586854' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T08:44:26.301 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:26 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: ignoring --setuser ceph since I am not root 2024-09-19T08:44:26.301 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:26 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: ignoring --setgroup ceph since I am not root 2024-09-19T08:44:26.301 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:26 smithi044 ceph-mgr[36443]: -- 172.21.15.44:0/3959889119 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d18398f0e0 con 0x55d18396d000 2024-09-19T08:44:26.301 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:26 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:26.134+0000 7fafa1472040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:44:26.301 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:26 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:26.193+0000 7fafa1472040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:44:26.331 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:25 smithi175 ceph-mon[35688]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T08:44:26.332 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:25 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3596586854' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T08:44:26.332 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:26 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: ignoring --setuser ceph since I am not root 2024-09-19T08:44:26.332 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:26 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: ignoring --setgroup ceph since I am not root 2024-09-19T08:44:26.332 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:26 smithi175 ceph-mgr[37498]: -- 172.21.15.175:0/456179963 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56050a9770e0 con 0x56050a955400 2024-09-19T08:44:26.333 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:26 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:26.127+0000 7fb1a06f6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:44:26.333 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:26 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:26.184+0000 7fb1a06f6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:44:26.333 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:26 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:26.331+0000 7fb1a06f6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:44:26.415 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:26.641 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:26 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:26.354+0000 7fccb7422040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:44:26.641 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:26 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:26.434+0000 7fccb7422040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:44:26.641 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:26 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:26.592+0000 7fccb7422040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:44:26.678 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:26 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:26.398+0000 7fb1a06f6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:44:26.678 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:26 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:26.543+0000 7fb1a06f6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:44:26.713 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:26 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:26.346+0000 7fafa1472040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:44:26.713 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:26 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:26.415+0000 7fafa1472040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:44:26.713 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:26 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:26.567+0000 7fafa1472040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:44:26.713 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:26 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:26.713+0000 7fafa1472040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:44:26.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.863+0000 7f1aa8bee640 1 -- 172.21.15.7:0/3424915762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa4100e20 msgr2=0x7f1aa4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:26.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.863+0000 7f1aa8bee640 1 --2- 172.21.15.7:0/3424915762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa4100e20 0x7f1aa4101200 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c009900 tx=0x7f1a8c02a480 comp rx=0 tx=0).stop 2024-09-19T08:44:26.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.863+0000 7f1aa8bee640 1 -- 172.21.15.7:0/3424915762 shutdown_connections 2024-09-19T08:44:26.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.863+0000 7f1aa8bee640 1 --2- 172.21.15.7:0/3424915762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa4102ef0 0x7f1aa410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:26.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.863+0000 7f1aa8bee640 1 --2- 172.21.15.7:0/3424915762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa4102570 0x7f1aa41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:26.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.863+0000 7f1aa8bee640 1 --2- 172.21.15.7:0/3424915762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa4100e20 0x7f1aa4101200 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:26.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.863+0000 7f1aa8bee640 1 -- 172.21.15.7:0/3424915762 >> 172.21.15.7:0/3424915762 conn(0x7f1aa40fc7d0 msgr2=0x7f1aa40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:26.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.863+0000 7f1aa8bee640 1 -- 172.21.15.7:0/3424915762 shutdown_connections 2024-09-19T08:44:26.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.863+0000 7f1aa8bee640 1 -- 172.21.15.7:0/3424915762 wait complete. 2024-09-19T08:44:26.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.864+0000 7f1aa8bee640 1 Processor -- start 2024-09-19T08:44:26.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.864+0000 7f1aa8bee640 1 -- start start 2024-09-19T08:44:26.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.864+0000 7f1aa8bee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa4100e20 0x7f1aa4197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:26.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.864+0000 7f1aa8bee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa4102570 0x7f1aa41979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:26.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.864+0000 7f1aa8bee640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa4102ef0 0x7f1aa419bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:26.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.864+0000 7f1aa8bee640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa4110f80 con 0x7f1aa4102570 2024-09-19T08:44:26.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.864+0000 7f1aa8bee640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa4110e00 con 0x7f1aa4100e20 2024-09-19T08:44:26.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.864+0000 7f1aa8bee640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa4111100 con 0x7f1aa4102ef0 2024-09-19T08:44:26.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.864+0000 7f1aa259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa4100e20 0x7f1aa4197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:26.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.865+0000 7f1aa1d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa4102570 0x7f1aa41979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:26.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.865+0000 7f1aa259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa4100e20 0x7f1aa4197460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:50394/0 (socket says 172.21.15.7:50394) 2024-09-19T08:44:26.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.865+0000 7f1aa259c640 1 -- 172.21.15.7:0/1652690269 learned_addr learned my addr 172.21.15.7:0/1652690269 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:26.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.865+0000 7f1aa2d9d640 1 --2- 172.21.15.7:0/1652690269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa4102ef0 0x7f1aa419bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:26.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.865+0000 7f1aa259c640 1 -- 172.21.15.7:0/1652690269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa4102ef0 msgr2=0x7f1aa419bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:26.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.865+0000 7f1aa259c640 1 --2- 172.21.15.7:0/1652690269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa4102ef0 0x7f1aa419bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:26.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.865+0000 7f1aa259c640 1 -- 172.21.15.7:0/1652690269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa4102570 msgr2=0x7f1aa41979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:26.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.865+0000 7f1aa259c640 1 --2- 172.21.15.7:0/1652690269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa4102570 0x7f1aa41979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:26.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.865+0000 7f1aa259c640 1 -- 172.21.15.7:0/1652690269 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa419c430 con 0x7f1aa4100e20 2024-09-19T08:44:26.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.865+0000 7f1aa1d9b640 1 --2- 172.21.15.7:0/1652690269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa4102570 0x7f1aa41979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:44:26.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.865+0000 7f1aa259c640 1 --2- 172.21.15.7:0/1652690269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa4100e20 0x7f1aa4197460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c006010 tx=0x7f1a8c003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:26.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.865+0000 7f1a9b7fe640 1 -- 172.21.15.7:0/1652690269 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c03f070 con 0x7f1aa4100e20 2024-09-19T08:44:26.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.865+0000 7f1a9b7fe640 1 -- 172.21.15.7:0/1652690269 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a8c031c30 con 0x7f1aa4100e20 2024-09-19T08:44:26.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.865+0000 7f1a9b7fe640 1 -- 172.21.15.7:0/1652690269 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c035030 con 0x7f1aa4100e20 2024-09-19T08:44:26.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.865+0000 7f1aa8bee640 1 -- 172.21.15.7:0/1652690269 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa419c6c0 con 0x7f1aa4100e20 2024-09-19T08:44:26.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.866+0000 7f1aa8bee640 1 -- 172.21.15.7:0/1652690269 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa419cb50 con 0x7f1aa4100e20 2024-09-19T08:44:26.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.867+0000 7f1aa8bee640 1 -- 172.21.15.7:0/1652690269 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa4101200 con 0x7f1aa4100e20 2024-09-19T08:44:26.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.868+0000 7f1a9b7fe640 1 -- 172.21.15.7:0/1652690269 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 18) ==== 138422+0+0 (secure 0 0 0) 0x7f1a8c042070 con 0x7f1aa4100e20 2024-09-19T08:44:26.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.868+0000 7f1a9b7fe640 1 --2- 172.21.15.7:0/1652690269 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1a900a3320 0x7f1a900a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:26.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.869+0000 7f1aa1d9b640 1 -- 172.21.15.7:0/1652690269 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1a900a3320 msgr2=0x7f1a900a57e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3577760109 2024-09-19T08:44:26.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.869+0000 7f1a9b7fe640 1 -- 172.21.15.7:0/1652690269 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1a8c0f0160 con 0x7f1aa4100e20 2024-09-19T08:44:26.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.869+0000 7f1aa1d9b640 1 --2- 172.21.15.7:0/1652690269 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1a900a3320 0x7f1a900a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:44:26.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:26.873+0000 7f1a9b7fe640 1 -- 172.21.15.7:0/1652690269 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1a8c031de0 con 0x7f1aa4100e20 2024-09-19T08:44:26.977 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:26 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:26.746+0000 7fccb7422040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:44:26.984 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:26 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:26.683+0000 7fb1a06f6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:44:27.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:27.070+0000 7f1aa1d9b640 1 -- 172.21.15.7:0/1652690269 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1a900a3320 msgr2=0x7f1a900a57e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3577760109 2024-09-19T08:44:27.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:27.070+0000 7f1aa1d9b640 1 --2- 172.21.15.7:0/1652690269 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1a900a3320 0x7f1a900a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:44:27.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:27.101+0000 7f1aa8bee640 1 -- 172.21.15.7:0/1652690269 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1aa4108b00 con 0x7f1aa4100e20 2024-09-19T08:44:27.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:27.102+0000 7f1a9b7fe640 1 -- 172.21.15.7:0/1652690269 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7f1a8c0bc6d0 con 0x7f1aa4100e20 2024-09-19T08:44:27.102 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T08:44:27.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:27.105+0000 7f1aa8bee640 1 -- 172.21.15.7:0/1652690269 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1a900a3320 msgr2=0x7f1a900a57e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:44:27.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:27.105+0000 7f1aa8bee640 1 --2- 172.21.15.7:0/1652690269 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1a900a3320 0x7f1a900a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:27.105+0000 7f1aa8bee640 1 -- 172.21.15.7:0/1652690269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa4100e20 msgr2=0x7f1aa4197460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:27.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:27.105+0000 7f1aa8bee640 1 --2- 172.21.15.7:0/1652690269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa4100e20 0x7f1aa4197460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c006010 tx=0x7f1a8c003c10 comp rx=0 tx=0).stop 2024-09-19T08:44:27.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:27.105+0000 7f1aa8bee640 1 -- 172.21.15.7:0/1652690269 shutdown_connections 2024-09-19T08:44:27.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:27.105+0000 7f1aa8bee640 1 --2- 172.21.15.7:0/1652690269 >> [v2:172.21.15.7:6800/3577760109,v1:172.21.15.7:6801/3577760109] conn(0x7f1a900a3320 0x7f1a900a57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:27.105+0000 7f1aa8bee640 1 --2- 172.21.15.7:0/1652690269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa4102ef0 0x7f1aa419bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:27.105+0000 7f1aa8bee640 1 --2- 172.21.15.7:0/1652690269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa4102570 0x7f1aa41979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:27.105+0000 7f1aa8bee640 1 --2- 172.21.15.7:0/1652690269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa4100e20 0x7f1aa4197460 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:27.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:27.105+0000 7f1aa8bee640 1 -- 172.21.15.7:0/1652690269 >> 172.21.15.7:0/1652690269 conn(0x7f1aa40fc7d0 msgr2=0x7f1aa40fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:27.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:27.105+0000 7f1aa8bee640 1 -- 172.21.15.7:0/1652690269 shutdown_connections 2024-09-19T08:44:27.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:27.105+0000 7f1aa8bee640 1 -- 172.21.15.7:0/1652690269 wait complete. 2024-09-19T08:44:27.241 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:26 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3596586854' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T08:44:27.241 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:26 smithi175 ceph-mon[35688]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T08:44:27.242 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:26 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:26.995+0000 7fb1a06f6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:44:27.242 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:27 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:27.056+0000 7fb1a06f6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:44:27.242 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:27 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:27.241+0000 7fb1a06f6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:44:27.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:26 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3596586854' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T08:44:27.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:26 smithi007 ceph-mon[31221]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T08:44:27.283 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:27 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:27.096+0000 7fccb7422040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:44:27.283 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:27 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:27.174+0000 7fccb7422040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:44:27.296 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:26 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3596586854' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T08:44:27.296 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:26 smithi044 ceph-mon[35072]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T08:44:27.296 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:27 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:27.039+0000 7fafa1472040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:44:27.296 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:27 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:27.103+0000 7fafa1472040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:44:27.296 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:27 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:27.296+0000 7fafa1472040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:44:27.783 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:27 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:27.368+0000 7fccb7422040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:44:27.876 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T08:44:27.877 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T08:44:27.877 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-09-19T08:44:27.877 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T08:44:27.877 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T08:44:27.877 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T08:44:27.877 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T08:44:27.877 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T08:44:27.877 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T08:44:27.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:44:27.878 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-09-19T08:44:27.895 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T08:44:27.895 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T08:44:27.895 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T08:44:27.895 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:44:27.895 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-09-19T08:44:27.895 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:44:27.896 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:44:27.896 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-09-19T08:44:27.896 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-09-19T08:44:27.896 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:44:27.896 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-09-19T08:44:27.896 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-09-19T08:44:27.896 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T08:44:27.896 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-09-19T08:44:27.896 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-09-19T08:44:27.896 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T08:44:27.896 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42184sec preferred_lft 42184sec 2024-09-19T08:44:27.896 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-09-19T08:44:27.897 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:44:27.897 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:44:27.897 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-09-19T08:44:27.897 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-09-19T08:44:27.897 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T08:44:27.897 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:44:27.897 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-19T08:44:27.898 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add name ceph-brx type bridge 2024-09-19T08:44:27.898 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr flush dev ceph-brx 2024-09-19T08:44:27.898 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set ceph-brx up 2024-09-19T08:44:27.898 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T08:44:27.898 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-19T08:44:27.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:44:28.101 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:27 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1652690269' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T08:44:28.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:44:28.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:44:28.113 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T08:44:28.139 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-09-19T08:44:28.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:44:28.141 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-09-19T08:44:28.212 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-09-19T08:44:28.213 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T08:44:28.213 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T08:44:28.213 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T08:44:28.213 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T08:44:28.213 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:44:28.213 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-19T08:44:28.213 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T08:44:28.213 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T08:44:28.214 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T08:44:28.214 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-19T08:44:28.284 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:27 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1652690269' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T08:44:28.284 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:28 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:28.214+0000 7fafa1472040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:44:28.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:44:28.396 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:28 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:28.322+0000 7fccb7422040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:44:28.396 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:28 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:28.395+0000 7fccb7422040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:44:28.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:27 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1652690269' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T08:44:28.428 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:28 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:28.124+0000 7fb1a06f6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:44:28.428 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:28 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:28.191+0000 7fb1a06f6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:44:28.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:44:28.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:44:28.494 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-09-19T08:44:28.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:44:28.511 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list-id 2024-09-19T08:44:28.550 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:28 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:28.284+0000 7fafa1472040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:44:28.566 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:44:28.567 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-19T08:44:28.567 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:44:28.567 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T08:44:28.567 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-19T08:44:28.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:44:28.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:44:28.689 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T08:44:28.689 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:44:28.689 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-19T08:44:28.689 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T08:44:28.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T08:44:28.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T08:44:28.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T08:44:28.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T08:44:28.690 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-19T08:44:28.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:44:28.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:44:28.822 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:44:28.823 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-19T08:44:28.823 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-09-19T08:44:28.823 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T08:44:28.823 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-19T08:44:28.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:44:28.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:44:28.904 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:44:28.904 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T08:44:28.920 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T08:44:28.920 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:44:28.920 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T08:44:28.976 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-19T08:44:28.976 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-19T08:44:28.976 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/de5fb11b-dddd-4e15-99ca-dbd7ff6b586c 2024-09-19T08:44:28.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:44:28.977 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/de5fb11b-dddd-4e15-99ca-dbd7ff6b586c /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-19T08:44:29.086 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-19T08:44:29.086 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-19T08:44:29.155 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:28 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:28.897+0000 7fb1a06f6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:44:29.156 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:29 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:29.013+0000 7fb1a06f6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:44:29.220 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-19T08:44:29.220 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-19T08:44:29.220 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.44:3300,172.21.15.175:3300" 2024-09-19T08:44:29.220 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with new device syntax: 0@ebd23124-7661-11ef-bceb-c7b262605968.cephfs=/volumes/qa/sv_1/de5fb11b-dddd-4e15-99ca-dbd7ff6b586c 2024-09-19T08:44:29.220 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.7:3300/172.21.15.44:3300/172.21.15.175:3300" will pass to kernel 2024-09-19T08:44:29.222 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T08:44:29.222 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-09-19T08:44:29.222 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T08:44:29.222 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T08:44:29.222 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T08:44:29.223 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T08:44:29.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:44:29.223 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T08:44:29.292 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:29 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:29.022+0000 7fafa1472040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:44:29.292 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:29 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:29.142+0000 7fafa1472040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:44:29.303 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:29 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:29.179+0000 7fccb7422040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:44:29.303 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:29 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:29.303+0000 7fccb7422040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:44:29.428 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:29 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:29.155+0000 7fb1a06f6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:44:29.428 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:29 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:29.218+0000 7fb1a06f6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:44:29.428 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:29 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:29.369+0000 7fb1a06f6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:44:29.550 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:29 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:29.292+0000 7fafa1472040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:44:29.551 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:29 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:29.355+0000 7fafa1472040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:44:29.551 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:29 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:29.511+0000 7fafa1472040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:44:29.674 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:29 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:29.453+0000 7fccb7422040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:44:29.674 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:29 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:29.517+0000 7fccb7422040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:44:29.674 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:29 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:29.674+0000 7fccb7422040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:44:29.718 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:29 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:29.437+0000 7fb1a06f6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:44:29.718 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:29 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:29.497+0000 7fb1a06f6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:44:29.718 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:29 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:29.653+0000 7fb1a06f6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:44:29.875 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:29 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:29.581+0000 7fafa1472040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:44:29.875 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:29 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:29.643+0000 7fafa1472040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:44:29.875 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:29 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:29.808+0000 7fafa1472040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:44:29.875 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:29 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:29.875+0000 7fafa1472040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:44:29.975 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:29 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:29.745+0000 7fccb7422040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:44:29.975 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:29 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:29.808+0000 7fccb7422040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:44:29.975 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:29 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:29.975+0000 7fccb7422040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:44:29.985 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:29 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:29.718+0000 7fb1a06f6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:44:29.985 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:29 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:29.785+0000 7fb1a06f6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:44:29.985 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:29 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:29.867+0000 7fb1a06f6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:44:29.985 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:29 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:29.926+0000 7fb1a06f6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:44:29.985 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:29 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:29.984+0000 7fb1a06f6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:44:30.153 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:29 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:29.944+0000 7fafa1472040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:44:30.153 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:30 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:30.029+0000 7fafa1472040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:44:30.153 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:30 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:30.091+0000 7fafa1472040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:44:30.153 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:30 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:30.153+0000 7fafa1472040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:44:30.262 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:30 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:30.043+0000 7fccb7422040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:44:30.262 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:30 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:30.113+0000 7fccb7422040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:44:30.262 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:30 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:30.199+0000 7fccb7422040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:44:30.262 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:30 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:30.262+0000 7fccb7422040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:44:30.533 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:30 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:30.324+0000 7fccb7422040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:44:31.161 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:30 smithi007 ceph-mon[31221]: Standby manager daemon z restarted 2024-09-19T08:44:31.162 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:30 smithi007 ceph-mon[31221]: Standby manager daemon z started 2024-09-19T08:44:31.162 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:30 smithi007 ceph-mon[31221]: from='mgr.? 172.21.15.175:0/260029001' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:44:31.162 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:30 smithi007 ceph-mon[31221]: from='mgr.? 172.21.15.175:0/260029001' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:44:31.162 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:30 smithi007 ceph-mon[31221]: from='mgr.? 172.21.15.175:0/260029001' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:44:31.162 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:30 smithi007 ceph-mon[31221]: from='mgr.? 172.21.15.175:0/260029001' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:44:31.178 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:44:30 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z[37494]: 2024-09-19T08:44:30.774+0000 7fb1a06f6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:44:31.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:30 smithi175 ceph-mon[35688]: Standby manager daemon z restarted 2024-09-19T08:44:31.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:30 smithi175 ceph-mon[35688]: Standby manager daemon z started 2024-09-19T08:44:31.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:30 smithi175 ceph-mon[35688]: from='mgr.? 172.21.15.175:0/260029001' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:44:31.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:30 smithi175 ceph-mon[35688]: from='mgr.? 172.21.15.175:0/260029001' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:44:31.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:30 smithi175 ceph-mon[35688]: from='mgr.? 172.21.15.175:0/260029001' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:44:31.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:30 smithi175 ceph-mon[35688]: from='mgr.? 172.21.15.175:0/260029001' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:44:31.200 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T08:44:31.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T08:44:31.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:44:31.274 INFO:teuthology.orchestra.run.smithi007.stdout:client24926 2024-09-19T08:44:31.274 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T08:44:31.274 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:44:31.295 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T08:44:31.300 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:44:30 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y[36439]: 2024-09-19T08:44:30.979+0000 7fafa1472040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:44:31.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:30 smithi044 ceph-mon[35072]: Standby manager daemon z restarted 2024-09-19T08:44:31.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:30 smithi044 ceph-mon[35072]: Standby manager daemon z started 2024-09-19T08:44:31.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:30 smithi044 ceph-mon[35072]: from='mgr.? 172.21.15.175:0/260029001' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:44:31.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:30 smithi044 ceph-mon[35072]: from='mgr.? 172.21.15.175:0/260029001' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:44:31.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:30 smithi044 ceph-mon[35072]: from='mgr.? 172.21.15.175:0/260029001' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:44:31.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:30 smithi044 ceph-mon[35072]: from='mgr.? 172.21.15.175:0/260029001' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:44:31.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T08:44:31.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:44:31.423 INFO:teuthology.orchestra.run.smithi007.stdout:client24926 2024-09-19T08:44:31.424 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T08:44:31.468 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:31.161+0000 7fccb7422040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:44:31.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T08:44:31.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:44:31.505 INFO:teuthology.orchestra.run.smithi007.stdout:client24926 2024-09-19T08:44:31.506 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/ebd23124-7661-11ef-bceb-c7b262605968.client24926/status') 2024-09-19T08:44:31.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:44:31.581 INFO:teuthology.orchestra.run.smithi007.stdout:instance: client.24926 (3)172.21.15.7:0/3855852908 2024-09-19T08:44:31.581 INFO:teuthology.orchestra.run.smithi007.stdout:blocklisted: false 2024-09-19T08:44:31.581 INFO:teuthology.orchestra.run.smithi007.stderr:0+1 records in 2024-09-19T08:44:31.581 INFO:teuthology.orchestra.run.smithi007.stderr:0+1 records out 2024-09-19T08:44:31.581 INFO:teuthology.orchestra.run.smithi007.stderr:70 bytes copied, 2.4329e-05 s, 2.9 MB/s 2024-09-19T08:44:31.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:44:31.588 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T08:44:31.597 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T08:44:31.597 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-19T08:44:31.597 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-19T08:44:31.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.704+0000 7f23d1b66640 1 -- 172.21.15.7:0/13982994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23cc104f90 msgr2=0x7f23cc107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:31.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.704+0000 7f23d1b66640 1 --2- 172.21.15.7:0/13982994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23cc104f90 0x7f23cc107380 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009900 tx=0x7f23c002a410 comp rx=0 tx=0).stop 2024-09-19T08:44:31.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.704+0000 7f23d1b66640 1 -- 172.21.15.7:0/13982994 shutdown_connections 2024-09-19T08:44:31.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.704+0000 7f23d1b66640 1 --2- 172.21.15.7:0/13982994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23cc1078c0 0x7f23cc109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:31.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.704+0000 7f23d1b66640 1 --2- 172.21.15.7:0/13982994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23cc104f90 0x7f23cc107380 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:31.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.704+0000 7f23d1b66640 1 --2- 172.21.15.7:0/13982994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23cc102660 0x7f23cc104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:31.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.704+0000 7f23d1b66640 1 -- 172.21.15.7:0/13982994 >> 172.21.15.7:0/13982994 conn(0x7f23cc0fc1c0 msgr2=0x7f23cc0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:31.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.704+0000 7f23d1b66640 1 -- 172.21.15.7:0/13982994 shutdown_connections 2024-09-19T08:44:31.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.704+0000 7f23d1b66640 1 -- 172.21.15.7:0/13982994 wait complete. 2024-09-19T08:44:31.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.704+0000 7f23d1b66640 1 Processor -- start 2024-09-19T08:44:31.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.705+0000 7f23d1b66640 1 -- start start 2024-09-19T08:44:31.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.705+0000 7f23d1b66640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23cc102660 0x7f23cc19a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:31.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.705+0000 7f23d1b66640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23cc104f90 0x7f23cc19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:31.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.705+0000 7f23d1b66640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23cc1078c0 0x7f23cc1a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:31.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.705+0000 7f23d1b66640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f23cc10d7d0 con 0x7f23cc1078c0 2024-09-19T08:44:31.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.705+0000 7f23d1b66640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f23cc10d650 con 0x7f23cc104f90 2024-09-19T08:44:31.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.705+0000 7f23d1b66640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f23cc10d950 con 0x7f23cc102660 2024-09-19T08:44:31.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.705+0000 7f23cbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23cc1078c0 0x7f23cc1a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:31.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.705+0000 7f23cb7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23cc102660 0x7f23cc19a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:31.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.705+0000 7f23cbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23cc1078c0 0x7f23cc1a1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34932/0 (socket says 172.21.15.7:34932) 2024-09-19T08:44:31.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.705+0000 7f23cb7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23cc102660 0x7f23cc19a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.7:58856/0 (socket says 172.21.15.7:58856) 2024-09-19T08:44:31.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.705+0000 7f23cbfff640 1 -- 172.21.15.7:0/1624482405 learned_addr learned my addr 172.21.15.7:0/1624482405 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:31.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.705+0000 7f23caffd640 1 --2- 172.21.15.7:0/1624482405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23cc104f90 0x7f23cc19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:31.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.705+0000 7f23cbfff640 1 -- 172.21.15.7:0/1624482405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23cc102660 msgr2=0x7f23cc19a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:31.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.705+0000 7f23cbfff640 1 --2- 172.21.15.7:0/1624482405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23cc102660 0x7f23cc19a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:31.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.705+0000 7f23cbfff640 1 -- 172.21.15.7:0/1624482405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23cc104f90 msgr2=0x7f23cc19a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:31.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.705+0000 7f23cbfff640 1 --2- 172.21.15.7:0/1624482405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23cc104f90 0x7f23cc19a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:31.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.705+0000 7f23cbfff640 1 -- 172.21.15.7:0/1624482405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23cc1a1cb0 con 0x7f23cc1078c0 2024-09-19T08:44:31.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.705+0000 7f23caffd640 1 --2- 172.21.15.7:0/1624482405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23cc104f90 0x7f23cc19a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:31.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.706+0000 7f23cbfff640 1 --2- 172.21.15.7:0/1624482405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23cc1078c0 0x7f23cc1a1640 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f23c400d720 tx=0x7f23c400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:31.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.706+0000 7f23c8ff9640 1 -- 172.21.15.7:0/1624482405 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4017070 con 0x7f23cc1078c0 2024-09-19T08:44:31.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.706+0000 7f23d1b66640 1 -- 172.21.15.7:0/1624482405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23cc1a1fa0 con 0x7f23cc1078c0 2024-09-19T08:44:31.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.706+0000 7f23c8ff9640 1 -- 172.21.15.7:0/1624482405 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23c400de30 con 0x7f23cc1078c0 2024-09-19T08:44:31.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.706+0000 7f23c8ff9640 1 -- 172.21.15.7:0/1624482405 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4004d90 con 0x7f23cc1078c0 2024-09-19T08:44:31.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.706+0000 7f23d1b66640 1 -- 172.21.15.7:0/1624482405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23cc1a2460 con 0x7f23cc1078c0 2024-09-19T08:44:31.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.707+0000 7f23d1b66640 1 -- 172.21.15.7:0/1624482405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23cc1093b0 con 0x7f23cc1078c0 2024-09-19T08:44:31.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.709+0000 7f23c8ff9640 1 -- 172.21.15.7:0/1624482405 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138040+0+0 (secure 0 0 0) 0x7f23c4004f30 con 0x7f23cc1078c0 2024-09-19T08:44:31.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.709+0000 7f23c8ff9640 1 -- 172.21.15.7:0/1624482405 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f23c40cf160 con 0x7f23cc1078c0 2024-09-19T08:44:31.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.713+0000 7f23c8ff9640 1 -- 172.21.15.7:0/1624482405 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f23c409c150 con 0x7f23cc1078c0 2024-09-19T08:44:31.783 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:31.468+0000 7fcc21a3a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:44:31.784 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:31.468+0000 7fcc21a3a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:44:31.784 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:31.468+0000 7fcc21a3a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:44:31.784 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:31.468+0000 7fcc21a3a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:44:31.784 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:31.468+0000 7fcc21a3a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:44:31.784 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:31.470+0000 7fcc1ea34640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:44:31.784 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:31.470+0000 7fcc1ea34640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:44:31.784 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:31.470+0000 7fcc1ea34640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:44:31.784 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:31.470+0000 7fcc1ea34640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:44:31.784 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:31.470+0000 7fcc1ea34640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:44:31.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:31.938+0000 7f23d1b66640 1 -- 172.21.15.7:0/1624482405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f23cc02d9c0 con 0x7f23cc1078c0 2024-09-19T08:44:32.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-19T08:44:32.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: Standby manager daemon y restarted 2024-09-19T08:44:32.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: Standby manager daemon y started 2024-09-19T08:44:32.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.? 172.21.15.44:0/2902936854' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:44:32.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.? 172.21.15.44:0/2902936854' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:44:32.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.? 172.21.15.44:0/2902936854' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:44:32.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.? 172.21.15.44:0/2902936854' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:44:32.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: Active manager daemon x restarted 2024-09-19T08:44:32.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: Activating manager daemon x 2024-09-19T08:44:32.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T08:44:32.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: mgrmap e20: x(active, starting, since 0.0109795s), standbys: z, y 2024-09-19T08:44:32.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:44:32.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:32.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:44:32.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T08:44:32.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T08:44:32.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T08:44:32.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T08:44:32.053 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:44:32.053 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T08:44:32.053 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:44:32.053 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:44:32.053 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:44:32.053 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:44:32.053 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:44:32.053 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:44:32.053 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:44:32.053 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:44:32.053 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:44:32.053 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:44:32.053 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:44:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:44:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:44:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:44:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:44:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:44:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:44:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:44:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:44:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:44:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:44:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:44:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:44:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:44:32.054 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: Manager daemon x is now available 2024-09-19T08:44:32.055 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:32.055 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:44:32.055 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:44:32.055 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:44:32.055 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:31 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:44:32.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-19T08:44:32.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: Standby manager daemon y restarted 2024-09-19T08:44:32.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: Standby manager daemon y started 2024-09-19T08:44:32.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.? 172.21.15.44:0/2902936854' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:44:32.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.? 172.21.15.44:0/2902936854' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:44:32.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.? 172.21.15.44:0/2902936854' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:44:32.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.? 172.21.15.44:0/2902936854' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:44:32.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: Active manager daemon x restarted 2024-09-19T08:44:32.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: Activating manager daemon x 2024-09-19T08:44:32.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T08:44:32.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: mgrmap e20: x(active, starting, since 0.0109795s), standbys: z, y 2024-09-19T08:44:32.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:44:32.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:32.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:44:32.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T08:44:32.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T08:44:32.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T08:44:32.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T08:44:32.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:44:32.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T08:44:32.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:44:32.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:44:32.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:44:32.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:44:32.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:44:32.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:44:32.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:44:32.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:44:32.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:44:32.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:44:32.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:44:32.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:44:32.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:44:32.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:44:32.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:44:32.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:44:32.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:44:32.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:44:32.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:44:32.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:44:32.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:44:32.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:44:32.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:44:32.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:44:32.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: Manager daemon x is now available 2024-09-19T08:44:32.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:32.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:44:32.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:44:32.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:44:32.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:31 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:44:32.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:32.181+0000 7f23c8ff9640 1 -- 172.21.15.7:0/1624482405 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f23c40977a0 con 0x7f23cc1078c0 2024-09-19T08:44:32.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:32.182+0000 7f23c8ff9640 1 --2- 172.21.15.7:0/1624482405 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f23b40aa010 0x7f23b40ac400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:32.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:32.184+0000 7f23cb7fe640 1 --2- 172.21.15.7:0/1624482405 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f23b40aa010 0x7f23b40ac400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:32.186+0000 7f23cb7fe640 1 --2- 172.21.15.7:0/1624482405 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f23b40aa010 0x7f23b40ac400 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f23bc007ec0 tx=0x7f23bc0075b0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:32.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-19T08:44:32.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: Standby manager daemon y restarted 2024-09-19T08:44:32.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: Standby manager daemon y started 2024-09-19T08:44:32.285 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.? 172.21.15.44:0/2902936854' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:44:32.285 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.? 172.21.15.44:0/2902936854' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:44:32.285 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.? 172.21.15.44:0/2902936854' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:44:32.285 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.? 172.21.15.44:0/2902936854' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:44:32.285 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: Active manager daemon x restarted 2024-09-19T08:44:32.286 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: Activating manager daemon x 2024-09-19T08:44:32.286 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T08:44:32.286 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: mgrmap e20: x(active, starting, since 0.0109795s), standbys: z, y 2024-09-19T08:44:32.286 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:44:32.286 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:32.286 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:44:32.287 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T08:44:32.287 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T08:44:32.287 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T08:44:32.287 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T08:44:32.287 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:44:32.287 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T08:44:32.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:44:32.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:44:32.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:44:32.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:44:32.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:44:32.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:44:32.289 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:44:32.289 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:44:32.289 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:44:32.289 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:44:32.289 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:44:32.289 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:44:32.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:44:32.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:44:32.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:44:32.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:44:32.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:44:32.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:44:32.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:44:32.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:44:32.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:44:32.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:44:32.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:44:32.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:44:32.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: Manager daemon x is now available 2024-09-19T08:44:32.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:32.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:44:32.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:44:32.293 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:44:32.293 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:31 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:44:32.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:32.845+0000 7f23c8ff9640 1 -- 172.21.15.7:0/1624482405 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7f23c4094000 con 0x7f23cc1078c0 2024-09-19T08:44:32.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:32.847+0000 7f23d1b66640 1 -- 172.21.15.7:0/1624482405 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f23b40aa010 msgr2=0x7f23b40ac400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:32.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:32.847+0000 7f23d1b66640 1 --2- 172.21.15.7:0/1624482405 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f23b40aa010 0x7f23b40ac400 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f23bc007ec0 tx=0x7f23bc0075b0 comp rx=0 tx=0).stop 2024-09-19T08:44:32.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:32.847+0000 7f23d1b66640 1 -- 172.21.15.7:0/1624482405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23cc1078c0 msgr2=0x7f23cc1a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:32.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:32.847+0000 7f23d1b66640 1 --2- 172.21.15.7:0/1624482405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23cc1078c0 0x7f23cc1a1640 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f23c400d720 tx=0x7f23c400dbe0 comp rx=0 tx=0).stop 2024-09-19T08:44:32.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:32.847+0000 7f23d1b66640 1 -- 172.21.15.7:0/1624482405 shutdown_connections 2024-09-19T08:44:32.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:32.847+0000 7f23d1b66640 1 --2- 172.21.15.7:0/1624482405 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f23b40aa010 0x7f23b40ac400 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:32.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:32.847+0000 7f23d1b66640 1 --2- 172.21.15.7:0/1624482405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23cc1078c0 0x7f23cc1a1640 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:32.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:32.847+0000 7f23d1b66640 1 --2- 172.21.15.7:0/1624482405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23cc104f90 0x7f23cc19a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:32.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:32.847+0000 7f23d1b66640 1 --2- 172.21.15.7:0/1624482405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23cc102660 0x7f23cc19a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:32.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:32.847+0000 7f23d1b66640 1 -- 172.21.15.7:0/1624482405 >> 172.21.15.7:0/1624482405 conn(0x7f23cc0fc1c0 msgr2=0x7f23cc101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:32.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:32.848+0000 7f23d1b66640 1 -- 172.21.15.7:0/1624482405 shutdown_connections 2024-09-19T08:44:32.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:32.848+0000 7f23d1b66640 1 -- 172.21.15.7:0/1624482405 wait complete. 2024-09-19T08:44:32.859 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T08:44:32.875 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-19T08:44:32.924 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:44:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.030+0000 7f5d1ae37640 1 -- 172.21.15.7:0/2805396900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d14104f60 msgr2=0x7f5d14107350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.030+0000 7f5d1ae37640 1 --2- 172.21.15.7:0/2805396900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d14104f60 0x7f5d14107350 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5d08009900 tx=0x7f5d0802a410 comp rx=0 tx=0).stop 2024-09-19T08:44:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.030+0000 7f5d1ae37640 1 -- 172.21.15.7:0/2805396900 shutdown_connections 2024-09-19T08:44:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.030+0000 7f5d1ae37640 1 --2- 172.21.15.7:0/2805396900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d14107890 0x7f5d14109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.030+0000 7f5d1ae37640 1 --2- 172.21.15.7:0/2805396900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d14104f60 0x7f5d14107350 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.030+0000 7f5d1ae37640 1 --2- 172.21.15.7:0/2805396900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d14102630 0x7f5d14104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.030+0000 7f5d1ae37640 1 -- 172.21.15.7:0/2805396900 >> 172.21.15.7:0/2805396900 conn(0x7f5d140fc1f0 msgr2=0x7f5d140fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.030+0000 7f5d1ae37640 1 -- 172.21.15.7:0/2805396900 shutdown_connections 2024-09-19T08:44:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.030+0000 7f5d1ae37640 1 -- 172.21.15.7:0/2805396900 wait complete. 2024-09-19T08:44:33.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.031+0000 7f5d1ae37640 1 Processor -- start 2024-09-19T08:44:33.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.031+0000 7f5d1ae37640 1 -- start start 2024-09-19T08:44:33.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.031+0000 7f5d1ae37640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d14102630 0x7f5d14101fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:33.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.031+0000 7f5d1ae37640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d14104f60 0x7f5d141005e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:33.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.031+0000 7f5d1ae37640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d14107890 0x7f5d14100b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:33.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.031+0000 7f5d1ae37640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1410d810 con 0x7f5d14107890 2024-09-19T08:44:33.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.031+0000 7f5d1ae37640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1410d690 con 0x7f5d14102630 2024-09-19T08:44:33.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.031+0000 7f5d1ae37640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1410d990 con 0x7f5d14104f60 2024-09-19T08:44:33.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.031+0000 7f5d193d4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d14107890 0x7f5d14100b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:33.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.031+0000 7f5d18bd3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d14102630 0x7f5d14101fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:33.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.031+0000 7f5d193d4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d14107890 0x7f5d14100b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34948/0 (socket says 172.21.15.7:34948) 2024-09-19T08:44:33.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.031+0000 7f5d193d4640 1 -- 172.21.15.7:0/2668530709 learned_addr learned my addr 172.21.15.7:0/2668530709 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:33.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.031+0000 7f5d13fff640 1 --2- 172.21.15.7:0/2668530709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d14104f60 0x7f5d141005e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:33.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.031+0000 7f5d18bd3640 1 -- 172.21.15.7:0/2668530709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d14104f60 msgr2=0x7f5d141005e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:33.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.031+0000 7f5d18bd3640 1 --2- 172.21.15.7:0/2668530709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d14104f60 0x7f5d141005e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.031+0000 7f5d18bd3640 1 -- 172.21.15.7:0/2668530709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d14107890 msgr2=0x7f5d14100b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:33.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.031+0000 7f5d18bd3640 1 --2- 172.21.15.7:0/2668530709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d14107890 0x7f5d14100b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.031+0000 7f5d18bd3640 1 -- 172.21.15.7:0/2668530709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d141013b0 con 0x7f5d14102630 2024-09-19T08:44:33.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.031+0000 7f5d193d4640 1 --2- 172.21.15.7:0/2668530709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d14107890 0x7f5d14100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:44:33.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.032+0000 7f5d18bd3640 1 --2- 172.21.15.7:0/2668530709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d14102630 0x7f5d14101fa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5d04009fd0 tx=0x7f5d0400ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:33.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.032+0000 7f5d11ffb640 1 -- 172.21.15.7:0/2668530709 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d04004b20 con 0x7f5d14102630 2024-09-19T08:44:33.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.032+0000 7f5d11ffb640 1 -- 172.21.15.7:0/2668530709 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d04004cc0 con 0x7f5d14102630 2024-09-19T08:44:33.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.032+0000 7f5d1ae37640 1 -- 172.21.15.7:0/2668530709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d141a1ff0 con 0x7f5d14102630 2024-09-19T08:44:33.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.032+0000 7f5d11ffb640 1 -- 172.21.15.7:0/2668530709 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d040107b0 con 0x7f5d14102630 2024-09-19T08:44:33.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.032+0000 7f5d1ae37640 1 -- 172.21.15.7:0/2668530709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d141a23f0 con 0x7f5d14102630 2024-09-19T08:44:33.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:32 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1624482405' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T08:44:33.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:32 smithi007 ceph-mon[31221]: mgrmap e21: x(active, since 1.01942s), standbys: z, y 2024-09-19T08:44:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.033+0000 7f5d1ae37640 1 -- 172.21.15.7:0/2668530709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d140fdce0 con 0x7f5d14102630 2024-09-19T08:44:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.034+0000 7f5d11ffb640 1 -- 172.21.15.7:0/2668530709 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f5d04005020 con 0x7f5d14102630 2024-09-19T08:44:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.035+0000 7f5d11ffb640 1 --2- 172.21.15.7:0/2668530709 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5cfc0a3050 0x7f5cfc0a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.035+0000 7f5d13fff640 1 --2- 172.21.15.7:0/2668530709 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5cfc0a3050 0x7f5cfc0a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.035+0000 7f5d11ffb640 1 -- 172.21.15.7:0/2668530709 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f5d040cfda0 con 0x7f5d14102630 2024-09-19T08:44:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.036+0000 7f5d13fff640 1 --2- 172.21.15.7:0/2668530709 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5cfc0a3050 0x7f5cfc0a5510 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5d08005ab0 tx=0x7f5d08000bc0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:33.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.043+0000 7f5d11ffb640 1 -- 172.21.15.7:0/2668530709 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5d0409cc80 con 0x7f5d14102630 2024-09-19T08:44:33.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:32 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1624482405' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T08:44:33.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:32 smithi175 ceph-mon[35688]: mgrmap e21: x(active, since 1.01942s), standbys: z, y 2024-09-19T08:44:33.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.248+0000 7f5d1ae37640 1 -- 172.21.15.7:0/2668530709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d14062e90 con 0x7f5d14102630 2024-09-19T08:44:33.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.250+0000 7f5d11ffb640 1 -- 172.21.15.7:0/2668530709 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+23065 (secure 0 0 0) 0x7f5d0409c580 con 0x7f5d14102630 2024-09-19T08:44:33.250 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:44:33.250 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":83,"fsid":"ebd23124-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:02.287380+0000","modified":"2024-09-19T08:44:31.163658+0000","last_up_change":"2024-09-19T08:41:54.742978+0000","last_in_change":"2024-09-19T08:41:31.685622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:13.285118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:42:40.425852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:42:43.006548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"837e6267-71c7-4f48-9e0b-4e3f124682b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6803","nonce":402668717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6805","nonce":402668717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6809","nonce":402668717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6807","nonce":402668717}]},"public_addr":"172.21.15.7:6803/402668717","cluster_addr":"172.21.15.7:6805/402668717","heartbeat_back_addr":"172.21.15.7:6809/402668717","heartbeat_front_addr":"172.21.15.7:6807/402668717","state":["exists","up"]},{"osd":1,"uuid":"67865372-ac22-4b30-bd02-498e118d6701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6801","nonce":2213694259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6803","nonce":2213694259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6807","nonce":2213694259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6805","nonce":2213694259}]},"public_addr":"172.21.15.44:6801/2213694259","cluster_addr":"172.21.15.44:6803/2213694259","heartbeat_back_addr":"172.21.15.44:6807/2213694259","heartbeat_front_addr":"172.21.15.44:6805/2213694259","state":["exists","up"]},{"osd":2,"uuid":"37c1cc2b-60ea-449f-baa7-c65d96c3559c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6801","nonce":3413002145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6803","nonce":3413002145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6807","nonce":3413002145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6805","nonce":3413002145}]},"public_addr":"172.21.15.175:6801/3413002145","cluster_addr":"172.21.15.175:6803/3413002145","heartbeat_back_addr":"172.21.15.175:6807/3413002145","heartbeat_front_addr":"172.21.15.175:6805/3413002145","state":["exists","up"]},{"osd":3,"uuid":"a8ffd2ae-4211-492a-a8ac-d4d6cbb4a03d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6811","nonce":2528867083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6813","nonce":2528867083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6817","nonce":2528867083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6815","nonce":2528867083}]},"public_addr":"172.21.15.7:6811/2528867083","cluster_addr":"172.21.15.7:6813/2528867083","heartbeat_back_addr":"172.21.15.7:6817/2528867083","heartbeat_front_addr":"172.21.15.7:6815/2528867083","state":["exists","up"]},{"osd":4,"uuid":"9a67b2ec-1a0a-413e-bd13-9532f24a0155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6809","nonce":3537143774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537143774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537143774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537143774}]},"public_addr":"172.21.15.44:6809/3537143774","cluster_addr":"172.21.15.44:6811/3537143774","heartbeat_back_addr":"172.21.15.44:6815/3537143774","heartbeat_front_addr":"172.21.15.44:6813/3537143774","state":["exists","up"]},{"osd":5,"uuid":"436cd596-710b-48e2-8255-8427c93cee1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6809","nonce":4001214751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6811","nonce":4001214751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6815","nonce":4001214751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6813","nonce":4001214751}]},"public_addr":"172.21.15.175:6809/4001214751","cluster_addr":"172.21.15.175:6811/4001214751","heartbeat_back_addr":"172.21.15.175:6815/4001214751","heartbeat_front_addr":"172.21.15.175:6813/4001214751","state":["exists","up"]},{"osd":6,"uuid":"f5a7ad2b-6b44-4b5a-8af7-f7fb00e7ca68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6819","nonce":1261079202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6821","nonce":1261079202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6825","nonce":1261079202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6823","nonce":1261079202}]},"public_addr":"172.21.15.7:6819/1261079202","cluster_addr":"172.21.15.7:6821/1261079202","heartbeat_back_addr":"172.21.15.7:6825/1261079202","heartbeat_front_addr":"172.21.15.7:6823/1261079202","state":["exists","up"]},{"osd":7,"uuid":"aa24aee5-6449-4842-8831-1c8e06cde75b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6817","nonce":3120822957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6819","nonce":3120822957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6823","nonce":3120822957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6821","nonce":3120822957}]},"public_addr":"172.21.15.44:6817/3120822957","cluster_addr":"172.21.15.44:6819/3120822957","heartbeat_back_addr":"172.21.15.44:6823/3120822957","heartbeat_front_addr":"172.21.15.44:6821/3120822957","state":["exists","up"]},{"osd":8,"uuid":"d912501a-bb7a-489e-b6ab-e451fb22210d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6817","nonce":2080374927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6819","nonce":2080374927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6823","nonce":2080374927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6821","nonce":2080374927}]},"public_addr":"172.21.15.175:6817/2080374927","cluster_addr":"172.21.15.175:6819/2080374927","heartbeat_back_addr":"172.21.15.175:6823/2080374927","heartbeat_front_addr":"172.21.15.175:6821/2080374927","state":["exists","up"]},{"osd":9,"uuid":"d132f5b2-75b9-4d6c-89ec-f52c303e0fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6827","nonce":3808356432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6829","nonce":3808356432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6833","nonce":3808356432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6831","nonce":3808356432}]},"public_addr":"172.21.15.7:6827/3808356432","cluster_addr":"172.21.15.7:6829/3808356432","heartbeat_back_addr":"172.21.15.7:6833/3808356432","heartbeat_front_addr":"172.21.15.7:6831/3808356432","state":["exists","up"]},{"osd":10,"uuid":"f6c405d6-a255-4e0e-8528-7bbc16d5e434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6825","nonce":4009464689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6827","nonce":4009464689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6831","nonce":4009464689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6829","nonce":4009464689}]},"public_addr":"172.21.15.44:6825/4009464689","cluster_addr":"172.21.15.44:6827/4009464689","heartbeat_back_addr":"172.21.15.44:6831/4009464689","heartbeat_front_addr":"172.21.15.44:6829/4009464689","state":["exists","up"]},{"osd":11,"uuid":"a2a046cd-9939-473a-988b-6e0ad28a0233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6825","nonce":4173951310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6827","nonce":4173951310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6831","nonce":4173951310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6829","nonce":4173951310}]},"public_addr":"172.21.15.175:6825/4173951310","cluster_addr":"172.21.15.175:6827/4173951310","heartbeat_back_addr":"172.21.15.175:6831/4173951310","heartbeat_front_addr":"172.21.15.175:6829/4173951310","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:20.015497+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:44.967046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:09.682080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:35.516899+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:00.705686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:25.276387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:49.927456+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:14.786755+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:38.553913+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.962825+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.812976+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:52.837744+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/973276283":"2024-09-20T08:44:31.163626+0000","172.21.15.7:0/2695884066":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/816886708":"2024-09-20T08:35:31.711540+0000","172.21.15.7:6800/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:6800/3577760109":"2024-09-20T08:44:31.163626+0000","172.21.15.7:0/1429582340":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/4277640815":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/499611189":"2024-09-20T08:44:31.163626+0000","172.21.15.7:6801/3577760109":"2024-09-20T08:44:31.163626+0000","172.21.15.7:0/4058698573":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/1800852158":"2024-09-20T08:44:31.163626+0000","172.21.15.7:0/2884903597":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/2457209252":"2024-09-20T08:44:31.163626+0000","172.21.15.7:6800/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/2008302629":"2024-09-20T08:44:31.163626+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:44:33.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.253+0000 7f5d1ae37640 1 -- 172.21.15.7:0/2668530709 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5cfc0a3050 msgr2=0x7f5cfc0a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:33.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.253+0000 7f5d1ae37640 1 --2- 172.21.15.7:0/2668530709 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5cfc0a3050 0x7f5cfc0a5510 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5d08005ab0 tx=0x7f5d08000bc0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.253+0000 7f5d1ae37640 1 -- 172.21.15.7:0/2668530709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d14102630 msgr2=0x7f5d14101fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:33.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.253+0000 7f5d1ae37640 1 --2- 172.21.15.7:0/2668530709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d14102630 0x7f5d14101fa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5d04009fd0 tx=0x7f5d0400ef90 comp rx=0 tx=0).stop 2024-09-19T08:44:33.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.253+0000 7f5d1ae37640 1 -- 172.21.15.7:0/2668530709 shutdown_connections 2024-09-19T08:44:33.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.253+0000 7f5d1ae37640 1 --2- 172.21.15.7:0/2668530709 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5cfc0a3050 0x7f5cfc0a5510 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.253+0000 7f5d1ae37640 1 --2- 172.21.15.7:0/2668530709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d14107890 0x7f5d14100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.253+0000 7f5d1ae37640 1 --2- 172.21.15.7:0/2668530709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d14104f60 0x7f5d141005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.253+0000 7f5d1ae37640 1 --2- 172.21.15.7:0/2668530709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d14102630 0x7f5d14101fa0 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5d04009fd0 tx=0x7f5d0400ef90 comp rx=0 tx=0).stop 2024-09-19T08:44:33.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.253+0000 7f5d1ae37640 1 -- 172.21.15.7:0/2668530709 >> 172.21.15.7:0/2668530709 conn(0x7f5d140fc1f0 msgr2=0x7f5d14102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:33.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.253+0000 7f5d1ae37640 1 -- 172.21.15.7:0/2668530709 shutdown_connections 2024-09-19T08:44:33.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.253+0000 7f5d1ae37640 1 -- 172.21.15.7:0/2668530709 wait complete. 2024-09-19T08:44:33.266 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T08:38:13.285118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T08:42:40.425852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T08:42:43.006548+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T08:44:33.266 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T08:44:33.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:32 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1624482405' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T08:44:33.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:32 smithi044 ceph-mon[35072]: mgrmap e21: x(active, since 1.01942s), standbys: z, y 2024-09-19T08:44:33.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.386+0000 7f5f03b23640 1 -- 172.21.15.7:0/3906257750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5efc074bf0 msgr2=0x7f5efc075050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:33.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.386+0000 7f5f03b23640 1 --2- 172.21.15.7:0/3906257750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5efc074bf0 0x7f5efc075050 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009900 tx=0x7f5eec02a480 comp rx=0 tx=0).stop 2024-09-19T08:44:33.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.386+0000 7f5f03b23640 1 -- 172.21.15.7:0/3906257750 shutdown_connections 2024-09-19T08:44:33.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.386+0000 7f5f03b23640 1 --2- 172.21.15.7:0/3906257750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5efc1099f0 0x7f5efc10beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.386+0000 7f5f03b23640 1 --2- 172.21.15.7:0/3906257750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5efc074bf0 0x7f5efc075050 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.386+0000 7f5f03b23640 1 --2- 172.21.15.7:0/3906257750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5efc0761d0 0x7f5efc074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.386+0000 7f5f03b23640 1 -- 172.21.15.7:0/3906257750 >> 172.21.15.7:0/3906257750 conn(0x7f5efc0fd2e0 msgr2=0x7f5efc0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.386+0000 7f5f03b23640 1 -- 172.21.15.7:0/3906257750 shutdown_connections 2024-09-19T08:44:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.386+0000 7f5f03b23640 1 -- 172.21.15.7:0/3906257750 wait complete. 2024-09-19T08:44:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.387+0000 7f5f03b23640 1 Processor -- start 2024-09-19T08:44:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.387+0000 7f5f03b23640 1 -- start start 2024-09-19T08:44:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.387+0000 7f5f03b23640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5efc074bf0 0x7f5efc19a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.387+0000 7f5f03b23640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5efc0761d0 0x7f5efc19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.387+0000 7f5f03b23640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5efc1099f0 0x7f5efc1a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.387+0000 7f5f03b23640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5efc10f9d0 con 0x7f5efc074bf0 2024-09-19T08:44:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.387+0000 7f5f03b23640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5efc10f850 con 0x7f5efc1099f0 2024-09-19T08:44:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.387+0000 7f5f03b23640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5efc10fb50 con 0x7f5efc0761d0 2024-09-19T08:44:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.387+0000 7f5f018bf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5efc074bf0 0x7f5efc19a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.387+0000 7f5f018bf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5efc074bf0 0x7f5efc19a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53250/0 (socket says 172.21.15.7:53250) 2024-09-19T08:44:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.387+0000 7f5f018bf640 1 -- 172.21.15.7:0/3356732050 learned_addr learned my addr 172.21.15.7:0/3356732050 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.387+0000 7f5f020c0640 1 --2- 172.21.15.7:0/3356732050 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5efc1099f0 0x7f5efc1a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.387+0000 7f5f010be640 1 --2- 172.21.15.7:0/3356732050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5efc0761d0 0x7f5efc19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.388+0000 7f5f020c0640 1 -- 172.21.15.7:0/3356732050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5efc0761d0 msgr2=0x7f5efc19a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.388+0000 7f5f020c0640 1 --2- 172.21.15.7:0/3356732050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5efc0761d0 0x7f5efc19a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.388+0000 7f5f020c0640 1 -- 172.21.15.7:0/3356732050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5efc074bf0 msgr2=0x7f5efc19a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.388+0000 7f5f020c0640 1 --2- 172.21.15.7:0/3356732050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5efc074bf0 0x7f5efc19a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.388+0000 7f5f020c0640 1 -- 172.21.15.7:0/3356732050 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5efc1a1c80 con 0x7f5efc1099f0 2024-09-19T08:44:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.388+0000 7f5f018bf640 1 --2- 172.21.15.7:0/3356732050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5efc074bf0 0x7f5efc19a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:44:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.388+0000 7f5f020c0640 1 --2- 172.21.15.7:0/3356732050 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5efc1099f0 0x7f5efc1a1610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009fd0 tx=0x7f5ef400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.388+0000 7f5ef2ffd640 1 -- 172.21.15.7:0/3356732050 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef400ce20 con 0x7f5efc1099f0 2024-09-19T08:44:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.388+0000 7f5ef2ffd640 1 -- 172.21.15.7:0/3356732050 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ef4005020 con 0x7f5efc1099f0 2024-09-19T08:44:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.388+0000 7f5ef2ffd640 1 -- 172.21.15.7:0/3356732050 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4010720 con 0x7f5efc1099f0 2024-09-19T08:44:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.388+0000 7f5f03b23640 1 -- 172.21.15.7:0/3356732050 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5efc1a1f70 con 0x7f5efc1099f0 2024-09-19T08:44:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.388+0000 7f5f03b23640 1 -- 172.21.15.7:0/3356732050 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5efc1a2430 con 0x7f5efc1099f0 2024-09-19T08:44:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.390+0000 7f5f03b23640 1 -- 172.21.15.7:0/3356732050 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5efc1080a0 con 0x7f5efc1099f0 2024-09-19T08:44:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.391+0000 7f5ef2ffd640 1 -- 172.21.15.7:0/3356732050 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f5ef4005540 con 0x7f5efc1099f0 2024-09-19T08:44:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.391+0000 7f5ef2ffd640 1 --2- 172.21.15.7:0/3356732050 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5ee80a30d0 0x7f5ee80a5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.391+0000 7f5f018bf640 1 --2- 172.21.15.7:0/3356732050 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5ee80a30d0 0x7f5ee80a5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.391+0000 7f5ef2ffd640 1 -- 172.21.15.7:0/3356732050 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f5ef40cfcc0 con 0x7f5efc1099f0 2024-09-19T08:44:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.392+0000 7f5f018bf640 1 --2- 172.21.15.7:0/3356732050 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5ee80a30d0 0x7f5ee80a5590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8011550 tx=0x7f5ef8005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:33.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.399+0000 7f5ef2ffd640 1 -- 172.21.15.7:0/3356732050 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5ef409cba0 con 0x7f5efc1099f0 2024-09-19T08:44:33.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.607+0000 7f5f03b23640 1 -- 172.21.15.7:0/3356732050 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5efc062e90 con 0x7f5efc1099f0 2024-09-19T08:44:33.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.607+0000 7f5ef2ffd640 1 -- 172.21.15.7:0/3356732050 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) ==== 93+0+10 (secure 0 0 0) 0x7f5ef409c4a0 con 0x7f5efc1099f0 2024-09-19T08:44:33.607 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-19T08:44:33.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.609+0000 7f5f03b23640 1 -- 172.21.15.7:0/3356732050 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5ee80a30d0 msgr2=0x7f5ee80a5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:33.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.609+0000 7f5f03b23640 1 --2- 172.21.15.7:0/3356732050 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5ee80a30d0 0x7f5ee80a5590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8011550 tx=0x7f5ef8005f90 comp rx=0 tx=0).stop 2024-09-19T08:44:33.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.609+0000 7f5f03b23640 1 -- 172.21.15.7:0/3356732050 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5efc1099f0 msgr2=0x7f5efc1a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:33.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.609+0000 7f5f03b23640 1 --2- 172.21.15.7:0/3356732050 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5efc1099f0 0x7f5efc1a1610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009fd0 tx=0x7f5ef400ef10 comp rx=0 tx=0).stop 2024-09-19T08:44:33.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.610+0000 7f5f03b23640 1 -- 172.21.15.7:0/3356732050 shutdown_connections 2024-09-19T08:44:33.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.610+0000 7f5f03b23640 1 --2- 172.21.15.7:0/3356732050 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5ee80a30d0 0x7f5ee80a5590 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.610+0000 7f5f03b23640 1 --2- 172.21.15.7:0/3356732050 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5efc1099f0 0x7f5efc1a1610 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.610+0000 7f5f03b23640 1 --2- 172.21.15.7:0/3356732050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5efc0761d0 0x7f5efc19a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.610+0000 7f5f03b23640 1 --2- 172.21.15.7:0/3356732050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5efc074bf0 0x7f5efc19a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.610+0000 7f5f03b23640 1 -- 172.21.15.7:0/3356732050 >> 172.21.15.7:0/3356732050 conn(0x7f5efc0fd2e0 msgr2=0x7f5efc10bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:33.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.610+0000 7f5f03b23640 1 -- 172.21.15.7:0/3356732050 shutdown_connections 2024-09-19T08:44:33.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.610+0000 7f5f03b23640 1 -- 172.21.15.7:0/3356732050 wait complete. 2024-09-19T08:44:33.620 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T08:44:33.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.728+0000 7ffb23c82640 1 -- 172.21.15.7:0/1667956934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb1c104ee0 msgr2=0x7ffb1c1072d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:33.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.728+0000 7ffb23c82640 1 --2- 172.21.15.7:0/1667956934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb1c104ee0 0x7ffb1c1072d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009900 tx=0x7ffb0c02a410 comp rx=0 tx=0).stop 2024-09-19T08:44:33.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.728+0000 7ffb23c82640 1 -- 172.21.15.7:0/1667956934 shutdown_connections 2024-09-19T08:44:33.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.728+0000 7ffb23c82640 1 --2- 172.21.15.7:0/1667956934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb1c107810 0x7ffb1c109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.728+0000 7ffb23c82640 1 --2- 172.21.15.7:0/1667956934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb1c104ee0 0x7ffb1c1072d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.728+0000 7ffb23c82640 1 --2- 172.21.15.7:0/1667956934 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb1c1025b0 0x7ffb1c1049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.728+0000 7ffb23c82640 1 -- 172.21.15.7:0/1667956934 >> 172.21.15.7:0/1667956934 conn(0x7ffb1c0fc190 msgr2=0x7ffb1c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:33.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.728+0000 7ffb23c82640 1 -- 172.21.15.7:0/1667956934 shutdown_connections 2024-09-19T08:44:33.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.728+0000 7ffb23c82640 1 -- 172.21.15.7:0/1667956934 wait complete. 2024-09-19T08:44:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.729+0000 7ffb23c82640 1 Processor -- start 2024-09-19T08:44:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.729+0000 7ffb23c82640 1 -- start start 2024-09-19T08:44:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.729+0000 7ffb23c82640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb1c1025b0 0x7ffb1c197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.729+0000 7ffb23c82640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb1c104ee0 0x7ffb1c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.729+0000 7ffb23c82640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb1c107810 0x7ffb1c19f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.729+0000 7ffb23c82640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c10d7f0 con 0x7ffb1c104ee0 2024-09-19T08:44:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.729+0000 7ffb23c82640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c10d670 con 0x7ffb1c1025b0 2024-09-19T08:44:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.729+0000 7ffb23c82640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c10d970 con 0x7ffb1c107810 2024-09-19T08:44:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.729+0000 7ffb2121d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb1c104ee0 0x7ffb1c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.729+0000 7ffb2121d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb1c104ee0 0x7ffb1c198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53266/0 (socket says 172.21.15.7:53266) 2024-09-19T08:44:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.729+0000 7ffb2121d640 1 -- 172.21.15.7:0/2123598994 learned_addr learned my addr 172.21.15.7:0/2123598994 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.729+0000 7ffb21a1e640 1 --2- 172.21.15.7:0/2123598994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb1c1025b0 0x7ffb1c197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.729+0000 7ffb2221f640 1 --2- 172.21.15.7:0/2123598994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb1c107810 0x7ffb1c19f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.729+0000 7ffb2121d640 1 -- 172.21.15.7:0/2123598994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb1c107810 msgr2=0x7ffb1c19f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.729+0000 7ffb2121d640 1 --2- 172.21.15.7:0/2123598994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb1c107810 0x7ffb1c19f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.730+0000 7ffb2121d640 1 -- 172.21.15.7:0/2123598994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb1c1025b0 msgr2=0x7ffb1c197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.730+0000 7ffb2121d640 1 --2- 172.21.15.7:0/2123598994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb1c1025b0 0x7ffb1c197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.730+0000 7ffb2121d640 1 -- 172.21.15.7:0/2123598994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1c19faf0 con 0x7ffb1c104ee0 2024-09-19T08:44:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.730+0000 7ffb21a1e640 1 --2- 172.21.15.7:0/2123598994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb1c1025b0 0x7ffb1c197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:44:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.730+0000 7ffb2121d640 1 --2- 172.21.15.7:0/2123598994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb1c104ee0 0x7ffb1c198410 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c031610 tx=0x7ffb0c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.730+0000 7ffb12ffd640 1 -- 172.21.15.7:0/2123598994 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c03f030 con 0x7ffb1c104ee0 2024-09-19T08:44:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.730+0000 7ffb23c82640 1 -- 172.21.15.7:0/2123598994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb1c19fd80 con 0x7ffb1c104ee0 2024-09-19T08:44:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.730+0000 7ffb12ffd640 1 -- 172.21.15.7:0/2123598994 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb0c003ad0 con 0x7ffb1c104ee0 2024-09-19T08:44:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.730+0000 7ffb12ffd640 1 -- 172.21.15.7:0/2123598994 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c035070 con 0x7ffb1c104ee0 2024-09-19T08:44:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.730+0000 7ffb23c82640 1 -- 172.21.15.7:0/2123598994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb1c1a0210 con 0x7ffb1c104ee0 2024-09-19T08:44:33.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.731+0000 7ffb23c82640 1 -- 172.21.15.7:0/2123598994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb1c0fdc80 con 0x7ffb1c104ee0 2024-09-19T08:44:33.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.732+0000 7ffb12ffd640 1 -- 172.21.15.7:0/2123598994 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7ffb0c042030 con 0x7ffb1c104ee0 2024-09-19T08:44:33.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.733+0000 7ffb12ffd640 1 --2- 172.21.15.7:0/2123598994 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffb080a3050 0x7ffb080a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:33.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.733+0000 7ffb21a1e640 1 --2- 172.21.15.7:0/2123598994 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffb080a3050 0x7ffb080a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:33.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.733+0000 7ffb12ffd640 1 -- 172.21.15.7:0/2123598994 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7ffb0c0efea0 con 0x7ffb1c104ee0 2024-09-19T08:44:33.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.733+0000 7ffb21a1e640 1 --2- 172.21.15.7:0/2123598994 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffb080a3050 0x7ffb080a5510 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffb180095f0 tx=0x7ffb18005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.736+0000 7ffb12ffd640 1 -- 172.21.15.7:0/2123598994 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffb0c0bc6f0 con 0x7ffb1c104ee0 2024-09-19T08:44:33.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.864+0000 7ffb12ffd640 1 -- 172.21.15.7:0/2123598994 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 22) ==== 138474+0+0 (secure 0 0 0) 0x7ffb0c03b460 con 0x7ffb1c104ee0 2024-09-19T08:44:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.931+0000 7ffb23c82640 1 -- 172.21.15.7:0/2123598994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ffb1c02da10 con 0x7ffb1c104ee0 2024-09-19T08:44:33.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.932+0000 7ffb12ffd640 1 -- 172.21.15.7:0/2123598994 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) ==== 104+0+11 (secure 0 0 0) 0x7ffb0c0a84c0 con 0x7ffb1c104ee0 2024-09-19T08:44:33.932 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-19T08:44:33.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.935+0000 7ffb23c82640 1 -- 172.21.15.7:0/2123598994 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffb080a3050 msgr2=0x7ffb080a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:33.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.935+0000 7ffb23c82640 1 --2- 172.21.15.7:0/2123598994 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffb080a3050 0x7ffb080a5510 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffb180095f0 tx=0x7ffb18005f90 comp rx=0 tx=0).stop 2024-09-19T08:44:33.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.935+0000 7ffb23c82640 1 -- 172.21.15.7:0/2123598994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb1c104ee0 msgr2=0x7ffb1c198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:33.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.935+0000 7ffb23c82640 1 --2- 172.21.15.7:0/2123598994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb1c104ee0 0x7ffb1c198410 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c031610 tx=0x7ffb0c004270 comp rx=0 tx=0).stop 2024-09-19T08:44:33.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.935+0000 7ffb23c82640 1 -- 172.21.15.7:0/2123598994 shutdown_connections 2024-09-19T08:44:33.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.935+0000 7ffb23c82640 1 --2- 172.21.15.7:0/2123598994 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffb080a3050 0x7ffb080a5510 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.935+0000 7ffb23c82640 1 --2- 172.21.15.7:0/2123598994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb1c107810 0x7ffb1c19f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.935+0000 7ffb23c82640 1 --2- 172.21.15.7:0/2123598994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb1c104ee0 0x7ffb1c198410 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.935+0000 7ffb23c82640 1 --2- 172.21.15.7:0/2123598994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb1c1025b0 0x7ffb1c197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:33.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.935+0000 7ffb23c82640 1 -- 172.21.15.7:0/2123598994 >> 172.21.15.7:0/2123598994 conn(0x7ffb1c0fc190 msgr2=0x7ffb1c102ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:33.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.935+0000 7ffb23c82640 1 -- 172.21.15.7:0/2123598994 shutdown_connections 2024-09-19T08:44:33.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:33.935+0000 7ffb23c82640 1 -- 172.21.15.7:0/2123598994 wait complete. 2024-09-19T08:44:33.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-mon[31221]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:44:33.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1624482405' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T08:44:33.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-mon[31221]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T08:44:33.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:33.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:33.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2668530709' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:33.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:33.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:33.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:33.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:33.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3356732050' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:44:33.950 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:33.691+0000 7fcc0143a640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:08:44:33] ENGINE Error in HTTPServer.serve 2024-09-19T08:44:33.950 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: Traceback (most recent call last): 2024-09-19T08:44:33.950 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:44:33.951 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: self._connections.run(self.expiration_interval) 2024-09-19T08:44:33.951 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:44:33.951 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: self._run(expiration_interval) 2024-09-19T08:44:33.951 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:44:33.951 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:44:33.951 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:44:33.951 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:44:33.951 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:44:33.951 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: s = self.context.wrap_socket( 2024-09-19T08:44:33.952 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:44:33.952 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: return self.sslsocket_class._create( 2024-09-19T08:44:33.952 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:44:33.952 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: self.do_handshake() 2024-09-19T08:44:33.952 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:44:33.952 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: self._sslobj.do_handshake() 2024-09-19T08:44:33.952 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:44:33.953 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:44:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:44:33.954 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T08:44:34.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.062+0000 7f436a5c0640 1 -- 172.21.15.7:0/957810903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4364107810 msgr2=0x7f4364109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:34.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.062+0000 7f436a5c0640 1 --2- 172.21.15.7:0/957810903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4364107810 0x7f4364109c80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f435c009ca0 tx=0x7f435c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:44:34.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.062+0000 7f436a5c0640 1 -- 172.21.15.7:0/957810903 shutdown_connections 2024-09-19T08:44:34.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.062+0000 7f436a5c0640 1 --2- 172.21.15.7:0/957810903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4364107810 0x7f4364109c80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:34.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.062+0000 7f436a5c0640 1 --2- 172.21.15.7:0/957810903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4364104ee0 0x7f43641072d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:34.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.062+0000 7f436a5c0640 1 --2- 172.21.15.7:0/957810903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43641025b0 0x7f43641049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:34.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.062+0000 7f436a5c0640 1 -- 172.21.15.7:0/957810903 >> 172.21.15.7:0/957810903 conn(0x7f43640fc190 msgr2=0x7f43640fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:34.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.062+0000 7f436a5c0640 1 -- 172.21.15.7:0/957810903 shutdown_connections 2024-09-19T08:44:34.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.062+0000 7f436a5c0640 1 -- 172.21.15.7:0/957810903 wait complete. 2024-09-19T08:44:34.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.063+0000 7f436a5c0640 1 Processor -- start 2024-09-19T08:44:34.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.063+0000 7f436a5c0640 1 -- start start 2024-09-19T08:44:34.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.063+0000 7f436a5c0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43641025b0 0x7f4364197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:34.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.063+0000 7f436a5c0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4364104ee0 0x7f43641983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:34.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.063+0000 7f436a5c0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4364107810 0x7f436419f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:34.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.063+0000 7f436a5c0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f436410d7f0 con 0x7f4364107810 2024-09-19T08:44:34.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.063+0000 7f436a5c0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f436410d670 con 0x7f4364104ee0 2024-09-19T08:44:34.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.063+0000 7f436a5c0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f436410d970 con 0x7f43641025b0 2024-09-19T08:44:34.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.063+0000 7f4368b5d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4364107810 0x7f436419f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:34.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.063+0000 7f4368b5d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4364107810 0x7f436419f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53284/0 (socket says 172.21.15.7:53284) 2024-09-19T08:44:34.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.063+0000 7f4368b5d640 1 -- 172.21.15.7:0/2973741323 learned_addr learned my addr 172.21.15.7:0/2973741323 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:34.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.063+0000 7f43637fe640 1 --2- 172.21.15.7:0/2973741323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4364104ee0 0x7f43641983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:34.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.063+0000 7f4363fff640 1 --2- 172.21.15.7:0/2973741323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43641025b0 0x7f4364197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:34.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.064+0000 7f4368b5d640 1 -- 172.21.15.7:0/2973741323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43641025b0 msgr2=0x7f4364197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:34.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.064+0000 7f4368b5d640 1 --2- 172.21.15.7:0/2973741323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43641025b0 0x7f4364197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:34.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.064+0000 7f4368b5d640 1 -- 172.21.15.7:0/2973741323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4364104ee0 msgr2=0x7f43641983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:34.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.064+0000 7f4368b5d640 1 --2- 172.21.15.7:0/2973741323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4364104ee0 0x7f43641983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:34.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.064+0000 7f4368b5d640 1 -- 172.21.15.7:0/2973741323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f436419faa0 con 0x7f4364107810 2024-09-19T08:44:34.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.064+0000 7f4368b5d640 1 --2- 172.21.15.7:0/2973741323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4364107810 0x7f436419f430 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f435c02f540 tx=0x7f435c031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:34.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.064+0000 7f43617fa640 1 -- 172.21.15.7:0/2973741323 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435c003c30 con 0x7f4364107810 2024-09-19T08:44:34.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.064+0000 7f43617fa640 1 -- 172.21.15.7:0/2973741323 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f435c003dd0 con 0x7f4364107810 2024-09-19T08:44:34.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.064+0000 7f436a5c0640 1 -- 172.21.15.7:0/2973741323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f436419fd30 con 0x7f4364107810 2024-09-19T08:44:34.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.064+0000 7f43617fa640 1 -- 172.21.15.7:0/2973741323 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435c02fd90 con 0x7f4364107810 2024-09-19T08:44:34.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.064+0000 7f436a5c0640 1 -- 172.21.15.7:0/2973741323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43641a0220 con 0x7f4364107810 2024-09-19T08:44:34.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.065+0000 7f436a5c0640 1 -- 172.21.15.7:0/2973741323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43640fdc80 con 0x7f4364107810 2024-09-19T08:44:34.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.066+0000 7f43617fa640 1 -- 172.21.15.7:0/2973741323 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 138474+0+0 (secure 0 0 0) 0x7f435c004050 con 0x7f4364107810 2024-09-19T08:44:34.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.067+0000 7f43617fa640 1 --2- 172.21.15.7:0/2973741323 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f434c0a33c0 0x7f434c0a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:34.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.067+0000 7f4363fff640 1 --2- 172.21.15.7:0/2973741323 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f434c0a33c0 0x7f434c0a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:34.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.067+0000 7f43617fa640 1 -- 172.21.15.7:0/2973741323 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f435c0f0d00 con 0x7f4364107810 2024-09-19T08:44:34.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.068+0000 7f4363fff640 1 --2- 172.21.15.7:0/2973741323 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f434c0a33c0 0x7f434c0a5880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4354009bd0 tx=0x7f4354005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:34.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.071+0000 7f43617fa640 1 -- 172.21.15.7:0/2973741323 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f435c0bd7e0 con 0x7f4364107810 2024-09-19T08:44:34.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:33 smithi175 ceph-mon[35688]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:44:34.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:33 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1624482405' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T08:44:34.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:33 smithi175 ceph-mon[35688]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T08:44:34.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:33 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:34.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:33 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:34.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:33 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/2668530709' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:34.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:33 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:34.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:33 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:34.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:33 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:34.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:33 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:34.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:33 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3356732050' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:44:34.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.251+0000 7f436a5c0640 1 -- 172.21.15.7:0/2973741323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4364062e90 con 0x7f4364107810 2024-09-19T08:44:34.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.252+0000 7f43617fa640 1 -- 172.21.15.7:0/2973741323 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) ==== 100+0+11 (secure 0 0 0) 0x7f435c0bd0e0 con 0x7f4364107810 2024-09-19T08:44:34.252 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-09-19T08:44:34.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.254+0000 7f436a5c0640 1 -- 172.21.15.7:0/2973741323 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f434c0a33c0 msgr2=0x7f434c0a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:34.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.254+0000 7f436a5c0640 1 --2- 172.21.15.7:0/2973741323 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f434c0a33c0 0x7f434c0a5880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4354009bd0 tx=0x7f4354005f90 comp rx=0 tx=0).stop 2024-09-19T08:44:34.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.254+0000 7f436a5c0640 1 -- 172.21.15.7:0/2973741323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4364107810 msgr2=0x7f436419f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:34.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.254+0000 7f436a5c0640 1 --2- 172.21.15.7:0/2973741323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4364107810 0x7f436419f430 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f435c02f540 tx=0x7f435c031ee0 comp rx=0 tx=0).stop 2024-09-19T08:44:34.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.254+0000 7f436a5c0640 1 -- 172.21.15.7:0/2973741323 shutdown_connections 2024-09-19T08:44:34.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.254+0000 7f436a5c0640 1 --2- 172.21.15.7:0/2973741323 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f434c0a33c0 0x7f434c0a5880 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:34.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.254+0000 7f436a5c0640 1 --2- 172.21.15.7:0/2973741323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4364107810 0x7f436419f430 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:34.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.254+0000 7f436a5c0640 1 --2- 172.21.15.7:0/2973741323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4364104ee0 0x7f43641983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:34.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.254+0000 7f436a5c0640 1 --2- 172.21.15.7:0/2973741323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43641025b0 0x7f4364197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:34.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.254+0000 7f436a5c0640 1 -- 172.21.15.7:0/2973741323 >> 172.21.15.7:0/2973741323 conn(0x7f43640fc190 msgr2=0x7f4364102f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:34.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.254+0000 7f436a5c0640 1 -- 172.21.15.7:0/2973741323 shutdown_connections 2024-09-19T08:44:34.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:34.254+0000 7f436a5c0640 1 -- 172.21.15.7:0/2973741323 wait complete. 2024-09-19T08:44:34.266 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-19T08:44:34.266 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:44:34.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:33 smithi044 ceph-mon[35072]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:44:34.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:33 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1624482405' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T08:44:34.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:33 smithi044 ceph-mon[35072]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T08:44:34.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:33 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:34.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:33 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:34.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:33 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/2668530709' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:34.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:33 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:34.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:33 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:34.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:33 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:34.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:33 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:34.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:33 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3356732050' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:44:34.532 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:34.994 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: [19/Sep/2024:08:44:33] ENGINE Bus STARTING 2024-09-19T08:44:34.994 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: [19/Sep/2024:08:44:33] ENGINE Serving on http://172.21.15.7:8765 2024-09-19T08:44:34.994 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: [19/Sep/2024:08:44:33] ENGINE Serving on https://172.21.15.7:7150 2024-09-19T08:44:34.994 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: [19/Sep/2024:08:44:33] ENGINE Bus STARTED 2024-09-19T08:44:34.994 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: [19/Sep/2024:08:44:33] ENGINE Error in HTTPServer.serve 2024-09-19T08:44:34.994 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-09-19T08:44:34.994 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:44:34.995 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:44:34.995 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:44:34.995 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._run(expiration_interval) 2024-09-19T08:44:34.995 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:44:34.995 INFO:journalctl@ceph.mon.a.smithi007.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:44:34.995 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:44:34.995 INFO:journalctl@ceph.mon.a.smithi007.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:44:34.995 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:44:34.995 INFO:journalctl@ceph.mon.a.smithi007.stdout: s = self.context.wrap_socket( 2024-09-19T08:44:34.995 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:44:34.995 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.sslsocket_class._create( 2024-09-19T08:44:34.996 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:44:34.996 INFO:journalctl@ceph.mon.a.smithi007.stdout: self.do_handshake() 2024-09-19T08:44:34.996 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:44:34.996 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._sslobj.do_handshake() 2024-09-19T08:44:34.996 INFO:journalctl@ceph.mon.a.smithi007.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:44:34.996 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-19T08:44:34.996 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:34.996 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:34.996 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.996 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.996 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.997 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.997 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.997 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.997 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.997 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.997 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: Adjusting osd_memory_target on smithi175 to 176.0M 2024-09-19T08:44:34.997 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: Unable to set osd_memory_target on smithi175 to 184573132: error parsing value: Value '184573132' is below minimum 939524096 2024-09-19T08:44:34.997 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2123598994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:44:34.997 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:34.997 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:34.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:34.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:34.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2973741323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:44:34.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:34.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:34.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:34 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:35.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: [19/Sep/2024:08:44:33] ENGINE Bus STARTING 2024-09-19T08:44:35.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: [19/Sep/2024:08:44:33] ENGINE Serving on http://172.21.15.7:8765 2024-09-19T08:44:35.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: [19/Sep/2024:08:44:33] ENGINE Serving on https://172.21.15.7:7150 2024-09-19T08:44:35.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: [19/Sep/2024:08:44:33] ENGINE Bus STARTED 2024-09-19T08:44:35.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: [19/Sep/2024:08:44:33] ENGINE Error in HTTPServer.serve 2024-09-19T08:44:35.179 INFO:journalctl@ceph.mon.c.smithi175.stdout: Traceback (most recent call last): 2024-09-19T08:44:35.180 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:44:35.180 INFO:journalctl@ceph.mon.c.smithi175.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:44:35.180 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:44:35.180 INFO:journalctl@ceph.mon.c.smithi175.stdout: self._run(expiration_interval) 2024-09-19T08:44:35.180 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:44:35.180 INFO:journalctl@ceph.mon.c.smithi175.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:44:35.180 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:44:35.180 INFO:journalctl@ceph.mon.c.smithi175.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:44:35.180 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:44:35.180 INFO:journalctl@ceph.mon.c.smithi175.stdout: s = self.context.wrap_socket( 2024-09-19T08:44:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:44:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout: return self.sslsocket_class._create( 2024-09-19T08:44:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:44:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout: self.do_handshake() 2024-09-19T08:44:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:44:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout: self._sslobj.do_handshake() 2024-09-19T08:44:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:44:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-19T08:44:35.181 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:35.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:35.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: Adjusting osd_memory_target on smithi175 to 176.0M 2024-09-19T08:44:35.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: Unable to set osd_memory_target on smithi175 to 184573132: error parsing value: Value '184573132' is below minimum 939524096 2024-09-19T08:44:35.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/2123598994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:44:35.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:35.182 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:35.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:35.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:35.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/2973741323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:44:35.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.183 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.184 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.184 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.184 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.184 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.184 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.184 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:35.184 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:34 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:35.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.081+0000 7f9deaa81640 1 -- 172.21.15.7:0/3634217920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9de4102d30 msgr2=0x7f9de4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:35.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.081+0000 7f9deaa81640 1 --2- 172.21.15.7:0/3634217920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9de4102d30 0x7f9de4103110 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009930 tx=0x7f9dd802a420 comp rx=0 tx=0).stop 2024-09-19T08:44:35.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.081+0000 7f9deaa81640 1 -- 172.21.15.7:0/3634217920 shutdown_connections 2024-09-19T08:44:35.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.081+0000 7f9deaa81640 1 --2- 172.21.15.7:0/3634217920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9de41082a0 0x7f9de410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.081+0000 7f9deaa81640 1 --2- 172.21.15.7:0/3634217920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9de41036e0 0x7f9de4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.081+0000 7f9deaa81640 1 --2- 172.21.15.7:0/3634217920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9de4102d30 0x7f9de4103110 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.081+0000 7f9deaa81640 1 -- 172.21.15.7:0/3634217920 >> 172.21.15.7:0/3634217920 conn(0x7f9de40fc7d0 msgr2=0x7f9de40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:35.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.081+0000 7f9deaa81640 1 -- 172.21.15.7:0/3634217920 shutdown_connections 2024-09-19T08:44:35.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.081+0000 7f9deaa81640 1 -- 172.21.15.7:0/3634217920 wait complete. 2024-09-19T08:44:35.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.081+0000 7f9deaa81640 1 Processor -- start 2024-09-19T08:44:35.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.081+0000 7f9deaa81640 1 -- start start 2024-09-19T08:44:35.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.082+0000 7f9deaa81640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9de4102d30 0x7f9de41985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:35.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.082+0000 7f9deaa81640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9de41036e0 0x7f9de4198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:35.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.082+0000 7f9deaa81640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9de41082a0 0x7f9de419ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:35.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.082+0000 7f9deaa81640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9de41120a0 con 0x7f9de41036e0 2024-09-19T08:44:35.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.082+0000 7f9deaa81640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9de4111f20 con 0x7f9de41082a0 2024-09-19T08:44:35.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.082+0000 7f9deaa81640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9de4112220 con 0x7f9de4102d30 2024-09-19T08:44:35.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.082+0000 7f9de3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9de41036e0 0x7f9de4198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:35.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.082+0000 7f9de881d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9de4102d30 0x7f9de41985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:35.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.082+0000 7f9de3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9de41036e0 0x7f9de4198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53292/0 (socket says 172.21.15.7:53292) 2024-09-19T08:44:35.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.082+0000 7f9de3fff640 1 -- 172.21.15.7:0/2708257908 learned_addr learned my addr 172.21.15.7:0/2708257908 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:35.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.082+0000 7f9de901e640 1 --2- 172.21.15.7:0/2708257908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9de41082a0 0x7f9de419ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:35.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.082+0000 7f9de3fff640 1 -- 172.21.15.7:0/2708257908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9de4102d30 msgr2=0x7f9de41985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:35.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.082+0000 7f9de3fff640 1 --2- 172.21.15.7:0/2708257908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9de4102d30 0x7f9de41985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.082+0000 7f9de3fff640 1 -- 172.21.15.7:0/2708257908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9de41082a0 msgr2=0x7f9de419ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:35.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.082+0000 7f9de3fff640 1 --2- 172.21.15.7:0/2708257908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9de41082a0 0x7f9de419ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.082+0000 7f9de3fff640 1 -- 172.21.15.7:0/2708257908 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de419d550 con 0x7f9de41036e0 2024-09-19T08:44:35.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.082+0000 7f9de881d640 1 --2- 172.21.15.7:0/2708257908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9de4102d30 0x7f9de41985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:44:35.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.083+0000 7f9de3fff640 1 --2- 172.21.15.7:0/2708257908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9de41036e0 0x7f9de4198ae0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000e9f0 tx=0x7f9dd000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:35.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.083+0000 7f9de1ffb640 1 -- 172.21.15.7:0/2708257908 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd000ccc0 con 0x7f9de41036e0 2024-09-19T08:44:35.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.083+0000 7f9deaa81640 1 -- 172.21.15.7:0/2708257908 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9de419d840 con 0x7f9de41036e0 2024-09-19T08:44:35.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.083+0000 7f9deaa81640 1 -- 172.21.15.7:0/2708257908 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9de41a5120 con 0x7f9de41036e0 2024-09-19T08:44:35.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.083+0000 7f9de1ffb640 1 -- 172.21.15.7:0/2708257908 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dd0010910 con 0x7f9de41036e0 2024-09-19T08:44:35.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.083+0000 7f9de1ffb640 1 -- 172.21.15.7:0/2708257908 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0018920 con 0x7f9de41036e0 2024-09-19T08:44:35.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.084+0000 7f9deaa81640 1 -- 172.21.15.7:0/2708257908 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9de406a850 con 0x7f9de41036e0 2024-09-19T08:44:35.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.085+0000 7f9de1ffb640 1 -- 172.21.15.7:0/2708257908 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 138474+0+0 (secure 0 0 0) 0x7f9dd0010ac0 con 0x7f9de41036e0 2024-09-19T08:44:35.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.086+0000 7f9de1ffb640 1 --2- 172.21.15.7:0/2708257908 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9dd40a3430 0x7f9dd40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:35.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.086+0000 7f9de1ffb640 1 -- 172.21.15.7:0/2708257908 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f9dd00cff90 con 0x7f9de41036e0 2024-09-19T08:44:35.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.086+0000 7f9de881d640 1 --2- 172.21.15.7:0/2708257908 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9dd40a3430 0x7f9dd40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:35.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.087+0000 7f9de881d640 1 --2- 172.21.15.7:0/2708257908 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9dd40a3430 0x7f9dd40a58f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009900 tx=0x7f9dd80058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:35.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.090+0000 7f9de1ffb640 1 -- 172.21.15.7:0/2708257908 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9dd009c310 con 0x7f9de41036e0 2024-09-19T08:44:35.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: [19/Sep/2024:08:44:33] ENGINE Bus STARTING 2024-09-19T08:44:35.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: [19/Sep/2024:08:44:33] ENGINE Serving on http://172.21.15.7:8765 2024-09-19T08:44:35.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: [19/Sep/2024:08:44:33] ENGINE Serving on https://172.21.15.7:7150 2024-09-19T08:44:35.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: [19/Sep/2024:08:44:33] ENGINE Bus STARTED 2024-09-19T08:44:35.302 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: [19/Sep/2024:08:44:33] ENGINE Error in HTTPServer.serve 2024-09-19T08:44:35.302 INFO:journalctl@ceph.mon.b.smithi044.stdout: Traceback (most recent call last): 2024-09-19T08:44:35.302 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:44:35.302 INFO:journalctl@ceph.mon.b.smithi044.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:44:35.302 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:44:35.302 INFO:journalctl@ceph.mon.b.smithi044.stdout: self._run(expiration_interval) 2024-09-19T08:44:35.302 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:44:35.302 INFO:journalctl@ceph.mon.b.smithi044.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:44:35.302 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:44:35.302 INFO:journalctl@ceph.mon.b.smithi044.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:44:35.303 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:44:35.303 INFO:journalctl@ceph.mon.b.smithi044.stdout: s = self.context.wrap_socket( 2024-09-19T08:44:35.303 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:44:35.303 INFO:journalctl@ceph.mon.b.smithi044.stdout: return self.sslsocket_class._create( 2024-09-19T08:44:35.303 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:44:35.303 INFO:journalctl@ceph.mon.b.smithi044.stdout: self.do_handshake() 2024-09-19T08:44:35.303 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:44:35.303 INFO:journalctl@ceph.mon.b.smithi044.stdout: self._sslobj.do_handshake() 2024-09-19T08:44:35.303 INFO:journalctl@ceph.mon.b.smithi044.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:44:35.303 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-19T08:44:35.303 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:35.303 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:35.303 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.303 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.304 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.304 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.304 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.304 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.304 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.304 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.304 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: Adjusting osd_memory_target on smithi175 to 176.0M 2024-09-19T08:44:35.304 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: Unable to set osd_memory_target on smithi175 to 184573132: error parsing value: Value '184573132' is below minimum 939524096 2024-09-19T08:44:35.305 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/2123598994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:44:35.305 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:35.305 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:35.305 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.305 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.305 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.305 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.305 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.305 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.305 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.306 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.306 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:35.306 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:35.306 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/2973741323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:44:35.306 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.306 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.306 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.306 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.306 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.306 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.306 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.306 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:35.306 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:35.307 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:34 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:35.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.310+0000 7f9deaa81640 1 -- 172.21.15.7:0/2708257908 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9de410a2b0 con 0x7f9de41036e0 2024-09-19T08:44:35.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.310+0000 7f9de1ffb640 1 -- 172.21.15.7:0/2708257908 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f9dd00a0610 con 0x7f9de41036e0 2024-09-19T08:44:35.310 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:44:35.310 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:44:35.310 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:44:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.313+0000 7f9deaa81640 1 -- 172.21.15.7:0/2708257908 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9dd40a3430 msgr2=0x7f9dd40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.313+0000 7f9deaa81640 1 --2- 172.21.15.7:0/2708257908 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9dd40a3430 0x7f9dd40a58f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009900 tx=0x7f9dd80058d0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.313+0000 7f9deaa81640 1 -- 172.21.15.7:0/2708257908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9de41036e0 msgr2=0x7f9de4198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.313+0000 7f9deaa81640 1 --2- 172.21.15.7:0/2708257908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9de41036e0 0x7f9de4198ae0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000e9f0 tx=0x7f9dd000eeb0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.313+0000 7f9deaa81640 1 -- 172.21.15.7:0/2708257908 shutdown_connections 2024-09-19T08:44:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.313+0000 7f9deaa81640 1 --2- 172.21.15.7:0/2708257908 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9dd40a3430 0x7f9dd40a58f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.313+0000 7f9deaa81640 1 --2- 172.21.15.7:0/2708257908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9de41082a0 0x7f9de419ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.313+0000 7f9deaa81640 1 --2- 172.21.15.7:0/2708257908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9de41036e0 0x7f9de4198ae0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.313+0000 7f9deaa81640 1 --2- 172.21.15.7:0/2708257908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9de4102d30 0x7f9de41985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.313+0000 7f9deaa81640 1 -- 172.21.15.7:0/2708257908 >> 172.21.15.7:0/2708257908 conn(0x7f9de40fc7d0 msgr2=0x7f9de4105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.313+0000 7f9deaa81640 1 -- 172.21.15.7:0/2708257908 shutdown_connections 2024-09-19T08:44:35.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:35.313+0000 7f9deaa81640 1 -- 172.21.15.7:0/2708257908 wait complete. 2024-09-19T08:44:36.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: Adjusting osd_memory_target on smithi044 to 177.0M 2024-09-19T08:44:36.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: Unable to set osd_memory_target on smithi044 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-19T08:44:36.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: Adjusting osd_memory_target on smithi007 to 177.0M 2024-09-19T08:44:36.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: Unable to set osd_memory_target on smithi007 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-19T08:44:36.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-19T08:44:36.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: Updating smithi044:/etc/ceph/ceph.conf 2024-09-19T08:44:36.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-19T08:44:36.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: Updating smithi044:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:44:36.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: Updating smithi175:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:44:36.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: Updating smithi007:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:44:36.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:44:36.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:44:36.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:44:36.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: Updating smithi044:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:44:36.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: Updating smithi175:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:44:36.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: Updating smithi007:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:44:36.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2708257908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:36.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:36.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:36.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:36.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:35 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.128 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-19T08:44:36.129 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-19T08:44:36.129 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:44:36.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: Adjusting osd_memory_target on smithi044 to 177.0M 2024-09-19T08:44:36.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: Unable to set osd_memory_target on smithi044 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-19T08:44:36.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: Adjusting osd_memory_target on smithi007 to 177.0M 2024-09-19T08:44:36.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: Unable to set osd_memory_target on smithi007 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-19T08:44:36.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-19T08:44:36.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: Updating smithi044:/etc/ceph/ceph.conf 2024-09-19T08:44:36.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-19T08:44:36.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: Updating smithi044:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:44:36.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: Updating smithi175:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:44:36.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: Updating smithi007:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:44:36.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:44:36.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:44:36.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:44:36.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: Updating smithi044:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:44:36.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: Updating smithi175:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:44:36.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: Updating smithi007:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:44:36.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/2708257908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:36.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:36.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:36.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:36.180 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:35 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.202 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: Adjusting osd_memory_target on smithi044 to 177.0M 2024-09-19T08:44:36.202 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: Unable to set osd_memory_target on smithi044 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-19T08:44:36.202 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: Adjusting osd_memory_target on smithi007 to 177.0M 2024-09-19T08:44:36.203 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: Unable to set osd_memory_target on smithi007 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-19T08:44:36.203 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-19T08:44:36.203 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: Updating smithi044:/etc/ceph/ceph.conf 2024-09-19T08:44:36.203 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: Updating smithi175:/etc/ceph/ceph.conf 2024-09-19T08:44:36.203 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: Updating smithi044:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:44:36.203 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: Updating smithi175:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:44:36.203 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: Updating smithi007:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:44:36.203 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:44:36.203 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:44:36.204 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:44:36.204 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: Updating smithi044:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:44:36.204 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: Updating smithi175:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:44:36.204 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: Updating smithi007:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:44:36.204 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.204 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.204 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.204 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.204 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.204 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.204 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.204 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/2708257908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:36.204 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:36.204 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:36.205 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:36.205 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:35 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:36.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.234+0000 7f58ccd31640 1 -- 172.21.15.7:0/2440282386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58c81009d0 msgr2=0x7f58c8100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:36.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.234+0000 7f58ccd31640 1 --2- 172.21.15.7:0/2440282386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58c81009d0 0x7f58c8100e30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009930 tx=0x7f58bc02a420 comp rx=0 tx=0).stop 2024-09-19T08:44:36.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.234+0000 7f58ccd31640 1 -- 172.21.15.7:0/2440282386 shutdown_connections 2024-09-19T08:44:36.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.234+0000 7f58ccd31640 1 --2- 172.21.15.7:0/2440282386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c8101370 0x7f58c810d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.234+0000 7f58ccd31640 1 --2- 172.21.15.7:0/2440282386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58c81009d0 0x7f58c8100e30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.234+0000 7f58ccd31640 1 --2- 172.21.15.7:0/2440282386 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58c81069e0 0x7f58c8106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.234+0000 7f58ccd31640 1 -- 172.21.15.7:0/2440282386 >> 172.21.15.7:0/2440282386 conn(0x7f58c80fc6b0 msgr2=0x7f58c80fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:36.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.234+0000 7f58ccd31640 1 -- 172.21.15.7:0/2440282386 shutdown_connections 2024-09-19T08:44:36.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.234+0000 7f58ccd31640 1 -- 172.21.15.7:0/2440282386 wait complete. 2024-09-19T08:44:36.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.235+0000 7f58ccd31640 1 Processor -- start 2024-09-19T08:44:36.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.235+0000 7f58ccd31640 1 -- start start 2024-09-19T08:44:36.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.235+0000 7f58ccd31640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c81009d0 0x7f58c81992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:36.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.235+0000 7f58ccd31640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58c8101370 0x7f58c81997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:36.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.235+0000 7f58ccd31640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58c81069e0 0x7f58c81a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.235+0000 7f58ccd31640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f58c8110e20 con 0x7f58c8101370 2024-09-19T08:44:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.235+0000 7f58ccd31640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f58c8110ca0 con 0x7f58c81069e0 2024-09-19T08:44:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.235+0000 7f58ccd31640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f58c8110fa0 con 0x7f58c81009d0 2024-09-19T08:44:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.236+0000 7f58c5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58c8101370 0x7f58c81997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.236+0000 7f58c5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58c8101370 0x7f58c81997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53312/0 (socket says 172.21.15.7:53312) 2024-09-19T08:44:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.236+0000 7f58c5d9b640 1 -- 172.21.15.7:0/3168723511 learned_addr learned my addr 172.21.15.7:0/3168723511 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.236+0000 7f58c6d9d640 1 --2- 172.21.15.7:0/3168723511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58c81069e0 0x7f58c81a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.236+0000 7f58c659c640 1 --2- 172.21.15.7:0/3168723511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c81009d0 0x7f58c81992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.236+0000 7f58c5d9b640 1 -- 172.21.15.7:0/3168723511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c81009d0 msgr2=0x7f58c81992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.236+0000 7f58c5d9b640 1 --2- 172.21.15.7:0/3168723511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c81009d0 0x7f58c81992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.236+0000 7f58c5d9b640 1 -- 172.21.15.7:0/3168723511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58c81069e0 msgr2=0x7f58c81a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.236+0000 7f58c5d9b640 1 --2- 172.21.15.7:0/3168723511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58c81069e0 0x7f58c81a4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.236+0000 7f58c5d9b640 1 -- 172.21.15.7:0/3168723511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c81a4870 con 0x7f58c8101370 2024-09-19T08:44:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.236+0000 7f58c5d9b640 1 --2- 172.21.15.7:0/3168723511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58c8101370 0x7f58c81997f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009230 tx=0x7f58bc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.236+0000 7f58b77fe640 1 -- 172.21.15.7:0/3168723511 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc03f030 con 0x7f58c8101370 2024-09-19T08:44:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.236+0000 7f58ccd31640 1 -- 172.21.15.7:0/3168723511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c81a4a40 con 0x7f58c8101370 2024-09-19T08:44:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.236+0000 7f58b77fe640 1 -- 172.21.15.7:0/3168723511 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58bc004440 con 0x7f58c8101370 2024-09-19T08:44:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.236+0000 7f58b77fe640 1 -- 172.21.15.7:0/3168723511 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc035070 con 0x7f58c8101370 2024-09-19T08:44:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.236+0000 7f58ccd31640 1 -- 172.21.15.7:0/3168723511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c81970a0 con 0x7f58c8101370 2024-09-19T08:44:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.237+0000 7f58ccd31640 1 -- 172.21.15.7:0/3168723511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c8102110 con 0x7f58c8101370 2024-09-19T08:44:36.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.238+0000 7f58b77fe640 1 -- 172.21.15.7:0/3168723511 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f58bc042030 con 0x7f58c8101370 2024-09-19T08:44:36.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.239+0000 7f58b77fe640 1 --2- 172.21.15.7:0/3168723511 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f58b00a7860 0x7f58b00a9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:36.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.239+0000 7f58c659c640 1 --2- 172.21.15.7:0/3168723511 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f58b00a7860 0x7f58b00a9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:36.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.239+0000 7f58b77fe640 1 -- 172.21.15.7:0/3168723511 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f58bc0f02c0 con 0x7f58c8101370 2024-09-19T08:44:36.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.240+0000 7f58c659c640 1 --2- 172.21.15.7:0/3168723511 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f58b00a7860 0x7f58b00a9d20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009ae0 tx=0x7f58b8005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:36.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.243+0000 7f58b77fe640 1 -- 172.21.15.7:0/3168723511 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f58bc0bcac0 con 0x7f58c8101370 2024-09-19T08:44:36.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.415+0000 7f58ccd31640 1 -- 172.21.15.7:0/3168723511 --> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f58c8062630 con 0x7f58b00a7860 2024-09-19T08:44:36.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.422+0000 7f58b77fe640 1 -- 172.21.15.7:0/3168723511 <== mgr.15132 v2:172.21.15.7:6800/3061932294 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257852 (secure 0 0 0) 0x7f58c8062630 con 0x7f58b00a7860 2024-09-19T08:44:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:44:36.425 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-19T08:44:36.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.425+0000 7f58ccd31640 1 -- 172.21.15.7:0/3168723511 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f58b00a7860 msgr2=0x7f58b00a9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:36.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.425+0000 7f58ccd31640 1 --2- 172.21.15.7:0/3168723511 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f58b00a7860 0x7f58b00a9d20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009ae0 tx=0x7f58b8005f90 comp rx=0 tx=0).stop 2024-09-19T08:44:36.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.425+0000 7f58ccd31640 1 -- 172.21.15.7:0/3168723511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58c8101370 msgr2=0x7f58c81997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:36.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.425+0000 7f58ccd31640 1 --2- 172.21.15.7:0/3168723511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58c8101370 0x7f58c81997f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009230 tx=0x7f58bc004040 comp rx=0 tx=0).stop 2024-09-19T08:44:36.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.425+0000 7f58ccd31640 1 -- 172.21.15.7:0/3168723511 shutdown_connections 2024-09-19T08:44:36.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.425+0000 7f58ccd31640 1 --2- 172.21.15.7:0/3168723511 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f58b00a7860 0x7f58b00a9d20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.425+0000 7f58ccd31640 1 --2- 172.21.15.7:0/3168723511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58c81069e0 0x7f58c81a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.425+0000 7f58ccd31640 1 --2- 172.21.15.7:0/3168723511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58c8101370 0x7f58c81997f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.425+0000 7f58ccd31640 1 --2- 172.21.15.7:0/3168723511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c81009d0 0x7f58c81992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.425+0000 7f58ccd31640 1 -- 172.21.15.7:0/3168723511 >> 172.21.15.7:0/3168723511 conn(0x7f58c80fc6b0 msgr2=0x7f58c80fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:36.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.425+0000 7f58ccd31640 1 -- 172.21.15.7:0/3168723511 shutdown_connections 2024-09-19T08:44:36.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.425+0000 7f58ccd31640 1 -- 172.21.15.7:0/3168723511 wait complete. 2024-09-19T08:44:36.436 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T08:44:35.182411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188063,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":847,"num_read_kb":581,"num_write":475,"num_write_kb":4378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1181934,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":867,"ondisk_log_size":867,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367340,"kb_used_data":13832,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124574484,"statfs":{"total":1151940427776,"available":1151564271616,"internally_reserved":0,"allocated":14163968,"data_stored":8330716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.989206"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226071+0000","last_change":"2024-09-19T08:42:44.035697+0000","last_active":"2024-09-19T08:44:31.226071+0000","last_peered":"2024-09-19T08:44:31.226071+0000","last_clean":"2024-09-19T08:44:31.226071+0000","last_became_active":"2024-09-19T08:42:44.035400+0000","last_became_peered":"2024-09-19T08:42:44.035400+0000","last_unstale":"2024-09-19T08:44:31.226071+0000","last_undegraded":"2024-09-19T08:44:31.226071+0000","last_fullsized":"2024-09-19T08:44:31.226071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:56.202947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.223958+0000","last_change":"2024-09-19T08:42:44.031393+0000","last_active":"2024-09-19T08:44:31.223958+0000","last_peered":"2024-09-19T08:44:31.223958+0000","last_clean":"2024-09-19T08:44:31.223958+0000","last_became_active":"2024-09-19T08:42:44.031056+0000","last_became_peered":"2024-09-19T08:42:44.031056+0000","last_unstale":"2024-09-19T08:44:31.223958+0000","last_undegraded":"2024-09-19T08:44:31.223958+0000","last_fullsized":"2024-09-19T08:44:31.223958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:44.694913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224221+0000","last_change":"2024-09-19T08:42:44.029586+0000","last_active":"2024-09-19T08:44:31.224221+0000","last_peered":"2024-09-19T08:44:31.224221+0000","last_clean":"2024-09-19T08:44:31.224221+0000","last_became_active":"2024-09-19T08:42:44.029279+0000","last_became_peered":"2024-09-19T08:42:44.029279+0000","last_unstale":"2024-09-19T08:44:31.224221+0000","last_undegraded":"2024-09-19T08:44:31.224221+0000","last_fullsized":"2024-09-19T08:44:31.224221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:12.036113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219401+0000","last_change":"2024-09-19T08:42:44.043192+0000","last_active":"2024-09-19T08:44:31.219401+0000","last_peered":"2024-09-19T08:44:31.219401+0000","last_clean":"2024-09-19T08:44:31.219401+0000","last_became_active":"2024-09-19T08:42:44.042838+0000","last_became_peered":"2024-09-19T08:42:44.042838+0000","last_unstale":"2024-09-19T08:44:31.219401+0000","last_undegraded":"2024-09-19T08:44:31.219401+0000","last_fullsized":"2024-09-19T08:44:31.219401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:20.549232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.207548+0000","last_change":"2024-09-19T08:42:44.032231+0000","last_active":"2024-09-19T08:44:31.207548+0000","last_peered":"2024-09-19T08:44:31.207548+0000","last_clean":"2024-09-19T08:44:31.207548+0000","last_became_active":"2024-09-19T08:42:44.031835+0000","last_became_peered":"2024-09-19T08:42:44.031835+0000","last_unstale":"2024-09-19T08:44:31.207548+0000","last_undegraded":"2024-09-19T08:44:31.207548+0000","last_fullsized":"2024-09-19T08:44:31.207548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:49.084085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.209888+0000","last_change":"2024-09-19T08:42:44.035487+0000","last_active":"2024-09-19T08:44:31.209888+0000","last_peered":"2024-09-19T08:44:31.209888+0000","last_clean":"2024-09-19T08:44:31.209888+0000","last_became_active":"2024-09-19T08:42:44.035138+0000","last_became_peered":"2024-09-19T08:42:44.035138+0000","last_unstale":"2024-09-19T08:44:31.209888+0000","last_undegraded":"2024-09-19T08:44:31.209888+0000","last_fullsized":"2024-09-19T08:44:31.209888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:43.483397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212841+0000","last_change":"2024-09-19T08:42:44.029052+0000","last_active":"2024-09-19T08:44:31.212841+0000","last_peered":"2024-09-19T08:44:31.212841+0000","last_clean":"2024-09-19T08:44:31.212841+0000","last_became_active":"2024-09-19T08:42:44.028722+0000","last_became_peered":"2024-09-19T08:42:44.028722+0000","last_unstale":"2024-09-19T08:44:31.212841+0000","last_undegraded":"2024-09-19T08:44:31.212841+0000","last_fullsized":"2024-09-19T08:44:31.212841+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:49.226044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212167+0000","last_change":"2024-09-19T08:42:44.031401+0000","last_active":"2024-09-19T08:44:31.212167+0000","last_peered":"2024-09-19T08:44:31.212167+0000","last_clean":"2024-09-19T08:44:31.212167+0000","last_became_active":"2024-09-19T08:42:44.031103+0000","last_became_peered":"2024-09-19T08:42:44.031103+0000","last_unstale":"2024-09-19T08:44:31.212167+0000","last_undegraded":"2024-09-19T08:44:31.212167+0000","last_fullsized":"2024-09-19T08:44:31.212167+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:57.406765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224039+0000","last_change":"2024-09-19T08:42:44.033011+0000","last_active":"2024-09-19T08:44:31.224039+0000","last_peered":"2024-09-19T08:44:31.224039+0000","last_clean":"2024-09-19T08:44:31.224039+0000","last_became_active":"2024-09-19T08:42:44.032075+0000","last_became_peered":"2024-09-19T08:42:44.032075+0000","last_unstale":"2024-09-19T08:44:31.224039+0000","last_undegraded":"2024-09-19T08:44:31.224039+0000","last_fullsized":"2024-09-19T08:44:31.224039+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:43.701684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212881+0000","last_change":"2024-09-19T08:42:44.037417+0000","last_active":"2024-09-19T08:44:31.212881+0000","last_peered":"2024-09-19T08:44:31.212881+0000","last_clean":"2024-09-19T08:44:31.212881+0000","last_became_active":"2024-09-19T08:42:44.037006+0000","last_became_peered":"2024-09-19T08:42:44.037006+0000","last_unstale":"2024-09-19T08:44:31.212881+0000","last_undegraded":"2024-09-19T08:44:31.212881+0000","last_fullsized":"2024-09-19T08:44:31.212881+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:10.952939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225737+0000","last_change":"2024-09-19T08:42:44.034125+0000","last_active":"2024-09-19T08:44:31.225737+0000","last_peered":"2024-09-19T08:44:31.225737+0000","last_clean":"2024-09-19T08:44:31.225737+0000","last_became_active":"2024-09-19T08:42:44.033772+0000","last_became_peered":"2024-09-19T08:42:44.033772+0000","last_unstale":"2024-09-19T08:44:31.225737+0000","last_undegraded":"2024-09-19T08:44:31.225737+0000","last_fullsized":"2024-09-19T08:44:31.225737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:42.854137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219105+0000","last_change":"2024-09-19T08:42:44.043047+0000","last_active":"2024-09-19T08:44:31.219105+0000","last_peered":"2024-09-19T08:44:31.219105+0000","last_clean":"2024-09-19T08:44:31.219105+0000","last_became_active":"2024-09-19T08:42:44.042666+0000","last_became_peered":"2024-09-19T08:42:44.042666+0000","last_unstale":"2024-09-19T08:44:31.219105+0000","last_undegraded":"2024-09-19T08:44:31.219105+0000","last_fullsized":"2024-09-19T08:44:31.219105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:16.504824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208420+0000","last_change":"2024-09-19T08:42:44.026475+0000","last_active":"2024-09-19T08:44:31.208420+0000","last_peered":"2024-09-19T08:44:31.208420+0000","last_clean":"2024-09-19T08:44:31.208420+0000","last_became_active":"2024-09-19T08:42:44.026169+0000","last_became_peered":"2024-09-19T08:42:44.026169+0000","last_unstale":"2024-09-19T08:44:31.208420+0000","last_undegraded":"2024-09-19T08:44:31.208420+0000","last_fullsized":"2024-09-19T08:44:31.208420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:17.130267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222128+0000","last_change":"2024-09-19T08:42:44.033725+0000","last_active":"2024-09-19T08:44:31.222128+0000","last_peered":"2024-09-19T08:44:31.222128+0000","last_clean":"2024-09-19T08:44:31.222128+0000","last_became_active":"2024-09-19T08:42:44.033304+0000","last_became_peered":"2024-09-19T08:42:44.033304+0000","last_unstale":"2024-09-19T08:44:31.222128+0000","last_undegraded":"2024-09-19T08:44:31.222128+0000","last_fullsized":"2024-09-19T08:44:31.222128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:47.520808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224694+0000","last_change":"2024-09-19T08:42:44.041762+0000","last_active":"2024-09-19T08:44:31.224694+0000","last_peered":"2024-09-19T08:44:31.224694+0000","last_clean":"2024-09-19T08:44:31.224694+0000","last_became_active":"2024-09-19T08:42:44.041433+0000","last_became_peered":"2024-09-19T08:42:44.041433+0000","last_unstale":"2024-09-19T08:44:31.224694+0000","last_undegraded":"2024-09-19T08:44:31.224694+0000","last_fullsized":"2024-09-19T08:44:31.224694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:05.504873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226669+0000","last_change":"2024-09-19T08:42:44.030316+0000","last_active":"2024-09-19T08:44:31.226669+0000","last_peered":"2024-09-19T08:44:31.226669+0000","last_clean":"2024-09-19T08:44:31.226669+0000","last_became_active":"2024-09-19T08:42:44.029872+0000","last_became_peered":"2024-09-19T08:42:44.029872+0000","last_unstale":"2024-09-19T08:44:31.226669+0000","last_undegraded":"2024-09-19T08:44:31.226669+0000","last_fullsized":"2024-09-19T08:44:31.226669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:18.011019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226224+0000","last_change":"2024-09-19T08:42:44.035523+0000","last_active":"2024-09-19T08:44:31.226224+0000","last_peered":"2024-09-19T08:44:31.226224+0000","last_clean":"2024-09-19T08:44:31.226224+0000","last_became_active":"2024-09-19T08:42:44.035185+0000","last_became_peered":"2024-09-19T08:42:44.035185+0000","last_unstale":"2024-09-19T08:44:31.226224+0000","last_undegraded":"2024-09-19T08:44:31.226224+0000","last_fullsized":"2024-09-19T08:44:31.226224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:03.475458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222791+0000","last_change":"2024-09-19T08:42:44.031803+0000","last_active":"2024-09-19T08:44:31.222791+0000","last_peered":"2024-09-19T08:44:31.222791+0000","last_clean":"2024-09-19T08:44:31.222791+0000","last_became_active":"2024-09-19T08:42:44.031501+0000","last_became_peered":"2024-09-19T08:42:44.031501+0000","last_unstale":"2024-09-19T08:44:31.222791+0000","last_undegraded":"2024-09-19T08:44:31.222791+0000","last_fullsized":"2024-09-19T08:44:31.222791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:31.780744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.211603+0000","last_change":"2024-09-19T08:42:44.036168+0000","last_active":"2024-09-19T08:44:31.211603+0000","last_peered":"2024-09-19T08:44:31.211603+0000","last_clean":"2024-09-19T08:44:31.211603+0000","last_became_active":"2024-09-19T08:42:44.035819+0000","last_became_peered":"2024-09-19T08:42:44.035819+0000","last_unstale":"2024-09-19T08:44:31.211603+0000","last_undegraded":"2024-09-19T08:44:31.211603+0000","last_fullsized":"2024-09-19T08:44:31.211603+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:26.478389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.220605+0000","last_change":"2024-09-19T08:42:44.037569+0000","last_active":"2024-09-19T08:44:31.220605+0000","last_peered":"2024-09-19T08:44:31.220605+0000","last_clean":"2024-09-19T08:44:31.220605+0000","last_became_active":"2024-09-19T08:42:44.037161+0000","last_became_peered":"2024-09-19T08:42:44.037161+0000","last_unstale":"2024-09-19T08:44:31.220605+0000","last_undegraded":"2024-09-19T08:44:31.220605+0000","last_fullsized":"2024-09-19T08:44:31.220605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:35.316314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226011+0000","last_change":"2024-09-19T08:42:44.023160+0000","last_active":"2024-09-19T08:44:31.226011+0000","last_peered":"2024-09-19T08:44:31.226011+0000","last_clean":"2024-09-19T08:44:31.226011+0000","last_became_active":"2024-09-19T08:42:44.022791+0000","last_became_peered":"2024-09-19T08:42:44.022791+0000","last_unstale":"2024-09-19T08:44:31.226011+0000","last_undegraded":"2024-09-19T08:44:31.226011+0000","last_fullsized":"2024-09-19T08:44:31.226011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:00.174583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225075+0000","last_change":"2024-09-19T08:42:44.035877+0000","last_active":"2024-09-19T08:44:31.225075+0000","last_peered":"2024-09-19T08:44:31.225075+0000","last_clean":"2024-09-19T08:44:31.225075+0000","last_became_active":"2024-09-19T08:42:44.035307+0000","last_became_peered":"2024-09-19T08:42:44.035307+0000","last_unstale":"2024-09-19T08:44:31.225075+0000","last_undegraded":"2024-09-19T08:44:31.225075+0000","last_fullsized":"2024-09-19T08:44:31.225075+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:54.717130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219964+0000","last_change":"2024-09-19T08:42:44.033536+0000","last_active":"2024-09-19T08:44:31.219964+0000","last_peered":"2024-09-19T08:44:31.219964+0000","last_clean":"2024-09-19T08:44:31.219964+0000","last_became_active":"2024-09-19T08:42:44.033179+0000","last_became_peered":"2024-09-19T08:42:44.033179+0000","last_unstale":"2024-09-19T08:44:31.219964+0000","last_undegraded":"2024-09-19T08:44:31.219964+0000","last_fullsized":"2024-09-19T08:44:31.219964+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:11.161785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.210217+0000","last_change":"2024-09-19T08:42:44.029674+0000","last_active":"2024-09-19T08:44:31.210217+0000","last_peered":"2024-09-19T08:44:31.210217+0000","last_clean":"2024-09-19T08:44:31.210217+0000","last_became_active":"2024-09-19T08:42:44.029368+0000","last_became_peered":"2024-09-19T08:42:44.029368+0000","last_unstale":"2024-09-19T08:44:31.210217+0000","last_undegraded":"2024-09-19T08:44:31.210217+0000","last_fullsized":"2024-09-19T08:44:31.210217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:34.943363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.213448+0000","last_change":"2024-09-19T08:42:44.039780+0000","last_active":"2024-09-19T08:44:31.213448+0000","last_peered":"2024-09-19T08:44:31.213448+0000","last_clean":"2024-09-19T08:44:31.213448+0000","last_became_active":"2024-09-19T08:42:44.039409+0000","last_became_peered":"2024-09-19T08:42:44.039409+0000","last_unstale":"2024-09-19T08:44:31.213448+0000","last_undegraded":"2024-09-19T08:44:31.213448+0000","last_fullsized":"2024-09-19T08:44:31.213448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:59.632132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.214979+0000","last_change":"2024-09-19T08:42:44.030881+0000","last_active":"2024-09-19T08:44:31.214979+0000","last_peered":"2024-09-19T08:44:31.214979+0000","last_clean":"2024-09-19T08:44:31.214979+0000","last_became_active":"2024-09-19T08:42:44.030530+0000","last_became_peered":"2024-09-19T08:42:44.030530+0000","last_unstale":"2024-09-19T08:44:31.214979+0000","last_undegraded":"2024-09-19T08:44:31.214979+0000","last_fullsized":"2024-09-19T08:44:31.214979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:16.908450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.214928+0000","last_change":"2024-09-19T08:42:44.033056+0000","last_active":"2024-09-19T08:44:31.214928+0000","last_peered":"2024-09-19T08:44:31.214928+0000","last_clean":"2024-09-19T08:44:31.214928+0000","last_became_active":"2024-09-19T08:42:44.032690+0000","last_became_peered":"2024-09-19T08:42:44.032690+0000","last_unstale":"2024-09-19T08:44:31.214928+0000","last_undegraded":"2024-09-19T08:44:31.214928+0000","last_fullsized":"2024-09-19T08:44:31.214928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:36.497824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225043+0000","last_change":"2024-09-19T08:42:58.106551+0000","last_active":"2024-09-19T08:44:31.225043+0000","last_peered":"2024-09-19T08:44:31.225043+0000","last_clean":"2024-09-19T08:44:31.225043+0000","last_became_active":"2024-09-19T08:42:58.106119+0000","last_became_peered":"2024-09-19T08:42:58.106119+0000","last_unstale":"2024-09-19T08:44:31.225043+0000","last_undegraded":"2024-09-19T08:44:31.225043+0000","last_fullsized":"2024-09-19T08:44:31.225043+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:46.794260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226527+0000","last_change":"2024-09-19T08:42:58.108106+0000","last_active":"2024-09-19T08:44:31.226527+0000","last_peered":"2024-09-19T08:44:31.226527+0000","last_clean":"2024-09-19T08:44:31.226527+0000","last_became_active":"2024-09-19T08:42:58.107532+0000","last_became_peered":"2024-09-19T08:42:58.107532+0000","last_unstale":"2024-09-19T08:44:31.226527+0000","last_undegraded":"2024-09-19T08:44:31.226527+0000","last_fullsized":"2024-09-19T08:44:31.226527+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:29.164983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224871+0000","last_change":"2024-09-19T08:42:44.029822+0000","last_active":"2024-09-19T08:44:31.224871+0000","last_peered":"2024-09-19T08:44:31.224871+0000","last_clean":"2024-09-19T08:44:31.224871+0000","last_became_active":"2024-09-19T08:42:44.029450+0000","last_became_peered":"2024-09-19T08:42:44.029450+0000","last_unstale":"2024-09-19T08:44:31.224871+0000","last_undegraded":"2024-09-19T08:44:31.224871+0000","last_fullsized":"2024-09-19T08:44:31.224871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:40.826261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.210860+0000","last_change":"2024-09-19T08:42:44.041354+0000","last_active":"2024-09-19T08:44:31.210860+0000","last_peered":"2024-09-19T08:44:31.210860+0000","last_clean":"2024-09-19T08:44:31.210860+0000","last_became_active":"2024-09-19T08:42:44.040912+0000","last_became_peered":"2024-09-19T08:42:44.040912+0000","last_unstale":"2024-09-19T08:44:31.210860+0000","last_undegraded":"2024-09-19T08:44:31.210860+0000","last_fullsized":"2024-09-19T08:44:31.210860+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:16.543950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.217246+0000","last_change":"2024-09-19T08:42:44.027912+0000","last_active":"2024-09-19T08:44:31.217246+0000","last_peered":"2024-09-19T08:44:31.217246+0000","last_clean":"2024-09-19T08:44:31.217246+0000","last_became_active":"2024-09-19T08:42:44.027505+0000","last_became_peered":"2024-09-19T08:42:44.027505+0000","last_unstale":"2024-09-19T08:44:31.217246+0000","last_undegraded":"2024-09-19T08:44:31.217246+0000","last_fullsized":"2024-09-19T08:44:31.217246+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:02.552756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208688+0000","last_change":"2024-09-19T08:42:44.034472+0000","last_active":"2024-09-19T08:44:31.208688+0000","last_peered":"2024-09-19T08:44:31.208688+0000","last_clean":"2024-09-19T08:44:31.208688+0000","last_became_active":"2024-09-19T08:42:44.034026+0000","last_became_peered":"2024-09-19T08:42:44.034026+0000","last_unstale":"2024-09-19T08:44:31.208688+0000","last_undegraded":"2024-09-19T08:44:31.208688+0000","last_fullsized":"2024-09-19T08:44:31.208688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:10.058882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'10","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.481139+0000","last_change":"2024-09-19T08:42:41.927174+0000","last_active":"2024-09-19T08:44:31.481139+0000","last_peered":"2024-09-19T08:44:31.481139+0000","last_clean":"2024-09-19T08:44:31.481139+0000","last_became_active":"2024-09-19T08:42:41.926826+0000","last_became_peered":"2024-09-19T08:42:41.926826+0000","last_unstale":"2024-09-19T08:44:31.481139+0000","last_undegraded":"2024-09-19T08:44:31.481139+0000","last_fullsized":"2024-09-19T08:44:31.481139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:37.274891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2250,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":5,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.210827+0000","last_change":"2024-09-19T08:42:58.110259+0000","last_active":"2024-09-19T08:44:31.210827+0000","last_peered":"2024-09-19T08:44:31.210827+0000","last_clean":"2024-09-19T08:44:31.210827+0000","last_became_active":"2024-09-19T08:42:58.109803+0000","last_became_peered":"2024-09-19T08:42:58.109803+0000","last_unstale":"2024-09-19T08:44:31.210827+0000","last_undegraded":"2024-09-19T08:44:31.210827+0000","last_fullsized":"2024-09-19T08:44:31.210827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:31.853404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177196+0000","last_change":"2024-09-19T08:42:58.114222+0000","last_active":"2024-09-19T08:44:31.177196+0000","last_peered":"2024-09-19T08:44:31.177196+0000","last_clean":"2024-09-19T08:44:31.177196+0000","last_became_active":"2024-09-19T08:42:58.110769+0000","last_became_peered":"2024-09-19T08:42:58.110769+0000","last_unstale":"2024-09-19T08:44:31.177196+0000","last_undegraded":"2024-09-19T08:44:31.177196+0000","last_fullsized":"2024-09-19T08:44:31.177196+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:17.952228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.176271+0000","last_change":"2024-09-19T08:42:41.923903+0000","last_active":"2024-09-19T08:44:31.176271+0000","last_peered":"2024-09-19T08:44:31.176271+0000","last_clean":"2024-09-19T08:44:31.176271+0000","last_became_active":"2024-09-19T08:42:41.923583+0000","last_became_peered":"2024-09-19T08:42:41.923583+0000","last_unstale":"2024-09-19T08:44:31.176271+0000","last_undegraded":"2024-09-19T08:44:31.176271+0000","last_fullsized":"2024-09-19T08:44:31.176271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:48.594343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219641+0000","last_change":"2024-09-19T08:42:44.028972+0000","last_active":"2024-09-19T08:44:31.219641+0000","last_peered":"2024-09-19T08:44:31.219641+0000","last_clean":"2024-09-19T08:44:31.219641+0000","last_became_active":"2024-09-19T08:42:44.028657+0000","last_became_peered":"2024-09-19T08:42:44.028657+0000","last_unstale":"2024-09-19T08:44:31.219641+0000","last_undegraded":"2024-09-19T08:44:31.219641+0000","last_fullsized":"2024-09-19T08:44:31.219641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:43.618010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178701+0000","last_change":"2024-09-19T08:42:41.926558+0000","last_active":"2024-09-19T08:44:31.178701+0000","last_peered":"2024-09-19T08:44:31.178701+0000","last_clean":"2024-09-19T08:44:31.178701+0000","last_became_active":"2024-09-19T08:42:41.926074+0000","last_became_peered":"2024-09-19T08:42:41.926074+0000","last_unstale":"2024-09-19T08:44:31.178701+0000","last_undegraded":"2024-09-19T08:44:31.178701+0000","last_fullsized":"2024-09-19T08:44:31.178701+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:47.563295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.223532+0000","last_change":"2024-09-19T08:42:44.029191+0000","last_active":"2024-09-19T08:44:31.223532+0000","last_peered":"2024-09-19T08:44:31.223532+0000","last_clean":"2024-09-19T08:44:31.223532+0000","last_became_active":"2024-09-19T08:42:44.028871+0000","last_became_peered":"2024-09-19T08:42:44.028871+0000","last_unstale":"2024-09-19T08:44:31.223532+0000","last_undegraded":"2024-09-19T08:44:31.223532+0000","last_fullsized":"2024-09-19T08:44:31.223532+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:41.262014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":126,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177656+0000","last_change":"2024-09-19T08:42:41.930265+0000","last_active":"2024-09-19T08:44:31.177656+0000","last_peered":"2024-09-19T08:44:31.177656+0000","last_clean":"2024-09-19T08:44:31.177656+0000","last_became_active":"2024-09-19T08:42:41.929829+0000","last_became_peered":"2024-09-19T08:42:41.929829+0000","last_unstale":"2024-09-19T08:44:31.177656+0000","last_undegraded":"2024-09-19T08:44:31.177656+0000","last_fullsized":"2024-09-19T08:44:31.177656+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:59.181622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224033+0000","last_change":"2024-09-19T08:42:44.027382+0000","last_active":"2024-09-19T08:44:31.224033+0000","last_peered":"2024-09-19T08:44:31.224033+0000","last_clean":"2024-09-19T08:44:31.224033+0000","last_became_active":"2024-09-19T08:42:44.026824+0000","last_became_peered":"2024-09-19T08:42:44.026824+0000","last_unstale":"2024-09-19T08:44:31.224033+0000","last_undegraded":"2024-09-19T08:44:31.224033+0000","last_fullsized":"2024-09-19T08:44:31.224033+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:58.520068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.180283+0000","last_change":"2024-09-19T08:42:41.927914+0000","last_active":"2024-09-19T08:44:31.180283+0000","last_peered":"2024-09-19T08:44:31.180283+0000","last_clean":"2024-09-19T08:44:31.180283+0000","last_became_active":"2024-09-19T08:42:41.926566+0000","last_became_peered":"2024-09-19T08:42:41.926566+0000","last_unstale":"2024-09-19T08:44:31.180283+0000","last_undegraded":"2024-09-19T08:44:31.180283+0000","last_fullsized":"2024-09-19T08:44:31.180283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:52.238352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224677+0000","last_change":"2024-09-19T08:42:44.039899+0000","last_active":"2024-09-19T08:44:31.224677+0000","last_peered":"2024-09-19T08:44:31.224677+0000","last_clean":"2024-09-19T08:44:31.224677+0000","last_became_active":"2024-09-19T08:42:44.039530+0000","last_became_peered":"2024-09-19T08:42:44.039530+0000","last_unstale":"2024-09-19T08:44:31.224677+0000","last_undegraded":"2024-09-19T08:44:31.224677+0000","last_fullsized":"2024-09-19T08:44:31.224677+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:20.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178662+0000","last_change":"2024-09-19T08:42:42.410128+0000","last_active":"2024-09-19T08:44:31.178662+0000","last_peered":"2024-09-19T08:44:31.178662+0000","last_clean":"2024-09-19T08:44:31.178662+0000","last_became_active":"2024-09-19T08:42:42.409717+0000","last_became_peered":"2024-09-19T08:42:42.409717+0000","last_unstale":"2024-09-19T08:44:31.178662+0000","last_undegraded":"2024-09-19T08:44:31.178662+0000","last_fullsized":"2024-09-19T08:44:31.178662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:41.682355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225965+0000","last_change":"2024-09-19T08:42:44.043248+0000","last_active":"2024-09-19T08:44:31.225965+0000","last_peered":"2024-09-19T08:44:31.225965+0000","last_clean":"2024-09-19T08:44:31.225965+0000","last_became_active":"2024-09-19T08:42:44.042849+0000","last_became_peered":"2024-09-19T08:42:44.042849+0000","last_unstale":"2024-09-19T08:44:31.225965+0000","last_undegraded":"2024-09-19T08:44:31.225965+0000","last_fullsized":"2024-09-19T08:44:31.225965+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:00.413217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'34","reported_seq":265,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.485244+0000","last_change":"2024-09-19T08:42:41.926582+0000","last_active":"2024-09-19T08:44:31.485244+0000","last_peered":"2024-09-19T08:44:31.485244+0000","last_clean":"2024-09-19T08:44:31.485244+0000","last_became_active":"2024-09-19T08:42:41.926234+0000","last_became_peered":"2024-09-19T08:42:41.926234+0000","last_unstale":"2024-09-19T08:44:31.485244+0000","last_undegraded":"2024-09-19T08:44:31.485244+0000","last_fullsized":"2024-09-19T08:44:31.485244+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:02.498976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":167,"num_write":35,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.199159+0000","last_change":"2024-09-19T08:42:44.034888+0000","last_active":"2024-09-19T08:44:31.199159+0000","last_peered":"2024-09-19T08:44:31.199159+0000","last_clean":"2024-09-19T08:44:31.199159+0000","last_became_active":"2024-09-19T08:42:44.034553+0000","last_became_peered":"2024-09-19T08:42:44.034553+0000","last_unstale":"2024-09-19T08:44:31.199159+0000","last_undegraded":"2024-09-19T08:44:31.199159+0000","last_fullsized":"2024-09-19T08:44:31.199159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:06.416289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.181995+0000","last_change":"2024-09-19T08:42:58.117912+0000","last_active":"2024-09-19T08:44:31.181995+0000","last_peered":"2024-09-19T08:44:31.181995+0000","last_clean":"2024-09-19T08:44:31.181995+0000","last_became_active":"2024-09-19T08:42:58.105810+0000","last_became_peered":"2024-09-19T08:42:58.105810+0000","last_unstale":"2024-09-19T08:44:31.181995+0000","last_undegraded":"2024-09-19T08:44:31.181995+0000","last_fullsized":"2024-09-19T08:44:31.181995+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:44.258256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.213617+0000","last_change":"2024-09-19T08:42:44.030519+0000","last_active":"2024-09-19T08:44:31.213617+0000","last_peered":"2024-09-19T08:44:31.213617+0000","last_clean":"2024-09-19T08:44:31.213617+0000","last_became_active":"2024-09-19T08:42:44.030190+0000","last_became_peered":"2024-09-19T08:42:44.030190+0000","last_unstale":"2024-09-19T08:44:31.213617+0000","last_undegraded":"2024-09-19T08:44:31.213617+0000","last_fullsized":"2024-09-19T08:44:31.213617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:20.220642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178349+0000","last_change":"2024-09-19T08:42:41.928124+0000","last_active":"2024-09-19T08:44:31.178349+0000","last_peered":"2024-09-19T08:44:31.178349+0000","last_clean":"2024-09-19T08:44:31.178349+0000","last_became_active":"2024-09-19T08:42:41.927761+0000","last_became_peered":"2024-09-19T08:42:41.927761+0000","last_unstale":"2024-09-19T08:44:31.178349+0000","last_undegraded":"2024-09-19T08:44:31.178349+0000","last_fullsized":"2024-09-19T08:44:31.178349+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:08.591270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.218267+0000","last_change":"2024-09-19T08:42:44.038234+0000","last_active":"2024-09-19T08:44:31.218267+0000","last_peered":"2024-09-19T08:44:31.218267+0000","last_clean":"2024-09-19T08:44:31.218267+0000","last_became_active":"2024-09-19T08:42:44.037726+0000","last_became_peered":"2024-09-19T08:42:44.037726+0000","last_unstale":"2024-09-19T08:44:31.218267+0000","last_undegraded":"2024-09-19T08:44:31.218267+0000","last_fullsized":"2024-09-19T08:44:31.218267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:08.865482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.239723+0000","last_change":"2024-09-19T08:42:41.926206+0000","last_active":"2024-09-19T08:44:31.239723+0000","last_peered":"2024-09-19T08:44:31.239723+0000","last_clean":"2024-09-19T08:44:31.239723+0000","last_became_active":"2024-09-19T08:42:41.925833+0000","last_became_peered":"2024-09-19T08:42:41.925833+0000","last_unstale":"2024-09-19T08:44:31.239723+0000","last_undegraded":"2024-09-19T08:44:31.239723+0000","last_fullsized":"2024-09-19T08:44:31.239723+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:27.944240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":5,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208340+0000","last_change":"2024-09-19T08:42:44.037181+0000","last_active":"2024-09-19T08:44:31.208340+0000","last_peered":"2024-09-19T08:44:31.208340+0000","last_clean":"2024-09-19T08:44:31.208340+0000","last_became_active":"2024-09-19T08:42:44.036865+0000","last_became_peered":"2024-09-19T08:42:44.036865+0000","last_unstale":"2024-09-19T08:44:31.208340+0000","last_undegraded":"2024-09-19T08:44:31.208340+0000","last_fullsized":"2024-09-19T08:44:31.208340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:20.233309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.169922+0000","last_change":"2024-09-19T08:42:42.408446+0000","last_active":"2024-09-19T08:44:31.169922+0000","last_peered":"2024-09-19T08:44:31.169922+0000","last_clean":"2024-09-19T08:44:31.169922+0000","last_became_active":"2024-09-19T08:42:42.408098+0000","last_became_peered":"2024-09-19T08:42:42.408098+0000","last_unstale":"2024-09-19T08:44:31.169922+0000","last_undegraded":"2024-09-19T08:44:31.169922+0000","last_fullsized":"2024-09-19T08:44:31.169922+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:22.603604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225407+0000","last_change":"2024-09-19T08:42:44.039954+0000","last_active":"2024-09-19T08:44:31.225407+0000","last_peered":"2024-09-19T08:44:31.225407+0000","last_clean":"2024-09-19T08:44:31.225407+0000","last_became_active":"2024-09-19T08:42:44.039601+0000","last_became_peered":"2024-09-19T08:42:44.039601+0000","last_unstale":"2024-09-19T08:44:31.225407+0000","last_undegraded":"2024-09-19T08:44:31.225407+0000","last_fullsized":"2024-09-19T08:44:31.225407+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:07.792167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'3","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170390+0000","last_change":"2024-09-19T08:42:41.929644+0000","last_active":"2024-09-19T08:44:31.170390+0000","last_peered":"2024-09-19T08:44:31.170390+0000","last_clean":"2024-09-19T08:44:31.170390+0000","last_became_active":"2024-09-19T08:42:41.929308+0000","last_became_peered":"2024-09-19T08:42:41.929308+0000","last_unstale":"2024-09-19T08:44:31.170390+0000","last_undegraded":"2024-09-19T08:44:31.170390+0000","last_fullsized":"2024-09-19T08:44:31.170390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:36.660470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222570+0000","last_change":"2024-09-19T08:42:58.107555+0000","last_active":"2024-09-19T08:44:31.222570+0000","last_peered":"2024-09-19T08:44:31.222570+0000","last_clean":"2024-09-19T08:44:31.222570+0000","last_became_active":"2024-09-19T08:42:58.107137+0000","last_became_peered":"2024-09-19T08:42:58.107137+0000","last_unstale":"2024-09-19T08:44:31.222570+0000","last_undegraded":"2024-09-19T08:44:31.222570+0000","last_fullsized":"2024-09-19T08:44:31.222570+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:13.198911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.176594+0000","last_change":"2024-09-19T08:42:41.925195+0000","last_active":"2024-09-19T08:44:31.176594+0000","last_peered":"2024-09-19T08:44:31.176594+0000","last_clean":"2024-09-19T08:44:31.176594+0000","last_became_active":"2024-09-19T08:42:41.924880+0000","last_became_peered":"2024-09-19T08:42:41.924880+0000","last_unstale":"2024-09-19T08:44:31.176594+0000","last_undegraded":"2024-09-19T08:44:31.176594+0000","last_fullsized":"2024-09-19T08:44:31.176594+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:11.256881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219778+0000","last_change":"2024-09-19T08:42:44.036439+0000","last_active":"2024-09-19T08:44:31.219778+0000","last_peered":"2024-09-19T08:44:31.219778+0000","last_clean":"2024-09-19T08:44:31.219778+0000","last_became_active":"2024-09-19T08:42:44.036036+0000","last_became_peered":"2024-09-19T08:42:44.036036+0000","last_unstale":"2024-09-19T08:44:31.219778+0000","last_undegraded":"2024-09-19T08:44:31.219778+0000","last_fullsized":"2024-09-19T08:44:31.219778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:37.410782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'39","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.411820+0000","last_change":"2024-09-19T08:42:41.927490+0000","last_active":"2024-09-19T08:44:31.411820+0000","last_peered":"2024-09-19T08:44:31.411820+0000","last_clean":"2024-09-19T08:44:31.411820+0000","last_became_active":"2024-09-19T08:42:41.927163+0000","last_became_peered":"2024-09-19T08:42:41.927163+0000","last_unstale":"2024-09-19T08:44:31.411820+0000","last_undegraded":"2024-09-19T08:44:31.411820+0000","last_fullsized":"2024-09-19T08:44:31.411820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:20.013661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208966+0000","last_change":"2024-09-19T08:42:44.036960+0000","last_active":"2024-09-19T08:44:31.208966+0000","last_peered":"2024-09-19T08:44:31.208966+0000","last_clean":"2024-09-19T08:44:31.208966+0000","last_became_active":"2024-09-19T08:42:44.036600+0000","last_became_peered":"2024-09-19T08:42:44.036600+0000","last_unstale":"2024-09-19T08:44:31.208966+0000","last_undegraded":"2024-09-19T08:44:31.208966+0000","last_fullsized":"2024-09-19T08:44:31.208966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:15.621888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177396+0000","last_change":"2024-09-19T08:42:58.114698+0000","last_active":"2024-09-19T08:44:31.177396+0000","last_peered":"2024-09-19T08:44:31.177396+0000","last_clean":"2024-09-19T08:44:31.177396+0000","last_became_active":"2024-09-19T08:42:58.105488+0000","last_became_peered":"2024-09-19T08:42:58.105488+0000","last_unstale":"2024-09-19T08:44:31.177396+0000","last_undegraded":"2024-09-19T08:44:31.177396+0000","last_fullsized":"2024-09-19T08:44:31.177396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:12.642715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225878+0000","last_change":"2024-09-19T08:42:44.035569+0000","last_active":"2024-09-19T08:44:31.225878+0000","last_peered":"2024-09-19T08:44:31.225878+0000","last_clean":"2024-09-19T08:44:31.225878+0000","last_became_active":"2024-09-19T08:42:44.035277+0000","last_became_peered":"2024-09-19T08:42:44.035277+0000","last_unstale":"2024-09-19T08:44:31.225878+0000","last_undegraded":"2024-09-19T08:44:31.225878+0000","last_fullsized":"2024-09-19T08:44:31.225878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:57.472721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":348,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.179827+0000","last_change":"2024-09-19T08:41:34.769047+0000","last_active":"2024-09-19T08:44:31.179827+0000","last_peered":"2024-09-19T08:44:31.179827+0000","last_clean":"2024-09-19T08:44:31.179827+0000","last_became_active":"2024-09-19T08:41:34.768619+0000","last_became_peered":"2024-09-19T08:41:34.768619+0000","last_unstale":"2024-09-19T08:44:31.179827+0000","last_undegraded":"2024-09-19T08:44:31.179827+0000","last_fullsized":"2024-09-19T08:44:31.179827+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:13.482855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:13.482855+0000","last_clean_scrub_stamp":"2024-09-19T08:38:13.482855+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.390775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177359+0000","last_change":"2024-09-19T08:42:41.925698+0000","last_active":"2024-09-19T08:44:31.177359+0000","last_peered":"2024-09-19T08:44:31.177359+0000","last_clean":"2024-09-19T08:44:31.177359+0000","last_became_active":"2024-09-19T08:42:41.924618+0000","last_became_peered":"2024-09-19T08:42:41.924618+0000","last_unstale":"2024-09-19T08:44:31.177359+0000","last_undegraded":"2024-09-19T08:44:31.177359+0000","last_fullsized":"2024-09-19T08:44:31.177359+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:53.717139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222668+0000","last_change":"2024-09-19T08:42:58.111206+0000","last_active":"2024-09-19T08:44:31.222668+0000","last_peered":"2024-09-19T08:44:31.222668+0000","last_clean":"2024-09-19T08:44:31.222668+0000","last_became_active":"2024-09-19T08:42:58.110765+0000","last_became_peered":"2024-09-19T08:42:58.110765+0000","last_unstale":"2024-09-19T08:44:31.222668+0000","last_undegraded":"2024-09-19T08:44:31.222668+0000","last_fullsized":"2024-09-19T08:44:31.222668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:44.783938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.179827+0000","last_change":"2024-09-19T08:42:41.928414+0000","last_active":"2024-09-19T08:44:31.179827+0000","last_peered":"2024-09-19T08:44:31.179827+0000","last_clean":"2024-09-19T08:44:31.179827+0000","last_became_active":"2024-09-19T08:42:41.928055+0000","last_became_peered":"2024-09-19T08:42:41.928055+0000","last_unstale":"2024-09-19T08:44:31.179827+0000","last_undegraded":"2024-09-19T08:44:31.179827+0000","last_fullsized":"2024-09-19T08:44:31.179827+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:12.688379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.197630+0000","last_change":"2024-09-19T08:42:44.035439+0000","last_active":"2024-09-19T08:44:31.197630+0000","last_peered":"2024-09-19T08:44:31.197630+0000","last_clean":"2024-09-19T08:44:31.197630+0000","last_became_active":"2024-09-19T08:42:44.035150+0000","last_became_peered":"2024-09-19T08:42:44.035150+0000","last_unstale":"2024-09-19T08:44:31.197630+0000","last_undegraded":"2024-09-19T08:44:31.197630+0000","last_fullsized":"2024-09-19T08:44:31.197630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:15.230660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":127,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177891+0000","last_change":"2024-09-19T08:42:42.407784+0000","last_active":"2024-09-19T08:44:31.177891+0000","last_peered":"2024-09-19T08:44:31.177891+0000","last_clean":"2024-09-19T08:44:31.177891+0000","last_became_active":"2024-09-19T08:42:42.407437+0000","last_became_peered":"2024-09-19T08:42:42.407437+0000","last_unstale":"2024-09-19T08:44:31.177891+0000","last_undegraded":"2024-09-19T08:44:31.177891+0000","last_fullsized":"2024-09-19T08:44:31.177891+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:44.829338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212600+0000","last_change":"2024-09-19T08:42:44.039780+0000","last_active":"2024-09-19T08:44:31.212600+0000","last_peered":"2024-09-19T08:44:31.212600+0000","last_clean":"2024-09-19T08:44:31.212600+0000","last_became_active":"2024-09-19T08:42:44.039441+0000","last_became_peered":"2024-09-19T08:42:44.039441+0000","last_unstale":"2024-09-19T08:44:31.212600+0000","last_undegraded":"2024-09-19T08:44:31.212600+0000","last_fullsized":"2024-09-19T08:44:31.212600+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:31.013663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.180830+0000","last_change":"2024-09-19T08:42:41.926998+0000","last_active":"2024-09-19T08:44:31.180830+0000","last_peered":"2024-09-19T08:44:31.180830+0000","last_clean":"2024-09-19T08:44:31.180830+0000","last_became_active":"2024-09-19T08:42:41.926560+0000","last_became_peered":"2024-09-19T08:42:41.926560+0000","last_unstale":"2024-09-19T08:44:31.180830+0000","last_undegraded":"2024-09-19T08:44:31.180830+0000","last_fullsized":"2024-09-19T08:44:31.180830+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:35.338601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225659+0000","last_change":"2024-09-19T08:42:44.039948+0000","last_active":"2024-09-19T08:44:31.225659+0000","last_peered":"2024-09-19T08:44:31.225659+0000","last_clean":"2024-09-19T08:44:31.225659+0000","last_became_active":"2024-09-19T08:42:44.038797+0000","last_became_peered":"2024-09-19T08:42:44.038797+0000","last_unstale":"2024-09-19T08:44:31.225659+0000","last_undegraded":"2024-09-19T08:44:31.225659+0000","last_fullsized":"2024-09-19T08:44:31.225659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:19.273191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.168583+0000","last_change":"2024-09-19T08:42:42.409954+0000","last_active":"2024-09-19T08:44:31.168583+0000","last_peered":"2024-09-19T08:44:31.168583+0000","last_clean":"2024-09-19T08:44:31.168583+0000","last_became_active":"2024-09-19T08:42:42.409388+0000","last_became_peered":"2024-09-19T08:42:42.409388+0000","last_unstale":"2024-09-19T08:44:31.168583+0000","last_undegraded":"2024-09-19T08:44:31.168583+0000","last_fullsized":"2024-09-19T08:44:31.168583+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:58.764877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.213210+0000","last_change":"2024-09-19T08:42:44.024360+0000","last_active":"2024-09-19T08:44:31.213210+0000","last_peered":"2024-09-19T08:44:31.213210+0000","last_clean":"2024-09-19T08:44:31.213210+0000","last_became_active":"2024-09-19T08:42:44.023703+0000","last_became_peered":"2024-09-19T08:42:44.023703+0000","last_unstale":"2024-09-19T08:44:31.213210+0000","last_undegraded":"2024-09-19T08:44:31.213210+0000","last_fullsized":"2024-09-19T08:44:31.213210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:10.852199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170383+0000","last_change":"2024-09-19T08:42:42.408101+0000","last_active":"2024-09-19T08:44:31.170383+0000","last_peered":"2024-09-19T08:44:31.170383+0000","last_clean":"2024-09-19T08:44:31.170383+0000","last_became_active":"2024-09-19T08:42:42.407692+0000","last_became_peered":"2024-09-19T08:42:42.407692+0000","last_unstale":"2024-09-19T08:44:31.170383+0000","last_undegraded":"2024-09-19T08:44:31.170383+0000","last_fullsized":"2024-09-19T08:44:31.170383+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:01.342213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.217468+0000","last_change":"2024-09-19T08:42:44.026612+0000","last_active":"2024-09-19T08:44:31.217468+0000","last_peered":"2024-09-19T08:44:31.217468+0000","last_clean":"2024-09-19T08:44:31.217468+0000","last_became_active":"2024-09-19T08:42:44.025408+0000","last_became_peered":"2024-09-19T08:42:44.025408+0000","last_unstale":"2024-09-19T08:44:31.217468+0000","last_undegraded":"2024-09-19T08:44:31.217468+0000","last_fullsized":"2024-09-19T08:44:31.217468+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:19.465342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'46","reported_seq":93,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.419159+0000","last_change":"2024-09-19T08:42:41.927561+0000","last_active":"2024-09-19T08:44:31.419159+0000","last_peered":"2024-09-19T08:44:31.419159+0000","last_clean":"2024-09-19T08:44:31.419159+0000","last_became_active":"2024-09-19T08:42:41.927159+0000","last_became_peered":"2024-09-19T08:42:41.927159+0000","last_unstale":"2024-09-19T08:44:31.419159+0000","last_undegraded":"2024-09-19T08:44:31.419159+0000","last_fullsized":"2024-09-19T08:44:31.419159+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:13.352727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":83,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.220812+0000","last_change":"2024-09-19T08:42:44.028129+0000","last_active":"2024-09-19T08:44:31.220812+0000","last_peered":"2024-09-19T08:44:31.220812+0000","last_clean":"2024-09-19T08:44:31.220812+0000","last_became_active":"2024-09-19T08:42:44.027826+0000","last_became_peered":"2024-09-19T08:42:44.027826+0000","last_unstale":"2024-09-19T08:44:31.220812+0000","last_undegraded":"2024-09-19T08:44:31.220812+0000","last_fullsized":"2024-09-19T08:44:31.220812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:03.129404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177705+0000","last_change":"2024-09-19T08:42:41.920264+0000","last_active":"2024-09-19T08:44:31.177705+0000","last_peered":"2024-09-19T08:44:31.177705+0000","last_clean":"2024-09-19T08:44:31.177705+0000","last_became_active":"2024-09-19T08:42:41.919655+0000","last_became_peered":"2024-09-19T08:42:41.919655+0000","last_unstale":"2024-09-19T08:44:31.177705+0000","last_undegraded":"2024-09-19T08:44:31.177705+0000","last_fullsized":"2024-09-19T08:44:31.177705+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:58.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226014+0000","last_change":"2024-09-19T08:42:44.039655+0000","last_active":"2024-09-19T08:44:31.226014+0000","last_peered":"2024-09-19T08:44:31.226014+0000","last_clean":"2024-09-19T08:44:31.226014+0000","last_became_active":"2024-09-19T08:42:44.039317+0000","last_became_peered":"2024-09-19T08:42:44.039317+0000","last_unstale":"2024-09-19T08:44:31.226014+0000","last_undegraded":"2024-09-19T08:44:31.226014+0000","last_fullsized":"2024-09-19T08:44:31.226014+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:19.064194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.169944+0000","last_change":"2024-09-19T08:42:42.408582+0000","last_active":"2024-09-19T08:44:31.169944+0000","last_peered":"2024-09-19T08:44:31.169944+0000","last_clean":"2024-09-19T08:44:31.169944+0000","last_became_active":"2024-09-19T08:42:42.408143+0000","last_became_peered":"2024-09-19T08:42:42.408143+0000","last_unstale":"2024-09-19T08:44:31.169944+0000","last_undegraded":"2024-09-19T08:44:31.169944+0000","last_fullsized":"2024-09-19T08:44:31.169944+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.526138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.195758+0000","last_change":"2024-09-19T08:42:44.034795+0000","last_active":"2024-09-19T08:44:31.195758+0000","last_peered":"2024-09-19T08:44:31.195758+0000","last_clean":"2024-09-19T08:44:31.195758+0000","last_became_active":"2024-09-19T08:42:44.034440+0000","last_became_peered":"2024-09-19T08:42:44.034440+0000","last_unstale":"2024-09-19T08:44:31.195758+0000","last_undegraded":"2024-09-19T08:44:31.195758+0000","last_fullsized":"2024-09-19T08:44:31.195758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:50.470240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.179034+0000","last_change":"2024-09-19T08:42:41.922621+0000","last_active":"2024-09-19T08:44:31.179034+0000","last_peered":"2024-09-19T08:44:31.179034+0000","last_clean":"2024-09-19T08:44:31.179034+0000","last_became_active":"2024-09-19T08:42:41.922303+0000","last_became_peered":"2024-09-19T08:42:41.922303+0000","last_unstale":"2024-09-19T08:44:31.179034+0000","last_undegraded":"2024-09-19T08:44:31.179034+0000","last_fullsized":"2024-09-19T08:44:31.179034+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:48.017892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225447+0000","last_change":"2024-09-19T08:42:44.028307+0000","last_active":"2024-09-19T08:44:31.225447+0000","last_peered":"2024-09-19T08:44:31.225447+0000","last_clean":"2024-09-19T08:44:31.225447+0000","last_became_active":"2024-09-19T08:42:44.026848+0000","last_became_peered":"2024-09-19T08:42:44.026848+0000","last_unstale":"2024-09-19T08:44:31.225447+0000","last_undegraded":"2024-09-19T08:44:31.225447+0000","last_fullsized":"2024-09-19T08:44:31.225447+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:20.768075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.180483+0000","last_change":"2024-09-19T08:42:41.929479+0000","last_active":"2024-09-19T08:44:31.180483+0000","last_peered":"2024-09-19T08:44:31.180483+0000","last_clean":"2024-09-19T08:44:31.180483+0000","last_became_active":"2024-09-19T08:42:41.928508+0000","last_became_peered":"2024-09-19T08:42:41.928508+0000","last_unstale":"2024-09-19T08:44:31.180483+0000","last_undegraded":"2024-09-19T08:44:31.180483+0000","last_fullsized":"2024-09-19T08:44:31.180483+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:46.108471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.205207+0000","last_change":"2024-09-19T08:42:44.028694+0000","last_active":"2024-09-19T08:44:31.205207+0000","last_peered":"2024-09-19T08:44:31.205207+0000","last_clean":"2024-09-19T08:44:31.205207+0000","last_became_active":"2024-09-19T08:42:44.027382+0000","last_became_peered":"2024-09-19T08:42:44.027382+0000","last_unstale":"2024-09-19T08:44:31.205207+0000","last_undegraded":"2024-09-19T08:44:31.205207+0000","last_fullsized":"2024-09-19T08:44:31.205207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:40.877505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170090+0000","last_change":"2024-09-19T08:42:41.931016+0000","last_active":"2024-09-19T08:44:31.170090+0000","last_peered":"2024-09-19T08:44:31.170090+0000","last_clean":"2024-09-19T08:44:31.170090+0000","last_became_active":"2024-09-19T08:42:41.930648+0000","last_became_peered":"2024-09-19T08:42:41.930648+0000","last_unstale":"2024-09-19T08:44:31.170090+0000","last_undegraded":"2024-09-19T08:44:31.170090+0000","last_fullsized":"2024-09-19T08:44:31.170090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:32.031025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226346+0000","last_change":"2024-09-19T08:42:44.035288+0000","last_active":"2024-09-19T08:44:31.226346+0000","last_peered":"2024-09-19T08:44:31.226346+0000","last_clean":"2024-09-19T08:44:31.226346+0000","last_became_active":"2024-09-19T08:42:44.034660+0000","last_became_peered":"2024-09-19T08:42:44.034660+0000","last_unstale":"2024-09-19T08:44:31.226346+0000","last_undegraded":"2024-09-19T08:44:31.226346+0000","last_fullsized":"2024-09-19T08:44:31.226346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:48.703463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225736+0000","last_change":"2024-09-19T08:42:44.040123+0000","last_active":"2024-09-19T08:44:31.225736+0000","last_peered":"2024-09-19T08:44:31.225736+0000","last_clean":"2024-09-19T08:44:31.225736+0000","last_became_active":"2024-09-19T08:42:44.039488+0000","last_became_peered":"2024-09-19T08:42:44.039488+0000","last_unstale":"2024-09-19T08:44:31.225736+0000","last_undegraded":"2024-09-19T08:44:31.225736+0000","last_fullsized":"2024-09-19T08:44:31.225736+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:15.273044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170228+0000","last_change":"2024-09-19T08:42:41.932400+0000","last_active":"2024-09-19T08:44:31.170228+0000","last_peered":"2024-09-19T08:44:31.170228+0000","last_clean":"2024-09-19T08:44:31.170228+0000","last_became_active":"2024-09-19T08:42:41.932020+0000","last_became_peered":"2024-09-19T08:42:41.932020+0000","last_unstale":"2024-09-19T08:44:31.170228+0000","last_undegraded":"2024-09-19T08:44:31.170228+0000","last_fullsized":"2024-09-19T08:44:31.170228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:08.583287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.221219+0000","last_change":"2024-09-19T08:42:44.026173+0000","last_active":"2024-09-19T08:44:31.221219+0000","last_peered":"2024-09-19T08:44:31.221219+0000","last_clean":"2024-09-19T08:44:31.221219+0000","last_became_active":"2024-09-19T08:42:44.024614+0000","last_became_peered":"2024-09-19T08:42:44.024614+0000","last_unstale":"2024-09-19T08:44:31.221219+0000","last_undegraded":"2024-09-19T08:44:31.221219+0000","last_fullsized":"2024-09-19T08:44:31.221219+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:42.695660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170318+0000","last_change":"2024-09-19T08:42:41.929576+0000","last_active":"2024-09-19T08:44:31.170318+0000","last_peered":"2024-09-19T08:44:31.170318+0000","last_clean":"2024-09-19T08:44:31.170318+0000","last_became_active":"2024-09-19T08:42:41.929231+0000","last_became_peered":"2024-09-19T08:42:41.929231+0000","last_unstale":"2024-09-19T08:44:31.170318+0000","last_undegraded":"2024-09-19T08:44:31.170318+0000","last_fullsized":"2024-09-19T08:44:31.170318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:54.492198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226525+0000","last_change":"2024-09-19T08:42:44.028612+0000","last_active":"2024-09-19T08:44:31.226525+0000","last_peered":"2024-09-19T08:44:31.226525+0000","last_clean":"2024-09-19T08:44:31.226525+0000","last_became_active":"2024-09-19T08:42:44.028301+0000","last_became_peered":"2024-09-19T08:42:44.028301+0000","last_unstale":"2024-09-19T08:44:31.226525+0000","last_undegraded":"2024-09-19T08:44:31.226525+0000","last_fullsized":"2024-09-19T08:44:31.226525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:03:09.539350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178947+0000","last_change":"2024-09-19T08:42:42.407931+0000","last_active":"2024-09-19T08:44:31.178947+0000","last_peered":"2024-09-19T08:44:31.178947+0000","last_clean":"2024-09-19T08:44:31.178947+0000","last_became_active":"2024-09-19T08:42:42.407573+0000","last_became_peered":"2024-09-19T08:42:42.407573+0000","last_unstale":"2024-09-19T08:44:31.178947+0000","last_undegraded":"2024-09-19T08:44:31.178947+0000","last_fullsized":"2024-09-19T08:44:31.178947+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:55.095275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.209474+0000","last_change":"2024-09-19T08:42:44.034109+0000","last_active":"2024-09-19T08:44:31.209474+0000","last_peered":"2024-09-19T08:44:31.209474+0000","last_clean":"2024-09-19T08:44:31.209474+0000","last_became_active":"2024-09-19T08:42:44.033753+0000","last_became_peered":"2024-09-19T08:42:44.033753+0000","last_unstale":"2024-09-19T08:44:31.209474+0000","last_undegraded":"2024-09-19T08:44:31.209474+0000","last_fullsized":"2024-09-19T08:44:31.209474+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:08.475476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.168653+0000","last_change":"2024-09-19T08:42:58.120292+0000","last_active":"2024-09-19T08:44:31.168653+0000","last_peered":"2024-09-19T08:44:31.168653+0000","last_clean":"2024-09-19T08:44:31.168653+0000","last_became_active":"2024-09-19T08:42:58.109929+0000","last_became_peered":"2024-09-19T08:42:58.109929+0000","last_unstale":"2024-09-19T08:44:31.168653+0000","last_undegraded":"2024-09-19T08:44:31.168653+0000","last_fullsized":"2024-09-19T08:44:31.168653+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:56.196868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":597461,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":711,"num_read_kb":462,"num_write":292,"num_write_kb":1438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1198,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":1792383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579939,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":442307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32952,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712200,"statfs":{"total":95995035648,"available":95961292800,"internally_reserved":0,"allocated":1748992,"data_stored":1232179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939692,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":925696,"data_stored":441927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168625,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28316,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716836,"statfs":{"total":95995035648,"available":95966040064,"internally_reserved":0,"allocated":1318912,"data_stored":835063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397557,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1515520,"data_stored":1035359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561083,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":441316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790014,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1531904,"data_stored":1033912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953541,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":442869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215178,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40928,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704224,"statfs":{"total":95995035648,"available":95953125376,"internally_reserved":0,"allocated":1458176,"data_stored":966443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444110,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":999424,"data_stored":509951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":978944,"data_stored":506803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":933888,"data_stored":442587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":200585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:44:36.441 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:44:36.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.580+0000 7f9fd599f640 1 -- 172.21.15.7:0/3941089985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd0101370 msgr2=0x7f9fd010d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:36.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.580+0000 7f9fd599f640 1 --2- 172.21.15.7:0/3941089985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd0101370 0x7f9fd010d8a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8009cd0 tx=0x7f9fc802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.580+0000 7f9fd599f640 1 -- 172.21.15.7:0/3941089985 shutdown_connections 2024-09-19T08:44:36.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.580+0000 7f9fd599f640 1 --2- 172.21.15.7:0/3941089985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd0101370 0x7f9fd010d8a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.580+0000 7f9fd599f640 1 --2- 172.21.15.7:0/3941089985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fd01009d0 0x7f9fd0100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.580+0000 7f9fd599f640 1 --2- 172.21.15.7:0/3941089985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fd01069e0 0x7f9fd0106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.580+0000 7f9fd599f640 1 -- 172.21.15.7:0/3941089985 >> 172.21.15.7:0/3941089985 conn(0x7f9fd00fc6b0 msgr2=0x7f9fd00fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:36.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.580+0000 7f9fd599f640 1 -- 172.21.15.7:0/3941089985 shutdown_connections 2024-09-19T08:44:36.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.580+0000 7f9fd599f640 1 -- 172.21.15.7:0/3941089985 wait complete. 2024-09-19T08:44:36.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.580+0000 7f9fd599f640 1 Processor -- start 2024-09-19T08:44:36.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.581+0000 7f9fd599f640 1 -- start start 2024-09-19T08:44:36.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.581+0000 7f9fd599f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fd01009d0 0x7f9fd0199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:36.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.581+0000 7f9fd599f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd0101370 0x7f9fd01997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:36.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.581+0000 7f9fd599f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fd01069e0 0x7f9fd01a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:36.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.581+0000 7f9fd599f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd0110e20 con 0x7f9fd0101370 2024-09-19T08:44:36.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.581+0000 7f9fd599f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd0110ca0 con 0x7f9fd01069e0 2024-09-19T08:44:36.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.581+0000 7f9fd599f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd0110fa0 con 0x7f9fd01009d0 2024-09-19T08:44:36.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.581+0000 7f9fce7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd0101370 0x7f9fd01997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:36.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.581+0000 7f9fce7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd0101370 0x7f9fd01997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53336/0 (socket says 172.21.15.7:53336) 2024-09-19T08:44:36.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.581+0000 7f9fce7fc640 1 -- 172.21.15.7:0/1821667017 learned_addr learned my addr 172.21.15.7:0/1821667017 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:36.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.581+0000 7f9fcf7fe640 1 --2- 172.21.15.7:0/1821667017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fd01069e0 0x7f9fd01a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:36.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.581+0000 7f9fceffd640 1 --2- 172.21.15.7:0/1821667017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fd01009d0 0x7f9fd0199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:36.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.581+0000 7f9fce7fc640 1 -- 172.21.15.7:0/1821667017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fd01009d0 msgr2=0x7f9fd0199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:36.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.581+0000 7f9fce7fc640 1 --2- 172.21.15.7:0/1821667017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fd01009d0 0x7f9fd0199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.581+0000 7f9fce7fc640 1 -- 172.21.15.7:0/1821667017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fd01069e0 msgr2=0x7f9fd01a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:36.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.581+0000 7f9fce7fc640 1 --2- 172.21.15.7:0/1821667017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fd01069e0 0x7f9fd01a42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.581+0000 7f9fce7fc640 1 -- 172.21.15.7:0/1821667017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd01a4830 con 0x7f9fd0101370 2024-09-19T08:44:36.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.581+0000 7f9fce7fc640 1 --2- 172.21.15.7:0/1821667017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd0101370 0x7f9fd01997b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400e9f0 tx=0x7f9fc400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:36.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.581+0000 7f9fd499d640 1 -- 172.21.15.7:0/1821667017 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc400cd80 con 0x7f9fd0101370 2024-09-19T08:44:36.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.582+0000 7f9fd499d640 1 -- 172.21.15.7:0/1821667017 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fc4005500 con 0x7f9fd0101370 2024-09-19T08:44:36.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.582+0000 7f9fd599f640 1 -- 172.21.15.7:0/1821667017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd01a4a00 con 0x7f9fd0101370 2024-09-19T08:44:36.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.582+0000 7f9fd499d640 1 -- 172.21.15.7:0/1821667017 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4010690 con 0x7f9fd0101370 2024-09-19T08:44:36.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.582+0000 7f9fd599f640 1 -- 172.21.15.7:0/1821667017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd01a4f20 con 0x7f9fd0101370 2024-09-19T08:44:36.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.583+0000 7f9fd599f640 1 -- 172.21.15.7:0/1821667017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fd0100e30 con 0x7f9fd0101370 2024-09-19T08:44:36.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.584+0000 7f9fd499d640 1 -- 172.21.15.7:0/1821667017 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f9fc40046c0 con 0x7f9fd0101370 2024-09-19T08:44:36.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.584+0000 7f9fd499d640 1 --2- 172.21.15.7:0/1821667017 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9fb80a34d0 0x7f9fb80a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:36.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.585+0000 7f9fceffd640 1 --2- 172.21.15.7:0/1821667017 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9fb80a34d0 0x7f9fb80a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:36.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.585+0000 7f9fd499d640 1 -- 172.21.15.7:0/1821667017 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f9fc40d0250 con 0x7f9fd0101370 2024-09-19T08:44:36.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.585+0000 7f9fceffd640 1 --2- 172.21.15.7:0/1821667017 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9fb80a34d0 0x7f9fb80a5990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009b50 tx=0x7f9fc0005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:36.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.589+0000 7f9fd499d640 1 -- 172.21.15.7:0/1821667017 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9fc409cab0 con 0x7f9fd0101370 2024-09-19T08:44:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.763+0000 7f9fd599f640 1 -- 172.21.15.7:0/1821667017 --> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9fd0108fd0 con 0x7f9fb80a34d0 2024-09-19T08:44:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.769+0000 7f9fd499d640 1 -- 172.21.15.7:0/1821667017 <== mgr.15132 v2:172.21.15.7:6800/3061932294 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257852 (secure 0 0 0) 0x7f9fc001b3f0 con 0x7f9fb80a34d0 2024-09-19T08:44:36.771 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:44:36.772 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-19T08:44:36.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.772+0000 7f9fd599f640 1 -- 172.21.15.7:0/1821667017 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9fb80a34d0 msgr2=0x7f9fb80a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:36.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.772+0000 7f9fd599f640 1 --2- 172.21.15.7:0/1821667017 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9fb80a34d0 0x7f9fb80a5990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009b50 tx=0x7f9fc0005f90 comp rx=0 tx=0).stop 2024-09-19T08:44:36.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.772+0000 7f9fd599f640 1 -- 172.21.15.7:0/1821667017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd0101370 msgr2=0x7f9fd01997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:36.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.772+0000 7f9fd599f640 1 --2- 172.21.15.7:0/1821667017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd0101370 0x7f9fd01997b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400e9f0 tx=0x7f9fc400edf0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.772+0000 7f9fd599f640 1 -- 172.21.15.7:0/1821667017 shutdown_connections 2024-09-19T08:44:36.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.772+0000 7f9fd599f640 1 --2- 172.21.15.7:0/1821667017 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9fb80a34d0 0x7f9fb80a5990 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.772+0000 7f9fd599f640 1 --2- 172.21.15.7:0/1821667017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fd01069e0 0x7f9fd01a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.772+0000 7f9fd599f640 1 --2- 172.21.15.7:0/1821667017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd0101370 0x7f9fd01997b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.772+0000 7f9fd599f640 1 --2- 172.21.15.7:0/1821667017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fd01009d0 0x7f9fd0199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.772+0000 7f9fd599f640 1 -- 172.21.15.7:0/1821667017 >> 172.21.15.7:0/1821667017 conn(0x7f9fd00fc6b0 msgr2=0x7f9fd00fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.772+0000 7f9fd599f640 1 -- 172.21.15.7:0/1821667017 shutdown_connections 2024-09-19T08:44:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.772+0000 7f9fd599f640 1 -- 172.21.15.7:0/1821667017 wait complete. 2024-09-19T08:44:36.783 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T08:44:35.182411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188063,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":847,"num_read_kb":581,"num_write":475,"num_write_kb":4378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1181934,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":867,"ondisk_log_size":867,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367340,"kb_used_data":13832,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124574484,"statfs":{"total":1151940427776,"available":1151564271616,"internally_reserved":0,"allocated":14163968,"data_stored":8330716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.989206"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226071+0000","last_change":"2024-09-19T08:42:44.035697+0000","last_active":"2024-09-19T08:44:31.226071+0000","last_peered":"2024-09-19T08:44:31.226071+0000","last_clean":"2024-09-19T08:44:31.226071+0000","last_became_active":"2024-09-19T08:42:44.035400+0000","last_became_peered":"2024-09-19T08:42:44.035400+0000","last_unstale":"2024-09-19T08:44:31.226071+0000","last_undegraded":"2024-09-19T08:44:31.226071+0000","last_fullsized":"2024-09-19T08:44:31.226071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:56.202947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.223958+0000","last_change":"2024-09-19T08:42:44.031393+0000","last_active":"2024-09-19T08:44:31.223958+0000","last_peered":"2024-09-19T08:44:31.223958+0000","last_clean":"2024-09-19T08:44:31.223958+0000","last_became_active":"2024-09-19T08:42:44.031056+0000","last_became_peered":"2024-09-19T08:42:44.031056+0000","last_unstale":"2024-09-19T08:44:31.223958+0000","last_undegraded":"2024-09-19T08:44:31.223958+0000","last_fullsized":"2024-09-19T08:44:31.223958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:44.694913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224221+0000","last_change":"2024-09-19T08:42:44.029586+0000","last_active":"2024-09-19T08:44:31.224221+0000","last_peered":"2024-09-19T08:44:31.224221+0000","last_clean":"2024-09-19T08:44:31.224221+0000","last_became_active":"2024-09-19T08:42:44.029279+0000","last_became_peered":"2024-09-19T08:42:44.029279+0000","last_unstale":"2024-09-19T08:44:31.224221+0000","last_undegraded":"2024-09-19T08:44:31.224221+0000","last_fullsized":"2024-09-19T08:44:31.224221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:12.036113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219401+0000","last_change":"2024-09-19T08:42:44.043192+0000","last_active":"2024-09-19T08:44:31.219401+0000","last_peered":"2024-09-19T08:44:31.219401+0000","last_clean":"2024-09-19T08:44:31.219401+0000","last_became_active":"2024-09-19T08:42:44.042838+0000","last_became_peered":"2024-09-19T08:42:44.042838+0000","last_unstale":"2024-09-19T08:44:31.219401+0000","last_undegraded":"2024-09-19T08:44:31.219401+0000","last_fullsized":"2024-09-19T08:44:31.219401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:20.549232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.207548+0000","last_change":"2024-09-19T08:42:44.032231+0000","last_active":"2024-09-19T08:44:31.207548+0000","last_peered":"2024-09-19T08:44:31.207548+0000","last_clean":"2024-09-19T08:44:31.207548+0000","last_became_active":"2024-09-19T08:42:44.031835+0000","last_became_peered":"2024-09-19T08:42:44.031835+0000","last_unstale":"2024-09-19T08:44:31.207548+0000","last_undegraded":"2024-09-19T08:44:31.207548+0000","last_fullsized":"2024-09-19T08:44:31.207548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:49.084085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.209888+0000","last_change":"2024-09-19T08:42:44.035487+0000","last_active":"2024-09-19T08:44:31.209888+0000","last_peered":"2024-09-19T08:44:31.209888+0000","last_clean":"2024-09-19T08:44:31.209888+0000","last_became_active":"2024-09-19T08:42:44.035138+0000","last_became_peered":"2024-09-19T08:42:44.035138+0000","last_unstale":"2024-09-19T08:44:31.209888+0000","last_undegraded":"2024-09-19T08:44:31.209888+0000","last_fullsized":"2024-09-19T08:44:31.209888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:43.483397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212841+0000","last_change":"2024-09-19T08:42:44.029052+0000","last_active":"2024-09-19T08:44:31.212841+0000","last_peered":"2024-09-19T08:44:31.212841+0000","last_clean":"2024-09-19T08:44:31.212841+0000","last_became_active":"2024-09-19T08:42:44.028722+0000","last_became_peered":"2024-09-19T08:42:44.028722+0000","last_unstale":"2024-09-19T08:44:31.212841+0000","last_undegraded":"2024-09-19T08:44:31.212841+0000","last_fullsized":"2024-09-19T08:44:31.212841+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:49.226044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212167+0000","last_change":"2024-09-19T08:42:44.031401+0000","last_active":"2024-09-19T08:44:31.212167+0000","last_peered":"2024-09-19T08:44:31.212167+0000","last_clean":"2024-09-19T08:44:31.212167+0000","last_became_active":"2024-09-19T08:42:44.031103+0000","last_became_peered":"2024-09-19T08:42:44.031103+0000","last_unstale":"2024-09-19T08:44:31.212167+0000","last_undegraded":"2024-09-19T08:44:31.212167+0000","last_fullsized":"2024-09-19T08:44:31.212167+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:57.406765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224039+0000","last_change":"2024-09-19T08:42:44.033011+0000","last_active":"2024-09-19T08:44:31.224039+0000","last_peered":"2024-09-19T08:44:31.224039+0000","last_clean":"2024-09-19T08:44:31.224039+0000","last_became_active":"2024-09-19T08:42:44.032075+0000","last_became_peered":"2024-09-19T08:42:44.032075+0000","last_unstale":"2024-09-19T08:44:31.224039+0000","last_undegraded":"2024-09-19T08:44:31.224039+0000","last_fullsized":"2024-09-19T08:44:31.224039+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:43.701684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212881+0000","last_change":"2024-09-19T08:42:44.037417+0000","last_active":"2024-09-19T08:44:31.212881+0000","last_peered":"2024-09-19T08:44:31.212881+0000","last_clean":"2024-09-19T08:44:31.212881+0000","last_became_active":"2024-09-19T08:42:44.037006+0000","last_became_peered":"2024-09-19T08:42:44.037006+0000","last_unstale":"2024-09-19T08:44:31.212881+0000","last_undegraded":"2024-09-19T08:44:31.212881+0000","last_fullsized":"2024-09-19T08:44:31.212881+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:10.952939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225737+0000","last_change":"2024-09-19T08:42:44.034125+0000","last_active":"2024-09-19T08:44:31.225737+0000","last_peered":"2024-09-19T08:44:31.225737+0000","last_clean":"2024-09-19T08:44:31.225737+0000","last_became_active":"2024-09-19T08:42:44.033772+0000","last_became_peered":"2024-09-19T08:42:44.033772+0000","last_unstale":"2024-09-19T08:44:31.225737+0000","last_undegraded":"2024-09-19T08:44:31.225737+0000","last_fullsized":"2024-09-19T08:44:31.225737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:42.854137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219105+0000","last_change":"2024-09-19T08:42:44.043047+0000","last_active":"2024-09-19T08:44:31.219105+0000","last_peered":"2024-09-19T08:44:31.219105+0000","last_clean":"2024-09-19T08:44:31.219105+0000","last_became_active":"2024-09-19T08:42:44.042666+0000","last_became_peered":"2024-09-19T08:42:44.042666+0000","last_unstale":"2024-09-19T08:44:31.219105+0000","last_undegraded":"2024-09-19T08:44:31.219105+0000","last_fullsized":"2024-09-19T08:44:31.219105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:16.504824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208420+0000","last_change":"2024-09-19T08:42:44.026475+0000","last_active":"2024-09-19T08:44:31.208420+0000","last_peered":"2024-09-19T08:44:31.208420+0000","last_clean":"2024-09-19T08:44:31.208420+0000","last_became_active":"2024-09-19T08:42:44.026169+0000","last_became_peered":"2024-09-19T08:42:44.026169+0000","last_unstale":"2024-09-19T08:44:31.208420+0000","last_undegraded":"2024-09-19T08:44:31.208420+0000","last_fullsized":"2024-09-19T08:44:31.208420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:17.130267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222128+0000","last_change":"2024-09-19T08:42:44.033725+0000","last_active":"2024-09-19T08:44:31.222128+0000","last_peered":"2024-09-19T08:44:31.222128+0000","last_clean":"2024-09-19T08:44:31.222128+0000","last_became_active":"2024-09-19T08:42:44.033304+0000","last_became_peered":"2024-09-19T08:42:44.033304+0000","last_unstale":"2024-09-19T08:44:31.222128+0000","last_undegraded":"2024-09-19T08:44:31.222128+0000","last_fullsized":"2024-09-19T08:44:31.222128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:47.520808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224694+0000","last_change":"2024-09-19T08:42:44.041762+0000","last_active":"2024-09-19T08:44:31.224694+0000","last_peered":"2024-09-19T08:44:31.224694+0000","last_clean":"2024-09-19T08:44:31.224694+0000","last_became_active":"2024-09-19T08:42:44.041433+0000","last_became_peered":"2024-09-19T08:42:44.041433+0000","last_unstale":"2024-09-19T08:44:31.224694+0000","last_undegraded":"2024-09-19T08:44:31.224694+0000","last_fullsized":"2024-09-19T08:44:31.224694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:05.504873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226669+0000","last_change":"2024-09-19T08:42:44.030316+0000","last_active":"2024-09-19T08:44:31.226669+0000","last_peered":"2024-09-19T08:44:31.226669+0000","last_clean":"2024-09-19T08:44:31.226669+0000","last_became_active":"2024-09-19T08:42:44.029872+0000","last_became_peered":"2024-09-19T08:42:44.029872+0000","last_unstale":"2024-09-19T08:44:31.226669+0000","last_undegraded":"2024-09-19T08:44:31.226669+0000","last_fullsized":"2024-09-19T08:44:31.226669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:18.011019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226224+0000","last_change":"2024-09-19T08:42:44.035523+0000","last_active":"2024-09-19T08:44:31.226224+0000","last_peered":"2024-09-19T08:44:31.226224+0000","last_clean":"2024-09-19T08:44:31.226224+0000","last_became_active":"2024-09-19T08:42:44.035185+0000","last_became_peered":"2024-09-19T08:42:44.035185+0000","last_unstale":"2024-09-19T08:44:31.226224+0000","last_undegraded":"2024-09-19T08:44:31.226224+0000","last_fullsized":"2024-09-19T08:44:31.226224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:03.475458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222791+0000","last_change":"2024-09-19T08:42:44.031803+0000","last_active":"2024-09-19T08:44:31.222791+0000","last_peered":"2024-09-19T08:44:31.222791+0000","last_clean":"2024-09-19T08:44:31.222791+0000","last_became_active":"2024-09-19T08:42:44.031501+0000","last_became_peered":"2024-09-19T08:42:44.031501+0000","last_unstale":"2024-09-19T08:44:31.222791+0000","last_undegraded":"2024-09-19T08:44:31.222791+0000","last_fullsized":"2024-09-19T08:44:31.222791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:31.780744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.211603+0000","last_change":"2024-09-19T08:42:44.036168+0000","last_active":"2024-09-19T08:44:31.211603+0000","last_peered":"2024-09-19T08:44:31.211603+0000","last_clean":"2024-09-19T08:44:31.211603+0000","last_became_active":"2024-09-19T08:42:44.035819+0000","last_became_peered":"2024-09-19T08:42:44.035819+0000","last_unstale":"2024-09-19T08:44:31.211603+0000","last_undegraded":"2024-09-19T08:44:31.211603+0000","last_fullsized":"2024-09-19T08:44:31.211603+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:26.478389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.220605+0000","last_change":"2024-09-19T08:42:44.037569+0000","last_active":"2024-09-19T08:44:31.220605+0000","last_peered":"2024-09-19T08:44:31.220605+0000","last_clean":"2024-09-19T08:44:31.220605+0000","last_became_active":"2024-09-19T08:42:44.037161+0000","last_became_peered":"2024-09-19T08:42:44.037161+0000","last_unstale":"2024-09-19T08:44:31.220605+0000","last_undegraded":"2024-09-19T08:44:31.220605+0000","last_fullsized":"2024-09-19T08:44:31.220605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:35.316314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226011+0000","last_change":"2024-09-19T08:42:44.023160+0000","last_active":"2024-09-19T08:44:31.226011+0000","last_peered":"2024-09-19T08:44:31.226011+0000","last_clean":"2024-09-19T08:44:31.226011+0000","last_became_active":"2024-09-19T08:42:44.022791+0000","last_became_peered":"2024-09-19T08:42:44.022791+0000","last_unstale":"2024-09-19T08:44:31.226011+0000","last_undegraded":"2024-09-19T08:44:31.226011+0000","last_fullsized":"2024-09-19T08:44:31.226011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:00.174583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225075+0000","last_change":"2024-09-19T08:42:44.035877+0000","last_active":"2024-09-19T08:44:31.225075+0000","last_peered":"2024-09-19T08:44:31.225075+0000","last_clean":"2024-09-19T08:44:31.225075+0000","last_became_active":"2024-09-19T08:42:44.035307+0000","last_became_peered":"2024-09-19T08:42:44.035307+0000","last_unstale":"2024-09-19T08:44:31.225075+0000","last_undegraded":"2024-09-19T08:44:31.225075+0000","last_fullsized":"2024-09-19T08:44:31.225075+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:54.717130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219964+0000","last_change":"2024-09-19T08:42:44.033536+0000","last_active":"2024-09-19T08:44:31.219964+0000","last_peered":"2024-09-19T08:44:31.219964+0000","last_clean":"2024-09-19T08:44:31.219964+0000","last_became_active":"2024-09-19T08:42:44.033179+0000","last_became_peered":"2024-09-19T08:42:44.033179+0000","last_unstale":"2024-09-19T08:44:31.219964+0000","last_undegraded":"2024-09-19T08:44:31.219964+0000","last_fullsized":"2024-09-19T08:44:31.219964+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:11.161785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.210217+0000","last_change":"2024-09-19T08:42:44.029674+0000","last_active":"2024-09-19T08:44:31.210217+0000","last_peered":"2024-09-19T08:44:31.210217+0000","last_clean":"2024-09-19T08:44:31.210217+0000","last_became_active":"2024-09-19T08:42:44.029368+0000","last_became_peered":"2024-09-19T08:42:44.029368+0000","last_unstale":"2024-09-19T08:44:31.210217+0000","last_undegraded":"2024-09-19T08:44:31.210217+0000","last_fullsized":"2024-09-19T08:44:31.210217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:34.943363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.213448+0000","last_change":"2024-09-19T08:42:44.039780+0000","last_active":"2024-09-19T08:44:31.213448+0000","last_peered":"2024-09-19T08:44:31.213448+0000","last_clean":"2024-09-19T08:44:31.213448+0000","last_became_active":"2024-09-19T08:42:44.039409+0000","last_became_peered":"2024-09-19T08:42:44.039409+0000","last_unstale":"2024-09-19T08:44:31.213448+0000","last_undegraded":"2024-09-19T08:44:31.213448+0000","last_fullsized":"2024-09-19T08:44:31.213448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:59.632132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.214979+0000","last_change":"2024-09-19T08:42:44.030881+0000","last_active":"2024-09-19T08:44:31.214979+0000","last_peered":"2024-09-19T08:44:31.214979+0000","last_clean":"2024-09-19T08:44:31.214979+0000","last_became_active":"2024-09-19T08:42:44.030530+0000","last_became_peered":"2024-09-19T08:42:44.030530+0000","last_unstale":"2024-09-19T08:44:31.214979+0000","last_undegraded":"2024-09-19T08:44:31.214979+0000","last_fullsized":"2024-09-19T08:44:31.214979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:16.908450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.214928+0000","last_change":"2024-09-19T08:42:44.033056+0000","last_active":"2024-09-19T08:44:31.214928+0000","last_peered":"2024-09-19T08:44:31.214928+0000","last_clean":"2024-09-19T08:44:31.214928+0000","last_became_active":"2024-09-19T08:42:44.032690+0000","last_became_peered":"2024-09-19T08:42:44.032690+0000","last_unstale":"2024-09-19T08:44:31.214928+0000","last_undegraded":"2024-09-19T08:44:31.214928+0000","last_fullsized":"2024-09-19T08:44:31.214928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:36.497824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225043+0000","last_change":"2024-09-19T08:42:58.106551+0000","last_active":"2024-09-19T08:44:31.225043+0000","last_peered":"2024-09-19T08:44:31.225043+0000","last_clean":"2024-09-19T08:44:31.225043+0000","last_became_active":"2024-09-19T08:42:58.106119+0000","last_became_peered":"2024-09-19T08:42:58.106119+0000","last_unstale":"2024-09-19T08:44:31.225043+0000","last_undegraded":"2024-09-19T08:44:31.225043+0000","last_fullsized":"2024-09-19T08:44:31.225043+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:46.794260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226527+0000","last_change":"2024-09-19T08:42:58.108106+0000","last_active":"2024-09-19T08:44:31.226527+0000","last_peered":"2024-09-19T08:44:31.226527+0000","last_clean":"2024-09-19T08:44:31.226527+0000","last_became_active":"2024-09-19T08:42:58.107532+0000","last_became_peered":"2024-09-19T08:42:58.107532+0000","last_unstale":"2024-09-19T08:44:31.226527+0000","last_undegraded":"2024-09-19T08:44:31.226527+0000","last_fullsized":"2024-09-19T08:44:31.226527+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:29.164983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224871+0000","last_change":"2024-09-19T08:42:44.029822+0000","last_active":"2024-09-19T08:44:31.224871+0000","last_peered":"2024-09-19T08:44:31.224871+0000","last_clean":"2024-09-19T08:44:31.224871+0000","last_became_active":"2024-09-19T08:42:44.029450+0000","last_became_peered":"2024-09-19T08:42:44.029450+0000","last_unstale":"2024-09-19T08:44:31.224871+0000","last_undegraded":"2024-09-19T08:44:31.224871+0000","last_fullsized":"2024-09-19T08:44:31.224871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:40.826261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.210860+0000","last_change":"2024-09-19T08:42:44.041354+0000","last_active":"2024-09-19T08:44:31.210860+0000","last_peered":"2024-09-19T08:44:31.210860+0000","last_clean":"2024-09-19T08:44:31.210860+0000","last_became_active":"2024-09-19T08:42:44.040912+0000","last_became_peered":"2024-09-19T08:42:44.040912+0000","last_unstale":"2024-09-19T08:44:31.210860+0000","last_undegraded":"2024-09-19T08:44:31.210860+0000","last_fullsized":"2024-09-19T08:44:31.210860+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:16.543950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.217246+0000","last_change":"2024-09-19T08:42:44.027912+0000","last_active":"2024-09-19T08:44:31.217246+0000","last_peered":"2024-09-19T08:44:31.217246+0000","last_clean":"2024-09-19T08:44:31.217246+0000","last_became_active":"2024-09-19T08:42:44.027505+0000","last_became_peered":"2024-09-19T08:42:44.027505+0000","last_unstale":"2024-09-19T08:44:31.217246+0000","last_undegraded":"2024-09-19T08:44:31.217246+0000","last_fullsized":"2024-09-19T08:44:31.217246+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:02.552756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208688+0000","last_change":"2024-09-19T08:42:44.034472+0000","last_active":"2024-09-19T08:44:31.208688+0000","last_peered":"2024-09-19T08:44:31.208688+0000","last_clean":"2024-09-19T08:44:31.208688+0000","last_became_active":"2024-09-19T08:42:44.034026+0000","last_became_peered":"2024-09-19T08:42:44.034026+0000","last_unstale":"2024-09-19T08:44:31.208688+0000","last_undegraded":"2024-09-19T08:44:31.208688+0000","last_fullsized":"2024-09-19T08:44:31.208688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:10.058882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'10","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.481139+0000","last_change":"2024-09-19T08:42:41.927174+0000","last_active":"2024-09-19T08:44:31.481139+0000","last_peered":"2024-09-19T08:44:31.481139+0000","last_clean":"2024-09-19T08:44:31.481139+0000","last_became_active":"2024-09-19T08:42:41.926826+0000","last_became_peered":"2024-09-19T08:42:41.926826+0000","last_unstale":"2024-09-19T08:44:31.481139+0000","last_undegraded":"2024-09-19T08:44:31.481139+0000","last_fullsized":"2024-09-19T08:44:31.481139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:37.274891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2250,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":5,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.210827+0000","last_change":"2024-09-19T08:42:58.110259+0000","last_active":"2024-09-19T08:44:31.210827+0000","last_peered":"2024-09-19T08:44:31.210827+0000","last_clean":"2024-09-19T08:44:31.210827+0000","last_became_active":"2024-09-19T08:42:58.109803+0000","last_became_peered":"2024-09-19T08:42:58.109803+0000","last_unstale":"2024-09-19T08:44:31.210827+0000","last_undegraded":"2024-09-19T08:44:31.210827+0000","last_fullsized":"2024-09-19T08:44:31.210827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:31.853404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177196+0000","last_change":"2024-09-19T08:42:58.114222+0000","last_active":"2024-09-19T08:44:31.177196+0000","last_peered":"2024-09-19T08:44:31.177196+0000","last_clean":"2024-09-19T08:44:31.177196+0000","last_became_active":"2024-09-19T08:42:58.110769+0000","last_became_peered":"2024-09-19T08:42:58.110769+0000","last_unstale":"2024-09-19T08:44:31.177196+0000","last_undegraded":"2024-09-19T08:44:31.177196+0000","last_fullsized":"2024-09-19T08:44:31.177196+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:17.952228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.176271+0000","last_change":"2024-09-19T08:42:41.923903+0000","last_active":"2024-09-19T08:44:31.176271+0000","last_peered":"2024-09-19T08:44:31.176271+0000","last_clean":"2024-09-19T08:44:31.176271+0000","last_became_active":"2024-09-19T08:42:41.923583+0000","last_became_peered":"2024-09-19T08:42:41.923583+0000","last_unstale":"2024-09-19T08:44:31.176271+0000","last_undegraded":"2024-09-19T08:44:31.176271+0000","last_fullsized":"2024-09-19T08:44:31.176271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:48.594343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219641+0000","last_change":"2024-09-19T08:42:44.028972+0000","last_active":"2024-09-19T08:44:31.219641+0000","last_peered":"2024-09-19T08:44:31.219641+0000","last_clean":"2024-09-19T08:44:31.219641+0000","last_became_active":"2024-09-19T08:42:44.028657+0000","last_became_peered":"2024-09-19T08:42:44.028657+0000","last_unstale":"2024-09-19T08:44:31.219641+0000","last_undegraded":"2024-09-19T08:44:31.219641+0000","last_fullsized":"2024-09-19T08:44:31.219641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:43.618010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178701+0000","last_change":"2024-09-19T08:42:41.926558+0000","last_active":"2024-09-19T08:44:31.178701+0000","last_peered":"2024-09-19T08:44:31.178701+0000","last_clean":"2024-09-19T08:44:31.178701+0000","last_became_active":"2024-09-19T08:42:41.926074+0000","last_became_peered":"2024-09-19T08:42:41.926074+0000","last_unstale":"2024-09-19T08:44:31.178701+0000","last_undegraded":"2024-09-19T08:44:31.178701+0000","last_fullsized":"2024-09-19T08:44:31.178701+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:47.563295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.223532+0000","last_change":"2024-09-19T08:42:44.029191+0000","last_active":"2024-09-19T08:44:31.223532+0000","last_peered":"2024-09-19T08:44:31.223532+0000","last_clean":"2024-09-19T08:44:31.223532+0000","last_became_active":"2024-09-19T08:42:44.028871+0000","last_became_peered":"2024-09-19T08:42:44.028871+0000","last_unstale":"2024-09-19T08:44:31.223532+0000","last_undegraded":"2024-09-19T08:44:31.223532+0000","last_fullsized":"2024-09-19T08:44:31.223532+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:41.262014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":126,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177656+0000","last_change":"2024-09-19T08:42:41.930265+0000","last_active":"2024-09-19T08:44:31.177656+0000","last_peered":"2024-09-19T08:44:31.177656+0000","last_clean":"2024-09-19T08:44:31.177656+0000","last_became_active":"2024-09-19T08:42:41.929829+0000","last_became_peered":"2024-09-19T08:42:41.929829+0000","last_unstale":"2024-09-19T08:44:31.177656+0000","last_undegraded":"2024-09-19T08:44:31.177656+0000","last_fullsized":"2024-09-19T08:44:31.177656+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:59.181622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224033+0000","last_change":"2024-09-19T08:42:44.027382+0000","last_active":"2024-09-19T08:44:31.224033+0000","last_peered":"2024-09-19T08:44:31.224033+0000","last_clean":"2024-09-19T08:44:31.224033+0000","last_became_active":"2024-09-19T08:42:44.026824+0000","last_became_peered":"2024-09-19T08:42:44.026824+0000","last_unstale":"2024-09-19T08:44:31.224033+0000","last_undegraded":"2024-09-19T08:44:31.224033+0000","last_fullsized":"2024-09-19T08:44:31.224033+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:58.520068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.180283+0000","last_change":"2024-09-19T08:42:41.927914+0000","last_active":"2024-09-19T08:44:31.180283+0000","last_peered":"2024-09-19T08:44:31.180283+0000","last_clean":"2024-09-19T08:44:31.180283+0000","last_became_active":"2024-09-19T08:42:41.926566+0000","last_became_peered":"2024-09-19T08:42:41.926566+0000","last_unstale":"2024-09-19T08:44:31.180283+0000","last_undegraded":"2024-09-19T08:44:31.180283+0000","last_fullsized":"2024-09-19T08:44:31.180283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:52.238352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224677+0000","last_change":"2024-09-19T08:42:44.039899+0000","last_active":"2024-09-19T08:44:31.224677+0000","last_peered":"2024-09-19T08:44:31.224677+0000","last_clean":"2024-09-19T08:44:31.224677+0000","last_became_active":"2024-09-19T08:42:44.039530+0000","last_became_peered":"2024-09-19T08:42:44.039530+0000","last_unstale":"2024-09-19T08:44:31.224677+0000","last_undegraded":"2024-09-19T08:44:31.224677+0000","last_fullsized":"2024-09-19T08:44:31.224677+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:20.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178662+0000","last_change":"2024-09-19T08:42:42.410128+0000","last_active":"2024-09-19T08:44:31.178662+0000","last_peered":"2024-09-19T08:44:31.178662+0000","last_clean":"2024-09-19T08:44:31.178662+0000","last_became_active":"2024-09-19T08:42:42.409717+0000","last_became_peered":"2024-09-19T08:42:42.409717+0000","last_unstale":"2024-09-19T08:44:31.178662+0000","last_undegraded":"2024-09-19T08:44:31.178662+0000","last_fullsized":"2024-09-19T08:44:31.178662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:41.682355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225965+0000","last_change":"2024-09-19T08:42:44.043248+0000","last_active":"2024-09-19T08:44:31.225965+0000","last_peered":"2024-09-19T08:44:31.225965+0000","last_clean":"2024-09-19T08:44:31.225965+0000","last_became_active":"2024-09-19T08:42:44.042849+0000","last_became_peered":"2024-09-19T08:42:44.042849+0000","last_unstale":"2024-09-19T08:44:31.225965+0000","last_undegraded":"2024-09-19T08:44:31.225965+0000","last_fullsized":"2024-09-19T08:44:31.225965+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:00.413217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'34","reported_seq":265,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.485244+0000","last_change":"2024-09-19T08:42:41.926582+0000","last_active":"2024-09-19T08:44:31.485244+0000","last_peered":"2024-09-19T08:44:31.485244+0000","last_clean":"2024-09-19T08:44:31.485244+0000","last_became_active":"2024-09-19T08:42:41.926234+0000","last_became_peered":"2024-09-19T08:42:41.926234+0000","last_unstale":"2024-09-19T08:44:31.485244+0000","last_undegraded":"2024-09-19T08:44:31.485244+0000","last_fullsized":"2024-09-19T08:44:31.485244+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:02.498976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":167,"num_write":35,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.199159+0000","last_change":"2024-09-19T08:42:44.034888+0000","last_active":"2024-09-19T08:44:31.199159+0000","last_peered":"2024-09-19T08:44:31.199159+0000","last_clean":"2024-09-19T08:44:31.199159+0000","last_became_active":"2024-09-19T08:42:44.034553+0000","last_became_peered":"2024-09-19T08:42:44.034553+0000","last_unstale":"2024-09-19T08:44:31.199159+0000","last_undegraded":"2024-09-19T08:44:31.199159+0000","last_fullsized":"2024-09-19T08:44:31.199159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:06.416289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.181995+0000","last_change":"2024-09-19T08:42:58.117912+0000","last_active":"2024-09-19T08:44:31.181995+0000","last_peered":"2024-09-19T08:44:31.181995+0000","last_clean":"2024-09-19T08:44:31.181995+0000","last_became_active":"2024-09-19T08:42:58.105810+0000","last_became_peered":"2024-09-19T08:42:58.105810+0000","last_unstale":"2024-09-19T08:44:31.181995+0000","last_undegraded":"2024-09-19T08:44:31.181995+0000","last_fullsized":"2024-09-19T08:44:31.181995+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:44.258256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.213617+0000","last_change":"2024-09-19T08:42:44.030519+0000","last_active":"2024-09-19T08:44:31.213617+0000","last_peered":"2024-09-19T08:44:31.213617+0000","last_clean":"2024-09-19T08:44:31.213617+0000","last_became_active":"2024-09-19T08:42:44.030190+0000","last_became_peered":"2024-09-19T08:42:44.030190+0000","last_unstale":"2024-09-19T08:44:31.213617+0000","last_undegraded":"2024-09-19T08:44:31.213617+0000","last_fullsized":"2024-09-19T08:44:31.213617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:20.220642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178349+0000","last_change":"2024-09-19T08:42:41.928124+0000","last_active":"2024-09-19T08:44:31.178349+0000","last_peered":"2024-09-19T08:44:31.178349+0000","last_clean":"2024-09-19T08:44:31.178349+0000","last_became_active":"2024-09-19T08:42:41.927761+0000","last_became_peered":"2024-09-19T08:42:41.927761+0000","last_unstale":"2024-09-19T08:44:31.178349+0000","last_undegraded":"2024-09-19T08:44:31.178349+0000","last_fullsized":"2024-09-19T08:44:31.178349+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:08.591270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.218267+0000","last_change":"2024-09-19T08:42:44.038234+0000","last_active":"2024-09-19T08:44:31.218267+0000","last_peered":"2024-09-19T08:44:31.218267+0000","last_clean":"2024-09-19T08:44:31.218267+0000","last_became_active":"2024-09-19T08:42:44.037726+0000","last_became_peered":"2024-09-19T08:42:44.037726+0000","last_unstale":"2024-09-19T08:44:31.218267+0000","last_undegraded":"2024-09-19T08:44:31.218267+0000","last_fullsized":"2024-09-19T08:44:31.218267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:08.865482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.239723+0000","last_change":"2024-09-19T08:42:41.926206+0000","last_active":"2024-09-19T08:44:31.239723+0000","last_peered":"2024-09-19T08:44:31.239723+0000","last_clean":"2024-09-19T08:44:31.239723+0000","last_became_active":"2024-09-19T08:42:41.925833+0000","last_became_peered":"2024-09-19T08:42:41.925833+0000","last_unstale":"2024-09-19T08:44:31.239723+0000","last_undegraded":"2024-09-19T08:44:31.239723+0000","last_fullsized":"2024-09-19T08:44:31.239723+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:27.944240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":5,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208340+0000","last_change":"2024-09-19T08:42:44.037181+0000","last_active":"2024-09-19T08:44:31.208340+0000","last_peered":"2024-09-19T08:44:31.208340+0000","last_clean":"2024-09-19T08:44:31.208340+0000","last_became_active":"2024-09-19T08:42:44.036865+0000","last_became_peered":"2024-09-19T08:42:44.036865+0000","last_unstale":"2024-09-19T08:44:31.208340+0000","last_undegraded":"2024-09-19T08:44:31.208340+0000","last_fullsized":"2024-09-19T08:44:31.208340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:20.233309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.169922+0000","last_change":"2024-09-19T08:42:42.408446+0000","last_active":"2024-09-19T08:44:31.169922+0000","last_peered":"2024-09-19T08:44:31.169922+0000","last_clean":"2024-09-19T08:44:31.169922+0000","last_became_active":"2024-09-19T08:42:42.408098+0000","last_became_peered":"2024-09-19T08:42:42.408098+0000","last_unstale":"2024-09-19T08:44:31.169922+0000","last_undegraded":"2024-09-19T08:44:31.169922+0000","last_fullsized":"2024-09-19T08:44:31.169922+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:22.603604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225407+0000","last_change":"2024-09-19T08:42:44.039954+0000","last_active":"2024-09-19T08:44:31.225407+0000","last_peered":"2024-09-19T08:44:31.225407+0000","last_clean":"2024-09-19T08:44:31.225407+0000","last_became_active":"2024-09-19T08:42:44.039601+0000","last_became_peered":"2024-09-19T08:42:44.039601+0000","last_unstale":"2024-09-19T08:44:31.225407+0000","last_undegraded":"2024-09-19T08:44:31.225407+0000","last_fullsized":"2024-09-19T08:44:31.225407+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:07.792167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'3","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170390+0000","last_change":"2024-09-19T08:42:41.929644+0000","last_active":"2024-09-19T08:44:31.170390+0000","last_peered":"2024-09-19T08:44:31.170390+0000","last_clean":"2024-09-19T08:44:31.170390+0000","last_became_active":"2024-09-19T08:42:41.929308+0000","last_became_peered":"2024-09-19T08:42:41.929308+0000","last_unstale":"2024-09-19T08:44:31.170390+0000","last_undegraded":"2024-09-19T08:44:31.170390+0000","last_fullsized":"2024-09-19T08:44:31.170390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:36.660470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222570+0000","last_change":"2024-09-19T08:42:58.107555+0000","last_active":"2024-09-19T08:44:31.222570+0000","last_peered":"2024-09-19T08:44:31.222570+0000","last_clean":"2024-09-19T08:44:31.222570+0000","last_became_active":"2024-09-19T08:42:58.107137+0000","last_became_peered":"2024-09-19T08:42:58.107137+0000","last_unstale":"2024-09-19T08:44:31.222570+0000","last_undegraded":"2024-09-19T08:44:31.222570+0000","last_fullsized":"2024-09-19T08:44:31.222570+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:13.198911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.176594+0000","last_change":"2024-09-19T08:42:41.925195+0000","last_active":"2024-09-19T08:44:31.176594+0000","last_peered":"2024-09-19T08:44:31.176594+0000","last_clean":"2024-09-19T08:44:31.176594+0000","last_became_active":"2024-09-19T08:42:41.924880+0000","last_became_peered":"2024-09-19T08:42:41.924880+0000","last_unstale":"2024-09-19T08:44:31.176594+0000","last_undegraded":"2024-09-19T08:44:31.176594+0000","last_fullsized":"2024-09-19T08:44:31.176594+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:11.256881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219778+0000","last_change":"2024-09-19T08:42:44.036439+0000","last_active":"2024-09-19T08:44:31.219778+0000","last_peered":"2024-09-19T08:44:31.219778+0000","last_clean":"2024-09-19T08:44:31.219778+0000","last_became_active":"2024-09-19T08:42:44.036036+0000","last_became_peered":"2024-09-19T08:42:44.036036+0000","last_unstale":"2024-09-19T08:44:31.219778+0000","last_undegraded":"2024-09-19T08:44:31.219778+0000","last_fullsized":"2024-09-19T08:44:31.219778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:37.410782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'39","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.411820+0000","last_change":"2024-09-19T08:42:41.927490+0000","last_active":"2024-09-19T08:44:31.411820+0000","last_peered":"2024-09-19T08:44:31.411820+0000","last_clean":"2024-09-19T08:44:31.411820+0000","last_became_active":"2024-09-19T08:42:41.927163+0000","last_became_peered":"2024-09-19T08:42:41.927163+0000","last_unstale":"2024-09-19T08:44:31.411820+0000","last_undegraded":"2024-09-19T08:44:31.411820+0000","last_fullsized":"2024-09-19T08:44:31.411820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:20.013661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208966+0000","last_change":"2024-09-19T08:42:44.036960+0000","last_active":"2024-09-19T08:44:31.208966+0000","last_peered":"2024-09-19T08:44:31.208966+0000","last_clean":"2024-09-19T08:44:31.208966+0000","last_became_active":"2024-09-19T08:42:44.036600+0000","last_became_peered":"2024-09-19T08:42:44.036600+0000","last_unstale":"2024-09-19T08:44:31.208966+0000","last_undegraded":"2024-09-19T08:44:31.208966+0000","last_fullsized":"2024-09-19T08:44:31.208966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:15.621888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177396+0000","last_change":"2024-09-19T08:42:58.114698+0000","last_active":"2024-09-19T08:44:31.177396+0000","last_peered":"2024-09-19T08:44:31.177396+0000","last_clean":"2024-09-19T08:44:31.177396+0000","last_became_active":"2024-09-19T08:42:58.105488+0000","last_became_peered":"2024-09-19T08:42:58.105488+0000","last_unstale":"2024-09-19T08:44:31.177396+0000","last_undegraded":"2024-09-19T08:44:31.177396+0000","last_fullsized":"2024-09-19T08:44:31.177396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:12.642715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225878+0000","last_change":"2024-09-19T08:42:44.035569+0000","last_active":"2024-09-19T08:44:31.225878+0000","last_peered":"2024-09-19T08:44:31.225878+0000","last_clean":"2024-09-19T08:44:31.225878+0000","last_became_active":"2024-09-19T08:42:44.035277+0000","last_became_peered":"2024-09-19T08:42:44.035277+0000","last_unstale":"2024-09-19T08:44:31.225878+0000","last_undegraded":"2024-09-19T08:44:31.225878+0000","last_fullsized":"2024-09-19T08:44:31.225878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:57.472721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":348,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.179827+0000","last_change":"2024-09-19T08:41:34.769047+0000","last_active":"2024-09-19T08:44:31.179827+0000","last_peered":"2024-09-19T08:44:31.179827+0000","last_clean":"2024-09-19T08:44:31.179827+0000","last_became_active":"2024-09-19T08:41:34.768619+0000","last_became_peered":"2024-09-19T08:41:34.768619+0000","last_unstale":"2024-09-19T08:44:31.179827+0000","last_undegraded":"2024-09-19T08:44:31.179827+0000","last_fullsized":"2024-09-19T08:44:31.179827+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:13.482855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:13.482855+0000","last_clean_scrub_stamp":"2024-09-19T08:38:13.482855+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.390775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177359+0000","last_change":"2024-09-19T08:42:41.925698+0000","last_active":"2024-09-19T08:44:31.177359+0000","last_peered":"2024-09-19T08:44:31.177359+0000","last_clean":"2024-09-19T08:44:31.177359+0000","last_became_active":"2024-09-19T08:42:41.924618+0000","last_became_peered":"2024-09-19T08:42:41.924618+0000","last_unstale":"2024-09-19T08:44:31.177359+0000","last_undegraded":"2024-09-19T08:44:31.177359+0000","last_fullsized":"2024-09-19T08:44:31.177359+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:53.717139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222668+0000","last_change":"2024-09-19T08:42:58.111206+0000","last_active":"2024-09-19T08:44:31.222668+0000","last_peered":"2024-09-19T08:44:31.222668+0000","last_clean":"2024-09-19T08:44:31.222668+0000","last_became_active":"2024-09-19T08:42:58.110765+0000","last_became_peered":"2024-09-19T08:42:58.110765+0000","last_unstale":"2024-09-19T08:44:31.222668+0000","last_undegraded":"2024-09-19T08:44:31.222668+0000","last_fullsized":"2024-09-19T08:44:31.222668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:44.783938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.179827+0000","last_change":"2024-09-19T08:42:41.928414+0000","last_active":"2024-09-19T08:44:31.179827+0000","last_peered":"2024-09-19T08:44:31.179827+0000","last_clean":"2024-09-19T08:44:31.179827+0000","last_became_active":"2024-09-19T08:42:41.928055+0000","last_became_peered":"2024-09-19T08:42:41.928055+0000","last_unstale":"2024-09-19T08:44:31.179827+0000","last_undegraded":"2024-09-19T08:44:31.179827+0000","last_fullsized":"2024-09-19T08:44:31.179827+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:12.688379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.197630+0000","last_change":"2024-09-19T08:42:44.035439+0000","last_active":"2024-09-19T08:44:31.197630+0000","last_peered":"2024-09-19T08:44:31.197630+0000","last_clean":"2024-09-19T08:44:31.197630+0000","last_became_active":"2024-09-19T08:42:44.035150+0000","last_became_peered":"2024-09-19T08:42:44.035150+0000","last_unstale":"2024-09-19T08:44:31.197630+0000","last_undegraded":"2024-09-19T08:44:31.197630+0000","last_fullsized":"2024-09-19T08:44:31.197630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:15.230660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":127,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177891+0000","last_change":"2024-09-19T08:42:42.407784+0000","last_active":"2024-09-19T08:44:31.177891+0000","last_peered":"2024-09-19T08:44:31.177891+0000","last_clean":"2024-09-19T08:44:31.177891+0000","last_became_active":"2024-09-19T08:42:42.407437+0000","last_became_peered":"2024-09-19T08:42:42.407437+0000","last_unstale":"2024-09-19T08:44:31.177891+0000","last_undegraded":"2024-09-19T08:44:31.177891+0000","last_fullsized":"2024-09-19T08:44:31.177891+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:44.829338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212600+0000","last_change":"2024-09-19T08:42:44.039780+0000","last_active":"2024-09-19T08:44:31.212600+0000","last_peered":"2024-09-19T08:44:31.212600+0000","last_clean":"2024-09-19T08:44:31.212600+0000","last_became_active":"2024-09-19T08:42:44.039441+0000","last_became_peered":"2024-09-19T08:42:44.039441+0000","last_unstale":"2024-09-19T08:44:31.212600+0000","last_undegraded":"2024-09-19T08:44:31.212600+0000","last_fullsized":"2024-09-19T08:44:31.212600+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:31.013663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.180830+0000","last_change":"2024-09-19T08:42:41.926998+0000","last_active":"2024-09-19T08:44:31.180830+0000","last_peered":"2024-09-19T08:44:31.180830+0000","last_clean":"2024-09-19T08:44:31.180830+0000","last_became_active":"2024-09-19T08:42:41.926560+0000","last_became_peered":"2024-09-19T08:42:41.926560+0000","last_unstale":"2024-09-19T08:44:31.180830+0000","last_undegraded":"2024-09-19T08:44:31.180830+0000","last_fullsized":"2024-09-19T08:44:31.180830+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:35.338601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225659+0000","last_change":"2024-09-19T08:42:44.039948+0000","last_active":"2024-09-19T08:44:31.225659+0000","last_peered":"2024-09-19T08:44:31.225659+0000","last_clean":"2024-09-19T08:44:31.225659+0000","last_became_active":"2024-09-19T08:42:44.038797+0000","last_became_peered":"2024-09-19T08:42:44.038797+0000","last_unstale":"2024-09-19T08:44:31.225659+0000","last_undegraded":"2024-09-19T08:44:31.225659+0000","last_fullsized":"2024-09-19T08:44:31.225659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:19.273191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.168583+0000","last_change":"2024-09-19T08:42:42.409954+0000","last_active":"2024-09-19T08:44:31.168583+0000","last_peered":"2024-09-19T08:44:31.168583+0000","last_clean":"2024-09-19T08:44:31.168583+0000","last_became_active":"2024-09-19T08:42:42.409388+0000","last_became_peered":"2024-09-19T08:42:42.409388+0000","last_unstale":"2024-09-19T08:44:31.168583+0000","last_undegraded":"2024-09-19T08:44:31.168583+0000","last_fullsized":"2024-09-19T08:44:31.168583+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:58.764877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.213210+0000","last_change":"2024-09-19T08:42:44.024360+0000","last_active":"2024-09-19T08:44:31.213210+0000","last_peered":"2024-09-19T08:44:31.213210+0000","last_clean":"2024-09-19T08:44:31.213210+0000","last_became_active":"2024-09-19T08:42:44.023703+0000","last_became_peered":"2024-09-19T08:42:44.023703+0000","last_unstale":"2024-09-19T08:44:31.213210+0000","last_undegraded":"2024-09-19T08:44:31.213210+0000","last_fullsized":"2024-09-19T08:44:31.213210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:10.852199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170383+0000","last_change":"2024-09-19T08:42:42.408101+0000","last_active":"2024-09-19T08:44:31.170383+0000","last_peered":"2024-09-19T08:44:31.170383+0000","last_clean":"2024-09-19T08:44:31.170383+0000","last_became_active":"2024-09-19T08:42:42.407692+0000","last_became_peered":"2024-09-19T08:42:42.407692+0000","last_unstale":"2024-09-19T08:44:31.170383+0000","last_undegraded":"2024-09-19T08:44:31.170383+0000","last_fullsized":"2024-09-19T08:44:31.170383+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:01.342213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.217468+0000","last_change":"2024-09-19T08:42:44.026612+0000","last_active":"2024-09-19T08:44:31.217468+0000","last_peered":"2024-09-19T08:44:31.217468+0000","last_clean":"2024-09-19T08:44:31.217468+0000","last_became_active":"2024-09-19T08:42:44.025408+0000","last_became_peered":"2024-09-19T08:42:44.025408+0000","last_unstale":"2024-09-19T08:44:31.217468+0000","last_undegraded":"2024-09-19T08:44:31.217468+0000","last_fullsized":"2024-09-19T08:44:31.217468+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:19.465342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'46","reported_seq":93,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.419159+0000","last_change":"2024-09-19T08:42:41.927561+0000","last_active":"2024-09-19T08:44:31.419159+0000","last_peered":"2024-09-19T08:44:31.419159+0000","last_clean":"2024-09-19T08:44:31.419159+0000","last_became_active":"2024-09-19T08:42:41.927159+0000","last_became_peered":"2024-09-19T08:42:41.927159+0000","last_unstale":"2024-09-19T08:44:31.419159+0000","last_undegraded":"2024-09-19T08:44:31.419159+0000","last_fullsized":"2024-09-19T08:44:31.419159+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:13.352727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":83,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.220812+0000","last_change":"2024-09-19T08:42:44.028129+0000","last_active":"2024-09-19T08:44:31.220812+0000","last_peered":"2024-09-19T08:44:31.220812+0000","last_clean":"2024-09-19T08:44:31.220812+0000","last_became_active":"2024-09-19T08:42:44.027826+0000","last_became_peered":"2024-09-19T08:42:44.027826+0000","last_unstale":"2024-09-19T08:44:31.220812+0000","last_undegraded":"2024-09-19T08:44:31.220812+0000","last_fullsized":"2024-09-19T08:44:31.220812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:03.129404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177705+0000","last_change":"2024-09-19T08:42:41.920264+0000","last_active":"2024-09-19T08:44:31.177705+0000","last_peered":"2024-09-19T08:44:31.177705+0000","last_clean":"2024-09-19T08:44:31.177705+0000","last_became_active":"2024-09-19T08:42:41.919655+0000","last_became_peered":"2024-09-19T08:42:41.919655+0000","last_unstale":"2024-09-19T08:44:31.177705+0000","last_undegraded":"2024-09-19T08:44:31.177705+0000","last_fullsized":"2024-09-19T08:44:31.177705+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:58.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226014+0000","last_change":"2024-09-19T08:42:44.039655+0000","last_active":"2024-09-19T08:44:31.226014+0000","last_peered":"2024-09-19T08:44:31.226014+0000","last_clean":"2024-09-19T08:44:31.226014+0000","last_became_active":"2024-09-19T08:42:44.039317+0000","last_became_peered":"2024-09-19T08:42:44.039317+0000","last_unstale":"2024-09-19T08:44:31.226014+0000","last_undegraded":"2024-09-19T08:44:31.226014+0000","last_fullsized":"2024-09-19T08:44:31.226014+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:19.064194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.169944+0000","last_change":"2024-09-19T08:42:42.408582+0000","last_active":"2024-09-19T08:44:31.169944+0000","last_peered":"2024-09-19T08:44:31.169944+0000","last_clean":"2024-09-19T08:44:31.169944+0000","last_became_active":"2024-09-19T08:42:42.408143+0000","last_became_peered":"2024-09-19T08:42:42.408143+0000","last_unstale":"2024-09-19T08:44:31.169944+0000","last_undegraded":"2024-09-19T08:44:31.169944+0000","last_fullsized":"2024-09-19T08:44:31.169944+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.526138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.195758+0000","last_change":"2024-09-19T08:42:44.034795+0000","last_active":"2024-09-19T08:44:31.195758+0000","last_peered":"2024-09-19T08:44:31.195758+0000","last_clean":"2024-09-19T08:44:31.195758+0000","last_became_active":"2024-09-19T08:42:44.034440+0000","last_became_peered":"2024-09-19T08:42:44.034440+0000","last_unstale":"2024-09-19T08:44:31.195758+0000","last_undegraded":"2024-09-19T08:44:31.195758+0000","last_fullsized":"2024-09-19T08:44:31.195758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:50.470240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.179034+0000","last_change":"2024-09-19T08:42:41.922621+0000","last_active":"2024-09-19T08:44:31.179034+0000","last_peered":"2024-09-19T08:44:31.179034+0000","last_clean":"2024-09-19T08:44:31.179034+0000","last_became_active":"2024-09-19T08:42:41.922303+0000","last_became_peered":"2024-09-19T08:42:41.922303+0000","last_unstale":"2024-09-19T08:44:31.179034+0000","last_undegraded":"2024-09-19T08:44:31.179034+0000","last_fullsized":"2024-09-19T08:44:31.179034+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:48.017892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225447+0000","last_change":"2024-09-19T08:42:44.028307+0000","last_active":"2024-09-19T08:44:31.225447+0000","last_peered":"2024-09-19T08:44:31.225447+0000","last_clean":"2024-09-19T08:44:31.225447+0000","last_became_active":"2024-09-19T08:42:44.026848+0000","last_became_peered":"2024-09-19T08:42:44.026848+0000","last_unstale":"2024-09-19T08:44:31.225447+0000","last_undegraded":"2024-09-19T08:44:31.225447+0000","last_fullsized":"2024-09-19T08:44:31.225447+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:20.768075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.180483+0000","last_change":"2024-09-19T08:42:41.929479+0000","last_active":"2024-09-19T08:44:31.180483+0000","last_peered":"2024-09-19T08:44:31.180483+0000","last_clean":"2024-09-19T08:44:31.180483+0000","last_became_active":"2024-09-19T08:42:41.928508+0000","last_became_peered":"2024-09-19T08:42:41.928508+0000","last_unstale":"2024-09-19T08:44:31.180483+0000","last_undegraded":"2024-09-19T08:44:31.180483+0000","last_fullsized":"2024-09-19T08:44:31.180483+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:46.108471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.205207+0000","last_change":"2024-09-19T08:42:44.028694+0000","last_active":"2024-09-19T08:44:31.205207+0000","last_peered":"2024-09-19T08:44:31.205207+0000","last_clean":"2024-09-19T08:44:31.205207+0000","last_became_active":"2024-09-19T08:42:44.027382+0000","last_became_peered":"2024-09-19T08:42:44.027382+0000","last_unstale":"2024-09-19T08:44:31.205207+0000","last_undegraded":"2024-09-19T08:44:31.205207+0000","last_fullsized":"2024-09-19T08:44:31.205207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:40.877505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170090+0000","last_change":"2024-09-19T08:42:41.931016+0000","last_active":"2024-09-19T08:44:31.170090+0000","last_peered":"2024-09-19T08:44:31.170090+0000","last_clean":"2024-09-19T08:44:31.170090+0000","last_became_active":"2024-09-19T08:42:41.930648+0000","last_became_peered":"2024-09-19T08:42:41.930648+0000","last_unstale":"2024-09-19T08:44:31.170090+0000","last_undegraded":"2024-09-19T08:44:31.170090+0000","last_fullsized":"2024-09-19T08:44:31.170090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:32.031025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226346+0000","last_change":"2024-09-19T08:42:44.035288+0000","last_active":"2024-09-19T08:44:31.226346+0000","last_peered":"2024-09-19T08:44:31.226346+0000","last_clean":"2024-09-19T08:44:31.226346+0000","last_became_active":"2024-09-19T08:42:44.034660+0000","last_became_peered":"2024-09-19T08:42:44.034660+0000","last_unstale":"2024-09-19T08:44:31.226346+0000","last_undegraded":"2024-09-19T08:44:31.226346+0000","last_fullsized":"2024-09-19T08:44:31.226346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:48.703463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225736+0000","last_change":"2024-09-19T08:42:44.040123+0000","last_active":"2024-09-19T08:44:31.225736+0000","last_peered":"2024-09-19T08:44:31.225736+0000","last_clean":"2024-09-19T08:44:31.225736+0000","last_became_active":"2024-09-19T08:42:44.039488+0000","last_became_peered":"2024-09-19T08:42:44.039488+0000","last_unstale":"2024-09-19T08:44:31.225736+0000","last_undegraded":"2024-09-19T08:44:31.225736+0000","last_fullsized":"2024-09-19T08:44:31.225736+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:15.273044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170228+0000","last_change":"2024-09-19T08:42:41.932400+0000","last_active":"2024-09-19T08:44:31.170228+0000","last_peered":"2024-09-19T08:44:31.170228+0000","last_clean":"2024-09-19T08:44:31.170228+0000","last_became_active":"2024-09-19T08:42:41.932020+0000","last_became_peered":"2024-09-19T08:42:41.932020+0000","last_unstale":"2024-09-19T08:44:31.170228+0000","last_undegraded":"2024-09-19T08:44:31.170228+0000","last_fullsized":"2024-09-19T08:44:31.170228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:08.583287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.221219+0000","last_change":"2024-09-19T08:42:44.026173+0000","last_active":"2024-09-19T08:44:31.221219+0000","last_peered":"2024-09-19T08:44:31.221219+0000","last_clean":"2024-09-19T08:44:31.221219+0000","last_became_active":"2024-09-19T08:42:44.024614+0000","last_became_peered":"2024-09-19T08:42:44.024614+0000","last_unstale":"2024-09-19T08:44:31.221219+0000","last_undegraded":"2024-09-19T08:44:31.221219+0000","last_fullsized":"2024-09-19T08:44:31.221219+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:42.695660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170318+0000","last_change":"2024-09-19T08:42:41.929576+0000","last_active":"2024-09-19T08:44:31.170318+0000","last_peered":"2024-09-19T08:44:31.170318+0000","last_clean":"2024-09-19T08:44:31.170318+0000","last_became_active":"2024-09-19T08:42:41.929231+0000","last_became_peered":"2024-09-19T08:42:41.929231+0000","last_unstale":"2024-09-19T08:44:31.170318+0000","last_undegraded":"2024-09-19T08:44:31.170318+0000","last_fullsized":"2024-09-19T08:44:31.170318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:54.492198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226525+0000","last_change":"2024-09-19T08:42:44.028612+0000","last_active":"2024-09-19T08:44:31.226525+0000","last_peered":"2024-09-19T08:44:31.226525+0000","last_clean":"2024-09-19T08:44:31.226525+0000","last_became_active":"2024-09-19T08:42:44.028301+0000","last_became_peered":"2024-09-19T08:42:44.028301+0000","last_unstale":"2024-09-19T08:44:31.226525+0000","last_undegraded":"2024-09-19T08:44:31.226525+0000","last_fullsized":"2024-09-19T08:44:31.226525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:03:09.539350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178947+0000","last_change":"2024-09-19T08:42:42.407931+0000","last_active":"2024-09-19T08:44:31.178947+0000","last_peered":"2024-09-19T08:44:31.178947+0000","last_clean":"2024-09-19T08:44:31.178947+0000","last_became_active":"2024-09-19T08:42:42.407573+0000","last_became_peered":"2024-09-19T08:42:42.407573+0000","last_unstale":"2024-09-19T08:44:31.178947+0000","last_undegraded":"2024-09-19T08:44:31.178947+0000","last_fullsized":"2024-09-19T08:44:31.178947+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:55.095275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.209474+0000","last_change":"2024-09-19T08:42:44.034109+0000","last_active":"2024-09-19T08:44:31.209474+0000","last_peered":"2024-09-19T08:44:31.209474+0000","last_clean":"2024-09-19T08:44:31.209474+0000","last_became_active":"2024-09-19T08:42:44.033753+0000","last_became_peered":"2024-09-19T08:42:44.033753+0000","last_unstale":"2024-09-19T08:44:31.209474+0000","last_undegraded":"2024-09-19T08:44:31.209474+0000","last_fullsized":"2024-09-19T08:44:31.209474+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:08.475476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.168653+0000","last_change":"2024-09-19T08:42:58.120292+0000","last_active":"2024-09-19T08:44:31.168653+0000","last_peered":"2024-09-19T08:44:31.168653+0000","last_clean":"2024-09-19T08:44:31.168653+0000","last_became_active":"2024-09-19T08:42:58.109929+0000","last_became_peered":"2024-09-19T08:42:58.109929+0000","last_unstale":"2024-09-19T08:44:31.168653+0000","last_undegraded":"2024-09-19T08:44:31.168653+0000","last_fullsized":"2024-09-19T08:44:31.168653+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:56.196868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":597461,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":711,"num_read_kb":462,"num_write":292,"num_write_kb":1438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1198,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":1792383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579939,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":442307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32952,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712200,"statfs":{"total":95995035648,"available":95961292800,"internally_reserved":0,"allocated":1748992,"data_stored":1232179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939692,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":925696,"data_stored":441927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168625,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28316,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716836,"statfs":{"total":95995035648,"available":95966040064,"internally_reserved":0,"allocated":1318912,"data_stored":835063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397557,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1515520,"data_stored":1035359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561083,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":441316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790014,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1531904,"data_stored":1033912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953541,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":442869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215178,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40928,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704224,"statfs":{"total":95995035648,"available":95953125376,"internally_reserved":0,"allocated":1458176,"data_stored":966443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444110,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":999424,"data_stored":509951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":978944,"data_stored":506803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":933888,"data_stored":442587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":200585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:44:36.788 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-19T08:44:36.788 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:44:36.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.929+0000 7f07fad59640 1 -- 172.21.15.7:0/3021286866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f4101370 msgr2=0x7f07f410d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:36.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.929+0000 7f07fad59640 1 --2- 172.21.15.7:0/3021286866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f4101370 0x7f07f410d8a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009cd0 tx=0x7f07ec02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.929+0000 7f07fad59640 1 -- 172.21.15.7:0/3021286866 shutdown_connections 2024-09-19T08:44:36.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.929+0000 7f07fad59640 1 --2- 172.21.15.7:0/3021286866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f4101370 0x7f07f410d8a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.929+0000 7f07fad59640 1 --2- 172.21.15.7:0/3021286866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f41009d0 0x7f07f4100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.929+0000 7f07fad59640 1 --2- 172.21.15.7:0/3021286866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07f41069e0 0x7f07f4106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.929+0000 7f07fad59640 1 -- 172.21.15.7:0/3021286866 >> 172.21.15.7:0/3021286866 conn(0x7f07f40fc6b0 msgr2=0x7f07f40fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:36.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.929+0000 7f07fad59640 1 -- 172.21.15.7:0/3021286866 shutdown_connections 2024-09-19T08:44:36.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.929+0000 7f07fad59640 1 -- 172.21.15.7:0/3021286866 wait complete. 2024-09-19T08:44:36.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.930+0000 7f07fad59640 1 Processor -- start 2024-09-19T08:44:36.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.930+0000 7f07fad59640 1 -- start start 2024-09-19T08:44:36.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.930+0000 7f07fad59640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07f41009d0 0x7f07f419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:36.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.930+0000 7f07fad59640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f4101370 0x7f07f419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:36.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.930+0000 7f07fad59640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f41069e0 0x7f07f419eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:36.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.930+0000 7f07fad59640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f07f4110e20 con 0x7f07f41069e0 2024-09-19T08:44:36.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.930+0000 7f07fad59640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f07f4110ca0 con 0x7f07f4101370 2024-09-19T08:44:36.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.930+0000 7f07fad59640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f07f4110fa0 con 0x7f07f41009d0 2024-09-19T08:44:36.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.930+0000 7f07f92f6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f41069e0 0x7f07f419eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:36.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.930+0000 7f07f92f6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f41069e0 0x7f07f419eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53350/0 (socket says 172.21.15.7:53350) 2024-09-19T08:44:36.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.930+0000 7f07f3fff640 1 --2- 172.21.15.7:0/3207207453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f4101370 0x7f07f419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:36.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.930+0000 7f07f92f6640 1 -- 172.21.15.7:0/3207207453 learned_addr learned my addr 172.21.15.7:0/3207207453 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:36.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.930+0000 7f07f8af5640 1 --2- 172.21.15.7:0/3207207453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07f41009d0 0x7f07f419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:36.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.930+0000 7f07f92f6640 1 -- 172.21.15.7:0/3207207453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07f41009d0 msgr2=0x7f07f419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:36.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.930+0000 7f07f92f6640 1 --2- 172.21.15.7:0/3207207453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07f41009d0 0x7f07f419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.930+0000 7f07f92f6640 1 -- 172.21.15.7:0/3207207453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f4101370 msgr2=0x7f07f419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:36.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.930+0000 7f07f92f6640 1 --2- 172.21.15.7:0/3207207453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f4101370 0x7f07f419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:36.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.930+0000 7f07f92f6640 1 -- 172.21.15.7:0/3207207453 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f419f5d0 con 0x7f07f41069e0 2024-09-19T08:44:36.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.930+0000 7f07f3fff640 1 --2- 172.21.15.7:0/3207207453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f4101370 0x7f07f419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:44:36.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.931+0000 7f07f92f6640 1 --2- 172.21.15.7:0/3207207453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f41069e0 0x7f07f419eea0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f07ec005cc0 tx=0x7f07ec032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:36.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.931+0000 7f07f1ffb640 1 -- 172.21.15.7:0/3207207453 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec004040 con 0x7f07f41069e0 2024-09-19T08:44:36.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.931+0000 7f07f1ffb640 1 -- 172.21.15.7:0/3207207453 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07ec0046c0 con 0x7f07f41069e0 2024-09-19T08:44:36.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.931+0000 7f07f1ffb640 1 -- 172.21.15.7:0/3207207453 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec030e00 con 0x7f07f41069e0 2024-09-19T08:44:36.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.931+0000 7f07fad59640 1 -- 172.21.15.7:0/3207207453 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07f419f860 con 0x7f07f41069e0 2024-09-19T08:44:36.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.931+0000 7f07fad59640 1 -- 172.21.15.7:0/3207207453 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07f41a7150 con 0x7f07f41069e0 2024-09-19T08:44:36.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.932+0000 7f07fad59640 1 -- 172.21.15.7:0/3207207453 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07f4100e30 con 0x7f07f41069e0 2024-09-19T08:44:36.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.933+0000 7f07f1ffb640 1 -- 172.21.15.7:0/3207207453 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f07ec0305a0 con 0x7f07f41069e0 2024-09-19T08:44:36.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.934+0000 7f07f1ffb640 1 --2- 172.21.15.7:0/3207207453 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f07e00a3450 0x7f07e00a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:36.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.934+0000 7f07f8af5640 1 --2- 172.21.15.7:0/3207207453 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f07e00a3450 0x7f07e00a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:36.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.934+0000 7f07f1ffb640 1 -- 172.21.15.7:0/3207207453 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f07ec02e030 con 0x7f07f41069e0 2024-09-19T08:44:36.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.934+0000 7f07f8af5640 1 --2- 172.21.15.7:0/3207207453 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f07e00a3450 0x7f07e00a5910 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07e4005fd0 tx=0x7f07e400b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:36.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:36.938+0000 7f07f1ffb640 1 -- 172.21.15.7:0/3207207453 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f07ec04b060 con 0x7f07f41069e0 2024-09-19T08:44:37.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:36 smithi007 ceph-mon[31221]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:44:37.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:36 smithi007 ceph-mon[31221]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-09-19T08:44:37.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.113+0000 7f07fad59640 1 -- 172.21.15.7:0/3207207453 --> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f07f406aa80 con 0x7f07e00a3450 2024-09-19T08:44:37.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.119+0000 7f07f1ffb640 1 -- 172.21.15.7:0/3207207453 <== mgr.15132 v2:172.21.15.7:6800/3061932294 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257852 (secure 0 0 0) 0x7f07f406aa80 con 0x7f07e00a3450 2024-09-19T08:44:37.123 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:44:37.124 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-19T08:44:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.122+0000 7f07fad59640 1 -- 172.21.15.7:0/3207207453 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f07e00a3450 msgr2=0x7f07e00a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.122+0000 7f07fad59640 1 --2- 172.21.15.7:0/3207207453 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f07e00a3450 0x7f07e00a5910 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07e4005fd0 tx=0x7f07e400b390 comp rx=0 tx=0).stop 2024-09-19T08:44:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.122+0000 7f07fad59640 1 -- 172.21.15.7:0/3207207453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f41069e0 msgr2=0x7f07f419eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.122+0000 7f07fad59640 1 --2- 172.21.15.7:0/3207207453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f41069e0 0x7f07f419eea0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f07ec005cc0 tx=0x7f07ec032f40 comp rx=0 tx=0).stop 2024-09-19T08:44:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.122+0000 7f07fad59640 1 -- 172.21.15.7:0/3207207453 shutdown_connections 2024-09-19T08:44:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.122+0000 7f07fad59640 1 --2- 172.21.15.7:0/3207207453 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f07e00a3450 0x7f07e00a5910 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.122+0000 7f07fad59640 1 --2- 172.21.15.7:0/3207207453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f41069e0 0x7f07f419eea0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.122+0000 7f07fad59640 1 --2- 172.21.15.7:0/3207207453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07f4101370 0x7f07f419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.122+0000 7f07fad59640 1 --2- 172.21.15.7:0/3207207453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07f41009d0 0x7f07f419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.122+0000 7f07fad59640 1 -- 172.21.15.7:0/3207207453 >> 172.21.15.7:0/3207207453 conn(0x7f07f40fc6b0 msgr2=0x7f07f406a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.122+0000 7f07fad59640 1 -- 172.21.15.7:0/3207207453 shutdown_connections 2024-09-19T08:44:37.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.122+0000 7f07fad59640 1 -- 172.21.15.7:0/3207207453 wait complete. 2024-09-19T08:44:37.133 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T08:44:35.182411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188063,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":847,"num_read_kb":581,"num_write":475,"num_write_kb":4378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1181934,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":867,"ondisk_log_size":867,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367340,"kb_used_data":13832,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124574484,"statfs":{"total":1151940427776,"available":1151564271616,"internally_reserved":0,"allocated":14163968,"data_stored":8330716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.989206"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226071+0000","last_change":"2024-09-19T08:42:44.035697+0000","last_active":"2024-09-19T08:44:31.226071+0000","last_peered":"2024-09-19T08:44:31.226071+0000","last_clean":"2024-09-19T08:44:31.226071+0000","last_became_active":"2024-09-19T08:42:44.035400+0000","last_became_peered":"2024-09-19T08:42:44.035400+0000","last_unstale":"2024-09-19T08:44:31.226071+0000","last_undegraded":"2024-09-19T08:44:31.226071+0000","last_fullsized":"2024-09-19T08:44:31.226071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:56.202947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.223958+0000","last_change":"2024-09-19T08:42:44.031393+0000","last_active":"2024-09-19T08:44:31.223958+0000","last_peered":"2024-09-19T08:44:31.223958+0000","last_clean":"2024-09-19T08:44:31.223958+0000","last_became_active":"2024-09-19T08:42:44.031056+0000","last_became_peered":"2024-09-19T08:42:44.031056+0000","last_unstale":"2024-09-19T08:44:31.223958+0000","last_undegraded":"2024-09-19T08:44:31.223958+0000","last_fullsized":"2024-09-19T08:44:31.223958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:44.694913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224221+0000","last_change":"2024-09-19T08:42:44.029586+0000","last_active":"2024-09-19T08:44:31.224221+0000","last_peered":"2024-09-19T08:44:31.224221+0000","last_clean":"2024-09-19T08:44:31.224221+0000","last_became_active":"2024-09-19T08:42:44.029279+0000","last_became_peered":"2024-09-19T08:42:44.029279+0000","last_unstale":"2024-09-19T08:44:31.224221+0000","last_undegraded":"2024-09-19T08:44:31.224221+0000","last_fullsized":"2024-09-19T08:44:31.224221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:12.036113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219401+0000","last_change":"2024-09-19T08:42:44.043192+0000","last_active":"2024-09-19T08:44:31.219401+0000","last_peered":"2024-09-19T08:44:31.219401+0000","last_clean":"2024-09-19T08:44:31.219401+0000","last_became_active":"2024-09-19T08:42:44.042838+0000","last_became_peered":"2024-09-19T08:42:44.042838+0000","last_unstale":"2024-09-19T08:44:31.219401+0000","last_undegraded":"2024-09-19T08:44:31.219401+0000","last_fullsized":"2024-09-19T08:44:31.219401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:20.549232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.207548+0000","last_change":"2024-09-19T08:42:44.032231+0000","last_active":"2024-09-19T08:44:31.207548+0000","last_peered":"2024-09-19T08:44:31.207548+0000","last_clean":"2024-09-19T08:44:31.207548+0000","last_became_active":"2024-09-19T08:42:44.031835+0000","last_became_peered":"2024-09-19T08:42:44.031835+0000","last_unstale":"2024-09-19T08:44:31.207548+0000","last_undegraded":"2024-09-19T08:44:31.207548+0000","last_fullsized":"2024-09-19T08:44:31.207548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:49.084085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.209888+0000","last_change":"2024-09-19T08:42:44.035487+0000","last_active":"2024-09-19T08:44:31.209888+0000","last_peered":"2024-09-19T08:44:31.209888+0000","last_clean":"2024-09-19T08:44:31.209888+0000","last_became_active":"2024-09-19T08:42:44.035138+0000","last_became_peered":"2024-09-19T08:42:44.035138+0000","last_unstale":"2024-09-19T08:44:31.209888+0000","last_undegraded":"2024-09-19T08:44:31.209888+0000","last_fullsized":"2024-09-19T08:44:31.209888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:43.483397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212841+0000","last_change":"2024-09-19T08:42:44.029052+0000","last_active":"2024-09-19T08:44:31.212841+0000","last_peered":"2024-09-19T08:44:31.212841+0000","last_clean":"2024-09-19T08:44:31.212841+0000","last_became_active":"2024-09-19T08:42:44.028722+0000","last_became_peered":"2024-09-19T08:42:44.028722+0000","last_unstale":"2024-09-19T08:44:31.212841+0000","last_undegraded":"2024-09-19T08:44:31.212841+0000","last_fullsized":"2024-09-19T08:44:31.212841+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:49.226044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212167+0000","last_change":"2024-09-19T08:42:44.031401+0000","last_active":"2024-09-19T08:44:31.212167+0000","last_peered":"2024-09-19T08:44:31.212167+0000","last_clean":"2024-09-19T08:44:31.212167+0000","last_became_active":"2024-09-19T08:42:44.031103+0000","last_became_peered":"2024-09-19T08:42:44.031103+0000","last_unstale":"2024-09-19T08:44:31.212167+0000","last_undegraded":"2024-09-19T08:44:31.212167+0000","last_fullsized":"2024-09-19T08:44:31.212167+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:57.406765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224039+0000","last_change":"2024-09-19T08:42:44.033011+0000","last_active":"2024-09-19T08:44:31.224039+0000","last_peered":"2024-09-19T08:44:31.224039+0000","last_clean":"2024-09-19T08:44:31.224039+0000","last_became_active":"2024-09-19T08:42:44.032075+0000","last_became_peered":"2024-09-19T08:42:44.032075+0000","last_unstale":"2024-09-19T08:44:31.224039+0000","last_undegraded":"2024-09-19T08:44:31.224039+0000","last_fullsized":"2024-09-19T08:44:31.224039+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:43.701684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212881+0000","last_change":"2024-09-19T08:42:44.037417+0000","last_active":"2024-09-19T08:44:31.212881+0000","last_peered":"2024-09-19T08:44:31.212881+0000","last_clean":"2024-09-19T08:44:31.212881+0000","last_became_active":"2024-09-19T08:42:44.037006+0000","last_became_peered":"2024-09-19T08:42:44.037006+0000","last_unstale":"2024-09-19T08:44:31.212881+0000","last_undegraded":"2024-09-19T08:44:31.212881+0000","last_fullsized":"2024-09-19T08:44:31.212881+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:10.952939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225737+0000","last_change":"2024-09-19T08:42:44.034125+0000","last_active":"2024-09-19T08:44:31.225737+0000","last_peered":"2024-09-19T08:44:31.225737+0000","last_clean":"2024-09-19T08:44:31.225737+0000","last_became_active":"2024-09-19T08:42:44.033772+0000","last_became_peered":"2024-09-19T08:42:44.033772+0000","last_unstale":"2024-09-19T08:44:31.225737+0000","last_undegraded":"2024-09-19T08:44:31.225737+0000","last_fullsized":"2024-09-19T08:44:31.225737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:42.854137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219105+0000","last_change":"2024-09-19T08:42:44.043047+0000","last_active":"2024-09-19T08:44:31.219105+0000","last_peered":"2024-09-19T08:44:31.219105+0000","last_clean":"2024-09-19T08:44:31.219105+0000","last_became_active":"2024-09-19T08:42:44.042666+0000","last_became_peered":"2024-09-19T08:42:44.042666+0000","last_unstale":"2024-09-19T08:44:31.219105+0000","last_undegraded":"2024-09-19T08:44:31.219105+0000","last_fullsized":"2024-09-19T08:44:31.219105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:16.504824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208420+0000","last_change":"2024-09-19T08:42:44.026475+0000","last_active":"2024-09-19T08:44:31.208420+0000","last_peered":"2024-09-19T08:44:31.208420+0000","last_clean":"2024-09-19T08:44:31.208420+0000","last_became_active":"2024-09-19T08:42:44.026169+0000","last_became_peered":"2024-09-19T08:42:44.026169+0000","last_unstale":"2024-09-19T08:44:31.208420+0000","last_undegraded":"2024-09-19T08:44:31.208420+0000","last_fullsized":"2024-09-19T08:44:31.208420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:17.130267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222128+0000","last_change":"2024-09-19T08:42:44.033725+0000","last_active":"2024-09-19T08:44:31.222128+0000","last_peered":"2024-09-19T08:44:31.222128+0000","last_clean":"2024-09-19T08:44:31.222128+0000","last_became_active":"2024-09-19T08:42:44.033304+0000","last_became_peered":"2024-09-19T08:42:44.033304+0000","last_unstale":"2024-09-19T08:44:31.222128+0000","last_undegraded":"2024-09-19T08:44:31.222128+0000","last_fullsized":"2024-09-19T08:44:31.222128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:47.520808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224694+0000","last_change":"2024-09-19T08:42:44.041762+0000","last_active":"2024-09-19T08:44:31.224694+0000","last_peered":"2024-09-19T08:44:31.224694+0000","last_clean":"2024-09-19T08:44:31.224694+0000","last_became_active":"2024-09-19T08:42:44.041433+0000","last_became_peered":"2024-09-19T08:42:44.041433+0000","last_unstale":"2024-09-19T08:44:31.224694+0000","last_undegraded":"2024-09-19T08:44:31.224694+0000","last_fullsized":"2024-09-19T08:44:31.224694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:05.504873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226669+0000","last_change":"2024-09-19T08:42:44.030316+0000","last_active":"2024-09-19T08:44:31.226669+0000","last_peered":"2024-09-19T08:44:31.226669+0000","last_clean":"2024-09-19T08:44:31.226669+0000","last_became_active":"2024-09-19T08:42:44.029872+0000","last_became_peered":"2024-09-19T08:42:44.029872+0000","last_unstale":"2024-09-19T08:44:31.226669+0000","last_undegraded":"2024-09-19T08:44:31.226669+0000","last_fullsized":"2024-09-19T08:44:31.226669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:18.011019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226224+0000","last_change":"2024-09-19T08:42:44.035523+0000","last_active":"2024-09-19T08:44:31.226224+0000","last_peered":"2024-09-19T08:44:31.226224+0000","last_clean":"2024-09-19T08:44:31.226224+0000","last_became_active":"2024-09-19T08:42:44.035185+0000","last_became_peered":"2024-09-19T08:42:44.035185+0000","last_unstale":"2024-09-19T08:44:31.226224+0000","last_undegraded":"2024-09-19T08:44:31.226224+0000","last_fullsized":"2024-09-19T08:44:31.226224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:03.475458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222791+0000","last_change":"2024-09-19T08:42:44.031803+0000","last_active":"2024-09-19T08:44:31.222791+0000","last_peered":"2024-09-19T08:44:31.222791+0000","last_clean":"2024-09-19T08:44:31.222791+0000","last_became_active":"2024-09-19T08:42:44.031501+0000","last_became_peered":"2024-09-19T08:42:44.031501+0000","last_unstale":"2024-09-19T08:44:31.222791+0000","last_undegraded":"2024-09-19T08:44:31.222791+0000","last_fullsized":"2024-09-19T08:44:31.222791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:31.780744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.211603+0000","last_change":"2024-09-19T08:42:44.036168+0000","last_active":"2024-09-19T08:44:31.211603+0000","last_peered":"2024-09-19T08:44:31.211603+0000","last_clean":"2024-09-19T08:44:31.211603+0000","last_became_active":"2024-09-19T08:42:44.035819+0000","last_became_peered":"2024-09-19T08:42:44.035819+0000","last_unstale":"2024-09-19T08:44:31.211603+0000","last_undegraded":"2024-09-19T08:44:31.211603+0000","last_fullsized":"2024-09-19T08:44:31.211603+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:26.478389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.220605+0000","last_change":"2024-09-19T08:42:44.037569+0000","last_active":"2024-09-19T08:44:31.220605+0000","last_peered":"2024-09-19T08:44:31.220605+0000","last_clean":"2024-09-19T08:44:31.220605+0000","last_became_active":"2024-09-19T08:42:44.037161+0000","last_became_peered":"2024-09-19T08:42:44.037161+0000","last_unstale":"2024-09-19T08:44:31.220605+0000","last_undegraded":"2024-09-19T08:44:31.220605+0000","last_fullsized":"2024-09-19T08:44:31.220605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:35.316314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226011+0000","last_change":"2024-09-19T08:42:44.023160+0000","last_active":"2024-09-19T08:44:31.226011+0000","last_peered":"2024-09-19T08:44:31.226011+0000","last_clean":"2024-09-19T08:44:31.226011+0000","last_became_active":"2024-09-19T08:42:44.022791+0000","last_became_peered":"2024-09-19T08:42:44.022791+0000","last_unstale":"2024-09-19T08:44:31.226011+0000","last_undegraded":"2024-09-19T08:44:31.226011+0000","last_fullsized":"2024-09-19T08:44:31.226011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:00.174583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225075+0000","last_change":"2024-09-19T08:42:44.035877+0000","last_active":"2024-09-19T08:44:31.225075+0000","last_peered":"2024-09-19T08:44:31.225075+0000","last_clean":"2024-09-19T08:44:31.225075+0000","last_became_active":"2024-09-19T08:42:44.035307+0000","last_became_peered":"2024-09-19T08:42:44.035307+0000","last_unstale":"2024-09-19T08:44:31.225075+0000","last_undegraded":"2024-09-19T08:44:31.225075+0000","last_fullsized":"2024-09-19T08:44:31.225075+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:54.717130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219964+0000","last_change":"2024-09-19T08:42:44.033536+0000","last_active":"2024-09-19T08:44:31.219964+0000","last_peered":"2024-09-19T08:44:31.219964+0000","last_clean":"2024-09-19T08:44:31.219964+0000","last_became_active":"2024-09-19T08:42:44.033179+0000","last_became_peered":"2024-09-19T08:42:44.033179+0000","last_unstale":"2024-09-19T08:44:31.219964+0000","last_undegraded":"2024-09-19T08:44:31.219964+0000","last_fullsized":"2024-09-19T08:44:31.219964+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:11.161785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.210217+0000","last_change":"2024-09-19T08:42:44.029674+0000","last_active":"2024-09-19T08:44:31.210217+0000","last_peered":"2024-09-19T08:44:31.210217+0000","last_clean":"2024-09-19T08:44:31.210217+0000","last_became_active":"2024-09-19T08:42:44.029368+0000","last_became_peered":"2024-09-19T08:42:44.029368+0000","last_unstale":"2024-09-19T08:44:31.210217+0000","last_undegraded":"2024-09-19T08:44:31.210217+0000","last_fullsized":"2024-09-19T08:44:31.210217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:34.943363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.213448+0000","last_change":"2024-09-19T08:42:44.039780+0000","last_active":"2024-09-19T08:44:31.213448+0000","last_peered":"2024-09-19T08:44:31.213448+0000","last_clean":"2024-09-19T08:44:31.213448+0000","last_became_active":"2024-09-19T08:42:44.039409+0000","last_became_peered":"2024-09-19T08:42:44.039409+0000","last_unstale":"2024-09-19T08:44:31.213448+0000","last_undegraded":"2024-09-19T08:44:31.213448+0000","last_fullsized":"2024-09-19T08:44:31.213448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:59.632132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.214979+0000","last_change":"2024-09-19T08:42:44.030881+0000","last_active":"2024-09-19T08:44:31.214979+0000","last_peered":"2024-09-19T08:44:31.214979+0000","last_clean":"2024-09-19T08:44:31.214979+0000","last_became_active":"2024-09-19T08:42:44.030530+0000","last_became_peered":"2024-09-19T08:42:44.030530+0000","last_unstale":"2024-09-19T08:44:31.214979+0000","last_undegraded":"2024-09-19T08:44:31.214979+0000","last_fullsized":"2024-09-19T08:44:31.214979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:16.908450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.214928+0000","last_change":"2024-09-19T08:42:44.033056+0000","last_active":"2024-09-19T08:44:31.214928+0000","last_peered":"2024-09-19T08:44:31.214928+0000","last_clean":"2024-09-19T08:44:31.214928+0000","last_became_active":"2024-09-19T08:42:44.032690+0000","last_became_peered":"2024-09-19T08:42:44.032690+0000","last_unstale":"2024-09-19T08:44:31.214928+0000","last_undegraded":"2024-09-19T08:44:31.214928+0000","last_fullsized":"2024-09-19T08:44:31.214928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:36.497824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225043+0000","last_change":"2024-09-19T08:42:58.106551+0000","last_active":"2024-09-19T08:44:31.225043+0000","last_peered":"2024-09-19T08:44:31.225043+0000","last_clean":"2024-09-19T08:44:31.225043+0000","last_became_active":"2024-09-19T08:42:58.106119+0000","last_became_peered":"2024-09-19T08:42:58.106119+0000","last_unstale":"2024-09-19T08:44:31.225043+0000","last_undegraded":"2024-09-19T08:44:31.225043+0000","last_fullsized":"2024-09-19T08:44:31.225043+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:46.794260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226527+0000","last_change":"2024-09-19T08:42:58.108106+0000","last_active":"2024-09-19T08:44:31.226527+0000","last_peered":"2024-09-19T08:44:31.226527+0000","last_clean":"2024-09-19T08:44:31.226527+0000","last_became_active":"2024-09-19T08:42:58.107532+0000","last_became_peered":"2024-09-19T08:42:58.107532+0000","last_unstale":"2024-09-19T08:44:31.226527+0000","last_undegraded":"2024-09-19T08:44:31.226527+0000","last_fullsized":"2024-09-19T08:44:31.226527+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:29.164983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224871+0000","last_change":"2024-09-19T08:42:44.029822+0000","last_active":"2024-09-19T08:44:31.224871+0000","last_peered":"2024-09-19T08:44:31.224871+0000","last_clean":"2024-09-19T08:44:31.224871+0000","last_became_active":"2024-09-19T08:42:44.029450+0000","last_became_peered":"2024-09-19T08:42:44.029450+0000","last_unstale":"2024-09-19T08:44:31.224871+0000","last_undegraded":"2024-09-19T08:44:31.224871+0000","last_fullsized":"2024-09-19T08:44:31.224871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:40.826261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.210860+0000","last_change":"2024-09-19T08:42:44.041354+0000","last_active":"2024-09-19T08:44:31.210860+0000","last_peered":"2024-09-19T08:44:31.210860+0000","last_clean":"2024-09-19T08:44:31.210860+0000","last_became_active":"2024-09-19T08:42:44.040912+0000","last_became_peered":"2024-09-19T08:42:44.040912+0000","last_unstale":"2024-09-19T08:44:31.210860+0000","last_undegraded":"2024-09-19T08:44:31.210860+0000","last_fullsized":"2024-09-19T08:44:31.210860+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:16.543950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.217246+0000","last_change":"2024-09-19T08:42:44.027912+0000","last_active":"2024-09-19T08:44:31.217246+0000","last_peered":"2024-09-19T08:44:31.217246+0000","last_clean":"2024-09-19T08:44:31.217246+0000","last_became_active":"2024-09-19T08:42:44.027505+0000","last_became_peered":"2024-09-19T08:42:44.027505+0000","last_unstale":"2024-09-19T08:44:31.217246+0000","last_undegraded":"2024-09-19T08:44:31.217246+0000","last_fullsized":"2024-09-19T08:44:31.217246+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:02.552756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208688+0000","last_change":"2024-09-19T08:42:44.034472+0000","last_active":"2024-09-19T08:44:31.208688+0000","last_peered":"2024-09-19T08:44:31.208688+0000","last_clean":"2024-09-19T08:44:31.208688+0000","last_became_active":"2024-09-19T08:42:44.034026+0000","last_became_peered":"2024-09-19T08:42:44.034026+0000","last_unstale":"2024-09-19T08:44:31.208688+0000","last_undegraded":"2024-09-19T08:44:31.208688+0000","last_fullsized":"2024-09-19T08:44:31.208688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:10.058882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'10","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.481139+0000","last_change":"2024-09-19T08:42:41.927174+0000","last_active":"2024-09-19T08:44:31.481139+0000","last_peered":"2024-09-19T08:44:31.481139+0000","last_clean":"2024-09-19T08:44:31.481139+0000","last_became_active":"2024-09-19T08:42:41.926826+0000","last_became_peered":"2024-09-19T08:42:41.926826+0000","last_unstale":"2024-09-19T08:44:31.481139+0000","last_undegraded":"2024-09-19T08:44:31.481139+0000","last_fullsized":"2024-09-19T08:44:31.481139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:37.274891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2250,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":5,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.210827+0000","last_change":"2024-09-19T08:42:58.110259+0000","last_active":"2024-09-19T08:44:31.210827+0000","last_peered":"2024-09-19T08:44:31.210827+0000","last_clean":"2024-09-19T08:44:31.210827+0000","last_became_active":"2024-09-19T08:42:58.109803+0000","last_became_peered":"2024-09-19T08:42:58.109803+0000","last_unstale":"2024-09-19T08:44:31.210827+0000","last_undegraded":"2024-09-19T08:44:31.210827+0000","last_fullsized":"2024-09-19T08:44:31.210827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:31.853404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177196+0000","last_change":"2024-09-19T08:42:58.114222+0000","last_active":"2024-09-19T08:44:31.177196+0000","last_peered":"2024-09-19T08:44:31.177196+0000","last_clean":"2024-09-19T08:44:31.177196+0000","last_became_active":"2024-09-19T08:42:58.110769+0000","last_became_peered":"2024-09-19T08:42:58.110769+0000","last_unstale":"2024-09-19T08:44:31.177196+0000","last_undegraded":"2024-09-19T08:44:31.177196+0000","last_fullsized":"2024-09-19T08:44:31.177196+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:17.952228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.176271+0000","last_change":"2024-09-19T08:42:41.923903+0000","last_active":"2024-09-19T08:44:31.176271+0000","last_peered":"2024-09-19T08:44:31.176271+0000","last_clean":"2024-09-19T08:44:31.176271+0000","last_became_active":"2024-09-19T08:42:41.923583+0000","last_became_peered":"2024-09-19T08:42:41.923583+0000","last_unstale":"2024-09-19T08:44:31.176271+0000","last_undegraded":"2024-09-19T08:44:31.176271+0000","last_fullsized":"2024-09-19T08:44:31.176271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:48.594343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219641+0000","last_change":"2024-09-19T08:42:44.028972+0000","last_active":"2024-09-19T08:44:31.219641+0000","last_peered":"2024-09-19T08:44:31.219641+0000","last_clean":"2024-09-19T08:44:31.219641+0000","last_became_active":"2024-09-19T08:42:44.028657+0000","last_became_peered":"2024-09-19T08:42:44.028657+0000","last_unstale":"2024-09-19T08:44:31.219641+0000","last_undegraded":"2024-09-19T08:44:31.219641+0000","last_fullsized":"2024-09-19T08:44:31.219641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:43.618010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178701+0000","last_change":"2024-09-19T08:42:41.926558+0000","last_active":"2024-09-19T08:44:31.178701+0000","last_peered":"2024-09-19T08:44:31.178701+0000","last_clean":"2024-09-19T08:44:31.178701+0000","last_became_active":"2024-09-19T08:42:41.926074+0000","last_became_peered":"2024-09-19T08:42:41.926074+0000","last_unstale":"2024-09-19T08:44:31.178701+0000","last_undegraded":"2024-09-19T08:44:31.178701+0000","last_fullsized":"2024-09-19T08:44:31.178701+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:47.563295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.223532+0000","last_change":"2024-09-19T08:42:44.029191+0000","last_active":"2024-09-19T08:44:31.223532+0000","last_peered":"2024-09-19T08:44:31.223532+0000","last_clean":"2024-09-19T08:44:31.223532+0000","last_became_active":"2024-09-19T08:42:44.028871+0000","last_became_peered":"2024-09-19T08:42:44.028871+0000","last_unstale":"2024-09-19T08:44:31.223532+0000","last_undegraded":"2024-09-19T08:44:31.223532+0000","last_fullsized":"2024-09-19T08:44:31.223532+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:41.262014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":126,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177656+0000","last_change":"2024-09-19T08:42:41.930265+0000","last_active":"2024-09-19T08:44:31.177656+0000","last_peered":"2024-09-19T08:44:31.177656+0000","last_clean":"2024-09-19T08:44:31.177656+0000","last_became_active":"2024-09-19T08:42:41.929829+0000","last_became_peered":"2024-09-19T08:42:41.929829+0000","last_unstale":"2024-09-19T08:44:31.177656+0000","last_undegraded":"2024-09-19T08:44:31.177656+0000","last_fullsized":"2024-09-19T08:44:31.177656+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:59.181622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224033+0000","last_change":"2024-09-19T08:42:44.027382+0000","last_active":"2024-09-19T08:44:31.224033+0000","last_peered":"2024-09-19T08:44:31.224033+0000","last_clean":"2024-09-19T08:44:31.224033+0000","last_became_active":"2024-09-19T08:42:44.026824+0000","last_became_peered":"2024-09-19T08:42:44.026824+0000","last_unstale":"2024-09-19T08:44:31.224033+0000","last_undegraded":"2024-09-19T08:44:31.224033+0000","last_fullsized":"2024-09-19T08:44:31.224033+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:58.520068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.180283+0000","last_change":"2024-09-19T08:42:41.927914+0000","last_active":"2024-09-19T08:44:31.180283+0000","last_peered":"2024-09-19T08:44:31.180283+0000","last_clean":"2024-09-19T08:44:31.180283+0000","last_became_active":"2024-09-19T08:42:41.926566+0000","last_became_peered":"2024-09-19T08:42:41.926566+0000","last_unstale":"2024-09-19T08:44:31.180283+0000","last_undegraded":"2024-09-19T08:44:31.180283+0000","last_fullsized":"2024-09-19T08:44:31.180283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:52.238352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224677+0000","last_change":"2024-09-19T08:42:44.039899+0000","last_active":"2024-09-19T08:44:31.224677+0000","last_peered":"2024-09-19T08:44:31.224677+0000","last_clean":"2024-09-19T08:44:31.224677+0000","last_became_active":"2024-09-19T08:42:44.039530+0000","last_became_peered":"2024-09-19T08:42:44.039530+0000","last_unstale":"2024-09-19T08:44:31.224677+0000","last_undegraded":"2024-09-19T08:44:31.224677+0000","last_fullsized":"2024-09-19T08:44:31.224677+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:20.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178662+0000","last_change":"2024-09-19T08:42:42.410128+0000","last_active":"2024-09-19T08:44:31.178662+0000","last_peered":"2024-09-19T08:44:31.178662+0000","last_clean":"2024-09-19T08:44:31.178662+0000","last_became_active":"2024-09-19T08:42:42.409717+0000","last_became_peered":"2024-09-19T08:42:42.409717+0000","last_unstale":"2024-09-19T08:44:31.178662+0000","last_undegraded":"2024-09-19T08:44:31.178662+0000","last_fullsized":"2024-09-19T08:44:31.178662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:41.682355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225965+0000","last_change":"2024-09-19T08:42:44.043248+0000","last_active":"2024-09-19T08:44:31.225965+0000","last_peered":"2024-09-19T08:44:31.225965+0000","last_clean":"2024-09-19T08:44:31.225965+0000","last_became_active":"2024-09-19T08:42:44.042849+0000","last_became_peered":"2024-09-19T08:42:44.042849+0000","last_unstale":"2024-09-19T08:44:31.225965+0000","last_undegraded":"2024-09-19T08:44:31.225965+0000","last_fullsized":"2024-09-19T08:44:31.225965+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:00.413217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'34","reported_seq":265,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.485244+0000","last_change":"2024-09-19T08:42:41.926582+0000","last_active":"2024-09-19T08:44:31.485244+0000","last_peered":"2024-09-19T08:44:31.485244+0000","last_clean":"2024-09-19T08:44:31.485244+0000","last_became_active":"2024-09-19T08:42:41.926234+0000","last_became_peered":"2024-09-19T08:42:41.926234+0000","last_unstale":"2024-09-19T08:44:31.485244+0000","last_undegraded":"2024-09-19T08:44:31.485244+0000","last_fullsized":"2024-09-19T08:44:31.485244+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:02.498976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":167,"num_write":35,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.199159+0000","last_change":"2024-09-19T08:42:44.034888+0000","last_active":"2024-09-19T08:44:31.199159+0000","last_peered":"2024-09-19T08:44:31.199159+0000","last_clean":"2024-09-19T08:44:31.199159+0000","last_became_active":"2024-09-19T08:42:44.034553+0000","last_became_peered":"2024-09-19T08:42:44.034553+0000","last_unstale":"2024-09-19T08:44:31.199159+0000","last_undegraded":"2024-09-19T08:44:31.199159+0000","last_fullsized":"2024-09-19T08:44:31.199159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:06.416289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.181995+0000","last_change":"2024-09-19T08:42:58.117912+0000","last_active":"2024-09-19T08:44:31.181995+0000","last_peered":"2024-09-19T08:44:31.181995+0000","last_clean":"2024-09-19T08:44:31.181995+0000","last_became_active":"2024-09-19T08:42:58.105810+0000","last_became_peered":"2024-09-19T08:42:58.105810+0000","last_unstale":"2024-09-19T08:44:31.181995+0000","last_undegraded":"2024-09-19T08:44:31.181995+0000","last_fullsized":"2024-09-19T08:44:31.181995+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:44.258256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.213617+0000","last_change":"2024-09-19T08:42:44.030519+0000","last_active":"2024-09-19T08:44:31.213617+0000","last_peered":"2024-09-19T08:44:31.213617+0000","last_clean":"2024-09-19T08:44:31.213617+0000","last_became_active":"2024-09-19T08:42:44.030190+0000","last_became_peered":"2024-09-19T08:42:44.030190+0000","last_unstale":"2024-09-19T08:44:31.213617+0000","last_undegraded":"2024-09-19T08:44:31.213617+0000","last_fullsized":"2024-09-19T08:44:31.213617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:20.220642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178349+0000","last_change":"2024-09-19T08:42:41.928124+0000","last_active":"2024-09-19T08:44:31.178349+0000","last_peered":"2024-09-19T08:44:31.178349+0000","last_clean":"2024-09-19T08:44:31.178349+0000","last_became_active":"2024-09-19T08:42:41.927761+0000","last_became_peered":"2024-09-19T08:42:41.927761+0000","last_unstale":"2024-09-19T08:44:31.178349+0000","last_undegraded":"2024-09-19T08:44:31.178349+0000","last_fullsized":"2024-09-19T08:44:31.178349+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:08.591270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.218267+0000","last_change":"2024-09-19T08:42:44.038234+0000","last_active":"2024-09-19T08:44:31.218267+0000","last_peered":"2024-09-19T08:44:31.218267+0000","last_clean":"2024-09-19T08:44:31.218267+0000","last_became_active":"2024-09-19T08:42:44.037726+0000","last_became_peered":"2024-09-19T08:42:44.037726+0000","last_unstale":"2024-09-19T08:44:31.218267+0000","last_undegraded":"2024-09-19T08:44:31.218267+0000","last_fullsized":"2024-09-19T08:44:31.218267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:08.865482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.239723+0000","last_change":"2024-09-19T08:42:41.926206+0000","last_active":"2024-09-19T08:44:31.239723+0000","last_peered":"2024-09-19T08:44:31.239723+0000","last_clean":"2024-09-19T08:44:31.239723+0000","last_became_active":"2024-09-19T08:42:41.925833+0000","last_became_peered":"2024-09-19T08:42:41.925833+0000","last_unstale":"2024-09-19T08:44:31.239723+0000","last_undegraded":"2024-09-19T08:44:31.239723+0000","last_fullsized":"2024-09-19T08:44:31.239723+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:27.944240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":5,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208340+0000","last_change":"2024-09-19T08:42:44.037181+0000","last_active":"2024-09-19T08:44:31.208340+0000","last_peered":"2024-09-19T08:44:31.208340+0000","last_clean":"2024-09-19T08:44:31.208340+0000","last_became_active":"2024-09-19T08:42:44.036865+0000","last_became_peered":"2024-09-19T08:42:44.036865+0000","last_unstale":"2024-09-19T08:44:31.208340+0000","last_undegraded":"2024-09-19T08:44:31.208340+0000","last_fullsized":"2024-09-19T08:44:31.208340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:20.233309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.169922+0000","last_change":"2024-09-19T08:42:42.408446+0000","last_active":"2024-09-19T08:44:31.169922+0000","last_peered":"2024-09-19T08:44:31.169922+0000","last_clean":"2024-09-19T08:44:31.169922+0000","last_became_active":"2024-09-19T08:42:42.408098+0000","last_became_peered":"2024-09-19T08:42:42.408098+0000","last_unstale":"2024-09-19T08:44:31.169922+0000","last_undegraded":"2024-09-19T08:44:31.169922+0000","last_fullsized":"2024-09-19T08:44:31.169922+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:22.603604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225407+0000","last_change":"2024-09-19T08:42:44.039954+0000","last_active":"2024-09-19T08:44:31.225407+0000","last_peered":"2024-09-19T08:44:31.225407+0000","last_clean":"2024-09-19T08:44:31.225407+0000","last_became_active":"2024-09-19T08:42:44.039601+0000","last_became_peered":"2024-09-19T08:42:44.039601+0000","last_unstale":"2024-09-19T08:44:31.225407+0000","last_undegraded":"2024-09-19T08:44:31.225407+0000","last_fullsized":"2024-09-19T08:44:31.225407+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:07.792167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'3","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170390+0000","last_change":"2024-09-19T08:42:41.929644+0000","last_active":"2024-09-19T08:44:31.170390+0000","last_peered":"2024-09-19T08:44:31.170390+0000","last_clean":"2024-09-19T08:44:31.170390+0000","last_became_active":"2024-09-19T08:42:41.929308+0000","last_became_peered":"2024-09-19T08:42:41.929308+0000","last_unstale":"2024-09-19T08:44:31.170390+0000","last_undegraded":"2024-09-19T08:44:31.170390+0000","last_fullsized":"2024-09-19T08:44:31.170390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:36.660470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222570+0000","last_change":"2024-09-19T08:42:58.107555+0000","last_active":"2024-09-19T08:44:31.222570+0000","last_peered":"2024-09-19T08:44:31.222570+0000","last_clean":"2024-09-19T08:44:31.222570+0000","last_became_active":"2024-09-19T08:42:58.107137+0000","last_became_peered":"2024-09-19T08:42:58.107137+0000","last_unstale":"2024-09-19T08:44:31.222570+0000","last_undegraded":"2024-09-19T08:44:31.222570+0000","last_fullsized":"2024-09-19T08:44:31.222570+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:13.198911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.176594+0000","last_change":"2024-09-19T08:42:41.925195+0000","last_active":"2024-09-19T08:44:31.176594+0000","last_peered":"2024-09-19T08:44:31.176594+0000","last_clean":"2024-09-19T08:44:31.176594+0000","last_became_active":"2024-09-19T08:42:41.924880+0000","last_became_peered":"2024-09-19T08:42:41.924880+0000","last_unstale":"2024-09-19T08:44:31.176594+0000","last_undegraded":"2024-09-19T08:44:31.176594+0000","last_fullsized":"2024-09-19T08:44:31.176594+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:11.256881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219778+0000","last_change":"2024-09-19T08:42:44.036439+0000","last_active":"2024-09-19T08:44:31.219778+0000","last_peered":"2024-09-19T08:44:31.219778+0000","last_clean":"2024-09-19T08:44:31.219778+0000","last_became_active":"2024-09-19T08:42:44.036036+0000","last_became_peered":"2024-09-19T08:42:44.036036+0000","last_unstale":"2024-09-19T08:44:31.219778+0000","last_undegraded":"2024-09-19T08:44:31.219778+0000","last_fullsized":"2024-09-19T08:44:31.219778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:37.410782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'39","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.411820+0000","last_change":"2024-09-19T08:42:41.927490+0000","last_active":"2024-09-19T08:44:31.411820+0000","last_peered":"2024-09-19T08:44:31.411820+0000","last_clean":"2024-09-19T08:44:31.411820+0000","last_became_active":"2024-09-19T08:42:41.927163+0000","last_became_peered":"2024-09-19T08:42:41.927163+0000","last_unstale":"2024-09-19T08:44:31.411820+0000","last_undegraded":"2024-09-19T08:44:31.411820+0000","last_fullsized":"2024-09-19T08:44:31.411820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:20.013661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208966+0000","last_change":"2024-09-19T08:42:44.036960+0000","last_active":"2024-09-19T08:44:31.208966+0000","last_peered":"2024-09-19T08:44:31.208966+0000","last_clean":"2024-09-19T08:44:31.208966+0000","last_became_active":"2024-09-19T08:42:44.036600+0000","last_became_peered":"2024-09-19T08:42:44.036600+0000","last_unstale":"2024-09-19T08:44:31.208966+0000","last_undegraded":"2024-09-19T08:44:31.208966+0000","last_fullsized":"2024-09-19T08:44:31.208966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:15.621888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177396+0000","last_change":"2024-09-19T08:42:58.114698+0000","last_active":"2024-09-19T08:44:31.177396+0000","last_peered":"2024-09-19T08:44:31.177396+0000","last_clean":"2024-09-19T08:44:31.177396+0000","last_became_active":"2024-09-19T08:42:58.105488+0000","last_became_peered":"2024-09-19T08:42:58.105488+0000","last_unstale":"2024-09-19T08:44:31.177396+0000","last_undegraded":"2024-09-19T08:44:31.177396+0000","last_fullsized":"2024-09-19T08:44:31.177396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:12.642715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225878+0000","last_change":"2024-09-19T08:42:44.035569+0000","last_active":"2024-09-19T08:44:31.225878+0000","last_peered":"2024-09-19T08:44:31.225878+0000","last_clean":"2024-09-19T08:44:31.225878+0000","last_became_active":"2024-09-19T08:42:44.035277+0000","last_became_peered":"2024-09-19T08:42:44.035277+0000","last_unstale":"2024-09-19T08:44:31.225878+0000","last_undegraded":"2024-09-19T08:44:31.225878+0000","last_fullsized":"2024-09-19T08:44:31.225878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:57.472721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":348,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.179827+0000","last_change":"2024-09-19T08:41:34.769047+0000","last_active":"2024-09-19T08:44:31.179827+0000","last_peered":"2024-09-19T08:44:31.179827+0000","last_clean":"2024-09-19T08:44:31.179827+0000","last_became_active":"2024-09-19T08:41:34.768619+0000","last_became_peered":"2024-09-19T08:41:34.768619+0000","last_unstale":"2024-09-19T08:44:31.179827+0000","last_undegraded":"2024-09-19T08:44:31.179827+0000","last_fullsized":"2024-09-19T08:44:31.179827+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:13.482855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:13.482855+0000","last_clean_scrub_stamp":"2024-09-19T08:38:13.482855+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.390775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177359+0000","last_change":"2024-09-19T08:42:41.925698+0000","last_active":"2024-09-19T08:44:31.177359+0000","last_peered":"2024-09-19T08:44:31.177359+0000","last_clean":"2024-09-19T08:44:31.177359+0000","last_became_active":"2024-09-19T08:42:41.924618+0000","last_became_peered":"2024-09-19T08:42:41.924618+0000","last_unstale":"2024-09-19T08:44:31.177359+0000","last_undegraded":"2024-09-19T08:44:31.177359+0000","last_fullsized":"2024-09-19T08:44:31.177359+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:53.717139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222668+0000","last_change":"2024-09-19T08:42:58.111206+0000","last_active":"2024-09-19T08:44:31.222668+0000","last_peered":"2024-09-19T08:44:31.222668+0000","last_clean":"2024-09-19T08:44:31.222668+0000","last_became_active":"2024-09-19T08:42:58.110765+0000","last_became_peered":"2024-09-19T08:42:58.110765+0000","last_unstale":"2024-09-19T08:44:31.222668+0000","last_undegraded":"2024-09-19T08:44:31.222668+0000","last_fullsized":"2024-09-19T08:44:31.222668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:44.783938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.179827+0000","last_change":"2024-09-19T08:42:41.928414+0000","last_active":"2024-09-19T08:44:31.179827+0000","last_peered":"2024-09-19T08:44:31.179827+0000","last_clean":"2024-09-19T08:44:31.179827+0000","last_became_active":"2024-09-19T08:42:41.928055+0000","last_became_peered":"2024-09-19T08:42:41.928055+0000","last_unstale":"2024-09-19T08:44:31.179827+0000","last_undegraded":"2024-09-19T08:44:31.179827+0000","last_fullsized":"2024-09-19T08:44:31.179827+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:12.688379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.197630+0000","last_change":"2024-09-19T08:42:44.035439+0000","last_active":"2024-09-19T08:44:31.197630+0000","last_peered":"2024-09-19T08:44:31.197630+0000","last_clean":"2024-09-19T08:44:31.197630+0000","last_became_active":"2024-09-19T08:42:44.035150+0000","last_became_peered":"2024-09-19T08:42:44.035150+0000","last_unstale":"2024-09-19T08:44:31.197630+0000","last_undegraded":"2024-09-19T08:44:31.197630+0000","last_fullsized":"2024-09-19T08:44:31.197630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:15.230660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":127,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177891+0000","last_change":"2024-09-19T08:42:42.407784+0000","last_active":"2024-09-19T08:44:31.177891+0000","last_peered":"2024-09-19T08:44:31.177891+0000","last_clean":"2024-09-19T08:44:31.177891+0000","last_became_active":"2024-09-19T08:42:42.407437+0000","last_became_peered":"2024-09-19T08:42:42.407437+0000","last_unstale":"2024-09-19T08:44:31.177891+0000","last_undegraded":"2024-09-19T08:44:31.177891+0000","last_fullsized":"2024-09-19T08:44:31.177891+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:44.829338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212600+0000","last_change":"2024-09-19T08:42:44.039780+0000","last_active":"2024-09-19T08:44:31.212600+0000","last_peered":"2024-09-19T08:44:31.212600+0000","last_clean":"2024-09-19T08:44:31.212600+0000","last_became_active":"2024-09-19T08:42:44.039441+0000","last_became_peered":"2024-09-19T08:42:44.039441+0000","last_unstale":"2024-09-19T08:44:31.212600+0000","last_undegraded":"2024-09-19T08:44:31.212600+0000","last_fullsized":"2024-09-19T08:44:31.212600+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:31.013663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.180830+0000","last_change":"2024-09-19T08:42:41.926998+0000","last_active":"2024-09-19T08:44:31.180830+0000","last_peered":"2024-09-19T08:44:31.180830+0000","last_clean":"2024-09-19T08:44:31.180830+0000","last_became_active":"2024-09-19T08:42:41.926560+0000","last_became_peered":"2024-09-19T08:42:41.926560+0000","last_unstale":"2024-09-19T08:44:31.180830+0000","last_undegraded":"2024-09-19T08:44:31.180830+0000","last_fullsized":"2024-09-19T08:44:31.180830+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:35.338601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225659+0000","last_change":"2024-09-19T08:42:44.039948+0000","last_active":"2024-09-19T08:44:31.225659+0000","last_peered":"2024-09-19T08:44:31.225659+0000","last_clean":"2024-09-19T08:44:31.225659+0000","last_became_active":"2024-09-19T08:42:44.038797+0000","last_became_peered":"2024-09-19T08:42:44.038797+0000","last_unstale":"2024-09-19T08:44:31.225659+0000","last_undegraded":"2024-09-19T08:44:31.225659+0000","last_fullsized":"2024-09-19T08:44:31.225659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:19.273191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.168583+0000","last_change":"2024-09-19T08:42:42.409954+0000","last_active":"2024-09-19T08:44:31.168583+0000","last_peered":"2024-09-19T08:44:31.168583+0000","last_clean":"2024-09-19T08:44:31.168583+0000","last_became_active":"2024-09-19T08:42:42.409388+0000","last_became_peered":"2024-09-19T08:42:42.409388+0000","last_unstale":"2024-09-19T08:44:31.168583+0000","last_undegraded":"2024-09-19T08:44:31.168583+0000","last_fullsized":"2024-09-19T08:44:31.168583+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:58.764877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.213210+0000","last_change":"2024-09-19T08:42:44.024360+0000","last_active":"2024-09-19T08:44:31.213210+0000","last_peered":"2024-09-19T08:44:31.213210+0000","last_clean":"2024-09-19T08:44:31.213210+0000","last_became_active":"2024-09-19T08:42:44.023703+0000","last_became_peered":"2024-09-19T08:42:44.023703+0000","last_unstale":"2024-09-19T08:44:31.213210+0000","last_undegraded":"2024-09-19T08:44:31.213210+0000","last_fullsized":"2024-09-19T08:44:31.213210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:10.852199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170383+0000","last_change":"2024-09-19T08:42:42.408101+0000","last_active":"2024-09-19T08:44:31.170383+0000","last_peered":"2024-09-19T08:44:31.170383+0000","last_clean":"2024-09-19T08:44:31.170383+0000","last_became_active":"2024-09-19T08:42:42.407692+0000","last_became_peered":"2024-09-19T08:42:42.407692+0000","last_unstale":"2024-09-19T08:44:31.170383+0000","last_undegraded":"2024-09-19T08:44:31.170383+0000","last_fullsized":"2024-09-19T08:44:31.170383+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:01.342213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.217468+0000","last_change":"2024-09-19T08:42:44.026612+0000","last_active":"2024-09-19T08:44:31.217468+0000","last_peered":"2024-09-19T08:44:31.217468+0000","last_clean":"2024-09-19T08:44:31.217468+0000","last_became_active":"2024-09-19T08:42:44.025408+0000","last_became_peered":"2024-09-19T08:42:44.025408+0000","last_unstale":"2024-09-19T08:44:31.217468+0000","last_undegraded":"2024-09-19T08:44:31.217468+0000","last_fullsized":"2024-09-19T08:44:31.217468+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:19.465342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'46","reported_seq":93,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.419159+0000","last_change":"2024-09-19T08:42:41.927561+0000","last_active":"2024-09-19T08:44:31.419159+0000","last_peered":"2024-09-19T08:44:31.419159+0000","last_clean":"2024-09-19T08:44:31.419159+0000","last_became_active":"2024-09-19T08:42:41.927159+0000","last_became_peered":"2024-09-19T08:42:41.927159+0000","last_unstale":"2024-09-19T08:44:31.419159+0000","last_undegraded":"2024-09-19T08:44:31.419159+0000","last_fullsized":"2024-09-19T08:44:31.419159+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:13.352727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":83,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.220812+0000","last_change":"2024-09-19T08:42:44.028129+0000","last_active":"2024-09-19T08:44:31.220812+0000","last_peered":"2024-09-19T08:44:31.220812+0000","last_clean":"2024-09-19T08:44:31.220812+0000","last_became_active":"2024-09-19T08:42:44.027826+0000","last_became_peered":"2024-09-19T08:42:44.027826+0000","last_unstale":"2024-09-19T08:44:31.220812+0000","last_undegraded":"2024-09-19T08:44:31.220812+0000","last_fullsized":"2024-09-19T08:44:31.220812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:03.129404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177705+0000","last_change":"2024-09-19T08:42:41.920264+0000","last_active":"2024-09-19T08:44:31.177705+0000","last_peered":"2024-09-19T08:44:31.177705+0000","last_clean":"2024-09-19T08:44:31.177705+0000","last_became_active":"2024-09-19T08:42:41.919655+0000","last_became_peered":"2024-09-19T08:42:41.919655+0000","last_unstale":"2024-09-19T08:44:31.177705+0000","last_undegraded":"2024-09-19T08:44:31.177705+0000","last_fullsized":"2024-09-19T08:44:31.177705+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:58.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226014+0000","last_change":"2024-09-19T08:42:44.039655+0000","last_active":"2024-09-19T08:44:31.226014+0000","last_peered":"2024-09-19T08:44:31.226014+0000","last_clean":"2024-09-19T08:44:31.226014+0000","last_became_active":"2024-09-19T08:42:44.039317+0000","last_became_peered":"2024-09-19T08:42:44.039317+0000","last_unstale":"2024-09-19T08:44:31.226014+0000","last_undegraded":"2024-09-19T08:44:31.226014+0000","last_fullsized":"2024-09-19T08:44:31.226014+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:19.064194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.169944+0000","last_change":"2024-09-19T08:42:42.408582+0000","last_active":"2024-09-19T08:44:31.169944+0000","last_peered":"2024-09-19T08:44:31.169944+0000","last_clean":"2024-09-19T08:44:31.169944+0000","last_became_active":"2024-09-19T08:42:42.408143+0000","last_became_peered":"2024-09-19T08:42:42.408143+0000","last_unstale":"2024-09-19T08:44:31.169944+0000","last_undegraded":"2024-09-19T08:44:31.169944+0000","last_fullsized":"2024-09-19T08:44:31.169944+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.526138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.195758+0000","last_change":"2024-09-19T08:42:44.034795+0000","last_active":"2024-09-19T08:44:31.195758+0000","last_peered":"2024-09-19T08:44:31.195758+0000","last_clean":"2024-09-19T08:44:31.195758+0000","last_became_active":"2024-09-19T08:42:44.034440+0000","last_became_peered":"2024-09-19T08:42:44.034440+0000","last_unstale":"2024-09-19T08:44:31.195758+0000","last_undegraded":"2024-09-19T08:44:31.195758+0000","last_fullsized":"2024-09-19T08:44:31.195758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:50.470240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.179034+0000","last_change":"2024-09-19T08:42:41.922621+0000","last_active":"2024-09-19T08:44:31.179034+0000","last_peered":"2024-09-19T08:44:31.179034+0000","last_clean":"2024-09-19T08:44:31.179034+0000","last_became_active":"2024-09-19T08:42:41.922303+0000","last_became_peered":"2024-09-19T08:42:41.922303+0000","last_unstale":"2024-09-19T08:44:31.179034+0000","last_undegraded":"2024-09-19T08:44:31.179034+0000","last_fullsized":"2024-09-19T08:44:31.179034+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:48.017892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225447+0000","last_change":"2024-09-19T08:42:44.028307+0000","last_active":"2024-09-19T08:44:31.225447+0000","last_peered":"2024-09-19T08:44:31.225447+0000","last_clean":"2024-09-19T08:44:31.225447+0000","last_became_active":"2024-09-19T08:42:44.026848+0000","last_became_peered":"2024-09-19T08:42:44.026848+0000","last_unstale":"2024-09-19T08:44:31.225447+0000","last_undegraded":"2024-09-19T08:44:31.225447+0000","last_fullsized":"2024-09-19T08:44:31.225447+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:20.768075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.180483+0000","last_change":"2024-09-19T08:42:41.929479+0000","last_active":"2024-09-19T08:44:31.180483+0000","last_peered":"2024-09-19T08:44:31.180483+0000","last_clean":"2024-09-19T08:44:31.180483+0000","last_became_active":"2024-09-19T08:42:41.928508+0000","last_became_peered":"2024-09-19T08:42:41.928508+0000","last_unstale":"2024-09-19T08:44:31.180483+0000","last_undegraded":"2024-09-19T08:44:31.180483+0000","last_fullsized":"2024-09-19T08:44:31.180483+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:46.108471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.205207+0000","last_change":"2024-09-19T08:42:44.028694+0000","last_active":"2024-09-19T08:44:31.205207+0000","last_peered":"2024-09-19T08:44:31.205207+0000","last_clean":"2024-09-19T08:44:31.205207+0000","last_became_active":"2024-09-19T08:42:44.027382+0000","last_became_peered":"2024-09-19T08:42:44.027382+0000","last_unstale":"2024-09-19T08:44:31.205207+0000","last_undegraded":"2024-09-19T08:44:31.205207+0000","last_fullsized":"2024-09-19T08:44:31.205207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:40.877505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170090+0000","last_change":"2024-09-19T08:42:41.931016+0000","last_active":"2024-09-19T08:44:31.170090+0000","last_peered":"2024-09-19T08:44:31.170090+0000","last_clean":"2024-09-19T08:44:31.170090+0000","last_became_active":"2024-09-19T08:42:41.930648+0000","last_became_peered":"2024-09-19T08:42:41.930648+0000","last_unstale":"2024-09-19T08:44:31.170090+0000","last_undegraded":"2024-09-19T08:44:31.170090+0000","last_fullsized":"2024-09-19T08:44:31.170090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:32.031025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226346+0000","last_change":"2024-09-19T08:42:44.035288+0000","last_active":"2024-09-19T08:44:31.226346+0000","last_peered":"2024-09-19T08:44:31.226346+0000","last_clean":"2024-09-19T08:44:31.226346+0000","last_became_active":"2024-09-19T08:42:44.034660+0000","last_became_peered":"2024-09-19T08:42:44.034660+0000","last_unstale":"2024-09-19T08:44:31.226346+0000","last_undegraded":"2024-09-19T08:44:31.226346+0000","last_fullsized":"2024-09-19T08:44:31.226346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:48.703463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225736+0000","last_change":"2024-09-19T08:42:44.040123+0000","last_active":"2024-09-19T08:44:31.225736+0000","last_peered":"2024-09-19T08:44:31.225736+0000","last_clean":"2024-09-19T08:44:31.225736+0000","last_became_active":"2024-09-19T08:42:44.039488+0000","last_became_peered":"2024-09-19T08:42:44.039488+0000","last_unstale":"2024-09-19T08:44:31.225736+0000","last_undegraded":"2024-09-19T08:44:31.225736+0000","last_fullsized":"2024-09-19T08:44:31.225736+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:15.273044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170228+0000","last_change":"2024-09-19T08:42:41.932400+0000","last_active":"2024-09-19T08:44:31.170228+0000","last_peered":"2024-09-19T08:44:31.170228+0000","last_clean":"2024-09-19T08:44:31.170228+0000","last_became_active":"2024-09-19T08:42:41.932020+0000","last_became_peered":"2024-09-19T08:42:41.932020+0000","last_unstale":"2024-09-19T08:44:31.170228+0000","last_undegraded":"2024-09-19T08:44:31.170228+0000","last_fullsized":"2024-09-19T08:44:31.170228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:08.583287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.221219+0000","last_change":"2024-09-19T08:42:44.026173+0000","last_active":"2024-09-19T08:44:31.221219+0000","last_peered":"2024-09-19T08:44:31.221219+0000","last_clean":"2024-09-19T08:44:31.221219+0000","last_became_active":"2024-09-19T08:42:44.024614+0000","last_became_peered":"2024-09-19T08:42:44.024614+0000","last_unstale":"2024-09-19T08:44:31.221219+0000","last_undegraded":"2024-09-19T08:44:31.221219+0000","last_fullsized":"2024-09-19T08:44:31.221219+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:42.695660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170318+0000","last_change":"2024-09-19T08:42:41.929576+0000","last_active":"2024-09-19T08:44:31.170318+0000","last_peered":"2024-09-19T08:44:31.170318+0000","last_clean":"2024-09-19T08:44:31.170318+0000","last_became_active":"2024-09-19T08:42:41.929231+0000","last_became_peered":"2024-09-19T08:42:41.929231+0000","last_unstale":"2024-09-19T08:44:31.170318+0000","last_undegraded":"2024-09-19T08:44:31.170318+0000","last_fullsized":"2024-09-19T08:44:31.170318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:54.492198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226525+0000","last_change":"2024-09-19T08:42:44.028612+0000","last_active":"2024-09-19T08:44:31.226525+0000","last_peered":"2024-09-19T08:44:31.226525+0000","last_clean":"2024-09-19T08:44:31.226525+0000","last_became_active":"2024-09-19T08:42:44.028301+0000","last_became_peered":"2024-09-19T08:42:44.028301+0000","last_unstale":"2024-09-19T08:44:31.226525+0000","last_undegraded":"2024-09-19T08:44:31.226525+0000","last_fullsized":"2024-09-19T08:44:31.226525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:03:09.539350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178947+0000","last_change":"2024-09-19T08:42:42.407931+0000","last_active":"2024-09-19T08:44:31.178947+0000","last_peered":"2024-09-19T08:44:31.178947+0000","last_clean":"2024-09-19T08:44:31.178947+0000","last_became_active":"2024-09-19T08:42:42.407573+0000","last_became_peered":"2024-09-19T08:42:42.407573+0000","last_unstale":"2024-09-19T08:44:31.178947+0000","last_undegraded":"2024-09-19T08:44:31.178947+0000","last_fullsized":"2024-09-19T08:44:31.178947+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:55.095275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.209474+0000","last_change":"2024-09-19T08:42:44.034109+0000","last_active":"2024-09-19T08:44:31.209474+0000","last_peered":"2024-09-19T08:44:31.209474+0000","last_clean":"2024-09-19T08:44:31.209474+0000","last_became_active":"2024-09-19T08:42:44.033753+0000","last_became_peered":"2024-09-19T08:42:44.033753+0000","last_unstale":"2024-09-19T08:44:31.209474+0000","last_undegraded":"2024-09-19T08:44:31.209474+0000","last_fullsized":"2024-09-19T08:44:31.209474+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:08.475476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.168653+0000","last_change":"2024-09-19T08:42:58.120292+0000","last_active":"2024-09-19T08:44:31.168653+0000","last_peered":"2024-09-19T08:44:31.168653+0000","last_clean":"2024-09-19T08:44:31.168653+0000","last_became_active":"2024-09-19T08:42:58.109929+0000","last_became_peered":"2024-09-19T08:42:58.109929+0000","last_unstale":"2024-09-19T08:44:31.168653+0000","last_undegraded":"2024-09-19T08:44:31.168653+0000","last_fullsized":"2024-09-19T08:44:31.168653+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:56.196868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":597461,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":711,"num_read_kb":462,"num_write":292,"num_write_kb":1438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1198,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":1792383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579939,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":442307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32952,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712200,"statfs":{"total":95995035648,"available":95961292800,"internally_reserved":0,"allocated":1748992,"data_stored":1232179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939692,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":925696,"data_stored":441927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168625,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28316,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716836,"statfs":{"total":95995035648,"available":95966040064,"internally_reserved":0,"allocated":1318912,"data_stored":835063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397557,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1515520,"data_stored":1035359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561083,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":441316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790014,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1531904,"data_stored":1033912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953541,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":442869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215178,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40928,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704224,"statfs":{"total":95995035648,"available":95953125376,"internally_reserved":0,"allocated":1458176,"data_stored":966443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444110,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":999424,"data_stored":509951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":978944,"data_stored":506803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":933888,"data_stored":442587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":200585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:44:37.137 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:44:37.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:36 smithi175 ceph-mon[35688]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:44:37.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:36 smithi175 ceph-mon[35688]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-09-19T08:44:37.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:36 smithi044 ceph-mon[35072]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:44:37.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:36 smithi044 ceph-mon[35072]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-09-19T08:44:37.429 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.886+0000 7f7d9500d640 1 -- 172.21.15.7:0/3243618990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d90102790 msgr2=0x7f7d901067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:37.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.886+0000 7f7d9500d640 1 --2- 172.21.15.7:0/3243618990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d90102790 0x7f7d901067e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7d78009900 tx=0x7f7d7802a410 comp rx=0 tx=0).stop 2024-09-19T08:44:37.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.887+0000 7f7d9500d640 1 -- 172.21.15.7:0/3243618990 shutdown_connections 2024-09-19T08:44:37.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.887+0000 7f7d9500d640 1 --2- 172.21.15.7:0/3243618990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d90106f10 0x7f7d9010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.887+0000 7f7d9500d640 1 --2- 172.21.15.7:0/3243618990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d90102790 0x7f7d901067e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.887+0000 7f7d9500d640 1 --2- 172.21.15.7:0/3243618990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d90101de0 0x7f7d901021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.887+0000 7f7d9500d640 1 -- 172.21.15.7:0/3243618990 >> 172.21.15.7:0/3243618990 conn(0x7f7d900fd8c0 msgr2=0x7f7d900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:37.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.887+0000 7f7d9500d640 1 -- 172.21.15.7:0/3243618990 shutdown_connections 2024-09-19T08:44:37.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.887+0000 7f7d9500d640 1 -- 172.21.15.7:0/3243618990 wait complete. 2024-09-19T08:44:37.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.887+0000 7f7d9500d640 1 Processor -- start 2024-09-19T08:44:37.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.888+0000 7f7d9500d640 1 -- start start 2024-09-19T08:44:37.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.888+0000 7f7d9500d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d90101de0 0x7f7d90198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:37.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.888+0000 7f7d9500d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d90102790 0x7f7d90198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:37.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.888+0000 7f7d9500d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d90106f10 0x7f7d9019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:37.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.888+0000 7f7d9500d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7d90111f70 con 0x7f7d90101de0 2024-09-19T08:44:37.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.888+0000 7f7d9500d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7d90111df0 con 0x7f7d90102790 2024-09-19T08:44:37.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.888+0000 7f7d9500d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7d901120f0 con 0x7f7d90106f10 2024-09-19T08:44:37.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.888+0000 7f7d8ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d90101de0 0x7f7d90198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:37.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.888+0000 7f7d8ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d90101de0 0x7f7d90198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53356/0 (socket says 172.21.15.7:53356) 2024-09-19T08:44:37.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.888+0000 7f7d8ed9d640 1 -- 172.21.15.7:0/1085912941 learned_addr learned my addr 172.21.15.7:0/1085912941 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.888+0000 7f7d8f59e640 1 --2- 172.21.15.7:0/1085912941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d90106f10 0x7f7d9019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.888+0000 7f7d8e59c640 1 --2- 172.21.15.7:0/1085912941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d90102790 0x7f7d90198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.888+0000 7f7d8ed9d640 1 -- 172.21.15.7:0/1085912941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d90106f10 msgr2=0x7f7d9019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.888+0000 7f7d8ed9d640 1 --2- 172.21.15.7:0/1085912941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d90106f10 0x7f7d9019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.888+0000 7f7d8ed9d640 1 -- 172.21.15.7:0/1085912941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d90102790 msgr2=0x7f7d90198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.888+0000 7f7d8ed9d640 1 --2- 172.21.15.7:0/1085912941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d90102790 0x7f7d90198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.888+0000 7f7d8ed9d640 1 -- 172.21.15.7:0/1085912941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d9019d400 con 0x7f7d90101de0 2024-09-19T08:44:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.888+0000 7f7d8e59c640 1 --2- 172.21.15.7:0/1085912941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d90102790 0x7f7d90198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.888+0000 7f7d8ed9d640 1 --2- 172.21.15.7:0/1085912941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d90101de0 0x7f7d90198450 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000e9f0 tx=0x7f7d8000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.889+0000 7f7d87fff640 1 -- 172.21.15.7:0/1085912941 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8000cd80 con 0x7f7d90101de0 2024-09-19T08:44:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.889+0000 7f7d87fff640 1 -- 172.21.15.7:0/1085912941 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d80010910 con 0x7f7d90101de0 2024-09-19T08:44:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.889+0000 7f7d9500d640 1 -- 172.21.15.7:0/1085912941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d9019d6f0 con 0x7f7d90101de0 2024-09-19T08:44:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.889+0000 7f7d87fff640 1 -- 172.21.15.7:0/1085912941 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80018990 con 0x7f7d90101de0 2024-09-19T08:44:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.889+0000 7f7d9500d640 1 -- 172.21.15.7:0/1085912941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d901a4fd0 con 0x7f7d90101de0 2024-09-19T08:44:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.890+0000 7f7d9500d640 1 -- 172.21.15.7:0/1085912941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d901021c0 con 0x7f7d90101de0 2024-09-19T08:44:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.891+0000 7f7d87fff640 1 -- 172.21.15.7:0/1085912941 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f7d80010ac0 con 0x7f7d90101de0 2024-09-19T08:44:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.892+0000 7f7d87fff640 1 --2- 172.21.15.7:0/1085912941 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7d7c0a3440 0x7f7d7c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.892+0000 7f7d8e59c640 1 --2- 172.21.15.7:0/1085912941 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7d7c0a3440 0x7f7d7c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.892+0000 7f7d87fff640 1 -- 172.21.15.7:0/1085912941 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f7d800d0290 con 0x7f7d90101de0 2024-09-19T08:44:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.892+0000 7f7d8e59c640 1 --2- 172.21.15.7:0/1085912941 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7d7c0a3440 0x7f7d7c0a5900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7d900fe170 tx=0x7f7d78005a20 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:37.896+0000 7f7d87fff640 1 -- 172.21.15.7:0/1085912941 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7d8009caf0 con 0x7f7d90101de0 2024-09-19T08:44:38.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:38.110+0000 7f7d9500d640 1 -- 172.21.15.7:0/1085912941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d901997b0 con 0x7f7d90101de0 2024-09-19T08:44:38.110 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:37 smithi007 ceph-mon[31221]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:38.111 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:37 smithi007 ceph-mon[31221]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:38.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:38.111+0000 7f7d87fff640 1 -- 172.21.15.7:0/1085912941 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f7d8009c3f0 con 0x7f7d90101de0 2024-09-19T08:44:38.111 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:44:38.112 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:44:38.112 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:44:38.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:38.113+0000 7f7d9500d640 1 -- 172.21.15.7:0/1085912941 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7d7c0a3440 msgr2=0x7f7d7c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:38.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:38.113+0000 7f7d9500d640 1 --2- 172.21.15.7:0/1085912941 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7d7c0a3440 0x7f7d7c0a5900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7d900fe170 tx=0x7f7d78005a20 comp rx=0 tx=0).stop 2024-09-19T08:44:38.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:38.113+0000 7f7d9500d640 1 -- 172.21.15.7:0/1085912941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d90101de0 msgr2=0x7f7d90198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:38.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:38.113+0000 7f7d9500d640 1 --2- 172.21.15.7:0/1085912941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d90101de0 0x7f7d90198450 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000e9f0 tx=0x7f7d8000eeb0 comp rx=0 tx=0).stop 2024-09-19T08:44:38.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:38.113+0000 7f7d9500d640 1 -- 172.21.15.7:0/1085912941 shutdown_connections 2024-09-19T08:44:38.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:38.113+0000 7f7d9500d640 1 --2- 172.21.15.7:0/1085912941 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7d7c0a3440 0x7f7d7c0a5900 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:38.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:38.113+0000 7f7d9500d640 1 --2- 172.21.15.7:0/1085912941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d90106f10 0x7f7d9019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:38.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:38.113+0000 7f7d9500d640 1 --2- 172.21.15.7:0/1085912941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d90102790 0x7f7d90198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:38.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:38.113+0000 7f7d9500d640 1 --2- 172.21.15.7:0/1085912941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d90101de0 0x7f7d90198450 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:38.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:38.113+0000 7f7d9500d640 1 -- 172.21.15.7:0/1085912941 >> 172.21.15.7:0/1085912941 conn(0x7f7d900fd8c0 msgr2=0x7f7d900fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:38.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:38.114+0000 7f7d9500d640 1 -- 172.21.15.7:0/1085912941 shutdown_connections 2024-09-19T08:44:38.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:38.114+0000 7f7d9500d640 1 -- 172.21.15.7:0/1085912941 wait complete. 2024-09-19T08:44:38.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:37 smithi175 ceph-mon[35688]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:38.179 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:37 smithi175 ceph-mon[35688]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:38.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:37 smithi044 ceph-mon[35072]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:38.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:37 smithi044 ceph-mon[35072]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:38.899 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:44:39.160 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:39.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:38 smithi175 ceph-mon[35688]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:39.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:38 smithi175 ceph-mon[35688]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-19T08:44:39.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:38 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1085912941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:39.276 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:38 smithi007 ceph-mon[31221]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:39.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:38 smithi007 ceph-mon[31221]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-19T08:44:39.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:38 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1085912941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:39.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:38 smithi044 ceph-mon[35072]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:39.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:38 smithi044 ceph-mon[35072]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-19T08:44:39.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:38 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1085912941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:39.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.621+0000 7f0b6b1d0640 1 -- 172.21.15.7:0/1094489460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b64101400 msgr2=0x7f0b6410d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:39.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.621+0000 7f0b6b1d0640 1 --2- 172.21.15.7:0/1094489460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b64101400 0x7f0b6410d930 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009cd0 tx=0x7f0b5c02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:44:39.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.621+0000 7f0b6b1d0640 1 -- 172.21.15.7:0/1094489460 shutdown_connections 2024-09-19T08:44:39.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.621+0000 7f0b6b1d0640 1 --2- 172.21.15.7:0/1094489460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b64101400 0x7f0b6410d930 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:39.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.621+0000 7f0b6b1d0640 1 --2- 172.21.15.7:0/1094489460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b64100a60 0x7f0b64100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:39.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.621+0000 7f0b6b1d0640 1 --2- 172.21.15.7:0/1094489460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b64106a60 0x7f0b64106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:39.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.621+0000 7f0b6b1d0640 1 -- 172.21.15.7:0/1094489460 >> 172.21.15.7:0/1094489460 conn(0x7f0b640fc780 msgr2=0x7f0b640feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:39.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.621+0000 7f0b6b1d0640 1 -- 172.21.15.7:0/1094489460 shutdown_connections 2024-09-19T08:44:39.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.621+0000 7f0b6b1d0640 1 -- 172.21.15.7:0/1094489460 wait complete. 2024-09-19T08:44:39.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.622+0000 7f0b6b1d0640 1 Processor -- start 2024-09-19T08:44:39.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.622+0000 7f0b6b1d0640 1 -- start start 2024-09-19T08:44:39.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.622+0000 7f0b6b1d0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b64100a60 0x7f0b64198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:39.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.622+0000 7f0b6b1d0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b64101400 0x7f0b64198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:39.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.622+0000 7f0b6b1d0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b64106a60 0x7f0b6419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:39.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.622+0000 7f0b6b1d0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0b64110e60 con 0x7f0b64100a60 2024-09-19T08:44:39.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.622+0000 7f0b6b1d0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0b64110ce0 con 0x7f0b64106a60 2024-09-19T08:44:39.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.622+0000 7f0b6b1d0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0b64110fe0 con 0x7f0b64101400 2024-09-19T08:44:39.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.622+0000 7f0b68f6c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b64100a60 0x7f0b64198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:39.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.622+0000 7f0b68f6c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b64100a60 0x7f0b64198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53374/0 (socket says 172.21.15.7:53374) 2024-09-19T08:44:39.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.622+0000 7f0b68f6c640 1 -- 172.21.15.7:0/3234786209 learned_addr learned my addr 172.21.15.7:0/3234786209 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:39.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.622+0000 7f0b6976d640 1 --2- 172.21.15.7:0/3234786209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b64106a60 0x7f0b6419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:39.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.622+0000 7f0b63fff640 1 --2- 172.21.15.7:0/3234786209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b64101400 0x7f0b64198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:39.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.622+0000 7f0b68f6c640 1 -- 172.21.15.7:0/3234786209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b64101400 msgr2=0x7f0b64198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:39.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.622+0000 7f0b68f6c640 1 --2- 172.21.15.7:0/3234786209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b64101400 0x7f0b64198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.622+0000 7f0b68f6c640 1 -- 172.21.15.7:0/3234786209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b64106a60 msgr2=0x7f0b6419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.622+0000 7f0b68f6c640 1 --2- 172.21.15.7:0/3234786209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b64106a60 0x7f0b6419cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.622+0000 7f0b68f6c640 1 -- 172.21.15.7:0/3234786209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b6419d3f0 con 0x7f0b64100a60 2024-09-19T08:44:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.622+0000 7f0b6976d640 1 --2- 172.21.15.7:0/3234786209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b64106a60 0x7f0b6419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.623+0000 7f0b68f6c640 1 --2- 172.21.15.7:0/3234786209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b64100a60 0x7f0b64198440 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0b5400d770 tx=0x7f0b5400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.623+0000 7f0b61ffb640 1 -- 172.21.15.7:0/3234786209 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b54017070 con 0x7f0b64100a60 2024-09-19T08:44:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.623+0000 7f0b6b1d0640 1 -- 172.21.15.7:0/3234786209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b6419d6e0 con 0x7f0b64100a60 2024-09-19T08:44:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.623+0000 7f0b61ffb640 1 -- 172.21.15.7:0/3234786209 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b54005500 con 0x7f0b64100a60 2024-09-19T08:44:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.623+0000 7f0b61ffb640 1 -- 172.21.15.7:0/3234786209 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b54004e00 con 0x7f0b64100a60 2024-09-19T08:44:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.623+0000 7f0b6b1d0640 1 -- 172.21.15.7:0/3234786209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b641a4fc0 con 0x7f0b64100a60 2024-09-19T08:44:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.624+0000 7f0b6b1d0640 1 -- 172.21.15.7:0/3234786209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b64100ec0 con 0x7f0b64100a60 2024-09-19T08:44:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.625+0000 7f0b61ffb640 1 -- 172.21.15.7:0/3234786209 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f0b54004fa0 con 0x7f0b64100a60 2024-09-19T08:44:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.626+0000 7f0b61ffb640 1 --2- 172.21.15.7:0/3234786209 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0b4c0a3440 0x7f0b4c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:39.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.626+0000 7f0b63fff640 1 --2- 172.21.15.7:0/3234786209 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0b4c0a3440 0x7f0b4c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.626+0000 7f0b61ffb640 1 -- 172.21.15.7:0/3234786209 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f0b540cf9a0 con 0x7f0b64100a60 2024-09-19T08:44:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.626+0000 7f0b63fff640 1 --2- 172.21.15.7:0/3234786209 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0b4c0a3440 0x7f0b4c0a5900 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0b6406b7e0 tx=0x7f0b58005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:39.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.630+0000 7f0b61ffb640 1 -- 172.21.15.7:0/3234786209 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0b5409c1a0 con 0x7f0b64100a60 2024-09-19T08:44:39.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.809+0000 7f0b6b1d0640 1 -- 172.21.15.7:0/3234786209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b641a5220 con 0x7f0b64100a60 2024-09-19T08:44:39.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.810+0000 7f0b61ffb640 1 -- 172.21.15.7:0/3234786209 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+23065 (secure 0 0 0) 0x7f0b5409baa0 con 0x7f0b64100a60 2024-09-19T08:44:39.810 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:44:39.810 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":83,"fsid":"ebd23124-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:02.287380+0000","modified":"2024-09-19T08:44:31.163658+0000","last_up_change":"2024-09-19T08:41:54.742978+0000","last_in_change":"2024-09-19T08:41:31.685622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:13.285118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:42:40.425852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:42:43.006548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"837e6267-71c7-4f48-9e0b-4e3f124682b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6803","nonce":402668717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6805","nonce":402668717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6809","nonce":402668717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6807","nonce":402668717}]},"public_addr":"172.21.15.7:6803/402668717","cluster_addr":"172.21.15.7:6805/402668717","heartbeat_back_addr":"172.21.15.7:6809/402668717","heartbeat_front_addr":"172.21.15.7:6807/402668717","state":["exists","up"]},{"osd":1,"uuid":"67865372-ac22-4b30-bd02-498e118d6701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6801","nonce":2213694259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6803","nonce":2213694259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6807","nonce":2213694259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6805","nonce":2213694259}]},"public_addr":"172.21.15.44:6801/2213694259","cluster_addr":"172.21.15.44:6803/2213694259","heartbeat_back_addr":"172.21.15.44:6807/2213694259","heartbeat_front_addr":"172.21.15.44:6805/2213694259","state":["exists","up"]},{"osd":2,"uuid":"37c1cc2b-60ea-449f-baa7-c65d96c3559c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6801","nonce":3413002145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6803","nonce":3413002145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6807","nonce":3413002145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6805","nonce":3413002145}]},"public_addr":"172.21.15.175:6801/3413002145","cluster_addr":"172.21.15.175:6803/3413002145","heartbeat_back_addr":"172.21.15.175:6807/3413002145","heartbeat_front_addr":"172.21.15.175:6805/3413002145","state":["exists","up"]},{"osd":3,"uuid":"a8ffd2ae-4211-492a-a8ac-d4d6cbb4a03d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6811","nonce":2528867083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6813","nonce":2528867083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6817","nonce":2528867083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6815","nonce":2528867083}]},"public_addr":"172.21.15.7:6811/2528867083","cluster_addr":"172.21.15.7:6813/2528867083","heartbeat_back_addr":"172.21.15.7:6817/2528867083","heartbeat_front_addr":"172.21.15.7:6815/2528867083","state":["exists","up"]},{"osd":4,"uuid":"9a67b2ec-1a0a-413e-bd13-9532f24a0155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6809","nonce":3537143774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537143774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537143774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537143774}]},"public_addr":"172.21.15.44:6809/3537143774","cluster_addr":"172.21.15.44:6811/3537143774","heartbeat_back_addr":"172.21.15.44:6815/3537143774","heartbeat_front_addr":"172.21.15.44:6813/3537143774","state":["exists","up"]},{"osd":5,"uuid":"436cd596-710b-48e2-8255-8427c93cee1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6809","nonce":4001214751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6811","nonce":4001214751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6815","nonce":4001214751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6813","nonce":4001214751}]},"public_addr":"172.21.15.175:6809/4001214751","cluster_addr":"172.21.15.175:6811/4001214751","heartbeat_back_addr":"172.21.15.175:6815/4001214751","heartbeat_front_addr":"172.21.15.175:6813/4001214751","state":["exists","up"]},{"osd":6,"uuid":"f5a7ad2b-6b44-4b5a-8af7-f7fb00e7ca68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6819","nonce":1261079202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6821","nonce":1261079202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6825","nonce":1261079202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6823","nonce":1261079202}]},"public_addr":"172.21.15.7:6819/1261079202","cluster_addr":"172.21.15.7:6821/1261079202","heartbeat_back_addr":"172.21.15.7:6825/1261079202","heartbeat_front_addr":"172.21.15.7:6823/1261079202","state":["exists","up"]},{"osd":7,"uuid":"aa24aee5-6449-4842-8831-1c8e06cde75b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6817","nonce":3120822957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6819","nonce":3120822957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6823","nonce":3120822957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6821","nonce":3120822957}]},"public_addr":"172.21.15.44:6817/3120822957","cluster_addr":"172.21.15.44:6819/3120822957","heartbeat_back_addr":"172.21.15.44:6823/3120822957","heartbeat_front_addr":"172.21.15.44:6821/3120822957","state":["exists","up"]},{"osd":8,"uuid":"d912501a-bb7a-489e-b6ab-e451fb22210d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6817","nonce":2080374927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6819","nonce":2080374927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6823","nonce":2080374927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6821","nonce":2080374927}]},"public_addr":"172.21.15.175:6817/2080374927","cluster_addr":"172.21.15.175:6819/2080374927","heartbeat_back_addr":"172.21.15.175:6823/2080374927","heartbeat_front_addr":"172.21.15.175:6821/2080374927","state":["exists","up"]},{"osd":9,"uuid":"d132f5b2-75b9-4d6c-89ec-f52c303e0fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6827","nonce":3808356432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6829","nonce":3808356432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6833","nonce":3808356432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6831","nonce":3808356432}]},"public_addr":"172.21.15.7:6827/3808356432","cluster_addr":"172.21.15.7:6829/3808356432","heartbeat_back_addr":"172.21.15.7:6833/3808356432","heartbeat_front_addr":"172.21.15.7:6831/3808356432","state":["exists","up"]},{"osd":10,"uuid":"f6c405d6-a255-4e0e-8528-7bbc16d5e434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6825","nonce":4009464689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6827","nonce":4009464689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6831","nonce":4009464689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6829","nonce":4009464689}]},"public_addr":"172.21.15.44:6825/4009464689","cluster_addr":"172.21.15.44:6827/4009464689","heartbeat_back_addr":"172.21.15.44:6831/4009464689","heartbeat_front_addr":"172.21.15.44:6829/4009464689","state":["exists","up"]},{"osd":11,"uuid":"a2a046cd-9939-473a-988b-6e0ad28a0233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6825","nonce":4173951310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6827","nonce":4173951310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6831","nonce":4173951310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6829","nonce":4173951310}]},"public_addr":"172.21.15.175:6825/4173951310","cluster_addr":"172.21.15.175:6827/4173951310","heartbeat_back_addr":"172.21.15.175:6831/4173951310","heartbeat_front_addr":"172.21.15.175:6829/4173951310","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:20.015497+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:44.967046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:09.682080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:35.516899+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:00.705686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:25.276387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:49.927456+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:14.786755+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:38.553913+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.962825+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.812976+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:52.837744+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/973276283":"2024-09-20T08:44:31.163626+0000","172.21.15.7:0/2695884066":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/816886708":"2024-09-20T08:35:31.711540+0000","172.21.15.7:6800/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:6800/3577760109":"2024-09-20T08:44:31.163626+0000","172.21.15.7:0/1429582340":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/4277640815":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/499611189":"2024-09-20T08:44:31.163626+0000","172.21.15.7:6801/3577760109":"2024-09-20T08:44:31.163626+0000","172.21.15.7:0/4058698573":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/1800852158":"2024-09-20T08:44:31.163626+0000","172.21.15.7:0/2884903597":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/2457209252":"2024-09-20T08:44:31.163626+0000","172.21.15.7:6800/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/2008302629":"2024-09-20T08:44:31.163626+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:44:39.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.812+0000 7f0b6b1d0640 1 -- 172.21.15.7:0/3234786209 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0b4c0a3440 msgr2=0x7f0b4c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:39.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.812+0000 7f0b6b1d0640 1 --2- 172.21.15.7:0/3234786209 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0b4c0a3440 0x7f0b4c0a5900 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0b6406b7e0 tx=0x7f0b58005f90 comp rx=0 tx=0).stop 2024-09-19T08:44:39.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.812+0000 7f0b6b1d0640 1 -- 172.21.15.7:0/3234786209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b64100a60 msgr2=0x7f0b64198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:39.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.813+0000 7f0b6b1d0640 1 --2- 172.21.15.7:0/3234786209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b64100a60 0x7f0b64198440 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0b5400d770 tx=0x7f0b5400dc30 comp rx=0 tx=0).stop 2024-09-19T08:44:39.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.813+0000 7f0b6b1d0640 1 -- 172.21.15.7:0/3234786209 shutdown_connections 2024-09-19T08:44:39.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.813+0000 7f0b6b1d0640 1 --2- 172.21.15.7:0/3234786209 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0b4c0a3440 0x7f0b4c0a5900 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:39.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.813+0000 7f0b6b1d0640 1 --2- 172.21.15.7:0/3234786209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b64106a60 0x7f0b6419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:39.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.813+0000 7f0b6b1d0640 1 --2- 172.21.15.7:0/3234786209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b64101400 0x7f0b64198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:39.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.813+0000 7f0b6b1d0640 1 --2- 172.21.15.7:0/3234786209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b64100a60 0x7f0b64198440 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:39.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.813+0000 7f0b6b1d0640 1 -- 172.21.15.7:0/3234786209 >> 172.21.15.7:0/3234786209 conn(0x7f0b640fc780 msgr2=0x7f0b64104c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:39.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.813+0000 7f0b6b1d0640 1 -- 172.21.15.7:0/3234786209 shutdown_connections 2024-09-19T08:44:39.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:39.813+0000 7f0b6b1d0640 1 -- 172.21.15.7:0/3234786209 wait complete. 2024-09-19T08:44:40.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:39 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3234786209' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:40.178 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:39 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3234786209' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:40.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:39 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3234786209' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:40.512 DEBUG:tasks.fwd_scrub:Yielding 2024-09-19T08:44:40.512 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T08:44:40.523 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T08:44:40.523 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-19T08:44:40.523 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-19T08:44:40.524 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-19T08:44:40.524 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:44:40.524 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:44:40.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.632+0000 7f37cc05a640 1 -- 172.21.15.7:0/4045712460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c41009a0 msgr2=0x7f37c4100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:40.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.632+0000 7f37cc05a640 1 --2- 172.21.15.7:0/4045712460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c41009a0 0x7f37c4100e00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009930 tx=0x7f37b402a420 comp rx=0 tx=0).stop 2024-09-19T08:44:40.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.633+0000 7f37cc05a640 1 -- 172.21.15.7:0/4045712460 shutdown_connections 2024-09-19T08:44:40.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.633+0000 7f37cc05a640 1 --2- 172.21.15.7:0/4045712460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37c4101340 0x7f37c410d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:40.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.633+0000 7f37cc05a640 1 --2- 172.21.15.7:0/4045712460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c41009a0 0x7f37c4100e00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:40.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.633+0000 7f37cc05a640 1 --2- 172.21.15.7:0/4045712460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37c41069b0 0x7f37c4106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:40.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.633+0000 7f37cc05a640 1 -- 172.21.15.7:0/4045712460 >> 172.21.15.7:0/4045712460 conn(0x7f37c40779a0 msgr2=0x7f37c40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:40.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.633+0000 7f37cc05a640 1 -- 172.21.15.7:0/4045712460 shutdown_connections 2024-09-19T08:44:40.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.633+0000 7f37cc05a640 1 -- 172.21.15.7:0/4045712460 wait complete. 2024-09-19T08:44:40.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.633+0000 7f37cc05a640 1 Processor -- start 2024-09-19T08:44:40.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.633+0000 7f37cc05a640 1 -- start start 2024-09-19T08:44:40.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.634+0000 7f37cc05a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c41009a0 0x7f37c41984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:40.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.634+0000 7f37cc05a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37c4101340 0x7f37c4198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:40.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.634+0000 7f37cc05a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37c41069b0 0x7f37c419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:40.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.634+0000 7f37cc05a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f37c4110df0 con 0x7f37c41009a0 2024-09-19T08:44:40.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.634+0000 7f37cc05a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f37c4110c70 con 0x7f37c4101340 2024-09-19T08:44:40.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.634+0000 7f37cc05a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f37c4110f70 con 0x7f37c41069b0 2024-09-19T08:44:40.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.634+0000 7f37c9df6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c41009a0 0x7f37c41984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:40.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.634+0000 7f37c9df6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c41009a0 0x7f37c41984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53388/0 (socket says 172.21.15.7:53388) 2024-09-19T08:44:40.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.634+0000 7f37c9df6640 1 -- 172.21.15.7:0/3296606313 learned_addr learned my addr 172.21.15.7:0/3296606313 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:40.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.634+0000 7f37ca5f7640 1 --2- 172.21.15.7:0/3296606313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37c41069b0 0x7f37c419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:40.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.634+0000 7f37c95f5640 1 --2- 172.21.15.7:0/3296606313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37c4101340 0x7f37c4198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:40.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.634+0000 7f37c9df6640 1 -- 172.21.15.7:0/3296606313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37c41069b0 msgr2=0x7f37c419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:40.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.634+0000 7f37c9df6640 1 --2- 172.21.15.7:0/3296606313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37c41069b0 0x7f37c419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:40.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.634+0000 7f37c9df6640 1 -- 172.21.15.7:0/3296606313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37c4101340 msgr2=0x7f37c4198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:40.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.634+0000 7f37c9df6640 1 --2- 172.21.15.7:0/3296606313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37c4101340 0x7f37c4198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:40.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.634+0000 7f37c9df6640 1 -- 172.21.15.7:0/3296606313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c419d4b0 con 0x7f37c41009a0 2024-09-19T08:44:40.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.634+0000 7f37c9df6640 1 --2- 172.21.15.7:0/3296606313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c41009a0 0x7f37c41984c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f37c000e9f0 tx=0x7f37c000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:40.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.634+0000 7f37baffd640 1 -- 172.21.15.7:0/3296606313 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c000cd80 con 0x7f37c41009a0 2024-09-19T08:44:40.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.634+0000 7f37cc05a640 1 -- 172.21.15.7:0/3296606313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37c419d7a0 con 0x7f37c41009a0 2024-09-19T08:44:40.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.634+0000 7f37baffd640 1 -- 172.21.15.7:0/3296606313 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37c0005500 con 0x7f37c41009a0 2024-09-19T08:44:40.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.634+0000 7f37baffd640 1 -- 172.21.15.7:0/3296606313 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c0010690 con 0x7f37c41009a0 2024-09-19T08:44:40.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.634+0000 7f37cc05a640 1 -- 172.21.15.7:0/3296606313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37c41a5030 con 0x7f37c41009a0 2024-09-19T08:44:40.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.635+0000 7f37cc05a640 1 -- 172.21.15.7:0/3296606313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37c41020e0 con 0x7f37c41009a0 2024-09-19T08:44:40.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.637+0000 7f37baffd640 1 -- 172.21.15.7:0/3296606313 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f37c00046c0 con 0x7f37c41009a0 2024-09-19T08:44:40.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.638+0000 7f37baffd640 1 --2- 172.21.15.7:0/3296606313 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f37b00a3440 0x7f37b00a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:40.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.638+0000 7f37baffd640 1 -- 172.21.15.7:0/3296606313 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f37c00d0330 con 0x7f37c41009a0 2024-09-19T08:44:40.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.638+0000 7f37c95f5640 1 --2- 172.21.15.7:0/3296606313 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f37b00a3440 0x7f37b00a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:40.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.639+0000 7f37c95f5640 1 --2- 172.21.15.7:0/3296606313 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f37b00a3440 0x7f37b00a5900 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f37b4000c00 tx=0x7f37b4005a20 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:40.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.642+0000 7f37baffd640 1 -- 172.21.15.7:0/3296606313 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f37c009cb90 con 0x7f37c41009a0 2024-09-19T08:44:40.786 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:40.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.827+0000 7f37cc05a640 1 -- 172.21.15.7:0/3296606313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f37c4100e00 con 0x7f37c41009a0 2024-09-19T08:44:40.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.831+0000 7f37baffd640 1 -- 172.21.15.7:0/3296606313 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v27)=0 v27) ==== 129+0+0 (secure 0 0 0) 0x7f37c009c490 con 0x7f37c41009a0 2024-09-19T08:44:40.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.833+0000 7f37cc05a640 1 -- 172.21.15.7:0/3296606313 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f37b00a3440 msgr2=0x7f37b00a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:40.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.833+0000 7f37cc05a640 1 --2- 172.21.15.7:0/3296606313 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f37b00a3440 0x7f37b00a5900 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f37b4000c00 tx=0x7f37b4005a20 comp rx=0 tx=0).stop 2024-09-19T08:44:40.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.833+0000 7f37cc05a640 1 -- 172.21.15.7:0/3296606313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c41009a0 msgr2=0x7f37c41984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:40.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.833+0000 7f37cc05a640 1 --2- 172.21.15.7:0/3296606313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c41009a0 0x7f37c41984c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f37c000e9f0 tx=0x7f37c000edf0 comp rx=0 tx=0).stop 2024-09-19T08:44:40.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.833+0000 7f37cc05a640 1 -- 172.21.15.7:0/3296606313 shutdown_connections 2024-09-19T08:44:40.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.833+0000 7f37cc05a640 1 --2- 172.21.15.7:0/3296606313 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f37b00a3440 0x7f37b00a5900 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:40.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.833+0000 7f37cc05a640 1 --2- 172.21.15.7:0/3296606313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37c41069b0 0x7f37c419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:40.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.833+0000 7f37cc05a640 1 --2- 172.21.15.7:0/3296606313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37c4101340 0x7f37c4198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:40.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.833+0000 7f37cc05a640 1 --2- 172.21.15.7:0/3296606313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37c41009a0 0x7f37c41984c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:40.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.833+0000 7f37cc05a640 1 -- 172.21.15.7:0/3296606313 >> 172.21.15.7:0/3296606313 conn(0x7f37c40779a0 msgr2=0x7f37c4069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:40.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.833+0000 7f37cc05a640 1 -- 172.21.15.7:0/3296606313 shutdown_connections 2024-09-19T08:44:40.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.834+0000 7f37cc05a640 1 -- 172.21.15.7:0/3296606313 wait complete. 2024-09-19T08:44:40.845 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-19T08:44:40.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.953+0000 7faf1436d640 1 -- 172.21.15.7:0/3132366984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf0c1009d0 msgr2=0x7faf0c100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:40.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.953+0000 7faf1436d640 1 --2- 172.21.15.7:0/3132366984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf0c1009d0 0x7faf0c100e30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7faefc009930 tx=0x7faefc02a420 comp rx=0 tx=0).stop 2024-09-19T08:44:40.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.953+0000 7faf1436d640 1 -- 172.21.15.7:0/3132366984 shutdown_connections 2024-09-19T08:44:40.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.953+0000 7faf1436d640 1 --2- 172.21.15.7:0/3132366984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf0c101370 0x7faf0c10d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:40.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.953+0000 7faf1436d640 1 --2- 172.21.15.7:0/3132366984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf0c1009d0 0x7faf0c100e30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:40.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.953+0000 7faf1436d640 1 --2- 172.21.15.7:0/3132366984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf0c1069e0 0x7faf0c106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:40.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.953+0000 7faf1436d640 1 -- 172.21.15.7:0/3132366984 >> 172.21.15.7:0/3132366984 conn(0x7faf0c0fc6b0 msgr2=0x7faf0c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:40.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.953+0000 7faf1436d640 1 -- 172.21.15.7:0/3132366984 shutdown_connections 2024-09-19T08:44:40.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.953+0000 7faf1436d640 1 -- 172.21.15.7:0/3132366984 wait complete. 2024-09-19T08:44:40.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.954+0000 7faf1436d640 1 Processor -- start 2024-09-19T08:44:40.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.954+0000 7faf1436d640 1 -- start start 2024-09-19T08:44:40.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.954+0000 7faf1436d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf0c1009d0 0x7faf0c1972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:40.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.954+0000 7faf1436d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf0c101370 0x7faf0c197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:40.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.954+0000 7faf1436d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf0c1069e0 0x7faf0c19bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:40.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.954+0000 7faf1436d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c110e30 con 0x7faf0c1009d0 2024-09-19T08:44:40.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.954+0000 7faf1436d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c110cb0 con 0x7faf0c1069e0 2024-09-19T08:44:40.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.954+0000 7faf1436d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c110fb0 con 0x7faf0c101370 2024-09-19T08:44:40.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.954+0000 7faf12109640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf0c1009d0 0x7faf0c1972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:40.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.954+0000 7faf12109640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf0c1009d0 0x7faf0c1972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53394/0 (socket says 172.21.15.7:53394) 2024-09-19T08:44:40.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.954+0000 7faf12109640 1 -- 172.21.15.7:0/1957621456 learned_addr learned my addr 172.21.15.7:0/1957621456 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.954+0000 7faf11908640 1 --2- 172.21.15.7:0/1957621456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf0c101370 0x7faf0c197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.954+0000 7faf1290a640 1 --2- 172.21.15.7:0/1957621456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf0c1069e0 0x7faf0c19bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.954+0000 7faf12109640 1 -- 172.21.15.7:0/1957621456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf0c101370 msgr2=0x7faf0c197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.954+0000 7faf12109640 1 --2- 172.21.15.7:0/1957621456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf0c101370 0x7faf0c197800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.954+0000 7faf12109640 1 -- 172.21.15.7:0/1957621456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf0c1069e0 msgr2=0x7faf0c19bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.954+0000 7faf12109640 1 --2- 172.21.15.7:0/1957621456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf0c1069e0 0x7faf0c19bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.954+0000 7faf12109640 1 -- 172.21.15.7:0/1957621456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0c19c2b0 con 0x7faf0c1009d0 2024-09-19T08:44:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.955+0000 7faf12109640 1 --2- 172.21.15.7:0/1957621456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf0c1009d0 0x7faf0c1972c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7faf0800c920 tx=0x7faf0800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.955+0000 7faf037fe640 1 -- 172.21.15.7:0/1957621456 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08007c70 con 0x7faf0c1009d0 2024-09-19T08:44:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.955+0000 7faf037fe640 1 -- 172.21.15.7:0/1957621456 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf08007e10 con 0x7faf0c1009d0 2024-09-19T08:44:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.955+0000 7faf1436d640 1 -- 172.21.15.7:0/1957621456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf0c19c5a0 con 0x7faf0c1009d0 2024-09-19T08:44:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.955+0000 7faf037fe640 1 -- 172.21.15.7:0/1957621456 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08018890 con 0x7faf0c1009d0 2024-09-19T08:44:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.955+0000 7faf1436d640 1 -- 172.21.15.7:0/1957621456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf0c06a320 con 0x7faf0c1009d0 2024-09-19T08:44:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.956+0000 7faf1436d640 1 -- 172.21.15.7:0/1957621456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf0c100e30 con 0x7faf0c1009d0 2024-09-19T08:44:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.957+0000 7faf037fe640 1 -- 172.21.15.7:0/1957621456 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7faf08018a50 con 0x7faf0c1009d0 2024-09-19T08:44:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.958+0000 7faf037fe640 1 --2- 172.21.15.7:0/1957621456 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7faef80a3440 0x7faef80a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.958+0000 7faf037fe640 1 -- 172.21.15.7:0/1957621456 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7faf080cfff0 con 0x7faf0c1009d0 2024-09-19T08:44:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.958+0000 7faf11908640 1 --2- 172.21.15.7:0/1957621456 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7faef80a3440 0x7faef80a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.959+0000 7faf11908640 1 --2- 172.21.15.7:0/1957621456 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7faef80a3440 0x7faef80a5900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faefc006010 tx=0x7faefc000bc0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:40.962+0000 7faf037fe640 1 -- 172.21.15.7:0/1957621456 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faf08014030 con 0x7faf0c1009d0 2024-09-19T08:44:41.100 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:40 smithi007 ceph-mon[31221]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 0 B/s wr, 22 op/s 2024-09-19T08:44:41.100 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:40 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3296606313' entity='client.admin' 2024-09-19T08:44:41.101 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:40 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:41.101 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:40 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:41.101 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:40 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:41.101 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:40 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:41.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.147+0000 7faf1436d640 1 -- 172.21.15.7:0/1957621456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7faf0c06a5e0 con 0x7faf0c1009d0 2024-09-19T08:44:41.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.151+0000 7faf037fe640 1 -- 172.21.15.7:0/1957621456 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v28)=0 v28) ==== 138+0+0 (secure 0 0 0) 0x7faf0809c830 con 0x7faf0c1009d0 2024-09-19T08:44:41.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.153+0000 7faf1436d640 1 -- 172.21.15.7:0/1957621456 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7faef80a3440 msgr2=0x7faef80a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.153+0000 7faf1436d640 1 --2- 172.21.15.7:0/1957621456 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7faef80a3440 0x7faef80a5900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faefc006010 tx=0x7faefc000bc0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.153+0000 7faf1436d640 1 -- 172.21.15.7:0/1957621456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf0c1009d0 msgr2=0x7faf0c1972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.153+0000 7faf1436d640 1 --2- 172.21.15.7:0/1957621456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf0c1009d0 0x7faf0c1972c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7faf0800c920 tx=0x7faf0800cde0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.153+0000 7faf1436d640 1 -- 172.21.15.7:0/1957621456 shutdown_connections 2024-09-19T08:44:41.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.153+0000 7faf1436d640 1 --2- 172.21.15.7:0/1957621456 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7faef80a3440 0x7faef80a5900 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.153+0000 7faf1436d640 1 --2- 172.21.15.7:0/1957621456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf0c1069e0 0x7faf0c19bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.153+0000 7faf1436d640 1 --2- 172.21.15.7:0/1957621456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf0c101370 0x7faf0c197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.153+0000 7faf1436d640 1 --2- 172.21.15.7:0/1957621456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf0c1009d0 0x7faf0c1972c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.153+0000 7faf1436d640 1 -- 172.21.15.7:0/1957621456 >> 172.21.15.7:0/1957621456 conn(0x7faf0c0fc6b0 msgr2=0x7faf0c0fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:41.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.153+0000 7faf1436d640 1 -- 172.21.15.7:0/1957621456 shutdown_connections 2024-09-19T08:44:41.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.153+0000 7faf1436d640 1 -- 172.21.15.7:0/1957621456 wait complete. 2024-09-19T08:44:41.165 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-19T08:44:41.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:40 smithi175 ceph-mon[35688]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 0 B/s wr, 22 op/s 2024-09-19T08:44:41.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:40 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3296606313' entity='client.admin' 2024-09-19T08:44:41.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:40 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:41.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:40 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:41.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:40 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:41.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:40 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:41.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.286+0000 7f14729f1640 1 -- 172.21.15.7:0/3892819518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f146c101340 msgr2=0x7f146c10d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.286+0000 7f14729f1640 1 --2- 172.21.15.7:0/3892819518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f146c101340 0x7f146c10d870 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1464009cd0 tx=0x7f146402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.286+0000 7f14729f1640 1 -- 172.21.15.7:0/3892819518 shutdown_connections 2024-09-19T08:44:41.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.286+0000 7f14729f1640 1 --2- 172.21.15.7:0/3892819518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f146c101340 0x7f146c10d870 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.286+0000 7f14729f1640 1 --2- 172.21.15.7:0/3892819518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f146c1009a0 0x7f146c100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.286+0000 7f14729f1640 1 --2- 172.21.15.7:0/3892819518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f146c1069b0 0x7f146c106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.286+0000 7f14729f1640 1 -- 172.21.15.7:0/3892819518 >> 172.21.15.7:0/3892819518 conn(0x7f146c0779a0 msgr2=0x7f146c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:41.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.286+0000 7f14729f1640 1 -- 172.21.15.7:0/3892819518 shutdown_connections 2024-09-19T08:44:41.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.286+0000 7f14729f1640 1 -- 172.21.15.7:0/3892819518 wait complete. 2024-09-19T08:44:41.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.287+0000 7f14729f1640 1 Processor -- start 2024-09-19T08:44:41.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.287+0000 7f14729f1640 1 -- start start 2024-09-19T08:44:41.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.287+0000 7f14729f1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f146c1009a0 0x7f146c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.287+0000 7f14729f1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f146c101340 0x7f146c19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.287+0000 7f14729f1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f146c1069b0 0x7f146c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.287+0000 7f14729f1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f146c10fcf0 con 0x7f146c101340 2024-09-19T08:44:41.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.287+0000 7f14729f1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f146c10fb70 con 0x7f146c1009a0 2024-09-19T08:44:41.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.287+0000 7f14729f1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f146c10fe70 con 0x7f146c1069b0 2024-09-19T08:44:41.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.287+0000 7f146b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f146c101340 0x7f146c19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.287+0000 7f146b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f146c101340 0x7f146c19ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53416/0 (socket says 172.21.15.7:53416) 2024-09-19T08:44:41.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.287+0000 7f146b7fe640 1 -- 172.21.15.7:0/1838818734 learned_addr learned my addr 172.21.15.7:0/1838818734 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:41.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.287+0000 7f1470f8e640 1 --2- 172.21.15.7:0/1838818734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f146c1069b0 0x7f146c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.288+0000 7f146bfff640 1 --2- 172.21.15.7:0/1838818734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f146c1009a0 0x7f146c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.288+0000 7f146b7fe640 1 -- 172.21.15.7:0/1838818734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f146c1069b0 msgr2=0x7f146c19ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.288+0000 7f146b7fe640 1 --2- 172.21.15.7:0/1838818734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f146c1069b0 0x7f146c19ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.288+0000 7f146b7fe640 1 -- 172.21.15.7:0/1838818734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f146c1009a0 msgr2=0x7f146c19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.288+0000 7f146b7fe640 1 --2- 172.21.15.7:0/1838818734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f146c1009a0 0x7f146c19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.288+0000 7f146b7fe640 1 -- 172.21.15.7:0/1838818734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146c19f640 con 0x7f146c101340 2024-09-19T08:44:41.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.288+0000 7f146b7fe640 1 --2- 172.21.15.7:0/1838818734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f146c101340 0x7f146c19ab90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f146000e9f0 tx=0x7f146000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:41.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.288+0000 7f14697fa640 1 -- 172.21.15.7:0/1838818734 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146000cd80 con 0x7f146c101340 2024-09-19T08:44:41.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.288+0000 7f14729f1640 1 -- 172.21.15.7:0/1838818734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f146c19f930 con 0x7f146c101340 2024-09-19T08:44:41.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.288+0000 7f14697fa640 1 -- 172.21.15.7:0/1838818734 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1460010910 con 0x7f146c101340 2024-09-19T08:44:41.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.288+0000 7f14697fa640 1 -- 172.21.15.7:0/1838818734 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14600188f0 con 0x7f146c101340 2024-09-19T08:44:41.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.289+0000 7f14729f1640 1 -- 172.21.15.7:0/1838818734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f146c1a71c0 con 0x7f146c101340 2024-09-19T08:44:41.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.291+0000 7f14729f1640 1 -- 172.21.15.7:0/1838818734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1458005290 con 0x7f146c101340 2024-09-19T08:44:41.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.291+0000 7f14697fa640 1 -- 172.21.15.7:0/1838818734 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f1460018b50 con 0x7f146c101340 2024-09-19T08:44:41.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.292+0000 7f14697fa640 1 --2- 172.21.15.7:0/1838818734 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f14540a3440 0x7f14540a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.292+0000 7f14697fa640 1 -- 172.21.15.7:0/1838818734 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f14600d0140 con 0x7f146c101340 2024-09-19T08:44:41.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.293+0000 7f146bfff640 1 --2- 172.21.15.7:0/1838818734 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f14540a3440 0x7f14540a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.293+0000 7f146bfff640 1 --2- 172.21.15.7:0/1838818734 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f14540a3440 0x7f14540a5900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f145c00b3c0 tx=0x7f145c00d040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:41.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.298+0000 7f14697fa640 1 -- 172.21.15.7:0/1838818734 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f146009c350 con 0x7f146c101340 2024-09-19T08:44:41.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:40 smithi044 ceph-mon[35072]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 0 B/s wr, 22 op/s 2024-09-19T08:44:41.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:40 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3296606313' entity='client.admin' 2024-09-19T08:44:41.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:40 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:41.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:40 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:41.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:40 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:41.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:40 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:41.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.283+0000 7ff1ee381640 1 -- 172.21.15.7:0/2101210965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1e8102ef0 msgr2=0x7ff1e810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.283+0000 7ff1ee381640 1 --2- 172.21.15.7:0/2101210965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1e8102ef0 0x7ff1e810da40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009ca0 tx=0x7ff1e002a950 comp rx=0 tx=0).stop 2024-09-19T08:44:41.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.283+0000 7ff1ee381640 1 -- 172.21.15.7:0/2101210965 shutdown_connections 2024-09-19T08:44:41.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.283+0000 7ff1ee381640 1 --2- 172.21.15.7:0/2101210965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1e8102ef0 0x7ff1e810da40 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.283+0000 7ff1ee381640 1 --2- 172.21.15.7:0/2101210965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1e8102570 0x7ff1e81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.283+0000 7ff1ee381640 1 --2- 172.21.15.7:0/2101210965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1e8100e20 0x7ff1e8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.283+0000 7ff1ee381640 1 -- 172.21.15.7:0/2101210965 >> 172.21.15.7:0/2101210965 conn(0x7ff1e80fc7d0 msgr2=0x7ff1e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:41.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.283+0000 7ff1ee381640 1 -- 172.21.15.7:0/2101210965 shutdown_connections 2024-09-19T08:44:41.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.283+0000 7ff1ee381640 1 -- 172.21.15.7:0/2101210965 wait complete. 2024-09-19T08:44:41.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.284+0000 7ff1ee381640 1 Processor -- start 2024-09-19T08:44:41.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.284+0000 7ff1ee381640 1 -- start start 2024-09-19T08:44:41.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.284+0000 7ff1ee381640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1e8100e20 0x7ff1e8197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.284+0000 7ff1ee381640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1e8102570 0x7ff1e81978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.284+0000 7ff1ee381640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1e8102ef0 0x7ff1e819bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.285+0000 7ff1e7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1e8100e20 0x7ff1e8197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.285+0000 7ff1e7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1e8100e20 0x7ff1e8197380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53406/0 (socket says 172.21.15.7:53406) 2024-09-19T08:44:41.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.285+0000 7ff1e7fff640 1 -- 172.21.15.7:0/4169867182 learned_addr learned my addr 172.21.15.7:0/4169867182 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:41.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.285+0000 7ff1ee381640 1 -- 172.21.15.7:0/4169867182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e8110f80 con 0x7ff1e8100e20 2024-09-19T08:44:41.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.285+0000 7ff1ee381640 1 -- 172.21.15.7:0/4169867182 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e8110e00 con 0x7ff1e8102570 2024-09-19T08:44:41.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.285+0000 7ff1ee381640 1 -- 172.21.15.7:0/4169867182 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e8111100 con 0x7ff1e8102ef0 2024-09-19T08:44:41.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.285+0000 7ff1ec91e640 1 --2- 172.21.15.7:0/4169867182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1e8102ef0 0x7ff1e819bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.285+0000 7ff1e77fe640 1 --2- 172.21.15.7:0/4169867182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1e8102570 0x7ff1e81978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.285+0000 7ff1e7fff640 1 -- 172.21.15.7:0/4169867182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1e8102ef0 msgr2=0x7ff1e819bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.285+0000 7ff1e7fff640 1 --2- 172.21.15.7:0/4169867182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1e8102ef0 0x7ff1e819bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.285+0000 7ff1e7fff640 1 -- 172.21.15.7:0/4169867182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1e8102570 msgr2=0x7ff1e81978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.285+0000 7ff1e7fff640 1 --2- 172.21.15.7:0/4169867182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1e8102570 0x7ff1e81978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.285+0000 7ff1e7fff640 1 -- 172.21.15.7:0/4169867182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e819c330 con 0x7ff1e8100e20 2024-09-19T08:44:41.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.285+0000 7ff1e7fff640 1 --2- 172.21.15.7:0/4169867182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1e8100e20 0x7ff1e8197380 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800e9f0 tx=0x7ff1d800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:41.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.285+0000 7ff1e57fa640 1 -- 172.21.15.7:0/4169867182 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d800cd80 con 0x7ff1e8100e20 2024-09-19T08:44:41.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.285+0000 7ff1e57fa640 1 -- 172.21.15.7:0/4169867182 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1d8010910 con 0x7ff1e8100e20 2024-09-19T08:44:41.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.285+0000 7ff1e57fa640 1 -- 172.21.15.7:0/4169867182 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8018990 con 0x7ff1e8100e20 2024-09-19T08:44:41.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.285+0000 7ff1ee381640 1 -- 172.21.15.7:0/4169867182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e819c620 con 0x7ff1e8100e20 2024-09-19T08:44:41.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.286+0000 7ff1ee381640 1 -- 172.21.15.7:0/4169867182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e8069f70 con 0x7ff1e8100e20 2024-09-19T08:44:41.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.289+0000 7ff1f075a740 1 Processor -- start 2024-09-19T08:44:41.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.289+0000 7ff1f075a740 1 -- start start 2024-09-19T08:44:41.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.289+0000 7ff1f075a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfca00 0x55c333cfcde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.289+0000 7ff1f075a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333cfd320 0x55c333d0bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.289+0000 7ff1f075a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c333d0c150 0x55c333d0e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.289+0000 7ff1f075a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c333c62280 con 0x55c333cfd320 2024-09-19T08:44:41.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.289+0000 7ff1f075a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c333c09b10 con 0x55c333cfca00 2024-09-19T08:44:41.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.289+0000 7ff1f075a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c333c5e240 con 0x55c333d0c150 2024-09-19T08:44:41.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.290+0000 7ff1e77fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c333d0c150 0x55c333d0e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.290+0000 7ff1e77fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c333d0c150 0x55c333d0e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.7:60626/0 (socket says 172.21.15.7:60626) 2024-09-19T08:44:41.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.290+0000 7ff1e77fe640 1 -- 172.21.15.7:0/2506644452 learned_addr learned my addr 172.21.15.7:0/2506644452 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:41.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.290+0000 7ff1ec91e640 1 --2- 172.21.15.7:0/2506644452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfca00 0x55c333cfcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.290+0000 7ff1e77fe640 1 -- 172.21.15.7:0/2506644452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfca00 msgr2=0x55c333cfcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:41.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.290+0000 7ff1e77fe640 1 --2- 172.21.15.7:0/2506644452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfca00 0x55c333cfcde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.290+0000 7ff1e77fe640 1 -- 172.21.15.7:0/2506644452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333cfd320 msgr2=0x55c333d0bc10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:44:41.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.290+0000 7ff1e77fe640 1 --2- 172.21.15.7:0/2506644452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333cfd320 0x55c333d0bc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.290+0000 7ff1e77fe640 1 -- 172.21.15.7:0/2506644452 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c333c161f0 con 0x55c333d0c150 2024-09-19T08:44:41.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.290+0000 7ff1ec91e640 1 --2- 172.21.15.7:0/2506644452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfca00 0x55c333cfcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:44:41.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.290+0000 7ff1e77fe640 1 --2- 172.21.15.7:0/2506644452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c333d0c150 0x55c333d0e540 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc009ca0 tx=0x7ff1dc011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dc67ecdce45ca65 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:41.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.291+0000 7ff1ce7fc640 1 -- 172.21.15.7:0/2506644452 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc005220 con 0x55c333d0c150 2024-09-19T08:44:41.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.291+0000 7ff1ce7fc640 1 -- 172.21.15.7:0/2506644452 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1dc004c80 con 0x55c333d0c150 2024-09-19T08:44:41.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.291+0000 7ff1ce7fc640 1 -- 172.21.15.7:0/2506644452 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc019890 con 0x55c333d0c150 2024-09-19T08:44:41.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.291+0000 7ff1e57fa640 1 -- 172.21.15.7:0/4169867182 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7ff1d8010ac0 con 0x7ff1e8100e20 2024-09-19T08:44:41.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.291+0000 7ff1f075a740 1 -- 172.21.15.7:0/2506644452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c333d0c150 msgr2=0x55c333d0e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.291+0000 7ff1f075a740 1 --2- 172.21.15.7:0/2506644452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c333d0c150 0x55c333d0e540 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc009ca0 tx=0x7ff1dc011810 comp rx=0 tx=0).stop 2024-09-19T08:44:41.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.291+0000 7ff1f075a740 1 -- 172.21.15.7:0/2506644452 shutdown_connections 2024-09-19T08:44:41.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.291+0000 7ff1f075a740 1 --2- 172.21.15.7:0/2506644452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c333d0c150 0x55c333d0e540 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.291+0000 7ff1f075a740 1 --2- 172.21.15.7:0/2506644452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333cfd320 0x55c333d0bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.291+0000 7ff1f075a740 1 --2- 172.21.15.7:0/2506644452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfca00 0x55c333cfcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.291+0000 7ff1f075a740 1 -- 172.21.15.7:0/2506644452 >> 172.21.15.7:0/2506644452 conn(0x55c333cf90f0 msgr2=0x55c333cf94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:41.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.292+0000 7ff1f075a740 1 -- 172.21.15.7:0/2506644452 shutdown_connections 2024-09-19T08:44:41.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.292+0000 7ff1f075a740 1 -- 172.21.15.7:0/2506644452 wait complete. 2024-09-19T08:44:41.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.292+0000 7ff1e57fa640 1 --2- 172.21.15.7:0/4169867182 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff1d00a33e0 0x7ff1d00a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.292+0000 7ff1f075a740 1 -- start start 2024-09-19T08:44:41.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.292+0000 7ff1e57fa640 1 -- 172.21.15.7:0/4169867182 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7ff1d80d0130 con 0x7ff1e8100e20 2024-09-19T08:44:41.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.293+0000 7ff1f075a740 1 Processor -- start 2024-09-19T08:44:41.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.293+0000 7ff1e77fe640 1 --2- 172.21.15.7:0/4169867182 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff1d00a33e0 0x7ff1d00a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.293+0000 7ff1e77fe640 1 --2- 172.21.15.7:0/4169867182 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff1d00a33e0 0x7ff1d00a58a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0057c0 tx=0x7ff1dc009830 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:41.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.294+0000 7ff1f075a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfca00 0x55c333d08ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.294+0000 7ff1f075a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333cfd320 0x55c333d09530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.294+0000 7ff1f075a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c333d0c150 0x55c333d09a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.294+0000 7ff1f075a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c333d0ed20 con 0x55c333cfd320 2024-09-19T08:44:41.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.294+0000 7ff1f075a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c333c1cf10 con 0x55c333cfca00 2024-09-19T08:44:41.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.294+0000 7ff1f075a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c333d0eea0 con 0x55c333d0c150 2024-09-19T08:44:41.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.294+0000 7ff1f075a740 10 client.0 _ll_register_callbacks cb 0x55c333be5a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:44:41.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.294+0000 7ff1e77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333cfd320 0x55c333d09530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.294+0000 7ff1e77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333cfd320 0x55c333d09530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53430/0 (socket says 172.21.15.7:53430) 2024-09-19T08:44:41.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.294+0000 7ff1e77fe640 1 -- 172.21.15.7:0/533049616 learned_addr learned my addr 172.21.15.7:0/533049616 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:41.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.294+0000 7ff1e7fff640 1 --2- 172.21.15.7:0/533049616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfca00 0x55c333d08ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.294+0000 7ff1ec91e640 1 --2- 172.21.15.7:0/533049616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c333d0c150 0x55c333d09a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.294+0000 7ff1e77fe640 1 -- 172.21.15.7:0/533049616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c333d0c150 msgr2=0x55c333d09a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:41.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.294+0000 7ff1e77fe640 1 --2- 172.21.15.7:0/533049616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c333d0c150 0x55c333d09a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.294+0000 7ff1e77fe640 1 -- 172.21.15.7:0/533049616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfca00 msgr2=0x55c333d08ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:41.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.294+0000 7ff1e77fe640 1 --2- 172.21.15.7:0/533049616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfca00 0x55c333d08ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.294+0000 7ff1e77fe640 1 -- 172.21.15.7:0/533049616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3339d36a0 con 0x55c333cfd320 2024-09-19T08:44:41.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.294+0000 7ff1e77fe640 1 --2- 172.21.15.7:0/533049616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333cfd320 0x55c333d09530 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc005540 tx=0x7ff1dc009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29fcec90102abffe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:41.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.294+0000 7ff1c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:44:41.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.298+0000 7ff1c77fe640 1 -- 172.21.15.7:0/533049616 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc023840 con 0x55c333cfd320 2024-09-19T08:44:41.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.298+0000 7ff1c77fe640 1 -- 172.21.15.7:0/533049616 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7ff1dc0239e0 con 0x55c333cfd320 2024-09-19T08:44:41.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.298+0000 7ff1f075a740 1 -- 172.21.15.7:0/533049616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1dc004c80 con 0x55c333cfd320 2024-09-19T08:44:41.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.298+0000 7ff1c77fe640 1 -- 172.21.15.7:0/533049616 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff1dc023be0 con 0x55c333cfd320 2024-09-19T08:44:41.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.298+0000 7ff1f075a740 10 client.15270 fetch_fsmap learned FSMap version 25 2024-09-19T08:44:41.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.298+0000 7ff1f075a740 1 -- 172.21.15.7:0/533049616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c333d1a8d0 con 0x55c333cfd320 2024-09-19T08:44:41.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.298+0000 7ff1c77fe640 1 -- 172.21.15.7:0/533049616 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1dc004c80 con 0x55c333cfd320 2024-09-19T08:44:41.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.298+0000 7ff1c77fe640 1 -- 172.21.15.7:0/533049616 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff1dc02ec60 con 0x55c333cfd320 2024-09-19T08:44:41.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.298+0000 7ff1f075a740 10 client.15270 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:44:41.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.298+0000 7ff1f075a740 10 client.15270 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:44:41.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.298+0000 7ff1f075a740 20 client.15270 populate_metadata read hostname 'smithi007' 2024-09-19T08:44:41.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.298+0000 7ff1f075a740 1 --2- 172.21.15.7:0/533049616 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c333d1bd90 0x55c333d1e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.298+0000 7ff1f075a740 4 client.15270 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:44:41.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.298+0000 7ff1f075a740 1 -- 172.21.15.7:0/533049616 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c333c6f7f0 con 0x55c333d1bd90 2024-09-19T08:44:41.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.299+0000 7ff1e7fff640 1 --2- 172.21.15.7:0/533049616 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c333d1bd90 0x55c333d1e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.299+0000 7ff1c77fe640 10 client.15270 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:44:41.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.299+0000 7ff1e7fff640 1 --2- 172.21.15.7:0/533049616 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c333d1bd90 0x55c333d1e180 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55a50a0c35daab90 server_cookie=2150b7836f3dba56 in_seq=0 out_seq=0 2024-09-19T08:44:41.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.300+0000 7ff1c77fe640 1 -- 172.21.15.7:0/533049616 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c333c6f7f0 con 0x55c333d1bd90 2024-09-19T08:44:41.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.300+0000 7ff1c77fe640 10 client.15270 handle_command_reply: tid=0 2024-09-19T08:44:41.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.300+0000 7ff1f075a740 1 client.15270 shutdown 2024-09-19T08:44:41.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.300+0000 7ff1f075a740 1 -- 172.21.15.7:0/533049616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333cfd320 msgr2=0x55c333d09530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.300+0000 7ff1f075a740 1 --2- 172.21.15.7:0/533049616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333cfd320 0x55c333d09530 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc005540 tx=0x7ff1dc009f10 comp rx=0 tx=0).stop 2024-09-19T08:44:41.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.300+0000 7ff1f075a740 1 -- 172.21.15.7:0/533049616 shutdown_connections 2024-09-19T08:44:41.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.300+0000 7ff1f075a740 1 --2- 172.21.15.7:0/533049616 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c333d1bd90 0x55c333d1e180 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.300+0000 7ff1f075a740 1 --2- 172.21.15.7:0/533049616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c333d0c150 0x55c333d09a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.300+0000 7ff1f075a740 1 --2- 172.21.15.7:0/533049616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333cfd320 0x55c333d09530 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.300+0000 7ff1f075a740 1 --2- 172.21.15.7:0/533049616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfca00 0x55c333d08ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.300+0000 7ff1c77fe640 0 client.15270 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:44:41.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.300+0000 7ff1f075a740 1 -- 172.21.15.7:0/533049616 >> 172.21.15.7:0/533049616 conn(0x55c333cf90f0 msgr2=0x55c333cf8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:41.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.300+0000 7ff1f075a740 1 -- 172.21.15.7:0/533049616 shutdown_connections 2024-09-19T08:44:41.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.300+0000 7ff1f075a740 1 -- 172.21.15.7:0/533049616 wait complete. 2024-09-19T08:44:41.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.300+0000 7ff1f075a740 20 client.15270 trim_cache size 0 max 16384 2024-09-19T08:44:41.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.318+0000 7ff1f075a740 1 Processor -- start 2024-09-19T08:44:41.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.318+0000 7ff1f075a740 1 -- start start 2024-09-19T08:44:41.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.318+0000 7ff1f075a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfca00 0x55c333d23980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.319+0000 7ff1f075a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c333cfd320 0x55c333d23ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.319+0000 7ff1f075a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333d0c150 0x55c333cf7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.319+0000 7ff1f075a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e81adfb0 con 0x55c333d0c150 2024-09-19T08:44:41.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.319+0000 7ff1f075a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e81ab880 con 0x55c333cfca00 2024-09-19T08:44:41.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.319+0000 7ff1f075a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e81a96d0 con 0x55c333cfd320 2024-09-19T08:44:41.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.319+0000 7ff1ec91e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333d0c150 0x55c333cf7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.319+0000 7ff1ec91e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333d0c150 0x55c333cf7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53446/0 (socket says 172.21.15.7:53446) 2024-09-19T08:44:41.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.319+0000 7ff1ec91e640 1 -- 172.21.15.7:0/2813175254 learned_addr learned my addr 172.21.15.7:0/2813175254 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:41.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.319+0000 7ff1e77fe640 1 --2- 172.21.15.7:0/2813175254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c333cfd320 0x55c333d23ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.319+0000 7ff1e7fff640 1 --2- 172.21.15.7:0/2813175254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfca00 0x55c333d23980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.319+0000 7ff1ec91e640 1 -- 172.21.15.7:0/2813175254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c333cfd320 msgr2=0x55c333d23ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:41.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.319+0000 7ff1ec91e640 1 --2- 172.21.15.7:0/2813175254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c333cfd320 0x55c333d23ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.319+0000 7ff1ec91e640 1 -- 172.21.15.7:0/2813175254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfca00 msgr2=0x55c333d23980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:41.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.319+0000 7ff1ec91e640 1 --2- 172.21.15.7:0/2813175254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfca00 0x55c333d23980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.319+0000 7ff1ec91e640 1 -- 172.21.15.7:0/2813175254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c333d07580 con 0x55c333d0c150 2024-09-19T08:44:41.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.319+0000 7ff1e7fff640 1 --2- 172.21.15.7:0/2813175254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfca00 0x55c333d23980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:41.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.319+0000 7ff1ec91e640 1 --2- 172.21.15.7:0/2813175254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333d0c150 0x55c333cf7a50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0035000 tx=0x7ff1e0005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966e88bd8beee520 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:41.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.320+0000 7ff1cdffb640 1 -- 172.21.15.7:0/2813175254 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0034040 con 0x55c333d0c150 2024-09-19T08:44:41.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.320+0000 7ff1cdffb640 1 -- 172.21.15.7:0/2813175254 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1e002fbf0 con 0x55c333d0c150 2024-09-19T08:44:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.320+0000 7ff1cdffb640 1 -- 172.21.15.7:0/2813175254 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0004440 con 0x55c333d0c150 2024-09-19T08:44:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.320+0000 7ff1f075a740 1 -- 172.21.15.7:0/2813175254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333d0c150 msgr2=0x55c333cf7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.320+0000 7ff1f075a740 1 --2- 172.21.15.7:0/2813175254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333d0c150 0x55c333cf7a50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0035000 tx=0x7ff1e0005c50 comp rx=0 tx=0).stop 2024-09-19T08:44:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.320+0000 7ff1f075a740 1 -- 172.21.15.7:0/2813175254 shutdown_connections 2024-09-19T08:44:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.320+0000 7ff1f075a740 1 --2- 172.21.15.7:0/2813175254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333d0c150 0x55c333cf7a50 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.320+0000 7ff1f075a740 1 --2- 172.21.15.7:0/2813175254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c333cfd320 0x55c333d23ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.320+0000 7ff1f075a740 1 --2- 172.21.15.7:0/2813175254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfca00 0x55c333d23980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.320+0000 7ff1f075a740 1 -- 172.21.15.7:0/2813175254 >> 172.21.15.7:0/2813175254 conn(0x55c333cf90f0 msgr2=0x55c333d08120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.320+0000 7ff1f075a740 1 -- 172.21.15.7:0/2813175254 shutdown_connections 2024-09-19T08:44:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.320+0000 7ff1f075a740 1 -- 172.21.15.7:0/2813175254 wait complete. 2024-09-19T08:44:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.321+0000 7ff1f075a740 1 -- start start 2024-09-19T08:44:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.321+0000 7ff1f075a740 1 Processor -- start 2024-09-19T08:44:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.321+0000 7ff1f075a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333cfca00 0x55c333d0fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.321+0000 7ff1f075a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfd320 0x55c333d103e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.321+0000 7ff1f075a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c333d0c150 0x55c333d10920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.321+0000 7ff1f075a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e81a9d40 con 0x55c333cfca00 2024-09-19T08:44:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.321+0000 7ff1f075a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e81ab1b0 con 0x55c333cfd320 2024-09-19T08:44:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.321+0000 7ff1f075a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e81aa410 con 0x55c333d0c150 2024-09-19T08:44:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.322+0000 7ff1f075a740 10 client.0 _ll_register_callbacks cb 0x7ff1dc009af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:44:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.322+0000 7ff1e7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333cfca00 0x55c333d0fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.322+0000 7ff1e7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333cfca00 0x55c333d0fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53462/0 (socket says 172.21.15.7:53462) 2024-09-19T08:44:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.322+0000 7ff1e7fff640 1 -- 172.21.15.7:0/4033201699 learned_addr learned my addr 172.21.15.7:0/4033201699 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.322+0000 7ff1ec91e640 1 --2- 172.21.15.7:0/4033201699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c333d0c150 0x55c333d10920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.322+0000 7ff1e77fe640 1 --2- 172.21.15.7:0/4033201699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfd320 0x55c333d103e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.322+0000 7ff1e7fff640 1 -- 172.21.15.7:0/4033201699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c333d0c150 msgr2=0x55c333d10920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.322+0000 7ff1e7fff640 1 --2- 172.21.15.7:0/4033201699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c333d0c150 0x55c333d10920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.322+0000 7ff1e7fff640 1 -- 172.21.15.7:0/4033201699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfd320 msgr2=0x55c333d103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.322+0000 7ff1e7fff640 1 --2- 172.21.15.7:0/4033201699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfd320 0x55c333d103e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.322+0000 7ff1e7fff640 1 -- 172.21.15.7:0/4033201699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c333d85950 con 0x55c333cfca00 2024-09-19T08:44:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.322+0000 7ff1e77fe640 1 --2- 172.21.15.7:0/4033201699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfd320 0x55c333d103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.322+0000 7ff1e7fff640 1 --2- 172.21.15.7:0/4033201699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333cfca00 0x55c333d0fea0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff1d809c040 tx=0x7ff1d80bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d897e49fd5e964e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.322+0000 7ff1c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:44:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.322+0000 7ff1c77fe640 1 -- 172.21.15.7:0/4033201699 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d80b0060 con 0x55c333cfca00 2024-09-19T08:44:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.322+0000 7ff1c77fe640 1 -- 172.21.15.7:0/4033201699 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7ff1d80a0170 con 0x55c333cfca00 2024-09-19T08:44:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.322+0000 7ff1f075a740 1 -- 172.21.15.7:0/4033201699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c333c69d00 con 0x55c333cfca00 2024-09-19T08:44:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.323+0000 7ff1c77fe640 1 -- 172.21.15.7:0/4033201699 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff1d809a700 con 0x55c333cfca00 2024-09-19T08:44:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.323+0000 7ff1f075a740 10 client.15276 fetch_fsmap learned FSMap version 25 2024-09-19T08:44:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.323+0000 7ff1f075a740 1 -- 172.21.15.7:0/4033201699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c333d86c70 con 0x55c333cfca00 2024-09-19T08:44:41.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.323+0000 7ff1c77fe640 1 -- 172.21.15.7:0/4033201699 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55c333c69d00 con 0x55c333cfca00 2024-09-19T08:44:41.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.323+0000 7ff1c77fe640 1 -- 172.21.15.7:0/4033201699 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff1d80bc0b0 con 0x55c333cfca00 2024-09-19T08:44:41.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.323+0000 7ff1f075a740 10 client.15276 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:44:41.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.323+0000 7ff1f075a740 10 client.15276 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:44:41.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.323+0000 7ff1f075a740 20 client.15276 populate_metadata read hostname 'smithi007' 2024-09-19T08:44:41.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.323+0000 7ff1f075a740 1 --2- 172.21.15.7:0/4033201699 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c333d87340 0x55c333d89780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.323+0000 7ff1f075a740 4 client.15276 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:44:41.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.323+0000 7ff1f075a740 1 -- 172.21.15.7:0/4033201699 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c333be6110 con 0x55c333d87340 2024-09-19T08:44:41.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.323+0000 7ff1e77fe640 1 --2- 172.21.15.7:0/4033201699 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c333d87340 0x55c333d89780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.324+0000 7ff1c77fe640 10 client.15276 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:44:41.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.324+0000 7ff1e77fe640 1 --2- 172.21.15.7:0/4033201699 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c333d87340 0x55c333d89780 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fa3dea6804df1bc server_cookie=414096e869e5a097 in_seq=0 out_seq=0 2024-09-19T08:44:41.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.325+0000 7ff1c77fe640 1 -- 172.21.15.7:0/4033201699 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c333be6110 con 0x55c333d87340 2024-09-19T08:44:41.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.325+0000 7ff1c77fe640 10 client.15276 handle_command_reply: tid=0 2024-09-19T08:44:41.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.325+0000 7ff1f075a740 1 client.15276 shutdown 2024-09-19T08:44:41.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.325+0000 7ff1f075a740 1 -- 172.21.15.7:0/4033201699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333cfca00 msgr2=0x55c333d0fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.325+0000 7ff1f075a740 1 --2- 172.21.15.7:0/4033201699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333cfca00 0x55c333d0fea0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff1d809c040 tx=0x7ff1d80bc040 comp rx=0 tx=0).stop 2024-09-19T08:44:41.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.325+0000 7ff1f075a740 1 -- 172.21.15.7:0/4033201699 shutdown_connections 2024-09-19T08:44:41.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.325+0000 7ff1f075a740 1 --2- 172.21.15.7:0/4033201699 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c333d87340 0x55c333d89780 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.325+0000 7ff1f075a740 1 --2- 172.21.15.7:0/4033201699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c333d0c150 0x55c333d10920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.325+0000 7ff1f075a740 1 --2- 172.21.15.7:0/4033201699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c333cfd320 0x55c333d103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.325+0000 7ff1f075a740 1 --2- 172.21.15.7:0/4033201699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c333cfca00 0x55c333d0fea0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.325+0000 7ff1f075a740 1 -- 172.21.15.7:0/4033201699 >> 172.21.15.7:0/4033201699 conn(0x55c333cf90f0 msgr2=0x55c333cf7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:41.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.325+0000 7ff1c77fe640 0 client.15276 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:44:41.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.325+0000 7ff1f075a740 1 -- 172.21.15.7:0/4033201699 shutdown_connections 2024-09-19T08:44:41.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.325+0000 7ff1f075a740 1 -- 172.21.15.7:0/4033201699 wait complete. 2024-09-19T08:44:41.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.326+0000 7ff1f075a740 20 client.15276 trim_cache size 0 max 16384 2024-09-19T08:44:41.330 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:44:41.330 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-19T08:44:41.330 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "fe5791be-1e10-45fb-9be5-3ef912c6b2e2", 2024-09-19T08:44:41.330 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-19T08:44:41.330 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:44:41.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.326+0000 7ff1ee381640 1 -- 172.21.15.7:0/4169867182 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff1d00a33e0 msgr2=0x7ff1d00a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.326+0000 7ff1ee381640 1 --2- 172.21.15.7:0/4169867182 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff1d00a33e0 0x7ff1d00a58a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0057c0 tx=0x7ff1dc009830 comp rx=0 tx=0).stop 2024-09-19T08:44:41.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.326+0000 7ff1ee381640 1 -- 172.21.15.7:0/4169867182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1e8100e20 msgr2=0x7ff1e8197380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.326+0000 7ff1ee381640 1 --2- 172.21.15.7:0/4169867182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1e8100e20 0x7ff1e8197380 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800e9f0 tx=0x7ff1d800eeb0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.326+0000 7ff1ee381640 1 -- 172.21.15.7:0/4169867182 shutdown_connections 2024-09-19T08:44:41.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.326+0000 7ff1ee381640 1 --2- 172.21.15.7:0/4169867182 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff1d00a33e0 0x7ff1d00a58a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.326+0000 7ff1ee381640 1 --2- 172.21.15.7:0/4169867182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1e8102ef0 0x7ff1e819bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.326+0000 7ff1ee381640 1 --2- 172.21.15.7:0/4169867182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1e8102570 0x7ff1e81978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.326+0000 7ff1ee381640 1 --2- 172.21.15.7:0/4169867182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1e8100e20 0x7ff1e8197380 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.326+0000 7ff1ee381640 1 -- 172.21.15.7:0/4169867182 >> 172.21.15.7:0/4169867182 conn(0x7ff1e80fc7d0 msgr2=0x7ff1e8106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.327+0000 7ff1ee381640 1 -- 172.21.15.7:0/4169867182 shutdown_connections 2024-09-19T08:44:41.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.327+0000 7ff1ee381640 1 -- 172.21.15.7:0/4169867182 wait complete. 2024-09-19T08:44:41.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.486+0000 7f14729f1640 1 -- 172.21.15.7:0/1838818734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f1458005580 con 0x7f146c101340 2024-09-19T08:44:41.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.490+0000 7f14697fa640 1 -- 172.21.15.7:0/1838818734 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v29)=0 v29) ==== 133+0+0 (secure 0 0 0) 0x7f14600a0650 con 0x7f146c101340 2024-09-19T08:44:41.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.492+0000 7f14729f1640 1 -- 172.21.15.7:0/1838818734 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f14540a3440 msgr2=0x7f14540a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.492+0000 7f14729f1640 1 --2- 172.21.15.7:0/1838818734 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f14540a3440 0x7f14540a5900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f145c00b3c0 tx=0x7f145c00d040 comp rx=0 tx=0).stop 2024-09-19T08:44:41.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.492+0000 7f14729f1640 1 -- 172.21.15.7:0/1838818734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f146c101340 msgr2=0x7f146c19ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.492+0000 7f14729f1640 1 --2- 172.21.15.7:0/1838818734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f146c101340 0x7f146c19ab90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f146000e9f0 tx=0x7f146000eeb0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.492+0000 7f14729f1640 1 -- 172.21.15.7:0/1838818734 shutdown_connections 2024-09-19T08:44:41.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.492+0000 7f14729f1640 1 --2- 172.21.15.7:0/1838818734 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f14540a3440 0x7f14540a5900 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.492+0000 7f14729f1640 1 --2- 172.21.15.7:0/1838818734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f146c1069b0 0x7f146c19ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.492+0000 7f14729f1640 1 --2- 172.21.15.7:0/1838818734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f146c101340 0x7f146c19ab90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.492+0000 7f14729f1640 1 --2- 172.21.15.7:0/1838818734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f146c1009a0 0x7f146c19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.492+0000 7f14729f1640 1 -- 172.21.15.7:0/1838818734 >> 172.21.15.7:0/1838818734 conn(0x7f146c0779a0 msgr2=0x7f146c103810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:41.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.492+0000 7f14729f1640 1 -- 172.21.15.7:0/1838818734 shutdown_connections 2024-09-19T08:44:41.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.492+0000 7f14729f1640 1 -- 172.21.15.7:0/1838818734 wait complete. 2024-09-19T08:44:41.504 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-19T08:44:41.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.621+0000 7f9d8e931640 1 -- 172.21.15.7:0/1092273896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d88103620 msgr2=0x7f9d8810bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.621+0000 7f9d8e931640 1 --2- 172.21.15.7:0/1092273896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d88103620 0x7f9d8810bb00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009900 tx=0x7f9d7c02a480 comp rx=0 tx=0).stop 2024-09-19T08:44:41.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.621+0000 7f9d8e931640 1 -- 172.21.15.7:0/1092273896 shutdown_connections 2024-09-19T08:44:41.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.621+0000 7f9d8e931640 1 --2- 172.21.15.7:0/1092273896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d8810c0d0 0x7f9d8810e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.621+0000 7f9d8e931640 1 --2- 172.21.15.7:0/1092273896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d88103620 0x7f9d8810bb00 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.621+0000 7f9d8e931640 1 --2- 172.21.15.7:0/1092273896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d88102d00 0x7f9d881030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.621+0000 7f9d8e931640 1 -- 172.21.15.7:0/1092273896 >> 172.21.15.7:0/1092273896 conn(0x7f9d880779a0 msgr2=0x7f9d880fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:41.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.621+0000 7f9d8e931640 1 -- 172.21.15.7:0/1092273896 shutdown_connections 2024-09-19T08:44:41.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.621+0000 7f9d8e931640 1 -- 172.21.15.7:0/1092273896 wait complete. 2024-09-19T08:44:41.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.622+0000 7f9d8e931640 1 Processor -- start 2024-09-19T08:44:41.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.622+0000 7f9d8e931640 1 -- start start 2024-09-19T08:44:41.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.622+0000 7f9d8e931640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d88102d00 0x7f9d881983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.622+0000 7f9d8e931640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d88103620 0x7f9d88198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.622+0000 7f9d8e931640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d8810c0d0 0x7f9d8819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.622+0000 7f9d8e931640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9d88111ea0 con 0x7f9d8810c0d0 2024-09-19T08:44:41.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.622+0000 7f9d8e931640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9d88111d20 con 0x7f9d88102d00 2024-09-19T08:44:41.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.622+0000 7f9d8e931640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9d88112020 con 0x7f9d88103620 2024-09-19T08:44:41.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.622+0000 7f9d8cece640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d8810c0d0 0x7f9d8819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.622+0000 7f9d8cece640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d8810c0d0 0x7f9d8819ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53480/0 (socket says 172.21.15.7:53480) 2024-09-19T08:44:41.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.622+0000 7f9d8cece640 1 -- 172.21.15.7:0/2769040639 learned_addr learned my addr 172.21.15.7:0/2769040639 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:41.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.622+0000 7f9d87fff640 1 --2- 172.21.15.7:0/2769040639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d88102d00 0x7f9d881983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.622+0000 7f9d877fe640 1 --2- 172.21.15.7:0/2769040639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d88103620 0x7f9d88198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.623+0000 7f9d8cece640 1 -- 172.21.15.7:0/2769040639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d88103620 msgr2=0x7f9d88198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.623+0000 7f9d8cece640 1 --2- 172.21.15.7:0/2769040639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d88103620 0x7f9d88198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.623+0000 7f9d8cece640 1 -- 172.21.15.7:0/2769040639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d88102d00 msgr2=0x7f9d881983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.623+0000 7f9d8cece640 1 --2- 172.21.15.7:0/2769040639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d88102d00 0x7f9d881983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.623+0000 7f9d8cece640 1 -- 172.21.15.7:0/2769040639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d8819d3e0 con 0x7f9d8810c0d0 2024-09-19T08:44:41.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.623+0000 7f9d8cece640 1 --2- 172.21.15.7:0/2769040639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d8810c0d0 0x7f9d8819ccb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000eb10 tx=0x7f9d8000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:41.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.623+0000 7f9d857fa640 1 -- 172.21.15.7:0/2769040639 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d80004b20 con 0x7f9d8810c0d0 2024-09-19T08:44:41.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.623+0000 7f9d857fa640 1 -- 172.21.15.7:0/2769040639 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d80004cc0 con 0x7f9d8810c0d0 2024-09-19T08:44:41.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.623+0000 7f9d8e931640 1 -- 172.21.15.7:0/2769040639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d8819d6d0 con 0x7f9d8810c0d0 2024-09-19T08:44:41.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.623+0000 7f9d857fa640 1 -- 172.21.15.7:0/2769040639 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d80010760 con 0x7f9d8810c0d0 2024-09-19T08:44:41.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.623+0000 7f9d8e931640 1 -- 172.21.15.7:0/2769040639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d881a4f60 con 0x7f9d8810c0d0 2024-09-19T08:44:41.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.624+0000 7f9d8e931640 1 -- 172.21.15.7:0/2769040639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d881030e0 con 0x7f9d8810c0d0 2024-09-19T08:44:41.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.625+0000 7f9d857fa640 1 -- 172.21.15.7:0/2769040639 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f9d80005020 con 0x7f9d8810c0d0 2024-09-19T08:44:41.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.626+0000 7f9d857fa640 1 --2- 172.21.15.7:0/2769040639 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9d700a34c0 0x7f9d700a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:41.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.626+0000 7f9d87fff640 1 --2- 172.21.15.7:0/2769040639 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9d700a34c0 0x7f9d700a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:41.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.626+0000 7f9d857fa640 1 -- 172.21.15.7:0/2769040639 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f9d800d05b0 con 0x7f9d8810c0d0 2024-09-19T08:44:41.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.627+0000 7f9d87fff640 1 --2- 172.21.15.7:0/2769040639 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9d700a34c0 0x7f9d700a5980 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009bd0 tx=0x7f9d78005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:41.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.631+0000 7f9d857fa640 1 -- 172.21.15.7:0/2769040639 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9d8009cdb0 con 0x7f9d8810c0d0 2024-09-19T08:44:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.827+0000 7f9d8e931640 1 -- 172.21.15.7:0/2769040639 --> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f9d88062630 con 0x7f9d700a34c0 2024-09-19T08:44:41.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.890+0000 7f9d857fa640 1 -- 172.21.15.7:0/2769040639 <== mgr.15132 v2:172.21.15.7:6800/3061932294 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f9d88062630 con 0x7f9d700a34c0 2024-09-19T08:44:41.890 INFO:teuthology.orchestra.run.smithi007.stdout:Schedule set for path / 2024-09-19T08:44:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.892+0000 7f9d8e931640 1 -- 172.21.15.7:0/2769040639 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9d700a34c0 msgr2=0x7f9d700a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.892+0000 7f9d8e931640 1 --2- 172.21.15.7:0/2769040639 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9d700a34c0 0x7f9d700a5980 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009bd0 tx=0x7f9d78005f90 comp rx=0 tx=0).stop 2024-09-19T08:44:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.892+0000 7f9d8e931640 1 -- 172.21.15.7:0/2769040639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d8810c0d0 msgr2=0x7f9d8819ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.892+0000 7f9d8e931640 1 --2- 172.21.15.7:0/2769040639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d8810c0d0 0x7f9d8819ccb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000eb10 tx=0x7f9d8000c2d0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.893+0000 7f9d8e931640 1 -- 172.21.15.7:0/2769040639 shutdown_connections 2024-09-19T08:44:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.893+0000 7f9d8e931640 1 --2- 172.21.15.7:0/2769040639 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9d700a34c0 0x7f9d700a5980 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.893+0000 7f9d8e931640 1 --2- 172.21.15.7:0/2769040639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d8810c0d0 0x7f9d8819ccb0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.893+0000 7f9d8e931640 1 --2- 172.21.15.7:0/2769040639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d88103620 0x7f9d88198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.893+0000 7f9d8e931640 1 --2- 172.21.15.7:0/2769040639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d88102d00 0x7f9d881983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.893+0000 7f9d8e931640 1 -- 172.21.15.7:0/2769040639 >> 172.21.15.7:0/2769040639 conn(0x7f9d880779a0 msgr2=0x7f9d880fd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.893+0000 7f9d8e931640 1 -- 172.21.15.7:0/2769040639 shutdown_connections 2024-09-19T08:44:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:41.893+0000 7f9d8e931640 1 -- 172.21.15.7:0/2769040639 wait complete. 2024-09-19T08:44:41.903 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-19T08:44:42.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.010+0000 7f062d959640 1 -- 172.21.15.7:0/338745639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06281009d0 msgr2=0x7f0628100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.010+0000 7f062d959640 1 --2- 172.21.15.7:0/338745639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06281009d0 0x7f0628100e30 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f061c009930 tx=0x7f061c02a420 comp rx=0 tx=0).stop 2024-09-19T08:44:42.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.010+0000 7f062d959640 1 -- 172.21.15.7:0/338745639 shutdown_connections 2024-09-19T08:44:42.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.010+0000 7f062d959640 1 --2- 172.21.15.7:0/338745639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0628101370 0x7f062810d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.010+0000 7f062d959640 1 --2- 172.21.15.7:0/338745639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06281009d0 0x7f0628100e30 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.010+0000 7f062d959640 1 --2- 172.21.15.7:0/338745639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06281069e0 0x7f0628106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.010+0000 7f062d959640 1 -- 172.21.15.7:0/338745639 >> 172.21.15.7:0/338745639 conn(0x7f06280fc6b0 msgr2=0x7f06280fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:42.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.010+0000 7f062d959640 1 -- 172.21.15.7:0/338745639 shutdown_connections 2024-09-19T08:44:42.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.010+0000 7f062d959640 1 -- 172.21.15.7:0/338745639 wait complete. 2024-09-19T08:44:42.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.010+0000 7f062d959640 1 Processor -- start 2024-09-19T08:44:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.011+0000 7f062d959640 1 -- start start 2024-09-19T08:44:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.011+0000 7f062d959640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06281009d0 0x7f0628199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.011+0000 7f062d959640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0628101370 0x7f0628199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.011+0000 7f062d959640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06281069e0 0x7f06281a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.011+0000 7f062d959640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0628110e20 con 0x7f0628101370 2024-09-19T08:44:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.011+0000 7f062d959640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0628110ca0 con 0x7f06281009d0 2024-09-19T08:44:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.011+0000 7f062d959640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0628110fa0 con 0x7f06281069e0 2024-09-19T08:44:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.011+0000 7f06267fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0628101370 0x7f0628199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.011+0000 7f06267fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0628101370 0x7f0628199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53506/0 (socket says 172.21.15.7:53506) 2024-09-19T08:44:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.011+0000 7f06267fc640 1 -- 172.21.15.7:0/4076588644 learned_addr learned my addr 172.21.15.7:0/4076588644 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:42.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.011+0000 7f06277fe640 1 --2- 172.21.15.7:0/4076588644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06281069e0 0x7f06281a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.011+0000 7f0626ffd640 1 --2- 172.21.15.7:0/4076588644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06281009d0 0x7f0628199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.011+0000 7f06267fc640 1 -- 172.21.15.7:0/4076588644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06281069e0 msgr2=0x7f06281a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.011+0000 7f06267fc640 1 --2- 172.21.15.7:0/4076588644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06281069e0 0x7f06281a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.011+0000 7f06267fc640 1 -- 172.21.15.7:0/4076588644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06281009d0 msgr2=0x7f0628199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.011+0000 7f06267fc640 1 --2- 172.21.15.7:0/4076588644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06281009d0 0x7f0628199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.011+0000 7f06267fc640 1 -- 172.21.15.7:0/4076588644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06281a48d0 con 0x7f0628101370 2024-09-19T08:44:42.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.012+0000 7f06267fc640 1 --2- 172.21.15.7:0/4076588644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0628101370 0x7f0628199850 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f061c009230 tx=0x7f061c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:42.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.012+0000 7f062c957640 1 -- 172.21.15.7:0/4076588644 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061c03f030 con 0x7f0628101370 2024-09-19T08:44:42.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.012+0000 7f062d959640 1 -- 172.21.15.7:0/4076588644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06281a4aa0 con 0x7f0628101370 2024-09-19T08:44:42.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.012+0000 7f062c957640 1 -- 172.21.15.7:0/4076588644 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f061c003ad0 con 0x7f0628101370 2024-09-19T08:44:42.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.012+0000 7f062c957640 1 -- 172.21.15.7:0/4076588644 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061c035070 con 0x7f0628101370 2024-09-19T08:44:42.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.012+0000 7f062d959640 1 -- 172.21.15.7:0/4076588644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06281a4f60 con 0x7f0628101370 2024-09-19T08:44:42.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.013+0000 7f062d959640 1 -- 172.21.15.7:0/4076588644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0628100e30 con 0x7f0628101370 2024-09-19T08:44:42.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.014+0000 7f062c957640 1 -- 172.21.15.7:0/4076588644 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f061c042030 con 0x7f0628101370 2024-09-19T08:44:42.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.014+0000 7f062c957640 1 --2- 172.21.15.7:0/4076588644 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f06100a3440 0x7f06100a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.015+0000 7f0626ffd640 1 --2- 172.21.15.7:0/4076588644 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f06100a3440 0x7f06100a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.015+0000 7f062c957640 1 -- 172.21.15.7:0/4076588644 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f061c0f03a0 con 0x7f0628101370 2024-09-19T08:44:42.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.015+0000 7f0626ffd640 1 --2- 172.21.15.7:0/4076588644 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f06100a3440 0x7f06100a5900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0618005fd0 tx=0x7f0618005850 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:42.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.019+0000 7f062c957640 1 -- 172.21.15.7:0/4076588644 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f061c0bcc00 con 0x7f0628101370 2024-09-19T08:44:42.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:42 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1957621456' entity='client.admin' 2024-09-19T08:44:42.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:42 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:42.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:42 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:42.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:42 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:42.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:42 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:42.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:42 smithi007 ceph-mon[31221]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-19T08:44:42.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:42 smithi007 ceph-mon[31221]: scrub queued for path: / 2024-09-19T08:44:42.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:42 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:44:42.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:42 smithi007 ceph-mon[31221]: scrub summary: active paths [/] 2024-09-19T08:44:42.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:42 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:44:42.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:42 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1838818734' entity='client.admin' 2024-09-19T08:44:42.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:42 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:42.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:42 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:42.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:42 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:42.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:42 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:42.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:42 smithi007 ceph-mon[31221]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:42.170 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:44:42.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.227+0000 7f062d959640 1 -- 172.21.15.7:0/4076588644 --> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f0628062630 con 0x7f06100a3440 2024-09-19T08:44:42.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.285+0000 7f062c957640 1 -- 172.21.15.7:0/4076588644 <== mgr.15132 v2:172.21.15.7:6800/3061932294 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f0628062630 con 0x7f06100a3440 2024-09-19T08:44:42.286 INFO:teuthology.orchestra.run.smithi007.stdout:Retention added to path / 2024-09-19T08:44:42.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.287+0000 7f062d959640 1 -- 172.21.15.7:0/4076588644 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f06100a3440 msgr2=0x7f06100a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.288+0000 7f062d959640 1 --2- 172.21.15.7:0/4076588644 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f06100a3440 0x7f06100a5900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0618005fd0 tx=0x7f0618005850 comp rx=0 tx=0).stop 2024-09-19T08:44:42.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.288+0000 7f062d959640 1 -- 172.21.15.7:0/4076588644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0628101370 msgr2=0x7f0628199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.288+0000 7f062d959640 1 --2- 172.21.15.7:0/4076588644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0628101370 0x7f0628199850 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f061c009230 tx=0x7f061c004270 comp rx=0 tx=0).stop 2024-09-19T08:44:42.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.288+0000 7f062d959640 1 -- 172.21.15.7:0/4076588644 shutdown_connections 2024-09-19T08:44:42.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.288+0000 7f062d959640 1 --2- 172.21.15.7:0/4076588644 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f06100a3440 0x7f06100a5900 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.288+0000 7f062d959640 1 --2- 172.21.15.7:0/4076588644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06281069e0 0x7f06281a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.288+0000 7f062d959640 1 --2- 172.21.15.7:0/4076588644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0628101370 0x7f0628199850 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.288+0000 7f062d959640 1 --2- 172.21.15.7:0/4076588644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06281009d0 0x7f0628199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.288+0000 7f062d959640 1 -- 172.21.15.7:0/4076588644 >> 172.21.15.7:0/4076588644 conn(0x7f06280fc6b0 msgr2=0x7f06280fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:42.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.288+0000 7f062d959640 1 -- 172.21.15.7:0/4076588644 shutdown_connections 2024-09-19T08:44:42.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.288+0000 7f062d959640 1 -- 172.21.15.7:0/4076588644 wait complete. 2024-09-19T08:44:42.299 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T08:44:42.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.408+0000 7f484a7fd640 1 -- 172.21.15.7:0/2872496736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4844107b80 msgr2=0x7f4844107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.408+0000 7f484a7fd640 1 --2- 172.21.15.7:0/2872496736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4844107b80 0x7f4844107f60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4834009890 tx=0x7f483402a380 comp rx=0 tx=0).stop 2024-09-19T08:44:42.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.408+0000 7f484a7fd640 1 -- 172.21.15.7:0/2872496736 shutdown_connections 2024-09-19T08:44:42.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.408+0000 7f484a7fd640 1 --2- 172.21.15.7:0/2872496736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4844102480 0x7f484410e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.408+0000 7f484a7fd640 1 --2- 172.21.15.7:0/2872496736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4844101ae0 0x7f4844101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.408+0000 7f484a7fd640 1 --2- 172.21.15.7:0/2872496736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4844107b80 0x7f4844107f60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.408+0000 7f484a7fd640 1 -- 172.21.15.7:0/2872496736 >> 172.21.15.7:0/2872496736 conn(0x7f48440fd7e0 msgr2=0x7f48440ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:42.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.408+0000 7f484a7fd640 1 -- 172.21.15.7:0/2872496736 shutdown_connections 2024-09-19T08:44:42.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.408+0000 7f484a7fd640 1 -- 172.21.15.7:0/2872496736 wait complete. 2024-09-19T08:44:42.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.409+0000 7f484a7fd640 1 Processor -- start 2024-09-19T08:44:42.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.409+0000 7f484a7fd640 1 -- start start 2024-09-19T08:44:42.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.409+0000 7f484a7fd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4844101ae0 0x7f484419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.409+0000 7f484a7fd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4844102480 0x7f484419ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.409+0000 7f484a7fd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4844107b80 0x7f484419efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.409+0000 7f484a7fd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4844111f30 con 0x7f4844107b80 2024-09-19T08:44:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.409+0000 7f484a7fd640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4844111db0 con 0x7f4844102480 2024-09-19T08:44:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.409+0000 7f484a7fd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f48441120b0 con 0x7f4844101ae0 2024-09-19T08:44:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.409+0000 7f4848d9a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4844107b80 0x7f484419efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.409+0000 7f4843fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4844101ae0 0x7f484419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.409+0000 7f4848d9a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4844107b80 0x7f484419efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53534/0 (socket says 172.21.15.7:53534) 2024-09-19T08:44:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.409+0000 7f4843fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4844101ae0 0x7f484419a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.7:60732/0 (socket says 172.21.15.7:60732) 2024-09-19T08:44:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.409+0000 7f4848d9a640 1 -- 172.21.15.7:0/1379108494 learned_addr learned my addr 172.21.15.7:0/1379108494 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.409+0000 7f483bfff640 1 --2- 172.21.15.7:0/1379108494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4844102480 0x7f484419ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.409+0000 7f4848d9a640 1 -- 172.21.15.7:0/1379108494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4844101ae0 msgr2=0x7f484419a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.409+0000 7f4848d9a640 1 --2- 172.21.15.7:0/1379108494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4844101ae0 0x7f484419a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.409+0000 7f4848d9a640 1 -- 172.21.15.7:0/1379108494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4844102480 msgr2=0x7f484419ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.409+0000 7f4848d9a640 1 --2- 172.21.15.7:0/1379108494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4844102480 0x7f484419ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.409+0000 7f4848d9a640 1 -- 172.21.15.7:0/1379108494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f484419f6d0 con 0x7f4844107b80 2024-09-19T08:44:42.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.409+0000 7f4843fff640 1 --2- 172.21.15.7:0/1379108494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4844101ae0 0x7f484419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:44:42.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.410+0000 7f4848d9a640 1 --2- 172.21.15.7:0/1379108494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4844107b80 0x7f484419efa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f483c00efc0 tx=0x7f483c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:42.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.410+0000 7f4841ffb640 1 -- 172.21.15.7:0/1379108494 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483c003970 con 0x7f4844107b80 2024-09-19T08:44:42.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.410+0000 7f484a7fd640 1 -- 172.21.15.7:0/1379108494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f484419f9c0 con 0x7f4844107b80 2024-09-19T08:44:42.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.410+0000 7f4841ffb640 1 -- 172.21.15.7:0/1379108494 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f483c004020 con 0x7f4844107b80 2024-09-19T08:44:42.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.410+0000 7f4841ffb640 1 -- 172.21.15.7:0/1379108494 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483c00b9f0 con 0x7f4844107b80 2024-09-19T08:44:42.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.410+0000 7f484a7fd640 1 -- 172.21.15.7:0/1379108494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48441a7250 con 0x7f4844107b80 2024-09-19T08:44:42.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.411+0000 7f484a7fd640 1 -- 172.21.15.7:0/1379108494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4844101f40 con 0x7f4844107b80 2024-09-19T08:44:42.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.413+0000 7f4841ffb640 1 -- 172.21.15.7:0/1379108494 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f483c01d020 con 0x7f4844107b80 2024-09-19T08:44:42.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.413+0000 7f4841ffb640 1 --2- 172.21.15.7:0/1379108494 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f48300a3440 0x7f48300a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.414+0000 7f4843fff640 1 --2- 172.21.15.7:0/1379108494 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f48300a3440 0x7f48300a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.414+0000 7f4841ffb640 1 -- 172.21.15.7:0/1379108494 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f483c0cfce0 con 0x7f4844107b80 2024-09-19T08:44:42.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.414+0000 7f4843fff640 1 --2- 172.21.15.7:0/1379108494 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f48300a3440 0x7f48300a5900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f48340097b0 tx=0x7f48340058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:42.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.418+0000 7f4841ffb640 1 -- 172.21.15.7:0/1379108494 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f483c09c540 con 0x7f4844107b80 2024-09-19T08:44:42.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:42 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1957621456' entity='client.admin' 2024-09-19T08:44:42.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:42 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:42.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:42 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:42.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:42 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:42.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:42 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:42.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:42 smithi175 ceph-mon[35688]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-19T08:44:42.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:42 smithi175 ceph-mon[35688]: scrub queued for path: / 2024-09-19T08:44:42.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:42 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:44:42.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:42 smithi175 ceph-mon[35688]: scrub summary: active paths [/] 2024-09-19T08:44:42.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:42 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:44:42.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:42 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1838818734' entity='client.admin' 2024-09-19T08:44:42.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:42 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:42.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:42 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:42.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:42 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:42.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:42 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:42.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:42 smithi175 ceph-mon[35688]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:42.444 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:42.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:42 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1957621456' entity='client.admin' 2024-09-19T08:44:42.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:42 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:42.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:42 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:42.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:42 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:42.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:42 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:42.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:42 smithi044 ceph-mon[35072]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-19T08:44:42.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:42 smithi044 ceph-mon[35072]: scrub queued for path: / 2024-09-19T08:44:42.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:42 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:44:42.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:42 smithi044 ceph-mon[35072]: scrub summary: active paths [/] 2024-09-19T08:44:42.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:42 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:44:42.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:42 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1838818734' entity='client.admin' 2024-09-19T08:44:42.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:42 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:42.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:42 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:42.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:42 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:42.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:42 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:44:42.552 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:42 smithi044 ceph-mon[35072]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:42.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.619+0000 7f484a7fd640 1 -- 172.21.15.7:0/1379108494 --> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f48440fee10 con 0x7f48300a3440 2024-09-19T08:44:42.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.626+0000 7f4841ffb640 1 -- 172.21.15.7:0/1379108494 <== mgr.15132 v2:172.21.15.7:6800/3061932294 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f48440fee10 con 0x7f48300a3440 2024-09-19T08:44:42.625 INFO:teuthology.orchestra.run.smithi007.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T08:44:41", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-19T08:44:42.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.628+0000 7f484a7fd640 1 -- 172.21.15.7:0/1379108494 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f48300a3440 msgr2=0x7f48300a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.628+0000 7f484a7fd640 1 --2- 172.21.15.7:0/1379108494 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f48300a3440 0x7f48300a5900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f48340097b0 tx=0x7f48340058d0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.628+0000 7f484a7fd640 1 -- 172.21.15.7:0/1379108494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4844107b80 msgr2=0x7f484419efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.628+0000 7f484a7fd640 1 --2- 172.21.15.7:0/1379108494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4844107b80 0x7f484419efa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f483c00efc0 tx=0x7f483c00c800 comp rx=0 tx=0).stop 2024-09-19T08:44:42.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.628+0000 7f484a7fd640 1 -- 172.21.15.7:0/1379108494 shutdown_connections 2024-09-19T08:44:42.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.628+0000 7f484a7fd640 1 --2- 172.21.15.7:0/1379108494 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f48300a3440 0x7f48300a5900 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.628+0000 7f484a7fd640 1 --2- 172.21.15.7:0/1379108494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4844107b80 0x7f484419efa0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.628+0000 7f484a7fd640 1 --2- 172.21.15.7:0/1379108494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4844102480 0x7f484419ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.628+0000 7f484a7fd640 1 --2- 172.21.15.7:0/1379108494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4844101ae0 0x7f484419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.628+0000 7f484a7fd640 1 -- 172.21.15.7:0/1379108494 >> 172.21.15.7:0/1379108494 conn(0x7f48440fd7e0 msgr2=0x7f484410d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:42.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.628+0000 7f484a7fd640 1 -- 172.21.15.7:0/1379108494 shutdown_connections 2024-09-19T08:44:42.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.628+0000 7f484a7fd640 1 -- 172.21.15.7:0/1379108494 wait complete. 2024-09-19T08:44:42.640 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T08:44:42.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.748+0000 7fd6bd28d640 1 -- 172.21.15.7:0/3273736737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6b8103660 msgr2=0x7fd6b810bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.748+0000 7fd6bd28d640 1 --2- 172.21.15.7:0/3273736737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6b8103660 0x7fd6b810bb40 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009900 tx=0x7fd6a002a480 comp rx=0 tx=0).stop 2024-09-19T08:44:42.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.748+0000 7fd6bd28d640 1 -- 172.21.15.7:0/3273736737 shutdown_connections 2024-09-19T08:44:42.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.748+0000 7fd6bd28d640 1 --2- 172.21.15.7:0/3273736737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6b810c110 0x7fd6b810e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.748+0000 7fd6bd28d640 1 --2- 172.21.15.7:0/3273736737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6b8103660 0x7fd6b810bb40 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.748+0000 7fd6bd28d640 1 --2- 172.21.15.7:0/3273736737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b8102d40 0x7fd6b8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.748+0000 7fd6bd28d640 1 -- 172.21.15.7:0/3273736737 >> 172.21.15.7:0/3273736737 conn(0x7fd6b80fc6b0 msgr2=0x7fd6b80fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:42.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.748+0000 7fd6bd28d640 1 -- 172.21.15.7:0/3273736737 shutdown_connections 2024-09-19T08:44:42.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.748+0000 7fd6bd28d640 1 -- 172.21.15.7:0/3273736737 wait complete. 2024-09-19T08:44:42.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.748+0000 7fd6bd28d640 1 Processor -- start 2024-09-19T08:44:42.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.748+0000 7fd6bd28d640 1 -- start start 2024-09-19T08:44:42.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.749+0000 7fd6bd28d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6b8102d40 0x7fd6b8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.749+0000 7fd6bd28d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b8103660 0x7fd6b8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.749+0000 7fd6bd28d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6b810c110 0x7fd6b819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.749+0000 7fd6bd28d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b8111ee0 con 0x7fd6b8102d40 2024-09-19T08:44:42.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.749+0000 7fd6bd28d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b8111d60 con 0x7fd6b8103660 2024-09-19T08:44:42.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.749+0000 7fd6bd28d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b8112060 con 0x7fd6b810c110 2024-09-19T08:44:42.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.749+0000 7fd6b6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6b8102d40 0x7fd6b8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.749+0000 7fd6b6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6b8102d40 0x7fd6b8198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53552/0 (socket says 172.21.15.7:53552) 2024-09-19T08:44:42.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.749+0000 7fd6b6ffd640 1 -- 172.21.15.7:0/4123556165 learned_addr learned my addr 172.21.15.7:0/4123556165 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:42.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.749+0000 7fd6b77fe640 1 --2- 172.21.15.7:0/4123556165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6b810c110 0x7fd6b819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.749+0000 7fd6affff640 1 --2- 172.21.15.7:0/4123556165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b8103660 0x7fd6b8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.749+0000 7fd6b6ffd640 1 -- 172.21.15.7:0/4123556165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6b810c110 msgr2=0x7fd6b819cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.749+0000 7fd6b6ffd640 1 --2- 172.21.15.7:0/4123556165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6b810c110 0x7fd6b819cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.749+0000 7fd6b6ffd640 1 -- 172.21.15.7:0/4123556165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b8103660 msgr2=0x7fd6b8198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.749+0000 7fd6b6ffd640 1 --2- 172.21.15.7:0/4123556165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b8103660 0x7fd6b8198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.749+0000 7fd6b6ffd640 1 -- 172.21.15.7:0/4123556165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b819d440 con 0x7fd6b8102d40 2024-09-19T08:44:42.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.749+0000 7fd6affff640 1 --2- 172.21.15.7:0/4123556165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b8103660 0x7fd6b8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:42.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.749+0000 7fd6b6ffd640 1 --2- 172.21.15.7:0/4123556165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6b8102d40 0x7fd6b8198450 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800d950 tx=0x7fd6a800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:42.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.749+0000 7fd6b4ff9640 1 -- 172.21.15.7:0/4123556165 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8017070 con 0x7fd6b8102d40 2024-09-19T08:44:42.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.749+0000 7fd6b4ff9640 1 -- 172.21.15.7:0/4123556165 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6a800de80 con 0x7fd6b8102d40 2024-09-19T08:44:42.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.749+0000 7fd6b4ff9640 1 -- 172.21.15.7:0/4123556165 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a800f620 con 0x7fd6b8102d40 2024-09-19T08:44:42.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.749+0000 7fd6bd28d640 1 -- 172.21.15.7:0/4123556165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6b819d730 con 0x7fd6b8102d40 2024-09-19T08:44:42.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.750+0000 7fd6bd28d640 1 -- 172.21.15.7:0/4123556165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6b81a4fc0 con 0x7fd6b8102d40 2024-09-19T08:44:42.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.750+0000 7fd6bd28d640 1 -- 172.21.15.7:0/4123556165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6b8103120 con 0x7fd6b8102d40 2024-09-19T08:44:42.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.752+0000 7fd6b4ff9640 1 -- 172.21.15.7:0/4123556165 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7fd6a8009c30 con 0x7fd6b8102d40 2024-09-19T08:44:42.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.753+0000 7fd6b4ff9640 1 --2- 172.21.15.7:0/4123556165 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd6a40a34c0 0x7fd6a40a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.753+0000 7fd6affff640 1 --2- 172.21.15.7:0/4123556165 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd6a40a34c0 0x7fd6a40a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.753+0000 7fd6b4ff9640 1 -- 172.21.15.7:0/4123556165 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fd6a80cfac0 con 0x7fd6b8102d40 2024-09-19T08:44:42.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.754+0000 7fd6affff640 1 --2- 172.21.15.7:0/4123556165 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd6a40a34c0 0x7fd6a40a5980 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd6b80fed80 tx=0x7fd6a0005a20 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:42.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.757+0000 7fd6b4ff9640 1 -- 172.21.15.7:0/4123556165 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd6a809c320 con 0x7fd6b8102d40 2024-09-19T08:44:42.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.923+0000 7faa4af4f640 1 -- 172.21.15.7:0/956512738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa44102ef0 msgr2=0x7faa4410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.923+0000 7faa4af4f640 1 --2- 172.21.15.7:0/956512738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa44102ef0 0x7faa4410da40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7faa3c009ca0 tx=0x7faa3c02a950 comp rx=0 tx=0).stop 2024-09-19T08:44:42.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.924+0000 7faa4af4f640 1 -- 172.21.15.7:0/956512738 shutdown_connections 2024-09-19T08:44:42.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.924+0000 7faa4af4f640 1 --2- 172.21.15.7:0/956512738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa44102ef0 0x7faa4410da40 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.924+0000 7faa4af4f640 1 --2- 172.21.15.7:0/956512738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa44102570 0x7faa441029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.924+0000 7faa4af4f640 1 --2- 172.21.15.7:0/956512738 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa44100e20 0x7faa44101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.924+0000 7faa4af4f640 1 -- 172.21.15.7:0/956512738 >> 172.21.15.7:0/956512738 conn(0x7faa440fc7d0 msgr2=0x7faa440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:42.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.924+0000 7faa4af4f640 1 -- 172.21.15.7:0/956512738 shutdown_connections 2024-09-19T08:44:42.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.924+0000 7faa4af4f640 1 -- 172.21.15.7:0/956512738 wait complete. 2024-09-19T08:44:42.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.924+0000 7faa4af4f640 1 Processor -- start 2024-09-19T08:44:42.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.924+0000 7faa4af4f640 1 -- start start 2024-09-19T08:44:42.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.925+0000 7faa4af4f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa44100e20 0x7faa440fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.925+0000 7faa4af4f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa44102570 0x7faa440fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.925+0000 7faa4af4f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa44102ef0 0x7faa440fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.925+0000 7faa4af4f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faa44110f80 con 0x7faa44100e20 2024-09-19T08:44:42.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.925+0000 7faa4af4f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faa44110e00 con 0x7faa44102570 2024-09-19T08:44:42.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.925+0000 7faa4af4f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faa44111100 con 0x7faa44102ef0 2024-09-19T08:44:42.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.925+0000 7faa48ceb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa44100e20 0x7faa440fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.925+0000 7faa48ceb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa44100e20 0x7faa440fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53568/0 (socket says 172.21.15.7:53568) 2024-09-19T08:44:42.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.925+0000 7faa48ceb640 1 -- 172.21.15.7:0/3773717647 learned_addr learned my addr 172.21.15.7:0/3773717647 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:42.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.925+0000 7faa43fff640 1 --2- 172.21.15.7:0/3773717647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa44102570 0x7faa440fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.925+0000 7faa494ec640 1 --2- 172.21.15.7:0/3773717647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa44102ef0 0x7faa440fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.925+0000 7faa48ceb640 1 -- 172.21.15.7:0/3773717647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa44102ef0 msgr2=0x7faa440fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.925+0000 7faa48ceb640 1 --2- 172.21.15.7:0/3773717647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa44102ef0 0x7faa440fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.925+0000 7faa48ceb640 1 -- 172.21.15.7:0/3773717647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa44102570 msgr2=0x7faa440fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.925+0000 7faa48ceb640 1 --2- 172.21.15.7:0/3773717647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa44102570 0x7faa440fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.925+0000 7faa48ceb640 1 -- 172.21.15.7:0/3773717647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa441a6910 con 0x7faa44100e20 2024-09-19T08:44:42.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.926+0000 7faa48ceb640 1 --2- 172.21.15.7:0/3773717647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa44100e20 0x7faa440fcc80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7faa3800e9f0 tx=0x7faa3800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:42.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.926+0000 7faa41ffb640 1 -- 172.21.15.7:0/3773717647 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3800cd80 con 0x7faa44100e20 2024-09-19T08:44:42.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.926+0000 7faa41ffb640 1 -- 172.21.15.7:0/3773717647 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa38010910 con 0x7faa44100e20 2024-09-19T08:44:42.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.926+0000 7faa41ffb640 1 -- 172.21.15.7:0/3773717647 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa38018990 con 0x7faa44100e20 2024-09-19T08:44:42.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.926+0000 7faa4af4f640 1 -- 172.21.15.7:0/3773717647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa441a6c00 con 0x7faa44100e20 2024-09-19T08:44:42.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.926+0000 7faa4af4f640 1 -- 172.21.15.7:0/3773717647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa441a7190 con 0x7faa44100e20 2024-09-19T08:44:42.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.928+0000 7faa41ffb640 1 -- 172.21.15.7:0/3773717647 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7faa38010ac0 con 0x7faa44100e20 2024-09-19T08:44:42.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.928+0000 7faa4d328740 1 Processor -- start 2024-09-19T08:44:42.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.928+0000 7faa4d328740 1 -- start start 2024-09-19T08:44:42.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.929+0000 7faa4d328740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcacc884a0 0x55fcacc88880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.929+0000 7faa4d328740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc88dc0 0x55fcacc93140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.929+0000 7faa4d328740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcacc93680 0x55fcacc95a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.929+0000 7faa4d328740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fcacbee2e0 con 0x55fcacc88dc0 2024-09-19T08:44:42.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.929+0000 7faa4d328740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fcacb95ce0 con 0x55fcacc884a0 2024-09-19T08:44:42.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.929+0000 7faa4d328740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fcacbea2a0 con 0x55fcacc93680 2024-09-19T08:44:42.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.929+0000 7faa48ceb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc88dc0 0x55fcacc93140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.929+0000 7faa494ec640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcacc884a0 0x55fcacc88880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.929+0000 7faa494ec640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcacc884a0 0x55fcacc88880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:46212/0 (socket says 172.21.15.7:46212) 2024-09-19T08:44:42.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.929+0000 7faa48ceb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc88dc0 0x55fcacc93140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53580/0 (socket says 172.21.15.7:53580) 2024-09-19T08:44:42.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.929+0000 7faa494ec640 1 -- 172.21.15.7:0/418201693 learned_addr learned my addr 172.21.15.7:0/418201693 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:42.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.929+0000 7faa43fff640 1 --2- 172.21.15.7:0/418201693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcacc93680 0x55fcacc95a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.929+0000 7faa43fff640 1 -- 172.21.15.7:0/418201693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcacc884a0 msgr2=0x55fcacc88880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:42.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.929+0000 7faa43fff640 1 --2- 172.21.15.7:0/418201693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcacc884a0 0x55fcacc88880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.929+0000 7faa43fff640 1 -- 172.21.15.7:0/418201693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc88dc0 msgr2=0x55fcacc93140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:42.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.929+0000 7faa43fff640 1 --2- 172.21.15.7:0/418201693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc88dc0 0x55fcacc93140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.929+0000 7faa43fff640 1 -- 172.21.15.7:0/418201693 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcacb7a440 con 0x55fcacc93680 2024-09-19T08:44:42.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.929+0000 7faa48ceb640 1 --2- 172.21.15.7:0/418201693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc88dc0 0x55fcacc93140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:44:42.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.929+0000 7faa41ffb640 1 --2- 172.21.15.7:0/3773717647 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7faa340a34c0 0x7faa340a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.930+0000 7faa43fff640 1 --2- 172.21.15.7:0/418201693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcacc93680 0x55fcacc95a70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faa30009bf0 tx=0x7faa30011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a407289893da7b06 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:42.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.930+0000 7faa494ec640 1 --2- 172.21.15.7:0/3773717647 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7faa340a34c0 0x7faa340a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.930+0000 7faa41ffb640 1 -- 172.21.15.7:0/3773717647 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7faa380d0190 con 0x7faa44100e20 2024-09-19T08:44:42.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.930+0000 7faa2effd640 1 -- 172.21.15.7:0/418201693 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa30004310 con 0x55fcacc93680 2024-09-19T08:44:42.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.930+0000 7faa2effd640 1 -- 172.21.15.7:0/418201693 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa300044b0 con 0x55fcacc93680 2024-09-19T08:44:42.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.930+0000 7faa2effd640 1 -- 172.21.15.7:0/418201693 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa30019aa0 con 0x55fcacc93680 2024-09-19T08:44:42.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.931+0000 7faa4d328740 1 -- 172.21.15.7:0/418201693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcacc93680 msgr2=0x55fcacc95a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.931+0000 7faa494ec640 1 --2- 172.21.15.7:0/3773717647 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7faa340a34c0 0x7faa340a5980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faa3c009ca0 tx=0x7faa3c005c50 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:42.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.931+0000 7faa4d328740 1 --2- 172.21.15.7:0/418201693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcacc93680 0x55fcacc95a70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faa30009bf0 tx=0x7faa30011440 comp rx=0 tx=0).stop 2024-09-19T08:44:42.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.931+0000 7faa4d328740 1 -- 172.21.15.7:0/418201693 shutdown_connections 2024-09-19T08:44:42.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.931+0000 7faa4d328740 1 --2- 172.21.15.7:0/418201693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcacc93680 0x55fcacc95a70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.931+0000 7faa4d328740 1 --2- 172.21.15.7:0/418201693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc88dc0 0x55fcacc93140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.931+0000 7faa4d328740 1 --2- 172.21.15.7:0/418201693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcacc884a0 0x55fcacc88880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.931+0000 7faa4d328740 1 -- 172.21.15.7:0/418201693 >> 172.21.15.7:0/418201693 conn(0x55fcacc84a30 msgr2=0x55fcacc84e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:42.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.931+0000 7faa4d328740 1 -- 172.21.15.7:0/418201693 shutdown_connections 2024-09-19T08:44:42.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.931+0000 7faa4d328740 1 -- 172.21.15.7:0/418201693 wait complete. 2024-09-19T08:44:42.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.931+0000 7faa4d328740 1 -- start start 2024-09-19T08:44:42.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.931+0000 7faa4d328740 1 Processor -- start 2024-09-19T08:44:42.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.932+0000 7faa4d328740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcacc884a0 0x55fcacc92ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.932+0000 7faa4d328740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc88dc0 0x55fcacc90150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.932+0000 7faa4d328740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcacc93680 0x55fcacc90690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.932+0000 7faa4d328740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fcacc96250 con 0x55fcacc88dc0 2024-09-19T08:44:42.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.932+0000 7faa4d328740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fcacba9050 con 0x55fcacc884a0 2024-09-19T08:44:42.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.932+0000 7faa4d328740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fcacc963d0 con 0x55fcacc93680 2024-09-19T08:44:42.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.932+0000 7faa4d328740 10 client.0 _ll_register_callbacks cb 0x55fcacbe9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:44:42.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.932+0000 7faa43fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc88dc0 0x55fcacc90150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.932+0000 7faa43fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc88dc0 0x55fcacc90150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53592/0 (socket says 172.21.15.7:53592) 2024-09-19T08:44:42.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.932+0000 7faa43fff640 1 -- 172.21.15.7:0/2585026491 learned_addr learned my addr 172.21.15.7:0/2585026491 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:42.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.932+0000 7faa494ec640 1 --2- 172.21.15.7:0/2585026491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcacc93680 0x55fcacc90690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.932+0000 7faa48ceb640 1 --2- 172.21.15.7:0/2585026491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcacc884a0 0x55fcacc92ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.932+0000 7faa43fff640 1 -- 172.21.15.7:0/2585026491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcacc93680 msgr2=0x55fcacc90690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:42.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.932+0000 7faa43fff640 1 --2- 172.21.15.7:0/2585026491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcacc93680 0x55fcacc90690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.932+0000 7faa43fff640 1 -- 172.21.15.7:0/2585026491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcacc884a0 msgr2=0x55fcacc92ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:42.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.932+0000 7faa43fff640 1 --2- 172.21.15.7:0/2585026491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcacc884a0 0x55fcacc92ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.932+0000 7faa43fff640 1 -- 172.21.15.7:0/2585026491 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcac95f3c0 con 0x55fcacc88dc0 2024-09-19T08:44:42.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.932+0000 7faa494ec640 1 --2- 172.21.15.7:0/2585026491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcacc93680 0x55fcacc90690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:44:42.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.932+0000 7faa43fff640 1 --2- 172.21.15.7:0/2585026491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc88dc0 0x55fcacc90150 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7faa30019b10 tx=0x7faa30019b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c258d569a4ad33 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:42.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.932+0000 7faa23fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:44:42.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.933+0000 7faa23fff640 1 -- 172.21.15.7:0/2585026491 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa30028020 con 0x55fcacc88dc0 2024-09-19T08:44:42.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.933+0000 7faa23fff640 1 -- 172.21.15.7:0/2585026491 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7faa30005240 con 0x55fcacc88dc0 2024-09-19T08:44:42.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.933+0000 7faa4d328740 1 -- 172.21.15.7:0/2585026491 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa300044b0 con 0x55fcacc88dc0 2024-09-19T08:44:42.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.933+0000 7faa23fff640 1 -- 172.21.15.7:0/2585026491 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faa30033050 con 0x55fcacc88dc0 2024-09-19T08:44:42.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.933+0000 7faa4d328740 10 client.15312 fetch_fsmap learned FSMap version 25 2024-09-19T08:44:42.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.933+0000 7faa4d328740 1 -- 172.21.15.7:0/2585026491 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fcacca1b00 con 0x55fcacc88dc0 2024-09-19T08:44:42.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.933+0000 7faa23fff640 1 -- 172.21.15.7:0/2585026491 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa300044b0 con 0x55fcacc88dc0 2024-09-19T08:44:42.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.933+0000 7faa23fff640 1 -- 172.21.15.7:0/2585026491 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7faa30018070 con 0x55fcacc88dc0 2024-09-19T08:44:42.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.933+0000 7faa4d328740 10 client.15312 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:44:42.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.933+0000 7faa4d328740 10 client.15312 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:44:42.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.933+0000 7faa4d328740 20 client.15312 populate_metadata read hostname 'smithi007' 2024-09-19T08:44:42.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.933+0000 7faa4d328740 1 --2- 172.21.15.7:0/2585026491 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fcacca2fc0 0x55fcacca53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.933+0000 7faa4d328740 4 client.15312 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:44:42.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.933+0000 7faa4d328740 1 -- 172.21.15.7:0/2585026491 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcacbfb850 con 0x55fcacca2fc0 2024-09-19T08:44:42.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.934+0000 7faa48ceb640 1 --2- 172.21.15.7:0/2585026491 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fcacca2fc0 0x55fcacca53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.934+0000 7faa23fff640 10 client.15312 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:44:42.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.934+0000 7faa48ceb640 1 --2- 172.21.15.7:0/2585026491 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fcacca2fc0 0x55fcacca53b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ec95ff1524fa7b9 server_cookie=87b937fa8331b4ac in_seq=0 out_seq=0 2024-09-19T08:44:42.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.935+0000 7faa23fff640 1 -- 172.21.15.7:0/2585026491 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fcacbfb850 con 0x55fcacca2fc0 2024-09-19T08:44:42.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.935+0000 7faa23fff640 10 client.15312 handle_command_reply: tid=0 2024-09-19T08:44:42.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.935+0000 7faa4d328740 1 client.15312 shutdown 2024-09-19T08:44:42.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.935+0000 7faa4d328740 1 -- 172.21.15.7:0/2585026491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc88dc0 msgr2=0x55fcacc90150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.935+0000 7faa4d328740 1 --2- 172.21.15.7:0/2585026491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc88dc0 0x55fcacc90150 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7faa30019b10 tx=0x7faa30019b40 comp rx=0 tx=0).stop 2024-09-19T08:44:42.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.935+0000 7faa4d328740 1 -- 172.21.15.7:0/2585026491 shutdown_connections 2024-09-19T08:44:42.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.935+0000 7faa4d328740 1 --2- 172.21.15.7:0/2585026491 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fcacca2fc0 0x55fcacca53b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.935+0000 7faa4d328740 1 --2- 172.21.15.7:0/2585026491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcacc93680 0x55fcacc90690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.935+0000 7faa4d328740 1 --2- 172.21.15.7:0/2585026491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc88dc0 0x55fcacc90150 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.935+0000 7faa23fff640 0 client.15312 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:44:42.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.935+0000 7faa4d328740 1 --2- 172.21.15.7:0/2585026491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcacc884a0 0x55fcacc92ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.935+0000 7faa4d328740 1 -- 172.21.15.7:0/2585026491 >> 172.21.15.7:0/2585026491 conn(0x55fcacc84a30 msgr2=0x55fcacc8a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:42.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.935+0000 7faa4d328740 1 -- 172.21.15.7:0/2585026491 shutdown_connections 2024-09-19T08:44:42.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.935+0000 7faa4d328740 1 -- 172.21.15.7:0/2585026491 wait complete. 2024-09-19T08:44:42.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.935+0000 7faa4d328740 20 client.15312 trim_cache size 0 max 16384 2024-09-19T08:44:42.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.953+0000 7faa4d328740 1 Processor -- start 2024-09-19T08:44:42.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.953+0000 7faa4d328740 1 -- start start 2024-09-19T08:44:42.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.953+0000 7faa4d328740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcacc884a0 0x55fcacc920c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.953+0000 7faa4d328740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcacc88dc0 0x55fcaccaabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.953+0000 7faa4d328740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc93680 0x55fcaccab100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.953+0000 7faa4d328740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faa441b23c0 con 0x55fcacc93680 2024-09-19T08:44:42.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.953+0000 7faa4d328740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faa441afc90 con 0x55fcacc88dc0 2024-09-19T08:44:42.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.953+0000 7faa4d328740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faa441adae0 con 0x55fcacc884a0 2024-09-19T08:44:42.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.953+0000 7faa494ec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc93680 0x55fcaccab100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.953+0000 7faa494ec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc93680 0x55fcaccab100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53606/0 (socket says 172.21.15.7:53606) 2024-09-19T08:44:42.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.953+0000 7faa494ec640 1 -- 172.21.15.7:0/2846519451 learned_addr learned my addr 172.21.15.7:0/2846519451 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:42.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.953+0000 7faa48ceb640 1 --2- 172.21.15.7:0/2846519451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcacc884a0 0x55fcacc920c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.953+0000 7faa43fff640 1 --2- 172.21.15.7:0/2846519451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcacc88dc0 0x55fcaccaabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.953+0000 7faa494ec640 1 -- 172.21.15.7:0/2846519451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcacc884a0 msgr2=0x55fcacc920c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:42.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.953+0000 7faa494ec640 1 --2- 172.21.15.7:0/2846519451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcacc884a0 0x55fcacc920c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.953+0000 7faa494ec640 1 -- 172.21.15.7:0/2846519451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcacc88dc0 msgr2=0x55fcaccaabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:42.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.953+0000 7faa494ec640 1 --2- 172.21.15.7:0/2846519451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcacc88dc0 0x55fcaccaabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.953+0000 7faa494ec640 1 -- 172.21.15.7:0/2846519451 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcacc88bf0 con 0x55fcacc93680 2024-09-19T08:44:42.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.953+0000 7faa43fff640 1 --2- 172.21.15.7:0/2846519451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcacc88dc0 0x55fcaccaabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:42.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.953+0000 7faa494ec640 1 --2- 172.21.15.7:0/2846519451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc93680 0x55fcaccab100 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7faa3c035000 tx=0x7faa3c042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0e1f129ffd1a8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:42.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.954+0000 7faa2e7fc640 1 -- 172.21.15.7:0/2846519451 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c034040 con 0x55fcacc93680 2024-09-19T08:44:42.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.954+0000 7faa2e7fc640 1 -- 172.21.15.7:0/2846519451 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa3c004520 con 0x55fcacc93680 2024-09-19T08:44:42.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.954+0000 7faa2e7fc640 1 -- 172.21.15.7:0/2846519451 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c030a80 con 0x55fcacc93680 2024-09-19T08:44:42.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.954+0000 7faa4d328740 1 -- 172.21.15.7:0/2846519451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc93680 msgr2=0x55fcaccab100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.954+0000 7faa4d328740 1 --2- 172.21.15.7:0/2846519451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc93680 0x55fcaccab100 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7faa3c035000 tx=0x7faa3c042000 comp rx=0 tx=0).stop 2024-09-19T08:44:42.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.954+0000 7faa4d328740 1 -- 172.21.15.7:0/2846519451 shutdown_connections 2024-09-19T08:44:42.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.954+0000 7faa4d328740 1 --2- 172.21.15.7:0/2846519451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc93680 0x55fcaccab100 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.954+0000 7faa4d328740 1 --2- 172.21.15.7:0/2846519451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcacc88dc0 0x55fcaccaabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.954+0000 7faa4d328740 1 --2- 172.21.15.7:0/2846519451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcacc884a0 0x55fcacc920c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.954+0000 7faa4d328740 1 -- 172.21.15.7:0/2846519451 >> 172.21.15.7:0/2846519451 conn(0x55fcacc84a30 msgr2=0x55fcacc919b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.954+0000 7faa4d328740 1 -- 172.21.15.7:0/2846519451 shutdown_connections 2024-09-19T08:44:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.954+0000 7faa4d328740 1 -- 172.21.15.7:0/2846519451 wait complete. 2024-09-19T08:44:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.955+0000 7faa4d328740 1 -- start start 2024-09-19T08:44:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.955+0000 7faa4d328740 1 Processor -- start 2024-09-19T08:44:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.955+0000 7faa4d328740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc884a0 0x55fcacc9b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.955+0000 7faa4d328740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcacc88dc0 0x55fcacc9bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.955+0000 7faa4d328740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcacc93680 0x55fcacc8cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.955+0000 7faa4d328740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faa441ae150 con 0x55fcacc884a0 2024-09-19T08:44:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.955+0000 7faa4d328740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faa441af5c0 con 0x55fcacc93680 2024-09-19T08:44:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.955+0000 7faa4d328740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faa441ae820 con 0x55fcacc88dc0 2024-09-19T08:44:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.955+0000 7faa4d328740 10 client.0 _ll_register_callbacks cb 0x7faa380cd640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:44:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.955+0000 7faa48ceb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc884a0 0x55fcacc9b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.956+0000 7faa48ceb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc884a0 0x55fcacc9b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53612/0 (socket says 172.21.15.7:53612) 2024-09-19T08:44:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.956+0000 7faa48ceb640 1 -- 172.21.15.7:0/1230946794 learned_addr learned my addr 172.21.15.7:0/1230946794 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.956+0000 7faa43fff640 1 --2- 172.21.15.7:0/1230946794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcacc88dc0 0x55fcacc9bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.956+0000 7faa494ec640 1 --2- 172.21.15.7:0/1230946794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcacc93680 0x55fcacc8cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.956+0000 7faa48ceb640 1 -- 172.21.15.7:0/1230946794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcacc88dc0 msgr2=0x55fcacc9bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.956+0000 7faa48ceb640 1 --2- 172.21.15.7:0/1230946794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcacc88dc0 0x55fcacc9bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.956+0000 7faa48ceb640 1 -- 172.21.15.7:0/1230946794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcacc93680 msgr2=0x55fcacc8cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.956+0000 7faa48ceb640 1 --2- 172.21.15.7:0/1230946794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcacc93680 0x55fcacc8cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.956+0000 7faa48ceb640 1 -- 172.21.15.7:0/1230946794 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcacc8d530 con 0x55fcacc884a0 2024-09-19T08:44:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.956+0000 7faa48ceb640 1 --2- 172.21.15.7:0/1230946794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc884a0 0x55fcacc9b990 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7faa380987a0 tx=0x7faa380bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df94d125c8277e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.956+0000 7faa23fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:44:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.956+0000 7faa23fff640 1 -- 172.21.15.7:0/1230946794 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3809c340 con 0x55fcacc884a0 2024-09-19T08:44:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.956+0000 7faa23fff640 1 -- 172.21.15.7:0/1230946794 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7faa380d3c80 con 0x55fcacc884a0 2024-09-19T08:44:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.956+0000 7faa4d328740 1 -- 172.21.15.7:0/1230946794 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa3c004520 con 0x55fcacc884a0 2024-09-19T08:44:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.956+0000 7faa23fff640 1 -- 172.21.15.7:0/1230946794 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faa380a0640 con 0x55fcacc884a0 2024-09-19T08:44:42.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.956+0000 7faa4d328740 10 client.15318 fetch_fsmap learned FSMap version 25 2024-09-19T08:44:42.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.956+0000 7faa4d328740 1 -- 172.21.15.7:0/1230946794 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fcacd0d800 con 0x55fcacc884a0 2024-09-19T08:44:42.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.957+0000 7faa23fff640 1 -- 172.21.15.7:0/1230946794 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa3c004520 con 0x55fcacc884a0 2024-09-19T08:44:42.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.957+0000 7faa23fff640 1 -- 172.21.15.7:0/1230946794 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7faa380a0170 con 0x55fcacc884a0 2024-09-19T08:44:42.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.957+0000 7faa4d328740 10 client.15318 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:44:42.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.957+0000 7faa4d328740 10 client.15318 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:44:42.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.957+0000 7faa4d328740 20 client.15318 populate_metadata read hostname 'smithi007' 2024-09-19T08:44:42.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.957+0000 7faa4d328740 1 --2- 172.21.15.7:0/1230946794 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fcacd0df20 0x55fcacd10340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:42.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.957+0000 7faa4d328740 4 client.15318 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:44:42.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.957+0000 7faa4d328740 1 -- 172.21.15.7:0/1230946794 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fcacbf5d60 con 0x55fcacd0df20 2024-09-19T08:44:42.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.957+0000 7faa43fff640 1 --2- 172.21.15.7:0/1230946794 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fcacd0df20 0x55fcacd10340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:42.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.958+0000 7faa43fff640 1 --2- 172.21.15.7:0/1230946794 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fcacd0df20 0x55fcacd10340 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7de60f239e4195cb server_cookie=4b021e3544132ddb in_seq=0 out_seq=0 2024-09-19T08:44:42.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.958+0000 7faa23fff640 10 client.15318 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:44:42.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.958+0000 7faa23fff640 1 -- 172.21.15.7:0/1230946794 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55fcacbf5d60 con 0x55fcacd0df20 2024-09-19T08:44:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.958+0000 7faa23fff640 10 client.15318 handle_command_reply: tid=0 2024-09-19T08:44:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.958+0000 7faa4d328740 1 client.15318 shutdown 2024-09-19T08:44:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.958+0000 7faa4d328740 1 -- 172.21.15.7:0/1230946794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc884a0 msgr2=0x55fcacc9b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.958+0000 7faa4d328740 1 --2- 172.21.15.7:0/1230946794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc884a0 0x55fcacc9b990 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7faa380987a0 tx=0x7faa380bc040 comp rx=0 tx=0).stop 2024-09-19T08:44:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.958+0000 7faa4d328740 1 -- 172.21.15.7:0/1230946794 shutdown_connections 2024-09-19T08:44:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.958+0000 7faa4d328740 1 --2- 172.21.15.7:0/1230946794 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fcacd0df20 0x55fcacd10340 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.958+0000 7faa4d328740 1 --2- 172.21.15.7:0/1230946794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcacc93680 0x55fcacc8cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.958+0000 7faa23fff640 0 client.15318 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:44:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.958+0000 7faa4d328740 1 --2- 172.21.15.7:0/1230946794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fcacc88dc0 0x55fcacc9bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.958+0000 7faa4d328740 1 --2- 172.21.15.7:0/1230946794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fcacc884a0 0x55fcacc9b990 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.958+0000 7faa4d328740 1 -- 172.21.15.7:0/1230946794 >> 172.21.15.7:0/1230946794 conn(0x55fcacc84a30 msgr2=0x55fcacc921d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.958+0000 7faa4d328740 1 -- 172.21.15.7:0/1230946794 shutdown_connections 2024-09-19T08:44:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.958+0000 7faa4d328740 1 -- 172.21.15.7:0/1230946794 wait complete. 2024-09-19T08:44:42.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.958+0000 7faa4d328740 20 client.15318 trim_cache size 0 max 16384 2024-09-19T08:44:42.963 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:44:42.963 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:44:42.963 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-19T08:44:42.963 INFO:teuthology.orchestra.run.smithi007.stdout: "fe5791be-1e10-45fb-9be5-3ef912c6b2e2": { 2024-09-19T08:44:42.963 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-19T08:44:42.963 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "fe5791be-1e10-45fb-9be5-3ef912c6b2e2", 2024-09-19T08:44:42.963 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-19T08:44:42.963 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:44:42.963 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:44:42.963 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:44:42.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.959+0000 7faa4af4f640 1 -- 172.21.15.7:0/3773717647 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7faa340a34c0 msgr2=0x7faa340a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.959+0000 7faa4af4f640 1 --2- 172.21.15.7:0/3773717647 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7faa340a34c0 0x7faa340a5980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faa3c009ca0 tx=0x7faa3c005c50 comp rx=0 tx=0).stop 2024-09-19T08:44:42.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.959+0000 7faa4af4f640 1 -- 172.21.15.7:0/3773717647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa44100e20 msgr2=0x7faa440fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.959+0000 7faa4af4f640 1 --2- 172.21.15.7:0/3773717647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa44100e20 0x7faa440fcc80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7faa3800e9f0 tx=0x7faa3800eeb0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.959+0000 7faa4af4f640 1 -- 172.21.15.7:0/3773717647 shutdown_connections 2024-09-19T08:44:42.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.959+0000 7faa4af4f640 1 --2- 172.21.15.7:0/3773717647 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7faa340a34c0 0x7faa340a5980 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.959+0000 7faa4af4f640 1 --2- 172.21.15.7:0/3773717647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa44102ef0 0x7faa440fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.959+0000 7faa4af4f640 1 --2- 172.21.15.7:0/3773717647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa44102570 0x7faa440fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.959+0000 7faa4af4f640 1 --2- 172.21.15.7:0/3773717647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa44100e20 0x7faa440fcc80 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.959+0000 7faa4af4f640 1 -- 172.21.15.7:0/3773717647 >> 172.21.15.7:0/3773717647 conn(0x7faa440fc7d0 msgr2=0x7faa4406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:42.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.959+0000 7faa4af4f640 1 -- 172.21.15.7:0/3773717647 shutdown_connections 2024-09-19T08:44:42.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.959+0000 7faa4af4f640 1 -- 172.21.15.7:0/3773717647 wait complete. 2024-09-19T08:44:42.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.965+0000 7fd6bd28d640 1 -- 172.21.15.7:0/4123556165 --> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fd6b8062630 con 0x7fd6a40a34c0 2024-09-19T08:44:42.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.972+0000 7fd6b4ff9640 1 -- 172.21.15.7:0/4123556165 <== mgr.15132 v2:172.21.15.7:6800/3061932294 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fd6b8062630 con 0x7fd6a40a34c0 2024-09-19T08:44:42.972 INFO:teuthology.orchestra.run.smithi007.stdout:/ 1m 6m3h 2024-09-19T08:44:42.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.974+0000 7fd6bd28d640 1 -- 172.21.15.7:0/4123556165 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd6a40a34c0 msgr2=0x7fd6a40a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.974+0000 7fd6bd28d640 1 --2- 172.21.15.7:0/4123556165 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd6a40a34c0 0x7fd6a40a5980 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd6b80fed80 tx=0x7fd6a0005a20 comp rx=0 tx=0).stop 2024-09-19T08:44:42.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.974+0000 7fd6bd28d640 1 -- 172.21.15.7:0/4123556165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6b8102d40 msgr2=0x7fd6b8198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:42.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.974+0000 7fd6bd28d640 1 --2- 172.21.15.7:0/4123556165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6b8102d40 0x7fd6b8198450 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800d950 tx=0x7fd6a800dd50 comp rx=0 tx=0).stop 2024-09-19T08:44:42.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.974+0000 7fd6bd28d640 1 -- 172.21.15.7:0/4123556165 shutdown_connections 2024-09-19T08:44:42.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.974+0000 7fd6bd28d640 1 --2- 172.21.15.7:0/4123556165 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd6a40a34c0 0x7fd6a40a5980 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.974+0000 7fd6bd28d640 1 --2- 172.21.15.7:0/4123556165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6b810c110 0x7fd6b819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.974+0000 7fd6bd28d640 1 --2- 172.21.15.7:0/4123556165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b8103660 0x7fd6b8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.974+0000 7fd6bd28d640 1 --2- 172.21.15.7:0/4123556165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6b8102d40 0x7fd6b8198450 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:42.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.974+0000 7fd6bd28d640 1 -- 172.21.15.7:0/4123556165 >> 172.21.15.7:0/4123556165 conn(0x7fd6b80fc6b0 msgr2=0x7fd6b80fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:42.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.975+0000 7fd6bd28d640 1 -- 172.21.15.7:0/4123556165 shutdown_connections 2024-09-19T08:44:42.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:42.975+0000 7fd6bd28d640 1 -- 172.21.15.7:0/4123556165 wait complete. 2024-09-19T08:44:42.986 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-19T08:44:43.013 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-19T08:44:43.023 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-19T08:44:43.057 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T08:44:43.058 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:44:43.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:43 smithi175 ceph-mon[35688]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:43.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:43 smithi175 ceph-mon[35688]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:43.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:43 smithi175 ceph-mon[35688]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:43.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:43 smithi007 ceph-mon[31221]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:43.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:43 smithi007 ceph-mon[31221]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:43.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:43 smithi007 ceph-mon[31221]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:43.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:43 smithi044 ceph-mon[35072]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:43.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:43 smithi044 ceph-mon[35072]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:43.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:43 smithi044 ceph-mon[35072]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:43.738 INFO:tasks.cephfs.filesystem:scrub status for tag:fe5791be-1e10-45fb-9be5-3ef912c6b2e2 - {'path': '/', 'tag': 'fe5791be-1e10-45fb-9be5-3ef912c6b2e2', 'options': 'recursive,force'} 2024-09-19T08:44:43.847 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:44.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:44 smithi007 ceph-mon[31221]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 59 KiB/s wr, 32 op/s 2024-09-19T08:44:44.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.279+0000 7f9a1ecba640 1 -- 172.21.15.7:0/2968887756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a18102da0 msgr2=0x7f9a18103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:44.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.279+0000 7f9a1ecba640 1 --2- 172.21.15.7:0/2968887756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a18102da0 0x7f9a18103180 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c009900 tx=0x7f9a0c02a480 comp rx=0 tx=0).stop 2024-09-19T08:44:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.279+0000 7f9a1ecba640 1 -- 172.21.15.7:0/2968887756 shutdown_connections 2024-09-19T08:44:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.279+0000 7f9a1ecba640 1 --2- 172.21.15.7:0/2968887756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a1810c180 0x7f9a1810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.279+0000 7f9a1ecba640 1 --2- 172.21.15.7:0/2968887756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a181036c0 0x7f9a1810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.279+0000 7f9a1ecba640 1 --2- 172.21.15.7:0/2968887756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a18102da0 0x7f9a18103180 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.279+0000 7f9a1ecba640 1 -- 172.21.15.7:0/2968887756 >> 172.21.15.7:0/2968887756 conn(0x7f9a180fc7a0 msgr2=0x7f9a180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.280+0000 7f9a1ecba640 1 -- 172.21.15.7:0/2968887756 shutdown_connections 2024-09-19T08:44:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.280+0000 7f9a1ecba640 1 -- 172.21.15.7:0/2968887756 wait complete. 2024-09-19T08:44:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.280+0000 7f9a1ecba640 1 Processor -- start 2024-09-19T08:44:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.280+0000 7f9a1ecba640 1 -- start start 2024-09-19T08:44:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.280+0000 7f9a1ecba640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a18102da0 0x7f9a1819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.280+0000 7f9a1ecba640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a181036c0 0x7f9a1819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.280+0000 7f9a1ecba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a1810c180 0x7f9a1819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.281+0000 7f9a1ecba640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9a18111f60 con 0x7f9a18102da0 2024-09-19T08:44:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.281+0000 7f9a1ecba640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9a18111de0 con 0x7f9a1810c180 2024-09-19T08:44:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.281+0000 7f9a1ecba640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9a181120e0 con 0x7f9a181036c0 2024-09-19T08:44:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.281+0000 7f9a1ca56640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a18102da0 0x7f9a1819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.281+0000 7f9a1ca56640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a18102da0 0x7f9a1819a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41742/0 (socket says 172.21.15.7:41742) 2024-09-19T08:44:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.281+0000 7f9a1ca56640 1 -- 172.21.15.7:0/1883806961 learned_addr learned my addr 172.21.15.7:0/1883806961 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.281+0000 7f9a17fff640 1 --2- 172.21.15.7:0/1883806961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a181036c0 0x7f9a1819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.281+0000 7f9a1d257640 1 --2- 172.21.15.7:0/1883806961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a1810c180 0x7f9a1819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.281+0000 7f9a1ca56640 1 -- 172.21.15.7:0/1883806961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a181036c0 msgr2=0x7f9a1819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.281+0000 7f9a1ca56640 1 --2- 172.21.15.7:0/1883806961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a181036c0 0x7f9a1819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.281+0000 7f9a1ca56640 1 -- 172.21.15.7:0/1883806961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a1810c180 msgr2=0x7f9a1819ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.281+0000 7f9a1ca56640 1 --2- 172.21.15.7:0/1883806961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a1810c180 0x7f9a1819ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.281+0000 7f9a1ca56640 1 -- 172.21.15.7:0/1883806961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1819f610 con 0x7f9a18102da0 2024-09-19T08:44:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.281+0000 7f9a1d257640 1 --2- 172.21.15.7:0/1883806961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a1810c180 0x7f9a1819ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:44:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.281+0000 7f9a1ca56640 1 --2- 172.21.15.7:0/1883806961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a18102da0 0x7f9a1819a660 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c006010 tx=0x7f9a0c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.281+0000 7f9a15ffb640 1 -- 172.21.15.7:0/1883806961 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c03f030 con 0x7f9a18102da0 2024-09-19T08:44:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.281+0000 7f9a1ecba640 1 -- 172.21.15.7:0/1883806961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a1819f8a0 con 0x7f9a18102da0 2024-09-19T08:44:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.281+0000 7f9a15ffb640 1 -- 172.21.15.7:0/1883806961 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a0c003ce0 con 0x7f9a18102da0 2024-09-19T08:44:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.281+0000 7f9a15ffb640 1 -- 172.21.15.7:0/1883806961 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c035070 con 0x7f9a18102da0 2024-09-19T08:44:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.282+0000 7f9a1ecba640 1 -- 172.21.15.7:0/1883806961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a181a71e0 con 0x7f9a18102da0 2024-09-19T08:44:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.283+0000 7f9a1ecba640 1 -- 172.21.15.7:0/1883806961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a18103180 con 0x7f9a18102da0 2024-09-19T08:44:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.284+0000 7f9a15ffb640 1 -- 172.21.15.7:0/1883806961 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f9a0c042030 con 0x7f9a18102da0 2024-09-19T08:44:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.284+0000 7f9a15ffb640 1 --2- 172.21.15.7:0/1883806961 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9a080a34c0 0x7f9a080a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.285+0000 7f9a17fff640 1 --2- 172.21.15.7:0/1883806961 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9a080a34c0 0x7f9a080a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.285+0000 7f9a15ffb640 1 -- 172.21.15.7:0/1883806961 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f9a0c0f0460 con 0x7f9a18102da0 2024-09-19T08:44:44.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.285+0000 7f9a17fff640 1 --2- 172.21.15.7:0/1883806961 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9a080a34c0 0x7f9a080a5980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9a180febe0 tx=0x7f9a0400b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:44.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.289+0000 7f9a15ffb640 1 -- 172.21.15.7:0/1883806961 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9a0c0bcd80 con 0x7f9a18102da0 2024-09-19T08:44:44.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:44 smithi175 ceph-mon[35688]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 59 KiB/s wr, 32 op/s 2024-09-19T08:44:44.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.464+0000 7f9a1ecba640 1 -- 172.21.15.7:0/1883806961 --> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9a181020c0 con 0x7f9a080a34c0 2024-09-19T08:44:44.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.470+0000 7f9a15ffb640 1 -- 172.21.15.7:0/1883806961 <== mgr.15132 v2:172.21.15.7:6800/3061932294 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257761 (secure 0 0 0) 0x7f9a181020c0 con 0x7f9a080a34c0 2024-09-19T08:44:44.472 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:44:44.473 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-19T08:44:44.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.473+0000 7f9a1ecba640 1 -- 172.21.15.7:0/1883806961 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9a080a34c0 msgr2=0x7f9a080a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:44.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.473+0000 7f9a1ecba640 1 --2- 172.21.15.7:0/1883806961 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9a080a34c0 0x7f9a080a5980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9a180febe0 tx=0x7f9a0400b390 comp rx=0 tx=0).stop 2024-09-19T08:44:44.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.473+0000 7f9a1ecba640 1 -- 172.21.15.7:0/1883806961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a18102da0 msgr2=0x7f9a1819a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:44.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.473+0000 7f9a1ecba640 1 --2- 172.21.15.7:0/1883806961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a18102da0 0x7f9a1819a660 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c006010 tx=0x7f9a0c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.473+0000 7f9a1ecba640 1 -- 172.21.15.7:0/1883806961 shutdown_connections 2024-09-19T08:44:44.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.473+0000 7f9a1ecba640 1 --2- 172.21.15.7:0/1883806961 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9a080a34c0 0x7f9a080a5980 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.473+0000 7f9a1ecba640 1 --2- 172.21.15.7:0/1883806961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a1810c180 0x7f9a1819ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.473+0000 7f9a1ecba640 1 --2- 172.21.15.7:0/1883806961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a181036c0 0x7f9a1819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.473+0000 7f9a1ecba640 1 --2- 172.21.15.7:0/1883806961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a18102da0 0x7f9a1819a660 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:44.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.473+0000 7f9a1ecba640 1 -- 172.21.15.7:0/1883806961 >> 172.21.15.7:0/1883806961 conn(0x7f9a180fc7a0 msgr2=0x7f9a181019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:44.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.473+0000 7f9a1ecba640 1 -- 172.21.15.7:0/1883806961 shutdown_connections 2024-09-19T08:44:44.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:44.473+0000 7f9a1ecba640 1 -- 172.21.15.7:0/1883806961 wait complete. 2024-09-19T08:44:44.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:44 smithi044 ceph-mon[35072]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 59 KiB/s wr, 32 op/s 2024-09-19T08:44:45.126 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":9,"stamp":"2024-09-19T08:44:43.184289+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1384695,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1123,"num_read_kb":927,"num_write":559,"num_write_kb":5030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1181934,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":921,"ondisk_log_size":921,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367848,"kb_used_data":14352,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124573976,"statfs":{"total":1151940427776,"available":1151563751424,"internally_reserved":0,"allocated":14696448,"data_stored":8857497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":346,"num_write":84,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.991084"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226071+0000","last_change":"2024-09-19T08:42:44.035697+0000","last_active":"2024-09-19T08:44:31.226071+0000","last_peered":"2024-09-19T08:44:31.226071+0000","last_clean":"2024-09-19T08:44:31.226071+0000","last_became_active":"2024-09-19T08:42:44.035400+0000","last_became_peered":"2024-09-19T08:42:44.035400+0000","last_unstale":"2024-09-19T08:44:31.226071+0000","last_undegraded":"2024-09-19T08:44:31.226071+0000","last_fullsized":"2024-09-19T08:44:31.226071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:56.202947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.223958+0000","last_change":"2024-09-19T08:42:44.031393+0000","last_active":"2024-09-19T08:44:31.223958+0000","last_peered":"2024-09-19T08:44:31.223958+0000","last_clean":"2024-09-19T08:44:31.223958+0000","last_became_active":"2024-09-19T08:42:44.031056+0000","last_became_peered":"2024-09-19T08:42:44.031056+0000","last_unstale":"2024-09-19T08:44:31.223958+0000","last_undegraded":"2024-09-19T08:44:31.223958+0000","last_fullsized":"2024-09-19T08:44:31.223958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:44.694913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224221+0000","last_change":"2024-09-19T08:42:44.029586+0000","last_active":"2024-09-19T08:44:31.224221+0000","last_peered":"2024-09-19T08:44:31.224221+0000","last_clean":"2024-09-19T08:44:31.224221+0000","last_became_active":"2024-09-19T08:42:44.029279+0000","last_became_peered":"2024-09-19T08:42:44.029279+0000","last_unstale":"2024-09-19T08:44:31.224221+0000","last_undegraded":"2024-09-19T08:44:31.224221+0000","last_fullsized":"2024-09-19T08:44:31.224221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:12.036113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219401+0000","last_change":"2024-09-19T08:42:44.043192+0000","last_active":"2024-09-19T08:44:31.219401+0000","last_peered":"2024-09-19T08:44:31.219401+0000","last_clean":"2024-09-19T08:44:31.219401+0000","last_became_active":"2024-09-19T08:42:44.042838+0000","last_became_peered":"2024-09-19T08:42:44.042838+0000","last_unstale":"2024-09-19T08:44:31.219401+0000","last_undegraded":"2024-09-19T08:44:31.219401+0000","last_fullsized":"2024-09-19T08:44:31.219401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:20.549232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.207548+0000","last_change":"2024-09-19T08:42:44.032231+0000","last_active":"2024-09-19T08:44:31.207548+0000","last_peered":"2024-09-19T08:44:31.207548+0000","last_clean":"2024-09-19T08:44:31.207548+0000","last_became_active":"2024-09-19T08:42:44.031835+0000","last_became_peered":"2024-09-19T08:42:44.031835+0000","last_unstale":"2024-09-19T08:44:31.207548+0000","last_undegraded":"2024-09-19T08:44:31.207548+0000","last_fullsized":"2024-09-19T08:44:31.207548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:49.084085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.209888+0000","last_change":"2024-09-19T08:42:44.035487+0000","last_active":"2024-09-19T08:44:31.209888+0000","last_peered":"2024-09-19T08:44:31.209888+0000","last_clean":"2024-09-19T08:44:31.209888+0000","last_became_active":"2024-09-19T08:42:44.035138+0000","last_became_peered":"2024-09-19T08:42:44.035138+0000","last_unstale":"2024-09-19T08:44:31.209888+0000","last_undegraded":"2024-09-19T08:44:31.209888+0000","last_fullsized":"2024-09-19T08:44:31.209888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:43.483397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212841+0000","last_change":"2024-09-19T08:42:44.029052+0000","last_active":"2024-09-19T08:44:31.212841+0000","last_peered":"2024-09-19T08:44:31.212841+0000","last_clean":"2024-09-19T08:44:31.212841+0000","last_became_active":"2024-09-19T08:42:44.028722+0000","last_became_peered":"2024-09-19T08:42:44.028722+0000","last_unstale":"2024-09-19T08:44:31.212841+0000","last_undegraded":"2024-09-19T08:44:31.212841+0000","last_fullsized":"2024-09-19T08:44:31.212841+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:49.226044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212167+0000","last_change":"2024-09-19T08:42:44.031401+0000","last_active":"2024-09-19T08:44:31.212167+0000","last_peered":"2024-09-19T08:44:31.212167+0000","last_clean":"2024-09-19T08:44:31.212167+0000","last_became_active":"2024-09-19T08:42:44.031103+0000","last_became_peered":"2024-09-19T08:42:44.031103+0000","last_unstale":"2024-09-19T08:44:31.212167+0000","last_undegraded":"2024-09-19T08:44:31.212167+0000","last_fullsized":"2024-09-19T08:44:31.212167+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:57.406765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224039+0000","last_change":"2024-09-19T08:42:44.033011+0000","last_active":"2024-09-19T08:44:31.224039+0000","last_peered":"2024-09-19T08:44:31.224039+0000","last_clean":"2024-09-19T08:44:31.224039+0000","last_became_active":"2024-09-19T08:42:44.032075+0000","last_became_peered":"2024-09-19T08:42:44.032075+0000","last_unstale":"2024-09-19T08:44:31.224039+0000","last_undegraded":"2024-09-19T08:44:31.224039+0000","last_fullsized":"2024-09-19T08:44:31.224039+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:43.701684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212881+0000","last_change":"2024-09-19T08:42:44.037417+0000","last_active":"2024-09-19T08:44:31.212881+0000","last_peered":"2024-09-19T08:44:31.212881+0000","last_clean":"2024-09-19T08:44:31.212881+0000","last_became_active":"2024-09-19T08:42:44.037006+0000","last_became_peered":"2024-09-19T08:42:44.037006+0000","last_unstale":"2024-09-19T08:44:31.212881+0000","last_undegraded":"2024-09-19T08:44:31.212881+0000","last_fullsized":"2024-09-19T08:44:31.212881+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:10.952939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225737+0000","last_change":"2024-09-19T08:42:44.034125+0000","last_active":"2024-09-19T08:44:31.225737+0000","last_peered":"2024-09-19T08:44:31.225737+0000","last_clean":"2024-09-19T08:44:31.225737+0000","last_became_active":"2024-09-19T08:42:44.033772+0000","last_became_peered":"2024-09-19T08:42:44.033772+0000","last_unstale":"2024-09-19T08:44:31.225737+0000","last_undegraded":"2024-09-19T08:44:31.225737+0000","last_fullsized":"2024-09-19T08:44:31.225737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:42.854137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219105+0000","last_change":"2024-09-19T08:42:44.043047+0000","last_active":"2024-09-19T08:44:31.219105+0000","last_peered":"2024-09-19T08:44:31.219105+0000","last_clean":"2024-09-19T08:44:31.219105+0000","last_became_active":"2024-09-19T08:42:44.042666+0000","last_became_peered":"2024-09-19T08:42:44.042666+0000","last_unstale":"2024-09-19T08:44:31.219105+0000","last_undegraded":"2024-09-19T08:44:31.219105+0000","last_fullsized":"2024-09-19T08:44:31.219105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:16.504824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208420+0000","last_change":"2024-09-19T08:42:44.026475+0000","last_active":"2024-09-19T08:44:31.208420+0000","last_peered":"2024-09-19T08:44:31.208420+0000","last_clean":"2024-09-19T08:44:31.208420+0000","last_became_active":"2024-09-19T08:42:44.026169+0000","last_became_peered":"2024-09-19T08:42:44.026169+0000","last_unstale":"2024-09-19T08:44:31.208420+0000","last_undegraded":"2024-09-19T08:44:31.208420+0000","last_fullsized":"2024-09-19T08:44:31.208420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:17.130267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222128+0000","last_change":"2024-09-19T08:42:44.033725+0000","last_active":"2024-09-19T08:44:31.222128+0000","last_peered":"2024-09-19T08:44:31.222128+0000","last_clean":"2024-09-19T08:44:31.222128+0000","last_became_active":"2024-09-19T08:42:44.033304+0000","last_became_peered":"2024-09-19T08:42:44.033304+0000","last_unstale":"2024-09-19T08:44:31.222128+0000","last_undegraded":"2024-09-19T08:44:31.222128+0000","last_fullsized":"2024-09-19T08:44:31.222128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:47.520808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224694+0000","last_change":"2024-09-19T08:42:44.041762+0000","last_active":"2024-09-19T08:44:31.224694+0000","last_peered":"2024-09-19T08:44:31.224694+0000","last_clean":"2024-09-19T08:44:31.224694+0000","last_became_active":"2024-09-19T08:42:44.041433+0000","last_became_peered":"2024-09-19T08:42:44.041433+0000","last_unstale":"2024-09-19T08:44:31.224694+0000","last_undegraded":"2024-09-19T08:44:31.224694+0000","last_fullsized":"2024-09-19T08:44:31.224694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:05.504873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226669+0000","last_change":"2024-09-19T08:42:44.030316+0000","last_active":"2024-09-19T08:44:31.226669+0000","last_peered":"2024-09-19T08:44:31.226669+0000","last_clean":"2024-09-19T08:44:31.226669+0000","last_became_active":"2024-09-19T08:42:44.029872+0000","last_became_peered":"2024-09-19T08:42:44.029872+0000","last_unstale":"2024-09-19T08:44:31.226669+0000","last_undegraded":"2024-09-19T08:44:31.226669+0000","last_fullsized":"2024-09-19T08:44:31.226669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:18.011019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226224+0000","last_change":"2024-09-19T08:42:44.035523+0000","last_active":"2024-09-19T08:44:31.226224+0000","last_peered":"2024-09-19T08:44:31.226224+0000","last_clean":"2024-09-19T08:44:31.226224+0000","last_became_active":"2024-09-19T08:42:44.035185+0000","last_became_peered":"2024-09-19T08:42:44.035185+0000","last_unstale":"2024-09-19T08:44:31.226224+0000","last_undegraded":"2024-09-19T08:44:31.226224+0000","last_fullsized":"2024-09-19T08:44:31.226224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:03.475458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222791+0000","last_change":"2024-09-19T08:42:44.031803+0000","last_active":"2024-09-19T08:44:31.222791+0000","last_peered":"2024-09-19T08:44:31.222791+0000","last_clean":"2024-09-19T08:44:31.222791+0000","last_became_active":"2024-09-19T08:42:44.031501+0000","last_became_peered":"2024-09-19T08:42:44.031501+0000","last_unstale":"2024-09-19T08:44:31.222791+0000","last_undegraded":"2024-09-19T08:44:31.222791+0000","last_fullsized":"2024-09-19T08:44:31.222791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:31.780744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.211603+0000","last_change":"2024-09-19T08:42:44.036168+0000","last_active":"2024-09-19T08:44:31.211603+0000","last_peered":"2024-09-19T08:44:31.211603+0000","last_clean":"2024-09-19T08:44:31.211603+0000","last_became_active":"2024-09-19T08:42:44.035819+0000","last_became_peered":"2024-09-19T08:42:44.035819+0000","last_unstale":"2024-09-19T08:44:31.211603+0000","last_undegraded":"2024-09-19T08:44:31.211603+0000","last_fullsized":"2024-09-19T08:44:31.211603+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:26.478389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.220605+0000","last_change":"2024-09-19T08:42:44.037569+0000","last_active":"2024-09-19T08:44:31.220605+0000","last_peered":"2024-09-19T08:44:31.220605+0000","last_clean":"2024-09-19T08:44:31.220605+0000","last_became_active":"2024-09-19T08:42:44.037161+0000","last_became_peered":"2024-09-19T08:42:44.037161+0000","last_unstale":"2024-09-19T08:44:31.220605+0000","last_undegraded":"2024-09-19T08:44:31.220605+0000","last_fullsized":"2024-09-19T08:44:31.220605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:35.316314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226011+0000","last_change":"2024-09-19T08:42:44.023160+0000","last_active":"2024-09-19T08:44:31.226011+0000","last_peered":"2024-09-19T08:44:31.226011+0000","last_clean":"2024-09-19T08:44:31.226011+0000","last_became_active":"2024-09-19T08:42:44.022791+0000","last_became_peered":"2024-09-19T08:42:44.022791+0000","last_unstale":"2024-09-19T08:44:31.226011+0000","last_undegraded":"2024-09-19T08:44:31.226011+0000","last_fullsized":"2024-09-19T08:44:31.226011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:00.174583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225075+0000","last_change":"2024-09-19T08:42:44.035877+0000","last_active":"2024-09-19T08:44:31.225075+0000","last_peered":"2024-09-19T08:44:31.225075+0000","last_clean":"2024-09-19T08:44:31.225075+0000","last_became_active":"2024-09-19T08:42:44.035307+0000","last_became_peered":"2024-09-19T08:42:44.035307+0000","last_unstale":"2024-09-19T08:44:31.225075+0000","last_undegraded":"2024-09-19T08:44:31.225075+0000","last_fullsized":"2024-09-19T08:44:31.225075+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:54.717130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219964+0000","last_change":"2024-09-19T08:42:44.033536+0000","last_active":"2024-09-19T08:44:31.219964+0000","last_peered":"2024-09-19T08:44:31.219964+0000","last_clean":"2024-09-19T08:44:31.219964+0000","last_became_active":"2024-09-19T08:42:44.033179+0000","last_became_peered":"2024-09-19T08:42:44.033179+0000","last_unstale":"2024-09-19T08:44:31.219964+0000","last_undegraded":"2024-09-19T08:44:31.219964+0000","last_fullsized":"2024-09-19T08:44:31.219964+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:11.161785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.210217+0000","last_change":"2024-09-19T08:42:44.029674+0000","last_active":"2024-09-19T08:44:31.210217+0000","last_peered":"2024-09-19T08:44:31.210217+0000","last_clean":"2024-09-19T08:44:31.210217+0000","last_became_active":"2024-09-19T08:42:44.029368+0000","last_became_peered":"2024-09-19T08:42:44.029368+0000","last_unstale":"2024-09-19T08:44:31.210217+0000","last_undegraded":"2024-09-19T08:44:31.210217+0000","last_fullsized":"2024-09-19T08:44:31.210217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:34.943363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.213448+0000","last_change":"2024-09-19T08:42:44.039780+0000","last_active":"2024-09-19T08:44:31.213448+0000","last_peered":"2024-09-19T08:44:31.213448+0000","last_clean":"2024-09-19T08:44:31.213448+0000","last_became_active":"2024-09-19T08:42:44.039409+0000","last_became_peered":"2024-09-19T08:42:44.039409+0000","last_unstale":"2024-09-19T08:44:31.213448+0000","last_undegraded":"2024-09-19T08:44:31.213448+0000","last_fullsized":"2024-09-19T08:44:31.213448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:59.632132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.214979+0000","last_change":"2024-09-19T08:42:44.030881+0000","last_active":"2024-09-19T08:44:31.214979+0000","last_peered":"2024-09-19T08:44:31.214979+0000","last_clean":"2024-09-19T08:44:31.214979+0000","last_became_active":"2024-09-19T08:42:44.030530+0000","last_became_peered":"2024-09-19T08:42:44.030530+0000","last_unstale":"2024-09-19T08:44:31.214979+0000","last_undegraded":"2024-09-19T08:44:31.214979+0000","last_fullsized":"2024-09-19T08:44:31.214979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:16.908450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.214928+0000","last_change":"2024-09-19T08:42:44.033056+0000","last_active":"2024-09-19T08:44:31.214928+0000","last_peered":"2024-09-19T08:44:31.214928+0000","last_clean":"2024-09-19T08:44:31.214928+0000","last_became_active":"2024-09-19T08:42:44.032690+0000","last_became_peered":"2024-09-19T08:42:44.032690+0000","last_unstale":"2024-09-19T08:44:31.214928+0000","last_undegraded":"2024-09-19T08:44:31.214928+0000","last_fullsized":"2024-09-19T08:44:31.214928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:36.497824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225043+0000","last_change":"2024-09-19T08:42:58.106551+0000","last_active":"2024-09-19T08:44:31.225043+0000","last_peered":"2024-09-19T08:44:31.225043+0000","last_clean":"2024-09-19T08:44:31.225043+0000","last_became_active":"2024-09-19T08:42:58.106119+0000","last_became_peered":"2024-09-19T08:42:58.106119+0000","last_unstale":"2024-09-19T08:44:31.225043+0000","last_undegraded":"2024-09-19T08:44:31.225043+0000","last_fullsized":"2024-09-19T08:44:31.225043+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:46.794260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226527+0000","last_change":"2024-09-19T08:42:58.108106+0000","last_active":"2024-09-19T08:44:31.226527+0000","last_peered":"2024-09-19T08:44:31.226527+0000","last_clean":"2024-09-19T08:44:31.226527+0000","last_became_active":"2024-09-19T08:42:58.107532+0000","last_became_peered":"2024-09-19T08:42:58.107532+0000","last_unstale":"2024-09-19T08:44:31.226527+0000","last_undegraded":"2024-09-19T08:44:31.226527+0000","last_fullsized":"2024-09-19T08:44:31.226527+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:29.164983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224871+0000","last_change":"2024-09-19T08:42:44.029822+0000","last_active":"2024-09-19T08:44:31.224871+0000","last_peered":"2024-09-19T08:44:31.224871+0000","last_clean":"2024-09-19T08:44:31.224871+0000","last_became_active":"2024-09-19T08:42:44.029450+0000","last_became_peered":"2024-09-19T08:42:44.029450+0000","last_unstale":"2024-09-19T08:44:31.224871+0000","last_undegraded":"2024-09-19T08:44:31.224871+0000","last_fullsized":"2024-09-19T08:44:31.224871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:40.826261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.210860+0000","last_change":"2024-09-19T08:42:44.041354+0000","last_active":"2024-09-19T08:44:31.210860+0000","last_peered":"2024-09-19T08:44:31.210860+0000","last_clean":"2024-09-19T08:44:31.210860+0000","last_became_active":"2024-09-19T08:42:44.040912+0000","last_became_peered":"2024-09-19T08:42:44.040912+0000","last_unstale":"2024-09-19T08:44:31.210860+0000","last_undegraded":"2024-09-19T08:44:31.210860+0000","last_fullsized":"2024-09-19T08:44:31.210860+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:16.543950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.217246+0000","last_change":"2024-09-19T08:42:44.027912+0000","last_active":"2024-09-19T08:44:31.217246+0000","last_peered":"2024-09-19T08:44:31.217246+0000","last_clean":"2024-09-19T08:44:31.217246+0000","last_became_active":"2024-09-19T08:42:44.027505+0000","last_became_peered":"2024-09-19T08:42:44.027505+0000","last_unstale":"2024-09-19T08:44:31.217246+0000","last_undegraded":"2024-09-19T08:44:31.217246+0000","last_fullsized":"2024-09-19T08:44:31.217246+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:02.552756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208688+0000","last_change":"2024-09-19T08:42:44.034472+0000","last_active":"2024-09-19T08:44:31.208688+0000","last_peered":"2024-09-19T08:44:31.208688+0000","last_clean":"2024-09-19T08:44:31.208688+0000","last_became_active":"2024-09-19T08:42:44.034026+0000","last_became_peered":"2024-09-19T08:42:44.034026+0000","last_unstale":"2024-09-19T08:44:31.208688+0000","last_undegraded":"2024-09-19T08:44:31.208688+0000","last_fullsized":"2024-09-19T08:44:31.208688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:10.058882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'10","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:40.252860+0000","last_change":"2024-09-19T08:42:41.927174+0000","last_active":"2024-09-19T08:44:40.252860+0000","last_peered":"2024-09-19T08:44:40.252860+0000","last_clean":"2024-09-19T08:44:40.252860+0000","last_became_active":"2024-09-19T08:42:41.926826+0000","last_became_peered":"2024-09-19T08:42:41.926826+0000","last_unstale":"2024-09-19T08:44:40.252860+0000","last_undegraded":"2024-09-19T08:44:40.252860+0000","last_fullsized":"2024-09-19T08:44:40.252860+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:37.274891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2250,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.210827+0000","last_change":"2024-09-19T08:42:58.110259+0000","last_active":"2024-09-19T08:44:31.210827+0000","last_peered":"2024-09-19T08:44:31.210827+0000","last_clean":"2024-09-19T08:44:31.210827+0000","last_became_active":"2024-09-19T08:42:58.109803+0000","last_became_peered":"2024-09-19T08:42:58.109803+0000","last_unstale":"2024-09-19T08:44:31.210827+0000","last_undegraded":"2024-09-19T08:44:31.210827+0000","last_fullsized":"2024-09-19T08:44:31.210827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:31.853404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177196+0000","last_change":"2024-09-19T08:42:58.114222+0000","last_active":"2024-09-19T08:44:31.177196+0000","last_peered":"2024-09-19T08:44:31.177196+0000","last_clean":"2024-09-19T08:44:31.177196+0000","last_became_active":"2024-09-19T08:42:58.110769+0000","last_became_peered":"2024-09-19T08:42:58.110769+0000","last_unstale":"2024-09-19T08:44:31.177196+0000","last_undegraded":"2024-09-19T08:44:31.177196+0000","last_fullsized":"2024-09-19T08:44:31.177196+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:17.952228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.176271+0000","last_change":"2024-09-19T08:42:41.923903+0000","last_active":"2024-09-19T08:44:31.176271+0000","last_peered":"2024-09-19T08:44:31.176271+0000","last_clean":"2024-09-19T08:44:31.176271+0000","last_became_active":"2024-09-19T08:42:41.923583+0000","last_became_peered":"2024-09-19T08:42:41.923583+0000","last_unstale":"2024-09-19T08:44:31.176271+0000","last_undegraded":"2024-09-19T08:44:31.176271+0000","last_fullsized":"2024-09-19T08:44:31.176271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:48.594343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219641+0000","last_change":"2024-09-19T08:42:44.028972+0000","last_active":"2024-09-19T08:44:31.219641+0000","last_peered":"2024-09-19T08:44:31.219641+0000","last_clean":"2024-09-19T08:44:31.219641+0000","last_became_active":"2024-09-19T08:42:44.028657+0000","last_became_peered":"2024-09-19T08:42:44.028657+0000","last_unstale":"2024-09-19T08:44:31.219641+0000","last_undegraded":"2024-09-19T08:44:31.219641+0000","last_fullsized":"2024-09-19T08:44:31.219641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:43.618010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178701+0000","last_change":"2024-09-19T08:42:41.926558+0000","last_active":"2024-09-19T08:44:31.178701+0000","last_peered":"2024-09-19T08:44:31.178701+0000","last_clean":"2024-09-19T08:44:31.178701+0000","last_became_active":"2024-09-19T08:42:41.926074+0000","last_became_peered":"2024-09-19T08:42:41.926074+0000","last_unstale":"2024-09-19T08:44:31.178701+0000","last_undegraded":"2024-09-19T08:44:31.178701+0000","last_fullsized":"2024-09-19T08:44:31.178701+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:47.563295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.223532+0000","last_change":"2024-09-19T08:42:44.029191+0000","last_active":"2024-09-19T08:44:31.223532+0000","last_peered":"2024-09-19T08:44:31.223532+0000","last_clean":"2024-09-19T08:44:31.223532+0000","last_became_active":"2024-09-19T08:42:44.028871+0000","last_became_peered":"2024-09-19T08:42:44.028871+0000","last_unstale":"2024-09-19T08:44:31.223532+0000","last_undegraded":"2024-09-19T08:44:31.223532+0000","last_fullsized":"2024-09-19T08:44:31.223532+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:41.262014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":136,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:40.252212+0000","last_change":"2024-09-19T08:42:41.930265+0000","last_active":"2024-09-19T08:44:40.252212+0000","last_peered":"2024-09-19T08:44:40.252212+0000","last_clean":"2024-09-19T08:44:40.252212+0000","last_became_active":"2024-09-19T08:42:41.929829+0000","last_became_peered":"2024-09-19T08:42:41.929829+0000","last_unstale":"2024-09-19T08:44:40.252212+0000","last_undegraded":"2024-09-19T08:44:40.252212+0000","last_fullsized":"2024-09-19T08:44:40.252212+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:59.181622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224033+0000","last_change":"2024-09-19T08:42:44.027382+0000","last_active":"2024-09-19T08:44:31.224033+0000","last_peered":"2024-09-19T08:44:31.224033+0000","last_clean":"2024-09-19T08:44:31.224033+0000","last_became_active":"2024-09-19T08:42:44.026824+0000","last_became_peered":"2024-09-19T08:42:44.026824+0000","last_unstale":"2024-09-19T08:44:31.224033+0000","last_undegraded":"2024-09-19T08:44:31.224033+0000","last_fullsized":"2024-09-19T08:44:31.224033+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:58.520068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.180283+0000","last_change":"2024-09-19T08:42:41.927914+0000","last_active":"2024-09-19T08:44:31.180283+0000","last_peered":"2024-09-19T08:44:31.180283+0000","last_clean":"2024-09-19T08:44:31.180283+0000","last_became_active":"2024-09-19T08:42:41.926566+0000","last_became_peered":"2024-09-19T08:42:41.926566+0000","last_unstale":"2024-09-19T08:44:31.180283+0000","last_undegraded":"2024-09-19T08:44:31.180283+0000","last_fullsized":"2024-09-19T08:44:31.180283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:52.238352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224677+0000","last_change":"2024-09-19T08:42:44.039899+0000","last_active":"2024-09-19T08:44:31.224677+0000","last_peered":"2024-09-19T08:44:31.224677+0000","last_clean":"2024-09-19T08:44:31.224677+0000","last_became_active":"2024-09-19T08:42:44.039530+0000","last_became_peered":"2024-09-19T08:42:44.039530+0000","last_unstale":"2024-09-19T08:44:31.224677+0000","last_undegraded":"2024-09-19T08:44:31.224677+0000","last_fullsized":"2024-09-19T08:44:31.224677+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:20.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178662+0000","last_change":"2024-09-19T08:42:42.410128+0000","last_active":"2024-09-19T08:44:31.178662+0000","last_peered":"2024-09-19T08:44:31.178662+0000","last_clean":"2024-09-19T08:44:31.178662+0000","last_became_active":"2024-09-19T08:42:42.409717+0000","last_became_peered":"2024-09-19T08:42:42.409717+0000","last_unstale":"2024-09-19T08:44:31.178662+0000","last_undegraded":"2024-09-19T08:44:31.178662+0000","last_fullsized":"2024-09-19T08:44:31.178662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:41.682355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225965+0000","last_change":"2024-09-19T08:42:44.043248+0000","last_active":"2024-09-19T08:44:31.225965+0000","last_peered":"2024-09-19T08:44:31.225965+0000","last_clean":"2024-09-19T08:44:31.225965+0000","last_became_active":"2024-09-19T08:42:44.042849+0000","last_became_peered":"2024-09-19T08:42:44.042849+0000","last_unstale":"2024-09-19T08:44:31.225965+0000","last_undegraded":"2024-09-19T08:44:31.225965+0000","last_fullsized":"2024-09-19T08:44:31.225965+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:00.413217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'34","reported_seq":287,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:41.253653+0000","last_change":"2024-09-19T08:42:41.926582+0000","last_active":"2024-09-19T08:44:41.253653+0000","last_peered":"2024-09-19T08:44:41.253653+0000","last_clean":"2024-09-19T08:44:41.253653+0000","last_became_active":"2024-09-19T08:42:41.926234+0000","last_became_peered":"2024-09-19T08:42:41.926234+0000","last_unstale":"2024-09-19T08:44:41.253653+0000","last_undegraded":"2024-09-19T08:44:41.253653+0000","last_fullsized":"2024-09-19T08:44:41.253653+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:02.498976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":229,"num_read_kb":179,"num_write":35,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.199159+0000","last_change":"2024-09-19T08:42:44.034888+0000","last_active":"2024-09-19T08:44:31.199159+0000","last_peered":"2024-09-19T08:44:31.199159+0000","last_clean":"2024-09-19T08:44:31.199159+0000","last_became_active":"2024-09-19T08:42:44.034553+0000","last_became_peered":"2024-09-19T08:42:44.034553+0000","last_unstale":"2024-09-19T08:44:31.199159+0000","last_undegraded":"2024-09-19T08:44:31.199159+0000","last_fullsized":"2024-09-19T08:44:31.199159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:06.416289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.181995+0000","last_change":"2024-09-19T08:42:58.117912+0000","last_active":"2024-09-19T08:44:31.181995+0000","last_peered":"2024-09-19T08:44:31.181995+0000","last_clean":"2024-09-19T08:44:31.181995+0000","last_became_active":"2024-09-19T08:42:58.105810+0000","last_became_peered":"2024-09-19T08:42:58.105810+0000","last_unstale":"2024-09-19T08:44:31.181995+0000","last_undegraded":"2024-09-19T08:44:31.181995+0000","last_fullsized":"2024-09-19T08:44:31.181995+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:44.258256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.213617+0000","last_change":"2024-09-19T08:42:44.030519+0000","last_active":"2024-09-19T08:44:31.213617+0000","last_peered":"2024-09-19T08:44:31.213617+0000","last_clean":"2024-09-19T08:44:31.213617+0000","last_became_active":"2024-09-19T08:42:44.030190+0000","last_became_peered":"2024-09-19T08:42:44.030190+0000","last_unstale":"2024-09-19T08:44:31.213617+0000","last_undegraded":"2024-09-19T08:44:31.213617+0000","last_fullsized":"2024-09-19T08:44:31.213617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:20.220642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178349+0000","last_change":"2024-09-19T08:42:41.928124+0000","last_active":"2024-09-19T08:44:31.178349+0000","last_peered":"2024-09-19T08:44:31.178349+0000","last_clean":"2024-09-19T08:44:31.178349+0000","last_became_active":"2024-09-19T08:42:41.927761+0000","last_became_peered":"2024-09-19T08:42:41.927761+0000","last_unstale":"2024-09-19T08:44:31.178349+0000","last_undegraded":"2024-09-19T08:44:31.178349+0000","last_fullsized":"2024-09-19T08:44:31.178349+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:08.591270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.218267+0000","last_change":"2024-09-19T08:42:44.038234+0000","last_active":"2024-09-19T08:44:31.218267+0000","last_peered":"2024-09-19T08:44:31.218267+0000","last_clean":"2024-09-19T08:44:31.218267+0000","last_became_active":"2024-09-19T08:42:44.037726+0000","last_became_peered":"2024-09-19T08:42:44.037726+0000","last_unstale":"2024-09-19T08:44:31.218267+0000","last_undegraded":"2024-09-19T08:44:31.218267+0000","last_fullsized":"2024-09-19T08:44:31.218267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:08.865482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:40.252204+0000","last_change":"2024-09-19T08:42:41.926206+0000","last_active":"2024-09-19T08:44:40.252204+0000","last_peered":"2024-09-19T08:44:40.252204+0000","last_clean":"2024-09-19T08:44:40.252204+0000","last_became_active":"2024-09-19T08:42:41.925833+0000","last_became_peered":"2024-09-19T08:42:41.925833+0000","last_unstale":"2024-09-19T08:44:40.252204+0000","last_undegraded":"2024-09-19T08:44:40.252204+0000","last_fullsized":"2024-09-19T08:44:40.252204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:27.944240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208340+0000","last_change":"2024-09-19T08:42:44.037181+0000","last_active":"2024-09-19T08:44:31.208340+0000","last_peered":"2024-09-19T08:44:31.208340+0000","last_clean":"2024-09-19T08:44:31.208340+0000","last_became_active":"2024-09-19T08:42:44.036865+0000","last_became_peered":"2024-09-19T08:42:44.036865+0000","last_unstale":"2024-09-19T08:44:31.208340+0000","last_undegraded":"2024-09-19T08:44:31.208340+0000","last_fullsized":"2024-09-19T08:44:31.208340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:20.233309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.169922+0000","last_change":"2024-09-19T08:42:42.408446+0000","last_active":"2024-09-19T08:44:31.169922+0000","last_peered":"2024-09-19T08:44:31.169922+0000","last_clean":"2024-09-19T08:44:31.169922+0000","last_became_active":"2024-09-19T08:42:42.408098+0000","last_became_peered":"2024-09-19T08:42:42.408098+0000","last_unstale":"2024-09-19T08:44:31.169922+0000","last_undegraded":"2024-09-19T08:44:31.169922+0000","last_fullsized":"2024-09-19T08:44:31.169922+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:22.603604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225407+0000","last_change":"2024-09-19T08:42:44.039954+0000","last_active":"2024-09-19T08:44:31.225407+0000","last_peered":"2024-09-19T08:44:31.225407+0000","last_clean":"2024-09-19T08:44:31.225407+0000","last_became_active":"2024-09-19T08:42:44.039601+0000","last_became_peered":"2024-09-19T08:42:44.039601+0000","last_unstale":"2024-09-19T08:44:31.225407+0000","last_undegraded":"2024-09-19T08:44:31.225407+0000","last_fullsized":"2024-09-19T08:44:31.225407+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:07.792167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'3","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170390+0000","last_change":"2024-09-19T08:42:41.929644+0000","last_active":"2024-09-19T08:44:31.170390+0000","last_peered":"2024-09-19T08:44:31.170390+0000","last_clean":"2024-09-19T08:44:31.170390+0000","last_became_active":"2024-09-19T08:42:41.929308+0000","last_became_peered":"2024-09-19T08:42:41.929308+0000","last_unstale":"2024-09-19T08:44:31.170390+0000","last_undegraded":"2024-09-19T08:44:31.170390+0000","last_fullsized":"2024-09-19T08:44:31.170390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:36.660470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222570+0000","last_change":"2024-09-19T08:42:58.107555+0000","last_active":"2024-09-19T08:44:31.222570+0000","last_peered":"2024-09-19T08:44:31.222570+0000","last_clean":"2024-09-19T08:44:31.222570+0000","last_became_active":"2024-09-19T08:42:58.107137+0000","last_became_peered":"2024-09-19T08:42:58.107137+0000","last_unstale":"2024-09-19T08:44:31.222570+0000","last_undegraded":"2024-09-19T08:44:31.222570+0000","last_fullsized":"2024-09-19T08:44:31.222570+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:13.198911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.176594+0000","last_change":"2024-09-19T08:42:41.925195+0000","last_active":"2024-09-19T08:44:31.176594+0000","last_peered":"2024-09-19T08:44:31.176594+0000","last_clean":"2024-09-19T08:44:31.176594+0000","last_became_active":"2024-09-19T08:42:41.924880+0000","last_became_peered":"2024-09-19T08:42:41.924880+0000","last_unstale":"2024-09-19T08:44:31.176594+0000","last_undegraded":"2024-09-19T08:44:31.176594+0000","last_fullsized":"2024-09-19T08:44:31.176594+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:11.256881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219778+0000","last_change":"2024-09-19T08:42:44.036439+0000","last_active":"2024-09-19T08:44:31.219778+0000","last_peered":"2024-09-19T08:44:31.219778+0000","last_clean":"2024-09-19T08:44:31.219778+0000","last_became_active":"2024-09-19T08:42:44.036036+0000","last_became_peered":"2024-09-19T08:42:44.036036+0000","last_unstale":"2024-09-19T08:44:31.219778+0000","last_undegraded":"2024-09-19T08:44:31.219778+0000","last_fullsized":"2024-09-19T08:44:31.219778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:37.410782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'57","reported_seq":99,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:41.884313+0000","last_change":"2024-09-19T08:42:41.927490+0000","last_active":"2024-09-19T08:44:41.884313+0000","last_peered":"2024-09-19T08:44:41.884313+0000","last_clean":"2024-09-19T08:44:41.884313+0000","last_became_active":"2024-09-19T08:42:41.927163+0000","last_became_peered":"2024-09-19T08:42:41.927163+0000","last_unstale":"2024-09-19T08:44:41.884313+0000","last_undegraded":"2024-09-19T08:44:41.884313+0000","last_fullsized":"2024-09-19T08:44:41.884313+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:20.013661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":68,"num_write_kb":807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208966+0000","last_change":"2024-09-19T08:42:44.036960+0000","last_active":"2024-09-19T08:44:31.208966+0000","last_peered":"2024-09-19T08:44:31.208966+0000","last_clean":"2024-09-19T08:44:31.208966+0000","last_became_active":"2024-09-19T08:42:44.036600+0000","last_became_peered":"2024-09-19T08:42:44.036600+0000","last_unstale":"2024-09-19T08:44:31.208966+0000","last_undegraded":"2024-09-19T08:44:31.208966+0000","last_fullsized":"2024-09-19T08:44:31.208966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:15.621888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177396+0000","last_change":"2024-09-19T08:42:58.114698+0000","last_active":"2024-09-19T08:44:31.177396+0000","last_peered":"2024-09-19T08:44:31.177396+0000","last_clean":"2024-09-19T08:44:31.177396+0000","last_became_active":"2024-09-19T08:42:58.105488+0000","last_became_peered":"2024-09-19T08:42:58.105488+0000","last_unstale":"2024-09-19T08:44:31.177396+0000","last_undegraded":"2024-09-19T08:44:31.177396+0000","last_fullsized":"2024-09-19T08:44:31.177396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:12.642715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225878+0000","last_change":"2024-09-19T08:42:44.035569+0000","last_active":"2024-09-19T08:44:31.225878+0000","last_peered":"2024-09-19T08:44:31.225878+0000","last_clean":"2024-09-19T08:44:31.225878+0000","last_became_active":"2024-09-19T08:42:44.035277+0000","last_became_peered":"2024-09-19T08:42:44.035277+0000","last_unstale":"2024-09-19T08:44:31.225878+0000","last_undegraded":"2024-09-19T08:44:31.225878+0000","last_fullsized":"2024-09-19T08:44:31.225878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:57.472721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"83'148","reported_seq":392,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:33.303710+0000","last_change":"2024-09-19T08:41:34.769047+0000","last_active":"2024-09-19T08:44:33.303710+0000","last_peered":"2024-09-19T08:44:33.303710+0000","last_clean":"2024-09-19T08:44:33.303710+0000","last_became_active":"2024-09-19T08:41:34.768619+0000","last_became_peered":"2024-09-19T08:41:34.768619+0000","last_unstale":"2024-09-19T08:44:33.303710+0000","last_undegraded":"2024-09-19T08:44:33.303710+0000","last_fullsized":"2024-09-19T08:44:33.303710+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:13.482855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:13.482855+0000","last_clean_scrub_stamp":"2024-09-19T08:38:13.482855+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.390775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177359+0000","last_change":"2024-09-19T08:42:41.925698+0000","last_active":"2024-09-19T08:44:31.177359+0000","last_peered":"2024-09-19T08:44:31.177359+0000","last_clean":"2024-09-19T08:44:31.177359+0000","last_became_active":"2024-09-19T08:42:41.924618+0000","last_became_peered":"2024-09-19T08:42:41.924618+0000","last_unstale":"2024-09-19T08:44:31.177359+0000","last_undegraded":"2024-09-19T08:44:31.177359+0000","last_fullsized":"2024-09-19T08:44:31.177359+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:53.717139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222668+0000","last_change":"2024-09-19T08:42:58.111206+0000","last_active":"2024-09-19T08:44:31.222668+0000","last_peered":"2024-09-19T08:44:31.222668+0000","last_clean":"2024-09-19T08:44:31.222668+0000","last_became_active":"2024-09-19T08:42:58.110765+0000","last_became_peered":"2024-09-19T08:42:58.110765+0000","last_unstale":"2024-09-19T08:44:31.222668+0000","last_undegraded":"2024-09-19T08:44:31.222668+0000","last_fullsized":"2024-09-19T08:44:31.222668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:44.783938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.180014+0000","last_change":"2024-09-19T08:42:41.928414+0000","last_active":"2024-09-19T08:44:31.180014+0000","last_peered":"2024-09-19T08:44:31.180014+0000","last_clean":"2024-09-19T08:44:31.180014+0000","last_became_active":"2024-09-19T08:42:41.928055+0000","last_became_peered":"2024-09-19T08:42:41.928055+0000","last_unstale":"2024-09-19T08:44:31.180014+0000","last_undegraded":"2024-09-19T08:44:31.180014+0000","last_fullsized":"2024-09-19T08:44:31.180014+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:12.688379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.197630+0000","last_change":"2024-09-19T08:42:44.035439+0000","last_active":"2024-09-19T08:44:31.197630+0000","last_peered":"2024-09-19T08:44:31.197630+0000","last_clean":"2024-09-19T08:44:31.197630+0000","last_became_active":"2024-09-19T08:42:44.035150+0000","last_became_peered":"2024-09-19T08:42:44.035150+0000","last_unstale":"2024-09-19T08:44:31.197630+0000","last_undegraded":"2024-09-19T08:44:31.197630+0000","last_fullsized":"2024-09-19T08:44:31.197630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:15.230660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:40.251364+0000","last_change":"2024-09-19T08:42:42.407784+0000","last_active":"2024-09-19T08:44:40.251364+0000","last_peered":"2024-09-19T08:44:40.251364+0000","last_clean":"2024-09-19T08:44:40.251364+0000","last_became_active":"2024-09-19T08:42:42.407437+0000","last_became_peered":"2024-09-19T08:42:42.407437+0000","last_unstale":"2024-09-19T08:44:40.251364+0000","last_undegraded":"2024-09-19T08:44:40.251364+0000","last_fullsized":"2024-09-19T08:44:40.251364+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:44.829338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212600+0000","last_change":"2024-09-19T08:42:44.039780+0000","last_active":"2024-09-19T08:44:31.212600+0000","last_peered":"2024-09-19T08:44:31.212600+0000","last_clean":"2024-09-19T08:44:31.212600+0000","last_became_active":"2024-09-19T08:42:44.039441+0000","last_became_peered":"2024-09-19T08:42:44.039441+0000","last_unstale":"2024-09-19T08:44:31.212600+0000","last_undegraded":"2024-09-19T08:44:31.212600+0000","last_fullsized":"2024-09-19T08:44:31.212600+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:31.013663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.180830+0000","last_change":"2024-09-19T08:42:41.926998+0000","last_active":"2024-09-19T08:44:31.180830+0000","last_peered":"2024-09-19T08:44:31.180830+0000","last_clean":"2024-09-19T08:44:31.180830+0000","last_became_active":"2024-09-19T08:42:41.926560+0000","last_became_peered":"2024-09-19T08:42:41.926560+0000","last_unstale":"2024-09-19T08:44:31.180830+0000","last_undegraded":"2024-09-19T08:44:31.180830+0000","last_fullsized":"2024-09-19T08:44:31.180830+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:35.338601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225659+0000","last_change":"2024-09-19T08:42:44.039948+0000","last_active":"2024-09-19T08:44:31.225659+0000","last_peered":"2024-09-19T08:44:31.225659+0000","last_clean":"2024-09-19T08:44:31.225659+0000","last_became_active":"2024-09-19T08:42:44.038797+0000","last_became_peered":"2024-09-19T08:42:44.038797+0000","last_unstale":"2024-09-19T08:44:31.225659+0000","last_undegraded":"2024-09-19T08:44:31.225659+0000","last_fullsized":"2024-09-19T08:44:31.225659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:19.273191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.168583+0000","last_change":"2024-09-19T08:42:42.409954+0000","last_active":"2024-09-19T08:44:31.168583+0000","last_peered":"2024-09-19T08:44:31.168583+0000","last_clean":"2024-09-19T08:44:31.168583+0000","last_became_active":"2024-09-19T08:42:42.409388+0000","last_became_peered":"2024-09-19T08:42:42.409388+0000","last_unstale":"2024-09-19T08:44:31.168583+0000","last_undegraded":"2024-09-19T08:44:31.168583+0000","last_fullsized":"2024-09-19T08:44:31.168583+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:58.764877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.213210+0000","last_change":"2024-09-19T08:42:44.024360+0000","last_active":"2024-09-19T08:44:31.213210+0000","last_peered":"2024-09-19T08:44:31.213210+0000","last_clean":"2024-09-19T08:44:31.213210+0000","last_became_active":"2024-09-19T08:42:44.023703+0000","last_became_peered":"2024-09-19T08:42:44.023703+0000","last_unstale":"2024-09-19T08:44:31.213210+0000","last_undegraded":"2024-09-19T08:44:31.213210+0000","last_fullsized":"2024-09-19T08:44:31.213210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:10.852199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170383+0000","last_change":"2024-09-19T08:42:42.408101+0000","last_active":"2024-09-19T08:44:31.170383+0000","last_peered":"2024-09-19T08:44:31.170383+0000","last_clean":"2024-09-19T08:44:31.170383+0000","last_became_active":"2024-09-19T08:42:42.407692+0000","last_became_peered":"2024-09-19T08:42:42.407692+0000","last_unstale":"2024-09-19T08:44:31.170383+0000","last_undegraded":"2024-09-19T08:44:31.170383+0000","last_fullsized":"2024-09-19T08:44:31.170383+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:01.342213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.217468+0000","last_change":"2024-09-19T08:42:44.026612+0000","last_active":"2024-09-19T08:44:31.217468+0000","last_peered":"2024-09-19T08:44:31.217468+0000","last_clean":"2024-09-19T08:44:31.217468+0000","last_became_active":"2024-09-19T08:42:44.025408+0000","last_became_peered":"2024-09-19T08:42:44.025408+0000","last_unstale":"2024-09-19T08:44:31.217468+0000","last_undegraded":"2024-09-19T08:44:31.217468+0000","last_fullsized":"2024-09-19T08:44:31.217468+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:19.465342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'71","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:41.889318+0000","last_change":"2024-09-19T08:42:41.927561+0000","last_active":"2024-09-19T08:44:41.889318+0000","last_peered":"2024-09-19T08:44:41.889318+0000","last_clean":"2024-09-19T08:44:41.889318+0000","last_became_active":"2024-09-19T08:42:41.927159+0000","last_became_peered":"2024-09-19T08:42:41.927159+0000","last_unstale":"2024-09-19T08:44:41.889318+0000","last_undegraded":"2024-09-19T08:44:41.889318+0000","last_fullsized":"2024-09-19T08:44:41.889318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:13.352727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":160,"num_write":128,"num_write_kb":1157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.220812+0000","last_change":"2024-09-19T08:42:44.028129+0000","last_active":"2024-09-19T08:44:31.220812+0000","last_peered":"2024-09-19T08:44:31.220812+0000","last_clean":"2024-09-19T08:44:31.220812+0000","last_became_active":"2024-09-19T08:42:44.027826+0000","last_became_peered":"2024-09-19T08:42:44.027826+0000","last_unstale":"2024-09-19T08:44:31.220812+0000","last_undegraded":"2024-09-19T08:44:31.220812+0000","last_fullsized":"2024-09-19T08:44:31.220812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:03.129404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177705+0000","last_change":"2024-09-19T08:42:41.920264+0000","last_active":"2024-09-19T08:44:31.177705+0000","last_peered":"2024-09-19T08:44:31.177705+0000","last_clean":"2024-09-19T08:44:31.177705+0000","last_became_active":"2024-09-19T08:42:41.919655+0000","last_became_peered":"2024-09-19T08:42:41.919655+0000","last_unstale":"2024-09-19T08:44:31.177705+0000","last_undegraded":"2024-09-19T08:44:31.177705+0000","last_fullsized":"2024-09-19T08:44:31.177705+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:58.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226014+0000","last_change":"2024-09-19T08:42:44.039655+0000","last_active":"2024-09-19T08:44:31.226014+0000","last_peered":"2024-09-19T08:44:31.226014+0000","last_clean":"2024-09-19T08:44:31.226014+0000","last_became_active":"2024-09-19T08:42:44.039317+0000","last_became_peered":"2024-09-19T08:42:44.039317+0000","last_unstale":"2024-09-19T08:44:31.226014+0000","last_undegraded":"2024-09-19T08:44:31.226014+0000","last_fullsized":"2024-09-19T08:44:31.226014+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:19.064194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.169944+0000","last_change":"2024-09-19T08:42:42.408582+0000","last_active":"2024-09-19T08:44:31.169944+0000","last_peered":"2024-09-19T08:44:31.169944+0000","last_clean":"2024-09-19T08:44:31.169944+0000","last_became_active":"2024-09-19T08:42:42.408143+0000","last_became_peered":"2024-09-19T08:42:42.408143+0000","last_unstale":"2024-09-19T08:44:31.169944+0000","last_undegraded":"2024-09-19T08:44:31.169944+0000","last_fullsized":"2024-09-19T08:44:31.169944+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.526138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.195758+0000","last_change":"2024-09-19T08:42:44.034795+0000","last_active":"2024-09-19T08:44:31.195758+0000","last_peered":"2024-09-19T08:44:31.195758+0000","last_clean":"2024-09-19T08:44:31.195758+0000","last_became_active":"2024-09-19T08:42:44.034440+0000","last_became_peered":"2024-09-19T08:42:44.034440+0000","last_unstale":"2024-09-19T08:44:31.195758+0000","last_undegraded":"2024-09-19T08:44:31.195758+0000","last_fullsized":"2024-09-19T08:44:31.195758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:50.470240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.179034+0000","last_change":"2024-09-19T08:42:41.922621+0000","last_active":"2024-09-19T08:44:31.179034+0000","last_peered":"2024-09-19T08:44:31.179034+0000","last_clean":"2024-09-19T08:44:31.179034+0000","last_became_active":"2024-09-19T08:42:41.922303+0000","last_became_peered":"2024-09-19T08:42:41.922303+0000","last_unstale":"2024-09-19T08:44:31.179034+0000","last_undegraded":"2024-09-19T08:44:31.179034+0000","last_fullsized":"2024-09-19T08:44:31.179034+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:48.017892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225447+0000","last_change":"2024-09-19T08:42:44.028307+0000","last_active":"2024-09-19T08:44:31.225447+0000","last_peered":"2024-09-19T08:44:31.225447+0000","last_clean":"2024-09-19T08:44:31.225447+0000","last_became_active":"2024-09-19T08:42:44.026848+0000","last_became_peered":"2024-09-19T08:42:44.026848+0000","last_unstale":"2024-09-19T08:44:31.225447+0000","last_undegraded":"2024-09-19T08:44:31.225447+0000","last_fullsized":"2024-09-19T08:44:31.225447+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:20.768075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.180483+0000","last_change":"2024-09-19T08:42:41.929479+0000","last_active":"2024-09-19T08:44:31.180483+0000","last_peered":"2024-09-19T08:44:31.180483+0000","last_clean":"2024-09-19T08:44:31.180483+0000","last_became_active":"2024-09-19T08:42:41.928508+0000","last_became_peered":"2024-09-19T08:42:41.928508+0000","last_unstale":"2024-09-19T08:44:31.180483+0000","last_undegraded":"2024-09-19T08:44:31.180483+0000","last_fullsized":"2024-09-19T08:44:31.180483+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:46.108471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.205207+0000","last_change":"2024-09-19T08:42:44.028694+0000","last_active":"2024-09-19T08:44:31.205207+0000","last_peered":"2024-09-19T08:44:31.205207+0000","last_clean":"2024-09-19T08:44:31.205207+0000","last_became_active":"2024-09-19T08:42:44.027382+0000","last_became_peered":"2024-09-19T08:42:44.027382+0000","last_unstale":"2024-09-19T08:44:31.205207+0000","last_undegraded":"2024-09-19T08:44:31.205207+0000","last_fullsized":"2024-09-19T08:44:31.205207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:40.877505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170090+0000","last_change":"2024-09-19T08:42:41.931016+0000","last_active":"2024-09-19T08:44:31.170090+0000","last_peered":"2024-09-19T08:44:31.170090+0000","last_clean":"2024-09-19T08:44:31.170090+0000","last_became_active":"2024-09-19T08:42:41.930648+0000","last_became_peered":"2024-09-19T08:42:41.930648+0000","last_unstale":"2024-09-19T08:44:31.170090+0000","last_undegraded":"2024-09-19T08:44:31.170090+0000","last_fullsized":"2024-09-19T08:44:31.170090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:32.031025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226346+0000","last_change":"2024-09-19T08:42:44.035288+0000","last_active":"2024-09-19T08:44:31.226346+0000","last_peered":"2024-09-19T08:44:31.226346+0000","last_clean":"2024-09-19T08:44:31.226346+0000","last_became_active":"2024-09-19T08:42:44.034660+0000","last_became_peered":"2024-09-19T08:42:44.034660+0000","last_unstale":"2024-09-19T08:44:31.226346+0000","last_undegraded":"2024-09-19T08:44:31.226346+0000","last_fullsized":"2024-09-19T08:44:31.226346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:48.703463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225736+0000","last_change":"2024-09-19T08:42:44.040123+0000","last_active":"2024-09-19T08:44:31.225736+0000","last_peered":"2024-09-19T08:44:31.225736+0000","last_clean":"2024-09-19T08:44:31.225736+0000","last_became_active":"2024-09-19T08:42:44.039488+0000","last_became_peered":"2024-09-19T08:42:44.039488+0000","last_unstale":"2024-09-19T08:44:31.225736+0000","last_undegraded":"2024-09-19T08:44:31.225736+0000","last_fullsized":"2024-09-19T08:44:31.225736+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:15.273044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170228+0000","last_change":"2024-09-19T08:42:41.932400+0000","last_active":"2024-09-19T08:44:31.170228+0000","last_peered":"2024-09-19T08:44:31.170228+0000","last_clean":"2024-09-19T08:44:31.170228+0000","last_became_active":"2024-09-19T08:42:41.932020+0000","last_became_peered":"2024-09-19T08:42:41.932020+0000","last_unstale":"2024-09-19T08:44:31.170228+0000","last_undegraded":"2024-09-19T08:44:31.170228+0000","last_fullsized":"2024-09-19T08:44:31.170228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:08.583287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.221219+0000","last_change":"2024-09-19T08:42:44.026173+0000","last_active":"2024-09-19T08:44:31.221219+0000","last_peered":"2024-09-19T08:44:31.221219+0000","last_clean":"2024-09-19T08:44:31.221219+0000","last_became_active":"2024-09-19T08:42:44.024614+0000","last_became_peered":"2024-09-19T08:42:44.024614+0000","last_unstale":"2024-09-19T08:44:31.221219+0000","last_undegraded":"2024-09-19T08:44:31.221219+0000","last_fullsized":"2024-09-19T08:44:31.221219+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:42.695660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170318+0000","last_change":"2024-09-19T08:42:41.929576+0000","last_active":"2024-09-19T08:44:31.170318+0000","last_peered":"2024-09-19T08:44:31.170318+0000","last_clean":"2024-09-19T08:44:31.170318+0000","last_became_active":"2024-09-19T08:42:41.929231+0000","last_became_peered":"2024-09-19T08:42:41.929231+0000","last_unstale":"2024-09-19T08:44:31.170318+0000","last_undegraded":"2024-09-19T08:44:31.170318+0000","last_fullsized":"2024-09-19T08:44:31.170318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:54.492198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226525+0000","last_change":"2024-09-19T08:42:44.028612+0000","last_active":"2024-09-19T08:44:31.226525+0000","last_peered":"2024-09-19T08:44:31.226525+0000","last_clean":"2024-09-19T08:44:31.226525+0000","last_became_active":"2024-09-19T08:42:44.028301+0000","last_became_peered":"2024-09-19T08:42:44.028301+0000","last_unstale":"2024-09-19T08:44:31.226525+0000","last_undegraded":"2024-09-19T08:44:31.226525+0000","last_fullsized":"2024-09-19T08:44:31.226525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:03:09.539350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178947+0000","last_change":"2024-09-19T08:42:42.407931+0000","last_active":"2024-09-19T08:44:31.178947+0000","last_peered":"2024-09-19T08:44:31.178947+0000","last_clean":"2024-09-19T08:44:31.178947+0000","last_became_active":"2024-09-19T08:42:42.407573+0000","last_became_peered":"2024-09-19T08:42:42.407573+0000","last_unstale":"2024-09-19T08:44:31.178947+0000","last_undegraded":"2024-09-19T08:44:31.178947+0000","last_fullsized":"2024-09-19T08:44:31.178947+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:55.095275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.209474+0000","last_change":"2024-09-19T08:42:44.034109+0000","last_active":"2024-09-19T08:44:31.209474+0000","last_peered":"2024-09-19T08:44:31.209474+0000","last_clean":"2024-09-19T08:44:31.209474+0000","last_became_active":"2024-09-19T08:42:44.033753+0000","last_became_peered":"2024-09-19T08:42:44.033753+0000","last_unstale":"2024-09-19T08:44:31.209474+0000","last_undegraded":"2024-09-19T08:44:31.209474+0000","last_fullsized":"2024-09-19T08:44:31.209474+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:08.475476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.168710+0000","last_change":"2024-09-19T08:42:58.120292+0000","last_active":"2024-09-19T08:44:31.168710+0000","last_peered":"2024-09-19T08:44:31.168710+0000","last_clean":"2024-09-19T08:44:31.168710+0000","last_became_active":"2024-09-19T08:42:58.109929+0000","last_became_peered":"2024-09-19T08:42:58.109929+0000","last_unstale":"2024-09-19T08:44:31.168710+0000","last_undegraded":"2024-09-19T08:44:31.168710+0000","last_fullsized":"2024-09-19T08:44:31.168710+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:56.196868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":794093,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":886,"num_read_kb":597,"num_write":356,"num_write_kb":2090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1198,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2617344,"data_stored":2382279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579941,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":442307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32952,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712200,"statfs":{"total":95995035648,"available":95961292800,"internally_reserved":0,"allocated":1748992,"data_stored":1232179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939694,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36636,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708516,"statfs":{"total":95995035648,"available":95957520384,"internally_reserved":0,"allocated":1318912,"data_stored":835143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168627,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28312,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716840,"statfs":{"total":95995035648,"available":95966044160,"internally_reserved":0,"allocated":1318912,"data_stored":835063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397559,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1035359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561085,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":441316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790016,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28652,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716500,"statfs":{"total":95995035648,"available":95965696000,"internally_reserved":0,"allocated":1667072,"data_stored":1166298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953543,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":443262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215180,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40928,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704224,"statfs":{"total":95995035648,"available":95953125376,"internally_reserved":0,"allocated":1458176,"data_stored":966443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444112,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":999424,"data_stored":509951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":983040,"data_stored":507589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":933888,"data_stored":442587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":721732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":331336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":397217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:44:45.131 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:44:45.391 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:45.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:45 smithi175 ceph-mon[35688]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:45.513 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:45 smithi007 ceph-mon[31221]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:45.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:45 smithi044 ceph-mon[35072]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:45.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.871+0000 7f7cd4b24640 1 -- 172.21.15.7:0/2739172191 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cd0103660 msgr2=0x7f7cd010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:45.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.871+0000 7f7cd4b24640 1 --2- 172.21.15.7:0/2739172191 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cd0103660 0x7f7cd010bb50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8009900 tx=0x7f7cb802a480 comp rx=0 tx=0).stop 2024-09-19T08:44:45.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.871+0000 7f7cd4b24640 1 -- 172.21.15.7:0/2739172191 shutdown_connections 2024-09-19T08:44:45.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.871+0000 7f7cd4b24640 1 --2- 172.21.15.7:0/2739172191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cd010c170 0x7f7cd010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:45.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.871+0000 7f7cd4b24640 1 --2- 172.21.15.7:0/2739172191 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cd0103660 0x7f7cd010bb50 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:45.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.871+0000 7f7cd4b24640 1 --2- 172.21.15.7:0/2739172191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cd0102d40 0x7f7cd0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:45.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.871+0000 7f7cd4b24640 1 -- 172.21.15.7:0/2739172191 >> 172.21.15.7:0/2739172191 conn(0x7f7cd00fc7a0 msgr2=0x7f7cd00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:45.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.871+0000 7f7cd4b24640 1 -- 172.21.15.7:0/2739172191 shutdown_connections 2024-09-19T08:44:45.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.871+0000 7f7cd4b24640 1 -- 172.21.15.7:0/2739172191 wait complete. 2024-09-19T08:44:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.872+0000 7f7cd4b24640 1 Processor -- start 2024-09-19T08:44:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.872+0000 7f7cd4b24640 1 -- start start 2024-09-19T08:44:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.872+0000 7f7cd4b24640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cd0102d40 0x7f7cd01009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.872+0000 7f7cd4b24640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cd0103660 0x7f7cd0100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.872+0000 7f7cd4b24640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cd010c170 0x7f7cd0101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.872+0000 7f7cd4b24640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd0111f70 con 0x7f7cd0102d40 2024-09-19T08:44:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.872+0000 7f7cd4b24640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd0111df0 con 0x7f7cd010c170 2024-09-19T08:44:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.872+0000 7f7cd4b24640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd01120f0 con 0x7f7cd0103660 2024-09-19T08:44:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.872+0000 7f7cce59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cd0102d40 0x7f7cd01009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.873+0000 7f7cce59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cd0102d40 0x7f7cd01009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41760/0 (socket says 172.21.15.7:41760) 2024-09-19T08:44:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.873+0000 7f7cce59c640 1 -- 172.21.15.7:0/799243761 learned_addr learned my addr 172.21.15.7:0/799243761 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.873+0000 7f7cced9d640 1 --2- 172.21.15.7:0/799243761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cd010c170 0x7f7cd0101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.873+0000 7f7ccdd9b640 1 --2- 172.21.15.7:0/799243761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cd0103660 0x7f7cd0100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.873+0000 7f7cce59c640 1 -- 172.21.15.7:0/799243761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cd0103660 msgr2=0x7f7cd0100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.873+0000 7f7cce59c640 1 --2- 172.21.15.7:0/799243761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cd0103660 0x7f7cd0100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.873+0000 7f7cce59c640 1 -- 172.21.15.7:0/799243761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cd010c170 msgr2=0x7f7cd0101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.873+0000 7f7cce59c640 1 --2- 172.21.15.7:0/799243761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cd010c170 0x7f7cd0101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.873+0000 7f7cce59c640 1 -- 172.21.15.7:0/799243761 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd01a6890 con 0x7f7cd0102d40 2024-09-19T08:44:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.873+0000 7f7cce59c640 1 --2- 172.21.15.7:0/799243761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cd0102d40 0x7f7cd01009a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000c920 tx=0x7f7cc000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.873+0000 7f7cc77fe640 1 -- 172.21.15.7:0/799243761 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0007c70 con 0x7f7cd0102d40 2024-09-19T08:44:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.873+0000 7f7cd4b24640 1 -- 172.21.15.7:0/799243761 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd01a6b80 con 0x7f7cd0102d40 2024-09-19T08:44:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.873+0000 7f7cc77fe640 1 -- 172.21.15.7:0/799243761 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cc0007e10 con 0x7f7cd0102d40 2024-09-19T08:44:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.873+0000 7f7cc77fe640 1 -- 172.21.15.7:0/799243761 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0018890 con 0x7f7cd0102d40 2024-09-19T08:44:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.873+0000 7f7cd4b24640 1 -- 172.21.15.7:0/799243761 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cd01a7110 con 0x7f7cd0102d40 2024-09-19T08:44:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.874+0000 7f7cd4b24640 1 -- 172.21.15.7:0/799243761 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cd0103120 con 0x7f7cd0102d40 2024-09-19T08:44:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.876+0000 7f7cc77fe640 1 -- 172.21.15.7:0/799243761 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f7cc0018a70 con 0x7f7cd0102d40 2024-09-19T08:44:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.876+0000 7f7cc77fe640 1 --2- 172.21.15.7:0/799243761 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7cbc0a3440 0x7f7cbc0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.877+0000 7f7ccdd9b640 1 --2- 172.21.15.7:0/799243761 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7cbc0a3440 0x7f7cbc0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.877+0000 7f7cc77fe640 1 -- 172.21.15.7:0/799243761 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f7cc00d0020 con 0x7f7cd0102d40 2024-09-19T08:44:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.877+0000 7f7ccdd9b640 1 --2- 172.21.15.7:0/799243761 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7cbc0a3440 0x7f7cbc0a5900 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0102430 tx=0x7f7cb8005a20 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:45.880+0000 7f7cc77fe640 1 -- 172.21.15.7:0/799243761 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7cc0014030 con 0x7f7cd0102d40 2024-09-19T08:44:46.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:46.051+0000 7f7cd4b24640 1 -- 172.21.15.7:0/799243761 --> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7cd0062630 con 0x7f7cbc0a3440 2024-09-19T08:44:46.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:46.058+0000 7f7cc77fe640 1 -- 172.21.15.7:0/799243761 <== mgr.15132 v2:172.21.15.7:6800/3061932294 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257762 (secure 0 0 0) 0x7f7cd0062630 con 0x7f7cbc0a3440 2024-09-19T08:44:46.060 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:44:46.061 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-19T08:44:46.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:46.061+0000 7f7cd4b24640 1 -- 172.21.15.7:0/799243761 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7cbc0a3440 msgr2=0x7f7cbc0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:46.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:46.061+0000 7f7cd4b24640 1 --2- 172.21.15.7:0/799243761 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7cbc0a3440 0x7f7cbc0a5900 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0102430 tx=0x7f7cb8005a20 comp rx=0 tx=0).stop 2024-09-19T08:44:46.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:46.061+0000 7f7cd4b24640 1 -- 172.21.15.7:0/799243761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cd0102d40 msgr2=0x7f7cd01009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:46.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:46.061+0000 7f7cd4b24640 1 --2- 172.21.15.7:0/799243761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cd0102d40 0x7f7cd01009a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000c920 tx=0x7f7cc000cde0 comp rx=0 tx=0).stop 2024-09-19T08:44:46.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:46.062+0000 7f7cd4b24640 1 -- 172.21.15.7:0/799243761 shutdown_connections 2024-09-19T08:44:46.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:46.062+0000 7f7cd4b24640 1 --2- 172.21.15.7:0/799243761 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7cbc0a3440 0x7f7cbc0a5900 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:46.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:46.062+0000 7f7cd4b24640 1 --2- 172.21.15.7:0/799243761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cd010c170 0x7f7cd0101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:46.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:46.062+0000 7f7cd4b24640 1 --2- 172.21.15.7:0/799243761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cd0103660 0x7f7cd0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:46.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:46.062+0000 7f7cd4b24640 1 --2- 172.21.15.7:0/799243761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cd0102d40 0x7f7cd01009a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:46.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:46.062+0000 7f7cd4b24640 1 -- 172.21.15.7:0/799243761 >> 172.21.15.7:0/799243761 conn(0x7f7cd00fc7a0 msgr2=0x7f7cd00fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:46.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:46.062+0000 7f7cd4b24640 1 -- 172.21.15.7:0/799243761 shutdown_connections 2024-09-19T08:44:46.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:46.062+0000 7f7cd4b24640 1 -- 172.21.15.7:0/799243761 wait complete. 2024-09-19T08:44:46.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:46 smithi175 ceph-mon[35688]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 54 KiB/s wr, 29 op/s 2024-09-19T08:44:46.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:46 smithi007 ceph-mon[31221]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 54 KiB/s wr, 29 op/s 2024-09-19T08:44:46.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:46 smithi044 ceph-mon[35072]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 54 KiB/s wr, 29 op/s 2024-09-19T08:44:46.829 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-19T08:44:45.184773+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1384695,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1123,"num_read_kb":927,"num_write":559,"num_write_kb":5030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1181934,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":921,"ondisk_log_size":921,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367848,"kb_used_data":14352,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124573976,"statfs":{"total":1151940427776,"available":1151563751424,"internally_reserved":0,"allocated":14696448,"data_stored":8857497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":346,"num_write":84,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002786"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226071+0000","last_change":"2024-09-19T08:42:44.035697+0000","last_active":"2024-09-19T08:44:31.226071+0000","last_peered":"2024-09-19T08:44:31.226071+0000","last_clean":"2024-09-19T08:44:31.226071+0000","last_became_active":"2024-09-19T08:42:44.035400+0000","last_became_peered":"2024-09-19T08:42:44.035400+0000","last_unstale":"2024-09-19T08:44:31.226071+0000","last_undegraded":"2024-09-19T08:44:31.226071+0000","last_fullsized":"2024-09-19T08:44:31.226071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:56.202947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.223958+0000","last_change":"2024-09-19T08:42:44.031393+0000","last_active":"2024-09-19T08:44:31.223958+0000","last_peered":"2024-09-19T08:44:31.223958+0000","last_clean":"2024-09-19T08:44:31.223958+0000","last_became_active":"2024-09-19T08:42:44.031056+0000","last_became_peered":"2024-09-19T08:42:44.031056+0000","last_unstale":"2024-09-19T08:44:31.223958+0000","last_undegraded":"2024-09-19T08:44:31.223958+0000","last_fullsized":"2024-09-19T08:44:31.223958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:44.694913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224221+0000","last_change":"2024-09-19T08:42:44.029586+0000","last_active":"2024-09-19T08:44:31.224221+0000","last_peered":"2024-09-19T08:44:31.224221+0000","last_clean":"2024-09-19T08:44:31.224221+0000","last_became_active":"2024-09-19T08:42:44.029279+0000","last_became_peered":"2024-09-19T08:42:44.029279+0000","last_unstale":"2024-09-19T08:44:31.224221+0000","last_undegraded":"2024-09-19T08:44:31.224221+0000","last_fullsized":"2024-09-19T08:44:31.224221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:12.036113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219401+0000","last_change":"2024-09-19T08:42:44.043192+0000","last_active":"2024-09-19T08:44:31.219401+0000","last_peered":"2024-09-19T08:44:31.219401+0000","last_clean":"2024-09-19T08:44:31.219401+0000","last_became_active":"2024-09-19T08:42:44.042838+0000","last_became_peered":"2024-09-19T08:42:44.042838+0000","last_unstale":"2024-09-19T08:44:31.219401+0000","last_undegraded":"2024-09-19T08:44:31.219401+0000","last_fullsized":"2024-09-19T08:44:31.219401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:20.549232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.207548+0000","last_change":"2024-09-19T08:42:44.032231+0000","last_active":"2024-09-19T08:44:31.207548+0000","last_peered":"2024-09-19T08:44:31.207548+0000","last_clean":"2024-09-19T08:44:31.207548+0000","last_became_active":"2024-09-19T08:42:44.031835+0000","last_became_peered":"2024-09-19T08:42:44.031835+0000","last_unstale":"2024-09-19T08:44:31.207548+0000","last_undegraded":"2024-09-19T08:44:31.207548+0000","last_fullsized":"2024-09-19T08:44:31.207548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:49.084085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.209888+0000","last_change":"2024-09-19T08:42:44.035487+0000","last_active":"2024-09-19T08:44:31.209888+0000","last_peered":"2024-09-19T08:44:31.209888+0000","last_clean":"2024-09-19T08:44:31.209888+0000","last_became_active":"2024-09-19T08:42:44.035138+0000","last_became_peered":"2024-09-19T08:42:44.035138+0000","last_unstale":"2024-09-19T08:44:31.209888+0000","last_undegraded":"2024-09-19T08:44:31.209888+0000","last_fullsized":"2024-09-19T08:44:31.209888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:43.483397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212841+0000","last_change":"2024-09-19T08:42:44.029052+0000","last_active":"2024-09-19T08:44:31.212841+0000","last_peered":"2024-09-19T08:44:31.212841+0000","last_clean":"2024-09-19T08:44:31.212841+0000","last_became_active":"2024-09-19T08:42:44.028722+0000","last_became_peered":"2024-09-19T08:42:44.028722+0000","last_unstale":"2024-09-19T08:44:31.212841+0000","last_undegraded":"2024-09-19T08:44:31.212841+0000","last_fullsized":"2024-09-19T08:44:31.212841+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:49.226044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212167+0000","last_change":"2024-09-19T08:42:44.031401+0000","last_active":"2024-09-19T08:44:31.212167+0000","last_peered":"2024-09-19T08:44:31.212167+0000","last_clean":"2024-09-19T08:44:31.212167+0000","last_became_active":"2024-09-19T08:42:44.031103+0000","last_became_peered":"2024-09-19T08:42:44.031103+0000","last_unstale":"2024-09-19T08:44:31.212167+0000","last_undegraded":"2024-09-19T08:44:31.212167+0000","last_fullsized":"2024-09-19T08:44:31.212167+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:57.406765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224039+0000","last_change":"2024-09-19T08:42:44.033011+0000","last_active":"2024-09-19T08:44:31.224039+0000","last_peered":"2024-09-19T08:44:31.224039+0000","last_clean":"2024-09-19T08:44:31.224039+0000","last_became_active":"2024-09-19T08:42:44.032075+0000","last_became_peered":"2024-09-19T08:42:44.032075+0000","last_unstale":"2024-09-19T08:44:31.224039+0000","last_undegraded":"2024-09-19T08:44:31.224039+0000","last_fullsized":"2024-09-19T08:44:31.224039+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:43.701684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212881+0000","last_change":"2024-09-19T08:42:44.037417+0000","last_active":"2024-09-19T08:44:31.212881+0000","last_peered":"2024-09-19T08:44:31.212881+0000","last_clean":"2024-09-19T08:44:31.212881+0000","last_became_active":"2024-09-19T08:42:44.037006+0000","last_became_peered":"2024-09-19T08:42:44.037006+0000","last_unstale":"2024-09-19T08:44:31.212881+0000","last_undegraded":"2024-09-19T08:44:31.212881+0000","last_fullsized":"2024-09-19T08:44:31.212881+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:10.952939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225737+0000","last_change":"2024-09-19T08:42:44.034125+0000","last_active":"2024-09-19T08:44:31.225737+0000","last_peered":"2024-09-19T08:44:31.225737+0000","last_clean":"2024-09-19T08:44:31.225737+0000","last_became_active":"2024-09-19T08:42:44.033772+0000","last_became_peered":"2024-09-19T08:42:44.033772+0000","last_unstale":"2024-09-19T08:44:31.225737+0000","last_undegraded":"2024-09-19T08:44:31.225737+0000","last_fullsized":"2024-09-19T08:44:31.225737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:42.854137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219105+0000","last_change":"2024-09-19T08:42:44.043047+0000","last_active":"2024-09-19T08:44:31.219105+0000","last_peered":"2024-09-19T08:44:31.219105+0000","last_clean":"2024-09-19T08:44:31.219105+0000","last_became_active":"2024-09-19T08:42:44.042666+0000","last_became_peered":"2024-09-19T08:42:44.042666+0000","last_unstale":"2024-09-19T08:44:31.219105+0000","last_undegraded":"2024-09-19T08:44:31.219105+0000","last_fullsized":"2024-09-19T08:44:31.219105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:16.504824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208420+0000","last_change":"2024-09-19T08:42:44.026475+0000","last_active":"2024-09-19T08:44:31.208420+0000","last_peered":"2024-09-19T08:44:31.208420+0000","last_clean":"2024-09-19T08:44:31.208420+0000","last_became_active":"2024-09-19T08:42:44.026169+0000","last_became_peered":"2024-09-19T08:42:44.026169+0000","last_unstale":"2024-09-19T08:44:31.208420+0000","last_undegraded":"2024-09-19T08:44:31.208420+0000","last_fullsized":"2024-09-19T08:44:31.208420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:17.130267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222128+0000","last_change":"2024-09-19T08:42:44.033725+0000","last_active":"2024-09-19T08:44:31.222128+0000","last_peered":"2024-09-19T08:44:31.222128+0000","last_clean":"2024-09-19T08:44:31.222128+0000","last_became_active":"2024-09-19T08:42:44.033304+0000","last_became_peered":"2024-09-19T08:42:44.033304+0000","last_unstale":"2024-09-19T08:44:31.222128+0000","last_undegraded":"2024-09-19T08:44:31.222128+0000","last_fullsized":"2024-09-19T08:44:31.222128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:47.520808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224694+0000","last_change":"2024-09-19T08:42:44.041762+0000","last_active":"2024-09-19T08:44:31.224694+0000","last_peered":"2024-09-19T08:44:31.224694+0000","last_clean":"2024-09-19T08:44:31.224694+0000","last_became_active":"2024-09-19T08:42:44.041433+0000","last_became_peered":"2024-09-19T08:42:44.041433+0000","last_unstale":"2024-09-19T08:44:31.224694+0000","last_undegraded":"2024-09-19T08:44:31.224694+0000","last_fullsized":"2024-09-19T08:44:31.224694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:05.504873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226669+0000","last_change":"2024-09-19T08:42:44.030316+0000","last_active":"2024-09-19T08:44:31.226669+0000","last_peered":"2024-09-19T08:44:31.226669+0000","last_clean":"2024-09-19T08:44:31.226669+0000","last_became_active":"2024-09-19T08:42:44.029872+0000","last_became_peered":"2024-09-19T08:42:44.029872+0000","last_unstale":"2024-09-19T08:44:31.226669+0000","last_undegraded":"2024-09-19T08:44:31.226669+0000","last_fullsized":"2024-09-19T08:44:31.226669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:18.011019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226224+0000","last_change":"2024-09-19T08:42:44.035523+0000","last_active":"2024-09-19T08:44:31.226224+0000","last_peered":"2024-09-19T08:44:31.226224+0000","last_clean":"2024-09-19T08:44:31.226224+0000","last_became_active":"2024-09-19T08:42:44.035185+0000","last_became_peered":"2024-09-19T08:42:44.035185+0000","last_unstale":"2024-09-19T08:44:31.226224+0000","last_undegraded":"2024-09-19T08:44:31.226224+0000","last_fullsized":"2024-09-19T08:44:31.226224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:03.475458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222791+0000","last_change":"2024-09-19T08:42:44.031803+0000","last_active":"2024-09-19T08:44:31.222791+0000","last_peered":"2024-09-19T08:44:31.222791+0000","last_clean":"2024-09-19T08:44:31.222791+0000","last_became_active":"2024-09-19T08:42:44.031501+0000","last_became_peered":"2024-09-19T08:42:44.031501+0000","last_unstale":"2024-09-19T08:44:31.222791+0000","last_undegraded":"2024-09-19T08:44:31.222791+0000","last_fullsized":"2024-09-19T08:44:31.222791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:31.780744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.211603+0000","last_change":"2024-09-19T08:42:44.036168+0000","last_active":"2024-09-19T08:44:31.211603+0000","last_peered":"2024-09-19T08:44:31.211603+0000","last_clean":"2024-09-19T08:44:31.211603+0000","last_became_active":"2024-09-19T08:42:44.035819+0000","last_became_peered":"2024-09-19T08:42:44.035819+0000","last_unstale":"2024-09-19T08:44:31.211603+0000","last_undegraded":"2024-09-19T08:44:31.211603+0000","last_fullsized":"2024-09-19T08:44:31.211603+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:26.478389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.220605+0000","last_change":"2024-09-19T08:42:44.037569+0000","last_active":"2024-09-19T08:44:31.220605+0000","last_peered":"2024-09-19T08:44:31.220605+0000","last_clean":"2024-09-19T08:44:31.220605+0000","last_became_active":"2024-09-19T08:42:44.037161+0000","last_became_peered":"2024-09-19T08:42:44.037161+0000","last_unstale":"2024-09-19T08:44:31.220605+0000","last_undegraded":"2024-09-19T08:44:31.220605+0000","last_fullsized":"2024-09-19T08:44:31.220605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:35.316314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226011+0000","last_change":"2024-09-19T08:42:44.023160+0000","last_active":"2024-09-19T08:44:31.226011+0000","last_peered":"2024-09-19T08:44:31.226011+0000","last_clean":"2024-09-19T08:44:31.226011+0000","last_became_active":"2024-09-19T08:42:44.022791+0000","last_became_peered":"2024-09-19T08:42:44.022791+0000","last_unstale":"2024-09-19T08:44:31.226011+0000","last_undegraded":"2024-09-19T08:44:31.226011+0000","last_fullsized":"2024-09-19T08:44:31.226011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:00.174583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225075+0000","last_change":"2024-09-19T08:42:44.035877+0000","last_active":"2024-09-19T08:44:31.225075+0000","last_peered":"2024-09-19T08:44:31.225075+0000","last_clean":"2024-09-19T08:44:31.225075+0000","last_became_active":"2024-09-19T08:42:44.035307+0000","last_became_peered":"2024-09-19T08:42:44.035307+0000","last_unstale":"2024-09-19T08:44:31.225075+0000","last_undegraded":"2024-09-19T08:44:31.225075+0000","last_fullsized":"2024-09-19T08:44:31.225075+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:54.717130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219964+0000","last_change":"2024-09-19T08:42:44.033536+0000","last_active":"2024-09-19T08:44:31.219964+0000","last_peered":"2024-09-19T08:44:31.219964+0000","last_clean":"2024-09-19T08:44:31.219964+0000","last_became_active":"2024-09-19T08:42:44.033179+0000","last_became_peered":"2024-09-19T08:42:44.033179+0000","last_unstale":"2024-09-19T08:44:31.219964+0000","last_undegraded":"2024-09-19T08:44:31.219964+0000","last_fullsized":"2024-09-19T08:44:31.219964+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:11.161785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.210217+0000","last_change":"2024-09-19T08:42:44.029674+0000","last_active":"2024-09-19T08:44:31.210217+0000","last_peered":"2024-09-19T08:44:31.210217+0000","last_clean":"2024-09-19T08:44:31.210217+0000","last_became_active":"2024-09-19T08:42:44.029368+0000","last_became_peered":"2024-09-19T08:42:44.029368+0000","last_unstale":"2024-09-19T08:44:31.210217+0000","last_undegraded":"2024-09-19T08:44:31.210217+0000","last_fullsized":"2024-09-19T08:44:31.210217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:34.943363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.213448+0000","last_change":"2024-09-19T08:42:44.039780+0000","last_active":"2024-09-19T08:44:31.213448+0000","last_peered":"2024-09-19T08:44:31.213448+0000","last_clean":"2024-09-19T08:44:31.213448+0000","last_became_active":"2024-09-19T08:42:44.039409+0000","last_became_peered":"2024-09-19T08:42:44.039409+0000","last_unstale":"2024-09-19T08:44:31.213448+0000","last_undegraded":"2024-09-19T08:44:31.213448+0000","last_fullsized":"2024-09-19T08:44:31.213448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:59.632132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.214979+0000","last_change":"2024-09-19T08:42:44.030881+0000","last_active":"2024-09-19T08:44:31.214979+0000","last_peered":"2024-09-19T08:44:31.214979+0000","last_clean":"2024-09-19T08:44:31.214979+0000","last_became_active":"2024-09-19T08:42:44.030530+0000","last_became_peered":"2024-09-19T08:42:44.030530+0000","last_unstale":"2024-09-19T08:44:31.214979+0000","last_undegraded":"2024-09-19T08:44:31.214979+0000","last_fullsized":"2024-09-19T08:44:31.214979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:16.908450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.214928+0000","last_change":"2024-09-19T08:42:44.033056+0000","last_active":"2024-09-19T08:44:31.214928+0000","last_peered":"2024-09-19T08:44:31.214928+0000","last_clean":"2024-09-19T08:44:31.214928+0000","last_became_active":"2024-09-19T08:42:44.032690+0000","last_became_peered":"2024-09-19T08:42:44.032690+0000","last_unstale":"2024-09-19T08:44:31.214928+0000","last_undegraded":"2024-09-19T08:44:31.214928+0000","last_fullsized":"2024-09-19T08:44:31.214928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:36.497824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225043+0000","last_change":"2024-09-19T08:42:58.106551+0000","last_active":"2024-09-19T08:44:31.225043+0000","last_peered":"2024-09-19T08:44:31.225043+0000","last_clean":"2024-09-19T08:44:31.225043+0000","last_became_active":"2024-09-19T08:42:58.106119+0000","last_became_peered":"2024-09-19T08:42:58.106119+0000","last_unstale":"2024-09-19T08:44:31.225043+0000","last_undegraded":"2024-09-19T08:44:31.225043+0000","last_fullsized":"2024-09-19T08:44:31.225043+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:46.794260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226527+0000","last_change":"2024-09-19T08:42:58.108106+0000","last_active":"2024-09-19T08:44:31.226527+0000","last_peered":"2024-09-19T08:44:31.226527+0000","last_clean":"2024-09-19T08:44:31.226527+0000","last_became_active":"2024-09-19T08:42:58.107532+0000","last_became_peered":"2024-09-19T08:42:58.107532+0000","last_unstale":"2024-09-19T08:44:31.226527+0000","last_undegraded":"2024-09-19T08:44:31.226527+0000","last_fullsized":"2024-09-19T08:44:31.226527+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:29.164983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224871+0000","last_change":"2024-09-19T08:42:44.029822+0000","last_active":"2024-09-19T08:44:31.224871+0000","last_peered":"2024-09-19T08:44:31.224871+0000","last_clean":"2024-09-19T08:44:31.224871+0000","last_became_active":"2024-09-19T08:42:44.029450+0000","last_became_peered":"2024-09-19T08:42:44.029450+0000","last_unstale":"2024-09-19T08:44:31.224871+0000","last_undegraded":"2024-09-19T08:44:31.224871+0000","last_fullsized":"2024-09-19T08:44:31.224871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:40.826261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.210860+0000","last_change":"2024-09-19T08:42:44.041354+0000","last_active":"2024-09-19T08:44:31.210860+0000","last_peered":"2024-09-19T08:44:31.210860+0000","last_clean":"2024-09-19T08:44:31.210860+0000","last_became_active":"2024-09-19T08:42:44.040912+0000","last_became_peered":"2024-09-19T08:42:44.040912+0000","last_unstale":"2024-09-19T08:44:31.210860+0000","last_undegraded":"2024-09-19T08:44:31.210860+0000","last_fullsized":"2024-09-19T08:44:31.210860+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:16.543950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.217246+0000","last_change":"2024-09-19T08:42:44.027912+0000","last_active":"2024-09-19T08:44:31.217246+0000","last_peered":"2024-09-19T08:44:31.217246+0000","last_clean":"2024-09-19T08:44:31.217246+0000","last_became_active":"2024-09-19T08:42:44.027505+0000","last_became_peered":"2024-09-19T08:42:44.027505+0000","last_unstale":"2024-09-19T08:44:31.217246+0000","last_undegraded":"2024-09-19T08:44:31.217246+0000","last_fullsized":"2024-09-19T08:44:31.217246+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:02.552756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208688+0000","last_change":"2024-09-19T08:42:44.034472+0000","last_active":"2024-09-19T08:44:31.208688+0000","last_peered":"2024-09-19T08:44:31.208688+0000","last_clean":"2024-09-19T08:44:31.208688+0000","last_became_active":"2024-09-19T08:42:44.034026+0000","last_became_peered":"2024-09-19T08:42:44.034026+0000","last_unstale":"2024-09-19T08:44:31.208688+0000","last_undegraded":"2024-09-19T08:44:31.208688+0000","last_fullsized":"2024-09-19T08:44:31.208688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:10.058882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'10","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:40.252860+0000","last_change":"2024-09-19T08:42:41.927174+0000","last_active":"2024-09-19T08:44:40.252860+0000","last_peered":"2024-09-19T08:44:40.252860+0000","last_clean":"2024-09-19T08:44:40.252860+0000","last_became_active":"2024-09-19T08:42:41.926826+0000","last_became_peered":"2024-09-19T08:42:41.926826+0000","last_unstale":"2024-09-19T08:44:40.252860+0000","last_undegraded":"2024-09-19T08:44:40.252860+0000","last_fullsized":"2024-09-19T08:44:40.252860+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:37.274891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2250,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.210827+0000","last_change":"2024-09-19T08:42:58.110259+0000","last_active":"2024-09-19T08:44:31.210827+0000","last_peered":"2024-09-19T08:44:31.210827+0000","last_clean":"2024-09-19T08:44:31.210827+0000","last_became_active":"2024-09-19T08:42:58.109803+0000","last_became_peered":"2024-09-19T08:42:58.109803+0000","last_unstale":"2024-09-19T08:44:31.210827+0000","last_undegraded":"2024-09-19T08:44:31.210827+0000","last_fullsized":"2024-09-19T08:44:31.210827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:31.853404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177196+0000","last_change":"2024-09-19T08:42:58.114222+0000","last_active":"2024-09-19T08:44:31.177196+0000","last_peered":"2024-09-19T08:44:31.177196+0000","last_clean":"2024-09-19T08:44:31.177196+0000","last_became_active":"2024-09-19T08:42:58.110769+0000","last_became_peered":"2024-09-19T08:42:58.110769+0000","last_unstale":"2024-09-19T08:44:31.177196+0000","last_undegraded":"2024-09-19T08:44:31.177196+0000","last_fullsized":"2024-09-19T08:44:31.177196+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:17.952228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.176271+0000","last_change":"2024-09-19T08:42:41.923903+0000","last_active":"2024-09-19T08:44:31.176271+0000","last_peered":"2024-09-19T08:44:31.176271+0000","last_clean":"2024-09-19T08:44:31.176271+0000","last_became_active":"2024-09-19T08:42:41.923583+0000","last_became_peered":"2024-09-19T08:42:41.923583+0000","last_unstale":"2024-09-19T08:44:31.176271+0000","last_undegraded":"2024-09-19T08:44:31.176271+0000","last_fullsized":"2024-09-19T08:44:31.176271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:48.594343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219641+0000","last_change":"2024-09-19T08:42:44.028972+0000","last_active":"2024-09-19T08:44:31.219641+0000","last_peered":"2024-09-19T08:44:31.219641+0000","last_clean":"2024-09-19T08:44:31.219641+0000","last_became_active":"2024-09-19T08:42:44.028657+0000","last_became_peered":"2024-09-19T08:42:44.028657+0000","last_unstale":"2024-09-19T08:44:31.219641+0000","last_undegraded":"2024-09-19T08:44:31.219641+0000","last_fullsized":"2024-09-19T08:44:31.219641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:43.618010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178701+0000","last_change":"2024-09-19T08:42:41.926558+0000","last_active":"2024-09-19T08:44:31.178701+0000","last_peered":"2024-09-19T08:44:31.178701+0000","last_clean":"2024-09-19T08:44:31.178701+0000","last_became_active":"2024-09-19T08:42:41.926074+0000","last_became_peered":"2024-09-19T08:42:41.926074+0000","last_unstale":"2024-09-19T08:44:31.178701+0000","last_undegraded":"2024-09-19T08:44:31.178701+0000","last_fullsized":"2024-09-19T08:44:31.178701+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:47.563295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.223532+0000","last_change":"2024-09-19T08:42:44.029191+0000","last_active":"2024-09-19T08:44:31.223532+0000","last_peered":"2024-09-19T08:44:31.223532+0000","last_clean":"2024-09-19T08:44:31.223532+0000","last_became_active":"2024-09-19T08:42:44.028871+0000","last_became_peered":"2024-09-19T08:42:44.028871+0000","last_unstale":"2024-09-19T08:44:31.223532+0000","last_undegraded":"2024-09-19T08:44:31.223532+0000","last_fullsized":"2024-09-19T08:44:31.223532+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:41.262014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":136,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:40.252212+0000","last_change":"2024-09-19T08:42:41.930265+0000","last_active":"2024-09-19T08:44:40.252212+0000","last_peered":"2024-09-19T08:44:40.252212+0000","last_clean":"2024-09-19T08:44:40.252212+0000","last_became_active":"2024-09-19T08:42:41.929829+0000","last_became_peered":"2024-09-19T08:42:41.929829+0000","last_unstale":"2024-09-19T08:44:40.252212+0000","last_undegraded":"2024-09-19T08:44:40.252212+0000","last_fullsized":"2024-09-19T08:44:40.252212+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:59.181622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224033+0000","last_change":"2024-09-19T08:42:44.027382+0000","last_active":"2024-09-19T08:44:31.224033+0000","last_peered":"2024-09-19T08:44:31.224033+0000","last_clean":"2024-09-19T08:44:31.224033+0000","last_became_active":"2024-09-19T08:42:44.026824+0000","last_became_peered":"2024-09-19T08:42:44.026824+0000","last_unstale":"2024-09-19T08:44:31.224033+0000","last_undegraded":"2024-09-19T08:44:31.224033+0000","last_fullsized":"2024-09-19T08:44:31.224033+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:58.520068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.180283+0000","last_change":"2024-09-19T08:42:41.927914+0000","last_active":"2024-09-19T08:44:31.180283+0000","last_peered":"2024-09-19T08:44:31.180283+0000","last_clean":"2024-09-19T08:44:31.180283+0000","last_became_active":"2024-09-19T08:42:41.926566+0000","last_became_peered":"2024-09-19T08:42:41.926566+0000","last_unstale":"2024-09-19T08:44:31.180283+0000","last_undegraded":"2024-09-19T08:44:31.180283+0000","last_fullsized":"2024-09-19T08:44:31.180283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:52.238352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224677+0000","last_change":"2024-09-19T08:42:44.039899+0000","last_active":"2024-09-19T08:44:31.224677+0000","last_peered":"2024-09-19T08:44:31.224677+0000","last_clean":"2024-09-19T08:44:31.224677+0000","last_became_active":"2024-09-19T08:42:44.039530+0000","last_became_peered":"2024-09-19T08:42:44.039530+0000","last_unstale":"2024-09-19T08:44:31.224677+0000","last_undegraded":"2024-09-19T08:44:31.224677+0000","last_fullsized":"2024-09-19T08:44:31.224677+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:20.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178662+0000","last_change":"2024-09-19T08:42:42.410128+0000","last_active":"2024-09-19T08:44:31.178662+0000","last_peered":"2024-09-19T08:44:31.178662+0000","last_clean":"2024-09-19T08:44:31.178662+0000","last_became_active":"2024-09-19T08:42:42.409717+0000","last_became_peered":"2024-09-19T08:42:42.409717+0000","last_unstale":"2024-09-19T08:44:31.178662+0000","last_undegraded":"2024-09-19T08:44:31.178662+0000","last_fullsized":"2024-09-19T08:44:31.178662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:41.682355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225965+0000","last_change":"2024-09-19T08:42:44.043248+0000","last_active":"2024-09-19T08:44:31.225965+0000","last_peered":"2024-09-19T08:44:31.225965+0000","last_clean":"2024-09-19T08:44:31.225965+0000","last_became_active":"2024-09-19T08:42:44.042849+0000","last_became_peered":"2024-09-19T08:42:44.042849+0000","last_unstale":"2024-09-19T08:44:31.225965+0000","last_undegraded":"2024-09-19T08:44:31.225965+0000","last_fullsized":"2024-09-19T08:44:31.225965+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:00.413217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'34","reported_seq":287,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:41.253653+0000","last_change":"2024-09-19T08:42:41.926582+0000","last_active":"2024-09-19T08:44:41.253653+0000","last_peered":"2024-09-19T08:44:41.253653+0000","last_clean":"2024-09-19T08:44:41.253653+0000","last_became_active":"2024-09-19T08:42:41.926234+0000","last_became_peered":"2024-09-19T08:42:41.926234+0000","last_unstale":"2024-09-19T08:44:41.253653+0000","last_undegraded":"2024-09-19T08:44:41.253653+0000","last_fullsized":"2024-09-19T08:44:41.253653+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:02.498976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":229,"num_read_kb":179,"num_write":35,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.199159+0000","last_change":"2024-09-19T08:42:44.034888+0000","last_active":"2024-09-19T08:44:31.199159+0000","last_peered":"2024-09-19T08:44:31.199159+0000","last_clean":"2024-09-19T08:44:31.199159+0000","last_became_active":"2024-09-19T08:42:44.034553+0000","last_became_peered":"2024-09-19T08:42:44.034553+0000","last_unstale":"2024-09-19T08:44:31.199159+0000","last_undegraded":"2024-09-19T08:44:31.199159+0000","last_fullsized":"2024-09-19T08:44:31.199159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:06.416289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.181995+0000","last_change":"2024-09-19T08:42:58.117912+0000","last_active":"2024-09-19T08:44:31.181995+0000","last_peered":"2024-09-19T08:44:31.181995+0000","last_clean":"2024-09-19T08:44:31.181995+0000","last_became_active":"2024-09-19T08:42:58.105810+0000","last_became_peered":"2024-09-19T08:42:58.105810+0000","last_unstale":"2024-09-19T08:44:31.181995+0000","last_undegraded":"2024-09-19T08:44:31.181995+0000","last_fullsized":"2024-09-19T08:44:31.181995+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:44.258256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.213617+0000","last_change":"2024-09-19T08:42:44.030519+0000","last_active":"2024-09-19T08:44:31.213617+0000","last_peered":"2024-09-19T08:44:31.213617+0000","last_clean":"2024-09-19T08:44:31.213617+0000","last_became_active":"2024-09-19T08:42:44.030190+0000","last_became_peered":"2024-09-19T08:42:44.030190+0000","last_unstale":"2024-09-19T08:44:31.213617+0000","last_undegraded":"2024-09-19T08:44:31.213617+0000","last_fullsized":"2024-09-19T08:44:31.213617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:20.220642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178349+0000","last_change":"2024-09-19T08:42:41.928124+0000","last_active":"2024-09-19T08:44:31.178349+0000","last_peered":"2024-09-19T08:44:31.178349+0000","last_clean":"2024-09-19T08:44:31.178349+0000","last_became_active":"2024-09-19T08:42:41.927761+0000","last_became_peered":"2024-09-19T08:42:41.927761+0000","last_unstale":"2024-09-19T08:44:31.178349+0000","last_undegraded":"2024-09-19T08:44:31.178349+0000","last_fullsized":"2024-09-19T08:44:31.178349+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:08.591270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.218267+0000","last_change":"2024-09-19T08:42:44.038234+0000","last_active":"2024-09-19T08:44:31.218267+0000","last_peered":"2024-09-19T08:44:31.218267+0000","last_clean":"2024-09-19T08:44:31.218267+0000","last_became_active":"2024-09-19T08:42:44.037726+0000","last_became_peered":"2024-09-19T08:42:44.037726+0000","last_unstale":"2024-09-19T08:44:31.218267+0000","last_undegraded":"2024-09-19T08:44:31.218267+0000","last_fullsized":"2024-09-19T08:44:31.218267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:08.865482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:40.252204+0000","last_change":"2024-09-19T08:42:41.926206+0000","last_active":"2024-09-19T08:44:40.252204+0000","last_peered":"2024-09-19T08:44:40.252204+0000","last_clean":"2024-09-19T08:44:40.252204+0000","last_became_active":"2024-09-19T08:42:41.925833+0000","last_became_peered":"2024-09-19T08:42:41.925833+0000","last_unstale":"2024-09-19T08:44:40.252204+0000","last_undegraded":"2024-09-19T08:44:40.252204+0000","last_fullsized":"2024-09-19T08:44:40.252204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:27.944240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208340+0000","last_change":"2024-09-19T08:42:44.037181+0000","last_active":"2024-09-19T08:44:31.208340+0000","last_peered":"2024-09-19T08:44:31.208340+0000","last_clean":"2024-09-19T08:44:31.208340+0000","last_became_active":"2024-09-19T08:42:44.036865+0000","last_became_peered":"2024-09-19T08:42:44.036865+0000","last_unstale":"2024-09-19T08:44:31.208340+0000","last_undegraded":"2024-09-19T08:44:31.208340+0000","last_fullsized":"2024-09-19T08:44:31.208340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:20.233309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.169922+0000","last_change":"2024-09-19T08:42:42.408446+0000","last_active":"2024-09-19T08:44:31.169922+0000","last_peered":"2024-09-19T08:44:31.169922+0000","last_clean":"2024-09-19T08:44:31.169922+0000","last_became_active":"2024-09-19T08:42:42.408098+0000","last_became_peered":"2024-09-19T08:42:42.408098+0000","last_unstale":"2024-09-19T08:44:31.169922+0000","last_undegraded":"2024-09-19T08:44:31.169922+0000","last_fullsized":"2024-09-19T08:44:31.169922+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:22.603604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225407+0000","last_change":"2024-09-19T08:42:44.039954+0000","last_active":"2024-09-19T08:44:31.225407+0000","last_peered":"2024-09-19T08:44:31.225407+0000","last_clean":"2024-09-19T08:44:31.225407+0000","last_became_active":"2024-09-19T08:42:44.039601+0000","last_became_peered":"2024-09-19T08:42:44.039601+0000","last_unstale":"2024-09-19T08:44:31.225407+0000","last_undegraded":"2024-09-19T08:44:31.225407+0000","last_fullsized":"2024-09-19T08:44:31.225407+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:07.792167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'3","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170390+0000","last_change":"2024-09-19T08:42:41.929644+0000","last_active":"2024-09-19T08:44:31.170390+0000","last_peered":"2024-09-19T08:44:31.170390+0000","last_clean":"2024-09-19T08:44:31.170390+0000","last_became_active":"2024-09-19T08:42:41.929308+0000","last_became_peered":"2024-09-19T08:42:41.929308+0000","last_unstale":"2024-09-19T08:44:31.170390+0000","last_undegraded":"2024-09-19T08:44:31.170390+0000","last_fullsized":"2024-09-19T08:44:31.170390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:36.660470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222570+0000","last_change":"2024-09-19T08:42:58.107555+0000","last_active":"2024-09-19T08:44:31.222570+0000","last_peered":"2024-09-19T08:44:31.222570+0000","last_clean":"2024-09-19T08:44:31.222570+0000","last_became_active":"2024-09-19T08:42:58.107137+0000","last_became_peered":"2024-09-19T08:42:58.107137+0000","last_unstale":"2024-09-19T08:44:31.222570+0000","last_undegraded":"2024-09-19T08:44:31.222570+0000","last_fullsized":"2024-09-19T08:44:31.222570+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:13.198911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.176594+0000","last_change":"2024-09-19T08:42:41.925195+0000","last_active":"2024-09-19T08:44:31.176594+0000","last_peered":"2024-09-19T08:44:31.176594+0000","last_clean":"2024-09-19T08:44:31.176594+0000","last_became_active":"2024-09-19T08:42:41.924880+0000","last_became_peered":"2024-09-19T08:42:41.924880+0000","last_unstale":"2024-09-19T08:44:31.176594+0000","last_undegraded":"2024-09-19T08:44:31.176594+0000","last_fullsized":"2024-09-19T08:44:31.176594+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:11.256881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219778+0000","last_change":"2024-09-19T08:42:44.036439+0000","last_active":"2024-09-19T08:44:31.219778+0000","last_peered":"2024-09-19T08:44:31.219778+0000","last_clean":"2024-09-19T08:44:31.219778+0000","last_became_active":"2024-09-19T08:42:44.036036+0000","last_became_peered":"2024-09-19T08:42:44.036036+0000","last_unstale":"2024-09-19T08:44:31.219778+0000","last_undegraded":"2024-09-19T08:44:31.219778+0000","last_fullsized":"2024-09-19T08:44:31.219778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:37.410782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'57","reported_seq":99,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:41.884313+0000","last_change":"2024-09-19T08:42:41.927490+0000","last_active":"2024-09-19T08:44:41.884313+0000","last_peered":"2024-09-19T08:44:41.884313+0000","last_clean":"2024-09-19T08:44:41.884313+0000","last_became_active":"2024-09-19T08:42:41.927163+0000","last_became_peered":"2024-09-19T08:42:41.927163+0000","last_unstale":"2024-09-19T08:44:41.884313+0000","last_undegraded":"2024-09-19T08:44:41.884313+0000","last_fullsized":"2024-09-19T08:44:41.884313+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:20.013661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":68,"num_write_kb":807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208966+0000","last_change":"2024-09-19T08:42:44.036960+0000","last_active":"2024-09-19T08:44:31.208966+0000","last_peered":"2024-09-19T08:44:31.208966+0000","last_clean":"2024-09-19T08:44:31.208966+0000","last_became_active":"2024-09-19T08:42:44.036600+0000","last_became_peered":"2024-09-19T08:42:44.036600+0000","last_unstale":"2024-09-19T08:44:31.208966+0000","last_undegraded":"2024-09-19T08:44:31.208966+0000","last_fullsized":"2024-09-19T08:44:31.208966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:15.621888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177396+0000","last_change":"2024-09-19T08:42:58.114698+0000","last_active":"2024-09-19T08:44:31.177396+0000","last_peered":"2024-09-19T08:44:31.177396+0000","last_clean":"2024-09-19T08:44:31.177396+0000","last_became_active":"2024-09-19T08:42:58.105488+0000","last_became_peered":"2024-09-19T08:42:58.105488+0000","last_unstale":"2024-09-19T08:44:31.177396+0000","last_undegraded":"2024-09-19T08:44:31.177396+0000","last_fullsized":"2024-09-19T08:44:31.177396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:12.642715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225878+0000","last_change":"2024-09-19T08:42:44.035569+0000","last_active":"2024-09-19T08:44:31.225878+0000","last_peered":"2024-09-19T08:44:31.225878+0000","last_clean":"2024-09-19T08:44:31.225878+0000","last_became_active":"2024-09-19T08:42:44.035277+0000","last_became_peered":"2024-09-19T08:42:44.035277+0000","last_unstale":"2024-09-19T08:44:31.225878+0000","last_undegraded":"2024-09-19T08:44:31.225878+0000","last_fullsized":"2024-09-19T08:44:31.225878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:57.472721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"83'148","reported_seq":392,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:33.303710+0000","last_change":"2024-09-19T08:41:34.769047+0000","last_active":"2024-09-19T08:44:33.303710+0000","last_peered":"2024-09-19T08:44:33.303710+0000","last_clean":"2024-09-19T08:44:33.303710+0000","last_became_active":"2024-09-19T08:41:34.768619+0000","last_became_peered":"2024-09-19T08:41:34.768619+0000","last_unstale":"2024-09-19T08:44:33.303710+0000","last_undegraded":"2024-09-19T08:44:33.303710+0000","last_fullsized":"2024-09-19T08:44:33.303710+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:13.482855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:13.482855+0000","last_clean_scrub_stamp":"2024-09-19T08:38:13.482855+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.390775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177359+0000","last_change":"2024-09-19T08:42:41.925698+0000","last_active":"2024-09-19T08:44:31.177359+0000","last_peered":"2024-09-19T08:44:31.177359+0000","last_clean":"2024-09-19T08:44:31.177359+0000","last_became_active":"2024-09-19T08:42:41.924618+0000","last_became_peered":"2024-09-19T08:42:41.924618+0000","last_unstale":"2024-09-19T08:44:31.177359+0000","last_undegraded":"2024-09-19T08:44:31.177359+0000","last_fullsized":"2024-09-19T08:44:31.177359+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:53.717139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222668+0000","last_change":"2024-09-19T08:42:58.111206+0000","last_active":"2024-09-19T08:44:31.222668+0000","last_peered":"2024-09-19T08:44:31.222668+0000","last_clean":"2024-09-19T08:44:31.222668+0000","last_became_active":"2024-09-19T08:42:58.110765+0000","last_became_peered":"2024-09-19T08:42:58.110765+0000","last_unstale":"2024-09-19T08:44:31.222668+0000","last_undegraded":"2024-09-19T08:44:31.222668+0000","last_fullsized":"2024-09-19T08:44:31.222668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:44.783938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.180014+0000","last_change":"2024-09-19T08:42:41.928414+0000","last_active":"2024-09-19T08:44:31.180014+0000","last_peered":"2024-09-19T08:44:31.180014+0000","last_clean":"2024-09-19T08:44:31.180014+0000","last_became_active":"2024-09-19T08:42:41.928055+0000","last_became_peered":"2024-09-19T08:42:41.928055+0000","last_unstale":"2024-09-19T08:44:31.180014+0000","last_undegraded":"2024-09-19T08:44:31.180014+0000","last_fullsized":"2024-09-19T08:44:31.180014+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:12.688379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.197630+0000","last_change":"2024-09-19T08:42:44.035439+0000","last_active":"2024-09-19T08:44:31.197630+0000","last_peered":"2024-09-19T08:44:31.197630+0000","last_clean":"2024-09-19T08:44:31.197630+0000","last_became_active":"2024-09-19T08:42:44.035150+0000","last_became_peered":"2024-09-19T08:42:44.035150+0000","last_unstale":"2024-09-19T08:44:31.197630+0000","last_undegraded":"2024-09-19T08:44:31.197630+0000","last_fullsized":"2024-09-19T08:44:31.197630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:15.230660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:40.251364+0000","last_change":"2024-09-19T08:42:42.407784+0000","last_active":"2024-09-19T08:44:40.251364+0000","last_peered":"2024-09-19T08:44:40.251364+0000","last_clean":"2024-09-19T08:44:40.251364+0000","last_became_active":"2024-09-19T08:42:42.407437+0000","last_became_peered":"2024-09-19T08:42:42.407437+0000","last_unstale":"2024-09-19T08:44:40.251364+0000","last_undegraded":"2024-09-19T08:44:40.251364+0000","last_fullsized":"2024-09-19T08:44:40.251364+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:44.829338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212600+0000","last_change":"2024-09-19T08:42:44.039780+0000","last_active":"2024-09-19T08:44:31.212600+0000","last_peered":"2024-09-19T08:44:31.212600+0000","last_clean":"2024-09-19T08:44:31.212600+0000","last_became_active":"2024-09-19T08:42:44.039441+0000","last_became_peered":"2024-09-19T08:42:44.039441+0000","last_unstale":"2024-09-19T08:44:31.212600+0000","last_undegraded":"2024-09-19T08:44:31.212600+0000","last_fullsized":"2024-09-19T08:44:31.212600+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:31.013663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.180830+0000","last_change":"2024-09-19T08:42:41.926998+0000","last_active":"2024-09-19T08:44:31.180830+0000","last_peered":"2024-09-19T08:44:31.180830+0000","last_clean":"2024-09-19T08:44:31.180830+0000","last_became_active":"2024-09-19T08:42:41.926560+0000","last_became_peered":"2024-09-19T08:42:41.926560+0000","last_unstale":"2024-09-19T08:44:31.180830+0000","last_undegraded":"2024-09-19T08:44:31.180830+0000","last_fullsized":"2024-09-19T08:44:31.180830+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:35.338601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225659+0000","last_change":"2024-09-19T08:42:44.039948+0000","last_active":"2024-09-19T08:44:31.225659+0000","last_peered":"2024-09-19T08:44:31.225659+0000","last_clean":"2024-09-19T08:44:31.225659+0000","last_became_active":"2024-09-19T08:42:44.038797+0000","last_became_peered":"2024-09-19T08:42:44.038797+0000","last_unstale":"2024-09-19T08:44:31.225659+0000","last_undegraded":"2024-09-19T08:44:31.225659+0000","last_fullsized":"2024-09-19T08:44:31.225659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:19.273191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.168583+0000","last_change":"2024-09-19T08:42:42.409954+0000","last_active":"2024-09-19T08:44:31.168583+0000","last_peered":"2024-09-19T08:44:31.168583+0000","last_clean":"2024-09-19T08:44:31.168583+0000","last_became_active":"2024-09-19T08:42:42.409388+0000","last_became_peered":"2024-09-19T08:42:42.409388+0000","last_unstale":"2024-09-19T08:44:31.168583+0000","last_undegraded":"2024-09-19T08:44:31.168583+0000","last_fullsized":"2024-09-19T08:44:31.168583+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:58.764877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.213210+0000","last_change":"2024-09-19T08:42:44.024360+0000","last_active":"2024-09-19T08:44:31.213210+0000","last_peered":"2024-09-19T08:44:31.213210+0000","last_clean":"2024-09-19T08:44:31.213210+0000","last_became_active":"2024-09-19T08:42:44.023703+0000","last_became_peered":"2024-09-19T08:42:44.023703+0000","last_unstale":"2024-09-19T08:44:31.213210+0000","last_undegraded":"2024-09-19T08:44:31.213210+0000","last_fullsized":"2024-09-19T08:44:31.213210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:10.852199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170383+0000","last_change":"2024-09-19T08:42:42.408101+0000","last_active":"2024-09-19T08:44:31.170383+0000","last_peered":"2024-09-19T08:44:31.170383+0000","last_clean":"2024-09-19T08:44:31.170383+0000","last_became_active":"2024-09-19T08:42:42.407692+0000","last_became_peered":"2024-09-19T08:42:42.407692+0000","last_unstale":"2024-09-19T08:44:31.170383+0000","last_undegraded":"2024-09-19T08:44:31.170383+0000","last_fullsized":"2024-09-19T08:44:31.170383+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:01.342213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.217468+0000","last_change":"2024-09-19T08:42:44.026612+0000","last_active":"2024-09-19T08:44:31.217468+0000","last_peered":"2024-09-19T08:44:31.217468+0000","last_clean":"2024-09-19T08:44:31.217468+0000","last_became_active":"2024-09-19T08:42:44.025408+0000","last_became_peered":"2024-09-19T08:42:44.025408+0000","last_unstale":"2024-09-19T08:44:31.217468+0000","last_undegraded":"2024-09-19T08:44:31.217468+0000","last_fullsized":"2024-09-19T08:44:31.217468+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:19.465342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'71","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:41.889318+0000","last_change":"2024-09-19T08:42:41.927561+0000","last_active":"2024-09-19T08:44:41.889318+0000","last_peered":"2024-09-19T08:44:41.889318+0000","last_clean":"2024-09-19T08:44:41.889318+0000","last_became_active":"2024-09-19T08:42:41.927159+0000","last_became_peered":"2024-09-19T08:42:41.927159+0000","last_unstale":"2024-09-19T08:44:41.889318+0000","last_undegraded":"2024-09-19T08:44:41.889318+0000","last_fullsized":"2024-09-19T08:44:41.889318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:13.352727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":160,"num_write":128,"num_write_kb":1157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.220812+0000","last_change":"2024-09-19T08:42:44.028129+0000","last_active":"2024-09-19T08:44:31.220812+0000","last_peered":"2024-09-19T08:44:31.220812+0000","last_clean":"2024-09-19T08:44:31.220812+0000","last_became_active":"2024-09-19T08:42:44.027826+0000","last_became_peered":"2024-09-19T08:42:44.027826+0000","last_unstale":"2024-09-19T08:44:31.220812+0000","last_undegraded":"2024-09-19T08:44:31.220812+0000","last_fullsized":"2024-09-19T08:44:31.220812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:03.129404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177705+0000","last_change":"2024-09-19T08:42:41.920264+0000","last_active":"2024-09-19T08:44:31.177705+0000","last_peered":"2024-09-19T08:44:31.177705+0000","last_clean":"2024-09-19T08:44:31.177705+0000","last_became_active":"2024-09-19T08:42:41.919655+0000","last_became_peered":"2024-09-19T08:42:41.919655+0000","last_unstale":"2024-09-19T08:44:31.177705+0000","last_undegraded":"2024-09-19T08:44:31.177705+0000","last_fullsized":"2024-09-19T08:44:31.177705+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:58.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226014+0000","last_change":"2024-09-19T08:42:44.039655+0000","last_active":"2024-09-19T08:44:31.226014+0000","last_peered":"2024-09-19T08:44:31.226014+0000","last_clean":"2024-09-19T08:44:31.226014+0000","last_became_active":"2024-09-19T08:42:44.039317+0000","last_became_peered":"2024-09-19T08:42:44.039317+0000","last_unstale":"2024-09-19T08:44:31.226014+0000","last_undegraded":"2024-09-19T08:44:31.226014+0000","last_fullsized":"2024-09-19T08:44:31.226014+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:19.064194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.169944+0000","last_change":"2024-09-19T08:42:42.408582+0000","last_active":"2024-09-19T08:44:31.169944+0000","last_peered":"2024-09-19T08:44:31.169944+0000","last_clean":"2024-09-19T08:44:31.169944+0000","last_became_active":"2024-09-19T08:42:42.408143+0000","last_became_peered":"2024-09-19T08:42:42.408143+0000","last_unstale":"2024-09-19T08:44:31.169944+0000","last_undegraded":"2024-09-19T08:44:31.169944+0000","last_fullsized":"2024-09-19T08:44:31.169944+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.526138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.195758+0000","last_change":"2024-09-19T08:42:44.034795+0000","last_active":"2024-09-19T08:44:31.195758+0000","last_peered":"2024-09-19T08:44:31.195758+0000","last_clean":"2024-09-19T08:44:31.195758+0000","last_became_active":"2024-09-19T08:42:44.034440+0000","last_became_peered":"2024-09-19T08:42:44.034440+0000","last_unstale":"2024-09-19T08:44:31.195758+0000","last_undegraded":"2024-09-19T08:44:31.195758+0000","last_fullsized":"2024-09-19T08:44:31.195758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:50.470240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.179034+0000","last_change":"2024-09-19T08:42:41.922621+0000","last_active":"2024-09-19T08:44:31.179034+0000","last_peered":"2024-09-19T08:44:31.179034+0000","last_clean":"2024-09-19T08:44:31.179034+0000","last_became_active":"2024-09-19T08:42:41.922303+0000","last_became_peered":"2024-09-19T08:42:41.922303+0000","last_unstale":"2024-09-19T08:44:31.179034+0000","last_undegraded":"2024-09-19T08:44:31.179034+0000","last_fullsized":"2024-09-19T08:44:31.179034+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:48.017892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225447+0000","last_change":"2024-09-19T08:42:44.028307+0000","last_active":"2024-09-19T08:44:31.225447+0000","last_peered":"2024-09-19T08:44:31.225447+0000","last_clean":"2024-09-19T08:44:31.225447+0000","last_became_active":"2024-09-19T08:42:44.026848+0000","last_became_peered":"2024-09-19T08:42:44.026848+0000","last_unstale":"2024-09-19T08:44:31.225447+0000","last_undegraded":"2024-09-19T08:44:31.225447+0000","last_fullsized":"2024-09-19T08:44:31.225447+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:20.768075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.180483+0000","last_change":"2024-09-19T08:42:41.929479+0000","last_active":"2024-09-19T08:44:31.180483+0000","last_peered":"2024-09-19T08:44:31.180483+0000","last_clean":"2024-09-19T08:44:31.180483+0000","last_became_active":"2024-09-19T08:42:41.928508+0000","last_became_peered":"2024-09-19T08:42:41.928508+0000","last_unstale":"2024-09-19T08:44:31.180483+0000","last_undegraded":"2024-09-19T08:44:31.180483+0000","last_fullsized":"2024-09-19T08:44:31.180483+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:46.108471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.205207+0000","last_change":"2024-09-19T08:42:44.028694+0000","last_active":"2024-09-19T08:44:31.205207+0000","last_peered":"2024-09-19T08:44:31.205207+0000","last_clean":"2024-09-19T08:44:31.205207+0000","last_became_active":"2024-09-19T08:42:44.027382+0000","last_became_peered":"2024-09-19T08:42:44.027382+0000","last_unstale":"2024-09-19T08:44:31.205207+0000","last_undegraded":"2024-09-19T08:44:31.205207+0000","last_fullsized":"2024-09-19T08:44:31.205207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:40.877505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170090+0000","last_change":"2024-09-19T08:42:41.931016+0000","last_active":"2024-09-19T08:44:31.170090+0000","last_peered":"2024-09-19T08:44:31.170090+0000","last_clean":"2024-09-19T08:44:31.170090+0000","last_became_active":"2024-09-19T08:42:41.930648+0000","last_became_peered":"2024-09-19T08:42:41.930648+0000","last_unstale":"2024-09-19T08:44:31.170090+0000","last_undegraded":"2024-09-19T08:44:31.170090+0000","last_fullsized":"2024-09-19T08:44:31.170090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:32.031025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226346+0000","last_change":"2024-09-19T08:42:44.035288+0000","last_active":"2024-09-19T08:44:31.226346+0000","last_peered":"2024-09-19T08:44:31.226346+0000","last_clean":"2024-09-19T08:44:31.226346+0000","last_became_active":"2024-09-19T08:42:44.034660+0000","last_became_peered":"2024-09-19T08:42:44.034660+0000","last_unstale":"2024-09-19T08:44:31.226346+0000","last_undegraded":"2024-09-19T08:44:31.226346+0000","last_fullsized":"2024-09-19T08:44:31.226346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:48.703463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225736+0000","last_change":"2024-09-19T08:42:44.040123+0000","last_active":"2024-09-19T08:44:31.225736+0000","last_peered":"2024-09-19T08:44:31.225736+0000","last_clean":"2024-09-19T08:44:31.225736+0000","last_became_active":"2024-09-19T08:42:44.039488+0000","last_became_peered":"2024-09-19T08:42:44.039488+0000","last_unstale":"2024-09-19T08:44:31.225736+0000","last_undegraded":"2024-09-19T08:44:31.225736+0000","last_fullsized":"2024-09-19T08:44:31.225736+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:15.273044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170228+0000","last_change":"2024-09-19T08:42:41.932400+0000","last_active":"2024-09-19T08:44:31.170228+0000","last_peered":"2024-09-19T08:44:31.170228+0000","last_clean":"2024-09-19T08:44:31.170228+0000","last_became_active":"2024-09-19T08:42:41.932020+0000","last_became_peered":"2024-09-19T08:42:41.932020+0000","last_unstale":"2024-09-19T08:44:31.170228+0000","last_undegraded":"2024-09-19T08:44:31.170228+0000","last_fullsized":"2024-09-19T08:44:31.170228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:08.583287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.221219+0000","last_change":"2024-09-19T08:42:44.026173+0000","last_active":"2024-09-19T08:44:31.221219+0000","last_peered":"2024-09-19T08:44:31.221219+0000","last_clean":"2024-09-19T08:44:31.221219+0000","last_became_active":"2024-09-19T08:42:44.024614+0000","last_became_peered":"2024-09-19T08:42:44.024614+0000","last_unstale":"2024-09-19T08:44:31.221219+0000","last_undegraded":"2024-09-19T08:44:31.221219+0000","last_fullsized":"2024-09-19T08:44:31.221219+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:42.695660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170318+0000","last_change":"2024-09-19T08:42:41.929576+0000","last_active":"2024-09-19T08:44:31.170318+0000","last_peered":"2024-09-19T08:44:31.170318+0000","last_clean":"2024-09-19T08:44:31.170318+0000","last_became_active":"2024-09-19T08:42:41.929231+0000","last_became_peered":"2024-09-19T08:42:41.929231+0000","last_unstale":"2024-09-19T08:44:31.170318+0000","last_undegraded":"2024-09-19T08:44:31.170318+0000","last_fullsized":"2024-09-19T08:44:31.170318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:54.492198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226525+0000","last_change":"2024-09-19T08:42:44.028612+0000","last_active":"2024-09-19T08:44:31.226525+0000","last_peered":"2024-09-19T08:44:31.226525+0000","last_clean":"2024-09-19T08:44:31.226525+0000","last_became_active":"2024-09-19T08:42:44.028301+0000","last_became_peered":"2024-09-19T08:42:44.028301+0000","last_unstale":"2024-09-19T08:44:31.226525+0000","last_undegraded":"2024-09-19T08:44:31.226525+0000","last_fullsized":"2024-09-19T08:44:31.226525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:03:09.539350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178947+0000","last_change":"2024-09-19T08:42:42.407931+0000","last_active":"2024-09-19T08:44:31.178947+0000","last_peered":"2024-09-19T08:44:31.178947+0000","last_clean":"2024-09-19T08:44:31.178947+0000","last_became_active":"2024-09-19T08:42:42.407573+0000","last_became_peered":"2024-09-19T08:42:42.407573+0000","last_unstale":"2024-09-19T08:44:31.178947+0000","last_undegraded":"2024-09-19T08:44:31.178947+0000","last_fullsized":"2024-09-19T08:44:31.178947+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:55.095275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.209474+0000","last_change":"2024-09-19T08:42:44.034109+0000","last_active":"2024-09-19T08:44:31.209474+0000","last_peered":"2024-09-19T08:44:31.209474+0000","last_clean":"2024-09-19T08:44:31.209474+0000","last_became_active":"2024-09-19T08:42:44.033753+0000","last_became_peered":"2024-09-19T08:42:44.033753+0000","last_unstale":"2024-09-19T08:44:31.209474+0000","last_undegraded":"2024-09-19T08:44:31.209474+0000","last_fullsized":"2024-09-19T08:44:31.209474+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:08.475476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.168710+0000","last_change":"2024-09-19T08:42:58.120292+0000","last_active":"2024-09-19T08:44:31.168710+0000","last_peered":"2024-09-19T08:44:31.168710+0000","last_clean":"2024-09-19T08:44:31.168710+0000","last_became_active":"2024-09-19T08:42:58.109929+0000","last_became_peered":"2024-09-19T08:42:58.109929+0000","last_unstale":"2024-09-19T08:44:31.168710+0000","last_undegraded":"2024-09-19T08:44:31.168710+0000","last_fullsized":"2024-09-19T08:44:31.168710+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:56.196868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":794093,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":886,"num_read_kb":597,"num_write":356,"num_write_kb":2090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1198,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2617344,"data_stored":2382279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579941,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":442307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32952,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712200,"statfs":{"total":95995035648,"available":95961292800,"internally_reserved":0,"allocated":1748992,"data_stored":1232179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939694,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36636,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708516,"statfs":{"total":95995035648,"available":95957520384,"internally_reserved":0,"allocated":1318912,"data_stored":835143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168627,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28312,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716840,"statfs":{"total":95995035648,"available":95966044160,"internally_reserved":0,"allocated":1318912,"data_stored":835063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397559,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1035359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561085,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":441316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790016,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28652,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716500,"statfs":{"total":95995035648,"available":95965696000,"internally_reserved":0,"allocated":1667072,"data_stored":1166298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953543,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":443262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215180,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40928,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704224,"statfs":{"total":95995035648,"available":95953125376,"internally_reserved":0,"allocated":1458176,"data_stored":966443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444112,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":999424,"data_stored":509951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":983040,"data_stored":507589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":933888,"data_stored":442587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":721732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":331336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":397217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:44:46.834 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T08:44:46.834 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:44:47.094 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:47.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:47 smithi044 ceph-mon[35072]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:47.444 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:47 smithi007 ceph-mon[31221]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:47.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.526+0000 7f5c960ee640 1 -- 172.21.15.7:0/1273479788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c90102790 msgr2=0x7f5c901067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.526+0000 7f5c960ee640 1 --2- 172.21.15.7:0/1273479788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c90102790 0x7f5c901067e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5c84009900 tx=0x7f5c8402a410 comp rx=0 tx=0).stop 2024-09-19T08:44:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.526+0000 7f5c960ee640 1 -- 172.21.15.7:0/1273479788 shutdown_connections 2024-09-19T08:44:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.526+0000 7f5c960ee640 1 --2- 172.21.15.7:0/1273479788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c90106f10 0x7f5c9010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.526+0000 7f5c960ee640 1 --2- 172.21.15.7:0/1273479788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c90102790 0x7f5c901067e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.526+0000 7f5c960ee640 1 --2- 172.21.15.7:0/1273479788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c90101de0 0x7f5c901021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.526+0000 7f5c960ee640 1 -- 172.21.15.7:0/1273479788 >> 172.21.15.7:0/1273479788 conn(0x7f5c900fd8c0 msgr2=0x7f5c900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.526+0000 7f5c960ee640 1 -- 172.21.15.7:0/1273479788 shutdown_connections 2024-09-19T08:44:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.526+0000 7f5c960ee640 1 -- 172.21.15.7:0/1273479788 wait complete. 2024-09-19T08:44:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.527+0000 7f5c960ee640 1 Processor -- start 2024-09-19T08:44:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.527+0000 7f5c960ee640 1 -- start start 2024-09-19T08:44:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.527+0000 7f5c960ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c90101de0 0x7f5c900744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.527+0000 7f5c960ee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c90102790 0x7f5c90074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.527+0000 7f5c960ee640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c90106f10 0x7f5c90074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.527+0000 7f5c960ee640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5c90111fc0 con 0x7f5c90102790 2024-09-19T08:44:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.527+0000 7f5c960ee640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5c90111e40 con 0x7f5c90101de0 2024-09-19T08:44:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.527+0000 7f5c960ee640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5c90112140 con 0x7f5c90106f10 2024-09-19T08:44:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.527+0000 7f5c8effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c90102790 0x7f5c90074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.528+0000 7f5c8effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c90102790 0x7f5c90074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41784/0 (socket says 172.21.15.7:41784) 2024-09-19T08:44:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.528+0000 7f5c8effd640 1 -- 172.21.15.7:0/2071354045 learned_addr learned my addr 172.21.15.7:0/2071354045 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:47.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.528+0000 7f5c8f7fe640 1 --2- 172.21.15.7:0/2071354045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c90101de0 0x7f5c900744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:47.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.528+0000 7f5c8ffff640 1 --2- 172.21.15.7:0/2071354045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c90106f10 0x7f5c90074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:47.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.528+0000 7f5c8effd640 1 -- 172.21.15.7:0/2071354045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c90106f10 msgr2=0x7f5c90074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:47.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.528+0000 7f5c8effd640 1 --2- 172.21.15.7:0/2071354045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c90106f10 0x7f5c90074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:47.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.528+0000 7f5c8effd640 1 -- 172.21.15.7:0/2071354045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c90101de0 msgr2=0x7f5c900744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:47.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.528+0000 7f5c8effd640 1 --2- 172.21.15.7:0/2071354045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c90101de0 0x7f5c900744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:47.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.528+0000 7f5c8effd640 1 -- 172.21.15.7:0/2071354045 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c901a6920 con 0x7f5c90102790 2024-09-19T08:44:47.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.528+0000 7f5c8f7fe640 1 --2- 172.21.15.7:0/2071354045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c90101de0 0x7f5c900744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:44:47.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.528+0000 7f5c8effd640 1 --2- 172.21.15.7:0/2071354045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c90102790 0x7f5c90074a30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5c84004770 tx=0x7f5c84003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:47.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.528+0000 7f5c8cff9640 1 -- 172.21.15.7:0/2071354045 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8403f070 con 0x7f5c90102790 2024-09-19T08:44:47.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.528+0000 7f5c8cff9640 1 -- 172.21.15.7:0/2071354045 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c84031ca0 con 0x7f5c90102790 2024-09-19T08:44:47.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.528+0000 7f5c8cff9640 1 -- 172.21.15.7:0/2071354045 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c84035030 con 0x7f5c90102790 2024-09-19T08:44:47.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.528+0000 7f5c960ee640 1 -- 172.21.15.7:0/2071354045 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c901a6bb0 con 0x7f5c90102790 2024-09-19T08:44:47.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.528+0000 7f5c960ee640 1 -- 172.21.15.7:0/2071354045 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c901a7090 con 0x7f5c90102790 2024-09-19T08:44:47.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.529+0000 7f5c960ee640 1 -- 172.21.15.7:0/2071354045 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c901021c0 con 0x7f5c90102790 2024-09-19T08:44:47.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.531+0000 7f5c8cff9640 1 -- 172.21.15.7:0/2071354045 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f5c84042070 con 0x7f5c90102790 2024-09-19T08:44:47.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.531+0000 7f5c8cff9640 1 --2- 172.21.15.7:0/2071354045 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5c780a3440 0x7f5c780a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:47.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.531+0000 7f5c8f7fe640 1 --2- 172.21.15.7:0/2071354045 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5c780a3440 0x7f5c780a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:47.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.531+0000 7f5c8cff9640 1 -- 172.21.15.7:0/2071354045 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f5c840f0550 con 0x7f5c90102790 2024-09-19T08:44:47.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.532+0000 7f5c8f7fe640 1 --2- 172.21.15.7:0/2071354045 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5c780a3440 0x7f5c780a5900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5c80009fc0 tx=0x7f5c80005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:47.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.535+0000 7f5c8cff9640 1 -- 172.21.15.7:0/2071354045 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5c840bc760 con 0x7f5c90102790 2024-09-19T08:44:47.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:47 smithi175 ceph-mon[35688]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:48.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.708+0000 7f5c960ee640 1 -- 172.21.15.7:0/2071354045 --> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c90062630 con 0x7f5c780a3440 2024-09-19T08:44:48.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.715+0000 7f5c8cff9640 1 -- 172.21.15.7:0/2071354045 <== mgr.15132 v2:172.21.15.7:6800/3061932294 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257762 (secure 0 0 0) 0x7f5c90062630 con 0x7f5c780a3440 2024-09-19T08:44:48.327 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:44:48.328 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-19T08:44:48.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.718+0000 7f5c960ee640 1 -- 172.21.15.7:0/2071354045 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5c780a3440 msgr2=0x7f5c780a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:48.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.718+0000 7f5c960ee640 1 --2- 172.21.15.7:0/2071354045 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5c780a3440 0x7f5c780a5900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5c80009fc0 tx=0x7f5c80005f90 comp rx=0 tx=0).stop 2024-09-19T08:44:48.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.718+0000 7f5c960ee640 1 -- 172.21.15.7:0/2071354045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c90102790 msgr2=0x7f5c90074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:48.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.718+0000 7f5c960ee640 1 --2- 172.21.15.7:0/2071354045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c90102790 0x7f5c90074a30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5c84004770 tx=0x7f5c84003c10 comp rx=0 tx=0).stop 2024-09-19T08:44:48.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.718+0000 7f5c960ee640 1 -- 172.21.15.7:0/2071354045 shutdown_connections 2024-09-19T08:44:48.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.718+0000 7f5c960ee640 1 --2- 172.21.15.7:0/2071354045 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5c780a3440 0x7f5c780a5900 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:48.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.718+0000 7f5c960ee640 1 --2- 172.21.15.7:0/2071354045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c90106f10 0x7f5c90074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:48.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.718+0000 7f5c960ee640 1 --2- 172.21.15.7:0/2071354045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c90102790 0x7f5c90074a30 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:48.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.718+0000 7f5c960ee640 1 --2- 172.21.15.7:0/2071354045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c90101de0 0x7f5c900744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:48.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.718+0000 7f5c960ee640 1 -- 172.21.15.7:0/2071354045 >> 172.21.15.7:0/2071354045 conn(0x7f5c900fd8c0 msgr2=0x7f5c900fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:48.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.719+0000 7f5c960ee640 1 -- 172.21.15.7:0/2071354045 shutdown_connections 2024-09-19T08:44:48.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:47.719+0000 7f5c960ee640 1 -- 172.21.15.7:0/2071354045 wait complete. 2024-09-19T08:44:48.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:48 smithi007 ceph-mon[31221]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-19T08:44:48.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:48 smithi007 ceph-mon[31221]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:48.470 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-19T08:44:47.185071+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1384695,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1128,"num_read_kb":932,"num_write":559,"num_write_kb":5030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1181934,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":921,"ondisk_log_size":921,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367848,"kb_used_data":14352,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124573976,"statfs":{"total":1151940427776,"available":1151563751424,"internally_reserved":0,"allocated":14696448,"data_stored":8857497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":351,"num_write":84,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002659"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226071+0000","last_change":"2024-09-19T08:42:44.035697+0000","last_active":"2024-09-19T08:44:31.226071+0000","last_peered":"2024-09-19T08:44:31.226071+0000","last_clean":"2024-09-19T08:44:31.226071+0000","last_became_active":"2024-09-19T08:42:44.035400+0000","last_became_peered":"2024-09-19T08:42:44.035400+0000","last_unstale":"2024-09-19T08:44:31.226071+0000","last_undegraded":"2024-09-19T08:44:31.226071+0000","last_fullsized":"2024-09-19T08:44:31.226071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:56.202947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.223958+0000","last_change":"2024-09-19T08:42:44.031393+0000","last_active":"2024-09-19T08:44:31.223958+0000","last_peered":"2024-09-19T08:44:31.223958+0000","last_clean":"2024-09-19T08:44:31.223958+0000","last_became_active":"2024-09-19T08:42:44.031056+0000","last_became_peered":"2024-09-19T08:42:44.031056+0000","last_unstale":"2024-09-19T08:44:31.223958+0000","last_undegraded":"2024-09-19T08:44:31.223958+0000","last_fullsized":"2024-09-19T08:44:31.223958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:44.694913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224221+0000","last_change":"2024-09-19T08:42:44.029586+0000","last_active":"2024-09-19T08:44:31.224221+0000","last_peered":"2024-09-19T08:44:31.224221+0000","last_clean":"2024-09-19T08:44:31.224221+0000","last_became_active":"2024-09-19T08:42:44.029279+0000","last_became_peered":"2024-09-19T08:42:44.029279+0000","last_unstale":"2024-09-19T08:44:31.224221+0000","last_undegraded":"2024-09-19T08:44:31.224221+0000","last_fullsized":"2024-09-19T08:44:31.224221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:12.036113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219401+0000","last_change":"2024-09-19T08:42:44.043192+0000","last_active":"2024-09-19T08:44:31.219401+0000","last_peered":"2024-09-19T08:44:31.219401+0000","last_clean":"2024-09-19T08:44:31.219401+0000","last_became_active":"2024-09-19T08:42:44.042838+0000","last_became_peered":"2024-09-19T08:42:44.042838+0000","last_unstale":"2024-09-19T08:44:31.219401+0000","last_undegraded":"2024-09-19T08:44:31.219401+0000","last_fullsized":"2024-09-19T08:44:31.219401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:20.549232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.207548+0000","last_change":"2024-09-19T08:42:44.032231+0000","last_active":"2024-09-19T08:44:31.207548+0000","last_peered":"2024-09-19T08:44:31.207548+0000","last_clean":"2024-09-19T08:44:31.207548+0000","last_became_active":"2024-09-19T08:42:44.031835+0000","last_became_peered":"2024-09-19T08:42:44.031835+0000","last_unstale":"2024-09-19T08:44:31.207548+0000","last_undegraded":"2024-09-19T08:44:31.207548+0000","last_fullsized":"2024-09-19T08:44:31.207548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:49.084085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.209888+0000","last_change":"2024-09-19T08:42:44.035487+0000","last_active":"2024-09-19T08:44:31.209888+0000","last_peered":"2024-09-19T08:44:31.209888+0000","last_clean":"2024-09-19T08:44:31.209888+0000","last_became_active":"2024-09-19T08:42:44.035138+0000","last_became_peered":"2024-09-19T08:42:44.035138+0000","last_unstale":"2024-09-19T08:44:31.209888+0000","last_undegraded":"2024-09-19T08:44:31.209888+0000","last_fullsized":"2024-09-19T08:44:31.209888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:43.483397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212841+0000","last_change":"2024-09-19T08:42:44.029052+0000","last_active":"2024-09-19T08:44:31.212841+0000","last_peered":"2024-09-19T08:44:31.212841+0000","last_clean":"2024-09-19T08:44:31.212841+0000","last_became_active":"2024-09-19T08:42:44.028722+0000","last_became_peered":"2024-09-19T08:42:44.028722+0000","last_unstale":"2024-09-19T08:44:31.212841+0000","last_undegraded":"2024-09-19T08:44:31.212841+0000","last_fullsized":"2024-09-19T08:44:31.212841+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:49.226044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212167+0000","last_change":"2024-09-19T08:42:44.031401+0000","last_active":"2024-09-19T08:44:31.212167+0000","last_peered":"2024-09-19T08:44:31.212167+0000","last_clean":"2024-09-19T08:44:31.212167+0000","last_became_active":"2024-09-19T08:42:44.031103+0000","last_became_peered":"2024-09-19T08:42:44.031103+0000","last_unstale":"2024-09-19T08:44:31.212167+0000","last_undegraded":"2024-09-19T08:44:31.212167+0000","last_fullsized":"2024-09-19T08:44:31.212167+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:57.406765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224039+0000","last_change":"2024-09-19T08:42:44.033011+0000","last_active":"2024-09-19T08:44:31.224039+0000","last_peered":"2024-09-19T08:44:31.224039+0000","last_clean":"2024-09-19T08:44:31.224039+0000","last_became_active":"2024-09-19T08:42:44.032075+0000","last_became_peered":"2024-09-19T08:42:44.032075+0000","last_unstale":"2024-09-19T08:44:31.224039+0000","last_undegraded":"2024-09-19T08:44:31.224039+0000","last_fullsized":"2024-09-19T08:44:31.224039+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:43.701684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212881+0000","last_change":"2024-09-19T08:42:44.037417+0000","last_active":"2024-09-19T08:44:31.212881+0000","last_peered":"2024-09-19T08:44:31.212881+0000","last_clean":"2024-09-19T08:44:31.212881+0000","last_became_active":"2024-09-19T08:42:44.037006+0000","last_became_peered":"2024-09-19T08:42:44.037006+0000","last_unstale":"2024-09-19T08:44:31.212881+0000","last_undegraded":"2024-09-19T08:44:31.212881+0000","last_fullsized":"2024-09-19T08:44:31.212881+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:10.952939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225737+0000","last_change":"2024-09-19T08:42:44.034125+0000","last_active":"2024-09-19T08:44:31.225737+0000","last_peered":"2024-09-19T08:44:31.225737+0000","last_clean":"2024-09-19T08:44:31.225737+0000","last_became_active":"2024-09-19T08:42:44.033772+0000","last_became_peered":"2024-09-19T08:42:44.033772+0000","last_unstale":"2024-09-19T08:44:31.225737+0000","last_undegraded":"2024-09-19T08:44:31.225737+0000","last_fullsized":"2024-09-19T08:44:31.225737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:42.854137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219105+0000","last_change":"2024-09-19T08:42:44.043047+0000","last_active":"2024-09-19T08:44:31.219105+0000","last_peered":"2024-09-19T08:44:31.219105+0000","last_clean":"2024-09-19T08:44:31.219105+0000","last_became_active":"2024-09-19T08:42:44.042666+0000","last_became_peered":"2024-09-19T08:42:44.042666+0000","last_unstale":"2024-09-19T08:44:31.219105+0000","last_undegraded":"2024-09-19T08:44:31.219105+0000","last_fullsized":"2024-09-19T08:44:31.219105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:16.504824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208420+0000","last_change":"2024-09-19T08:42:44.026475+0000","last_active":"2024-09-19T08:44:31.208420+0000","last_peered":"2024-09-19T08:44:31.208420+0000","last_clean":"2024-09-19T08:44:31.208420+0000","last_became_active":"2024-09-19T08:42:44.026169+0000","last_became_peered":"2024-09-19T08:42:44.026169+0000","last_unstale":"2024-09-19T08:44:31.208420+0000","last_undegraded":"2024-09-19T08:44:31.208420+0000","last_fullsized":"2024-09-19T08:44:31.208420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:17.130267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222128+0000","last_change":"2024-09-19T08:42:44.033725+0000","last_active":"2024-09-19T08:44:31.222128+0000","last_peered":"2024-09-19T08:44:31.222128+0000","last_clean":"2024-09-19T08:44:31.222128+0000","last_became_active":"2024-09-19T08:42:44.033304+0000","last_became_peered":"2024-09-19T08:42:44.033304+0000","last_unstale":"2024-09-19T08:44:31.222128+0000","last_undegraded":"2024-09-19T08:44:31.222128+0000","last_fullsized":"2024-09-19T08:44:31.222128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:47.520808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224694+0000","last_change":"2024-09-19T08:42:44.041762+0000","last_active":"2024-09-19T08:44:31.224694+0000","last_peered":"2024-09-19T08:44:31.224694+0000","last_clean":"2024-09-19T08:44:31.224694+0000","last_became_active":"2024-09-19T08:42:44.041433+0000","last_became_peered":"2024-09-19T08:42:44.041433+0000","last_unstale":"2024-09-19T08:44:31.224694+0000","last_undegraded":"2024-09-19T08:44:31.224694+0000","last_fullsized":"2024-09-19T08:44:31.224694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:05.504873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226669+0000","last_change":"2024-09-19T08:42:44.030316+0000","last_active":"2024-09-19T08:44:31.226669+0000","last_peered":"2024-09-19T08:44:31.226669+0000","last_clean":"2024-09-19T08:44:31.226669+0000","last_became_active":"2024-09-19T08:42:44.029872+0000","last_became_peered":"2024-09-19T08:42:44.029872+0000","last_unstale":"2024-09-19T08:44:31.226669+0000","last_undegraded":"2024-09-19T08:44:31.226669+0000","last_fullsized":"2024-09-19T08:44:31.226669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:18.011019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226224+0000","last_change":"2024-09-19T08:42:44.035523+0000","last_active":"2024-09-19T08:44:31.226224+0000","last_peered":"2024-09-19T08:44:31.226224+0000","last_clean":"2024-09-19T08:44:31.226224+0000","last_became_active":"2024-09-19T08:42:44.035185+0000","last_became_peered":"2024-09-19T08:42:44.035185+0000","last_unstale":"2024-09-19T08:44:31.226224+0000","last_undegraded":"2024-09-19T08:44:31.226224+0000","last_fullsized":"2024-09-19T08:44:31.226224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:03.475458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222791+0000","last_change":"2024-09-19T08:42:44.031803+0000","last_active":"2024-09-19T08:44:31.222791+0000","last_peered":"2024-09-19T08:44:31.222791+0000","last_clean":"2024-09-19T08:44:31.222791+0000","last_became_active":"2024-09-19T08:42:44.031501+0000","last_became_peered":"2024-09-19T08:42:44.031501+0000","last_unstale":"2024-09-19T08:44:31.222791+0000","last_undegraded":"2024-09-19T08:44:31.222791+0000","last_fullsized":"2024-09-19T08:44:31.222791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:31.780744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.211603+0000","last_change":"2024-09-19T08:42:44.036168+0000","last_active":"2024-09-19T08:44:31.211603+0000","last_peered":"2024-09-19T08:44:31.211603+0000","last_clean":"2024-09-19T08:44:31.211603+0000","last_became_active":"2024-09-19T08:42:44.035819+0000","last_became_peered":"2024-09-19T08:42:44.035819+0000","last_unstale":"2024-09-19T08:44:31.211603+0000","last_undegraded":"2024-09-19T08:44:31.211603+0000","last_fullsized":"2024-09-19T08:44:31.211603+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:26.478389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.220605+0000","last_change":"2024-09-19T08:42:44.037569+0000","last_active":"2024-09-19T08:44:31.220605+0000","last_peered":"2024-09-19T08:44:31.220605+0000","last_clean":"2024-09-19T08:44:31.220605+0000","last_became_active":"2024-09-19T08:42:44.037161+0000","last_became_peered":"2024-09-19T08:42:44.037161+0000","last_unstale":"2024-09-19T08:44:31.220605+0000","last_undegraded":"2024-09-19T08:44:31.220605+0000","last_fullsized":"2024-09-19T08:44:31.220605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:35.316314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226011+0000","last_change":"2024-09-19T08:42:44.023160+0000","last_active":"2024-09-19T08:44:31.226011+0000","last_peered":"2024-09-19T08:44:31.226011+0000","last_clean":"2024-09-19T08:44:31.226011+0000","last_became_active":"2024-09-19T08:42:44.022791+0000","last_became_peered":"2024-09-19T08:42:44.022791+0000","last_unstale":"2024-09-19T08:44:31.226011+0000","last_undegraded":"2024-09-19T08:44:31.226011+0000","last_fullsized":"2024-09-19T08:44:31.226011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:00.174583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225075+0000","last_change":"2024-09-19T08:42:44.035877+0000","last_active":"2024-09-19T08:44:31.225075+0000","last_peered":"2024-09-19T08:44:31.225075+0000","last_clean":"2024-09-19T08:44:31.225075+0000","last_became_active":"2024-09-19T08:42:44.035307+0000","last_became_peered":"2024-09-19T08:42:44.035307+0000","last_unstale":"2024-09-19T08:44:31.225075+0000","last_undegraded":"2024-09-19T08:44:31.225075+0000","last_fullsized":"2024-09-19T08:44:31.225075+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:54.717130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219964+0000","last_change":"2024-09-19T08:42:44.033536+0000","last_active":"2024-09-19T08:44:31.219964+0000","last_peered":"2024-09-19T08:44:31.219964+0000","last_clean":"2024-09-19T08:44:31.219964+0000","last_became_active":"2024-09-19T08:42:44.033179+0000","last_became_peered":"2024-09-19T08:42:44.033179+0000","last_unstale":"2024-09-19T08:44:31.219964+0000","last_undegraded":"2024-09-19T08:44:31.219964+0000","last_fullsized":"2024-09-19T08:44:31.219964+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:11.161785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.210217+0000","last_change":"2024-09-19T08:42:44.029674+0000","last_active":"2024-09-19T08:44:31.210217+0000","last_peered":"2024-09-19T08:44:31.210217+0000","last_clean":"2024-09-19T08:44:31.210217+0000","last_became_active":"2024-09-19T08:42:44.029368+0000","last_became_peered":"2024-09-19T08:42:44.029368+0000","last_unstale":"2024-09-19T08:44:31.210217+0000","last_undegraded":"2024-09-19T08:44:31.210217+0000","last_fullsized":"2024-09-19T08:44:31.210217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:34.943363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.213448+0000","last_change":"2024-09-19T08:42:44.039780+0000","last_active":"2024-09-19T08:44:31.213448+0000","last_peered":"2024-09-19T08:44:31.213448+0000","last_clean":"2024-09-19T08:44:31.213448+0000","last_became_active":"2024-09-19T08:42:44.039409+0000","last_became_peered":"2024-09-19T08:42:44.039409+0000","last_unstale":"2024-09-19T08:44:31.213448+0000","last_undegraded":"2024-09-19T08:44:31.213448+0000","last_fullsized":"2024-09-19T08:44:31.213448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:59.632132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.214979+0000","last_change":"2024-09-19T08:42:44.030881+0000","last_active":"2024-09-19T08:44:31.214979+0000","last_peered":"2024-09-19T08:44:31.214979+0000","last_clean":"2024-09-19T08:44:31.214979+0000","last_became_active":"2024-09-19T08:42:44.030530+0000","last_became_peered":"2024-09-19T08:42:44.030530+0000","last_unstale":"2024-09-19T08:44:31.214979+0000","last_undegraded":"2024-09-19T08:44:31.214979+0000","last_fullsized":"2024-09-19T08:44:31.214979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:16.908450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.214928+0000","last_change":"2024-09-19T08:42:44.033056+0000","last_active":"2024-09-19T08:44:31.214928+0000","last_peered":"2024-09-19T08:44:31.214928+0000","last_clean":"2024-09-19T08:44:31.214928+0000","last_became_active":"2024-09-19T08:42:44.032690+0000","last_became_peered":"2024-09-19T08:42:44.032690+0000","last_unstale":"2024-09-19T08:44:31.214928+0000","last_undegraded":"2024-09-19T08:44:31.214928+0000","last_fullsized":"2024-09-19T08:44:31.214928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:36.497824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225043+0000","last_change":"2024-09-19T08:42:58.106551+0000","last_active":"2024-09-19T08:44:31.225043+0000","last_peered":"2024-09-19T08:44:31.225043+0000","last_clean":"2024-09-19T08:44:31.225043+0000","last_became_active":"2024-09-19T08:42:58.106119+0000","last_became_peered":"2024-09-19T08:42:58.106119+0000","last_unstale":"2024-09-19T08:44:31.225043+0000","last_undegraded":"2024-09-19T08:44:31.225043+0000","last_fullsized":"2024-09-19T08:44:31.225043+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:46.794260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226527+0000","last_change":"2024-09-19T08:42:58.108106+0000","last_active":"2024-09-19T08:44:31.226527+0000","last_peered":"2024-09-19T08:44:31.226527+0000","last_clean":"2024-09-19T08:44:31.226527+0000","last_became_active":"2024-09-19T08:42:58.107532+0000","last_became_peered":"2024-09-19T08:42:58.107532+0000","last_unstale":"2024-09-19T08:44:31.226527+0000","last_undegraded":"2024-09-19T08:44:31.226527+0000","last_fullsized":"2024-09-19T08:44:31.226527+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:29.164983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224871+0000","last_change":"2024-09-19T08:42:44.029822+0000","last_active":"2024-09-19T08:44:31.224871+0000","last_peered":"2024-09-19T08:44:31.224871+0000","last_clean":"2024-09-19T08:44:31.224871+0000","last_became_active":"2024-09-19T08:42:44.029450+0000","last_became_peered":"2024-09-19T08:42:44.029450+0000","last_unstale":"2024-09-19T08:44:31.224871+0000","last_undegraded":"2024-09-19T08:44:31.224871+0000","last_fullsized":"2024-09-19T08:44:31.224871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:40.826261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.210860+0000","last_change":"2024-09-19T08:42:44.041354+0000","last_active":"2024-09-19T08:44:31.210860+0000","last_peered":"2024-09-19T08:44:31.210860+0000","last_clean":"2024-09-19T08:44:31.210860+0000","last_became_active":"2024-09-19T08:42:44.040912+0000","last_became_peered":"2024-09-19T08:42:44.040912+0000","last_unstale":"2024-09-19T08:44:31.210860+0000","last_undegraded":"2024-09-19T08:44:31.210860+0000","last_fullsized":"2024-09-19T08:44:31.210860+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:16.543950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.217246+0000","last_change":"2024-09-19T08:42:44.027912+0000","last_active":"2024-09-19T08:44:31.217246+0000","last_peered":"2024-09-19T08:44:31.217246+0000","last_clean":"2024-09-19T08:44:31.217246+0000","last_became_active":"2024-09-19T08:42:44.027505+0000","last_became_peered":"2024-09-19T08:42:44.027505+0000","last_unstale":"2024-09-19T08:44:31.217246+0000","last_undegraded":"2024-09-19T08:44:31.217246+0000","last_fullsized":"2024-09-19T08:44:31.217246+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:02.552756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208688+0000","last_change":"2024-09-19T08:42:44.034472+0000","last_active":"2024-09-19T08:44:31.208688+0000","last_peered":"2024-09-19T08:44:31.208688+0000","last_clean":"2024-09-19T08:44:31.208688+0000","last_became_active":"2024-09-19T08:42:44.034026+0000","last_became_peered":"2024-09-19T08:42:44.034026+0000","last_unstale":"2024-09-19T08:44:31.208688+0000","last_undegraded":"2024-09-19T08:44:31.208688+0000","last_fullsized":"2024-09-19T08:44:31.208688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:10.058882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'10","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:40.252860+0000","last_change":"2024-09-19T08:42:41.927174+0000","last_active":"2024-09-19T08:44:40.252860+0000","last_peered":"2024-09-19T08:44:40.252860+0000","last_clean":"2024-09-19T08:44:40.252860+0000","last_became_active":"2024-09-19T08:42:41.926826+0000","last_became_peered":"2024-09-19T08:42:41.926826+0000","last_unstale":"2024-09-19T08:44:40.252860+0000","last_undegraded":"2024-09-19T08:44:40.252860+0000","last_fullsized":"2024-09-19T08:44:40.252860+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:37.274891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2250,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.210827+0000","last_change":"2024-09-19T08:42:58.110259+0000","last_active":"2024-09-19T08:44:31.210827+0000","last_peered":"2024-09-19T08:44:31.210827+0000","last_clean":"2024-09-19T08:44:31.210827+0000","last_became_active":"2024-09-19T08:42:58.109803+0000","last_became_peered":"2024-09-19T08:42:58.109803+0000","last_unstale":"2024-09-19T08:44:31.210827+0000","last_undegraded":"2024-09-19T08:44:31.210827+0000","last_fullsized":"2024-09-19T08:44:31.210827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:31.853404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177196+0000","last_change":"2024-09-19T08:42:58.114222+0000","last_active":"2024-09-19T08:44:31.177196+0000","last_peered":"2024-09-19T08:44:31.177196+0000","last_clean":"2024-09-19T08:44:31.177196+0000","last_became_active":"2024-09-19T08:42:58.110769+0000","last_became_peered":"2024-09-19T08:42:58.110769+0000","last_unstale":"2024-09-19T08:44:31.177196+0000","last_undegraded":"2024-09-19T08:44:31.177196+0000","last_fullsized":"2024-09-19T08:44:31.177196+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:17.952228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.176271+0000","last_change":"2024-09-19T08:42:41.923903+0000","last_active":"2024-09-19T08:44:31.176271+0000","last_peered":"2024-09-19T08:44:31.176271+0000","last_clean":"2024-09-19T08:44:31.176271+0000","last_became_active":"2024-09-19T08:42:41.923583+0000","last_became_peered":"2024-09-19T08:42:41.923583+0000","last_unstale":"2024-09-19T08:44:31.176271+0000","last_undegraded":"2024-09-19T08:44:31.176271+0000","last_fullsized":"2024-09-19T08:44:31.176271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:48.594343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219641+0000","last_change":"2024-09-19T08:42:44.028972+0000","last_active":"2024-09-19T08:44:31.219641+0000","last_peered":"2024-09-19T08:44:31.219641+0000","last_clean":"2024-09-19T08:44:31.219641+0000","last_became_active":"2024-09-19T08:42:44.028657+0000","last_became_peered":"2024-09-19T08:42:44.028657+0000","last_unstale":"2024-09-19T08:44:31.219641+0000","last_undegraded":"2024-09-19T08:44:31.219641+0000","last_fullsized":"2024-09-19T08:44:31.219641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:43.618010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178701+0000","last_change":"2024-09-19T08:42:41.926558+0000","last_active":"2024-09-19T08:44:31.178701+0000","last_peered":"2024-09-19T08:44:31.178701+0000","last_clean":"2024-09-19T08:44:31.178701+0000","last_became_active":"2024-09-19T08:42:41.926074+0000","last_became_peered":"2024-09-19T08:42:41.926074+0000","last_unstale":"2024-09-19T08:44:31.178701+0000","last_undegraded":"2024-09-19T08:44:31.178701+0000","last_fullsized":"2024-09-19T08:44:31.178701+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:47.563295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.223532+0000","last_change":"2024-09-19T08:42:44.029191+0000","last_active":"2024-09-19T08:44:31.223532+0000","last_peered":"2024-09-19T08:44:31.223532+0000","last_clean":"2024-09-19T08:44:31.223532+0000","last_became_active":"2024-09-19T08:42:44.028871+0000","last_became_peered":"2024-09-19T08:42:44.028871+0000","last_unstale":"2024-09-19T08:44:31.223532+0000","last_undegraded":"2024-09-19T08:44:31.223532+0000","last_fullsized":"2024-09-19T08:44:31.223532+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:41.262014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":136,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:40.252212+0000","last_change":"2024-09-19T08:42:41.930265+0000","last_active":"2024-09-19T08:44:40.252212+0000","last_peered":"2024-09-19T08:44:40.252212+0000","last_clean":"2024-09-19T08:44:40.252212+0000","last_became_active":"2024-09-19T08:42:41.929829+0000","last_became_peered":"2024-09-19T08:42:41.929829+0000","last_unstale":"2024-09-19T08:44:40.252212+0000","last_undegraded":"2024-09-19T08:44:40.252212+0000","last_fullsized":"2024-09-19T08:44:40.252212+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:59.181622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224033+0000","last_change":"2024-09-19T08:42:44.027382+0000","last_active":"2024-09-19T08:44:31.224033+0000","last_peered":"2024-09-19T08:44:31.224033+0000","last_clean":"2024-09-19T08:44:31.224033+0000","last_became_active":"2024-09-19T08:42:44.026824+0000","last_became_peered":"2024-09-19T08:42:44.026824+0000","last_unstale":"2024-09-19T08:44:31.224033+0000","last_undegraded":"2024-09-19T08:44:31.224033+0000","last_fullsized":"2024-09-19T08:44:31.224033+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:58.520068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.180283+0000","last_change":"2024-09-19T08:42:41.927914+0000","last_active":"2024-09-19T08:44:31.180283+0000","last_peered":"2024-09-19T08:44:31.180283+0000","last_clean":"2024-09-19T08:44:31.180283+0000","last_became_active":"2024-09-19T08:42:41.926566+0000","last_became_peered":"2024-09-19T08:42:41.926566+0000","last_unstale":"2024-09-19T08:44:31.180283+0000","last_undegraded":"2024-09-19T08:44:31.180283+0000","last_fullsized":"2024-09-19T08:44:31.180283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:52.238352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.224677+0000","last_change":"2024-09-19T08:42:44.039899+0000","last_active":"2024-09-19T08:44:31.224677+0000","last_peered":"2024-09-19T08:44:31.224677+0000","last_clean":"2024-09-19T08:44:31.224677+0000","last_became_active":"2024-09-19T08:42:44.039530+0000","last_became_peered":"2024-09-19T08:42:44.039530+0000","last_unstale":"2024-09-19T08:44:31.224677+0000","last_undegraded":"2024-09-19T08:44:31.224677+0000","last_fullsized":"2024-09-19T08:44:31.224677+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:20.960211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178662+0000","last_change":"2024-09-19T08:42:42.410128+0000","last_active":"2024-09-19T08:44:31.178662+0000","last_peered":"2024-09-19T08:44:31.178662+0000","last_clean":"2024-09-19T08:44:31.178662+0000","last_became_active":"2024-09-19T08:42:42.409717+0000","last_became_peered":"2024-09-19T08:42:42.409717+0000","last_unstale":"2024-09-19T08:44:31.178662+0000","last_undegraded":"2024-09-19T08:44:31.178662+0000","last_fullsized":"2024-09-19T08:44:31.178662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:41.682355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225965+0000","last_change":"2024-09-19T08:42:44.043248+0000","last_active":"2024-09-19T08:44:31.225965+0000","last_peered":"2024-09-19T08:44:31.225965+0000","last_clean":"2024-09-19T08:44:31.225965+0000","last_became_active":"2024-09-19T08:42:44.042849+0000","last_became_peered":"2024-09-19T08:42:44.042849+0000","last_unstale":"2024-09-19T08:44:31.225965+0000","last_undegraded":"2024-09-19T08:44:31.225965+0000","last_fullsized":"2024-09-19T08:44:31.225965+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:00.413217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'34","reported_seq":287,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:41.253653+0000","last_change":"2024-09-19T08:42:41.926582+0000","last_active":"2024-09-19T08:44:41.253653+0000","last_peered":"2024-09-19T08:44:41.253653+0000","last_clean":"2024-09-19T08:44:41.253653+0000","last_became_active":"2024-09-19T08:42:41.926234+0000","last_became_peered":"2024-09-19T08:42:41.926234+0000","last_unstale":"2024-09-19T08:44:41.253653+0000","last_undegraded":"2024-09-19T08:44:41.253653+0000","last_fullsized":"2024-09-19T08:44:41.253653+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:02.498976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":229,"num_read_kb":179,"num_write":35,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.199159+0000","last_change":"2024-09-19T08:42:44.034888+0000","last_active":"2024-09-19T08:44:31.199159+0000","last_peered":"2024-09-19T08:44:31.199159+0000","last_clean":"2024-09-19T08:44:31.199159+0000","last_became_active":"2024-09-19T08:42:44.034553+0000","last_became_peered":"2024-09-19T08:42:44.034553+0000","last_unstale":"2024-09-19T08:44:31.199159+0000","last_undegraded":"2024-09-19T08:44:31.199159+0000","last_fullsized":"2024-09-19T08:44:31.199159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:06.416289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.181995+0000","last_change":"2024-09-19T08:42:58.117912+0000","last_active":"2024-09-19T08:44:31.181995+0000","last_peered":"2024-09-19T08:44:31.181995+0000","last_clean":"2024-09-19T08:44:31.181995+0000","last_became_active":"2024-09-19T08:42:58.105810+0000","last_became_peered":"2024-09-19T08:42:58.105810+0000","last_unstale":"2024-09-19T08:44:31.181995+0000","last_undegraded":"2024-09-19T08:44:31.181995+0000","last_fullsized":"2024-09-19T08:44:31.181995+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:44.258256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.213617+0000","last_change":"2024-09-19T08:42:44.030519+0000","last_active":"2024-09-19T08:44:31.213617+0000","last_peered":"2024-09-19T08:44:31.213617+0000","last_clean":"2024-09-19T08:44:31.213617+0000","last_became_active":"2024-09-19T08:42:44.030190+0000","last_became_peered":"2024-09-19T08:42:44.030190+0000","last_unstale":"2024-09-19T08:44:31.213617+0000","last_undegraded":"2024-09-19T08:44:31.213617+0000","last_fullsized":"2024-09-19T08:44:31.213617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:20.220642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178349+0000","last_change":"2024-09-19T08:42:41.928124+0000","last_active":"2024-09-19T08:44:31.178349+0000","last_peered":"2024-09-19T08:44:31.178349+0000","last_clean":"2024-09-19T08:44:31.178349+0000","last_became_active":"2024-09-19T08:42:41.927761+0000","last_became_peered":"2024-09-19T08:42:41.927761+0000","last_unstale":"2024-09-19T08:44:31.178349+0000","last_undegraded":"2024-09-19T08:44:31.178349+0000","last_fullsized":"2024-09-19T08:44:31.178349+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:08.591270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.218267+0000","last_change":"2024-09-19T08:42:44.038234+0000","last_active":"2024-09-19T08:44:31.218267+0000","last_peered":"2024-09-19T08:44:31.218267+0000","last_clean":"2024-09-19T08:44:31.218267+0000","last_became_active":"2024-09-19T08:42:44.037726+0000","last_became_peered":"2024-09-19T08:42:44.037726+0000","last_unstale":"2024-09-19T08:44:31.218267+0000","last_undegraded":"2024-09-19T08:44:31.218267+0000","last_fullsized":"2024-09-19T08:44:31.218267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:08.865482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:40.252204+0000","last_change":"2024-09-19T08:42:41.926206+0000","last_active":"2024-09-19T08:44:40.252204+0000","last_peered":"2024-09-19T08:44:40.252204+0000","last_clean":"2024-09-19T08:44:40.252204+0000","last_became_active":"2024-09-19T08:42:41.925833+0000","last_became_peered":"2024-09-19T08:42:41.925833+0000","last_unstale":"2024-09-19T08:44:40.252204+0000","last_undegraded":"2024-09-19T08:44:40.252204+0000","last_fullsized":"2024-09-19T08:44:40.252204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:27.944240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208340+0000","last_change":"2024-09-19T08:42:44.037181+0000","last_active":"2024-09-19T08:44:31.208340+0000","last_peered":"2024-09-19T08:44:31.208340+0000","last_clean":"2024-09-19T08:44:31.208340+0000","last_became_active":"2024-09-19T08:42:44.036865+0000","last_became_peered":"2024-09-19T08:42:44.036865+0000","last_unstale":"2024-09-19T08:44:31.208340+0000","last_undegraded":"2024-09-19T08:44:31.208340+0000","last_fullsized":"2024-09-19T08:44:31.208340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:20.233309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.169922+0000","last_change":"2024-09-19T08:42:42.408446+0000","last_active":"2024-09-19T08:44:31.169922+0000","last_peered":"2024-09-19T08:44:31.169922+0000","last_clean":"2024-09-19T08:44:31.169922+0000","last_became_active":"2024-09-19T08:42:42.408098+0000","last_became_peered":"2024-09-19T08:42:42.408098+0000","last_unstale":"2024-09-19T08:44:31.169922+0000","last_undegraded":"2024-09-19T08:44:31.169922+0000","last_fullsized":"2024-09-19T08:44:31.169922+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:22.603604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225407+0000","last_change":"2024-09-19T08:42:44.039954+0000","last_active":"2024-09-19T08:44:31.225407+0000","last_peered":"2024-09-19T08:44:31.225407+0000","last_clean":"2024-09-19T08:44:31.225407+0000","last_became_active":"2024-09-19T08:42:44.039601+0000","last_became_peered":"2024-09-19T08:42:44.039601+0000","last_unstale":"2024-09-19T08:44:31.225407+0000","last_undegraded":"2024-09-19T08:44:31.225407+0000","last_fullsized":"2024-09-19T08:44:31.225407+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:07.792167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'3","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170390+0000","last_change":"2024-09-19T08:42:41.929644+0000","last_active":"2024-09-19T08:44:31.170390+0000","last_peered":"2024-09-19T08:44:31.170390+0000","last_clean":"2024-09-19T08:44:31.170390+0000","last_became_active":"2024-09-19T08:42:41.929308+0000","last_became_peered":"2024-09-19T08:42:41.929308+0000","last_unstale":"2024-09-19T08:44:31.170390+0000","last_undegraded":"2024-09-19T08:44:31.170390+0000","last_fullsized":"2024-09-19T08:44:31.170390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:36.660470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222570+0000","last_change":"2024-09-19T08:42:58.107555+0000","last_active":"2024-09-19T08:44:31.222570+0000","last_peered":"2024-09-19T08:44:31.222570+0000","last_clean":"2024-09-19T08:44:31.222570+0000","last_became_active":"2024-09-19T08:42:58.107137+0000","last_became_peered":"2024-09-19T08:42:58.107137+0000","last_unstale":"2024-09-19T08:44:31.222570+0000","last_undegraded":"2024-09-19T08:44:31.222570+0000","last_fullsized":"2024-09-19T08:44:31.222570+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:13.198911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.176594+0000","last_change":"2024-09-19T08:42:41.925195+0000","last_active":"2024-09-19T08:44:31.176594+0000","last_peered":"2024-09-19T08:44:31.176594+0000","last_clean":"2024-09-19T08:44:31.176594+0000","last_became_active":"2024-09-19T08:42:41.924880+0000","last_became_peered":"2024-09-19T08:42:41.924880+0000","last_unstale":"2024-09-19T08:44:31.176594+0000","last_undegraded":"2024-09-19T08:44:31.176594+0000","last_fullsized":"2024-09-19T08:44:31.176594+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:11.256881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.219778+0000","last_change":"2024-09-19T08:42:44.036439+0000","last_active":"2024-09-19T08:44:31.219778+0000","last_peered":"2024-09-19T08:44:31.219778+0000","last_clean":"2024-09-19T08:44:31.219778+0000","last_became_active":"2024-09-19T08:42:44.036036+0000","last_became_peered":"2024-09-19T08:42:44.036036+0000","last_unstale":"2024-09-19T08:44:31.219778+0000","last_undegraded":"2024-09-19T08:44:31.219778+0000","last_fullsized":"2024-09-19T08:44:31.219778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:37.410782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'57","reported_seq":99,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:41.884313+0000","last_change":"2024-09-19T08:42:41.927490+0000","last_active":"2024-09-19T08:44:41.884313+0000","last_peered":"2024-09-19T08:44:41.884313+0000","last_clean":"2024-09-19T08:44:41.884313+0000","last_became_active":"2024-09-19T08:42:41.927163+0000","last_became_peered":"2024-09-19T08:42:41.927163+0000","last_unstale":"2024-09-19T08:44:41.884313+0000","last_undegraded":"2024-09-19T08:44:41.884313+0000","last_fullsized":"2024-09-19T08:44:41.884313+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:20.013661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":68,"num_write_kb":807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.208966+0000","last_change":"2024-09-19T08:42:44.036960+0000","last_active":"2024-09-19T08:44:31.208966+0000","last_peered":"2024-09-19T08:44:31.208966+0000","last_clean":"2024-09-19T08:44:31.208966+0000","last_became_active":"2024-09-19T08:42:44.036600+0000","last_became_peered":"2024-09-19T08:42:44.036600+0000","last_unstale":"2024-09-19T08:44:31.208966+0000","last_undegraded":"2024-09-19T08:44:31.208966+0000","last_fullsized":"2024-09-19T08:44:31.208966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:15.621888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177396+0000","last_change":"2024-09-19T08:42:58.114698+0000","last_active":"2024-09-19T08:44:31.177396+0000","last_peered":"2024-09-19T08:44:31.177396+0000","last_clean":"2024-09-19T08:44:31.177396+0000","last_became_active":"2024-09-19T08:42:58.105488+0000","last_became_peered":"2024-09-19T08:42:58.105488+0000","last_unstale":"2024-09-19T08:44:31.177396+0000","last_undegraded":"2024-09-19T08:44:31.177396+0000","last_fullsized":"2024-09-19T08:44:31.177396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:12.642715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225878+0000","last_change":"2024-09-19T08:42:44.035569+0000","last_active":"2024-09-19T08:44:31.225878+0000","last_peered":"2024-09-19T08:44:31.225878+0000","last_clean":"2024-09-19T08:44:31.225878+0000","last_became_active":"2024-09-19T08:42:44.035277+0000","last_became_peered":"2024-09-19T08:42:44.035277+0000","last_unstale":"2024-09-19T08:44:31.225878+0000","last_undegraded":"2024-09-19T08:44:31.225878+0000","last_fullsized":"2024-09-19T08:44:31.225878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:57.472721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"83'148","reported_seq":392,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:33.303710+0000","last_change":"2024-09-19T08:41:34.769047+0000","last_active":"2024-09-19T08:44:33.303710+0000","last_peered":"2024-09-19T08:44:33.303710+0000","last_clean":"2024-09-19T08:44:33.303710+0000","last_became_active":"2024-09-19T08:41:34.768619+0000","last_became_peered":"2024-09-19T08:41:34.768619+0000","last_unstale":"2024-09-19T08:44:33.303710+0000","last_undegraded":"2024-09-19T08:44:33.303710+0000","last_fullsized":"2024-09-19T08:44:33.303710+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:13.482855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:13.482855+0000","last_clean_scrub_stamp":"2024-09-19T08:38:13.482855+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.390775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177359+0000","last_change":"2024-09-19T08:42:41.925698+0000","last_active":"2024-09-19T08:44:31.177359+0000","last_peered":"2024-09-19T08:44:31.177359+0000","last_clean":"2024-09-19T08:44:31.177359+0000","last_became_active":"2024-09-19T08:42:41.924618+0000","last_became_peered":"2024-09-19T08:42:41.924618+0000","last_unstale":"2024-09-19T08:44:31.177359+0000","last_undegraded":"2024-09-19T08:44:31.177359+0000","last_fullsized":"2024-09-19T08:44:31.177359+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:53.717139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.222668+0000","last_change":"2024-09-19T08:42:58.111206+0000","last_active":"2024-09-19T08:44:31.222668+0000","last_peered":"2024-09-19T08:44:31.222668+0000","last_clean":"2024-09-19T08:44:31.222668+0000","last_became_active":"2024-09-19T08:42:58.110765+0000","last_became_peered":"2024-09-19T08:42:58.110765+0000","last_unstale":"2024-09-19T08:44:31.222668+0000","last_undegraded":"2024-09-19T08:44:31.222668+0000","last_fullsized":"2024-09-19T08:44:31.222668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:44.783938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.180014+0000","last_change":"2024-09-19T08:42:41.928414+0000","last_active":"2024-09-19T08:44:31.180014+0000","last_peered":"2024-09-19T08:44:31.180014+0000","last_clean":"2024-09-19T08:44:31.180014+0000","last_became_active":"2024-09-19T08:42:41.928055+0000","last_became_peered":"2024-09-19T08:42:41.928055+0000","last_unstale":"2024-09-19T08:44:31.180014+0000","last_undegraded":"2024-09-19T08:44:31.180014+0000","last_fullsized":"2024-09-19T08:44:31.180014+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:12.688379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.197630+0000","last_change":"2024-09-19T08:42:44.035439+0000","last_active":"2024-09-19T08:44:31.197630+0000","last_peered":"2024-09-19T08:44:31.197630+0000","last_clean":"2024-09-19T08:44:31.197630+0000","last_became_active":"2024-09-19T08:42:44.035150+0000","last_became_peered":"2024-09-19T08:42:44.035150+0000","last_unstale":"2024-09-19T08:44:31.197630+0000","last_undegraded":"2024-09-19T08:44:31.197630+0000","last_fullsized":"2024-09-19T08:44:31.197630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:15.230660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:46.259867+0000","last_change":"2024-09-19T08:42:42.407784+0000","last_active":"2024-09-19T08:44:46.259867+0000","last_peered":"2024-09-19T08:44:46.259867+0000","last_clean":"2024-09-19T08:44:46.259867+0000","last_became_active":"2024-09-19T08:42:42.407437+0000","last_became_peered":"2024-09-19T08:42:42.407437+0000","last_unstale":"2024-09-19T08:44:46.259867+0000","last_undegraded":"2024-09-19T08:44:46.259867+0000","last_fullsized":"2024-09-19T08:44:46.259867+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:44.829338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.212600+0000","last_change":"2024-09-19T08:42:44.039780+0000","last_active":"2024-09-19T08:44:31.212600+0000","last_peered":"2024-09-19T08:44:31.212600+0000","last_clean":"2024-09-19T08:44:31.212600+0000","last_became_active":"2024-09-19T08:42:44.039441+0000","last_became_peered":"2024-09-19T08:42:44.039441+0000","last_unstale":"2024-09-19T08:44:31.212600+0000","last_undegraded":"2024-09-19T08:44:31.212600+0000","last_fullsized":"2024-09-19T08:44:31.212600+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:31.013663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.180830+0000","last_change":"2024-09-19T08:42:41.926998+0000","last_active":"2024-09-19T08:44:31.180830+0000","last_peered":"2024-09-19T08:44:31.180830+0000","last_clean":"2024-09-19T08:44:31.180830+0000","last_became_active":"2024-09-19T08:42:41.926560+0000","last_became_peered":"2024-09-19T08:42:41.926560+0000","last_unstale":"2024-09-19T08:44:31.180830+0000","last_undegraded":"2024-09-19T08:44:31.180830+0000","last_fullsized":"2024-09-19T08:44:31.180830+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:35.338601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225659+0000","last_change":"2024-09-19T08:42:44.039948+0000","last_active":"2024-09-19T08:44:31.225659+0000","last_peered":"2024-09-19T08:44:31.225659+0000","last_clean":"2024-09-19T08:44:31.225659+0000","last_became_active":"2024-09-19T08:42:44.038797+0000","last_became_peered":"2024-09-19T08:42:44.038797+0000","last_unstale":"2024-09-19T08:44:31.225659+0000","last_undegraded":"2024-09-19T08:44:31.225659+0000","last_fullsized":"2024-09-19T08:44:31.225659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:19.273191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.168583+0000","last_change":"2024-09-19T08:42:42.409954+0000","last_active":"2024-09-19T08:44:31.168583+0000","last_peered":"2024-09-19T08:44:31.168583+0000","last_clean":"2024-09-19T08:44:31.168583+0000","last_became_active":"2024-09-19T08:42:42.409388+0000","last_became_peered":"2024-09-19T08:42:42.409388+0000","last_unstale":"2024-09-19T08:44:31.168583+0000","last_undegraded":"2024-09-19T08:44:31.168583+0000","last_fullsized":"2024-09-19T08:44:31.168583+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:58.764877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.213210+0000","last_change":"2024-09-19T08:42:44.024360+0000","last_active":"2024-09-19T08:44:31.213210+0000","last_peered":"2024-09-19T08:44:31.213210+0000","last_clean":"2024-09-19T08:44:31.213210+0000","last_became_active":"2024-09-19T08:42:44.023703+0000","last_became_peered":"2024-09-19T08:42:44.023703+0000","last_unstale":"2024-09-19T08:44:31.213210+0000","last_undegraded":"2024-09-19T08:44:31.213210+0000","last_fullsized":"2024-09-19T08:44:31.213210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:10.852199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170383+0000","last_change":"2024-09-19T08:42:42.408101+0000","last_active":"2024-09-19T08:44:31.170383+0000","last_peered":"2024-09-19T08:44:31.170383+0000","last_clean":"2024-09-19T08:44:31.170383+0000","last_became_active":"2024-09-19T08:42:42.407692+0000","last_became_peered":"2024-09-19T08:42:42.407692+0000","last_unstale":"2024-09-19T08:44:31.170383+0000","last_undegraded":"2024-09-19T08:44:31.170383+0000","last_fullsized":"2024-09-19T08:44:31.170383+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:01.342213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.217468+0000","last_change":"2024-09-19T08:42:44.026612+0000","last_active":"2024-09-19T08:44:31.217468+0000","last_peered":"2024-09-19T08:44:31.217468+0000","last_clean":"2024-09-19T08:44:31.217468+0000","last_became_active":"2024-09-19T08:42:44.025408+0000","last_became_peered":"2024-09-19T08:42:44.025408+0000","last_unstale":"2024-09-19T08:44:31.217468+0000","last_undegraded":"2024-09-19T08:44:31.217468+0000","last_fullsized":"2024-09-19T08:44:31.217468+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:19.465342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'71","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:41.889318+0000","last_change":"2024-09-19T08:42:41.927561+0000","last_active":"2024-09-19T08:44:41.889318+0000","last_peered":"2024-09-19T08:44:41.889318+0000","last_clean":"2024-09-19T08:44:41.889318+0000","last_became_active":"2024-09-19T08:42:41.927159+0000","last_became_peered":"2024-09-19T08:42:41.927159+0000","last_unstale":"2024-09-19T08:44:41.889318+0000","last_undegraded":"2024-09-19T08:44:41.889318+0000","last_fullsized":"2024-09-19T08:44:41.889318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:13.352727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":160,"num_write":128,"num_write_kb":1157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.220812+0000","last_change":"2024-09-19T08:42:44.028129+0000","last_active":"2024-09-19T08:44:31.220812+0000","last_peered":"2024-09-19T08:44:31.220812+0000","last_clean":"2024-09-19T08:44:31.220812+0000","last_became_active":"2024-09-19T08:42:44.027826+0000","last_became_peered":"2024-09-19T08:42:44.027826+0000","last_unstale":"2024-09-19T08:44:31.220812+0000","last_undegraded":"2024-09-19T08:44:31.220812+0000","last_fullsized":"2024-09-19T08:44:31.220812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:03.129404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.177705+0000","last_change":"2024-09-19T08:42:41.920264+0000","last_active":"2024-09-19T08:44:31.177705+0000","last_peered":"2024-09-19T08:44:31.177705+0000","last_clean":"2024-09-19T08:44:31.177705+0000","last_became_active":"2024-09-19T08:42:41.919655+0000","last_became_peered":"2024-09-19T08:42:41.919655+0000","last_unstale":"2024-09-19T08:44:31.177705+0000","last_undegraded":"2024-09-19T08:44:31.177705+0000","last_fullsized":"2024-09-19T08:44:31.177705+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:58.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226014+0000","last_change":"2024-09-19T08:42:44.039655+0000","last_active":"2024-09-19T08:44:31.226014+0000","last_peered":"2024-09-19T08:44:31.226014+0000","last_clean":"2024-09-19T08:44:31.226014+0000","last_became_active":"2024-09-19T08:42:44.039317+0000","last_became_peered":"2024-09-19T08:42:44.039317+0000","last_unstale":"2024-09-19T08:44:31.226014+0000","last_undegraded":"2024-09-19T08:44:31.226014+0000","last_fullsized":"2024-09-19T08:44:31.226014+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:19.064194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.169944+0000","last_change":"2024-09-19T08:42:42.408582+0000","last_active":"2024-09-19T08:44:31.169944+0000","last_peered":"2024-09-19T08:44:31.169944+0000","last_clean":"2024-09-19T08:44:31.169944+0000","last_became_active":"2024-09-19T08:42:42.408143+0000","last_became_peered":"2024-09-19T08:42:42.408143+0000","last_unstale":"2024-09-19T08:44:31.169944+0000","last_undegraded":"2024-09-19T08:44:31.169944+0000","last_fullsized":"2024-09-19T08:44:31.169944+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.526138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.195758+0000","last_change":"2024-09-19T08:42:44.034795+0000","last_active":"2024-09-19T08:44:31.195758+0000","last_peered":"2024-09-19T08:44:31.195758+0000","last_clean":"2024-09-19T08:44:31.195758+0000","last_became_active":"2024-09-19T08:42:44.034440+0000","last_became_peered":"2024-09-19T08:42:44.034440+0000","last_unstale":"2024-09-19T08:44:31.195758+0000","last_undegraded":"2024-09-19T08:44:31.195758+0000","last_fullsized":"2024-09-19T08:44:31.195758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:50.470240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.179034+0000","last_change":"2024-09-19T08:42:41.922621+0000","last_active":"2024-09-19T08:44:31.179034+0000","last_peered":"2024-09-19T08:44:31.179034+0000","last_clean":"2024-09-19T08:44:31.179034+0000","last_became_active":"2024-09-19T08:42:41.922303+0000","last_became_peered":"2024-09-19T08:42:41.922303+0000","last_unstale":"2024-09-19T08:44:31.179034+0000","last_undegraded":"2024-09-19T08:44:31.179034+0000","last_fullsized":"2024-09-19T08:44:31.179034+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:48.017892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225447+0000","last_change":"2024-09-19T08:42:44.028307+0000","last_active":"2024-09-19T08:44:31.225447+0000","last_peered":"2024-09-19T08:44:31.225447+0000","last_clean":"2024-09-19T08:44:31.225447+0000","last_became_active":"2024-09-19T08:42:44.026848+0000","last_became_peered":"2024-09-19T08:42:44.026848+0000","last_unstale":"2024-09-19T08:44:31.225447+0000","last_undegraded":"2024-09-19T08:44:31.225447+0000","last_fullsized":"2024-09-19T08:44:31.225447+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:20.768075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.180483+0000","last_change":"2024-09-19T08:42:41.929479+0000","last_active":"2024-09-19T08:44:31.180483+0000","last_peered":"2024-09-19T08:44:31.180483+0000","last_clean":"2024-09-19T08:44:31.180483+0000","last_became_active":"2024-09-19T08:42:41.928508+0000","last_became_peered":"2024-09-19T08:42:41.928508+0000","last_unstale":"2024-09-19T08:44:31.180483+0000","last_undegraded":"2024-09-19T08:44:31.180483+0000","last_fullsized":"2024-09-19T08:44:31.180483+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:46.108471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.205207+0000","last_change":"2024-09-19T08:42:44.028694+0000","last_active":"2024-09-19T08:44:31.205207+0000","last_peered":"2024-09-19T08:44:31.205207+0000","last_clean":"2024-09-19T08:44:31.205207+0000","last_became_active":"2024-09-19T08:42:44.027382+0000","last_became_peered":"2024-09-19T08:42:44.027382+0000","last_unstale":"2024-09-19T08:44:31.205207+0000","last_undegraded":"2024-09-19T08:44:31.205207+0000","last_fullsized":"2024-09-19T08:44:31.205207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:40.877505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170090+0000","last_change":"2024-09-19T08:42:41.931016+0000","last_active":"2024-09-19T08:44:31.170090+0000","last_peered":"2024-09-19T08:44:31.170090+0000","last_clean":"2024-09-19T08:44:31.170090+0000","last_became_active":"2024-09-19T08:42:41.930648+0000","last_became_peered":"2024-09-19T08:42:41.930648+0000","last_unstale":"2024-09-19T08:44:31.170090+0000","last_undegraded":"2024-09-19T08:44:31.170090+0000","last_fullsized":"2024-09-19T08:44:31.170090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:32.031025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226346+0000","last_change":"2024-09-19T08:42:44.035288+0000","last_active":"2024-09-19T08:44:31.226346+0000","last_peered":"2024-09-19T08:44:31.226346+0000","last_clean":"2024-09-19T08:44:31.226346+0000","last_became_active":"2024-09-19T08:42:44.034660+0000","last_became_peered":"2024-09-19T08:42:44.034660+0000","last_unstale":"2024-09-19T08:44:31.226346+0000","last_undegraded":"2024-09-19T08:44:31.226346+0000","last_fullsized":"2024-09-19T08:44:31.226346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:48.703463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.225736+0000","last_change":"2024-09-19T08:42:44.040123+0000","last_active":"2024-09-19T08:44:31.225736+0000","last_peered":"2024-09-19T08:44:31.225736+0000","last_clean":"2024-09-19T08:44:31.225736+0000","last_became_active":"2024-09-19T08:42:44.039488+0000","last_became_peered":"2024-09-19T08:42:44.039488+0000","last_unstale":"2024-09-19T08:44:31.225736+0000","last_undegraded":"2024-09-19T08:44:31.225736+0000","last_fullsized":"2024-09-19T08:44:31.225736+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:15.273044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170228+0000","last_change":"2024-09-19T08:42:41.932400+0000","last_active":"2024-09-19T08:44:31.170228+0000","last_peered":"2024-09-19T08:44:31.170228+0000","last_clean":"2024-09-19T08:44:31.170228+0000","last_became_active":"2024-09-19T08:42:41.932020+0000","last_became_peered":"2024-09-19T08:42:41.932020+0000","last_unstale":"2024-09-19T08:44:31.170228+0000","last_undegraded":"2024-09-19T08:44:31.170228+0000","last_fullsized":"2024-09-19T08:44:31.170228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:08.583287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.221219+0000","last_change":"2024-09-19T08:42:44.026173+0000","last_active":"2024-09-19T08:44:31.221219+0000","last_peered":"2024-09-19T08:44:31.221219+0000","last_clean":"2024-09-19T08:44:31.221219+0000","last_became_active":"2024-09-19T08:42:44.024614+0000","last_became_peered":"2024-09-19T08:42:44.024614+0000","last_unstale":"2024-09-19T08:44:31.221219+0000","last_undegraded":"2024-09-19T08:44:31.221219+0000","last_fullsized":"2024-09-19T08:44:31.221219+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:42.695660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.170318+0000","last_change":"2024-09-19T08:42:41.929576+0000","last_active":"2024-09-19T08:44:31.170318+0000","last_peered":"2024-09-19T08:44:31.170318+0000","last_clean":"2024-09-19T08:44:31.170318+0000","last_became_active":"2024-09-19T08:42:41.929231+0000","last_became_peered":"2024-09-19T08:42:41.929231+0000","last_unstale":"2024-09-19T08:44:31.170318+0000","last_undegraded":"2024-09-19T08:44:31.170318+0000","last_fullsized":"2024-09-19T08:44:31.170318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:54.492198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.226525+0000","last_change":"2024-09-19T08:42:44.028612+0000","last_active":"2024-09-19T08:44:31.226525+0000","last_peered":"2024-09-19T08:44:31.226525+0000","last_clean":"2024-09-19T08:44:31.226525+0000","last_became_active":"2024-09-19T08:42:44.028301+0000","last_became_peered":"2024-09-19T08:42:44.028301+0000","last_unstale":"2024-09-19T08:44:31.226525+0000","last_undegraded":"2024-09-19T08:44:31.226525+0000","last_fullsized":"2024-09-19T08:44:31.226525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:03:09.539350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.178947+0000","last_change":"2024-09-19T08:42:42.407931+0000","last_active":"2024-09-19T08:44:31.178947+0000","last_peered":"2024-09-19T08:44:31.178947+0000","last_clean":"2024-09-19T08:44:31.178947+0000","last_became_active":"2024-09-19T08:42:42.407573+0000","last_became_peered":"2024-09-19T08:42:42.407573+0000","last_unstale":"2024-09-19T08:44:31.178947+0000","last_undegraded":"2024-09-19T08:44:31.178947+0000","last_fullsized":"2024-09-19T08:44:31.178947+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:55.095275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.209474+0000","last_change":"2024-09-19T08:42:44.034109+0000","last_active":"2024-09-19T08:44:31.209474+0000","last_peered":"2024-09-19T08:44:31.209474+0000","last_clean":"2024-09-19T08:44:31.209474+0000","last_became_active":"2024-09-19T08:42:44.033753+0000","last_became_peered":"2024-09-19T08:42:44.033753+0000","last_unstale":"2024-09-19T08:44:31.209474+0000","last_undegraded":"2024-09-19T08:44:31.209474+0000","last_fullsized":"2024-09-19T08:44:31.209474+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:43.007640+0000","last_clean_scrub_stamp":"2024-09-19T08:42:43.007640+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:08.475476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T08:44:31.168710+0000","last_change":"2024-09-19T08:42:58.120292+0000","last_active":"2024-09-19T08:44:31.168710+0000","last_peered":"2024-09-19T08:44:31.168710+0000","last_clean":"2024-09-19T08:44:31.168710+0000","last_became_active":"2024-09-19T08:42:58.109929+0000","last_became_peered":"2024-09-19T08:42:58.109929+0000","last_unstale":"2024-09-19T08:44:31.168710+0000","last_undegraded":"2024-09-19T08:44:31.168710+0000","last_fullsized":"2024-09-19T08:44:31.168710+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:42:40.908806+0000","last_clean_scrub_stamp":"2024-09-19T08:42:40.908806+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:56.196868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":794093,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":891,"num_read_kb":602,"num_write":356,"num_write_kb":2090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1198,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2617344,"data_stored":2382279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579941,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":442307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32952,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712200,"statfs":{"total":95995035648,"available":95961292800,"internally_reserved":0,"allocated":1748992,"data_stored":1232179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939694,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36636,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708516,"statfs":{"total":95995035648,"available":95957520384,"internally_reserved":0,"allocated":1318912,"data_stored":835143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168627,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28312,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716840,"statfs":{"total":95995035648,"available":95966044160,"internally_reserved":0,"allocated":1318912,"data_stored":835063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397559,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1035359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561086,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":441316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790016,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28652,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716500,"statfs":{"total":95995035648,"available":95965696000,"internally_reserved":0,"allocated":1667072,"data_stored":1166298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953543,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":443262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215180,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40928,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704224,"statfs":{"total":95995035648,"available":95953125376,"internally_reserved":0,"allocated":1458176,"data_stored":966443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444112,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":999424,"data_stored":509951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":983040,"data_stored":507589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":933888,"data_stored":442587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":721732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":331336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":397217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:44:48.474 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:44:48.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:48 smithi044 ceph-mon[35072]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-19T08:44:48.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:48 smithi044 ceph-mon[35072]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:48.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:48 smithi175 ceph-mon[35688]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-19T08:44:48.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:48 smithi175 ceph-mon[35688]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:48.728 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:49.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.270+0000 7ffbda352640 1 -- 172.21.15.7:0/3876550531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbd4102dd0 msgr2=0x7ffbd41031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:49.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.270+0000 7ffbda352640 1 --2- 172.21.15.7:0/3876550531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbd4102dd0 0x7ffbd41031b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4009930 tx=0x7ffbc402a420 comp rx=0 tx=0).stop 2024-09-19T08:44:49.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.270+0000 7ffbda352640 1 -- 172.21.15.7:0/3876550531 shutdown_connections 2024-09-19T08:44:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.270+0000 7ffbda352640 1 --2- 172.21.15.7:0/3876550531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbd4108300 0x7ffbd410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.270+0000 7ffbda352640 1 --2- 172.21.15.7:0/3876550531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbd4103780 0x7ffbd4107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.270+0000 7ffbda352640 1 --2- 172.21.15.7:0/3876550531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbd4102dd0 0x7ffbd41031b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.270+0000 7ffbda352640 1 -- 172.21.15.7:0/3876550531 >> 172.21.15.7:0/3876550531 conn(0x7ffbd40fc7d0 msgr2=0x7ffbd40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.270+0000 7ffbda352640 1 -- 172.21.15.7:0/3876550531 shutdown_connections 2024-09-19T08:44:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.270+0000 7ffbda352640 1 -- 172.21.15.7:0/3876550531 wait complete. 2024-09-19T08:44:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.270+0000 7ffbda352640 1 Processor -- start 2024-09-19T08:44:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.271+0000 7ffbda352640 1 -- start start 2024-09-19T08:44:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.271+0000 7ffbda352640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbd4102dd0 0x7ffbd4100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.271+0000 7ffbda352640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbd4103780 0x7ffbd4100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:49.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.271+0000 7ffbda352640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbd4108300 0x7ffbd41014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:49.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.271+0000 7ffbda352640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd4112090 con 0x7ffbd4102dd0 2024-09-19T08:44:49.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.271+0000 7ffbda352640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd4111f10 con 0x7ffbd4108300 2024-09-19T08:44:49.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.271+0000 7ffbda352640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd4112210 con 0x7ffbd4103780 2024-09-19T08:44:49.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.271+0000 7ffbd3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbd4102dd0 0x7ffbd4100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:49.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.271+0000 7ffbd3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbd4102dd0 0x7ffbd4100a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41802/0 (socket says 172.21.15.7:41802) 2024-09-19T08:44:49.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.271+0000 7ffbd3fff640 1 -- 172.21.15.7:0/3924332577 learned_addr learned my addr 172.21.15.7:0/3924332577 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:49.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.271+0000 7ffbd37fe640 1 --2- 172.21.15.7:0/3924332577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbd4103780 0x7ffbd4100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:49.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.271+0000 7ffbd88ef640 1 --2- 172.21.15.7:0/3924332577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbd4108300 0x7ffbd41014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:49.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.271+0000 7ffbd3fff640 1 -- 172.21.15.7:0/3924332577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbd4103780 msgr2=0x7ffbd4100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:49.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.271+0000 7ffbd3fff640 1 --2- 172.21.15.7:0/3924332577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbd4103780 0x7ffbd4100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:49.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.272+0000 7ffbd3fff640 1 -- 172.21.15.7:0/3924332577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbd4108300 msgr2=0x7ffbd41014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:49.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.272+0000 7ffbd3fff640 1 --2- 172.21.15.7:0/3924332577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbd4108300 0x7ffbd41014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:49.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.272+0000 7ffbd3fff640 1 -- 172.21.15.7:0/3924332577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd41a6a10 con 0x7ffbd4102dd0 2024-09-19T08:44:49.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.272+0000 7ffbd3fff640 1 --2- 172.21.15.7:0/3924332577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbd4102dd0 0x7ffbd4100a30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4009230 tx=0x7ffbc4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:49.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.272+0000 7ffbd17fa640 1 -- 172.21.15.7:0/3924332577 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc403f030 con 0x7ffbd4102dd0 2024-09-19T08:44:49.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.272+0000 7ffbd17fa640 1 -- 172.21.15.7:0/3924332577 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbc4003ad0 con 0x7ffbd4102dd0 2024-09-19T08:44:49.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.272+0000 7ffbda352640 1 -- 172.21.15.7:0/3924332577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbd41a6ca0 con 0x7ffbd4102dd0 2024-09-19T08:44:49.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.272+0000 7ffbd17fa640 1 -- 172.21.15.7:0/3924332577 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4035070 con 0x7ffbd4102dd0 2024-09-19T08:44:49.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.272+0000 7ffbda352640 1 -- 172.21.15.7:0/3924332577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbd41a7180 con 0x7ffbd4102dd0 2024-09-19T08:44:49.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.273+0000 7ffbda352640 1 -- 172.21.15.7:0/3924332577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbd41031b0 con 0x7ffbd4102dd0 2024-09-19T08:44:49.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.274+0000 7ffbd17fa640 1 -- 172.21.15.7:0/3924332577 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7ffbc4042030 con 0x7ffbd4102dd0 2024-09-19T08:44:49.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.275+0000 7ffbd17fa640 1 --2- 172.21.15.7:0/3924332577 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffbbc0a3540 0x7ffbbc0a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:49.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.275+0000 7ffbd37fe640 1 --2- 172.21.15.7:0/3924332577 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffbbc0a3540 0x7ffbbc0a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:49.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.275+0000 7ffbd17fa640 1 -- 172.21.15.7:0/3924332577 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7ffbc40f02d0 con 0x7ffbd4102dd0 2024-09-19T08:44:49.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.276+0000 7ffbd37fe640 1 --2- 172.21.15.7:0/3924332577 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffbbc0a3540 0x7ffbbc0a5a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffbd41024c0 tx=0x7ffbc800b410 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:49.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.280+0000 7ffbd17fa640 1 -- 172.21.15.7:0/3924332577 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffbc40bc480 con 0x7ffbd4102dd0 2024-09-19T08:44:49.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.492+0000 7ffbda352640 1 -- 172.21.15.7:0/3924332577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffbd410a290 con 0x7ffbd4102dd0 2024-09-19T08:44:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.493+0000 7ffbd17fa640 1 -- 172.21.15.7:0/3924332577 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7ffbc40c0780 con 0x7ffbd4102dd0 2024-09-19T08:44:49.494 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:44:49.494 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:44:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:44:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.495+0000 7ffbda352640 1 -- 172.21.15.7:0/3924332577 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffbbc0a3540 msgr2=0x7ffbbc0a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.495+0000 7ffbda352640 1 --2- 172.21.15.7:0/3924332577 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffbbc0a3540 0x7ffbbc0a5a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffbd41024c0 tx=0x7ffbc800b410 comp rx=0 tx=0).stop 2024-09-19T08:44:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.495+0000 7ffbda352640 1 -- 172.21.15.7:0/3924332577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbd4102dd0 msgr2=0x7ffbd4100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.495+0000 7ffbda352640 1 --2- 172.21.15.7:0/3924332577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbd4102dd0 0x7ffbd4100a30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4009230 tx=0x7ffbc4004270 comp rx=0 tx=0).stop 2024-09-19T08:44:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.495+0000 7ffbda352640 1 -- 172.21.15.7:0/3924332577 shutdown_connections 2024-09-19T08:44:49.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.495+0000 7ffbda352640 1 --2- 172.21.15.7:0/3924332577 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffbbc0a3540 0x7ffbbc0a5a00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:49.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.495+0000 7ffbda352640 1 --2- 172.21.15.7:0/3924332577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbd4108300 0x7ffbd41014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:49.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.495+0000 7ffbda352640 1 --2- 172.21.15.7:0/3924332577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbd4103780 0x7ffbd4100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:49.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.495+0000 7ffbda352640 1 --2- 172.21.15.7:0/3924332577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbd4102dd0 0x7ffbd4100a30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:49.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.495+0000 7ffbda352640 1 -- 172.21.15.7:0/3924332577 >> 172.21.15.7:0/3924332577 conn(0x7ffbd40fc7d0 msgr2=0x7ffbd4105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:49.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.495+0000 7ffbda352640 1 -- 172.21.15.7:0/3924332577 shutdown_connections 2024-09-19T08:44:49.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:49.495+0000 7ffbda352640 1 -- 172.21.15.7:0/3924332577 wait complete. 2024-09-19T08:44:50.200 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:50 smithi007 ceph-mon[31221]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 49 op/s 2024-09-19T08:44:50.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:50 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3924332577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:50.227 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:44:50.487 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:50.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:50 smithi044 ceph-mon[35072]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 49 op/s 2024-09-19T08:44:50.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:50 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3924332577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:50.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:50 smithi175 ceph-mon[35688]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 49 op/s 2024-09-19T08:44:50.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:50 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3924332577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:50.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.961+0000 7fb5f3106640 1 -- 172.21.15.7:0/623752417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ec112b90 msgr2=0x7fb5ec114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:50.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.961+0000 7fb5f3106640 1 --2- 172.21.15.7:0/623752417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ec112b90 0x7fb5ec114f80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4009ca0 tx=0x7fb5e402a950 comp rx=0 tx=0).stop 2024-09-19T08:44:50.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.961+0000 7fb5f3106640 1 -- 172.21.15.7:0/623752417 shutdown_connections 2024-09-19T08:44:50.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.961+0000 7fb5f3106640 1 --2- 172.21.15.7:0/623752417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ec112b90 0x7fb5ec114f80 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:50.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.961+0000 7fb5f3106640 1 --2- 172.21.15.7:0/623752417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5ec074eb0 0x7fb5ec112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:50.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.961+0000 7fb5f3106640 1 --2- 172.21.15.7:0/623752417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5ec074590 0x7fb5ec074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:50.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.961+0000 7fb5f3106640 1 -- 172.21.15.7:0/623752417 >> 172.21.15.7:0/623752417 conn(0x7fb5ec0fd8c0 msgr2=0x7fb5ec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:50.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.961+0000 7fb5f3106640 1 -- 172.21.15.7:0/623752417 shutdown_connections 2024-09-19T08:44:50.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.961+0000 7fb5f3106640 1 -- 172.21.15.7:0/623752417 wait complete. 2024-09-19T08:44:50.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.962+0000 7fb5f3106640 1 Processor -- start 2024-09-19T08:44:50.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.962+0000 7fb5f3106640 1 -- start start 2024-09-19T08:44:50.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.962+0000 7fb5f3106640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5ec074590 0x7fb5ec1a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:50.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.962+0000 7fb5f3106640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5ec074eb0 0x7fb5ec1a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:50.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.962+0000 7fb5f3106640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ec112b90 0x7fb5ec19e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:50.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.962+0000 7fb5f3106640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec1185b0 con 0x7fb5ec112b90 2024-09-19T08:44:50.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.962+0000 7fb5f3106640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec118430 con 0x7fb5ec074590 2024-09-19T08:44:50.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.962+0000 7fb5f3106640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec118730 con 0x7fb5ec074eb0 2024-09-19T08:44:50.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.963+0000 7fb5f16a3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ec112b90 0x7fb5ec19e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:50.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.963+0000 7fb5f16a3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ec112b90 0x7fb5ec19e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41826/0 (socket says 172.21.15.7:41826) 2024-09-19T08:44:50.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.963+0000 7fb5f16a3640 1 -- 172.21.15.7:0/465505360 learned_addr learned my addr 172.21.15.7:0/465505360 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:50.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.963+0000 7fb5f0ea2640 1 --2- 172.21.15.7:0/465505360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5ec074590 0x7fb5ec1a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:50.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.963+0000 7fb5ebfff640 1 --2- 172.21.15.7:0/465505360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5ec074eb0 0x7fb5ec1a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:50.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.963+0000 7fb5f16a3640 1 -- 172.21.15.7:0/465505360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5ec074eb0 msgr2=0x7fb5ec1a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:50.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.963+0000 7fb5f16a3640 1 --2- 172.21.15.7:0/465505360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5ec074eb0 0x7fb5ec1a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:50.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.963+0000 7fb5f16a3640 1 -- 172.21.15.7:0/465505360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5ec074590 msgr2=0x7fb5ec1a4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:50.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.963+0000 7fb5f16a3640 1 --2- 172.21.15.7:0/465505360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5ec074590 0x7fb5ec1a4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:50.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.963+0000 7fb5f16a3640 1 -- 172.21.15.7:0/465505360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ec19f010 con 0x7fb5ec112b90 2024-09-19T08:44:50.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.963+0000 7fb5f0ea2640 1 --2- 172.21.15.7:0/465505360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5ec074590 0x7fb5ec1a4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:50.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.963+0000 7fb5f16a3640 1 --2- 172.21.15.7:0/465505360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ec112b90 0x7fb5ec19e8e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4006010 tx=0x7fb5e402f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:50.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.963+0000 7fb5e9ffb640 1 -- 172.21.15.7:0/465505360 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4034040 con 0x7fb5ec112b90 2024-09-19T08:44:50.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.963+0000 7fb5e9ffb640 1 -- 172.21.15.7:0/465505360 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5e4003e00 con 0x7fb5ec112b90 2024-09-19T08:44:50.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.963+0000 7fb5e9ffb640 1 -- 172.21.15.7:0/465505360 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40456e0 con 0x7fb5ec112b90 2024-09-19T08:44:50.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.963+0000 7fb5f3106640 1 -- 172.21.15.7:0/465505360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5ec19f2a0 con 0x7fb5ec112b90 2024-09-19T08:44:50.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.963+0000 7fb5f3106640 1 -- 172.21.15.7:0/465505360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5ec1ab5f0 con 0x7fb5ec112b90 2024-09-19T08:44:50.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.964+0000 7fb5f3106640 1 -- 172.21.15.7:0/465505360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5ec074970 con 0x7fb5ec112b90 2024-09-19T08:44:50.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.966+0000 7fb5e9ffb640 1 -- 172.21.15.7:0/465505360 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7fb5e4037020 con 0x7fb5ec112b90 2024-09-19T08:44:50.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.966+0000 7fb5e9ffb640 1 --2- 172.21.15.7:0/465505360 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb5dc0a3440 0x7fb5dc0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:50.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.967+0000 7fb5f0ea2640 1 --2- 172.21.15.7:0/465505360 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb5dc0a3440 0x7fb5dc0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:50.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.967+0000 7fb5e9ffb640 1 -- 172.21.15.7:0/465505360 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fb5e40f1000 con 0x7fb5ec112b90 2024-09-19T08:44:50.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.967+0000 7fb5f0ea2640 1 --2- 172.21.15.7:0/465505360 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb5dc0a3440 0x7fb5dc0a5900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0005fd0 tx=0x7fb5e0005ec0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:50.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:50.971+0000 7fb5e9ffb640 1 -- 172.21.15.7:0/465505360 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb5e40bda00 con 0x7fb5ec112b90 2024-09-19T08:44:51.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:51.182+0000 7fb5f3106640 1 -- 172.21.15.7:0/465505360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5ec104fd0 con 0x7fb5ec112b90 2024-09-19T08:44:51.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:51.182+0000 7fb5e9ffb640 1 -- 172.21.15.7:0/465505360 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7fb5e40bd300 con 0x7fb5ec112b90 2024-09-19T08:44:51.183 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:44:51.183 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:44:51.183 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:44:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:51.185+0000 7fb5f3106640 1 -- 172.21.15.7:0/465505360 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb5dc0a3440 msgr2=0x7fb5dc0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:51.185+0000 7fb5f3106640 1 --2- 172.21.15.7:0/465505360 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb5dc0a3440 0x7fb5dc0a5900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0005fd0 tx=0x7fb5e0005ec0 comp rx=0 tx=0).stop 2024-09-19T08:44:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:51.185+0000 7fb5f3106640 1 -- 172.21.15.7:0/465505360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ec112b90 msgr2=0x7fb5ec19e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:51.185+0000 7fb5f3106640 1 --2- 172.21.15.7:0/465505360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ec112b90 0x7fb5ec19e8e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4006010 tx=0x7fb5e402f710 comp rx=0 tx=0).stop 2024-09-19T08:44:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:51.185+0000 7fb5f3106640 1 -- 172.21.15.7:0/465505360 shutdown_connections 2024-09-19T08:44:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:51.185+0000 7fb5f3106640 1 --2- 172.21.15.7:0/465505360 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb5dc0a3440 0x7fb5dc0a5900 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:51.185+0000 7fb5f3106640 1 --2- 172.21.15.7:0/465505360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ec112b90 0x7fb5ec19e8e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:51.185+0000 7fb5f3106640 1 --2- 172.21.15.7:0/465505360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5ec074eb0 0x7fb5ec1a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:51.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:51.185+0000 7fb5f3106640 1 --2- 172.21.15.7:0/465505360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5ec074590 0x7fb5ec1a4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:51.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:51.185+0000 7fb5f3106640 1 -- 172.21.15.7:0/465505360 >> 172.21.15.7:0/465505360 conn(0x7fb5ec0fd8c0 msgr2=0x7fb5ec0ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:51.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:51.185+0000 7fb5f3106640 1 -- 172.21.15.7:0/465505360 shutdown_connections 2024-09-19T08:44:51.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:51.185+0000 7fb5f3106640 1 -- 172.21.15.7:0/465505360 wait complete. 2024-09-19T08:44:51.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:51 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/465505360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:51.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:51 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/465505360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:51.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:51 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/465505360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:51.867 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:44:52.127 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:52.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:52 smithi007 ceph-mon[31221]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-19T08:44:52.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:52 smithi044 ceph-mon[35072]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-19T08:44:52.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.636+0000 7fb4b1156640 1 -- 172.21.15.7:0/4053552653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4ac100e20 msgr2=0x7fb4ac101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:52.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.636+0000 7fb4b1156640 1 --2- 172.21.15.7:0/4053552653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4ac100e20 0x7fb4ac101200 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009900 tx=0x7fb49c02a480 comp rx=0 tx=0).stop 2024-09-19T08:44:52.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.636+0000 7fb4b1156640 1 -- 172.21.15.7:0/4053552653 shutdown_connections 2024-09-19T08:44:52.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.636+0000 7fb4b1156640 1 --2- 172.21.15.7:0/4053552653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4ac102ef0 0x7fb4ac10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:52.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.636+0000 7fb4b1156640 1 --2- 172.21.15.7:0/4053552653 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4ac102570 0x7fb4ac1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:52.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.636+0000 7fb4b1156640 1 --2- 172.21.15.7:0/4053552653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4ac100e20 0x7fb4ac101200 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:52.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.636+0000 7fb4b1156640 1 -- 172.21.15.7:0/4053552653 >> 172.21.15.7:0/4053552653 conn(0x7fb4ac0fc7d0 msgr2=0x7fb4ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:52.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.636+0000 7fb4b1156640 1 -- 172.21.15.7:0/4053552653 shutdown_connections 2024-09-19T08:44:52.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.636+0000 7fb4b1156640 1 -- 172.21.15.7:0/4053552653 wait complete. 2024-09-19T08:44:52.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.636+0000 7fb4b1156640 1 Processor -- start 2024-09-19T08:44:52.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.637+0000 7fb4b1156640 1 -- start start 2024-09-19T08:44:52.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.637+0000 7fb4b1156640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4ac100e20 0x7fb4ac199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:52.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.637+0000 7fb4b1156640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4ac102570 0x7fb4ac199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:52.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.637+0000 7fb4b1156640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4ac102ef0 0x7fb4ac1a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:52.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.637+0000 7fb4b1156640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ac110f80 con 0x7fb4ac100e20 2024-09-19T08:44:52.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.637+0000 7fb4b1156640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ac110e00 con 0x7fb4ac102570 2024-09-19T08:44:52.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.637+0000 7fb4b1156640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ac111100 con 0x7fb4ac102ef0 2024-09-19T08:44:52.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.637+0000 7fb4aad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4ac100e20 0x7fb4ac199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:52.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.637+0000 7fb4aad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4ac100e20 0x7fb4ac199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41834/0 (socket says 172.21.15.7:41834) 2024-09-19T08:44:52.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.637+0000 7fb4aad9d640 1 -- 172.21.15.7:0/151433867 learned_addr learned my addr 172.21.15.7:0/151433867 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:52.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.637+0000 7fb4ab59e640 1 --2- 172.21.15.7:0/151433867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4ac102ef0 0x7fb4ac1a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:52.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.637+0000 7fb4a259c640 1 --2- 172.21.15.7:0/151433867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4ac102570 0x7fb4ac199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:52.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.637+0000 7fb4aad9d640 1 -- 172.21.15.7:0/151433867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4ac102ef0 msgr2=0x7fb4ac1a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:52.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.637+0000 7fb4aad9d640 1 --2- 172.21.15.7:0/151433867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4ac102ef0 0x7fb4ac1a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:52.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.637+0000 7fb4aad9d640 1 -- 172.21.15.7:0/151433867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4ac102570 msgr2=0x7fb4ac199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:52.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.637+0000 7fb4aad9d640 1 --2- 172.21.15.7:0/151433867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4ac102570 0x7fb4ac199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:52.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.638+0000 7fb4aad9d640 1 -- 172.21.15.7:0/151433867 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4ac1a48f0 con 0x7fb4ac100e20 2024-09-19T08:44:52.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.638+0000 7fb4a259c640 1 --2- 172.21.15.7:0/151433867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4ac102570 0x7fb4ac199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:52.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.638+0000 7fb4aad9d640 1 --2- 172.21.15.7:0/151433867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4ac100e20 0x7fb4ac199330 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb49c006010 tx=0x7fb49c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:52.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.638+0000 7fb4a8d99640 1 -- 172.21.15.7:0/151433867 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49c03f070 con 0x7fb4ac100e20 2024-09-19T08:44:52.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.638+0000 7fb4a8d99640 1 -- 172.21.15.7:0/151433867 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb49c031c30 con 0x7fb4ac100e20 2024-09-19T08:44:52.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.638+0000 7fb4a8d99640 1 -- 172.21.15.7:0/151433867 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49c035030 con 0x7fb4ac100e20 2024-09-19T08:44:52.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.638+0000 7fb4b1156640 1 -- 172.21.15.7:0/151433867 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4ac1a4ac0 con 0x7fb4ac100e20 2024-09-19T08:44:52.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.638+0000 7fb4b1156640 1 -- 172.21.15.7:0/151433867 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4ac1a4f10 con 0x7fb4ac100e20 2024-09-19T08:44:52.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.639+0000 7fb4b1156640 1 -- 172.21.15.7:0/151433867 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4ac101200 con 0x7fb4ac100e20 2024-09-19T08:44:52.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.640+0000 7fb4a8d99640 1 -- 172.21.15.7:0/151433867 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7fb49c042070 con 0x7fb4ac100e20 2024-09-19T08:44:52.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.641+0000 7fb4a8d99640 1 --2- 172.21.15.7:0/151433867 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb4980a3440 0x7fb4980a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:52.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.641+0000 7fb4a8d99640 1 -- 172.21.15.7:0/151433867 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fb49c0f05d0 con 0x7fb4ac100e20 2024-09-19T08:44:52.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.641+0000 7fb4a259c640 1 --2- 172.21.15.7:0/151433867 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb4980a3440 0x7fb4980a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:52.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.641+0000 7fb4a259c640 1 --2- 172.21.15.7:0/151433867 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb4980a3440 0x7fb4980a5900 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac06aac0 tx=0x7fb494005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:52.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.645+0000 7fb4a8d99640 1 -- 172.21.15.7:0/151433867 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb49c0bce30 con 0x7fb4ac100e20 2024-09-19T08:44:52.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:52 smithi175 ceph-mon[35688]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-19T08:44:52.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.820+0000 7fb4b1156640 1 -- 172.21.15.7:0/151433867 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4ac109090 con 0x7fb4ac100e20 2024-09-19T08:44:52.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.821+0000 7fb4a8d99640 1 -- 172.21.15.7:0/151433867 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+23065 (secure 0 0 0) 0x7fb49c0bc730 con 0x7fb4ac100e20 2024-09-19T08:44:52.822 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:44:52.822 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":83,"fsid":"ebd23124-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:02.287380+0000","modified":"2024-09-19T08:44:31.163658+0000","last_up_change":"2024-09-19T08:41:54.742978+0000","last_in_change":"2024-09-19T08:41:31.685622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:13.285118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:42:40.425852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:42:43.006548+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"837e6267-71c7-4f48-9e0b-4e3f124682b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6803","nonce":402668717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6805","nonce":402668717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6809","nonce":402668717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6807","nonce":402668717}]},"public_addr":"172.21.15.7:6803/402668717","cluster_addr":"172.21.15.7:6805/402668717","heartbeat_back_addr":"172.21.15.7:6809/402668717","heartbeat_front_addr":"172.21.15.7:6807/402668717","state":["exists","up"]},{"osd":1,"uuid":"67865372-ac22-4b30-bd02-498e118d6701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6801","nonce":2213694259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6803","nonce":2213694259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6807","nonce":2213694259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6805","nonce":2213694259}]},"public_addr":"172.21.15.44:6801/2213694259","cluster_addr":"172.21.15.44:6803/2213694259","heartbeat_back_addr":"172.21.15.44:6807/2213694259","heartbeat_front_addr":"172.21.15.44:6805/2213694259","state":["exists","up"]},{"osd":2,"uuid":"37c1cc2b-60ea-449f-baa7-c65d96c3559c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6801","nonce":3413002145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6803","nonce":3413002145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6807","nonce":3413002145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6805","nonce":3413002145}]},"public_addr":"172.21.15.175:6801/3413002145","cluster_addr":"172.21.15.175:6803/3413002145","heartbeat_back_addr":"172.21.15.175:6807/3413002145","heartbeat_front_addr":"172.21.15.175:6805/3413002145","state":["exists","up"]},{"osd":3,"uuid":"a8ffd2ae-4211-492a-a8ac-d4d6cbb4a03d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6811","nonce":2528867083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6813","nonce":2528867083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6817","nonce":2528867083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6815","nonce":2528867083}]},"public_addr":"172.21.15.7:6811/2528867083","cluster_addr":"172.21.15.7:6813/2528867083","heartbeat_back_addr":"172.21.15.7:6817/2528867083","heartbeat_front_addr":"172.21.15.7:6815/2528867083","state":["exists","up"]},{"osd":4,"uuid":"9a67b2ec-1a0a-413e-bd13-9532f24a0155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6809","nonce":3537143774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537143774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537143774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537143774}]},"public_addr":"172.21.15.44:6809/3537143774","cluster_addr":"172.21.15.44:6811/3537143774","heartbeat_back_addr":"172.21.15.44:6815/3537143774","heartbeat_front_addr":"172.21.15.44:6813/3537143774","state":["exists","up"]},{"osd":5,"uuid":"436cd596-710b-48e2-8255-8427c93cee1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6809","nonce":4001214751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6811","nonce":4001214751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6815","nonce":4001214751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6813","nonce":4001214751}]},"public_addr":"172.21.15.175:6809/4001214751","cluster_addr":"172.21.15.175:6811/4001214751","heartbeat_back_addr":"172.21.15.175:6815/4001214751","heartbeat_front_addr":"172.21.15.175:6813/4001214751","state":["exists","up"]},{"osd":6,"uuid":"f5a7ad2b-6b44-4b5a-8af7-f7fb00e7ca68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6819","nonce":1261079202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6821","nonce":1261079202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6825","nonce":1261079202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6823","nonce":1261079202}]},"public_addr":"172.21.15.7:6819/1261079202","cluster_addr":"172.21.15.7:6821/1261079202","heartbeat_back_addr":"172.21.15.7:6825/1261079202","heartbeat_front_addr":"172.21.15.7:6823/1261079202","state":["exists","up"]},{"osd":7,"uuid":"aa24aee5-6449-4842-8831-1c8e06cde75b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6817","nonce":3120822957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6819","nonce":3120822957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6823","nonce":3120822957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6821","nonce":3120822957}]},"public_addr":"172.21.15.44:6817/3120822957","cluster_addr":"172.21.15.44:6819/3120822957","heartbeat_back_addr":"172.21.15.44:6823/3120822957","heartbeat_front_addr":"172.21.15.44:6821/3120822957","state":["exists","up"]},{"osd":8,"uuid":"d912501a-bb7a-489e-b6ab-e451fb22210d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6817","nonce":2080374927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6819","nonce":2080374927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6823","nonce":2080374927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6821","nonce":2080374927}]},"public_addr":"172.21.15.175:6817/2080374927","cluster_addr":"172.21.15.175:6819/2080374927","heartbeat_back_addr":"172.21.15.175:6823/2080374927","heartbeat_front_addr":"172.21.15.175:6821/2080374927","state":["exists","up"]},{"osd":9,"uuid":"d132f5b2-75b9-4d6c-89ec-f52c303e0fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6827","nonce":3808356432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6829","nonce":3808356432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6833","nonce":3808356432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6831","nonce":3808356432}]},"public_addr":"172.21.15.7:6827/3808356432","cluster_addr":"172.21.15.7:6829/3808356432","heartbeat_back_addr":"172.21.15.7:6833/3808356432","heartbeat_front_addr":"172.21.15.7:6831/3808356432","state":["exists","up"]},{"osd":10,"uuid":"f6c405d6-a255-4e0e-8528-7bbc16d5e434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6825","nonce":4009464689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6827","nonce":4009464689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6831","nonce":4009464689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6829","nonce":4009464689}]},"public_addr":"172.21.15.44:6825/4009464689","cluster_addr":"172.21.15.44:6827/4009464689","heartbeat_back_addr":"172.21.15.44:6831/4009464689","heartbeat_front_addr":"172.21.15.44:6829/4009464689","state":["exists","up"]},{"osd":11,"uuid":"a2a046cd-9939-473a-988b-6e0ad28a0233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6825","nonce":4173951310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6827","nonce":4173951310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6831","nonce":4173951310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6829","nonce":4173951310}]},"public_addr":"172.21.15.175:6825/4173951310","cluster_addr":"172.21.15.175:6827/4173951310","heartbeat_back_addr":"172.21.15.175:6831/4173951310","heartbeat_front_addr":"172.21.15.175:6829/4173951310","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:20.015497+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:44.967046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:09.682080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:35.516899+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:00.705686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:25.276387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:49.927456+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:14.786755+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:38.553913+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.962825+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.812976+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:52.837744+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/973276283":"2024-09-20T08:44:31.163626+0000","172.21.15.7:0/2695884066":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/816886708":"2024-09-20T08:35:31.711540+0000","172.21.15.7:6800/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:6800/3577760109":"2024-09-20T08:44:31.163626+0000","172.21.15.7:0/1429582340":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/4277640815":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/499611189":"2024-09-20T08:44:31.163626+0000","172.21.15.7:6801/3577760109":"2024-09-20T08:44:31.163626+0000","172.21.15.7:0/4058698573":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/1800852158":"2024-09-20T08:44:31.163626+0000","172.21.15.7:0/2884903597":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/2457209252":"2024-09-20T08:44:31.163626+0000","172.21.15.7:6800/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/2008302629":"2024-09-20T08:44:31.163626+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:44:52.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.823+0000 7fb4b1156640 1 -- 172.21.15.7:0/151433867 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb4980a3440 msgr2=0x7fb4980a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:52.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.823+0000 7fb4b1156640 1 --2- 172.21.15.7:0/151433867 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb4980a3440 0x7fb4980a5900 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac06aac0 tx=0x7fb494005f90 comp rx=0 tx=0).stop 2024-09-19T08:44:52.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.823+0000 7fb4b1156640 1 -- 172.21.15.7:0/151433867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4ac100e20 msgr2=0x7fb4ac199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:52.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.823+0000 7fb4b1156640 1 --2- 172.21.15.7:0/151433867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4ac100e20 0x7fb4ac199330 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb49c006010 tx=0x7fb49c003c10 comp rx=0 tx=0).stop 2024-09-19T08:44:52.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.824+0000 7fb4b1156640 1 -- 172.21.15.7:0/151433867 shutdown_connections 2024-09-19T08:44:52.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.824+0000 7fb4b1156640 1 --2- 172.21.15.7:0/151433867 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb4980a3440 0x7fb4980a5900 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:52.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.824+0000 7fb4b1156640 1 --2- 172.21.15.7:0/151433867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4ac102ef0 0x7fb4ac1a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:52.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.824+0000 7fb4b1156640 1 --2- 172.21.15.7:0/151433867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4ac102570 0x7fb4ac199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:52.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.824+0000 7fb4b1156640 1 --2- 172.21.15.7:0/151433867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4ac100e20 0x7fb4ac199330 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:52.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.824+0000 7fb4b1156640 1 -- 172.21.15.7:0/151433867 >> 172.21.15.7:0/151433867 conn(0x7fb4ac0fc7d0 msgr2=0x7fb4ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:52.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.824+0000 7fb4b1156640 1 -- 172.21.15.7:0/151433867 shutdown_connections 2024-09-19T08:44:52.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:52.824+0000 7fb4b1156640 1 -- 172.21.15.7:0/151433867 wait complete. 2024-09-19T08:44:53.466 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:53 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/151433867' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:53.499 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-19T08:44:53.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:53 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/151433867' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:53.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:53 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/151433867' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:44:53.756 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:54.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:54 smithi007 ceph-mon[31221]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-09-19T08:44:54.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:54 smithi007 ceph-mon[31221]: scrub summary: idle 2024-09-19T08:44:54.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:54 smithi044 ceph-mon[35072]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-09-19T08:44:54.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:54 smithi044 ceph-mon[35072]: scrub summary: idle 2024-09-19T08:44:54.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:54 smithi175 ceph-mon[35688]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-09-19T08:44:54.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:54 smithi175 ceph-mon[35688]: scrub summary: idle 2024-09-19T08:44:54.877 INFO:teuthology.orchestra.run.smithi007.stdout:{"run_dir":"/var/run/ceph"} 2024-09-19T08:44:54.878 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-19T08:44:54.878 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1747 2024-09-19T08:44:54.878 DEBUG:tasks.quiescer:Yielding 2024-09-19T08:44:54.878 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T08:44:54.894 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T08:44:54.894 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T08:44:54.894 INFO:tasks.workunit:timeout=3h 2024-09-19T08:44:54.894 INFO:tasks.workunit:cleanup=True 2024-09-19T08:44:54.894 DEBUG:teuthology.orchestra.run.smithi007:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T08:44:54.895 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:44:54.915 INFO:teuthology.orchestra.run.smithi007.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T08:44:54.915 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-19T08:44:54.916 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-19T08:44:54.916 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:44:54.916 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-19T08:44:54.916 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-19 08:43:02.567133594 +0000 2024-09-19T08:44:54.916 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-19 08:43:02.567133594 +0000 2024-09-19T08:44:54.916 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-19 08:44:31.188556553 +0000 2024-09-19T08:44:54.916 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-19 08:43:02.567133594 +0000 2024-09-19T08:44:54.916 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T08:44:54.916 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T08:44:54.992 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T08:44:55.048 INFO:tasks.workunit.client.0.smithi007.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T08:44:55.167 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:55.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.646+0000 7f9b49793640 1 -- 172.21.15.7:0/164656057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b44100e20 msgr2=0x7f9b44101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:55.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.646+0000 7f9b49793640 1 --2- 172.21.15.7:0/164656057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b44100e20 0x7f9b44101200 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009900 tx=0x7f9b3402a480 comp rx=0 tx=0).stop 2024-09-19T08:44:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.646+0000 7f9b49793640 1 -- 172.21.15.7:0/164656057 shutdown_connections 2024-09-19T08:44:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.646+0000 7f9b49793640 1 --2- 172.21.15.7:0/164656057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b44102ef0 0x7f9b4410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.646+0000 7f9b49793640 1 --2- 172.21.15.7:0/164656057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b44102570 0x7f9b441029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.646+0000 7f9b49793640 1 --2- 172.21.15.7:0/164656057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b44100e20 0x7f9b44101200 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.646+0000 7f9b49793640 1 -- 172.21.15.7:0/164656057 >> 172.21.15.7:0/164656057 conn(0x7f9b440fc7d0 msgr2=0x7f9b440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.646+0000 7f9b49793640 1 -- 172.21.15.7:0/164656057 shutdown_connections 2024-09-19T08:44:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.646+0000 7f9b49793640 1 -- 172.21.15.7:0/164656057 wait complete. 2024-09-19T08:44:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.647+0000 7f9b49793640 1 Processor -- start 2024-09-19T08:44:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.647+0000 7f9b49793640 1 -- start start 2024-09-19T08:44:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.647+0000 7f9b49793640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b44100e20 0x7f9b44197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.648+0000 7f9b49793640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b44102570 0x7f9b441979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.648+0000 7f9b49793640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b44102ef0 0x7f9b4419bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.648+0000 7f9b49793640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9b44110f80 con 0x7f9b44102ef0 2024-09-19T08:44:55.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.648+0000 7f9b49793640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9b44110e00 con 0x7f9b44102570 2024-09-19T08:44:55.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.648+0000 7f9b49793640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9b44111100 con 0x7f9b44100e20 2024-09-19T08:44:55.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.648+0000 7f9b437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b44102ef0 0x7f9b4419bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:55.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.648+0000 7f9b437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b44102ef0 0x7f9b4419bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51076/0 (socket says 172.21.15.7:51076) 2024-09-19T08:44:55.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.648+0000 7f9b437fe640 1 -- 172.21.15.7:0/3150824137 learned_addr learned my addr 172.21.15.7:0/3150824137 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:55.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.648+0000 7f9b427fc640 1 --2- 172.21.15.7:0/3150824137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b44102570 0x7f9b441979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:55.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.648+0000 7f9b42ffd640 1 --2- 172.21.15.7:0/3150824137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b44100e20 0x7f9b44197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:55.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.648+0000 7f9b437fe640 1 -- 172.21.15.7:0/3150824137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b44100e20 msgr2=0x7f9b44197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:55.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.648+0000 7f9b437fe640 1 --2- 172.21.15.7:0/3150824137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b44100e20 0x7f9b44197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:55.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.648+0000 7f9b437fe640 1 -- 172.21.15.7:0/3150824137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b44102570 msgr2=0x7f9b441979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:55.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.648+0000 7f9b437fe640 1 --2- 172.21.15.7:0/3150824137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b44102570 0x7f9b441979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:55.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.648+0000 7f9b437fe640 1 -- 172.21.15.7:0/3150824137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4419c410 con 0x7f9b44102ef0 2024-09-19T08:44:55.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.648+0000 7f9b42ffd640 1 --2- 172.21.15.7:0/3150824137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b44100e20 0x7f9b44197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:55.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.648+0000 7f9b427fc640 1 --2- 172.21.15.7:0/3150824137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b44102570 0x7f9b441979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:44:55.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.648+0000 7f9b437fe640 1 --2- 172.21.15.7:0/3150824137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b44102ef0 0x7f9b4419bd30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00eaa0 tx=0x7f9b3c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:55.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.649+0000 7f9b2bfff640 1 -- 172.21.15.7:0/3150824137 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c00cdb0 con 0x7f9b44102ef0 2024-09-19T08:44:55.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.649+0000 7f9b2bfff640 1 -- 172.21.15.7:0/3150824137 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b3c005020 con 0x7f9b44102ef0 2024-09-19T08:44:55.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.649+0000 7f9b49793640 1 -- 172.21.15.7:0/3150824137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b4419c700 con 0x7f9b44102ef0 2024-09-19T08:44:55.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.649+0000 7f9b2bfff640 1 -- 172.21.15.7:0/3150824137 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c0116b0 con 0x7f9b44102ef0 2024-09-19T08:44:55.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.649+0000 7f9b49793640 1 -- 172.21.15.7:0/3150824137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b44069f70 con 0x7f9b44102ef0 2024-09-19T08:44:55.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.650+0000 7f9b49793640 1 -- 172.21.15.7:0/3150824137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b44101200 con 0x7f9b44102ef0 2024-09-19T08:44:55.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.651+0000 7f9b2bfff640 1 -- 172.21.15.7:0/3150824137 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f9b3c005560 con 0x7f9b44102ef0 2024-09-19T08:44:55.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.652+0000 7f9b2bfff640 1 --2- 172.21.15.7:0/3150824137 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9b2c0a3440 0x7f9b2c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:55.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.652+0000 7f9b42ffd640 1 --2- 172.21.15.7:0/3150824137 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9b2c0a3440 0x7f9b2c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:55.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.652+0000 7f9b2bfff640 1 -- 172.21.15.7:0/3150824137 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f9b3c0d0130 con 0x7f9b44102ef0 2024-09-19T08:44:55.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.652+0000 7f9b42ffd640 1 --2- 172.21.15.7:0/3150824137 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9b2c0a3440 0x7f9b2c0a5900 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9b34005ab0 tx=0x7f9b3403a040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:55.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.660+0000 7f9b2bfff640 1 -- 172.21.15.7:0/3150824137 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9b3c016030 con 0x7f9b44102ef0 2024-09-19T08:44:55.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.870+0000 7f9b49793640 1 -- 172.21.15.7:0/3150824137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b441987c0 con 0x7f9b44102ef0 2024-09-19T08:44:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.871+0000 7f9b2bfff640 1 -- 172.21.15.7:0/3150824137 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f9b441987c0 con 0x7f9b44102ef0 2024-09-19T08:44:55.871 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:44:55.871 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:44:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:44:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.873+0000 7f9b49793640 1 -- 172.21.15.7:0/3150824137 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9b2c0a3440 msgr2=0x7f9b2c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.873+0000 7f9b49793640 1 --2- 172.21.15.7:0/3150824137 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9b2c0a3440 0x7f9b2c0a5900 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9b34005ab0 tx=0x7f9b3403a040 comp rx=0 tx=0).stop 2024-09-19T08:44:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.874+0000 7f9b49793640 1 -- 172.21.15.7:0/3150824137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b44102ef0 msgr2=0x7f9b4419bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.874+0000 7f9b49793640 1 --2- 172.21.15.7:0/3150824137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b44102ef0 0x7f9b4419bd30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00eaa0 tx=0x7f9b3c00ef60 comp rx=0 tx=0).stop 2024-09-19T08:44:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.874+0000 7f9b49793640 1 -- 172.21.15.7:0/3150824137 shutdown_connections 2024-09-19T08:44:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.874+0000 7f9b49793640 1 --2- 172.21.15.7:0/3150824137 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9b2c0a3440 0x7f9b2c0a5900 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.874+0000 7f9b49793640 1 --2- 172.21.15.7:0/3150824137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b44102ef0 0x7f9b4419bd30 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.874+0000 7f9b49793640 1 --2- 172.21.15.7:0/3150824137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b44102570 0x7f9b441979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.874+0000 7f9b49793640 1 --2- 172.21.15.7:0/3150824137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b44100e20 0x7f9b44197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.874+0000 7f9b49793640 1 -- 172.21.15.7:0/3150824137 >> 172.21.15.7:0/3150824137 conn(0x7f9b440fc7d0 msgr2=0x7f9b440fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.874+0000 7f9b49793640 1 -- 172.21.15.7:0/3150824137 shutdown_connections 2024-09-19T08:44:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:55.874+0000 7f9b49793640 1 -- 172.21.15.7:0/3150824137 wait complete. 2024-09-19T08:44:56.458 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:56 smithi007 ceph-mon[31221]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:44:56.458 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:56 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3150824137' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:56.488 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T08:42:44.586692+0000', 'modified': '2024-09-19T08:44:31.939950+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24491, 'mds_1': 24472, 'mds_2': 24458}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24443': {'gid': 24443, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6835/2261554115', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 2261554115}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 2261554115}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24445': {'gid': 24445, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6835/1285566250', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 1285566250}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 1285566250}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6837/2128553811', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 2128553811}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 2128553811}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24458': {'gid': 24458, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.44:6837/1232834466', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6836', 'nonce': 1232834466}, {'type': 'v1', 'addr': '172.21.15.44:6837', 'nonce': 1232834466}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.175:6839/3928264317', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6838', 'nonce': 3928264317}, {'type': 'v1', 'addr': '172.21.15.175:6839', 'nonce': 3928264317}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24491': {'gid': 24491, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.44:6839/1737549475', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6838', 'nonce': 1737549475}, {'type': 'v1', 'addr': '172.21.15.44:6839', 'nonce': 1737549475}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24491, 'qdb_cluster': [24491, 24472, 24458]} 2024-09-19T08:44:56.488 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T08:44:56.489 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T08:44:56.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:56 smithi044 ceph-mon[35072]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:44:56.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:56 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3150824137' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:56.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:56 smithi175 ceph-mon[35688]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:44:56.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:56 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3150824137' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:44:56.787 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:57.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.246+0000 7fa84f0ed640 1 -- 172.21.15.7:0/2964808727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa848103720 msgr2=0x7fa84810bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:57.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.246+0000 7fa84f0ed640 1 --2- 172.21.15.7:0/2964808727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa848103720 0x7fa84810bc10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa834009900 tx=0x7fa83402a480 comp rx=0 tx=0).stop 2024-09-19T08:44:57.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.246+0000 7fa84f0ed640 1 -- 172.21.15.7:0/2964808727 shutdown_connections 2024-09-19T08:44:57.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.246+0000 7fa84f0ed640 1 --2- 172.21.15.7:0/2964808727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa84810c1a0 0x7fa84810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.246+0000 7fa84f0ed640 1 --2- 172.21.15.7:0/2964808727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa848103720 0x7fa84810bc10 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.246+0000 7fa84f0ed640 1 --2- 172.21.15.7:0/2964808727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa848102e00 0x7fa8481031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.246+0000 7fa84f0ed640 1 -- 172.21.15.7:0/2964808727 >> 172.21.15.7:0/2964808727 conn(0x7fa8480fc7a0 msgr2=0x7fa8480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:57.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.246+0000 7fa84f0ed640 1 -- 172.21.15.7:0/2964808727 shutdown_connections 2024-09-19T08:44:57.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.246+0000 7fa84f0ed640 1 -- 172.21.15.7:0/2964808727 wait complete. 2024-09-19T08:44:57.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.247+0000 7fa84f0ed640 1 Processor -- start 2024-09-19T08:44:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.247+0000 7fa84f0ed640 1 -- start start 2024-09-19T08:44:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.247+0000 7fa84f0ed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa848102e00 0x7fa848100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.247+0000 7fa84f0ed640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa848103720 0x7fa848100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.247+0000 7fa84f0ed640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa84810c1a0 0x7fa8481014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.247+0000 7fa84f0ed640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa848111f70 con 0x7fa848102e00 2024-09-19T08:44:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.247+0000 7fa84f0ed640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa848111df0 con 0x7fa84810c1a0 2024-09-19T08:44:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.247+0000 7fa84f0ed640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa8481120f0 con 0x7fa848103720 2024-09-19T08:44:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.247+0000 7fa84ce89640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa848102e00 0x7fa848100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.247+0000 7fa84ce89640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa848102e00 0x7fa848100a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51100/0 (socket says 172.21.15.7:51100) 2024-09-19T08:44:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.247+0000 7fa84ce89640 1 -- 172.21.15.7:0/835500034 learned_addr learned my addr 172.21.15.7:0/835500034 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.247+0000 7fa847fff640 1 --2- 172.21.15.7:0/835500034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa848103720 0x7fa848100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.247+0000 7fa84d68a640 1 --2- 172.21.15.7:0/835500034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa84810c1a0 0x7fa8481014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.248+0000 7fa84ce89640 1 -- 172.21.15.7:0/835500034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa848103720 msgr2=0x7fa848100fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.248+0000 7fa84ce89640 1 --2- 172.21.15.7:0/835500034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa848103720 0x7fa848100fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.248+0000 7fa84ce89640 1 -- 172.21.15.7:0/835500034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa84810c1a0 msgr2=0x7fa8481014e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.248+0000 7fa84ce89640 1 --2- 172.21.15.7:0/835500034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa84810c1a0 0x7fa8481014e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.248+0000 7fa84ce89640 1 -- 172.21.15.7:0/835500034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8481a6930 con 0x7fa848102e00 2024-09-19T08:44:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.248+0000 7fa84d68a640 1 --2- 172.21.15.7:0/835500034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa84810c1a0 0x7fa8481014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:44:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.248+0000 7fa84ce89640 1 --2- 172.21.15.7:0/835500034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa848102e00 0x7fa848100a60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa83c00d770 tx=0x7fa83c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:57.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.248+0000 7fa845ffb640 1 -- 172.21.15.7:0/835500034 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83c017070 con 0x7fa848102e00 2024-09-19T08:44:57.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.248+0000 7fa845ffb640 1 -- 172.21.15.7:0/835500034 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa83c005500 con 0x7fa848102e00 2024-09-19T08:44:57.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.248+0000 7fa84f0ed640 1 -- 172.21.15.7:0/835500034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8481a6c20 con 0x7fa848102e00 2024-09-19T08:44:57.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.248+0000 7fa845ffb640 1 -- 172.21.15.7:0/835500034 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83c004e00 con 0x7fa848102e00 2024-09-19T08:44:57.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.248+0000 7fa84f0ed640 1 -- 172.21.15.7:0/835500034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8481a7130 con 0x7fa848102e00 2024-09-19T08:44:57.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.250+0000 7fa845ffb640 1 -- 172.21.15.7:0/835500034 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7fa83c004fa0 con 0x7fa848102e00 2024-09-19T08:44:57.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.251+0000 7fa8514c6740 1 Processor -- start 2024-09-19T08:44:57.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.251+0000 7fa845ffb640 1 --2- 172.21.15.7:0/835500034 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa8380a34c0 0x7fa8380a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:57.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.251+0000 7fa8514c6740 1 -- start start 2024-09-19T08:44:57.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.251+0000 7fa84d68a640 1 --2- 172.21.15.7:0/835500034 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa8380a34c0 0x7fa8380a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:57.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.251+0000 7fa845ffb640 1 -- 172.21.15.7:0/835500034 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fa83c0cf8e0 con 0x7fa848102e00 2024-09-19T08:44:57.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.251+0000 7fa8514c6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614da7609d0 0x5614da760db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:57.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.251+0000 7fa8514c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da7612f0 0x5614da76b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:57.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.251+0000 7fa8514c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614da76bbb0 0x5614da76dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:57.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.251+0000 7fa8514c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5614da6c7090 con 0x5614da7612f0 2024-09-19T08:44:57.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.251+0000 7fa8514c6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5614da66ea70 con 0x5614da7609d0 2024-09-19T08:44:57.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.251+0000 7fa8514c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5614da6c3050 con 0x5614da76bbb0 2024-09-19T08:44:57.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.251+0000 7fa847fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da7612f0 0x5614da76b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:57.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.251+0000 7fa847fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da7612f0 0x5614da76b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51106/0 (socket says 172.21.15.7:51106) 2024-09-19T08:44:57.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.251+0000 7fa847fff640 1 -- 172.21.15.7:0/367075467 learned_addr learned my addr 172.21.15.7:0/367075467 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:57.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.252+0000 7fa84ce89640 1 --2- 172.21.15.7:0/367075467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614da7609d0 0x5614da760db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:57.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.252+0000 7fa84d68a640 1 --2- 172.21.15.7:0/367075467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614da76bbb0 0x5614da76dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:57.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.252+0000 7fa84d68a640 1 --2- 172.21.15.7:0/835500034 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa8380a34c0 0x7fa8380a5980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa840005fd0 tx=0x7fa840009440 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:57.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.252+0000 7fa847fff640 1 -- 172.21.15.7:0/367075467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614da76bbb0 msgr2=0x5614da76dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:57.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.252+0000 7fa847fff640 1 --2- 172.21.15.7:0/367075467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614da76bbb0 0x5614da76dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.252+0000 7fa847fff640 1 -- 172.21.15.7:0/367075467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614da7609d0 msgr2=0x5614da760db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:57.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.252+0000 7fa847fff640 1 --2- 172.21.15.7:0/367075467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614da7609d0 0x5614da760db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.252+0000 7fa847fff640 1 -- 172.21.15.7:0/367075467 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614da67b130 con 0x5614da7612f0 2024-09-19T08:44:57.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.252+0000 7fa847fff640 1 --2- 172.21.15.7:0/367075467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da7612f0 0x5614da76b670 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa834009900 tx=0x7fa834005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948c2042a505bea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:57.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.252+0000 7fa832ffd640 1 -- 172.21.15.7:0/367075467 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa834040070 con 0x5614da7612f0 2024-09-19T08:44:57.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.252+0000 7fa832ffd640 1 -- 172.21.15.7:0/367075467 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8340319f0 con 0x5614da7612f0 2024-09-19T08:44:57.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.252+0000 7fa832ffd640 1 -- 172.21.15.7:0/367075467 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa834035040 con 0x5614da7612f0 2024-09-19T08:44:57.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.253+0000 7fa8514c6740 1 -- 172.21.15.7:0/367075467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da7612f0 msgr2=0x5614da76b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:57.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.253+0000 7fa8514c6740 1 --2- 172.21.15.7:0/367075467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da7612f0 0x5614da76b670 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa834009900 tx=0x7fa834005e80 comp rx=0 tx=0).stop 2024-09-19T08:44:57.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.253+0000 7fa8514c6740 1 -- 172.21.15.7:0/367075467 shutdown_connections 2024-09-19T08:44:57.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.253+0000 7fa8514c6740 1 --2- 172.21.15.7:0/367075467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614da76bbb0 0x5614da76dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.253+0000 7fa8514c6740 1 --2- 172.21.15.7:0/367075467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da7612f0 0x5614da76b670 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.253+0000 7fa8514c6740 1 --2- 172.21.15.7:0/367075467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614da7609d0 0x5614da760db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.253+0000 7fa8514c6740 1 -- 172.21.15.7:0/367075467 >> 172.21.15.7:0/367075467 conn(0x5614da75cf60 msgr2=0x5614da75d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:57.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.253+0000 7fa8514c6740 1 -- 172.21.15.7:0/367075467 shutdown_connections 2024-09-19T08:44:57.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.253+0000 7fa8514c6740 1 -- 172.21.15.7:0/367075467 wait complete. 2024-09-19T08:44:57.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.253+0000 7fa8514c6740 1 -- start start 2024-09-19T08:44:57.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.253+0000 7fa8514c6740 1 Processor -- start 2024-09-19T08:44:57.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.254+0000 7fa8514c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614da7609d0 0x5614da76b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:57.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.254+0000 7fa8514c6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614da7612f0 0x5614da768710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:57.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.254+0000 7fa8514c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da76bbb0 0x5614da768c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:57.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.254+0000 7fa8514c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5614da76e780 con 0x5614da76bbb0 2024-09-19T08:44:57.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.254+0000 7fa8514c6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5614da681f20 con 0x5614da7612f0 2024-09-19T08:44:57.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.254+0000 7fa8514c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5614da76e900 con 0x5614da7609d0 2024-09-19T08:44:57.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.254+0000 7fa8514c6740 10 client.0 _ll_register_callbacks cb 0x5614da64b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:44:57.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.254+0000 7fa84d68a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da76bbb0 0x5614da768c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:57.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.254+0000 7fa84d68a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da76bbb0 0x5614da768c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51118/0 (socket says 172.21.15.7:51118) 2024-09-19T08:44:57.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.254+0000 7fa84d68a640 1 -- 172.21.15.7:0/1577113447 learned_addr learned my addr 172.21.15.7:0/1577113447 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:57.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.254+0000 7fa847fff640 1 --2- 172.21.15.7:0/1577113447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614da7612f0 0x5614da768710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:57.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.254+0000 7fa84ce89640 1 --2- 172.21.15.7:0/1577113447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614da7609d0 0x5614da76b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:57.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.254+0000 7fa84d68a640 1 -- 172.21.15.7:0/1577113447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614da7609d0 msgr2=0x5614da76b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:57.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.254+0000 7fa84d68a640 1 --2- 172.21.15.7:0/1577113447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614da7609d0 0x5614da76b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.254+0000 7fa84d68a640 1 -- 172.21.15.7:0/1577113447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614da7612f0 msgr2=0x5614da768710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:57.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.254+0000 7fa84d68a640 1 --2- 172.21.15.7:0/1577113447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614da7612f0 0x5614da768710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.254+0000 7fa84d68a640 1 -- 172.21.15.7:0/1577113447 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614da4382b0 con 0x5614da76bbb0 2024-09-19T08:44:57.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.254+0000 7fa84d68a640 1 --2- 172.21.15.7:0/1577113447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da76bbb0 0x5614da768c50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa840011c10 tx=0x7fa840004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7259f213151f3d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:57.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.254+0000 7fa827fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:44:57.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.255+0000 7fa827fff640 1 -- 172.21.15.7:0/1577113447 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa840023070 con 0x5614da76bbb0 2024-09-19T08:44:57.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.255+0000 7fa827fff640 1 -- 172.21.15.7:0/1577113447 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fa840003970 con 0x5614da76bbb0 2024-09-19T08:44:57.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.255+0000 7fa8514c6740 1 -- 172.21.15.7:0/1577113447 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8340319f0 con 0x5614da76bbb0 2024-09-19T08:44:57.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.255+0000 7fa827fff640 1 -- 172.21.15.7:0/1577113447 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa84002e050 con 0x5614da76bbb0 2024-09-19T08:44:57.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.255+0000 7fa8514c6740 10 client.15372 fetch_fsmap learned FSMap version 25 2024-09-19T08:44:57.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.255+0000 7fa8514c6740 1 -- 172.21.15.7:0/1577113447 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5614da77a0f0 con 0x5614da76bbb0 2024-09-19T08:44:57.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.255+0000 7fa827fff640 1 -- 172.21.15.7:0/1577113447 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8340319f0 con 0x5614da76bbb0 2024-09-19T08:44:57.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.255+0000 7fa827fff640 1 -- 172.21.15.7:0/1577113447 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa84000f040 con 0x5614da76bbb0 2024-09-19T08:44:57.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.255+0000 7fa8514c6740 10 client.15372 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:44:57.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.255+0000 7fa8514c6740 10 client.15372 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T08:44:57.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.255+0000 7fa8514c6740 20 client.15372 populate_metadata read hostname 'smithi007' 2024-09-19T08:44:57.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.255+0000 7fa8514c6740 1 --2- 172.21.15.7:0/1577113447 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5614da77c750 0x5614da77dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:57.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.255+0000 7fa8514c6740 4 client.15372 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:44:57.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.255+0000 7fa8514c6740 1 -- 172.21.15.7:0/1577113447 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614da6d4600 con 0x5614da77c750 2024-09-19T08:44:57.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.256+0000 7fa84ce89640 1 --2- 172.21.15.7:0/1577113447 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5614da77c750 0x5614da77dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:57.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.256+0000 7fa84ce89640 1 --2- 172.21.15.7:0/1577113447 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5614da77c750 0x5614da77dbc0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4457f5ce4436c43f server_cookie=2d781bed1b030b72 in_seq=0 out_seq=0 2024-09-19T08:44:57.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.256+0000 7fa827fff640 10 client.15372 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:44:57.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.257+0000 7fa827fff640 1 -- 172.21.15.7:0/1577113447 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5614da6d4600 con 0x5614da77c750 2024-09-19T08:44:57.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.257+0000 7fa827fff640 10 client.15372 handle_command_reply: tid=0 2024-09-19T08:44:57.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.257+0000 7fa8514c6740 1 client.15372 shutdown 2024-09-19T08:44:57.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.257+0000 7fa8514c6740 1 -- 172.21.15.7:0/1577113447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da76bbb0 msgr2=0x5614da768c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:57.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.257+0000 7fa8514c6740 1 --2- 172.21.15.7:0/1577113447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da76bbb0 0x5614da768c50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa840011c10 tx=0x7fa840004a40 comp rx=0 tx=0).stop 2024-09-19T08:44:57.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.257+0000 7fa8514c6740 1 -- 172.21.15.7:0/1577113447 shutdown_connections 2024-09-19T08:44:57.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.257+0000 7fa8514c6740 1 --2- 172.21.15.7:0/1577113447 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5614da77c750 0x5614da77dbc0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.257+0000 7fa8514c6740 1 --2- 172.21.15.7:0/1577113447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da76bbb0 0x5614da768c50 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.257+0000 7fa8514c6740 1 --2- 172.21.15.7:0/1577113447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614da7612f0 0x5614da768710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.257+0000 7fa827fff640 0 client.15372 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:44:57.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.257+0000 7fa8514c6740 1 --2- 172.21.15.7:0/1577113447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614da7609d0 0x5614da76b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.257+0000 7fa8514c6740 1 -- 172.21.15.7:0/1577113447 >> 172.21.15.7:0/1577113447 conn(0x5614da75cf60 msgr2=0x5614da762c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:57.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.257+0000 7fa8514c6740 1 -- 172.21.15.7:0/1577113447 shutdown_connections 2024-09-19T08:44:57.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.257+0000 7fa8514c6740 1 -- 172.21.15.7:0/1577113447 wait complete. 2024-09-19T08:44:57.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.257+0000 7fa8514c6740 20 client.15372 trim_cache size 0 max 16384 2024-09-19T08:44:57.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.275+0000 7fa8514c6740 1 Processor -- start 2024-09-19T08:44:57.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.275+0000 7fa8514c6740 1 -- start start 2024-09-19T08:44:57.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.275+0000 7fa8514c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614da7609d0 0x5614da77dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:57.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.275+0000 7fa8514c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da7612f0 0x5614da766fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:57.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.275+0000 7fa8514c6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614da76bbb0 0x5614da767520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:57.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.275+0000 7fa8514c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5614da77bf00 con 0x5614da7612f0 2024-09-19T08:44:57.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.275+0000 7fa8514c6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5614da77c5d0 con 0x5614da76bbb0 2024-09-19T08:44:57.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.275+0000 7fa8514c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5614da77cca0 con 0x5614da7609d0 2024-09-19T08:44:57.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.275+0000 7fa847fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da7612f0 0x5614da766fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:57.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.275+0000 7fa847fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da7612f0 0x5614da766fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51126/0 (socket says 172.21.15.7:51126) 2024-09-19T08:44:57.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.275+0000 7fa847fff640 1 -- 172.21.15.7:0/3179409355 learned_addr learned my addr 172.21.15.7:0/3179409355 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:57.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.275+0000 7fa84ce89640 1 --2- 172.21.15.7:0/3179409355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614da7609d0 0x5614da77dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:57.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.275+0000 7fa847fff640 1 -- 172.21.15.7:0/3179409355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614da7609d0 msgr2=0x5614da77dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:57.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.275+0000 7fa847fff640 1 --2- 172.21.15.7:0/3179409355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614da7609d0 0x5614da77dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.275+0000 7fa847fff640 1 -- 172.21.15.7:0/3179409355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614da76bbb0 msgr2=0x5614da767520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:57.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.275+0000 7fa847fff640 1 --2- 172.21.15.7:0/3179409355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614da76bbb0 0x5614da767520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.275+0000 7fa847fff640 1 -- 172.21.15.7:0/3179409355 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614da76b730 con 0x5614da7612f0 2024-09-19T08:44:57.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.276+0000 7fa847fff640 1 --2- 172.21.15.7:0/3179409355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da7612f0 0x5614da766fe0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa834009900 tx=0x7fa83402ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f3aadd28e02bb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:57.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.276+0000 7fa8327fc640 1 -- 172.21.15.7:0/3179409355 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83404c030 con 0x5614da7612f0 2024-09-19T08:44:57.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.276+0000 7fa8327fc640 1 -- 172.21.15.7:0/3179409355 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8340318b0 con 0x5614da7612f0 2024-09-19T08:44:57.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.276+0000 7fa8327fc640 1 -- 172.21.15.7:0/3179409355 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa834040040 con 0x5614da7612f0 2024-09-19T08:44:57.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.276+0000 7fa8514c6740 1 -- 172.21.15.7:0/3179409355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da7612f0 msgr2=0x5614da766fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:57.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.276+0000 7fa8514c6740 1 --2- 172.21.15.7:0/3179409355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da7612f0 0x5614da766fe0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa834009900 tx=0x7fa83402ac30 comp rx=0 tx=0).stop 2024-09-19T08:44:57.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.276+0000 7fa8514c6740 1 -- 172.21.15.7:0/3179409355 shutdown_connections 2024-09-19T08:44:57.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.276+0000 7fa8514c6740 1 --2- 172.21.15.7:0/3179409355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614da76bbb0 0x5614da767520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.276+0000 7fa8514c6740 1 --2- 172.21.15.7:0/3179409355 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da7612f0 0x5614da766fe0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.276+0000 7fa8514c6740 1 --2- 172.21.15.7:0/3179409355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614da7609d0 0x5614da77dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.276+0000 7fa8514c6740 1 -- 172.21.15.7:0/3179409355 >> 172.21.15.7:0/3179409355 conn(0x5614da75cf60 msgr2=0x5614da7686d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:57.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.276+0000 7fa8514c6740 1 -- 172.21.15.7:0/3179409355 shutdown_connections 2024-09-19T08:44:57.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.277+0000 7fa8514c6740 1 -- 172.21.15.7:0/3179409355 wait complete. 2024-09-19T08:44:57.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.277+0000 7fa8514c6740 1 -- start start 2024-09-19T08:44:57.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.277+0000 7fa8514c6740 1 Processor -- start 2024-09-19T08:44:57.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.277+0000 7fa8514c6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614da7609d0 0x5614da786040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:57.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.277+0000 7fa8514c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da76bbb0 0x5614da786580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:57.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.277+0000 7fa8514c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614da77f2d0 0x5614da77f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:57.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.277+0000 7fa8514c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5614da77da40 con 0x5614da76bbb0 2024-09-19T08:44:57.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.277+0000 7fa8514c6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5614da77d370 con 0x5614da7609d0 2024-09-19T08:44:57.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.277+0000 7fa8514c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5614da77e110 con 0x5614da77f2d0 2024-09-19T08:44:57.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.277+0000 7fa8514c6740 10 client.0 _ll_register_callbacks cb 0x7fa840009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:44:57.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.278+0000 7fa847fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da76bbb0 0x5614da786580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:57.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.278+0000 7fa847fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da76bbb0 0x5614da786580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51134/0 (socket says 172.21.15.7:51134) 2024-09-19T08:44:57.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.278+0000 7fa847fff640 1 -- 172.21.15.7:0/2732780240 learned_addr learned my addr 172.21.15.7:0/2732780240 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:57.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.278+0000 7fa84ce89640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614da7609d0 0x5614da786040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:57.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.278+0000 7fa84d68a640 1 --2- 172.21.15.7:0/2732780240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614da77f2d0 0x5614da77f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:57.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.278+0000 7fa847fff640 1 -- 172.21.15.7:0/2732780240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614da77f2d0 msgr2=0x5614da77f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:57.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.278+0000 7fa847fff640 1 --2- 172.21.15.7:0/2732780240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614da77f2d0 0x5614da77f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.278+0000 7fa847fff640 1 -- 172.21.15.7:0/2732780240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614da7609d0 msgr2=0x5614da786040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:57.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.278+0000 7fa847fff640 1 --2- 172.21.15.7:0/2732780240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614da7609d0 0x5614da786040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.278+0000 7fa847fff640 1 -- 172.21.15.7:0/2732780240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614da77fec0 con 0x5614da76bbb0 2024-09-19T08:44:57.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.278+0000 7fa847fff640 1 --2- 172.21.15.7:0/2732780240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da76bbb0 0x5614da786580 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa834000c00 tx=0x7fa834005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce909f3bb752c40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:57.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.278+0000 7fa827fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:44:57.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.278+0000 7fa827fff640 1 -- 172.21.15.7:0/2732780240 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa834056060 con 0x5614da76bbb0 2024-09-19T08:44:57.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.278+0000 7fa827fff640 1 -- 172.21.15.7:0/2732780240 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fa834004430 con 0x5614da76bbb0 2024-09-19T08:44:57.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.278+0000 7fa8514c6740 1 -- 172.21.15.7:0/2732780240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8340318b0 con 0x5614da76bbb0 2024-09-19T08:44:57.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.278+0000 7fa827fff640 1 -- 172.21.15.7:0/2732780240 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa834040070 con 0x5614da76bbb0 2024-09-19T08:44:57.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.278+0000 7fa8514c6740 10 client.15378 fetch_fsmap learned FSMap version 25 2024-09-19T08:44:57.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.278+0000 7fa8514c6740 1 -- 172.21.15.7:0/2732780240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5614da7e6e60 con 0x5614da76bbb0 2024-09-19T08:44:57.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.279+0000 7fa827fff640 1 -- 172.21.15.7:0/2732780240 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8340318b0 con 0x5614da76bbb0 2024-09-19T08:44:57.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.279+0000 7fa827fff640 1 -- 172.21.15.7:0/2732780240 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa8340037a0 con 0x5614da76bbb0 2024-09-19T08:44:57.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.279+0000 7fa8514c6740 10 client.15378 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:44:57.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.279+0000 7fa8514c6740 10 client.15378 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T08:44:57.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.279+0000 7fa8514c6740 20 client.15378 populate_metadata read hostname 'smithi007' 2024-09-19T08:44:57.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.279+0000 7fa8514c6740 1 --2- 172.21.15.7:0/2732780240 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5614da7eb250 0x5614da7e9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:57.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.279+0000 7fa8514c6740 4 client.15378 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:44:57.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.279+0000 7fa8514c6740 1 -- 172.21.15.7:0/2732780240 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "status"}) -- 0x5614da6ceb10 con 0x5614da7eb250 2024-09-19T08:44:57.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.279+0000 7fa84ce89640 1 --2- 172.21.15.7:0/2732780240 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5614da7eb250 0x5614da7e9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:57.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.279+0000 7fa827fff640 10 client.15378 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:44:57.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.279+0000 7fa84ce89640 1 --2- 172.21.15.7:0/2732780240 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5614da7eb250 0x5614da7e9f60 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1de21134d22778a0 server_cookie=1710e8ce52055081 in_seq=0 out_seq=0 2024-09-19T08:44:57.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.280+0000 7fa827fff640 1 -- 172.21.15.7:0/2732780240 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5614da6ceb10 con 0x5614da7eb250 2024-09-19T08:44:57.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.280+0000 7fa827fff640 10 client.15378 handle_command_reply: tid=0 2024-09-19T08:44:57.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.280+0000 7fa8514c6740 1 client.15378 shutdown 2024-09-19T08:44:57.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.280+0000 7fa8514c6740 1 -- 172.21.15.7:0/2732780240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da76bbb0 msgr2=0x5614da786580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:57.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.280+0000 7fa8514c6740 1 --2- 172.21.15.7:0/2732780240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da76bbb0 0x5614da786580 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa834000c00 tx=0x7fa834005e80 comp rx=0 tx=0).stop 2024-09-19T08:44:57.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.280+0000 7fa8514c6740 1 -- 172.21.15.7:0/2732780240 shutdown_connections 2024-09-19T08:44:57.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.280+0000 7fa8514c6740 1 --2- 172.21.15.7:0/2732780240 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5614da7eb250 0x5614da7e9f60 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.280+0000 7fa8514c6740 1 --2- 172.21.15.7:0/2732780240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614da77f2d0 0x5614da77f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.280+0000 7fa8514c6740 1 --2- 172.21.15.7:0/2732780240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614da76bbb0 0x5614da786580 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.280+0000 7fa8514c6740 1 --2- 172.21.15.7:0/2732780240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614da7609d0 0x5614da786040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.280+0000 7fa8514c6740 1 -- 172.21.15.7:0/2732780240 >> 172.21.15.7:0/2732780240 conn(0x5614da75cf60 msgr2=0x5614da766f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:57.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.280+0000 7fa827fff640 0 client.15378 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:44:57.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.280+0000 7fa8514c6740 1 -- 172.21.15.7:0/2732780240 shutdown_connections 2024-09-19T08:44:57.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.280+0000 7fa8514c6740 1 -- 172.21.15.7:0/2732780240 wait complete. 2024-09-19T08:44:57.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.280+0000 7fa8514c6740 20 client.15378 trim_cache size 0 max 16384 2024-09-19T08:44:57.303 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:44:57.303 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "ebd23124-7661-11ef-bceb-c7b262605968", 2024-09-19T08:44:57.303 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 2, 2024-09-19T08:44:57.303 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24458, 2024-09-19T08:44:57.303 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T08:44:57.303 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T08:44:57.304 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T08:44:57.304 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 124.198739381, 2024-09-19T08:44:57.304 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 25, 2024-09-19T08:44:57.304 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 83, 2024-09-19T08:44:57.304 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 83, 2024-09-19T08:44:57.304 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 154.05680064500001 2024-09-19T08:44:57.304 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:44:57.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.281+0000 7fa84f0ed640 1 -- 172.21.15.7:0/835500034 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa8380a34c0 msgr2=0x7fa8380a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:57.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.281+0000 7fa84f0ed640 1 --2- 172.21.15.7:0/835500034 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa8380a34c0 0x7fa8380a5980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa840005fd0 tx=0x7fa840009440 comp rx=0 tx=0).stop 2024-09-19T08:44:57.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.281+0000 7fa84f0ed640 1 -- 172.21.15.7:0/835500034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa848102e00 msgr2=0x7fa848100a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:57.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.281+0000 7fa84f0ed640 1 --2- 172.21.15.7:0/835500034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa848102e00 0x7fa848100a60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa83c00d770 tx=0x7fa83c00dc30 comp rx=0 tx=0).stop 2024-09-19T08:44:57.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.281+0000 7fa84f0ed640 1 -- 172.21.15.7:0/835500034 shutdown_connections 2024-09-19T08:44:57.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.281+0000 7fa84f0ed640 1 --2- 172.21.15.7:0/835500034 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa8380a34c0 0x7fa8380a5980 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.281+0000 7fa84f0ed640 1 --2- 172.21.15.7:0/835500034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa84810c1a0 0x7fa8481014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.281+0000 7fa84f0ed640 1 --2- 172.21.15.7:0/835500034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa848103720 0x7fa848100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.281+0000 7fa84f0ed640 1 --2- 172.21.15.7:0/835500034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa848102e00 0x7fa848100a60 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:57.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.281+0000 7fa84f0ed640 1 -- 172.21.15.7:0/835500034 >> 172.21.15.7:0/835500034 conn(0x7fa8480fc7a0 msgr2=0x7fa8480fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:57.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.281+0000 7fa84f0ed640 1 -- 172.21.15.7:0/835500034 shutdown_connections 2024-09-19T08:44:57.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:57.281+0000 7fa84f0ed640 1 -- 172.21.15.7:0/835500034 wait complete. 2024-09-19T08:44:57.965 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T08:44:58.227 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:58.469 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:44:58 smithi007 ceph-mon[31221]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:44:58.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:44:58 smithi044 ceph-mon[35072]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:44:58.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:44:58 smithi175 ceph-mon[35688]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:44:58.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.672+0000 7f6934b79640 1 -- 172.21.15.7:0/1247478874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6930106a80 msgr2=0x7f6930106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:58.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.672+0000 7f6934b79640 1 --2- 172.21.15.7:0/1247478874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6930106a80 0x7f6930106e60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6920009930 tx=0x7f692002a420 comp rx=0 tx=0).stop 2024-09-19T08:44:58.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.672+0000 7f6934b79640 1 -- 172.21.15.7:0/1247478874 shutdown_connections 2024-09-19T08:44:58.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.672+0000 7f6934b79640 1 --2- 172.21.15.7:0/1247478874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6930101420 0x7f693010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.672+0000 7f6934b79640 1 --2- 172.21.15.7:0/1247478874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6930100a80 0x7f6930100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.672+0000 7f6934b79640 1 --2- 172.21.15.7:0/1247478874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6930106a80 0x7f6930106e60 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.672+0000 7f6934b79640 1 -- 172.21.15.7:0/1247478874 >> 172.21.15.7:0/1247478874 conn(0x7f69300fc7a0 msgr2=0x7f69300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:58.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.672+0000 7f6934b79640 1 -- 172.21.15.7:0/1247478874 shutdown_connections 2024-09-19T08:44:58.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.672+0000 7f6934b79640 1 -- 172.21.15.7:0/1247478874 wait complete. 2024-09-19T08:44:58.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.673+0000 7f6934b79640 1 Processor -- start 2024-09-19T08:44:58.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.673+0000 7f6934b79640 1 -- start start 2024-09-19T08:44:58.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.673+0000 7f6934b79640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6930100a80 0x7f6930199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:58.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.673+0000 7f6934b79640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6930101420 0x7f6930199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:58.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.673+0000 7f6934b79640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6930106a80 0x7f69301a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:58.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.673+0000 7f6934b79640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6930110ea0 con 0x7f6930106a80 2024-09-19T08:44:58.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.673+0000 7f6934b79640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6930110d20 con 0x7f6930101420 2024-09-19T08:44:58.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.673+0000 7f6934b79640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6930111020 con 0x7f6930100a80 2024-09-19T08:44:58.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.673+0000 7f692ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6930106a80 0x7f69301a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:58.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.673+0000 7f692ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6930106a80 0x7f69301a4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51144/0 (socket says 172.21.15.7:51144) 2024-09-19T08:44:58.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.673+0000 7f692ed9d640 1 -- 172.21.15.7:0/544282507 learned_addr learned my addr 172.21.15.7:0/544282507 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:58.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.673+0000 7f692e59c640 1 --2- 172.21.15.7:0/544282507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6930100a80 0x7f6930199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:58.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.673+0000 7f692dd9b640 1 --2- 172.21.15.7:0/544282507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6930101420 0x7f6930199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:58.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.673+0000 7f692ed9d640 1 -- 172.21.15.7:0/544282507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6930100a80 msgr2=0x7f6930199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:58.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.673+0000 7f692ed9d640 1 --2- 172.21.15.7:0/544282507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6930100a80 0x7f6930199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.673+0000 7f692ed9d640 1 -- 172.21.15.7:0/544282507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6930101420 msgr2=0x7f6930199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:58.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.673+0000 7f692ed9d640 1 --2- 172.21.15.7:0/544282507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6930101420 0x7f6930199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.674+0000 7f692ed9d640 1 -- 172.21.15.7:0/544282507 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69301a48d0 con 0x7f6930106a80 2024-09-19T08:44:58.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.674+0000 7f692ed9d640 1 --2- 172.21.15.7:0/544282507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6930106a80 0x7f69301a4390 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f692800b970 tx=0x7f692800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:58.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.674+0000 7f691f7fe640 1 -- 172.21.15.7:0/544282507 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928019070 con 0x7f6930106a80 2024-09-19T08:44:58.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.674+0000 7f6934b79640 1 -- 172.21.15.7:0/544282507 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69301a4aa0 con 0x7f6930106a80 2024-09-19T08:44:58.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.674+0000 7f691f7fe640 1 -- 172.21.15.7:0/544282507 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f692800cb40 con 0x7f6930106a80 2024-09-19T08:44:58.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.674+0000 7f691f7fe640 1 -- 172.21.15.7:0/544282507 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69280075f0 con 0x7f6930106a80 2024-09-19T08:44:58.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.674+0000 7f6934b79640 1 -- 172.21.15.7:0/544282507 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69301a4f90 con 0x7f6930106a80 2024-09-19T08:44:58.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.676+0000 7f6936f52740 1 Processor -- start 2024-09-19T08:44:58.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.676+0000 7f691f7fe640 1 -- 172.21.15.7:0/544282507 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f692801c070 con 0x7f6930106a80 2024-09-19T08:44:58.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.677+0000 7f6936f52740 1 -- start start 2024-09-19T08:44:58.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.677+0000 7f6936f52740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567537848b0 0x556753784c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:58.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.677+0000 7f6936f52740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567537851d0 0x556753793a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:58.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.677+0000 7f6936f52740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556753793fc0 0x5567537963b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:58.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.677+0000 7f6936f52740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5567536eb090 con 0x5567537851d0 2024-09-19T08:44:58.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.677+0000 7f6936f52740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556753692a70 con 0x5567537848b0 2024-09-19T08:44:58.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.677+0000 7f6936f52740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5567536e7050 con 0x556753793fc0 2024-09-19T08:44:58.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.677+0000 7f692e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567537851d0 0x556753793a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:58.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.677+0000 7f692e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567537851d0 0x556753793a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51148/0 (socket says 172.21.15.7:51148) 2024-09-19T08:44:58.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.677+0000 7f692e59c640 1 -- 172.21.15.7:0/2084877625 learned_addr learned my addr 172.21.15.7:0/2084877625 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:58.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.677+0000 7f692dd9b640 1 --2- 172.21.15.7:0/2084877625 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567537848b0 0x556753784c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:58.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.677+0000 7f692dd9b640 1 --2- 172.21.15.7:0/2084877625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556753793fc0 0x5567537963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:58.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.677+0000 7f691f7fe640 1 --2- 172.21.15.7:0/544282507 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f69180a3440 0x7f69180a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:58.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.678+0000 7f692e59c640 1 -- 172.21.15.7:0/2084877625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556753793fc0 msgr2=0x5567537963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:58.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.678+0000 7f692e59c640 1 --2- 172.21.15.7:0/2084877625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556753793fc0 0x5567537963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.678+0000 7f692e59c640 1 -- 172.21.15.7:0/2084877625 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567537848b0 msgr2=0x556753784c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:58.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.678+0000 7f692e59c640 1 --2- 172.21.15.7:0/2084877625 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567537848b0 0x556753784c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.678+0000 7f692ed9d640 1 --2- 172.21.15.7:0/544282507 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f69180a3440 0x7f69180a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:58.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.678+0000 7f692e59c640 1 -- 172.21.15.7:0/2084877625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55675369f130 con 0x5567537851d0 2024-09-19T08:44:58.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.678+0000 7f691f7fe640 1 -- 172.21.15.7:0/544282507 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f69280cf2d0 con 0x7f6930106a80 2024-09-19T08:44:58.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.678+0000 7f692e59c640 1 --2- 172.21.15.7:0/2084877625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567537851d0 0x556753793a80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f692002a940 tx=0x7f69200316e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d4202773c63854 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:58.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.678+0000 7f692ed9d640 1 --2- 172.21.15.7:0/544282507 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f69180a3440 0x7f69180a5900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f69280ccac0 tx=0x7f6928004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:58.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.678+0000 7f691cff9640 1 -- 172.21.15.7:0/2084877625 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6920040070 con 0x5567537851d0 2024-09-19T08:44:58.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.678+0000 7f691cff9640 1 -- 172.21.15.7:0/2084877625 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6920005020 con 0x5567537851d0 2024-09-19T08:44:58.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.678+0000 7f691cff9640 1 -- 172.21.15.7:0/2084877625 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6920035040 con 0x5567537851d0 2024-09-19T08:44:58.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.679+0000 7f6936f52740 1 -- 172.21.15.7:0/2084877625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567537851d0 msgr2=0x556753793a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:58.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.679+0000 7f6936f52740 1 --2- 172.21.15.7:0/2084877625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567537851d0 0x556753793a80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f692002a940 tx=0x7f69200316e0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.679+0000 7f6936f52740 1 -- 172.21.15.7:0/2084877625 shutdown_connections 2024-09-19T08:44:58.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.679+0000 7f6936f52740 1 --2- 172.21.15.7:0/2084877625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556753793fc0 0x5567537963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.679+0000 7f6936f52740 1 --2- 172.21.15.7:0/2084877625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567537851d0 0x556753793a80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.679+0000 7f6936f52740 1 --2- 172.21.15.7:0/2084877625 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567537848b0 0x556753784c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.679+0000 7f6936f52740 1 -- 172.21.15.7:0/2084877625 >> 172.21.15.7:0/2084877625 conn(0x556753780f60 msgr2=0x556753781340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:58.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.679+0000 7f6936f52740 1 -- 172.21.15.7:0/2084877625 shutdown_connections 2024-09-19T08:44:58.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.679+0000 7f6936f52740 1 -- 172.21.15.7:0/2084877625 wait complete. 2024-09-19T08:44:58.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.679+0000 7f6936f52740 1 -- start start 2024-09-19T08:44:58.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.679+0000 7f6936f52740 1 Processor -- start 2024-09-19T08:44:58.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.680+0000 7f6936f52740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567537848b0 0x556753793800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:58.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.680+0000 7f6936f52740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567537851d0 0x556753790ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:58.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.680+0000 7f6936f52740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556753793fc0 0x5567537910e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:58.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.680+0000 7f6936f52740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556753796b90 con 0x5567537848b0 2024-09-19T08:44:58.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.680+0000 7f6936f52740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5567536a5f20 con 0x5567537851d0 2024-09-19T08:44:58.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.680+0000 7f6936f52740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556753796d10 con 0x556753793fc0 2024-09-19T08:44:58.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.680+0000 7f6936f52740 10 client.0 _ll_register_callbacks cb 0x55675366f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:44:58.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.680+0000 7f692dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567537848b0 0x556753793800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:58.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.680+0000 7f692dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567537848b0 0x556753793800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51154/0 (socket says 172.21.15.7:51154) 2024-09-19T08:44:58.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.680+0000 7f692dd9b640 1 -- 172.21.15.7:0/614402395 learned_addr learned my addr 172.21.15.7:0/614402395 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:58.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.680+0000 7f692e59c640 1 --2- 172.21.15.7:0/614402395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567537851d0 0x556753790ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:58.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.680+0000 7f692dd9b640 1 -- 172.21.15.7:0/614402395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556753793fc0 msgr2=0x5567537910e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:58.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.680+0000 7f692dd9b640 1 --2- 172.21.15.7:0/614402395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556753793fc0 0x5567537910e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.680+0000 7f692dd9b640 1 -- 172.21.15.7:0/614402395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567537851d0 msgr2=0x556753790ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:58.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.680+0000 7f692dd9b640 1 --2- 172.21.15.7:0/614402395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567537851d0 0x556753790ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.680+0000 7f692dd9b640 1 -- 172.21.15.7:0/614402395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55675345c2b0 con 0x5567537848b0 2024-09-19T08:44:58.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.680+0000 7f692e59c640 1 --2- 172.21.15.7:0/614402395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567537851d0 0x556753790ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:58.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.680+0000 7f692dd9b640 1 --2- 172.21.15.7:0/614402395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567537848b0 0x556753793800 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f69240058c0 tx=0x7f6924013f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937c71ec504756b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:58.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.680+0000 7f6915ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:44:58.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.680+0000 7f6915ffb640 1 -- 172.21.15.7:0/614402395 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6924011dd0 con 0x5567537848b0 2024-09-19T08:44:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.681+0000 7f6915ffb640 1 -- 172.21.15.7:0/614402395 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f6924005020 con 0x5567537848b0 2024-09-19T08:44:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.681+0000 7f6936f52740 1 -- 172.21.15.7:0/614402395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6920005020 con 0x5567537848b0 2024-09-19T08:44:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.681+0000 7f6915ffb640 1 -- 172.21.15.7:0/614402395 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6924005220 con 0x5567537848b0 2024-09-19T08:44:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.681+0000 7f6936f52740 10 client.15390 fetch_fsmap learned FSMap version 25 2024-09-19T08:44:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.681+0000 7f6936f52740 1 -- 172.21.15.7:0/614402395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5567537a24c0 con 0x5567537848b0 2024-09-19T08:44:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.681+0000 7f6915ffb640 1 -- 172.21.15.7:0/614402395 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6920005020 con 0x5567537848b0 2024-09-19T08:44:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.681+0000 7f6915ffb640 1 -- 172.21.15.7:0/614402395 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6924010550 con 0x5567537848b0 2024-09-19T08:44:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.681+0000 7f6936f52740 10 client.15390 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:44:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.681+0000 7f6936f52740 10 client.15390 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T08:44:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.681+0000 7f6936f52740 20 client.15390 populate_metadata read hostname 'smithi007' 2024-09-19T08:44:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.681+0000 7f6936f52740 1 --2- 172.21.15.7:0/614402395 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5567537a4b20 0x5567537a5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.681+0000 7f6936f52740 4 client.15390 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:44:58.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.681+0000 7f6936f52740 1 -- 172.21.15.7:0/614402395 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5567536f8600 con 0x5567537a4b20 2024-09-19T08:44:58.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.682+0000 7f692e59c640 1 --2- 172.21.15.7:0/614402395 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5567537a4b20 0x5567537a5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:58.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.682+0000 7f692e59c640 1 --2- 172.21.15.7:0/614402395 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5567537a4b20 0x5567537a5f90 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d50490fbe98647d6 server_cookie=78c8c2822592c55d in_seq=0 out_seq=0 2024-09-19T08:44:58.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.682+0000 7f6915ffb640 10 client.15390 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:44:58.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.683+0000 7f6915ffb640 1 -- 172.21.15.7:0/614402395 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5567536f8600 con 0x5567537a4b20 2024-09-19T08:44:58.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.683+0000 7f6915ffb640 10 client.15390 handle_command_reply: tid=0 2024-09-19T08:44:58.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.683+0000 7f6936f52740 1 client.15390 shutdown 2024-09-19T08:44:58.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.683+0000 7f6936f52740 1 -- 172.21.15.7:0/614402395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567537848b0 msgr2=0x556753793800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:58.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.683+0000 7f6936f52740 1 --2- 172.21.15.7:0/614402395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567537848b0 0x556753793800 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f69240058c0 tx=0x7f6924013f10 comp rx=0 tx=0).stop 2024-09-19T08:44:58.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.683+0000 7f6936f52740 1 -- 172.21.15.7:0/614402395 shutdown_connections 2024-09-19T08:44:58.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.683+0000 7f6936f52740 1 --2- 172.21.15.7:0/614402395 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5567537a4b20 0x5567537a5f90 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.683+0000 7f6936f52740 1 --2- 172.21.15.7:0/614402395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556753793fc0 0x5567537910e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.683+0000 7f6936f52740 1 --2- 172.21.15.7:0/614402395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567537851d0 0x556753790ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.683+0000 7f6915ffb640 0 client.15390 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:44:58.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.683+0000 7f6936f52740 1 --2- 172.21.15.7:0/614402395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5567537848b0 0x556753793800 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.683+0000 7f6936f52740 1 -- 172.21.15.7:0/614402395 >> 172.21.15.7:0/614402395 conn(0x556753780f60 msgr2=0x556753786cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:58.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.683+0000 7f6936f52740 1 -- 172.21.15.7:0/614402395 shutdown_connections 2024-09-19T08:44:58.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.683+0000 7f6936f52740 1 -- 172.21.15.7:0/614402395 wait complete. 2024-09-19T08:44:58.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.683+0000 7f6936f52740 20 client.15390 trim_cache size 0 max 16384 2024-09-19T08:44:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.701+0000 7f6936f52740 1 Processor -- start 2024-09-19T08:44:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.701+0000 7f6936f52740 1 -- start start 2024-09-19T08:44:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.701+0000 7f6936f52740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567537848b0 0x5567537a4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.701+0000 7f6936f52740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567537851d0 0x5567537a5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.701+0000 7f6936f52740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556753793fc0 0x55675378f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.701+0000 7f6936f52740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5567537a42d0 con 0x556753793fc0 2024-09-19T08:44:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.701+0000 7f6936f52740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5567537a49a0 con 0x5567537848b0 2024-09-19T08:44:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.701+0000 7f6936f52740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5567537a5070 con 0x5567537851d0 2024-09-19T08:44:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.702+0000 7f692dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556753793fc0 0x55675378f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.702+0000 7f692dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556753793fc0 0x55675378f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51160/0 (socket says 172.21.15.7:51160) 2024-09-19T08:44:58.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.702+0000 7f692dd9b640 1 -- 172.21.15.7:0/1784402525 learned_addr learned my addr 172.21.15.7:0/1784402525 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:58.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.702+0000 7f692dd9b640 1 --2- 172.21.15.7:0/1784402525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567537848b0 0x5567537a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:58.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.702+0000 7f692e59c640 1 --2- 172.21.15.7:0/1784402525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567537851d0 0x5567537a5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:58.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.702+0000 7f692dd9b640 1 -- 172.21.15.7:0/1784402525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567537851d0 msgr2=0x5567537a5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:58.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.702+0000 7f692dd9b640 1 --2- 172.21.15.7:0/1784402525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567537851d0 0x5567537a5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.702+0000 7f692dd9b640 1 -- 172.21.15.7:0/1784402525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567537848b0 msgr2=0x5567537a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:58.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.702+0000 7f692dd9b640 1 --2- 172.21.15.7:0/1784402525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567537848b0 0x5567537a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.702+0000 7f692dd9b640 1 -- 172.21.15.7:0/1784402525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556753785000 con 0x556753793fc0 2024-09-19T08:44:58.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.702+0000 7f692dd9b640 1 --2- 172.21.15.7:0/1784402525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556753793fc0 0x55675378f470 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6924001eb0 tx=0x7f6924014f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654a00d225d162d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:58.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.702+0000 7f6917fff640 1 -- 172.21.15.7:0/1784402525 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6924010d10 con 0x556753793fc0 2024-09-19T08:44:58.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.702+0000 7f6917fff640 1 -- 172.21.15.7:0/1784402525 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6924004c80 con 0x556753793fc0 2024-09-19T08:44:58.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.702+0000 7f6917fff640 1 -- 172.21.15.7:0/1784402525 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6924010430 con 0x556753793fc0 2024-09-19T08:44:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.703+0000 7f6936f52740 1 -- 172.21.15.7:0/1784402525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556753793fc0 msgr2=0x55675378f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.703+0000 7f6936f52740 1 --2- 172.21.15.7:0/1784402525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556753793fc0 0x55675378f470 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6924001eb0 tx=0x7f6924014f90 comp rx=0 tx=0).stop 2024-09-19T08:44:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.703+0000 7f6936f52740 1 -- 172.21.15.7:0/1784402525 shutdown_connections 2024-09-19T08:44:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.703+0000 7f6936f52740 1 --2- 172.21.15.7:0/1784402525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556753793fc0 0x55675378f470 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.703+0000 7f6936f52740 1 --2- 172.21.15.7:0/1784402525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567537851d0 0x5567537a5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.703+0000 7f6936f52740 1 --2- 172.21.15.7:0/1784402525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567537848b0 0x5567537a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.703+0000 7f6936f52740 1 -- 172.21.15.7:0/1784402525 >> 172.21.15.7:0/1784402525 conn(0x556753780f60 msgr2=0x556753790b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.703+0000 7f6936f52740 1 -- 172.21.15.7:0/1784402525 shutdown_connections 2024-09-19T08:44:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.703+0000 7f6936f52740 1 -- 172.21.15.7:0/1784402525 wait complete. 2024-09-19T08:44:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.703+0000 7f6936f52740 1 -- start start 2024-09-19T08:44:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.704+0000 7f6936f52740 1 Processor -- start 2024-09-19T08:44:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.704+0000 7f6936f52740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567537848b0 0x55675378d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.704+0000 7f6936f52740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567537851d0 0x55675378d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.704+0000 7f6936f52740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556753793fc0 0x5567537ad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.704+0000 7f6936f52740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5567537a5e10 con 0x556753793fc0 2024-09-19T08:44:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.704+0000 7f6936f52740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5567537a5740 con 0x5567537851d0 2024-09-19T08:44:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.704+0000 7f6936f52740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5567537a64e0 con 0x5567537848b0 2024-09-19T08:44:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.704+0000 7f6936f52740 10 client.0 _ll_register_callbacks cb 0x7f6924013050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:44:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.704+0000 7f692dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556753793fc0 0x5567537ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.704+0000 7f692dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556753793fc0 0x5567537ad250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51162/0 (socket says 172.21.15.7:51162) 2024-09-19T08:44:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.704+0000 7f692dd9b640 1 -- 172.21.15.7:0/1109384233 learned_addr learned my addr 172.21.15.7:0/1109384233 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:44:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.704+0000 7f692e59c640 1 --2- 172.21.15.7:0/1109384233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567537851d0 0x55675378d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.704+0000 7f692dd9b640 1 --2- 172.21.15.7:0/1109384233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567537848b0 0x55675378d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.704+0000 7f692dd9b640 1 -- 172.21.15.7:0/1109384233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567537848b0 msgr2=0x55675378d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.704+0000 7f692dd9b640 1 --2- 172.21.15.7:0/1109384233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567537848b0 0x55675378d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.704+0000 7f692dd9b640 1 -- 172.21.15.7:0/1109384233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567537851d0 msgr2=0x55675378d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:44:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.704+0000 7f692dd9b640 1 --2- 172.21.15.7:0/1109384233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567537851d0 0x55675378d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.704+0000 7f692dd9b640 1 -- 172.21.15.7:0/1109384233 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567537ad790 con 0x556753793fc0 2024-09-19T08:44:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.704+0000 7f692e59c640 1 --2- 172.21.15.7:0/1109384233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567537851d0 0x55675378d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.705+0000 7f692dd9b640 1 --2- 172.21.15.7:0/1109384233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556753793fc0 0x5567537ad250 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6924005f30 tx=0x7f6924034040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffae37c30ee9016a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.705+0000 7f6915ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:44:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.705+0000 7f6915ffb640 1 -- 172.21.15.7:0/1109384233 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6924011bd0 con 0x556753793fc0 2024-09-19T08:44:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.705+0000 7f6915ffb640 1 -- 172.21.15.7:0/1109384233 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f6924011d70 con 0x556753793fc0 2024-09-19T08:44:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.705+0000 7f6936f52740 1 -- 172.21.15.7:0/1109384233 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6924004c80 con 0x556753793fc0 2024-09-19T08:44:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.705+0000 7f6915ffb640 1 -- 172.21.15.7:0/1109384233 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6924010430 con 0x556753793fc0 2024-09-19T08:44:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.705+0000 7f6936f52740 10 client.15396 fetch_fsmap learned FSMap version 25 2024-09-19T08:44:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.705+0000 7f6936f52740 1 -- 172.21.15.7:0/1109384233 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5567537aea50 con 0x556753793fc0 2024-09-19T08:44:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.705+0000 7f6915ffb640 1 -- 172.21.15.7:0/1109384233 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6924004c80 con 0x556753793fc0 2024-09-19T08:44:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.705+0000 7f6915ffb640 1 -- 172.21.15.7:0/1109384233 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6924026740 con 0x556753793fc0 2024-09-19T08:44:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.705+0000 7f6936f52740 10 client.15396 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:44:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.705+0000 7f6936f52740 10 client.15396 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T08:44:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.705+0000 7f6936f52740 20 client.15396 populate_metadata read hostname 'smithi007' 2024-09-19T08:44:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.705+0000 7f6936f52740 1 --2- 172.21.15.7:0/1109384233 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x556753813350 0x556753812060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.705+0000 7f6936f52740 4 client.15396 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:44:58.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.705+0000 7f6936f52740 1 -- 172.21.15.7:0/1109384233 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "status"}) -- 0x5567536f2b10 con 0x556753813350 2024-09-19T08:44:58.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.706+0000 7f692e59c640 1 --2- 172.21.15.7:0/1109384233 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x556753813350 0x556753812060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:58.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.706+0000 7f692e59c640 1 --2- 172.21.15.7:0/1109384233 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x556753813350 0x556753812060 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=26a783aee4cf06e3 server_cookie=cd3522bb82255fae in_seq=0 out_seq=0 2024-09-19T08:44:58.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.706+0000 7f6915ffb640 10 client.15396 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:44:58.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.706+0000 7f6915ffb640 1 -- 172.21.15.7:0/1109384233 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5567536f2b10 con 0x556753813350 2024-09-19T08:44:58.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.706+0000 7f6915ffb640 10 client.15396 handle_command_reply: tid=0 2024-09-19T08:44:58.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.706+0000 7f6936f52740 1 client.15396 shutdown 2024-09-19T08:44:58.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.706+0000 7f6936f52740 1 -- 172.21.15.7:0/1109384233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556753793fc0 msgr2=0x5567537ad250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:58.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.706+0000 7f6936f52740 1 --2- 172.21.15.7:0/1109384233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556753793fc0 0x5567537ad250 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6924005f30 tx=0x7f6924034040 comp rx=0 tx=0).stop 2024-09-19T08:44:58.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.707+0000 7f6936f52740 1 -- 172.21.15.7:0/1109384233 shutdown_connections 2024-09-19T08:44:58.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.707+0000 7f6936f52740 1 --2- 172.21.15.7:0/1109384233 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x556753813350 0x556753812060 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.707+0000 7f6936f52740 1 --2- 172.21.15.7:0/1109384233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556753793fc0 0x5567537ad250 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.707+0000 7f6936f52740 1 --2- 172.21.15.7:0/1109384233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567537851d0 0x55675378d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.707+0000 7f6936f52740 1 --2- 172.21.15.7:0/1109384233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567537848b0 0x55675378d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.707+0000 7f6936f52740 1 -- 172.21.15.7:0/1109384233 >> 172.21.15.7:0/1109384233 conn(0x556753780f60 msgr2=0x55675378ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:58.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.707+0000 7f6915ffb640 0 client.15396 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:44:58.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.707+0000 7f6936f52740 1 -- 172.21.15.7:0/1109384233 shutdown_connections 2024-09-19T08:44:58.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.707+0000 7f6936f52740 1 -- 172.21.15.7:0/1109384233 wait complete. 2024-09-19T08:44:58.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.707+0000 7f6936f52740 20 client.15396 trim_cache size 0 max 16384 2024-09-19T08:44:58.712 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:44:58.712 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "ebd23124-7661-11ef-bceb-c7b262605968", 2024-09-19T08:44:58.712 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 1, 2024-09-19T08:44:58.713 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24472, 2024-09-19T08:44:58.713 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T08:44:58.713 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T08:44:58.713 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T08:44:58.713 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 126.635828132, 2024-09-19T08:44:58.713 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 25, 2024-09-19T08:44:58.713 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 83, 2024-09-19T08:44:58.713 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 83, 2024-09-19T08:44:58.713 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 153.22849190599999 2024-09-19T08:44:58.713 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:44:58.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.707+0000 7f6934b79640 1 -- 172.21.15.7:0/544282507 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f69180a3440 msgr2=0x7f69180a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:58.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.707+0000 7f6934b79640 1 --2- 172.21.15.7:0/544282507 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f69180a3440 0x7f69180a5900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f69280ccac0 tx=0x7f6928004a40 comp rx=0 tx=0).stop 2024-09-19T08:44:58.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.707+0000 7f6934b79640 1 -- 172.21.15.7:0/544282507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6930106a80 msgr2=0x7f69301a4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:58.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.707+0000 7f6934b79640 1 --2- 172.21.15.7:0/544282507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6930106a80 0x7f69301a4390 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f692800b970 tx=0x7f692800be30 comp rx=0 tx=0).stop 2024-09-19T08:44:58.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.707+0000 7f6934b79640 1 -- 172.21.15.7:0/544282507 shutdown_connections 2024-09-19T08:44:58.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.707+0000 7f6934b79640 1 --2- 172.21.15.7:0/544282507 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f69180a3440 0x7f69180a5900 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.707+0000 7f6934b79640 1 --2- 172.21.15.7:0/544282507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6930106a80 0x7f69301a4390 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.707+0000 7f6934b79640 1 --2- 172.21.15.7:0/544282507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6930101420 0x7f6930199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.707+0000 7f6934b79640 1 --2- 172.21.15.7:0/544282507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6930100a80 0x7f6930199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:58.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.707+0000 7f6934b79640 1 -- 172.21.15.7:0/544282507 >> 172.21.15.7:0/544282507 conn(0x7f69300fc7a0 msgr2=0x7f69300fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:58.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.707+0000 7f6934b79640 1 -- 172.21.15.7:0/544282507 shutdown_connections 2024-09-19T08:44:58.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:44:58.707+0000 7f6934b79640 1 -- 172.21.15.7:0/544282507 wait complete. 2024-09-19T08:44:59.522 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T08:44:59.776 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:00.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.238+0000 7f0a36cb8640 1 -- 172.21.15.7:0/1125487523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a30108290 msgr2=0x7f0a3010ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:00.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.238+0000 7f0a36cb8640 1 --2- 172.21.15.7:0/1125487523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a30108290 0x7f0a3010ec30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0a28009cd0 tx=0x7f0a2802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.238+0000 7f0a36cb8640 1 -- 172.21.15.7:0/1125487523 shutdown_connections 2024-09-19T08:45:00.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.238+0000 7f0a36cb8640 1 --2- 172.21.15.7:0/1125487523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a30108290 0x7f0a3010ec30 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.238+0000 7f0a36cb8640 1 --2- 172.21.15.7:0/1125487523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a30103740 0x7f0a30107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.238+0000 7f0a36cb8640 1 --2- 172.21.15.7:0/1125487523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a30102d90 0x7f0a30103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.238+0000 7f0a36cb8640 1 -- 172.21.15.7:0/1125487523 >> 172.21.15.7:0/1125487523 conn(0x7f0a300fc7d0 msgr2=0x7f0a300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:00.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.238+0000 7f0a36cb8640 1 -- 172.21.15.7:0/1125487523 shutdown_connections 2024-09-19T08:45:00.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.238+0000 7f0a36cb8640 1 -- 172.21.15.7:0/1125487523 wait complete. 2024-09-19T08:45:00.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.238+0000 7f0a36cb8640 1 Processor -- start 2024-09-19T08:45:00.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.239+0000 7f0a36cb8640 1 -- start start 2024-09-19T08:45:00.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.239+0000 7f0a36cb8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a30102d90 0x7f0a301985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:00.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.239+0000 7f0a36cb8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a30103740 0x7f0a30198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:00.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.239+0000 7f0a36cb8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a30108290 0x7f0a3019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:00.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.239+0000 7f0a36cb8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0a301120d0 con 0x7f0a30108290 2024-09-19T08:45:00.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.239+0000 7f0a36cb8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0a30111f50 con 0x7f0a30102d90 2024-09-19T08:45:00.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.239+0000 7f0a36cb8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0a30112250 con 0x7f0a30103740 2024-09-19T08:45:00.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.239+0000 7f0a35255640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a30108290 0x7f0a3019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:00.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.239+0000 7f0a35255640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a30108290 0x7f0a3019ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51192/0 (socket says 172.21.15.7:51192) 2024-09-19T08:45:00.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.239+0000 7f0a35255640 1 -- 172.21.15.7:0/1658444838 learned_addr learned my addr 172.21.15.7:0/1658444838 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:00.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.239+0000 7f0a34a54640 1 --2- 172.21.15.7:0/1658444838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a30102d90 0x7f0a301985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:00.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.239+0000 7f0a2ffff640 1 --2- 172.21.15.7:0/1658444838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a30103740 0x7f0a30198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:00.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.239+0000 7f0a35255640 1 -- 172.21.15.7:0/1658444838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a30103740 msgr2=0x7f0a30198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:00.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.239+0000 7f0a35255640 1 --2- 172.21.15.7:0/1658444838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a30103740 0x7f0a30198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.239+0000 7f0a35255640 1 -- 172.21.15.7:0/1658444838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a30102d90 msgr2=0x7f0a301985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:00.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.239+0000 7f0a35255640 1 --2- 172.21.15.7:0/1658444838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a30102d90 0x7f0a301985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.239+0000 7f0a35255640 1 -- 172.21.15.7:0/1658444838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a3019d560 con 0x7f0a30108290 2024-09-19T08:45:00.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.239+0000 7f0a35255640 1 --2- 172.21.15.7:0/1658444838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a30108290 0x7f0a3019ce80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0a28006010 tx=0x7f0a28003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:00.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.240+0000 7f0a2dffb640 1 -- 172.21.15.7:0/1658444838 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a28004450 con 0x7f0a30108290 2024-09-19T08:45:00.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.240+0000 7f0a2dffb640 1 -- 172.21.15.7:0/1658444838 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a28003e10 con 0x7f0a30108290 2024-09-19T08:45:00.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.240+0000 7f0a36cb8640 1 -- 172.21.15.7:0/1658444838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a3019d7f0 con 0x7f0a30108290 2024-09-19T08:45:00.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.240+0000 7f0a2dffb640 1 -- 172.21.15.7:0/1658444838 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a28046480 con 0x7f0a30108290 2024-09-19T08:45:00.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.240+0000 7f0a36cb8640 1 -- 172.21.15.7:0/1658444838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a301a5130 con 0x7f0a30108290 2024-09-19T08:45:00.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.243+0000 7f0a2dffb640 1 -- 172.21.15.7:0/1658444838 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f0a280045f0 con 0x7f0a30108290 2024-09-19T08:45:00.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.243+0000 7f0a39091740 1 Processor -- start 2024-09-19T08:45:00.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.243+0000 7f0a39091740 1 -- start start 2024-09-19T08:45:00.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.243+0000 7f0a39091740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdec39d0 0x5625cdec3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:00.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.243+0000 7f0a39091740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625cdec42f0 0x5625cdece670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:00.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.243+0000 7f0a39091740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625cdecebb0 0x5625cded0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:00.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.243+0000 7f0a39091740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5625cde2a090 con 0x5625cdec39d0 2024-09-19T08:45:00.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.243+0000 7f0a39091740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5625cddd1a70 con 0x5625cdecebb0 2024-09-19T08:45:00.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.243+0000 7f0a39091740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5625cde26050 con 0x5625cdec42f0 2024-09-19T08:45:00.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.243+0000 7f0a2ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdec39d0 0x5625cdec3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:00.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.243+0000 7f0a2ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdec39d0 0x5625cdec3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51204/0 (socket says 172.21.15.7:51204) 2024-09-19T08:45:00.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.243+0000 7f0a2ffff640 1 -- 172.21.15.7:0/1825832175 learned_addr learned my addr 172.21.15.7:0/1825832175 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:00.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.244+0000 7f0a2ffff640 1 --2- 172.21.15.7:0/1825832175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625cdecebb0 0x5625cded0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:00.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.244+0000 7f0a34a54640 1 --2- 172.21.15.7:0/1825832175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625cdec42f0 0x5625cdece670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:00.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.244+0000 7f0a2ffff640 1 -- 172.21.15.7:0/1825832175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625cdec42f0 msgr2=0x5625cdece670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:00.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.244+0000 7f0a2dffb640 1 --2- 172.21.15.7:0/1658444838 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0a1c0a3440 0x7f0a1c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:00.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.244+0000 7f0a2ffff640 1 --2- 172.21.15.7:0/1825832175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625cdec42f0 0x5625cdece670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.244+0000 7f0a2ffff640 1 -- 172.21.15.7:0/1825832175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625cdecebb0 msgr2=0x5625cded0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:00.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.244+0000 7f0a2ffff640 1 --2- 172.21.15.7:0/1825832175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625cdecebb0 0x5625cded0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.244+0000 7f0a2ffff640 1 -- 172.21.15.7:0/1825832175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625cddde130 con 0x5625cdec39d0 2024-09-19T08:45:00.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.244+0000 7f0a35255640 1 --2- 172.21.15.7:0/1658444838 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0a1c0a3440 0x7f0a1c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:00.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.244+0000 7f0a2ffff640 1 --2- 172.21.15.7:0/1825832175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdec39d0 0x5625cdec3db0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009f80 tx=0x7f0a18009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72a3d064f736493 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:00.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.244+0000 7f0a2dffb640 1 -- 172.21.15.7:0/1658444838 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f0a2802e030 con 0x7f0a30108290 2024-09-19T08:45:00.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.244+0000 7f0a26ffd640 1 -- 172.21.15.7:0/1825832175 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a18017610 con 0x5625cdec39d0 2024-09-19T08:45:00.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.244+0000 7f0a26ffd640 1 -- 172.21.15.7:0/1825832175 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a1801c070 con 0x5625cdec39d0 2024-09-19T08:45:00.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.244+0000 7f0a26ffd640 1 -- 172.21.15.7:0/1825832175 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a18015910 con 0x5625cdec39d0 2024-09-19T08:45:00.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.245+0000 7f0a39091740 1 -- 172.21.15.7:0/1825832175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdec39d0 msgr2=0x5625cdec3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:00.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.245+0000 7f0a35255640 1 --2- 172.21.15.7:0/1658444838 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0a1c0a3440 0x7f0a1c0a5900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a280eee70 tx=0x7f0a280e86c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:00.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.245+0000 7f0a39091740 1 --2- 172.21.15.7:0/1825832175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdec39d0 0x5625cdec3db0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009f80 tx=0x7f0a18009570 comp rx=0 tx=0).stop 2024-09-19T08:45:00.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.245+0000 7f0a39091740 1 -- 172.21.15.7:0/1825832175 shutdown_connections 2024-09-19T08:45:00.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.245+0000 7f0a39091740 1 --2- 172.21.15.7:0/1825832175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625cdecebb0 0x5625cded0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.245+0000 7f0a39091740 1 --2- 172.21.15.7:0/1825832175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625cdec42f0 0x5625cdece670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.245+0000 7f0a39091740 1 --2- 172.21.15.7:0/1825832175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdec39d0 0x5625cdec3db0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.245+0000 7f0a39091740 1 -- 172.21.15.7:0/1825832175 >> 172.21.15.7:0/1825832175 conn(0x5625cdebff60 msgr2=0x5625cdec0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:00.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.245+0000 7f0a39091740 1 -- 172.21.15.7:0/1825832175 shutdown_connections 2024-09-19T08:45:00.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.245+0000 7f0a39091740 1 -- 172.21.15.7:0/1825832175 wait complete. 2024-09-19T08:45:00.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.245+0000 7f0a39091740 1 -- start start 2024-09-19T08:45:00.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.245+0000 7f0a39091740 1 Processor -- start 2024-09-19T08:45:00.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.246+0000 7f0a39091740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625cdec39d0 0x5625cdece440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:00.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.246+0000 7f0a39091740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625cdec42f0 0x5625cdecb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:00.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.246+0000 7f0a39091740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdecebb0 0x5625cdecbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:00.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.246+0000 7f0a39091740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5625cded1780 con 0x5625cdecebb0 2024-09-19T08:45:00.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.246+0000 7f0a39091740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5625cdde4f20 con 0x5625cdec39d0 2024-09-19T08:45:00.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.246+0000 7f0a39091740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5625cded1900 con 0x5625cdec42f0 2024-09-19T08:45:00.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.246+0000 7f0a39091740 10 client.0 _ll_register_callbacks cb 0x5625cddae030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:00.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.246+0000 7f0a2ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdecebb0 0x5625cdecbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.246+0000 7f0a2ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdecebb0 0x5625cdecbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51210/0 (socket says 172.21.15.7:51210) 2024-09-19T08:45:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.246+0000 7f0a2ffff640 1 -- 172.21.15.7:0/2131512155 learned_addr learned my addr 172.21.15.7:0/2131512155 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.246+0000 7f0a34a54640 1 --2- 172.21.15.7:0/2131512155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625cdec42f0 0x5625cdecb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.246+0000 7f0a2ffff640 1 --2- 172.21.15.7:0/2131512155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625cdec39d0 0x5625cdece440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.246+0000 7f0a2ffff640 1 -- 172.21.15.7:0/2131512155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625cdec42f0 msgr2=0x5625cdecb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.246+0000 7f0a2ffff640 1 --2- 172.21.15.7:0/2131512155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625cdec42f0 0x5625cdecb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.246+0000 7f0a2ffff640 1 -- 172.21.15.7:0/2131512155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625cdec39d0 msgr2=0x5625cdece440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.246+0000 7f0a2ffff640 1 --2- 172.21.15.7:0/2131512155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625cdec39d0 0x5625cdece440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.246+0000 7f0a2ffff640 1 -- 172.21.15.7:0/2131512155 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625cdb9b2b0 con 0x5625cdecebb0 2024-09-19T08:45:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.247+0000 7f0a2ffff640 1 --2- 172.21.15.7:0/2131512155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdecebb0 0x5625cdecbcd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800a010 tx=0x7f0a180154f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda38489be1a61ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.247+0000 7f0a0ffff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:45:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.247+0000 7f0a0ffff640 1 -- 172.21.15.7:0/2131512155 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a18015b20 con 0x5625cdecebb0 2024-09-19T08:45:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.247+0000 7f0a0ffff640 1 -- 172.21.15.7:0/2131512155 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f0a18015cc0 con 0x5625cdecebb0 2024-09-19T08:45:00.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.247+0000 7f0a39091740 1 -- 172.21.15.7:0/2131512155 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a1801c070 con 0x5625cdecebb0 2024-09-19T08:45:00.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.247+0000 7f0a0ffff640 1 -- 172.21.15.7:0/2131512155 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0a18035050 con 0x5625cdecebb0 2024-09-19T08:45:00.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.247+0000 7f0a39091740 10 client.15408 fetch_fsmap learned FSMap version 25 2024-09-19T08:45:00.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.247+0000 7f0a39091740 1 -- 172.21.15.7:0/2131512155 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5625cdedd090 con 0x5625cdecebb0 2024-09-19T08:45:00.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.247+0000 7f0a0ffff640 1 -- 172.21.15.7:0/2131512155 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a1801c070 con 0x5625cdecebb0 2024-09-19T08:45:00.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.247+0000 7f0a0ffff640 1 -- 172.21.15.7:0/2131512155 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0a18021800 con 0x5625cdecebb0 2024-09-19T08:45:00.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.247+0000 7f0a39091740 10 client.15408 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:45:00.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.248+0000 7f0a39091740 10 client.15408 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:45:00.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.248+0000 7f0a39091740 20 client.15408 populate_metadata read hostname 'smithi007' 2024-09-19T08:45:00.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.248+0000 7f0a39091740 1 --2- 172.21.15.7:0/2131512155 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5625cdedf300 0x5625cdee0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:00.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.248+0000 7f0a39091740 4 client.15408 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:45:00.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.248+0000 7f0a39091740 1 -- 172.21.15.7:0/2131512155 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625cde37600 con 0x5625cdedf300 2024-09-19T08:45:00.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.248+0000 7f0a34a54640 1 --2- 172.21.15.7:0/2131512155 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5625cdedf300 0x5625cdee0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:00.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.248+0000 7f0a34a54640 1 --2- 172.21.15.7:0/2131512155 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5625cdedf300 0x5625cdee0770 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=177f848e0bb154cd server_cookie=7316c9966dc0074d in_seq=0 out_seq=0 2024-09-19T08:45:00.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.248+0000 7f0a0ffff640 10 client.15408 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:00.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.249+0000 7f0a0ffff640 1 -- 172.21.15.7:0/2131512155 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5625cde37600 con 0x5625cdedf300 2024-09-19T08:45:00.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.249+0000 7f0a0ffff640 10 client.15408 handle_command_reply: tid=0 2024-09-19T08:45:00.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.249+0000 7f0a39091740 1 client.15408 shutdown 2024-09-19T08:45:00.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.249+0000 7f0a39091740 1 -- 172.21.15.7:0/2131512155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdecebb0 msgr2=0x5625cdecbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:00.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.249+0000 7f0a39091740 1 --2- 172.21.15.7:0/2131512155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdecebb0 0x5625cdecbcd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800a010 tx=0x7f0a180154f0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.249+0000 7f0a39091740 1 -- 172.21.15.7:0/2131512155 shutdown_connections 2024-09-19T08:45:00.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.249+0000 7f0a39091740 1 --2- 172.21.15.7:0/2131512155 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5625cdedf300 0x5625cdee0770 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.249+0000 7f0a39091740 1 --2- 172.21.15.7:0/2131512155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdecebb0 0x5625cdecbcd0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.249+0000 7f0a39091740 1 --2- 172.21.15.7:0/2131512155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625cdec42f0 0x5625cdecb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.249+0000 7f0a39091740 1 --2- 172.21.15.7:0/2131512155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625cdec39d0 0x5625cdece440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.249+0000 7f0a0ffff640 0 client.15408 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:00.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.249+0000 7f0a39091740 1 -- 172.21.15.7:0/2131512155 >> 172.21.15.7:0/2131512155 conn(0x5625cdebff60 msgr2=0x5625cdec5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:00.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.250+0000 7f0a39091740 1 -- 172.21.15.7:0/2131512155 shutdown_connections 2024-09-19T08:45:00.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.250+0000 7f0a39091740 1 -- 172.21.15.7:0/2131512155 wait complete. 2024-09-19T08:45:00.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.250+0000 7f0a39091740 20 client.15408 trim_cache size 0 max 16384 2024-09-19T08:45:00.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.267+0000 7f0a39091740 1 Processor -- start 2024-09-19T08:45:00.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.267+0000 7f0a39091740 1 -- start start 2024-09-19T08:45:00.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.268+0000 7f0a39091740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625cdec39d0 0x5625cdedec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:00.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.268+0000 7f0a39091740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625cdec42f0 0x5625cdee00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:00.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.268+0000 7f0a39091740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdecebb0 0x5625cdecb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:00.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.268+0000 7f0a39091740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5625cdedeab0 con 0x5625cdecebb0 2024-09-19T08:45:00.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.268+0000 7f0a39091740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5625cdedf180 con 0x5625cdec42f0 2024-09-19T08:45:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.268+0000 7f0a39091740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5625cdedf850 con 0x5625cdec39d0 2024-09-19T08:45:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.268+0000 7f0a2ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdecebb0 0x5625cdecb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.268+0000 7f0a2ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdecebb0 0x5625cdecb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51218/0 (socket says 172.21.15.7:51218) 2024-09-19T08:45:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.268+0000 7f0a2ffff640 1 -- 172.21.15.7:0/2282625004 learned_addr learned my addr 172.21.15.7:0/2282625004 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.268+0000 7f0a34a54640 1 --2- 172.21.15.7:0/2282625004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625cdec42f0 0x5625cdee00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.268+0000 7f0a2ffff640 1 --2- 172.21.15.7:0/2282625004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625cdec39d0 0x5625cdedec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.268+0000 7f0a2ffff640 1 -- 172.21.15.7:0/2282625004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625cdec39d0 msgr2=0x5625cdedec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.268+0000 7f0a2ffff640 1 --2- 172.21.15.7:0/2282625004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625cdec39d0 0x5625cdedec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.268+0000 7f0a2ffff640 1 -- 172.21.15.7:0/2282625004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625cdec42f0 msgr2=0x5625cdee00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.268+0000 7f0a2ffff640 1 --2- 172.21.15.7:0/2282625004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625cdec42f0 0x5625cdee00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.268+0000 7f0a2ffff640 1 -- 172.21.15.7:0/2282625004 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625cdecc2d0 con 0x5625cdecebb0 2024-09-19T08:45:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.268+0000 7f0a2ffff640 1 --2- 172.21.15.7:0/2282625004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdecebb0 0x5625cdecb050 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009500 tx=0x7f0a18000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1682f9360763045a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.268+0000 7f0a267fc640 1 -- 172.21.15.7:0/2282625004 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a18032070 con 0x5625cdecebb0 2024-09-19T08:45:00.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.268+0000 7f0a267fc640 1 -- 172.21.15.7:0/2282625004 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a1801c040 con 0x5625cdecebb0 2024-09-19T08:45:00.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.268+0000 7f0a267fc640 1 -- 172.21.15.7:0/2282625004 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a180173f0 con 0x5625cdecebb0 2024-09-19T08:45:00.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.269+0000 7f0a39091740 1 -- 172.21.15.7:0/2282625004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdecebb0 msgr2=0x5625cdecb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:00.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.269+0000 7f0a39091740 1 --2- 172.21.15.7:0/2282625004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdecebb0 0x5625cdecb050 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009500 tx=0x7f0a18000bc0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.269+0000 7f0a39091740 1 -- 172.21.15.7:0/2282625004 shutdown_connections 2024-09-19T08:45:00.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.269+0000 7f0a39091740 1 --2- 172.21.15.7:0/2282625004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdecebb0 0x5625cdecb050 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.269+0000 7f0a39091740 1 --2- 172.21.15.7:0/2282625004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625cdec42f0 0x5625cdee00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.269+0000 7f0a39091740 1 --2- 172.21.15.7:0/2282625004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625cdec39d0 0x5625cdedec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.269+0000 7f0a39091740 1 -- 172.21.15.7:0/2282625004 >> 172.21.15.7:0/2282625004 conn(0x5625cdebff60 msgr2=0x5625cdebace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:00.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.269+0000 7f0a39091740 1 -- 172.21.15.7:0/2282625004 shutdown_connections 2024-09-19T08:45:00.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.269+0000 7f0a39091740 1 -- 172.21.15.7:0/2282625004 wait complete. 2024-09-19T08:45:00.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.269+0000 7f0a39091740 1 -- start start 2024-09-19T08:45:00.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.270+0000 7f0a39091740 1 Processor -- start 2024-09-19T08:45:00.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.270+0000 7f0a39091740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625cdec39d0 0x5625cdee1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:00.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.270+0000 7f0a39091740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625cdec42f0 0x5625cdee1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:00.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.270+0000 7f0a39091740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdecebb0 0x5625cdee23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:00.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.270+0000 7f0a39091740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5625cdee05f0 con 0x5625cdecebb0 2024-09-19T08:45:00.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.270+0000 7f0a39091740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5625cdedff20 con 0x5625cdec39d0 2024-09-19T08:45:00.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.270+0000 7f0a39091740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5625cdee0cc0 con 0x5625cdec42f0 2024-09-19T08:45:00.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.270+0000 7f0a39091740 10 client.0 _ll_register_callbacks cb 0x7f0a18009de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:00.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.270+0000 7f0a2ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdecebb0 0x5625cdee23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:00.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.270+0000 7f0a2ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdecebb0 0x5625cdee23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51230/0 (socket says 172.21.15.7:51230) 2024-09-19T08:45:00.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.270+0000 7f0a2ffff640 1 -- 172.21.15.7:0/2237260902 learned_addr learned my addr 172.21.15.7:0/2237260902 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:00.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.270+0000 7f0a34a54640 1 --2- 172.21.15.7:0/2237260902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625cdec42f0 0x5625cdee1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:00.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.270+0000 7f0a2ffff640 1 --2- 172.21.15.7:0/2237260902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625cdec39d0 0x5625cdee1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:00.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.270+0000 7f0a2ffff640 1 -- 172.21.15.7:0/2237260902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625cdec42f0 msgr2=0x5625cdee1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:00.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.270+0000 7f0a2ffff640 1 --2- 172.21.15.7:0/2237260902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625cdec42f0 0x5625cdee1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.270+0000 7f0a2ffff640 1 -- 172.21.15.7:0/2237260902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625cdec39d0 msgr2=0x5625cdee1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:00.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.270+0000 7f0a2ffff640 1 --2- 172.21.15.7:0/2237260902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625cdec39d0 0x5625cdee1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.270+0000 7f0a2ffff640 1 -- 172.21.15.7:0/2237260902 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625cdf47b30 con 0x5625cdecebb0 2024-09-19T08:45:00.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.271+0000 7f0a2ffff640 1 --2- 172.21.15.7:0/2237260902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdecebb0 0x5625cdee23f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0a18010c00 tx=0x7f0a18021f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30bff6b452bc62fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:00.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.271+0000 7f0a0ffff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:45:00.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.271+0000 7f0a0ffff640 1 -- 172.21.15.7:0/2237260902 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a18032040 con 0x5625cdecebb0 2024-09-19T08:45:00.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.271+0000 7f0a0ffff640 1 -- 172.21.15.7:0/2237260902 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f0a180059c0 con 0x5625cdecebb0 2024-09-19T08:45:00.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.271+0000 7f0a39091740 1 -- 172.21.15.7:0/2237260902 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a1801c040 con 0x5625cdecebb0 2024-09-19T08:45:00.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.271+0000 7f0a0ffff640 1 -- 172.21.15.7:0/2237260902 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0a18049050 con 0x5625cdecebb0 2024-09-19T08:45:00.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.271+0000 7f0a39091740 10 client.15414 fetch_fsmap learned FSMap version 25 2024-09-19T08:45:00.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.271+0000 7f0a39091740 1 -- 172.21.15.7:0/2237260902 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5625cdf48e30 con 0x5625cdecebb0 2024-09-19T08:45:00.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.271+0000 7f0a0ffff640 1 -- 172.21.15.7:0/2237260902 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a1801c040 con 0x5625cdecebb0 2024-09-19T08:45:00.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.271+0000 7f0a0ffff640 1 -- 172.21.15.7:0/2237260902 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0a180216d0 con 0x5625cdecebb0 2024-09-19T08:45:00.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.271+0000 7f0a39091740 10 client.15414 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:45:00.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.272+0000 7f0a39091740 10 client.15414 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:45:00.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.272+0000 7f0a39091740 20 client.15414 populate_metadata read hostname 'smithi007' 2024-09-19T08:45:00.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.272+0000 7f0a39091740 1 --2- 172.21.15.7:0/2237260902 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5625cdf4d650 0x5625cdf4c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:00.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.272+0000 7f0a39091740 4 client.15414 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:45:00.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.272+0000 7f0a39091740 1 -- 172.21.15.7:0/2237260902 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "status"}) -- 0x5625cde31b10 con 0x5625cdf4d650 2024-09-19T08:45:00.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.272+0000 7f0a34a54640 1 --2- 172.21.15.7:0/2237260902 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5625cdf4d650 0x5625cdf4c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:00.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.272+0000 7f0a34a54640 1 --2- 172.21.15.7:0/2237260902 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5625cdf4d650 0x5625cdf4c360 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e2dc24283a38583 server_cookie=f118ebdaf1e907bf in_seq=0 out_seq=0 2024-09-19T08:45:00.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.272+0000 7f0a0ffff640 10 client.15414 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:00.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.272+0000 7f0a0ffff640 1 -- 172.21.15.7:0/2237260902 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5625cde31b10 con 0x5625cdf4d650 2024-09-19T08:45:00.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.272+0000 7f0a0ffff640 10 client.15414 handle_command_reply: tid=0 2024-09-19T08:45:00.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.272+0000 7f0a39091740 1 client.15414 shutdown 2024-09-19T08:45:00.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.273+0000 7f0a39091740 1 -- 172.21.15.7:0/2237260902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdecebb0 msgr2=0x5625cdee23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:00.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.273+0000 7f0a39091740 1 --2- 172.21.15.7:0/2237260902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdecebb0 0x5625cdee23f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0a18010c00 tx=0x7f0a18021f00 comp rx=0 tx=0).stop 2024-09-19T08:45:00.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.273+0000 7f0a39091740 1 -- 172.21.15.7:0/2237260902 shutdown_connections 2024-09-19T08:45:00.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.273+0000 7f0a39091740 1 --2- 172.21.15.7:0/2237260902 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5625cdf4d650 0x5625cdf4c360 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.273+0000 7f0a0ffff640 0 client.15414 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:00.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.273+0000 7f0a39091740 1 --2- 172.21.15.7:0/2237260902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5625cdecebb0 0x5625cdee23f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.273+0000 7f0a39091740 1 --2- 172.21.15.7:0/2237260902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625cdec42f0 0x5625cdee1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.273+0000 7f0a39091740 1 --2- 172.21.15.7:0/2237260902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625cdec39d0 0x5625cdee1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.273+0000 7f0a39091740 1 -- 172.21.15.7:0/2237260902 >> 172.21.15.7:0/2237260902 conn(0x5625cdebff60 msgr2=0x5625cdec0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:00.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.273+0000 7f0a39091740 1 -- 172.21.15.7:0/2237260902 shutdown_connections 2024-09-19T08:45:00.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.273+0000 7f0a39091740 1 -- 172.21.15.7:0/2237260902 wait complete. 2024-09-19T08:45:00.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.273+0000 7f0a39091740 20 client.15414 trim_cache size 0 max 16384 2024-09-19T08:45:00.278 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:45:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "ebd23124-7661-11ef-bceb-c7b262605968", 2024-09-19T08:45:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-09-19T08:45:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24491, 2024-09-19T08:45:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T08:45:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T08:45:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T08:45:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 135.23929046999999, 2024-09-19T08:45:00.278 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 25, 2024-09-19T08:45:00.279 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 83, 2024-09-19T08:45:00.279 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 83, 2024-09-19T08:45:00.279 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 146.36222323600001 2024-09-19T08:45:00.279 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:45:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.273+0000 7f0a36cb8640 1 -- 172.21.15.7:0/1658444838 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0a1c0a3440 msgr2=0x7f0a1c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.273+0000 7f0a36cb8640 1 --2- 172.21.15.7:0/1658444838 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0a1c0a3440 0x7f0a1c0a5900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a280eee70 tx=0x7f0a280e86c0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.273+0000 7f0a36cb8640 1 -- 172.21.15.7:0/1658444838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a30108290 msgr2=0x7f0a3019ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.273+0000 7f0a36cb8640 1 --2- 172.21.15.7:0/1658444838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a30108290 0x7f0a3019ce80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0a28006010 tx=0x7f0a28003c20 comp rx=0 tx=0).stop 2024-09-19T08:45:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.273+0000 7f0a36cb8640 1 -- 172.21.15.7:0/1658444838 shutdown_connections 2024-09-19T08:45:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.273+0000 7f0a36cb8640 1 --2- 172.21.15.7:0/1658444838 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0a1c0a3440 0x7f0a1c0a5900 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.273+0000 7f0a36cb8640 1 --2- 172.21.15.7:0/1658444838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a30108290 0x7f0a3019ce80 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.273+0000 7f0a36cb8640 1 --2- 172.21.15.7:0/1658444838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a30103740 0x7f0a30198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.274+0000 7f0a36cb8640 1 --2- 172.21.15.7:0/1658444838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a30102d90 0x7f0a301985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.274+0000 7f0a36cb8640 1 -- 172.21.15.7:0/1658444838 >> 172.21.15.7:0/1658444838 conn(0x7f0a300fc7d0 msgr2=0x7f0a30105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:00.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.274+0000 7f0a36cb8640 1 -- 172.21.15.7:0/1658444838 shutdown_connections 2024-09-19T08:45:00.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:00.274+0000 7f0a36cb8640 1 -- 172.21.15.7:0/1658444838 wait complete. 2024-09-19T08:45:00.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:00 smithi007 ceph-mon[31221]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T08:45:00.533 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:45:00 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:45:00.295+0000 7fcbfb2ee640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:45:00.533 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:45:00 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:45:00.295+0000 7fcbfb2ee640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:45:00.533 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:45:00 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:45:00.295+0000 7fcbfb2ee640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:45:00.534 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:45:00 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:45:00.295+0000 7fcbfb2ee640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:45:00.534 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:45:00 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:45:00.295+0000 7fcbfb2ee640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:45:00.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:00 smithi044 ceph-mon[35072]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T08:45:00.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:00 smithi175 ceph-mon[35688]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T08:45:00.922 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-19T08:45:02.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:02 smithi007 ceph-mon[31221]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-19T08:45:02.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:02 smithi007 ceph-mon[31221]: mgrmap e24: x(active, since 30s), standbys: z, y 2024-09-19T08:45:02.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:02 smithi044 ceph-mon[35072]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-19T08:45:02.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:02 smithi044 ceph-mon[35072]: mgrmap e24: x(active, since 30s), standbys: z, y 2024-09-19T08:45:02.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:02 smithi175 ceph-mon[35688]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-19T08:45:02.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:02 smithi175 ceph-mon[35688]: mgrmap e24: x(active, since 30s), standbys: z, y 2024-09-19T08:45:04.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:04 smithi044 ceph-mon[35072]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-19T08:45:04.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:04 smithi175 ceph-mon[35688]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-19T08:45:04.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:04 smithi007 ceph-mon[31221]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-19T08:45:06.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:06 smithi007 ceph-mon[31221]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T08:45:06.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:06 smithi044 ceph-mon[35072]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T08:45:06.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:06 smithi175 ceph-mon[35688]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T08:45:08.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:08 smithi007 ceph-mon[31221]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-19T08:45:08.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:08 smithi044 ceph-mon[35072]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-19T08:45:08.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:08 smithi175 ceph-mon[35688]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-19T08:45:10.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:10 smithi007 ceph-mon[31221]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T08:45:10.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:10 smithi044 ceph-mon[35072]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T08:45:10.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:10 smithi175 ceph-mon[35688]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T08:45:12.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:12 smithi007 ceph-mon[31221]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T08:45:12.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:12 smithi044 ceph-mon[35072]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T08:45:12.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:12 smithi175 ceph-mon[35688]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T08:45:13.739 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:45:14.005 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:14.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:14 smithi007 ceph-mon[31221]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T08:45:14.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.514+0000 7f4eb0a15640 1 -- 172.21.15.7:0/3872182743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eac101430 msgr2=0x7f4eac10d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:14.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.514+0000 7f4eb0a15640 1 --2- 172.21.15.7:0/3872182743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eac101430 0x7f4eac10d960 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4009cd0 tx=0x7f4ea402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.514+0000 7f4eb0a15640 1 -- 172.21.15.7:0/3872182743 shutdown_connections 2024-09-19T08:45:14.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.514+0000 7f4eb0a15640 1 --2- 172.21.15.7:0/3872182743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eac101430 0x7f4eac10d960 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.514+0000 7f4eb0a15640 1 --2- 172.21.15.7:0/3872182743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eac100a90 0x7f4eac100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.514+0000 7f4eb0a15640 1 --2- 172.21.15.7:0/3872182743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4eac106a90 0x7f4eac106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.514+0000 7f4eb0a15640 1 -- 172.21.15.7:0/3872182743 >> 172.21.15.7:0/3872182743 conn(0x7f4eac0fc7d0 msgr2=0x7f4eac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:14.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.514+0000 7f4eb0a15640 1 -- 172.21.15.7:0/3872182743 shutdown_connections 2024-09-19T08:45:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.514+0000 7f4eb0a15640 1 -- 172.21.15.7:0/3872182743 wait complete. 2024-09-19T08:45:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.515+0000 7f4eb0a15640 1 Processor -- start 2024-09-19T08:45:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.515+0000 7f4eb0a15640 1 -- start start 2024-09-19T08:45:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.515+0000 7f4eb0a15640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eac100a90 0x7f4eac1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.515+0000 7f4eb0a15640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eac101430 0x7f4eac198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.515+0000 7f4eb0a15640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4eac106a90 0x7f4eac19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.515+0000 7f4eb0a15640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac110e90 con 0x7f4eac100a90 2024-09-19T08:45:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.515+0000 7f4eb0a15640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac110d10 con 0x7f4eac106a90 2024-09-19T08:45:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.515+0000 7f4eb0a15640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac111010 con 0x7f4eac101430 2024-09-19T08:45:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.515+0000 7f4eaa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eac100a90 0x7f4eac1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.515+0000 7f4eaa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eac100a90 0x7f4eac1983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57122/0 (socket says 172.21.15.7:57122) 2024-09-19T08:45:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.515+0000 7f4eaad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4eac106a90 0x7f4eac19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.515+0000 7f4eaa59c640 1 -- 172.21.15.7:0/1693253739 learned_addr learned my addr 172.21.15.7:0/1693253739 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.515+0000 7f4ea3fff640 1 --2- 172.21.15.7:0/1693253739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eac101430 0x7f4eac198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.516+0000 7f4eaa59c640 1 -- 172.21.15.7:0/1693253739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eac101430 msgr2=0x7f4eac198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.516+0000 7f4eaa59c640 1 --2- 172.21.15.7:0/1693253739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eac101430 0x7f4eac198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.516+0000 7f4eaa59c640 1 -- 172.21.15.7:0/1693253739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4eac106a90 msgr2=0x7f4eac19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.516+0000 7f4eaa59c640 1 --2- 172.21.15.7:0/1693253739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4eac106a90 0x7f4eac19ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.516+0000 7f4eaa59c640 1 -- 172.21.15.7:0/1693253739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eac19d3a0 con 0x7f4eac100a90 2024-09-19T08:45:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.516+0000 7f4eaad9d640 1 --2- 172.21.15.7:0/1693253739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4eac106a90 0x7f4eac19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:45:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.516+0000 7f4eaa59c640 1 --2- 172.21.15.7:0/1693253739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eac100a90 0x7f4eac1983f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00d950 tx=0x7f4e9c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.516+0000 7f4ea37fe640 1 -- 172.21.15.7:0/1693253739 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c017030 con 0x7f4eac100a90 2024-09-19T08:45:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.516+0000 7f4ea37fe640 1 -- 172.21.15.7:0/1693253739 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e9c004020 con 0x7f4eac100a90 2024-09-19T08:45:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.516+0000 7f4eb0a15640 1 -- 172.21.15.7:0/1693253739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eac19d690 con 0x7f4eac100a90 2024-09-19T08:45:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.516+0000 7f4ea37fe640 1 -- 172.21.15.7:0/1693253739 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0047a0 con 0x7f4eac100a90 2024-09-19T08:45:14.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.516+0000 7f4eb0a15640 1 -- 172.21.15.7:0/1693253739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eac1a4f70 con 0x7f4eac100a90 2024-09-19T08:45:14.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.518+0000 7f4ea37fe640 1 -- 172.21.15.7:0/1693253739 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 138587+0+0 (secure 0 0 0) 0x7f4e9c0041d0 con 0x7f4eac100a90 2024-09-19T08:45:14.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.519+0000 7f4ea37fe640 1 --2- 172.21.15.7:0/1693253739 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4e980a34d0 0x7f4e980a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:14.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.519+0000 7f4ea37fe640 1 -- 172.21.15.7:0/1693253739 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f4e9c0cf880 con 0x7f4eac100a90 2024-09-19T08:45:14.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.519+0000 7f4ea3fff640 1 --2- 172.21.15.7:0/1693253739 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4e980a34d0 0x7f4e980a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:14.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.520+0000 7f4eb2dee740 1 Processor -- start 2024-09-19T08:45:14.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.520+0000 7f4ea3fff640 1 --2- 172.21.15.7:0/1693253739 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4e980a34d0 0x7f4e980a5990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4eac105130 tx=0x7f4e9400b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:14.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.520+0000 7f4eb2dee740 1 -- start start 2024-09-19T08:45:14.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.520+0000 7f4eb2dee740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd631d4a0 0x563fd631d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:14.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.520+0000 7f4eb2dee740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fd631ddc0 0x563fd6328140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:14.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.520+0000 7f4eb2dee740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd6328680 0x563fd632aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:14.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.520+0000 7f4eb2dee740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563fd62832e0 con 0x563fd6328680 2024-09-19T08:45:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.520+0000 7f4eb2dee740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563fd622ace0 con 0x563fd631d4a0 2024-09-19T08:45:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.520+0000 7f4eb2dee740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563fd627f2a0 con 0x563fd631ddc0 2024-09-19T08:45:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.520+0000 7f4eaad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd6328680 0x563fd632aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.520+0000 7f4eaa59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd631d4a0 0x563fd631d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.520+0000 7f4eaad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd6328680 0x563fd632aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57136/0 (socket says 172.21.15.7:57136) 2024-09-19T08:45:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.520+0000 7f4eaad9d640 1 -- 172.21.15.7:0/4021445352 learned_addr learned my addr 172.21.15.7:0/4021445352 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.520+0000 7f4ea3fff640 1 --2- 172.21.15.7:0/4021445352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fd631ddc0 0x563fd6328140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.521+0000 7f4eaa59c640 1 -- 172.21.15.7:0/4021445352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fd631ddc0 msgr2=0x563fd6328140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.521+0000 7f4eaa59c640 1 --2- 172.21.15.7:0/4021445352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fd631ddc0 0x563fd6328140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.521+0000 7f4eaa59c640 1 -- 172.21.15.7:0/4021445352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd6328680 msgr2=0x563fd632aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.521+0000 7f4eaa59c640 1 --2- 172.21.15.7:0/4021445352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd6328680 0x563fd632aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.521+0000 7f4eaa59c640 1 -- 172.21.15.7:0/4021445352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fd620f440 con 0x563fd631d4a0 2024-09-19T08:45:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.521+0000 7f4eaad9d640 1 --2- 172.21.15.7:0/4021445352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd6328680 0x563fd632aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:45:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.521+0000 7f4eaa59c640 1 --2- 172.21.15.7:0/4021445352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd631d4a0 0x563fd631d880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0cce40 tx=0x7f4e9c09b4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5419c11d7d4547e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.521+0000 7f4ea0ff9640 1 -- 172.21.15.7:0/4021445352 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c09b900 con 0x563fd631d4a0 2024-09-19T08:45:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.521+0000 7f4ea0ff9640 1 -- 172.21.15.7:0/4021445352 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e9c09fcb0 con 0x563fd631d4a0 2024-09-19T08:45:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.521+0000 7f4ea0ff9640 1 -- 172.21.15.7:0/4021445352 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c09ad50 con 0x563fd631d4a0 2024-09-19T08:45:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.522+0000 7f4eb2dee740 1 -- 172.21.15.7:0/4021445352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd631d4a0 msgr2=0x563fd631d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.522+0000 7f4eb2dee740 1 --2- 172.21.15.7:0/4021445352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd631d4a0 0x563fd631d880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0cce40 tx=0x7f4e9c09b4c0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.522+0000 7f4eb2dee740 1 -- 172.21.15.7:0/4021445352 shutdown_connections 2024-09-19T08:45:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.522+0000 7f4eb2dee740 1 --2- 172.21.15.7:0/4021445352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd6328680 0x563fd632aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.522+0000 7f4eb2dee740 1 --2- 172.21.15.7:0/4021445352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fd631ddc0 0x563fd6328140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.522+0000 7f4eb2dee740 1 --2- 172.21.15.7:0/4021445352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd631d4a0 0x563fd631d880 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.522+0000 7f4eb2dee740 1 -- 172.21.15.7:0/4021445352 >> 172.21.15.7:0/4021445352 conn(0x563fd6319a30 msgr2=0x563fd6319e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.522+0000 7f4eb2dee740 1 -- 172.21.15.7:0/4021445352 shutdown_connections 2024-09-19T08:45:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.522+0000 7f4eb2dee740 1 -- 172.21.15.7:0/4021445352 wait complete. 2024-09-19T08:45:14.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.523+0000 7f4eb2dee740 1 -- start start 2024-09-19T08:45:14.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.523+0000 7f4eb2dee740 1 Processor -- start 2024-09-19T08:45:14.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.523+0000 7f4eb2dee740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd631d4a0 0x563fd6328060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:14.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.523+0000 7f4eb2dee740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fd631ddc0 0x563fd6325310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:14.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.523+0000 7f4eb2dee740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd6328680 0x563fd63258e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:14.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.523+0000 7f4eb2dee740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563fd632b250 con 0x563fd631d4a0 2024-09-19T08:45:14.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.523+0000 7f4eb2dee740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563fd623e050 con 0x563fd6328680 2024-09-19T08:45:14.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.523+0000 7f4eb2dee740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563fd632b3d0 con 0x563fd631ddc0 2024-09-19T08:45:14.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.523+0000 7f4eaa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd631d4a0 0x563fd6328060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:14.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.523+0000 7f4eb2dee740 10 client.0 _ll_register_callbacks cb 0x563fd627e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:14.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.523+0000 7f4eaa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd631d4a0 0x563fd6328060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57146/0 (socket says 172.21.15.7:57146) 2024-09-19T08:45:14.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.523+0000 7f4eaa59c640 1 -- 172.21.15.7:0/1713678336 learned_addr learned my addr 172.21.15.7:0/1713678336 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:14.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.524+0000 7f4ea3fff640 1 --2- 172.21.15.7:0/1713678336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fd631ddc0 0x563fd6325310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:14.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.524+0000 7f4eaad9d640 1 --2- 172.21.15.7:0/1713678336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd6328680 0x563fd63258e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:14.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.524+0000 7f4eaa59c640 1 -- 172.21.15.7:0/1713678336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fd631ddc0 msgr2=0x563fd6325310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:14.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.524+0000 7f4eaa59c640 1 --2- 172.21.15.7:0/1713678336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fd631ddc0 0x563fd6325310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.524+0000 7f4eaa59c640 1 -- 172.21.15.7:0/1713678336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd6328680 msgr2=0x563fd63258e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:14.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.524+0000 7f4eaa59c640 1 --2- 172.21.15.7:0/1713678336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd6328680 0x563fd63258e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.524+0000 7f4eaa59c640 1 -- 172.21.15.7:0/1713678336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fd5ff43c0 con 0x563fd631d4a0 2024-09-19T08:45:14.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.524+0000 7f4eaad9d640 1 --2- 172.21.15.7:0/1713678336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd6328680 0x563fd63258e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:45:14.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.524+0000 7f4eaa59c640 1 --2- 172.21.15.7:0/1713678336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd631d4a0 0x563fd6328060 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0cfba0 tx=0x7f4e9c0981a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289d032595ffc64c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:14.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.524+0000 7f4e91ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:45:14.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.524+0000 7f4e91ffb640 1 -- 172.21.15.7:0/1713678336 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c09b900 con 0x563fd631d4a0 2024-09-19T08:45:14.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.524+0000 7f4eb2dee740 1 -- 172.21.15.7:0/1713678336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e9c09fcb0 con 0x563fd631d4a0 2024-09-19T08:45:14.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.524+0000 7f4e91ffb640 1 -- 172.21.15.7:0/1713678336 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f4e9c0ba2a0 con 0x563fd631d4a0 2024-09-19T08:45:14.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.524+0000 7f4e91ffb640 1 -- 172.21.15.7:0/1713678336 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4e9c0a4570 con 0x563fd631d4a0 2024-09-19T08:45:14.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.524+0000 7f4eb2dee740 10 client.15432 fetch_fsmap learned FSMap version 25 2024-09-19T08:45:14.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.524+0000 7f4eb2dee740 1 -- 172.21.15.7:0/1713678336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563fd6336c90 con 0x563fd631d4a0 2024-09-19T08:45:14.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.525+0000 7f4e91ffb640 1 -- 172.21.15.7:0/1713678336 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e9c09fcb0 con 0x563fd631d4a0 2024-09-19T08:45:14.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.525+0000 7f4e91ffb640 1 -- 172.21.15.7:0/1713678336 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4e9c09a7c0 con 0x563fd631d4a0 2024-09-19T08:45:14.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.525+0000 7f4eb2dee740 10 client.15432 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:45:14.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.525+0000 7f4eb2dee740 10 client.15432 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:45:14.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.525+0000 7f4eb2dee740 20 client.15432 populate_metadata read hostname 'smithi007' 2024-09-19T08:45:14.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.525+0000 7f4eb2dee740 1 --2- 172.21.15.7:0/1713678336 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563fd6337fe0 0x563fd633a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:14.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.525+0000 7f4eb2dee740 4 client.15432 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:45:14.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.525+0000 7f4eb2dee740 1 -- 172.21.15.7:0/1713678336 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563fd6290850 con 0x563fd6337fe0 2024-09-19T08:45:14.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.525+0000 7f4ea3fff640 1 --2- 172.21.15.7:0/1713678336 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563fd6337fe0 0x563fd633a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:14.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.526+0000 7f4e91ffb640 10 client.15432 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:14.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.526+0000 7f4ea3fff640 1 --2- 172.21.15.7:0/1713678336 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563fd6337fe0 0x563fd633a3d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c7786c444859c48 server_cookie=4d322faf7ee9ed03 in_seq=0 out_seq=0 2024-09-19T08:45:14.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.526+0000 7f4e91ffb640 1 -- 172.21.15.7:0/1713678336 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563fd6290850 con 0x563fd6337fe0 2024-09-19T08:45:14.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.526+0000 7f4e91ffb640 10 client.15432 handle_command_reply: tid=0 2024-09-19T08:45:14.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.527+0000 7f4eb2dee740 1 client.15432 shutdown 2024-09-19T08:45:14.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.527+0000 7f4eb2dee740 1 -- 172.21.15.7:0/1713678336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd631d4a0 msgr2=0x563fd6328060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:14.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.527+0000 7f4eb2dee740 1 --2- 172.21.15.7:0/1713678336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd631d4a0 0x563fd6328060 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0cfba0 tx=0x7f4e9c0981a0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.527+0000 7f4eb2dee740 1 -- 172.21.15.7:0/1713678336 shutdown_connections 2024-09-19T08:45:14.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.527+0000 7f4eb2dee740 1 --2- 172.21.15.7:0/1713678336 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563fd6337fe0 0x563fd633a3d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.527+0000 7f4eb2dee740 1 --2- 172.21.15.7:0/1713678336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd6328680 0x563fd63258e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.527+0000 7f4eb2dee740 1 --2- 172.21.15.7:0/1713678336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fd631ddc0 0x563fd6325310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.527+0000 7f4eb2dee740 1 --2- 172.21.15.7:0/1713678336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd631d4a0 0x563fd6328060 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.527+0000 7f4eb2dee740 1 -- 172.21.15.7:0/1713678336 >> 172.21.15.7:0/1713678336 conn(0x563fd6319a30 msgr2=0x563fd631f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:14.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.527+0000 7f4e91ffb640 0 client.15432 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:14.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.527+0000 7f4eb2dee740 1 -- 172.21.15.7:0/1713678336 shutdown_connections 2024-09-19T08:45:14.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.527+0000 7f4eb2dee740 1 -- 172.21.15.7:0/1713678336 wait complete. 2024-09-19T08:45:14.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.527+0000 7f4eb2dee740 20 client.15432 trim_cache size 0 max 16384 2024-09-19T08:45:14.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.546+0000 7f4eb2dee740 1 Processor -- start 2024-09-19T08:45:14.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.546+0000 7f4eb2dee740 1 -- start start 2024-09-19T08:45:14.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.546+0000 7f4eb2dee740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd631d4a0 0x563fd633d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:14.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.546+0000 7f4eb2dee740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd631ddc0 0x563fd633d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:14.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.546+0000 7f4eb2dee740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fd6328680 0x563fd6322570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:14.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.546+0000 7f4eb2dee740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac1b0180 con 0x563fd631d4a0 2024-09-19T08:45:14.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.546+0000 7f4eb2dee740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac1ada50 con 0x563fd631ddc0 2024-09-19T08:45:14.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.546+0000 7f4eb2dee740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac1ab8a0 con 0x563fd6328680 2024-09-19T08:45:14.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.547+0000 7f4eaa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd631d4a0 0x563fd633d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:14.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.547+0000 7f4eaa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd631d4a0 0x563fd633d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57154/0 (socket says 172.21.15.7:57154) 2024-09-19T08:45:14.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.547+0000 7f4eaa59c640 1 -- 172.21.15.7:0/1360331892 learned_addr learned my addr 172.21.15.7:0/1360331892 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:14.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.547+0000 7f4ea3fff640 1 --2- 172.21.15.7:0/1360331892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd631ddc0 0x563fd633d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:14.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.547+0000 7f4eaad9d640 1 --2- 172.21.15.7:0/1360331892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fd6328680 0x563fd6322570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:14.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.547+0000 7f4ea3fff640 1 -- 172.21.15.7:0/1360331892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fd6328680 msgr2=0x563fd6322570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:14.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.547+0000 7f4ea3fff640 1 --2- 172.21.15.7:0/1360331892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fd6328680 0x563fd6322570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.547+0000 7f4ea3fff640 1 -- 172.21.15.7:0/1360331892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd631d4a0 msgr2=0x563fd633d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:14.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.547+0000 7f4ea3fff640 1 --2- 172.21.15.7:0/1360331892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd631d4a0 0x563fd633d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.547+0000 7f4ea3fff640 1 -- 172.21.15.7:0/1360331892 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fd63283d0 con 0x563fd631ddc0 2024-09-19T08:45:14.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.547+0000 7f4eaa59c640 1 --2- 172.21.15.7:0/1360331892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd631d4a0 0x563fd633d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:45:14.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.547+0000 7f4ea3fff640 1 --2- 172.21.15.7:0/1360331892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd631ddc0 0x563fd633d550 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x563fd6324ba0 tx=0x7f4e94013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f95da044fe3c20a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:14.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.548+0000 7f4e93fff640 1 -- 172.21.15.7:0/1360331892 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9402e070 con 0x563fd631ddc0 2024-09-19T08:45:14.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.548+0000 7f4e93fff640 1 -- 172.21.15.7:0/1360331892 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e940210d0 con 0x563fd631ddc0 2024-09-19T08:45:14.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.548+0000 7f4e93fff640 1 -- 172.21.15.7:0/1360331892 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e940116c0 con 0x563fd631ddc0 2024-09-19T08:45:14.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.548+0000 7f4eb2dee740 1 -- 172.21.15.7:0/1360331892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd631ddc0 msgr2=0x563fd633d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:14.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.548+0000 7f4eb2dee740 1 --2- 172.21.15.7:0/1360331892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd631ddc0 0x563fd633d550 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x563fd6324ba0 tx=0x7f4e94013000 comp rx=0 tx=0).stop 2024-09-19T08:45:14.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.548+0000 7f4eb2dee740 1 -- 172.21.15.7:0/1360331892 shutdown_connections 2024-09-19T08:45:14.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.548+0000 7f4eb2dee740 1 --2- 172.21.15.7:0/1360331892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fd6328680 0x563fd6322570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.548+0000 7f4eb2dee740 1 --2- 172.21.15.7:0/1360331892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd631ddc0 0x563fd633d550 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.548+0000 7f4eb2dee740 1 --2- 172.21.15.7:0/1360331892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd631d4a0 0x563fd633d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.548+0000 7f4eb2dee740 1 -- 172.21.15.7:0/1360331892 >> 172.21.15.7:0/1360331892 conn(0x563fd6319a30 msgr2=0x563fd6320850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:14.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.548+0000 7f4eb2dee740 1 -- 172.21.15.7:0/1360331892 shutdown_connections 2024-09-19T08:45:14.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.548+0000 7f4eb2dee740 1 -- 172.21.15.7:0/1360331892 wait complete. 2024-09-19T08:45:14.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.549+0000 7f4eb2dee740 1 -- start start 2024-09-19T08:45:14.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.549+0000 7f4eb2dee740 1 Processor -- start 2024-09-19T08:45:14.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.549+0000 7f4eb2dee740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd631d4a0 0x563fd633d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:14.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.549+0000 7f4eb2dee740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd631ddc0 0x563fd639b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:14.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.549+0000 7f4eb2dee740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fd6328680 0x563fd639b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:14.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.549+0000 7f4eb2dee740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac1abf10 con 0x563fd631ddc0 2024-09-19T08:45:14.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.549+0000 7f4eb2dee740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac1ad380 con 0x563fd631d4a0 2024-09-19T08:45:14.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.549+0000 7f4eb2dee740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac1ac5e0 con 0x563fd6328680 2024-09-19T08:45:14.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.549+0000 7f4eb2dee740 10 client.0 _ll_register_callbacks cb 0x7f4e940042a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:14.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.549+0000 7f4ea3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd631ddc0 0x563fd639b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:14.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.549+0000 7f4ea3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd631ddc0 0x563fd639b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57160/0 (socket says 172.21.15.7:57160) 2024-09-19T08:45:14.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.549+0000 7f4ea3fff640 1 -- 172.21.15.7:0/28362281 learned_addr learned my addr 172.21.15.7:0/28362281 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:14.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.549+0000 7f4eaa59c640 1 --2- 172.21.15.7:0/28362281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd631d4a0 0x563fd633d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:14.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.549+0000 7f4eaad9d640 1 --2- 172.21.15.7:0/28362281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fd6328680 0x563fd639b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:14.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.550+0000 7f4ea3fff640 1 -- 172.21.15.7:0/28362281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fd6328680 msgr2=0x563fd639b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:14.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.550+0000 7f4ea3fff640 1 --2- 172.21.15.7:0/28362281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fd6328680 0x563fd639b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.550+0000 7f4ea3fff640 1 -- 172.21.15.7:0/28362281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd631d4a0 msgr2=0x563fd633d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:14.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.550+0000 7f4ea3fff640 1 --2- 172.21.15.7:0/28362281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd631d4a0 0x563fd633d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.550+0000 7f4ea3fff640 1 -- 172.21.15.7:0/28362281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fd639bf60 con 0x563fd631ddc0 2024-09-19T08:45:14.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.550+0000 7f4ea3fff640 1 --2- 172.21.15.7:0/28362281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd631ddc0 0x563fd639b2e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4e94003960 tx=0x7f4e94005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67de79b9de9acee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:14.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.550+0000 7f4e91ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:45:14.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.550+0000 7f4e91ffb640 1 -- 172.21.15.7:0/28362281 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e94037060 con 0x563fd631ddc0 2024-09-19T08:45:14.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.550+0000 7f4e91ffb640 1 -- 172.21.15.7:0/28362281 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f4e94027050 con 0x563fd631ddc0 2024-09-19T08:45:14.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.550+0000 7f4eb2dee740 1 -- 172.21.15.7:0/28362281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e940210d0 con 0x563fd631ddc0 2024-09-19T08:45:14.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.550+0000 7f4e91ffb640 1 -- 172.21.15.7:0/28362281 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4e9402e030 con 0x563fd631ddc0 2024-09-19T08:45:14.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.550+0000 7f4eb2dee740 10 client.15438 fetch_fsmap learned FSMap version 25 2024-09-19T08:45:14.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.550+0000 7f4eb2dee740 1 -- 172.21.15.7:0/28362281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563fd63a6d20 con 0x563fd631ddc0 2024-09-19T08:45:14.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.551+0000 7f4e91ffb640 1 -- 172.21.15.7:0/28362281 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e940210d0 con 0x563fd631ddc0 2024-09-19T08:45:14.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.551+0000 7f4e91ffb640 1 -- 172.21.15.7:0/28362281 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4e94011660 con 0x563fd631ddc0 2024-09-19T08:45:14.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.551+0000 7f4eb2dee740 10 client.15438 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:45:14.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.551+0000 7f4eb2dee740 10 client.15438 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:45:14.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.551+0000 7f4eb2dee740 20 client.15438 populate_metadata read hostname 'smithi007' 2024-09-19T08:45:14.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.551+0000 7f4eb2dee740 1 --2- 172.21.15.7:0/28362281 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563fd63a73c0 0x563fd63a97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:14.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.551+0000 7f4eb2dee740 4 client.15438 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:45:14.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.551+0000 7f4eb2dee740 1 -- 172.21.15.7:0/28362281 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563fd628ad60 con 0x563fd63a73c0 2024-09-19T08:45:14.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.551+0000 7f4eaa59c640 1 --2- 172.21.15.7:0/28362281 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563fd63a73c0 0x563fd63a97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:14.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.552+0000 7f4eaa59c640 1 --2- 172.21.15.7:0/28362281 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563fd63a73c0 0x563fd63a97e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcce0bbd0394f115 server_cookie=9cc9939078cc12e in_seq=0 out_seq=0 2024-09-19T08:45:14.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.552+0000 7f4e91ffb640 10 client.15438 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:14.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.552+0000 7f4e91ffb640 1 -- 172.21.15.7:0/28362281 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563fd628ad60 con 0x563fd63a73c0 2024-09-19T08:45:14.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.552+0000 7f4e91ffb640 10 client.15438 handle_command_reply: tid=0 2024-09-19T08:45:14.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.552+0000 7f4eb2dee740 1 client.15438 shutdown 2024-09-19T08:45:14.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.552+0000 7f4eb2dee740 1 -- 172.21.15.7:0/28362281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd631ddc0 msgr2=0x563fd639b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:14.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.552+0000 7f4eb2dee740 1 --2- 172.21.15.7:0/28362281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd631ddc0 0x563fd639b2e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4e94003960 tx=0x7f4e94005760 comp rx=0 tx=0).stop 2024-09-19T08:45:14.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.552+0000 7f4eb2dee740 1 -- 172.21.15.7:0/28362281 shutdown_connections 2024-09-19T08:45:14.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.552+0000 7f4eb2dee740 1 --2- 172.21.15.7:0/28362281 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563fd63a73c0 0x563fd63a97e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.552+0000 7f4eb2dee740 1 --2- 172.21.15.7:0/28362281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fd6328680 0x563fd639b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.552+0000 7f4eb2dee740 1 --2- 172.21.15.7:0/28362281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563fd631ddc0 0x563fd639b2e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.552+0000 7f4eb2dee740 1 --2- 172.21.15.7:0/28362281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563fd631d4a0 0x563fd633d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.552+0000 7f4eb2dee740 1 -- 172.21.15.7:0/28362281 >> 172.21.15.7:0/28362281 conn(0x563fd6319a30 msgr2=0x563fd631eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:14.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.552+0000 7f4e91ffb640 0 client.15438 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:14.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.552+0000 7f4eb2dee740 1 -- 172.21.15.7:0/28362281 shutdown_connections 2024-09-19T08:45:14.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.552+0000 7f4eb2dee740 1 -- 172.21.15.7:0/28362281 wait complete. 2024-09-19T08:45:14.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.552+0000 7f4eb2dee740 20 client.15438 trim_cache size 0 max 16384 2024-09-19T08:45:14.561 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:45:14.561 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-19T08:45:14.561 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-09-19T08:45:14.561 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:45:14.561 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:14 smithi044 ceph-mon[35072]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T08:45:14.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.553+0000 7f4eb0a15640 1 -- 172.21.15.7:0/1693253739 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4e980a34d0 msgr2=0x7f4e980a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:14.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.553+0000 7f4eb0a15640 1 --2- 172.21.15.7:0/1693253739 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4e980a34d0 0x7f4e980a5990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4eac105130 tx=0x7f4e9400b390 comp rx=0 tx=0).stop 2024-09-19T08:45:14.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.553+0000 7f4eb0a15640 1 -- 172.21.15.7:0/1693253739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eac100a90 msgr2=0x7f4eac1983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:14.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.553+0000 7f4eb0a15640 1 --2- 172.21.15.7:0/1693253739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eac100a90 0x7f4eac1983f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00d950 tx=0x7f4e9c00de10 comp rx=0 tx=0).stop 2024-09-19T08:45:14.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.553+0000 7f4eb0a15640 1 -- 172.21.15.7:0/1693253739 shutdown_connections 2024-09-19T08:45:14.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.553+0000 7f4eb0a15640 1 --2- 172.21.15.7:0/1693253739 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4e980a34d0 0x7f4e980a5990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.553+0000 7f4eb0a15640 1 --2- 172.21.15.7:0/1693253739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4eac106a90 0x7f4eac19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.553+0000 7f4eb0a15640 1 --2- 172.21.15.7:0/1693253739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eac101430 0x7f4eac198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.553+0000 7f4eb0a15640 1 --2- 172.21.15.7:0/1693253739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eac100a90 0x7f4eac1983f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:14.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.553+0000 7f4eb0a15640 1 -- 172.21.15.7:0/1693253739 >> 172.21.15.7:0/1693253739 conn(0x7f4eac0fc7d0 msgr2=0x7f4eac06a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:14.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.553+0000 7f4eb0a15640 1 -- 172.21.15.7:0/1693253739 shutdown_connections 2024-09-19T08:45:14.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:14.553+0000 7f4eb0a15640 1 -- 172.21.15.7:0/1693253739 wait complete. 2024-09-19T08:45:14.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:14 smithi175 ceph-mon[35688]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T08:45:15.271 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:45:15.272 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:45:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:15.923 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 11.2 2024-09-19T08:45:15.924 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:45:16.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.409+0000 7fdbcd384640 1 -- 172.21.15.7:0/4124613469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbc81036e0 msgr2=0x7fdbc8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:16.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.409+0000 7fdbcd384640 1 --2- 172.21.15.7:0/4124613469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbc81036e0 0x7fdbc8107b90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc009930 tx=0x7fdbbc02a420 comp rx=0 tx=0).stop 2024-09-19T08:45:16.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.409+0000 7fdbcd384640 1 -- 172.21.15.7:0/4124613469 shutdown_connections 2024-09-19T08:45:16.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.409+0000 7fdbcd384640 1 --2- 172.21.15.7:0/4124613469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbc81082a0 0x7fdbc810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:16.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.409+0000 7fdbcd384640 1 --2- 172.21.15.7:0/4124613469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbc81036e0 0x7fdbc8107b90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:16.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.409+0000 7fdbcd384640 1 --2- 172.21.15.7:0/4124613469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbc8102d30 0x7fdbc8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:16.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.409+0000 7fdbcd384640 1 -- 172.21.15.7:0/4124613469 >> 172.21.15.7:0/4124613469 conn(0x7fdbc80fc7d0 msgr2=0x7fdbc80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:16.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.409+0000 7fdbcd384640 1 -- 172.21.15.7:0/4124613469 shutdown_connections 2024-09-19T08:45:16.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.409+0000 7fdbcd384640 1 -- 172.21.15.7:0/4124613469 wait complete. 2024-09-19T08:45:16.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.410+0000 7fdbcd384640 1 Processor -- start 2024-09-19T08:45:16.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.410+0000 7fdbcd384640 1 -- start start 2024-09-19T08:45:16.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.410+0000 7fdbcd384640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbc8102d30 0x7fdbc81985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:16.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.410+0000 7fdbcd384640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbc81036e0 0x7fdbc8198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:16.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.410+0000 7fdbcd384640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbc81082a0 0x7fdbc819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:16.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.410+0000 7fdbcd384640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc81120b0 con 0x7fdbc81036e0 2024-09-19T08:45:16.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.410+0000 7fdbcd384640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc8111f30 con 0x7fdbc8102d30 2024-09-19T08:45:16.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.410+0000 7fdbcd384640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc8112230 con 0x7fdbc81082a0 2024-09-19T08:45:16.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.410+0000 7fdbc67fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbc81036e0 0x7fdbc8198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:16.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.410+0000 7fdbc67fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbc81036e0 0x7fdbc8198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57182/0 (socket says 172.21.15.7:57182) 2024-09-19T08:45:16.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.410+0000 7fdbc67fc640 1 -- 172.21.15.7:0/276759354 learned_addr learned my addr 172.21.15.7:0/276759354 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:16.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.410+0000 7fdbc6ffd640 1 --2- 172.21.15.7:0/276759354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbc8102d30 0x7fdbc81985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:16.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.411+0000 7fdbc77fe640 1 --2- 172.21.15.7:0/276759354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbc81082a0 0x7fdbc819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:16.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.411+0000 7fdbc67fc640 1 -- 172.21.15.7:0/276759354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbc81082a0 msgr2=0x7fdbc819ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:16.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.411+0000 7fdbc67fc640 1 --2- 172.21.15.7:0/276759354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbc81082a0 0x7fdbc819ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:16.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.411+0000 7fdbc67fc640 1 -- 172.21.15.7:0/276759354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbc8102d30 msgr2=0x7fdbc81985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:16.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.411+0000 7fdbc67fc640 1 --2- 172.21.15.7:0/276759354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbc8102d30 0x7fdbc81985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:16.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.411+0000 7fdbc67fc640 1 -- 172.21.15.7:0/276759354 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc819d560 con 0x7fdbc81036e0 2024-09-19T08:45:16.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.411+0000 7fdbc6ffd640 1 --2- 172.21.15.7:0/276759354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbc8102d30 0x7fdbc81985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:16.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.411+0000 7fdbc67fc640 1 --2- 172.21.15.7:0/276759354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbc81036e0 0x7fdbc8198af0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc02a940 tx=0x7fdbbc003b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:16.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.411+0000 7fdbaffff640 1 -- 172.21.15.7:0/276759354 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc03f070 con 0x7fdbc81036e0 2024-09-19T08:45:16.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.411+0000 7fdbaffff640 1 -- 172.21.15.7:0/276759354 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbbc031c90 con 0x7fdbc81036e0 2024-09-19T08:45:16.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.411+0000 7fdbcd384640 1 -- 172.21.15.7:0/276759354 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc819d7f0 con 0x7fdbc81036e0 2024-09-19T08:45:16.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.411+0000 7fdbaffff640 1 -- 172.21.15.7:0/276759354 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc035030 con 0x7fdbc81036e0 2024-09-19T08:45:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.411+0000 7fdbcd384640 1 -- 172.21.15.7:0/276759354 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc81a5130 con 0x7fdbc81036e0 2024-09-19T08:45:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.413+0000 7fdbcd384640 1 -- 172.21.15.7:0/276759354 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbc8103110 con 0x7fdbc81036e0 2024-09-19T08:45:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.414+0000 7fdbaffff640 1 -- 172.21.15.7:0/276759354 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 138587+0+0 (secure 0 0 0) 0x7fdbbc042070 con 0x7fdbc81036e0 2024-09-19T08:45:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.415+0000 7fdbaffff640 1 --2- 172.21.15.7:0/276759354 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdbb00a34d0 0x7fdbb00a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.415+0000 7fdbc6ffd640 1 --2- 172.21.15.7:0/276759354 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdbb00a34d0 0x7fdbb00a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:16.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.415+0000 7fdbaffff640 1 -- 172.21.15.7:0/276759354 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fdbbc0f05a0 con 0x7fdbc81036e0 2024-09-19T08:45:16.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.415+0000 7fdbc6ffd640 1 --2- 172.21.15.7:0/276759354 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdbb00a34d0 0x7fdbb00a5990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8009c20 tx=0x7fdbb8005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:16.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.419+0000 7fdbaffff640 1 -- 172.21.15.7:0/276759354 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdbbc0bcdf0 con 0x7fdbc81036e0 2024-09-19T08:45:16.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:16 smithi007 ceph-mon[31221]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-19T08:45:16.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:16 smithi044 ceph-mon[35072]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-19T08:45:16.577 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:16.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.666+0000 7fdbcd384640 1 -- 172.21.15.7:0/276759354 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdbc810a2b0 con 0x7fdbc81036e0 2024-09-19T08:45:16.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.667+0000 7fdbaffff640 1 -- 172.21.15.7:0/276759354 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7fdbbc0bc6f0 con 0x7fdbc81036e0 2024-09-19T08:45:16.668 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:45:16.669 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:45:16.669 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:45:16.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.669+0000 7fdbcd384640 1 -- 172.21.15.7:0/276759354 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdbb00a34d0 msgr2=0x7fdbb00a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:16.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.669+0000 7fdbcd384640 1 --2- 172.21.15.7:0/276759354 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdbb00a34d0 0x7fdbb00a5990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8009c20 tx=0x7fdbb8005f90 comp rx=0 tx=0).stop 2024-09-19T08:45:16.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.669+0000 7fdbcd384640 1 -- 172.21.15.7:0/276759354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbc81036e0 msgr2=0x7fdbc8198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:16.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.669+0000 7fdbcd384640 1 --2- 172.21.15.7:0/276759354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbc81036e0 0x7fdbc8198af0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc02a940 tx=0x7fdbbc003b20 comp rx=0 tx=0).stop 2024-09-19T08:45:16.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.669+0000 7fdbcd384640 1 -- 172.21.15.7:0/276759354 shutdown_connections 2024-09-19T08:45:16.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.669+0000 7fdbcd384640 1 --2- 172.21.15.7:0/276759354 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdbb00a34d0 0x7fdbb00a5990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:16.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.669+0000 7fdbcd384640 1 --2- 172.21.15.7:0/276759354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdbc81082a0 0x7fdbc819ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:16.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.669+0000 7fdbcd384640 1 --2- 172.21.15.7:0/276759354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbc81036e0 0x7fdbc8198af0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:16.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.669+0000 7fdbcd384640 1 --2- 172.21.15.7:0/276759354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbc8102d30 0x7fdbc81985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:16.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.669+0000 7fdbcd384640 1 -- 172.21.15.7:0/276759354 >> 172.21.15.7:0/276759354 conn(0x7fdbc80fc7d0 msgr2=0x7fdbc8106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:16.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.670+0000 7fdbcd384640 1 -- 172.21.15.7:0/276759354 shutdown_connections 2024-09-19T08:45:16.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:16.670+0000 7fdbcd384640 1 -- 172.21.15.7:0/276759354 wait complete. 2024-09-19T08:45:16.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:16 smithi175 ceph-mon[35688]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-19T08:45:17.359 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:17 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/276759354' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:45:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.446+0000 7f4ccef32640 1 -- 172.21.15.7:0/177657550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cc81082a0 msgr2=0x7f4cc810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.446+0000 7f4ccef32640 1 --2- 172.21.15.7:0/177657550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cc81082a0 0x7f4cc810ec40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0009cd0 tx=0x7f4cc002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:45:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.446+0000 7f4ccef32640 1 -- 172.21.15.7:0/177657550 shutdown_connections 2024-09-19T08:45:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.446+0000 7f4ccef32640 1 --2- 172.21.15.7:0/177657550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cc81082a0 0x7f4cc810ec40 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.446+0000 7f4ccef32640 1 --2- 172.21.15.7:0/177657550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cc81036e0 0x7f4cc8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.446+0000 7f4ccef32640 1 --2- 172.21.15.7:0/177657550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cc8102d30 0x7f4cc8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.446+0000 7f4ccef32640 1 -- 172.21.15.7:0/177657550 >> 172.21.15.7:0/177657550 conn(0x7f4cc80fc7d0 msgr2=0x7f4cc80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.447+0000 7f4ccef32640 1 -- 172.21.15.7:0/177657550 shutdown_connections 2024-09-19T08:45:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.447+0000 7f4ccef32640 1 -- 172.21.15.7:0/177657550 wait complete. 2024-09-19T08:45:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.447+0000 7f4ccef32640 1 Processor -- start 2024-09-19T08:45:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.447+0000 7f4ccef32640 1 -- start start 2024-09-19T08:45:17.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.447+0000 7f4ccef32640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cc8102d30 0x7f4cc8198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:17.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.447+0000 7f4ccef32640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cc81036e0 0x7f4cc8198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:17.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.447+0000 7f4ccef32640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cc81082a0 0x7f4cc819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:17.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.447+0000 7f4ccef32640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8112080 con 0x7f4cc81036e0 2024-09-19T08:45:17.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.447+0000 7f4ccef32640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8111f00 con 0x7f4cc81082a0 2024-09-19T08:45:17.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.447+0000 7f4ccef32640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8112200 con 0x7f4cc8102d30 2024-09-19T08:45:17.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.447+0000 7f4cc7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cc81036e0 0x7f4cc8198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:17.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.448+0000 7f4cc7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cc81036e0 0x7f4cc8198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57198/0 (socket says 172.21.15.7:57198) 2024-09-19T08:45:17.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.448+0000 7f4cc7fff640 1 -- 172.21.15.7:0/88721705 learned_addr learned my addr 172.21.15.7:0/88721705 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:17.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.448+0000 7f4ccd4cf640 1 --2- 172.21.15.7:0/88721705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cc81082a0 0x7f4cc819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:17.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.448+0000 7f4ccccce640 1 --2- 172.21.15.7:0/88721705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cc8102d30 0x7f4cc8198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:17.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.448+0000 7f4cc7fff640 1 -- 172.21.15.7:0/88721705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cc8102d30 msgr2=0x7f4cc8198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:17.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.448+0000 7f4cc7fff640 1 --2- 172.21.15.7:0/88721705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cc8102d30 0x7f4cc8198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:17.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.448+0000 7f4cc7fff640 1 -- 172.21.15.7:0/88721705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cc81082a0 msgr2=0x7f4cc819ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:17.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.448+0000 7f4cc7fff640 1 --2- 172.21.15.7:0/88721705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cc81082a0 0x7f4cc819ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:17.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.448+0000 7f4cc7fff640 1 -- 172.21.15.7:0/88721705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc819d530 con 0x7f4cc81036e0 2024-09-19T08:45:17.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.448+0000 7f4cc7fff640 1 --2- 172.21.15.7:0/88721705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cc81036e0 0x7f4cc8198ac0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400c970 tx=0x7f4cb400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:17.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.448+0000 7f4cc5ffb640 1 -- 172.21.15.7:0/88721705 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4007bb0 con 0x7f4cc81036e0 2024-09-19T08:45:17.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.448+0000 7f4cc5ffb640 1 -- 172.21.15.7:0/88721705 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cb4007d50 con 0x7f4cc81036e0 2024-09-19T08:45:17.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.448+0000 7f4ccef32640 1 -- 172.21.15.7:0/88721705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc819d820 con 0x7f4cc81036e0 2024-09-19T08:45:17.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.448+0000 7f4cc5ffb640 1 -- 172.21.15.7:0/88721705 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb400f450 con 0x7f4cc81036e0 2024-09-19T08:45:17.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.449+0000 7f4ccef32640 1 -- 172.21.15.7:0/88721705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc81a5100 con 0x7f4cc81036e0 2024-09-19T08:45:17.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.450+0000 7f4ccef32640 1 -- 172.21.15.7:0/88721705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc8103110 con 0x7f4cc81036e0 2024-09-19T08:45:17.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.451+0000 7f4cc5ffb640 1 -- 172.21.15.7:0/88721705 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 138587+0+0 (secure 0 0 0) 0x7f4cb4004f60 con 0x7f4cc81036e0 2024-09-19T08:45:17.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.452+0000 7f4cc5ffb640 1 --2- 172.21.15.7:0/88721705 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4cb80a3550 0x7f4cb80a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:17.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.452+0000 7f4ccccce640 1 --2- 172.21.15.7:0/88721705 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4cb80a3550 0x7f4cb80a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:17.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.452+0000 7f4cc5ffb640 1 -- 172.21.15.7:0/88721705 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f4cb40cfc60 con 0x7f4cc81036e0 2024-09-19T08:45:17.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.452+0000 7f4ccccce640 1 --2- 172.21.15.7:0/88721705 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4cb80a3550 0x7f4cb80a5a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc005fd0 tx=0x7f4cbc005850 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:17.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.456+0000 7f4cc5ffb640 1 -- 172.21.15.7:0/88721705 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4cb4014030 con 0x7f4cc81036e0 2024-09-19T08:45:17.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:17 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/276759354' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:45:17.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:17 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/276759354' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:45:17.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.678+0000 7f4ccef32640 1 -- 172.21.15.7:0/88721705 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4cc810a2e0 con 0x7f4cc81036e0 2024-09-19T08:45:17.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.679+0000 7f4cc5ffb640 1 -- 172.21.15.7:0/88721705 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f4cb409c380 con 0x7f4cc81036e0 2024-09-19T08:45:17.680 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:45:17.680 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:45:17.680 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:45:17.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.682+0000 7f4ccef32640 1 -- 172.21.15.7:0/88721705 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4cb80a3550 msgr2=0x7f4cb80a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:17.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.682+0000 7f4ccef32640 1 --2- 172.21.15.7:0/88721705 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4cb80a3550 0x7f4cb80a5a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc005fd0 tx=0x7f4cbc005850 comp rx=0 tx=0).stop 2024-09-19T08:45:17.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.682+0000 7f4ccef32640 1 -- 172.21.15.7:0/88721705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cc81036e0 msgr2=0x7f4cc8198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:17.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.682+0000 7f4ccef32640 1 --2- 172.21.15.7:0/88721705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cc81036e0 0x7f4cc8198ac0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400c970 tx=0x7f4cb400ce30 comp rx=0 tx=0).stop 2024-09-19T08:45:17.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.682+0000 7f4ccef32640 1 -- 172.21.15.7:0/88721705 shutdown_connections 2024-09-19T08:45:17.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.682+0000 7f4ccef32640 1 --2- 172.21.15.7:0/88721705 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4cb80a3550 0x7f4cb80a5a10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:17.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.682+0000 7f4ccef32640 1 --2- 172.21.15.7:0/88721705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cc81082a0 0x7f4cc819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:17.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.682+0000 7f4ccef32640 1 --2- 172.21.15.7:0/88721705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cc81036e0 0x7f4cc8198ac0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:17.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.682+0000 7f4ccef32640 1 --2- 172.21.15.7:0/88721705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cc8102d30 0x7f4cc8198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:17.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.682+0000 7f4ccef32640 1 -- 172.21.15.7:0/88721705 >> 172.21.15.7:0/88721705 conn(0x7f4cc80fc7d0 msgr2=0x7f4cc8106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:17.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.682+0000 7f4ccef32640 1 -- 172.21.15.7:0/88721705 shutdown_connections 2024-09-19T08:45:17.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:17.682+0000 7f4ccef32640 1 -- 172.21.15.7:0/88721705 wait complete. 2024-09-19T08:45:18.184 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:45:18.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:18 smithi007 ceph-mon[31221]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-19T08:45:18.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:18 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/88721705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:45:18.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:18 smithi044 ceph-mon[35072]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-19T08:45:18.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:18 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/88721705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:45:18.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:18 smithi175 ceph-mon[35688]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-19T08:45:18.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:18 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/88721705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:45:18.708 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24491 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0' 2024-09-19T08:45:18.709 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24491 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0 2024-09-19T08:45:18.735 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:19.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.221+0000 7f825942d640 1 -- 172.21.15.7:0/4056342682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8254102790 msgr2=0x7f82541067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:19.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.221+0000 7f825942d640 1 --2- 172.21.15.7:0/4056342682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8254102790 0x7f82541067e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8248009900 tx=0x7f824802a410 comp rx=0 tx=0).stop 2024-09-19T08:45:19.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.221+0000 7f825942d640 1 -- 172.21.15.7:0/4056342682 shutdown_connections 2024-09-19T08:45:19.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.221+0000 7f825942d640 1 --2- 172.21.15.7:0/4056342682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8254106f10 0x7f825410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.221+0000 7f825942d640 1 --2- 172.21.15.7:0/4056342682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8254102790 0x7f82541067e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.221+0000 7f825942d640 1 --2- 172.21.15.7:0/4056342682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8254101de0 0x7f82541021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.221+0000 7f825942d640 1 -- 172.21.15.7:0/4056342682 >> 172.21.15.7:0/4056342682 conn(0x7f82540fd8c0 msgr2=0x7f82540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:19.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.221+0000 7f825942d640 1 -- 172.21.15.7:0/4056342682 shutdown_connections 2024-09-19T08:45:19.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.221+0000 7f825942d640 1 -- 172.21.15.7:0/4056342682 wait complete. 2024-09-19T08:45:19.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.222+0000 7f825942d640 1 Processor -- start 2024-09-19T08:45:19.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.222+0000 7f825942d640 1 -- start start 2024-09-19T08:45:19.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.222+0000 7f825942d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8254101de0 0x7f8254198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:19.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.222+0000 7f825942d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8254102790 0x7f82541989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:19.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.222+0000 7f825942d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8254106f10 0x7f825419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:19.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.222+0000 7f825942d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8254111f30 con 0x7f8254102790 2024-09-19T08:45:19.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.222+0000 7f825942d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8254111db0 con 0x7f8254106f10 2024-09-19T08:45:19.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.222+0000 7f825942d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f82541120b0 con 0x7f8254101de0 2024-09-19T08:45:19.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.222+0000 7f82527fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8254102790 0x7f82541989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:19.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.222+0000 7f82527fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8254102790 0x7f82541989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57218/0 (socket says 172.21.15.7:57218) 2024-09-19T08:45:19.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.222+0000 7f82527fc640 1 -- 172.21.15.7:0/260345092 learned_addr learned my addr 172.21.15.7:0/260345092 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:19.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.223+0000 7f82537fe640 1 --2- 172.21.15.7:0/260345092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8254106f10 0x7f825419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:19.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.223+0000 7f8252ffd640 1 --2- 172.21.15.7:0/260345092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8254101de0 0x7f8254198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:19.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.223+0000 7f82527fc640 1 -- 172.21.15.7:0/260345092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8254101de0 msgr2=0x7f8254198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:19.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.223+0000 7f82527fc640 1 --2- 172.21.15.7:0/260345092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8254101de0 0x7f8254198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.223+0000 7f82527fc640 1 -- 172.21.15.7:0/260345092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8254106f10 msgr2=0x7f825419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:19.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.223+0000 7f82527fc640 1 --2- 172.21.15.7:0/260345092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8254106f10 0x7f825419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.223+0000 7f82527fc640 1 -- 172.21.15.7:0/260345092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f825419d440 con 0x7f8254102790 2024-09-19T08:45:19.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.223+0000 7f82527fc640 1 --2- 172.21.15.7:0/260345092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8254102790 0x7f82541989d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8248006010 tx=0x7f82480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:19.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.223+0000 7f823bfff640 1 -- 172.21.15.7:0/260345092 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824803f030 con 0x7f8254102790 2024-09-19T08:45:19.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.223+0000 7f823bfff640 1 -- 172.21.15.7:0/260345092 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8248003ce0 con 0x7f8254102790 2024-09-19T08:45:19.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.223+0000 7f823bfff640 1 -- 172.21.15.7:0/260345092 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8248035070 con 0x7f8254102790 2024-09-19T08:45:19.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.223+0000 7f825942d640 1 -- 172.21.15.7:0/260345092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f825419d6d0 con 0x7f8254102790 2024-09-19T08:45:19.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.223+0000 7f825942d640 1 -- 172.21.15.7:0/260345092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f825419db60 con 0x7f8254102790 2024-09-19T08:45:19.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.226+0000 7f823bfff640 1 -- 172.21.15.7:0/260345092 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 138587+0+0 (secure 0 0 0) 0x7f8248042030 con 0x7f8254102790 2024-09-19T08:45:19.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.226+0000 7f825b806740 1 Processor -- start 2024-09-19T08:45:19.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.226+0000 7f825b806740 1 -- start start 2024-09-19T08:45:19.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.226+0000 7f825b806740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5cbb40 0x55c84d5ca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:19.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.226+0000 7f825b806740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5ca5d0 0x55c84d5caa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:19.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.226+0000 7f825b806740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5d5370 0x55c84d5d7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:19.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.226+0000 7f825b806740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c84d5302f0 con 0x55c84d5d5370 2024-09-19T08:45:19.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.226+0000 7f825b806740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c84d4d7cf0 con 0x55c84d5cbb40 2024-09-19T08:45:19.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.226+0000 7f825b806740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c84d52c2b0 con 0x55c84d5ca5d0 2024-09-19T08:45:19.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.227+0000 7f82527fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5d5370 0x55c84d5d7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:19.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.227+0000 7f82527fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5d5370 0x55c84d5d7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57220/0 (socket says 172.21.15.7:57220) 2024-09-19T08:45:19.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.227+0000 7f82527fc640 1 -- 172.21.15.7:0/976992747 learned_addr learned my addr 172.21.15.7:0/976992747 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:19.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.227+0000 7f8252ffd640 1 --2- 172.21.15.7:0/976992747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5ca5d0 0x55c84d5caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:19.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.227+0000 7f823bfff640 1 --2- 172.21.15.7:0/260345092 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f823c0a34d0 0x7f823c0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:19.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.227+0000 7f82537fe640 1 --2- 172.21.15.7:0/976992747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5cbb40 0x55c84d5ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:19.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.227+0000 7f823bfff640 1 -- 172.21.15.7:0/260345092 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f82480f0020 con 0x7f8254102790 2024-09-19T08:45:19.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.227+0000 7f82527fc640 1 -- 172.21.15.7:0/976992747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5ca5d0 msgr2=0x55c84d5caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:19.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.227+0000 7f82527fc640 1 --2- 172.21.15.7:0/976992747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5ca5d0 0x55c84d5caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.227+0000 7f82527fc640 1 -- 172.21.15.7:0/976992747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5cbb40 msgr2=0x55c84d5ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:19.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.227+0000 7f82527fc640 1 --2- 172.21.15.7:0/976992747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5cbb40 0x55c84d5ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.227+0000 7f82527fc640 1 -- 172.21.15.7:0/976992747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c84d4bc3a0 con 0x55c84d5d5370 2024-09-19T08:45:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.227+0000 7f82537fe640 1 --2- 172.21.15.7:0/260345092 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f823c0a34d0 0x7f823c0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.227+0000 7f8252ffd640 1 --2- 172.21.15.7:0/976992747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5ca5d0 0x55c84d5caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.227+0000 7f82527fc640 1 --2- 172.21.15.7:0/976992747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5d5370 0x55c84d5d7760 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f82480ed670 tx=0x7f8248031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8194486355e9e613 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.228+0000 7f82397fa640 1 -- 172.21.15.7:0/976992747 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8248049070 con 0x55c84d5d5370 2024-09-19T08:45:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.228+0000 7f82397fa640 1 -- 172.21.15.7:0/976992747 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82480bc930 con 0x55c84d5d5370 2024-09-19T08:45:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.228+0000 7f82397fa640 1 -- 172.21.15.7:0/976992747 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82480c05e0 con 0x55c84d5d5370 2024-09-19T08:45:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.229+0000 7f825b806740 1 -- 172.21.15.7:0/976992747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5d5370 msgr2=0x55c84d5d7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.229+0000 7f825b806740 1 --2- 172.21.15.7:0/976992747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5d5370 0x55c84d5d7760 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f82480ed670 tx=0x7f8248031a60 comp rx=0 tx=0).stop 2024-09-19T08:45:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.229+0000 7f82537fe640 1 --2- 172.21.15.7:0/260345092 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f823c0a34d0 0x7f823c0a5990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f824c005fd0 tx=0x7f824c015040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.229+0000 7f825b806740 1 -- 172.21.15.7:0/976992747 shutdown_connections 2024-09-19T08:45:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.229+0000 7f825b806740 1 --2- 172.21.15.7:0/976992747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5d5370 0x55c84d5d7760 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.229+0000 7f825b806740 1 --2- 172.21.15.7:0/976992747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5ca5d0 0x55c84d5caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.229+0000 7f825b806740 1 --2- 172.21.15.7:0/976992747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5cbb40 0x55c84d5ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.229+0000 7f825b806740 1 -- 172.21.15.7:0/976992747 >> 172.21.15.7:0/976992747 conn(0x55c84d593310 msgr2=0x55c84d5c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.229+0000 7f825b806740 1 -- 172.21.15.7:0/976992747 shutdown_connections 2024-09-19T08:45:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.229+0000 7f825b806740 1 -- 172.21.15.7:0/976992747 wait complete. 2024-09-19T08:45:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.229+0000 7f825b806740 1 -- start start 2024-09-19T08:45:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.229+0000 7f825b806740 1 Processor -- start 2024-09-19T08:45:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.230+0000 7f825b806740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5ca5d0 0x55c84d5d4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.230+0000 7f825b806740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5cbb40 0x55c84d5d2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.230+0000 7f825b806740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5d5370 0x55c84d5d27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:19.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.230+0000 7f825b806740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c84d5302f0 con 0x55c84d5d5370 2024-09-19T08:45:19.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.230+0000 7f825b806740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c84d4eb060 con 0x55c84d5cbb40 2024-09-19T08:45:19.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.230+0000 7f825b806740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c84d5dc240 con 0x55c84d5ca5d0 2024-09-19T08:45:19.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.230+0000 7f82537fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5d5370 0x55c84d5d27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:19.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.230+0000 7f82537fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5d5370 0x55c84d5d27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57230/0 (socket says 172.21.15.7:57230) 2024-09-19T08:45:19.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.230+0000 7f82537fe640 1 -- 172.21.15.7:0/2292410961 learned_addr learned my addr 172.21.15.7:0/2292410961 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:19.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.230+0000 7f82527fc640 1 --2- 172.21.15.7:0/2292410961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5cbb40 0x55c84d5d2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:19.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.230+0000 7f8252ffd640 1 --2- 172.21.15.7:0/2292410961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5ca5d0 0x55c84d5d4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:19.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.230+0000 7f825b806740 10 client.0 _ll_register_callbacks cb 0x55c84d23e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:19.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.230+0000 7f82537fe640 1 -- 172.21.15.7:0/2292410961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5ca5d0 msgr2=0x55c84d5d4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:19.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.230+0000 7f82537fe640 1 --2- 172.21.15.7:0/2292410961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5ca5d0 0x55c84d5d4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.230+0000 7f82537fe640 1 -- 172.21.15.7:0/2292410961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5cbb40 msgr2=0x55c84d5d2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:19.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.230+0000 7f82537fe640 1 --2- 172.21.15.7:0/2292410961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5cbb40 0x55c84d5d2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.230+0000 7f82537fe640 1 -- 172.21.15.7:0/2292410961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c84d2a13c0 con 0x55c84d5d5370 2024-09-19T08:45:19.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.230+0000 7f82537fe640 1 --2- 172.21.15.7:0/2292410961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5d5370 0x55c84d5d27f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f824c00fc50 tx=0x7f824c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308402721369c004 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:19.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.230+0000 7f8236ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:45:19.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.231+0000 7f8236ff5640 1 -- 172.21.15.7:0/2292410961 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c01d430 con 0x55c84d5d5370 2024-09-19T08:45:19.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.231+0000 7f8236ff5640 1 -- 172.21.15.7:0/2292410961 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f824c01d5d0 con 0x55c84d5d5370 2024-09-19T08:45:19.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.231+0000 7f825b806740 1 -- 172.21.15.7:0/2292410961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82480bc930 con 0x55c84d5d5370 2024-09-19T08:45:19.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.231+0000 7f8236ff5640 1 -- 172.21.15.7:0/2292410961 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f824c01d7d0 con 0x55c84d5d5370 2024-09-19T08:45:19.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.231+0000 7f825b806740 10 client.15462 fetch_fsmap learned FSMap version 25 2024-09-19T08:45:19.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.231+0000 7f825b806740 1 -- 172.21.15.7:0/2292410961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c84d5e7bf0 con 0x55c84d5d5370 2024-09-19T08:45:19.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.231+0000 7f8236ff5640 1 -- 172.21.15.7:0/2292410961 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f824c01de50 con 0x55c84d5d5370 2024-09-19T08:45:19.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.231+0000 7f8236ff5640 1 -- 172.21.15.7:0/2292410961 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f824c01c070 con 0x55c84d5d5370 2024-09-19T08:45:19.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.232+0000 7f825b806740 10 client.15462 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:45:19.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.232+0000 7f825b806740 10 client.15462 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:45:19.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.232+0000 7f825b806740 20 client.15462 populate_metadata read hostname 'smithi007' 2024-09-19T08:45:19.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.232+0000 7f825b806740 1 --2- 172.21.15.7:0/2292410961 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c84d5e9050 0x55c84d5eb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:19.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.232+0000 7f825b806740 4 client.15462 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:45:19.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.232+0000 7f825b806740 1 -- 172.21.15.7:0/2292410961 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f82480bc930 con 0x55c84d5e9050 2024-09-19T08:45:19.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.232+0000 7f8252ffd640 1 --2- 172.21.15.7:0/2292410961 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c84d5e9050 0x55c84d5eb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:19.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.232+0000 7f8252ffd640 1 --2- 172.21.15.7:0/2292410961 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c84d5e9050 0x55c84d5eb480 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1b7289ba0b965b92 server_cookie=87273360a0a19192 in_seq=0 out_seq=0 2024-09-19T08:45:19.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.232+0000 7f8236ff5640 10 client.15462 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:45:19.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.233+0000 7f8236ff5640 1 -- 172.21.15.7:0/2292410961 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f82480bc930 con 0x55c84d5e9050 2024-09-19T08:45:19.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.233+0000 7f8236ff5640 10 client.15462 handle_command_reply: tid=0 2024-09-19T08:45:19.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.233+0000 7f825b806740 1 client.15462 shutdown 2024-09-19T08:45:19.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.233+0000 7f825b806740 1 -- 172.21.15.7:0/2292410961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5d5370 msgr2=0x55c84d5d27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:19.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.233+0000 7f825b806740 1 --2- 172.21.15.7:0/2292410961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5d5370 0x55c84d5d27f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f824c00fc50 tx=0x7f824c004ab0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.234+0000 7f825b806740 1 -- 172.21.15.7:0/2292410961 shutdown_connections 2024-09-19T08:45:19.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.234+0000 7f825b806740 1 --2- 172.21.15.7:0/2292410961 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c84d5e9050 0x55c84d5eb480 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.234+0000 7f825b806740 1 --2- 172.21.15.7:0/2292410961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5d5370 0x55c84d5d27f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.234+0000 7f825b806740 1 --2- 172.21.15.7:0/2292410961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5cbb40 0x55c84d5d2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.234+0000 7f8236ff5640 0 client.15462 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:45:19.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.234+0000 7f825b806740 1 --2- 172.21.15.7:0/2292410961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5ca5d0 0x55c84d5d4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.234+0000 7f825b806740 1 -- 172.21.15.7:0/2292410961 >> 172.21.15.7:0/2292410961 conn(0x55c84d593310 msgr2=0x55c84d5cc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:19.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.234+0000 7f825b806740 1 -- 172.21.15.7:0/2292410961 shutdown_connections 2024-09-19T08:45:19.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.234+0000 7f825b806740 1 -- 172.21.15.7:0/2292410961 wait complete. 2024-09-19T08:45:19.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.234+0000 7f825b806740 20 client.15462 trim_cache size 0 max 16384 2024-09-19T08:45:19.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.260+0000 7f825b806740 1 Processor -- start 2024-09-19T08:45:19.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.260+0000 7f825b806740 1 -- start start 2024-09-19T08:45:19.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.260+0000 7f825b806740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5ca5d0 0x55c84d5d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:19.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.260+0000 7f825b806740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5cbb40 0x55c84d5f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:19.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.260+0000 7f825b806740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5d5370 0x55c84d5f1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:19.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.261+0000 7f825b806740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f82541adf40 con 0x55c84d5ca5d0 2024-09-19T08:45:19.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.261+0000 7f825b806740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f82541ab810 con 0x55c84d5d5370 2024-09-19T08:45:19.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.261+0000 7f825b806740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f82541a9660 con 0x55c84d5cbb40 2024-09-19T08:45:19.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.261+0000 7f82537fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5d5370 0x55c84d5f1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:19.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.261+0000 7f82527fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5cbb40 0x55c84d5f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:19.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.261+0000 7f82537fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5d5370 0x55c84d5f1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:34004/0 (socket says 172.21.15.7:34004) 2024-09-19T08:45:19.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.261+0000 7f82537fe640 1 -- 172.21.15.7:0/1123165695 learned_addr learned my addr 172.21.15.7:0/1123165695 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:19.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.261+0000 7f8252ffd640 1 --2- 172.21.15.7:0/1123165695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5ca5d0 0x55c84d5d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:19.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.261+0000 7f82527fc640 1 -- 172.21.15.7:0/1123165695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5d5370 msgr2=0x55c84d5f1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:19.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.261+0000 7f82527fc640 1 --2- 172.21.15.7:0/1123165695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5d5370 0x55c84d5f1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.261+0000 7f82527fc640 1 -- 172.21.15.7:0/1123165695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5ca5d0 msgr2=0x55c84d5d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:19.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.261+0000 7f82527fc640 1 --2- 172.21.15.7:0/1123165695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5ca5d0 0x55c84d5d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.261+0000 7f82527fc640 1 -- 172.21.15.7:0/1123165695 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c84d5d05b0 con 0x55c84d5cbb40 2024-09-19T08:45:19.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.261+0000 7f82527fc640 1 --2- 172.21.15.7:0/1123165695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5cbb40 0x55c84d5f0d50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55c84d5cb070 tx=0x7f824803b5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=636b144f885a3bb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:19.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.262+0000 7f8238ff9640 1 -- 172.21.15.7:0/1123165695 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8248049040 con 0x55c84d5cbb40 2024-09-19T08:45:19.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.262+0000 7f8238ff9640 1 -- 172.21.15.7:0/1123165695 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82480bc930 con 0x55c84d5cbb40 2024-09-19T08:45:19.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.262+0000 7f8238ff9640 1 -- 172.21.15.7:0/1123165695 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82480dc0b0 con 0x55c84d5cbb40 2024-09-19T08:45:19.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.263+0000 7f825b806740 1 -- 172.21.15.7:0/1123165695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5cbb40 msgr2=0x55c84d5f0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:19.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.263+0000 7f825b806740 1 --2- 172.21.15.7:0/1123165695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5cbb40 0x55c84d5f0d50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55c84d5cb070 tx=0x7f824803b5d0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.263+0000 7f825b806740 1 -- 172.21.15.7:0/1123165695 shutdown_connections 2024-09-19T08:45:19.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.263+0000 7f825b806740 1 --2- 172.21.15.7:0/1123165695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5d5370 0x55c84d5f1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.263+0000 7f825b806740 1 --2- 172.21.15.7:0/1123165695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5cbb40 0x55c84d5f0d50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.263+0000 7f825b806740 1 --2- 172.21.15.7:0/1123165695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5ca5d0 0x55c84d5d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.264+0000 7f825b806740 1 -- 172.21.15.7:0/1123165695 >> 172.21.15.7:0/1123165695 conn(0x55c84d593310 msgr2=0x55c84d5d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:19.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.264+0000 7f825b806740 1 -- 172.21.15.7:0/1123165695 shutdown_connections 2024-09-19T08:45:19.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.264+0000 7f825b806740 1 -- 172.21.15.7:0/1123165695 wait complete. 2024-09-19T08:45:19.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.265+0000 7f825b806740 1 -- start start 2024-09-19T08:45:19.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.265+0000 7f825b806740 1 Processor -- start 2024-09-19T08:45:19.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.266+0000 7f825b806740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5ca5d0 0x55c84d5dd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:19.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.266+0000 7f825b806740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5cbb40 0x55c84d5dd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:19.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.266+0000 7f8252ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5ca5d0 0x55c84d5dd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:19.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.266+0000 7f8252ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5ca5d0 0x55c84d5dd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:34018/0 (socket says 172.21.15.7:34018) 2024-09-19T08:45:19.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.266+0000 7f8252ffd640 1 -- 172.21.15.7:0/2347796847 learned_addr learned my addr 172.21.15.7:0/2347796847 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.266+0000 7f82527fc640 1 --2- 172.21.15.7:0/2347796847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5cbb40 0x55c84d5dd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.267+0000 7f825b806740 1 --2- 172.21.15.7:0/2347796847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5d5370 0x55c84d5dde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.267+0000 7f825b806740 1 -- 172.21.15.7:0/2347796847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f82541a9cd0 con 0x55c84d5d5370 2024-09-19T08:45:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.267+0000 7f82537fe640 1 --2- 172.21.15.7:0/2347796847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5d5370 0x55c84d5dde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.267+0000 7f825b806740 1 -- 172.21.15.7:0/2347796847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f82541ab140 con 0x55c84d5ca5d0 2024-09-19T08:45:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.267+0000 7f825b806740 1 -- 172.21.15.7:0/2347796847 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f82541aa3a0 con 0x55c84d5cbb40 2024-09-19T08:45:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.267+0000 7f825b806740 10 client.0 _ll_register_callbacks cb 0x7f824c009d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.267+0000 7f82527fc640 1 -- 172.21.15.7:0/2347796847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5ca5d0 msgr2=0x55c84d5dd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.267+0000 7f82527fc640 1 --2- 172.21.15.7:0/2347796847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5ca5d0 0x55c84d5dd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.267+0000 7f82527fc640 1 -- 172.21.15.7:0/2347796847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5d5370 msgr2=0x55c84d5dde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.267+0000 7f82527fc640 1 --2- 172.21.15.7:0/2347796847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5d5370 0x55c84d5dde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.267+0000 7f82527fc640 1 -- 172.21.15.7:0/2347796847 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c84d652e80 con 0x55c84d5cbb40 2024-09-19T08:45:19.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.267+0000 7f82537fe640 1 --2- 172.21.15.7:0/2347796847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5d5370 0x55c84d5dde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:45:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.267+0000 7f8252ffd640 1 --2- 172.21.15.7:0/2347796847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5ca5d0 0x55c84d5dd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:45:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.268+0000 7f82527fc640 1 --2- 172.21.15.7:0/2347796847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5cbb40 0x55c84d5dd8c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x55c84d5cb070 tx=0x7f82480b8ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2a6736db13220c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.268+0000 7f8236ff5640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-19T08:45:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.268+0000 7f8236ff5640 1 -- 172.21.15.7:0/2347796847 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8248049070 con 0x55c84d5cbb40 2024-09-19T08:45:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.268+0000 7f825b806740 1 -- 172.21.15.7:0/2347796847 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82480bc930 con 0x55c84d5cbb40 2024-09-19T08:45:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.268+0000 7f8236ff5640 1 -- 172.21.15.7:0/2347796847 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f82480bc690 con 0x55c84d5cbb40 2024-09-19T08:45:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.268+0000 7f8236ff5640 1 -- 172.21.15.7:0/2347796847 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f82480bc000 con 0x55c84d5cbb40 2024-09-19T08:45:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.268+0000 7f825b806740 10 client.25096 fetch_fsmap learned FSMap version 25 2024-09-19T08:45:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.268+0000 7f825b806740 1 -- 172.21.15.7:0/2347796847 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c84d654100 con 0x55c84d5cbb40 2024-09-19T08:45:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.269+0000 7f8236ff5640 1 -- 172.21.15.7:0/2347796847 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82480c4ea0 con 0x55c84d5cbb40 2024-09-19T08:45:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.269+0000 7f8236ff5640 1 -- 172.21.15.7:0/2347796847 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f824804c060 con 0x55c84d5cbb40 2024-09-19T08:45:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.270+0000 7f825b806740 10 client.25096 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:45:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.270+0000 7f825b806740 10 client.25096 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:45:19.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.270+0000 7f825b806740 20 client.25096 populate_metadata read hostname 'smithi007' 2024-09-19T08:45:19.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.270+0000 7f825b806740 1 --2- 172.21.15.7:0/2347796847 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c84d654380 0x55c84d656770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:19.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.270+0000 7f825b806740 4 client.25096 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:45:19.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.270+0000 7f825b806740 1 -- 172.21.15.7:0/2347796847 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f82480bc930 con 0x55c84d654380 2024-09-19T08:45:19.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.270+0000 7f8252ffd640 1 --2- 172.21.15.7:0/2347796847 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c84d654380 0x55c84d656770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:19.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.270+0000 7f8236ff5640 10 client.25096 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:45:19.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.270+0000 7f8252ffd640 1 --2- 172.21.15.7:0/2347796847 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c84d654380 0x55c84d656770 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2125f11bff59ab65 server_cookie=895d16d8d79bbc86 in_seq=0 out_seq=0 2024-09-19T08:45:19.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.271+0000 7f8236ff5640 1 -- 172.21.15.7:0/2347796847 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f82480bc930 con 0x55c84d654380 2024-09-19T08:45:19.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.271+0000 7f8236ff5640 10 client.25096 handle_command_reply: tid=0 2024-09-19T08:45:19.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.271+0000 7f825b806740 1 client.25096 shutdown 2024-09-19T08:45:19.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.271+0000 7f825b806740 1 -- 172.21.15.7:0/2347796847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5cbb40 msgr2=0x55c84d5dd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:19.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.271+0000 7f825b806740 1 --2- 172.21.15.7:0/2347796847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5cbb40 0x55c84d5dd8c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x55c84d5cb070 tx=0x7f82480b8ad0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.271+0000 7f825b806740 1 -- 172.21.15.7:0/2347796847 shutdown_connections 2024-09-19T08:45:19.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.271+0000 7f825b806740 1 --2- 172.21.15.7:0/2347796847 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c84d654380 0x55c84d656770 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.271+0000 7f825b806740 1 --2- 172.21.15.7:0/2347796847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c84d5d5370 0x55c84d5dde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.271+0000 7f825b806740 1 --2- 172.21.15.7:0/2347796847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c84d5cbb40 0x55c84d5dd8c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.271+0000 7f825b806740 1 --2- 172.21.15.7:0/2347796847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c84d5ca5d0 0x55c84d5dd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.271+0000 7f825b806740 1 -- 172.21.15.7:0/2347796847 >> 172.21.15.7:0/2347796847 conn(0x55c84d593310 msgr2=0x55c84d5d1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:19.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.271+0000 7f8236ff5640 0 client.25096 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:45:19.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.271+0000 7f825b806740 1 -- 172.21.15.7:0/2347796847 shutdown_connections 2024-09-19T08:45:19.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.271+0000 7f825b806740 1 -- 172.21.15.7:0/2347796847 wait complete. 2024-09-19T08:45:19.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.272+0000 7f825b806740 20 client.25096 trim_cache size 0 max 16384 2024-09-19T08:45:19.391 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:45:19.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.273+0000 7f825942d640 1 -- 172.21.15.7:0/260345092 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f823c0a34d0 msgr2=0x7f823c0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:19.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.273+0000 7f825942d640 1 --2- 172.21.15.7:0/260345092 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f823c0a34d0 0x7f823c0a5990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f824c005fd0 tx=0x7f824c015040 comp rx=0 tx=0).stop 2024-09-19T08:45:19.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.273+0000 7f825942d640 1 -- 172.21.15.7:0/260345092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8254102790 msgr2=0x7f82541989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:19.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.273+0000 7f825942d640 1 --2- 172.21.15.7:0/260345092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8254102790 0x7f82541989d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8248006010 tx=0x7f82480042f0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.273+0000 7f825942d640 1 -- 172.21.15.7:0/260345092 shutdown_connections 2024-09-19T08:45:19.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.273+0000 7f825942d640 1 --2- 172.21.15.7:0/260345092 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f823c0a34d0 0x7f823c0a5990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.273+0000 7f825942d640 1 --2- 172.21.15.7:0/260345092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8254106f10 0x7f825419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.273+0000 7f825942d640 1 --2- 172.21.15.7:0/260345092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8254102790 0x7f82541989d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.273+0000 7f825942d640 1 --2- 172.21.15.7:0/260345092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8254101de0 0x7f8254198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:19.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.273+0000 7f825942d640 1 -- 172.21.15.7:0/260345092 >> 172.21.15.7:0/260345092 conn(0x7f82540fd8c0 msgr2=0x7f82540fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:19.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.273+0000 7f825942d640 1 -- 172.21.15.7:0/260345092 shutdown_connections 2024-09-19T08:45:19.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:19.273+0000 7f825942d640 1 -- 172.21.15.7:0/260345092 wait complete. 2024-09-19T08:45:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:19.968 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:45:20.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.435+0000 7f727b1d4640 1 -- 172.21.15.7:0/2011436671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7274102d50 msgr2=0x7f7274103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:20.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.435+0000 7f727b1d4640 1 --2- 172.21.15.7:0/2011436671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7274102d50 0x7f7274103130 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7268009900 tx=0x7f726802a480 comp rx=0 tx=0).stop 2024-09-19T08:45:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.435+0000 7f727b1d4640 1 -- 172.21.15.7:0/2011436671 shutdown_connections 2024-09-19T08:45:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.435+0000 7f727b1d4640 1 --2- 172.21.15.7:0/2011436671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f727410c180 0x7f727410e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.435+0000 7f727b1d4640 1 --2- 172.21.15.7:0/2011436671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7274103670 0x7f727410bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.435+0000 7f727b1d4640 1 --2- 172.21.15.7:0/2011436671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7274102d50 0x7f7274103130 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.435+0000 7f727b1d4640 1 -- 172.21.15.7:0/2011436671 >> 172.21.15.7:0/2011436671 conn(0x7f72740fc7d0 msgr2=0x7f72740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.435+0000 7f727b1d4640 1 -- 172.21.15.7:0/2011436671 shutdown_connections 2024-09-19T08:45:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.435+0000 7f727b1d4640 1 -- 172.21.15.7:0/2011436671 wait complete. 2024-09-19T08:45:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.436+0000 7f727b1d4640 1 Processor -- start 2024-09-19T08:45:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.436+0000 7f727b1d4640 1 -- start start 2024-09-19T08:45:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.436+0000 7f727b1d4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7274102d50 0x7f72741009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.436+0000 7f727b1d4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7274103670 0x7f7274100ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.436+0000 7f727b1d4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f727410c180 0x7f7274101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.436+0000 7f727b1d4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7274111f80 con 0x7f7274103670 2024-09-19T08:45:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.436+0000 7f727b1d4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7274111e00 con 0x7f7274102d50 2024-09-19T08:45:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.436+0000 7f727b1d4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7274112100 con 0x7f727410c180 2024-09-19T08:45:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.436+0000 7f7273fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7274103670 0x7f7274100ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.436+0000 7f7273fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7274103670 0x7f7274100ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57264/0 (socket says 172.21.15.7:57264) 2024-09-19T08:45:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.436+0000 7f7273fff640 1 -- 172.21.15.7:0/1220444966 learned_addr learned my addr 172.21.15.7:0/1220444966 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.436+0000 7f7278f70640 1 --2- 172.21.15.7:0/1220444966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7274102d50 0x7f72741009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.436+0000 7f7279771640 1 --2- 172.21.15.7:0/1220444966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f727410c180 0x7f7274101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.437+0000 7f7273fff640 1 -- 172.21.15.7:0/1220444966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f727410c180 msgr2=0x7f7274101430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.437+0000 7f7273fff640 1 --2- 172.21.15.7:0/1220444966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f727410c180 0x7f7274101430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.437+0000 7f7273fff640 1 -- 172.21.15.7:0/1220444966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7274102d50 msgr2=0x7f72741009b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.437+0000 7f7273fff640 1 --2- 172.21.15.7:0/1220444966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7274102d50 0x7f72741009b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.437+0000 7f7273fff640 1 -- 172.21.15.7:0/1220444966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72741a6860 con 0x7f7274103670 2024-09-19T08:45:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.437+0000 7f7278f70640 1 --2- 172.21.15.7:0/1220444966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7274102d50 0x7f72741009b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:45:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.437+0000 7f7273fff640 1 --2- 172.21.15.7:0/1220444966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7274103670 0x7f7274100ef0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f726000c970 tx=0x7f726000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.437+0000 7f7271ffb640 1 -- 172.21.15.7:0/1220444966 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260007bb0 con 0x7f7274103670 2024-09-19T08:45:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.437+0000 7f7271ffb640 1 -- 172.21.15.7:0/1220444966 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7260007d50 con 0x7f7274103670 2024-09-19T08:45:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.437+0000 7f727b1d4640 1 -- 172.21.15.7:0/1220444966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72741a6b50 con 0x7f7274103670 2024-09-19T08:45:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.437+0000 7f7271ffb640 1 -- 172.21.15.7:0/1220444966 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260018820 con 0x7f7274103670 2024-09-19T08:45:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.438+0000 7f727b1d4640 1 -- 172.21.15.7:0/1220444966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72741a7090 con 0x7f7274103670 2024-09-19T08:45:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.440+0000 7f7271ffb640 1 -- 172.21.15.7:0/1220444966 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 138587+0+0 (secure 0 0 0) 0x7f72600189c0 con 0x7f7274103670 2024-09-19T08:45:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.440+0000 7f727d5ad740 1 Processor -- start 2024-09-19T08:45:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.440+0000 7f727d5ad740 1 -- start start 2024-09-19T08:45:20.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.441+0000 7f727d5ad740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d69cd8760 0x561d69cd8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.441+0000 7f727d5ad740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69ce3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.441+0000 7f727d5ad740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d69ce3940 0x561d69ce5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.441+0000 7f727d5ad740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561d69c3e2a0 con 0x561d69cd9080 2024-09-19T08:45:20.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.441+0000 7f727d5ad740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561d69be5b10 con 0x561d69ce3940 2024-09-19T08:45:20.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.441+0000 7f727d5ad740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561d69c3a260 con 0x561d69cd8760 2024-09-19T08:45:20.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.441+0000 7f7278f70640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69ce3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.441+0000 7f7278f70640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69ce3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57272/0 (socket says 172.21.15.7:57272) 2024-09-19T08:45:20.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.441+0000 7f7278f70640 1 -- 172.21.15.7:0/1453167893 learned_addr learned my addr 172.21.15.7:0/1453167893 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:20.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.441+0000 7f7273fff640 1 --2- 172.21.15.7:0/1453167893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d69ce3940 0x561d69ce5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.441+0000 7f7279771640 1 --2- 172.21.15.7:0/1453167893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d69cd8760 0x561d69cd8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.441+0000 7f7271ffb640 1 --2- 172.21.15.7:0/1220444966 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f72640a34d0 0x7f72640a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.441+0000 7f7278f70640 1 -- 172.21.15.7:0/1453167893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d69cd8760 msgr2=0x561d69cd8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:20.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.441+0000 7f7278f70640 1 --2- 172.21.15.7:0/1453167893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d69cd8760 0x561d69cd8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.441+0000 7f7278f70640 1 -- 172.21.15.7:0/1453167893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d69ce3940 msgr2=0x561d69ce5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:20.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.441+0000 7f7278f70640 1 --2- 172.21.15.7:0/1453167893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d69ce3940 0x561d69ce5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.441+0000 7f7278f70640 1 -- 172.21.15.7:0/1453167893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d699afb90 con 0x561d69cd9080 2024-09-19T08:45:20.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.441+0000 7f7279771640 1 --2- 172.21.15.7:0/1453167893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d69cd8760 0x561d69cd8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:20.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.441+0000 7f7271ffb640 1 -- 172.21.15.7:0/1220444966 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f72600cffc0 con 0x7f7274103670 2024-09-19T08:45:20.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.442+0000 7f7279771640 1 --2- 172.21.15.7:0/1220444966 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f72640a34d0 0x7f72640a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.442+0000 7f7278f70640 1 --2- 172.21.15.7:0/1453167893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69ce3400 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f726802a9a0 tx=0x7f72680315b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31bf3939bb8fef18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:20.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.442+0000 7f725effd640 1 -- 172.21.15.7:0/1453167893 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7268035040 con 0x561d69cd9080 2024-09-19T08:45:20.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.442+0000 7f725effd640 1 -- 172.21.15.7:0/1453167893 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7268005020 con 0x561d69cd9080 2024-09-19T08:45:20.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.442+0000 7f725effd640 1 -- 172.21.15.7:0/1453167893 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7268004a90 con 0x561d69cd9080 2024-09-19T08:45:20.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.443+0000 7f727d5ad740 1 -- 172.21.15.7:0/1453167893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 msgr2=0x561d69ce3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:20.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.443+0000 7f727d5ad740 1 --2- 172.21.15.7:0/1453167893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69ce3400 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f726802a9a0 tx=0x7f72680315b0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.443+0000 7f7279771640 1 --2- 172.21.15.7:0/1220444966 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f72640a34d0 0x7f72640a5990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f726c005fd0 tx=0x7f726c014040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:20.446 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:20 smithi007 ceph-mon[31221]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-19T08:45:20.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.443+0000 7f727d5ad740 1 -- 172.21.15.7:0/1453167893 shutdown_connections 2024-09-19T08:45:20.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.443+0000 7f727d5ad740 1 --2- 172.21.15.7:0/1453167893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d69ce3940 0x561d69ce5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.443+0000 7f727d5ad740 1 --2- 172.21.15.7:0/1453167893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69ce3400 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.443+0000 7f727d5ad740 1 --2- 172.21.15.7:0/1453167893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d69cd8760 0x561d69cd8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.443+0000 7f727d5ad740 1 -- 172.21.15.7:0/1453167893 >> 172.21.15.7:0/1453167893 conn(0x561d69cd4cf0 msgr2=0x561d69cd50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:20.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.443+0000 7f727d5ad740 1 -- 172.21.15.7:0/1453167893 shutdown_connections 2024-09-19T08:45:20.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.443+0000 7f727d5ad740 1 -- 172.21.15.7:0/1453167893 wait complete. 2024-09-19T08:45:20.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.444+0000 7f727d5ad740 1 -- start start 2024-09-19T08:45:20.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.444+0000 7f727d5ad740 1 Processor -- start 2024-09-19T08:45:20.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.444+0000 7f727d5ad740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d69cd8760 0x561d69ce07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.444+0000 7f727d5ad740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69ce0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.444+0000 7f727d5ad740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d69ce3940 0x561d69ce1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.444+0000 7f727d5ad740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561d69ce6510 con 0x561d69cd9080 2024-09-19T08:45:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.444+0000 7f727d5ad740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561d69bc66e0 con 0x561d69cd8760 2024-09-19T08:45:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.444+0000 7f727d5ad740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561d69ce6690 con 0x561d69ce3940 2024-09-19T08:45:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.445+0000 7f727d5ad740 10 client.0 _ll_register_callbacks cb 0x561d69beaa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.445+0000 7f7279771640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d69ce3940 0x561d69ce1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.445+0000 7f7273fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69ce0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.445+0000 7f7278f70640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d69cd8760 0x561d69ce07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.445+0000 7f7279771640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d69ce3940 0x561d69ce1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.7:36458/0 (socket says 172.21.15.7:36458) 2024-09-19T08:45:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.445+0000 7f7273fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69ce0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57286/0 (socket says 172.21.15.7:57286) 2024-09-19T08:45:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.445+0000 7f7279771640 1 -- 172.21.15.7:0/3564098598 learned_addr learned my addr 172.21.15.7:0/3564098598 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.445+0000 7f7278f70640 1 -- 172.21.15.7:0/3564098598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d69ce3940 msgr2=0x561d69ce1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.445+0000 7f7278f70640 1 --2- 172.21.15.7:0/3564098598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d69ce3940 0x561d69ce1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.445+0000 7f7278f70640 1 -- 172.21.15.7:0/3564098598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 msgr2=0x561d69ce0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.445+0000 7f7278f70640 1 --2- 172.21.15.7:0/3564098598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69ce0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.445+0000 7f7278f70640 1 -- 172.21.15.7:0/3564098598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d69cef980 con 0x561d69cd8760 2024-09-19T08:45:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.446+0000 7f7278f70640 1 --2- 172.21.15.7:0/3564098598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d69cd8760 0x561d69ce07b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x561d69cd5b50 tx=0x7f7268031a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a4a59f8e58a32a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.446+0000 7f7253fff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-19T08:45:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.446+0000 7f7253fff640 1 -- 172.21.15.7:0/3564098598 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7268035070 con 0x561d69cd8760 2024-09-19T08:45:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.446+0000 7f7253fff640 1 -- 172.21.15.7:0/3564098598 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f72680053e0 con 0x561d69cd8760 2024-09-19T08:45:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.446+0000 7f727d5ad740 1 -- 172.21.15.7:0/3564098598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7268005020 con 0x561d69cd8760 2024-09-19T08:45:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.446+0000 7f7253fff640 1 -- 172.21.15.7:0/3564098598 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f72680055e0 con 0x561d69cd8760 2024-09-19T08:45:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.446+0000 7f727d5ad740 10 client.25235 fetch_fsmap learned FSMap version 25 2024-09-19T08:45:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.446+0000 7f727d5ad740 1 -- 172.21.15.7:0/3564098598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561d69cfab20 con 0x561d69cd8760 2024-09-19T08:45:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.446+0000 7f7253fff640 1 -- 172.21.15.7:0/3564098598 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7268005020 con 0x561d69cd8760 2024-09-19T08:45:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.447+0000 7f7253fff640 1 -- 172.21.15.7:0/3564098598 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7268046980 con 0x561d69cd8760 2024-09-19T08:45:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.447+0000 7f727d5ad740 10 client.25235 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:45:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.447+0000 7f727d5ad740 10 client.25235 resolve_mds: validated gid 24491 aka daemon mds.b 2024-09-19T08:45:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.447+0000 7f727d5ad740 20 client.25235 populate_metadata read hostname 'smithi007' 2024-09-19T08:45:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.447+0000 7f727d5ad740 1 --2- 172.21.15.7:0/3564098598 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561d69cfbe70 0x561d69cfe260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.447+0000 7f727d5ad740 4 client.25235 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:45:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.447+0000 7f727d5ad740 1 -- 172.21.15.7:0/3564098598 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d69c4b9d0 con 0x561d69cfbe70 2024-09-19T08:45:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.447+0000 7f7273fff640 1 --2- 172.21.15.7:0/3564098598 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561d69cfbe70 0x561d69cfe260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.448+0000 7f7273fff640 1 --2- 172.21.15.7:0/3564098598 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561d69cfbe70 0x561d69cfe260 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1104ee5671637b9d server_cookie=24e286661441b49e in_seq=0 out_seq=0 2024-09-19T08:45:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.448+0000 7f7253fff640 10 client.25235 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.448+0000 7f7253fff640 1 -- 172.21.15.7:0/3564098598 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561d69c4b9d0 con 0x561d69cfbe70 2024-09-19T08:45:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.448+0000 7f7253fff640 10 client.25235 handle_command_reply: tid=0 2024-09-19T08:45:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.448+0000 7f727d5ad740 1 client.25235 shutdown 2024-09-19T08:45:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.449+0000 7f727d5ad740 1 -- 172.21.15.7:0/3564098598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d69cd8760 msgr2=0x561d69ce07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.449+0000 7f727d5ad740 1 --2- 172.21.15.7:0/3564098598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d69cd8760 0x561d69ce07b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x561d69cd5b50 tx=0x7f7268031a90 comp rx=0 tx=0).stop 2024-09-19T08:45:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.449+0000 7f727d5ad740 1 -- 172.21.15.7:0/3564098598 shutdown_connections 2024-09-19T08:45:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.449+0000 7f727d5ad740 1 --2- 172.21.15.7:0/3564098598 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561d69cfbe70 0x561d69cfe260 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.449+0000 7f7253fff640 0 client.25235 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.449+0000 7f727d5ad740 1 --2- 172.21.15.7:0/3564098598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d69ce3940 0x561d69ce1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.449+0000 7f727d5ad740 1 --2- 172.21.15.7:0/3564098598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69ce0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.449+0000 7f727d5ad740 1 --2- 172.21.15.7:0/3564098598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d69cd8760 0x561d69ce07b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.449+0000 7f727d5ad740 1 -- 172.21.15.7:0/3564098598 >> 172.21.15.7:0/3564098598 conn(0x561d69cd4cf0 msgr2=0x561d69cd3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.449+0000 7f727d5ad740 1 -- 172.21.15.7:0/3564098598 shutdown_connections 2024-09-19T08:45:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.449+0000 7f727d5ad740 1 -- 172.21.15.7:0/3564098598 wait complete. 2024-09-19T08:45:20.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.449+0000 7f727d5ad740 20 client.25235 trim_cache size 0 max 16384 2024-09-19T08:45:20.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.474+0000 7f727d5ad740 1 Processor -- start 2024-09-19T08:45:20.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.474+0000 7f727d5ad740 1 -- start start 2024-09-19T08:45:20.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.475+0000 7f727d5ad740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d69cd8760 0x561d69cdb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.475+0000 7f727d5ad740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69cdf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.475+0000 7f727d5ad740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d69ce3940 0x561d69cdda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.475+0000 7f727d5ad740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f72741adf20 con 0x561d69cd9080 2024-09-19T08:45:20.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.475+0000 7f727d5ad740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f72741ab7f0 con 0x561d69ce3940 2024-09-19T08:45:20.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.475+0000 7f727d5ad740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f72741a9640 con 0x561d69cd8760 2024-09-19T08:45:20.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.475+0000 7f7273fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69cdf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.475+0000 7f7273fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69cdf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57290/0 (socket says 172.21.15.7:57290) 2024-09-19T08:45:20.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.475+0000 7f7273fff640 1 -- 172.21.15.7:0/354329790 learned_addr learned my addr 172.21.15.7:0/354329790 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:20.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.475+0000 7f7278f70640 1 --2- 172.21.15.7:0/354329790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d69cd8760 0x561d69cdb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.475+0000 7f7279771640 1 --2- 172.21.15.7:0/354329790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d69ce3940 0x561d69cdda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.475+0000 7f7273fff640 1 -- 172.21.15.7:0/354329790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d69cd8760 msgr2=0x561d69cdb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:20.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.475+0000 7f7273fff640 1 --2- 172.21.15.7:0/354329790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d69cd8760 0x561d69cdb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.475+0000 7f7273fff640 1 -- 172.21.15.7:0/354329790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d69ce3940 msgr2=0x561d69cdda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:20.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.475+0000 7f7273fff640 1 --2- 172.21.15.7:0/354329790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d69ce3940 0x561d69cdda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.475+0000 7f7273fff640 1 -- 172.21.15.7:0/354329790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d69cd4b20 con 0x561d69cd9080 2024-09-19T08:45:20.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.476+0000 7f7273fff640 1 --2- 172.21.15.7:0/354329790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69cdf660 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f72600cd5e0 tx=0x7f72600d24d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc944766236989e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:20.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.476+0000 7f725e7fc640 1 -- 172.21.15.7:0/354329790 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260018cb0 con 0x561d69cd9080 2024-09-19T08:45:20.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.476+0000 7f725e7fc640 1 -- 172.21.15.7:0/354329790 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72600cde50 con 0x561d69cd9080 2024-09-19T08:45:20.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.476+0000 7f725e7fc640 1 -- 172.21.15.7:0/354329790 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726009a340 con 0x561d69cd9080 2024-09-19T08:45:20.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.477+0000 7f727d5ad740 1 -- 172.21.15.7:0/354329790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 msgr2=0x561d69cdf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:20.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.477+0000 7f727d5ad740 1 --2- 172.21.15.7:0/354329790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69cdf660 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f72600cd5e0 tx=0x7f72600d24d0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.477+0000 7f727d5ad740 1 -- 172.21.15.7:0/354329790 shutdown_connections 2024-09-19T08:45:20.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.477+0000 7f727d5ad740 1 --2- 172.21.15.7:0/354329790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d69ce3940 0x561d69cdda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.477+0000 7f727d5ad740 1 --2- 172.21.15.7:0/354329790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69cdf660 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.477+0000 7f727d5ad740 1 --2- 172.21.15.7:0/354329790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d69cd8760 0x561d69cdb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.477+0000 7f727d5ad740 1 -- 172.21.15.7:0/354329790 >> 172.21.15.7:0/354329790 conn(0x561d69cd4cf0 msgr2=0x561d69cdef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:20.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.477+0000 7f727d5ad740 1 -- 172.21.15.7:0/354329790 shutdown_connections 2024-09-19T08:45:20.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.477+0000 7f727d5ad740 1 -- 172.21.15.7:0/354329790 wait complete. 2024-09-19T08:45:20.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.477+0000 7f727d5ad740 1 -- start start 2024-09-19T08:45:20.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.478+0000 7f727d5ad740 1 Processor -- start 2024-09-19T08:45:20.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.478+0000 7f727d5ad740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d69cd8760 0x561d69cff960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.478+0000 7f727d5ad740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69cffea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.478+0000 7f727d5ad740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d69ce3940 0x561d69d5f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.478+0000 7f727d5ad740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f72741a9cb0 con 0x561d69cd9080 2024-09-19T08:45:20.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.478+0000 7f727d5ad740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f72741ab120 con 0x561d69ce3940 2024-09-19T08:45:20.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.478+0000 7f727d5ad740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f72741aa380 con 0x561d69cd8760 2024-09-19T08:45:20.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.478+0000 7f727d5ad740 10 client.0 _ll_register_callbacks cb 0x7f7268005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:20.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.478+0000 7f7273fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69cffea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.478+0000 7f7273fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69cffea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57294/0 (socket says 172.21.15.7:57294) 2024-09-19T08:45:20.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.478+0000 7f7273fff640 1 -- 172.21.15.7:0/1294109151 learned_addr learned my addr 172.21.15.7:0/1294109151 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:20.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.478+0000 7f7278f70640 1 --2- 172.21.15.7:0/1294109151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d69cd8760 0x561d69cff960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.478+0000 7f7279771640 1 --2- 172.21.15.7:0/1294109151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d69ce3940 0x561d69d5f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.479+0000 7f7273fff640 1 -- 172.21.15.7:0/1294109151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d69cd8760 msgr2=0x561d69cff960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:20.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.479+0000 7f7273fff640 1 --2- 172.21.15.7:0/1294109151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d69cd8760 0x561d69cff960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.479+0000 7f7273fff640 1 -- 172.21.15.7:0/1294109151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d69ce3940 msgr2=0x561d69d5f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:20.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.479+0000 7f7273fff640 1 --2- 172.21.15.7:0/1294109151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d69ce3940 0x561d69d5f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.479+0000 7f7273fff640 1 -- 172.21.15.7:0/1294109151 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d69d5fe30 con 0x561d69cd9080 2024-09-19T08:45:20.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.479+0000 7f7273fff640 1 --2- 172.21.15.7:0/1294109151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69cffea0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7260007590 tx=0x7f72600d3840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77a968cc47d7bbf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:20.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.479+0000 7f7253fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:45:20.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.479+0000 7f7253fff640 1 -- 172.21.15.7:0/1294109151 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72600b4020 con 0x561d69cd9080 2024-09-19T08:45:20.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.479+0000 7f727d5ad740 1 -- 172.21.15.7:0/1294109151 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72600cde50 con 0x561d69cd9080 2024-09-19T08:45:20.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.479+0000 7f7253fff640 1 -- 172.21.15.7:0/1294109151 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f72600a00d0 con 0x561d69cd9080 2024-09-19T08:45:20.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.479+0000 7f7253fff640 1 -- 172.21.15.7:0/1294109151 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f726007e030 con 0x561d69cd9080 2024-09-19T08:45:20.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.479+0000 7f727d5ad740 10 client.15486 fetch_fsmap learned FSMap version 25 2024-09-19T08:45:20.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.479+0000 7f727d5ad740 1 -- 172.21.15.7:0/1294109151 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561d69d671c0 con 0x561d69cd9080 2024-09-19T08:45:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.480+0000 7f7253fff640 1 -- 172.21.15.7:0/1294109151 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72600cde50 con 0x561d69cd9080 2024-09-19T08:45:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.480+0000 7f7253fff640 1 -- 172.21.15.7:0/1294109151 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f72600986b0 con 0x561d69cd9080 2024-09-19T08:45:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.480+0000 7f727d5ad740 10 client.15486 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:45:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.480+0000 7f727d5ad740 10 client.15486 resolve_mds: validated gid 24491 aka daemon mds.b 2024-09-19T08:45:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.480+0000 7f727d5ad740 20 client.15486 populate_metadata read hostname 'smithi007' 2024-09-19T08:45:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.480+0000 7f727d5ad740 1 --2- 172.21.15.7:0/1294109151 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561d69d678a0 0x561d69d69cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.480+0000 7f727d5ad740 4 client.15486 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}] 2024-09-19T08:45:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.480+0000 7f727d5ad740 1 -- 172.21.15.7:0/1294109151 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}) -- 0x561d69c45d20 con 0x561d69d678a0 2024-09-19T08:45:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.480+0000 7f7278f70640 1 --2- 172.21.15.7:0/1294109151 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561d69d678a0 0x561d69d69cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.481+0000 7f7253fff640 10 client.15486 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:20.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.481+0000 7f7278f70640 1 --2- 172.21.15.7:0/1294109151 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561d69d678a0 0x561d69d69cc0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf95ce5129e47bd5 server_cookie=85d0f3c31b25942c in_seq=0 out_seq=0 2024-09-19T08:45:20.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.493+0000 7f7253fff640 1 -- 172.21.15.7:0/1294109151 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x561d69c45d20 con 0x561d69d678a0 2024-09-19T08:45:20.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.493+0000 7f7253fff640 10 client.15486 handle_command_reply: tid=0 2024-09-19T08:45:20.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.493+0000 7f727d5ad740 1 client.15486 shutdown 2024-09-19T08:45:20.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.493+0000 7f727d5ad740 1 -- 172.21.15.7:0/1294109151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 msgr2=0x561d69cffea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:20.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.493+0000 7f727d5ad740 1 --2- 172.21.15.7:0/1294109151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69cffea0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7260007590 tx=0x7f72600d3840 comp rx=0 tx=0).stop 2024-09-19T08:45:20.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.493+0000 7f727d5ad740 1 -- 172.21.15.7:0/1294109151 shutdown_connections 2024-09-19T08:45:20.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.493+0000 7f727d5ad740 1 --2- 172.21.15.7:0/1294109151 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561d69d678a0 0x561d69d69cc0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.493+0000 7f727d5ad740 1 --2- 172.21.15.7:0/1294109151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d69ce3940 0x561d69d5f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.493+0000 7f7253fff640 0 client.15486 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:20.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.493+0000 7f727d5ad740 1 --2- 172.21.15.7:0/1294109151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561d69cd9080 0x561d69cffea0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.493+0000 7f727d5ad740 1 --2- 172.21.15.7:0/1294109151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d69cd8760 0x561d69cff960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.493+0000 7f727d5ad740 1 -- 172.21.15.7:0/1294109151 >> 172.21.15.7:0/1294109151 conn(0x561d69cd4cf0 msgr2=0x561d69cdf770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:20.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.493+0000 7f727d5ad740 1 -- 172.21.15.7:0/1294109151 shutdown_connections 2024-09-19T08:45:20.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.493+0000 7f727d5ad740 1 -- 172.21.15.7:0/1294109151 wait complete. 2024-09-19T08:45:20.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.494+0000 7f727d5ad740 20 client.15486 trim_cache size 0 max 16384 2024-09-19T08:45:20.496 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:45:20.496 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 25, 2024-09-19T08:45:20.496 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24491, 2024-09-19T08:45:20.496 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 2, 2024-09-19T08:45:20.496 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": { 2024-09-19T08:45:20.496 INFO:teuthology.orchestra.run.smithi007.stdout: "20b786cd": { 2024-09-19T08:45:20.497 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 2, 2024-09-19T08:45:20.497 INFO:teuthology.orchestra.run.smithi007.stdout: "age_ref": 0.0, 2024-09-19T08:45:20.497 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T08:45:20.497 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "QUIESCED", 2024-09-19T08:45:20.497 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T08:45:20.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:45:20.497 INFO:teuthology.orchestra.run.smithi007.stdout: "timeout": 90.0, 2024-09-19T08:45:20.497 INFO:teuthology.orchestra.run.smithi007.stdout: "expiration": 131.2, 2024-09-19T08:45:20.497 INFO:teuthology.orchestra.run.smithi007.stdout: "members": { 2024-09-19T08:45:20.497 INFO:teuthology.orchestra.run.smithi007.stdout: "file:/": { 2024-09-19T08:45:20.497 INFO:teuthology.orchestra.run.smithi007.stdout: "excluded": false, 2024-09-19T08:45:20.497 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T08:45:20.497 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "QUIESCED", 2024-09-19T08:45:20.498 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T08:45:20.498 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:45:20.498 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:45:20.498 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:45:20.498 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:45:20.498 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:45:20.498 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:45:20.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.495+0000 7f727b1d4640 1 -- 172.21.15.7:0/1220444966 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f72640a34d0 msgr2=0x7f72640a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:20.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.495+0000 7f727b1d4640 1 --2- 172.21.15.7:0/1220444966 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f72640a34d0 0x7f72640a5990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f726c005fd0 tx=0x7f726c014040 comp rx=0 tx=0).stop 2024-09-19T08:45:20.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.495+0000 7f727b1d4640 1 -- 172.21.15.7:0/1220444966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7274103670 msgr2=0x7f7274100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:20.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.495+0000 7f727b1d4640 1 --2- 172.21.15.7:0/1220444966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7274103670 0x7f7274100ef0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f726000c970 tx=0x7f726000ce30 comp rx=0 tx=0).stop 2024-09-19T08:45:20.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.495+0000 7f727b1d4640 1 -- 172.21.15.7:0/1220444966 shutdown_connections 2024-09-19T08:45:20.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.495+0000 7f727b1d4640 1 --2- 172.21.15.7:0/1220444966 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f72640a34d0 0x7f72640a5990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.495+0000 7f727b1d4640 1 --2- 172.21.15.7:0/1220444966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f727410c180 0x7f7274101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.495+0000 7f727b1d4640 1 --2- 172.21.15.7:0/1220444966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7274103670 0x7f7274100ef0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.495+0000 7f727b1d4640 1 --2- 172.21.15.7:0/1220444966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7274102d50 0x7f72741009b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:20.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.495+0000 7f727b1d4640 1 -- 172.21.15.7:0/1220444966 >> 172.21.15.7:0/1220444966 conn(0x7f72740fc7d0 msgr2=0x7f72740fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:20.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.495+0000 7f727b1d4640 1 -- 172.21.15.7:0/1220444966 shutdown_connections 2024-09-19T08:45:20.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:20.495+0000 7f727b1d4640 1 -- 172.21.15.7:0/1220444966 wait complete. 2024-09-19T08:45:20.506 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:20.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:20 smithi044 ceph-mon[35072]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-19T08:45:20.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:20 smithi175 ceph-mon[35688]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-19T08:45:21.299 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '20b786cd', quiesce took 5.4 seconds. Will release after: 5.799999999999999 2024-09-19T08:45:22.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:22 smithi007 ceph-mon[31221]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:45:22.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:22 smithi044 ceph-mon[35072]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:45:22.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.825+0000 7fd745213640 1 -- 172.21.15.7:0/1066903432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd740102ef0 msgr2=0x7fd74010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:22.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.825+0000 7fd745213640 1 --2- 172.21.15.7:0/1066903432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd740102ef0 0x7fd74010da40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd738009ca0 tx=0x7fd73802a950 comp rx=0 tx=0).stop 2024-09-19T08:45:22.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.826+0000 7fd745213640 1 -- 172.21.15.7:0/1066903432 shutdown_connections 2024-09-19T08:45:22.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.826+0000 7fd745213640 1 --2- 172.21.15.7:0/1066903432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd740102ef0 0x7fd74010da40 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.826+0000 7fd745213640 1 --2- 172.21.15.7:0/1066903432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd740102570 0x7fd7401029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.826+0000 7fd745213640 1 --2- 172.21.15.7:0/1066903432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd740100e20 0x7fd740101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.826+0000 7fd745213640 1 -- 172.21.15.7:0/1066903432 >> 172.21.15.7:0/1066903432 conn(0x7fd7400fc7d0 msgr2=0x7fd7400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.826+0000 7fd745213640 1 -- 172.21.15.7:0/1066903432 shutdown_connections 2024-09-19T08:45:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.826+0000 7fd745213640 1 -- 172.21.15.7:0/1066903432 wait complete. 2024-09-19T08:45:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.826+0000 7fd745213640 1 Processor -- start 2024-09-19T08:45:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.827+0000 7fd745213640 1 -- start start 2024-09-19T08:45:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.827+0000 7fd745213640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd740100e20 0x7fd7400fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.827+0000 7fd745213640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd740102570 0x7fd7400fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.827+0000 7fd745213640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd740102ef0 0x7fd7400fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.827+0000 7fd745213640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd740110f80 con 0x7fd740100e20 2024-09-19T08:45:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.827+0000 7fd745213640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd740110e00 con 0x7fd740102570 2024-09-19T08:45:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.827+0000 7fd745213640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd740111100 con 0x7fd740102ef0 2024-09-19T08:45:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.827+0000 7fd73ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd740100e20 0x7fd7400fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.827+0000 7fd73ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd740100e20 0x7fd7400fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57306/0 (socket says 172.21.15.7:57306) 2024-09-19T08:45:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.827+0000 7fd73ed9d640 1 -- 172.21.15.7:0/473586203 learned_addr learned my addr 172.21.15.7:0/473586203 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:22.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.827+0000 7fd73e59c640 1 --2- 172.21.15.7:0/473586203 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd740102570 0x7fd7400fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.827+0000 7fd73f59e640 1 --2- 172.21.15.7:0/473586203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd740102ef0 0x7fd7400fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.827+0000 7fd73ed9d640 1 -- 172.21.15.7:0/473586203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd740102ef0 msgr2=0x7fd7400fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.827+0000 7fd73ed9d640 1 --2- 172.21.15.7:0/473586203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd740102ef0 0x7fd7400fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.827+0000 7fd73ed9d640 1 -- 172.21.15.7:0/473586203 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd740102570 msgr2=0x7fd7400fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.827+0000 7fd73ed9d640 1 --2- 172.21.15.7:0/473586203 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd740102570 0x7fd7400fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.827+0000 7fd73ed9d640 1 -- 172.21.15.7:0/473586203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7401a6890 con 0x7fd740100e20 2024-09-19T08:45:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.827+0000 7fd73e59c640 1 --2- 172.21.15.7:0/473586203 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd740102570 0x7fd7400fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.828+0000 7fd73ed9d640 1 --2- 172.21.15.7:0/473586203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd740100e20 0x7fd7400fcc80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd73000c920 tx=0x7fd73000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.828+0000 7fd727fff640 1 -- 172.21.15.7:0/473586203 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd730007c70 con 0x7fd740100e20 2024-09-19T08:45:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.828+0000 7fd727fff640 1 -- 172.21.15.7:0/473586203 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd730007e10 con 0x7fd740100e20 2024-09-19T08:45:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.828+0000 7fd727fff640 1 -- 172.21.15.7:0/473586203 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd730018890 con 0x7fd740100e20 2024-09-19T08:45:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.828+0000 7fd745213640 1 -- 172.21.15.7:0/473586203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7401a6b80 con 0x7fd740100e20 2024-09-19T08:45:22.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.828+0000 7fd745213640 1 -- 172.21.15.7:0/473586203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7401a7070 con 0x7fd740100e20 2024-09-19T08:45:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.830+0000 7fd727fff640 1 -- 172.21.15.7:0/473586203 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 138587+0+0 (secure 0 0 0) 0x7fd730018a50 con 0x7fd740100e20 2024-09-19T08:45:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.831+0000 7fd7475ec740 1 Processor -- start 2024-09-19T08:45:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.831+0000 7fd7475ec740 1 -- start start 2024-09-19T08:45:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.831+0000 7fd7475ec740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800c5b40 0x55f6800c4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.831+0000 7fd7475ec740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f6800c45d0 0x55f6800c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.831+0000 7fd7475ec740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6800cf370 0x55f6800d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.831+0000 7fd7475ec740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f68002a2f0 con 0x55f6800c5b40 2024-09-19T08:45:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.831+0000 7fd7475ec740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f67ffd1cf0 con 0x55f6800c45d0 2024-09-19T08:45:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.831+0000 7fd7475ec740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f6800262b0 con 0x55f6800cf370 2024-09-19T08:45:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.831+0000 7fd727fff640 1 --2- 172.21.15.7:0/473586203 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd7280a3550 0x7fd7280a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:22.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.831+0000 7fd73f59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800c5b40 0x55f6800c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:22.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.831+0000 7fd73f59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800c5b40 0x55f6800c4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57312/0 (socket says 172.21.15.7:57312) 2024-09-19T08:45:22.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.831+0000 7fd73f59e640 1 -- 172.21.15.7:0/670533302 learned_addr learned my addr 172.21.15.7:0/670533302 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:22.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.832+0000 7fd73ed9d640 1 --2- 172.21.15.7:0/670533302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f6800c45d0 0x55f6800c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:22.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.832+0000 7fd73e59c640 1 --2- 172.21.15.7:0/670533302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6800cf370 0x55f6800d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:22.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.832+0000 7fd727fff640 1 -- 172.21.15.7:0/473586203 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fd7300d0140 con 0x7fd740100e20 2024-09-19T08:45:22.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.832+0000 7fd73f59e640 1 -- 172.21.15.7:0/670533302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6800cf370 msgr2=0x55f6800d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:22.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.832+0000 7fd73f59e640 1 --2- 172.21.15.7:0/670533302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6800cf370 0x55f6800d1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.832+0000 7fd73f59e640 1 -- 172.21.15.7:0/670533302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f6800c45d0 msgr2=0x55f6800c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:22.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.832+0000 7fd73f59e640 1 --2- 172.21.15.7:0/670533302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f6800c45d0 0x55f6800c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.832+0000 7fd73f59e640 1 -- 172.21.15.7:0/670533302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f67ffb63a0 con 0x55f6800c5b40 2024-09-19T08:45:22.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.832+0000 7fd73f59e640 1 --2- 172.21.15.7:0/473586203 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd7280a3550 0x7fd7280a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:22.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.832+0000 7fd73f59e640 1 --2- 172.21.15.7:0/670533302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800c5b40 0x55f6800c4090 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd73802fa90 tx=0x7fd738009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38fd76ca2d1102b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:22.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.832+0000 7fd7257fa640 1 -- 172.21.15.7:0/670533302 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd738034040 con 0x55f6800c5b40 2024-09-19T08:45:22.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.833+0000 7fd7257fa640 1 -- 172.21.15.7:0/670533302 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd738004520 con 0x55f6800c5b40 2024-09-19T08:45:22.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.833+0000 7fd7257fa640 1 -- 172.21.15.7:0/670533302 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd738039970 con 0x55f6800c5b40 2024-09-19T08:45:22.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.833+0000 7fd7475ec740 1 -- 172.21.15.7:0/670533302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800c5b40 msgr2=0x55f6800c4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:22.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.833+0000 7fd7475ec740 1 --2- 172.21.15.7:0/670533302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800c5b40 0x55f6800c4090 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd73802fa90 tx=0x7fd738009a20 comp rx=0 tx=0).stop 2024-09-19T08:45:22.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.833+0000 7fd73f59e640 1 --2- 172.21.15.7:0/473586203 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd7280a3550 0x7fd7280a5a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd73804c000 tx=0x7fd738049000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:22.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.833+0000 7fd7475ec740 1 -- 172.21.15.7:0/670533302 shutdown_connections 2024-09-19T08:45:22.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.833+0000 7fd7475ec740 1 --2- 172.21.15.7:0/670533302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6800cf370 0x55f6800d1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.833+0000 7fd7475ec740 1 --2- 172.21.15.7:0/670533302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f6800c45d0 0x55f6800c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.833+0000 7fd7475ec740 1 --2- 172.21.15.7:0/670533302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800c5b40 0x55f6800c4090 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.833+0000 7fd7475ec740 1 -- 172.21.15.7:0/670533302 >> 172.21.15.7:0/670533302 conn(0x55f68008d310 msgr2=0x55f6800c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:22.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.834+0000 7fd7475ec740 1 -- 172.21.15.7:0/670533302 shutdown_connections 2024-09-19T08:45:22.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.834+0000 7fd7475ec740 1 -- 172.21.15.7:0/670533302 wait complete. 2024-09-19T08:45:22.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.834+0000 7fd7475ec740 1 -- start start 2024-09-19T08:45:22.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.834+0000 7fd7475ec740 1 Processor -- start 2024-09-19T08:45:22.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.834+0000 7fd7475ec740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800c45d0 0x55f6800ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:22.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.834+0000 7fd7475ec740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f6800c5b40 0x55f6800cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:22.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.834+0000 7fd7475ec740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6800cf370 0x55f6800cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:22.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.834+0000 7fd7475ec740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f6800d2070 con 0x55f6800c45d0 2024-09-19T08:45:22.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.834+0000 7fd7475ec740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f67ffe5060 con 0x55f6800c5b40 2024-09-19T08:45:22.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.834+0000 7fd7475ec740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f6800d21f0 con 0x55f6800cf370 2024-09-19T08:45:22.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.834+0000 7fd7475ec740 10 client.0 _ll_register_callbacks cb 0x55f67fd388c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:22.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.834+0000 7fd73ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800c45d0 0x55f6800ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:22.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.834+0000 7fd73ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800c45d0 0x55f6800ced30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57324/0 (socket says 172.21.15.7:57324) 2024-09-19T08:45:22.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.834+0000 7fd73ed9d640 1 -- 172.21.15.7:0/2457056950 learned_addr learned my addr 172.21.15.7:0/2457056950 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:22.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.834+0000 7fd73e59c640 1 --2- 172.21.15.7:0/2457056950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f6800c5b40 0x55f6800cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:22.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.835+0000 7fd73f59e640 1 --2- 172.21.15.7:0/2457056950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6800cf370 0x55f6800cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:22.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.835+0000 7fd73ed9d640 1 -- 172.21.15.7:0/2457056950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6800cf370 msgr2=0x55f6800cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:22.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.835+0000 7fd73ed9d640 1 --2- 172.21.15.7:0/2457056950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6800cf370 0x55f6800cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.835+0000 7fd73ed9d640 1 -- 172.21.15.7:0/2457056950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f6800c5b40 msgr2=0x55f6800cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:22.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.835+0000 7fd73ed9d640 1 --2- 172.21.15.7:0/2457056950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f6800c5b40 0x55f6800cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.835+0000 7fd73ed9d640 1 -- 172.21.15.7:0/2457056950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f67fd9b3c0 con 0x55f6800c45d0 2024-09-19T08:45:22.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.835+0000 7fd73f59e640 1 --2- 172.21.15.7:0/2457056950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6800cf370 0x55f6800cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:45:22.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.835+0000 7fd73ed9d640 1 --2- 172.21.15.7:0/2457056950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800c45d0 0x55f6800ced30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd730098620 tx=0x7fd73006aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41361f480ba82c4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.835+0000 7fd722ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:45:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.835+0000 7fd722ff5640 1 -- 172.21.15.7:0/2457056950 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73000de20 con 0x55f6800c45d0 2024-09-19T08:45:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.835+0000 7fd722ff5640 1 -- 172.21.15.7:0/2457056950 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fd73000fb30 con 0x55f6800c45d0 2024-09-19T08:45:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.835+0000 7fd7475ec740 1 -- 172.21.15.7:0/2457056950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd738004520 con 0x55f6800c45d0 2024-09-19T08:45:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.835+0000 7fd722ff5640 1 -- 172.21.15.7:0/2457056950 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd73009c1c0 con 0x55f6800c45d0 2024-09-19T08:45:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.835+0000 7fd7475ec740 10 client.15498 fetch_fsmap learned FSMap version 25 2024-09-19T08:45:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.835+0000 7fd7475ec740 1 -- 172.21.15.7:0/2457056950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f6800ddad0 con 0x55f6800c45d0 2024-09-19T08:45:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.836+0000 7fd722ff5640 1 -- 172.21.15.7:0/2457056950 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd738004520 con 0x55f6800c45d0 2024-09-19T08:45:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.836+0000 7fd722ff5640 1 -- 172.21.15.7:0/2457056950 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd7300bc0b0 con 0x55f6800c45d0 2024-09-19T08:45:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.836+0000 7fd7475ec740 10 client.15498 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:45:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.836+0000 7fd7475ec740 10 client.15498 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:45:22.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.836+0000 7fd7475ec740 20 client.15498 populate_metadata read hostname 'smithi007' 2024-09-19T08:45:22.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.836+0000 7fd7475ec740 1 --2- 172.21.15.7:0/2457056950 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f6800deee0 0x55f6800e12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:22.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.836+0000 7fd7475ec740 4 client.15498 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:45:22.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.836+0000 7fd7475ec740 1 -- 172.21.15.7:0/2457056950 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f680037860 con 0x55f6800deee0 2024-09-19T08:45:22.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.836+0000 7fd73e59c640 1 --2- 172.21.15.7:0/2457056950 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f6800deee0 0x55f6800e12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:22.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.837+0000 7fd73e59c640 1 --2- 172.21.15.7:0/2457056950 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f6800deee0 0x55f6800e12d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=896e59073176a989 server_cookie=c80d9c4acaecaaba in_seq=0 out_seq=0 2024-09-19T08:45:22.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.837+0000 7fd722ff5640 10 client.15498 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:45:22.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.837+0000 7fd722ff5640 1 -- 172.21.15.7:0/2457056950 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f680037860 con 0x55f6800deee0 2024-09-19T08:45:22.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.837+0000 7fd722ff5640 10 client.15498 handle_command_reply: tid=0 2024-09-19T08:45:22.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.837+0000 7fd7475ec740 1 client.15498 shutdown 2024-09-19T08:45:22.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.837+0000 7fd7475ec740 1 -- 172.21.15.7:0/2457056950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800c45d0 msgr2=0x55f6800ced30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:22.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.837+0000 7fd7475ec740 1 --2- 172.21.15.7:0/2457056950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800c45d0 0x55f6800ced30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd730098620 tx=0x7fd73006aeb0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.837+0000 7fd7475ec740 1 -- 172.21.15.7:0/2457056950 shutdown_connections 2024-09-19T08:45:22.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.837+0000 7fd7475ec740 1 --2- 172.21.15.7:0/2457056950 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f6800deee0 0x55f6800e12d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.837+0000 7fd7475ec740 1 --2- 172.21.15.7:0/2457056950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6800cf370 0x55f6800cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.837+0000 7fd7475ec740 1 --2- 172.21.15.7:0/2457056950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f6800c5b40 0x55f6800cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.837+0000 7fd7475ec740 1 --2- 172.21.15.7:0/2457056950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800c45d0 0x55f6800ced30 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.837+0000 7fd722ff5640 0 client.15498 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:45:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.837+0000 7fd7475ec740 1 -- 172.21.15.7:0/2457056950 >> 172.21.15.7:0/2457056950 conn(0x55f68008d310 msgr2=0x55f6800c6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.838+0000 7fd7475ec740 1 -- 172.21.15.7:0/2457056950 shutdown_connections 2024-09-19T08:45:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.838+0000 7fd7475ec740 1 -- 172.21.15.7:0/2457056950 wait complete. 2024-09-19T08:45:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.838+0000 7fd7475ec740 20 client.15498 trim_cache size 0 max 16384 2024-09-19T08:45:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.852+0000 7fd7475ec740 1 Processor -- start 2024-09-19T08:45:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.852+0000 7fd7475ec740 1 -- start start 2024-09-19T08:45:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.852+0000 7fd7475ec740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800c45d0 0x55f6800c7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.852+0000 7fd7475ec740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f6800c5b40 0x55f6800c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.852+0000 7fd7475ec740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6800cf370 0x55f6800e6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.852+0000 7fd7475ec740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd7401b2360 con 0x55f6800c45d0 2024-09-19T08:45:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.852+0000 7fd7475ec740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd7401afc30 con 0x55f6800c5b40 2024-09-19T08:45:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.852+0000 7fd7475ec740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd7401ada80 con 0x55f6800cf370 2024-09-19T08:45:22.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.853+0000 7fd73ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800c45d0 0x55f6800c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:22.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.853+0000 7fd73ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800c45d0 0x55f6800c7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57330/0 (socket says 172.21.15.7:57330) 2024-09-19T08:45:22.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.853+0000 7fd73ed9d640 1 -- 172.21.15.7:0/2195191749 learned_addr learned my addr 172.21.15.7:0/2195191749 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:22.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.853+0000 7fd73e59c640 1 --2- 172.21.15.7:0/2195191749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f6800c5b40 0x55f6800c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:22.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.853+0000 7fd73ed9d640 1 -- 172.21.15.7:0/2195191749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6800cf370 msgr2=0x55f6800e6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:22.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.853+0000 7fd73ed9d640 1 --2- 172.21.15.7:0/2195191749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6800cf370 0x55f6800e6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.853+0000 7fd73ed9d640 1 -- 172.21.15.7:0/2195191749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f6800c5b40 msgr2=0x55f6800c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:22.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.853+0000 7fd73ed9d640 1 --2- 172.21.15.7:0/2195191749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f6800c5b40 0x55f6800c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.853+0000 7fd73ed9d640 1 -- 172.21.15.7:0/2195191749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6800bf310 con 0x55f6800c45d0 2024-09-19T08:45:22.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.853+0000 7fd73e59c640 1 --2- 172.21.15.7:0/2195191749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f6800c5b40 0x55f6800c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:22.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.853+0000 7fd73ed9d640 1 --2- 172.21.15.7:0/2195191749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800c45d0 0x55f6800c7120 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd73009a470 tx=0x7fd73009c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7404eedc0fa95ed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:22.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.853+0000 7fd724ff9640 1 -- 172.21.15.7:0/2195191749 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7300b51b0 con 0x55f6800c45d0 2024-09-19T08:45:22.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.853+0000 7fd724ff9640 1 -- 172.21.15.7:0/2195191749 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd73006be50 con 0x55f6800c45d0 2024-09-19T08:45:22.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.853+0000 7fd724ff9640 1 -- 172.21.15.7:0/2195191749 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd730066f40 con 0x55f6800c45d0 2024-09-19T08:45:22.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.854+0000 7fd7475ec740 1 -- 172.21.15.7:0/2195191749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800c45d0 msgr2=0x55f6800c7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:22.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.854+0000 7fd7475ec740 1 --2- 172.21.15.7:0/2195191749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800c45d0 0x55f6800c7120 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd73009a470 tx=0x7fd73009c570 comp rx=0 tx=0).stop 2024-09-19T08:45:22.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.854+0000 7fd7475ec740 1 -- 172.21.15.7:0/2195191749 shutdown_connections 2024-09-19T08:45:22.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.854+0000 7fd7475ec740 1 --2- 172.21.15.7:0/2195191749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6800cf370 0x55f6800e6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.854+0000 7fd7475ec740 1 --2- 172.21.15.7:0/2195191749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f6800c5b40 0x55f6800c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.854+0000 7fd7475ec740 1 --2- 172.21.15.7:0/2195191749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800c45d0 0x55f6800c7120 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.854+0000 7fd7475ec740 1 -- 172.21.15.7:0/2195191749 >> 172.21.15.7:0/2195191749 conn(0x55f68008d310 msgr2=0x55f6800ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:22.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.854+0000 7fd7475ec740 1 -- 172.21.15.7:0/2195191749 shutdown_connections 2024-09-19T08:45:22.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.854+0000 7fd7475ec740 1 -- 172.21.15.7:0/2195191749 wait complete. 2024-09-19T08:45:22.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.854+0000 7fd7475ec740 1 -- start start 2024-09-19T08:45:22.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.854+0000 7fd7475ec740 1 Processor -- start 2024-09-19T08:45:22.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.855+0000 7fd7475ec740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6800c45d0 0x55f6800d7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:22.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.855+0000 7fd7475ec740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f6800c5b40 0x55f6800d79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:22.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.855+0000 7fd7475ec740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800cf370 0x55f6800d4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:22.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.855+0000 7fd7475ec740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd7401ae0f0 con 0x55f6800cf370 2024-09-19T08:45:22.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.855+0000 7fd7475ec740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd7401af560 con 0x55f6800c5b40 2024-09-19T08:45:22.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.855+0000 7fd7475ec740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd7401ae7c0 con 0x55f6800c45d0 2024-09-19T08:45:22.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.855+0000 7fd7475ec740 10 client.0 _ll_register_callbacks cb 0x7fd73009bdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:22.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.855+0000 7fd73f59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800cf370 0x55f6800d4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:22.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.855+0000 7fd73f59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800cf370 0x55f6800d4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57336/0 (socket says 172.21.15.7:57336) 2024-09-19T08:45:22.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.855+0000 7fd73f59e640 1 -- 172.21.15.7:0/535564345 learned_addr learned my addr 172.21.15.7:0/535564345 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:22.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.855+0000 7fd73e59c640 1 --2- 172.21.15.7:0/535564345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f6800c5b40 0x55f6800d79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:22.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.855+0000 7fd73ed9d640 1 --2- 172.21.15.7:0/535564345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6800c45d0 0x55f6800d7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:22.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.855+0000 7fd73f59e640 1 -- 172.21.15.7:0/535564345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6800c45d0 msgr2=0x55f6800d7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:22.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.855+0000 7fd73f59e640 1 --2- 172.21.15.7:0/535564345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6800c45d0 0x55f6800d7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.855+0000 7fd73f59e640 1 -- 172.21.15.7:0/535564345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f6800c5b40 msgr2=0x55f6800d79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:22.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.855+0000 7fd73f59e640 1 --2- 172.21.15.7:0/535564345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f6800c5b40 0x55f6800d79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.855+0000 7fd73f59e640 1 -- 172.21.15.7:0/535564345 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6800c1960 con 0x55f6800cf370 2024-09-19T08:45:22.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.855+0000 7fd73e59c640 1 --2- 172.21.15.7:0/535564345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f6800c5b40 0x55f6800d79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:45:22.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.856+0000 7fd73f59e640 1 --2- 172.21.15.7:0/535564345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800cf370 0x55f6800d4450 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd73802f8d0 tx=0x7fd738009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f28c7189fad22e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:22.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.856+0000 7fd722ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:45:22.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.856+0000 7fd722ff5640 1 -- 172.21.15.7:0/535564345 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd738039950 con 0x55f6800cf370 2024-09-19T08:45:22.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.856+0000 7fd722ff5640 1 -- 172.21.15.7:0/535564345 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fd738004040 con 0x55f6800cf370 2024-09-19T08:45:22.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.856+0000 7fd7475ec740 1 -- 172.21.15.7:0/535564345 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd73006be50 con 0x55f6800cf370 2024-09-19T08:45:22.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.856+0000 7fd722ff5640 1 -- 172.21.15.7:0/535564345 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd738004240 con 0x55f6800cf370 2024-09-19T08:45:22.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.856+0000 7fd7475ec740 10 client.15504 fetch_fsmap learned FSMap version 25 2024-09-19T08:45:22.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.856+0000 7fd7475ec740 1 -- 172.21.15.7:0/535564345 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f68014a150 con 0x55f6800cf370 2024-09-19T08:45:22.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.856+0000 7fd722ff5640 1 -- 172.21.15.7:0/535564345 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd73006be50 con 0x55f6800cf370 2024-09-19T08:45:22.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.856+0000 7fd722ff5640 1 -- 172.21.15.7:0/535564345 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd738051880 con 0x55f6800cf370 2024-09-19T08:45:22.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.856+0000 7fd7475ec740 10 client.15504 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:45:22.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.856+0000 7fd7475ec740 10 client.15504 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:45:22.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.856+0000 7fd7475ec740 20 client.15504 populate_metadata read hostname 'smithi007' 2024-09-19T08:45:22.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.856+0000 7fd7475ec740 1 --2- 172.21.15.7:0/535564345 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f68014a540 0x55f68014c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:22.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.856+0000 7fd7475ec740 4 client.15504 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:45:22.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.856+0000 7fd7475ec740 1 -- 172.21.15.7:0/535564345 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f680031d70 con 0x55f68014a540 2024-09-19T08:45:22.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.857+0000 7fd73ed9d640 1 --2- 172.21.15.7:0/535564345 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f68014a540 0x55f68014c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:22.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.857+0000 7fd73ed9d640 1 --2- 172.21.15.7:0/535564345 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f68014a540 0x55f68014c930 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4163da28ff83e51 server_cookie=dc8cb0343ed93f65 in_seq=0 out_seq=0 2024-09-19T08:45:22.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.857+0000 7fd722ff5640 10 client.15504 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:45:22.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.857+0000 7fd722ff5640 1 -- 172.21.15.7:0/535564345 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f680031d70 con 0x55f68014a540 2024-09-19T08:45:22.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.857+0000 7fd722ff5640 10 client.15504 handle_command_reply: tid=0 2024-09-19T08:45:22.697 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:45:22.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.857+0000 7fd7475ec740 1 client.15504 shutdown 2024-09-19T08:45:22.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.857+0000 7fd7475ec740 1 -- 172.21.15.7:0/535564345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800cf370 msgr2=0x55f6800d4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:22.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.857+0000 7fd7475ec740 1 --2- 172.21.15.7:0/535564345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800cf370 0x55f6800d4450 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd73802f8d0 tx=0x7fd738009560 comp rx=0 tx=0).stop 2024-09-19T08:45:22.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.857+0000 7fd7475ec740 1 -- 172.21.15.7:0/535564345 shutdown_connections 2024-09-19T08:45:22.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.857+0000 7fd7475ec740 1 --2- 172.21.15.7:0/535564345 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f68014a540 0x55f68014c930 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.857+0000 7fd722ff5640 0 client.15504 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:45:22.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.857+0000 7fd7475ec740 1 --2- 172.21.15.7:0/535564345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f6800cf370 0x55f6800d4450 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.857+0000 7fd7475ec740 1 --2- 172.21.15.7:0/535564345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f6800c5b40 0x55f6800d79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.857+0000 7fd7475ec740 1 --2- 172.21.15.7:0/535564345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f6800c45d0 0x55f6800d7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.857+0000 7fd7475ec740 1 -- 172.21.15.7:0/535564345 >> 172.21.15.7:0/535564345 conn(0x55f68008d310 msgr2=0x55f6800ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:22.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.858+0000 7fd7475ec740 1 -- 172.21.15.7:0/535564345 shutdown_connections 2024-09-19T08:45:22.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.858+0000 7fd7475ec740 1 -- 172.21.15.7:0/535564345 wait complete. 2024-09-19T08:45:22.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.858+0000 7fd7475ec740 20 client.15504 trim_cache size 0 max 16384 2024-09-19T08:45:22.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.858+0000 7fd745213640 1 -- 172.21.15.7:0/473586203 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd7280a3550 msgr2=0x7fd7280a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:22.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.858+0000 7fd745213640 1 --2- 172.21.15.7:0/473586203 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd7280a3550 0x7fd7280a5a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd73804c000 tx=0x7fd738049000 comp rx=0 tx=0).stop 2024-09-19T08:45:22.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.858+0000 7fd745213640 1 -- 172.21.15.7:0/473586203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd740100e20 msgr2=0x7fd7400fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:22.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.858+0000 7fd745213640 1 --2- 172.21.15.7:0/473586203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd740100e20 0x7fd7400fcc80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd73000c920 tx=0x7fd73000cde0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.858+0000 7fd745213640 1 -- 172.21.15.7:0/473586203 shutdown_connections 2024-09-19T08:45:22.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.858+0000 7fd745213640 1 --2- 172.21.15.7:0/473586203 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd7280a3550 0x7fd7280a5a10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.858+0000 7fd745213640 1 --2- 172.21.15.7:0/473586203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd740102ef0 0x7fd7400fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.858+0000 7fd745213640 1 --2- 172.21.15.7:0/473586203 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd740102570 0x7fd7400fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.858+0000 7fd745213640 1 --2- 172.21.15.7:0/473586203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd740100e20 0x7fd7400fcc80 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:22.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.858+0000 7fd745213640 1 -- 172.21.15.7:0/473586203 >> 172.21.15.7:0/473586203 conn(0x7fd7400fc7d0 msgr2=0x7fd74006a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:22.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.859+0000 7fd745213640 1 -- 172.21.15.7:0/473586203 shutdown_connections 2024-09-19T08:45:22.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:21.859+0000 7fd745213640 1 -- 172.21.15.7:0/473586203 wait complete. 2024-09-19T08:45:22.700 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:22 smithi175 ceph-mon[35688]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:45:24.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:24 smithi007 ceph-mon[31221]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T08:45:24.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:24 smithi044 ceph-mon[35072]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T08:45:24.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:24 smithi175 ceph-mon[35688]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T08:45:26.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:26 smithi007 ceph-mon[31221]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-19T08:45:26.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:26 smithi044 ceph-mon[35072]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-19T08:45:26.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:26 smithi175 ceph-mon[35688]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-19T08:45:27.067 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:45:27.100 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:45:27.414 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:27.461 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:28.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.269+0000 7f9c2929d640 1 -- 172.21.15.7:0/4197182461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c24101df0 msgr2=0x7f9c241021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:28.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.269+0000 7f9c2929d640 1 --2- 172.21.15.7:0/4197182461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c24101df0 0x7f9c241021d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9c14009900 tx=0x7f9c1402a410 comp rx=0 tx=0).stop 2024-09-19T08:45:28.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.269+0000 7f9c2929d640 1 -- 172.21.15.7:0/4197182461 shutdown_connections 2024-09-19T08:45:28.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.269+0000 7f9c2929d640 1 --2- 172.21.15.7:0/4197182461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c24106f20 0x7f9c2410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.269+0000 7f9c2929d640 1 --2- 172.21.15.7:0/4197182461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c241027a0 0x7f9c241067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.269+0000 7f9c2929d640 1 --2- 172.21.15.7:0/4197182461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c24101df0 0x7f9c241021d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.269+0000 7f9c2929d640 1 -- 172.21.15.7:0/4197182461 >> 172.21.15.7:0/4197182461 conn(0x7f9c240fd8f0 msgr2=0x7f9c240ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:28.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.269+0000 7f9c2929d640 1 -- 172.21.15.7:0/4197182461 shutdown_connections 2024-09-19T08:45:28.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.269+0000 7f9c2929d640 1 -- 172.21.15.7:0/4197182461 wait complete. 2024-09-19T08:45:28.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.270+0000 7f9c2929d640 1 Processor -- start 2024-09-19T08:45:28.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.270+0000 7f9c2929d640 1 -- start start 2024-09-19T08:45:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.270+0000 7f9c2929d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c24101df0 0x7f9c241a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.270+0000 7f9c2929d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c241027a0 0x7f9c241a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.270+0000 7f9c2929d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c24106f20 0x7f9c2410dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.270+0000 7f9c2929d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9c24111f40 con 0x7f9c24101df0 2024-09-19T08:45:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.270+0000 7f9c2929d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9c24111dc0 con 0x7f9c241027a0 2024-09-19T08:45:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.270+0000 7f9c2929d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9c241120c0 con 0x7f9c24106f20 2024-09-19T08:45:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.270+0000 7f9c22ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c24101df0 0x7f9c241a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.270+0000 7f9c22ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c24101df0 0x7f9c241a4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35542/0 (socket says 172.21.15.7:35542) 2024-09-19T08:45:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.270+0000 7f9c22ffd640 1 -- 172.21.15.7:0/1000749344 learned_addr learned my addr 172.21.15.7:0/1000749344 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.270+0000 7f9c1bfff640 1 --2- 172.21.15.7:0/1000749344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c241027a0 0x7f9c241a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.271+0000 7f9c237fe640 1 --2- 172.21.15.7:0/1000749344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c24106f20 0x7f9c2410dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.271+0000 7f9c22ffd640 1 -- 172.21.15.7:0/1000749344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c24106f20 msgr2=0x7f9c2410dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:28.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.271+0000 7f9c22ffd640 1 --2- 172.21.15.7:0/1000749344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c24106f20 0x7f9c2410dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.271+0000 7f9c22ffd640 1 -- 172.21.15.7:0/1000749344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c241027a0 msgr2=0x7f9c241a4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.271+0000 7f9c22ffd640 1 --2- 172.21.15.7:0/1000749344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c241027a0 0x7f9c241a4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.271+0000 7f9c22ffd640 1 -- 172.21.15.7:0/1000749344 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2410e3e0 con 0x7f9c24101df0 2024-09-19T08:45:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.271+0000 7f9c1bfff640 1 --2- 172.21.15.7:0/1000749344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c241027a0 0x7f9c241a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:45:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.271+0000 7f9c22ffd640 1 --2- 172.21.15.7:0/1000749344 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c24101df0 0x7f9c241a4690 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9c14006010 tx=0x7f9c140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.271+0000 7f9c20ff9640 1 -- 172.21.15.7:0/1000749344 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1403f030 con 0x7f9c24101df0 2024-09-19T08:45:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.271+0000 7f9c2929d640 1 -- 172.21.15.7:0/1000749344 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2410e670 con 0x7f9c24101df0 2024-09-19T08:45:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.271+0000 7f9c20ff9640 1 -- 172.21.15.7:0/1000749344 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c14003ce0 con 0x7f9c24101df0 2024-09-19T08:45:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.271+0000 7f9c20ff9640 1 -- 172.21.15.7:0/1000749344 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14035070 con 0x7f9c24101df0 2024-09-19T08:45:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.272+0000 7f9c2929d640 1 -- 172.21.15.7:0/1000749344 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c241ab4f0 con 0x7f9c24101df0 2024-09-19T08:45:28.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.273+0000 7f9c2929d640 1 -- 172.21.15.7:0/1000749344 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c241032d0 con 0x7f9c24101df0 2024-09-19T08:45:28.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.275+0000 7f9c20ff9640 1 -- 172.21.15.7:0/1000749344 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 138587+0+0 (secure 0 0 0) 0x7f9c14042030 con 0x7f9c24101df0 2024-09-19T08:45:28.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.276+0000 7f9c20ff9640 1 --2- 172.21.15.7:0/1000749344 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9c100a3550 0x7f9c100a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:28.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.276+0000 7f9c1bfff640 1 --2- 172.21.15.7:0/1000749344 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9c100a3550 0x7f9c100a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:28.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.276+0000 7f9c20ff9640 1 -- 172.21.15.7:0/1000749344 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f9c140f0630 con 0x7f9c24101df0 2024-09-19T08:45:28.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.277+0000 7f9c1bfff640 1 --2- 172.21.15.7:0/1000749344 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9c100a3550 0x7f9c100a5a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0095f0 tx=0x7f9c0c005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:28.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.282+0000 7f9c20ff9640 1 -- 172.21.15.7:0/1000749344 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9c140bcf40 con 0x7f9c24101df0 2024-09-19T08:45:28.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.175+0000 7f1fe2e9c640 1 -- 172.21.15.7:0/2192047914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fdc102570 msgr2=0x7f1fdc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:28.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.175+0000 7f1fe2e9c640 1 --2- 172.21.15.7:0/2192047914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fdc102570 0x7f1fdc1029b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8009900 tx=0x7f1fc802a480 comp rx=0 tx=0).stop 2024-09-19T08:45:28.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.175+0000 7f1fe2e9c640 1 -- 172.21.15.7:0/2192047914 shutdown_connections 2024-09-19T08:45:28.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.175+0000 7f1fe2e9c640 1 --2- 172.21.15.7:0/2192047914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fdc102ef0 0x7f1fdc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.175+0000 7f1fe2e9c640 1 --2- 172.21.15.7:0/2192047914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fdc102570 0x7f1fdc1029b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.175+0000 7f1fe2e9c640 1 --2- 172.21.15.7:0/2192047914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fdc100e20 0x7f1fdc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.175+0000 7f1fe2e9c640 1 -- 172.21.15.7:0/2192047914 >> 172.21.15.7:0/2192047914 conn(0x7f1fdc0fc7d0 msgr2=0x7f1fdc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.176+0000 7f1fe2e9c640 1 -- 172.21.15.7:0/2192047914 shutdown_connections 2024-09-19T08:45:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.176+0000 7f1fe2e9c640 1 -- 172.21.15.7:0/2192047914 wait complete. 2024-09-19T08:45:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.176+0000 7f1fe2e9c640 1 Processor -- start 2024-09-19T08:45:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.176+0000 7f1fe2e9c640 1 -- start start 2024-09-19T08:45:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.177+0000 7f1fe2e9c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fdc100e20 0x7f1fdc1960e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.177+0000 7f1fe2e9c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fdc102570 0x7f1fdc196620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.177+0000 7f1fe2e9c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fdc102ef0 0x7f1fdc19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.177+0000 7f1fe2e9c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc10fe80 con 0x7f1fdc102570 2024-09-19T08:45:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.177+0000 7f1fe2e9c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc10fd00 con 0x7f1fdc102ef0 2024-09-19T08:45:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.177+0000 7f1fe2e9c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc110000 con 0x7f1fdc100e20 2024-09-19T08:45:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.177+0000 7f1fdbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fdc102570 0x7f1fdc196620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.177+0000 7f1fdbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fdc102570 0x7f1fdc196620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35498/0 (socket says 172.21.15.7:35498) 2024-09-19T08:45:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.177+0000 7f1fdbfff640 1 -- 172.21.15.7:0/3846762879 learned_addr learned my addr 172.21.15.7:0/3846762879 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.177+0000 7f1fe0c38640 1 --2- 172.21.15.7:0/3846762879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fdc100e20 0x7f1fdc1960e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.177+0000 7f1fdbfff640 1 -- 172.21.15.7:0/3846762879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fdc100e20 msgr2=0x7f1fdc1960e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.177+0000 7f1fdbfff640 1 --2- 172.21.15.7:0/3846762879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fdc100e20 0x7f1fdc1960e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.177+0000 7f1fdbfff640 1 -- 172.21.15.7:0/3846762879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fdc102ef0 msgr2=0x7f1fdc19a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.177+0000 7f1fdbfff640 1 --2- 172.21.15.7:0/3846762879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fdc102ef0 0x7f1fdc19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.177+0000 7f1fdbfff640 1 -- 172.21.15.7:0/3846762879 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fdc19b090 con 0x7f1fdc102570 2024-09-19T08:45:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.178+0000 7f1fdbfff640 1 --2- 172.21.15.7:0/3846762879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fdc102570 0x7f1fdc196620 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1fc80309c0 tx=0x7f1fc80309f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.178+0000 7f1fd9ffb640 1 -- 172.21.15.7:0/3846762879 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc803f070 con 0x7f1fdc102570 2024-09-19T08:45:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.178+0000 7f1fd9ffb640 1 -- 172.21.15.7:0/3846762879 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fc8032e40 con 0x7f1fdc102570 2024-09-19T08:45:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.178+0000 7f1fe2e9c640 1 -- 172.21.15.7:0/3846762879 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fdc19b320 con 0x7f1fdc102570 2024-09-19T08:45:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.178+0000 7f1fd9ffb640 1 -- 172.21.15.7:0/3846762879 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8035030 con 0x7f1fdc102570 2024-09-19T08:45:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.179+0000 7f1fe2e9c640 1 -- 172.21.15.7:0/3846762879 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fdc1a2c60 con 0x7f1fdc102570 2024-09-19T08:45:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.182+0000 7f1fe5275740 1 Processor -- start 2024-09-19T08:45:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.182+0000 7f1fe5275740 1 -- start start 2024-09-19T08:45:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.182+0000 7f1fd9ffb640 1 -- 172.21.15.7:0/3846762879 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 138587+0+0 (secure 0 0 0) 0x7f1fc8042070 con 0x7f1fdc102570 2024-09-19T08:45:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.183+0000 7f1fe5275740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a2bf50 0x555d64a2a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.183+0000 7f1fe5275740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a2a9e0 0x555d64a2ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.183+0000 7f1fe5275740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a35780 0x555d64a37b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.183+0000 7f1fe5275740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555d6498c2f0 con 0x555d64a35780 2024-09-19T08:45:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.183+0000 7f1fe5275740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555d64933cf0 con 0x555d64a2a9e0 2024-09-19T08:45:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.183+0000 7f1fe5275740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555d649882b0 con 0x555d64a2bf50 2024-09-19T08:45:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.183+0000 7f1fe1439640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a2bf50 0x555d64a2a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.183+0000 7f1fe1439640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a2bf50 0x555d64a2a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.7:53778/0 (socket says 172.21.15.7:53778) 2024-09-19T08:45:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.183+0000 7f1fe1439640 1 -- 172.21.15.7:0/4208196366 learned_addr learned my addr 172.21.15.7:0/4208196366 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.183+0000 7f1fdbfff640 1 --2- 172.21.15.7:0/4208196366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a35780 0x555d64a37b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.183+0000 7f1fe0c38640 1 --2- 172.21.15.7:0/4208196366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a2a9e0 0x555d64a2ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:28.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.183+0000 7f1fe1439640 1 -- 172.21.15.7:0/4208196366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a2a9e0 msgr2=0x555d64a2ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:28.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.183+0000 7f1fe1439640 1 --2- 172.21.15.7:0/4208196366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a2a9e0 0x555d64a2ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.183+0000 7f1fe1439640 1 -- 172.21.15.7:0/4208196366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a35780 msgr2=0x555d64a37b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:28.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.183+0000 7f1fe1439640 1 --2- 172.21.15.7:0/4208196366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a35780 0x555d64a37b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.183+0000 7f1fe1439640 1 -- 172.21.15.7:0/4208196366 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d649183a0 con 0x555d64a2bf50 2024-09-19T08:45:28.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.183+0000 7f1fdbfff640 1 --2- 172.21.15.7:0/4208196366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a35780 0x555d64a37b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:28.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.184+0000 7f1fe1439640 1 --2- 172.21.15.7:0/4208196366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a2bf50 0x555d64a2a4a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4009d10 tx=0x7f1fd400e6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9f7bebae8398e97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:28.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.184+0000 7f1fc6ffd640 1 -- 172.21.15.7:0/4208196366 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4016070 con 0x555d64a2bf50 2024-09-19T08:45:28.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.184+0000 7f1fd9ffb640 1 --2- 172.21.15.7:0/3846762879 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1fcc0a35d0 0x7f1fcc0a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:28.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.184+0000 7f1fc6ffd640 1 -- 172.21.15.7:0/4208196366 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fd4005020 con 0x555d64a2bf50 2024-09-19T08:45:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.184+0000 7f1fc6ffd640 1 -- 172.21.15.7:0/4208196366 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd40116b0 con 0x555d64a2bf50 2024-09-19T08:45:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.184+0000 7f1fd9ffb640 1 -- 172.21.15.7:0/3846762879 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f1fc80f0a20 con 0x7f1fdc102570 2024-09-19T08:45:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.185+0000 7f1fe0c38640 1 --2- 172.21.15.7:0/3846762879 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1fcc0a35d0 0x7f1fcc0a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.185+0000 7f1fe5275740 1 -- 172.21.15.7:0/4208196366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a2bf50 msgr2=0x555d64a2a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.185+0000 7f1fe5275740 1 --2- 172.21.15.7:0/4208196366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a2bf50 0x555d64a2a4a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4009d10 tx=0x7f1fd400e6c0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.185+0000 7f1fe5275740 1 -- 172.21.15.7:0/4208196366 shutdown_connections 2024-09-19T08:45:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.185+0000 7f1fe5275740 1 --2- 172.21.15.7:0/4208196366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a35780 0x555d64a37b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.185+0000 7f1fe5275740 1 --2- 172.21.15.7:0/4208196366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a2a9e0 0x555d64a2ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.185+0000 7f1fe5275740 1 --2- 172.21.15.7:0/4208196366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a2bf50 0x555d64a2a4a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.185+0000 7f1fe5275740 1 -- 172.21.15.7:0/4208196366 >> 172.21.15.7:0/4208196366 conn(0x555d649ef310 msgr2=0x555d64a27070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.185+0000 7f1fe0c38640 1 --2- 172.21.15.7:0/3846762879 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1fcc0a35d0 0x7f1fcc0a5a90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x555d64a27ed0 tx=0x7f1fd000a2d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.185+0000 7f1fe5275740 1 -- 172.21.15.7:0/4208196366 shutdown_connections 2024-09-19T08:45:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.185+0000 7f1fe5275740 1 -- 172.21.15.7:0/4208196366 wait complete. 2024-09-19T08:45:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.186+0000 7f1fe5275740 1 -- start start 2024-09-19T08:45:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.186+0000 7f1fe5275740 1 Processor -- start 2024-09-19T08:45:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.187+0000 7f1fe5275740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a2a9e0 0x555d64a35140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.187+0000 7f1fe5275740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a2bf50 0x555d64a323f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.187+0000 7f1fe5275740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a35780 0x555d64a329e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.187+0000 7f1fe1439640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a35780 0x555d64a329e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.187+0000 7f1fe1439640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a35780 0x555d64a329e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35512/0 (socket says 172.21.15.7:35512) 2024-09-19T08:45:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.187+0000 7f1fe1439640 1 -- 172.21.15.7:0/1459729304 learned_addr learned my addr 172.21.15.7:0/1459729304 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.187+0000 7f1fe0c38640 1 --2- 172.21.15.7:0/1459729304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a2a9e0 0x555d64a35140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.187+0000 7f1fdbfff640 1 --2- 172.21.15.7:0/1459729304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a2bf50 0x555d64a323f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.187+0000 7f1fe5275740 1 -- 172.21.15.7:0/1459729304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555d64a384d0 con 0x555d64a35780 2024-09-19T08:45:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.187+0000 7f1fe5275740 1 -- 172.21.15.7:0/1459729304 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555d64947060 con 0x555d64a2bf50 2024-09-19T08:45:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.187+0000 7f1fe5275740 1 -- 172.21.15.7:0/1459729304 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555d64a38650 con 0x555d64a2a9e0 2024-09-19T08:45:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.187+0000 7f1fe5275740 10 client.0 _ll_register_callbacks cb 0x555d6469a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.188+0000 7f1fe0c38640 1 -- 172.21.15.7:0/1459729304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a2bf50 msgr2=0x555d64a323f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.188+0000 7f1fe0c38640 1 --2- 172.21.15.7:0/1459729304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a2bf50 0x555d64a323f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.188+0000 7f1fe0c38640 1 -- 172.21.15.7:0/1459729304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a35780 msgr2=0x555d64a329e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:28.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.188+0000 7f1fe0c38640 1 --2- 172.21.15.7:0/1459729304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a35780 0x555d64a329e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.188+0000 7f1fe0c38640 1 -- 172.21.15.7:0/1459729304 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d646fd3c0 con 0x555d64a2a9e0 2024-09-19T08:45:28.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.188+0000 7f1fe1439640 1 --2- 172.21.15.7:0/1459729304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a35780 0x555d64a329e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:45:28.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.188+0000 7f1fdbfff640 1 --2- 172.21.15.7:0/1459729304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a2bf50 0x555d64a323f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:28.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.188+0000 7f1fe0c38640 1 --2- 172.21.15.7:0/1459729304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a2a9e0 0x555d64a35140 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0010c90 tx=0x7f1fd0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b37b16d6de476471 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:28.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.188+0000 7f1fbbfff640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-19T08:45:28.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.188+0000 7f1fbbfff640 1 -- 172.21.15.7:0/1459729304 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd002c060 con 0x555d64a2a9e0 2024-09-19T08:45:28.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.188+0000 7f1fbbfff640 1 -- 172.21.15.7:0/1459729304 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f1fd0016030 con 0x555d64a2a9e0 2024-09-19T08:45:28.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.188+0000 7f1fe5275740 1 -- 172.21.15.7:0/1459729304 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fd4005020 con 0x555d64a2a9e0 2024-09-19T08:45:28.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.189+0000 7f1fbbfff640 1 -- 172.21.15.7:0/1459729304 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1fd000adf0 con 0x555d64a2a9e0 2024-09-19T08:45:28.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.189+0000 7f1fe5275740 10 client.25129 fetch_fsmap learned FSMap version 25 2024-09-19T08:45:28.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.189+0000 7f1fe5275740 1 -- 172.21.15.7:0/1459729304 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555d64a43f50 con 0x555d64a2a9e0 2024-09-19T08:45:28.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.189+0000 7f1fbbfff640 1 -- 172.21.15.7:0/1459729304 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fd4005020 con 0x555d64a2a9e0 2024-09-19T08:45:28.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.189+0000 7f1fbbfff640 1 -- 172.21.15.7:0/1459729304 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1fd002f6f0 con 0x555d64a2a9e0 2024-09-19T08:45:28.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.190+0000 7f1fe5275740 10 client.25129 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:45:28.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.190+0000 7f1fe5275740 10 client.25129 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:45:28.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.190+0000 7f1fe5275740 20 client.25129 populate_metadata read hostname 'smithi007' 2024-09-19T08:45:28.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.190+0000 7f1fe5275740 1 --2- 172.21.15.7:0/1459729304 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x555d64a45410 0x555d64a47840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:28.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.190+0000 7f1fe5275740 4 client.25129 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:45:28.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.190+0000 7f1fe5275740 1 -- 172.21.15.7:0/1459729304 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d64999860 con 0x555d64a45410 2024-09-19T08:45:28.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.190+0000 7f1fdbfff640 1 --2- 172.21.15.7:0/1459729304 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x555d64a45410 0x555d64a47840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:28.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.191+0000 7f1fbbfff640 10 client.25129 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:28.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.191+0000 7f1fdbfff640 1 --2- 172.21.15.7:0/1459729304 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x555d64a45410 0x555d64a47840 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8eb9b51bc95e0c0a server_cookie=69ea3d84fb328c55 in_seq=0 out_seq=0 2024-09-19T08:45:28.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.191+0000 7f1fbbfff640 1 -- 172.21.15.7:0/1459729304 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555d64999860 con 0x555d64a45410 2024-09-19T08:45:28.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.191+0000 7f1fbbfff640 10 client.25129 handle_command_reply: tid=0 2024-09-19T08:45:28.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.192+0000 7f1fe5275740 1 client.25129 shutdown 2024-09-19T08:45:28.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.192+0000 7f1fe5275740 1 -- 172.21.15.7:0/1459729304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a2a9e0 msgr2=0x555d64a35140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:28.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.192+0000 7f1fe5275740 1 --2- 172.21.15.7:0/1459729304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a2a9e0 0x555d64a35140 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0010c90 tx=0x7f1fd0004730 comp rx=0 tx=0).stop 2024-09-19T08:45:28.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.192+0000 7f1fe5275740 1 -- 172.21.15.7:0/1459729304 shutdown_connections 2024-09-19T08:45:28.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.192+0000 7f1fe5275740 1 --2- 172.21.15.7:0/1459729304 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x555d64a45410 0x555d64a47840 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.192+0000 7f1fe5275740 1 --2- 172.21.15.7:0/1459729304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a35780 0x555d64a329e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.192+0000 7f1fe5275740 1 --2- 172.21.15.7:0/1459729304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a2bf50 0x555d64a323f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.192+0000 7f1fe5275740 1 --2- 172.21.15.7:0/1459729304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a2a9e0 0x555d64a35140 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.192+0000 7f1fe5275740 1 -- 172.21.15.7:0/1459729304 >> 172.21.15.7:0/1459729304 conn(0x555d649ef310 msgr2=0x555d64a2cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:28.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.192+0000 7f1fbbfff640 0 client.25129 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:28.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.192+0000 7f1fe5275740 1 -- 172.21.15.7:0/1459729304 shutdown_connections 2024-09-19T08:45:28.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.193+0000 7f1fe5275740 1 -- 172.21.15.7:0/1459729304 wait complete. 2024-09-19T08:45:28.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.193+0000 7f1fe5275740 20 client.25129 trim_cache size 0 max 16384 2024-09-19T08:45:28.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.218+0000 7f1fe5275740 1 Processor -- start 2024-09-19T08:45:28.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.218+0000 7f1fe5275740 1 -- start start 2024-09-19T08:45:28.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.218+0000 7f1fe5275740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a2a9e0 0x555d64a31cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:28.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.218+0000 7f1fe5275740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a2bf50 0x555d64a34360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:28.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.218+0000 7f1fe5275740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a35780 0x555d64a2d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:28.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.218+0000 7f1fe5275740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc1adf40 con 0x555d64a2a9e0 2024-09-19T08:45:28.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.218+0000 7f1fe5275740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc1ab810 con 0x555d64a2bf50 2024-09-19T08:45:28.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.218+0000 7f1fe5275740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc1a9660 con 0x555d64a35780 2024-09-19T08:45:28.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.218+0000 7f1fe0c38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a2a9e0 0x555d64a31cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:28.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.218+0000 7f1fdbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a2bf50 0x555d64a34360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:28.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.218+0000 7f1fdbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a2bf50 0x555d64a34360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:56328/0 (socket says 172.21.15.7:56328) 2024-09-19T08:45:28.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.218+0000 7f1fdbfff640 1 -- 172.21.15.7:0/3864688112 learned_addr learned my addr 172.21.15.7:0/3864688112 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:28.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.219+0000 7f1fe1439640 1 --2- 172.21.15.7:0/3864688112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a35780 0x555d64a2d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:28.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.219+0000 7f1fdbfff640 1 -- 172.21.15.7:0/3864688112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a35780 msgr2=0x555d64a2d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:28.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.219+0000 7f1fdbfff640 1 --2- 172.21.15.7:0/3864688112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a35780 0x555d64a2d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.219+0000 7f1fdbfff640 1 -- 172.21.15.7:0/3864688112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a2a9e0 msgr2=0x555d64a31cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:28.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.219+0000 7f1fdbfff640 1 --2- 172.21.15.7:0/3864688112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a2a9e0 0x555d64a31cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.219+0000 7f1fdbfff640 1 -- 172.21.15.7:0/3864688112 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d64a313a0 con 0x555d64a2bf50 2024-09-19T08:45:28.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.219+0000 7f1fe1439640 1 --2- 172.21.15.7:0/3864688112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a35780 0x555d64a2d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:45:28.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.219+0000 7f1fe0c38640 1 --2- 172.21.15.7:0/3864688112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a2a9e0 0x555d64a31cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:45:28.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.219+0000 7f1fdbfff640 1 --2- 172.21.15.7:0/3864688112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a2bf50 0x555d64a34360 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8003710 tx=0x7f1fc80f62e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=754f97dfa3bb05ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:28.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.220+0000 7f1fc67fc640 1 -- 172.21.15.7:0/3864688112 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8049040 con 0x555d64a2bf50 2024-09-19T08:45:28.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.220+0000 7f1fc67fc640 1 -- 172.21.15.7:0/3864688112 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fc800b0b0 con 0x555d64a2bf50 2024-09-19T08:45:28.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.220+0000 7f1fc67fc640 1 -- 172.21.15.7:0/3864688112 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc80b9180 con 0x555d64a2bf50 2024-09-19T08:45:28.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.221+0000 7f1fe5275740 1 -- 172.21.15.7:0/3864688112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a2bf50 msgr2=0x555d64a34360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:28.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.221+0000 7f1fe5275740 1 --2- 172.21.15.7:0/3864688112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a2bf50 0x555d64a34360 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8003710 tx=0x7f1fc80f62e0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.221+0000 7f1fe5275740 1 -- 172.21.15.7:0/3864688112 shutdown_connections 2024-09-19T08:45:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.221+0000 7f1fe5275740 1 --2- 172.21.15.7:0/3864688112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a35780 0x555d64a2d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.221+0000 7f1fe5275740 1 --2- 172.21.15.7:0/3864688112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a2bf50 0x555d64a34360 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.221+0000 7f1fe5275740 1 --2- 172.21.15.7:0/3864688112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a2a9e0 0x555d64a31cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.221+0000 7f1fe5275740 1 -- 172.21.15.7:0/3864688112 >> 172.21.15.7:0/3864688112 conn(0x555d649ef310 msgr2=0x555d64a33c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.221+0000 7f1fe5275740 1 -- 172.21.15.7:0/3864688112 shutdown_connections 2024-09-19T08:45:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.221+0000 7f1fe5275740 1 -- 172.21.15.7:0/3864688112 wait complete. 2024-09-19T08:45:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.221+0000 7f1fe5275740 1 -- start start 2024-09-19T08:45:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.221+0000 7f1fe5275740 1 Processor -- start 2024-09-19T08:45:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.222+0000 7f1fe5275740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a2a9e0 0x555d64a3df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.222+0000 7f1fe5275740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a2bf50 0x555d64a392d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.222+0000 7f1fe5275740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a35780 0x555d64a39810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.222+0000 7f1fe5275740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc1a9cd0 con 0x555d64a2a9e0 2024-09-19T08:45:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.222+0000 7f1fe5275740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc1ab140 con 0x555d64a35780 2024-09-19T08:45:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.222+0000 7f1fe5275740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc1aa3a0 con 0x555d64a2bf50 2024-09-19T08:45:28.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.222+0000 7f1fe5275740 10 client.0 _ll_register_callbacks cb 0x7f1fd000aa60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:28.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.222+0000 7f1fe0c38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a2a9e0 0x555d64a3df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:28.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.222+0000 7f1fe0c38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a2a9e0 0x555d64a3df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35524/0 (socket says 172.21.15.7:35524) 2024-09-19T08:45:28.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.222+0000 7f1fe0c38640 1 -- 172.21.15.7:0/3495575383 learned_addr learned my addr 172.21.15.7:0/3495575383 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:28.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.222+0000 7f1fe1439640 1 --2- 172.21.15.7:0/3495575383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a35780 0x555d64a39810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:28.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.223+0000 7f1fdbfff640 1 --2- 172.21.15.7:0/3495575383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a2bf50 0x555d64a392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:28.410 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:45:28.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.223+0000 7f1fe0c38640 1 -- 172.21.15.7:0/3495575383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a2bf50 msgr2=0x555d64a392d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:28.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.223+0000 7f1fe0c38640 1 --2- 172.21.15.7:0/3495575383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a2bf50 0x555d64a392d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.223+0000 7f1fe0c38640 1 -- 172.21.15.7:0/3495575383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a35780 msgr2=0x555d64a39810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:28.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.223+0000 7f1fe0c38640 1 --2- 172.21.15.7:0/3495575383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a35780 0x555d64a39810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.223+0000 7f1fe0c38640 1 -- 172.21.15.7:0/3495575383 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d64a3a040 con 0x555d64a2a9e0 2024-09-19T08:45:28.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.223+0000 7f1fdbfff640 1 --2- 172.21.15.7:0/3495575383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a2bf50 0x555d64a392d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:45:28.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.223+0000 7f1fe0c38640 1 --2- 172.21.15.7:0/3495575383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a2a9e0 0x555d64a3df50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1fd002fcb0 tx=0x7f1fd000ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e67e6f7d58d13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:28.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.223+0000 7f1fbbfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:45:28.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.223+0000 7f1fbbfff640 1 -- 172.21.15.7:0/3495575383 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd002f600 con 0x555d64a2a9e0 2024-09-19T08:45:28.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.223+0000 7f1fbbfff640 1 -- 172.21.15.7:0/3495575383 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f1fd0022040 con 0x555d64a2a9e0 2024-09-19T08:45:28.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.223+0000 7f1fe5275740 1 -- 172.21.15.7:0/3495575383 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fc800b0b0 con 0x555d64a2a9e0 2024-09-19T08:45:28.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.223+0000 7f1fbbfff640 1 -- 172.21.15.7:0/3495575383 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1fd002f7a0 con 0x555d64a2a9e0 2024-09-19T08:45:28.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.224+0000 7f1fe5275740 10 client.15522 fetch_fsmap learned FSMap version 25 2024-09-19T08:45:28.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.224+0000 7f1fe5275740 1 -- 172.21.15.7:0/3495575383 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555d64ab0010 con 0x555d64a2a9e0 2024-09-19T08:45:28.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.224+0000 7f1fbbfff640 1 -- 172.21.15.7:0/3495575383 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fc800b0b0 con 0x555d64a2a9e0 2024-09-19T08:45:28.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.224+0000 7f1fbbfff640 1 -- 172.21.15.7:0/3495575383 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1fd000fbd0 con 0x555d64a2a9e0 2024-09-19T08:45:28.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.224+0000 7f1fe5275740 10 client.15522 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:45:28.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.224+0000 7f1fe5275740 10 client.15522 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:45:28.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.224+0000 7f1fe5275740 20 client.15522 populate_metadata read hostname 'smithi007' 2024-09-19T08:45:28.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.224+0000 7f1fe5275740 1 --2- 172.21.15.7:0/3495575383 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x555d64ab0710 0x555d64ab2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:28.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.224+0000 7f1fe5275740 4 client.15522 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:45:28.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.224+0000 7f1fe5275740 1 -- 172.21.15.7:0/3495575383 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555d64993d70 con 0x555d64ab0710 2024-09-19T08:45:28.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.224+0000 7f1fdbfff640 1 --2- 172.21.15.7:0/3495575383 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x555d64ab0710 0x555d64ab2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:28.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.225+0000 7f1fbbfff640 10 client.15522 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:28.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.225+0000 7f1fdbfff640 1 --2- 172.21.15.7:0/3495575383 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x555d64ab0710 0x555d64ab2b30 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95b59eac36b48879 server_cookie=7166278c0dc5cf08 in_seq=0 out_seq=0 2024-09-19T08:45:28.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.225+0000 7f1fbbfff640 1 -- 172.21.15.7:0/3495575383 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555d64993d70 con 0x555d64ab0710 2024-09-19T08:45:28.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.225+0000 7f1fbbfff640 10 client.15522 handle_command_reply: tid=0 2024-09-19T08:45:28.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.225+0000 7f1fe5275740 1 client.15522 shutdown 2024-09-19T08:45:28.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.225+0000 7f1fe5275740 1 -- 172.21.15.7:0/3495575383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a2a9e0 msgr2=0x555d64a3df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:28.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.225+0000 7f1fe5275740 1 --2- 172.21.15.7:0/3495575383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a2a9e0 0x555d64a3df50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1fd002fcb0 tx=0x7f1fd000ab80 comp rx=0 tx=0).stop 2024-09-19T08:45:28.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.226+0000 7f1fe5275740 1 -- 172.21.15.7:0/3495575383 shutdown_connections 2024-09-19T08:45:28.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.226+0000 7f1fe5275740 1 --2- 172.21.15.7:0/3495575383 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x555d64ab0710 0x555d64ab2b30 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.226+0000 7f1fe5275740 1 --2- 172.21.15.7:0/3495575383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555d64a35780 0x555d64a39810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.226+0000 7f1fe5275740 1 --2- 172.21.15.7:0/3495575383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555d64a2bf50 0x555d64a392d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.226+0000 7f1fbbfff640 0 client.15522 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:28.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.226+0000 7f1fe5275740 1 --2- 172.21.15.7:0/3495575383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d64a2a9e0 0x555d64a3df50 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.226+0000 7f1fe5275740 1 -- 172.21.15.7:0/3495575383 >> 172.21.15.7:0/3495575383 conn(0x555d649ef310 msgr2=0x555d64a34470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:28.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.226+0000 7f1fe5275740 1 -- 172.21.15.7:0/3495575383 shutdown_connections 2024-09-19T08:45:28.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.226+0000 7f1fe5275740 1 -- 172.21.15.7:0/3495575383 wait complete. 2024-09-19T08:45:28.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.226+0000 7f1fe5275740 20 client.15522 trim_cache size 0 max 16384 2024-09-19T08:45:28.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.227+0000 7f1fe2e9c640 1 -- 172.21.15.7:0/3846762879 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1fcc0a35d0 msgr2=0x7f1fcc0a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:28.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.227+0000 7f1fe2e9c640 1 --2- 172.21.15.7:0/3846762879 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1fcc0a35d0 0x7f1fcc0a5a90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x555d64a27ed0 tx=0x7f1fd000a2d0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.227+0000 7f1fe2e9c640 1 -- 172.21.15.7:0/3846762879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fdc102570 msgr2=0x7f1fdc196620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:28.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.227+0000 7f1fe2e9c640 1 --2- 172.21.15.7:0/3846762879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fdc102570 0x7f1fdc196620 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1fc80309c0 tx=0x7f1fc80309f0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.227+0000 7f1fe2e9c640 1 -- 172.21.15.7:0/3846762879 shutdown_connections 2024-09-19T08:45:28.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.227+0000 7f1fe2e9c640 1 --2- 172.21.15.7:0/3846762879 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1fcc0a35d0 0x7f1fcc0a5a90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.227+0000 7f1fe2e9c640 1 --2- 172.21.15.7:0/3846762879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fdc102ef0 0x7f1fdc19a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.227+0000 7f1fe2e9c640 1 --2- 172.21.15.7:0/3846762879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1fdc102570 0x7f1fdc196620 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.227+0000 7f1fe2e9c640 1 --2- 172.21.15.7:0/3846762879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fdc100e20 0x7f1fdc1960e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.227+0000 7f1fe2e9c640 1 -- 172.21.15.7:0/3846762879 >> 172.21.15.7:0/3846762879 conn(0x7f1fdc0fc7d0 msgr2=0x7f1fdc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:28.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.227+0000 7f1fe2e9c640 1 -- 172.21.15.7:0/3846762879 shutdown_connections 2024-09-19T08:45:28.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.227+0000 7f1fe2e9c640 1 -- 172.21.15.7:0/3846762879 wait complete. 2024-09-19T08:45:28.415 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:28 smithi007 ceph-mon[31221]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-19T08:45:28.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:28 smithi044 ceph-mon[35072]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-19T08:45:28.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.586+0000 7f9c2929d640 1 -- 172.21.15.7:0/1000749344 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c241021d0 con 0x7f9c24101df0 2024-09-19T08:45:28.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.587+0000 7f9c20ff9640 1 -- 172.21.15.7:0/1000749344 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f9c241021d0 con 0x7f9c24101df0 2024-09-19T08:45:28.587 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:45:28.587 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:45:28.588 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:45:28.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.591+0000 7f9c2929d640 1 -- 172.21.15.7:0/1000749344 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9c100a3550 msgr2=0x7f9c100a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:28.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.591+0000 7f9c2929d640 1 --2- 172.21.15.7:0/1000749344 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9c100a3550 0x7f9c100a5a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0095f0 tx=0x7f9c0c005f90 comp rx=0 tx=0).stop 2024-09-19T08:45:28.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.591+0000 7f9c2929d640 1 -- 172.21.15.7:0/1000749344 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c24101df0 msgr2=0x7f9c241a4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:28.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.591+0000 7f9c2929d640 1 --2- 172.21.15.7:0/1000749344 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c24101df0 0x7f9c241a4690 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9c14006010 tx=0x7f9c140042f0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.591+0000 7f9c2929d640 1 -- 172.21.15.7:0/1000749344 shutdown_connections 2024-09-19T08:45:28.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.591+0000 7f9c2929d640 1 --2- 172.21.15.7:0/1000749344 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9c100a3550 0x7f9c100a5a10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.591+0000 7f9c2929d640 1 --2- 172.21.15.7:0/1000749344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c24106f20 0x7f9c2410dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.591+0000 7f9c2929d640 1 --2- 172.21.15.7:0/1000749344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c241027a0 0x7f9c241a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.591+0000 7f9c2929d640 1 --2- 172.21.15.7:0/1000749344 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c24101df0 0x7f9c241a4690 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:28.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.591+0000 7f9c2929d640 1 -- 172.21.15.7:0/1000749344 >> 172.21.15.7:0/1000749344 conn(0x7f9c240fd8f0 msgr2=0x7f9c240fdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:28.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.591+0000 7f9c2929d640 1 -- 172.21.15.7:0/1000749344 shutdown_connections 2024-09-19T08:45:28.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:28.591+0000 7f9c2929d640 1 -- 172.21.15.7:0/1000749344 wait complete. 2024-09-19T08:45:28.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:28 smithi175 ceph-mon[35688]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-19T08:45:29.316 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24491 quiesce db --set-id 20b786cd --release --await' 2024-09-19T08:45:29.316 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24491 quiesce db --set-id 20b786cd --release --await 2024-09-19T08:45:29.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:29 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1000749344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:45:29.577 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:29 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1000749344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:45:29.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:29 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1000749344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:45:29.866 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:30.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.387+0000 7f547fd47640 1 -- 172.21.15.7:0/1172989442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5478102d30 msgr2=0x7f5478103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:30.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.387+0000 7f547fd47640 1 --2- 172.21.15.7:0/1172989442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5478102d30 0x7f5478103110 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5474009930 tx=0x7f547402a420 comp rx=0 tx=0).stop 2024-09-19T08:45:30.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.387+0000 7f547fd47640 1 -- 172.21.15.7:0/1172989442 shutdown_connections 2024-09-19T08:45:30.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.387+0000 7f547fd47640 1 --2- 172.21.15.7:0/1172989442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54781082a0 0x7f547810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.387+0000 7f547fd47640 1 --2- 172.21.15.7:0/1172989442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54781036e0 0x7f5478107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.387+0000 7f547fd47640 1 --2- 172.21.15.7:0/1172989442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5478102d30 0x7f5478103110 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.387+0000 7f547fd47640 1 -- 172.21.15.7:0/1172989442 >> 172.21.15.7:0/1172989442 conn(0x7f54780fc7d0 msgr2=0x7f54780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:30.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.387+0000 7f547fd47640 1 -- 172.21.15.7:0/1172989442 shutdown_connections 2024-09-19T08:45:30.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.387+0000 7f547fd47640 1 -- 172.21.15.7:0/1172989442 wait complete. 2024-09-19T08:45:30.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.388+0000 7f547fd47640 1 Processor -- start 2024-09-19T08:45:30.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.388+0000 7f547fd47640 1 -- start start 2024-09-19T08:45:30.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.388+0000 7f547fd47640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5478102d30 0x7f54781985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:30.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.388+0000 7f547fd47640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54781036e0 0x7f5478198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:30.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.388+0000 7f547fd47640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54781082a0 0x7f547819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:30.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.388+0000 7f547fd47640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f54781120a0 con 0x7f54781082a0 2024-09-19T08:45:30.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.388+0000 7f547fd47640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5478111f20 con 0x7f54781036e0 2024-09-19T08:45:30.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.388+0000 7f547fd47640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5478112220 con 0x7f5478102d30 2024-09-19T08:45:30.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.388+0000 7f547e2e4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54781082a0 0x7f547819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:30.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.388+0000 7f547e2e4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54781082a0 0x7f547819ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35560/0 (socket says 172.21.15.7:35560) 2024-09-19T08:45:30.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.388+0000 7f547e2e4640 1 -- 172.21.15.7:0/3693994670 learned_addr learned my addr 172.21.15.7:0/3693994670 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:30.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.388+0000 7f547dae3640 1 --2- 172.21.15.7:0/3693994670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5478102d30 0x7f54781985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:30.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.389+0000 7f547e2e4640 1 -- 172.21.15.7:0/3693994670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5478102d30 msgr2=0x7f54781985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:30.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.389+0000 7f547e2e4640 1 --2- 172.21.15.7:0/3693994670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5478102d30 0x7f54781985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.389+0000 7f547e2e4640 1 -- 172.21.15.7:0/3693994670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54781036e0 msgr2=0x7f5478198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:30.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.389+0000 7f547e2e4640 1 --2- 172.21.15.7:0/3693994670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54781036e0 0x7f5478198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.389+0000 7f547e2e4640 1 -- 172.21.15.7:0/3693994670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547819d550 con 0x7f54781082a0 2024-09-19T08:45:30.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.389+0000 7f547e2e4640 1 --2- 172.21.15.7:0/3693994670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54781082a0 0x7f547819ce70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5470009fd0 tx=0x7f547000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:30.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.389+0000 7f546effd640 1 -- 172.21.15.7:0/3693994670 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5470017070 con 0x7f54781082a0 2024-09-19T08:45:30.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.389+0000 7f546effd640 1 -- 172.21.15.7:0/3693994670 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5470003e50 con 0x7f54781082a0 2024-09-19T08:45:30.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.389+0000 7f547fd47640 1 -- 172.21.15.7:0/3693994670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f547819d840 con 0x7f54781082a0 2024-09-19T08:45:30.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.389+0000 7f546effd640 1 -- 172.21.15.7:0/3693994670 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54700106c0 con 0x7f54781082a0 2024-09-19T08:45:30.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.390+0000 7f547fd47640 1 -- 172.21.15.7:0/3693994670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54781008c0 con 0x7f54781082a0 2024-09-19T08:45:30.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.393+0000 7f546effd640 1 -- 172.21.15.7:0/3693994670 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 138587+0+0 (secure 0 0 0) 0x7f5470003970 con 0x7f54781082a0 2024-09-19T08:45:30.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.393+0000 7f5482120740 1 Processor -- start 2024-09-19T08:45:30.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.393+0000 7f5482120740 1 -- start start 2024-09-19T08:45:30.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.394+0000 7f5482120740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0ec51a060 0x55a0ec51a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:30.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.394+0000 7f5482120740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a980 0x55a0ec524d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:30.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.394+0000 7f5482120740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec525240 0x55a0ec527630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:30.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.394+0000 7f5482120740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a0ec47f620 con 0x55a0ec51a980 2024-09-19T08:45:30.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.394+0000 7f5482120740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a0ec426e50 con 0x55a0ec525240 2024-09-19T08:45:30.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.394+0000 7f5482120740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a0ec47b5e0 con 0x55a0ec51a060 2024-09-19T08:45:30.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.394+0000 7f547dae3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a980 0x55a0ec524d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:30.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.394+0000 7f547dae3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a980 0x55a0ec524d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35566/0 (socket says 172.21.15.7:35566) 2024-09-19T08:45:30.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.394+0000 7f547dae3640 1 -- 172.21.15.7:0/1358156081 learned_addr learned my addr 172.21.15.7:0/1358156081 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:30.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.394+0000 7f547d2e2640 1 --2- 172.21.15.7:0/1358156081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec525240 0x55a0ec527630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:30.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.394+0000 7f546effd640 1 --2- 172.21.15.7:0/3693994670 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f54640a34d0 0x7f54640a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:30.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.394+0000 7f547d2e2640 1 --2- 172.21.15.7:0/1358156081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0ec51a060 0x55a0ec51a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:30.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.394+0000 7f547e2e4640 1 --2- 172.21.15.7:0/3693994670 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f54640a34d0 0x7f54640a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:30.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.395+0000 7f547dae3640 1 -- 172.21.15.7:0/1358156081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0ec51a060 msgr2=0x55a0ec51a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:30.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.395+0000 7f547dae3640 1 --2- 172.21.15.7:0/1358156081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0ec51a060 0x55a0ec51a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.395+0000 7f547dae3640 1 -- 172.21.15.7:0/1358156081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec525240 msgr2=0x55a0ec527630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:30.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.395+0000 7f547dae3640 1 --2- 172.21.15.7:0/1358156081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec525240 0x55a0ec527630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.395+0000 7f547dae3640 1 -- 172.21.15.7:0/1358156081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0ec417d40 con 0x55a0ec51a980 2024-09-19T08:45:30.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.395+0000 7f546effd640 1 -- 172.21.15.7:0/3693994670 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f54700cfd50 con 0x7f54781082a0 2024-09-19T08:45:30.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.395+0000 7f547dae3640 1 --2- 172.21.15.7:0/1358156081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a980 0x55a0ec524d00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f547402a940 tx=0x7f5474005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36dbdc425d46bd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:30.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.395+0000 7f5463fff640 1 -- 172.21.15.7:0/1358156081 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5474040070 con 0x55a0ec51a980 2024-09-19T08:45:30.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.395+0000 7f5463fff640 1 -- 172.21.15.7:0/1358156081 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5474031930 con 0x55a0ec51a980 2024-09-19T08:45:30.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.395+0000 7f547e2e4640 1 --2- 172.21.15.7:0/3693994670 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f54640a34d0 0x7f54640a5990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f54700cd370 tx=0x7f5470018460 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:30.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.396+0000 7f5463fff640 1 -- 172.21.15.7:0/1358156081 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5474035040 con 0x55a0ec51a980 2024-09-19T08:45:30.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.396+0000 7f5482120740 1 -- 172.21.15.7:0/1358156081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a980 msgr2=0x55a0ec524d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:30.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.396+0000 7f5482120740 1 --2- 172.21.15.7:0/1358156081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a980 0x55a0ec524d00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f547402a940 tx=0x7f5474005c00 comp rx=0 tx=0).stop 2024-09-19T08:45:30.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.396+0000 7f5482120740 1 -- 172.21.15.7:0/1358156081 shutdown_connections 2024-09-19T08:45:30.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.396+0000 7f5482120740 1 --2- 172.21.15.7:0/1358156081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec525240 0x55a0ec527630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.396+0000 7f5482120740 1 --2- 172.21.15.7:0/1358156081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a980 0x55a0ec524d00 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.396+0000 7f5482120740 1 --2- 172.21.15.7:0/1358156081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0ec51a060 0x55a0ec51a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.396+0000 7f5482120740 1 -- 172.21.15.7:0/1358156081 >> 172.21.15.7:0/1358156081 conn(0x55a0ec5165f0 msgr2=0x55a0ec5169d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:30.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.397+0000 7f5482120740 1 -- 172.21.15.7:0/1358156081 shutdown_connections 2024-09-19T08:45:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.397+0000 7f5482120740 1 -- 172.21.15.7:0/1358156081 wait complete. 2024-09-19T08:45:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.397+0000 7f5482120740 1 -- start start 2024-09-19T08:45:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.397+0000 7f5482120740 1 Processor -- start 2024-09-19T08:45:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.398+0000 7f5482120740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a060 0x55a0ec524c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.398+0000 7f5482120740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0ec51a980 0x55a0ec521f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.398+0000 7f5482120740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec525240 0x55a0ec5226d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.398+0000 7f5482120740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a0ec527e60 con 0x55a0ec51a060 2024-09-19T08:45:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.398+0000 7f5482120740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a0ec407f10 con 0x55a0ec525240 2024-09-19T08:45:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.398+0000 7f5482120740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a0ec527fe0 con 0x55a0ec51a980 2024-09-19T08:45:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.398+0000 7f5482120740 10 client.0 _ll_register_callbacks cb 0x55a0ec42bdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.398+0000 7f547d2e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a060 0x55a0ec524c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.398+0000 7f547d2e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a060 0x55a0ec524c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35578/0 (socket says 172.21.15.7:35578) 2024-09-19T08:45:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.398+0000 7f547d2e2640 1 -- 172.21.15.7:0/2700245446 learned_addr learned my addr 172.21.15.7:0/2700245446 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.398+0000 7f547dae3640 1 --2- 172.21.15.7:0/2700245446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0ec51a980 0x55a0ec521f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.398+0000 7f547d2e2640 1 --2- 172.21.15.7:0/2700245446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec525240 0x55a0ec5226d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.398+0000 7f547dae3640 1 -- 172.21.15.7:0/2700245446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec525240 msgr2=0x55a0ec5226d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.398+0000 7f547dae3640 1 --2- 172.21.15.7:0/2700245446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec525240 0x55a0ec5226d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.398+0000 7f547dae3640 1 -- 172.21.15.7:0/2700245446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a060 msgr2=0x55a0ec524c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.398+0000 7f547dae3640 1 --2- 172.21.15.7:0/2700245446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a060 0x55a0ec524c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.398+0000 7f547dae3640 1 -- 172.21.15.7:0/2700245446 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0ec18e580 con 0x55a0ec51a980 2024-09-19T08:45:30.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.398+0000 7f547d2e2640 1 --2- 172.21.15.7:0/2700245446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec525240 0x55a0ec5226d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:30.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.399+0000 7f547dae3640 1 --2- 172.21.15.7:0/2700245446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0ec51a980 0x55a0ec521f40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5474009900 tx=0x7f54740052b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48a88f8ec230bbd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:30.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.399+0000 7f54617fa640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-19T08:45:30.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.399+0000 7f54617fa640 1 -- 172.21.15.7:0/2700245446 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5474040030 con 0x55a0ec51a980 2024-09-19T08:45:30.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.399+0000 7f54617fa640 1 -- 172.21.15.7:0/2700245446 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f5474031730 con 0x55a0ec51a980 2024-09-19T08:45:30.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.399+0000 7f5482120740 1 -- 172.21.15.7:0/2700245446 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5474031930 con 0x55a0ec51a980 2024-09-19T08:45:30.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.399+0000 7f54617fa640 1 -- 172.21.15.7:0/2700245446 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5474035040 con 0x55a0ec51a980 2024-09-19T08:45:30.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.399+0000 7f5482120740 10 client.25150 fetch_fsmap learned FSMap version 25 2024-09-19T08:45:30.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.399+0000 7f5482120740 1 -- 172.21.15.7:0/2700245446 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a0ec258960 con 0x55a0ec51a980 2024-09-19T08:45:30.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.400+0000 7f54617fa640 1 -- 172.21.15.7:0/2700245446 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5474009520 con 0x55a0ec51a980 2024-09-19T08:45:30.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.400+0000 7f54617fa640 1 -- 172.21.15.7:0/2700245446 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f54740035f0 con 0x55a0ec51a980 2024-09-19T08:45:30.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.400+0000 7f5482120740 10 client.25150 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:45:30.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.400+0000 7f5482120740 10 client.25150 resolve_mds: validated gid 24491 aka daemon mds.b 2024-09-19T08:45:30.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.400+0000 7f5482120740 20 client.25150 populate_metadata read hostname 'smithi007' 2024-09-19T08:45:30.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.400+0000 7f5482120740 1 --2- 172.21.15.7:0/2700245446 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a0ec534b00 0x55a0ec536ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:30.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.400+0000 7f5482120740 4 client.25150 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:45:30.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.400+0000 7f5482120740 1 -- 172.21.15.7:0/2700245446 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5474031930 con 0x55a0ec534b00 2024-09-19T08:45:30.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.401+0000 7f547d2e2640 1 --2- 172.21.15.7:0/2700245446 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a0ec534b00 0x55a0ec536ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:30.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.401+0000 7f547d2e2640 1 --2- 172.21.15.7:0/2700245446 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a0ec534b00 0x55a0ec536ef0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=589283011364c2bd server_cookie=ceb81c9d77e0428f in_seq=0 out_seq=0 2024-09-19T08:45:30.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.401+0000 7f54617fa640 10 client.25150 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:30.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.402+0000 7f54617fa640 1 -- 172.21.15.7:0/2700245446 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f5474031930 con 0x55a0ec534b00 2024-09-19T08:45:30.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.402+0000 7f54617fa640 10 client.25150 handle_command_reply: tid=0 2024-09-19T08:45:30.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.402+0000 7f5482120740 1 client.25150 shutdown 2024-09-19T08:45:30.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.402+0000 7f5482120740 1 -- 172.21.15.7:0/2700245446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0ec51a980 msgr2=0x55a0ec521f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:30.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.402+0000 7f5482120740 1 --2- 172.21.15.7:0/2700245446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0ec51a980 0x55a0ec521f40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5474009900 tx=0x7f54740052b0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.402+0000 7f5482120740 1 -- 172.21.15.7:0/2700245446 shutdown_connections 2024-09-19T08:45:30.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.402+0000 7f5482120740 1 --2- 172.21.15.7:0/2700245446 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a0ec534b00 0x55a0ec536ef0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.402+0000 7f5482120740 1 --2- 172.21.15.7:0/2700245446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec525240 0x55a0ec5226d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.402+0000 7f5482120740 1 --2- 172.21.15.7:0/2700245446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0ec51a980 0x55a0ec521f40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.402+0000 7f5482120740 1 --2- 172.21.15.7:0/2700245446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a060 0x55a0ec524c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.402+0000 7f5482120740 1 -- 172.21.15.7:0/2700245446 >> 172.21.15.7:0/2700245446 conn(0x55a0ec5165f0 msgr2=0x55a0ec51c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:30.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.403+0000 7f54617fa640 0 client.25150 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:30.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.403+0000 7f5482120740 1 -- 172.21.15.7:0/2700245446 shutdown_connections 2024-09-19T08:45:30.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.403+0000 7f5482120740 1 -- 172.21.15.7:0/2700245446 wait complete. 2024-09-19T08:45:30.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.403+0000 7f5482120740 20 client.25150 trim_cache size 0 max 16384 2024-09-19T08:45:30.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.435+0000 7f5482120740 1 Processor -- start 2024-09-19T08:45:30.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.435+0000 7f5482120740 1 -- start start 2024-09-19T08:45:30.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.436+0000 7f5482120740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a060 0x55a0ec539b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:30.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.436+0000 7f5482120740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec51a980 0x55a0ec53a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.436+0000 7f5482120740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0ec525240 0x55a0ec526630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.436+0000 7f5482120740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f54781b6800 con 0x55a0ec51a060 2024-09-19T08:45:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.436+0000 7f5482120740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f54781b40d0 con 0x55a0ec51a980 2024-09-19T08:45:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.436+0000 7f5482120740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f54781b1f20 con 0x55a0ec525240 2024-09-19T08:45:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.436+0000 7f547d2e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a060 0x55a0ec539b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.436+0000 7f547dae3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec51a980 0x55a0ec53a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.436+0000 7f547dae3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec51a980 0x55a0ec53a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:56394/0 (socket says 172.21.15.7:56394) 2024-09-19T08:45:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.436+0000 7f547d2e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a060 0x55a0ec539b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35582/0 (socket says 172.21.15.7:35582) 2024-09-19T08:45:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.436+0000 7f547dae3640 1 -- 172.21.15.7:0/2594331851 learned_addr learned my addr 172.21.15.7:0/2594331851 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.436+0000 7f547d2e2640 1 --2- 172.21.15.7:0/2594331851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0ec525240 0x55a0ec526630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.436+0000 7f547d2e2640 1 -- 172.21.15.7:0/2594331851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0ec525240 msgr2=0x55a0ec526630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.436+0000 7f547d2e2640 1 --2- 172.21.15.7:0/2594331851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0ec525240 0x55a0ec526630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.436+0000 7f547d2e2640 1 -- 172.21.15.7:0/2594331851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec51a980 msgr2=0x55a0ec53a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:30.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.436+0000 7f547d2e2640 1 --2- 172.21.15.7:0/2594331851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec51a980 0x55a0ec53a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.436+0000 7f547d2e2640 1 -- 172.21.15.7:0/2594331851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0ec520ef0 con 0x55a0ec51a060 2024-09-19T08:45:30.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.437+0000 7f547d2e2640 1 --2- 172.21.15.7:0/2594331851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a060 0x55a0ec539b30 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5474005580 tx=0x7f54680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f7db3418d110972 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:30.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.437+0000 7f54637fe640 1 -- 172.21.15.7:0/2594331851 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5468022c40 con 0x55a0ec51a060 2024-09-19T08:45:30.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.437+0000 7f54637fe640 1 -- 172.21.15.7:0/2594331851 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f546801e930 con 0x55a0ec51a060 2024-09-19T08:45:30.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.437+0000 7f54637fe640 1 -- 172.21.15.7:0/2594331851 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54680289f0 con 0x55a0ec51a060 2024-09-19T08:45:30.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.438+0000 7f5482120740 1 -- 172.21.15.7:0/2594331851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a060 msgr2=0x55a0ec539b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:30.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.438+0000 7f5482120740 1 --2- 172.21.15.7:0/2594331851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a060 0x55a0ec539b30 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5474005580 tx=0x7f54680046c0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.438+0000 7f5482120740 1 -- 172.21.15.7:0/2594331851 shutdown_connections 2024-09-19T08:45:30.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.438+0000 7f5482120740 1 --2- 172.21.15.7:0/2594331851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0ec525240 0x55a0ec526630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.438+0000 7f5482120740 1 --2- 172.21.15.7:0/2594331851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec51a980 0x55a0ec53a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.438+0000 7f5482120740 1 --2- 172.21.15.7:0/2594331851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a060 0x55a0ec539b30 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.438+0000 7f5482120740 1 -- 172.21.15.7:0/2594331851 >> 172.21.15.7:0/2594331851 conn(0x55a0ec5165f0 msgr2=0x55a0ec523fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:30.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.438+0000 7f5482120740 1 -- 172.21.15.7:0/2594331851 shutdown_connections 2024-09-19T08:45:30.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.438+0000 7f5482120740 1 -- 172.21.15.7:0/2594331851 wait complete. 2024-09-19T08:45:30.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.439+0000 7f5482120740 1 -- start start 2024-09-19T08:45:30.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.439+0000 7f5482120740 1 Processor -- start 2024-09-19T08:45:30.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.439+0000 7f5482120740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a060 0x55a0ec53a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:30.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.439+0000 7f5482120740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec51a980 0x55a0ec536510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:30.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.439+0000 7f5482120740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0ec525240 0x55a0ec536a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:30.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.439+0000 7f5482120740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f54781b2590 con 0x55a0ec51a060 2024-09-19T08:45:30.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.439+0000 7f5482120740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f54781b3a00 con 0x55a0ec51a980 2024-09-19T08:45:30.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.439+0000 7f5482120740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f54781b2c60 con 0x55a0ec525240 2024-09-19T08:45:30.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.439+0000 7f5482120740 10 client.0 _ll_register_callbacks cb 0x7f546800dda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:30.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.440+0000 7f547d2e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a060 0x55a0ec53a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:30.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.440+0000 7f547d2e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a060 0x55a0ec53a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35590/0 (socket says 172.21.15.7:35590) 2024-09-19T08:45:30.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.440+0000 7f547d2e2640 1 -- 172.21.15.7:0/4008180914 learned_addr learned my addr 172.21.15.7:0/4008180914 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:30.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.440+0000 7f547dae3640 1 --2- 172.21.15.7:0/4008180914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec51a980 0x55a0ec536510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:30.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.440+0000 7f547d2e2640 1 --2- 172.21.15.7:0/4008180914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0ec525240 0x55a0ec536a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:30.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.440+0000 7f547d2e2640 1 -- 172.21.15.7:0/4008180914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0ec525240 msgr2=0x55a0ec536a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:30.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.440+0000 7f547d2e2640 1 --2- 172.21.15.7:0/4008180914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0ec525240 0x55a0ec536a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.440+0000 7f547d2e2640 1 -- 172.21.15.7:0/4008180914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec51a980 msgr2=0x55a0ec536510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:30.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.440+0000 7f547d2e2640 1 --2- 172.21.15.7:0/4008180914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec51a980 0x55a0ec536510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.440+0000 7f547d2e2640 1 -- 172.21.15.7:0/4008180914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0ec51a7b0 con 0x55a0ec51a060 2024-09-19T08:45:30.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.440+0000 7f547dae3640 1 --2- 172.21.15.7:0/4008180914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec51a980 0x55a0ec536510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:30.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.440+0000 7f547d2e2640 1 --2- 172.21.15.7:0/4008180914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a060 0x55a0ec53a180 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f54680286d0 tx=0x7f5468005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bbf217ed3661703 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:30.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.440+0000 7f54617fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:45:30.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.441+0000 7f54617fa640 1 -- 172.21.15.7:0/4008180914 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546801e450 con 0x55a0ec51a060 2024-09-19T08:45:30.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.441+0000 7f54617fa640 1 -- 172.21.15.7:0/4008180914 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f546801e5f0 con 0x55a0ec51a060 2024-09-19T08:45:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.441+0000 7f5482120740 1 -- 172.21.15.7:0/4008180914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f546801e930 con 0x55a0ec51a060 2024-09-19T08:45:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.441+0000 7f54617fa640 1 -- 172.21.15.7:0/4008180914 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f546801eae0 con 0x55a0ec51a060 2024-09-19T08:45:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.441+0000 7f5482120740 10 client.15546 fetch_fsmap learned FSMap version 25 2024-09-19T08:45:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.441+0000 7f5482120740 1 -- 172.21.15.7:0/4008180914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a0ec5a0190 con 0x55a0ec51a060 2024-09-19T08:45:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.441+0000 7f54617fa640 1 -- 172.21.15.7:0/4008180914 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f546801e930 con 0x55a0ec51a060 2024-09-19T08:45:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.441+0000 7f54617fa640 1 -- 172.21.15.7:0/4008180914 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f54680047a0 con 0x55a0ec51a060 2024-09-19T08:45:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.441+0000 7f5482120740 10 client.15546 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:45:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.441+0000 7f5482120740 10 client.15546 resolve_mds: validated gid 24491 aka daemon mds.b 2024-09-19T08:45:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.442+0000 7f5482120740 20 client.15546 populate_metadata read hostname 'smithi007' 2024-09-19T08:45:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.442+0000 7f5482120740 1 --2- 172.21.15.7:0/4008180914 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a0ec5a0850 0x55a0ec5a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.442+0000 7f5482120740 4 client.15546 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "20b786cd", "release": true, "await": true}] 2024-09-19T08:45:30.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.442+0000 7f5482120740 1 -- 172.21.15.7:0/4008180914 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "quiesce db", "set_id": "20b786cd", "release": true, "await": true}) -- 0x55a0ec48cb90 con 0x55a0ec5a0850 2024-09-19T08:45:30.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.442+0000 7f547dae3640 1 --2- 172.21.15.7:0/4008180914 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a0ec5a0850 0x55a0ec5a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:30.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.442+0000 7f54617fa640 10 client.15546 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:30.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.442+0000 7f547dae3640 1 --2- 172.21.15.7:0/4008180914 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a0ec5a0850 0x55a0ec5a2c70 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de88f63d699c1b08 server_cookie=31a9ab972dda94e3 in_seq=0 out_seq=0 2024-09-19T08:45:30.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.444+0000 7f54617fa640 1 -- 172.21.15.7:0/4008180914 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55a0ec48cb90 con 0x55a0ec5a0850 2024-09-19T08:45:30.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.444+0000 7f54617fa640 10 client.15546 handle_command_reply: tid=0 2024-09-19T08:45:30.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.444+0000 7f5482120740 1 client.15546 shutdown 2024-09-19T08:45:30.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.444+0000 7f5482120740 1 -- 172.21.15.7:0/4008180914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a060 msgr2=0x55a0ec53a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:30.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.444+0000 7f5482120740 1 --2- 172.21.15.7:0/4008180914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a060 0x55a0ec53a180 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f54680286d0 tx=0x7f5468005fd0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.444+0000 7f5482120740 1 -- 172.21.15.7:0/4008180914 shutdown_connections 2024-09-19T08:45:30.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.444+0000 7f5482120740 1 --2- 172.21.15.7:0/4008180914 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a0ec5a0850 0x55a0ec5a2c70 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.444+0000 7f5482120740 1 --2- 172.21.15.7:0/4008180914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a0ec525240 0x55a0ec536a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.444+0000 7f5482120740 1 --2- 172.21.15.7:0/4008180914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0ec51a980 0x55a0ec536510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.444+0000 7f54617fa640 0 client.15546 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:30.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.444+0000 7f5482120740 1 --2- 172.21.15.7:0/4008180914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0ec51a060 0x55a0ec53a180 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.444+0000 7f5482120740 1 -- 172.21.15.7:0/4008180914 >> 172.21.15.7:0/4008180914 conn(0x55a0ec5165f0 msgr2=0x55a0ec5237a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:30.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.445+0000 7f5482120740 1 -- 172.21.15.7:0/4008180914 shutdown_connections 2024-09-19T08:45:30.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.445+0000 7f5482120740 1 -- 172.21.15.7:0/4008180914 wait complete. 2024-09-19T08:45:30.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.445+0000 7f5482120740 20 client.15546 trim_cache size 0 max 16384 2024-09-19T08:45:30.458 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:45:30.458 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 25, 2024-09-19T08:45:30.458 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24491, 2024-09-19T08:45:30.458 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 4, 2024-09-19T08:45:30.459 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": { 2024-09-19T08:45:30.459 INFO:teuthology.orchestra.run.smithi007.stdout: "20b786cd": { 2024-09-19T08:45:30.459 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 4, 2024-09-19T08:45:30.459 INFO:teuthology.orchestra.run.smithi007.stdout: "age_ref": 0.0, 2024-09-19T08:45:30.459 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T08:45:30.459 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RELEASED", 2024-09-19T08:45:30.459 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T08:45:30.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:45:30.459 INFO:teuthology.orchestra.run.smithi007.stdout: "timeout": 90.0, 2024-09-19T08:45:30.459 INFO:teuthology.orchestra.run.smithi007.stdout: "expiration": 131.2, 2024-09-19T08:45:30.459 INFO:teuthology.orchestra.run.smithi007.stdout: "members": { 2024-09-19T08:45:30.459 INFO:teuthology.orchestra.run.smithi007.stdout: "file:/": { 2024-09-19T08:45:30.460 INFO:teuthology.orchestra.run.smithi007.stdout: "excluded": false, 2024-09-19T08:45:30.460 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T08:45:30.460 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RELEASED", 2024-09-19T08:45:30.460 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T08:45:30.460 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:45:30.460 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:45:30.460 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:45:30.460 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:45:30.460 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:45:30.460 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:45:30.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.445+0000 7f547fd47640 1 -- 172.21.15.7:0/3693994670 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f54640a34d0 msgr2=0x7f54640a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:30.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.445+0000 7f547fd47640 1 --2- 172.21.15.7:0/3693994670 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f54640a34d0 0x7f54640a5990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f54700cd370 tx=0x7f5470018460 comp rx=0 tx=0).stop 2024-09-19T08:45:30.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.445+0000 7f547fd47640 1 -- 172.21.15.7:0/3693994670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54781082a0 msgr2=0x7f547819ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:30.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.445+0000 7f547fd47640 1 --2- 172.21.15.7:0/3693994670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54781082a0 0x7f547819ce70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5470009fd0 tx=0x7f547000b260 comp rx=0 tx=0).stop 2024-09-19T08:45:30.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.446+0000 7f547fd47640 1 -- 172.21.15.7:0/3693994670 shutdown_connections 2024-09-19T08:45:30.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.446+0000 7f547fd47640 1 --2- 172.21.15.7:0/3693994670 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f54640a34d0 0x7f54640a5990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.446+0000 7f547fd47640 1 --2- 172.21.15.7:0/3693994670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54781082a0 0x7f547819ce70 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.446+0000 7f547fd47640 1 --2- 172.21.15.7:0/3693994670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54781036e0 0x7f5478198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.446+0000 7f547fd47640 1 --2- 172.21.15.7:0/3693994670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5478102d30 0x7f54781985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.446+0000 7f547fd47640 1 -- 172.21.15.7:0/3693994670 >> 172.21.15.7:0/3693994670 conn(0x7f54780fc7d0 msgr2=0x7f5478105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:30.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.446+0000 7f547fd47640 1 -- 172.21.15.7:0/3693994670 shutdown_connections 2024-09-19T08:45:30.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:30.446+0000 7f547fd47640 1 -- 172.21.15.7:0/3693994670 wait complete. 2024-09-19T08:45:30.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:30 smithi044 ceph-mon[35072]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-19T08:45:30.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:30 smithi175 ceph-mon[35688]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-19T08:45:30.755 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:30 smithi007 ceph-mon[31221]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-19T08:45:30.775 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:45:30.775 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:45:31.195 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '20b786cd', total seconds elapsed: 15.3 2024-09-19T08:45:31.252 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:31.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.782+0000 7f987846d640 1 -- 172.21.15.7:0/1595825785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98701082a0 msgr2=0x7f987010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:31.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.782+0000 7f987846d640 1 --2- 172.21.15.7:0/1595825785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98701082a0 0x7f987010ec40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9868009cd0 tx=0x7f986802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.783+0000 7f987846d640 1 -- 172.21.15.7:0/1595825785 shutdown_connections 2024-09-19T08:45:31.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.783+0000 7f987846d640 1 --2- 172.21.15.7:0/1595825785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98701082a0 0x7f987010ec40 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.783+0000 7f987846d640 1 --2- 172.21.15.7:0/1595825785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98701036e0 0x7f9870107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.783+0000 7f987846d640 1 --2- 172.21.15.7:0/1595825785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9870102d30 0x7f9870103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.783+0000 7f987846d640 1 -- 172.21.15.7:0/1595825785 >> 172.21.15.7:0/1595825785 conn(0x7f98700fc7d0 msgr2=0x7f98700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:31.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.783+0000 7f987846d640 1 -- 172.21.15.7:0/1595825785 shutdown_connections 2024-09-19T08:45:31.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.783+0000 7f987846d640 1 -- 172.21.15.7:0/1595825785 wait complete. 2024-09-19T08:45:31.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.784+0000 7f987846d640 1 Processor -- start 2024-09-19T08:45:31.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.784+0000 7f987846d640 1 -- start start 2024-09-19T08:45:31.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.784+0000 7f987846d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9870102d30 0x7f98701985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:31.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.784+0000 7f987846d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98701036e0 0x7f9870198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:31.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.784+0000 7f987846d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98701082a0 0x7f987019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:31.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.785+0000 7f987846d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f98701120f0 con 0x7f98701036e0 2024-09-19T08:45:31.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.785+0000 7f987846d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9870111f70 con 0x7f98701082a0 2024-09-19T08:45:31.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.785+0000 7f987846d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9870112270 con 0x7f9870102d30 2024-09-19T08:45:31.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.785+0000 7f9875a08640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98701036e0 0x7f9870198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:31.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.785+0000 7f9876a0a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98701082a0 0x7f987019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:31.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.785+0000 7f9876a0a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98701082a0 0x7f987019cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:56420/0 (socket says 172.21.15.7:56420) 2024-09-19T08:45:31.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.785+0000 7f9876a0a640 1 -- 172.21.15.7:0/2475682651 learned_addr learned my addr 172.21.15.7:0/2475682651 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:31.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.785+0000 7f9876a0a640 1 -- 172.21.15.7:0/2475682651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9870102d30 msgr2=0x7f98701985d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T08:45:31.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.785+0000 7f9876a0a640 1 --2- 172.21.15.7:0/2475682651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9870102d30 0x7f98701985d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.785+0000 7f9876a0a640 1 -- 172.21.15.7:0/2475682651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98701036e0 msgr2=0x7f9870198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:31.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.785+0000 7f9876a0a640 1 --2- 172.21.15.7:0/2475682651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98701036e0 0x7f9870198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.785+0000 7f9876a0a640 1 -- 172.21.15.7:0/2475682651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987019d580 con 0x7f98701082a0 2024-09-19T08:45:31.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.785+0000 7f9875a08640 1 --2- 172.21.15.7:0/2475682651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98701036e0 0x7f9870198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:45:31.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.786+0000 7f9876a0a640 1 --2- 172.21.15.7:0/2475682651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98701082a0 0x7f987019cea0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9868033040 tx=0x7f9868031e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:31.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.786+0000 7f98677fe640 1 -- 172.21.15.7:0/2475682651 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9868004040 con 0x7f98701082a0 2024-09-19T08:45:31.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.786+0000 7f98677fe640 1 -- 172.21.15.7:0/2475682651 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98680046c0 con 0x7f98701082a0 2024-09-19T08:45:31.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.786+0000 7f987846d640 1 -- 172.21.15.7:0/2475682651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f987019d810 con 0x7f98701082a0 2024-09-19T08:45:31.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.786+0000 7f98677fe640 1 -- 172.21.15.7:0/2475682651 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9868046480 con 0x7f98701082a0 2024-09-19T08:45:31.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.786+0000 7f987846d640 1 -- 172.21.15.7:0/2475682651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f987019dc90 con 0x7f98701082a0 2024-09-19T08:45:31.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.789+0000 7f987a846740 1 Processor -- start 2024-09-19T08:45:31.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.789+0000 7f98677fe640 1 -- 172.21.15.7:0/2475682651 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 24) ==== 138587+0+0 (secure 0 0 0) 0x7f98680305a0 con 0x7f98701082a0 2024-09-19T08:45:31.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.790+0000 7f987a846740 1 -- start start 2024-09-19T08:45:31.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.790+0000 7f987a846740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562f70d59a80 0x562f70d59e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:31.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.790+0000 7f987a846740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f70d5a3a0 0x562f70d68c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:31.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.790+0000 7f987a846740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d69150 0x562f70d6b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:31.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.790+0000 7f987a846740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562f70cbf280 con 0x562f70d69150 2024-09-19T08:45:31.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.790+0000 7f987a846740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562f70c66b10 con 0x562f70d59a80 2024-09-19T08:45:31.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.790+0000 7f987a846740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562f70cbb240 con 0x562f70d5a3a0 2024-09-19T08:45:31.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.790+0000 7f9875a08640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d69150 0x562f70d6b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:31.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.791+0000 7f9875a08640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d69150 0x562f70d6b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35624/0 (socket says 172.21.15.7:35624) 2024-09-19T08:45:31.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.791+0000 7f9875a08640 1 -- 172.21.15.7:0/3354952933 learned_addr learned my addr 172.21.15.7:0/3354952933 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:31.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.791+0000 7f98677fe640 1 --2- 172.21.15.7:0/2475682651 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f985c0a35d0 0x7f985c0a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:31.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.791+0000 7f9876209640 1 --2- 172.21.15.7:0/3354952933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f70d5a3a0 0x562f70d68c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:31.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.791+0000 7f9875a08640 1 --2- 172.21.15.7:0/3354952933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562f70d59a80 0x562f70d59e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:31.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.791+0000 7f9875a08640 1 -- 172.21.15.7:0/3354952933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f70d5a3a0 msgr2=0x562f70d68c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:31.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.791+0000 7f9875a08640 1 --2- 172.21.15.7:0/3354952933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f70d5a3a0 0x562f70d68c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.791+0000 7f9875a08640 1 -- 172.21.15.7:0/3354952933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562f70d59a80 msgr2=0x562f70d59e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:31.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.791+0000 7f9875a08640 1 --2- 172.21.15.7:0/3354952933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562f70d59a80 0x562f70d59e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.791+0000 7f9875a08640 1 -- 172.21.15.7:0/3354952933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f70c731f0 con 0x562f70d69150 2024-09-19T08:45:31.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.791+0000 7f9876a0a640 1 --2- 172.21.15.7:0/2475682651 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f985c0a35d0 0x7f985c0a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:31.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.791+0000 7f98677fe640 1 -- 172.21.15.7:0/2475682651 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f986802e030 con 0x7f98701082a0 2024-09-19T08:45:31.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.791+0000 7f9875a08640 1 --2- 172.21.15.7:0/3354952933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d69150 0x562f70d6b540 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9860011740 tx=0x7f9860009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3247c81f4454886 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:31.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.792+0000 7f9864dea640 1 -- 172.21.15.7:0/3354952933 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9860011130 con 0x562f70d69150 2024-09-19T08:45:31.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.792+0000 7f9864dea640 1 -- 172.21.15.7:0/3354952933 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98600112d0 con 0x562f70d69150 2024-09-19T08:45:31.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.792+0000 7f9864dea640 1 -- 172.21.15.7:0/3354952933 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9860003830 con 0x562f70d69150 2024-09-19T08:45:31.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.793+0000 7f987a846740 1 -- 172.21.15.7:0/3354952933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d69150 msgr2=0x562f70d6b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:31.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.793+0000 7f987a846740 1 --2- 172.21.15.7:0/3354952933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d69150 0x562f70d6b540 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9860011740 tx=0x7f9860009cd0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.793+0000 7f9876a0a640 1 --2- 172.21.15.7:0/2475682651 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f985c0a35d0 0x7f985c0a5a90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f98680eecc0 tx=0x7f986804cfc0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:31.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.793+0000 7f987a846740 1 -- 172.21.15.7:0/3354952933 shutdown_connections 2024-09-19T08:45:31.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.793+0000 7f987a846740 1 --2- 172.21.15.7:0/3354952933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d69150 0x562f70d6b540 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.793+0000 7f987a846740 1 --2- 172.21.15.7:0/3354952933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f70d5a3a0 0x562f70d68c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.793+0000 7f987a846740 1 --2- 172.21.15.7:0/3354952933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562f70d59a80 0x562f70d59e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.793+0000 7f987a846740 1 -- 172.21.15.7:0/3354952933 >> 172.21.15.7:0/3354952933 conn(0x562f70d560f0 msgr2=0x562f70d564d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:31.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.793+0000 7f987a846740 1 -- 172.21.15.7:0/3354952933 shutdown_connections 2024-09-19T08:45:31.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.793+0000 7f987a846740 1 -- 172.21.15.7:0/3354952933 wait complete. 2024-09-19T08:45:31.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.794+0000 7f987a846740 1 -- start start 2024-09-19T08:45:31.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.794+0000 7f987a846740 1 Processor -- start 2024-09-19T08:45:31.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.794+0000 7f987a846740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562f70d59a80 0x562f70d68ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:31.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.794+0000 7f987a846740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d5a3a0 0x562f70d66090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:31.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.794+0000 7f987a846740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f70d69150 0x562f70d665d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:31.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.794+0000 7f987a846740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562f70d6bd60 con 0x562f70d5a3a0 2024-09-19T08:45:31.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.794+0000 7f987a846740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562f70c79f10 con 0x562f70d59a80 2024-09-19T08:45:31.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.794+0000 7f987a846740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562f70d6bee0 con 0x562f70d69150 2024-09-19T08:45:31.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.794+0000 7f987a846740 10 client.0 _ll_register_callbacks cb 0x562f70c42a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:31.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.795+0000 7f9876209640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d5a3a0 0x562f70d66090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:31.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.795+0000 7f9875a08640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562f70d59a80 0x562f70d68ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:31.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.795+0000 7f9875a08640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562f70d59a80 0x562f70d68ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:56434/0 (socket says 172.21.15.7:56434) 2024-09-19T08:45:31.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.795+0000 7f9875a08640 1 -- 172.21.15.7:0/4007667142 learned_addr learned my addr 172.21.15.7:0/4007667142 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:31.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.795+0000 7f9875a08640 1 --2- 172.21.15.7:0/4007667142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f70d69150 0x562f70d665d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:31.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.795+0000 7f9875a08640 1 -- 172.21.15.7:0/4007667142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f70d69150 msgr2=0x562f70d665d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:31.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.795+0000 7f9875a08640 1 --2- 172.21.15.7:0/4007667142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f70d69150 0x562f70d665d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.795+0000 7f9875a08640 1 -- 172.21.15.7:0/4007667142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d5a3a0 msgr2=0x562f70d66090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:31.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.795+0000 7f9875a08640 1 --2- 172.21.15.7:0/4007667142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d5a3a0 0x562f70d66090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.795+0000 7f9875a08640 1 -- 172.21.15.7:0/4007667142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f70a306a0 con 0x562f70d59a80 2024-09-19T08:45:31.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.795+0000 7f9876209640 1 --2- 172.21.15.7:0/4007667142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d5a3a0 0x562f70d66090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:45:31.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.796+0000 7f9875a08640 1 --2- 172.21.15.7:0/4007667142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562f70d59a80 0x562f70d68ad0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f986000fcf0 tx=0x7f986000fe20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b3504d71ece1ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:31.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.796+0000 7f9859ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-19T08:45:31.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.796+0000 7f9859ffb640 1 -- 172.21.15.7:0/4007667142 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98600035f0 con 0x562f70d59a80 2024-09-19T08:45:31.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.796+0000 7f9859ffb640 1 -- 172.21.15.7:0/4007667142 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f9860003790 con 0x562f70d59a80 2024-09-19T08:45:31.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.796+0000 7f987a846740 1 -- 172.21.15.7:0/4007667142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98600112d0 con 0x562f70d59a80 2024-09-19T08:45:31.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.796+0000 7f9859ffb640 1 -- 172.21.15.7:0/4007667142 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9860003990 con 0x562f70d59a80 2024-09-19T08:45:31.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.796+0000 7f987a846740 10 client.25307 fetch_fsmap learned FSMap version 25 2024-09-19T08:45:31.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.796+0000 7f987a846740 1 -- 172.21.15.7:0/4007667142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562f70d605a0 con 0x562f70d59a80 2024-09-19T08:45:31.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.797+0000 7f9859ffb640 1 -- 172.21.15.7:0/4007667142 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98600112d0 con 0x562f70d59a80 2024-09-19T08:45:31.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.797+0000 7f9859ffb640 1 -- 172.21.15.7:0/4007667142 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f986002d400 con 0x562f70d59a80 2024-09-19T08:45:31.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.797+0000 7f987a846740 10 client.25307 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:45:31.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.797+0000 7f987a846740 10 client.25307 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:45:31.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.797+0000 7f987a846740 20 client.25307 populate_metadata read hostname 'smithi007' 2024-09-19T08:45:31.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.797+0000 7f987a846740 1 --2- 172.21.15.7:0/4007667142 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562f70d7d1f0 0x562f70d7f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:31.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.797+0000 7f987a846740 4 client.25307 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:45:31.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.797+0000 7f987a846740 1 -- 172.21.15.7:0/4007667142 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f70ccc7f0 con 0x562f70d7d1f0 2024-09-19T08:45:31.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.797+0000 7f9876209640 1 --2- 172.21.15.7:0/4007667142 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562f70d7d1f0 0x562f70d7f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:31.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.798+0000 7f9859ffb640 10 client.25307 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:31.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.798+0000 7f9876209640 1 --2- 172.21.15.7:0/4007667142 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562f70d7d1f0 0x562f70d7f5e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=665c7cf5eaafb25a server_cookie=e74b1826c9146e03 in_seq=0 out_seq=0 2024-09-19T08:45:31.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.799+0000 7f9859ffb640 1 -- 172.21.15.7:0/4007667142 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562f70ccc7f0 con 0x562f70d7d1f0 2024-09-19T08:45:31.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.799+0000 7f9859ffb640 10 client.25307 handle_command_reply: tid=0 2024-09-19T08:45:31.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.799+0000 7f987a846740 1 client.25307 shutdown 2024-09-19T08:45:31.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.799+0000 7f987a846740 1 -- 172.21.15.7:0/4007667142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562f70d59a80 msgr2=0x562f70d68ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:31.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.799+0000 7f987a846740 1 --2- 172.21.15.7:0/4007667142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562f70d59a80 0x562f70d68ad0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f986000fcf0 tx=0x7f986000fe20 comp rx=0 tx=0).stop 2024-09-19T08:45:31.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.799+0000 7f987a846740 1 -- 172.21.15.7:0/4007667142 shutdown_connections 2024-09-19T08:45:31.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.799+0000 7f987a846740 1 --2- 172.21.15.7:0/4007667142 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562f70d7d1f0 0x562f70d7f5e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.799+0000 7f9859ffb640 0 client.25307 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:31.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.799+0000 7f987a846740 1 --2- 172.21.15.7:0/4007667142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f70d69150 0x562f70d665d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.799+0000 7f987a846740 1 --2- 172.21.15.7:0/4007667142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d5a3a0 0x562f70d66090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.799+0000 7f987a846740 1 --2- 172.21.15.7:0/4007667142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562f70d59a80 0x562f70d68ad0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.799+0000 7f987a846740 1 -- 172.21.15.7:0/4007667142 >> 172.21.15.7:0/4007667142 conn(0x562f70d560f0 msgr2=0x562f70d55270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:31.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.800+0000 7f987a846740 1 -- 172.21.15.7:0/4007667142 shutdown_connections 2024-09-19T08:45:31.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.800+0000 7f987a846740 1 -- 172.21.15.7:0/4007667142 wait complete. 2024-09-19T08:45:31.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.800+0000 7f987a846740 20 client.25307 trim_cache size 0 max 16384 2024-09-19T08:45:31.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.834+0000 7f987a846740 1 Processor -- start 2024-09-19T08:45:31.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.834+0000 7f987a846740 1 -- start start 2024-09-19T08:45:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.835+0000 7f987a846740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f70d5a3a0 0x562f70d687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.835+0000 7f987a846740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d69150 0x562f70d84d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.835+0000 7f987a846740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562f70d7d1f0 0x562f70d85260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.835+0000 7f987a846740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f98701adf80 con 0x562f70d69150 2024-09-19T08:45:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.835+0000 7f987a846740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f98701ab850 con 0x562f70d7d1f0 2024-09-19T08:45:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.835+0000 7f987a846740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f98701a96a0 con 0x562f70d5a3a0 2024-09-19T08:45:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.835+0000 7f9876209640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d69150 0x562f70d84d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.835+0000 7f9876209640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d69150 0x562f70d84d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35648/0 (socket says 172.21.15.7:35648) 2024-09-19T08:45:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.835+0000 7f9876209640 1 -- 172.21.15.7:0/3227417680 learned_addr learned my addr 172.21.15.7:0/3227417680 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.835+0000 7f9876209640 1 -- 172.21.15.7:0/3227417680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f70d5a3a0 msgr2=0x562f70d687f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:45:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.835+0000 7f9875a08640 1 --2- 172.21.15.7:0/3227417680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f70d5a3a0 0x562f70d687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.835+0000 7f9876209640 1 --2- 172.21.15.7:0/3227417680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f70d5a3a0 0x562f70d687f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.835+0000 7f9876209640 1 -- 172.21.15.7:0/3227417680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562f70d7d1f0 msgr2=0x562f70d85260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:45:31.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.835+0000 7f9876209640 1 --2- 172.21.15.7:0/3227417680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562f70d7d1f0 0x562f70d85260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.835+0000 7f9876209640 1 -- 172.21.15.7:0/3227417680 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f70d56c30 con 0x562f70d69150 2024-09-19T08:45:31.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.836+0000 7f9876209640 1 --2- 172.21.15.7:0/3227417680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d69150 0x562f70d84d20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f986c004410 tx=0x7f986c00d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae249ed993e1f730 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:31.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.836+0000 7f985bfff640 1 -- 172.21.15.7:0/3227417680 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c003e80 con 0x562f70d69150 2024-09-19T08:45:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.836+0000 7f985bfff640 1 -- 172.21.15.7:0/3227417680 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f986c005500 con 0x562f70d69150 2024-09-19T08:45:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.836+0000 7f985bfff640 1 -- 172.21.15.7:0/3227417680 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c01a590 con 0x562f70d69150 2024-09-19T08:45:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.837+0000 7f987a846740 1 -- 172.21.15.7:0/3227417680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d69150 msgr2=0x562f70d84d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.837+0000 7f987a846740 1 --2- 172.21.15.7:0/3227417680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d69150 0x562f70d84d20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f986c004410 tx=0x7f986c00d3e0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.837+0000 7f987a846740 1 -- 172.21.15.7:0/3227417680 shutdown_connections 2024-09-19T08:45:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.837+0000 7f987a846740 1 --2- 172.21.15.7:0/3227417680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562f70d7d1f0 0x562f70d85260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.837+0000 7f987a846740 1 --2- 172.21.15.7:0/3227417680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d69150 0x562f70d84d20 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.837+0000 7f987a846740 1 --2- 172.21.15.7:0/3227417680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f70d5a3a0 0x562f70d687f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.837+0000 7f987a846740 1 -- 172.21.15.7:0/3227417680 >> 172.21.15.7:0/3227417680 conn(0x562f70d560f0 msgr2=0x562f70d55270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.837+0000 7f987a846740 1 -- 172.21.15.7:0/3227417680 shutdown_connections 2024-09-19T08:45:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.837+0000 7f987a846740 1 -- 172.21.15.7:0/3227417680 wait complete. 2024-09-19T08:45:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.838+0000 7f987a846740 1 -- start start 2024-09-19T08:45:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.838+0000 7f987a846740 1 Processor -- start 2024-09-19T08:45:31.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.839+0000 7f987a846740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562f70d5a3a0 0x562f70d75820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:31.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.839+0000 7f987a846740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d7d1f0 0x562f70d75d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:31.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.839+0000 7f9876209640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d7d1f0 0x562f70d75d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:31.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.839+0000 7f9876209640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d7d1f0 0x562f70d75d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35652/0 (socket says 172.21.15.7:35652) 2024-09-19T08:45:31.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.839+0000 7f987a846740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f70d762a0 0x562f70de6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.839+0000 7f9876209640 1 -- 172.21.15.7:0/326823323 learned_addr learned my addr 172.21.15.7:0/326823323 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.839+0000 7f987a846740 1 -- 172.21.15.7:0/326823323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f98701a9d10 con 0x562f70d7d1f0 2024-09-19T08:45:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.839+0000 7f987a846740 1 -- 172.21.15.7:0/326823323 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f98701ab180 con 0x562f70d5a3a0 2024-09-19T08:45:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.839+0000 7f987a846740 1 -- 172.21.15.7:0/326823323 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f98701aa3e0 con 0x562f70d762a0 2024-09-19T08:45:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.839+0000 7f987a846740 10 client.0 _ll_register_callbacks cb 0x7f9860011620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.839+0000 7f9876209640 1 -- 172.21.15.7:0/326823323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f70d762a0 msgr2=0x562f70de6cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:45:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.839+0000 7f9876209640 1 --2- 172.21.15.7:0/326823323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f70d762a0 0x562f70de6cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.839+0000 7f9876209640 1 -- 172.21.15.7:0/326823323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562f70d5a3a0 msgr2=0x562f70d75820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:45:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.839+0000 7f9876209640 1 --2- 172.21.15.7:0/326823323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562f70d5a3a0 0x562f70d75820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.839+0000 7f9876209640 1 -- 172.21.15.7:0/326823323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f70de7230 con 0x562f70d7d1f0 2024-09-19T08:45:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.839+0000 7f987a846740 1 -- 172.21.15.7:0/326823323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f986c005500 con 0x562f70d7d1f0 2024-09-19T08:45:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.840+0000 7f9876209640 1 --2- 172.21.15.7:0/326823323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d7d1f0 0x562f70d75d60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f986c004700 tx=0x7f986c004e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d471f1cbb7be99a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.840+0000 7f9859ffb640 10 client.15564 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:45:31.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.840+0000 7f9859ffb640 1 -- 172.21.15.7:0/326823323 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c033050 con 0x562f70d7d1f0 2024-09-19T08:45:31.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.840+0000 7f9859ffb640 1 -- 172.21.15.7:0/326823323 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f986c003c80 con 0x562f70d7d1f0 2024-09-19T08:45:31.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.840+0000 7f9859ffb640 1 -- 172.21.15.7:0/326823323 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f986c0049a0 con 0x562f70d7d1f0 2024-09-19T08:45:31.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.840+0000 7f987a846740 10 client.15564 fetch_fsmap learned FSMap version 25 2024-09-19T08:45:31.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.840+0000 7f987a846740 1 -- 172.21.15.7:0/326823323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=25}) -- 0x562f70de82b0 con 0x562f70d7d1f0 2024-09-19T08:45:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.841+0000 7f9859ffb640 1 -- 172.21.15.7:0/326823323 <== mon.0 v2:172.21.15.7:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f986c004f80 con 0x562f70d7d1f0 2024-09-19T08:45:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.841+0000 7f987a846740 10 client.15564 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:45:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.841+0000 7f987a846740 10 client.15564 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:45:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.841+0000 7f987a846740 20 client.15564 populate_metadata read hostname 'smithi007' 2024-09-19T08:45:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.841+0000 7f987a846740 1 --2- 172.21.15.7:0/326823323 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562f70de87c0 0x562f70deabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.841+0000 7f987a846740 4 client.15564 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:45:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.841+0000 7f987a846740 1 -- 172.21.15.7:0/326823323 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562f70cc6d00 con 0x562f70de87c0 2024-09-19T08:45:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.841+0000 7f9875a08640 1 --2- 172.21.15.7:0/326823323 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562f70de87c0 0x562f70deabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.842+0000 7f9859ffb640 10 client.15564 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.842+0000 7f9875a08640 1 --2- 172.21.15.7:0/326823323 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562f70de87c0 0x562f70deabe0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=163ffedeadec21f0 server_cookie=791d451c7cd55437 in_seq=0 out_seq=0 2024-09-19T08:45:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.843+0000 7f9859ffb640 1 -- 172.21.15.7:0/326823323 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562f70cc6d00 con 0x562f70de87c0 2024-09-19T08:45:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.843+0000 7f9859ffb640 10 client.15564 handle_command_reply: tid=0 2024-09-19T08:45:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.843+0000 7f987a846740 1 client.15564 shutdown 2024-09-19T08:45:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.843+0000 7f987a846740 1 -- 172.21.15.7:0/326823323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d7d1f0 msgr2=0x562f70d75d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.843+0000 7f987a846740 1 --2- 172.21.15.7:0/326823323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d7d1f0 0x562f70d75d60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f986c004700 tx=0x7f986c004e10 comp rx=0 tx=0).stop 2024-09-19T08:45:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.843+0000 7f987a846740 1 -- 172.21.15.7:0/326823323 shutdown_connections 2024-09-19T08:45:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.843+0000 7f987a846740 1 --2- 172.21.15.7:0/326823323 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562f70de87c0 0x562f70deabe0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.843+0000 7f987a846740 1 --2- 172.21.15.7:0/326823323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f70d762a0 0x562f70de6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.843+0000 7f987a846740 1 --2- 172.21.15.7:0/326823323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f70d7d1f0 0x562f70d75d60 secure :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f986c004700 tx=0x7f986c004e10 comp rx=0 tx=0).stop 2024-09-19T08:45:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.843+0000 7f987a846740 1 --2- 172.21.15.7:0/326823323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562f70d5a3a0 0x562f70d75820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.843+0000 7f987a846740 1 -- 172.21.15.7:0/326823323 >> 172.21.15.7:0/326823323 conn(0x562f70d560f0 msgr2=0x562f70d5b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.843+0000 7f9859ffb640 0 client.15564 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:31.845 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:45:31.846 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-19T08:45:31.846 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "7071a177-4b80-4a0d-adb6-71b11033ef04", 2024-09-19T08:45:31.846 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-19T08:45:31.846 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:45:31.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.844+0000 7f987a846740 1 -- 172.21.15.7:0/326823323 shutdown_connections 2024-09-19T08:45:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.844+0000 7f987a846740 1 -- 172.21.15.7:0/326823323 wait complete. 2024-09-19T08:45:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.844+0000 7f987a846740 20 client.15564 trim_cache size 0 max 16384 2024-09-19T08:45:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.845+0000 7f987846d640 1 -- 172.21.15.7:0/2475682651 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f985c0a35d0 msgr2=0x7f985c0a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.845+0000 7f987846d640 1 --2- 172.21.15.7:0/2475682651 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f985c0a35d0 0x7f985c0a5a90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f98680eecc0 tx=0x7f986804cfc0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.845+0000 7f987846d640 1 -- 172.21.15.7:0/2475682651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98701082a0 msgr2=0x7f987019cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.845+0000 7f987846d640 1 --2- 172.21.15.7:0/2475682651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98701082a0 0x7f987019cea0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9868033040 tx=0x7f9868031e60 comp rx=0 tx=0).stop 2024-09-19T08:45:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.845+0000 7f987846d640 1 -- 172.21.15.7:0/2475682651 shutdown_connections 2024-09-19T08:45:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.845+0000 7f987846d640 1 --2- 172.21.15.7:0/2475682651 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f985c0a35d0 0x7f985c0a5a90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.845+0000 7f987846d640 1 --2- 172.21.15.7:0/2475682651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98701082a0 0x7f987019cea0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.845+0000 7f987846d640 1 --2- 172.21.15.7:0/2475682651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98701036e0 0x7f9870198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.845+0000 7f987846d640 1 --2- 172.21.15.7:0/2475682651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9870102d30 0x7f98701985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.845+0000 7f987846d640 1 -- 172.21.15.7:0/2475682651 >> 172.21.15.7:0/2475682651 conn(0x7f98700fc7d0 msgr2=0x7f9870106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:31.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.845+0000 7f987846d640 1 -- 172.21.15.7:0/2475682651 shutdown_connections 2024-09-19T08:45:31.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:31.845+0000 7f987846d640 1 -- 172.21.15.7:0/2475682651 wait complete. 2024-09-19T08:45:32.514 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:45:32.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:32 smithi044 ceph-mon[35072]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-19T08:45:32.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:32 smithi044 ceph-mon[35072]: scrub queued for path: / 2024-09-19T08:45:32.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:32 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:45:32.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:32 smithi044 ceph-mon[35072]: scrub summary: active paths [/] 2024-09-19T08:45:32.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:32 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:45:32.577 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:32 smithi007 ceph-mon[31221]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-19T08:45:32.577 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:32 smithi007 ceph-mon[31221]: scrub queued for path: / 2024-09-19T08:45:32.577 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:32 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:45:32.577 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:32 smithi007 ceph-mon[31221]: scrub summary: active paths [/] 2024-09-19T08:45:32.577 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:32 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:45:32.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:32 smithi175 ceph-mon[35688]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-19T08:45:32.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:32 smithi175 ceph-mon[35688]: scrub queued for path: / 2024-09-19T08:45:32.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:32 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:45:32.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:32 smithi175 ceph-mon[35688]: scrub summary: active paths [/] 2024-09-19T08:45:32.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:32 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:45:32.785 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:33.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.313+0000 7fb22311e640 1 -- 172.21.15.7:0/217057028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb21c1036e0 msgr2=0x7fb21c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:33.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.313+0000 7fb22311e640 1 --2- 172.21.15.7:0/217057028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb21c1036e0 0x7fb21c107b90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb208009930 tx=0x7fb20802a420 comp rx=0 tx=0).stop 2024-09-19T08:45:33.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.313+0000 7fb22311e640 1 -- 172.21.15.7:0/217057028 shutdown_connections 2024-09-19T08:45:33.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.313+0000 7fb22311e640 1 --2- 172.21.15.7:0/217057028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb21c1082a0 0x7fb21c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.313+0000 7fb22311e640 1 --2- 172.21.15.7:0/217057028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb21c1036e0 0x7fb21c107b90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.313+0000 7fb22311e640 1 --2- 172.21.15.7:0/217057028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb21c102d30 0x7fb21c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.313+0000 7fb22311e640 1 -- 172.21.15.7:0/217057028 >> 172.21.15.7:0/217057028 conn(0x7fb21c0fc7d0 msgr2=0x7fb21c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:33.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.314+0000 7fb22311e640 1 -- 172.21.15.7:0/217057028 shutdown_connections 2024-09-19T08:45:33.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.314+0000 7fb22311e640 1 -- 172.21.15.7:0/217057028 wait complete. 2024-09-19T08:45:33.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.315+0000 7fb22311e640 1 Processor -- start 2024-09-19T08:45:33.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.315+0000 7fb22311e640 1 -- start start 2024-09-19T08:45:33.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.315+0000 7fb22311e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb21c102d30 0x7fb21c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:33.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.315+0000 7fb22311e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb21c1036e0 0x7fb21c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:33.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.315+0000 7fb22311e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb21c1082a0 0x7fb21c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:33.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.315+0000 7fb22311e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c112060 con 0x7fb21c102d30 2024-09-19T08:45:33.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.315+0000 7fb22311e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c111ee0 con 0x7fb21c1082a0 2024-09-19T08:45:33.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.315+0000 7fb22311e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c1121e0 con 0x7fb21c1036e0 2024-09-19T08:45:33.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.315+0000 7fb220eba640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb21c102d30 0x7fb21c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:33.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.315+0000 7fb220eba640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb21c102d30 0x7fb21c100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32942/0 (socket says 172.21.15.7:32942) 2024-09-19T08:45:33.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.315+0000 7fb220eba640 1 -- 172.21.15.7:0/2143536227 learned_addr learned my addr 172.21.15.7:0/2143536227 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:33.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.316+0000 7fb21bfff640 1 --2- 172.21.15.7:0/2143536227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb21c1036e0 0x7fb21c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:33.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.316+0000 7fb2216bb640 1 --2- 172.21.15.7:0/2143536227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb21c1082a0 0x7fb21c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:33.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.316+0000 7fb21bfff640 1 -- 172.21.15.7:0/2143536227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb21c1082a0 msgr2=0x7fb21c101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:33.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.316+0000 7fb21bfff640 1 --2- 172.21.15.7:0/2143536227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb21c1082a0 0x7fb21c101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.316+0000 7fb21bfff640 1 -- 172.21.15.7:0/2143536227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb21c102d30 msgr2=0x7fb21c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:33.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.316+0000 7fb21bfff640 1 --2- 172.21.15.7:0/2143536227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb21c102d30 0x7fb21c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.316+0000 7fb21bfff640 1 -- 172.21.15.7:0/2143536227 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21c1a6a00 con 0x7fb21c1036e0 2024-09-19T08:45:33.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.316+0000 7fb21bfff640 1 --2- 172.21.15.7:0/2143536227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb21c1036e0 0x7fb21c100ed0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb20802a940 tx=0x7fb2080042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:33.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.316+0000 7fb219ffb640 1 -- 172.21.15.7:0/2143536227 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20803f070 con 0x7fb21c1036e0 2024-09-19T08:45:33.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.317+0000 7fb22311e640 1 -- 172.21.15.7:0/2143536227 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb21c1a6c90 con 0x7fb21c1036e0 2024-09-19T08:45:33.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.317+0000 7fb219ffb640 1 -- 172.21.15.7:0/2143536227 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb20803b460 con 0x7fb21c1036e0 2024-09-19T08:45:33.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.317+0000 7fb219ffb640 1 -- 172.21.15.7:0/2143536227 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb208035070 con 0x7fb21c1036e0 2024-09-19T08:45:33.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.318+0000 7fb22311e640 1 -- 172.21.15.7:0/2143536227 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb21c1a7190 con 0x7fb21c1036e0 2024-09-19T08:45:33.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.321+0000 7fb2254f7740 1 Processor -- start 2024-09-19T08:45:33.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.321+0000 7fb2254f7740 1 -- start start 2024-09-19T08:45:33.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.321+0000 7fb219ffb640 1 -- 172.21.15.7:0/2143536227 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 24) ==== 138587+0+0 (secure 0 0 0) 0x7fb20803b610 con 0x7fb21c1036e0 2024-09-19T08:45:33.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.321+0000 7fb2254f7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611055543c0 0x5611055547a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:33.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.321+0000 7fb2254f7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561105554ce0 0x561105567950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:33.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.321+0000 7fb2254f7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561105567e90 0x56110556a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:33.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.321+0000 7fb2254f7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5611054ba2e0 con 0x561105567e90 2024-09-19T08:45:33.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.321+0000 7fb2254f7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561105461ce0 con 0x5611055543c0 2024-09-19T08:45:33.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.321+0000 7fb2254f7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5611054b62a0 con 0x561105554ce0 2024-09-19T08:45:33.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.322+0000 7fb2216bb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611055543c0 0x5611055547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:33.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.322+0000 7fb220eba640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561105554ce0 0x561105567950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:33.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.322+0000 7fb2216bb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611055543c0 0x5611055547a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:48586/0 (socket says 172.21.15.7:48586) 2024-09-19T08:45:33.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.322+0000 7fb2216bb640 1 -- 172.21.15.7:0/516085533 learned_addr learned my addr 172.21.15.7:0/516085533 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:33.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.322+0000 7fb21bfff640 1 --2- 172.21.15.7:0/516085533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561105567e90 0x56110556a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:33.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.322+0000 7fb2216bb640 1 -- 172.21.15.7:0/516085533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561105554ce0 msgr2=0x561105567950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:33.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.322+0000 7fb2216bb640 1 --2- 172.21.15.7:0/516085533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561105554ce0 0x561105567950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.322+0000 7fb2216bb640 1 -- 172.21.15.7:0/516085533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561105567e90 msgr2=0x56110556a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:33.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.322+0000 7fb2216bb640 1 --2- 172.21.15.7:0/516085533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561105567e90 0x56110556a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.322+0000 7fb2216bb640 1 -- 172.21.15.7:0/516085533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561105446440 con 0x5611055543c0 2024-09-19T08:45:33.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.322+0000 7fb21bfff640 1 --2- 172.21.15.7:0/516085533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561105567e90 0x56110556a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:33.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.323+0000 7fb2216bb640 1 --2- 172.21.15.7:0/516085533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611055543c0 0x5611055547a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb214009f70 tx=0x7fb214010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ce6dd117dde480b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:33.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.323+0000 7fb219ffb640 1 --2- 172.21.15.7:0/2143536227 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb20c0a35d0 0x7fb20c0a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:33.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.323+0000 7fb219ffb640 1 -- 172.21.15.7:0/2143536227 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fb2080efee0 con 0x7fb21c1036e0 2024-09-19T08:45:33.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.323+0000 7fb220eba640 1 --2- 172.21.15.7:0/2143536227 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb20c0a35d0 0x7fb20c0a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:33.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.323+0000 7fb206ffd640 1 -- 172.21.15.7:0/516085533 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb214016070 con 0x5611055543c0 2024-09-19T08:45:33.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.323+0000 7fb206ffd640 1 -- 172.21.15.7:0/516085533 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb214004d20 con 0x5611055543c0 2024-09-19T08:45:33.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.323+0000 7fb206ffd640 1 -- 172.21.15.7:0/516085533 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb214012950 con 0x5611055543c0 2024-09-19T08:45:33.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.324+0000 7fb2254f7740 1 -- 172.21.15.7:0/516085533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611055543c0 msgr2=0x5611055547a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:33.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.324+0000 7fb2254f7740 1 --2- 172.21.15.7:0/516085533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611055543c0 0x5611055547a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb214009f70 tx=0x7fb214010800 comp rx=0 tx=0).stop 2024-09-19T08:45:33.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.324+0000 7fb220eba640 1 --2- 172.21.15.7:0/2143536227 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb20c0a35d0 0x7fb20c0a5a90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb21000adc0 tx=0x7fb21000a380 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:33.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.324+0000 7fb2254f7740 1 -- 172.21.15.7:0/516085533 shutdown_connections 2024-09-19T08:45:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.324+0000 7fb2254f7740 1 --2- 172.21.15.7:0/516085533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561105567e90 0x56110556a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.324+0000 7fb2254f7740 1 --2- 172.21.15.7:0/516085533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561105554ce0 0x561105567950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.324+0000 7fb2254f7740 1 --2- 172.21.15.7:0/516085533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611055543c0 0x5611055547a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.324+0000 7fb2254f7740 1 -- 172.21.15.7:0/516085533 >> 172.21.15.7:0/516085533 conn(0x561105550a30 msgr2=0x561105550e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.324+0000 7fb2254f7740 1 -- 172.21.15.7:0/516085533 shutdown_connections 2024-09-19T08:45:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.324+0000 7fb2254f7740 1 -- 172.21.15.7:0/516085533 wait complete. 2024-09-19T08:45:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.325+0000 7fb2254f7740 1 -- start start 2024-09-19T08:45:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.325+0000 7fb2254f7740 1 Processor -- start 2024-09-19T08:45:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.325+0000 7fb2254f7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611055543c0 0x561105567950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.325+0000 7fb2254f7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561105554ce0 0x561105564c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.325+0000 7fb2254f7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561105567e90 0x561105565390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.325+0000 7fb2254f7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56110556aa00 con 0x561105554ce0 2024-09-19T08:45:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.325+0000 7fb2254f7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561105475050 con 0x561105567e90 2024-09-19T08:45:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.325+0000 7fb2254f7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56110556ab80 con 0x5611055543c0 2024-09-19T08:45:33.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.325+0000 7fb2254f7740 10 client.0 _ll_register_callbacks cb 0x5611054b5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:33.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.326+0000 7fb21bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561105554ce0 0x561105564c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:33.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.326+0000 7fb21bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561105554ce0 0x561105564c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32964/0 (socket says 172.21.15.7:32964) 2024-09-19T08:45:33.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.326+0000 7fb21bfff640 1 -- 172.21.15.7:0/1330991618 learned_addr learned my addr 172.21.15.7:0/1330991618 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:33.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.326+0000 7fb2216bb640 1 --2- 172.21.15.7:0/1330991618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561105567e90 0x561105565390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:33.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.326+0000 7fb220eba640 1 --2- 172.21.15.7:0/1330991618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611055543c0 0x561105567950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:33.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.326+0000 7fb21bfff640 1 -- 172.21.15.7:0/1330991618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611055543c0 msgr2=0x561105567950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:33.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.326+0000 7fb21bfff640 1 --2- 172.21.15.7:0/1330991618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611055543c0 0x561105567950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.326+0000 7fb21bfff640 1 -- 172.21.15.7:0/1330991618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561105567e90 msgr2=0x561105565390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:33.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.326+0000 7fb21bfff640 1 --2- 172.21.15.7:0/1330991618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561105567e90 0x561105565390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.326+0000 7fb21bfff640 1 -- 172.21.15.7:0/1330991618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56110522b3c0 con 0x561105554ce0 2024-09-19T08:45:33.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.326+0000 7fb2216bb640 1 --2- 172.21.15.7:0/1330991618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561105567e90 0x561105565390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:45:33.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.326+0000 7fb21bfff640 1 --2- 172.21.15.7:0/1330991618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561105554ce0 0x561105564c00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb2080b84e0 tx=0x7fb2080b7cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25530a684854e3a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:33.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.326+0000 7fb1fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:45:33.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.327+0000 7fb1fbfff640 1 -- 172.21.15.7:0/1330991618 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2080bbbc0 con 0x561105554ce0 2024-09-19T08:45:33.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.327+0000 7fb1fbfff640 1 -- 172.21.15.7:0/1330991618 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fb20803b9a0 con 0x561105554ce0 2024-09-19T08:45:33.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.327+0000 7fb2254f7740 1 -- 172.21.15.7:0/1330991618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb214004d20 con 0x561105554ce0 2024-09-19T08:45:33.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.327+0000 7fb1fbfff640 1 -- 172.21.15.7:0/1330991618 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb2080044e0 con 0x561105554ce0 2024-09-19T08:45:33.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.327+0000 7fb2254f7740 10 client.15576 fetch_fsmap learned FSMap version 25 2024-09-19T08:45:33.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.327+0000 7fb2254f7740 1 -- 172.21.15.7:0/1330991618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5611055570e0 con 0x561105554ce0 2024-09-19T08:45:33.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.327+0000 7fb1fbfff640 1 -- 172.21.15.7:0/1330991618 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb214004d20 con 0x561105554ce0 2024-09-19T08:45:33.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.327+0000 7fb1fbfff640 1 -- 172.21.15.7:0/1330991618 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb2080c47b0 con 0x561105554ce0 2024-09-19T08:45:33.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.328+0000 7fb2254f7740 10 client.15576 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:45:33.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.328+0000 7fb2254f7740 10 client.15576 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:45:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.328+0000 7fb2254f7740 20 client.15576 populate_metadata read hostname 'smithi007' 2024-09-19T08:45:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.328+0000 7fb2254f7740 1 --2- 172.21.15.7:0/1330991618 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561105558640 0x56110555aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.328+0000 7fb2254f7740 4 client.15576 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:45:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.328+0000 7fb2254f7740 1 -- 172.21.15.7:0/1330991618 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611054c7850 con 0x561105558640 2024-09-19T08:45:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.328+0000 7fb220eba640 1 --2- 172.21.15.7:0/1330991618 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561105558640 0x56110555aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.328+0000 7fb220eba640 1 --2- 172.21.15.7:0/1330991618 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561105558640 0x56110555aa30 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee99ca8aab1d326a server_cookie=f8ed2a7cd150109b in_seq=0 out_seq=0 2024-09-19T08:45:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.328+0000 7fb1fbfff640 10 client.15576 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.329+0000 7fb1fbfff640 1 -- 172.21.15.7:0/1330991618 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5611054c7850 con 0x561105558640 2024-09-19T08:45:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.329+0000 7fb1fbfff640 10 client.15576 handle_command_reply: tid=0 2024-09-19T08:45:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.329+0000 7fb2254f7740 1 client.15576 shutdown 2024-09-19T08:45:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.329+0000 7fb2254f7740 1 -- 172.21.15.7:0/1330991618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561105554ce0 msgr2=0x561105564c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.329+0000 7fb2254f7740 1 --2- 172.21.15.7:0/1330991618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561105554ce0 0x561105564c00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb2080b84e0 tx=0x7fb2080b7cc0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.329+0000 7fb2254f7740 1 -- 172.21.15.7:0/1330991618 shutdown_connections 2024-09-19T08:45:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.329+0000 7fb2254f7740 1 --2- 172.21.15.7:0/1330991618 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561105558640 0x56110555aa30 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.329+0000 7fb2254f7740 1 --2- 172.21.15.7:0/1330991618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561105567e90 0x561105565390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.330+0000 7fb2254f7740 1 --2- 172.21.15.7:0/1330991618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561105554ce0 0x561105564c00 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.330+0000 7fb1fbfff640 0 client.15576 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:33.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.330+0000 7fb2254f7740 1 --2- 172.21.15.7:0/1330991618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611055543c0 0x561105567950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.330+0000 7fb2254f7740 1 -- 172.21.15.7:0/1330991618 >> 172.21.15.7:0/1330991618 conn(0x561105550a30 msgr2=0x56110554fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:33.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.330+0000 7fb2254f7740 1 -- 172.21.15.7:0/1330991618 shutdown_connections 2024-09-19T08:45:33.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.330+0000 7fb2254f7740 1 -- 172.21.15.7:0/1330991618 wait complete. 2024-09-19T08:45:33.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.330+0000 7fb2254f7740 20 client.15576 trim_cache size 0 max 16384 2024-09-19T08:45:33.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.347+0000 7fb2254f7740 1 Processor -- start 2024-09-19T08:45:33.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.347+0000 7fb2254f7740 1 -- start start 2024-09-19T08:45:33.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.348+0000 7fb2254f7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611055543c0 0x5611055634d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.348+0000 7fb2254f7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561105554ce0 0x5611055602d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.348+0000 7fb2254f7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561105558640 0x56110557b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.348+0000 7fb2254f7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c1adeb0 con 0x561105558640 2024-09-19T08:45:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.348+0000 7fb2254f7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c1ab780 con 0x561105554ce0 2024-09-19T08:45:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.348+0000 7fb2254f7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c1a95d0 con 0x5611055543c0 2024-09-19T08:45:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.348+0000 7fb21bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561105554ce0 0x5611055602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.348+0000 7fb21bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561105554ce0 0x5611055602d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:48598/0 (socket says 172.21.15.7:48598) 2024-09-19T08:45:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.348+0000 7fb21bfff640 1 -- 172.21.15.7:0/1148709196 learned_addr learned my addr 172.21.15.7:0/1148709196 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.348+0000 7fb2216bb640 1 --2- 172.21.15.7:0/1148709196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561105558640 0x56110557b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.348+0000 7fb220eba640 1 --2- 172.21.15.7:0/1148709196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611055543c0 0x5611055634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.348+0000 7fb220eba640 1 -- 172.21.15.7:0/1148709196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561105554ce0 msgr2=0x5611055602d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:33.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.348+0000 7fb220eba640 1 --2- 172.21.15.7:0/1148709196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561105554ce0 0x5611055602d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.348+0000 7fb220eba640 1 -- 172.21.15.7:0/1148709196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561105558640 msgr2=0x56110557b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:33.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.348+0000 7fb220eba640 1 --2- 172.21.15.7:0/1148709196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561105558640 0x56110557b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.349+0000 7fb220eba640 1 -- 172.21.15.7:0/1148709196 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561105563bb0 con 0x5611055543c0 2024-09-19T08:45:33.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.349+0000 7fb2216bb640 1 --2- 172.21.15.7:0/1148709196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561105558640 0x56110557b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:45:33.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.349+0000 7fb220eba640 1 --2- 172.21.15.7:0/1148709196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611055543c0 0x5611055634d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x56110555b240 tx=0x7fb210017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92434bd337438736 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:33.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.349+0000 7fb2067fc640 1 -- 172.21.15.7:0/1148709196 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb210005020 con 0x5611055543c0 2024-09-19T08:45:33.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.349+0000 7fb2067fc640 1 -- 172.21.15.7:0/1148709196 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2100047a0 con 0x5611055543c0 2024-09-19T08:45:33.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.349+0000 7fb2067fc640 1 -- 172.21.15.7:0/1148709196 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb210029690 con 0x5611055543c0 2024-09-19T08:45:33.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.350+0000 7fb2254f7740 1 -- 172.21.15.7:0/1148709196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611055543c0 msgr2=0x5611055634d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:33.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.350+0000 7fb2254f7740 1 --2- 172.21.15.7:0/1148709196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611055543c0 0x5611055634d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x56110555b240 tx=0x7fb210017000 comp rx=0 tx=0).stop 2024-09-19T08:45:33.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.350+0000 7fb2254f7740 1 -- 172.21.15.7:0/1148709196 shutdown_connections 2024-09-19T08:45:33.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.350+0000 7fb2254f7740 1 --2- 172.21.15.7:0/1148709196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561105558640 0x56110557b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.350+0000 7fb2254f7740 1 --2- 172.21.15.7:0/1148709196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561105554ce0 0x5611055602d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.350+0000 7fb2254f7740 1 --2- 172.21.15.7:0/1148709196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611055543c0 0x5611055634d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.350+0000 7fb2254f7740 1 -- 172.21.15.7:0/1148709196 >> 172.21.15.7:0/1148709196 conn(0x561105550a30 msgr2=0x56110554fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.350+0000 7fb2254f7740 1 -- 172.21.15.7:0/1148709196 shutdown_connections 2024-09-19T08:45:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.350+0000 7fb2254f7740 1 -- 172.21.15.7:0/1148709196 wait complete. 2024-09-19T08:45:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.351+0000 7fb2254f7740 1 -- start start 2024-09-19T08:45:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.351+0000 7fb2254f7740 1 Processor -- start 2024-09-19T08:45:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.351+0000 7fb2254f7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611055543c0 0x56110557ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.351+0000 7fb2254f7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561105554ce0 0x561105578de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.351+0000 7fb2254f7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561105558640 0x561105579320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.351+0000 7fb220eba640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611055543c0 0x56110557ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.351+0000 7fb220eba640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611055543c0 0x56110557ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32980/0 (socket says 172.21.15.7:32980) 2024-09-19T08:45:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.351+0000 7fb220eba640 1 -- 172.21.15.7:0/177026558 learned_addr learned my addr 172.21.15.7:0/177026558 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.351+0000 7fb2254f7740 1 -- 172.21.15.7:0/177026558 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c1a9c40 con 0x5611055543c0 2024-09-19T08:45:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.351+0000 7fb2254f7740 1 -- 172.21.15.7:0/177026558 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c1ab0b0 con 0x561105554ce0 2024-09-19T08:45:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.352+0000 7fb2254f7740 1 -- 172.21.15.7:0/177026558 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c1aa310 con 0x561105558640 2024-09-19T08:45:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.352+0000 7fb21bfff640 1 --2- 172.21.15.7:0/177026558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561105554ce0 0x561105578de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.352+0000 7fb2216bb640 1 --2- 172.21.15.7:0/177026558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561105558640 0x561105579320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.352+0000 7fb21bfff640 1 -- 172.21.15.7:0/177026558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561105558640 msgr2=0x561105579320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.352+0000 7fb21bfff640 1 --2- 172.21.15.7:0/177026558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561105558640 0x561105579320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.352+0000 7fb21bfff640 1 -- 172.21.15.7:0/177026558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611055543c0 msgr2=0x56110557ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:33.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.352+0000 7fb2254f7740 10 client.0 _ll_register_callbacks cb 0x7fb2080ed4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:33.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.352+0000 7fb21bfff640 1 --2- 172.21.15.7:0/177026558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611055543c0 0x56110557ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.352+0000 7fb21bfff640 1 -- 172.21.15.7:0/177026558 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56110555ada0 con 0x561105554ce0 2024-09-19T08:45:33.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.352+0000 7fb220eba640 1 --2- 172.21.15.7:0/177026558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611055543c0 0x56110557ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:45:33.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.352+0000 7fb2254f7740 1 -- 172.21.15.7:0/177026558 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2100047a0 con 0x561105554ce0 2024-09-19T08:45:33.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.352+0000 7fb21bfff640 1 --2- 172.21.15.7:0/177026558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561105554ce0 0x561105578de0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb2080b8a50 tx=0x7fb2080ed720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=214dfbc80862c546 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:33.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.352+0000 7fb1fbfff640 10 client.25325 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-19T08:45:33.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.353+0000 7fb1fbfff640 1 -- 172.21.15.7:0/177026558 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2080bb9e0 con 0x561105554ce0 2024-09-19T08:45:33.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.353+0000 7fb1fbfff640 1 -- 172.21.15.7:0/177026558 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fb2080d0210 con 0x561105554ce0 2024-09-19T08:45:33.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.353+0000 7fb1fbfff640 1 -- 172.21.15.7:0/177026558 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb2080c4c40 con 0x561105554ce0 2024-09-19T08:45:33.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.353+0000 7fb2254f7740 10 client.25325 fetch_fsmap learned FSMap version 25 2024-09-19T08:45:33.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.353+0000 7fb2254f7740 1 -- 172.21.15.7:0/177026558 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=25}) -- 0x5611055d9fb0 con 0x561105554ce0 2024-09-19T08:45:33.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.353+0000 7fb1fbfff640 1 -- 172.21.15.7:0/177026558 <== mon.2 v2:172.21.15.44:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb20809ace0 con 0x561105554ce0 2024-09-19T08:45:33.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.354+0000 7fb2254f7740 10 client.25325 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:45:33.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.354+0000 7fb2254f7740 10 client.25325 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:45:33.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.354+0000 7fb2254f7740 20 client.25325 populate_metadata read hostname 'smithi007' 2024-09-19T08:45:33.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.354+0000 7fb2254f7740 1 --2- 172.21.15.7:0/177026558 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561105567e90 0x5611055dc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:33.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.354+0000 7fb2254f7740 4 client.25325 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:45:33.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.354+0000 7fb2254f7740 1 -- 172.21.15.7:0/177026558 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5611054c1d60 con 0x561105567e90 2024-09-19T08:45:33.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.354+0000 7fb220eba640 1 --2- 172.21.15.7:0/177026558 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561105567e90 0x5611055dc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:33.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.354+0000 7fb220eba640 1 --2- 172.21.15.7:0/177026558 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561105567e90 0x5611055dc480 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e38e3b218f7f2d1 server_cookie=a8f949b3e8c9248c in_seq=0 out_seq=0 2024-09-19T08:45:33.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.354+0000 7fb1fbfff640 10 client.25325 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:33.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.355+0000 7fb1fbfff640 1 -- 172.21.15.7:0/177026558 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5611054c1d60 con 0x561105567e90 2024-09-19T08:45:33.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.355+0000 7fb1fbfff640 10 client.25325 handle_command_reply: tid=0 2024-09-19T08:45:33.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.355+0000 7fb2254f7740 1 client.25325 shutdown 2024-09-19T08:45:33.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.355+0000 7fb2254f7740 1 -- 172.21.15.7:0/177026558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561105554ce0 msgr2=0x561105578de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:33.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.355+0000 7fb2254f7740 1 --2- 172.21.15.7:0/177026558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561105554ce0 0x561105578de0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb2080b8a50 tx=0x7fb2080ed720 comp rx=0 tx=0).stop 2024-09-19T08:45:33.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.355+0000 7fb2254f7740 1 -- 172.21.15.7:0/177026558 shutdown_connections 2024-09-19T08:45:33.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.355+0000 7fb2254f7740 1 --2- 172.21.15.7:0/177026558 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561105567e90 0x5611055dc480 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.355+0000 7fb2254f7740 1 --2- 172.21.15.7:0/177026558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561105558640 0x561105579320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.355+0000 7fb2254f7740 1 --2- 172.21.15.7:0/177026558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561105554ce0 0x561105578de0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.355+0000 7fb2254f7740 1 --2- 172.21.15.7:0/177026558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611055543c0 0x56110557ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.355+0000 7fb2254f7740 1 -- 172.21.15.7:0/177026558 >> 172.21.15.7:0/177026558 conn(0x561105550a30 msgr2=0x56110554fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:33.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.355+0000 7fb1fbfff640 0 client.25325 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:33.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.355+0000 7fb2254f7740 1 -- 172.21.15.7:0/177026558 shutdown_connections 2024-09-19T08:45:33.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.355+0000 7fb2254f7740 1 -- 172.21.15.7:0/177026558 wait complete. 2024-09-19T08:45:33.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.355+0000 7fb2254f7740 20 client.25325 trim_cache size 0 max 16384 2024-09-19T08:45:33.361 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:45:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:45:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-19T08:45:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: "7071a177-4b80-4a0d-adb6-71b11033ef04": { 2024-09-19T08:45:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-19T08:45:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "7071a177-4b80-4a0d-adb6-71b11033ef04", 2024-09-19T08:45:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-19T08:45:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:45:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:45:33.362 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:45:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.356+0000 7fb22311e640 1 -- 172.21.15.7:0/2143536227 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb20c0a35d0 msgr2=0x7fb20c0a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.356+0000 7fb22311e640 1 --2- 172.21.15.7:0/2143536227 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb20c0a35d0 0x7fb20c0a5a90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb21000adc0 tx=0x7fb21000a380 comp rx=0 tx=0).stop 2024-09-19T08:45:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.356+0000 7fb22311e640 1 -- 172.21.15.7:0/2143536227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb21c1036e0 msgr2=0x7fb21c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:33.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.356+0000 7fb22311e640 1 --2- 172.21.15.7:0/2143536227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb21c1036e0 0x7fb21c100ed0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb20802a940 tx=0x7fb2080042f0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.356+0000 7fb22311e640 1 -- 172.21.15.7:0/2143536227 shutdown_connections 2024-09-19T08:45:33.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.357+0000 7fb22311e640 1 --2- 172.21.15.7:0/2143536227 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb20c0a35d0 0x7fb20c0a5a90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.357+0000 7fb22311e640 1 --2- 172.21.15.7:0/2143536227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb21c1082a0 0x7fb21c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.357+0000 7fb22311e640 1 --2- 172.21.15.7:0/2143536227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb21c1036e0 0x7fb21c100ed0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.357+0000 7fb22311e640 1 --2- 172.21.15.7:0/2143536227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb21c102d30 0x7fb21c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:33.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.357+0000 7fb22311e640 1 -- 172.21.15.7:0/2143536227 >> 172.21.15.7:0/2143536227 conn(0x7fb21c0fc7d0 msgr2=0x7fb21c105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:33.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.357+0000 7fb22311e640 1 -- 172.21.15.7:0/2143536227 shutdown_connections 2024-09-19T08:45:33.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:33.357+0000 7fb22311e640 1 -- 172.21.15.7:0/2143536227 wait complete. 2024-09-19T08:45:33.991 INFO:tasks.cephfs.filesystem:scrub status for tag:7071a177-4b80-4a0d-adb6-71b11033ef04 - {'path': '/', 'tag': '7071a177-4b80-4a0d-adb6-71b11033ef04', 'options': 'recursive,force'} 2024-09-19T08:45:34.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:34 smithi044 ceph-mon[35072]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T08:45:34.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:34 smithi044 ceph-mon[35072]: scrub summary: idle 2024-09-19T08:45:34.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:34 smithi175 ceph-mon[35688]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T08:45:34.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:34 smithi175 ceph-mon[35688]: scrub summary: idle 2024-09-19T08:45:34.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:34 smithi007 ceph-mon[31221]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T08:45:34.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:34 smithi007 ceph-mon[31221]: scrub summary: idle 2024-09-19T08:45:36.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:36 smithi044 ceph-mon[35072]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:45:36.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:36 smithi175 ceph-mon[35688]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:45:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:36 smithi007 ceph-mon[31221]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:45:38.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:38 smithi175 ceph-mon[35688]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T08:45:38.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:38 smithi007 ceph-mon[31221]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T08:45:38.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:38 smithi044 ceph-mon[35072]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T08:45:40.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:40 smithi175 ceph-mon[35688]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T08:45:40.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:40 smithi007 ceph-mon[31221]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T08:45:40.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:40 smithi044 ceph-mon[35072]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T08:45:42.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:42 smithi175 ceph-mon[35688]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:45:42.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:42 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:42.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:42 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:42.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:42 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:45:42.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:42 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:45:42.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:42 smithi007 ceph-mon[31221]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:45:42.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:42 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:42.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:42 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:42.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:42 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:45:42.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:42 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:45:42.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:42 smithi044 ceph-mon[35072]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:45:42.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:42 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:42.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:42 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:42.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:42 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:45:42.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:42 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:45:44.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:44 smithi175 ceph-mon[35688]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T08:45:44.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:44 smithi007 ceph-mon[31221]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T08:45:44.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:44 smithi044 ceph-mon[35072]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T08:45:46.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:46 smithi175 ceph-mon[35688]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:45:46.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:46 smithi007 ceph-mon[31221]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:45:46.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:46 smithi044 ceph-mon[35072]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:45:48.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:48 smithi007 ceph-mon[31221]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:45:48.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:48 smithi175 ceph-mon[35688]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:45:48.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:48 smithi044 ceph-mon[35072]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:45:50.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:50 smithi175 ceph-mon[35688]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:45:50.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:50 smithi007 ceph-mon[31221]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:45:50.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:50 smithi044 ceph-mon[35072]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T08:45:51.997 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T08:45:51.997 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T08:45:51.997 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:45:52.273 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:52.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:52 smithi175 ceph-mon[35688]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:45:52.696 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:52 smithi007 ceph-mon[31221]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:45:52.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:52 smithi044 ceph-mon[35072]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:45:53.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.035+0000 7fc85d5df640 1 -- 172.21.15.7:0/1096712259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc858102790 msgr2=0x7fc8581067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:53.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.035+0000 7fc85d5df640 1 --2- 172.21.15.7:0/1096712259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc858102790 0x7fc8581067e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc840009900 tx=0x7fc84002a410 comp rx=0 tx=0).stop 2024-09-19T08:45:53.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.035+0000 7fc85d5df640 1 -- 172.21.15.7:0/1096712259 shutdown_connections 2024-09-19T08:45:53.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.035+0000 7fc85d5df640 1 --2- 172.21.15.7:0/1096712259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc858106f10 0x7fc85810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:53.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.035+0000 7fc85d5df640 1 --2- 172.21.15.7:0/1096712259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc858102790 0x7fc8581067e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:53.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.035+0000 7fc85d5df640 1 --2- 172.21.15.7:0/1096712259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc858101de0 0x7fc8581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:53.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.035+0000 7fc85d5df640 1 -- 172.21.15.7:0/1096712259 >> 172.21.15.7:0/1096712259 conn(0x7fc8580fd8c0 msgr2=0x7fc8580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:53.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.035+0000 7fc85d5df640 1 -- 172.21.15.7:0/1096712259 shutdown_connections 2024-09-19T08:45:53.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.035+0000 7fc85d5df640 1 -- 172.21.15.7:0/1096712259 wait complete. 2024-09-19T08:45:53.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.035+0000 7fc85d5df640 1 Processor -- start 2024-09-19T08:45:53.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.036+0000 7fc85d5df640 1 -- start start 2024-09-19T08:45:53.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.036+0000 7fc85d5df640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc858101de0 0x7fc858198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.036+0000 7fc85d5df640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc858102790 0x7fc8581989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.036+0000 7fc85d5df640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc858106f10 0x7fc85819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.036+0000 7fc85d5df640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc858111f70 con 0x7fc858101de0 2024-09-19T08:45:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.036+0000 7fc85d5df640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc858111df0 con 0x7fc858106f10 2024-09-19T08:45:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.036+0000 7fc85d5df640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc8581120f0 con 0x7fc858102790 2024-09-19T08:45:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.036+0000 7fc856ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc858101de0 0x7fc858198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.036+0000 7fc856ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc858101de0 0x7fc858198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55906/0 (socket says 172.21.15.7:55906) 2024-09-19T08:45:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.036+0000 7fc856ffd640 1 -- 172.21.15.7:0/512095868 learned_addr learned my addr 172.21.15.7:0/512095868 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.036+0000 7fc8577fe640 1 --2- 172.21.15.7:0/512095868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc858106f10 0x7fc85819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.036+0000 7fc84ffff640 1 --2- 172.21.15.7:0/512095868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc858102790 0x7fc8581989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.036+0000 7fc856ffd640 1 -- 172.21.15.7:0/512095868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc858102790 msgr2=0x7fc8581989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.036+0000 7fc856ffd640 1 --2- 172.21.15.7:0/512095868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc858102790 0x7fc8581989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.036+0000 7fc856ffd640 1 -- 172.21.15.7:0/512095868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc858106f10 msgr2=0x7fc85819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:53.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.036+0000 7fc856ffd640 1 --2- 172.21.15.7:0/512095868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc858106f10 0x7fc85819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:53.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.036+0000 7fc856ffd640 1 -- 172.21.15.7:0/512095868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc85819d440 con 0x7fc858101de0 2024-09-19T08:45:53.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.036+0000 7fc84ffff640 1 --2- 172.21.15.7:0/512095868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc858102790 0x7fc8581989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:53.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.037+0000 7fc856ffd640 1 --2- 172.21.15.7:0/512095868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc858101de0 0x7fc858198490 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc84800c890 tx=0x7fc84800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:53.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.037+0000 7fc854ff9640 1 -- 172.21.15.7:0/512095868 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc848004220 con 0x7fc858101de0 2024-09-19T08:45:53.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.037+0000 7fc854ff9640 1 -- 172.21.15.7:0/512095868 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8480043c0 con 0x7fc858101de0 2024-09-19T08:45:53.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.037+0000 7fc854ff9640 1 -- 172.21.15.7:0/512095868 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8480049e0 con 0x7fc858101de0 2024-09-19T08:45:53.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.037+0000 7fc85d5df640 1 -- 172.21.15.7:0/512095868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc85819d730 con 0x7fc858101de0 2024-09-19T08:45:53.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.037+0000 7fc85d5df640 1 -- 172.21.15.7:0/512095868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8581a5010 con 0x7fc858101de0 2024-09-19T08:45:53.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.038+0000 7fc85d5df640 1 -- 172.21.15.7:0/512095868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8581021c0 con 0x7fc858101de0 2024-09-19T08:45:53.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.039+0000 7fc854ff9640 1 -- 172.21.15.7:0/512095868 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 138587+0+0 (secure 0 0 0) 0x7fc8480079b0 con 0x7fc858101de0 2024-09-19T08:45:53.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.040+0000 7fc854ff9640 1 --2- 172.21.15.7:0/512095868 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc8440a34d0 0x7fc8440a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:53.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.040+0000 7fc84ffff640 1 --2- 172.21.15.7:0/512095868 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc8440a34d0 0x7fc8440a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:53.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.040+0000 7fc854ff9640 1 -- 172.21.15.7:0/512095868 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fc8480d0040 con 0x7fc858101de0 2024-09-19T08:45:53.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.040+0000 7fc84ffff640 1 --2- 172.21.15.7:0/512095868 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc8440a34d0 0x7fc8440a5990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc8580fdce0 tx=0x7fc840005a20 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:53.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.044+0000 7fc854ff9640 1 -- 172.21.15.7:0/512095868 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc848014030 con 0x7fc858101de0 2024-09-19T08:45:53.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.277+0000 7fc85d5df640 1 -- 172.21.15.7:0/512095868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc85810a180 con 0x7fc858101de0 2024-09-19T08:45:53.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.278+0000 7fc854ff9640 1 -- 172.21.15.7:0/512095868 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7fc84809c7c0 con 0x7fc858101de0 2024-09-19T08:45:53.278 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:45:53.278 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:45:53.279 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:45:53.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.281+0000 7fc85d5df640 1 -- 172.21.15.7:0/512095868 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc8440a34d0 msgr2=0x7fc8440a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:53.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.281+0000 7fc85d5df640 1 --2- 172.21.15.7:0/512095868 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc8440a34d0 0x7fc8440a5990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc8580fdce0 tx=0x7fc840005a20 comp rx=0 tx=0).stop 2024-09-19T08:45:53.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.281+0000 7fc85d5df640 1 -- 172.21.15.7:0/512095868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc858101de0 msgr2=0x7fc858198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:53.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.281+0000 7fc85d5df640 1 --2- 172.21.15.7:0/512095868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc858101de0 0x7fc858198490 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc84800c890 tx=0x7fc84800cd50 comp rx=0 tx=0).stop 2024-09-19T08:45:53.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.281+0000 7fc85d5df640 1 -- 172.21.15.7:0/512095868 shutdown_connections 2024-09-19T08:45:53.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.281+0000 7fc85d5df640 1 --2- 172.21.15.7:0/512095868 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc8440a34d0 0x7fc8440a5990 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:53.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.281+0000 7fc85d5df640 1 --2- 172.21.15.7:0/512095868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc858106f10 0x7fc85819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:53.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.281+0000 7fc85d5df640 1 --2- 172.21.15.7:0/512095868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc858102790 0x7fc8581989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:53.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.281+0000 7fc85d5df640 1 --2- 172.21.15.7:0/512095868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc858101de0 0x7fc858198490 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:53.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.281+0000 7fc85d5df640 1 -- 172.21.15.7:0/512095868 >> 172.21.15.7:0/512095868 conn(0x7fc8580fd8c0 msgr2=0x7fc8580fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:53.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.281+0000 7fc85d5df640 1 -- 172.21.15.7:0/512095868 shutdown_connections 2024-09-19T08:45:53.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:53.281+0000 7fc85d5df640 1 -- 172.21.15.7:0/512095868 wait complete. 2024-09-19T08:45:53.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:53 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/512095868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:45:53.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:53 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/512095868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:45:53.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:53 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/512095868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:45:54.235 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24491 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T08:45:54.235 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24491 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T08:45:54.387 INFO:tasks.workunit.client.0.smithi007.stderr:Updating files: 90% (11704/12896) Updating files: 91% (11736/12896) Updating files: 92% (11865/12896) Updating files: 93% (11994/12896) Updating files: 94% (12123/12896) Updating files: 95% (12252/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T08:45:54.505 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:54.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:54 smithi007 ceph-mon[31221]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:45:54.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:54 smithi175 ceph-mon[35688]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:45:54.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:54 smithi044 ceph-mon[35072]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:45:55.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.009+0000 7fe899ac5640 1 -- 172.21.15.7:0/2373673449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe894100e20 msgr2=0x7fe894101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:55.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.009+0000 7fe899ac5640 1 --2- 172.21.15.7:0/2373673449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe894100e20 0x7fe894101200 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe884009900 tx=0x7fe88402a480 comp rx=0 tx=0).stop 2024-09-19T08:45:55.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.009+0000 7fe899ac5640 1 -- 172.21.15.7:0/2373673449 shutdown_connections 2024-09-19T08:45:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.009+0000 7fe899ac5640 1 --2- 172.21.15.7:0/2373673449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe894102ef0 0x7fe89410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.009+0000 7fe899ac5640 1 --2- 172.21.15.7:0/2373673449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe894102570 0x7fe8941029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.009+0000 7fe899ac5640 1 --2- 172.21.15.7:0/2373673449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe894100e20 0x7fe894101200 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.009+0000 7fe899ac5640 1 -- 172.21.15.7:0/2373673449 >> 172.21.15.7:0/2373673449 conn(0x7fe8940fc7d0 msgr2=0x7fe8940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.009+0000 7fe899ac5640 1 -- 172.21.15.7:0/2373673449 shutdown_connections 2024-09-19T08:45:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.009+0000 7fe899ac5640 1 -- 172.21.15.7:0/2373673449 wait complete. 2024-09-19T08:45:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.010+0000 7fe899ac5640 1 Processor -- start 2024-09-19T08:45:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.010+0000 7fe899ac5640 1 -- start start 2024-09-19T08:45:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.010+0000 7fe899ac5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe894100e20 0x7fe894103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.010+0000 7fe899ac5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe894102570 0x7fe894103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.010+0000 7fe899ac5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe894102ef0 0x7fe8941041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.010+0000 7fe899ac5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe894110f80 con 0x7fe894102ef0 2024-09-19T08:45:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.010+0000 7fe899ac5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe894110e00 con 0x7fe894102570 2024-09-19T08:45:55.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.010+0000 7fe899ac5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe894111100 con 0x7fe894100e20 2024-09-19T08:45:55.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.011+0000 7fe893fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe894102ef0 0x7fe8941041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:55.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.011+0000 7fe8937fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe894100e20 0x7fe894103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:55.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.011+0000 7fe893fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe894102ef0 0x7fe8941041d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57314/0 (socket says 172.21.15.7:57314) 2024-09-19T08:45:55.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.011+0000 7fe893fff640 1 -- 172.21.15.7:0/1993301873 learned_addr learned my addr 172.21.15.7:0/1993301873 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:55.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.011+0000 7fe8937fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe894100e20 0x7fe894103750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.7:50610/0 (socket says 172.21.15.7:50610) 2024-09-19T08:45:55.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.011+0000 7fe892ffd640 1 --2- 172.21.15.7:0/1993301873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe894102570 0x7fe894103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:55.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.011+0000 7fe893fff640 1 -- 172.21.15.7:0/1993301873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe894100e20 msgr2=0x7fe894103750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:55.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.011+0000 7fe893fff640 1 --2- 172.21.15.7:0/1993301873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe894100e20 0x7fe894103750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.011+0000 7fe893fff640 1 -- 172.21.15.7:0/1993301873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe894102570 msgr2=0x7fe894103c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:55.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.011+0000 7fe893fff640 1 --2- 172.21.15.7:0/1993301873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe894102570 0x7fe894103c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.011+0000 7fe893fff640 1 -- 172.21.15.7:0/1993301873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8941a69c0 con 0x7fe894102ef0 2024-09-19T08:45:55.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.011+0000 7fe892ffd640 1 --2- 172.21.15.7:0/1993301873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe894102570 0x7fe894103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:55.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.011+0000 7fe893fff640 1 --2- 172.21.15.7:0/1993301873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe894102ef0 0x7fe8941041d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00eb10 tx=0x7fe88c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:55.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.011+0000 7fe890ff9640 1 -- 172.21.15.7:0/1993301873 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c004b20 con 0x7fe894102ef0 2024-09-19T08:45:55.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.011+0000 7fe890ff9640 1 -- 172.21.15.7:0/1993301873 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe88c004cc0 con 0x7fe894102ef0 2024-09-19T08:45:55.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.011+0000 7fe899ac5640 1 -- 172.21.15.7:0/1993301873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8941a6cb0 con 0x7fe894102ef0 2024-09-19T08:45:55.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.011+0000 7fe890ff9640 1 -- 172.21.15.7:0/1993301873 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c010760 con 0x7fe894102ef0 2024-09-19T08:45:55.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.012+0000 7fe899ac5640 1 -- 172.21.15.7:0/1993301873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8941a71f0 con 0x7fe894102ef0 2024-09-19T08:45:55.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.014+0000 7fe890ff9640 1 -- 172.21.15.7:0/1993301873 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 138587+0+0 (secure 0 0 0) 0x7fe88c005020 con 0x7fe894102ef0 2024-09-19T08:45:55.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.014+0000 7fe89be9e740 1 Processor -- start 2024-09-19T08:45:55.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.014+0000 7fe89be9e740 1 -- start start 2024-09-19T08:45:55.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.014+0000 7fe890ff9640 1 --2- 172.21.15.7:0/1993301873 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe87c0a3550 0x7fe87c0a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:55.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.015+0000 7fe892ffd640 1 --2- 172.21.15.7:0/1993301873 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe87c0a3550 0x7fe87c0a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:55.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.015+0000 7fe89be9e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131e2850 0x5644131e2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:55.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.015+0000 7fe89be9e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131e3170 0x5644131ed4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.015+0000 7fe89be9e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131eda30 0x5644131efe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.015+0000 7fe89be9e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564413147160 con 0x5644131e3170 2024-09-19T08:45:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.015+0000 7fe89be9e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5644130ee720 con 0x5644131e2850 2024-09-19T08:45:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.015+0000 7fe890ff9640 1 -- 172.21.15.7:0/1993301873 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fe88c0d0520 con 0x7fe894102ef0 2024-09-19T08:45:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.015+0000 7fe89be9e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564413143120 con 0x5644131eda30 2024-09-19T08:45:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.015+0000 7fe8937fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131e2850 0x5644131e2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.015+0000 7fe892ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131e3170 0x5644131ed4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.015+0000 7fe8937fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131e2850 0x5644131e2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:49896/0 (socket says 172.21.15.7:49896) 2024-09-19T08:45:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.015+0000 7fe8937fe640 1 -- 172.21.15.7:0/3521471548 learned_addr learned my addr 172.21.15.7:0/3521471548 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.015+0000 7fe893fff640 1 --2- 172.21.15.7:0/3521471548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131eda30 0x5644131efe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.015+0000 7fe8937fe640 1 -- 172.21.15.7:0/3521471548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131eda30 msgr2=0x5644131efe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.015+0000 7fe8937fe640 1 --2- 172.21.15.7:0/3521471548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131eda30 0x5644131efe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.015+0000 7fe892ffd640 1 --2- 172.21.15.7:0/1993301873 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe87c0a3550 0x7fe87c0a5a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe8880058c0 tx=0x7fe8880139c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.015+0000 7fe8937fe640 1 -- 172.21.15.7:0/3521471548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131e3170 msgr2=0x5644131ed4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.015+0000 7fe8937fe640 1 --2- 172.21.15.7:0/3521471548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131e3170 0x5644131ed4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.015+0000 7fe8937fe640 1 -- 172.21.15.7:0/3521471548 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564412eb8ba0 con 0x5644131e2850 2024-09-19T08:45:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.015+0000 7fe893fff640 1 --2- 172.21.15.7:0/3521471548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131eda30 0x5644131efe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:45:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.016+0000 7fe8937fe640 1 --2- 172.21.15.7:0/3521471548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131e2850 0x5644131e2c30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe88402a9a0 tx=0x7fe884005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b4944a981524bca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.016+0000 7fe879ffb640 1 -- 172.21.15.7:0/3521471548 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884035030 con 0x5644131e2850 2024-09-19T08:45:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.016+0000 7fe879ffb640 1 -- 172.21.15.7:0/3521471548 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe884040070 con 0x5644131e2850 2024-09-19T08:45:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.016+0000 7fe879ffb640 1 -- 172.21.15.7:0/3521471548 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8840317a0 con 0x5644131e2850 2024-09-19T08:45:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.017+0000 7fe89be9e740 1 -- 172.21.15.7:0/3521471548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131e2850 msgr2=0x5644131e2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.017+0000 7fe89be9e740 1 --2- 172.21.15.7:0/3521471548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131e2850 0x5644131e2c30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe88402a9a0 tx=0x7fe884005e80 comp rx=0 tx=0).stop 2024-09-19T08:45:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.017+0000 7fe89be9e740 1 -- 172.21.15.7:0/3521471548 shutdown_connections 2024-09-19T08:45:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.017+0000 7fe89be9e740 1 --2- 172.21.15.7:0/3521471548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131eda30 0x5644131efe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.017+0000 7fe89be9e740 1 --2- 172.21.15.7:0/3521471548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131e3170 0x5644131ed4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.017+0000 7fe89be9e740 1 --2- 172.21.15.7:0/3521471548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131e2850 0x5644131e2c30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.017+0000 7fe89be9e740 1 -- 172.21.15.7:0/3521471548 >> 172.21.15.7:0/3521471548 conn(0x5644131dede0 msgr2=0x5644131df1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.017+0000 7fe89be9e740 1 -- 172.21.15.7:0/3521471548 shutdown_connections 2024-09-19T08:45:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.017+0000 7fe89be9e740 1 -- 172.21.15.7:0/3521471548 wait complete. 2024-09-19T08:45:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.017+0000 7fe89be9e740 1 -- start start 2024-09-19T08:45:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.017+0000 7fe89be9e740 1 Processor -- start 2024-09-19T08:45:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.018+0000 7fe89be9e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131e2850 0x5644131ea840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.018+0000 7fe89be9e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131e3170 0x5644131ead80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.018+0000 7fe89be9e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131eda30 0x5644131eb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.018+0000 7fe89be9e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5644131f0600 con 0x5644131e2850 2024-09-19T08:45:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.018+0000 7fe89be9e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5644130cf900 con 0x5644131eda30 2024-09-19T08:45:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.018+0000 7fe89be9e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5644131f0780 con 0x5644131e3170 2024-09-19T08:45:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.018+0000 7fe89be9e740 10 client.0 _ll_register_callbacks cb 0x5644130cd780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.018+0000 7fe8937fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131e2850 0x5644131ea840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:55.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.018+0000 7fe8937fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131e2850 0x5644131ea840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57320/0 (socket says 172.21.15.7:57320) 2024-09-19T08:45:55.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.018+0000 7fe8937fe640 1 -- 172.21.15.7:0/249047486 learned_addr learned my addr 172.21.15.7:0/249047486 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:55.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.018+0000 7fe893fff640 1 --2- 172.21.15.7:0/249047486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131eda30 0x5644131eb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:55.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.018+0000 7fe892ffd640 1 --2- 172.21.15.7:0/249047486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131e3170 0x5644131ead80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:55.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.018+0000 7fe8937fe640 1 -- 172.21.15.7:0/249047486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131e3170 msgr2=0x5644131ead80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:55.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.018+0000 7fe8937fe640 1 --2- 172.21.15.7:0/249047486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131e3170 0x5644131ead80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.018+0000 7fe8937fe640 1 -- 172.21.15.7:0/249047486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131eda30 msgr2=0x5644131eb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:55.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.018+0000 7fe8937fe640 1 --2- 172.21.15.7:0/249047486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131eda30 0x5644131eb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.018+0000 7fe8937fe640 1 -- 172.21.15.7:0/249047486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56441310fc50 con 0x5644131e2850 2024-09-19T08:45:55.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.018+0000 7fe8937fe640 1 --2- 172.21.15.7:0/249047486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131e2850 0x5644131ea840 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe884000c00 tx=0x7fe884004370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93de42db7ab5118 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:55.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.018+0000 7fe872ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:45:55.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.019+0000 7fe872ffd640 1 -- 172.21.15.7:0/249047486 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884035070 con 0x5644131e2850 2024-09-19T08:45:55.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.019+0000 7fe89be9e740 1 -- 172.21.15.7:0/249047486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe884040070 con 0x5644131e2850 2024-09-19T08:45:55.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.019+0000 7fe872ffd640 1 -- 172.21.15.7:0/249047486 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fe884003800 con 0x5644131e2850 2024-09-19T08:45:55.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.019+0000 7fe872ffd640 1 -- 172.21.15.7:0/249047486 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe884056050 con 0x5644131e2850 2024-09-19T08:45:55.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.019+0000 7fe89be9e740 10 client.15600 fetch_fsmap learned FSMap version 25 2024-09-19T08:45:55.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.019+0000 7fe89be9e740 1 -- 172.21.15.7:0/249047486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5644131fc200 con 0x5644131e2850 2024-09-19T08:45:55.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.019+0000 7fe872ffd640 1 -- 172.21.15.7:0/249047486 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe884040070 con 0x5644131e2850 2024-09-19T08:45:55.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.019+0000 7fe872ffd640 1 -- 172.21.15.7:0/249047486 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe884004910 con 0x5644131e2850 2024-09-19T08:45:55.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.019+0000 7fe89be9e740 10 client.15600 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:45:55.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.019+0000 7fe89be9e740 10 client.15600 resolve_mds: validated gid 24491 aka daemon mds.b 2024-09-19T08:45:55.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.019+0000 7fe89be9e740 20 client.15600 populate_metadata read hostname 'smithi007' 2024-09-19T08:45:55.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.019+0000 7fe89be9e740 1 --2- 172.21.15.7:0/249047486 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5644131fd550 0x5644131ff940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:55.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.019+0000 7fe89be9e740 4 client.15600 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:45:55.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.019+0000 7fe89be9e740 1 -- 172.21.15.7:0/249047486 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564413154890 con 0x5644131fd550 2024-09-19T08:45:55.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.020+0000 7fe892ffd640 1 --2- 172.21.15.7:0/249047486 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5644131fd550 0x5644131ff940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:55.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.020+0000 7fe892ffd640 1 --2- 172.21.15.7:0/249047486 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5644131fd550 0x5644131ff940 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=515e6f7ad85b0e9 server_cookie=2b0c8cd65db328f6 in_seq=0 out_seq=0 2024-09-19T08:45:55.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.020+0000 7fe872ffd640 10 client.15600 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:55.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.021+0000 7fe872ffd640 1 -- 172.21.15.7:0/249047486 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564413154890 con 0x5644131fd550 2024-09-19T08:45:55.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.021+0000 7fe872ffd640 10 client.15600 handle_command_reply: tid=0 2024-09-19T08:45:55.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.021+0000 7fe89be9e740 1 client.15600 shutdown 2024-09-19T08:45:55.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.021+0000 7fe89be9e740 1 -- 172.21.15.7:0/249047486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131e2850 msgr2=0x5644131ea840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:55.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.021+0000 7fe89be9e740 1 --2- 172.21.15.7:0/249047486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131e2850 0x5644131ea840 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe884000c00 tx=0x7fe884004370 comp rx=0 tx=0).stop 2024-09-19T08:45:55.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.021+0000 7fe89be9e740 1 -- 172.21.15.7:0/249047486 shutdown_connections 2024-09-19T08:45:55.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.021+0000 7fe89be9e740 1 --2- 172.21.15.7:0/249047486 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5644131fd550 0x5644131ff940 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.021+0000 7fe89be9e740 1 --2- 172.21.15.7:0/249047486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131eda30 0x5644131eb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.021+0000 7fe89be9e740 1 --2- 172.21.15.7:0/249047486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131e3170 0x5644131ead80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.021+0000 7fe89be9e740 1 --2- 172.21.15.7:0/249047486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131e2850 0x5644131ea840 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.021+0000 7fe89be9e740 1 -- 172.21.15.7:0/249047486 >> 172.21.15.7:0/249047486 conn(0x5644131dede0 msgr2=0x5644131e4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:55.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.021+0000 7fe872ffd640 0 client.15600 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:55.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.021+0000 7fe89be9e740 1 -- 172.21.15.7:0/249047486 shutdown_connections 2024-09-19T08:45:55.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.021+0000 7fe89be9e740 1 -- 172.21.15.7:0/249047486 wait complete. 2024-09-19T08:45:55.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.021+0000 7fe89be9e740 20 client.15600 trim_cache size 0 max 16384 2024-09-19T08:45:55.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.038+0000 7fe89be9e740 1 Processor -- start 2024-09-19T08:45:55.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.038+0000 7fe89be9e740 1 -- start start 2024-09-19T08:45:55.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.039+0000 7fe89be9e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131e2850 0x5644131e52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:55.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.039+0000 7fe89be9e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131e3170 0x5644131e7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:55.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.039+0000 7fe89be9e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131eda30 0x5644131e7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:55.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.039+0000 7fe89be9e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe8941b2340 con 0x5644131e3170 2024-09-19T08:45:55.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.039+0000 7fe89be9e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe8941afc10 con 0x5644131eda30 2024-09-19T08:45:55.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.039+0000 7fe89be9e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe8941ada60 con 0x5644131e2850 2024-09-19T08:45:55.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.039+0000 7fe892ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131e3170 0x5644131e7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:55.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.039+0000 7fe892ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131e3170 0x5644131e7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57322/0 (socket says 172.21.15.7:57322) 2024-09-19T08:45:55.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.039+0000 7fe892ffd640 1 -- 172.21.15.7:0/2984320201 learned_addr learned my addr 172.21.15.7:0/2984320201 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:55.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.039+0000 7fe893fff640 1 --2- 172.21.15.7:0/2984320201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131eda30 0x5644131e7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:55.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.039+0000 7fe8937fe640 1 --2- 172.21.15.7:0/2984320201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131e2850 0x5644131e52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:55.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.039+0000 7fe892ffd640 1 -- 172.21.15.7:0/2984320201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131e2850 msgr2=0x5644131e52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:55.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.039+0000 7fe892ffd640 1 --2- 172.21.15.7:0/2984320201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131e2850 0x5644131e52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.039+0000 7fe892ffd640 1 -- 172.21.15.7:0/2984320201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131eda30 msgr2=0x5644131e7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:55.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.039+0000 7fe892ffd640 1 --2- 172.21.15.7:0/2984320201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131eda30 0x5644131e7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.039+0000 7fe892ffd640 1 -- 172.21.15.7:0/2984320201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644131e2fa0 con 0x5644131e3170 2024-09-19T08:45:55.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.039+0000 7fe893fff640 1 --2- 172.21.15.7:0/2984320201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131eda30 0x5644131e7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:55.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.039+0000 7fe8937fe640 1 --2- 172.21.15.7:0/2984320201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131e2850 0x5644131e52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:55.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.039+0000 7fe892ffd640 1 --2- 172.21.15.7:0/2984320201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131e3170 0x5644131e7aa0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe888005b60 tx=0x7fe88801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab8b1fadc789945 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:55.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.039+0000 7fe8797fa640 1 -- 172.21.15.7:0/2984320201 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe888030070 con 0x5644131e3170 2024-09-19T08:45:55.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.040+0000 7fe8797fa640 1 -- 172.21.15.7:0/2984320201 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe888029400 con 0x5644131e3170 2024-09-19T08:45:55.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.040+0000 7fe8797fa640 1 -- 172.21.15.7:0/2984320201 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88801f6a0 con 0x5644131e3170 2024-09-19T08:45:55.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.041+0000 7fe89be9e740 1 -- 172.21.15.7:0/2984320201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131e3170 msgr2=0x5644131e7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:55.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.041+0000 7fe89be9e740 1 --2- 172.21.15.7:0/2984320201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131e3170 0x5644131e7aa0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe888005b60 tx=0x7fe88801d000 comp rx=0 tx=0).stop 2024-09-19T08:45:55.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.041+0000 7fe89be9e740 1 -- 172.21.15.7:0/2984320201 shutdown_connections 2024-09-19T08:45:55.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.041+0000 7fe89be9e740 1 --2- 172.21.15.7:0/2984320201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131eda30 0x5644131e7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.041+0000 7fe89be9e740 1 --2- 172.21.15.7:0/2984320201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131e3170 0x5644131e7aa0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.041+0000 7fe89be9e740 1 --2- 172.21.15.7:0/2984320201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131e2850 0x5644131e52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.041+0000 7fe89be9e740 1 -- 172.21.15.7:0/2984320201 >> 172.21.15.7:0/2984320201 conn(0x5644131dede0 msgr2=0x5644131f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:55.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.041+0000 7fe89be9e740 1 -- 172.21.15.7:0/2984320201 shutdown_connections 2024-09-19T08:45:55.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.041+0000 7fe89be9e740 1 -- 172.21.15.7:0/2984320201 wait complete. 2024-09-19T08:45:55.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.041+0000 7fe89be9e740 1 -- start start 2024-09-19T08:45:55.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.041+0000 7fe89be9e740 1 Processor -- start 2024-09-19T08:45:55.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.042+0000 7fe89be9e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131e2850 0x564413202930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:55.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.042+0000 7fe89be9e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131e3170 0x564413202e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:55.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.042+0000 7fe89be9e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131eda30 0x5644131ffe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:55.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.042+0000 7fe89be9e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe8941ae0d0 con 0x5644131eda30 2024-09-19T08:45:55.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.042+0000 7fe89be9e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe8941af540 con 0x5644131e3170 2024-09-19T08:45:55.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.042+0000 7fe89be9e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe8941ae7a0 con 0x5644131e2850 2024-09-19T08:45:55.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.042+0000 7fe89be9e740 10 client.0 _ll_register_callbacks cb 0x7fe88800ba90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:45:55.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.042+0000 7fe893fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131eda30 0x5644131ffe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:55.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.042+0000 7fe893fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131eda30 0x5644131ffe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57326/0 (socket says 172.21.15.7:57326) 2024-09-19T08:45:55.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.042+0000 7fe893fff640 1 -- 172.21.15.7:0/3121792909 learned_addr learned my addr 172.21.15.7:0/3121792909 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:45:55.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.042+0000 7fe892ffd640 1 --2- 172.21.15.7:0/3121792909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131e3170 0x564413202e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:55.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.042+0000 7fe8937fe640 1 --2- 172.21.15.7:0/3121792909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131e2850 0x564413202930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:55.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.042+0000 7fe892ffd640 1 -- 172.21.15.7:0/3121792909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131e2850 msgr2=0x564413202930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:55.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.042+0000 7fe892ffd640 1 --2- 172.21.15.7:0/3121792909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131e2850 0x564413202930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.042+0000 7fe892ffd640 1 -- 172.21.15.7:0/3121792909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131eda30 msgr2=0x5644131ffe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:45:55.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.042+0000 7fe892ffd640 1 --2- 172.21.15.7:0/3121792909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131eda30 0x5644131ffe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.042+0000 7fe892ffd640 1 -- 172.21.15.7:0/3121792909 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644132006b0 con 0x5644131e3170 2024-09-19T08:45:55.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.043+0000 7fe892ffd640 1 --2- 172.21.15.7:0/3121792909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131e3170 0x564413202e70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x5644131e2f70 tx=0x7fe888029de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=652c0b0a4862fee9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:55.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.043+0000 7fe872ffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-19T08:45:55.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.043+0000 7fe8937fe640 1 --2- 172.21.15.7:0/3121792909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131e2850 0x564413202930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:55.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.043+0000 7fe893fff640 1 --2- 172.21.15.7:0/3121792909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131eda30 0x5644131ffe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:45:55.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.043+0000 7fe872ffd640 1 -- 172.21.15.7:0/3121792909 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88803b060 con 0x5644131e3170 2024-09-19T08:45:55.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.043+0000 7fe872ffd640 1 -- 172.21.15.7:0/3121792909 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fe8880209a0 con 0x5644131e3170 2024-09-19T08:45:55.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.043+0000 7fe89be9e740 1 -- 172.21.15.7:0/3121792909 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe888029400 con 0x5644131e3170 2024-09-19T08:45:55.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.043+0000 7fe872ffd640 1 -- 172.21.15.7:0/3121792909 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe888030070 con 0x5644131e3170 2024-09-19T08:45:55.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.043+0000 7fe89be9e740 10 client.25349 fetch_fsmap learned FSMap version 25 2024-09-19T08:45:55.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.043+0000 7fe89be9e740 1 -- 172.21.15.7:0/3121792909 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564413267ad0 con 0x5644131e3170 2024-09-19T08:45:55.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.044+0000 7fe872ffd640 1 -- 172.21.15.7:0/3121792909 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe888029400 con 0x5644131e3170 2024-09-19T08:45:55.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.044+0000 7fe872ffd640 1 -- 172.21.15.7:0/3121792909 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe8880050d0 con 0x5644131e3170 2024-09-19T08:45:55.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.044+0000 7fe89be9e740 10 client.25349 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:45:55.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.044+0000 7fe89be9e740 10 client.25349 resolve_mds: validated gid 24491 aka daemon mds.b 2024-09-19T08:45:55.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.044+0000 7fe89be9e740 20 client.25349 populate_metadata read hostname 'smithi007' 2024-09-19T08:45:55.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.044+0000 7fe89be9e740 1 --2- 172.21.15.7:0/3121792909 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5644132681e0 0x56441326a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:55.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.044+0000 7fe89be9e740 4 client.25349 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T08:45:55.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.044+0000 7fe89be9e740 1 -- 172.21.15.7:0/3121792909 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x56441314ebe0 con 0x5644132681e0 2024-09-19T08:45:55.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.044+0000 7fe8937fe640 1 --2- 172.21.15.7:0/3121792909 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5644132681e0 0x56441326a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:55.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.044+0000 7fe872ffd640 10 client.25349 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:55.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.044+0000 7fe8937fe640 1 --2- 172.21.15.7:0/3121792909 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5644132681e0 0x56441326a600 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ed9bdce1716eab server_cookie=4ad7dc5e182b208a in_seq=0 out_seq=0 2024-09-19T08:45:55.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.051+0000 7fe872ffd640 1 -- 172.21.15.7:0/3121792909 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x56441314ebe0 con 0x5644132681e0 2024-09-19T08:45:55.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.051+0000 7fe872ffd640 10 client.25349 handle_command_reply: tid=0 2024-09-19T08:45:55.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.051+0000 7fe89be9e740 1 client.25349 shutdown 2024-09-19T08:45:55.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.051+0000 7fe89be9e740 1 -- 172.21.15.7:0/3121792909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131e3170 msgr2=0x564413202e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:55.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.051+0000 7fe89be9e740 1 --2- 172.21.15.7:0/3121792909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131e3170 0x564413202e70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x5644131e2f70 tx=0x7fe888029de0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.051+0000 7fe89be9e740 1 -- 172.21.15.7:0/3121792909 shutdown_connections 2024-09-19T08:45:55.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.051+0000 7fe89be9e740 1 --2- 172.21.15.7:0/3121792909 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5644132681e0 0x56441326a600 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.051+0000 7fe89be9e740 1 --2- 172.21.15.7:0/3121792909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644131eda30 0x5644131ffe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.051+0000 7fe89be9e740 1 --2- 172.21.15.7:0/3121792909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644131e3170 0x564413202e70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.051+0000 7fe872ffd640 0 client.25349 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:45:55.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.051+0000 7fe89be9e740 1 --2- 172.21.15.7:0/3121792909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644131e2850 0x564413202930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.051+0000 7fe89be9e740 1 -- 172.21.15.7:0/3121792909 >> 172.21.15.7:0/3121792909 conn(0x5644131dede0 msgr2=0x5644131e8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:55.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.052+0000 7fe89be9e740 1 -- 172.21.15.7:0/3121792909 shutdown_connections 2024-09-19T08:45:55.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.052+0000 7fe89be9e740 1 -- 172.21.15.7:0/3121792909 wait complete. 2024-09-19T08:45:55.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.052+0000 7fe89be9e740 20 client.25349 trim_cache size 0 max 16384 2024-09-19T08:45:55.061 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:45:55.062 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 25, 2024-09-19T08:45:55.062 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24491, 2024-09-19T08:45:55.062 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 6, 2024-09-19T08:45:55.062 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": { 2024-09-19T08:45:55.062 INFO:teuthology.orchestra.run.smithi007.stdout: "3f50ac2e": { 2024-09-19T08:45:55.062 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 6, 2024-09-19T08:45:55.062 INFO:teuthology.orchestra.run.smithi007.stdout: "age_ref": 0.0, 2024-09-19T08:45:55.062 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T08:45:55.062 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "QUIESCED", 2024-09-19T08:45:55.062 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T08:45:55.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:45:55.062 INFO:teuthology.orchestra.run.smithi007.stdout: "timeout": 90.0, 2024-09-19T08:45:55.062 INFO:teuthology.orchestra.run.smithi007.stdout: "expiration": 140.3, 2024-09-19T08:45:55.063 INFO:teuthology.orchestra.run.smithi007.stdout: "members": { 2024-09-19T08:45:55.063 INFO:teuthology.orchestra.run.smithi007.stdout: "file:/": { 2024-09-19T08:45:55.063 INFO:teuthology.orchestra.run.smithi007.stdout: "excluded": false, 2024-09-19T08:45:55.063 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T08:45:55.063 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "QUIESCED", 2024-09-19T08:45:55.063 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T08:45:55.063 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:45:55.063 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:45:55.063 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:45:55.063 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:45:55.063 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:45:55.063 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:45:55.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.052+0000 7fe899ac5640 1 -- 172.21.15.7:0/1993301873 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe87c0a3550 msgr2=0x7fe87c0a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:55.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.052+0000 7fe899ac5640 1 --2- 172.21.15.7:0/1993301873 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe87c0a3550 0x7fe87c0a5a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe8880058c0 tx=0x7fe8880139c0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.052+0000 7fe899ac5640 1 -- 172.21.15.7:0/1993301873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe894102ef0 msgr2=0x7fe8941041d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:55.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.052+0000 7fe899ac5640 1 --2- 172.21.15.7:0/1993301873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe894102ef0 0x7fe8941041d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00eb10 tx=0x7fe88c00c2d0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.052+0000 7fe899ac5640 1 -- 172.21.15.7:0/1993301873 shutdown_connections 2024-09-19T08:45:55.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.052+0000 7fe899ac5640 1 --2- 172.21.15.7:0/1993301873 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe87c0a3550 0x7fe87c0a5a10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.052+0000 7fe899ac5640 1 --2- 172.21.15.7:0/1993301873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe894102ef0 0x7fe8941041d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.052+0000 7fe899ac5640 1 --2- 172.21.15.7:0/1993301873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe894102570 0x7fe894103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.052+0000 7fe899ac5640 1 --2- 172.21.15.7:0/1993301873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe894100e20 0x7fe894103750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:55.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.052+0000 7fe899ac5640 1 -- 172.21.15.7:0/1993301873 >> 172.21.15.7:0/1993301873 conn(0x7fe8940fc7d0 msgr2=0x7fe89406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:55.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.053+0000 7fe899ac5640 1 -- 172.21.15.7:0/1993301873 shutdown_connections 2024-09-19T08:45:55.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:45:55.053+0000 7fe899ac5640 1 -- 172.21.15.7:0/1993301873 wait complete. 2024-09-19T08:45:55.149 INFO:tasks.workunit.client.0.smithi007.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T08:45:55.150 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-19T08:45:55.150 INFO:tasks.workunit.client.0.smithi007.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T08:45:55.150 INFO:tasks.workunit.client.0.smithi007.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T08:45:55.150 INFO:tasks.workunit.client.0.smithi007.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T08:45:55.150 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-19T08:45:55.150 INFO:tasks.workunit.client.0.smithi007.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T08:45:55.150 INFO:tasks.workunit.client.0.smithi007.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T08:45:55.150 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-19T08:45:55.150 INFO:tasks.workunit.client.0.smithi007.stderr: git switch -c 2024-09-19T08:45:55.150 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-19T08:45:55.150 INFO:tasks.workunit.client.0.smithi007.stderr:Or undo this operation with: 2024-09-19T08:45:55.150 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-19T08:45:55.150 INFO:tasks.workunit.client.0.smithi007.stderr: git switch - 2024-09-19T08:45:55.151 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-19T08:45:55.151 INFO:tasks.workunit.client.0.smithi007.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T08:45:55.151 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-19T08:45:55.151 INFO:tasks.workunit.client.0.smithi007.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T08:45:55.155 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T08:45:55.257 INFO:tasks.workunit.client.0.smithi007.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T08:45:55.259 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T08:45:55.259 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T08:45:56.211 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3f50ac2e', quiesce took 4.2 seconds. Will release after: 16.150000000000002 2024-09-19T08:45:56.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:56 smithi007 ceph-mon[31221]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:45:56.645 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T08:45:56.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:56 smithi175 ceph-mon[35688]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:45:56.730 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T08:45:56.773 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T08:45:56.775 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T08:45:56.775 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T08:45:56.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:56 smithi044 ceph-mon[35072]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:45:56.815 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T08:45:56.819 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T08:45:56.820 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T08:45:56.836 INFO:tasks.workunit:Running workunits matching suites/fsync-tester.sh on client.0... 2024-09-19T08:45:56.838 INFO:tasks.workunit:Running workunit suites/fsync-tester.sh... 2024-09-19T08:45:56.838 DEBUG:teuthology.orchestra.run.smithi007:workunit test suites/fsync-tester.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-09-19T08:45:58.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:45:58 smithi175 ceph-mon[35688]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T08:45:58.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:45:58 smithi007 ceph-mon[31221]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T08:45:58.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:45:58 smithi044 ceph-mon[35072]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T08:46:00.623 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:00 smithi007 ceph-mon[31221]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:46:00.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:00 smithi175 ceph-mon[35688]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:46:00.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:00 smithi044 ceph-mon[35072]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:46:02.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:02 smithi175 ceph-mon[35688]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:46:02.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:02 smithi007 ceph-mon[31221]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:46:02.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:02 smithi044 ceph-mon[35072]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:46:03.992 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:46:04.265 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:46:04.653 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:04 smithi007 ceph-mon[31221]: pgmap v49: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-19T08:46:04.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:04 smithi007 ceph-mon[31221]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-19T08:46:04.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:04 smithi175 ceph-mon[35688]: pgmap v49: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-19T08:46:04.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:04 smithi175 ceph-mon[35688]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-19T08:46:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.739+0000 7f31ab303640 1 -- 172.21.15.7:0/3511272526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31a4106a80 msgr2=0x7f31a4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.739+0000 7f31ab303640 1 --2- 172.21.15.7:0/3511272526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31a4106a80 0x7f31a4106e60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009930 tx=0x7f31a002a420 comp rx=0 tx=0).stop 2024-09-19T08:46:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.739+0000 7f31ab303640 1 -- 172.21.15.7:0/3511272526 shutdown_connections 2024-09-19T08:46:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.739+0000 7f31ab303640 1 --2- 172.21.15.7:0/3511272526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31a4101420 0x7f31a410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.739+0000 7f31ab303640 1 --2- 172.21.15.7:0/3511272526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31a4100a80 0x7f31a4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.739+0000 7f31ab303640 1 --2- 172.21.15.7:0/3511272526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31a4106a80 0x7f31a4106e60 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.739+0000 7f31ab303640 1 -- 172.21.15.7:0/3511272526 >> 172.21.15.7:0/3511272526 conn(0x7f31a40fc7a0 msgr2=0x7f31a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.740+0000 7f31ab303640 1 -- 172.21.15.7:0/3511272526 shutdown_connections 2024-09-19T08:46:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.740+0000 7f31ab303640 1 -- 172.21.15.7:0/3511272526 wait complete. 2024-09-19T08:46:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.740+0000 7f31ab303640 1 Processor -- start 2024-09-19T08:46:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.740+0000 7f31ab303640 1 -- start start 2024-09-19T08:46:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.740+0000 7f31ab303640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31a4100a80 0x7f31a4102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.740+0000 7f31ab303640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31a4101420 0x7f31a4102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.740+0000 7f31ab303640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31a4106a80 0x7f31a41030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.740+0000 7f31ab303640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f31a4110e80 con 0x7f31a4100a80 2024-09-19T08:46:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.740+0000 7f31ab303640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f31a4110d00 con 0x7f31a4106a80 2024-09-19T08:46:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.740+0000 7f31ab303640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f31a4111000 con 0x7f31a4101420 2024-09-19T08:46:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.740+0000 7f31a909f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31a4100a80 0x7f31a4102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.741+0000 7f31a909f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31a4100a80 0x7f31a4102650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49808/0 (socket says 172.21.15.7:49808) 2024-09-19T08:46:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.741+0000 7f31a909f640 1 -- 172.21.15.7:0/2792538121 learned_addr learned my addr 172.21.15.7:0/2792538121 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.741+0000 7f31a889e640 1 --2- 172.21.15.7:0/2792538121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31a4101420 0x7f31a4102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.741+0000 7f31a98a0640 1 --2- 172.21.15.7:0/2792538121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31a4106a80 0x7f31a41030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.741+0000 7f31a909f640 1 -- 172.21.15.7:0/2792538121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31a4101420 msgr2=0x7f31a4102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.741+0000 7f31a909f640 1 --2- 172.21.15.7:0/2792538121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31a4101420 0x7f31a4102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.741+0000 7f31a909f640 1 -- 172.21.15.7:0/2792538121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31a4106a80 msgr2=0x7f31a41030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.741+0000 7f31a909f640 1 --2- 172.21.15.7:0/2792538121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31a4106a80 0x7f31a41030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.741+0000 7f31a909f640 1 -- 172.21.15.7:0/2792538121 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a41a6890 con 0x7f31a4100a80 2024-09-19T08:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.741+0000 7f31a889e640 1 --2- 172.21.15.7:0/2792538121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31a4101420 0x7f31a4102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.741+0000 7f31a909f640 1 --2- 172.21.15.7:0/2792538121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31a4100a80 0x7f31a4102650 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009230 tx=0x7f31a0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.741+0000 7f319a7fc640 1 -- 172.21.15.7:0/2792538121 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a003f030 con 0x7f31a4100a80 2024-09-19T08:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.741+0000 7f319a7fc640 1 -- 172.21.15.7:0/2792538121 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31a0003ad0 con 0x7f31a4100a80 2024-09-19T08:46:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.741+0000 7f31ab303640 1 -- 172.21.15.7:0/2792538121 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31a41a6b20 con 0x7f31a4100a80 2024-09-19T08:46:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.741+0000 7f319a7fc640 1 -- 172.21.15.7:0/2792538121 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a0035070 con 0x7f31a4100a80 2024-09-19T08:46:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.741+0000 7f31ab303640 1 -- 172.21.15.7:0/2792538121 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31a41a7050 con 0x7f31a4100a80 2024-09-19T08:46:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.744+0000 7f319a7fc640 1 -- 172.21.15.7:0/2792538121 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f31a0042030 con 0x7f31a4100a80 2024-09-19T08:46:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.744+0000 7f31ad6dc740 1 Processor -- start 2024-09-19T08:46:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.744+0000 7f31ad6dc740 1 -- start start 2024-09-19T08:46:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.744+0000 7f31ad6dc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d284a0 0x564c37d28880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.745+0000 7f31ad6dc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c37d28dc0 0x564c37d33140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.745+0000 7f31ad6dc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c37d33680 0x564c37d35a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.745+0000 7f31ad6dc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564c37c8e2e0 con 0x564c37d284a0 2024-09-19T08:46:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.745+0000 7f31ad6dc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564c37c35ce0 con 0x564c37d28dc0 2024-09-19T08:46:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.745+0000 7f31ad6dc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564c37c8a2a0 con 0x564c37d33680 2024-09-19T08:46:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.745+0000 7f31a98a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d284a0 0x564c37d28880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.745+0000 7f31a98a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d284a0 0x564c37d28880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49810/0 (socket says 172.21.15.7:49810) 2024-09-19T08:46:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.745+0000 7f31a98a0640 1 -- 172.21.15.7:0/3654280118 learned_addr learned my addr 172.21.15.7:0/3654280118 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.745+0000 7f319a7fc640 1 --2- 172.21.15.7:0/2792538121 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f31900a3430 0x7f31900a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.745+0000 7f31a909f640 1 --2- 172.21.15.7:0/3654280118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c37d28dc0 0x564c37d33140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.745+0000 7f31a98a0640 1 --2- 172.21.15.7:0/2792538121 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f31900a3430 0x7f31900a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.745+0000 7f31a889e640 1 --2- 172.21.15.7:0/3654280118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c37d33680 0x564c37d35a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.745+0000 7f31a98a0640 1 -- 172.21.15.7:0/3654280118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c37d33680 msgr2=0x564c37d35a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.745+0000 7f31a98a0640 1 --2- 172.21.15.7:0/3654280118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c37d33680 0x564c37d35a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.745+0000 7f31a98a0640 1 -- 172.21.15.7:0/3654280118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c37d28dc0 msgr2=0x564c37d33140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.745+0000 7f31a98a0640 1 --2- 172.21.15.7:0/3654280118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c37d28dc0 0x564c37d33140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.745+0000 7f31a98a0640 1 -- 172.21.15.7:0/3654280118 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c37c1a440 con 0x564c37d284a0 2024-09-19T08:46:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.745+0000 7f319a7fc640 1 -- 172.21.15.7:0/2792538121 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f31a00efea0 con 0x7f31a4100a80 2024-09-19T08:46:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.745+0000 7f31a98a0640 1 --2- 172.21.15.7:0/3654280118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d284a0 0x564c37d28880 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f319c012890 tx=0x7f319c012d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988f31645fad1c95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:04.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.746+0000 7f318f7fe640 1 -- 172.21.15.7:0/3654280118 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319c005020 con 0x564c37d284a0 2024-09-19T08:46:04.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.746+0000 7f318f7fe640 1 -- 172.21.15.7:0/3654280118 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f319c0056a0 con 0x564c37d284a0 2024-09-19T08:46:04.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.746+0000 7f318f7fe640 1 -- 172.21.15.7:0/3654280118 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319c01c810 con 0x564c37d284a0 2024-09-19T08:46:04.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.746+0000 7f31ad6dc740 1 -- 172.21.15.7:0/3654280118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d284a0 msgr2=0x564c37d28880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:04.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.746+0000 7f31ad6dc740 1 --2- 172.21.15.7:0/3654280118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d284a0 0x564c37d28880 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f319c012890 tx=0x7f319c012d50 comp rx=0 tx=0).stop 2024-09-19T08:46:04.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.746+0000 7f31a98a0640 1 --2- 172.21.15.7:0/2792538121 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f31900a3430 0x7f31900a58f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f319c01f000 tx=0x7f319c01e000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:04.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.747+0000 7f31ad6dc740 1 -- 172.21.15.7:0/3654280118 shutdown_connections 2024-09-19T08:46:04.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.747+0000 7f31ad6dc740 1 --2- 172.21.15.7:0/3654280118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c37d33680 0x564c37d35a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.747+0000 7f31ad6dc740 1 --2- 172.21.15.7:0/3654280118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c37d28dc0 0x564c37d33140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.747+0000 7f31ad6dc740 1 --2- 172.21.15.7:0/3654280118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d284a0 0x564c37d28880 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.747+0000 7f31ad6dc740 1 -- 172.21.15.7:0/3654280118 >> 172.21.15.7:0/3654280118 conn(0x564c37d24a30 msgr2=0x564c37d24e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:04.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.747+0000 7f31ad6dc740 1 -- 172.21.15.7:0/3654280118 shutdown_connections 2024-09-19T08:46:04.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.747+0000 7f31ad6dc740 1 -- 172.21.15.7:0/3654280118 wait complete. 2024-09-19T08:46:04.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.747+0000 7f31ad6dc740 1 -- start start 2024-09-19T08:46:04.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.747+0000 7f31ad6dc740 1 Processor -- start 2024-09-19T08:46:04.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.748+0000 7f31ad6dc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c37d284a0 0x564c37d32f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.748+0000 7f31ad6dc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c37d28dc0 0x564c37d301f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.748+0000 7f31ad6dc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d33680 0x564c37d30730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.748+0000 7f31ad6dc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564c37d36250 con 0x564c37d33680 2024-09-19T08:46:04.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.748+0000 7f31ad6dc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564c37c49050 con 0x564c37d28dc0 2024-09-19T08:46:04.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.748+0000 7f31ad6dc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564c37d363d0 con 0x564c37d284a0 2024-09-19T08:46:04.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.748+0000 7f31ad6dc740 10 client.0 _ll_register_callbacks cb 0x564c37c89160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:04.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.748+0000 7f31a98a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d33680 0x564c37d30730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.748+0000 7f31a98a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d33680 0x564c37d30730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49824/0 (socket says 172.21.15.7:49824) 2024-09-19T08:46:04.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.748+0000 7f31a98a0640 1 -- 172.21.15.7:0/1375754262 learned_addr learned my addr 172.21.15.7:0/1375754262 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:04.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.748+0000 7f31a889e640 1 --2- 172.21.15.7:0/1375754262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c37d28dc0 0x564c37d301f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.748+0000 7f31a909f640 1 --2- 172.21.15.7:0/1375754262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c37d284a0 0x564c37d32f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.748+0000 7f31a98a0640 1 -- 172.21.15.7:0/1375754262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c37d284a0 msgr2=0x564c37d32f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:04.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.748+0000 7f31a98a0640 1 --2- 172.21.15.7:0/1375754262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c37d284a0 0x564c37d32f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.748+0000 7f31a98a0640 1 -- 172.21.15.7:0/1375754262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c37d28dc0 msgr2=0x564c37d301f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:04.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.748+0000 7f31a98a0640 1 --2- 172.21.15.7:0/1375754262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c37d28dc0 0x564c37d301f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.748+0000 7f31a98a0640 1 -- 172.21.15.7:0/1375754262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c379ff3c0 con 0x564c37d33680 2024-09-19T08:46:04.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.748+0000 7f31a98a0640 1 --2- 172.21.15.7:0/1375754262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d33680 0x564c37d30730 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f319c005cc0 tx=0x7f319c01c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7068de76a828ad4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:04.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.748+0000 7f318cff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:04.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.749+0000 7f318cff9640 1 -- 172.21.15.7:0/1375754262 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319c01ccf0 con 0x564c37d33680 2024-09-19T08:46:04.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.749+0000 7f318cff9640 1 -- 172.21.15.7:0/1375754262 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f319c021040 con 0x564c37d33680 2024-09-19T08:46:04.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.749+0000 7f31ad6dc740 1 -- 172.21.15.7:0/1375754262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f319c0056a0 con 0x564c37d33680 2024-09-19T08:46:04.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.749+0000 7f318cff9640 1 -- 172.21.15.7:0/1375754262 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f319c005000 con 0x564c37d33680 2024-09-19T08:46:04.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.749+0000 7f31ad6dc740 10 client.15618 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:04.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.749+0000 7f31ad6dc740 1 -- 172.21.15.7:0/1375754262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564c37d41ba0 con 0x564c37d33680 2024-09-19T08:46:04.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.749+0000 7f318cff9640 1 -- 172.21.15.7:0/1375754262 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f319c0056a0 con 0x564c37d33680 2024-09-19T08:46:04.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.749+0000 7f318cff9640 1 -- 172.21.15.7:0/1375754262 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f319c025680 con 0x564c37d33680 2024-09-19T08:46:04.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.749+0000 7f31ad6dc740 10 client.15618 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:04.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.749+0000 7f31ad6dc740 10 client.15618 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:04.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.749+0000 7f31ad6dc740 20 client.15618 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:04.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.749+0000 7f31ad6dc740 1 --2- 172.21.15.7:0/1375754262 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564c37d43060 0x564c37d45450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.749+0000 7f31ad6dc740 4 client.15618 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:46:04.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.749+0000 7f31ad6dc740 1 -- 172.21.15.7:0/1375754262 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c37c9b850 con 0x564c37d43060 2024-09-19T08:46:04.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.750+0000 7f31a909f640 1 --2- 172.21.15.7:0/1375754262 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564c37d43060 0x564c37d45450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.750+0000 7f31a909f640 1 --2- 172.21.15.7:0/1375754262 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564c37d43060 0x564c37d45450 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93b6140edee7dc65 server_cookie=ba379850c706469e in_seq=0 out_seq=0 2024-09-19T08:46:04.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.750+0000 7f318cff9640 10 client.15618 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:04.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.751+0000 7f318cff9640 1 -- 172.21.15.7:0/1375754262 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564c37c9b850 con 0x564c37d43060 2024-09-19T08:46:04.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.751+0000 7f318cff9640 10 client.15618 handle_command_reply: tid=0 2024-09-19T08:46:04.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.751+0000 7f31ad6dc740 1 client.15618 shutdown 2024-09-19T08:46:04.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.751+0000 7f31ad6dc740 1 -- 172.21.15.7:0/1375754262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d33680 msgr2=0x564c37d30730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:04.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.751+0000 7f31ad6dc740 1 --2- 172.21.15.7:0/1375754262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d33680 0x564c37d30730 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f319c005cc0 tx=0x7f319c01c7c0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.751+0000 7f31ad6dc740 1 -- 172.21.15.7:0/1375754262 shutdown_connections 2024-09-19T08:46:04.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.751+0000 7f31ad6dc740 1 --2- 172.21.15.7:0/1375754262 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564c37d43060 0x564c37d45450 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.751+0000 7f31ad6dc740 1 --2- 172.21.15.7:0/1375754262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d33680 0x564c37d30730 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.751+0000 7f31ad6dc740 1 --2- 172.21.15.7:0/1375754262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c37d28dc0 0x564c37d301f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.751+0000 7f31ad6dc740 1 --2- 172.21.15.7:0/1375754262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c37d284a0 0x564c37d32f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.751+0000 7f318cff9640 0 client.15618 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:04.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.751+0000 7f31ad6dc740 1 -- 172.21.15.7:0/1375754262 >> 172.21.15.7:0/1375754262 conn(0x564c37d24a30 msgr2=0x564c37d23b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:04.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.751+0000 7f31ad6dc740 1 -- 172.21.15.7:0/1375754262 shutdown_connections 2024-09-19T08:46:04.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.751+0000 7f31ad6dc740 1 -- 172.21.15.7:0/1375754262 wait complete. 2024-09-19T08:46:04.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.751+0000 7f31ad6dc740 20 client.15618 trim_cache size 0 max 16384 2024-09-19T08:46:04.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.768+0000 7f31ad6dc740 1 Processor -- start 2024-09-19T08:46:04.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.768+0000 7f31ad6dc740 1 -- start start 2024-09-19T08:46:04.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.769+0000 7f31ad6dc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c37d284a0 0x564c37d3f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.769+0000 7f31ad6dc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c37d28dc0 0x564c37d4acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.769+0000 7f31ad6dc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d33680 0x564c37d4b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.769+0000 7f31ad6dc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f31a41b2300 con 0x564c37d33680 2024-09-19T08:46:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.769+0000 7f31ad6dc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f31a41afbd0 con 0x564c37d284a0 2024-09-19T08:46:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.769+0000 7f31ad6dc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f31a41ada20 con 0x564c37d28dc0 2024-09-19T08:46:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.769+0000 7f31a98a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d33680 0x564c37d4b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.769+0000 7f31a98a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d33680 0x564c37d4b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49836/0 (socket says 172.21.15.7:49836) 2024-09-19T08:46:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.769+0000 7f31a98a0640 1 -- 172.21.15.7:0/3959201661 learned_addr learned my addr 172.21.15.7:0/3959201661 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.769+0000 7f31a889e640 1 --2- 172.21.15.7:0/3959201661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c37d28dc0 0x564c37d4acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.769+0000 7f31a909f640 1 --2- 172.21.15.7:0/3959201661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c37d284a0 0x564c37d3f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.769+0000 7f31a98a0640 1 -- 172.21.15.7:0/3959201661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c37d28dc0 msgr2=0x564c37d4acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:04.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.769+0000 7f31a98a0640 1 --2- 172.21.15.7:0/3959201661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c37d28dc0 0x564c37d4acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.769+0000 7f31a98a0640 1 -- 172.21.15.7:0/3959201661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c37d284a0 msgr2=0x564c37d3f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:04.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.769+0000 7f31a98a0640 1 --2- 172.21.15.7:0/3959201661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c37d284a0 0x564c37d3f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.769+0000 7f31a98a0640 1 -- 172.21.15.7:0/3959201661 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c37d45a80 con 0x564c37d33680 2024-09-19T08:46:04.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.769+0000 7f31a909f640 1 --2- 172.21.15.7:0/3959201661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c37d284a0 0x564c37d3f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:04.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.769+0000 7f31a98a0640 1 --2- 172.21.15.7:0/3959201661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d33680 0x564c37d4b1f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f319c002230 tx=0x7f319c007ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad3ce3e43c40726 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:04.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.769+0000 7f318effd640 1 -- 172.21.15.7:0/3959201661 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319c029070 con 0x564c37d33680 2024-09-19T08:46:04.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.770+0000 7f318effd640 1 -- 172.21.15.7:0/3959201661 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f319c0051a0 con 0x564c37d33680 2024-09-19T08:46:04.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.770+0000 7f318effd640 1 -- 172.21.15.7:0/3959201661 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319c031420 con 0x564c37d33680 2024-09-19T08:46:04.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.770+0000 7f31ad6dc740 1 -- 172.21.15.7:0/3959201661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d33680 msgr2=0x564c37d4b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:04.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.770+0000 7f31ad6dc740 1 --2- 172.21.15.7:0/3959201661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d33680 0x564c37d4b1f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f319c002230 tx=0x7f319c007ba0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.770+0000 7f31ad6dc740 1 -- 172.21.15.7:0/3959201661 shutdown_connections 2024-09-19T08:46:04.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.770+0000 7f31ad6dc740 1 --2- 172.21.15.7:0/3959201661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d33680 0x564c37d4b1f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.770+0000 7f31ad6dc740 1 --2- 172.21.15.7:0/3959201661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c37d28dc0 0x564c37d4acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.770+0000 7f31ad6dc740 1 --2- 172.21.15.7:0/3959201661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c37d284a0 0x564c37d3f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.770+0000 7f31ad6dc740 1 -- 172.21.15.7:0/3959201661 >> 172.21.15.7:0/3959201661 conn(0x564c37d24a30 msgr2=0x564c37d2f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:04.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.770+0000 7f31ad6dc740 1 -- 172.21.15.7:0/3959201661 shutdown_connections 2024-09-19T08:46:04.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.770+0000 7f31ad6dc740 1 -- 172.21.15.7:0/3959201661 wait complete. 2024-09-19T08:46:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.770+0000 7f31ad6dc740 1 -- start start 2024-09-19T08:46:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.771+0000 7f31ad6dc740 1 Processor -- start 2024-09-19T08:46:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.771+0000 7f31ad6dc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c37d284a0 0x564c37d38de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.771+0000 7f31ad6dc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d28dc0 0x564c37d39320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.771+0000 7f31ad6dc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c37d33680 0x564c37d3b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.771+0000 7f31ad6dc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f31a41ae090 con 0x564c37d28dc0 2024-09-19T08:46:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.771+0000 7f31ad6dc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f31a41af500 con 0x564c37d284a0 2024-09-19T08:46:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.771+0000 7f31ad6dc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f31a41ae760 con 0x564c37d33680 2024-09-19T08:46:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.771+0000 7f31ad6dc740 10 client.0 _ll_register_callbacks cb 0x7f31a00bbf60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.771+0000 7f31a889e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d28dc0 0x564c37d39320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.771+0000 7f31a889e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d28dc0 0x564c37d39320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49852/0 (socket says 172.21.15.7:49852) 2024-09-19T08:46:04.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.771+0000 7f31a889e640 1 -- 172.21.15.7:0/3447421142 learned_addr learned my addr 172.21.15.7:0/3447421142 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:04.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.771+0000 7f31a909f640 1 --2- 172.21.15.7:0/3447421142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c37d284a0 0x564c37d38de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.771+0000 7f31a98a0640 1 --2- 172.21.15.7:0/3447421142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c37d33680 0x564c37d3b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.771+0000 7f31a889e640 1 -- 172.21.15.7:0/3447421142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c37d33680 msgr2=0x564c37d3b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:04.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.771+0000 7f31a889e640 1 --2- 172.21.15.7:0/3447421142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c37d33680 0x564c37d3b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.771+0000 7f31a889e640 1 -- 172.21.15.7:0/3447421142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c37d284a0 msgr2=0x564c37d38de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:04.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.771+0000 7f31a889e640 1 --2- 172.21.15.7:0/3447421142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c37d284a0 0x564c37d38de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.771+0000 7f31a889e640 1 -- 172.21.15.7:0/3447421142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c37d29330 con 0x564c37d28dc0 2024-09-19T08:46:04.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.772+0000 7f31a889e640 1 --2- 172.21.15.7:0/3447421142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d28dc0 0x564c37d39320 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x564c37d25db0 tx=0x7f3194012bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbaa5055e65b0f24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:04.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.772+0000 7f318cff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:04.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.772+0000 7f318cff9640 1 -- 172.21.15.7:0/3447421142 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3194022060 con 0x564c37d28dc0 2024-09-19T08:46:04.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.772+0000 7f31ad6dc740 1 -- 172.21.15.7:0/3447421142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f319c0051a0 con 0x564c37d28dc0 2024-09-19T08:46:04.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.772+0000 7f318cff9640 1 -- 172.21.15.7:0/3447421142 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f3194004460 con 0x564c37d28dc0 2024-09-19T08:46:04.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.772+0000 7f318cff9640 1 -- 172.21.15.7:0/3447421142 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f31940118f0 con 0x564c37d28dc0 2024-09-19T08:46:04.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.772+0000 7f31ad6dc740 10 client.15624 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:04.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.772+0000 7f31ad6dc740 1 -- 172.21.15.7:0/3447421142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564c37dad6e0 con 0x564c37d28dc0 2024-09-19T08:46:04.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.772+0000 7f318cff9640 1 -- 172.21.15.7:0/3447421142 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f319c0051a0 con 0x564c37d28dc0 2024-09-19T08:46:04.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.772+0000 7f318cff9640 1 -- 172.21.15.7:0/3447421142 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f319401c030 con 0x564c37d28dc0 2024-09-19T08:46:04.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.772+0000 7f31ad6dc740 10 client.15624 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:04.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.772+0000 7f31ad6dc740 10 client.15624 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:04.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.772+0000 7f31ad6dc740 20 client.15624 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:04.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.773+0000 7f31ad6dc740 1 --2- 172.21.15.7:0/3447421142 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564c37dade70 0x564c37db0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:04.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.773+0000 7f31ad6dc740 4 client.15624 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:46:04.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.773+0000 7f31ad6dc740 1 -- 172.21.15.7:0/3447421142 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564c37c95d60 con 0x564c37dade70 2024-09-19T08:46:04.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.773+0000 7f31a909f640 1 --2- 172.21.15.7:0/3447421142 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564c37dade70 0x564c37db0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:04.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.773+0000 7f318cff9640 10 client.15624 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:04.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.773+0000 7f31a909f640 1 --2- 172.21.15.7:0/3447421142 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564c37dade70 0x564c37db0290 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d84080fb84ecdc server_cookie=84f1253bd3c4899b in_seq=0 out_seq=0 2024-09-19T08:46:04.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.773+0000 7f318cff9640 1 -- 172.21.15.7:0/3447421142 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564c37c95d60 con 0x564c37dade70 2024-09-19T08:46:04.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.773+0000 7f318cff9640 10 client.15624 handle_command_reply: tid=0 2024-09-19T08:46:04.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.773+0000 7f31ad6dc740 1 client.15624 shutdown 2024-09-19T08:46:04.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.773+0000 7f31ad6dc740 1 -- 172.21.15.7:0/3447421142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d28dc0 msgr2=0x564c37d39320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:04.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.773+0000 7f31ad6dc740 1 --2- 172.21.15.7:0/3447421142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d28dc0 0x564c37d39320 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x564c37d25db0 tx=0x7f3194012bd0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.774+0000 7f31ad6dc740 1 -- 172.21.15.7:0/3447421142 shutdown_connections 2024-09-19T08:46:04.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.774+0000 7f31ad6dc740 1 --2- 172.21.15.7:0/3447421142 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564c37dade70 0x564c37db0290 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.774+0000 7f31ad6dc740 1 --2- 172.21.15.7:0/3447421142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564c37d33680 0x564c37d3b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.774+0000 7f31ad6dc740 1 --2- 172.21.15.7:0/3447421142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c37d28dc0 0x564c37d39320 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.774+0000 7f31ad6dc740 1 --2- 172.21.15.7:0/3447421142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c37d284a0 0x564c37d38de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.774+0000 7f318cff9640 0 client.15624 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:04.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.774+0000 7f31ad6dc740 1 -- 172.21.15.7:0/3447421142 >> 172.21.15.7:0/3447421142 conn(0x564c37d24a30 msgr2=0x564c37d31a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:04.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.774+0000 7f31ad6dc740 1 -- 172.21.15.7:0/3447421142 shutdown_connections 2024-09-19T08:46:04.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.774+0000 7f31ad6dc740 1 -- 172.21.15.7:0/3447421142 wait complete. 2024-09-19T08:46:04.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.774+0000 7f31ad6dc740 20 client.15624 trim_cache size 0 max 16384 2024-09-19T08:46:04.781 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:46:04.781 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-19T08:46:04.781 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-09-19T08:46:04.782 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:46:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.774+0000 7f31ab303640 1 -- 172.21.15.7:0/2792538121 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f31900a3430 msgr2=0x7f31900a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.774+0000 7f31ab303640 1 --2- 172.21.15.7:0/2792538121 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f31900a3430 0x7f31900a58f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f319c01f000 tx=0x7f319c01e000 comp rx=0 tx=0).stop 2024-09-19T08:46:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.774+0000 7f31ab303640 1 -- 172.21.15.7:0/2792538121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31a4100a80 msgr2=0x7f31a4102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.774+0000 7f31ab303640 1 --2- 172.21.15.7:0/2792538121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31a4100a80 0x7f31a4102650 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009230 tx=0x7f31a0004270 comp rx=0 tx=0).stop 2024-09-19T08:46:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.774+0000 7f31ab303640 1 -- 172.21.15.7:0/2792538121 shutdown_connections 2024-09-19T08:46:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.774+0000 7f31ab303640 1 --2- 172.21.15.7:0/2792538121 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f31900a3430 0x7f31900a58f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.774+0000 7f31ab303640 1 --2- 172.21.15.7:0/2792538121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31a4106a80 0x7f31a41030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.774+0000 7f31ab303640 1 --2- 172.21.15.7:0/2792538121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31a4101420 0x7f31a4102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.774+0000 7f31ab303640 1 --2- 172.21.15.7:0/2792538121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31a4100a80 0x7f31a4102650 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.774+0000 7f31ab303640 1 -- 172.21.15.7:0/2792538121 >> 172.21.15.7:0/2792538121 conn(0x7f31a40fc7a0 msgr2=0x7f31a406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:04.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.775+0000 7f31ab303640 1 -- 172.21.15.7:0/2792538121 shutdown_connections 2024-09-19T08:46:04.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:04.775+0000 7f31ab303640 1 -- 172.21.15.7:0/2792538121 wait complete. 2024-09-19T08:46:04.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:04 smithi044 ceph-mon[35072]: pgmap v49: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-19T08:46:04.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:04 smithi044 ceph-mon[35072]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-19T08:46:05.581 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:46:05.581 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:46:05.844 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:46:06.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.290+0000 7fce6744b640 1 -- 172.21.15.7:0/2199993887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce60100c80 msgr2=0x7fce60106820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:06.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.290+0000 7fce6744b640 1 --2- 172.21.15.7:0/2199993887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce60100c80 0x7fce60106820 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fce50009930 tx=0x7fce5002a420 comp rx=0 tx=0).stop 2024-09-19T08:46:06.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.291+0000 7fce6744b640 1 -- 172.21.15.7:0/2199993887 shutdown_connections 2024-09-19T08:46:06.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.291+0000 7fce6744b640 1 --2- 172.21.15.7:0/2199993887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce60106f30 0x7fce6010ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:06.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.291+0000 7fce6744b640 1 --2- 172.21.15.7:0/2199993887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce60100c80 0x7fce60106820 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:06.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.291+0000 7fce6744b640 1 --2- 172.21.15.7:0/2199993887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce601002d0 0x7fce601006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:06.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.291+0000 7fce6744b640 1 -- 172.21.15.7:0/2199993887 >> 172.21.15.7:0/2199993887 conn(0x7fce600fbee0 msgr2=0x7fce600fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:06.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.291+0000 7fce6744b640 1 -- 172.21.15.7:0/2199993887 shutdown_connections 2024-09-19T08:46:06.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.291+0000 7fce6744b640 1 -- 172.21.15.7:0/2199993887 wait complete. 2024-09-19T08:46:06.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.291+0000 7fce6744b640 1 Processor -- start 2024-09-19T08:46:06.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.291+0000 7fce6744b640 1 -- start start 2024-09-19T08:46:06.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.291+0000 7fce6744b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce601002d0 0x7fce60101250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:06.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.291+0000 7fce6744b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce60100c80 0x7fce60101790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:06.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.292+0000 7fce6744b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce60106f30 0x7fce60101cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:06.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.292+0000 7fce6744b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fce60111f80 con 0x7fce60100c80 2024-09-19T08:46:06.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.292+0000 7fce6744b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fce60111e00 con 0x7fce60106f30 2024-09-19T08:46:06.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.292+0000 7fce6744b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fce60112100 con 0x7fce601002d0 2024-09-19T08:46:06.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.292+0000 7fce649e6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce60100c80 0x7fce60101790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:06.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.292+0000 7fce649e6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce60100c80 0x7fce60101790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49870/0 (socket says 172.21.15.7:49870) 2024-09-19T08:46:06.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.292+0000 7fce649e6640 1 -- 172.21.15.7:0/3177542839 learned_addr learned my addr 172.21.15.7:0/3177542839 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:06.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.292+0000 7fce651e7640 1 --2- 172.21.15.7:0/3177542839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce601002d0 0x7fce60101250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:06.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.292+0000 7fce659e8640 1 --2- 172.21.15.7:0/3177542839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce60106f30 0x7fce60101cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:06.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.292+0000 7fce649e6640 1 -- 172.21.15.7:0/3177542839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce601002d0 msgr2=0x7fce60101250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:06.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.292+0000 7fce649e6640 1 --2- 172.21.15.7:0/3177542839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce601002d0 0x7fce60101250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:06.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.292+0000 7fce649e6640 1 -- 172.21.15.7:0/3177542839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce60106f30 msgr2=0x7fce60101cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:06.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.292+0000 7fce649e6640 1 --2- 172.21.15.7:0/3177542839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce60106f30 0x7fce60101cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:06.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.292+0000 7fce649e6640 1 -- 172.21.15.7:0/3177542839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce601a6960 con 0x7fce60100c80 2024-09-19T08:46:06.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.292+0000 7fce659e8640 1 --2- 172.21.15.7:0/3177542839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce60106f30 0x7fce60101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:06.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.292+0000 7fce649e6640 1 --2- 172.21.15.7:0/3177542839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce60100c80 0x7fce60101790 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fce50005940 tx=0x7fce50004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:06.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.292+0000 7fce567fc640 1 -- 172.21.15.7:0/3177542839 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5003f030 con 0x7fce60100c80 2024-09-19T08:46:06.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.292+0000 7fce567fc640 1 -- 172.21.15.7:0/3177542839 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce50003ad0 con 0x7fce60100c80 2024-09-19T08:46:06.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.292+0000 7fce6744b640 1 -- 172.21.15.7:0/3177542839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce601a6bf0 con 0x7fce60100c80 2024-09-19T08:46:06.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.292+0000 7fce567fc640 1 -- 172.21.15.7:0/3177542839 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce50035070 con 0x7fce60100c80 2024-09-19T08:46:06.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.293+0000 7fce6744b640 1 -- 172.21.15.7:0/3177542839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce601a7120 con 0x7fce60100c80 2024-09-19T08:46:06.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.293+0000 7fce6744b640 1 -- 172.21.15.7:0/3177542839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce601006b0 con 0x7fce60100c80 2024-09-19T08:46:06.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.295+0000 7fce567fc640 1 -- 172.21.15.7:0/3177542839 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fce50042030 con 0x7fce60100c80 2024-09-19T08:46:06.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.296+0000 7fce567fc640 1 --2- 172.21.15.7:0/3177542839 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fce4c0a3430 0x7fce4c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:06.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.296+0000 7fce651e7640 1 --2- 172.21.15.7:0/3177542839 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fce4c0a3430 0x7fce4c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:06.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.296+0000 7fce567fc640 1 -- 172.21.15.7:0/3177542839 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fce500f0590 con 0x7fce60100c80 2024-09-19T08:46:06.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.296+0000 7fce651e7640 1 --2- 172.21.15.7:0/3177542839 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fce4c0a3430 0x7fce4c0a58f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fce5c009bd0 tx=0x7fce5c005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:06.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.299+0000 7fce567fc640 1 -- 172.21.15.7:0/3177542839 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fce500bcf60 con 0x7fce60100c80 2024-09-19T08:46:06.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.512+0000 7fce6744b640 1 -- 172.21.15.7:0/3177542839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce6002d7c0 con 0x7fce60100c80 2024-09-19T08:46:06.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.513+0000 7fce567fc640 1 -- 172.21.15.7:0/3177542839 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7fce500bc860 con 0x7fce60100c80 2024-09-19T08:46:06.513 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:46:06.513 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:46:06.514 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:46:06.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.515+0000 7fce6744b640 1 -- 172.21.15.7:0/3177542839 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fce4c0a3430 msgr2=0x7fce4c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:06.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.515+0000 7fce6744b640 1 --2- 172.21.15.7:0/3177542839 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fce4c0a3430 0x7fce4c0a58f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fce5c009bd0 tx=0x7fce5c005f90 comp rx=0 tx=0).stop 2024-09-19T08:46:06.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.515+0000 7fce6744b640 1 -- 172.21.15.7:0/3177542839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce60100c80 msgr2=0x7fce60101790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:06.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.515+0000 7fce6744b640 1 --2- 172.21.15.7:0/3177542839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce60100c80 0x7fce60101790 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fce50005940 tx=0x7fce50004270 comp rx=0 tx=0).stop 2024-09-19T08:46:06.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.515+0000 7fce6744b640 1 -- 172.21.15.7:0/3177542839 shutdown_connections 2024-09-19T08:46:06.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.515+0000 7fce6744b640 1 --2- 172.21.15.7:0/3177542839 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fce4c0a3430 0x7fce4c0a58f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:06.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.515+0000 7fce6744b640 1 --2- 172.21.15.7:0/3177542839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce60106f30 0x7fce60101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:06.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.515+0000 7fce6744b640 1 --2- 172.21.15.7:0/3177542839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce60100c80 0x7fce60101790 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:06.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.515+0000 7fce6744b640 1 --2- 172.21.15.7:0/3177542839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce601002d0 0x7fce60101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:06.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.515+0000 7fce6744b640 1 -- 172.21.15.7:0/3177542839 >> 172.21.15.7:0/3177542839 conn(0x7fce600fbee0 msgr2=0x7fce600fd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:06.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.515+0000 7fce6744b640 1 -- 172.21.15.7:0/3177542839 shutdown_connections 2024-09-19T08:46:06.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:06.515+0000 7fce6744b640 1 -- 172.21.15.7:0/3177542839 wait complete. 2024-09-19T08:46:06.603 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:06 smithi044 ceph-mon[35072]: pgmap v50: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-19T08:46:06.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:06 smithi175 ceph-mon[35688]: pgmap v50: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-19T08:46:06.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:06 smithi007 ceph-mon[31221]: pgmap v50: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-19T08:46:07.193 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:46:07.455 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:46:07.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:07 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3177542839' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:46:07.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:07 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3177542839' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:46:07.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:07 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3177542839' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:46:07.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.915+0000 7eff2e6bb640 1 -- 172.21.15.7:0/845911889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff28106f10 msgr2=0x7eff2810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:07.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.915+0000 7eff2e6bb640 1 --2- 172.21.15.7:0/845911889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff28106f10 0x7eff2810ea90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7eff20009ca0 tx=0x7eff2002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.915+0000 7eff2e6bb640 1 -- 172.21.15.7:0/845911889 shutdown_connections 2024-09-19T08:46:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.915+0000 7eff2e6bb640 1 --2- 172.21.15.7:0/845911889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff28106f10 0x7eff2810ea90 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.915+0000 7eff2e6bb640 1 --2- 172.21.15.7:0/845911889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff28102790 0x7eff281067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.915+0000 7eff2e6bb640 1 --2- 172.21.15.7:0/845911889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff28101de0 0x7eff281021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.915+0000 7eff2e6bb640 1 -- 172.21.15.7:0/845911889 >> 172.21.15.7:0/845911889 conn(0x7eff280fd8c0 msgr2=0x7eff280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.915+0000 7eff2e6bb640 1 -- 172.21.15.7:0/845911889 shutdown_connections 2024-09-19T08:46:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.915+0000 7eff2e6bb640 1 -- 172.21.15.7:0/845911889 wait complete. 2024-09-19T08:46:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.916+0000 7eff2e6bb640 1 Processor -- start 2024-09-19T08:46:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.916+0000 7eff2e6bb640 1 -- start start 2024-09-19T08:46:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.916+0000 7eff2e6bb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff28101de0 0x7eff280744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:07.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.916+0000 7eff2e6bb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff28102790 0x7eff28074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:07.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.916+0000 7eff2e6bb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff28106f10 0x7eff28074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:07.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.916+0000 7eff2e6bb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7eff28111f70 con 0x7eff28102790 2024-09-19T08:46:07.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.916+0000 7eff2e6bb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7eff28111df0 con 0x7eff28106f10 2024-09-19T08:46:07.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.916+0000 7eff2e6bb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff281120f0 con 0x7eff28101de0 2024-09-19T08:46:07.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.916+0000 7eff277fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff28102790 0x7eff28074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:07.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.916+0000 7eff277fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff28102790 0x7eff28074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49880/0 (socket says 172.21.15.7:49880) 2024-09-19T08:46:07.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.916+0000 7eff277fe640 1 -- 172.21.15.7:0/1986945376 learned_addr learned my addr 172.21.15.7:0/1986945376 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:07.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.917+0000 7eff2cc58640 1 --2- 172.21.15.7:0/1986945376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff28106f10 0x7eff28074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:07.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.917+0000 7eff277fe640 1 -- 172.21.15.7:0/1986945376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff28101de0 msgr2=0x7eff280744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:07.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.917+0000 7eff27fff640 1 --2- 172.21.15.7:0/1986945376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff28101de0 0x7eff280744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:07.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.917+0000 7eff277fe640 1 --2- 172.21.15.7:0/1986945376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff28101de0 0x7eff280744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.917+0000 7eff277fe640 1 -- 172.21.15.7:0/1986945376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff28106f10 msgr2=0x7eff28074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:07.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.917+0000 7eff277fe640 1 --2- 172.21.15.7:0/1986945376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff28106f10 0x7eff28074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.917+0000 7eff277fe640 1 -- 172.21.15.7:0/1986945376 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff281a68b0 con 0x7eff28102790 2024-09-19T08:46:07.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.917+0000 7eff2cc58640 1 --2- 172.21.15.7:0/1986945376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff28106f10 0x7eff28074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:46:07.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.917+0000 7eff277fe640 1 --2- 172.21.15.7:0/1986945376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff28102790 0x7eff28074a30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00d950 tx=0x7eff1c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:07.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.917+0000 7eff257fa640 1 -- 172.21.15.7:0/1986945376 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c017070 con 0x7eff28102790 2024-09-19T08:46:07.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.917+0000 7eff2e6bb640 1 -- 172.21.15.7:0/1986945376 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff281a6ba0 con 0x7eff28102790 2024-09-19T08:46:07.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.917+0000 7eff257fa640 1 -- 172.21.15.7:0/1986945376 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff1c009c30 con 0x7eff28102790 2024-09-19T08:46:07.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.917+0000 7eff257fa640 1 -- 172.21.15.7:0/1986945376 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c00f6b0 con 0x7eff28102790 2024-09-19T08:46:07.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.917+0000 7eff2e6bb640 1 -- 172.21.15.7:0/1986945376 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff281a7130 con 0x7eff28102790 2024-09-19T08:46:07.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.920+0000 7eff257fa640 1 -- 172.21.15.7:0/1986945376 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7eff1c0109d0 con 0x7eff28102790 2024-09-19T08:46:07.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.920+0000 7eff30a94740 1 Processor -- start 2024-09-19T08:46:07.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.920+0000 7eff30a94740 1 -- start start 2024-09-19T08:46:07.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.921+0000 7eff30a94740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b991b5b40 0x563b991b4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:07.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.921+0000 7eff30a94740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991b45d0 0x563b991b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:07.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.921+0000 7eff30a94740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b991bf370 0x563b991c1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:07.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.921+0000 7eff30a94740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563b9911a2f0 con 0x563b991b45d0 2024-09-19T08:46:07.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.921+0000 7eff30a94740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563b990c1cf0 con 0x563b991b5b40 2024-09-19T08:46:07.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.921+0000 7eff30a94740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563b991162b0 con 0x563b991bf370 2024-09-19T08:46:07.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.921+0000 7eff27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991b45d0 0x563b991b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:07.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.921+0000 7eff27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991b45d0 0x563b991b4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49884/0 (socket says 172.21.15.7:49884) 2024-09-19T08:46:07.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.921+0000 7eff27fff640 1 -- 172.21.15.7:0/4089750388 learned_addr learned my addr 172.21.15.7:0/4089750388 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:07.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.921+0000 7eff2cc58640 1 --2- 172.21.15.7:0/4089750388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b991b5b40 0x563b991b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:07.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.921+0000 7eff257fa640 1 --2- 172.21.15.7:0/1986945376 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7eff100a33b0 0x7eff100a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:07.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.921+0000 7eff277fe640 1 --2- 172.21.15.7:0/4089750388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b991bf370 0x563b991c1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:07.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.921+0000 7eff257fa640 1 -- 172.21.15.7:0/1986945376 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7eff1c0cf970 con 0x7eff28102790 2024-09-19T08:46:07.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.921+0000 7eff27fff640 1 -- 172.21.15.7:0/4089750388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b991bf370 msgr2=0x563b991c1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:07.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.921+0000 7eff2cc58640 1 --2- 172.21.15.7:0/1986945376 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7eff100a33b0 0x7eff100a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:07.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.921+0000 7eff27fff640 1 --2- 172.21.15.7:0/4089750388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b991bf370 0x563b991c1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.921+0000 7eff27fff640 1 -- 172.21.15.7:0/4089750388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b991b5b40 msgr2=0x563b991b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:07.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.921+0000 7eff27fff640 1 --2- 172.21.15.7:0/4089750388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b991b5b40 0x563b991b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.921+0000 7eff27fff640 1 -- 172.21.15.7:0/4089750388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b990a63a0 con 0x563b991b45d0 2024-09-19T08:46:07.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.921+0000 7eff277fe640 1 --2- 172.21.15.7:0/4089750388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b991bf370 0x563b991c1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:46:07.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.921+0000 7eff27fff640 1 --2- 172.21.15.7:0/4089750388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991b45d0 0x563b991b4a10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7eff18009c50 tx=0x7eff18010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83fea5c27670c4a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:07.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.922+0000 7eff0e7fc640 1 -- 172.21.15.7:0/4089750388 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff18004020 con 0x563b991b45d0 2024-09-19T08:46:07.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.922+0000 7eff2cc58640 1 --2- 172.21.15.7:0/1986945376 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7eff100a33b0 0x7eff100a5870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7eff20009bf0 tx=0x7eff2002a8c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:07.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.922+0000 7eff0e7fc640 1 -- 172.21.15.7:0/4089750388 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff180041c0 con 0x563b991b45d0 2024-09-19T08:46:07.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.922+0000 7eff0e7fc640 1 -- 172.21.15.7:0/4089750388 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff18012690 con 0x563b991b45d0 2024-09-19T08:46:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.922+0000 7eff30a94740 1 -- 172.21.15.7:0/4089750388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991b45d0 msgr2=0x563b991b4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.922+0000 7eff30a94740 1 --2- 172.21.15.7:0/4089750388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991b45d0 0x563b991b4a10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7eff18009c50 tx=0x7eff18010740 comp rx=0 tx=0).stop 2024-09-19T08:46:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.922+0000 7eff30a94740 1 -- 172.21.15.7:0/4089750388 shutdown_connections 2024-09-19T08:46:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.922+0000 7eff30a94740 1 --2- 172.21.15.7:0/4089750388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b991bf370 0x563b991c1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.922+0000 7eff30a94740 1 --2- 172.21.15.7:0/4089750388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991b45d0 0x563b991b4a10 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.922+0000 7eff30a94740 1 --2- 172.21.15.7:0/4089750388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b991b5b40 0x563b991b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.922+0000 7eff30a94740 1 -- 172.21.15.7:0/4089750388 >> 172.21.15.7:0/4089750388 conn(0x563b9917d310 msgr2=0x563b991b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.922+0000 7eff30a94740 1 -- 172.21.15.7:0/4089750388 shutdown_connections 2024-09-19T08:46:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.922+0000 7eff30a94740 1 -- 172.21.15.7:0/4089750388 wait complete. 2024-09-19T08:46:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.923+0000 7eff30a94740 1 -- start start 2024-09-19T08:46:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.923+0000 7eff30a94740 1 Processor -- start 2024-09-19T08:46:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.923+0000 7eff30a94740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b991b45d0 0x563b991becf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.923+0000 7eff30a94740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b991b5b40 0x563b991bbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.923+0000 7eff30a94740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991bf370 0x563b991bc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.923+0000 7eff30a94740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563b991c2070 con 0x563b991bf370 2024-09-19T08:46:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.923+0000 7eff30a94740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563b990d5060 con 0x563b991b45d0 2024-09-19T08:46:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.923+0000 7eff30a94740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563b991c21f0 con 0x563b991b5b40 2024-09-19T08:46:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.923+0000 7eff30a94740 10 client.0 _ll_register_callbacks cb 0x563b98e288c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.923+0000 7eff2cc58640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991bf370 0x563b991bc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.923+0000 7eff2cc58640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991bf370 0x563b991bc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49892/0 (socket says 172.21.15.7:49892) 2024-09-19T08:46:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.923+0000 7eff2cc58640 1 -- 172.21.15.7:0/2997525084 learned_addr learned my addr 172.21.15.7:0/2997525084 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.923+0000 7eff27fff640 1 --2- 172.21.15.7:0/2997525084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b991b45d0 0x563b991becf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.924+0000 7eff277fe640 1 --2- 172.21.15.7:0/2997525084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b991b5b40 0x563b991bbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.924+0000 7eff2cc58640 1 -- 172.21.15.7:0/2997525084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b991b5b40 msgr2=0x563b991bbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.924+0000 7eff2cc58640 1 --2- 172.21.15.7:0/2997525084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b991b5b40 0x563b991bbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.924+0000 7eff2cc58640 1 -- 172.21.15.7:0/2997525084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b991b45d0 msgr2=0x563b991becf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:07.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.924+0000 7eff2cc58640 1 --2- 172.21.15.7:0/2997525084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b991b45d0 0x563b991becf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.924+0000 7eff2cc58640 1 -- 172.21.15.7:0/2997525084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b98e8b3c0 con 0x563b991bf370 2024-09-19T08:46:07.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.924+0000 7eff2cc58640 1 --2- 172.21.15.7:0/2997525084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991bf370 0x563b991bc520 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7eff2002f3c0 tx=0x7eff200095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec6ebb97022e100 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:07.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.924+0000 7eff077fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:07.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.924+0000 7eff077fe640 1 -- 172.21.15.7:0/2997525084 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2004e070 con 0x563b991bf370 2024-09-19T08:46:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.924+0000 7eff077fe640 1 -- 172.21.15.7:0/2997525084 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7eff20004250 con 0x563b991bf370 2024-09-19T08:46:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.924+0000 7eff30a94740 1 -- 172.21.15.7:0/2997525084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff180041c0 con 0x563b991bf370 2024-09-19T08:46:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.924+0000 7eff077fe640 1 -- 172.21.15.7:0/2997525084 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7eff2005a050 con 0x563b991bf370 2024-09-19T08:46:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.924+0000 7eff30a94740 10 client.15642 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.924+0000 7eff30a94740 1 -- 172.21.15.7:0/2997525084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563b991cda90 con 0x563b991bf370 2024-09-19T08:46:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.925+0000 7eff077fe640 1 -- 172.21.15.7:0/2997525084 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff180041c0 con 0x563b991bf370 2024-09-19T08:46:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.925+0000 7eff077fe640 1 -- 172.21.15.7:0/2997525084 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7eff200305c0 con 0x563b991bf370 2024-09-19T08:46:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.925+0000 7eff30a94740 10 client.15642 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.925+0000 7eff30a94740 10 client.15642 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:46:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.925+0000 7eff30a94740 20 client.15642 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.925+0000 7eff30a94740 1 --2- 172.21.15.7:0/2997525084 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x563b991ceef0 0x563b991d1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.925+0000 7eff30a94740 4 client.15642 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:46:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.925+0000 7eff30a94740 1 -- 172.21.15.7:0/2997525084 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b99127860 con 0x563b991ceef0 2024-09-19T08:46:07.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.925+0000 7eff27fff640 1 --2- 172.21.15.7:0/2997525084 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x563b991ceef0 0x563b991d1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:07.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.926+0000 7eff27fff640 1 --2- 172.21.15.7:0/2997525084 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x563b991ceef0 0x563b991d1370 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1235b7b7408a55e0 server_cookie=369d1ede30378323 in_seq=0 out_seq=0 2024-09-19T08:46:07.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.926+0000 7eff077fe640 10 client.15642 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:46:07.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.926+0000 7eff077fe640 1 -- 172.21.15.7:0/2997525084 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563b99127860 con 0x563b991ceef0 2024-09-19T08:46:07.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.926+0000 7eff077fe640 10 client.15642 handle_command_reply: tid=0 2024-09-19T08:46:07.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.926+0000 7eff30a94740 1 client.15642 shutdown 2024-09-19T08:46:07.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.927+0000 7eff30a94740 1 -- 172.21.15.7:0/2997525084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991bf370 msgr2=0x563b991bc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:07.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.927+0000 7eff30a94740 1 --2- 172.21.15.7:0/2997525084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991bf370 0x563b991bc520 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7eff2002f3c0 tx=0x7eff200095c0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.927+0000 7eff30a94740 1 -- 172.21.15.7:0/2997525084 shutdown_connections 2024-09-19T08:46:07.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.927+0000 7eff30a94740 1 --2- 172.21.15.7:0/2997525084 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x563b991ceef0 0x563b991d1370 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.927+0000 7eff30a94740 1 --2- 172.21.15.7:0/2997525084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991bf370 0x563b991bc520 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.927+0000 7eff30a94740 1 --2- 172.21.15.7:0/2997525084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b991b5b40 0x563b991bbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.927+0000 7eff30a94740 1 --2- 172.21.15.7:0/2997525084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b991b45d0 0x563b991becf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.927+0000 7eff30a94740 1 -- 172.21.15.7:0/2997525084 >> 172.21.15.7:0/2997525084 conn(0x563b9917d310 msgr2=0x563b991b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:07.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.927+0000 7eff077fe640 0 client.15642 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:46:07.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.927+0000 7eff30a94740 1 -- 172.21.15.7:0/2997525084 shutdown_connections 2024-09-19T08:46:07.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.927+0000 7eff30a94740 1 -- 172.21.15.7:0/2997525084 wait complete. 2024-09-19T08:46:07.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.927+0000 7eff30a94740 20 client.15642 trim_cache size 0 max 16384 2024-09-19T08:46:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.940+0000 7eff30a94740 1 Processor -- start 2024-09-19T08:46:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.940+0000 7eff30a94740 1 -- start start 2024-09-19T08:46:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.940+0000 7eff30a94740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991b45d0 0x563b991b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.940+0000 7eff30a94740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b991b5b40 0x563b991cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.940+0000 7eff30a94740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b991bf370 0x563b991d6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.940+0000 7eff30a94740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7eff281b2330 con 0x563b991b45d0 2024-09-19T08:46:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.940+0000 7eff30a94740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7eff281afc00 con 0x563b991bf370 2024-09-19T08:46:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.940+0000 7eff30a94740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff281ada50 con 0x563b991b5b40 2024-09-19T08:46:07.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.940+0000 7eff27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991b45d0 0x563b991b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:07.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.940+0000 7eff27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991b45d0 0x563b991b0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49898/0 (socket says 172.21.15.7:49898) 2024-09-19T08:46:07.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.940+0000 7eff27fff640 1 -- 172.21.15.7:0/2898849761 learned_addr learned my addr 172.21.15.7:0/2898849761 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:07.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.941+0000 7eff277fe640 1 --2- 172.21.15.7:0/2898849761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b991b5b40 0x563b991cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:07.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.941+0000 7eff2cc58640 1 --2- 172.21.15.7:0/2898849761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b991bf370 0x563b991d6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:07.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.941+0000 7eff27fff640 1 -- 172.21.15.7:0/2898849761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b991b5b40 msgr2=0x563b991cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:07.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.941+0000 7eff27fff640 1 --2- 172.21.15.7:0/2898849761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b991b5b40 0x563b991cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.941+0000 7eff27fff640 1 -- 172.21.15.7:0/2898849761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b991bf370 msgr2=0x563b991d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:07.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.941+0000 7eff27fff640 1 --2- 172.21.15.7:0/2898849761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b991bf370 0x563b991d6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.941+0000 7eff27fff640 1 -- 172.21.15.7:0/2898849761 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b991ba550 con 0x563b991b45d0 2024-09-19T08:46:07.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.941+0000 7eff27fff640 1 --2- 172.21.15.7:0/2898849761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991b45d0 0x563b991b0e10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7eff18009b70 tx=0x7eff1801e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b66d831ec76485 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:07.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.941+0000 7eff0dffb640 1 -- 172.21.15.7:0/2898849761 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff18009d40 con 0x563b991b45d0 2024-09-19T08:46:07.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.941+0000 7eff0dffb640 1 -- 172.21.15.7:0/2898849761 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff18005040 con 0x563b991b45d0 2024-09-19T08:46:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.941+0000 7eff0dffb640 1 -- 172.21.15.7:0/2898849761 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff180049c0 con 0x563b991b45d0 2024-09-19T08:46:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.942+0000 7eff30a94740 1 -- 172.21.15.7:0/2898849761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991b45d0 msgr2=0x563b991b0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.942+0000 7eff30a94740 1 --2- 172.21.15.7:0/2898849761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991b45d0 0x563b991b0e10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7eff18009b70 tx=0x7eff1801e040 comp rx=0 tx=0).stop 2024-09-19T08:46:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.942+0000 7eff30a94740 1 -- 172.21.15.7:0/2898849761 shutdown_connections 2024-09-19T08:46:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.942+0000 7eff30a94740 1 --2- 172.21.15.7:0/2898849761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b991bf370 0x563b991d6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.942+0000 7eff30a94740 1 --2- 172.21.15.7:0/2898849761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b991b5b40 0x563b991cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.942+0000 7eff30a94740 1 --2- 172.21.15.7:0/2898849761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991b45d0 0x563b991b0e10 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.942+0000 7eff30a94740 1 -- 172.21.15.7:0/2898849761 >> 172.21.15.7:0/2898849761 conn(0x563b9917d310 msgr2=0x563b991b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.942+0000 7eff30a94740 1 -- 172.21.15.7:0/2898849761 shutdown_connections 2024-09-19T08:46:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.942+0000 7eff30a94740 1 -- 172.21.15.7:0/2898849761 wait complete. 2024-09-19T08:46:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.942+0000 7eff30a94740 1 -- start start 2024-09-19T08:46:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.942+0000 7eff30a94740 1 Processor -- start 2024-09-19T08:46:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff30a94740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b991b45d0 0x563b991c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff30a94740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991b5b40 0x563b991b8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff30a94740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b991bf370 0x563b991b93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff30a94740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7eff281ae0c0 con 0x563b991b5b40 2024-09-19T08:46:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff30a94740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7eff281af530 con 0x563b991b45d0 2024-09-19T08:46:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff30a94740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff281ae790 con 0x563b991bf370 2024-09-19T08:46:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff30a94740 10 client.0 _ll_register_callbacks cb 0x7eff18005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff277fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991b5b40 0x563b991b8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff277fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991b5b40 0x563b991b8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49908/0 (socket says 172.21.15.7:49908) 2024-09-19T08:46:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff277fe640 1 -- 172.21.15.7:0/165196377 learned_addr learned my addr 172.21.15.7:0/165196377 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff27fff640 1 --2- 172.21.15.7:0/165196377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b991b45d0 0x563b991c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff2cc58640 1 --2- 172.21.15.7:0/165196377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b991bf370 0x563b991b93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff277fe640 1 -- 172.21.15.7:0/165196377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b991bf370 msgr2=0x563b991b93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff277fe640 1 --2- 172.21.15.7:0/165196377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b991bf370 0x563b991b93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff277fe640 1 -- 172.21.15.7:0/165196377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b991b45d0 msgr2=0x563b991c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff277fe640 1 --2- 172.21.15.7:0/165196377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b991b45d0 0x563b991c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff277fe640 1 -- 172.21.15.7:0/165196377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b991b9bd0 con 0x563b991b5b40 2024-09-19T08:46:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff2cc58640 1 --2- 172.21.15.7:0/165196377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b991bf370 0x563b991b93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff277fe640 1 --2- 172.21.15.7:0/165196377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991b5b40 0x563b991b8e20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7eff1c000c00 tx=0x7eff1c06b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89dcf8e16d3daea4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff077fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff077fe640 1 -- 172.21.15.7:0/165196377 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c020050 con 0x563b991b5b40 2024-09-19T08:46:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff077fe640 1 -- 172.21.15.7:0/165196377 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7eff1c09b090 con 0x563b991b5b40 2024-09-19T08:46:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.943+0000 7eff30a94740 1 -- 172.21.15.7:0/165196377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff18005040 con 0x563b991b5b40 2024-09-19T08:46:07.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.944+0000 7eff077fe640 1 -- 172.21.15.7:0/165196377 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7eff1c009de0 con 0x563b991b5b40 2024-09-19T08:46:07.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.944+0000 7eff30a94740 10 client.15648 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:07.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.944+0000 7eff30a94740 1 -- 172.21.15.7:0/165196377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563b99239cb0 con 0x563b991b5b40 2024-09-19T08:46:07.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.944+0000 7eff077fe640 1 -- 172.21.15.7:0/165196377 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff18005040 con 0x563b991b5b40 2024-09-19T08:46:07.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.944+0000 7eff077fe640 1 -- 172.21.15.7:0/165196377 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7eff1c097990 con 0x563b991b5b40 2024-09-19T08:46:07.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.944+0000 7eff30a94740 10 client.15648 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:07.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.944+0000 7eff30a94740 10 client.15648 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:46:07.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.944+0000 7eff30a94740 20 client.15648 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:07.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.944+0000 7eff30a94740 1 --2- 172.21.15.7:0/165196377 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x563b9923a420 0x563b9923c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:07.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.944+0000 7eff30a94740 4 client.15648 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:46:07.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.944+0000 7eff30a94740 1 -- 172.21.15.7:0/165196377 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563b99121d70 con 0x563b9923a420 2024-09-19T08:46:07.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.944+0000 7eff27fff640 1 --2- 172.21.15.7:0/165196377 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x563b9923a420 0x563b9923c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:07.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.945+0000 7eff27fff640 1 --2- 172.21.15.7:0/165196377 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x563b9923a420 0x563b9923c810 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=675bcc14d9f92db0 server_cookie=66f60afa2abecc1f in_seq=0 out_seq=0 2024-09-19T08:46:07.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.945+0000 7eff077fe640 10 client.15648 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:46:07.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.945+0000 7eff077fe640 1 -- 172.21.15.7:0/165196377 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563b99121d70 con 0x563b9923a420 2024-09-19T08:46:07.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.945+0000 7eff077fe640 10 client.15648 handle_command_reply: tid=0 2024-09-19T08:46:07.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.945+0000 7eff30a94740 1 client.15648 shutdown 2024-09-19T08:46:07.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.945+0000 7eff30a94740 1 -- 172.21.15.7:0/165196377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991b5b40 msgr2=0x563b991b8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:07.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.945+0000 7eff30a94740 1 --2- 172.21.15.7:0/165196377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991b5b40 0x563b991b8e20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7eff1c000c00 tx=0x7eff1c06b860 comp rx=0 tx=0).stop 2024-09-19T08:46:07.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.945+0000 7eff30a94740 1 -- 172.21.15.7:0/165196377 shutdown_connections 2024-09-19T08:46:07.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.945+0000 7eff30a94740 1 --2- 172.21.15.7:0/165196377 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x563b9923a420 0x563b9923c810 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.945+0000 7eff30a94740 1 --2- 172.21.15.7:0/165196377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563b991bf370 0x563b991b93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.945+0000 7eff30a94740 1 --2- 172.21.15.7:0/165196377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b991b5b40 0x563b991b8e20 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.945+0000 7eff30a94740 1 --2- 172.21.15.7:0/165196377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b991b45d0 0x563b991c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.945+0000 7eff077fe640 0 client.15648 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:46:07.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.945+0000 7eff30a94740 1 -- 172.21.15.7:0/165196377 >> 172.21.15.7:0/165196377 conn(0x563b9917d310 msgr2=0x563b991ba8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:07.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.945+0000 7eff30a94740 1 -- 172.21.15.7:0/165196377 shutdown_connections 2024-09-19T08:46:07.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.945+0000 7eff30a94740 1 -- 172.21.15.7:0/165196377 wait complete. 2024-09-19T08:46:07.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.945+0000 7eff30a94740 20 client.15648 trim_cache size 0 max 16384 2024-09-19T08:46:07.955 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:46:07.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.946+0000 7eff2e6bb640 1 -- 172.21.15.7:0/1986945376 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7eff100a33b0 msgr2=0x7eff100a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:07.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.946+0000 7eff2e6bb640 1 --2- 172.21.15.7:0/1986945376 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7eff100a33b0 0x7eff100a5870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7eff20009bf0 tx=0x7eff2002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.946+0000 7eff2e6bb640 1 -- 172.21.15.7:0/1986945376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff28102790 msgr2=0x7eff28074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:07.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.946+0000 7eff2e6bb640 1 --2- 172.21.15.7:0/1986945376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff28102790 0x7eff28074a30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00d950 tx=0x7eff1c00de10 comp rx=0 tx=0).stop 2024-09-19T08:46:07.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.946+0000 7eff2e6bb640 1 -- 172.21.15.7:0/1986945376 shutdown_connections 2024-09-19T08:46:07.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.946+0000 7eff2e6bb640 1 --2- 172.21.15.7:0/1986945376 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7eff100a33b0 0x7eff100a5870 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.946+0000 7eff2e6bb640 1 --2- 172.21.15.7:0/1986945376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff28106f10 0x7eff28074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.946+0000 7eff2e6bb640 1 --2- 172.21.15.7:0/1986945376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff28102790 0x7eff28074a30 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.946+0000 7eff2e6bb640 1 --2- 172.21.15.7:0/1986945376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff28101de0 0x7eff280744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:07.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.946+0000 7eff2e6bb640 1 -- 172.21.15.7:0/1986945376 >> 172.21.15.7:0/1986945376 conn(0x7eff280fd8c0 msgr2=0x7eff280feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:07.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.946+0000 7eff2e6bb640 1 -- 172.21.15.7:0/1986945376 shutdown_connections 2024-09-19T08:46:07.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:07.946+0000 7eff2e6bb640 1 -- 172.21.15.7:0/1986945376 wait complete. 2024-09-19T08:46:08.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:08 smithi175 ceph-mon[35688]: pgmap v51: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T08:46:08.678 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:08 smithi007 ceph-mon[31221]: pgmap v51: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T08:46:08.710 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:46:08.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:08 smithi044 ceph-mon[35072]: pgmap v51: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T08:46:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:46:09.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.400+0000 7fd31df05640 1 -- 172.21.15.7:0/3736409398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd318102ef0 msgr2=0x7fd31810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:09.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.400+0000 7fd31df05640 1 --2- 172.21.15.7:0/3736409398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd318102ef0 0x7fd31810da40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd310009900 tx=0x7fd31002a480 comp rx=0 tx=0).stop 2024-09-19T08:46:09.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.401+0000 7fd31df05640 1 -- 172.21.15.7:0/3736409398 shutdown_connections 2024-09-19T08:46:09.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.401+0000 7fd31df05640 1 --2- 172.21.15.7:0/3736409398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd318102ef0 0x7fd31810da40 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.401+0000 7fd31df05640 1 --2- 172.21.15.7:0/3736409398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd318102570 0x7fd3181029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.401+0000 7fd31df05640 1 --2- 172.21.15.7:0/3736409398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd318100e20 0x7fd318101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.401+0000 7fd31df05640 1 -- 172.21.15.7:0/3736409398 >> 172.21.15.7:0/3736409398 conn(0x7fd3180fc7d0 msgr2=0x7fd3180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:09.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.401+0000 7fd31df05640 1 -- 172.21.15.7:0/3736409398 shutdown_connections 2024-09-19T08:46:09.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.401+0000 7fd31df05640 1 -- 172.21.15.7:0/3736409398 wait complete. 2024-09-19T08:46:09.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.401+0000 7fd31df05640 1 Processor -- start 2024-09-19T08:46:09.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.401+0000 7fd31df05640 1 -- start start 2024-09-19T08:46:09.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.402+0000 7fd31df05640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd318100e20 0x7fd3181984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:09.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.402+0000 7fd31df05640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd318102570 0x7fd3181989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:09.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.402+0000 7fd31df05640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd318102ef0 0x7fd31819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:09.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.402+0000 7fd31df05640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd318110fd0 con 0x7fd318102570 2024-09-19T08:46:09.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.402+0000 7fd31df05640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd318110e50 con 0x7fd318102ef0 2024-09-19T08:46:09.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.402+0000 7fd31df05640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd318111150 con 0x7fd318100e20 2024-09-19T08:46:09.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.402+0000 7fd316ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd318102570 0x7fd3181989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:09.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.402+0000 7fd316ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd318102570 0x7fd3181989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49926/0 (socket says 172.21.15.7:49926) 2024-09-19T08:46:09.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.402+0000 7fd316ffd640 1 -- 172.21.15.7:0/3734695018 learned_addr learned my addr 172.21.15.7:0/3734695018 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:09.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.402+0000 7fd3177fe640 1 --2- 172.21.15.7:0/3734695018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd318100e20 0x7fd3181984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:09.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.402+0000 7fd317fff640 1 --2- 172.21.15.7:0/3734695018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd318102ef0 0x7fd31819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:09.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.402+0000 7fd316ffd640 1 -- 172.21.15.7:0/3734695018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd318100e20 msgr2=0x7fd3181984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:09.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.402+0000 7fd316ffd640 1 --2- 172.21.15.7:0/3734695018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd318100e20 0x7fd3181984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.402+0000 7fd316ffd640 1 -- 172.21.15.7:0/3734695018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd318102ef0 msgr2=0x7fd31819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:09.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.402+0000 7fd316ffd640 1 --2- 172.21.15.7:0/3734695018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd318102ef0 0x7fd31819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.402+0000 7fd316ffd640 1 -- 172.21.15.7:0/3734695018 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31819d460 con 0x7fd318102570 2024-09-19T08:46:09.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.402+0000 7fd316ffd640 1 --2- 172.21.15.7:0/3734695018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd318102570 0x7fd3181989f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00c890 tx=0x7fd30c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:09.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.403+0000 7fd314ff9640 1 -- 172.21.15.7:0/3734695018 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c004220 con 0x7fd318102570 2024-09-19T08:46:09.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.403+0000 7fd314ff9640 1 -- 172.21.15.7:0/3734695018 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd30c0043c0 con 0x7fd318102570 2024-09-19T08:46:09.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.403+0000 7fd31df05640 1 -- 172.21.15.7:0/3734695018 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31819d750 con 0x7fd318102570 2024-09-19T08:46:09.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.403+0000 7fd314ff9640 1 -- 172.21.15.7:0/3734695018 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c0049e0 con 0x7fd318102570 2024-09-19T08:46:09.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.403+0000 7fd31df05640 1 -- 172.21.15.7:0/3734695018 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3181a5030 con 0x7fd318102570 2024-09-19T08:46:09.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.405+0000 7fd314ff9640 1 -- 172.21.15.7:0/3734695018 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fd30c0079b0 con 0x7fd318102570 2024-09-19T08:46:09.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.406+0000 7fd3202de740 1 Processor -- start 2024-09-19T08:46:09.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.406+0000 7fd3202de740 1 -- start start 2024-09-19T08:46:09.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.406+0000 7fd314ff9640 1 --2- 172.21.15.7:0/3734695018 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd3000a33b0 0x7fd3000a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:09.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.406+0000 7fd317fff640 1 --2- 172.21.15.7:0/3734695018 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd3000a33b0 0x7fd3000a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:09.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.406+0000 7fd314ff9640 1 -- 172.21.15.7:0/3734695018 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fd30c0cfd40 con 0x7fd318102570 2024-09-19T08:46:09.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.406+0000 7fd3202de740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56c1b40 0x55d3f56c0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:09.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.406+0000 7fd3202de740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3f56c05d0 0x55d3f56c0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:09.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.406+0000 7fd3202de740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3f56cf780 0x55d3f56d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:09.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.406+0000 7fd3202de740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d3f56262f0 con 0x55d3f56c1b40 2024-09-19T08:46:09.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.406+0000 7fd3202de740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d3f55cdcf0 con 0x55d3f56c05d0 2024-09-19T08:46:09.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.406+0000 7fd3202de740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d3f56222b0 con 0x55d3f56cf780 2024-09-19T08:46:09.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.406+0000 7fd3177fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56c1b40 0x55d3f56c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:09.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.406+0000 7fd3177fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56c1b40 0x55d3f56c0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49936/0 (socket says 172.21.15.7:49936) 2024-09-19T08:46:09.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.406+0000 7fd3177fe640 1 -- 172.21.15.7:0/1458528332 learned_addr learned my addr 172.21.15.7:0/1458528332 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:09.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.406+0000 7fd316ffd640 1 --2- 172.21.15.7:0/1458528332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3f56c05d0 0x55d3f56c0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:09.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.406+0000 7fd317fff640 1 --2- 172.21.15.7:0/3734695018 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd3000a33b0 0x7fd3000a5870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd310006010 tx=0x7fd3100046c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:09.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.406+0000 7fd3177fe640 1 -- 172.21.15.7:0/1458528332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3f56cf780 msgr2=0x55d3f56d1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:09.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.406+0000 7fd3177fe640 1 --2- 172.21.15.7:0/1458528332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3f56cf780 0x55d3f56d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.407+0000 7fd3177fe640 1 -- 172.21.15.7:0/1458528332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3f56c05d0 msgr2=0x55d3f56c0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:09.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.407+0000 7fd3177fe640 1 --2- 172.21.15.7:0/1458528332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3f56c05d0 0x55d3f56c0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.407+0000 7fd3177fe640 1 -- 172.21.15.7:0/1458528332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3f55b23a0 con 0x55d3f56c1b40 2024-09-19T08:46:09.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.407+0000 7fd316ffd640 1 --2- 172.21.15.7:0/1458528332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3f56c05d0 0x55d3f56c0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:09.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.407+0000 7fd3177fe640 1 --2- 172.21.15.7:0/1458528332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56c1b40 0x55d3f56c0090 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd3080103f0 tx=0x7fd3080108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1376acaadaa9c00c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:09.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.407+0000 7fd2fdffb640 1 -- 172.21.15.7:0/1458528332 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308016070 con 0x55d3f56c1b40 2024-09-19T08:46:09.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.407+0000 7fd2fdffb640 1 -- 172.21.15.7:0/1458528332 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd308004d20 con 0x55d3f56c1b40 2024-09-19T08:46:09.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.407+0000 7fd2fdffb640 1 -- 172.21.15.7:0/1458528332 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3080054c0 con 0x55d3f56c1b40 2024-09-19T08:46:09.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.408+0000 7fd3202de740 1 -- 172.21.15.7:0/1458528332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56c1b40 msgr2=0x55d3f56c0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:09.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.408+0000 7fd3202de740 1 --2- 172.21.15.7:0/1458528332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56c1b40 0x55d3f56c0090 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd3080103f0 tx=0x7fd3080108b0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.408+0000 7fd3202de740 1 -- 172.21.15.7:0/1458528332 shutdown_connections 2024-09-19T08:46:09.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.408+0000 7fd3202de740 1 --2- 172.21.15.7:0/1458528332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3f56cf780 0x55d3f56d1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.408+0000 7fd3202de740 1 --2- 172.21.15.7:0/1458528332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3f56c05d0 0x55d3f56c0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.408+0000 7fd3202de740 1 --2- 172.21.15.7:0/1458528332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56c1b40 0x55d3f56c0090 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.408+0000 7fd3202de740 1 -- 172.21.15.7:0/1458528332 >> 172.21.15.7:0/1458528332 conn(0x55d3f5689310 msgr2=0x55d3f56bcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:09.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.408+0000 7fd3202de740 1 -- 172.21.15.7:0/1458528332 shutdown_connections 2024-09-19T08:46:09.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.408+0000 7fd3202de740 1 -- 172.21.15.7:0/1458528332 wait complete. 2024-09-19T08:46:09.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.408+0000 7fd3202de740 1 -- start start 2024-09-19T08:46:09.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.408+0000 7fd3202de740 1 Processor -- start 2024-09-19T08:46:09.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.408+0000 7fd3202de740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3f56c05d0 0x55d3f56cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:09.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.408+0000 7fd3202de740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3f56c1b40 0x55d3f56cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:09.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.409+0000 7fd3202de740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56cf780 0x55d3f56cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:09.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.409+0000 7fd3202de740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d3f56d2480 con 0x55d3f56cf780 2024-09-19T08:46:09.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.409+0000 7fd3202de740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d3f55e1060 con 0x55d3f56c05d0 2024-09-19T08:46:09.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.409+0000 7fd3202de740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d3f56d2600 con 0x55d3f56c1b40 2024-09-19T08:46:09.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.409+0000 7fd3202de740 10 client.0 _ll_register_callbacks cb 0x55d3f53348c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:09.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.409+0000 7fd317fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56cf780 0x55d3f56cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:09.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.409+0000 7fd317fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56cf780 0x55d3f56cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49950/0 (socket says 172.21.15.7:49950) 2024-09-19T08:46:09.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.409+0000 7fd317fff640 1 -- 172.21.15.7:0/4219007427 learned_addr learned my addr 172.21.15.7:0/4219007427 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:09.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.409+0000 7fd3177fe640 1 --2- 172.21.15.7:0/4219007427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3f56c05d0 0x55d3f56cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:09.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.409+0000 7fd316ffd640 1 --2- 172.21.15.7:0/4219007427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3f56c1b40 0x55d3f56cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:09.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.409+0000 7fd317fff640 1 -- 172.21.15.7:0/4219007427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3f56c1b40 msgr2=0x55d3f56cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:09.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.409+0000 7fd317fff640 1 --2- 172.21.15.7:0/4219007427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3f56c1b40 0x55d3f56cc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.409+0000 7fd317fff640 1 -- 172.21.15.7:0/4219007427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3f56c05d0 msgr2=0x55d3f56cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:09.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.409+0000 7fd317fff640 1 --2- 172.21.15.7:0/4219007427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3f56c05d0 0x55d3f56cf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.409+0000 7fd317fff640 1 -- 172.21.15.7:0/4219007427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3f53973c0 con 0x55d3f56cf780 2024-09-19T08:46:09.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.409+0000 7fd316ffd640 1 --2- 172.21.15.7:0/4219007427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3f56c1b40 0x55d3f56cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:09.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.409+0000 7fd317fff640 1 --2- 172.21.15.7:0/4219007427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56cf780 0x55d3f56cc900 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd310009900 tx=0x7fd3100045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81aa940c45134004 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:09.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.409+0000 7fd2f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:09.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.409+0000 7fd2f6ffd640 1 -- 172.21.15.7:0/4219007427 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31004d070 con 0x55d3f56cf780 2024-09-19T08:46:09.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.409+0000 7fd2f6ffd640 1 -- 172.21.15.7:0/4219007427 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fd310031740 con 0x55d3f56cf780 2024-09-19T08:46:09.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.409+0000 7fd3202de740 1 -- 172.21.15.7:0/4219007427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd308004d20 con 0x55d3f56cf780 2024-09-19T08:46:09.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.410+0000 7fd2f6ffd640 1 -- 172.21.15.7:0/4219007427 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd310059050 con 0x55d3f56cf780 2024-09-19T08:46:09.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.410+0000 7fd3202de740 10 client.15660 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:09.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.410+0000 7fd3202de740 1 -- 172.21.15.7:0/4219007427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d3f56dde90 con 0x55d3f56cf780 2024-09-19T08:46:09.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.410+0000 7fd2f6ffd640 1 -- 172.21.15.7:0/4219007427 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd308004d20 con 0x55d3f56cf780 2024-09-19T08:46:09.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.410+0000 7fd2f6ffd640 1 -- 172.21.15.7:0/4219007427 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd310049a20 con 0x55d3f56cf780 2024-09-19T08:46:09.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.410+0000 7fd3202de740 10 client.15660 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:09.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.410+0000 7fd3202de740 10 client.15660 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:46:09.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.410+0000 7fd3202de740 20 client.15660 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:09.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.410+0000 7fd3202de740 1 --2- 172.21.15.7:0/4219007427 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55d3f56df2f0 0x55d3f56e1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:09.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.410+0000 7fd3202de740 4 client.15660 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:46:09.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.410+0000 7fd3202de740 1 -- 172.21.15.7:0/4219007427 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3f5633860 con 0x55d3f56df2f0 2024-09-19T08:46:09.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.410+0000 7fd3177fe640 1 --2- 172.21.15.7:0/4219007427 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55d3f56df2f0 0x55d3f56e1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:09.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.411+0000 7fd3177fe640 1 --2- 172.21.15.7:0/4219007427 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55d3f56df2f0 0x55d3f56e1770 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9608f1917235ae00 server_cookie=296881df72ab96e1 in_seq=0 out_seq=0 2024-09-19T08:46:09.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.411+0000 7fd2f6ffd640 10 client.15660 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:46:09.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.412+0000 7fd2f6ffd640 1 -- 172.21.15.7:0/4219007427 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d3f5633860 con 0x55d3f56df2f0 2024-09-19T08:46:09.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.412+0000 7fd2f6ffd640 10 client.15660 handle_command_reply: tid=0 2024-09-19T08:46:09.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.412+0000 7fd3202de740 1 client.15660 shutdown 2024-09-19T08:46:09.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.412+0000 7fd3202de740 1 -- 172.21.15.7:0/4219007427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56cf780 msgr2=0x55d3f56cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:09.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.412+0000 7fd3202de740 1 --2- 172.21.15.7:0/4219007427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56cf780 0x55d3f56cc900 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd310009900 tx=0x7fd3100045c0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.412+0000 7fd3202de740 1 -- 172.21.15.7:0/4219007427 shutdown_connections 2024-09-19T08:46:09.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.412+0000 7fd3202de740 1 --2- 172.21.15.7:0/4219007427 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55d3f56df2f0 0x55d3f56e1770 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.412+0000 7fd3202de740 1 --2- 172.21.15.7:0/4219007427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56cf780 0x55d3f56cc900 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.412+0000 7fd3202de740 1 --2- 172.21.15.7:0/4219007427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3f56c1b40 0x55d3f56cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.412+0000 7fd3202de740 1 --2- 172.21.15.7:0/4219007427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3f56c05d0 0x55d3f56cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.412+0000 7fd2f6ffd640 0 client.15660 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:46:09.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.412+0000 7fd3202de740 1 -- 172.21.15.7:0/4219007427 >> 172.21.15.7:0/4219007427 conn(0x55d3f5689310 msgr2=0x55d3f56c2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:09.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.412+0000 7fd3202de740 1 -- 172.21.15.7:0/4219007427 shutdown_connections 2024-09-19T08:46:09.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.412+0000 7fd3202de740 1 -- 172.21.15.7:0/4219007427 wait complete. 2024-09-19T08:46:09.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.412+0000 7fd3202de740 20 client.15660 trim_cache size 0 max 16384 2024-09-19T08:46:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.425+0000 7fd3202de740 1 Processor -- start 2024-09-19T08:46:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.425+0000 7fd3202de740 1 -- start start 2024-09-19T08:46:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.425+0000 7fd3202de740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3f56c05d0 0x55d3f56db720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.425+0000 7fd3202de740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56c1b40 0x55d3f56c7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.425+0000 7fd3202de740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3f56cf780 0x55d3f56e7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.425+0000 7fd3202de740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd3181adf00 con 0x55d3f56c1b40 2024-09-19T08:46:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.425+0000 7fd3202de740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd3181ab7d0 con 0x55d3f56cf780 2024-09-19T08:46:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.425+0000 7fd3202de740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd3181a9620 con 0x55d3f56c05d0 2024-09-19T08:46:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.425+0000 7fd316ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56c1b40 0x55d3f56c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.425+0000 7fd316ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56c1b40 0x55d3f56c7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49954/0 (socket says 172.21.15.7:49954) 2024-09-19T08:46:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.425+0000 7fd316ffd640 1 -- 172.21.15.7:0/2478860274 learned_addr learned my addr 172.21.15.7:0/2478860274 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:09.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.426+0000 7fd316ffd640 1 -- 172.21.15.7:0/2478860274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3f56c05d0 msgr2=0x55d3f56db720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:09.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.426+0000 7fd3177fe640 1 --2- 172.21.15.7:0/2478860274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3f56c05d0 0x55d3f56db720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:09.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.426+0000 7fd317fff640 1 --2- 172.21.15.7:0/2478860274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3f56cf780 0x55d3f56e7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:09.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.426+0000 7fd316ffd640 1 --2- 172.21.15.7:0/2478860274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3f56c05d0 0x55d3f56db720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.426+0000 7fd316ffd640 1 -- 172.21.15.7:0/2478860274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3f56cf780 msgr2=0x55d3f56e7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:09.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.426+0000 7fd316ffd640 1 --2- 172.21.15.7:0/2478860274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3f56cf780 0x55d3f56e7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.426+0000 7fd316ffd640 1 -- 172.21.15.7:0/2478860274 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3f56bd960 con 0x55d3f56c1b40 2024-09-19T08:46:09.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.426+0000 7fd317fff640 1 --2- 172.21.15.7:0/2478860274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3f56cf780 0x55d3f56e7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:46:09.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.426+0000 7fd316ffd640 1 --2- 172.21.15.7:0/2478860274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56c1b40 0x55d3f56c7720 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0058c0 tx=0x7fd30c09c060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20f576a322d3610 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:09.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.426+0000 7fd2fd7fa640 1 -- 172.21.15.7:0/2478860274 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c01d040 con 0x55d3f56c1b40 2024-09-19T08:46:09.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.426+0000 7fd2fd7fa640 1 -- 172.21.15.7:0/2478860274 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd30c0986d0 con 0x55d3f56c1b40 2024-09-19T08:46:09.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.426+0000 7fd2fd7fa640 1 -- 172.21.15.7:0/2478860274 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c096e30 con 0x55d3f56c1b40 2024-09-19T08:46:09.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.426+0000 7fd3202de740 1 -- 172.21.15.7:0/2478860274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56c1b40 msgr2=0x55d3f56c7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:09.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.426+0000 7fd3202de740 1 --2- 172.21.15.7:0/2478860274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56c1b40 0x55d3f56c7720 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0058c0 tx=0x7fd30c09c060 comp rx=0 tx=0).stop 2024-09-19T08:46:09.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.427+0000 7fd3202de740 1 -- 172.21.15.7:0/2478860274 shutdown_connections 2024-09-19T08:46:09.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.427+0000 7fd3202de740 1 --2- 172.21.15.7:0/2478860274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3f56cf780 0x55d3f56e7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.427+0000 7fd3202de740 1 --2- 172.21.15.7:0/2478860274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56c1b40 0x55d3f56c7720 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.427+0000 7fd3202de740 1 --2- 172.21.15.7:0/2478860274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3f56c05d0 0x55d3f56db720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.427+0000 7fd3202de740 1 -- 172.21.15.7:0/2478860274 >> 172.21.15.7:0/2478860274 conn(0x55d3f5689310 msgr2=0x55d3f56cb490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:09.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.427+0000 7fd3202de740 1 -- 172.21.15.7:0/2478860274 shutdown_connections 2024-09-19T08:46:09.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.427+0000 7fd3202de740 1 -- 172.21.15.7:0/2478860274 wait complete. 2024-09-19T08:46:09.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.427+0000 7fd3202de740 1 -- start start 2024-09-19T08:46:09.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.427+0000 7fd3202de740 1 Processor -- start 2024-09-19T08:46:09.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.427+0000 7fd3202de740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56c05d0 0x55d3f56d7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:09.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.427+0000 7fd3202de740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3f56c1b40 0x55d3f56d7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:09.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.427+0000 7fd3202de740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3f56cf780 0x55d3f56d4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:09.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.427+0000 7fd3202de740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd3181a9c90 con 0x55d3f56c05d0 2024-09-19T08:46:09.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.427+0000 7fd3202de740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd3181ab100 con 0x55d3f56cf780 2024-09-19T08:46:09.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.427+0000 7fd3202de740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd3181aa360 con 0x55d3f56c1b40 2024-09-19T08:46:09.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.427+0000 7fd3202de740 10 client.0 _ll_register_callbacks cb 0x7fd310040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:09.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.428+0000 7fd3177fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56c05d0 0x55d3f56d7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:09.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.428+0000 7fd3177fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56c05d0 0x55d3f56d7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49956/0 (socket says 172.21.15.7:49956) 2024-09-19T08:46:09.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.428+0000 7fd3177fe640 1 -- 172.21.15.7:0/1504483677 learned_addr learned my addr 172.21.15.7:0/1504483677 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:09.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.428+0000 7fd316ffd640 1 --2- 172.21.15.7:0/1504483677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3f56c1b40 0x55d3f56d7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:09.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.428+0000 7fd317fff640 1 --2- 172.21.15.7:0/1504483677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3f56cf780 0x55d3f56d4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:09.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.428+0000 7fd3177fe640 1 -- 172.21.15.7:0/1504483677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3f56c1b40 msgr2=0x55d3f56d7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:09.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.428+0000 7fd3177fe640 1 --2- 172.21.15.7:0/1504483677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3f56c1b40 0x55d3f56d7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.428+0000 7fd3177fe640 1 -- 172.21.15.7:0/1504483677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3f56cf780 msgr2=0x55d3f56d4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:09.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.428+0000 7fd3177fe640 1 --2- 172.21.15.7:0/1504483677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3f56cf780 0x55d3f56d4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.428+0000 7fd3177fe640 1 -- 172.21.15.7:0/1504483677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3f56d4fa0 con 0x55d3f56c05d0 2024-09-19T08:46:09.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.428+0000 7fd3177fe640 1 --2- 172.21.15.7:0/1504483677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56c05d0 0x55d3f56d7a70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd308009930 tx=0x7fd308009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8168dbec11a3ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:09.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.428+0000 7fd2f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:09.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.428+0000 7fd2f6ffd640 1 -- 172.21.15.7:0/1504483677 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308016040 con 0x55d3f56c05d0 2024-09-19T08:46:09.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.428+0000 7fd2f6ffd640 1 -- 172.21.15.7:0/1504483677 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fd308005150 con 0x55d3f56c05d0 2024-09-19T08:46:09.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.428+0000 7fd3202de740 1 -- 172.21.15.7:0/1504483677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd30c0986d0 con 0x55d3f56c05d0 2024-09-19T08:46:09.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.428+0000 7fd2f6ffd640 1 -- 172.21.15.7:0/1504483677 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd308005350 con 0x55d3f56c05d0 2024-09-19T08:46:09.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.429+0000 7fd3202de740 10 client.15666 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:09.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.429+0000 7fd3202de740 1 -- 172.21.15.7:0/1504483677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d3f574a9d0 con 0x55d3f56c05d0 2024-09-19T08:46:09.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.429+0000 7fd2f6ffd640 1 -- 172.21.15.7:0/1504483677 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd30c0986d0 con 0x55d3f56c05d0 2024-09-19T08:46:09.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.429+0000 7fd2f6ffd640 1 -- 172.21.15.7:0/1504483677 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd30800f040 con 0x55d3f56c05d0 2024-09-19T08:46:09.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.429+0000 7fd3202de740 10 client.15666 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:09.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.429+0000 7fd3202de740 10 client.15666 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:46:09.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.429+0000 7fd3202de740 20 client.15666 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:09.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.429+0000 7fd3202de740 1 --2- 172.21.15.7:0/1504483677 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55d3f574af00 0x55d3f574d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:09.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.429+0000 7fd3202de740 4 client.15666 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:46:09.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.429+0000 7fd3202de740 1 -- 172.21.15.7:0/1504483677 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d3f562dd70 con 0x55d3f574af00 2024-09-19T08:46:09.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.429+0000 7fd316ffd640 1 --2- 172.21.15.7:0/1504483677 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55d3f574af00 0x55d3f574d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:09.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.430+0000 7fd316ffd640 1 --2- 172.21.15.7:0/1504483677 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55d3f574af00 0x55d3f574d2f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=648002c48e6d09a2 server_cookie=379e3a080b6f9aa9 in_seq=0 out_seq=0 2024-09-19T08:46:09.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.430+0000 7fd2f6ffd640 10 client.15666 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:46:09.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.430+0000 7fd2f6ffd640 1 -- 172.21.15.7:0/1504483677 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d3f562dd70 con 0x55d3f574af00 2024-09-19T08:46:09.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.430+0000 7fd2f6ffd640 10 client.15666 handle_command_reply: tid=0 2024-09-19T08:46:09.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.430+0000 7fd3202de740 1 client.15666 shutdown 2024-09-19T08:46:09.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.430+0000 7fd3202de740 1 -- 172.21.15.7:0/1504483677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56c05d0 msgr2=0x55d3f56d7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:09.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.430+0000 7fd3202de740 1 --2- 172.21.15.7:0/1504483677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56c05d0 0x55d3f56d7a70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd308009930 tx=0x7fd308009b00 comp rx=0 tx=0).stop 2024-09-19T08:46:09.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.430+0000 7fd3202de740 1 -- 172.21.15.7:0/1504483677 shutdown_connections 2024-09-19T08:46:09.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.430+0000 7fd3202de740 1 --2- 172.21.15.7:0/1504483677 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55d3f574af00 0x55d3f574d2f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.430+0000 7fd3202de740 1 --2- 172.21.15.7:0/1504483677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3f56cf780 0x55d3f56d4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.430+0000 7fd3202de740 1 --2- 172.21.15.7:0/1504483677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3f56c1b40 0x55d3f56d7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.430+0000 7fd2f6ffd640 0 client.15666 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:46:09.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.430+0000 7fd3202de740 1 --2- 172.21.15.7:0/1504483677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d3f56c05d0 0x55d3f56d7a70 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.430+0000 7fd3202de740 1 -- 172.21.15.7:0/1504483677 >> 172.21.15.7:0/1504483677 conn(0x55d3f5689310 msgr2=0x55d3f56cdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:09.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.430+0000 7fd3202de740 1 -- 172.21.15.7:0/1504483677 shutdown_connections 2024-09-19T08:46:09.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.430+0000 7fd3202de740 1 -- 172.21.15.7:0/1504483677 wait complete. 2024-09-19T08:46:09.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.430+0000 7fd3202de740 20 client.15666 trim_cache size 0 max 16384 2024-09-19T08:46:09.438 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:46:09.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.431+0000 7fd31df05640 1 -- 172.21.15.7:0/3734695018 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd3000a33b0 msgr2=0x7fd3000a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:09.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.431+0000 7fd31df05640 1 --2- 172.21.15.7:0/3734695018 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd3000a33b0 0x7fd3000a5870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd310006010 tx=0x7fd3100046c0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.431+0000 7fd31df05640 1 -- 172.21.15.7:0/3734695018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd318102570 msgr2=0x7fd3181989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:09.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.431+0000 7fd31df05640 1 --2- 172.21.15.7:0/3734695018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd318102570 0x7fd3181989f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00c890 tx=0x7fd30c00cd50 comp rx=0 tx=0).stop 2024-09-19T08:46:09.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.431+0000 7fd31df05640 1 -- 172.21.15.7:0/3734695018 shutdown_connections 2024-09-19T08:46:09.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.431+0000 7fd31df05640 1 --2- 172.21.15.7:0/3734695018 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd3000a33b0 0x7fd3000a5870 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.431+0000 7fd31df05640 1 --2- 172.21.15.7:0/3734695018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd318102ef0 0x7fd31819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.431+0000 7fd31df05640 1 --2- 172.21.15.7:0/3734695018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd318102570 0x7fd3181989f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.431+0000 7fd31df05640 1 --2- 172.21.15.7:0/3734695018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd318100e20 0x7fd3181984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:09.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.431+0000 7fd31df05640 1 -- 172.21.15.7:0/3734695018 >> 172.21.15.7:0/3734695018 conn(0x7fd3180fc7d0 msgr2=0x7fd31806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:09.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.431+0000 7fd31df05640 1 -- 172.21.15.7:0/3734695018 shutdown_connections 2024-09-19T08:46:09.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:09.431+0000 7fd31df05640 1 -- 172.21.15.7:0/3734695018 wait complete. 2024-09-19T08:46:10.187 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:46:10.446 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:46:10.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:10 smithi007 ceph-mon[31221]: pgmap v52: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-19T08:46:10.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:10 smithi175 ceph-mon[35688]: pgmap v52: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-19T08:46:10.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:10 smithi044 ceph-mon[35072]: pgmap v52: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-19T08:46:10.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.908+0000 7f0401b7e640 1 -- 172.21.15.7:0/449056446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03fc10c180 msgr2=0x7f03fc10e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:10.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.908+0000 7f0401b7e640 1 --2- 172.21.15.7:0/449056446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03fc10c180 0x7f03fc10e600 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f03f4009ca0 tx=0x7f03f402a950 comp rx=0 tx=0).stop 2024-09-19T08:46:10.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.908+0000 7f0401b7e640 1 -- 172.21.15.7:0/449056446 shutdown_connections 2024-09-19T08:46:10.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.908+0000 7f0401b7e640 1 --2- 172.21.15.7:0/449056446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03fc10c180 0x7f03fc10e600 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.908+0000 7f0401b7e640 1 --2- 172.21.15.7:0/449056446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03fc1036c0 0x7f03fc10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.908+0000 7f0401b7e640 1 --2- 172.21.15.7:0/449056446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03fc102da0 0x7f03fc103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.908+0000 7f0401b7e640 1 -- 172.21.15.7:0/449056446 >> 172.21.15.7:0/449056446 conn(0x7f03fc0fc7a0 msgr2=0x7f03fc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.908+0000 7f0401b7e640 1 -- 172.21.15.7:0/449056446 shutdown_connections 2024-09-19T08:46:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.908+0000 7f0401b7e640 1 -- 172.21.15.7:0/449056446 wait complete. 2024-09-19T08:46:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.908+0000 7f0401b7e640 1 Processor -- start 2024-09-19T08:46:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.908+0000 7f0401b7e640 1 -- start start 2024-09-19T08:46:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.909+0000 7f0401b7e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03fc102da0 0x7f03fc198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.909+0000 7f0401b7e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03fc1036c0 0x7f03fc1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.909+0000 7f0401b7e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03fc10c180 0x7f03fc19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.909+0000 7f0401b7e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc111f60 con 0x7f03fc10c180 2024-09-19T08:46:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.909+0000 7f0401b7e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc111de0 con 0x7f03fc102da0 2024-09-19T08:46:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.909+0000 7f0401b7e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc1120e0 con 0x7f03fc1036c0 2024-09-19T08:46:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.909+0000 7f03fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03fc10c180 0x7f03fc19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.909+0000 7f03fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03fc10c180 0x7f03fc19cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49976/0 (socket says 172.21.15.7:49976) 2024-09-19T08:46:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.909+0000 7f03fbfff640 1 -- 172.21.15.7:0/2784793615 learned_addr learned my addr 172.21.15.7:0/2784793615 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.909+0000 7f03fb7fe640 1 --2- 172.21.15.7:0/2784793615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03fc102da0 0x7f03fc198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.909+0000 7f03faffd640 1 --2- 172.21.15.7:0/2784793615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03fc1036c0 0x7f03fc1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.909+0000 7f03fbfff640 1 -- 172.21.15.7:0/2784793615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03fc1036c0 msgr2=0x7f03fc1988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.909+0000 7f03fbfff640 1 --2- 172.21.15.7:0/2784793615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03fc1036c0 0x7f03fc1988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.909+0000 7f03fbfff640 1 -- 172.21.15.7:0/2784793615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03fc102da0 msgr2=0x7f03fc198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.909+0000 7f03fbfff640 1 --2- 172.21.15.7:0/2784793615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03fc102da0 0x7f03fc198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.909+0000 7f03fbfff640 1 -- 172.21.15.7:0/2784793615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03fc19d310 con 0x7f03fc10c180 2024-09-19T08:46:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.909+0000 7f03faffd640 1 --2- 172.21.15.7:0/2784793615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03fc1036c0 0x7f03fc1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.909+0000 7f03fbfff640 1 --2- 172.21.15.7:0/2784793615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03fc10c180 0x7f03fc19cc30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f03f4006010 tx=0x7f03f402f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.910+0000 7f03f8ff9640 1 -- 172.21.15.7:0/2784793615 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f4034040 con 0x7f03fc10c180 2024-09-19T08:46:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.910+0000 7f0401b7e640 1 -- 172.21.15.7:0/2784793615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03fc19d5a0 con 0x7f03fc10c180 2024-09-19T08:46:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.910+0000 7f03f8ff9640 1 -- 172.21.15.7:0/2784793615 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03f4003e00 con 0x7f03fc10c180 2024-09-19T08:46:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.910+0000 7f03f8ff9640 1 -- 172.21.15.7:0/2784793615 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f40456e0 con 0x7f03fc10c180 2024-09-19T08:46:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.910+0000 7f0401b7e640 1 -- 172.21.15.7:0/2784793615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03fc1a4ee0 con 0x7f03fc10c180 2024-09-19T08:46:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.912+0000 7f03f8ff9640 1 -- 172.21.15.7:0/2784793615 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f03f4037020 con 0x7f03fc10c180 2024-09-19T08:46:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.912+0000 7f0403f57740 1 Processor -- start 2024-09-19T08:46:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.912+0000 7f0403f57740 1 -- start start 2024-09-19T08:46:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.912+0000 7f0403f57740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564abdf01b40 0x564abdf00090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.912+0000 7f0403f57740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564abdf005d0 0x564abdf00a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.912+0000 7f0403f57740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf0b370 0x564abdf0d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.912+0000 7f0403f57740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564abde662f0 con 0x564abdf0b370 2024-09-19T08:46:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.912+0000 7f0403f57740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564abde0dcf0 con 0x564abdf005d0 2024-09-19T08:46:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.912+0000 7f0403f57740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564abde622b0 con 0x564abdf01b40 2024-09-19T08:46:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.913+0000 7f03faffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf0b370 0x564abdf0d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.913+0000 7f03faffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf0b370 0x564abdf0d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49990/0 (socket says 172.21.15.7:49990) 2024-09-19T08:46:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.913+0000 7f03faffd640 1 -- 172.21.15.7:0/1934032691 learned_addr learned my addr 172.21.15.7:0/1934032691 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.913+0000 7f03fb7fe640 1 --2- 172.21.15.7:0/1934032691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564abdf005d0 0x564abdf00a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.913+0000 7f03faffd640 1 --2- 172.21.15.7:0/1934032691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564abdf01b40 0x564abdf00090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.913+0000 7f03f8ff9640 1 --2- 172.21.15.7:0/2784793615 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f03e40a33b0 0x7f03e40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.913+0000 7f03faffd640 1 -- 172.21.15.7:0/1934032691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564abdf01b40 msgr2=0x564abdf00090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.913+0000 7f03faffd640 1 --2- 172.21.15.7:0/1934032691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564abdf01b40 0x564abdf00090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.913+0000 7f03faffd640 1 -- 172.21.15.7:0/1934032691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564abdf005d0 msgr2=0x564abdf00a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.913+0000 7f03faffd640 1 --2- 172.21.15.7:0/1934032691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564abdf005d0 0x564abdf00a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.913+0000 7f03faffd640 1 -- 172.21.15.7:0/1934032691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564abddf23a0 con 0x564abdf0b370 2024-09-19T08:46:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.913+0000 7f03f8ff9640 1 -- 172.21.15.7:0/2784793615 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f03f40f0cf0 con 0x7f03fc10c180 2024-09-19T08:46:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.913+0000 7f03faffd640 1 --2- 172.21.15.7:0/1934032691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf0b370 0x564abdf0d760 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f03f000bf90 tx=0x7f03f000b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb4b11cd6df77b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.913+0000 7f03fbfff640 1 --2- 172.21.15.7:0/2784793615 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f03e40a33b0 0x7f03e40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.913+0000 7f03e1ffb640 1 -- 172.21.15.7:0/1934032691 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f0018070 con 0x564abdf0b370 2024-09-19T08:46:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.913+0000 7f03e1ffb640 1 -- 172.21.15.7:0/1934032691 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03f0010c00 con 0x564abdf0b370 2024-09-19T08:46:10.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.913+0000 7f03e1ffb640 1 -- 172.21.15.7:0/1934032691 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f0003a40 con 0x564abdf0b370 2024-09-19T08:46:10.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.914+0000 7f0403f57740 1 -- 172.21.15.7:0/1934032691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf0b370 msgr2=0x564abdf0d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:10.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.914+0000 7f03fbfff640 1 --2- 172.21.15.7:0/2784793615 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f03e40a33b0 0x7f03e40a5870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f03f40ee5a0 tx=0x7f03f402a950 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:10.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.914+0000 7f0403f57740 1 --2- 172.21.15.7:0/1934032691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf0b370 0x564abdf0d760 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f03f000bf90 tx=0x7f03f000b660 comp rx=0 tx=0).stop 2024-09-19T08:46:10.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.914+0000 7f0403f57740 1 -- 172.21.15.7:0/1934032691 shutdown_connections 2024-09-19T08:46:10.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.914+0000 7f0403f57740 1 --2- 172.21.15.7:0/1934032691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf0b370 0x564abdf0d760 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.914+0000 7f0403f57740 1 --2- 172.21.15.7:0/1934032691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564abdf005d0 0x564abdf00a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.914+0000 7f0403f57740 1 --2- 172.21.15.7:0/1934032691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564abdf01b40 0x564abdf00090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.914+0000 7f0403f57740 1 -- 172.21.15.7:0/1934032691 >> 172.21.15.7:0/1934032691 conn(0x564abdec9310 msgr2=0x564abdefcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:10.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.914+0000 7f0403f57740 1 -- 172.21.15.7:0/1934032691 shutdown_connections 2024-09-19T08:46:10.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.914+0000 7f0403f57740 1 -- 172.21.15.7:0/1934032691 wait complete. 2024-09-19T08:46:10.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.914+0000 7f0403f57740 1 -- start start 2024-09-19T08:46:10.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.915+0000 7f0403f57740 1 Processor -- start 2024-09-19T08:46:10.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.915+0000 7f0403f57740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564abdf005d0 0x564abdf0ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:10.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.915+0000 7f0403f57740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf01b40 0x564abdf08020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:10.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.915+0000 7f0403f57740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564abdf0b370 0x564abdf08610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:10.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.915+0000 7f0403f57740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564abdf0e070 con 0x564abdf01b40 2024-09-19T08:46:10.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.915+0000 7f0403f57740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564abde21060 con 0x564abdf005d0 2024-09-19T08:46:10.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.915+0000 7f0403f57740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564abdf0e1f0 con 0x564abdf0b370 2024-09-19T08:46:10.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.915+0000 7f0403f57740 10 client.0 _ll_register_callbacks cb 0x564abdb748c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:10.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.915+0000 7f03fb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf01b40 0x564abdf08020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:10.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.915+0000 7f03fb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf01b40 0x564abdf08020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50006/0 (socket says 172.21.15.7:50006) 2024-09-19T08:46:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.915+0000 7f03fb7fe640 1 -- 172.21.15.7:0/2758877202 learned_addr learned my addr 172.21.15.7:0/2758877202 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.915+0000 7f03faffd640 1 --2- 172.21.15.7:0/2758877202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564abdf005d0 0x564abdf0ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.915+0000 7f03faffd640 1 --2- 172.21.15.7:0/2758877202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564abdf0b370 0x564abdf08610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.915+0000 7f03fb7fe640 1 -- 172.21.15.7:0/2758877202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564abdf0b370 msgr2=0x564abdf08610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.915+0000 7f03fb7fe640 1 --2- 172.21.15.7:0/2758877202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564abdf0b370 0x564abdf08610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.915+0000 7f03fb7fe640 1 -- 172.21.15.7:0/2758877202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564abdf005d0 msgr2=0x564abdf0ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.915+0000 7f03fb7fe640 1 --2- 172.21.15.7:0/2758877202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564abdf005d0 0x564abdf0ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.915+0000 7f03fb7fe640 1 -- 172.21.15.7:0/2758877202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564abdbd73c0 con 0x564abdf01b40 2024-09-19T08:46:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.916+0000 7f03faffd640 1 --2- 172.21.15.7:0/2758877202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564abdf0b370 0x564abdf08610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:46:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.916+0000 7f03fb7fe640 1 --2- 172.21.15.7:0/2758877202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf01b40 0x564abdf08020 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f03ec010820 tx=0x7f03ec010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8559211b2b6b49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.916+0000 7f03daffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.916+0000 7f03daffd640 1 -- 172.21.15.7:0/2758877202 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec01e060 con 0x564abdf01b40 2024-09-19T08:46:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.916+0000 7f0403f57740 1 -- 172.21.15.7:0/2758877202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03f0010c00 con 0x564abdf01b40 2024-09-19T08:46:10.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.916+0000 7f03daffd640 1 -- 172.21.15.7:0/2758877202 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f03ec00fb90 con 0x564abdf01b40 2024-09-19T08:46:10.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.916+0000 7f03daffd640 1 -- 172.21.15.7:0/2758877202 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f03ec00fd90 con 0x564abdf01b40 2024-09-19T08:46:10.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.916+0000 7f0403f57740 10 client.15678 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:10.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.916+0000 7f0403f57740 1 -- 172.21.15.7:0/2758877202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564abdf19bc0 con 0x564abdf01b40 2024-09-19T08:46:10.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.916+0000 7f03daffd640 1 -- 172.21.15.7:0/2758877202 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03f0010c00 con 0x564abdf01b40 2024-09-19T08:46:10.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.916+0000 7f03daffd640 1 -- 172.21.15.7:0/2758877202 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f03ec00e570 con 0x564abdf01b40 2024-09-19T08:46:10.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.916+0000 7f0403f57740 10 client.15678 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:10.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.916+0000 7f0403f57740 10 client.15678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:10.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.916+0000 7f0403f57740 20 client.15678 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:10.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.916+0000 7f0403f57740 1 --2- 172.21.15.7:0/2758877202 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564abdf1b020 0x564abdf1d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:10.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.916+0000 7f0403f57740 4 client.15678 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:46:10.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.916+0000 7f0403f57740 1 -- 172.21.15.7:0/2758877202 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564abde73860 con 0x564abdf1b020 2024-09-19T08:46:10.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.917+0000 7f03faffd640 1 --2- 172.21.15.7:0/2758877202 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564abdf1b020 0x564abdf1d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:10.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.917+0000 7f03faffd640 1 --2- 172.21.15.7:0/2758877202 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564abdf1b020 0x564abdf1d440 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3452bc097623f037 server_cookie=d9eb869903f8a33f in_seq=0 out_seq=0 2024-09-19T08:46:10.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.917+0000 7f03daffd640 10 client.15678 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:10.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.918+0000 7f03daffd640 1 -- 172.21.15.7:0/2758877202 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564abde73860 con 0x564abdf1b020 2024-09-19T08:46:10.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.918+0000 7f03daffd640 10 client.15678 handle_command_reply: tid=0 2024-09-19T08:46:10.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.918+0000 7f0403f57740 1 client.15678 shutdown 2024-09-19T08:46:10.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.918+0000 7f0403f57740 1 -- 172.21.15.7:0/2758877202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf01b40 msgr2=0x564abdf08020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:10.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.918+0000 7f0403f57740 1 --2- 172.21.15.7:0/2758877202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf01b40 0x564abdf08020 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f03ec010820 tx=0x7f03ec010ce0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.918+0000 7f0403f57740 1 -- 172.21.15.7:0/2758877202 shutdown_connections 2024-09-19T08:46:10.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.918+0000 7f0403f57740 1 --2- 172.21.15.7:0/2758877202 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564abdf1b020 0x564abdf1d440 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.919+0000 7f0403f57740 1 --2- 172.21.15.7:0/2758877202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564abdf0b370 0x564abdf08610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.919+0000 7f0403f57740 1 --2- 172.21.15.7:0/2758877202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf01b40 0x564abdf08020 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.919+0000 7f0403f57740 1 --2- 172.21.15.7:0/2758877202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564abdf005d0 0x564abdf0ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.919+0000 7f03daffd640 0 client.15678 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:10.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.919+0000 7f0403f57740 1 -- 172.21.15.7:0/2758877202 >> 172.21.15.7:0/2758877202 conn(0x564abdec9310 msgr2=0x564abdf02960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:10.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.919+0000 7f0403f57740 1 -- 172.21.15.7:0/2758877202 shutdown_connections 2024-09-19T08:46:10.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.919+0000 7f0403f57740 1 -- 172.21.15.7:0/2758877202 wait complete. 2024-09-19T08:46:10.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.919+0000 7f0403f57740 20 client.15678 trim_cache size 0 max 16384 2024-09-19T08:46:10.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.932+0000 7f0403f57740 1 Processor -- start 2024-09-19T08:46:10.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.932+0000 7f0403f57740 1 -- start start 2024-09-19T08:46:10.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.932+0000 7f0403f57740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564abdf005d0 0x564abdefcd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:10.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.932+0000 7f0403f57740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564abdf01b40 0x564abdf17310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:10.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.932+0000 7f0403f57740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf0b370 0x564abdf07020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:10.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.932+0000 7f0403f57740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc1b0070 con 0x564abdf0b370 2024-09-19T08:46:10.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.932+0000 7f0403f57740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc1ad940 con 0x564abdf01b40 2024-09-19T08:46:10.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.932+0000 7f0403f57740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc1ab790 con 0x564abdf005d0 2024-09-19T08:46:10.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.932+0000 7f03faffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf0b370 0x564abdf07020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:10.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.932+0000 7f03faffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf0b370 0x564abdf07020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50016/0 (socket says 172.21.15.7:50016) 2024-09-19T08:46:10.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.932+0000 7f03faffd640 1 -- 172.21.15.7:0/147959895 learned_addr learned my addr 172.21.15.7:0/147959895 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:10.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.932+0000 7f03fb7fe640 1 --2- 172.21.15.7:0/147959895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564abdf01b40 0x564abdf17310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:10.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.932+0000 7f03faffd640 1 --2- 172.21.15.7:0/147959895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564abdf005d0 0x564abdefcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:10.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.932+0000 7f03faffd640 1 -- 172.21.15.7:0/147959895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564abdf005d0 msgr2=0x564abdefcd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:10.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.932+0000 7f03faffd640 1 --2- 172.21.15.7:0/147959895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564abdf005d0 0x564abdefcd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.932+0000 7f03faffd640 1 -- 172.21.15.7:0/147959895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564abdf01b40 msgr2=0x564abdf17310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:10.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.932+0000 7f03faffd640 1 --2- 172.21.15.7:0/147959895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564abdf01b40 0x564abdf17310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.932+0000 7f03faffd640 1 -- 172.21.15.7:0/147959895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564abdefd960 con 0x564abdf0b370 2024-09-19T08:46:10.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.933+0000 7f03faffd640 1 --2- 172.21.15.7:0/147959895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf0b370 0x564abdf07020 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f03f00036d0 tx=0x7f03f0003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae77bfa0b5af460b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:10.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.933+0000 7f03e17fa640 1 -- 172.21.15.7:0/147959895 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f0018040 con 0x564abdf0b370 2024-09-19T08:46:10.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.933+0000 7f03e17fa640 1 -- 172.21.15.7:0/147959895 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03f0010c00 con 0x564abdf0b370 2024-09-19T08:46:10.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.933+0000 7f03e17fa640 1 -- 172.21.15.7:0/147959895 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f00039d0 con 0x564abdf0b370 2024-09-19T08:46:10.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.933+0000 7f0403f57740 1 -- 172.21.15.7:0/147959895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf0b370 msgr2=0x564abdf07020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:10.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.933+0000 7f0403f57740 1 --2- 172.21.15.7:0/147959895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf0b370 0x564abdf07020 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f03f00036d0 tx=0x7f03f0003700 comp rx=0 tx=0).stop 2024-09-19T08:46:10.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.933+0000 7f0403f57740 1 -- 172.21.15.7:0/147959895 shutdown_connections 2024-09-19T08:46:10.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.933+0000 7f0403f57740 1 --2- 172.21.15.7:0/147959895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf0b370 0x564abdf07020 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.933+0000 7f0403f57740 1 --2- 172.21.15.7:0/147959895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564abdf01b40 0x564abdf17310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.933+0000 7f0403f57740 1 --2- 172.21.15.7:0/147959895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564abdf005d0 0x564abdefcd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.933+0000 7f0403f57740 1 -- 172.21.15.7:0/147959895 >> 172.21.15.7:0/147959895 conn(0x564abdec9310 msgr2=0x564abdf06910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:10.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.933+0000 7f0403f57740 1 -- 172.21.15.7:0/147959895 shutdown_connections 2024-09-19T08:46:10.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.933+0000 7f0403f57740 1 -- 172.21.15.7:0/147959895 wait complete. 2024-09-19T08:46:10.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.934+0000 7f0403f57740 1 -- start start 2024-09-19T08:46:10.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.934+0000 7f0403f57740 1 Processor -- start 2024-09-19T08:46:10.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.934+0000 7f0403f57740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564abdf005d0 0x564abdf13480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:10.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.934+0000 7f0403f57740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf01b40 0x564abdf139c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:10.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.934+0000 7f0403f57740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564abdf0b370 0x564abdf04670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:10.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.934+0000 7f0403f57740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc1abe00 con 0x564abdf01b40 2024-09-19T08:46:10.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.934+0000 7f0403f57740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc1ad270 con 0x564abdf0b370 2024-09-19T08:46:10.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.934+0000 7f0403f57740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc1ac4d0 con 0x564abdf005d0 2024-09-19T08:46:10.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.934+0000 7f0403f57740 10 client.0 _ll_register_callbacks cb 0x7f03ec00a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:10.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.934+0000 7f03fb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf01b40 0x564abdf139c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:10.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.934+0000 7f03fb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf01b40 0x564abdf139c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50032/0 (socket says 172.21.15.7:50032) 2024-09-19T08:46:10.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.934+0000 7f03fb7fe640 1 -- 172.21.15.7:0/3387365683 learned_addr learned my addr 172.21.15.7:0/3387365683 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:10.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.934+0000 7f03faffd640 1 --2- 172.21.15.7:0/3387365683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564abdf0b370 0x564abdf04670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:10.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.935+0000 7f03faffd640 1 --2- 172.21.15.7:0/3387365683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564abdf005d0 0x564abdf13480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:10.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.935+0000 7f03fb7fe640 1 -- 172.21.15.7:0/3387365683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564abdf005d0 msgr2=0x564abdf13480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:10.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.935+0000 7f03fb7fe640 1 --2- 172.21.15.7:0/3387365683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564abdf005d0 0x564abdf13480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.935+0000 7f03fb7fe640 1 -- 172.21.15.7:0/3387365683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564abdf0b370 msgr2=0x564abdf04670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:10.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.935+0000 7f03fb7fe640 1 --2- 172.21.15.7:0/3387365683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564abdf0b370 0x564abdf04670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.935+0000 7f03fb7fe640 1 -- 172.21.15.7:0/3387365683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564abdf04be0 con 0x564abdf01b40 2024-09-19T08:46:10.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.935+0000 7f03faffd640 1 --2- 172.21.15.7:0/3387365683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564abdf005d0 0x564abdf13480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:46:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.935+0000 7f03fb7fe640 1 --2- 172.21.15.7:0/3387365683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf01b40 0x564abdf139c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00ea10 tx=0x7f03ec010500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b85f06f7ee6e0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.935+0000 7f03daffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.935+0000 7f03daffd640 1 -- 172.21.15.7:0/3387365683 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec00e5c0 con 0x564abdf01b40 2024-09-19T08:46:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.935+0000 7f03daffd640 1 -- 172.21.15.7:0/3387365683 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f03ec022420 con 0x564abdf01b40 2024-09-19T08:46:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.935+0000 7f0403f57740 1 -- 172.21.15.7:0/3387365683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03f0010c00 con 0x564abdf01b40 2024-09-19T08:46:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.935+0000 7f03daffd640 1 -- 172.21.15.7:0/3387365683 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f03ec039050 con 0x564abdf01b40 2024-09-19T08:46:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.935+0000 7f0403f57740 10 client.15684 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.935+0000 7f0403f57740 1 -- 172.21.15.7:0/3387365683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564abdf85520 con 0x564abdf01b40 2024-09-19T08:46:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.936+0000 7f03daffd640 1 -- 172.21.15.7:0/3387365683 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03f0010c00 con 0x564abdf01b40 2024-09-19T08:46:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.936+0000 7f03daffd640 1 -- 172.21.15.7:0/3387365683 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f03ec019530 con 0x564abdf01b40 2024-09-19T08:46:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.936+0000 7f0403f57740 10 client.15684 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.936+0000 7f0403f57740 10 client.15684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.936+0000 7f0403f57740 20 client.15684 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:10.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.936+0000 7f0403f57740 1 --2- 172.21.15.7:0/3387365683 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564abdf85cb0 0x564abdf880d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:10.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.936+0000 7f0403f57740 4 client.15684 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:46:10.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.936+0000 7f0403f57740 1 -- 172.21.15.7:0/3387365683 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564abde6dd70 con 0x564abdf85cb0 2024-09-19T08:46:10.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.936+0000 7f03faffd640 1 --2- 172.21.15.7:0/3387365683 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564abdf85cb0 0x564abdf880d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:10.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.936+0000 7f03faffd640 1 --2- 172.21.15.7:0/3387365683 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564abdf85cb0 0x564abdf880d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8ce573a624be759 server_cookie=16b29de5766e6dc6 in_seq=0 out_seq=0 2024-09-19T08:46:10.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.936+0000 7f03daffd640 10 client.15684 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:10.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.937+0000 7f03daffd640 1 -- 172.21.15.7:0/3387365683 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564abde6dd70 con 0x564abdf85cb0 2024-09-19T08:46:10.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.937+0000 7f03daffd640 10 client.15684 handle_command_reply: tid=0 2024-09-19T08:46:10.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.937+0000 7f0403f57740 1 client.15684 shutdown 2024-09-19T08:46:10.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.937+0000 7f0403f57740 1 -- 172.21.15.7:0/3387365683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf01b40 msgr2=0x564abdf139c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:10.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.937+0000 7f0403f57740 1 --2- 172.21.15.7:0/3387365683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf01b40 0x564abdf139c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00ea10 tx=0x7f03ec010500 comp rx=0 tx=0).stop 2024-09-19T08:46:10.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.937+0000 7f0403f57740 1 -- 172.21.15.7:0/3387365683 shutdown_connections 2024-09-19T08:46:10.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.937+0000 7f0403f57740 1 --2- 172.21.15.7:0/3387365683 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564abdf85cb0 0x564abdf880d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.937+0000 7f0403f57740 1 --2- 172.21.15.7:0/3387365683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564abdf0b370 0x564abdf04670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.937+0000 7f0403f57740 1 --2- 172.21.15.7:0/3387365683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564abdf01b40 0x564abdf139c0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.937+0000 7f0403f57740 1 --2- 172.21.15.7:0/3387365683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564abdf005d0 0x564abdf13480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.937+0000 7f0403f57740 1 -- 172.21.15.7:0/3387365683 >> 172.21.15.7:0/3387365683 conn(0x564abdec9310 msgr2=0x564abdf07130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:10.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.937+0000 7f03daffd640 0 client.15684 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:10.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.937+0000 7f0403f57740 1 -- 172.21.15.7:0/3387365683 shutdown_connections 2024-09-19T08:46:10.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.937+0000 7f0403f57740 1 -- 172.21.15.7:0/3387365683 wait complete. 2024-09-19T08:46:10.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.937+0000 7f0403f57740 20 client.15684 trim_cache size 0 max 16384 2024-09-19T08:46:10.942 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:46:10.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.938+0000 7f0401b7e640 1 -- 172.21.15.7:0/2784793615 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f03e40a33b0 msgr2=0x7f03e40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:10.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.938+0000 7f0401b7e640 1 --2- 172.21.15.7:0/2784793615 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f03e40a33b0 0x7f03e40a5870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f03f40ee5a0 tx=0x7f03f402a950 comp rx=0 tx=0).stop 2024-09-19T08:46:10.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.938+0000 7f0401b7e640 1 -- 172.21.15.7:0/2784793615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03fc10c180 msgr2=0x7f03fc19cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:10.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.938+0000 7f0401b7e640 1 --2- 172.21.15.7:0/2784793615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03fc10c180 0x7f03fc19cc30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f03f4006010 tx=0x7f03f402f710 comp rx=0 tx=0).stop 2024-09-19T08:46:10.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.938+0000 7f0401b7e640 1 -- 172.21.15.7:0/2784793615 shutdown_connections 2024-09-19T08:46:10.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.938+0000 7f0401b7e640 1 --2- 172.21.15.7:0/2784793615 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f03e40a33b0 0x7f03e40a5870 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.938+0000 7f0401b7e640 1 --2- 172.21.15.7:0/2784793615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03fc10c180 0x7f03fc19cc30 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.938+0000 7f0401b7e640 1 --2- 172.21.15.7:0/2784793615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03fc1036c0 0x7f03fc1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.938+0000 7f0401b7e640 1 --2- 172.21.15.7:0/2784793615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03fc102da0 0x7f03fc198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:10.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.938+0000 7f0401b7e640 1 -- 172.21.15.7:0/2784793615 >> 172.21.15.7:0/2784793615 conn(0x7f03fc0fc7a0 msgr2=0x7f03fc0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:10.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.938+0000 7f0401b7e640 1 -- 172.21.15.7:0/2784793615 shutdown_connections 2024-09-19T08:46:10.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:10.938+0000 7f0401b7e640 1 -- 172.21.15.7:0/2784793615 wait complete. 2024-09-19T08:46:12.362 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:46:12.629 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:46:12.681 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:12 smithi175 ceph-mon[35688]: pgmap v53: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-19T08:46:12.684 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:46:12.685 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:46:12.707 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:12 smithi007 ceph-mon[31221]: pgmap v53: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-19T08:46:12.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:12 smithi044 ceph-mon[35072]: pgmap v53: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-19T08:46:13.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.096+0000 7f98e0a9b640 1 -- 172.21.15.7:0/377711676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98dc101420 msgr2=0x7f98dc10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:13.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.096+0000 7f98e0a9b640 1 --2- 172.21.15.7:0/377711676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98dc101420 0x7f98dc10d950 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009cd0 tx=0x7f98d402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:46:13.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.096+0000 7f98e0a9b640 1 -- 172.21.15.7:0/377711676 shutdown_connections 2024-09-19T08:46:13.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.096+0000 7f98e0a9b640 1 --2- 172.21.15.7:0/377711676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98dc101420 0x7f98dc10d950 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:13.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.096+0000 7f98e0a9b640 1 --2- 172.21.15.7:0/377711676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98dc100a80 0x7f98dc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:13.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.096+0000 7f98e0a9b640 1 --2- 172.21.15.7:0/377711676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98dc106a80 0x7f98dc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:13.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.097+0000 7f98e0a9b640 1 -- 172.21.15.7:0/377711676 >> 172.21.15.7:0/377711676 conn(0x7f98dc0fc7a0 msgr2=0x7f98dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:13.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.097+0000 7f98e0a9b640 1 -- 172.21.15.7:0/377711676 shutdown_connections 2024-09-19T08:46:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.097+0000 7f98e0a9b640 1 -- 172.21.15.7:0/377711676 wait complete. 2024-09-19T08:46:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.097+0000 7f98e0a9b640 1 Processor -- start 2024-09-19T08:46:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.098+0000 7f98e0a9b640 1 -- start start 2024-09-19T08:46:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.098+0000 7f98e0a9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98dc100a80 0x7f98dc198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.098+0000 7f98e0a9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98dc101420 0x7f98dc198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.098+0000 7f98e0a9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98dc106a80 0x7f98dc19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.098+0000 7f98e0a9b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f98dc111f80 con 0x7f98dc106a80 2024-09-19T08:46:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.098+0000 7f98e0a9b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f98dc111e00 con 0x7f98dc100a80 2024-09-19T08:46:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.098+0000 7f98e0a9b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f98dc112100 con 0x7f98dc101420 2024-09-19T08:46:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.098+0000 7f98dad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98dc106a80 0x7f98dc19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.098+0000 7f98dad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98dc106a80 0x7f98dc19ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50064/0 (socket says 172.21.15.7:50064) 2024-09-19T08:46:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.098+0000 7f98dad9d640 1 -- 172.21.15.7:0/182005217 learned_addr learned my addr 172.21.15.7:0/182005217 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:13.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.098+0000 7f98da59c640 1 --2- 172.21.15.7:0/182005217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98dc100a80 0x7f98dc198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:13.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.098+0000 7f98d9d9b640 1 --2- 172.21.15.7:0/182005217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98dc101420 0x7f98dc198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:13.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.098+0000 7f98dad9d640 1 -- 172.21.15.7:0/182005217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98dc101420 msgr2=0x7f98dc198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:13.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.098+0000 7f98dad9d640 1 --2- 172.21.15.7:0/182005217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98dc101420 0x7f98dc198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:13.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.098+0000 7f98dad9d640 1 -- 172.21.15.7:0/182005217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98dc100a80 msgr2=0x7f98dc198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:13.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.098+0000 7f98dad9d640 1 --2- 172.21.15.7:0/182005217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98dc100a80 0x7f98dc198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:13.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.098+0000 7f98dad9d640 1 -- 172.21.15.7:0/182005217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98dc19d3d0 con 0x7f98dc106a80 2024-09-19T08:46:13.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.099+0000 7f98dad9d640 1 --2- 172.21.15.7:0/182005217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98dc106a80 0x7f98dc19ccf0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f98d4005cc0 tx=0x7f98d4003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:13.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.099+0000 7f98cb7fe640 1 -- 172.21.15.7:0/182005217 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d4004040 con 0x7f98dc106a80 2024-09-19T08:46:13.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.099+0000 7f98cb7fe640 1 -- 172.21.15.7:0/182005217 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98d40046c0 con 0x7f98dc106a80 2024-09-19T08:46:13.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.099+0000 7f98e0a9b640 1 -- 172.21.15.7:0/182005217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98dc19d660 con 0x7f98dc106a80 2024-09-19T08:46:13.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.099+0000 7f98cb7fe640 1 -- 172.21.15.7:0/182005217 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d4046480 con 0x7f98dc106a80 2024-09-19T08:46:13.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.099+0000 7f98e0a9b640 1 -- 172.21.15.7:0/182005217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98dc1a4fa0 con 0x7f98dc106a80 2024-09-19T08:46:13.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.100+0000 7f98e0a9b640 1 -- 172.21.15.7:0/182005217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98dc100ee0 con 0x7f98dc106a80 2024-09-19T08:46:13.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.101+0000 7f98cb7fe640 1 -- 172.21.15.7:0/182005217 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f98d40305a0 con 0x7f98dc106a80 2024-09-19T08:46:13.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.102+0000 7f98cb7fe640 1 --2- 172.21.15.7:0/182005217 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f98c40a33b0 0x7f98c40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:13.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.102+0000 7f98da59c640 1 --2- 172.21.15.7:0/182005217 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f98c40a33b0 0x7f98c40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:13.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.102+0000 7f98cb7fe640 1 -- 172.21.15.7:0/182005217 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f98d402e030 con 0x7f98dc106a80 2024-09-19T08:46:13.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.102+0000 7f98da59c640 1 --2- 172.21.15.7:0/182005217 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f98c40a33b0 0x7f98c40a5870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f98cc00bb60 tx=0x7f98cc00b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:13.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.106+0000 7f98cb7fe640 1 -- 172.21.15.7:0/182005217 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f98d404b060 con 0x7f98dc106a80 2024-09-19T08:46:13.147 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:46:13.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.340+0000 7f98e0a9b640 1 -- 172.21.15.7:0/182005217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98dc108ff0 con 0x7f98dc106a80 2024-09-19T08:46:13.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.340+0000 7f98cb7fe640 1 -- 172.21.15.7:0/182005217 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f98d40bde70 con 0x7f98dc106a80 2024-09-19T08:46:13.340 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:46:13.341 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:46:13.341 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:46:13.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.342+0000 7f98e0a9b640 1 -- 172.21.15.7:0/182005217 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f98c40a33b0 msgr2=0x7f98c40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:13.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.342+0000 7f98e0a9b640 1 --2- 172.21.15.7:0/182005217 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f98c40a33b0 0x7f98c40a5870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f98cc00bb60 tx=0x7f98cc00b390 comp rx=0 tx=0).stop 2024-09-19T08:46:13.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.342+0000 7f98e0a9b640 1 -- 172.21.15.7:0/182005217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98dc106a80 msgr2=0x7f98dc19ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:13.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.342+0000 7f98e0a9b640 1 --2- 172.21.15.7:0/182005217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98dc106a80 0x7f98dc19ccf0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f98d4005cc0 tx=0x7f98d4003970 comp rx=0 tx=0).stop 2024-09-19T08:46:13.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.342+0000 7f98e0a9b640 1 -- 172.21.15.7:0/182005217 shutdown_connections 2024-09-19T08:46:13.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.342+0000 7f98e0a9b640 1 --2- 172.21.15.7:0/182005217 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f98c40a33b0 0x7f98c40a5870 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:13.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.342+0000 7f98e0a9b640 1 --2- 172.21.15.7:0/182005217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98dc106a80 0x7f98dc19ccf0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:13.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.342+0000 7f98e0a9b640 1 --2- 172.21.15.7:0/182005217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98dc101420 0x7f98dc198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:13.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.342+0000 7f98e0a9b640 1 --2- 172.21.15.7:0/182005217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98dc100a80 0x7f98dc198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:13.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.342+0000 7f98e0a9b640 1 -- 172.21.15.7:0/182005217 >> 172.21.15.7:0/182005217 conn(0x7f98dc0fc7a0 msgr2=0x7f98dc0fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:13.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.342+0000 7f98e0a9b640 1 -- 172.21.15.7:0/182005217 shutdown_connections 2024-09-19T08:46:13.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:13.342+0000 7f98e0a9b640 1 -- 172.21.15.7:0/182005217 wait complete. 2024-09-19T08:46:13.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:13 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/182005217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:46:13.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:13 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/182005217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:46:13.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:13 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/182005217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:46:14.051 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24491 quiesce db --set-id 3f50ac2e --release --await' 2024-09-19T08:46:14.052 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24491 quiesce db --set-id 3f50ac2e --release --await 2024-09-19T08:46:14.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.295+0000 7f3cccf91640 1 -- 172.21.15.7:0/2322957941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cc8103660 msgr2=0x7f3cc810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:14.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.295+0000 7f3cccf91640 1 --2- 172.21.15.7:0/2322957941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cc8103660 0x7f3cc810bb50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009900 tx=0x7f3cb002a480 comp rx=0 tx=0).stop 2024-09-19T08:46:14.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.295+0000 7f3cccf91640 1 -- 172.21.15.7:0/2322957941 shutdown_connections 2024-09-19T08:46:14.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.295+0000 7f3cccf91640 1 --2- 172.21.15.7:0/2322957941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cc810c170 0x7f3cc810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.295+0000 7f3cccf91640 1 --2- 172.21.15.7:0/2322957941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cc8103660 0x7f3cc810bb50 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.295+0000 7f3cccf91640 1 --2- 172.21.15.7:0/2322957941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cc8102d40 0x7f3cc8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.295+0000 7f3cccf91640 1 -- 172.21.15.7:0/2322957941 >> 172.21.15.7:0/2322957941 conn(0x7f3cc80fc7a0 msgr2=0x7f3cc80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:14.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.295+0000 7f3cccf91640 1 -- 172.21.15.7:0/2322957941 shutdown_connections 2024-09-19T08:46:14.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.295+0000 7f3cccf91640 1 -- 172.21.15.7:0/2322957941 wait complete. 2024-09-19T08:46:14.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.296+0000 7f3cccf91640 1 Processor -- start 2024-09-19T08:46:14.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.296+0000 7f3cccf91640 1 -- start start 2024-09-19T08:46:14.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.297+0000 7f3cccf91640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cc8102d40 0x7f3cc819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:14.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.297+0000 7f3cccf91640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cc8103660 0x7f3cc819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:14.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.297+0000 7f3cccf91640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cc810c170 0x7f3cc819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:14.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.297+0000 7f3cccf91640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc8111f70 con 0x7f3cc810c170 2024-09-19T08:46:14.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.297+0000 7f3cccf91640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc8111df0 con 0x7f3cc8102d40 2024-09-19T08:46:14.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.297+0000 7f3cccf91640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc81120f0 con 0x7f3cc8103660 2024-09-19T08:46:14.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.297+0000 7f3cc6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cc810c170 0x7f3cc819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:14.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.297+0000 7f3cc659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cc8102d40 0x7f3cc819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:14.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.297+0000 7f3cc6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cc810c170 0x7f3cc819ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43404/0 (socket says 172.21.15.7:43404) 2024-09-19T08:46:14.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.297+0000 7f3cc659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cc8102d40 0x7f3cc819a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:46786/0 (socket says 172.21.15.7:46786) 2024-09-19T08:46:14.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.297+0000 7f3cc6d9d640 1 -- 172.21.15.7:0/355577621 learned_addr learned my addr 172.21.15.7:0/355577621 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:14.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.297+0000 7f3cbdd9b640 1 --2- 172.21.15.7:0/355577621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cc8103660 0x7f3cc819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:14.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.297+0000 7f3cc6d9d640 1 -- 172.21.15.7:0/355577621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cc8103660 msgr2=0x7f3cc819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:14.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.297+0000 7f3cc6d9d640 1 --2- 172.21.15.7:0/355577621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cc8103660 0x7f3cc819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.297+0000 7f3cc6d9d640 1 -- 172.21.15.7:0/355577621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cc8102d40 msgr2=0x7f3cc819a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:14.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.297+0000 7f3cc6d9d640 1 --2- 172.21.15.7:0/355577621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cc8102d40 0x7f3cc819a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.297+0000 7f3cc6d9d640 1 -- 172.21.15.7:0/355577621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc819f610 con 0x7f3cc810c170 2024-09-19T08:46:14.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.298+0000 7f3cc6d9d640 1 --2- 172.21.15.7:0/355577621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cc810c170 0x7f3cc819ef30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000eb10 tx=0x7f3cc000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:14.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.298+0000 7f3cbffff640 1 -- 172.21.15.7:0/355577621 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0004b20 con 0x7f3cc810c170 2024-09-19T08:46:14.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.298+0000 7f3cbffff640 1 -- 172.21.15.7:0/355577621 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cc0004cc0 con 0x7f3cc810c170 2024-09-19T08:46:14.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.298+0000 7f3cccf91640 1 -- 172.21.15.7:0/355577621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cc819f900 con 0x7f3cc810c170 2024-09-19T08:46:14.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.298+0000 7f3cbffff640 1 -- 172.21.15.7:0/355577621 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0010760 con 0x7f3cc810c170 2024-09-19T08:46:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.298+0000 7f3cccf91640 1 -- 172.21.15.7:0/355577621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cc81a71e0 con 0x7f3cc810c170 2024-09-19T08:46:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.300+0000 7f3cbffff640 1 -- 172.21.15.7:0/355577621 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f3cc0005020 con 0x7f3cc810c170 2024-09-19T08:46:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.301+0000 7f3ccf36a740 1 Processor -- start 2024-09-19T08:46:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.301+0000 7f3ccf36a740 1 -- start start 2024-09-19T08:46:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.301+0000 7f3ccf36a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55701bb12b60 0x55701bb12f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.301+0000 7f3ccf36a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb13480 0x55701bb1d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.301+0000 7f3ccf36a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55701bb1dd40 0x55701bb20130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.301+0000 7f3ccf36a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55701ba78280 con 0x55701bb13480 2024-09-19T08:46:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.301+0000 7f3ccf36a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55701ba1fb10 con 0x55701bb1dd40 2024-09-19T08:46:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.301+0000 7f3ccf36a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55701ba74240 con 0x55701bb12b60 2024-09-19T08:46:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.301+0000 7f3cc659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb13480 0x55701bb1d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.301+0000 7f3cc659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb13480 0x55701bb1d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43408/0 (socket says 172.21.15.7:43408) 2024-09-19T08:46:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.301+0000 7f3cc659c640 1 -- 172.21.15.7:0/1945862234 learned_addr learned my addr 172.21.15.7:0/1945862234 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.301+0000 7f3cbdd9b640 1 --2- 172.21.15.7:0/1945862234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55701bb1dd40 0x55701bb20130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.302+0000 7f3cbdd9b640 1 --2- 172.21.15.7:0/1945862234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55701bb12b60 0x55701bb12f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.302+0000 7f3cc659c640 1 -- 172.21.15.7:0/1945862234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55701bb12b60 msgr2=0x55701bb12f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.302+0000 7f3cc659c640 1 --2- 172.21.15.7:0/1945862234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55701bb12b60 0x55701bb12f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.302+0000 7f3cc659c640 1 -- 172.21.15.7:0/1945862234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55701bb1dd40 msgr2=0x55701bb20130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.302+0000 7f3cc659c640 1 --2- 172.21.15.7:0/1945862234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55701bb1dd40 0x55701bb20130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.302+0000 7f3cc659c640 1 -- 172.21.15.7:0/1945862234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55701ba2c1f0 con 0x55701bb13480 2024-09-19T08:46:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.302+0000 7f3cbffff640 1 --2- 172.21.15.7:0/355577621 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3cb40a3430 0x7f3cb40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.302+0000 7f3cbdd9b640 1 --2- 172.21.15.7:0/355577621 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3cb40a3430 0x7f3cb40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.302+0000 7f3cbffff640 1 -- 172.21.15.7:0/355577621 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f3cc00d02e0 con 0x7f3cc810c170 2024-09-19T08:46:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.302+0000 7f3cc659c640 1 --2- 172.21.15.7:0/1945862234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb13480 0x55701bb1d800 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800bd10 tx=0x7f3cb80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87b16016fda7f11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.302+0000 7f3cbcd99640 1 -- 172.21.15.7:0/1945862234 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8004030 con 0x55701bb13480 2024-09-19T08:46:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.302+0000 7f3cbcd99640 1 -- 172.21.15.7:0/1945862234 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cb80041d0 con 0x55701bb13480 2024-09-19T08:46:14.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.302+0000 7f3cbcd99640 1 -- 172.21.15.7:0/1945862234 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8011730 con 0x55701bb13480 2024-09-19T08:46:14.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.303+0000 7f3ccf36a740 1 -- 172.21.15.7:0/1945862234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb13480 msgr2=0x55701bb1d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:14.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.303+0000 7f3ccf36a740 1 --2- 172.21.15.7:0/1945862234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb13480 0x55701bb1d800 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800bd10 tx=0x7f3cb80107a0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.303+0000 7f3cbdd9b640 1 --2- 172.21.15.7:0/355577621 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3cb40a3430 0x7f3cb40a58f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009230 tx=0x7f3cb0041040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:14.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.303+0000 7f3ccf36a740 1 -- 172.21.15.7:0/1945862234 shutdown_connections 2024-09-19T08:46:14.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.303+0000 7f3ccf36a740 1 --2- 172.21.15.7:0/1945862234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55701bb1dd40 0x55701bb20130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.303+0000 7f3ccf36a740 1 --2- 172.21.15.7:0/1945862234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb13480 0x55701bb1d800 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.303+0000 7f3ccf36a740 1 --2- 172.21.15.7:0/1945862234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55701bb12b60 0x55701bb12f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.303+0000 7f3ccf36a740 1 -- 172.21.15.7:0/1945862234 >> 172.21.15.7:0/1945862234 conn(0x55701bb0f0f0 msgr2=0x55701bb0f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:14.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.303+0000 7f3ccf36a740 1 -- 172.21.15.7:0/1945862234 shutdown_connections 2024-09-19T08:46:14.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.303+0000 7f3ccf36a740 1 -- 172.21.15.7:0/1945862234 wait complete. 2024-09-19T08:46:14.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.304+0000 7f3ccf36a740 1 -- start start 2024-09-19T08:46:14.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.304+0000 7f3ccf36a740 1 Processor -- start 2024-09-19T08:46:14.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.304+0000 7f3ccf36a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb12b60 0x55701bb1adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:14.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.304+0000 7f3ccf36a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55701bb1dd40 0x55701bb1b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:14.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.304+0000 7f3ccf36a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55701bb1b840 0x55701bb29d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:14.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.304+0000 7f3ccf36a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55701bb20910 con 0x55701bb12b60 2024-09-19T08:46:14.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.304+0000 7f3ccf36a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55701ba32f10 con 0x55701bb1dd40 2024-09-19T08:46:14.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.304+0000 7f3ccf36a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55701bb20a90 con 0x55701bb1b840 2024-09-19T08:46:14.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.304+0000 7f3ccf36a740 10 client.0 _ll_register_callbacks cb 0x55701b9fba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:14.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.304+0000 7f3cc659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb12b60 0x55701bb1adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:14.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.304+0000 7f3cc6d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55701bb1b840 0x55701bb29d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:14.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.305+0000 7f3cc6d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55701bb1b840 0x55701bb29d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.7:53098/0 (socket says 172.21.15.7:53098) 2024-09-19T08:46:14.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.305+0000 7f3cc6d9d640 1 -- 172.21.15.7:0/3629768408 learned_addr learned my addr 172.21.15.7:0/3629768408 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:14.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.305+0000 7f3cbdd9b640 1 --2- 172.21.15.7:0/3629768408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55701bb1dd40 0x55701bb1b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:14.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.305+0000 7f3cc6d9d640 1 -- 172.21.15.7:0/3629768408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55701bb1dd40 msgr2=0x55701bb1b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:14.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.305+0000 7f3cc6d9d640 1 --2- 172.21.15.7:0/3629768408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55701bb1dd40 0x55701bb1b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.305+0000 7f3cc6d9d640 1 -- 172.21.15.7:0/3629768408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb12b60 msgr2=0x55701bb1adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:14.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.305+0000 7f3cc6d9d640 1 --2- 172.21.15.7:0/3629768408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb12b60 0x55701bb1adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.305+0000 7f3cc6d9d640 1 -- 172.21.15.7:0/3629768408 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55701b7e96a0 con 0x55701bb1b840 2024-09-19T08:46:14.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.305+0000 7f3cbdd9b640 1 --2- 172.21.15.7:0/3629768408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55701bb1dd40 0x55701bb1b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:14.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.305+0000 7f3cc6d9d640 1 --2- 172.21.15.7:0/3629768408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55701bb1b840 0x55701bb29d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3cc00a4cf0 tx=0x7f3cc009c0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e729bfff2f54bbf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:14.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.305+0000 7f3cadffb640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-19T08:46:14.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.305+0000 7f3cadffb640 1 -- 172.21.15.7:0/3629768408 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc00cf070 con 0x55701bb1b840 2024-09-19T08:46:14.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.305+0000 7f3ccf36a740 1 -- 172.21.15.7:0/3629768408 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cb80041d0 con 0x55701bb1b840 2024-09-19T08:46:14.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.305+0000 7f3cadffb640 1 -- 172.21.15.7:0/3629768408 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f3cc0005510 con 0x55701bb1b840 2024-09-19T08:46:14.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.306+0000 7f3cadffb640 1 -- 172.21.15.7:0/3629768408 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3cc009c5b0 con 0x55701bb1b840 2024-09-19T08:46:14.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.306+0000 7f3ccf36a740 10 client.25273 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:14.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.306+0000 7f3ccf36a740 1 -- 172.21.15.7:0/3629768408 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55701bb2cb20 con 0x55701bb1b840 2024-09-19T08:46:14.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.306+0000 7f3cadffb640 1 -- 172.21.15.7:0/3629768408 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cb80041d0 con 0x55701bb1b840 2024-09-19T08:46:14.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.306+0000 7f3cadffb640 1 -- 172.21.15.7:0/3629768408 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3cc00b0ad0 con 0x55701bb1b840 2024-09-19T08:46:14.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.306+0000 7f3ccf36a740 10 client.25273 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.306+0000 7f3ccf36a740 10 client.25273 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.306+0000 7f3ccf36a740 20 client.25273 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.306+0000 7f3ccf36a740 1 --2- 172.21.15.7:0/3629768408 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55701bb2dfe0 0x55701bb30450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.306+0000 7f3ccf36a740 4 client.25273 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:46:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.306+0000 7f3ccf36a740 1 -- 172.21.15.7:0/3629768408 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55701ba857f0 con 0x55701bb2dfe0 2024-09-19T08:46:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.306+0000 7f3cc659c640 1 --2- 172.21.15.7:0/3629768408 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55701bb2dfe0 0x55701bb30450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.307+0000 7f3cadffb640 10 client.25273 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.307+0000 7f3cc659c640 1 --2- 172.21.15.7:0/3629768408 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55701bb2dfe0 0x55701bb30450 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6f7674ebd64b6d4 server_cookie=92b14d94a1f5cc70 in_seq=0 out_seq=0 2024-09-19T08:46:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.307+0000 7f3cadffb640 1 -- 172.21.15.7:0/3629768408 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55701ba857f0 con 0x55701bb2dfe0 2024-09-19T08:46:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.307+0000 7f3cadffb640 10 client.25273 handle_command_reply: tid=0 2024-09-19T08:46:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.308+0000 7f3ccf36a740 1 client.25273 shutdown 2024-09-19T08:46:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.308+0000 7f3ccf36a740 1 -- 172.21.15.7:0/3629768408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55701bb1b840 msgr2=0x55701bb29d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.308+0000 7f3ccf36a740 1 --2- 172.21.15.7:0/3629768408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55701bb1b840 0x55701bb29d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3cc00a4cf0 tx=0x7f3cc009c0f0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.308+0000 7f3ccf36a740 1 -- 172.21.15.7:0/3629768408 shutdown_connections 2024-09-19T08:46:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.308+0000 7f3ccf36a740 1 --2- 172.21.15.7:0/3629768408 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55701bb2dfe0 0x55701bb30450 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.308+0000 7f3ccf36a740 1 --2- 172.21.15.7:0/3629768408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55701bb1b840 0x55701bb29d80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.308+0000 7f3ccf36a740 1 --2- 172.21.15.7:0/3629768408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55701bb1dd40 0x55701bb1b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.308+0000 7f3cadffb640 0 client.25273 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.308+0000 7f3ccf36a740 1 --2- 172.21.15.7:0/3629768408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb12b60 0x55701bb1adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.308+0000 7f3ccf36a740 1 -- 172.21.15.7:0/3629768408 >> 172.21.15.7:0/3629768408 conn(0x55701bb0f0f0 msgr2=0x55701bb0e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.308+0000 7f3ccf36a740 1 -- 172.21.15.7:0/3629768408 shutdown_connections 2024-09-19T08:46:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.308+0000 7f3ccf36a740 1 -- 172.21.15.7:0/3629768408 wait complete. 2024-09-19T08:46:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.308+0000 7f3ccf36a740 20 client.25273 trim_cache size 0 max 16384 2024-09-19T08:46:14.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.328+0000 7f3ccf36a740 1 Processor -- start 2024-09-19T08:46:14.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.328+0000 7f3ccf36a740 1 -- start start 2024-09-19T08:46:14.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.328+0000 7f3ccf36a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55701bb12b60 0x55701bb29b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:14.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.328+0000 7f3ccf36a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb1b840 0x55701bb35d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:14.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.328+0000 7f3ccf36a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55701bb1dd40 0x55701bb36290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:14.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.328+0000 7f3ccf36a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc81b23c0 con 0x55701bb1b840 2024-09-19T08:46:14.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.328+0000 7f3ccf36a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc81afc90 con 0x55701bb1dd40 2024-09-19T08:46:14.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.328+0000 7f3ccf36a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc81adae0 con 0x55701bb12b60 2024-09-19T08:46:14.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.328+0000 7f3cbdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb1b840 0x55701bb35d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:14.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.328+0000 7f3cbdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb1b840 0x55701bb35d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43424/0 (socket says 172.21.15.7:43424) 2024-09-19T08:46:14.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.328+0000 7f3cbdd9b640 1 -- 172.21.15.7:0/3738879636 learned_addr learned my addr 172.21.15.7:0/3738879636 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:14.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.328+0000 7f3cc6d9d640 1 --2- 172.21.15.7:0/3738879636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55701bb1dd40 0x55701bb36290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:14.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.328+0000 7f3cc659c640 1 --2- 172.21.15.7:0/3738879636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55701bb12b60 0x55701bb29b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:14.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.329+0000 7f3cbdd9b640 1 -- 172.21.15.7:0/3738879636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55701bb12b60 msgr2=0x55701bb29b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:14.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.329+0000 7f3cbdd9b640 1 --2- 172.21.15.7:0/3738879636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55701bb12b60 0x55701bb29b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.329+0000 7f3cbdd9b640 1 -- 172.21.15.7:0/3738879636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55701bb1dd40 msgr2=0x55701bb36290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:14.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.329+0000 7f3cbdd9b640 1 --2- 172.21.15.7:0/3738879636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55701bb1dd40 0x55701bb36290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.329+0000 7f3cbdd9b640 1 -- 172.21.15.7:0/3738879636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55701bb2a0b0 con 0x55701bb1b840 2024-09-19T08:46:14.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.329+0000 7f3cbdd9b640 1 --2- 172.21.15.7:0/3738879636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb1b840 0x55701bb35d50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3cb002a9a0 tx=0x7f3cb00058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0aaa61c8457efdb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:14.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.329+0000 7f3caffff640 1 -- 172.21.15.7:0/3738879636 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb00037f0 con 0x55701bb1b840 2024-09-19T08:46:14.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.329+0000 7f3caffff640 1 -- 172.21.15.7:0/3738879636 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cb0052070 con 0x55701bb1b840 2024-09-19T08:46:14.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.329+0000 7f3caffff640 1 -- 172.21.15.7:0/3738879636 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb003dc50 con 0x55701bb1b840 2024-09-19T08:46:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.330+0000 7f3ccf36a740 1 -- 172.21.15.7:0/3738879636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb1b840 msgr2=0x55701bb35d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.330+0000 7f3ccf36a740 1 --2- 172.21.15.7:0/3738879636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb1b840 0x55701bb35d50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3cb002a9a0 tx=0x7f3cb00058d0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.330+0000 7f3ccf36a740 1 -- 172.21.15.7:0/3738879636 shutdown_connections 2024-09-19T08:46:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.330+0000 7f3ccf36a740 1 --2- 172.21.15.7:0/3738879636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55701bb1dd40 0x55701bb36290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.330+0000 7f3ccf36a740 1 --2- 172.21.15.7:0/3738879636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb1b840 0x55701bb35d50 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.330+0000 7f3ccf36a740 1 --2- 172.21.15.7:0/3738879636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55701bb12b60 0x55701bb29b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.330+0000 7f3ccf36a740 1 -- 172.21.15.7:0/3738879636 >> 172.21.15.7:0/3738879636 conn(0x55701bb0f0f0 msgr2=0x55701bb19690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.330+0000 7f3ccf36a740 1 -- 172.21.15.7:0/3738879636 shutdown_connections 2024-09-19T08:46:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.330+0000 7f3ccf36a740 1 -- 172.21.15.7:0/3738879636 wait complete. 2024-09-19T08:46:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.330+0000 7f3ccf36a740 1 -- start start 2024-09-19T08:46:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.330+0000 7f3ccf36a740 1 Processor -- start 2024-09-19T08:46:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.331+0000 7f3ccf36a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55701bb12b60 0x55701bb21a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.331+0000 7f3ccf36a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55701bb1b840 0x55701bb21f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.331+0000 7f3ccf36a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb1dd40 0x55701bb224d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.331+0000 7f3ccf36a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc81ae150 con 0x55701bb1dd40 2024-09-19T08:46:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.331+0000 7f3ccf36a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc81af5c0 con 0x55701bb1b840 2024-09-19T08:46:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.331+0000 7f3ccf36a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc81ae820 con 0x55701bb12b60 2024-09-19T08:46:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.331+0000 7f3ccf36a740 10 client.0 _ll_register_callbacks cb 0x7f3cc0098850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.331+0000 7f3cc6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb1dd40 0x55701bb224d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.331+0000 7f3cc659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55701bb12b60 0x55701bb21a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.331+0000 7f3cc6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb1dd40 0x55701bb224d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43440/0 (socket says 172.21.15.7:43440) 2024-09-19T08:46:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.331+0000 7f3cc6d9d640 1 -- 172.21.15.7:0/3118522792 learned_addr learned my addr 172.21.15.7:0/3118522792 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.331+0000 7f3cbdd9b640 1 --2- 172.21.15.7:0/3118522792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55701bb1b840 0x55701bb21f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.331+0000 7f3cc6d9d640 1 -- 172.21.15.7:0/3118522792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55701bb12b60 msgr2=0x55701bb21a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.331+0000 7f3cc6d9d640 1 --2- 172.21.15.7:0/3118522792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55701bb12b60 0x55701bb21a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.331+0000 7f3cc6d9d640 1 -- 172.21.15.7:0/3118522792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55701bb1b840 msgr2=0x55701bb21f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.331+0000 7f3cc6d9d640 1 --2- 172.21.15.7:0/3118522792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55701bb1b840 0x55701bb21f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.331+0000 7f3cc6d9d640 1 -- 172.21.15.7:0/3118522792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55701bb97d50 con 0x55701bb1dd40 2024-09-19T08:46:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.332+0000 7f3cc6d9d640 1 --2- 172.21.15.7:0/3118522792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb1dd40 0x55701bb224d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3cc00b0e40 tx=0x7f3cc009bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805678eb58e1841d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.332+0000 7f3cadffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.332+0000 7f3cadffb640 1 -- 172.21.15.7:0/3118522792 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc00cf070 con 0x55701bb1dd40 2024-09-19T08:46:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.332+0000 7f3cadffb640 1 -- 172.21.15.7:0/3118522792 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f3cc0098300 con 0x55701bb1dd40 2024-09-19T08:46:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.332+0000 7f3ccf36a740 1 -- 172.21.15.7:0/3118522792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cb0052070 con 0x55701bb1dd40 2024-09-19T08:46:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.332+0000 7f3cadffb640 1 -- 172.21.15.7:0/3118522792 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3cc009bf10 con 0x55701bb1dd40 2024-09-19T08:46:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.332+0000 7f3ccf36a740 10 client.15708 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:14.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.332+0000 7f3ccf36a740 1 -- 172.21.15.7:0/3118522792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55701bb99050 con 0x55701bb1dd40 2024-09-19T08:46:14.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.332+0000 7f3cadffb640 1 -- 172.21.15.7:0/3118522792 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cb0052070 con 0x55701bb1dd40 2024-09-19T08:46:14.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.333+0000 7f3cadffb640 1 -- 172.21.15.7:0/3118522792 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3cc0098500 con 0x55701bb1dd40 2024-09-19T08:46:14.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.333+0000 7f3ccf36a740 10 client.15708 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:14.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.333+0000 7f3ccf36a740 10 client.15708 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:14.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.333+0000 7f3ccf36a740 20 client.15708 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:14.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.333+0000 7f3ccf36a740 1 --2- 172.21.15.7:0/3118522792 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55701bb2dfe0 0x55701bb9b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:14.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.333+0000 7f3ccf36a740 4 client.15708 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:46:14.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.333+0000 7f3ccf36a740 1 -- 172.21.15.7:0/3118522792 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55701ba7fd00 con 0x55701bb2dfe0 2024-09-19T08:46:14.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.333+0000 7f3cc659c640 1 --2- 172.21.15.7:0/3118522792 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55701bb2dfe0 0x55701bb9b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:14.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.333+0000 7f3cc659c640 1 --2- 172.21.15.7:0/3118522792 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55701bb2dfe0 0x55701bb9b780 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe7e238c1cae172 server_cookie=c4c03a913d8c7b38 in_seq=0 out_seq=0 2024-09-19T08:46:14.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.333+0000 7f3cadffb640 10 client.15708 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.334+0000 7f3cadffb640 1 -- 172.21.15.7:0/3118522792 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55701ba7fd00 con 0x55701bb2dfe0 2024-09-19T08:46:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.334+0000 7f3cadffb640 10 client.15708 handle_command_reply: tid=0 2024-09-19T08:46:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.334+0000 7f3ccf36a740 1 client.15708 shutdown 2024-09-19T08:46:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.335+0000 7f3ccf36a740 1 -- 172.21.15.7:0/3118522792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb1dd40 msgr2=0x55701bb224d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.335+0000 7f3ccf36a740 1 --2- 172.21.15.7:0/3118522792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb1dd40 0x55701bb224d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3cc00b0e40 tx=0x7f3cc009bc30 comp rx=0 tx=0).stop 2024-09-19T08:46:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.335+0000 7f3ccf36a740 1 -- 172.21.15.7:0/3118522792 shutdown_connections 2024-09-19T08:46:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.335+0000 7f3ccf36a740 1 --2- 172.21.15.7:0/3118522792 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55701bb2dfe0 0x55701bb9b780 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.335+0000 7f3ccf36a740 1 --2- 172.21.15.7:0/3118522792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701bb1dd40 0x55701bb224d0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.335+0000 7f3ccf36a740 1 --2- 172.21.15.7:0/3118522792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55701bb1b840 0x55701bb21f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.335+0000 7f3ccf36a740 1 --2- 172.21.15.7:0/3118522792 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55701bb12b60 0x55701bb21a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.335+0000 7f3ccf36a740 1 -- 172.21.15.7:0/3118522792 >> 172.21.15.7:0/3118522792 conn(0x55701bb0f0f0 msgr2=0x55701bb145b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:14.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.335+0000 7f3cadffb640 0 client.15708 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:14.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.335+0000 7f3ccf36a740 1 -- 172.21.15.7:0/3118522792 shutdown_connections 2024-09-19T08:46:14.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.335+0000 7f3ccf36a740 1 -- 172.21.15.7:0/3118522792 wait complete. 2024-09-19T08:46:14.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.335+0000 7f3ccf36a740 20 client.15708 trim_cache size 0 max 16384 2024-09-19T08:46:14.339 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:46:14.339 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-19T08:46:14.339 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "314e2cdd-b9c4-42b0-954f-35b9e357d703", 2024-09-19T08:46:14.339 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-19T08:46:14.340 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:46:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.336+0000 7f3cccf91640 1 -- 172.21.15.7:0/355577621 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3cb40a3430 msgr2=0x7f3cb40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.336+0000 7f3cccf91640 1 --2- 172.21.15.7:0/355577621 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3cb40a3430 0x7f3cb40a58f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009230 tx=0x7f3cb0041040 comp rx=0 tx=0).stop 2024-09-19T08:46:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.336+0000 7f3cccf91640 1 -- 172.21.15.7:0/355577621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cc810c170 msgr2=0x7f3cc819ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.336+0000 7f3cccf91640 1 --2- 172.21.15.7:0/355577621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cc810c170 0x7f3cc819ef30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000eb10 tx=0x7f3cc000c2d0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.336+0000 7f3cccf91640 1 -- 172.21.15.7:0/355577621 shutdown_connections 2024-09-19T08:46:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.336+0000 7f3cccf91640 1 --2- 172.21.15.7:0/355577621 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3cb40a3430 0x7f3cb40a58f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.336+0000 7f3cccf91640 1 --2- 172.21.15.7:0/355577621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cc810c170 0x7f3cc819ef30 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.336+0000 7f3cccf91640 1 --2- 172.21.15.7:0/355577621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cc8103660 0x7f3cc819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.336+0000 7f3cccf91640 1 --2- 172.21.15.7:0/355577621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cc8102d40 0x7f3cc819a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.336+0000 7f3cccf91640 1 -- 172.21.15.7:0/355577621 >> 172.21.15.7:0/355577621 conn(0x7f3cc80fc7a0 msgr2=0x7f3cc810d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.336+0000 7f3cccf91640 1 -- 172.21.15.7:0/355577621 shutdown_connections 2024-09-19T08:46:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:14.336+0000 7f3cccf91640 1 -- 172.21.15.7:0/355577621 wait complete. 2024-09-19T08:46:14.544 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:46:14.659 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:14 smithi007 ceph-mon[31221]: pgmap v54: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-19T08:46:14.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:14 smithi175 ceph-mon[35688]: pgmap v54: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-19T08:46:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:14 smithi044 ceph-mon[35072]: pgmap v54: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-19T08:46:15.066 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:46:15.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.521+0000 7f6b97378640 1 -- 172.21.15.7:0/469489932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b90102ef0 msgr2=0x7f6b9010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:15.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.521+0000 7f6b97378640 1 --2- 172.21.15.7:0/469489932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b90102ef0 0x7f6b9010da40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6b88009ca0 tx=0x7f6b8802a950 comp rx=0 tx=0).stop 2024-09-19T08:46:15.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.521+0000 7f6b97378640 1 -- 172.21.15.7:0/469489932 shutdown_connections 2024-09-19T08:46:15.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.521+0000 7f6b97378640 1 --2- 172.21.15.7:0/469489932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b90102ef0 0x7f6b9010da40 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.521+0000 7f6b97378640 1 --2- 172.21.15.7:0/469489932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b90102570 0x7f6b901029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.521+0000 7f6b97378640 1 --2- 172.21.15.7:0/469489932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b90100e20 0x7f6b90101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.521+0000 7f6b97378640 1 -- 172.21.15.7:0/469489932 >> 172.21.15.7:0/469489932 conn(0x7f6b900fc7d0 msgr2=0x7f6b900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:15.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.521+0000 7f6b97378640 1 -- 172.21.15.7:0/469489932 shutdown_connections 2024-09-19T08:46:15.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.521+0000 7f6b97378640 1 -- 172.21.15.7:0/469489932 wait complete. 2024-09-19T08:46:15.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.522+0000 7f6b97378640 1 Processor -- start 2024-09-19T08:46:15.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.522+0000 7f6b97378640 1 -- start start 2024-09-19T08:46:15.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.522+0000 7f6b97378640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b90100e20 0x7f6b90199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:15.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.522+0000 7f6b97378640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b90102570 0x7f6b90199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:15.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.522+0000 7f6b97378640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b90102ef0 0x7f6b90199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:15.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.522+0000 7f6b97378640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6b90110f80 con 0x7f6b90100e20 2024-09-19T08:46:15.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.522+0000 7f6b97378640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6b90110e00 con 0x7f6b90102ef0 2024-09-19T08:46:15.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.522+0000 7f6b97378640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6b90111100 con 0x7f6b90102570 2024-09-19T08:46:15.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.523+0000 7f6b95114640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b90100e20 0x7f6b90199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:15.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.523+0000 7f6b95114640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b90100e20 0x7f6b90199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43468/0 (socket says 172.21.15.7:43468) 2024-09-19T08:46:15.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.523+0000 7f6b95114640 1 -- 172.21.15.7:0/2145191671 learned_addr learned my addr 172.21.15.7:0/2145191671 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:15.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.523+0000 7f6b94913640 1 --2- 172.21.15.7:0/2145191671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b90102570 0x7f6b90199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:15.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.523+0000 7f6b95915640 1 --2- 172.21.15.7:0/2145191671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b90102ef0 0x7f6b90199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:15.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.523+0000 7f6b95114640 1 -- 172.21.15.7:0/2145191671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b90102570 msgr2=0x7f6b90199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:15.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.523+0000 7f6b95114640 1 --2- 172.21.15.7:0/2145191671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b90102570 0x7f6b90199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.523+0000 7f6b95114640 1 -- 172.21.15.7:0/2145191671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b90102ef0 msgr2=0x7f6b90199df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:15.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.523+0000 7f6b95114640 1 --2- 172.21.15.7:0/2145191671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b90102ef0 0x7f6b90199df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.523+0000 7f6b95114640 1 -- 172.21.15.7:0/2145191671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b901a4730 con 0x7f6b90100e20 2024-09-19T08:46:15.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.523+0000 7f6b94913640 1 --2- 172.21.15.7:0/2145191671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b90102570 0x7f6b90199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:15.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.523+0000 7f6b95114640 1 --2- 172.21.15.7:0/2145191671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b90100e20 0x7f6b90199330 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00d950 tx=0x7f6b8c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:15.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.523+0000 7f6b867fc640 1 -- 172.21.15.7:0/2145191671 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c017030 con 0x7f6b90100e20 2024-09-19T08:46:15.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.523+0000 7f6b97378640 1 -- 172.21.15.7:0/2145191671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b901a4a20 con 0x7f6b90100e20 2024-09-19T08:46:15.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.523+0000 7f6b867fc640 1 -- 172.21.15.7:0/2145191671 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b8c004020 con 0x7f6b90100e20 2024-09-19T08:46:15.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.523+0000 7f6b867fc640 1 -- 172.21.15.7:0/2145191671 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c0047a0 con 0x7f6b90100e20 2024-09-19T08:46:15.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.524+0000 7f6b97378640 1 -- 172.21.15.7:0/2145191671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b901a4fb0 con 0x7f6b90100e20 2024-09-19T08:46:15.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.526+0000 7f6b867fc640 1 -- 172.21.15.7:0/2145191671 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f6b8c0041d0 con 0x7f6b90100e20 2024-09-19T08:46:15.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.527+0000 7f6b99751740 1 Processor -- start 2024-09-19T08:46:15.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.527+0000 7f6b99751740 1 -- start start 2024-09-19T08:46:15.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.527+0000 7f6b99751740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90431f20 0x55ca90432300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:15.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.527+0000 7f6b99751740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ca90432840 0x55ca90441110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:15.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.527+0000 7f6b99751740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90441650 0x55ca90443a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.527+0000 7f6b99751740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ca90397620 con 0x55ca90431f20 2024-09-19T08:46:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.527+0000 7f6b99751740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ca9033ee50 con 0x55ca90432840 2024-09-19T08:46:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.527+0000 7f6b99751740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ca903935e0 con 0x55ca90441650 2024-09-19T08:46:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.527+0000 7f6b95915640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90431f20 0x55ca90432300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.528+0000 7f6b95915640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90431f20 0x55ca90432300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43478/0 (socket says 172.21.15.7:43478) 2024-09-19T08:46:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.528+0000 7f6b95915640 1 -- 172.21.15.7:0/1983644331 learned_addr learned my addr 172.21.15.7:0/1983644331 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.528+0000 7f6b867fc640 1 --2- 172.21.15.7:0/2145191671 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6b7c0a33b0 0x7f6b7c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.528+0000 7f6b94913640 1 --2- 172.21.15.7:0/1983644331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90441650 0x55ca90443a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.528+0000 7f6b95114640 1 --2- 172.21.15.7:0/1983644331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ca90432840 0x55ca90441110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:15.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.528+0000 7f6b867fc640 1 -- 172.21.15.7:0/2145191671 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f6b8c0cf7c0 con 0x7f6b90100e20 2024-09-19T08:46:15.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.528+0000 7f6b95915640 1 -- 172.21.15.7:0/1983644331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90441650 msgr2=0x55ca90443a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:15.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.528+0000 7f6b95915640 1 --2- 172.21.15.7:0/1983644331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90441650 0x55ca90443a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.528+0000 7f6b95915640 1 -- 172.21.15.7:0/1983644331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ca90432840 msgr2=0x55ca90441110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:15.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.528+0000 7f6b95915640 1 --2- 172.21.15.7:0/1983644331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ca90432840 0x55ca90441110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.528+0000 7f6b95915640 1 -- 172.21.15.7:0/1983644331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca9032fd40 con 0x55ca90431f20 2024-09-19T08:46:15.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.528+0000 7f6b95915640 1 --2- 172.21.15.7:0/1983644331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90431f20 0x55ca90432300 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6b88035000 tx=0x7f6b88009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37dc336853f6124e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:15.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.528+0000 7f6b95915640 1 --2- 172.21.15.7:0/2145191671 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6b7c0a33b0 0x7f6b7c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:15.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.529+0000 7f6b7b7fe640 1 -- 172.21.15.7:0/1983644331 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88049040 con 0x55ca90431f20 2024-09-19T08:46:15.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.529+0000 7f6b7b7fe640 1 -- 172.21.15.7:0/1983644331 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b88003e50 con 0x55ca90431f20 2024-09-19T08:46:15.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.529+0000 7f6b7b7fe640 1 -- 172.21.15.7:0/1983644331 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88034040 con 0x55ca90431f20 2024-09-19T08:46:15.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.529+0000 7f6b99751740 1 -- 172.21.15.7:0/1983644331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90431f20 msgr2=0x55ca90432300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:15.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.529+0000 7f6b95915640 1 --2- 172.21.15.7:0/2145191671 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6b7c0a33b0 0x7f6b7c0a5870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6b88030040 tx=0x7f6b88044500 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:15.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.529+0000 7f6b99751740 1 --2- 172.21.15.7:0/1983644331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90431f20 0x55ca90432300 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6b88035000 tx=0x7f6b88009800 comp rx=0 tx=0).stop 2024-09-19T08:46:15.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.529+0000 7f6b99751740 1 -- 172.21.15.7:0/1983644331 shutdown_connections 2024-09-19T08:46:15.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.529+0000 7f6b99751740 1 --2- 172.21.15.7:0/1983644331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90441650 0x55ca90443a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.529+0000 7f6b99751740 1 --2- 172.21.15.7:0/1983644331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ca90432840 0x55ca90441110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.529+0000 7f6b99751740 1 --2- 172.21.15.7:0/1983644331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90431f20 0x55ca90432300 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.529+0000 7f6b99751740 1 -- 172.21.15.7:0/1983644331 >> 172.21.15.7:0/1983644331 conn(0x55ca9042e5f0 msgr2=0x55ca9042e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:15.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.530+0000 7f6b99751740 1 -- 172.21.15.7:0/1983644331 shutdown_connections 2024-09-19T08:46:15.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.530+0000 7f6b99751740 1 -- 172.21.15.7:0/1983644331 wait complete. 2024-09-19T08:46:15.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.530+0000 7f6b99751740 1 -- start start 2024-09-19T08:46:15.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.530+0000 7f6b99751740 1 Processor -- start 2024-09-19T08:46:15.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.531+0000 7f6b99751740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90431f20 0x55ca9043e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:15.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.531+0000 7f6b99751740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90432840 0x55ca9043ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:15.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.531+0000 7f6b99751740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ca90441650 0x55ca9043efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:15.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.531+0000 7f6b99751740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ca904441c0 con 0x55ca90432840 2024-09-19T08:46:15.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.531+0000 7f6b99751740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ca9031ff10 con 0x55ca90441650 2024-09-19T08:46:15.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.531+0000 7f6b99751740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ca90444340 con 0x55ca90431f20 2024-09-19T08:46:15.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.531+0000 7f6b99751740 10 client.0 _ll_register_callbacks cb 0x55ca90343db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:15.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.531+0000 7f6b94913640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90432840 0x55ca9043ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:15.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.531+0000 7f6b94913640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90432840 0x55ca9043ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43492/0 (socket says 172.21.15.7:43492) 2024-09-19T08:46:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.531+0000 7f6b94913640 1 -- 172.21.15.7:0/1098494384 learned_addr learned my addr 172.21.15.7:0/1098494384 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.531+0000 7f6b95114640 1 --2- 172.21.15.7:0/1098494384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90431f20 0x55ca9043e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.531+0000 7f6b95915640 1 --2- 172.21.15.7:0/1098494384 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ca90441650 0x55ca9043efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.531+0000 7f6b95114640 1 -- 172.21.15.7:0/1098494384 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ca90441650 msgr2=0x55ca9043efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.531+0000 7f6b95114640 1 --2- 172.21.15.7:0/1098494384 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ca90441650 0x55ca9043efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.531+0000 7f6b95114640 1 -- 172.21.15.7:0/1098494384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90432840 msgr2=0x55ca9043ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.531+0000 7f6b95114640 1 --2- 172.21.15.7:0/1098494384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90432840 0x55ca9043ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.531+0000 7f6b95114640 1 -- 172.21.15.7:0/1098494384 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca900a6580 con 0x55ca90431f20 2024-09-19T08:46:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.531+0000 7f6b94913640 1 --2- 172.21.15.7:0/1098494384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90432840 0x55ca9043ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.532+0000 7f6b95114640 1 --2- 172.21.15.7:0/1098494384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90431f20 0x55ca9043e550 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0cced0 tx=0x7f6b8c06b6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2479406817027ec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.532+0000 7f6b78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-19T08:46:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.532+0000 7f6b78ff9640 1 -- 172.21.15.7:0/1098494384 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c0668e0 con 0x55ca90431f20 2024-09-19T08:46:15.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.532+0000 7f6b78ff9640 1 -- 172.21.15.7:0/1098494384 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f6b8c0860b0 con 0x55ca90431f20 2024-09-19T08:46:15.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.532+0000 7f6b99751740 1 -- 172.21.15.7:0/1098494384 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b88003e50 con 0x55ca90431f20 2024-09-19T08:46:15.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.532+0000 7f6b78ff9640 1 -- 172.21.15.7:0/1098494384 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6b8c09c190 con 0x55ca90431f20 2024-09-19T08:46:15.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.532+0000 7f6b99751740 10 client.25291 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:15.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.532+0000 7f6b99751740 1 -- 172.21.15.7:0/1098494384 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ca90170960 con 0x55ca90431f20 2024-09-19T08:46:15.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.532+0000 7f6b78ff9640 1 -- 172.21.15.7:0/1098494384 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b8c09ba90 con 0x55ca90431f20 2024-09-19T08:46:15.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.532+0000 7f6b78ff9640 1 -- 172.21.15.7:0/1098494384 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6b8c066b70 con 0x55ca90431f20 2024-09-19T08:46:15.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.533+0000 7f6b99751740 10 client.25291 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:15.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.533+0000 7f6b99751740 10 client.25291 resolve_mds: validated gid 24491 aka daemon mds.b 2024-09-19T08:46:15.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.533+0000 7f6b99751740 20 client.25291 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:15.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.533+0000 7f6b99751740 1 --2- 172.21.15.7:0/1098494384 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ca90451180 0x55ca904535d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:15.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.533+0000 7f6b99751740 4 client.25291 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:46:15.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.533+0000 7f6b99751740 1 -- 172.21.15.7:0/1098494384 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6b88003e50 con 0x55ca90451180 2024-09-19T08:46:15.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.533+0000 7f6b94913640 1 --2- 172.21.15.7:0/1098494384 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ca90451180 0x55ca904535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:15.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.533+0000 7f6b78ff9640 10 client.25291 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:15.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.533+0000 7f6b94913640 1 --2- 172.21.15.7:0/1098494384 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ca90451180 0x55ca904535d0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1932676e137f8b4b server_cookie=b0784f509361ac9 in_seq=0 out_seq=0 2024-09-19T08:46:15.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.534+0000 7f6b78ff9640 1 -- 172.21.15.7:0/1098494384 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f6b88003e50 con 0x55ca90451180 2024-09-19T08:46:15.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.534+0000 7f6b78ff9640 10 client.25291 handle_command_reply: tid=0 2024-09-19T08:46:15.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.534+0000 7f6b99751740 1 client.25291 shutdown 2024-09-19T08:46:15.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.534+0000 7f6b99751740 1 -- 172.21.15.7:0/1098494384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90431f20 msgr2=0x55ca9043e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:15.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.534+0000 7f6b99751740 1 --2- 172.21.15.7:0/1098494384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90431f20 0x55ca9043e550 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0cced0 tx=0x7f6b8c06b6b0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.534+0000 7f6b99751740 1 -- 172.21.15.7:0/1098494384 shutdown_connections 2024-09-19T08:46:15.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.534+0000 7f6b99751740 1 --2- 172.21.15.7:0/1098494384 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ca90451180 0x55ca904535d0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.534+0000 7f6b99751740 1 --2- 172.21.15.7:0/1098494384 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ca90441650 0x55ca9043efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.534+0000 7f6b99751740 1 --2- 172.21.15.7:0/1098494384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90432840 0x55ca9043ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.534+0000 7f6b99751740 1 --2- 172.21.15.7:0/1098494384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90431f20 0x55ca9043e550 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.534+0000 7f6b99751740 1 -- 172.21.15.7:0/1098494384 >> 172.21.15.7:0/1098494384 conn(0x55ca9042e5f0 msgr2=0x55ca90434350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:15.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.535+0000 7f6b78ff9640 0 client.25291 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:15.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.535+0000 7f6b99751740 1 -- 172.21.15.7:0/1098494384 shutdown_connections 2024-09-19T08:46:15.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.535+0000 7f6b99751740 1 -- 172.21.15.7:0/1098494384 wait complete. 2024-09-19T08:46:15.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.535+0000 7f6b99751740 20 client.25291 trim_cache size 0 max 16384 2024-09-19T08:46:15.549 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:46:15.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.556+0000 7f6b99751740 1 Processor -- start 2024-09-19T08:46:15.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.556+0000 7f6b99751740 1 -- start start 2024-09-19T08:46:15.557 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:15 smithi007 ceph-mon[31221]: scrub queued for path: / 2024-09-19T08:46:15.557 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:15 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:46:15.557 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:15 smithi007 ceph-mon[31221]: scrub summary: active paths [/] 2024-09-19T08:46:15.557 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:15 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:46:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.556+0000 7f6b99751740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90431f20 0x55ca9042d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.556+0000 7f6b99751740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ca90432840 0x55ca90458ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.556+0000 7f6b99751740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90441650 0x55ca904593e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.556+0000 7f6b99751740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6b901ae010 con 0x55ca90441650 2024-09-19T08:46:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.556+0000 7f6b99751740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6b901ab8e0 con 0x55ca90432840 2024-09-19T08:46:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.556+0000 7f6b99751740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6b901a9730 con 0x55ca90431f20 2024-09-19T08:46:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.557+0000 7f6b95915640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90441650 0x55ca904593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.557+0000 7f6b95915640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90441650 0x55ca904593e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43506/0 (socket says 172.21.15.7:43506) 2024-09-19T08:46:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.557+0000 7f6b95915640 1 -- 172.21.15.7:0/849762139 learned_addr learned my addr 172.21.15.7:0/849762139 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.557+0000 7f6b95114640 1 --2- 172.21.15.7:0/849762139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90431f20 0x55ca9042d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.557+0000 7f6b95915640 1 -- 172.21.15.7:0/849762139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90431f20 msgr2=0x55ca9042d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:15.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.557+0000 7f6b95915640 1 --2- 172.21.15.7:0/849762139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90431f20 0x55ca9042d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.557+0000 7f6b95915640 1 -- 172.21.15.7:0/849762139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ca90432840 msgr2=0x55ca90458ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:15.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.557+0000 7f6b95915640 1 --2- 172.21.15.7:0/849762139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ca90432840 0x55ca90458ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.557+0000 7f6b95915640 1 -- 172.21.15.7:0/849762139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca90443de0 con 0x55ca90441650 2024-09-19T08:46:15.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.557+0000 7f6b95114640 1 --2- 172.21.15.7:0/849762139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90431f20 0x55ca9042d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:15.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.557+0000 7f6b95915640 1 --2- 172.21.15.7:0/849762139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90441650 0x55ca904593e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6b88009430 tx=0x7f6b88050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4252bc5185d162 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:15.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.557+0000 7f6b7affd640 1 -- 172.21.15.7:0/849762139 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8805f070 con 0x55ca90441650 2024-09-19T08:46:15.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.558+0000 7f6b7affd640 1 -- 172.21.15.7:0/849762139 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b88044d80 con 0x55ca90441650 2024-09-19T08:46:15.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.558+0000 7f6b7affd640 1 -- 172.21.15.7:0/849762139 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88056040 con 0x55ca90441650 2024-09-19T08:46:15.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.559+0000 7f6b99751740 1 -- 172.21.15.7:0/849762139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90441650 msgr2=0x55ca904593e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:15.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.559+0000 7f6b99751740 1 --2- 172.21.15.7:0/849762139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90441650 0x55ca904593e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6b88009430 tx=0x7f6b88050000 comp rx=0 tx=0).stop 2024-09-19T08:46:15.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.559+0000 7f6b99751740 1 -- 172.21.15.7:0/849762139 shutdown_connections 2024-09-19T08:46:15.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.559+0000 7f6b99751740 1 --2- 172.21.15.7:0/849762139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90441650 0x55ca904593e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.559+0000 7f6b99751740 1 --2- 172.21.15.7:0/849762139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ca90432840 0x55ca90458ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.559+0000 7f6b99751740 1 --2- 172.21.15.7:0/849762139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90431f20 0x55ca9042d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.559+0000 7f6b99751740 1 -- 172.21.15.7:0/849762139 >> 172.21.15.7:0/849762139 conn(0x55ca9042e5f0 msgr2=0x55ca9042cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:15.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.559+0000 7f6b99751740 1 -- 172.21.15.7:0/849762139 shutdown_connections 2024-09-19T08:46:15.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.559+0000 7f6b99751740 1 -- 172.21.15.7:0/849762139 wait complete. 2024-09-19T08:46:15.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.559+0000 7f6b99751740 1 -- start start 2024-09-19T08:46:15.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.559+0000 7f6b99751740 1 Processor -- start 2024-09-19T08:46:15.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.560+0000 7f6b99751740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90431f20 0x55ca90445420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:15.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.560+0000 7f6b99751740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90432840 0x55ca90445960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:15.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.560+0000 7f6b99751740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ca90441650 0x55ca90445ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:15.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.560+0000 7f6b99751740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6b901a9da0 con 0x55ca90432840 2024-09-19T08:46:15.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.560+0000 7f6b99751740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6b901ab210 con 0x55ca90441650 2024-09-19T08:46:15.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.560+0000 7f6b99751740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6b901aa470 con 0x55ca90431f20 2024-09-19T08:46:15.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.560+0000 7f6b99751740 10 client.0 _ll_register_callbacks cb 0x7f6b8c097db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:15.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.560+0000 7f6b94913640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90432840 0x55ca90445960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:15.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.560+0000 7f6b94913640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90432840 0x55ca90445960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43510/0 (socket says 172.21.15.7:43510) 2024-09-19T08:46:15.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.560+0000 7f6b94913640 1 -- 172.21.15.7:0/401474790 learned_addr learned my addr 172.21.15.7:0/401474790 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:15.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.560+0000 7f6b95915640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ca90441650 0x55ca90445ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:15.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.560+0000 7f6b95114640 1 --2- 172.21.15.7:0/401474790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90431f20 0x55ca90445420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:15.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.561+0000 7f6b95915640 1 -- 172.21.15.7:0/401474790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90431f20 msgr2=0x55ca90445420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:15.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.561+0000 7f6b95915640 1 --2- 172.21.15.7:0/401474790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90431f20 0x55ca90445420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.561+0000 7f6b95915640 1 -- 172.21.15.7:0/401474790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90432840 msgr2=0x55ca90445960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:15.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.561+0000 7f6b95915640 1 --2- 172.21.15.7:0/401474790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90432840 0x55ca90445960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.561+0000 7f6b95915640 1 -- 172.21.15.7:0/401474790 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca904baf40 con 0x55ca90441650 2024-09-19T08:46:15.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.561+0000 7f6b95114640 1 --2- 172.21.15.7:0/401474790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90431f20 0x55ca90445420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:15.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.561+0000 7f6b95915640 1 --2- 172.21.15.7:0/401474790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ca90441650 0x55ca90445ea0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6b88006010 tx=0x7f6b8802f870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0d4ae1fb297da4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:15.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.561+0000 7f6b78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-19T08:46:15.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.561+0000 7f6b78ff9640 1 -- 172.21.15.7:0/401474790 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8805f070 con 0x55ca90441650 2024-09-19T08:46:15.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.561+0000 7f6b78ff9640 1 -- 172.21.15.7:0/401474790 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f6b88003b70 con 0x55ca90441650 2024-09-19T08:46:15.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.561+0000 7f6b99751740 1 -- 172.21.15.7:0/401474790 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b88044d80 con 0x55ca90441650 2024-09-19T08:46:15.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.562+0000 7f6b78ff9640 1 -- 172.21.15.7:0/401474790 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6b88056040 con 0x55ca90441650 2024-09-19T08:46:15.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.562+0000 7f6b99751740 10 client.25451 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:15.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.562+0000 7f6b99751740 1 -- 172.21.15.7:0/401474790 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ca904bc260 con 0x55ca90441650 2024-09-19T08:46:15.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.562+0000 7f6b78ff9640 1 -- 172.21.15.7:0/401474790 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b88044d80 con 0x55ca90441650 2024-09-19T08:46:15.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.562+0000 7f6b78ff9640 1 -- 172.21.15.7:0/401474790 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6b88042070 con 0x55ca90441650 2024-09-19T08:46:15.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.562+0000 7f6b99751740 10 client.25451 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:15.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.562+0000 7f6b99751740 10 client.25451 resolve_mds: validated gid 24491 aka daemon mds.b 2024-09-19T08:46:15.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.562+0000 7f6b99751740 20 client.25451 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:15.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.562+0000 7f6b99751740 1 --2- 172.21.15.7:0/401474790 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ca904bc480 0x55ca904be870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:15.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.562+0000 7f6b99751740 4 client.25451 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3f50ac2e", "release": true, "await": true}] 2024-09-19T08:46:15.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.562+0000 7f6b99751740 1 -- 172.21.15.7:0/401474790 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3f50ac2e", "release": true, "await": true}) -- 0x55ca903a4b90 con 0x55ca904bc480 2024-09-19T08:46:15.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.563+0000 7f6b95114640 1 --2- 172.21.15.7:0/401474790 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ca904bc480 0x55ca904be870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:15.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.563+0000 7f6b78ff9640 10 client.25451 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:15.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.563+0000 7f6b95114640 1 --2- 172.21.15.7:0/401474790 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ca904bc480 0x55ca904be870 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3041543960fc79eb server_cookie=4a889d73f4113295 in_seq=0 out_seq=0 2024-09-19T08:46:15.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.567+0000 7f6b78ff9640 1 -- 172.21.15.7:0/401474790 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55ca903a4b90 con 0x55ca904bc480 2024-09-19T08:46:15.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.567+0000 7f6b78ff9640 10 client.25451 handle_command_reply: tid=0 2024-09-19T08:46:15.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.567+0000 7f6b99751740 1 client.25451 shutdown 2024-09-19T08:46:15.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.567+0000 7f6b99751740 1 -- 172.21.15.7:0/401474790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ca90441650 msgr2=0x55ca90445ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:15.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.567+0000 7f6b99751740 1 --2- 172.21.15.7:0/401474790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ca90441650 0x55ca90445ea0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6b88006010 tx=0x7f6b8802f870 comp rx=0 tx=0).stop 2024-09-19T08:46:15.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.567+0000 7f6b99751740 1 -- 172.21.15.7:0/401474790 shutdown_connections 2024-09-19T08:46:15.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.567+0000 7f6b99751740 1 --2- 172.21.15.7:0/401474790 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ca904bc480 0x55ca904be870 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.567+0000 7f6b99751740 1 --2- 172.21.15.7:0/401474790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ca90441650 0x55ca90445ea0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.567+0000 7f6b99751740 1 --2- 172.21.15.7:0/401474790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ca90432840 0x55ca90445960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.567+0000 7f6b99751740 1 --2- 172.21.15.7:0/401474790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca90431f20 0x55ca90445420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.567+0000 7f6b99751740 1 -- 172.21.15.7:0/401474790 >> 172.21.15.7:0/401474790 conn(0x55ca9042e5f0 msgr2=0x55ca9043ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:15.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.567+0000 7f6b78ff9640 0 client.25451 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:15.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.567+0000 7f6b99751740 1 -- 172.21.15.7:0/401474790 shutdown_connections 2024-09-19T08:46:15.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.567+0000 7f6b99751740 1 -- 172.21.15.7:0/401474790 wait complete. 2024-09-19T08:46:15.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.568+0000 7f6b99751740 20 client.25451 trim_cache size 0 max 16384 2024-09-19T08:46:15.570 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:46:15.571 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 25, 2024-09-19T08:46:15.571 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24491, 2024-09-19T08:46:15.571 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 8, 2024-09-19T08:46:15.571 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": { 2024-09-19T08:46:15.571 INFO:teuthology.orchestra.run.smithi007.stdout: "3f50ac2e": { 2024-09-19T08:46:15.571 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 8, 2024-09-19T08:46:15.571 INFO:teuthology.orchestra.run.smithi007.stdout: "age_ref": 0.0, 2024-09-19T08:46:15.571 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T08:46:15.571 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RELEASED", 2024-09-19T08:46:15.571 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T08:46:15.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:46:15.572 INFO:teuthology.orchestra.run.smithi007.stdout: "timeout": 90.0, 2024-09-19T08:46:15.572 INFO:teuthology.orchestra.run.smithi007.stdout: "expiration": 140.3, 2024-09-19T08:46:15.572 INFO:teuthology.orchestra.run.smithi007.stdout: "members": { 2024-09-19T08:46:15.572 INFO:teuthology.orchestra.run.smithi007.stdout: "file:/": { 2024-09-19T08:46:15.572 INFO:teuthology.orchestra.run.smithi007.stdout: "excluded": false, 2024-09-19T08:46:15.572 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T08:46:15.572 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RELEASED", 2024-09-19T08:46:15.572 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T08:46:15.572 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:46:15.573 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:46:15.573 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:46:15.573 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:46:15.573 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:46:15.573 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:46:15.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.568+0000 7f6b97378640 1 -- 172.21.15.7:0/2145191671 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6b7c0a33b0 msgr2=0x7f6b7c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:15.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.568+0000 7f6b97378640 1 --2- 172.21.15.7:0/2145191671 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6b7c0a33b0 0x7f6b7c0a5870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6b88030040 tx=0x7f6b88044500 comp rx=0 tx=0).stop 2024-09-19T08:46:15.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.569+0000 7f6b97378640 1 -- 172.21.15.7:0/2145191671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b90100e20 msgr2=0x7f6b90199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:15.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.569+0000 7f6b97378640 1 --2- 172.21.15.7:0/2145191671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b90100e20 0x7f6b90199330 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00d950 tx=0x7f6b8c00de10 comp rx=0 tx=0).stop 2024-09-19T08:46:15.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.569+0000 7f6b97378640 1 -- 172.21.15.7:0/2145191671 shutdown_connections 2024-09-19T08:46:15.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.569+0000 7f6b97378640 1 --2- 172.21.15.7:0/2145191671 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6b7c0a33b0 0x7f6b7c0a5870 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.569+0000 7f6b97378640 1 --2- 172.21.15.7:0/2145191671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b90102ef0 0x7f6b90199df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.569+0000 7f6b97378640 1 --2- 172.21.15.7:0/2145191671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b90102570 0x7f6b90199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.569+0000 7f6b97378640 1 --2- 172.21.15.7:0/2145191671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b90100e20 0x7f6b90199330 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:15.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.569+0000 7f6b97378640 1 -- 172.21.15.7:0/2145191671 >> 172.21.15.7:0/2145191671 conn(0x7f6b900fc7d0 msgr2=0x7f6b900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:15.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.569+0000 7f6b97378640 1 -- 172.21.15.7:0/2145191671 shutdown_connections 2024-09-19T08:46:15.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:15.569+0000 7f6b97378640 1 -- 172.21.15.7:0/2145191671 wait complete. 2024-09-19T08:46:15.575 INFO:tasks.workunit.client.0.smithi007.stderr:+ wget http://download.ceph.com/qa/fsync-tester.c 2024-09-19T08:46:15.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:15 smithi175 ceph-mon[35688]: scrub queued for path: / 2024-09-19T08:46:15.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:15 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:46:15.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:15 smithi175 ceph-mon[35688]: scrub summary: active paths [/] 2024-09-19T08:46:15.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:15 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:46:15.682 INFO:tasks.workunit.client.0.smithi007.stderr:--2024-09-19 08:46:15-- http://download.ceph.com/qa/fsync-tester.c 2024-09-19T08:46:15.682 INFO:tasks.workunit.client.0.smithi007.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-19T08:46:15.754 INFO:tasks.workunit.client.0.smithi007.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-19T08:46:15.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:15 smithi044 ceph-mon[35072]: scrub queued for path: / 2024-09-19T08:46:15.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:15 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:46:15.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:15 smithi044 ceph-mon[35072]: scrub summary: active paths [/] 2024-09-19T08:46:15.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:15 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:46:15.826 INFO:tasks.workunit.client.0.smithi007.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-19T08:46:15.826 INFO:tasks.workunit.client.0.smithi007.stderr:Length: 3024 (3.0K) [application/octet-stream] 2024-09-19T08:46:15.828 INFO:tasks.workunit.client.0.smithi007.stderr:Saving to: ‘fsync-tester.c’ 2024-09-19T08:46:15.831 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-19T08:46:15.831 INFO:tasks.workunit.client.0.smithi007.stderr: 0K .. 100% 204M=0s 2024-09-19T08:46:15.831 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-19T08:46:15.831 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-19 08:46:15 (204 MB/s) - ‘fsync-tester.c’ saved [3024/3024] 2024-09-19T08:46:15.831 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-19T08:46:15.832 INFO:tasks.workunit.client.0.smithi007.stderr:+ gcc -D_GNU_SOURCE fsync-tester.c -o fsync-tester 2024-09-19T08:46:16.152 INFO:tasks.workunit.client.0.smithi007.stderr:+ ./fsync-tester 2024-09-19T08:46:16.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.315+0000 7f8542aaa640 1 -- 172.21.15.7:0/45256587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f853c102d40 msgr2=0x7f853c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:16.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.315+0000 7f8542aaa640 1 --2- 172.21.15.7:0/45256587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f853c102d40 0x7f853c103120 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8530009900 tx=0x7f853002a480 comp rx=0 tx=0).stop 2024-09-19T08:46:16.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.315+0000 7f8542aaa640 1 -- 172.21.15.7:0/45256587 shutdown_connections 2024-09-19T08:46:16.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.315+0000 7f8542aaa640 1 --2- 172.21.15.7:0/45256587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f853c10c170 0x7f853c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.315+0000 7f8542aaa640 1 --2- 172.21.15.7:0/45256587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f853c103660 0x7f853c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.315+0000 7f8542aaa640 1 --2- 172.21.15.7:0/45256587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f853c102d40 0x7f853c103120 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.315+0000 7f8542aaa640 1 -- 172.21.15.7:0/45256587 >> 172.21.15.7:0/45256587 conn(0x7f853c0fc7a0 msgr2=0x7f853c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:16.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.316+0000 7f8542aaa640 1 -- 172.21.15.7:0/45256587 shutdown_connections 2024-09-19T08:46:16.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.316+0000 7f8542aaa640 1 -- 172.21.15.7:0/45256587 wait complete. 2024-09-19T08:46:16.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.316+0000 7f8542aaa640 1 Processor -- start 2024-09-19T08:46:16.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.316+0000 7f8542aaa640 1 -- start start 2024-09-19T08:46:16.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.316+0000 7f8542aaa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f853c102d40 0x7f853c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:16.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.316+0000 7f8542aaa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f853c103660 0x7f853c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:16.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.316+0000 7f8542aaa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f853c10c170 0x7f853c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:16.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.317+0000 7f8542aaa640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f853c111f70 con 0x7f853c10c170 2024-09-19T08:46:16.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.317+0000 7f8542aaa640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f853c111df0 con 0x7f853c103660 2024-09-19T08:46:16.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.317+0000 7f8542aaa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f853c1120f0 con 0x7f853c102d40 2024-09-19T08:46:16.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.317+0000 7f8541047640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f853c10c170 0x7f853c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:16.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.317+0000 7f853bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f853c103660 0x7f853c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:16.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.317+0000 7f8541047640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f853c10c170 0x7f853c19cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43528/0 (socket says 172.21.15.7:43528) 2024-09-19T08:46:16.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.317+0000 7f8541047640 1 -- 172.21.15.7:0/528232080 learned_addr learned my addr 172.21.15.7:0/528232080 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:16.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.317+0000 7f8540846640 1 --2- 172.21.15.7:0/528232080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f853c102d40 0x7f853c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:16.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.317+0000 7f853bfff640 1 -- 172.21.15.7:0/528232080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f853c102d40 msgr2=0x7f853c198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:16.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.317+0000 7f853bfff640 1 --2- 172.21.15.7:0/528232080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f853c102d40 0x7f853c198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.317+0000 7f853bfff640 1 -- 172.21.15.7:0/528232080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f853c10c170 msgr2=0x7f853c19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:16.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.317+0000 7f853bfff640 1 --2- 172.21.15.7:0/528232080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f853c10c170 0x7f853c19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.317+0000 7f853bfff640 1 -- 172.21.15.7:0/528232080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f853c19d440 con 0x7f853c103660 2024-09-19T08:46:16.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.317+0000 7f853bfff640 1 --2- 172.21.15.7:0/528232080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f853c103660 0x7f853c1989d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f852800e7c0 tx=0x7f852800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:16.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.317+0000 7f8539ffb640 1 -- 172.21.15.7:0/528232080 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8528009530 con 0x7f853c103660 2024-09-19T08:46:16.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.318+0000 7f8542aaa640 1 -- 172.21.15.7:0/528232080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f853c19d730 con 0x7f853c103660 2024-09-19T08:46:16.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.318+0000 7f8539ffb640 1 -- 172.21.15.7:0/528232080 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f852800ccc0 con 0x7f853c103660 2024-09-19T08:46:16.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.318+0000 7f8539ffb640 1 -- 172.21.15.7:0/528232080 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8528004a00 con 0x7f853c103660 2024-09-19T08:46:16.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.318+0000 7f8542aaa640 1 -- 172.21.15.7:0/528232080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f853c1a5010 con 0x7f853c103660 2024-09-19T08:46:16.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.320+0000 7f8544e83740 1 Processor -- start 2024-09-19T08:46:16.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.320+0000 7f8544e83740 1 -- start start 2024-09-19T08:46:16.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.321+0000 7f8544e83740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89740f3a0 0x55b89740f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:16.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.321+0000 7f8544e83740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b89740fcc0 0x55b89741e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:16.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.321+0000 7f8544e83740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b89741ea90 0x55b897420e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:16.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.321+0000 7f8544e83740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b8973752e0 con 0x55b89740f3a0 2024-09-19T08:46:16.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.321+0000 7f8544e83740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b89731cce0 con 0x55b89740fcc0 2024-09-19T08:46:16.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.321+0000 7f8544e83740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b8973712a0 con 0x55b89741ea90 2024-09-19T08:46:16.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.321+0000 7f8541047640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89740f3a0 0x55b89740f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:16.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.321+0000 7f8541047640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89740f3a0 0x55b89740f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43532/0 (socket says 172.21.15.7:43532) 2024-09-19T08:46:16.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.321+0000 7f8541047640 1 -- 172.21.15.7:0/2595558465 learned_addr learned my addr 172.21.15.7:0/2595558465 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:16.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.321+0000 7f8540846640 1 --2- 172.21.15.7:0/2595558465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b89740fcc0 0x55b89741e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:16.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.321+0000 7f8541047640 1 -- 172.21.15.7:0/2595558465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b89741ea90 msgr2=0x55b897420e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:46:16.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.321+0000 7f8541047640 1 --2- 172.21.15.7:0/2595558465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b89741ea90 0x55b897420e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.321+0000 7f8541047640 1 -- 172.21.15.7:0/2595558465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b89740fcc0 msgr2=0x55b89741e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:16.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.321+0000 7f8541047640 1 --2- 172.21.15.7:0/2595558465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b89740fcc0 0x55b89741e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.321+0000 7f8541047640 1 -- 172.21.15.7:0/2595558465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b897301440 con 0x55b89740f3a0 2024-09-19T08:46:16.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.321+0000 7f8540846640 1 --2- 172.21.15.7:0/2595558465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b89740fcc0 0x55b89741e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:16.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.321+0000 7f8539ffb640 1 -- 172.21.15.7:0/528232080 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8528004ba0 con 0x7f853c103660 2024-09-19T08:46:16.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.321+0000 7f8541047640 1 --2- 172.21.15.7:0/2595558465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89740f3a0 0x55b89740f780 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8534011490 tx=0x7f8534011950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ef1b01fbf13459 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:16.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.322+0000 7f8526ffd640 1 -- 172.21.15.7:0/2595558465 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853401e070 con 0x55b89740f3a0 2024-09-19T08:46:16.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.322+0000 7f8526ffd640 1 -- 172.21.15.7:0/2595558465 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f853400fae0 con 0x55b89740f3a0 2024-09-19T08:46:16.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.322+0000 7f8526ffd640 1 -- 172.21.15.7:0/2595558465 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8534019ba0 con 0x55b89740f3a0 2024-09-19T08:46:16.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.322+0000 7f8539ffb640 1 --2- 172.21.15.7:0/528232080 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f852c0a33b0 0x7f852c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:16.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.322+0000 7f8540846640 1 --2- 172.21.15.7:0/528232080 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f852c0a33b0 0x7f852c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:16.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.322+0000 7f8539ffb640 1 -- 172.21.15.7:0/528232080 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f85280cfbd0 con 0x7f853c103660 2024-09-19T08:46:16.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.323+0000 7f8540846640 1 --2- 172.21.15.7:0/528232080 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f852c0a33b0 0x7f852c0a5870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8530009230 tx=0x7f85300058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:16.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.323+0000 7f8544e83740 1 -- 172.21.15.7:0/2595558465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89740f3a0 msgr2=0x55b89740f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:16.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.323+0000 7f8544e83740 1 --2- 172.21.15.7:0/2595558465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89740f3a0 0x55b89740f780 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8534011490 tx=0x7f8534011950 comp rx=0 tx=0).stop 2024-09-19T08:46:16.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.323+0000 7f8544e83740 1 -- 172.21.15.7:0/2595558465 shutdown_connections 2024-09-19T08:46:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.323+0000 7f8544e83740 1 --2- 172.21.15.7:0/2595558465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b89741ea90 0x55b897420e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.323+0000 7f8544e83740 1 --2- 172.21.15.7:0/2595558465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b89740fcc0 0x55b89741e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.323+0000 7f8544e83740 1 --2- 172.21.15.7:0/2595558465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89740f3a0 0x55b89740f780 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.323+0000 7f8544e83740 1 -- 172.21.15.7:0/2595558465 >> 172.21.15.7:0/2595558465 conn(0x55b89740ba30 msgr2=0x55b89740be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.323+0000 7f8544e83740 1 -- 172.21.15.7:0/2595558465 shutdown_connections 2024-09-19T08:46:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.323+0000 7f8544e83740 1 -- 172.21.15.7:0/2595558465 wait complete. 2024-09-19T08:46:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.323+0000 7f8544e83740 1 -- start start 2024-09-19T08:46:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.323+0000 7f8544e83740 1 Processor -- start 2024-09-19T08:46:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.324+0000 7f8544e83740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b89740f3a0 0x55b89741e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.324+0000 7f8544e83740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89740fcc0 0x55b89741b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.324+0000 7f8544e83740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b89741ea90 0x55b89741bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.324+0000 7f8544e83740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b8974216c0 con 0x55b89740fcc0 2024-09-19T08:46:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.324+0000 7f8544e83740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b897330050 con 0x55b89741ea90 2024-09-19T08:46:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.324+0000 7f8544e83740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b897421840 con 0x55b89740f3a0 2024-09-19T08:46:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.324+0000 7f8544e83740 10 client.0 _ll_register_callbacks cb 0x55b897370160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.324+0000 7f853bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89740fcc0 0x55b89741b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.324+0000 7f853bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89740fcc0 0x55b89741b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43536/0 (socket says 172.21.15.7:43536) 2024-09-19T08:46:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.324+0000 7f853bfff640 1 -- 172.21.15.7:0/609134449 learned_addr learned my addr 172.21.15.7:0/609134449 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.324+0000 7f8540846640 1 --2- 172.21.15.7:0/609134449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b89740f3a0 0x55b89741e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.324+0000 7f8541047640 1 --2- 172.21.15.7:0/609134449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b89741ea90 0x55b89741bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.324+0000 7f853bfff640 1 -- 172.21.15.7:0/609134449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b89740f3a0 msgr2=0x55b89741e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.324+0000 7f853bfff640 1 --2- 172.21.15.7:0/609134449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b89740f3a0 0x55b89741e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.324+0000 7f853bfff640 1 -- 172.21.15.7:0/609134449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b89741ea90 msgr2=0x55b89741bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.324+0000 7f853bfff640 1 --2- 172.21.15.7:0/609134449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b89741ea90 0x55b89741bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.324+0000 7f853bfff640 1 -- 172.21.15.7:0/609134449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8970e63c0 con 0x55b89740fcc0 2024-09-19T08:46:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.325+0000 7f853bfff640 1 --2- 172.21.15.7:0/609134449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89740fcc0 0x55b89741b6f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f85280cd910 tx=0x7f852809baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13403ec770e3ce2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.325+0000 7f851bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:16.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.325+0000 7f851bfff640 1 -- 172.21.15.7:0/609134449 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852801c040 con 0x55b89740fcc0 2024-09-19T08:46:16.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.325+0000 7f851bfff640 1 -- 172.21.15.7:0/609134449 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f8528098510 con 0x55b89740fcc0 2024-09-19T08:46:16.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.325+0000 7f8544e83740 1 -- 172.21.15.7:0/609134449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f853400fae0 con 0x55b89740fcc0 2024-09-19T08:46:16.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.325+0000 7f851bfff640 1 -- 172.21.15.7:0/609134449 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f852809bea0 con 0x55b89740fcc0 2024-09-19T08:46:16.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.325+0000 7f8544e83740 10 client.15738 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:16.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.325+0000 7f8544e83740 1 -- 172.21.15.7:0/609134449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b89742d110 con 0x55b89740fcc0 2024-09-19T08:46:16.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.325+0000 7f851bfff640 1 -- 172.21.15.7:0/609134449 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85280b8030 con 0x55b89740fcc0 2024-09-19T08:46:16.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.326+0000 7f851bfff640 1 -- 172.21.15.7:0/609134449 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f85280ba020 con 0x55b89740fcc0 2024-09-19T08:46:16.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.326+0000 7f8544e83740 10 client.15738 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:16.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.326+0000 7f8544e83740 10 client.15738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:16.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.326+0000 7f8544e83740 20 client.15738 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:16.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.326+0000 7f8544e83740 1 --2- 172.21.15.7:0/609134449 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b89742e460 0x55b897430850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:16.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.326+0000 7f8544e83740 4 client.15738 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:46:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.326+0000 7f8544e83740 1 -- 172.21.15.7:0/609134449 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b897382850 con 0x55b89742e460 2024-09-19T08:46:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.326+0000 7f8540846640 1 --2- 172.21.15.7:0/609134449 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b89742e460 0x55b897430850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.326+0000 7f851bfff640 10 client.15738 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.326+0000 7f8540846640 1 --2- 172.21.15.7:0/609134449 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b89742e460 0x55b897430850 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b7c2cb9bcc9e2ad server_cookie=ff442b0e2bc0b5ab in_seq=0 out_seq=0 2024-09-19T08:46:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.327+0000 7f851bfff640 1 -- 172.21.15.7:0/609134449 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b897382850 con 0x55b89742e460 2024-09-19T08:46:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.327+0000 7f851bfff640 10 client.15738 handle_command_reply: tid=0 2024-09-19T08:46:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.327+0000 7f8544e83740 1 client.15738 shutdown 2024-09-19T08:46:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.327+0000 7f8544e83740 1 -- 172.21.15.7:0/609134449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89740fcc0 msgr2=0x55b89741b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.327+0000 7f8544e83740 1 --2- 172.21.15.7:0/609134449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89740fcc0 0x55b89741b6f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f85280cd910 tx=0x7f852809baa0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.327+0000 7f8544e83740 1 -- 172.21.15.7:0/609134449 shutdown_connections 2024-09-19T08:46:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.327+0000 7f8544e83740 1 --2- 172.21.15.7:0/609134449 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b89742e460 0x55b897430850 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.327+0000 7f851bfff640 0 client.15738 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.327+0000 7f8544e83740 1 --2- 172.21.15.7:0/609134449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b89741ea90 0x55b89741bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.327+0000 7f8544e83740 1 --2- 172.21.15.7:0/609134449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89740fcc0 0x55b89741b6f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.327+0000 7f8544e83740 1 --2- 172.21.15.7:0/609134449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b89740f3a0 0x55b89741e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.327+0000 7f8544e83740 1 -- 172.21.15.7:0/609134449 >> 172.21.15.7:0/609134449 conn(0x55b89740ba30 msgr2=0x55b897411790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.328+0000 7f8544e83740 1 -- 172.21.15.7:0/609134449 shutdown_connections 2024-09-19T08:46:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.328+0000 7f8544e83740 1 -- 172.21.15.7:0/609134449 wait complete. 2024-09-19T08:46:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.328+0000 7f8544e83740 20 client.15738 trim_cache size 0 max 16384 2024-09-19T08:46:16.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.350+0000 7f8544e83740 1 Processor -- start 2024-09-19T08:46:16.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.350+0000 7f8544e83740 1 -- start start 2024-09-19T08:46:16.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.350+0000 7f8544e83740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b89740f3a0 0x55b89742a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:16.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.350+0000 7f8544e83740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b89740fcc0 0x55b8974360b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:16.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.350+0000 7f8544e83740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89741ea90 0x55b8974365f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:16.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.350+0000 7f8544e83740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f853c1adfe0 con 0x55b89741ea90 2024-09-19T08:46:16.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.350+0000 7f8544e83740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f853c1ab8b0 con 0x55b89740f3a0 2024-09-19T08:46:16.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.350+0000 7f8544e83740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f853c1a9700 con 0x55b89740fcc0 2024-09-19T08:46:16.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.351+0000 7f853bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b89740fcc0 0x55b8974360b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:16.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.351+0000 7f853bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b89740fcc0 0x55b8974360b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.7:53218/0 (socket says 172.21.15.7:53218) 2024-09-19T08:46:16.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.351+0000 7f853bfff640 1 -- 172.21.15.7:0/39222782 learned_addr learned my addr 172.21.15.7:0/39222782 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:16.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.351+0000 7f8541047640 1 --2- 172.21.15.7:0/39222782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89741ea90 0x55b8974365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.351+0000 7f8540846640 1 --2- 172.21.15.7:0/39222782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b89740f3a0 0x55b89742a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.351+0000 7f853bfff640 1 -- 172.21.15.7:0/39222782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b89740f3a0 msgr2=0x55b89742a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.351+0000 7f853bfff640 1 --2- 172.21.15.7:0/39222782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b89740f3a0 0x55b89742a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.351+0000 7f853bfff640 1 -- 172.21.15.7:0/39222782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89741ea90 msgr2=0x55b8974365f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.351+0000 7f853bfff640 1 --2- 172.21.15.7:0/39222782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89741ea90 0x55b8974365f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.351+0000 7f853bfff640 1 -- 172.21.15.7:0/39222782 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b897430bc0 con 0x55b89740fcc0 2024-09-19T08:46:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.351+0000 7f8540846640 1 --2- 172.21.15.7:0/39222782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b89740f3a0 0x55b89742a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:46:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.351+0000 7f853bfff640 1 --2- 172.21.15.7:0/39222782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b89740fcc0 0x55b8974360b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f852809be30 tx=0x7f852809bb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=857d0ae492ba6805 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.352+0000 7f85267fc640 1 -- 172.21.15.7:0/39222782 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852801c070 con 0x55b89740fcc0 2024-09-19T08:46:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.352+0000 7f85267fc640 1 -- 172.21.15.7:0/39222782 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85280b8030 con 0x55b89740fcc0 2024-09-19T08:46:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.352+0000 7f85267fc640 1 -- 172.21.15.7:0/39222782 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8528097bf0 con 0x55b89740fcc0 2024-09-19T08:46:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.352+0000 7f8544e83740 1 -- 172.21.15.7:0/39222782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b89740fcc0 msgr2=0x55b8974360b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.352+0000 7f8544e83740 1 --2- 172.21.15.7:0/39222782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b89740fcc0 0x55b8974360b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f852809be30 tx=0x7f852809bb10 comp rx=0 tx=0).stop 2024-09-19T08:46:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.352+0000 7f8544e83740 1 -- 172.21.15.7:0/39222782 shutdown_connections 2024-09-19T08:46:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.352+0000 7f8544e83740 1 --2- 172.21.15.7:0/39222782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89741ea90 0x55b8974365f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.352+0000 7f8544e83740 1 --2- 172.21.15.7:0/39222782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b89740fcc0 0x55b8974360b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.352+0000 7f8544e83740 1 --2- 172.21.15.7:0/39222782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b89740f3a0 0x55b89742a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.352+0000 7f8544e83740 1 -- 172.21.15.7:0/39222782 >> 172.21.15.7:0/39222782 conn(0x55b89740ba30 msgr2=0x55b897411760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.353+0000 7f8544e83740 1 -- 172.21.15.7:0/39222782 shutdown_connections 2024-09-19T08:46:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.353+0000 7f8544e83740 1 -- 172.21.15.7:0/39222782 wait complete. 2024-09-19T08:46:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.353+0000 7f8544e83740 1 -- start start 2024-09-19T08:46:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.353+0000 7f8544e83740 1 Processor -- start 2024-09-19T08:46:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.354+0000 7f8544e83740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b89740f3a0 0x55b8974273f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.354+0000 7f8544e83740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89740fcc0 0x55b897422720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.354+0000 7f8544e83740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b89741ea90 0x55b897422eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.354+0000 7f8544e83740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f853c1a9d70 con 0x55b89740fcc0 2024-09-19T08:46:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.354+0000 7f853bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89740fcc0 0x55b897422720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.354+0000 7f8540846640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b89740f3a0 0x55b8974273f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.354+0000 7f853bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89740fcc0 0x55b897422720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43554/0 (socket says 172.21.15.7:43554) 2024-09-19T08:46:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.354+0000 7f853bfff640 1 -- 172.21.15.7:0/541211062 learned_addr learned my addr 172.21.15.7:0/541211062 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.354+0000 7f8544e83740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f853c1ab1e0 con 0x55b89741ea90 2024-09-19T08:46:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.354+0000 7f8544e83740 1 -- 172.21.15.7:0/541211062 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f853c1aa440 con 0x55b89740f3a0 2024-09-19T08:46:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.354+0000 7f8541047640 1 --2- 172.21.15.7:0/541211062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b89741ea90 0x55b897422eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.354+0000 7f8544e83740 10 client.0 _ll_register_callbacks cb 0x7f85280981b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.355+0000 7f853bfff640 1 -- 172.21.15.7:0/541211062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b89740f3a0 msgr2=0x55b8974273f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.355+0000 7f853bfff640 1 --2- 172.21.15.7:0/541211062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b89740f3a0 0x55b8974273f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.355+0000 7f853bfff640 1 -- 172.21.15.7:0/541211062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b89741ea90 msgr2=0x55b897422eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.355+0000 7f853bfff640 1 --2- 172.21.15.7:0/541211062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b89741ea90 0x55b897422eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.355+0000 7f853bfff640 1 -- 172.21.15.7:0/541211062 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b897498080 con 0x55b89740fcc0 2024-09-19T08:46:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.355+0000 7f853bfff640 1 --2- 172.21.15.7:0/541211062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89740fcc0 0x55b897422720 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f85280cd910 tx=0x7f852809baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a495a2c628c1a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.355+0000 7f851bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.355+0000 7f851bfff640 1 -- 172.21.15.7:0/541211062 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852801c070 con 0x55b89740fcc0 2024-09-19T08:46:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.355+0000 7f851bfff640 1 -- 172.21.15.7:0/541211062 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f85280a4680 con 0x55b89740fcc0 2024-09-19T08:46:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.355+0000 7f8544e83740 1 -- 172.21.15.7:0/541211062 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85280b8030 con 0x55b89740fcc0 2024-09-19T08:46:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.355+0000 7f851bfff640 1 -- 172.21.15.7:0/541211062 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f85280a4b10 con 0x55b89740fcc0 2024-09-19T08:46:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.355+0000 7f8544e83740 10 client.15744 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.355+0000 7f8544e83740 1 -- 172.21.15.7:0/541211062 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b897498080 con 0x55b89740fcc0 2024-09-19T08:46:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.356+0000 7f851bfff640 1 -- 172.21.15.7:0/541211062 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85280b8030 con 0x55b89740fcc0 2024-09-19T08:46:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.356+0000 7f851bfff640 1 -- 172.21.15.7:0/541211062 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f852809ad60 con 0x55b89740fcc0 2024-09-19T08:46:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.356+0000 7f8544e83740 10 client.15744 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.356+0000 7f8544e83740 10 client.15744 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.356+0000 7f8544e83740 20 client.15744 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.356+0000 7f8544e83740 1 --2- 172.21.15.7:0/541211062 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b897412570 0x55b897414990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.356+0000 7f8544e83740 4 client.15744 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:46:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.356+0000 7f8544e83740 1 -- 172.21.15.7:0/541211062 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b89737cd60 con 0x55b897412570 2024-09-19T08:46:16.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.356+0000 7f8540846640 1 --2- 172.21.15.7:0/541211062 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b897412570 0x55b897414990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.357+0000 7f851bfff640 10 client.15744 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.357+0000 7f8540846640 1 --2- 172.21.15.7:0/541211062 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b897412570 0x55b897414990 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc903eea51e6fde5 server_cookie=b9e76068a33a653c in_seq=0 out_seq=0 2024-09-19T08:46:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.357+0000 7f851bfff640 1 -- 172.21.15.7:0/541211062 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b89737cd60 con 0x55b897412570 2024-09-19T08:46:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.357+0000 7f851bfff640 10 client.15744 handle_command_reply: tid=0 2024-09-19T08:46:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.357+0000 7f8544e83740 1 client.15744 shutdown 2024-09-19T08:46:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.357+0000 7f8544e83740 1 -- 172.21.15.7:0/541211062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89740fcc0 msgr2=0x55b897422720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.357+0000 7f8544e83740 1 --2- 172.21.15.7:0/541211062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89740fcc0 0x55b897422720 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f85280cd910 tx=0x7f852809baa0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.357+0000 7f8544e83740 1 -- 172.21.15.7:0/541211062 shutdown_connections 2024-09-19T08:46:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.357+0000 7f8544e83740 1 --2- 172.21.15.7:0/541211062 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b897412570 0x55b897414990 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.357+0000 7f851bfff640 0 client.15744 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.357+0000 7f8544e83740 1 --2- 172.21.15.7:0/541211062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b89741ea90 0x55b897422eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.357+0000 7f8544e83740 1 --2- 172.21.15.7:0/541211062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b89740fcc0 0x55b897422720 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.357+0000 7f8544e83740 1 --2- 172.21.15.7:0/541211062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b89740f3a0 0x55b8974273f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.357+0000 7f8544e83740 1 -- 172.21.15.7:0/541211062 >> 172.21.15.7:0/541211062 conn(0x55b89740ba30 msgr2=0x55b89741cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:16.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.357+0000 7f8544e83740 1 -- 172.21.15.7:0/541211062 shutdown_connections 2024-09-19T08:46:16.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.357+0000 7f8544e83740 1 -- 172.21.15.7:0/541211062 wait complete. 2024-09-19T08:46:16.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.358+0000 7f8544e83740 20 client.15744 trim_cache size 0 max 16384 2024-09-19T08:46:16.363 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:46:16.363 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:46:16.363 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-19T08:46:16.363 INFO:teuthology.orchestra.run.smithi007.stdout: "314e2cdd-b9c4-42b0-954f-35b9e357d703": { 2024-09-19T08:46:16.363 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-19T08:46:16.363 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "314e2cdd-b9c4-42b0-954f-35b9e357d703", 2024-09-19T08:46:16.364 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-19T08:46:16.364 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:46:16.364 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:46:16.364 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:46:16.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.358+0000 7f8542aaa640 1 -- 172.21.15.7:0/528232080 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f852c0a33b0 msgr2=0x7f852c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:16.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.358+0000 7f8542aaa640 1 --2- 172.21.15.7:0/528232080 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f852c0a33b0 0x7f852c0a5870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8530009230 tx=0x7f85300058d0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.358+0000 7f8542aaa640 1 -- 172.21.15.7:0/528232080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f853c103660 msgr2=0x7f853c1989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:16.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.358+0000 7f8542aaa640 1 --2- 172.21.15.7:0/528232080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f853c103660 0x7f853c1989d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f852800e7c0 tx=0x7f852800ec80 comp rx=0 tx=0).stop 2024-09-19T08:46:16.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.358+0000 7f8542aaa640 1 -- 172.21.15.7:0/528232080 shutdown_connections 2024-09-19T08:46:16.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.358+0000 7f8542aaa640 1 --2- 172.21.15.7:0/528232080 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f852c0a33b0 0x7f852c0a5870 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.358+0000 7f8542aaa640 1 --2- 172.21.15.7:0/528232080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f853c10c170 0x7f853c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.358+0000 7f8542aaa640 1 --2- 172.21.15.7:0/528232080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f853c103660 0x7f853c1989d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.358+0000 7f8542aaa640 1 --2- 172.21.15.7:0/528232080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f853c102d40 0x7f853c198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:16.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.358+0000 7f8542aaa640 1 -- 172.21.15.7:0/528232080 >> 172.21.15.7:0/528232080 conn(0x7f853c0fc7a0 msgr2=0x7f853c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:16.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.359+0000 7f8542aaa640 1 -- 172.21.15.7:0/528232080 shutdown_connections 2024-09-19T08:46:16.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:16.359+0000 7f8542aaa640 1 -- 172.21.15.7:0/528232080 wait complete. 2024-09-19T08:46:16.491 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:16 smithi007 ceph-mon[31221]: pgmap v55: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:46:16.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:16 smithi175 ceph-mon[35688]: pgmap v55: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:46:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:16 smithi044 ceph-mon[35072]: pgmap v55: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:46:16.890 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3f50ac2e', total seconds elapsed: 24.9 2024-09-19T08:46:16.891 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T08:46:16.891 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:46:17.552 INFO:tasks.cephfs.filesystem:scrub status for tag:314e2cdd-b9c4-42b0-954f-35b9e357d703 - {'path': '/', 'tag': '314e2cdd-b9c4-42b0-954f-35b9e357d703', 'options': 'recursive,force'} 2024-09-19T08:46:17.607 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:46:18.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.041+0000 7f53f4234640 1 -- 172.21.15.7:0/2819024812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53ec100a70 msgr2=0x7f53ec100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:18.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.041+0000 7f53f4234640 1 --2- 172.21.15.7:0/2819024812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53ec100a70 0x7f53ec100ed0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009930 tx=0x7f53dc02a420 comp rx=0 tx=0).stop 2024-09-19T08:46:18.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.041+0000 7f53f4234640 1 -- 172.21.15.7:0/2819024812 shutdown_connections 2024-09-19T08:46:18.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.041+0000 7f53f4234640 1 --2- 172.21.15.7:0/2819024812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53ec101410 0x7f53ec10d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:18.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.041+0000 7f53f4234640 1 --2- 172.21.15.7:0/2819024812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53ec100a70 0x7f53ec100ed0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:18.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.041+0000 7f53f4234640 1 --2- 172.21.15.7:0/2819024812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53ec106a70 0x7f53ec106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:18.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.041+0000 7f53f4234640 1 -- 172.21.15.7:0/2819024812 >> 172.21.15.7:0/2819024812 conn(0x7f53ec0fc790 msgr2=0x7f53ec0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:18.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.041+0000 7f53f4234640 1 -- 172.21.15.7:0/2819024812 shutdown_connections 2024-09-19T08:46:18.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.041+0000 7f53f4234640 1 -- 172.21.15.7:0/2819024812 wait complete. 2024-09-19T08:46:18.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.042+0000 7f53f4234640 1 Processor -- start 2024-09-19T08:46:18.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.042+0000 7f53f4234640 1 -- start start 2024-09-19T08:46:18.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.042+0000 7f53f4234640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53ec100a70 0x7f53ec0fced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:18.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.042+0000 7f53f4234640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53ec101410 0x7f53ec0fd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:18.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.042+0000 7f53f4234640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53ec106a70 0x7f53ec0fd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:18.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.042+0000 7f53f4234640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f53ec110e70 con 0x7f53ec100a70 2024-09-19T08:46:18.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.042+0000 7f53f4234640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f53ec110cf0 con 0x7f53ec101410 2024-09-19T08:46:18.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.042+0000 7f53f4234640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f53ec110ff0 con 0x7f53ec106a70 2024-09-19T08:46:18.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.042+0000 7f53f1fd0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53ec100a70 0x7f53ec0fced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:18.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.042+0000 7f53f1fd0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53ec100a70 0x7f53ec0fced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43584/0 (socket says 172.21.15.7:43584) 2024-09-19T08:46:18.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.042+0000 7f53f1fd0640 1 -- 172.21.15.7:0/1794957729 learned_addr learned my addr 172.21.15.7:0/1794957729 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:18.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.043+0000 7f53f17cf640 1 --2- 172.21.15.7:0/1794957729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53ec101410 0x7f53ec0fd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:18.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.043+0000 7f53f27d1640 1 --2- 172.21.15.7:0/1794957729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53ec106a70 0x7f53ec0fd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:18.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.043+0000 7f53f1fd0640 1 -- 172.21.15.7:0/1794957729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53ec106a70 msgr2=0x7f53ec0fd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:18.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.043+0000 7f53f1fd0640 1 --2- 172.21.15.7:0/1794957729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53ec106a70 0x7f53ec0fd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:18.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.043+0000 7f53f1fd0640 1 -- 172.21.15.7:0/1794957729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53ec101410 msgr2=0x7f53ec0fd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:18.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.043+0000 7f53f1fd0640 1 --2- 172.21.15.7:0/1794957729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53ec101410 0x7f53ec0fd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:18.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.043+0000 7f53f1fd0640 1 -- 172.21.15.7:0/1794957729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ec1a6950 con 0x7f53ec100a70 2024-09-19T08:46:18.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.043+0000 7f53f27d1640 1 --2- 172.21.15.7:0/1794957729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53ec106a70 0x7f53ec0fd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:18.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.043+0000 7f53f1fd0640 1 --2- 172.21.15.7:0/1794957729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53ec100a70 0x7f53ec0fced0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f53e800d950 tx=0x7f53e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:18.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.043+0000 7f53e2ffd640 1 -- 172.21.15.7:0/1794957729 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e8017070 con 0x7f53ec100a70 2024-09-19T08:46:18.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.043+0000 7f53f4234640 1 -- 172.21.15.7:0/1794957729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53ec1a6c40 con 0x7f53ec100a70 2024-09-19T08:46:18.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.043+0000 7f53e2ffd640 1 -- 172.21.15.7:0/1794957729 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53e8009c30 con 0x7f53ec100a70 2024-09-19T08:46:18.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.043+0000 7f53e2ffd640 1 -- 172.21.15.7:0/1794957729 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e800f6b0 con 0x7f53ec100a70 2024-09-19T08:46:18.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.043+0000 7f53f4234640 1 -- 172.21.15.7:0/1794957729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53ec1a71a0 con 0x7f53ec100a70 2024-09-19T08:46:18.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.045+0000 7f53f4234640 1 -- 172.21.15.7:0/1794957729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53ec100ed0 con 0x7f53ec100a70 2024-09-19T08:46:18.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.046+0000 7f53e2ffd640 1 -- 172.21.15.7:0/1794957729 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f53e80109d0 con 0x7f53ec100a70 2024-09-19T08:46:18.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.047+0000 7f53e2ffd640 1 --2- 172.21.15.7:0/1794957729 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f53d80a33b0 0x7f53d80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:18.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.047+0000 7f53e2ffd640 1 -- 172.21.15.7:0/1794957729 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f53e80cf8c0 con 0x7f53ec100a70 2024-09-19T08:46:18.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.047+0000 7f53f17cf640 1 --2- 172.21.15.7:0/1794957729 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f53d80a33b0 0x7f53d80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:18.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.048+0000 7f53f17cf640 1 --2- 172.21.15.7:0/1794957729 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f53d80a33b0 0x7f53d80a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009900 tx=0x7f53dc0058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:18.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.052+0000 7f53e2ffd640 1 -- 172.21.15.7:0/1794957729 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f53e8009de0 con 0x7f53ec100a70 2024-09-19T08:46:18.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.271+0000 7f53f4234640 1 -- 172.21.15.7:0/1794957729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53ec02d7c0 con 0x7f53ec100a70 2024-09-19T08:46:18.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.272+0000 7f53e2ffd640 1 -- 172.21.15.7:0/1794957729 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f53e809c290 con 0x7f53ec100a70 2024-09-19T08:46:18.273 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:46:18.273 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:46:18.273 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:46:18.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.275+0000 7f53f4234640 1 -- 172.21.15.7:0/1794957729 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f53d80a33b0 msgr2=0x7f53d80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:18.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.275+0000 7f53f4234640 1 --2- 172.21.15.7:0/1794957729 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f53d80a33b0 0x7f53d80a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009900 tx=0x7f53dc0058d0 comp rx=0 tx=0).stop 2024-09-19T08:46:18.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.275+0000 7f53f4234640 1 -- 172.21.15.7:0/1794957729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53ec100a70 msgr2=0x7f53ec0fced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:18.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.275+0000 7f53f4234640 1 --2- 172.21.15.7:0/1794957729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53ec100a70 0x7f53ec0fced0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f53e800d950 tx=0x7f53e800de10 comp rx=0 tx=0).stop 2024-09-19T08:46:18.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.275+0000 7f53f4234640 1 -- 172.21.15.7:0/1794957729 shutdown_connections 2024-09-19T08:46:18.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.275+0000 7f53f4234640 1 --2- 172.21.15.7:0/1794957729 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f53d80a33b0 0x7f53d80a5870 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:18.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.275+0000 7f53f4234640 1 --2- 172.21.15.7:0/1794957729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53ec106a70 0x7f53ec0fd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:18.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.275+0000 7f53f4234640 1 --2- 172.21.15.7:0/1794957729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53ec101410 0x7f53ec0fd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:18.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.275+0000 7f53f4234640 1 --2- 172.21.15.7:0/1794957729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53ec100a70 0x7f53ec0fced0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:18.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.275+0000 7f53f4234640 1 -- 172.21.15.7:0/1794957729 >> 172.21.15.7:0/1794957729 conn(0x7f53ec0fc790 msgr2=0x7f53ec06ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:18.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.275+0000 7f53f4234640 1 -- 172.21.15.7:0/1794957729 shutdown_connections 2024-09-19T08:46:18.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:18.275+0000 7f53f4234640 1 -- 172.21.15.7:0/1794957729 wait complete. 2024-09-19T08:46:18.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:18 smithi007 ceph-mon[31221]: pgmap v56: 97 pgs: 97 active+clean; 2.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 90 KiB/s wr, 9 op/s 2024-09-19T08:46:18.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:18 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1794957729' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:46:18.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:18 smithi175 ceph-mon[35688]: pgmap v56: 97 pgs: 97 active+clean; 2.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 90 KiB/s wr, 9 op/s 2024-09-19T08:46:18.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:18 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1794957729' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:46:18.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:18 smithi044 ceph-mon[35072]: pgmap v56: 97 pgs: 97 active+clean; 2.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 90 KiB/s wr, 9 op/s 2024-09-19T08:46:18.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:18 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1794957729' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:46:18.962 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24491 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T08:46:18.963 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24491 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T08:46:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:46:19.649 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:19 smithi007 ceph-mon[31221]: scrub summary: idle 2024-09-19T08:46:19.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:19 smithi175 ceph-mon[35688]: scrub summary: idle 2024-09-19T08:46:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.749+0000 7ff0c9d40640 1 -- 172.21.15.7:0/3538750108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c4103740 msgr2=0x7ff0c4107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.749+0000 7ff0c9d40640 1 --2- 172.21.15.7:0/3538750108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c4103740 0x7ff0c4107b80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009930 tx=0x7ff0ac02a420 comp rx=0 tx=0).stop 2024-09-19T08:46:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.749+0000 7ff0c9d40640 1 -- 172.21.15.7:0/3538750108 shutdown_connections 2024-09-19T08:46:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.749+0000 7ff0c9d40640 1 --2- 172.21.15.7:0/3538750108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c4108290 0x7ff0c410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.749+0000 7ff0c9d40640 1 --2- 172.21.15.7:0/3538750108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c4103740 0x7ff0c4107b80 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.749+0000 7ff0c9d40640 1 --2- 172.21.15.7:0/3538750108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0c4102d90 0x7ff0c4103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.749+0000 7ff0c9d40640 1 -- 172.21.15.7:0/3538750108 >> 172.21.15.7:0/3538750108 conn(0x7ff0c40fc7d0 msgr2=0x7ff0c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.749+0000 7ff0c9d40640 1 -- 172.21.15.7:0/3538750108 shutdown_connections 2024-09-19T08:46:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.749+0000 7ff0c9d40640 1 -- 172.21.15.7:0/3538750108 wait complete. 2024-09-19T08:46:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.750+0000 7ff0c9d40640 1 Processor -- start 2024-09-19T08:46:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.750+0000 7ff0c9d40640 1 -- start start 2024-09-19T08:46:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.750+0000 7ff0c9d40640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0c4102d90 0x7ff0c4198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.750+0000 7ff0c9d40640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c4103740 0x7ff0c4198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.750+0000 7ff0c9d40640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c4108290 0x7ff0c419ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.750+0000 7ff0c9d40640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c4112080 con 0x7ff0c4103740 2024-09-19T08:46:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.750+0000 7ff0c9d40640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c4111f00 con 0x7ff0c4108290 2024-09-19T08:46:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.750+0000 7ff0c9d40640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c4112200 con 0x7ff0c4102d90 2024-09-19T08:46:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.750+0000 7ff0bbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c4103740 0x7ff0c4198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.750+0000 7ff0bbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c4103740 0x7ff0c4198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43600/0 (socket says 172.21.15.7:43600) 2024-09-19T08:46:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.750+0000 7ff0bbfff640 1 -- 172.21.15.7:0/3097841233 learned_addr learned my addr 172.21.15.7:0/3097841233 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.750+0000 7ff0c3fff640 1 --2- 172.21.15.7:0/3097841233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c4108290 0x7ff0c419ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.750+0000 7ff0c37fe640 1 --2- 172.21.15.7:0/3097841233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0c4102d90 0x7ff0c4198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.751+0000 7ff0bbfff640 1 -- 172.21.15.7:0/3097841233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0c4102d90 msgr2=0x7ff0c4198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.751+0000 7ff0bbfff640 1 --2- 172.21.15.7:0/3097841233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0c4102d90 0x7ff0c4198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.751+0000 7ff0bbfff640 1 -- 172.21.15.7:0/3097841233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c4108290 msgr2=0x7ff0c419ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.751+0000 7ff0bbfff640 1 --2- 172.21.15.7:0/3097841233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c4108290 0x7ff0c419ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.751+0000 7ff0bbfff640 1 -- 172.21.15.7:0/3097841233 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c419d5b0 con 0x7ff0c4103740 2024-09-19T08:46:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.751+0000 7ff0c3fff640 1 --2- 172.21.15.7:0/3097841233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c4108290 0x7ff0c419ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.751+0000 7ff0bbfff640 1 --2- 172.21.15.7:0/3097841233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c4103740 0x7ff0c4198b40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac02a940 tx=0x7ff0ac003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.751+0000 7ff0c17fa640 1 -- 172.21.15.7:0/3097841233 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac03f070 con 0x7ff0c4103740 2024-09-19T08:46:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.751+0000 7ff0c17fa640 1 -- 172.21.15.7:0/3097841233 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0ac031c90 con 0x7ff0c4103740 2024-09-19T08:46:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.751+0000 7ff0c9d40640 1 -- 172.21.15.7:0/3097841233 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0c419d840 con 0x7ff0c4103740 2024-09-19T08:46:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.751+0000 7ff0c17fa640 1 -- 172.21.15.7:0/3097841233 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac035030 con 0x7ff0c4103740 2024-09-19T08:46:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.751+0000 7ff0c9d40640 1 -- 172.21.15.7:0/3097841233 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0c41a5180 con 0x7ff0c4103740 2024-09-19T08:46:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.754+0000 7ff0c17fa640 1 -- 172.21.15.7:0/3097841233 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff0ac042070 con 0x7ff0c4103740 2024-09-19T08:46:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.754+0000 7ff0cc119740 1 Processor -- start 2024-09-19T08:46:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.754+0000 7ff0cc119740 1 -- start start 2024-09-19T08:46:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.754+0000 7ff0cc119740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce4539850 0x55cce4539c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.754+0000 7ff0cc119740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce453a170 0x55cce45444f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.754+0000 7ff0cc119740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4544a30 0x55cce4546e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.754+0000 7ff0cc119740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cce449e160 con 0x55cce4539850 2024-09-19T08:46:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.754+0000 7ff0cc119740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cce4445720 con 0x55cce453a170 2024-09-19T08:46:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.754+0000 7ff0cc119740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cce449a120 con 0x55cce4544a30 2024-09-19T08:46:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.754+0000 7ff0c3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce4539850 0x55cce4539c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.755+0000 7ff0c17fa640 1 --2- 172.21.15.7:0/3097841233 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff0b00a33b0 0x7ff0b00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.755+0000 7ff0c3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce4539850 0x55cce4539c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43606/0 (socket says 172.21.15.7:43606) 2024-09-19T08:46:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.755+0000 7ff0c3fff640 1 -- 172.21.15.7:0/4177643782 learned_addr learned my addr 172.21.15.7:0/4177643782 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.755+0000 7ff0c37fe640 1 --2- 172.21.15.7:0/4177643782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce453a170 0x55cce45444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.755+0000 7ff0c17fa640 1 -- 172.21.15.7:0/3097841233 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7ff0ac0f0510 con 0x7ff0c4103740 2024-09-19T08:46:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.755+0000 7ff0bbfff640 1 --2- 172.21.15.7:0/4177643782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4544a30 0x55cce4546e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.755+0000 7ff0c3fff640 1 --2- 172.21.15.7:0/3097841233 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff0b00a33b0 0x7ff0b00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.755+0000 7ff0c3fff640 1 -- 172.21.15.7:0/4177643782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4544a30 msgr2=0x55cce4546e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.755+0000 7ff0c3fff640 1 --2- 172.21.15.7:0/4177643782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4544a30 0x55cce4546e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.755+0000 7ff0c3fff640 1 -- 172.21.15.7:0/4177643782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce453a170 msgr2=0x55cce45444f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.755+0000 7ff0c3fff640 1 --2- 172.21.15.7:0/4177643782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce453a170 0x55cce45444f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.755+0000 7ff0c3fff640 1 -- 172.21.15.7:0/4177643782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cce420fba0 con 0x55cce4539850 2024-09-19T08:46:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.755+0000 7ff0c37fe640 1 --2- 172.21.15.7:0/4177643782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce453a170 0x55cce45444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.755+0000 7ff0c3fff640 1 --2- 172.21.15.7:0/4177643782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce4539850 0x55cce4539c30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc005c40 tx=0x7ff0bc012f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22974f956d77ed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.756+0000 7ff0b9ffb640 1 -- 172.21.15.7:0/4177643782 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc023030 con 0x55cce4539850 2024-09-19T08:46:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.756+0000 7ff0b9ffb640 1 -- 172.21.15.7:0/4177643782 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0bc01fc90 con 0x55cce4539850 2024-09-19T08:46:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.756+0000 7ff0b9ffb640 1 -- 172.21.15.7:0/4177643782 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc00fbc0 con 0x55cce4539850 2024-09-19T08:46:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.756+0000 7ff0c3fff640 1 --2- 172.21.15.7:0/3097841233 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff0b00a33b0 0x7ff0b00a5870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc023000 tx=0x7ff0bc022000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.756+0000 7ff0cc119740 1 -- 172.21.15.7:0/4177643782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce4539850 msgr2=0x55cce4539c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.756+0000 7ff0cc119740 1 --2- 172.21.15.7:0/4177643782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce4539850 0x55cce4539c30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc005c40 tx=0x7ff0bc012f80 comp rx=0 tx=0).stop 2024-09-19T08:46:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.756+0000 7ff0cc119740 1 -- 172.21.15.7:0/4177643782 shutdown_connections 2024-09-19T08:46:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.756+0000 7ff0cc119740 1 --2- 172.21.15.7:0/4177643782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4544a30 0x55cce4546e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.756+0000 7ff0cc119740 1 --2- 172.21.15.7:0/4177643782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce453a170 0x55cce45444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.756+0000 7ff0cc119740 1 --2- 172.21.15.7:0/4177643782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce4539850 0x55cce4539c30 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.757+0000 7ff0cc119740 1 -- 172.21.15.7:0/4177643782 >> 172.21.15.7:0/4177643782 conn(0x55cce4535de0 msgr2=0x55cce45361c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.757+0000 7ff0cc119740 1 -- 172.21.15.7:0/4177643782 shutdown_connections 2024-09-19T08:46:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.757+0000 7ff0cc119740 1 -- 172.21.15.7:0/4177643782 wait complete. 2024-09-19T08:46:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.757+0000 7ff0cc119740 1 -- start start 2024-09-19T08:46:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.757+0000 7ff0cc119740 1 Processor -- start 2024-09-19T08:46:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.758+0000 7ff0cc119740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce4539850 0x55cce45418f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.758+0000 7ff0cc119740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce453a170 0x55cce4541e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:19.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.758+0000 7ff0cc119740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4544a30 0x55cce4542370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:19.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.758+0000 7ff0cc119740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cce4547600 con 0x55cce453a170 2024-09-19T08:46:19.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.758+0000 7ff0cc119740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cce4426900 con 0x55cce4539850 2024-09-19T08:46:19.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.758+0000 7ff0cc119740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cce4547780 con 0x55cce4544a30 2024-09-19T08:46:19.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.758+0000 7ff0cc119740 10 client.0 _ll_register_callbacks cb 0x55cce4424780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:19.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.758+0000 7ff0bbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce453a170 0x55cce4541e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:19.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.758+0000 7ff0bbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce453a170 0x55cce4541e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43618/0 (socket says 172.21.15.7:43618) 2024-09-19T08:46:19.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.758+0000 7ff0c37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce4539850 0x55cce45418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:19.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.758+0000 7ff0bbfff640 1 -- 172.21.15.7:0/2652270439 learned_addr learned my addr 172.21.15.7:0/2652270439 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:19.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.758+0000 7ff0c3fff640 1 --2- 172.21.15.7:0/2652270439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4544a30 0x55cce4542370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.758+0000 7ff0bbfff640 1 -- 172.21.15.7:0/2652270439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4544a30 msgr2=0x55cce4542370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.758+0000 7ff0bbfff640 1 --2- 172.21.15.7:0/2652270439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4544a30 0x55cce4542370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.758+0000 7ff0bbfff640 1 -- 172.21.15.7:0/2652270439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce4539850 msgr2=0x55cce45418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.758+0000 7ff0bbfff640 1 --2- 172.21.15.7:0/2652270439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce4539850 0x55cce45418f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.758+0000 7ff0bbfff640 1 -- 172.21.15.7:0/2652270439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cce4466c50 con 0x55cce453a170 2024-09-19T08:46:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.758+0000 7ff0c37fe640 1 --2- 172.21.15.7:0/2652270439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce4539850 0x55cce45418f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.758+0000 7ff0bbfff640 1 --2- 172.21.15.7:0/2652270439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce453a170 0x55cce4541e30 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0b8c40 tx=0x7ff0ac005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b2de6fcb890e5e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.758+0000 7ff0a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.759+0000 7ff0a2ffd640 1 -- 172.21.15.7:0/2652270439 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac049040 con 0x55cce453a170 2024-09-19T08:46:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.759+0000 7ff0a2ffd640 1 -- 172.21.15.7:0/2652270439 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7ff0ac0b8e50 con 0x55cce453a170 2024-09-19T08:46:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.759+0000 7ff0cc119740 1 -- 172.21.15.7:0/2652270439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0bc01fc90 con 0x55cce453a170 2024-09-19T08:46:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.759+0000 7ff0a2ffd640 1 -- 172.21.15.7:0/2652270439 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff0ac0bcee0 con 0x55cce453a170 2024-09-19T08:46:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.759+0000 7ff0cc119740 10 client.15762 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.759+0000 7ff0cc119740 1 -- 172.21.15.7:0/2652270439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cce4553280 con 0x55cce453a170 2024-09-19T08:46:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.759+0000 7ff0a2ffd640 1 -- 172.21.15.7:0/2652270439 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0bc01fc90 con 0x55cce453a170 2024-09-19T08:46:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.759+0000 7ff0a2ffd640 1 -- 172.21.15.7:0/2652270439 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff0ac0c4fc0 con 0x55cce453a170 2024-09-19T08:46:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.759+0000 7ff0cc119740 10 client.15762 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.759+0000 7ff0cc119740 10 client.15762 resolve_mds: validated gid 24491 aka daemon mds.b 2024-09-19T08:46:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.759+0000 7ff0cc119740 20 client.15762 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.759+0000 7ff0cc119740 1 --2- 172.21.15.7:0/2652270439 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55cce4554770 0x55cce4556bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.759+0000 7ff0cc119740 4 client.15762 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:46:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.759+0000 7ff0cc119740 1 -- 172.21.15.7:0/2652270439 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cce44ab890 con 0x55cce4554770 2024-09-19T08:46:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.760+0000 7ff0c37fe640 1 --2- 172.21.15.7:0/2652270439 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55cce4554770 0x55cce4556bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.760+0000 7ff0a2ffd640 10 client.15762 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.760+0000 7ff0c37fe640 1 --2- 172.21.15.7:0/2652270439 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55cce4554770 0x55cce4556bf0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfb86f74cc5be8ab server_cookie=e44d4486886a5eb2 in_seq=0 out_seq=0 2024-09-19T08:46:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.761+0000 7ff0a2ffd640 1 -- 172.21.15.7:0/2652270439 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cce44ab890 con 0x55cce4554770 2024-09-19T08:46:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.761+0000 7ff0a2ffd640 10 client.15762 handle_command_reply: tid=0 2024-09-19T08:46:19.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.761+0000 7ff0cc119740 1 client.15762 shutdown 2024-09-19T08:46:19.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.761+0000 7ff0cc119740 1 -- 172.21.15.7:0/2652270439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce453a170 msgr2=0x55cce4541e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:19.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.761+0000 7ff0cc119740 1 --2- 172.21.15.7:0/2652270439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce453a170 0x55cce4541e30 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0b8c40 tx=0x7ff0ac005dc0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.761+0000 7ff0cc119740 1 -- 172.21.15.7:0/2652270439 shutdown_connections 2024-09-19T08:46:19.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.761+0000 7ff0cc119740 1 --2- 172.21.15.7:0/2652270439 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55cce4554770 0x55cce4556bf0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.761+0000 7ff0cc119740 1 --2- 172.21.15.7:0/2652270439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4544a30 0x55cce4542370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.761+0000 7ff0a2ffd640 0 client.15762 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:19.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.761+0000 7ff0cc119740 1 --2- 172.21.15.7:0/2652270439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce453a170 0x55cce4541e30 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.761+0000 7ff0cc119740 1 --2- 172.21.15.7:0/2652270439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce4539850 0x55cce45418f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.761+0000 7ff0cc119740 1 -- 172.21.15.7:0/2652270439 >> 172.21.15.7:0/2652270439 conn(0x55cce4535de0 msgr2=0x55cce453bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:19.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.761+0000 7ff0cc119740 1 -- 172.21.15.7:0/2652270439 shutdown_connections 2024-09-19T08:46:19.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.761+0000 7ff0cc119740 1 -- 172.21.15.7:0/2652270439 wait complete. 2024-09-19T08:46:19.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.762+0000 7ff0cc119740 20 client.15762 trim_cache size 0 max 16384 2024-09-19T08:46:19.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.779+0000 7ff0cc119740 1 Processor -- start 2024-09-19T08:46:19.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.779+0000 7ff0cc119740 1 -- start start 2024-09-19T08:46:19.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.779+0000 7ff0cc119740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4539850 0x55cce4534d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:19.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.780+0000 7ff0cc119740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce453a170 0x55cce453c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:19.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.780+0000 7ff0cc119740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce4544a30 0x55cce45401c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:19.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.780+0000 7ff0cc119740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c41b0200 con 0x55cce453a170 2024-09-19T08:46:19.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.780+0000 7ff0cc119740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c41adad0 con 0x55cce4544a30 2024-09-19T08:46:19.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.780+0000 7ff0cc119740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c41ab920 con 0x55cce4539850 2024-09-19T08:46:19.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.780+0000 7ff0bbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce453a170 0x55cce453c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:19.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.780+0000 7ff0bbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce453a170 0x55cce453c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43632/0 (socket says 172.21.15.7:43632) 2024-09-19T08:46:19.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.780+0000 7ff0bbfff640 1 -- 172.21.15.7:0/2357392824 learned_addr learned my addr 172.21.15.7:0/2357392824 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:19.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.780+0000 7ff0c37fe640 1 --2- 172.21.15.7:0/2357392824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4539850 0x55cce4534d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:19.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.780+0000 7ff0bbfff640 1 -- 172.21.15.7:0/2357392824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4539850 msgr2=0x55cce4534d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:19.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.780+0000 7ff0bbfff640 1 --2- 172.21.15.7:0/2357392824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4539850 0x55cce4534d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.780+0000 7ff0bbfff640 1 -- 172.21.15.7:0/2357392824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce4544a30 msgr2=0x55cce45401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:19.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.780+0000 7ff0c3fff640 1 --2- 172.21.15.7:0/2357392824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce4544a30 0x55cce45401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:19.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.780+0000 7ff0bbfff640 1 --2- 172.21.15.7:0/2357392824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce4544a30 0x55cce45401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.780+0000 7ff0bbfff640 1 -- 172.21.15.7:0/2357392824 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cce4539fa0 con 0x55cce453a170 2024-09-19T08:46:19.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.780+0000 7ff0c3fff640 1 --2- 172.21.15.7:0/2357392824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce4544a30 0x55cce45401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:46:19.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.780+0000 7ff0bbfff640 1 --2- 172.21.15.7:0/2357392824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce453a170 0x55cce453c2b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0ee250 tx=0x7ff0ac03b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a583cbc04978815 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:19.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.780+0000 7ff0b97fa640 1 -- 172.21.15.7:0/2357392824 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac049070 con 0x55cce453a170 2024-09-19T08:46:19.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.781+0000 7ff0b97fa640 1 -- 172.21.15.7:0/2357392824 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0ac0c5450 con 0x55cce453a170 2024-09-19T08:46:19.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.781+0000 7ff0b97fa640 1 -- 172.21.15.7:0/2357392824 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac0c4fc0 con 0x55cce453a170 2024-09-19T08:46:19.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.781+0000 7ff0cc119740 1 -- 172.21.15.7:0/2357392824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce453a170 msgr2=0x55cce453c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:19.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.781+0000 7ff0cc119740 1 --2- 172.21.15.7:0/2357392824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce453a170 0x55cce453c2b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0ee250 tx=0x7ff0ac03b790 comp rx=0 tx=0).stop 2024-09-19T08:46:19.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.781+0000 7ff0cc119740 1 -- 172.21.15.7:0/2357392824 shutdown_connections 2024-09-19T08:46:19.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.781+0000 7ff0cc119740 1 --2- 172.21.15.7:0/2357392824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce4544a30 0x55cce45401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.781+0000 7ff0cc119740 1 --2- 172.21.15.7:0/2357392824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce453a170 0x55cce453c2b0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.781+0000 7ff0cc119740 1 --2- 172.21.15.7:0/2357392824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4539850 0x55cce4534d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.781+0000 7ff0cc119740 1 -- 172.21.15.7:0/2357392824 >> 172.21.15.7:0/2357392824 conn(0x55cce4535de0 msgr2=0x55cce4543970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:19.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.781+0000 7ff0cc119740 1 -- 172.21.15.7:0/2357392824 shutdown_connections 2024-09-19T08:46:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.782+0000 7ff0cc119740 1 -- 172.21.15.7:0/2357392824 wait complete. 2024-09-19T08:46:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.782+0000 7ff0cc119740 1 -- start start 2024-09-19T08:46:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.782+0000 7ff0cc119740 1 Processor -- start 2024-09-19T08:46:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.782+0000 7ff0cc119740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4539850 0x55cce454cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.782+0000 7ff0cc119740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce453a170 0x55cce4549260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.782+0000 7ff0cc119740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce4544a30 0x55cce45497a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.782+0000 7ff0cc119740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c41abf90 con 0x55cce453a170 2024-09-19T08:46:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.782+0000 7ff0cc119740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c41ad400 con 0x55cce4544a30 2024-09-19T08:46:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.782+0000 7ff0cc119740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c41ac660 con 0x55cce4539850 2024-09-19T08:46:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.782+0000 7ff0cc119740 10 client.0 _ll_register_callbacks cb 0x7ff0ac031e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.783+0000 7ff0bbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce453a170 0x55cce4549260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.783+0000 7ff0bbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce453a170 0x55cce4549260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43648/0 (socket says 172.21.15.7:43648) 2024-09-19T08:46:19.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.783+0000 7ff0bbfff640 1 -- 172.21.15.7:0/584582794 learned_addr learned my addr 172.21.15.7:0/584582794 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:19.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.783+0000 7ff0c3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce4544a30 0x55cce45497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:19.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.783+0000 7ff0c37fe640 1 --2- 172.21.15.7:0/584582794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4539850 0x55cce454cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:19.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.783+0000 7ff0bbfff640 1 -- 172.21.15.7:0/584582794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4539850 msgr2=0x55cce454cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:19.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.783+0000 7ff0bbfff640 1 --2- 172.21.15.7:0/584582794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4539850 0x55cce454cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.783+0000 7ff0bbfff640 1 -- 172.21.15.7:0/584582794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce4544a30 msgr2=0x55cce45497a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:19.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.783+0000 7ff0bbfff640 1 --2- 172.21.15.7:0/584582794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce4544a30 0x55cce45497a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.783+0000 7ff0bbfff640 1 -- 172.21.15.7:0/584582794 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cce4549d90 con 0x55cce453a170 2024-09-19T08:46:19.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.783+0000 7ff0c3fff640 1 --2- 172.21.15.7:0/584582794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce4544a30 0x55cce45497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:19.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.783+0000 7ff0bbfff640 1 --2- 172.21.15.7:0/584582794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce453a170 0x55cce4549260 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009900 tx=0x7ff0ac005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ea885759939bb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:19.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.783+0000 7ff0a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:19.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.783+0000 7ff0a2ffd640 1 -- 172.21.15.7:0/584582794 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac049050 con 0x55cce453a170 2024-09-19T08:46:19.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.783+0000 7ff0a2ffd640 1 -- 172.21.15.7:0/584582794 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7ff0ac0319b0 con 0x55cce453a170 2024-09-19T08:46:19.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.783+0000 7ff0cc119740 1 -- 172.21.15.7:0/584582794 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0ac0c5450 con 0x55cce453a170 2024-09-19T08:46:19.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.784+0000 7ff0a2ffd640 1 -- 172.21.15.7:0/584582794 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff0ac0c51d0 con 0x55cce453a170 2024-09-19T08:46:19.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.784+0000 7ff0cc119740 10 client.15768 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:19.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.784+0000 7ff0cc119740 1 -- 172.21.15.7:0/584582794 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cce4549d90 con 0x55cce453a170 2024-09-19T08:46:19.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.784+0000 7ff0a2ffd640 1 -- 172.21.15.7:0/584582794 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0ac0c5450 con 0x55cce453a170 2024-09-19T08:46:19.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.784+0000 7ff0a2ffd640 1 -- 172.21.15.7:0/584582794 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff0ac0b8530 con 0x55cce453a170 2024-09-19T08:46:19.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.784+0000 7ff0cc119740 10 client.15768 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:19.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.784+0000 7ff0cc119740 10 client.15768 resolve_mds: validated gid 24491 aka daemon mds.b 2024-09-19T08:46:19.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.784+0000 7ff0cc119740 20 client.15768 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:19.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.784+0000 7ff0cc119740 1 --2- 172.21.15.7:0/584582794 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55cce4554770 0x55cce45c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:19.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.784+0000 7ff0cc119740 4 client.15768 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T08:46:19.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.784+0000 7ff0cc119740 1 -- 172.21.15.7:0/584582794 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x55cce44a5be0 con 0x55cce4554770 2024-09-19T08:46:19.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.784+0000 7ff0c37fe640 1 --2- 172.21.15.7:0/584582794 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55cce4554770 0x55cce45c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:19.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.785+0000 7ff0c37fe640 1 --2- 172.21.15.7:0/584582794 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55cce4554770 0x55cce45c25e0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e9839bc9d8e83cc server_cookie=5c22b8d666a0969c in_seq=0 out_seq=0 2024-09-19T08:46:19.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.785+0000 7ff0a2ffd640 10 client.15768 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:19.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.799+0000 7ff0a2ffd640 1 -- 172.21.15.7:0/584582794 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55cce44a5be0 con 0x55cce4554770 2024-09-19T08:46:19.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.799+0000 7ff0a2ffd640 10 client.15768 handle_command_reply: tid=0 2024-09-19T08:46:19.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.799+0000 7ff0cc119740 1 client.15768 shutdown 2024-09-19T08:46:19.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.799+0000 7ff0cc119740 1 -- 172.21.15.7:0/584582794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce453a170 msgr2=0x55cce4549260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:19.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.799+0000 7ff0cc119740 1 --2- 172.21.15.7:0/584582794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce453a170 0x55cce4549260 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009900 tx=0x7ff0ac005e50 comp rx=0 tx=0).stop 2024-09-19T08:46:19.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.800+0000 7ff0cc119740 1 -- 172.21.15.7:0/584582794 shutdown_connections 2024-09-19T08:46:19.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.800+0000 7ff0cc119740 1 --2- 172.21.15.7:0/584582794 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55cce4554770 0x55cce45c25e0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.800+0000 7ff0cc119740 1 --2- 172.21.15.7:0/584582794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cce4544a30 0x55cce45497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.800+0000 7ff0cc119740 1 --2- 172.21.15.7:0/584582794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cce453a170 0x55cce4549260 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.800+0000 7ff0cc119740 1 --2- 172.21.15.7:0/584582794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4539850 0x55cce454cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.800+0000 7ff0cc119740 1 -- 172.21.15.7:0/584582794 >> 172.21.15.7:0/584582794 conn(0x55cce4535de0 msgr2=0x55cce4543970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:19.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.800+0000 7ff0a2ffd640 0 client.15768 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:19.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.800+0000 7ff0cc119740 1 -- 172.21.15.7:0/584582794 shutdown_connections 2024-09-19T08:46:19.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.800+0000 7ff0cc119740 1 -- 172.21.15.7:0/584582794 wait complete. 2024-09-19T08:46:19.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.800+0000 7ff0cc119740 20 client.15768 trim_cache size 0 max 16384 2024-09-19T08:46:19.802 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:46:19.803 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 25, 2024-09-19T08:46:19.803 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24491, 2024-09-19T08:46:19.803 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 10, 2024-09-19T08:46:19.803 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": { 2024-09-19T08:46:19.803 INFO:teuthology.orchestra.run.smithi007.stdout: "b717c8cd": { 2024-09-19T08:46:19.803 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 10, 2024-09-19T08:46:19.803 INFO:teuthology.orchestra.run.smithi007.stdout: "age_ref": 0.0, 2024-09-19T08:46:19.803 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T08:46:19.803 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "QUIESCED", 2024-09-19T08:46:19.803 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T08:46:19.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:46:19.803 INFO:teuthology.orchestra.run.smithi007.stdout: "timeout": 90.0, 2024-09-19T08:46:19.803 INFO:teuthology.orchestra.run.smithi007.stdout: "expiration": 140.3, 2024-09-19T08:46:19.804 INFO:teuthology.orchestra.run.smithi007.stdout: "members": { 2024-09-19T08:46:19.804 INFO:teuthology.orchestra.run.smithi007.stdout: "file:/": { 2024-09-19T08:46:19.804 INFO:teuthology.orchestra.run.smithi007.stdout: "excluded": false, 2024-09-19T08:46:19.804 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T08:46:19.804 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "QUIESCED", 2024-09-19T08:46:19.804 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T08:46:19.804 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:46:19.804 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:46:19.804 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:46:19.805 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:46:19.805 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:46:19.805 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:46:19.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.801+0000 7ff0c9d40640 1 -- 172.21.15.7:0/3097841233 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff0b00a33b0 msgr2=0x7ff0b00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:19.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.801+0000 7ff0c9d40640 1 --2- 172.21.15.7:0/3097841233 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff0b00a33b0 0x7ff0b00a5870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc023000 tx=0x7ff0bc022000 comp rx=0 tx=0).stop 2024-09-19T08:46:19.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.801+0000 7ff0c9d40640 1 -- 172.21.15.7:0/3097841233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c4103740 msgr2=0x7ff0c4198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:19.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.801+0000 7ff0c9d40640 1 --2- 172.21.15.7:0/3097841233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c4103740 0x7ff0c4198b40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac02a940 tx=0x7ff0ac003b90 comp rx=0 tx=0).stop 2024-09-19T08:46:19.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.801+0000 7ff0c9d40640 1 -- 172.21.15.7:0/3097841233 shutdown_connections 2024-09-19T08:46:19.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.801+0000 7ff0c9d40640 1 --2- 172.21.15.7:0/3097841233 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff0b00a33b0 0x7ff0b00a5870 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.801+0000 7ff0c9d40640 1 --2- 172.21.15.7:0/3097841233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c4108290 0x7ff0c419ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.801+0000 7ff0c9d40640 1 --2- 172.21.15.7:0/3097841233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c4103740 0x7ff0c4198b40 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.801+0000 7ff0c9d40640 1 --2- 172.21.15.7:0/3097841233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0c4102d90 0x7ff0c4198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:19.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.801+0000 7ff0c9d40640 1 -- 172.21.15.7:0/3097841233 >> 172.21.15.7:0/3097841233 conn(0x7ff0c40fc7d0 msgr2=0x7ff0c4106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:19.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.801+0000 7ff0c9d40640 1 -- 172.21.15.7:0/3097841233 shutdown_connections 2024-09-19T08:46:19.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:19.801+0000 7ff0c9d40640 1 -- 172.21.15.7:0/3097841233 wait complete. 2024-09-19T08:46:19.807 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:19 smithi044 ceph-mon[35072]: scrub summary: idle 2024-09-19T08:46:20.495 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:20 smithi007 ceph-mon[31221]: pgmap v57: 97 pgs: 97 active+clean; 2.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 90 KiB/s wr, 6 op/s 2024-09-19T08:46:20.523 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b717c8cd', quiesce took 3.6 seconds. Will release after: 16.75 2024-09-19T08:46:20.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:20 smithi175 ceph-mon[35688]: pgmap v57: 97 pgs: 97 active+clean; 2.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 90 KiB/s wr, 6 op/s 2024-09-19T08:46:20.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:20 smithi044 ceph-mon[35072]: pgmap v57: 97 pgs: 97 active+clean; 2.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 90 KiB/s wr, 6 op/s 2024-09-19T08:46:22.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:22 smithi175 ceph-mon[35688]: pgmap v58: 97 pgs: 97 active+clean; 2.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 90 KiB/s wr, 6 op/s 2024-09-19T08:46:22.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:22 smithi007 ceph-mon[31221]: pgmap v58: 97 pgs: 97 active+clean; 2.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 90 KiB/s wr, 6 op/s 2024-09-19T08:46:22.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:22 smithi044 ceph-mon[35072]: pgmap v58: 97 pgs: 97 active+clean; 2.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 90 KiB/s wr, 6 op/s 2024-09-19T08:46:24.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:24 smithi175 ceph-mon[35688]: pgmap v59: 97 pgs: 97 active+clean; 2.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 350 KiB/s wr, 10 op/s 2024-09-19T08:46:24.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:24 smithi007 ceph-mon[31221]: pgmap v59: 97 pgs: 97 active+clean; 2.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 350 KiB/s wr, 10 op/s 2024-09-19T08:46:24.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:24 smithi044 ceph-mon[35072]: pgmap v59: 97 pgs: 97 active+clean; 2.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 350 KiB/s wr, 10 op/s 2024-09-19T08:46:26.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:26 smithi175 ceph-mon[35688]: pgmap v60: 97 pgs: 97 active+clean; 2.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 350 KiB/s wr, 7 op/s 2024-09-19T08:46:26.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:26 smithi007 ceph-mon[31221]: pgmap v60: 97 pgs: 97 active+clean; 2.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 350 KiB/s wr, 7 op/s 2024-09-19T08:46:26.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:26 smithi044 ceph-mon[35072]: pgmap v60: 97 pgs: 97 active+clean; 2.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 350 KiB/s wr, 7 op/s 2024-09-19T08:46:28.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:28 smithi175 ceph-mon[35688]: pgmap v61: 97 pgs: 97 active+clean; 90 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.7 MiB/s wr, 12 op/s 2024-09-19T08:46:28.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:28 smithi007 ceph-mon[31221]: pgmap v61: 97 pgs: 97 active+clean; 90 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.7 MiB/s wr, 12 op/s 2024-09-19T08:46:28.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:28 smithi044 ceph-mon[35072]: pgmap v61: 97 pgs: 97 active+clean; 90 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.7 MiB/s wr, 12 op/s 2024-09-19T08:46:30.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:30 smithi175 ceph-mon[35688]: pgmap v62: 97 pgs: 97 active+clean; 90 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 7.6 MiB/s wr, 8 op/s 2024-09-19T08:46:30.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:30 smithi007 ceph-mon[31221]: pgmap v62: 97 pgs: 97 active+clean; 90 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 7.6 MiB/s wr, 8 op/s 2024-09-19T08:46:30.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:30 smithi044 ceph-mon[35072]: pgmap v62: 97 pgs: 97 active+clean; 90 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 7.6 MiB/s wr, 8 op/s 2024-09-19T08:46:32.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:32 smithi175 ceph-mon[35688]: pgmap v63: 97 pgs: 97 active+clean; 90 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 7.6 MiB/s wr, 8 op/s 2024-09-19T08:46:32.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:32 smithi007 ceph-mon[31221]: pgmap v63: 97 pgs: 97 active+clean; 90 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 7.6 MiB/s wr, 8 op/s 2024-09-19T08:46:32.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:32 smithi044 ceph-mon[35072]: pgmap v63: 97 pgs: 97 active+clean; 90 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 7.6 MiB/s wr, 8 op/s 2024-09-19T08:46:34.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:34 smithi175 ceph-mon[35688]: pgmap v64: 97 pgs: 97 active+clean; 258 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 22 MiB/s wr, 14 op/s 2024-09-19T08:46:34.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:34 smithi007 ceph-mon[31221]: pgmap v64: 97 pgs: 97 active+clean; 258 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 22 MiB/s wr, 14 op/s 2024-09-19T08:46:34.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:34 smithi044 ceph-mon[35072]: pgmap v64: 97 pgs: 97 active+clean; 258 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 22 MiB/s wr, 14 op/s 2024-09-19T08:46:36.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:36 smithi175 ceph-mon[35688]: pgmap v65: 97 pgs: 97 active+clean; 258 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 21 MiB/s wr, 10 op/s 2024-09-19T08:46:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:36 smithi007 ceph-mon[31221]: pgmap v65: 97 pgs: 97 active+clean; 258 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 21 MiB/s wr, 10 op/s 2024-09-19T08:46:36.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:36 smithi044 ceph-mon[35072]: pgmap v65: 97 pgs: 97 active+clean; 258 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 21 MiB/s wr, 10 op/s 2024-09-19T08:46:37.274 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:46:37.547 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:46:38.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.004+0000 7f3b65f31640 1 -- 172.21.15.7:0/4278731713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b60100e20 msgr2=0x7f3b60101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:38.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.004+0000 7f3b65f31640 1 --2- 172.21.15.7:0/4278731713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b60100e20 0x7f3b60101200 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009900 tx=0x7f3b4802a480 comp rx=0 tx=0).stop 2024-09-19T08:46:38.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.004+0000 7f3b65f31640 1 -- 172.21.15.7:0/4278731713 shutdown_connections 2024-09-19T08:46:38.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.004+0000 7f3b65f31640 1 --2- 172.21.15.7:0/4278731713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b60102ef0 0x7f3b6010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:38.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.004+0000 7f3b65f31640 1 --2- 172.21.15.7:0/4278731713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b60102570 0x7f3b601029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:38.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.004+0000 7f3b65f31640 1 --2- 172.21.15.7:0/4278731713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b60100e20 0x7f3b60101200 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:38.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.004+0000 7f3b65f31640 1 -- 172.21.15.7:0/4278731713 >> 172.21.15.7:0/4278731713 conn(0x7f3b600fc7d0 msgr2=0x7f3b600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:38.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.004+0000 7f3b65f31640 1 -- 172.21.15.7:0/4278731713 shutdown_connections 2024-09-19T08:46:38.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.004+0000 7f3b65f31640 1 -- 172.21.15.7:0/4278731713 wait complete. 2024-09-19T08:46:38.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.005+0000 7f3b65f31640 1 Processor -- start 2024-09-19T08:46:38.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.005+0000 7f3b65f31640 1 -- start start 2024-09-19T08:46:38.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.005+0000 7f3b65f31640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b60100e20 0x7f3b60198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:38.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.005+0000 7f3b65f31640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b60102570 0x7f3b60198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:38.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.005+0000 7f3b65f31640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b60102ef0 0x7f3b6019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:38.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.005+0000 7f3b65f31640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3b60110f80 con 0x7f3b60102570 2024-09-19T08:46:38.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.005+0000 7f3b65f31640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3b60110e00 con 0x7f3b60100e20 2024-09-19T08:46:38.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.005+0000 7f3b65f31640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3b60111100 con 0x7f3b60102ef0 2024-09-19T08:46:38.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.005+0000 7f3b5effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b60102570 0x7f3b60198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:38.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.005+0000 7f3b5effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b60102570 0x7f3b60198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52032/0 (socket says 172.21.15.7:52032) 2024-09-19T08:46:38.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.005+0000 7f3b5effd640 1 -- 172.21.15.7:0/3264620912 learned_addr learned my addr 172.21.15.7:0/3264620912 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:38.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.006+0000 7f3b5f7fe640 1 --2- 172.21.15.7:0/3264620912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b60100e20 0x7f3b60198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:38.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.006+0000 7f3b5effd640 1 -- 172.21.15.7:0/3264620912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b60102ef0 msgr2=0x7f3b6019cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:38.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.006+0000 7f3b5ffff640 1 --2- 172.21.15.7:0/3264620912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b60102ef0 0x7f3b6019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:38.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.006+0000 7f3b5effd640 1 --2- 172.21.15.7:0/3264620912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b60102ef0 0x7f3b6019cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:38.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.006+0000 7f3b5effd640 1 -- 172.21.15.7:0/3264620912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b60100e20 msgr2=0x7f3b60198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:38.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.006+0000 7f3b5effd640 1 --2- 172.21.15.7:0/3264620912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b60100e20 0x7f3b60198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:38.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.006+0000 7f3b5effd640 1 -- 172.21.15.7:0/3264620912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6019d4d0 con 0x7f3b60102570 2024-09-19T08:46:38.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.006+0000 7f3b5f7fe640 1 --2- 172.21.15.7:0/3264620912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b60100e20 0x7f3b60198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:38.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.006+0000 7f3b5effd640 1 --2- 172.21.15.7:0/3264620912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b60102570 0x7f3b60198a60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3b5000e9f0 tx=0x7f3b5000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:38.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.006+0000 7f3b5cff9640 1 -- 172.21.15.7:0/3264620912 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5000cd80 con 0x7f3b60102570 2024-09-19T08:46:38.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.006+0000 7f3b5cff9640 1 -- 172.21.15.7:0/3264620912 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b50005500 con 0x7f3b60102570 2024-09-19T08:46:38.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.006+0000 7f3b65f31640 1 -- 172.21.15.7:0/3264620912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b6019d7c0 con 0x7f3b60102570 2024-09-19T08:46:38.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.006+0000 7f3b5cff9640 1 -- 172.21.15.7:0/3264620912 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b50010690 con 0x7f3b60102570 2024-09-19T08:46:38.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.006+0000 7f3b65f31640 1 -- 172.21.15.7:0/3264620912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b601a50a0 con 0x7f3b60102570 2024-09-19T08:46:38.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.007+0000 7f3b65f31640 1 -- 172.21.15.7:0/3264620912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b60101200 con 0x7f3b60102570 2024-09-19T08:46:38.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.008+0000 7f3b5cff9640 1 -- 172.21.15.7:0/3264620912 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f3b500046c0 con 0x7f3b60102570 2024-09-19T08:46:38.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.010+0000 7f3b5cff9640 1 --2- 172.21.15.7:0/3264620912 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3b4c0a33b0 0x7f3b4c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:38.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.010+0000 7f3b5f7fe640 1 --2- 172.21.15.7:0/3264620912 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3b4c0a33b0 0x7f3b4c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:38.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.010+0000 7f3b5cff9640 1 -- 172.21.15.7:0/3264620912 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f3b500d02f0 con 0x7f3b60102570 2024-09-19T08:46:38.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.010+0000 7f3b5f7fe640 1 --2- 172.21.15.7:0/3264620912 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3b4c0a33b0 0x7f3b4c0a5870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3b48005ab0 tx=0x7f3b48005a20 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:38.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.014+0000 7f3b5cff9640 1 -- 172.21.15.7:0/3264620912 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3b5009cc60 con 0x7f3b60102570 2024-09-19T08:46:38.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.232+0000 7f3b65f31640 1 -- 172.21.15.7:0/3264620912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b601a5270 con 0x7f3b60102570 2024-09-19T08:46:38.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.233+0000 7f3b5cff9640 1 -- 172.21.15.7:0/3264620912 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f3b5009c560 con 0x7f3b60102570 2024-09-19T08:46:38.233 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:46:38.233 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:46:38.234 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:46:38.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.235+0000 7f3b65f31640 1 -- 172.21.15.7:0/3264620912 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3b4c0a33b0 msgr2=0x7f3b4c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:38.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.235+0000 7f3b65f31640 1 --2- 172.21.15.7:0/3264620912 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3b4c0a33b0 0x7f3b4c0a5870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3b48005ab0 tx=0x7f3b48005a20 comp rx=0 tx=0).stop 2024-09-19T08:46:38.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.235+0000 7f3b65f31640 1 -- 172.21.15.7:0/3264620912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b60102570 msgr2=0x7f3b60198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:38.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.235+0000 7f3b65f31640 1 --2- 172.21.15.7:0/3264620912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b60102570 0x7f3b60198a60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3b5000e9f0 tx=0x7f3b5000edf0 comp rx=0 tx=0).stop 2024-09-19T08:46:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.235+0000 7f3b65f31640 1 -- 172.21.15.7:0/3264620912 shutdown_connections 2024-09-19T08:46:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.235+0000 7f3b65f31640 1 --2- 172.21.15.7:0/3264620912 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3b4c0a33b0 0x7f3b4c0a5870 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.235+0000 7f3b65f31640 1 --2- 172.21.15.7:0/3264620912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b60102ef0 0x7f3b6019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.235+0000 7f3b65f31640 1 --2- 172.21.15.7:0/3264620912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b60102570 0x7f3b60198a60 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.235+0000 7f3b65f31640 1 --2- 172.21.15.7:0/3264620912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b60100e20 0x7f3b60198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.235+0000 7f3b65f31640 1 -- 172.21.15.7:0/3264620912 >> 172.21.15.7:0/3264620912 conn(0x7f3b600fc7d0 msgr2=0x7f3b6006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.236+0000 7f3b65f31640 1 -- 172.21.15.7:0/3264620912 shutdown_connections 2024-09-19T08:46:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:38.236+0000 7f3b65f31640 1 -- 172.21.15.7:0/3264620912 wait complete. 2024-09-19T08:46:38.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:38 smithi007 ceph-mon[31221]: pgmap v66: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 21 MiB/s wr, 13 op/s 2024-09-19T08:46:38.534 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:38 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3264620912' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:46:38.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:38 smithi175 ceph-mon[35688]: pgmap v66: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 21 MiB/s wr, 13 op/s 2024-09-19T08:46:38.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:38 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3264620912' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:46:38.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:38 smithi044 ceph-mon[35072]: pgmap v66: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 21 MiB/s wr, 13 op/s 2024-09-19T08:46:38.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:38 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3264620912' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:46:38.896 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24491 quiesce db --set-id b717c8cd --release --await' 2024-09-19T08:46:38.896 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24491 quiesce db --set-id b717c8cd --release --await 2024-09-19T08:46:39.157 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:46:39.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.701+0000 7f751fb73640 1 -- 172.21.15.7:0/3144284580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7518102ef0 msgr2=0x7f751810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:39.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.701+0000 7f751fb73640 1 --2- 172.21.15.7:0/3144284580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7518102ef0 0x7f751810da40 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7510009ca0 tx=0x7f751002a950 comp rx=0 tx=0).stop 2024-09-19T08:46:39.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.701+0000 7f751fb73640 1 -- 172.21.15.7:0/3144284580 shutdown_connections 2024-09-19T08:46:39.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.701+0000 7f751fb73640 1 --2- 172.21.15.7:0/3144284580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7518102ef0 0x7f751810da40 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.701+0000 7f751fb73640 1 --2- 172.21.15.7:0/3144284580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7518102570 0x7f75181029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.701+0000 7f751fb73640 1 --2- 172.21.15.7:0/3144284580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7518100e20 0x7f7518101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.701+0000 7f751fb73640 1 -- 172.21.15.7:0/3144284580 >> 172.21.15.7:0/3144284580 conn(0x7f75180fc7d0 msgr2=0x7f75180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:39.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.701+0000 7f751fb73640 1 -- 172.21.15.7:0/3144284580 shutdown_connections 2024-09-19T08:46:39.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.701+0000 7f751fb73640 1 -- 172.21.15.7:0/3144284580 wait complete. 2024-09-19T08:46:39.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.702+0000 7f751fb73640 1 Processor -- start 2024-09-19T08:46:39.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.702+0000 7f751fb73640 1 -- start start 2024-09-19T08:46:39.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.702+0000 7f751fb73640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7518100e20 0x7f75181984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:39.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.702+0000 7f751fb73640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7518102570 0x7f75181989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:39.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.702+0000 7f751fb73640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7518102ef0 0x7f751819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:39.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.702+0000 7f751fb73640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7518110f80 con 0x7f7518100e20 2024-09-19T08:46:39.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.702+0000 7f751fb73640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7518110e00 con 0x7f7518102ef0 2024-09-19T08:46:39.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.702+0000 7f751fb73640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7518111100 con 0x7f7518102570 2024-09-19T08:46:39.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.702+0000 7f751d90f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7518100e20 0x7f75181984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:39.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.702+0000 7f751d90f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7518100e20 0x7f75181984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52050/0 (socket says 172.21.15.7:52050) 2024-09-19T08:46:39.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.702+0000 7f751d90f640 1 -- 172.21.15.7:0/3982588900 learned_addr learned my addr 172.21.15.7:0/3982588900 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:39.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.703+0000 7f751d10e640 1 --2- 172.21.15.7:0/3982588900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7518102570 0x7f75181989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:39.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.703+0000 7f751d90f640 1 -- 172.21.15.7:0/3982588900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7518102570 msgr2=0x7f75181989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:39.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.703+0000 7f751d90f640 1 --2- 172.21.15.7:0/3982588900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7518102570 0x7f75181989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.703+0000 7f751e110640 1 --2- 172.21.15.7:0/3982588900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7518102ef0 0x7f751819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:39.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.703+0000 7f751d90f640 1 -- 172.21.15.7:0/3982588900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7518102ef0 msgr2=0x7f751819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:39.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.703+0000 7f751d90f640 1 --2- 172.21.15.7:0/3982588900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7518102ef0 0x7f751819cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.703+0000 7f751d90f640 1 -- 172.21.15.7:0/3982588900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751819d460 con 0x7f7518100e20 2024-09-19T08:46:39.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.703+0000 7f751d90f640 1 --2- 172.21.15.7:0/3982588900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7518100e20 0x7f75181984b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f751400e9f0 tx=0x7f751400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:39.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.703+0000 7f750effd640 1 -- 172.21.15.7:0/3982588900 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751400cd80 con 0x7f7518100e20 2024-09-19T08:46:39.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.703+0000 7f751fb73640 1 -- 172.21.15.7:0/3982588900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f751819d750 con 0x7f7518100e20 2024-09-19T08:46:39.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.703+0000 7f750effd640 1 -- 172.21.15.7:0/3982588900 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7514005500 con 0x7f7518100e20 2024-09-19T08:46:39.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.703+0000 7f750effd640 1 -- 172.21.15.7:0/3982588900 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7514010690 con 0x7f7518100e20 2024-09-19T08:46:39.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.703+0000 7f751fb73640 1 -- 172.21.15.7:0/3982588900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75181a5030 con 0x7f7518100e20 2024-09-19T08:46:39.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.706+0000 7f750effd640 1 -- 172.21.15.7:0/3982588900 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f75140046c0 con 0x7f7518100e20 2024-09-19T08:46:39.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.706+0000 7f7521f4c740 1 Processor -- start 2024-09-19T08:46:39.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.706+0000 7f7521f4c740 1 -- start start 2024-09-19T08:46:39.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.706+0000 7f7521f4c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c881af40 0x5644c881b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:39.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.706+0000 7f7521f4c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644c881b860 0x5644c882a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:39.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.706+0000 7f7521f4c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644c882a650 0x5644c882ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:39.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.706+0000 7f7521f4c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5644c8780620 con 0x5644c881af40 2024-09-19T08:46:39.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.706+0000 7f7521f4c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5644c8727e50 con 0x5644c882a650 2024-09-19T08:46:39.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.706+0000 7f7521f4c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5644c877c5e0 con 0x5644c881b860 2024-09-19T08:46:39.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.707+0000 7f750effd640 1 --2- 172.21.15.7:0/3982588900 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f75040a33b0 0x7f75040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:39.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.707+0000 7f751e110640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c881af40 0x5644c881b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:39.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.707+0000 7f751e110640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c881af40 0x5644c881b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52058/0 (socket says 172.21.15.7:52058) 2024-09-19T08:46:39.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.707+0000 7f751e110640 1 -- 172.21.15.7:0/2413734575 learned_addr learned my addr 172.21.15.7:0/2413734575 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:39.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.707+0000 7f751d10e640 1 --2- 172.21.15.7:0/2413734575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644c882a650 0x5644c882ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:39.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.707+0000 7f750effd640 1 -- 172.21.15.7:0/3982588900 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f75140d0290 con 0x7f7518100e20 2024-09-19T08:46:39.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.707+0000 7f751d90f640 1 --2- 172.21.15.7:0/2413734575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644c881b860 0x5644c882a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:39.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.707+0000 7f751e110640 1 --2- 172.21.15.7:0/3982588900 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f75040a33b0 0x7f75040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:39.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.707+0000 7f751e110640 1 -- 172.21.15.7:0/2413734575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644c881b860 msgr2=0x5644c882a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:39.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.707+0000 7f751e110640 1 --2- 172.21.15.7:0/2413734575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644c881b860 0x5644c882a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.707+0000 7f751e110640 1 -- 172.21.15.7:0/2413734575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644c882a650 msgr2=0x5644c882ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:39.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.707+0000 7f751e110640 1 --2- 172.21.15.7:0/2413734575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644c882a650 0x5644c882ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.707+0000 7f751e110640 1 -- 172.21.15.7:0/2413734575 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644c8718d40 con 0x5644c881af40 2024-09-19T08:46:39.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.707+0000 7f751e110640 1 --2- 172.21.15.7:0/2413734575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c881af40 0x5644c881b320 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7510005e30 tx=0x7f751002fc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a10e5b34e8bae1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:39.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.708+0000 7f751e110640 1 --2- 172.21.15.7:0/3982588900 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f75040a33b0 0x7f75040a5870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7510009430 tx=0x7f7510048000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:39.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.708+0000 7f7503fff640 1 -- 172.21.15.7:0/2413734575 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751004e070 con 0x5644c881af40 2024-09-19T08:46:39.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.708+0000 7f7503fff640 1 -- 172.21.15.7:0/2413734575 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f751002f720 con 0x5644c881af40 2024-09-19T08:46:39.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.708+0000 7f7503fff640 1 -- 172.21.15.7:0/2413734575 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7510034070 con 0x5644c881af40 2024-09-19T08:46:39.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.709+0000 7f7521f4c740 1 -- 172.21.15.7:0/2413734575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c881af40 msgr2=0x5644c881b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:39.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.709+0000 7f7521f4c740 1 --2- 172.21.15.7:0/2413734575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c881af40 0x5644c881b320 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7510005e30 tx=0x7f751002fc50 comp rx=0 tx=0).stop 2024-09-19T08:46:39.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.709+0000 7f7521f4c740 1 -- 172.21.15.7:0/2413734575 shutdown_connections 2024-09-19T08:46:39.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.709+0000 7f7521f4c740 1 --2- 172.21.15.7:0/2413734575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644c882a650 0x5644c882ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.709+0000 7f7521f4c740 1 --2- 172.21.15.7:0/2413734575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644c881b860 0x5644c882a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.709+0000 7f7521f4c740 1 --2- 172.21.15.7:0/2413734575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c881af40 0x5644c881b320 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.709+0000 7f7521f4c740 1 -- 172.21.15.7:0/2413734575 >> 172.21.15.7:0/2413734575 conn(0x5644c88175f0 msgr2=0x5644c88179d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:39.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.709+0000 7f7521f4c740 1 -- 172.21.15.7:0/2413734575 shutdown_connections 2024-09-19T08:46:39.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.709+0000 7f7521f4c740 1 -- 172.21.15.7:0/2413734575 wait complete. 2024-09-19T08:46:39.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.709+0000 7f7521f4c740 1 -- start start 2024-09-19T08:46:39.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.709+0000 7f7521f4c740 1 Processor -- start 2024-09-19T08:46:39.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.710+0000 7f7521f4c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644c881af40 0x5644c88275d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:39.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.710+0000 7f7521f4c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644c881b860 0x5644c8827b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:39.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.710+0000 7f7521f4c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c882a650 0x5644c8828050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:39.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.710+0000 7f7521f4c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5644c882d220 con 0x5644c882a650 2024-09-19T08:46:39.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.710+0000 7f7521f4c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5644c8708f10 con 0x5644c881af40 2024-09-19T08:46:39.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.710+0000 7f7521f4c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5644c882d3a0 con 0x5644c881b860 2024-09-19T08:46:39.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.710+0000 7f7521f4c740 10 client.0 _ll_register_callbacks cb 0x5644c872cdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:39.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.710+0000 7f751e110640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c882a650 0x5644c8828050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:39.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.710+0000 7f751e110640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c882a650 0x5644c8828050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52066/0 (socket says 172.21.15.7:52066) 2024-09-19T08:46:39.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.710+0000 7f751d90f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644c881af40 0x5644c88275d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:39.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.710+0000 7f751e110640 1 -- 172.21.15.7:0/4229148274 learned_addr learned my addr 172.21.15.7:0/4229148274 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:39.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.710+0000 7f751d10e640 1 --2- 172.21.15.7:0/4229148274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644c881b860 0x5644c8827b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:39.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.710+0000 7f751e110640 1 -- 172.21.15.7:0/4229148274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644c881b860 msgr2=0x5644c8827b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:39.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.710+0000 7f751e110640 1 --2- 172.21.15.7:0/4229148274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644c881b860 0x5644c8827b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.710+0000 7f751e110640 1 -- 172.21.15.7:0/4229148274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644c881af40 msgr2=0x5644c88275d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:39.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.710+0000 7f751e110640 1 --2- 172.21.15.7:0/4229148274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644c881af40 0x5644c88275d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.710+0000 7f751e110640 1 -- 172.21.15.7:0/4229148274 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644c848f580 con 0x5644c882a650 2024-09-19T08:46:39.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.710+0000 7f751d90f640 1 --2- 172.21.15.7:0/4229148274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644c881af40 0x5644c88275d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:39.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.710+0000 7f751e110640 1 --2- 172.21.15.7:0/4229148274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c882a650 0x5644c8828050 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f751002fcc0 tx=0x7f7510004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3cdae2ad9a81c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:39.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.710+0000 7f75017fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:39.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.711+0000 7f75017fa640 1 -- 172.21.15.7:0/4229148274 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7510055020 con 0x5644c882a650 2024-09-19T08:46:39.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.711+0000 7f75017fa640 1 -- 172.21.15.7:0/4229148274 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f75100487f0 con 0x5644c882a650 2024-09-19T08:46:39.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.711+0000 7f7521f4c740 1 -- 172.21.15.7:0/4229148274 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f751002f720 con 0x5644c882a650 2024-09-19T08:46:39.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.711+0000 7f75017fa640 1 -- 172.21.15.7:0/4229148274 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7510060050 con 0x5644c882a650 2024-09-19T08:46:39.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.711+0000 7f7521f4c740 10 client.15786 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:39.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.711+0000 7f7521f4c740 1 -- 172.21.15.7:0/4229148274 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5644c8559960 con 0x5644c882a650 2024-09-19T08:46:39.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.711+0000 7f75017fa640 1 -- 172.21.15.7:0/4229148274 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f751002f720 con 0x5644c882a650 2024-09-19T08:46:39.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.711+0000 7f75017fa640 1 -- 172.21.15.7:0/4229148274 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f75100305d0 con 0x5644c882a650 2024-09-19T08:46:39.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.711+0000 7f7521f4c740 10 client.15786 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:39.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.711+0000 7f7521f4c740 10 client.15786 resolve_mds: validated gid 24491 aka daemon mds.b 2024-09-19T08:46:39.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.711+0000 7f7521f4c740 20 client.15786 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:39.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.711+0000 7f7521f4c740 1 --2- 172.21.15.7:0/4229148274 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5644c883a110 0x5644c883c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:39.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.711+0000 7f7521f4c740 4 client.15786 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:46:39.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.711+0000 7f7521f4c740 1 -- 172.21.15.7:0/4229148274 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644c878db90 con 0x5644c883a110 2024-09-19T08:46:39.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.712+0000 7f751d90f640 1 --2- 172.21.15.7:0/4229148274 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5644c883a110 0x5644c883c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:39.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.712+0000 7f751d90f640 1 --2- 172.21.15.7:0/4229148274 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5644c883a110 0x5644c883c500 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bfdc8acf50ce75f server_cookie=f04b5cff06632754 in_seq=0 out_seq=0 2024-09-19T08:46:39.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.712+0000 7f75017fa640 10 client.15786 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:39.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.713+0000 7f75017fa640 1 -- 172.21.15.7:0/4229148274 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5644c878db90 con 0x5644c883a110 2024-09-19T08:46:39.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.713+0000 7f75017fa640 10 client.15786 handle_command_reply: tid=0 2024-09-19T08:46:39.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.713+0000 7f7521f4c740 1 client.15786 shutdown 2024-09-19T08:46:39.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.713+0000 7f7521f4c740 1 -- 172.21.15.7:0/4229148274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c882a650 msgr2=0x5644c8828050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:39.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.713+0000 7f7521f4c740 1 --2- 172.21.15.7:0/4229148274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c882a650 0x5644c8828050 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f751002fcc0 tx=0x7f7510004640 comp rx=0 tx=0).stop 2024-09-19T08:46:39.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.713+0000 7f7521f4c740 1 -- 172.21.15.7:0/4229148274 shutdown_connections 2024-09-19T08:46:39.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.713+0000 7f7521f4c740 1 --2- 172.21.15.7:0/4229148274 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5644c883a110 0x5644c883c500 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.713+0000 7f7521f4c740 1 --2- 172.21.15.7:0/4229148274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c882a650 0x5644c8828050 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.713+0000 7f7521f4c740 1 --2- 172.21.15.7:0/4229148274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644c881b860 0x5644c8827b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.713+0000 7f7521f4c740 1 --2- 172.21.15.7:0/4229148274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644c881af40 0x5644c88275d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.713+0000 7f75017fa640 0 client.15786 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:39.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.713+0000 7f7521f4c740 1 -- 172.21.15.7:0/4229148274 >> 172.21.15.7:0/4229148274 conn(0x5644c88175f0 msgr2=0x5644c881d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:39.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.713+0000 7f7521f4c740 1 -- 172.21.15.7:0/4229148274 shutdown_connections 2024-09-19T08:46:39.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.713+0000 7f7521f4c740 1 -- 172.21.15.7:0/4229148274 wait complete. 2024-09-19T08:46:39.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.713+0000 7f7521f4c740 20 client.15786 trim_cache size 0 max 16384 2024-09-19T08:46:39.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.730+0000 7f7521f4c740 1 Processor -- start 2024-09-19T08:46:39.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.730+0000 7f7521f4c740 1 -- start start 2024-09-19T08:46:39.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.730+0000 7f7521f4c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c881af40 0x5644c8825ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:39.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.730+0000 7f7521f4c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644c881b860 0x5644c8816640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:39.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.730+0000 7f7521f4c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644c882a650 0x5644c8841bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:39.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.730+0000 7f7521f4c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f75181adea0 con 0x5644c881af40 2024-09-19T08:46:39.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.730+0000 7f7521f4c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f75181ab770 con 0x5644c881b860 2024-09-19T08:46:39.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.730+0000 7f7521f4c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f75181a95c0 con 0x5644c882a650 2024-09-19T08:46:39.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.731+0000 7f751d90f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c881af40 0x5644c8825ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:39.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.731+0000 7f751d90f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c881af40 0x5644c8825ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52070/0 (socket says 172.21.15.7:52070) 2024-09-19T08:46:39.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.731+0000 7f751d90f640 1 -- 172.21.15.7:0/4073994264 learned_addr learned my addr 172.21.15.7:0/4073994264 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:39.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.731+0000 7f751d10e640 1 --2- 172.21.15.7:0/4073994264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644c881b860 0x5644c8816640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:39.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.731+0000 7f751e110640 1 --2- 172.21.15.7:0/4073994264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644c882a650 0x5644c8841bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:39.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.731+0000 7f751d90f640 1 -- 172.21.15.7:0/4073994264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644c882a650 msgr2=0x5644c8841bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:39.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.731+0000 7f751d90f640 1 --2- 172.21.15.7:0/4073994264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644c882a650 0x5644c8841bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.731+0000 7f751d90f640 1 -- 172.21.15.7:0/4073994264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644c881b860 msgr2=0x5644c8816640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:39.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.731+0000 7f751d90f640 1 --2- 172.21.15.7:0/4073994264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644c881b860 0x5644c8816640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.731+0000 7f751d90f640 1 -- 172.21.15.7:0/4073994264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644c8815bb0 con 0x5644c881af40 2024-09-19T08:46:39.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.731+0000 7f751d90f640 1 --2- 172.21.15.7:0/4073994264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c881af40 0x5644c8825ea0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f75140cdfd0 tx=0x7f7514098800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3247e0d950d7023f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:39.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.731+0000 7f75037fe640 1 -- 172.21.15.7:0/4073994264 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751409c560 con 0x5644c881af40 2024-09-19T08:46:39.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.731+0000 7f75037fe640 1 -- 172.21.15.7:0/4073994264 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75140a0910 con 0x5644c881af40 2024-09-19T08:46:39.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.731+0000 7f75037fe640 1 -- 172.21.15.7:0/4073994264 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75140a4fa0 con 0x5644c881af40 2024-09-19T08:46:39.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.732+0000 7f7521f4c740 1 -- 172.21.15.7:0/4073994264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c881af40 msgr2=0x5644c8825ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:39.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.732+0000 7f7521f4c740 1 --2- 172.21.15.7:0/4073994264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c881af40 0x5644c8825ea0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f75140cdfd0 tx=0x7f7514098800 comp rx=0 tx=0).stop 2024-09-19T08:46:39.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.732+0000 7f7521f4c740 1 -- 172.21.15.7:0/4073994264 shutdown_connections 2024-09-19T08:46:39.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.732+0000 7f7521f4c740 1 --2- 172.21.15.7:0/4073994264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644c882a650 0x5644c8841bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.732+0000 7f7521f4c740 1 --2- 172.21.15.7:0/4073994264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644c881b860 0x5644c8816640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.732+0000 7f7521f4c740 1 --2- 172.21.15.7:0/4073994264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c881af40 0x5644c8825ea0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.732+0000 7f7521f4c740 1 -- 172.21.15.7:0/4073994264 >> 172.21.15.7:0/4073994264 conn(0x5644c88175f0 msgr2=0x5644c8815f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:39.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.732+0000 7f7521f4c740 1 -- 172.21.15.7:0/4073994264 shutdown_connections 2024-09-19T08:46:39.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.732+0000 7f7521f4c740 1 -- 172.21.15.7:0/4073994264 wait complete. 2024-09-19T08:46:39.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.732+0000 7f7521f4c740 1 -- start start 2024-09-19T08:46:39.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.732+0000 7f7521f4c740 1 Processor -- start 2024-09-19T08:46:39.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.733+0000 7f7521f4c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c881af40 0x5644c8832810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:39.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.733+0000 7f7521f4c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644c881b860 0x5644c8832d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:39.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.733+0000 7f7521f4c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644c882a650 0x5644c882f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:39.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.733+0000 7f7521f4c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f75181a9c30 con 0x5644c881af40 2024-09-19T08:46:39.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.733+0000 7f7521f4c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f75181ab0a0 con 0x5644c882a650 2024-09-19T08:46:39.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.733+0000 7f7521f4c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f75181aa300 con 0x5644c881b860 2024-09-19T08:46:39.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.733+0000 7f7521f4c740 10 client.0 _ll_register_callbacks cb 0x7f751400cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:39.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.733+0000 7f751d90f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c881af40 0x5644c8832810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:39.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.733+0000 7f751d90f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c881af40 0x5644c8832810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52080/0 (socket says 172.21.15.7:52080) 2024-09-19T08:46:39.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.733+0000 7f751d90f640 1 -- 172.21.15.7:0/3013291917 learned_addr learned my addr 172.21.15.7:0/3013291917 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:39.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.733+0000 7f751d10e640 1 --2- 172.21.15.7:0/3013291917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644c881b860 0x5644c8832d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:39.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.733+0000 7f751e110640 1 --2- 172.21.15.7:0/3013291917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644c882a650 0x5644c882f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:39.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.733+0000 7f751d90f640 1 -- 172.21.15.7:0/3013291917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644c881b860 msgr2=0x5644c8832d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:39.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.733+0000 7f751d90f640 1 --2- 172.21.15.7:0/3013291917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644c881b860 0x5644c8832d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.733+0000 7f751d90f640 1 -- 172.21.15.7:0/3013291917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644c882a650 msgr2=0x5644c882f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:39.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.733+0000 7f751d90f640 1 --2- 172.21.15.7:0/3013291917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644c882a650 0x5644c882f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.733+0000 7f751d90f640 1 -- 172.21.15.7:0/3013291917 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644c882fdd0 con 0x5644c881af40 2024-09-19T08:46:39.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.733+0000 7f751d90f640 1 --2- 172.21.15.7:0/3013291917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c881af40 0x5644c8832810 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f751409c260 tx=0x7f75140a52a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c3262fd2f558dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:39.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.733+0000 7f75017fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.734+0000 7f75017fa640 1 -- 172.21.15.7:0/3013291917 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7514066060 con 0x5644c881af40 2024-09-19T08:46:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.734+0000 7f75017fa640 1 -- 172.21.15.7:0/3013291917 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f75140a4d40 con 0x5644c881af40 2024-09-19T08:46:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.734+0000 7f7521f4c740 1 -- 172.21.15.7:0/3013291917 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75140a0910 con 0x5644c881af40 2024-09-19T08:46:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.734+0000 7f75017fa640 1 -- 172.21.15.7:0/3013291917 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f75140a4f80 con 0x5644c881af40 2024-09-19T08:46:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.734+0000 7f7521f4c740 10 client.15792 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.734+0000 7f7521f4c740 1 -- 172.21.15.7:0/3013291917 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5644c88a5610 con 0x5644c881af40 2024-09-19T08:46:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.734+0000 7f75017fa640 1 -- 172.21.15.7:0/3013291917 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75140a0910 con 0x5644c881af40 2024-09-19T08:46:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.734+0000 7f75017fa640 1 -- 172.21.15.7:0/3013291917 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f751409b9b0 con 0x5644c881af40 2024-09-19T08:46:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.734+0000 7f7521f4c740 10 client.15792 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.734+0000 7f7521f4c740 10 client.15792 resolve_mds: validated gid 24491 aka daemon mds.b 2024-09-19T08:46:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.734+0000 7f7521f4c740 20 client.15792 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.734+0000 7f7521f4c740 1 --2- 172.21.15.7:0/3013291917 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5644c88a5c80 0x5644c88a8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.734+0000 7f7521f4c740 4 client.15792 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b717c8cd", "release": true, "await": true}] 2024-09-19T08:46:39.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.734+0000 7f7521f4c740 1 -- 172.21.15.7:0/3013291917 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b717c8cd", "release": true, "await": true}) -- 0x5644c87880a0 con 0x5644c88a5c80 2024-09-19T08:46:39.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.734+0000 7f751d10e640 1 --2- 172.21.15.7:0/3013291917 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5644c88a5c80 0x5644c88a8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:39.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.735+0000 7f75017fa640 10 client.15792 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:39.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.735+0000 7f751d10e640 1 --2- 172.21.15.7:0/3013291917 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5644c88a5c80 0x5644c88a8070 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=373068ba39967152 server_cookie=e5a552867b086c13 in_seq=0 out_seq=0 2024-09-19T08:46:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.737+0000 7f75017fa640 1 -- 172.21.15.7:0/3013291917 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5644c87880a0 con 0x5644c88a5c80 2024-09-19T08:46:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.737+0000 7f75017fa640 10 client.15792 handle_command_reply: tid=0 2024-09-19T08:46:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.737+0000 7f7521f4c740 1 client.15792 shutdown 2024-09-19T08:46:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.737+0000 7f7521f4c740 1 -- 172.21.15.7:0/3013291917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c881af40 msgr2=0x5644c8832810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.737+0000 7f7521f4c740 1 --2- 172.21.15.7:0/3013291917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c881af40 0x5644c8832810 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f751409c260 tx=0x7f75140a52a0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.738+0000 7f7521f4c740 1 -- 172.21.15.7:0/3013291917 shutdown_connections 2024-09-19T08:46:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.738+0000 7f7521f4c740 1 --2- 172.21.15.7:0/3013291917 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5644c88a5c80 0x5644c88a8070 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.738+0000 7f7521f4c740 1 --2- 172.21.15.7:0/3013291917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644c882a650 0x5644c882f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.738+0000 7f7521f4c740 1 --2- 172.21.15.7:0/3013291917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5644c881b860 0x5644c8832d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.738+0000 7f75017fa640 0 client.15792 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:39.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.738+0000 7f7521f4c740 1 --2- 172.21.15.7:0/3013291917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644c881af40 0x5644c8832810 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.738+0000 7f7521f4c740 1 -- 172.21.15.7:0/3013291917 >> 172.21.15.7:0/3013291917 conn(0x5644c88175f0 msgr2=0x5644c881d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:39.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.738+0000 7f7521f4c740 1 -- 172.21.15.7:0/3013291917 shutdown_connections 2024-09-19T08:46:39.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.738+0000 7f7521f4c740 1 -- 172.21.15.7:0/3013291917 wait complete. 2024-09-19T08:46:39.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.738+0000 7f7521f4c740 20 client.15792 trim_cache size 0 max 16384 2024-09-19T08:46:39.741 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:46:39.741 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 25, 2024-09-19T08:46:39.741 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24491, 2024-09-19T08:46:39.741 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 12, 2024-09-19T08:46:39.741 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": { 2024-09-19T08:46:39.742 INFO:teuthology.orchestra.run.smithi007.stdout: "b717c8cd": { 2024-09-19T08:46:39.742 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 12, 2024-09-19T08:46:39.742 INFO:teuthology.orchestra.run.smithi007.stdout: "age_ref": 0.0, 2024-09-19T08:46:39.742 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T08:46:39.742 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RELEASED", 2024-09-19T08:46:39.742 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T08:46:39.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:46:39.742 INFO:teuthology.orchestra.run.smithi007.stdout: "timeout": 90.0, 2024-09-19T08:46:39.742 INFO:teuthology.orchestra.run.smithi007.stdout: "expiration": 140.3, 2024-09-19T08:46:39.742 INFO:teuthology.orchestra.run.smithi007.stdout: "members": { 2024-09-19T08:46:39.742 INFO:teuthology.orchestra.run.smithi007.stdout: "file:/": { 2024-09-19T08:46:39.742 INFO:teuthology.orchestra.run.smithi007.stdout: "excluded": false, 2024-09-19T08:46:39.742 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T08:46:39.742 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RELEASED", 2024-09-19T08:46:39.743 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T08:46:39.743 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:46:39.743 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:46:39.743 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:46:39.743 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:46:39.743 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:46:39.743 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:46:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.739+0000 7f751fb73640 1 -- 172.21.15.7:0/3982588900 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f75040a33b0 msgr2=0x7f75040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.739+0000 7f751fb73640 1 --2- 172.21.15.7:0/3982588900 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f75040a33b0 0x7f75040a5870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7510009430 tx=0x7f7510048000 comp rx=0 tx=0).stop 2024-09-19T08:46:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.739+0000 7f751fb73640 1 -- 172.21.15.7:0/3982588900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7518100e20 msgr2=0x7f75181984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.739+0000 7f751fb73640 1 --2- 172.21.15.7:0/3982588900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7518100e20 0x7f75181984b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f751400e9f0 tx=0x7f751400edf0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.739+0000 7f751fb73640 1 -- 172.21.15.7:0/3982588900 shutdown_connections 2024-09-19T08:46:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.739+0000 7f751fb73640 1 --2- 172.21.15.7:0/3982588900 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f75040a33b0 0x7f75040a5870 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.739+0000 7f751fb73640 1 --2- 172.21.15.7:0/3982588900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7518102ef0 0x7f751819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.739+0000 7f751fb73640 1 --2- 172.21.15.7:0/3982588900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7518102570 0x7f75181989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.739+0000 7f751fb73640 1 --2- 172.21.15.7:0/3982588900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7518100e20 0x7f75181984b0 secure :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f751400e9f0 tx=0x7f751400edf0 comp rx=0 tx=0).stop 2024-09-19T08:46:39.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.739+0000 7f751fb73640 1 -- 172.21.15.7:0/3982588900 >> 172.21.15.7:0/3982588900 conn(0x7f75180fc7d0 msgr2=0x7f7518069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:39.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.739+0000 7f751fb73640 1 -- 172.21.15.7:0/3982588900 shutdown_connections 2024-09-19T08:46:39.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:39.739+0000 7f751fb73640 1 -- 172.21.15.7:0/3982588900 wait complete. 2024-09-19T08:46:40.490 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b717c8cd', total seconds elapsed: 23.6 2024-09-19T08:46:40.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:40 smithi175 ceph-mon[35688]: pgmap v67: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 14 MiB/s wr, 8 op/s 2024-09-19T08:46:40.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:40 smithi007 ceph-mon[31221]: pgmap v67: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 14 MiB/s wr, 8 op/s 2024-09-19T08:46:40.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:40 smithi044 ceph-mon[35072]: pgmap v67: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 14 MiB/s wr, 8 op/s 2024-09-19T08:46:42.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:42 smithi007 ceph-mon[31221]: pgmap v68: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 14 MiB/s wr, 8 op/s 2024-09-19T08:46:42.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:42 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:46:42.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:42 smithi044 ceph-mon[35072]: pgmap v68: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 14 MiB/s wr, 8 op/s 2024-09-19T08:46:42.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:42 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:46:42.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:42 smithi175 ceph-mon[35688]: pgmap v68: 97 pgs: 97 active+clean; 258 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 14 MiB/s wr, 8 op/s 2024-09-19T08:46:42.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:42 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:46:43.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:43 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:46:43.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:43 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:46:43.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:43 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:46:43.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:43 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:46:43.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:43 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:46:43.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:43 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:46:43.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:43 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:43.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:43 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:46:43.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:43 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:46:43.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:43 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:46:43.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:43 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:46:43.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:43 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:46:43.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:43 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:46:43.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:43 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:46:43.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:43 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:46:43.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:43 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:43.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:43 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:46:43.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:43 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:46:43.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:43 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:46:43.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:43 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:46:43.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:43 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:46:43.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:43 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:46:43.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:43 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:46:43.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:43 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:46:43.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:43 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:43.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:43 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:46:43.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:43 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:46:45.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:44 smithi007 ceph-mon[31221]: pgmap v69: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 14 MiB/s wr, 11 op/s 2024-09-19T08:46:45.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:44 smithi044 ceph-mon[35072]: pgmap v69: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 14 MiB/s wr, 11 op/s 2024-09-19T08:46:45.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:44 smithi175 ceph-mon[35688]: pgmap v69: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 14 MiB/s wr, 11 op/s 2024-09-19T08:46:47.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:46 smithi007 ceph-mon[31221]: pgmap v70: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 259 KiB/s wr, 5 op/s 2024-09-19T08:46:47.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:46 smithi044 ceph-mon[35072]: pgmap v70: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 259 KiB/s wr, 5 op/s 2024-09-19T08:46:47.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:46 smithi175 ceph-mon[35688]: pgmap v70: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 259 KiB/s wr, 5 op/s 2024-09-19T08:46:47.554 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:46:47.825 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:46:48.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.282+0000 7fa9faf77640 1 -- 172.21.15.7:0/586883256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9f4102d90 msgr2=0x7fa9f4103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:48.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.282+0000 7fa9faf77640 1 --2- 172.21.15.7:0/586883256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9f4102d90 0x7fa9f4103170 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8009930 tx=0x7fa9e802a420 comp rx=0 tx=0).stop 2024-09-19T08:46:48.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.282+0000 7fa9faf77640 1 -- 172.21.15.7:0/586883256 shutdown_connections 2024-09-19T08:46:48.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.282+0000 7fa9faf77640 1 --2- 172.21.15.7:0/586883256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9f4108290 0x7fa9f410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.282+0000 7fa9faf77640 1 --2- 172.21.15.7:0/586883256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9f4103740 0x7fa9f4107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.282+0000 7fa9faf77640 1 --2- 172.21.15.7:0/586883256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9f4102d90 0x7fa9f4103170 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.282+0000 7fa9faf77640 1 -- 172.21.15.7:0/586883256 >> 172.21.15.7:0/586883256 conn(0x7fa9f40fc7d0 msgr2=0x7fa9f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.283+0000 7fa9faf77640 1 -- 172.21.15.7:0/586883256 shutdown_connections 2024-09-19T08:46:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.283+0000 7fa9faf77640 1 -- 172.21.15.7:0/586883256 wait complete. 2024-09-19T08:46:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.283+0000 7fa9faf77640 1 Processor -- start 2024-09-19T08:46:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.283+0000 7fa9faf77640 1 -- start start 2024-09-19T08:46:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.284+0000 7fa9faf77640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9f4102d90 0x7fa9f41985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.284+0000 7fa9faf77640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9f4103740 0x7fa9f4198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.284+0000 7fa9faf77640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9f4108290 0x7fa9f419ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.284+0000 7fa9faf77640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f4112090 con 0x7fa9f4108290 2024-09-19T08:46:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.284+0000 7fa9faf77640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f4111f10 con 0x7fa9f4102d90 2024-09-19T08:46:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.284+0000 7fa9faf77640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f4112210 con 0x7fa9f4103740 2024-09-19T08:46:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.284+0000 7fa9f9514640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9f4108290 0x7fa9f419ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.284+0000 7fa9f9514640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9f4108290 0x7fa9f419ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38244/0 (socket says 172.21.15.7:38244) 2024-09-19T08:46:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.284+0000 7fa9f9514640 1 -- 172.21.15.7:0/2544117332 learned_addr learned my addr 172.21.15.7:0/2544117332 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:48.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.284+0000 7fa9f8d13640 1 --2- 172.21.15.7:0/2544117332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9f4102d90 0x7fa9f41985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:48.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.284+0000 7fa9f3fff640 1 --2- 172.21.15.7:0/2544117332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9f4103740 0x7fa9f4198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:48.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.284+0000 7fa9f9514640 1 -- 172.21.15.7:0/2544117332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9f4103740 msgr2=0x7fa9f4198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:48.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.284+0000 7fa9f9514640 1 --2- 172.21.15.7:0/2544117332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9f4103740 0x7fa9f4198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.284+0000 7fa9f9514640 1 -- 172.21.15.7:0/2544117332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9f4102d90 msgr2=0x7fa9f41985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:48.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.284+0000 7fa9f9514640 1 --2- 172.21.15.7:0/2544117332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9f4102d90 0x7fa9f41985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.284+0000 7fa9f9514640 1 -- 172.21.15.7:0/2544117332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f419d550 con 0x7fa9f4108290 2024-09-19T08:46:48.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.284+0000 7fa9f8d13640 1 --2- 172.21.15.7:0/2544117332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9f4102d90 0x7fa9f41985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:48.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.285+0000 7fa9f9514640 1 --2- 172.21.15.7:0/2544117332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9f4108290 0x7fa9f419ce70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00eaa0 tx=0x7fa9ec00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:48.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.285+0000 7fa9f1ffb640 1 -- 172.21.15.7:0/2544117332 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec00cdb0 con 0x7fa9f4108290 2024-09-19T08:46:48.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.285+0000 7fa9faf77640 1 -- 172.21.15.7:0/2544117332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9f419d840 con 0x7fa9f4108290 2024-09-19T08:46:48.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.285+0000 7fa9f1ffb640 1 -- 172.21.15.7:0/2544117332 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9ec005020 con 0x7fa9f4108290 2024-09-19T08:46:48.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.285+0000 7fa9f1ffb640 1 -- 172.21.15.7:0/2544117332 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec0116b0 con 0x7fa9f4108290 2024-09-19T08:46:48.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.285+0000 7fa9faf77640 1 -- 172.21.15.7:0/2544117332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9f41a5120 con 0x7fa9f4108290 2024-09-19T08:46:48.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.287+0000 7fa9f1ffb640 1 -- 172.21.15.7:0/2544117332 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa9ec005560 con 0x7fa9f4108290 2024-09-19T08:46:48.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.288+0000 7fa9fd350740 1 Processor -- start 2024-09-19T08:46:48.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.288+0000 7fa9fd350740 1 -- start start 2024-09-19T08:46:48.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.288+0000 7fa9f1ffb640 1 --2- 172.21.15.7:0/2544117332 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa9e40a3430 0x7fa9e40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:48.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.288+0000 7fa9fd350740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05e2380 0x5623c05e2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:48.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.288+0000 7fa9fd350740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2ca0 0x5623c05f1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:48.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.288+0000 7fa9f1ffb640 1 -- 172.21.15.7:0/2544117332 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fa9ec0cfe40 con 0x7fa9f4108290 2024-09-19T08:46:48.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.288+0000 7fa9fd350740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623c05f1a90 0x5623c05f3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:48.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.288+0000 7fa9fd350740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5623c05482e0 con 0x5623c05e2380 2024-09-19T08:46:48.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.288+0000 7fa9fd350740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5623c04efce0 con 0x5623c05f1a90 2024-09-19T08:46:48.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.288+0000 7fa9fd350740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5623c05442a0 con 0x5623c05e2ca0 2024-09-19T08:46:48.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.288+0000 7fa9f3fff640 1 --2- 172.21.15.7:0/2544117332 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa9e40a3430 0x7fa9e40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:48.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.288+0000 7fa9f8d13640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05e2380 0x5623c05e2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:48.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.288+0000 7fa9f8d13640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05e2380 0x5623c05e2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38246/0 (socket says 172.21.15.7:38246) 2024-09-19T08:46:48.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.288+0000 7fa9f8d13640 1 -- 172.21.15.7:0/4248692241 learned_addr learned my addr 172.21.15.7:0/4248692241 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:48.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.288+0000 7fa9f3fff640 1 --2- 172.21.15.7:0/4248692241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2ca0 0x5623c05f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:48.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.289+0000 7fa9f9514640 1 --2- 172.21.15.7:0/4248692241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623c05f1a90 0x5623c05f3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:48.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.289+0000 7fa9f8d13640 1 -- 172.21.15.7:0/4248692241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2ca0 msgr2=0x5623c05f1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:48.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.289+0000 7fa9f8d13640 1 --2- 172.21.15.7:0/4248692241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2ca0 0x5623c05f1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.289+0000 7fa9f8d13640 1 -- 172.21.15.7:0/4248692241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623c05f1a90 msgr2=0x5623c05f3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:48.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.289+0000 7fa9f8d13640 1 --2- 172.21.15.7:0/4248692241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623c05f1a90 0x5623c05f3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.289+0000 7fa9f8d13640 1 -- 172.21.15.7:0/4248692241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623c04d4440 con 0x5623c05e2380 2024-09-19T08:46:48.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.289+0000 7fa9f3fff640 1 --2- 172.21.15.7:0/4248692241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2ca0 0x5623c05f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:48.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.289+0000 7fa9f3fff640 1 --2- 172.21.15.7:0/2544117332 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa9e40a3430 0x7fa9e40a58f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa9f40fee80 tx=0x7fa9e000bef0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:48.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.289+0000 7fa9f8d13640 1 --2- 172.21.15.7:0/4248692241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05e2380 0x5623c05e2760 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8000c00 tx=0x7fa9e8005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e5804530fafaa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:48.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.289+0000 7fa9deffd640 1 -- 172.21.15.7:0/4248692241 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e8035040 con 0x5623c05e2380 2024-09-19T08:46:48.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.289+0000 7fa9deffd640 1 -- 172.21.15.7:0/4248692241 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9e8031930 con 0x5623c05e2380 2024-09-19T08:46:48.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.289+0000 7fa9deffd640 1 -- 172.21.15.7:0/4248692241 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e803c440 con 0x5623c05e2380 2024-09-19T08:46:48.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.290+0000 7fa9fd350740 1 -- 172.21.15.7:0/4248692241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05e2380 msgr2=0x5623c05e2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:48.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.290+0000 7fa9fd350740 1 --2- 172.21.15.7:0/4248692241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05e2380 0x5623c05e2760 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8000c00 tx=0x7fa9e8005e80 comp rx=0 tx=0).stop 2024-09-19T08:46:48.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.290+0000 7fa9fd350740 1 -- 172.21.15.7:0/4248692241 shutdown_connections 2024-09-19T08:46:48.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.290+0000 7fa9fd350740 1 --2- 172.21.15.7:0/4248692241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623c05f1a90 0x5623c05f3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.290+0000 7fa9fd350740 1 --2- 172.21.15.7:0/4248692241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2ca0 0x5623c05f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.290+0000 7fa9fd350740 1 --2- 172.21.15.7:0/4248692241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05e2380 0x5623c05e2760 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.290+0000 7fa9fd350740 1 -- 172.21.15.7:0/4248692241 >> 172.21.15.7:0/4248692241 conn(0x5623c05dea30 msgr2=0x5623c05dee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:48.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.290+0000 7fa9fd350740 1 -- 172.21.15.7:0/4248692241 shutdown_connections 2024-09-19T08:46:48.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.290+0000 7fa9fd350740 1 -- 172.21.15.7:0/4248692241 wait complete. 2024-09-19T08:46:48.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.291+0000 7fa9fd350740 1 -- start start 2024-09-19T08:46:48.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.291+0000 7fa9fd350740 1 Processor -- start 2024-09-19T08:46:48.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.291+0000 7fa9fd350740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623c05e2380 0x5623c05f12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:48.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.291+0000 7fa9fd350740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2ca0 0x5623c05ee5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:48.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.291+0000 7fa9fd350740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05f1a90 0x5623c05eeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:48.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.291+0000 7fa9fd350740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5623c05f4660 con 0x5623c05f1a90 2024-09-19T08:46:48.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.291+0000 7fa9fd350740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5623c0503050 con 0x5623c05e2380 2024-09-19T08:46:48.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.291+0000 7fa9fd350740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5623c05f47e0 con 0x5623c05e2ca0 2024-09-19T08:46:48.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.291+0000 7fa9fd350740 10 client.0 _ll_register_callbacks cb 0x5623c0543160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:48.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.291+0000 7fa9f9514640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05f1a90 0x5623c05eeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:48.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.291+0000 7fa9f9514640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05f1a90 0x5623c05eeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38252/0 (socket says 172.21.15.7:38252) 2024-09-19T08:46:48.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.291+0000 7fa9f9514640 1 -- 172.21.15.7:0/765973525 learned_addr learned my addr 172.21.15.7:0/765973525 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:48.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.292+0000 7fa9f8d13640 1 --2- 172.21.15.7:0/765973525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623c05e2380 0x5623c05f12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:48.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.292+0000 7fa9f3fff640 1 --2- 172.21.15.7:0/765973525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2ca0 0x5623c05ee5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:48.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.292+0000 7fa9f9514640 1 -- 172.21.15.7:0/765973525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2ca0 msgr2=0x5623c05ee5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:48.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.292+0000 7fa9f9514640 1 --2- 172.21.15.7:0/765973525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2ca0 0x5623c05ee5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.292+0000 7fa9f9514640 1 -- 172.21.15.7:0/765973525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623c05e2380 msgr2=0x5623c05f12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:48.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.292+0000 7fa9f9514640 1 --2- 172.21.15.7:0/765973525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623c05e2380 0x5623c05f12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.292+0000 7fa9f9514640 1 -- 172.21.15.7:0/765973525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623c02b93c0 con 0x5623c05f1a90 2024-09-19T08:46:48.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.292+0000 7fa9f8d13640 1 --2- 172.21.15.7:0/765973525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623c05e2380 0x5623c05f12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:48.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.292+0000 7fa9f3fff640 1 --2- 172.21.15.7:0/765973525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2ca0 0x5623c05ee5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:48.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.292+0000 7fa9f9514640 1 --2- 172.21.15.7:0/765973525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05f1a90 0x5623c05eeae0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00efd0 tx=0x7fa9ec0a0590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c979270d3d5cf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:48.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.292+0000 7fa9d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:48.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.292+0000 7fa9d3fff640 1 -- 172.21.15.7:0/765973525 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec0b4020 con 0x5623c05f1a90 2024-09-19T08:46:48.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.292+0000 7fa9d3fff640 1 -- 172.21.15.7:0/765973525 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fa9ec0987d0 con 0x5623c05f1a90 2024-09-19T08:46:48.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.292+0000 7fa9fd350740 1 -- 172.21.15.7:0/765973525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9e8031930 con 0x5623c05f1a90 2024-09-19T08:46:48.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.293+0000 7fa9d3fff640 1 -- 172.21.15.7:0/765973525 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa9ec07f050 con 0x5623c05f1a90 2024-09-19T08:46:48.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.293+0000 7fa9fd350740 10 client.15804 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:48.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.293+0000 7fa9fd350740 1 -- 172.21.15.7:0/765973525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5623c05ffff0 con 0x5623c05f1a90 2024-09-19T08:46:48.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.293+0000 7fa9d3fff640 1 -- 172.21.15.7:0/765973525 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9e8031930 con 0x5623c05f1a90 2024-09-19T08:46:48.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.293+0000 7fa9d3fff640 1 -- 172.21.15.7:0/765973525 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa9ec00f040 con 0x5623c05f1a90 2024-09-19T08:46:48.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.293+0000 7fa9fd350740 10 client.15804 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:48.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.293+0000 7fa9fd350740 10 client.15804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:48.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.293+0000 7fa9fd350740 20 client.15804 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:48.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.293+0000 7fa9fd350740 1 --2- 172.21.15.7:0/765973525 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5623c0601450 0x5623c06038f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:48.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.293+0000 7fa9fd350740 4 client.15804 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:46:48.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.293+0000 7fa9fd350740 1 -- 172.21.15.7:0/765973525 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623c0555850 con 0x5623c0601450 2024-09-19T08:46:48.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.293+0000 7fa9f8d13640 1 --2- 172.21.15.7:0/765973525 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5623c0601450 0x5623c06038f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:48.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.294+0000 7fa9d3fff640 10 client.15804 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:48.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.294+0000 7fa9f8d13640 1 --2- 172.21.15.7:0/765973525 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5623c0601450 0x5623c06038f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=688717805814fe76 server_cookie=2c328f0ca5d16fbf in_seq=0 out_seq=0 2024-09-19T08:46:48.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.295+0000 7fa9d3fff640 1 -- 172.21.15.7:0/765973525 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5623c0555850 con 0x5623c0601450 2024-09-19T08:46:48.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.295+0000 7fa9d3fff640 10 client.15804 handle_command_reply: tid=0 2024-09-19T08:46:48.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.295+0000 7fa9fd350740 1 client.15804 shutdown 2024-09-19T08:46:48.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.295+0000 7fa9fd350740 1 -- 172.21.15.7:0/765973525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05f1a90 msgr2=0x5623c05eeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:48.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.295+0000 7fa9fd350740 1 --2- 172.21.15.7:0/765973525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05f1a90 0x5623c05eeae0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00efd0 tx=0x7fa9ec0a0590 comp rx=0 tx=0).stop 2024-09-19T08:46:48.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.295+0000 7fa9fd350740 1 -- 172.21.15.7:0/765973525 shutdown_connections 2024-09-19T08:46:48.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.295+0000 7fa9fd350740 1 --2- 172.21.15.7:0/765973525 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5623c0601450 0x5623c06038f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.295+0000 7fa9fd350740 1 --2- 172.21.15.7:0/765973525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05f1a90 0x5623c05eeae0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.295+0000 7fa9fd350740 1 --2- 172.21.15.7:0/765973525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2ca0 0x5623c05ee5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.295+0000 7fa9fd350740 1 --2- 172.21.15.7:0/765973525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623c05e2380 0x5623c05f12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.295+0000 7fa9d3fff640 0 client.15804 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:48.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.295+0000 7fa9fd350740 1 -- 172.21.15.7:0/765973525 >> 172.21.15.7:0/765973525 conn(0x5623c05dea30 msgr2=0x5623c05e4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:48.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.295+0000 7fa9fd350740 1 -- 172.21.15.7:0/765973525 shutdown_connections 2024-09-19T08:46:48.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.295+0000 7fa9fd350740 1 -- 172.21.15.7:0/765973525 wait complete. 2024-09-19T08:46:48.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.295+0000 7fa9fd350740 20 client.15804 trim_cache size 0 max 16384 2024-09-19T08:46:48.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.313+0000 7fa9fd350740 1 Processor -- start 2024-09-19T08:46:48.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.313+0000 7fa9fd350740 1 -- start start 2024-09-19T08:46:48.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.313+0000 7fa9fd350740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623c05e2380 0x5623c05ece70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:48.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.313+0000 7fa9fd350740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2ca0 0x5623c05dda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:48.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.313+0000 7fa9fd350740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05f1a90 0x5623c06091c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:48.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.313+0000 7fa9fd350740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f41adf90 con 0x5623c05f1a90 2024-09-19T08:46:48.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.313+0000 7fa9fd350740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f41ab860 con 0x5623c05e2380 2024-09-19T08:46:48.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.313+0000 7fa9fd350740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f41a96b0 con 0x5623c05e2ca0 2024-09-19T08:46:48.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.313+0000 7fa9f9514640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05f1a90 0x5623c06091c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:48.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.313+0000 7fa9f9514640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05f1a90 0x5623c06091c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38260/0 (socket says 172.21.15.7:38260) 2024-09-19T08:46:48.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.313+0000 7fa9f9514640 1 -- 172.21.15.7:0/1372842695 learned_addr learned my addr 172.21.15.7:0/1372842695 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:48.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.313+0000 7fa9f3fff640 1 --2- 172.21.15.7:0/1372842695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2ca0 0x5623c05dda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:48.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.313+0000 7fa9f8d13640 1 --2- 172.21.15.7:0/1372842695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623c05e2380 0x5623c05ece70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:48.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.314+0000 7fa9f9514640 1 -- 172.21.15.7:0/1372842695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2ca0 msgr2=0x5623c05dda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:48.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.314+0000 7fa9f9514640 1 --2- 172.21.15.7:0/1372842695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2ca0 0x5623c05dda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.314+0000 7fa9f9514640 1 -- 172.21.15.7:0/1372842695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623c05e2380 msgr2=0x5623c05ece70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:48.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.314+0000 7fa9f9514640 1 --2- 172.21.15.7:0/1372842695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623c05e2380 0x5623c05ece70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.314+0000 7fa9f9514640 1 -- 172.21.15.7:0/1372842695 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623c05ed550 con 0x5623c05f1a90 2024-09-19T08:46:48.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.314+0000 7fa9f3fff640 1 --2- 172.21.15.7:0/1372842695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2ca0 0x5623c05dda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:48.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.314+0000 7fa9f9514640 1 --2- 172.21.15.7:0/1372842695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05f1a90 0x5623c06091c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec09c0f0 tx=0x7fa9ec09bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d32736d41a8d2f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:48.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.314+0000 7fa9de7fc640 1 -- 172.21.15.7:0/1372842695 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec0b4070 con 0x5623c05f1a90 2024-09-19T08:46:48.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.314+0000 7fa9de7fc640 1 -- 172.21.15.7:0/1372842695 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9ec0a0110 con 0x5623c05f1a90 2024-09-19T08:46:48.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.314+0000 7fa9de7fc640 1 -- 172.21.15.7:0/1372842695 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec01f040 con 0x5623c05f1a90 2024-09-19T08:46:48.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.315+0000 7fa9fd350740 1 -- 172.21.15.7:0/1372842695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05f1a90 msgr2=0x5623c06091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:48.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.315+0000 7fa9fd350740 1 --2- 172.21.15.7:0/1372842695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05f1a90 0x5623c06091c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec09c0f0 tx=0x7fa9ec09bdd0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.315+0000 7fa9fd350740 1 -- 172.21.15.7:0/1372842695 shutdown_connections 2024-09-19T08:46:48.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.315+0000 7fa9fd350740 1 --2- 172.21.15.7:0/1372842695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05f1a90 0x5623c06091c0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.315+0000 7fa9fd350740 1 --2- 172.21.15.7:0/1372842695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2ca0 0x5623c05dda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.315+0000 7fa9fd350740 1 --2- 172.21.15.7:0/1372842695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623c05e2380 0x5623c05ece70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.315+0000 7fa9fd350740 1 -- 172.21.15.7:0/1372842695 >> 172.21.15.7:0/1372842695 conn(0x5623c05dea30 msgr2=0x5623c05dd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:48.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.315+0000 7fa9fd350740 1 -- 172.21.15.7:0/1372842695 shutdown_connections 2024-09-19T08:46:48.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.315+0000 7fa9fd350740 1 -- 172.21.15.7:0/1372842695 wait complete. 2024-09-19T08:46:48.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.315+0000 7fa9fd350740 1 -- start start 2024-09-19T08:46:48.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.316+0000 7fa9fd350740 1 Processor -- start 2024-09-19T08:46:48.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.316+0000 7fa9fd350740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2380 0x5623c05f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:48.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.316+0000 7fa9fd350740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05e2ca0 0x5623c05f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:48.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.316+0000 7fa9fd350740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623c05f1a90 0x5623c05f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:48.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.316+0000 7fa9fd350740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f41a9d20 con 0x5623c05e2ca0 2024-09-19T08:46:48.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.316+0000 7fa9fd350740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f41ab190 con 0x5623c05f1a90 2024-09-19T08:46:48.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.316+0000 7fa9fd350740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f41aa3f0 con 0x5623c05e2380 2024-09-19T08:46:48.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.316+0000 7fa9fd350740 10 client.0 _ll_register_callbacks cb 0x7fa9ec09c280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:48.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.316+0000 7fa9f3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05e2ca0 0x5623c05f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:48.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.316+0000 7fa9f3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05e2ca0 0x5623c05f5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38266/0 (socket says 172.21.15.7:38266) 2024-09-19T08:46:48.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.316+0000 7fa9f3fff640 1 -- 172.21.15.7:0/3908471346 learned_addr learned my addr 172.21.15.7:0/3908471346 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:48.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.316+0000 7fa9f8d13640 1 --2- 172.21.15.7:0/3908471346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2380 0x5623c05f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:48.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.317+0000 7fa9f9514640 1 --2- 172.21.15.7:0/3908471346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623c05f1a90 0x5623c05f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:48.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.317+0000 7fa9f3fff640 1 -- 172.21.15.7:0/3908471346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2380 msgr2=0x5623c05f5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:48.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.317+0000 7fa9f3fff640 1 --2- 172.21.15.7:0/3908471346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2380 0x5623c05f5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.317+0000 7fa9f3fff640 1 -- 172.21.15.7:0/3908471346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623c05f1a90 msgr2=0x5623c05f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:48.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.317+0000 7fa9f3fff640 1 --2- 172.21.15.7:0/3908471346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623c05f1a90 0x5623c05f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.317+0000 7fa9f3fff640 1 -- 172.21.15.7:0/3908471346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623c05f1660 con 0x5623c05e2ca0 2024-09-19T08:46:48.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.317+0000 7fa9f8d13640 1 --2- 172.21.15.7:0/3908471346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2380 0x5623c05f5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:48.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.317+0000 7fa9f3fff640 1 --2- 172.21.15.7:0/3908471346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05e2ca0 0x5623c05f5fa0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa9f40697d0 tx=0x7fa9e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82bd943c4da9defe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:48.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.317+0000 7fa9d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:48.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.317+0000 7fa9d3fff640 1 -- 172.21.15.7:0/3908471346 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0005220 con 0x5623c05e2ca0 2024-09-19T08:46:48.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.317+0000 7fa9d3fff640 1 -- 172.21.15.7:0/3908471346 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fa9e00053c0 con 0x5623c05e2ca0 2024-09-19T08:46:48.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.317+0000 7fa9fd350740 1 -- 172.21.15.7:0/3908471346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9ec0a0110 con 0x5623c05e2ca0 2024-09-19T08:46:48.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.318+0000 7fa9d3fff640 1 -- 172.21.15.7:0/3908471346 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa9e0011e20 con 0x5623c05e2ca0 2024-09-19T08:46:48.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.318+0000 7fa9fd350740 10 client.15810 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:48.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.318+0000 7fa9fd350740 1 -- 172.21.15.7:0/3908471346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5623c066c550 con 0x5623c05e2ca0 2024-09-19T08:46:48.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.318+0000 7fa9d3fff640 1 -- 172.21.15.7:0/3908471346 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9ec0a0110 con 0x5623c05e2ca0 2024-09-19T08:46:48.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.318+0000 7fa9d3fff640 1 -- 172.21.15.7:0/3908471346 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa9e00229e0 con 0x5623c05e2ca0 2024-09-19T08:46:48.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.318+0000 7fa9fd350740 10 client.15810 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:48.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.318+0000 7fa9fd350740 10 client.15810 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:48.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.318+0000 7fa9fd350740 20 client.15810 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:48.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.318+0000 7fa9fd350740 1 --2- 172.21.15.7:0/3908471346 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5623c066cd00 0x5623c066f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:48.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.318+0000 7fa9fd350740 4 client.15810 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:46:48.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.318+0000 7fa9fd350740 1 -- 172.21.15.7:0/3908471346 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5623c054fd60 con 0x5623c066cd00 2024-09-19T08:46:48.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.318+0000 7fa9f8d13640 1 --2- 172.21.15.7:0/3908471346 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5623c066cd00 0x5623c066f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:48.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.319+0000 7fa9f8d13640 1 --2- 172.21.15.7:0/3908471346 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5623c066cd00 0x5623c066f120 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=978cf77df1676b6b server_cookie=23042bb241915eab in_seq=0 out_seq=0 2024-09-19T08:46:48.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.319+0000 7fa9d3fff640 10 client.15810 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:48.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.319+0000 7fa9d3fff640 1 -- 172.21.15.7:0/3908471346 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5623c054fd60 con 0x5623c066cd00 2024-09-19T08:46:48.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.319+0000 7fa9d3fff640 10 client.15810 handle_command_reply: tid=0 2024-09-19T08:46:48.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.319+0000 7fa9fd350740 1 client.15810 shutdown 2024-09-19T08:46:48.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.319+0000 7fa9fd350740 1 -- 172.21.15.7:0/3908471346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05e2ca0 msgr2=0x5623c05f5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:48.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.319+0000 7fa9fd350740 1 --2- 172.21.15.7:0/3908471346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05e2ca0 0x5623c05f5fa0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa9f40697d0 tx=0x7fa9e0004730 comp rx=0 tx=0).stop 2024-09-19T08:46:48.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.319+0000 7fa9fd350740 1 -- 172.21.15.7:0/3908471346 shutdown_connections 2024-09-19T08:46:48.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.319+0000 7fa9fd350740 1 --2- 172.21.15.7:0/3908471346 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5623c066cd00 0x5623c066f120 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.319+0000 7fa9fd350740 1 --2- 172.21.15.7:0/3908471346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623c05f1a90 0x5623c05f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.319+0000 7fa9d3fff640 0 client.15810 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:48.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.319+0000 7fa9fd350740 1 --2- 172.21.15.7:0/3908471346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623c05e2ca0 0x5623c05f5fa0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.319+0000 7fa9fd350740 1 --2- 172.21.15.7:0/3908471346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5623c05e2380 0x5623c05f5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.320+0000 7fa9fd350740 1 -- 172.21.15.7:0/3908471346 >> 172.21.15.7:0/3908471346 conn(0x5623c05dea30 msgr2=0x5623c05efe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:48.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.320+0000 7fa9fd350740 1 -- 172.21.15.7:0/3908471346 shutdown_connections 2024-09-19T08:46:48.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.320+0000 7fa9fd350740 1 -- 172.21.15.7:0/3908471346 wait complete. 2024-09-19T08:46:48.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.320+0000 7fa9fd350740 20 client.15810 trim_cache size 0 max 16384 2024-09-19T08:46:48.326 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:46:48.326 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-19T08:46:48.326 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-09-19T08:46:48.326 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:46:48.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.321+0000 7fa9faf77640 1 -- 172.21.15.7:0/2544117332 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa9e40a3430 msgr2=0x7fa9e40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:48.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.321+0000 7fa9faf77640 1 --2- 172.21.15.7:0/2544117332 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa9e40a3430 0x7fa9e40a58f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa9f40fee80 tx=0x7fa9e000bef0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.321+0000 7fa9faf77640 1 -- 172.21.15.7:0/2544117332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9f4108290 msgr2=0x7fa9f419ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:48.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.321+0000 7fa9faf77640 1 --2- 172.21.15.7:0/2544117332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9f4108290 0x7fa9f419ce70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00eaa0 tx=0x7fa9ec00ef60 comp rx=0 tx=0).stop 2024-09-19T08:46:48.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.321+0000 7fa9faf77640 1 -- 172.21.15.7:0/2544117332 shutdown_connections 2024-09-19T08:46:48.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.321+0000 7fa9faf77640 1 --2- 172.21.15.7:0/2544117332 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa9e40a3430 0x7fa9e40a58f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.321+0000 7fa9faf77640 1 --2- 172.21.15.7:0/2544117332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9f4108290 0x7fa9f419ce70 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.321+0000 7fa9faf77640 1 --2- 172.21.15.7:0/2544117332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9f4103740 0x7fa9f4198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.321+0000 7fa9faf77640 1 --2- 172.21.15.7:0/2544117332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9f4102d90 0x7fa9f41985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:48.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.321+0000 7fa9faf77640 1 -- 172.21.15.7:0/2544117332 >> 172.21.15.7:0/2544117332 conn(0x7fa9f40fc7d0 msgr2=0x7fa9f4105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:48.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.321+0000 7fa9faf77640 1 -- 172.21.15.7:0/2544117332 shutdown_connections 2024-09-19T08:46:48.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:48.321+0000 7fa9faf77640 1 -- 172.21.15.7:0/2544117332 wait complete. 2024-09-19T08:46:49.030 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:46:49.030 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:46:49.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:48 smithi007 ceph-mon[31221]: pgmap v71: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 691 KiB/s wr, 9 op/s 2024-09-19T08:46:49.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:48 smithi044 ceph-mon[35072]: pgmap v71: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 691 KiB/s wr, 9 op/s 2024-09-19T08:46:49.303 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:46:49.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:48 smithi175 ceph-mon[35688]: pgmap v71: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 691 KiB/s wr, 9 op/s 2024-09-19T08:46:49.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.780+0000 7f13406f6640 1 -- 172.21.15.7:0/69827094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1338103650 msgr2=0x7f133810bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:49.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.780+0000 7f13406f6640 1 --2- 172.21.15.7:0/69827094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1338103650 0x7f133810bb40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1328009900 tx=0x7f132802a480 comp rx=0 tx=0).stop 2024-09-19T08:46:49.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.780+0000 7f13406f6640 1 -- 172.21.15.7:0/69827094 shutdown_connections 2024-09-19T08:46:49.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.780+0000 7f13406f6640 1 --2- 172.21.15.7:0/69827094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f133810c160 0x7f133810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:49.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.780+0000 7f13406f6640 1 --2- 172.21.15.7:0/69827094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1338103650 0x7f133810bb40 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:49.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.780+0000 7f13406f6640 1 --2- 172.21.15.7:0/69827094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1338102d30 0x7f1338103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:49.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.780+0000 7f13406f6640 1 -- 172.21.15.7:0/69827094 >> 172.21.15.7:0/69827094 conn(0x7f13380fc7d0 msgr2=0x7f13380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:49.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.780+0000 7f13406f6640 1 -- 172.21.15.7:0/69827094 shutdown_connections 2024-09-19T08:46:49.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.780+0000 7f13406f6640 1 -- 172.21.15.7:0/69827094 wait complete. 2024-09-19T08:46:49.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.780+0000 7f13406f6640 1 Processor -- start 2024-09-19T08:46:49.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.781+0000 7f13406f6640 1 -- start start 2024-09-19T08:46:49.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.781+0000 7f13406f6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1338102d30 0x7f1338100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:49.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.781+0000 7f13406f6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1338103650 0x7f1338100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:49.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.781+0000 7f13406f6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f133810c160 0x7f1338101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:49.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.781+0000 7f13406f6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1338111f60 con 0x7f1338103650 2024-09-19T08:46:49.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.781+0000 7f13406f6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1338111de0 con 0x7f1338102d30 2024-09-19T08:46:49.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.781+0000 7f13406f6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f13381120e0 con 0x7f133810c160 2024-09-19T08:46:49.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.781+0000 7f133dc91640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1338103650 0x7f1338100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:49.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.781+0000 7f133dc91640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1338103650 0x7f1338100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38270/0 (socket says 172.21.15.7:38270) 2024-09-19T08:46:49.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.781+0000 7f133dc91640 1 -- 172.21.15.7:0/3079776351 learned_addr learned my addr 172.21.15.7:0/3079776351 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:49.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.781+0000 7f133e492640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1338102d30 0x7f1338100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:49.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.781+0000 7f133ec93640 1 --2- 172.21.15.7:0/3079776351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f133810c160 0x7f1338101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:49.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.781+0000 7f133ec93640 1 -- 172.21.15.7:0/3079776351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1338102d30 msgr2=0x7f1338100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:49.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.781+0000 7f133ec93640 1 --2- 172.21.15.7:0/3079776351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1338102d30 0x7f1338100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:49.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.781+0000 7f133ec93640 1 -- 172.21.15.7:0/3079776351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1338103650 msgr2=0x7f1338100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:49.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.781+0000 7f133ec93640 1 --2- 172.21.15.7:0/3079776351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1338103650 0x7f1338100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:49.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.781+0000 7f133ec93640 1 -- 172.21.15.7:0/3079776351 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13381a69a0 con 0x7f133810c160 2024-09-19T08:46:49.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.781+0000 7f133dc91640 1 --2- 172.21.15.7:0/3079776351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1338103650 0x7f1338100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:49.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.781+0000 7f133e492640 1 --2- 172.21.15.7:0/3079776351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1338102d30 0x7f1338100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:49.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.782+0000 7f133ec93640 1 --2- 172.21.15.7:0/3079776351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f133810c160 0x7f1338101410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1330009fd0 tx=0x7f133000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:49.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.782+0000 7f132f7fe640 1 -- 172.21.15.7:0/3079776351 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133000ce20 con 0x7f133810c160 2024-09-19T08:46:49.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.782+0000 7f13406f6640 1 -- 172.21.15.7:0/3079776351 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13381a6c90 con 0x7f133810c160 2024-09-19T08:46:49.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.782+0000 7f132f7fe640 1 -- 172.21.15.7:0/3079776351 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1330005020 con 0x7f133810c160 2024-09-19T08:46:49.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.782+0000 7f132f7fe640 1 -- 172.21.15.7:0/3079776351 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1330010720 con 0x7f133810c160 2024-09-19T08:46:49.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.782+0000 7f13406f6640 1 -- 172.21.15.7:0/3079776351 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13381a7180 con 0x7f133810c160 2024-09-19T08:46:49.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.783+0000 7f13406f6640 1 -- 172.21.15.7:0/3079776351 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1338103110 con 0x7f133810c160 2024-09-19T08:46:49.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.785+0000 7f132f7fe640 1 -- 172.21.15.7:0/3079776351 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f1330005540 con 0x7f133810c160 2024-09-19T08:46:49.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.786+0000 7f132f7fe640 1 --2- 172.21.15.7:0/3079776351 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f13240a33b0 0x7f13240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:49.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.786+0000 7f132f7fe640 1 -- 172.21.15.7:0/3079776351 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f13300d0400 con 0x7f133810c160 2024-09-19T08:46:49.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.786+0000 7f133e492640 1 --2- 172.21.15.7:0/3079776351 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f13240a33b0 0x7f13240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:49.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.787+0000 7f133e492640 1 --2- 172.21.15.7:0/3079776351 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f13240a33b0 0x7f13240a5870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1334009fc0 tx=0x7f1334005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:49.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:49.791+0000 7f132f7fe640 1 -- 172.21.15.7:0/3079776351 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f133009cd70 con 0x7f133810c160 2024-09-19T08:46:50.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:50.007+0000 7f13406f6640 1 -- 172.21.15.7:0/3079776351 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13381071d0 con 0x7f133810c160 2024-09-19T08:46:50.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:50.007+0000 7f132f7fe640 1 -- 172.21.15.7:0/3079776351 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f133009c670 con 0x7f133810c160 2024-09-19T08:46:50.007 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:46:50.008 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:46:50.008 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:46:50.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:50.010+0000 7f13406f6640 1 -- 172.21.15.7:0/3079776351 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f13240a33b0 msgr2=0x7f13240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:50.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:50.010+0000 7f13406f6640 1 --2- 172.21.15.7:0/3079776351 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f13240a33b0 0x7f13240a5870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1334009fc0 tx=0x7f1334005f90 comp rx=0 tx=0).stop 2024-09-19T08:46:50.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:50.010+0000 7f13406f6640 1 -- 172.21.15.7:0/3079776351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f133810c160 msgr2=0x7f1338101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:50.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:50.010+0000 7f13406f6640 1 --2- 172.21.15.7:0/3079776351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f133810c160 0x7f1338101410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1330009fd0 tx=0x7f133000ef10 comp rx=0 tx=0).stop 2024-09-19T08:46:50.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:50.010+0000 7f13406f6640 1 -- 172.21.15.7:0/3079776351 shutdown_connections 2024-09-19T08:46:50.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:50.010+0000 7f13406f6640 1 --2- 172.21.15.7:0/3079776351 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f13240a33b0 0x7f13240a5870 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:50.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:50.010+0000 7f13406f6640 1 --2- 172.21.15.7:0/3079776351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f133810c160 0x7f1338101410 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:50.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:50.010+0000 7f13406f6640 1 --2- 172.21.15.7:0/3079776351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1338103650 0x7f1338100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:50.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:50.010+0000 7f13406f6640 1 --2- 172.21.15.7:0/3079776351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1338102d30 0x7f1338100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:50.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:50.010+0000 7f13406f6640 1 -- 172.21.15.7:0/3079776351 >> 172.21.15.7:0/3079776351 conn(0x7f13380fc7d0 msgr2=0x7f13380fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:50.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:50.010+0000 7f13406f6640 1 -- 172.21.15.7:0/3079776351 shutdown_connections 2024-09-19T08:46:50.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:50.010+0000 7f13406f6640 1 -- 172.21.15.7:0/3079776351 wait complete. 2024-09-19T08:46:50.695 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:46:50.966 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:46:51.237 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:50 smithi007 ceph-mon[31221]: pgmap v72: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 691 KiB/s wr, 6 op/s 2024-09-19T08:46:51.237 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:50 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3079776351' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:46:51.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:50 smithi044 ceph-mon[35072]: pgmap v72: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 691 KiB/s wr, 6 op/s 2024-09-19T08:46:51.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:50 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3079776351' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:46:51.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:50 smithi175 ceph-mon[35688]: pgmap v72: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 691 KiB/s wr, 6 op/s 2024-09-19T08:46:51.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:50 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3079776351' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:46:51.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.447+0000 7ff55ff1c640 1 -- 172.21.15.7:0/1870263351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff55810e500 msgr2=0x7ff558110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:51.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.447+0000 7ff55ff1c640 1 --2- 172.21.15.7:0/1870263351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff55810e500 0x7ff558110910 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff550009ca0 tx=0x7ff55002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.447+0000 7ff55ff1c640 1 -- 172.21.15.7:0/1870263351 shutdown_connections 2024-09-19T08:46:51.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.447+0000 7ff55ff1c640 1 --2- 172.21.15.7:0/1870263351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff55810e500 0x7ff558110910 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.447+0000 7ff55ff1c640 1 --2- 172.21.15.7:0/1870263351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff558101440 0x7ff55810df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.447+0000 7ff55ff1c640 1 --2- 172.21.15.7:0/1870263351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff558100b20 0x7ff558100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.447+0000 7ff55ff1c640 1 -- 172.21.15.7:0/1870263351 >> 172.21.15.7:0/1870263351 conn(0x7ff5580fc7d0 msgr2=0x7ff5580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:51.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.447+0000 7ff55ff1c640 1 -- 172.21.15.7:0/1870263351 shutdown_connections 2024-09-19T08:46:51.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.447+0000 7ff55ff1c640 1 -- 172.21.15.7:0/1870263351 wait complete. 2024-09-19T08:46:51.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.448+0000 7ff55ff1c640 1 Processor -- start 2024-09-19T08:46:51.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.448+0000 7ff55ff1c640 1 -- start start 2024-09-19T08:46:51.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.448+0000 7ff55ff1c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff558100b20 0x7ff55819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:51.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.448+0000 7ff55ff1c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff558101440 0x7ff55819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:51.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.448+0000 7ff55ff1c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff55810e500 0x7ff55819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:51.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.448+0000 7ff55ff1c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff558114230 con 0x7ff55810e500 2024-09-19T08:46:51.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.448+0000 7ff55ff1c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff5581140b0 con 0x7ff558101440 2024-09-19T08:46:51.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.448+0000 7ff55ff1c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5581143b0 con 0x7ff558100b20 2024-09-19T08:46:51.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.448+0000 7ff55e4b9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff55810e500 0x7ff55819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:51.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.448+0000 7ff55e4b9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff55810e500 0x7ff55819ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38280/0 (socket says 172.21.15.7:38280) 2024-09-19T08:46:51.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.448+0000 7ff55e4b9640 1 -- 172.21.15.7:0/737538254 learned_addr learned my addr 172.21.15.7:0/737538254 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:51.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.448+0000 7ff55d4b7640 1 --2- 172.21.15.7:0/737538254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff558101440 0x7ff55819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:51.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.448+0000 7ff55dcb8640 1 --2- 172.21.15.7:0/737538254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff558100b20 0x7ff55819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:51.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.449+0000 7ff55e4b9640 1 -- 172.21.15.7:0/737538254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff558100b20 msgr2=0x7ff55819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:51.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.449+0000 7ff55e4b9640 1 --2- 172.21.15.7:0/737538254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff558100b20 0x7ff55819a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.449+0000 7ff55e4b9640 1 -- 172.21.15.7:0/737538254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff558101440 msgr2=0x7ff55819abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:51.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.449+0000 7ff55e4b9640 1 --2- 172.21.15.7:0/737538254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff558101440 0x7ff55819abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.449+0000 7ff55e4b9640 1 -- 172.21.15.7:0/737538254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55819f620 con 0x7ff55810e500 2024-09-19T08:46:51.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.449+0000 7ff55e4b9640 1 --2- 172.21.15.7:0/737538254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff55810e500 0x7ff55819ef40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff5500319f0 tx=0x7ff550031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:51.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.449+0000 7ff54effd640 1 -- 172.21.15.7:0/737538254 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff550003b70 con 0x7ff55810e500 2024-09-19T08:46:51.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.449+0000 7ff54effd640 1 -- 172.21.15.7:0/737538254 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff550003d10 con 0x7ff55810e500 2024-09-19T08:46:51.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.449+0000 7ff54effd640 1 -- 172.21.15.7:0/737538254 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55002fd60 con 0x7ff55810e500 2024-09-19T08:46:51.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.449+0000 7ff55ff1c640 1 -- 172.21.15.7:0/737538254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff55819f8b0 con 0x7ff55810e500 2024-09-19T08:46:51.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.449+0000 7ff55ff1c640 1 -- 172.21.15.7:0/737538254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5581a71f0 con 0x7ff55810e500 2024-09-19T08:46:51.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.452+0000 7ff5622f5740 1 Processor -- start 2024-09-19T08:46:51.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.452+0000 7ff54effd640 1 -- 172.21.15.7:0/737538254 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff550004050 con 0x7ff55810e500 2024-09-19T08:46:51.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.452+0000 7ff5622f5740 1 -- start start 2024-09-19T08:46:51.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.452+0000 7ff5622f5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f1de86bb40 0x55f1de86a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:51.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.452+0000 7ff5622f5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de86a5d0 0x55f1de86aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:51.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.452+0000 7ff5622f5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de875370 0x55f1de877760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:51.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.452+0000 7ff5622f5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f1de7d02f0 con 0x55f1de875370 2024-09-19T08:46:51.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.452+0000 7ff5622f5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f1de777cf0 con 0x55f1de86bb40 2024-09-19T08:46:51.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.452+0000 7ff5622f5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f1de7cc2b0 con 0x55f1de86a5d0 2024-09-19T08:46:51.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.453+0000 7ff55d4b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de875370 0x55f1de877760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:51.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.453+0000 7ff55d4b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de875370 0x55f1de877760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38282/0 (socket says 172.21.15.7:38282) 2024-09-19T08:46:51.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.453+0000 7ff55d4b7640 1 -- 172.21.15.7:0/1606563773 learned_addr learned my addr 172.21.15.7:0/1606563773 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:51.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.453+0000 7ff55dcb8640 1 --2- 172.21.15.7:0/1606563773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de86a5d0 0x55f1de86aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:51.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.453+0000 7ff55d4b7640 1 --2- 172.21.15.7:0/1606563773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f1de86bb40 0x55f1de86a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:51.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.453+0000 7ff55dcb8640 1 -- 172.21.15.7:0/1606563773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f1de86bb40 msgr2=0x55f1de86a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:51.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.453+0000 7ff55dcb8640 1 --2- 172.21.15.7:0/1606563773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f1de86bb40 0x55f1de86a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.453+0000 7ff55dcb8640 1 -- 172.21.15.7:0/1606563773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de875370 msgr2=0x55f1de877760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:51.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.453+0000 7ff54effd640 1 --2- 172.21.15.7:0/737538254 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff5440a33b0 0x7ff5440a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:51.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.453+0000 7ff55dcb8640 1 --2- 172.21.15.7:0/1606563773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de875370 0x55f1de877760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.453+0000 7ff55dcb8640 1 -- 172.21.15.7:0/1606563773 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1de75c3a0 con 0x55f1de86a5d0 2024-09-19T08:46:51.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.453+0000 7ff55e4b9640 1 --2- 172.21.15.7:0/737538254 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff5440a33b0 0x7ff5440a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:51.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.453+0000 7ff55dcb8640 1 --2- 172.21.15.7:0/1606563773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de86a5d0 0x55f1de86aa10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff55400abf0 tx=0x7ff55400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44151ccffbda108f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:51.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.453+0000 7ff54effd640 1 -- 172.21.15.7:0/737538254 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7ff5500f0d90 con 0x7ff55810e500 2024-09-19T08:46:51.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.454+0000 7ff543fff640 1 -- 172.21.15.7:0/1606563773 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff554005220 con 0x55f1de86a5d0 2024-09-19T08:46:51.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.454+0000 7ff543fff640 1 -- 172.21.15.7:0/1606563773 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff554004c80 con 0x55f1de86a5d0 2024-09-19T08:46:51.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.454+0000 7ff543fff640 1 -- 172.21.15.7:0/1606563773 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5540187b0 con 0x55f1de86a5d0 2024-09-19T08:46:51.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.454+0000 7ff5622f5740 1 -- 172.21.15.7:0/1606563773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de86a5d0 msgr2=0x55f1de86aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:51.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.454+0000 7ff55e4b9640 1 --2- 172.21.15.7:0/737538254 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff5440a33b0 0x7ff5440a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff5500b9660 tx=0x7ff55002a8c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:51.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.454+0000 7ff5622f5740 1 --2- 172.21.15.7:0/1606563773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de86a5d0 0x55f1de86aa10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff55400abf0 tx=0x7ff55400f790 comp rx=0 tx=0).stop 2024-09-19T08:46:51.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.455+0000 7ff5622f5740 1 -- 172.21.15.7:0/1606563773 shutdown_connections 2024-09-19T08:46:51.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.455+0000 7ff5622f5740 1 --2- 172.21.15.7:0/1606563773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de875370 0x55f1de877760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.455+0000 7ff5622f5740 1 --2- 172.21.15.7:0/1606563773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de86a5d0 0x55f1de86aa10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.455+0000 7ff5622f5740 1 --2- 172.21.15.7:0/1606563773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f1de86bb40 0x55f1de86a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.455+0000 7ff5622f5740 1 -- 172.21.15.7:0/1606563773 >> 172.21.15.7:0/1606563773 conn(0x55f1de833310 msgr2=0x55f1de866c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:51.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.455+0000 7ff5622f5740 1 -- 172.21.15.7:0/1606563773 shutdown_connections 2024-09-19T08:46:51.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.455+0000 7ff5622f5740 1 -- 172.21.15.7:0/1606563773 wait complete. 2024-09-19T08:46:51.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.455+0000 7ff5622f5740 1 -- start start 2024-09-19T08:46:51.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.455+0000 7ff5622f5740 1 Processor -- start 2024-09-19T08:46:51.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.456+0000 7ff5622f5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f1de86a5d0 0x55f1de874cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:51.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.456+0000 7ff5622f5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de86bb40 0x55f1de871f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:51.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.456+0000 7ff5622f5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de875370 0x55f1de8724d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:51.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.456+0000 7ff5622f5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f1de878070 con 0x55f1de875370 2024-09-19T08:46:51.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.456+0000 7ff5622f5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f1de78b060 con 0x55f1de86a5d0 2024-09-19T08:46:51.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.456+0000 7ff5622f5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f1de8781f0 con 0x55f1de86bb40 2024-09-19T08:46:51.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.456+0000 7ff5622f5740 10 client.0 _ll_register_callbacks cb 0x55f1de4de8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:51.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.456+0000 7ff55d4b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de875370 0x55f1de8724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:51.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.456+0000 7ff55dcb8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de86bb40 0x55f1de871f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:51.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.456+0000 7ff55d4b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de875370 0x55f1de8724d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38298/0 (socket says 172.21.15.7:38298) 2024-09-19T08:46:51.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.456+0000 7ff55dcb8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de86bb40 0x55f1de871f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.7:41356/0 (socket says 172.21.15.7:41356) 2024-09-19T08:46:51.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.456+0000 7ff55d4b7640 1 -- 172.21.15.7:0/3749632543 learned_addr learned my addr 172.21.15.7:0/3749632543 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:51.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.456+0000 7ff55d4b7640 1 --2- 172.21.15.7:0/3749632543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f1de86a5d0 0x55f1de874cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:51.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.456+0000 7ff55dcb8640 1 -- 172.21.15.7:0/3749632543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f1de86a5d0 msgr2=0x55f1de874cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:51.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.456+0000 7ff55dcb8640 1 --2- 172.21.15.7:0/3749632543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f1de86a5d0 0x55f1de874cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.456+0000 7ff55dcb8640 1 -- 172.21.15.7:0/3749632543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de875370 msgr2=0x55f1de8724d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:51.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.456+0000 7ff55dcb8640 1 --2- 172.21.15.7:0/3749632543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de875370 0x55f1de8724d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.456+0000 7ff55dcb8640 1 -- 172.21.15.7:0/3749632543 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1de5413c0 con 0x55f1de86bb40 2024-09-19T08:46:51.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.456+0000 7ff55d4b7640 1 --2- 172.21.15.7:0/3749632543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de875370 0x55f1de8724d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:51.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.457+0000 7ff55dcb8640 1 --2- 172.21.15.7:0/3749632543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de86bb40 0x55f1de871f70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff554000c00 tx=0x7ff554018440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9edd9bb4d2bf0fd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:51.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.457+0000 7ff5417fa640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-19T08:46:51.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.457+0000 7ff5417fa640 1 -- 172.21.15.7:0/3749632543 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff554027070 con 0x55f1de86bb40 2024-09-19T08:46:51.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.457+0000 7ff5622f5740 1 -- 172.21.15.7:0/3749632543 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff554004c80 con 0x55f1de86bb40 2024-09-19T08:46:51.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.457+0000 7ff5417fa640 1 -- 172.21.15.7:0/3749632543 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7ff554005210 con 0x55f1de86bb40 2024-09-19T08:46:51.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.457+0000 7ff5417fa640 1 -- 172.21.15.7:0/3749632543 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff554033050 con 0x55f1de86bb40 2024-09-19T08:46:51.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.457+0000 7ff5622f5740 10 client.25384 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:51.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.457+0000 7ff5622f5740 1 -- 172.21.15.7:0/3749632543 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f1de883a80 con 0x55f1de86bb40 2024-09-19T08:46:51.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.457+0000 7ff5417fa640 1 -- 172.21.15.7:0/3749632543 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff554004c80 con 0x55f1de86bb40 2024-09-19T08:46:51.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.457+0000 7ff5417fa640 1 -- 172.21.15.7:0/3749632543 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff554023430 con 0x55f1de86bb40 2024-09-19T08:46:51.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.457+0000 7ff5622f5740 10 client.25384 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:51.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.458+0000 7ff5622f5740 10 client.25384 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:46:51.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.458+0000 7ff5622f5740 20 client.25384 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:51.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.458+0000 7ff5622f5740 1 --2- 172.21.15.7:0/3749632543 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f1de884e30 0x55f1de887220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:51.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.458+0000 7ff5622f5740 4 client.25384 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:46:51.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.458+0000 7ff5622f5740 1 -- 172.21.15.7:0/3749632543 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1de7dd860 con 0x55f1de884e30 2024-09-19T08:46:51.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.458+0000 7ff55d4b7640 1 --2- 172.21.15.7:0/3749632543 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f1de884e30 0x55f1de887220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:51.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.458+0000 7ff55d4b7640 1 --2- 172.21.15.7:0/3749632543 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f1de884e30 0x55f1de887220 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3ec27174a4446e7f server_cookie=ee3cbd0bf24f8ffa in_seq=0 out_seq=0 2024-09-19T08:46:51.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.458+0000 7ff5417fa640 10 client.25384 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:46:51.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.459+0000 7ff5417fa640 1 -- 172.21.15.7:0/3749632543 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f1de7dd860 con 0x55f1de884e30 2024-09-19T08:46:51.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.459+0000 7ff5417fa640 10 client.25384 handle_command_reply: tid=0 2024-09-19T08:46:51.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.459+0000 7ff5622f5740 1 client.25384 shutdown 2024-09-19T08:46:51.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.459+0000 7ff5622f5740 1 -- 172.21.15.7:0/3749632543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de86bb40 msgr2=0x55f1de871f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:51.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.459+0000 7ff5622f5740 1 --2- 172.21.15.7:0/3749632543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de86bb40 0x55f1de871f70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff554000c00 tx=0x7ff554018440 comp rx=0 tx=0).stop 2024-09-19T08:46:51.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.459+0000 7ff5622f5740 1 -- 172.21.15.7:0/3749632543 shutdown_connections 2024-09-19T08:46:51.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.459+0000 7ff5622f5740 1 --2- 172.21.15.7:0/3749632543 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f1de884e30 0x55f1de887220 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.459+0000 7ff5622f5740 1 --2- 172.21.15.7:0/3749632543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de875370 0x55f1de8724d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.459+0000 7ff5622f5740 1 --2- 172.21.15.7:0/3749632543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de86bb40 0x55f1de871f70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.459+0000 7ff5622f5740 1 --2- 172.21.15.7:0/3749632543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f1de86a5d0 0x55f1de874cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.459+0000 7ff5622f5740 1 -- 172.21.15.7:0/3749632543 >> 172.21.15.7:0/3749632543 conn(0x55f1de833310 msgr2=0x55f1de86c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:51.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.459+0000 7ff5417fa640 0 client.25384 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:46:51.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.459+0000 7ff5622f5740 1 -- 172.21.15.7:0/3749632543 shutdown_connections 2024-09-19T08:46:51.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.459+0000 7ff5622f5740 1 -- 172.21.15.7:0/3749632543 wait complete. 2024-09-19T08:46:51.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.460+0000 7ff5622f5740 20 client.25384 trim_cache size 0 max 16384 2024-09-19T08:46:51.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.473+0000 7ff5622f5740 1 Processor -- start 2024-09-19T08:46:51.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.473+0000 7ff5622f5740 1 -- start start 2024-09-19T08:46:51.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.473+0000 7ff5622f5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de86a5d0 0x55f1de881310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:51.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.473+0000 7ff5622f5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f1de86bb40 0x55f1de870f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:51.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.473+0000 7ff5622f5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de875370 0x55f1de88c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:51.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.473+0000 7ff5622f5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff5581b2300 con 0x55f1de86a5d0 2024-09-19T08:46:51.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.473+0000 7ff5622f5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff5581afbd0 con 0x55f1de86bb40 2024-09-19T08:46:51.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.473+0000 7ff5622f5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5581ada20 con 0x55f1de875370 2024-09-19T08:46:51.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.473+0000 7ff55d4b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de86a5d0 0x55f1de881310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:51.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.473+0000 7ff55d4b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de86a5d0 0x55f1de881310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38304/0 (socket says 172.21.15.7:38304) 2024-09-19T08:46:51.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.473+0000 7ff55d4b7640 1 -- 172.21.15.7:0/976757683 learned_addr learned my addr 172.21.15.7:0/976757683 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:51.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.473+0000 7ff55dcb8640 1 --2- 172.21.15.7:0/976757683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f1de86bb40 0x55f1de870f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:51.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.474+0000 7ff55d4b7640 1 --2- 172.21.15.7:0/976757683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de875370 0x55f1de88c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:51.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.474+0000 7ff55d4b7640 1 -- 172.21.15.7:0/976757683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de875370 msgr2=0x55f1de88c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:51.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.474+0000 7ff55d4b7640 1 --2- 172.21.15.7:0/976757683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de875370 0x55f1de88c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.474+0000 7ff55d4b7640 1 -- 172.21.15.7:0/976757683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f1de86bb40 msgr2=0x55f1de870f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:51.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.474+0000 7ff55d4b7640 1 --2- 172.21.15.7:0/976757683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f1de86bb40 0x55f1de870f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.474+0000 7ff55d4b7640 1 -- 172.21.15.7:0/976757683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1de8664f0 con 0x55f1de86a5d0 2024-09-19T08:46:51.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.474+0000 7ff55d4b7640 1 --2- 172.21.15.7:0/976757683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de86a5d0 0x55f1de881310 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff54800bee0 tx=0x7ff5480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b090560ae5df77d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:51.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.474+0000 7ff5437fe640 1 -- 172.21.15.7:0/976757683 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff548005020 con 0x55f1de86a5d0 2024-09-19T08:46:51.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.474+0000 7ff5437fe640 1 -- 172.21.15.7:0/976757683 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5480047a0 con 0x55f1de86a5d0 2024-09-19T08:46:51.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.474+0000 7ff5437fe640 1 -- 172.21.15.7:0/976757683 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff548003910 con 0x55f1de86a5d0 2024-09-19T08:46:51.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.475+0000 7ff5622f5740 1 -- 172.21.15.7:0/976757683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de86a5d0 msgr2=0x55f1de881310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:51.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.475+0000 7ff5622f5740 1 --2- 172.21.15.7:0/976757683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de86a5d0 0x55f1de881310 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff54800bee0 tx=0x7ff5480046c0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.475+0000 7ff5622f5740 1 -- 172.21.15.7:0/976757683 shutdown_connections 2024-09-19T08:46:51.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.475+0000 7ff5622f5740 1 --2- 172.21.15.7:0/976757683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de875370 0x55f1de88c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.475+0000 7ff5622f5740 1 --2- 172.21.15.7:0/976757683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f1de86bb40 0x55f1de870f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.475+0000 7ff5622f5740 1 --2- 172.21.15.7:0/976757683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de86a5d0 0x55f1de881310 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.475+0000 7ff5622f5740 1 -- 172.21.15.7:0/976757683 >> 172.21.15.7:0/976757683 conn(0x55f1de833310 msgr2=0x55f1de870840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:51.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.475+0000 7ff5622f5740 1 -- 172.21.15.7:0/976757683 shutdown_connections 2024-09-19T08:46:51.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.475+0000 7ff5622f5740 1 -- 172.21.15.7:0/976757683 wait complete. 2024-09-19T08:46:51.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.475+0000 7ff5622f5740 1 -- start start 2024-09-19T08:46:51.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.475+0000 7ff5622f5740 1 Processor -- start 2024-09-19T08:46:51.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.476+0000 7ff5622f5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de86a5d0 0x55f1de87d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:51.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.476+0000 7ff5622f5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f1de86bb40 0x55f1de87dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:51.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.476+0000 7ff5622f5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de875370 0x55f1de878bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:51.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.476+0000 7ff5622f5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff5581ae090 con 0x55f1de86a5d0 2024-09-19T08:46:51.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.476+0000 7ff5622f5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff5581af500 con 0x55f1de86bb40 2024-09-19T08:46:51.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.476+0000 7ff5622f5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5581ae760 con 0x55f1de875370 2024-09-19T08:46:51.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.476+0000 7ff5622f5740 10 client.0 _ll_register_callbacks cb 0x7ff54800ba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:51.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.476+0000 7ff55d4b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de86a5d0 0x55f1de87d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:51.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.476+0000 7ff55d4b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de86a5d0 0x55f1de87d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38310/0 (socket says 172.21.15.7:38310) 2024-09-19T08:46:51.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.476+0000 7ff55d4b7640 1 -- 172.21.15.7:0/2569287881 learned_addr learned my addr 172.21.15.7:0/2569287881 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:51.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.476+0000 7ff55dcb8640 1 --2- 172.21.15.7:0/2569287881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f1de86bb40 0x55f1de87dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:51.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.476+0000 7ff55d4b7640 1 --2- 172.21.15.7:0/2569287881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de875370 0x55f1de878bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:51.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.476+0000 7ff55d4b7640 1 -- 172.21.15.7:0/2569287881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de875370 msgr2=0x55f1de878bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:51.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.477+0000 7ff55d4b7640 1 --2- 172.21.15.7:0/2569287881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de875370 0x55f1de878bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.477+0000 7ff55d4b7640 1 -- 172.21.15.7:0/2569287881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f1de86bb40 msgr2=0x55f1de87dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:51.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.477+0000 7ff55d4b7640 1 --2- 172.21.15.7:0/2569287881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f1de86bb40 0x55f1de87dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.477+0000 7ff55d4b7640 1 -- 172.21.15.7:0/2569287881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1de879420 con 0x55f1de86a5d0 2024-09-19T08:46:51.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.477+0000 7ff55d4b7640 1 --2- 172.21.15.7:0/2569287881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de86a5d0 0x55f1de87d790 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff548006010 tx=0x7ff54800bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae8809c6107ff3d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:51.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.477+0000 7ff5417fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:51.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.477+0000 7ff5417fa640 1 -- 172.21.15.7:0/2569287881 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54803c060 con 0x55f1de86a5d0 2024-09-19T08:46:51.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.477+0000 7ff5417fa640 1 -- 172.21.15.7:0/2569287881 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7ff548012a60 con 0x55f1de86a5d0 2024-09-19T08:46:51.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.477+0000 7ff5622f5740 1 -- 172.21.15.7:0/2569287881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5480047a0 con 0x55f1de86a5d0 2024-09-19T08:46:51.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.477+0000 7ff5417fa640 1 -- 172.21.15.7:0/2569287881 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff548012c60 con 0x55f1de86a5d0 2024-09-19T08:46:51.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.477+0000 7ff5622f5740 10 client.15834 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:51.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.477+0000 7ff5622f5740 1 -- 172.21.15.7:0/2569287881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f1de8ef410 con 0x55f1de86a5d0 2024-09-19T08:46:51.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.477+0000 7ff5417fa640 1 -- 172.21.15.7:0/2569287881 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5480047a0 con 0x55f1de86a5d0 2024-09-19T08:46:51.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.478+0000 7ff5417fa640 1 -- 172.21.15.7:0/2569287881 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff548003910 con 0x55f1de86a5d0 2024-09-19T08:46:51.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.478+0000 7ff5622f5740 10 client.15834 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:51.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.478+0000 7ff5622f5740 10 client.15834 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:46:51.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.478+0000 7ff5622f5740 20 client.15834 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:51.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.478+0000 7ff5622f5740 1 --2- 172.21.15.7:0/2569287881 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f1de8efa80 0x55f1de8f1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:51.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.478+0000 7ff5622f5740 4 client.15834 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:46:51.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.478+0000 7ff5622f5740 1 -- 172.21.15.7:0/2569287881 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f1de7d7d70 con 0x55f1de8efa80 2024-09-19T08:46:51.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.478+0000 7ff55dcb8640 1 --2- 172.21.15.7:0/2569287881 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f1de8efa80 0x55f1de8f1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:51.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.478+0000 7ff55dcb8640 1 --2- 172.21.15.7:0/2569287881 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f1de8efa80 0x55f1de8f1ea0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5751e2a0a4a545b5 server_cookie=6c09f02c50c7e96e in_seq=0 out_seq=0 2024-09-19T08:46:51.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.478+0000 7ff5417fa640 10 client.15834 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:46:51.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.479+0000 7ff5417fa640 1 -- 172.21.15.7:0/2569287881 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f1de7d7d70 con 0x55f1de8efa80 2024-09-19T08:46:51.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.479+0000 7ff5417fa640 10 client.15834 handle_command_reply: tid=0 2024-09-19T08:46:51.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.479+0000 7ff5622f5740 1 client.15834 shutdown 2024-09-19T08:46:51.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.479+0000 7ff5622f5740 1 -- 172.21.15.7:0/2569287881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de86a5d0 msgr2=0x55f1de87d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:51.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.479+0000 7ff5622f5740 1 --2- 172.21.15.7:0/2569287881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de86a5d0 0x55f1de87d790 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff548006010 tx=0x7ff54800bf20 comp rx=0 tx=0).stop 2024-09-19T08:46:51.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.479+0000 7ff5622f5740 1 -- 172.21.15.7:0/2569287881 shutdown_connections 2024-09-19T08:46:51.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.479+0000 7ff5622f5740 1 --2- 172.21.15.7:0/2569287881 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f1de8efa80 0x55f1de8f1ea0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.479+0000 7ff5622f5740 1 --2- 172.21.15.7:0/2569287881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1de875370 0x55f1de878bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.479+0000 7ff5622f5740 1 --2- 172.21.15.7:0/2569287881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f1de86bb40 0x55f1de87dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.479+0000 7ff5622f5740 1 --2- 172.21.15.7:0/2569287881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1de86a5d0 0x55f1de87d790 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.479+0000 7ff5417fa640 0 client.15834 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:46:51.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.479+0000 7ff5622f5740 1 -- 172.21.15.7:0/2569287881 >> 172.21.15.7:0/2569287881 conn(0x55f1de833310 msgr2=0x55f1de871060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:51.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.479+0000 7ff5622f5740 1 -- 172.21.15.7:0/2569287881 shutdown_connections 2024-09-19T08:46:51.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.479+0000 7ff5622f5740 1 -- 172.21.15.7:0/2569287881 wait complete. 2024-09-19T08:46:51.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.479+0000 7ff5622f5740 20 client.15834 trim_cache size 0 max 16384 2024-09-19T08:46:51.484 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:46:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.480+0000 7ff55ff1c640 1 -- 172.21.15.7:0/737538254 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff5440a33b0 msgr2=0x7ff5440a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.480+0000 7ff55ff1c640 1 --2- 172.21.15.7:0/737538254 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff5440a33b0 0x7ff5440a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff5500b9660 tx=0x7ff55002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.480+0000 7ff55ff1c640 1 -- 172.21.15.7:0/737538254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff55810e500 msgr2=0x7ff55819ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.480+0000 7ff55ff1c640 1 --2- 172.21.15.7:0/737538254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff55810e500 0x7ff55819ef40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff5500319f0 tx=0x7ff550031a20 comp rx=0 tx=0).stop 2024-09-19T08:46:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.480+0000 7ff55ff1c640 1 -- 172.21.15.7:0/737538254 shutdown_connections 2024-09-19T08:46:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.480+0000 7ff55ff1c640 1 --2- 172.21.15.7:0/737538254 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff5440a33b0 0x7ff5440a5870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.480+0000 7ff55ff1c640 1 --2- 172.21.15.7:0/737538254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff55810e500 0x7ff55819ef40 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.480+0000 7ff55ff1c640 1 --2- 172.21.15.7:0/737538254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff558101440 0x7ff55819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.480+0000 7ff55ff1c640 1 --2- 172.21.15.7:0/737538254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff558100b20 0x7ff55819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.480+0000 7ff55ff1c640 1 -- 172.21.15.7:0/737538254 >> 172.21.15.7:0/737538254 conn(0x7ff5580fc7d0 msgr2=0x7ff5580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.480+0000 7ff55ff1c640 1 -- 172.21.15.7:0/737538254 shutdown_connections 2024-09-19T08:46:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:51.480+0000 7ff55ff1c640 1 -- 172.21.15.7:0/737538254 wait complete. 2024-09-19T08:46:52.286 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:46:52.568 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:46:53.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.041+0000 7f467e62a640 1 -- 172.21.15.7:0/1705262937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46781082a0 msgr2=0x7f467810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:53.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.041+0000 7f467e62a640 1 --2- 172.21.15.7:0/1705262937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46781082a0 0x7f467810ec40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4670009cd0 tx=0x7f467002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.041+0000 7f467e62a640 1 -- 172.21.15.7:0/1705262937 shutdown_connections 2024-09-19T08:46:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.041+0000 7f467e62a640 1 --2- 172.21.15.7:0/1705262937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46781082a0 0x7f467810ec40 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.041+0000 7f467e62a640 1 --2- 172.21.15.7:0/1705262937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46781036e0 0x7f4678107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.041+0000 7f467e62a640 1 --2- 172.21.15.7:0/1705262937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4678102d30 0x7f4678103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.041+0000 7f467e62a640 1 -- 172.21.15.7:0/1705262937 >> 172.21.15.7:0/1705262937 conn(0x7f46780fc7d0 msgr2=0x7f46780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.041+0000 7f467e62a640 1 -- 172.21.15.7:0/1705262937 shutdown_connections 2024-09-19T08:46:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.041+0000 7f467e62a640 1 -- 172.21.15.7:0/1705262937 wait complete. 2024-09-19T08:46:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.041+0000 7f467e62a640 1 Processor -- start 2024-09-19T08:46:53.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.041+0000 7f467e62a640 1 -- start start 2024-09-19T08:46:53.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.042+0000 7f467e62a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4678102d30 0x7f4678198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:53.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.042+0000 7f467e62a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46781036e0 0x7f4678198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:53.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.042+0000 7f467e62a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46781082a0 0x7f467819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:53.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.042+0000 7f467e62a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f46781120a0 con 0x7f46781082a0 2024-09-19T08:46:53.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.042+0000 7f467e62a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4678111f20 con 0x7f46781036e0 2024-09-19T08:46:53.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.042+0000 7f467e62a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4678112220 con 0x7f4678102d30 2024-09-19T08:46:53.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.042+0000 7f467cbc7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46781082a0 0x7f467819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:53.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.042+0000 7f467cbc7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46781082a0 0x7f467819ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38328/0 (socket says 172.21.15.7:38328) 2024-09-19T08:46:53.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.042+0000 7f467cbc7640 1 -- 172.21.15.7:0/3773832734 learned_addr learned my addr 172.21.15.7:0/3773832734 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:53.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.042+0000 7f4677fff640 1 --2- 172.21.15.7:0/3773832734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4678102d30 0x7f4678198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:53.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.042+0000 7f466ffff640 1 --2- 172.21.15.7:0/3773832734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46781036e0 0x7f4678198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:53.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.042+0000 7f467cbc7640 1 -- 172.21.15.7:0/3773832734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4678102d30 msgr2=0x7f4678198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:53.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.042+0000 7f467cbc7640 1 --2- 172.21.15.7:0/3773832734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4678102d30 0x7f4678198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.042+0000 7f467cbc7640 1 -- 172.21.15.7:0/3773832734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46781036e0 msgr2=0x7f4678198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:53.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.042+0000 7f467cbc7640 1 --2- 172.21.15.7:0/3773832734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46781036e0 0x7f4678198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.042+0000 7f467cbc7640 1 -- 172.21.15.7:0/3773832734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467819d4e0 con 0x7f46781082a0 2024-09-19T08:46:53.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.042+0000 7f466ffff640 1 --2- 172.21.15.7:0/3773832734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46781036e0 0x7f4678198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:53.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.042+0000 7f467cbc7640 1 --2- 172.21.15.7:0/3773832734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46781082a0 0x7f467819ce00 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4670005cc0 tx=0x7f46700093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:53.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.043+0000 7f4675ffb640 1 -- 172.21.15.7:0/3773832734 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4670003e00 con 0x7f46781082a0 2024-09-19T08:46:53.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.043+0000 7f4675ffb640 1 -- 172.21.15.7:0/3773832734 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4670004520 con 0x7f46781082a0 2024-09-19T08:46:53.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.043+0000 7f4675ffb640 1 -- 172.21.15.7:0/3773832734 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4670030db0 con 0x7f46781082a0 2024-09-19T08:46:53.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.043+0000 7f467e62a640 1 -- 172.21.15.7:0/3773832734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f467819d770 con 0x7f46781082a0 2024-09-19T08:46:53.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.043+0000 7f467e62a640 1 -- 172.21.15.7:0/3773832734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46781a50b0 con 0x7f46781082a0 2024-09-19T08:46:53.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.045+0000 7f4675ffb640 1 -- 172.21.15.7:0/3773832734 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f46700046d0 con 0x7f46781082a0 2024-09-19T08:46:53.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.046+0000 7f4680a03740 1 Processor -- start 2024-09-19T08:46:53.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.046+0000 7f4680a03740 1 -- start start 2024-09-19T08:46:53.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.046+0000 7f4680a03740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edc5b40 0x560e2edc4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:53.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.046+0000 7f4680a03740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e2edc45d0 0x560e2edc4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:53.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.046+0000 7f4680a03740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2edd3780 0x560e2edd5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:53.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.046+0000 7f4680a03740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560e2ed2a2f0 con 0x560e2edc5b40 2024-09-19T08:46:53.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.046+0000 7f4680a03740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560e2ecd1cf0 con 0x560e2edc45d0 2024-09-19T08:46:53.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.046+0000 7f4680a03740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560e2ed262b0 con 0x560e2edd3780 2024-09-19T08:46:53.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.046+0000 7f4675ffb640 1 --2- 172.21.15.7:0/3773832734 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f46640a33b0 0x7f46640a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:53.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.046+0000 7f466ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edc5b40 0x560e2edc4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:53.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.046+0000 7f466ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edc5b40 0x560e2edc4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38332/0 (socket says 172.21.15.7:38332) 2024-09-19T08:46:53.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.046+0000 7f466ffff640 1 -- 172.21.15.7:0/2720917397 learned_addr learned my addr 172.21.15.7:0/2720917397 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:53.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.046+0000 7f4677fff640 1 --2- 172.21.15.7:0/2720917397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e2edc45d0 0x560e2edc4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:53.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.046+0000 7f4675ffb640 1 -- 172.21.15.7:0/3773832734 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f467002e030 con 0x7f46781082a0 2024-09-19T08:46:53.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.046+0000 7f467cbc7640 1 --2- 172.21.15.7:0/3773832734 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f46640a33b0 0x7f46640a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:53.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.047+0000 7f466ffff640 1 --2- 172.21.15.7:0/2720917397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2edd3780 0x560e2edd5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:53.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.047+0000 7f4677fff640 1 -- 172.21.15.7:0/2720917397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2edd3780 msgr2=0x560e2edd5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:53.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.047+0000 7f4677fff640 1 --2- 172.21.15.7:0/2720917397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2edd3780 0x560e2edd5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.047+0000 7f4677fff640 1 -- 172.21.15.7:0/2720917397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edc5b40 msgr2=0x560e2edc4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:53.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.047+0000 7f4677fff640 1 --2- 172.21.15.7:0/2720917397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edc5b40 0x560e2edc4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.047+0000 7f4677fff640 1 -- 172.21.15.7:0/2720917397 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e2ecb63a0 con 0x560e2edc45d0 2024-09-19T08:46:53.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.047+0000 7f466ffff640 1 --2- 172.21.15.7:0/2720917397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edc5b40 0x560e2edc4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:53.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.047+0000 7f4677fff640 1 --2- 172.21.15.7:0/2720917397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e2edc45d0 0x560e2edc4a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4668009c00 tx=0x7f4668011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30d60ca026563ba4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:53.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.047+0000 7f467cbc7640 1 --2- 172.21.15.7:0/3773832734 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f46640a33b0 0x7f46640a5870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f46700c5e20 tx=0x7f46700095c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:53.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.047+0000 7f466e7fc640 1 -- 172.21.15.7:0/2720917397 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668004230 con 0x560e2edc45d0 2024-09-19T08:46:53.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.047+0000 7f466e7fc640 1 -- 172.21.15.7:0/2720917397 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46680043d0 con 0x560e2edc45d0 2024-09-19T08:46:53.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.047+0000 7f466e7fc640 1 -- 172.21.15.7:0/2720917397 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668004dd0 con 0x560e2edc45d0 2024-09-19T08:46:53.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.048+0000 7f4680a03740 1 -- 172.21.15.7:0/2720917397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e2edc45d0 msgr2=0x560e2edc4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:53.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.048+0000 7f4680a03740 1 --2- 172.21.15.7:0/2720917397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e2edc45d0 0x560e2edc4a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4668009c00 tx=0x7f4668011810 comp rx=0 tx=0).stop 2024-09-19T08:46:53.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.048+0000 7f4680a03740 1 -- 172.21.15.7:0/2720917397 shutdown_connections 2024-09-19T08:46:53.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.048+0000 7f4680a03740 1 --2- 172.21.15.7:0/2720917397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2edd3780 0x560e2edd5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.048+0000 7f4680a03740 1 --2- 172.21.15.7:0/2720917397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e2edc45d0 0x560e2edc4a10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.048+0000 7f4680a03740 1 --2- 172.21.15.7:0/2720917397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edc5b40 0x560e2edc4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.048+0000 7f4680a03740 1 -- 172.21.15.7:0/2720917397 >> 172.21.15.7:0/2720917397 conn(0x560e2ed8d310 msgr2=0x560e2edc0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:53.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.048+0000 7f4680a03740 1 -- 172.21.15.7:0/2720917397 shutdown_connections 2024-09-19T08:46:53.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.048+0000 7f4680a03740 1 -- 172.21.15.7:0/2720917397 wait complete. 2024-09-19T08:46:53.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.048+0000 7f4680a03740 1 -- start start 2024-09-19T08:46:53.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.049+0000 7f4680a03740 1 Processor -- start 2024-09-19T08:46:53.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.049+0000 7f4680a03740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edc45d0 0x560e2edd3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:53.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.049+0000 7f4680a03740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e2edc5b40 0x560e2edd03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:53.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.049+0000 7f4680a03740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2edd3780 0x560e2edd0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:53.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.049+0000 7f4680a03740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560e2edd6480 con 0x560e2edc45d0 2024-09-19T08:46:53.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.049+0000 7f4680a03740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560e2ece5060 con 0x560e2edc5b40 2024-09-19T08:46:53.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.049+0000 7f4680a03740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560e2edd6600 con 0x560e2edd3780 2024-09-19T08:46:53.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.049+0000 7f4680a03740 10 client.0 _ll_register_callbacks cb 0x560e2ea388c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:53.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.049+0000 7f466ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edc45d0 0x560e2edd3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:53.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.049+0000 7f466ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edc45d0 0x560e2edd3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38340/0 (socket says 172.21.15.7:38340) 2024-09-19T08:46:53.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.049+0000 7f466ffff640 1 -- 172.21.15.7:0/1965045241 learned_addr learned my addr 172.21.15.7:0/1965045241 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:53.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.049+0000 7f4677fff640 1 --2- 172.21.15.7:0/1965045241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e2edc5b40 0x560e2edd03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:53.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.050+0000 7f466ffff640 1 -- 172.21.15.7:0/1965045241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2edd3780 msgr2=0x560e2edd0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:53.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.050+0000 7f466ffff640 1 --2- 172.21.15.7:0/1965045241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2edd3780 0x560e2edd0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.050+0000 7f466ffff640 1 -- 172.21.15.7:0/1965045241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e2edc5b40 msgr2=0x560e2edd03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:53.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.050+0000 7f466ffff640 1 --2- 172.21.15.7:0/1965045241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e2edc5b40 0x560e2edd03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.050+0000 7f466ffff640 1 -- 172.21.15.7:0/1965045241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e2ea9b3c0 con 0x560e2edc45d0 2024-09-19T08:46:53.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.050+0000 7f466ffff640 1 --2- 172.21.15.7:0/1965045241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edc45d0 0x560e2edd3120 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4660009d00 tx=0x7f4660009df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923954d79aff2e53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:53.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.050+0000 7f46577fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:53.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.050+0000 7f46577fe640 1 -- 172.21.15.7:0/1965045241 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466000fcd0 con 0x560e2edc45d0 2024-09-19T08:46:53.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.050+0000 7f46577fe640 1 -- 172.21.15.7:0/1965045241 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f466001e430 con 0x560e2edc45d0 2024-09-19T08:46:53.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.050+0000 7f4680a03740 1 -- 172.21.15.7:0/1965045241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46680043d0 con 0x560e2edc45d0 2024-09-19T08:46:53.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.050+0000 7f46577fe640 1 -- 172.21.15.7:0/1965045241 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f466000fe70 con 0x560e2edc45d0 2024-09-19T08:46:53.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.050+0000 7f4680a03740 10 client.15846 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:53.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.050+0000 7f4680a03740 1 -- 172.21.15.7:0/1965045241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560e2ede1f30 con 0x560e2edc45d0 2024-09-19T08:46:53.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.050+0000 7f46577fe640 1 -- 172.21.15.7:0/1965045241 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46680043d0 con 0x560e2edc45d0 2024-09-19T08:46:53.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.051+0000 7f46577fe640 1 -- 172.21.15.7:0/1965045241 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f46600108f0 con 0x560e2edc45d0 2024-09-19T08:46:53.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.051+0000 7f4680a03740 10 client.15846 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:53.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.051+0000 7f4680a03740 10 client.15846 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:46:53.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.051+0000 7f4680a03740 20 client.15846 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:53.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.051+0000 7f4680a03740 1 --2- 172.21.15.7:0/1965045241 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x560e2ede33f0 0x560e2ede5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:53.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.051+0000 7f4680a03740 4 client.15846 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:46:53.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.051+0000 7f4680a03740 1 -- 172.21.15.7:0/1965045241 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e2ed37860 con 0x560e2ede33f0 2024-09-19T08:46:53.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.051+0000 7f4677fff640 1 --2- 172.21.15.7:0/1965045241 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x560e2ede33f0 0x560e2ede5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:53.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.051+0000 7f4677fff640 1 --2- 172.21.15.7:0/1965045241 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x560e2ede33f0 0x560e2ede5800 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=81ea7de60c37674a server_cookie=7a92b87682cfbbba in_seq=0 out_seq=0 2024-09-19T08:46:53.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.051+0000 7f46577fe640 10 client.15846 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:46:53.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.052+0000 7f46577fe640 1 -- 172.21.15.7:0/1965045241 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e2ed37860 con 0x560e2ede33f0 2024-09-19T08:46:53.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.052+0000 7f46577fe640 10 client.15846 handle_command_reply: tid=0 2024-09-19T08:46:53.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.052+0000 7f4680a03740 1 client.15846 shutdown 2024-09-19T08:46:53.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.052+0000 7f4680a03740 1 -- 172.21.15.7:0/1965045241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edc45d0 msgr2=0x560e2edd3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:53.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.052+0000 7f4680a03740 1 --2- 172.21.15.7:0/1965045241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edc45d0 0x560e2edd3120 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4660009d00 tx=0x7f4660009df0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.052+0000 7f4680a03740 1 -- 172.21.15.7:0/1965045241 shutdown_connections 2024-09-19T08:46:53.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.052+0000 7f4680a03740 1 --2- 172.21.15.7:0/1965045241 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x560e2ede33f0 0x560e2ede5800 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.052+0000 7f46577fe640 0 client.15846 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:46:53.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.052+0000 7f4680a03740 1 --2- 172.21.15.7:0/1965045241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2edd3780 0x560e2edd0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.052+0000 7f4680a03740 1 --2- 172.21.15.7:0/1965045241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e2edc5b40 0x560e2edd03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.052+0000 7f4680a03740 1 --2- 172.21.15.7:0/1965045241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edc45d0 0x560e2edd3120 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.052+0000 7f4680a03740 1 -- 172.21.15.7:0/1965045241 >> 172.21.15.7:0/1965045241 conn(0x560e2ed8d310 msgr2=0x560e2edc6930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:53.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.052+0000 7f4680a03740 1 -- 172.21.15.7:0/1965045241 shutdown_connections 2024-09-19T08:46:53.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.052+0000 7f4680a03740 1 -- 172.21.15.7:0/1965045241 wait complete. 2024-09-19T08:46:53.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.053+0000 7f4680a03740 20 client.15846 trim_cache size 0 max 16384 2024-09-19T08:46:53.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.067+0000 7f4680a03740 1 Processor -- start 2024-09-19T08:46:53.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.067+0000 7f4680a03740 1 -- start start 2024-09-19T08:46:53.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.067+0000 7f4680a03740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edc45d0 0x560e2eddf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:53.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.067+0000 7f4680a03740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e2edc5b40 0x560e2edcfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:53.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.067+0000 7f4680a03740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2edd3780 0x560e2edbfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:53.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.067+0000 7f4680a03740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f46781adec0 con 0x560e2edc45d0 2024-09-19T08:46:53.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.067+0000 7f4680a03740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f46781ab790 con 0x560e2edc5b40 2024-09-19T08:46:53.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.067+0000 7f4680a03740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f46781a95e0 con 0x560e2edd3780 2024-09-19T08:46:53.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.067+0000 7f466ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edc45d0 0x560e2eddf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:53.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.067+0000 7f466ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edc45d0 0x560e2eddf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38350/0 (socket says 172.21.15.7:38350) 2024-09-19T08:46:53.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.067+0000 7f466ffff640 1 -- 172.21.15.7:0/4026847973 learned_addr learned my addr 172.21.15.7:0/4026847973 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:53.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.068+0000 7f4677fff640 1 --2- 172.21.15.7:0/4026847973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e2edc5b40 0x560e2edcfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:53.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.068+0000 7f466ffff640 1 -- 172.21.15.7:0/4026847973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2edd3780 msgr2=0x560e2edbfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:53.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.068+0000 7f466ffff640 1 --2- 172.21.15.7:0/4026847973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2edd3780 0x560e2edbfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.068+0000 7f466ffff640 1 -- 172.21.15.7:0/4026847973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e2edc5b40 msgr2=0x560e2edcfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:53.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.068+0000 7f466ffff640 1 --2- 172.21.15.7:0/4026847973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e2edc5b40 0x560e2edcfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.068+0000 7f466ffff640 1 -- 172.21.15.7:0/4026847973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e2edcf380 con 0x560e2edc45d0 2024-09-19T08:46:53.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.068+0000 7f466ffff640 1 --2- 172.21.15.7:0/4026847973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edc45d0 0x560e2eddf720 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4660001eb0 tx=0x7f4660010fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128a9d214a79e4db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:53.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.068+0000 7f466dffb640 1 -- 172.21.15.7:0/4026847973 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466000fad0 con 0x560e2edc45d0 2024-09-19T08:46:53.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.068+0000 7f466dffb640 1 -- 172.21.15.7:0/4026847973 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f466000fc70 con 0x560e2edc45d0 2024-09-19T08:46:53.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.068+0000 7f466dffb640 1 -- 172.21.15.7:0/4026847973 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4660003b60 con 0x560e2edc45d0 2024-09-19T08:46:53.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.069+0000 7f4680a03740 1 -- 172.21.15.7:0/4026847973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edc45d0 msgr2=0x560e2eddf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:53.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.069+0000 7f4680a03740 1 --2- 172.21.15.7:0/4026847973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edc45d0 0x560e2eddf720 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4660001eb0 tx=0x7f4660010fb0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.069+0000 7f4680a03740 1 -- 172.21.15.7:0/4026847973 shutdown_connections 2024-09-19T08:46:53.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.069+0000 7f4680a03740 1 --2- 172.21.15.7:0/4026847973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2edd3780 0x560e2edbfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.069+0000 7f4680a03740 1 --2- 172.21.15.7:0/4026847973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e2edc5b40 0x560e2edcfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.069+0000 7f4680a03740 1 --2- 172.21.15.7:0/4026847973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edc45d0 0x560e2eddf720 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.069+0000 7f4680a03740 1 -- 172.21.15.7:0/4026847973 >> 172.21.15.7:0/4026847973 conn(0x560e2ed8d310 msgr2=0x560e2edbf500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:53.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.069+0000 7f4680a03740 1 -- 172.21.15.7:0/4026847973 shutdown_connections 2024-09-19T08:46:53.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.069+0000 7f4680a03740 1 -- 172.21.15.7:0/4026847973 wait complete. 2024-09-19T08:46:53.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.069+0000 7f4680a03740 1 -- start start 2024-09-19T08:46:53.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.070+0000 7f4680a03740 1 Processor -- start 2024-09-19T08:46:53.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.070+0000 7f4680a03740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2edc45d0 0x560e2edcd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:53.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.070+0000 7f4680a03740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e2edc5b40 0x560e2edcd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:53.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.070+0000 7f4680a03740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edd3780 0x560e2edcde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.070+0000 7f4680a03740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f46781a9c50 con 0x560e2edd3780 2024-09-19T08:46:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.070+0000 7f4680a03740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f46781ab0c0 con 0x560e2edc5b40 2024-09-19T08:46:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.070+0000 7f4680a03740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f46781aa320 con 0x560e2edc45d0 2024-09-19T08:46:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.070+0000 7f4680a03740 10 client.0 _ll_register_callbacks cb 0x7f4660009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.070+0000 7f466ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edd3780 0x560e2edcde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.070+0000 7f4677fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e2edc5b40 0x560e2edcd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.070+0000 7f466ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edd3780 0x560e2edcde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38358/0 (socket says 172.21.15.7:38358) 2024-09-19T08:46:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.070+0000 7f466ffff640 1 -- 172.21.15.7:0/2151386913 learned_addr learned my addr 172.21.15.7:0/2151386913 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.070+0000 7f466ffff640 1 --2- 172.21.15.7:0/2151386913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2edc45d0 0x560e2edcd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.071+0000 7f4677fff640 1 -- 172.21.15.7:0/2151386913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2edc45d0 msgr2=0x560e2edcd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.071+0000 7f4677fff640 1 --2- 172.21.15.7:0/2151386913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2edc45d0 0x560e2edcd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.071+0000 7f4677fff640 1 -- 172.21.15.7:0/2151386913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edd3780 msgr2=0x560e2edcde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.071+0000 7f4677fff640 1 --2- 172.21.15.7:0/2151386913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edd3780 0x560e2edcde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.071+0000 7f4677fff640 1 -- 172.21.15.7:0/2151386913 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e2ee4d0f0 con 0x560e2edc5b40 2024-09-19T08:46:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.071+0000 7f466ffff640 1 --2- 172.21.15.7:0/2151386913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2edc45d0 0x560e2edcd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.071+0000 7f4677fff640 1 --2- 172.21.15.7:0/2151386913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e2edc5b40 0x560e2edcd950 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4668009bd0 tx=0x7f46680047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9027a76b7624c6fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.071+0000 7f46577fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-19T08:46:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.071+0000 7f46577fe640 1 -- 172.21.15.7:0/2151386913 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668004250 con 0x560e2edc5b40 2024-09-19T08:46:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.071+0000 7f4680a03740 1 -- 172.21.15.7:0/2151386913 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f466000fc70 con 0x560e2edc5b40 2024-09-19T08:46:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.071+0000 7f46577fe640 1 -- 172.21.15.7:0/2151386913 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f46680043f0 con 0x560e2edc5b40 2024-09-19T08:46:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.071+0000 7f46577fe640 1 -- 172.21.15.7:0/2151386913 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f46680035f0 con 0x560e2edc5b40 2024-09-19T08:46:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.071+0000 7f4680a03740 10 client.25568 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.071+0000 7f4680a03740 1 -- 172.21.15.7:0/2151386913 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560e2ee4e3d0 con 0x560e2edc5b40 2024-09-19T08:46:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.072+0000 7f46577fe640 1 -- 172.21.15.7:0/2151386913 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f466000fc70 con 0x560e2edc5b40 2024-09-19T08:46:53.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.072+0000 7f46577fe640 1 -- 172.21.15.7:0/2151386913 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4668024040 con 0x560e2edc5b40 2024-09-19T08:46:53.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.072+0000 7f4680a03740 10 client.25568 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:53.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.072+0000 7f4680a03740 10 client.25568 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:46:53.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.072+0000 7f4680a03740 20 client.25568 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:53.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.072+0000 7f4680a03740 1 --2- 172.21.15.7:0/2151386913 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x560e2ede33f0 0x560e2ee50a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:53.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.072+0000 7f4680a03740 4 client.25568 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:46:53.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.072+0000 7f4680a03740 1 -- 172.21.15.7:0/2151386913 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560e2ed31d70 con 0x560e2ede33f0 2024-09-19T08:46:53.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.072+0000 7f466ffff640 1 --2- 172.21.15.7:0/2151386913 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x560e2ede33f0 0x560e2ee50a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:53.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.073+0000 7f466ffff640 1 --2- 172.21.15.7:0/2151386913 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x560e2ede33f0 0x560e2ee50a20 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b0f5071a89795fdd server_cookie=14d6ba56e76cb92d in_seq=0 out_seq=0 2024-09-19T08:46:53.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.073+0000 7f46577fe640 10 client.25568 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:46:53.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.073+0000 7f46577fe640 1 -- 172.21.15.7:0/2151386913 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560e2ed31d70 con 0x560e2ede33f0 2024-09-19T08:46:53.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.073+0000 7f46577fe640 10 client.25568 handle_command_reply: tid=0 2024-09-19T08:46:53.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.073+0000 7f4680a03740 1 client.25568 shutdown 2024-09-19T08:46:53.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.073+0000 7f4680a03740 1 -- 172.21.15.7:0/2151386913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e2edc5b40 msgr2=0x560e2edcd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:53.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.073+0000 7f4680a03740 1 --2- 172.21.15.7:0/2151386913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e2edc5b40 0x560e2edcd950 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4668009bd0 tx=0x7f46680047c0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.073+0000 7f4680a03740 1 -- 172.21.15.7:0/2151386913 shutdown_connections 2024-09-19T08:46:53.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.073+0000 7f4680a03740 1 --2- 172.21.15.7:0/2151386913 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x560e2ede33f0 0x560e2ee50a20 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.073+0000 7f4680a03740 1 --2- 172.21.15.7:0/2151386913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e2edd3780 0x560e2edcde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.073+0000 7f46577fe640 0 client.25568 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:46:53.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.073+0000 7f4680a03740 1 --2- 172.21.15.7:0/2151386913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e2edc5b40 0x560e2edcd950 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.073+0000 7f4680a03740 1 --2- 172.21.15.7:0/2151386913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e2edc45d0 0x560e2edcd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.073+0000 7f4680a03740 1 -- 172.21.15.7:0/2151386913 >> 172.21.15.7:0/2151386913 conn(0x560e2ed8d310 msgr2=0x560e2edbfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:53.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.073+0000 7f4680a03740 1 -- 172.21.15.7:0/2151386913 shutdown_connections 2024-09-19T08:46:53.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.073+0000 7f4680a03740 1 -- 172.21.15.7:0/2151386913 wait complete. 2024-09-19T08:46:53.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.074+0000 7f4680a03740 20 client.25568 trim_cache size 0 max 16384 2024-09-19T08:46:53.093 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:46:53.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.074+0000 7f467e62a640 1 -- 172.21.15.7:0/3773832734 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f46640a33b0 msgr2=0x7f46640a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:53.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.074+0000 7f467e62a640 1 --2- 172.21.15.7:0/3773832734 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f46640a33b0 0x7f46640a5870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f46700c5e20 tx=0x7f46700095c0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.074+0000 7f467e62a640 1 -- 172.21.15.7:0/3773832734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46781082a0 msgr2=0x7f467819ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:53.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.074+0000 7f467e62a640 1 --2- 172.21.15.7:0/3773832734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46781082a0 0x7f467819ce00 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4670005cc0 tx=0x7f46700093d0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.074+0000 7f467e62a640 1 -- 172.21.15.7:0/3773832734 shutdown_connections 2024-09-19T08:46:53.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.074+0000 7f467e62a640 1 --2- 172.21.15.7:0/3773832734 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f46640a33b0 0x7f46640a5870 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.074+0000 7f467e62a640 1 --2- 172.21.15.7:0/3773832734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46781082a0 0x7f467819ce00 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.074+0000 7f467e62a640 1 --2- 172.21.15.7:0/3773832734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46781036e0 0x7f4678198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.074+0000 7f467e62a640 1 --2- 172.21.15.7:0/3773832734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4678102d30 0x7f4678198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:53.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.074+0000 7f467e62a640 1 -- 172.21.15.7:0/3773832734 >> 172.21.15.7:0/3773832734 conn(0x7f46780fc7d0 msgr2=0x7f4678105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:53.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.074+0000 7f467e62a640 1 -- 172.21.15.7:0/3773832734 shutdown_connections 2024-09-19T08:46:53.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:53.074+0000 7f467e62a640 1 -- 172.21.15.7:0/3773832734 wait complete. 2024-09-19T08:46:53.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:52 smithi007 ceph-mon[31221]: pgmap v73: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 691 KiB/s wr, 6 op/s 2024-09-19T08:46:53.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:52 smithi044 ceph-mon[35072]: pgmap v73: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 691 KiB/s wr, 6 op/s 2024-09-19T08:46:53.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:52 smithi175 ceph-mon[35688]: pgmap v73: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 691 KiB/s wr, 6 op/s 2024-09-19T08:46:53.841 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:46:54.117 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:46:54.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.547+0000 7f3372c77640 1 -- 172.21.15.7:0/5133245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f336c100e20 msgr2=0x7f336c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:54.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.547+0000 7f3372c77640 1 --2- 172.21.15.7:0/5133245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f336c100e20 0x7f336c101200 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f3360009900 tx=0x7f336002a480 comp rx=0 tx=0).stop 2024-09-19T08:46:54.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.547+0000 7f3372c77640 1 -- 172.21.15.7:0/5133245 shutdown_connections 2024-09-19T08:46:54.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.547+0000 7f3372c77640 1 --2- 172.21.15.7:0/5133245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f336c102ef0 0x7f336c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.547+0000 7f3372c77640 1 --2- 172.21.15.7:0/5133245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f336c102570 0x7f336c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.547+0000 7f3372c77640 1 --2- 172.21.15.7:0/5133245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f336c100e20 0x7f336c101200 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.547+0000 7f3372c77640 1 -- 172.21.15.7:0/5133245 >> 172.21.15.7:0/5133245 conn(0x7f336c0fc7d0 msgr2=0x7f336c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:54.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.547+0000 7f3372c77640 1 -- 172.21.15.7:0/5133245 shutdown_connections 2024-09-19T08:46:54.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.547+0000 7f3372c77640 1 -- 172.21.15.7:0/5133245 wait complete. 2024-09-19T08:46:54.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.547+0000 7f3372c77640 1 Processor -- start 2024-09-19T08:46:54.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.548+0000 7f3372c77640 1 -- start start 2024-09-19T08:46:54.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.548+0000 7f3372c77640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f336c100e20 0x7f336c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:54.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.548+0000 7f3372c77640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f336c102570 0x7f336c199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:54.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.548+0000 7f3372c77640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f336c102ef0 0x7f336c1a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:54.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.548+0000 7f3372c77640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f336c110f80 con 0x7f336c102570 2024-09-19T08:46:54.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.548+0000 7f3372c77640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f336c110e00 con 0x7f336c100e20 2024-09-19T08:46:54.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.548+0000 7f3372c77640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f336c111100 con 0x7f336c102ef0 2024-09-19T08:46:54.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.548+0000 7f336bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f336c102570 0x7f336c199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:54.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.548+0000 7f336bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f336c102570 0x7f336c199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57830/0 (socket says 172.21.15.7:57830) 2024-09-19T08:46:54.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.548+0000 7f336bfff640 1 -- 172.21.15.7:0/3717123259 learned_addr learned my addr 172.21.15.7:0/3717123259 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:54.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.548+0000 7f3371214640 1 --2- 172.21.15.7:0/3717123259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f336c102ef0 0x7f336c1a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:54.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.548+0000 7f3370a13640 1 --2- 172.21.15.7:0/3717123259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f336c100e20 0x7f336c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:54.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.548+0000 7f336bfff640 1 -- 172.21.15.7:0/3717123259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f336c102ef0 msgr2=0x7f336c1a43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:54.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.548+0000 7f336bfff640 1 --2- 172.21.15.7:0/3717123259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f336c102ef0 0x7f336c1a43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.548+0000 7f336bfff640 1 -- 172.21.15.7:0/3717123259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f336c100e20 msgr2=0x7f336c199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:54.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.548+0000 7f336bfff640 1 --2- 172.21.15.7:0/3717123259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f336c100e20 0x7f336c199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.548+0000 7f336bfff640 1 -- 172.21.15.7:0/3717123259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336c1a48e0 con 0x7f336c102570 2024-09-19T08:46:54.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.549+0000 7f336bfff640 1 --2- 172.21.15.7:0/3717123259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f336c102570 0x7f336c199860 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f335800d950 tx=0x7f335800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:54.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.549+0000 7f3369ffb640 1 -- 172.21.15.7:0/3717123259 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3358017070 con 0x7f336c102570 2024-09-19T08:46:54.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.549+0000 7f3369ffb640 1 -- 172.21.15.7:0/3717123259 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3358009c30 con 0x7f336c102570 2024-09-19T08:46:54.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.549+0000 7f3372c77640 1 -- 172.21.15.7:0/3717123259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f336c1a4ab0 con 0x7f336c102570 2024-09-19T08:46:54.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.549+0000 7f3369ffb640 1 -- 172.21.15.7:0/3717123259 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335800f6b0 con 0x7f336c102570 2024-09-19T08:46:54.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.549+0000 7f3372c77640 1 -- 172.21.15.7:0/3717123259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f336c1a4ff0 con 0x7f336c102570 2024-09-19T08:46:54.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.552+0000 7f3375050740 1 Processor -- start 2024-09-19T08:46:54.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.552+0000 7f3375050740 1 -- start start 2024-09-19T08:46:54.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.552+0000 7f3369ffb640 1 -- 172.21.15.7:0/3717123259 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f33580109d0 con 0x7f336c102570 2024-09-19T08:46:54.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.552+0000 7f3375050740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55844f703b40 0x55844f702090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:54.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.552+0000 7f3375050740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f7025d0 0x55844f702a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:54.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.552+0000 7f3375050740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f70d370 0x55844f70f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:54.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.552+0000 7f3375050740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55844f6682f0 con 0x55844f7025d0 2024-09-19T08:46:54.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.552+0000 7f3375050740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55844f60fcf0 con 0x55844f703b40 2024-09-19T08:46:54.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.552+0000 7f3375050740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55844f6642b0 con 0x55844f70d370 2024-09-19T08:46:54.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.553+0000 7f3370a13640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f7025d0 0x55844f702a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:54.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.553+0000 7f3370a13640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f7025d0 0x55844f702a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57840/0 (socket says 172.21.15.7:57840) 2024-09-19T08:46:54.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.553+0000 7f3370a13640 1 -- 172.21.15.7:0/499466820 learned_addr learned my addr 172.21.15.7:0/499466820 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:54.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.553+0000 7f3371214640 1 --2- 172.21.15.7:0/499466820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55844f703b40 0x55844f702090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:54.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.553+0000 7f336bfff640 1 --2- 172.21.15.7:0/499466820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f70d370 0x55844f70f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:54.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.553+0000 7f3370a13640 1 -- 172.21.15.7:0/499466820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f70d370 msgr2=0x55844f70f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:54.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.553+0000 7f3370a13640 1 --2- 172.21.15.7:0/499466820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f70d370 0x55844f70f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.553+0000 7f3370a13640 1 -- 172.21.15.7:0/499466820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55844f703b40 msgr2=0x55844f702090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:54.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.553+0000 7f3370a13640 1 --2- 172.21.15.7:0/499466820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55844f703b40 0x55844f702090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.553+0000 7f3370a13640 1 -- 172.21.15.7:0/499466820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55844f5f43a0 con 0x55844f7025d0 2024-09-19T08:46:54.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.553+0000 7f3371214640 1 --2- 172.21.15.7:0/499466820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55844f703b40 0x55844f702090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:54.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.553+0000 7f336bfff640 1 --2- 172.21.15.7:0/499466820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f70d370 0x55844f70f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:46:54.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.553+0000 7f3370a13640 1 --2- 172.21.15.7:0/499466820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f7025d0 0x55844f702a10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f336002a9a0 tx=0x7f33600040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8904a3647af600a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:54.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.553+0000 7f3369ffb640 1 --2- 172.21.15.7:0/3717123259 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f335c0a33b0 0x7f335c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:54.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.554+0000 7f3356ffd640 1 -- 172.21.15.7:0/499466820 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3360035030 con 0x55844f7025d0 2024-09-19T08:46:54.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.554+0000 7f3356ffd640 1 -- 172.21.15.7:0/499466820 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3360040070 con 0x55844f7025d0 2024-09-19T08:46:54.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.554+0000 7f3356ffd640 1 -- 172.21.15.7:0/499466820 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3360031a40 con 0x55844f7025d0 2024-09-19T08:46:54.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.554+0000 7f3371214640 1 --2- 172.21.15.7:0/3717123259 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f335c0a33b0 0x7f335c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:54.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.554+0000 7f3369ffb640 1 -- 172.21.15.7:0/3717123259 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f33580cf910 con 0x7f336c102570 2024-09-19T08:46:54.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.555+0000 7f3375050740 1 -- 172.21.15.7:0/499466820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f7025d0 msgr2=0x55844f702a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:54.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.555+0000 7f3371214640 1 --2- 172.21.15.7:0/3717123259 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f335c0a33b0 0x7f335c0a5870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3364005fd0 tx=0x7f3364009600 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:54.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.555+0000 7f3375050740 1 --2- 172.21.15.7:0/499466820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f7025d0 0x55844f702a10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f336002a9a0 tx=0x7f33600040c0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.555+0000 7f3375050740 1 -- 172.21.15.7:0/499466820 shutdown_connections 2024-09-19T08:46:54.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.555+0000 7f3375050740 1 --2- 172.21.15.7:0/499466820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f70d370 0x55844f70f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.555+0000 7f3375050740 1 --2- 172.21.15.7:0/499466820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f7025d0 0x55844f702a10 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.555+0000 7f3375050740 1 --2- 172.21.15.7:0/499466820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55844f703b40 0x55844f702090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.555+0000 7f3375050740 1 -- 172.21.15.7:0/499466820 >> 172.21.15.7:0/499466820 conn(0x55844f6cb310 msgr2=0x55844f6fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:54.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.555+0000 7f3375050740 1 -- 172.21.15.7:0/499466820 shutdown_connections 2024-09-19T08:46:54.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.555+0000 7f3375050740 1 -- 172.21.15.7:0/499466820 wait complete. 2024-09-19T08:46:54.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.555+0000 7f3375050740 1 -- start start 2024-09-19T08:46:54.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.555+0000 7f3375050740 1 Processor -- start 2024-09-19T08:46:54.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.556+0000 7f3375050740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f7025d0 0x55844f70cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:54.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.556+0000 7f3375050740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f703b40 0x55844f709fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:54.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.556+0000 7f3375050740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55844f70d370 0x55844f70a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:54.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.556+0000 7f3375050740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55844f710010 con 0x55844f7025d0 2024-09-19T08:46:54.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.556+0000 7f3375050740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55844f623060 con 0x55844f70d370 2024-09-19T08:46:54.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.556+0000 7f3375050740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55844f710190 con 0x55844f703b40 2024-09-19T08:46:54.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.556+0000 7f3375050740 10 client.0 _ll_register_callbacks cb 0x55844f3768c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:54.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.556+0000 7f3370a13640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f7025d0 0x55844f70cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:54.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.556+0000 7f3370a13640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f7025d0 0x55844f70cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57852/0 (socket says 172.21.15.7:57852) 2024-09-19T08:46:54.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.556+0000 7f3370a13640 1 -- 172.21.15.7:0/3498163854 learned_addr learned my addr 172.21.15.7:0/3498163854 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:54.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.556+0000 7f3371214640 1 --2- 172.21.15.7:0/3498163854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55844f70d370 0x55844f70a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:54.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.556+0000 7f336bfff640 1 --2- 172.21.15.7:0/3498163854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f703b40 0x55844f709fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:54.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.556+0000 7f3370a13640 1 -- 172.21.15.7:0/3498163854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f703b40 msgr2=0x55844f709fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:54.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.556+0000 7f3370a13640 1 --2- 172.21.15.7:0/3498163854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f703b40 0x55844f709fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.556+0000 7f3370a13640 1 -- 172.21.15.7:0/3498163854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55844f70d370 msgr2=0x55844f70a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:54.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.556+0000 7f3370a13640 1 --2- 172.21.15.7:0/3498163854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55844f70d370 0x55844f70a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.556+0000 7f3370a13640 1 -- 172.21.15.7:0/3498163854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55844f3d93c0 con 0x55844f7025d0 2024-09-19T08:46:54.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.556+0000 7f3370a13640 1 --2- 172.21.15.7:0/3498163854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f7025d0 0x55844f70cd10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3360005940 tx=0x7f33600316c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556513f6687046f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:54.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.556+0000 7f334bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:54.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.557+0000 7f334bfff640 1 -- 172.21.15.7:0/3498163854 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3360035070 con 0x55844f7025d0 2024-09-19T08:46:54.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.557+0000 7f334bfff640 1 -- 172.21.15.7:0/3498163854 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f33600319d0 con 0x55844f7025d0 2024-09-19T08:46:54.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.557+0000 7f3375050740 1 -- 172.21.15.7:0/3498163854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3360040070 con 0x55844f7025d0 2024-09-19T08:46:54.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.557+0000 7f334bfff640 1 -- 172.21.15.7:0/3498163854 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3360056050 con 0x55844f7025d0 2024-09-19T08:46:54.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.557+0000 7f3375050740 10 client.15864 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:54.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.557+0000 7f3375050740 1 -- 172.21.15.7:0/3498163854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55844f71b9d0 con 0x55844f7025d0 2024-09-19T08:46:54.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.557+0000 7f334bfff640 1 -- 172.21.15.7:0/3498163854 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3360040070 con 0x55844f7025d0 2024-09-19T08:46:54.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.557+0000 7f334bfff640 1 -- 172.21.15.7:0/3498163854 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3360004a80 con 0x55844f7025d0 2024-09-19T08:46:54.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.557+0000 7f3375050740 10 client.15864 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:54.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.557+0000 7f3375050740 10 client.15864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:54.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.557+0000 7f3375050740 20 client.15864 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:54.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.557+0000 7f3375050740 1 --2- 172.21.15.7:0/3498163854 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55844f71cd20 0x55844f71f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:54.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.557+0000 7f3375050740 4 client.15864 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:46:54.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.557+0000 7f3375050740 1 -- 172.21.15.7:0/3498163854 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55844f675860 con 0x55844f71cd20 2024-09-19T08:46:54.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.558+0000 7f336bfff640 1 --2- 172.21.15.7:0/3498163854 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55844f71cd20 0x55844f71f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:54.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.558+0000 7f334bfff640 10 client.15864 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:54.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.558+0000 7f336bfff640 1 --2- 172.21.15.7:0/3498163854 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55844f71cd20 0x55844f71f110 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d103fc05752a0ab server_cookie=b34faebb9b7539d1 in_seq=0 out_seq=0 2024-09-19T08:46:54.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.559+0000 7f334bfff640 1 -- 172.21.15.7:0/3498163854 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55844f675860 con 0x55844f71cd20 2024-09-19T08:46:54.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.559+0000 7f334bfff640 10 client.15864 handle_command_reply: tid=0 2024-09-19T08:46:54.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.559+0000 7f3375050740 1 client.15864 shutdown 2024-09-19T08:46:54.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.559+0000 7f3375050740 1 -- 172.21.15.7:0/3498163854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f7025d0 msgr2=0x55844f70cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:54.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.559+0000 7f3375050740 1 --2- 172.21.15.7:0/3498163854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f7025d0 0x55844f70cd10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3360005940 tx=0x7f33600316c0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.559+0000 7f3375050740 1 -- 172.21.15.7:0/3498163854 shutdown_connections 2024-09-19T08:46:54.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.559+0000 7f3375050740 1 --2- 172.21.15.7:0/3498163854 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55844f71cd20 0x55844f71f110 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.559+0000 7f3375050740 1 --2- 172.21.15.7:0/3498163854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55844f70d370 0x55844f70a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.559+0000 7f3375050740 1 --2- 172.21.15.7:0/3498163854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f703b40 0x55844f709fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.559+0000 7f3375050740 1 --2- 172.21.15.7:0/3498163854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f7025d0 0x55844f70cd10 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.559+0000 7f3375050740 1 -- 172.21.15.7:0/3498163854 >> 172.21.15.7:0/3498163854 conn(0x55844f6cb310 msgr2=0x55844f704930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:54.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.559+0000 7f334bfff640 0 client.15864 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:54.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.559+0000 7f3375050740 1 -- 172.21.15.7:0/3498163854 shutdown_connections 2024-09-19T08:46:54.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.559+0000 7f3375050740 1 -- 172.21.15.7:0/3498163854 wait complete. 2024-09-19T08:46:54.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.559+0000 7f3375050740 20 client.15864 trim_cache size 0 max 16384 2024-09-19T08:46:54.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.573+0000 7f3375050740 1 Processor -- start 2024-09-19T08:46:54.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.573+0000 7f3375050740 1 -- start start 2024-09-19T08:46:54.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.573+0000 7f3375050740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55844f7025d0 0x55844f708fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:54.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.573+0000 7f3375050740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f703b40 0x55844f722130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:54.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.573+0000 7f3375050740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f70d370 0x55844f722670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:54.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.573+0000 7f3375050740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f336c1b01b0 con 0x55844f703b40 2024-09-19T08:46:54.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.573+0000 7f3375050740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f336c1ada80 con 0x55844f7025d0 2024-09-19T08:46:54.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.573+0000 7f3375050740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f336c1ab8d0 con 0x55844f70d370 2024-09-19T08:46:54.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.573+0000 7f336bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f703b40 0x55844f722130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:54.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.573+0000 7f336bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f703b40 0x55844f722130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57858/0 (socket says 172.21.15.7:57858) 2024-09-19T08:46:54.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.573+0000 7f336bfff640 1 -- 172.21.15.7:0/1414352803 learned_addr learned my addr 172.21.15.7:0/1414352803 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:54.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.573+0000 7f3370a13640 1 --2- 172.21.15.7:0/1414352803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55844f7025d0 0x55844f708fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:54.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.573+0000 7f3371214640 1 --2- 172.21.15.7:0/1414352803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f70d370 0x55844f722670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:54.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.574+0000 7f336bfff640 1 -- 172.21.15.7:0/1414352803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f70d370 msgr2=0x55844f722670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:54.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.574+0000 7f336bfff640 1 --2- 172.21.15.7:0/1414352803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f70d370 0x55844f722670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.574+0000 7f336bfff640 1 -- 172.21.15.7:0/1414352803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55844f7025d0 msgr2=0x55844f708fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:54.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.574+0000 7f336bfff640 1 --2- 172.21.15.7:0/1414352803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55844f7025d0 0x55844f708fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.574+0000 7f336bfff640 1 -- 172.21.15.7:0/1414352803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55844f70a890 con 0x55844f703b40 2024-09-19T08:46:54.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.574+0000 7f3371214640 1 --2- 172.21.15.7:0/1414352803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f70d370 0x55844f722670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:54.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.574+0000 7f336bfff640 1 --2- 172.21.15.7:0/1414352803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f703b40 0x55844f722130 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3358009610 tx=0x7f3358000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd638ddfb06478cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:54.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.574+0000 7f33567fc640 1 -- 172.21.15.7:0/1414352803 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3358020040 con 0x55844f703b40 2024-09-19T08:46:54.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.574+0000 7f33567fc640 1 -- 172.21.15.7:0/1414352803 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33580a4850 con 0x55844f703b40 2024-09-19T08:46:54.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.574+0000 7f33567fc640 1 -- 172.21.15.7:0/1414352803 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335809b0e0 con 0x55844f703b40 2024-09-19T08:46:54.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.575+0000 7f3375050740 1 -- 172.21.15.7:0/1414352803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f703b40 msgr2=0x55844f722130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:54.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.575+0000 7f3375050740 1 --2- 172.21.15.7:0/1414352803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f703b40 0x55844f722130 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3358009610 tx=0x7f3358000bc0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.575+0000 7f3375050740 1 -- 172.21.15.7:0/1414352803 shutdown_connections 2024-09-19T08:46:54.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.575+0000 7f3375050740 1 --2- 172.21.15.7:0/1414352803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f70d370 0x55844f722670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.575+0000 7f3375050740 1 --2- 172.21.15.7:0/1414352803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f703b40 0x55844f722130 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.575+0000 7f3375050740 1 --2- 172.21.15.7:0/1414352803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55844f7025d0 0x55844f708fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.575+0000 7f3375050740 1 -- 172.21.15.7:0/1414352803 >> 172.21.15.7:0/1414352803 conn(0x55844f6cb310 msgr2=0x55844f708890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:54.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.575+0000 7f3375050740 1 -- 172.21.15.7:0/1414352803 shutdown_connections 2024-09-19T08:46:54.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.575+0000 7f3375050740 1 -- 172.21.15.7:0/1414352803 wait complete. 2024-09-19T08:46:54.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.575+0000 7f3375050740 1 -- start start 2024-09-19T08:46:54.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.575+0000 7f3375050740 1 Processor -- start 2024-09-19T08:46:54.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.576+0000 7f3375050740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f7025d0 0x55844f722880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:54.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.576+0000 7f3375050740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55844f703b40 0x55844f71fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:54.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.576+0000 7f3375050740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f70d370 0x55844f720110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:54.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.576+0000 7f3375050740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f336c1abf40 con 0x55844f70d370 2024-09-19T08:46:54.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.576+0000 7f3375050740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f336c1ad3b0 con 0x55844f703b40 2024-09-19T08:46:54.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.576+0000 7f3375050740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f336c1ac610 con 0x55844f7025d0 2024-09-19T08:46:54.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.576+0000 7f3375050740 10 client.0 _ll_register_callbacks cb 0x7f3360005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:54.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.576+0000 7f3371214640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f70d370 0x55844f720110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:54.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.576+0000 7f3371214640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f70d370 0x55844f720110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57872/0 (socket says 172.21.15.7:57872) 2024-09-19T08:46:54.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.576+0000 7f3371214640 1 -- 172.21.15.7:0/1781957990 learned_addr learned my addr 172.21.15.7:0/1781957990 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:54.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.576+0000 7f3370a13640 1 --2- 172.21.15.7:0/1781957990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f7025d0 0x55844f722880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:54.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.576+0000 7f3371214640 1 -- 172.21.15.7:0/1781957990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f7025d0 msgr2=0x55844f722880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:54.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.576+0000 7f3371214640 1 --2- 172.21.15.7:0/1781957990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f7025d0 0x55844f722880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.576+0000 7f3371214640 1 -- 172.21.15.7:0/1781957990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55844f703b40 msgr2=0x55844f71fbd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:46:54.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.577+0000 7f3371214640 1 --2- 172.21.15.7:0/1781957990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55844f703b40 0x55844f71fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.577+0000 7f3371214640 1 -- 172.21.15.7:0/1781957990 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55844f720940 con 0x55844f70d370 2024-09-19T08:46:54.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.577+0000 7f3370a13640 1 --2- 172.21.15.7:0/1781957990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f7025d0 0x55844f722880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:54.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.577+0000 7f3371214640 1 --2- 172.21.15.7:0/1781957990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f70d370 0x55844f720110 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3364010900 tx=0x7f3364014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5018b89dcdd5edf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:54.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.577+0000 7f334bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:54.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.577+0000 7f334bfff640 1 -- 172.21.15.7:0/1781957990 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336402d060 con 0x55844f70d370 2024-09-19T08:46:54.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.577+0000 7f334bfff640 1 -- 172.21.15.7:0/1781957990 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f336401cd90 con 0x55844f70d370 2024-09-19T08:46:54.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.577+0000 7f3375050740 1 -- 172.21.15.7:0/1781957990 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33580a4850 con 0x55844f70d370 2024-09-19T08:46:54.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.577+0000 7f334bfff640 1 -- 172.21.15.7:0/1781957990 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3364010e80 con 0x55844f70d370 2024-09-19T08:46:54.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.577+0000 7f3375050740 10 client.15870 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:54.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.577+0000 7f3375050740 1 -- 172.21.15.7:0/1781957990 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55844f7876b0 con 0x55844f70d370 2024-09-19T08:46:54.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.577+0000 7f334bfff640 1 -- 172.21.15.7:0/1781957990 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33580a4850 con 0x55844f70d370 2024-09-19T08:46:54.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.578+0000 7f334bfff640 1 -- 172.21.15.7:0/1781957990 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f336400f040 con 0x55844f70d370 2024-09-19T08:46:54.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.578+0000 7f3375050740 10 client.15870 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:54.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.578+0000 7f3375050740 10 client.15870 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:54.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.578+0000 7f3375050740 20 client.15870 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:54.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.578+0000 7f3375050740 1 --2- 172.21.15.7:0/1781957990 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55844f787e30 0x55844f78a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:54.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.578+0000 7f3375050740 4 client.15870 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:46:54.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.578+0000 7f3375050740 1 -- 172.21.15.7:0/1781957990 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55844f66fd70 con 0x55844f787e30 2024-09-19T08:46:54.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.578+0000 7f3370a13640 1 --2- 172.21.15.7:0/1781957990 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55844f787e30 0x55844f78a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:54.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.578+0000 7f334bfff640 10 client.15870 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:54.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.578+0000 7f3370a13640 1 --2- 172.21.15.7:0/1781957990 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55844f787e30 0x55844f78a250 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9202805bfc6a8fe8 server_cookie=f4911c20f35ad18a in_seq=0 out_seq=0 2024-09-19T08:46:54.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.578+0000 7f334bfff640 1 -- 172.21.15.7:0/1781957990 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55844f66fd70 con 0x55844f787e30 2024-09-19T08:46:54.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.578+0000 7f334bfff640 10 client.15870 handle_command_reply: tid=0 2024-09-19T08:46:54.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.578+0000 7f3375050740 1 client.15870 shutdown 2024-09-19T08:46:54.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.579+0000 7f3375050740 1 -- 172.21.15.7:0/1781957990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f70d370 msgr2=0x55844f720110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.579+0000 7f3375050740 1 --2- 172.21.15.7:0/1781957990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f70d370 0x55844f720110 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3364010900 tx=0x7f3364014040 comp rx=0 tx=0).stop 2024-09-19T08:46:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.579+0000 7f3375050740 1 -- 172.21.15.7:0/1781957990 shutdown_connections 2024-09-19T08:46:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.579+0000 7f3375050740 1 --2- 172.21.15.7:0/1781957990 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55844f787e30 0x55844f78a250 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.579+0000 7f3375050740 1 --2- 172.21.15.7:0/1781957990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55844f70d370 0x55844f720110 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.579+0000 7f3375050740 1 --2- 172.21.15.7:0/1781957990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55844f703b40 0x55844f71fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.579+0000 7f3375050740 1 --2- 172.21.15.7:0/1781957990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55844f7025d0 0x55844f722880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.579+0000 7f3375050740 1 -- 172.21.15.7:0/1781957990 >> 172.21.15.7:0/1781957990 conn(0x55844f6cb310 msgr2=0x55844f7090b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.579+0000 7f334bfff640 0 client.15870 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.579+0000 7f3375050740 1 -- 172.21.15.7:0/1781957990 shutdown_connections 2024-09-19T08:46:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.579+0000 7f3375050740 1 -- 172.21.15.7:0/1781957990 wait complete. 2024-09-19T08:46:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.579+0000 7f3375050740 20 client.15870 trim_cache size 0 max 16384 2024-09-19T08:46:54.588 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:46:54.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.580+0000 7f3372c77640 1 -- 172.21.15.7:0/3717123259 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f335c0a33b0 msgr2=0x7f335c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:54.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.580+0000 7f3372c77640 1 --2- 172.21.15.7:0/3717123259 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f335c0a33b0 0x7f335c0a5870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3364005fd0 tx=0x7f3364009600 comp rx=0 tx=0).stop 2024-09-19T08:46:54.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.580+0000 7f3372c77640 1 -- 172.21.15.7:0/3717123259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f336c102570 msgr2=0x7f336c199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:54.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.580+0000 7f3372c77640 1 --2- 172.21.15.7:0/3717123259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f336c102570 0x7f336c199860 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f335800d950 tx=0x7f335800de10 comp rx=0 tx=0).stop 2024-09-19T08:46:54.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.580+0000 7f3372c77640 1 -- 172.21.15.7:0/3717123259 shutdown_connections 2024-09-19T08:46:54.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.580+0000 7f3372c77640 1 --2- 172.21.15.7:0/3717123259 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f335c0a33b0 0x7f335c0a5870 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.580+0000 7f3372c77640 1 --2- 172.21.15.7:0/3717123259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f336c102ef0 0x7f336c1a43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.580+0000 7f3372c77640 1 --2- 172.21.15.7:0/3717123259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f336c102570 0x7f336c199860 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.580+0000 7f3372c77640 1 --2- 172.21.15.7:0/3717123259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f336c100e20 0x7f336c199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:54.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.580+0000 7f3372c77640 1 -- 172.21.15.7:0/3717123259 >> 172.21.15.7:0/3717123259 conn(0x7f336c0fc7d0 msgr2=0x7f336c0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:54.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.580+0000 7f3372c77640 1 -- 172.21.15.7:0/3717123259 shutdown_connections 2024-09-19T08:46:54.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:54.580+0000 7f3372c77640 1 -- 172.21.15.7:0/3717123259 wait complete. 2024-09-19T08:46:55.235 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:54 smithi007 ceph-mon[31221]: pgmap v74: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2024-09-19T08:46:55.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:54 smithi044 ceph-mon[35072]: pgmap v74: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2024-09-19T08:46:55.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:54 smithi175 ceph-mon[35688]: pgmap v74: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2024-09-19T08:46:56.271 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:46:56.271 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:46:56.540 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:46:57.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.006+0000 7f15db8e1640 1 -- 172.21.15.7:0/11292674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d4100e20 msgr2=0x7f15d4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:57.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.006+0000 7f15db8e1640 1 --2- 172.21.15.7:0/11292674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d4100e20 0x7f15d4101200 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009900 tx=0x7f15d002a480 comp rx=0 tx=0).stop 2024-09-19T08:46:57.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.006+0000 7f15db8e1640 1 -- 172.21.15.7:0/11292674 shutdown_connections 2024-09-19T08:46:57.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.006+0000 7f15db8e1640 1 --2- 172.21.15.7:0/11292674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15d4102ef0 0x7f15d410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.006+0000 7f15db8e1640 1 --2- 172.21.15.7:0/11292674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d4102570 0x7f15d41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.006+0000 7f15db8e1640 1 --2- 172.21.15.7:0/11292674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d4100e20 0x7f15d4101200 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.006+0000 7f15db8e1640 1 -- 172.21.15.7:0/11292674 >> 172.21.15.7:0/11292674 conn(0x7f15d40fc7d0 msgr2=0x7f15d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:57.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.006+0000 7f15db8e1640 1 -- 172.21.15.7:0/11292674 shutdown_connections 2024-09-19T08:46:57.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.006+0000 7f15db8e1640 1 -- 172.21.15.7:0/11292674 wait complete. 2024-09-19T08:46:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.007+0000 7f15db8e1640 1 Processor -- start 2024-09-19T08:46:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.007+0000 7f15db8e1640 1 -- start start 2024-09-19T08:46:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.007+0000 7f15db8e1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d4100e20 0x7f15d4199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.007+0000 7f15db8e1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15d4102570 0x7f15d41998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.007+0000 7f15db8e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d4102ef0 0x7f15d41a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.007+0000 7f15db8e1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f15d4110f80 con 0x7f15d4102ef0 2024-09-19T08:46:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.007+0000 7f15db8e1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f15d4110e00 con 0x7f15d4100e20 2024-09-19T08:46:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.007+0000 7f15db8e1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f15d4111100 con 0x7f15d4102570 2024-09-19T08:46:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.007+0000 7f15d9e7e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d4102ef0 0x7f15d41a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.007+0000 7f15d9e7e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d4102ef0 0x7f15d41a43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57884/0 (socket says 172.21.15.7:57884) 2024-09-19T08:46:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.007+0000 7f15d9e7e640 1 -- 172.21.15.7:0/1762242597 learned_addr learned my addr 172.21.15.7:0/1762242597 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.007+0000 7f15d967d640 1 --2- 172.21.15.7:0/1762242597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d4100e20 0x7f15d4199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.008+0000 7f15d8e7c640 1 --2- 172.21.15.7:0/1762242597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15d4102570 0x7f15d41998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.008+0000 7f15d9e7e640 1 -- 172.21.15.7:0/1762242597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15d4102570 msgr2=0x7f15d41998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.008+0000 7f15d9e7e640 1 --2- 172.21.15.7:0/1762242597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15d4102570 0x7f15d41998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.008+0000 7f15d9e7e640 1 -- 172.21.15.7:0/1762242597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d4100e20 msgr2=0x7f15d4199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.008+0000 7f15d9e7e640 1 --2- 172.21.15.7:0/1762242597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d4100e20 0x7f15d4199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.008+0000 7f15d9e7e640 1 -- 172.21.15.7:0/1762242597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d41a4930 con 0x7f15d4102ef0 2024-09-19T08:46:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.008+0000 7f15d9e7e640 1 --2- 172.21.15.7:0/1762242597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d4102ef0 0x7f15d41a43f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00eaa0 tx=0x7f15cc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.008+0000 7f15ca7fc640 1 -- 172.21.15.7:0/1762242597 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc00cdb0 con 0x7f15d4102ef0 2024-09-19T08:46:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.008+0000 7f15db8e1640 1 -- 172.21.15.7:0/1762242597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d41a4b00 con 0x7f15d4102ef0 2024-09-19T08:46:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.008+0000 7f15ca7fc640 1 -- 172.21.15.7:0/1762242597 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15cc005020 con 0x7f15d4102ef0 2024-09-19T08:46:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.008+0000 7f15ca7fc640 1 -- 172.21.15.7:0/1762242597 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc0116b0 con 0x7f15d4102ef0 2024-09-19T08:46:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.008+0000 7f15db8e1640 1 -- 172.21.15.7:0/1762242597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d41a5010 con 0x7f15d4102ef0 2024-09-19T08:46:57.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.011+0000 7f15ca7fc640 1 -- 172.21.15.7:0/1762242597 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f15cc005560 con 0x7f15d4102ef0 2024-09-19T08:46:57.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.011+0000 7f15ca7fc640 1 --2- 172.21.15.7:0/1762242597 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f15c00a3430 0x7f15c00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:57.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.012+0000 7f15d967d640 1 --2- 172.21.15.7:0/1762242597 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f15c00a3430 0x7f15c00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:57.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.012+0000 7f15ca7fc640 1 -- 172.21.15.7:0/1762242597 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f15cc0cfe10 con 0x7f15d4102ef0 2024-09-19T08:46:57.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.012+0000 7f15d967d640 1 --2- 172.21.15.7:0/1762242597 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f15c00a3430 0x7f15c00a58f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009230 tx=0x7f15d00058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:57.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.013+0000 7f15ddcba740 1 Processor -- start 2024-09-19T08:46:57.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.013+0000 7f15ddcba740 1 -- start start 2024-09-19T08:46:57.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.013+0000 7f15ddcba740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f119619b60 0x55f119619f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:57.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.013+0000 7f15ddcba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f11961a480 0x55f119624800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:57.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.013+0000 7f15ddcba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f119624d40 0x55f119627130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:57.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.013+0000 7f15ddcba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f11957f280 con 0x55f11961a480 2024-09-19T08:46:57.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.013+0000 7f15ddcba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f119526b10 con 0x55f119624d40 2024-09-19T08:46:57.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.013+0000 7f15ddcba740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f11957b240 con 0x55f119619b60 2024-09-19T08:46:57.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.013+0000 7f15d8e7c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f11961a480 0x55f119624800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:57.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.013+0000 7f15d8e7c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f11961a480 0x55f119624800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57886/0 (socket says 172.21.15.7:57886) 2024-09-19T08:46:57.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.013+0000 7f15d8e7c640 1 -- 172.21.15.7:0/4162783182 learned_addr learned my addr 172.21.15.7:0/4162783182 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:57.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.013+0000 7f15d967d640 1 --2- 172.21.15.7:0/4162783182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f119619b60 0x55f119619f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:57.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.013+0000 7f15d9e7e640 1 --2- 172.21.15.7:0/4162783182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f119624d40 0x55f119627130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:57.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.014+0000 7f15d8e7c640 1 -- 172.21.15.7:0/4162783182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f119619b60 msgr2=0x55f119619f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:57.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.014+0000 7f15d8e7c640 1 --2- 172.21.15.7:0/4162783182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f119619b60 0x55f119619f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.014+0000 7f15d8e7c640 1 -- 172.21.15.7:0/4162783182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f119624d40 msgr2=0x55f119627130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:57.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.014+0000 7f15d8e7c640 1 --2- 172.21.15.7:0/4162783182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f119624d40 0x55f119627130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.014+0000 7f15d8e7c640 1 -- 172.21.15.7:0/4162783182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1195331f0 con 0x55f11961a480 2024-09-19T08:46:57.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.014+0000 7f15d967d640 1 --2- 172.21.15.7:0/4162783182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f119619b60 0x55f119619f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:57.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.014+0000 7f15d9e7e640 1 --2- 172.21.15.7:0/4162783182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f119624d40 0x55f119627130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:57.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.014+0000 7f15d8e7c640 1 --2- 172.21.15.7:0/4162783182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f11961a480 0x55f119624800 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009c90 tx=0x7f15c4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01e5f1033701097 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:57.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.014+0000 7f15bf7fe640 1 -- 172.21.15.7:0/4162783182 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c401e070 con 0x55f11961a480 2024-09-19T08:46:57.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.014+0000 7f15bf7fe640 1 -- 172.21.15.7:0/4162783182 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15c4019b10 con 0x55f11961a480 2024-09-19T08:46:57.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.014+0000 7f15bf7fe640 1 -- 172.21.15.7:0/4162783182 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c400ea60 con 0x55f11961a480 2024-09-19T08:46:57.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.015+0000 7f15ddcba740 1 -- 172.21.15.7:0/4162783182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f11961a480 msgr2=0x55f119624800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:57.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.015+0000 7f15ddcba740 1 --2- 172.21.15.7:0/4162783182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f11961a480 0x55f119624800 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009c90 tx=0x7f15c4011810 comp rx=0 tx=0).stop 2024-09-19T08:46:57.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.015+0000 7f15ddcba740 1 -- 172.21.15.7:0/4162783182 shutdown_connections 2024-09-19T08:46:57.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.015+0000 7f15ddcba740 1 --2- 172.21.15.7:0/4162783182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f119624d40 0x55f119627130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.015+0000 7f15ddcba740 1 --2- 172.21.15.7:0/4162783182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f11961a480 0x55f119624800 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.015+0000 7f15ddcba740 1 --2- 172.21.15.7:0/4162783182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f119619b60 0x55f119619f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.015+0000 7f15ddcba740 1 -- 172.21.15.7:0/4162783182 >> 172.21.15.7:0/4162783182 conn(0x55f1196160f0 msgr2=0x55f1196164d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:57.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.015+0000 7f15ddcba740 1 -- 172.21.15.7:0/4162783182 shutdown_connections 2024-09-19T08:46:57.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.015+0000 7f15ddcba740 1 -- 172.21.15.7:0/4162783182 wait complete. 2024-09-19T08:46:57.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.015+0000 7f15ddcba740 1 -- start start 2024-09-19T08:46:57.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.016+0000 7f15ddcba740 1 Processor -- start 2024-09-19T08:46:57.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.016+0000 7f15ddcba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f119619b60 0x55f119621bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:57.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.016+0000 7f15ddcba740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f11961a480 0x55f119622110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:57.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.016+0000 7f15ddcba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f119624d40 0x55f119622650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:57.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.016+0000 7f15ddcba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f119627910 con 0x55f119619b60 2024-09-19T08:46:57.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.016+0000 7f15ddcba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f119539f10 con 0x55f119624d40 2024-09-19T08:46:57.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.016+0000 7f15ddcba740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f119627a90 con 0x55f11961a480 2024-09-19T08:46:57.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.016+0000 7f15ddcba740 10 client.0 _ll_register_callbacks cb 0x55f119502a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:57.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.016+0000 7f15d967d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f119619b60 0x55f119621bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:57.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.016+0000 7f15d967d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f119619b60 0x55f119621bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57888/0 (socket says 172.21.15.7:57888) 2024-09-19T08:46:57.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.016+0000 7f15d967d640 1 -- 172.21.15.7:0/802064719 learned_addr learned my addr 172.21.15.7:0/802064719 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:57.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.017+0000 7f15d8e7c640 1 --2- 172.21.15.7:0/802064719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f11961a480 0x55f119622110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:57.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.017+0000 7f15d9e7e640 1 --2- 172.21.15.7:0/802064719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f119624d40 0x55f119622650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:57.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.017+0000 7f15d8e7c640 1 -- 172.21.15.7:0/802064719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f119624d40 msgr2=0x55f119622650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:57.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.017+0000 7f15d8e7c640 1 --2- 172.21.15.7:0/802064719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f119624d40 0x55f119622650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.017+0000 7f15d8e7c640 1 -- 172.21.15.7:0/802064719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f119619b60 msgr2=0x55f119621bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:57.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.017+0000 7f15d8e7c640 1 --2- 172.21.15.7:0/802064719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f119619b60 0x55f119621bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.017+0000 7f15d8e7c640 1 -- 172.21.15.7:0/802064719 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1192f06a0 con 0x55f11961a480 2024-09-19T08:46:57.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.017+0000 7f15d967d640 1 --2- 172.21.15.7:0/802064719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f119619b60 0x55f119621bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:57.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.017+0000 7f15d8e7c640 1 --2- 172.21.15.7:0/802064719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f11961a480 0x55f119622110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009c90 tx=0x7f15c400e5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=788be24aed3d8e93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:57.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.017+0000 7f15bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-19T08:46:57.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.017+0000 7f15bcff9640 1 -- 172.21.15.7:0/802064719 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c402a060 con 0x55f11961a480 2024-09-19T08:46:57.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.017+0000 7f15ddcba740 1 -- 172.21.15.7:0/802064719 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15c4019b10 con 0x55f11961a480 2024-09-19T08:46:57.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.017+0000 7f15bcff9640 1 -- 172.21.15.7:0/802064719 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f15c4004030 con 0x55f11961a480 2024-09-19T08:46:57.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.018+0000 7f15bcff9640 1 -- 172.21.15.7:0/802064719 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f15c401e040 con 0x55f11961a480 2024-09-19T08:46:57.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.018+0000 7f15ddcba740 10 client.25426 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:57.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.018+0000 7f15ddcba740 1 -- 172.21.15.7:0/802064719 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f1196378d0 con 0x55f11961a480 2024-09-19T08:46:57.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.018+0000 7f15bcff9640 1 -- 172.21.15.7:0/802064719 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15c4019b10 con 0x55f11961a480 2024-09-19T08:46:57.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.018+0000 7f15bcff9640 1 -- 172.21.15.7:0/802064719 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f15c400e7c0 con 0x55f11961a480 2024-09-19T08:46:57.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.018+0000 7f15ddcba740 10 client.25426 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:57.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.018+0000 7f15ddcba740 10 client.25426 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:57.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.018+0000 7f15ddcba740 20 client.25426 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:57.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.018+0000 7f15ddcba740 1 --2- 172.21.15.7:0/802064719 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f119638ce0 0x55f11963b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:57.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.018+0000 7f15ddcba740 4 client.25426 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:46:57.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.018+0000 7f15ddcba740 1 -- 172.21.15.7:0/802064719 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f11958c7f0 con 0x55f119638ce0 2024-09-19T08:46:57.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.018+0000 7f15d967d640 1 --2- 172.21.15.7:0/802064719 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f119638ce0 0x55f11963b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:57.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.019+0000 7f15bcff9640 10 client.25426 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:57.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.019+0000 7f15d967d640 1 --2- 172.21.15.7:0/802064719 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f119638ce0 0x55f11963b0d0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15d076397ac1f126 server_cookie=d63c017222192d31 in_seq=0 out_seq=0 2024-09-19T08:46:57.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.020+0000 7f15bcff9640 1 -- 172.21.15.7:0/802064719 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f11958c7f0 con 0x55f119638ce0 2024-09-19T08:46:57.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.020+0000 7f15bcff9640 10 client.25426 handle_command_reply: tid=0 2024-09-19T08:46:57.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.020+0000 7f15ddcba740 1 client.25426 shutdown 2024-09-19T08:46:57.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.020+0000 7f15ddcba740 1 -- 172.21.15.7:0/802064719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f11961a480 msgr2=0x55f119622110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:57.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.020+0000 7f15ddcba740 1 --2- 172.21.15.7:0/802064719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f11961a480 0x55f119622110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009c90 tx=0x7f15c400e5a0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.020+0000 7f15ddcba740 1 -- 172.21.15.7:0/802064719 shutdown_connections 2024-09-19T08:46:57.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.020+0000 7f15ddcba740 1 --2- 172.21.15.7:0/802064719 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f119638ce0 0x55f11963b0d0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.020+0000 7f15ddcba740 1 --2- 172.21.15.7:0/802064719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f119624d40 0x55f119622650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.020+0000 7f15ddcba740 1 --2- 172.21.15.7:0/802064719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f11961a480 0x55f119622110 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.020+0000 7f15ddcba740 1 --2- 172.21.15.7:0/802064719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f119619b60 0x55f119621bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.020+0000 7f15ddcba740 1 -- 172.21.15.7:0/802064719 >> 172.21.15.7:0/802064719 conn(0x55f1196160f0 msgr2=0x55f119615270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:57.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.020+0000 7f15bcff9640 0 client.25426 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:57.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.020+0000 7f15ddcba740 1 -- 172.21.15.7:0/802064719 shutdown_connections 2024-09-19T08:46:57.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.020+0000 7f15ddcba740 1 -- 172.21.15.7:0/802064719 wait complete. 2024-09-19T08:46:57.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.020+0000 7f15ddcba740 20 client.25426 trim_cache size 0 max 16384 2024-09-19T08:46:57.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.038+0000 7f15ddcba740 1 Processor -- start 2024-09-19T08:46:57.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.038+0000 7f15ddcba740 1 -- start start 2024-09-19T08:46:57.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.038+0000 7f15ddcba740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f119619b60 0x55f11961c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:57.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.038+0000 7f15ddcba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f11961a480 0x55f1196407c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:57.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.038+0000 7f15ddcba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f119624d40 0x55f119640d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:57.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.038+0000 7f15ddcba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41ae070 con 0x55f11961a480 2024-09-19T08:46:57.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.038+0000 7f15ddcba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41ab940 con 0x55f119624d40 2024-09-19T08:46:57.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.038+0000 7f15ddcba740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41a9790 con 0x55f119619b60 2024-09-19T08:46:57.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.038+0000 7f15d8e7c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f11961a480 0x55f1196407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:57.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.038+0000 7f15d8e7c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f11961a480 0x55f1196407c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57890/0 (socket says 172.21.15.7:57890) 2024-09-19T08:46:57.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.038+0000 7f15d8e7c640 1 -- 172.21.15.7:0/3440842107 learned_addr learned my addr 172.21.15.7:0/3440842107 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:57.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.039+0000 7f15d9e7e640 1 --2- 172.21.15.7:0/3440842107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f119624d40 0x55f119640d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:57.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.039+0000 7f15d967d640 1 --2- 172.21.15.7:0/3440842107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f119619b60 0x55f11961c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:57.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.039+0000 7f15d8e7c640 1 -- 172.21.15.7:0/3440842107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f119619b60 msgr2=0x55f11961c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:57.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.039+0000 7f15d8e7c640 1 --2- 172.21.15.7:0/3440842107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f119619b60 0x55f11961c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.039+0000 7f15d8e7c640 1 -- 172.21.15.7:0/3440842107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f119624d40 msgr2=0x55f119640d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:57.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.039+0000 7f15d8e7c640 1 --2- 172.21.15.7:0/3440842107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f119624d40 0x55f119640d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.039+0000 7f15d8e7c640 1 -- 172.21.15.7:0/3440842107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f11961a2b0 con 0x55f11961a480 2024-09-19T08:46:57.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.039+0000 7f15d8e7c640 1 --2- 172.21.15.7:0/3440842107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f11961a480 0x55f1196407c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f15c400ec10 tx=0x7f15c4012f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae34d9a0e6a70b6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:57.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.039+0000 7f15beffd640 1 -- 172.21.15.7:0/3440842107 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c40097a0 con 0x55f11961a480 2024-09-19T08:46:57.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.039+0000 7f15beffd640 1 -- 172.21.15.7:0/3440842107 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15c4019a40 con 0x55f11961a480 2024-09-19T08:46:57.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.039+0000 7f15beffd640 1 -- 172.21.15.7:0/3440842107 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c4004540 con 0x55f11961a480 2024-09-19T08:46:57.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.040+0000 7f15ddcba740 1 -- 172.21.15.7:0/3440842107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f11961a480 msgr2=0x55f1196407c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:57.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.040+0000 7f15ddcba740 1 --2- 172.21.15.7:0/3440842107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f11961a480 0x55f1196407c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f15c400ec10 tx=0x7f15c4012f90 comp rx=0 tx=0).stop 2024-09-19T08:46:57.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.040+0000 7f15ddcba740 1 -- 172.21.15.7:0/3440842107 shutdown_connections 2024-09-19T08:46:57.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.040+0000 7f15ddcba740 1 --2- 172.21.15.7:0/3440842107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f119624d40 0x55f119640d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.040+0000 7f15ddcba740 1 --2- 172.21.15.7:0/3440842107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f11961a480 0x55f1196407c0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.040+0000 7f15ddcba740 1 --2- 172.21.15.7:0/3440842107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f119619b60 0x55f11961c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.040+0000 7f15ddcba740 1 -- 172.21.15.7:0/3440842107 >> 172.21.15.7:0/3440842107 conn(0x55f1196160f0 msgr2=0x55f119623b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:57.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.040+0000 7f15ddcba740 1 -- 172.21.15.7:0/3440842107 shutdown_connections 2024-09-19T08:46:57.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.040+0000 7f15ddcba740 1 -- 172.21.15.7:0/3440842107 wait complete. 2024-09-19T08:46:57.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.041+0000 7f15ddcba740 1 -- start start 2024-09-19T08:46:57.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.041+0000 7f15ddcba740 1 Processor -- start 2024-09-19T08:46:57.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.041+0000 7f15ddcba740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f119619b60 0x55f119631900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:57.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.041+0000 7f15ddcba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f11961a480 0x55f11962cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:57.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.041+0000 7f15ddcba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f119624d40 0x55f11962d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:57.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.041+0000 7f15ddcba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41a9e00 con 0x55f11961a480 2024-09-19T08:46:57.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.041+0000 7f15ddcba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41ab270 con 0x55f119624d40 2024-09-19T08:46:57.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.041+0000 7f15ddcba740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41aa4d0 con 0x55f119619b60 2024-09-19T08:46:57.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.042+0000 7f15d8e7c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f11961a480 0x55f11962cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:57.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.042+0000 7f15d8e7c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f11961a480 0x55f11962cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57900/0 (socket says 172.21.15.7:57900) 2024-09-19T08:46:57.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.042+0000 7f15d8e7c640 1 -- 172.21.15.7:0/2847388893 learned_addr learned my addr 172.21.15.7:0/2847388893 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:57.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.042+0000 7f15ddcba740 10 client.0 _ll_register_callbacks cb 0x7f15c401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:57.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.042+0000 7f15d9e7e640 1 --2- 172.21.15.7:0/2847388893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f119624d40 0x55f11962d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:57.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.042+0000 7f15d967d640 1 --2- 172.21.15.7:0/2847388893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f119619b60 0x55f119631900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:57.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.042+0000 7f15d8e7c640 1 -- 172.21.15.7:0/2847388893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f119619b60 msgr2=0x55f119631900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:57.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.042+0000 7f15d8e7c640 1 --2- 172.21.15.7:0/2847388893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f119619b60 0x55f119631900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.042+0000 7f15d8e7c640 1 -- 172.21.15.7:0/2847388893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f119624d40 msgr2=0x55f11962d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:57.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.042+0000 7f15d8e7c640 1 --2- 172.21.15.7:0/2847388893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f119624d40 0x55f11962d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.042+0000 7f15d8e7c640 1 -- 172.21.15.7:0/2847388893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f11962d970 con 0x55f11961a480 2024-09-19T08:46:57.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.042+0000 7f15d9e7e640 1 --2- 172.21.15.7:0/2847388893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f119624d40 0x55f11962d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:57.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.042+0000 7f15d8e7c640 1 --2- 172.21.15.7:0/2847388893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f11961a480 0x55f11962cc30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f15c4025040 tx=0x7f15c40040b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a36ebdcceaaccd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:57.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.042+0000 7f15bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:57.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.042+0000 7f15bcff9640 1 -- 172.21.15.7:0/2847388893 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c40045d0 con 0x55f11961a480 2024-09-19T08:46:57.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.042+0000 7f15bcff9640 1 -- 172.21.15.7:0/2847388893 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f15c400e3b0 con 0x55f11961a480 2024-09-19T08:46:57.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.042+0000 7f15ddcba740 1 -- 172.21.15.7:0/2847388893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15c4019a40 con 0x55f11961a480 2024-09-19T08:46:57.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.043+0000 7f15bcff9640 1 -- 172.21.15.7:0/2847388893 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f15c4047050 con 0x55f11961a480 2024-09-19T08:46:57.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.043+0000 7f15ddcba740 10 client.15888 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:57.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.043+0000 7f15ddcba740 1 -- 172.21.15.7:0/2847388893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f1196a3800 con 0x55f11961a480 2024-09-19T08:46:57.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.043+0000 7f15bcff9640 1 -- 172.21.15.7:0/2847388893 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15c40035f0 con 0x55f11961a480 2024-09-19T08:46:57.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.043+0000 7f15bcff9640 1 -- 172.21.15.7:0/2847388893 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f15c4024470 con 0x55f11961a480 2024-09-19T08:46:57.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.043+0000 7f15ddcba740 10 client.15888 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:57.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.043+0000 7f15ddcba740 10 client.15888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:57.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.043+0000 7f15ddcba740 20 client.15888 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:57.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.043+0000 7f15ddcba740 1 --2- 172.21.15.7:0/2847388893 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f1196a3e40 0x55f1196a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:57.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.043+0000 7f15ddcba740 4 client.15888 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:46:57.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.043+0000 7f15ddcba740 1 -- 172.21.15.7:0/2847388893 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f15c4019a40 con 0x55f1196a3e40 2024-09-19T08:46:57.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.043+0000 7f15d967d640 1 --2- 172.21.15.7:0/2847388893 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f1196a3e40 0x55f1196a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:57.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.044+0000 7f15d967d640 1 --2- 172.21.15.7:0/2847388893 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f1196a3e40 0x55f1196a6260 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a8b407ace41ac90 server_cookie=37ca9e0dcf739693 in_seq=0 out_seq=0 2024-09-19T08:46:57.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.044+0000 7f15bcff9640 10 client.15888 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:57.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.045+0000 7f15bcff9640 1 -- 172.21.15.7:0/2847388893 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f15c4019a40 con 0x55f1196a3e40 2024-09-19T08:46:57.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.045+0000 7f15bcff9640 10 client.15888 handle_command_reply: tid=0 2024-09-19T08:46:57.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.045+0000 7f15ddcba740 1 client.15888 shutdown 2024-09-19T08:46:57.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.045+0000 7f15ddcba740 1 -- 172.21.15.7:0/2847388893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f11961a480 msgr2=0x55f11962cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:57.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.045+0000 7f15ddcba740 1 --2- 172.21.15.7:0/2847388893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f11961a480 0x55f11962cc30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f15c4025040 tx=0x7f15c40040b0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.045+0000 7f15ddcba740 1 -- 172.21.15.7:0/2847388893 shutdown_connections 2024-09-19T08:46:57.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.045+0000 7f15ddcba740 1 --2- 172.21.15.7:0/2847388893 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f1196a3e40 0x55f1196a6260 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.045+0000 7f15ddcba740 1 --2- 172.21.15.7:0/2847388893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f119624d40 0x55f11962d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.045+0000 7f15ddcba740 1 --2- 172.21.15.7:0/2847388893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f11961a480 0x55f11962cc30 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.045+0000 7f15ddcba740 1 --2- 172.21.15.7:0/2847388893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f119619b60 0x55f119631900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.045+0000 7f15ddcba740 1 -- 172.21.15.7:0/2847388893 >> 172.21.15.7:0/2847388893 conn(0x55f1196160f0 msgr2=0x55f119621b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:57.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.045+0000 7f15bcff9640 0 client.15888 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:57.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.045+0000 7f15ddcba740 1 -- 172.21.15.7:0/2847388893 shutdown_connections 2024-09-19T08:46:57.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.045+0000 7f15ddcba740 1 -- 172.21.15.7:0/2847388893 wait complete. 2024-09-19T08:46:57.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.046+0000 7f15ddcba740 20 client.15888 trim_cache size 0 max 16384 2024-09-19T08:46:57.051 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:46:57.051 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-19T08:46:57.051 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "9870567b-035e-4e9a-87df-b6cb5a2d51f5", 2024-09-19T08:46:57.052 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-19T08:46:57.052 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:46:57.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.046+0000 7f15db8e1640 1 -- 172.21.15.7:0/1762242597 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f15c00a3430 msgr2=0x7f15c00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:57.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.046+0000 7f15db8e1640 1 --2- 172.21.15.7:0/1762242597 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f15c00a3430 0x7f15c00a58f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009230 tx=0x7f15d00058d0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.046+0000 7f15db8e1640 1 -- 172.21.15.7:0/1762242597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d4102ef0 msgr2=0x7f15d41a43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:57.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.046+0000 7f15db8e1640 1 --2- 172.21.15.7:0/1762242597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d4102ef0 0x7f15d41a43f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00eaa0 tx=0x7f15cc00ef60 comp rx=0 tx=0).stop 2024-09-19T08:46:57.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.046+0000 7f15db8e1640 1 -- 172.21.15.7:0/1762242597 shutdown_connections 2024-09-19T08:46:57.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.046+0000 7f15db8e1640 1 --2- 172.21.15.7:0/1762242597 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f15c00a3430 0x7f15c00a58f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.046+0000 7f15db8e1640 1 --2- 172.21.15.7:0/1762242597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15d4102ef0 0x7f15d41a43f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.046+0000 7f15db8e1640 1 --2- 172.21.15.7:0/1762242597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15d4102570 0x7f15d41998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.046+0000 7f15db8e1640 1 --2- 172.21.15.7:0/1762242597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d4100e20 0x7f15d4199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:57.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.046+0000 7f15db8e1640 1 -- 172.21.15.7:0/1762242597 >> 172.21.15.7:0/1762242597 conn(0x7f15d40fc7d0 msgr2=0x7f15d40fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:57.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.047+0000 7f15db8e1640 1 -- 172.21.15.7:0/1762242597 shutdown_connections 2024-09-19T08:46:57.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:57.047+0000 7f15db8e1640 1 -- 172.21.15.7:0/1762242597 wait complete. 2024-09-19T08:46:57.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:56 smithi007 ceph-mon[31221]: pgmap v75: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 864 KiB/s wr, 7 op/s 2024-09-19T08:46:57.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:56 smithi044 ceph-mon[35072]: pgmap v75: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 864 KiB/s wr, 7 op/s 2024-09-19T08:46:57.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:56 smithi175 ceph-mon[35688]: pgmap v75: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 864 KiB/s wr, 7 op/s 2024-09-19T08:46:57.792 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:46:58.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:57 smithi007 ceph-mon[31221]: scrub queued for path: / 2024-09-19T08:46:58.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:57 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:46:58.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:57 smithi007 ceph-mon[31221]: scrub summary: active paths [/] 2024-09-19T08:46:58.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:57 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:46:58.064 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:46:58.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:57 smithi044 ceph-mon[35072]: scrub queued for path: / 2024-09-19T08:46:58.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:57 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:46:58.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:57 smithi044 ceph-mon[35072]: scrub summary: active paths [/] 2024-09-19T08:46:58.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:57 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:46:58.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:57 smithi175 ceph-mon[35688]: scrub queued for path: / 2024-09-19T08:46:58.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:57 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:46:58.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:57 smithi175 ceph-mon[35688]: scrub summary: active paths [/] 2024-09-19T08:46:58.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:57 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:46:58.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.535+0000 7f3dd6730640 1 -- 172.21.15.7:0/1419755805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dd0100e20 msgr2=0x7f3dd0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:58.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.535+0000 7f3dd6730640 1 --2- 172.21.15.7:0/1419755805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dd0100e20 0x7f3dd0101200 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009900 tx=0x7f3dc002a480 comp rx=0 tx=0).stop 2024-09-19T08:46:58.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.535+0000 7f3dd6730640 1 -- 172.21.15.7:0/1419755805 shutdown_connections 2024-09-19T08:46:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.535+0000 7f3dd6730640 1 --2- 172.21.15.7:0/1419755805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dd0102ef0 0x7f3dd010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.535+0000 7f3dd6730640 1 --2- 172.21.15.7:0/1419755805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dd0102570 0x7f3dd01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.535+0000 7f3dd6730640 1 --2- 172.21.15.7:0/1419755805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dd0100e20 0x7f3dd0101200 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.535+0000 7f3dd6730640 1 -- 172.21.15.7:0/1419755805 >> 172.21.15.7:0/1419755805 conn(0x7f3dd00fc7d0 msgr2=0x7f3dd00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.535+0000 7f3dd6730640 1 -- 172.21.15.7:0/1419755805 shutdown_connections 2024-09-19T08:46:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.535+0000 7f3dd6730640 1 -- 172.21.15.7:0/1419755805 wait complete. 2024-09-19T08:46:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.536+0000 7f3dd6730640 1 Processor -- start 2024-09-19T08:46:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.536+0000 7f3dd6730640 1 -- start start 2024-09-19T08:46:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.537+0000 7f3dd6730640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dd0100e20 0x7f3dd0198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.537+0000 7f3dd6730640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dd0102570 0x7f3dd0198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.537+0000 7f3dd6730640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dd0102ef0 0x7f3dd019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.537+0000 7f3dd6730640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd0110f80 con 0x7f3dd0102570 2024-09-19T08:46:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.537+0000 7f3dd6730640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd0110e00 con 0x7f3dd0100e20 2024-09-19T08:46:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.537+0000 7f3dd6730640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd0111100 con 0x7f3dd0102ef0 2024-09-19T08:46:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.537+0000 7f3dcf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dd0102570 0x7f3dd0198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.537+0000 7f3dcf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dd0102570 0x7f3dd0198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57924/0 (socket says 172.21.15.7:57924) 2024-09-19T08:46:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.537+0000 7f3dcf7fe640 1 -- 172.21.15.7:0/4169687043 learned_addr learned my addr 172.21.15.7:0/4169687043 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.537+0000 7f3dcffff640 1 --2- 172.21.15.7:0/4169687043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dd0100e20 0x7f3dd0198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.537+0000 7f3dd4ccd640 1 --2- 172.21.15.7:0/4169687043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dd0102ef0 0x7f3dd019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.537+0000 7f3dcf7fe640 1 -- 172.21.15.7:0/4169687043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dd0102ef0 msgr2=0x7f3dd019cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.537+0000 7f3dcf7fe640 1 --2- 172.21.15.7:0/4169687043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dd0102ef0 0x7f3dd019cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.537+0000 7f3dcf7fe640 1 -- 172.21.15.7:0/4169687043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dd0100e20 msgr2=0x7f3dd0198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.537+0000 7f3dcf7fe640 1 --2- 172.21.15.7:0/4169687043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dd0100e20 0x7f3dd0198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.537+0000 7f3dcf7fe640 1 -- 172.21.15.7:0/4169687043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd019d4b0 con 0x7f3dd0102570 2024-09-19T08:46:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.537+0000 7f3dcffff640 1 --2- 172.21.15.7:0/4169687043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dd0100e20 0x7f3dd0198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.537+0000 7f3dd4ccd640 1 --2- 172.21.15.7:0/4169687043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dd0102ef0 0x7f3dd019cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.537+0000 7f3dcf7fe640 1 --2- 172.21.15.7:0/4169687043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dd0102570 0x7f3dd0198a40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400e9f0 tx=0x7f3dc400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.538+0000 7f3dcd7fa640 1 -- 172.21.15.7:0/4169687043 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc400cd80 con 0x7f3dd0102570 2024-09-19T08:46:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.538+0000 7f3dcd7fa640 1 -- 172.21.15.7:0/4169687043 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dc4010910 con 0x7f3dd0102570 2024-09-19T08:46:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.538+0000 7f3dd6730640 1 -- 172.21.15.7:0/4169687043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd019d7a0 con 0x7f3dd0102570 2024-09-19T08:46:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.538+0000 7f3dcd7fa640 1 -- 172.21.15.7:0/4169687043 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4018990 con 0x7f3dd0102570 2024-09-19T08:46:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.538+0000 7f3dd6730640 1 -- 172.21.15.7:0/4169687043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd01a5080 con 0x7f3dd0102570 2024-09-19T08:46:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.540+0000 7f3dcd7fa640 1 -- 172.21.15.7:0/4169687043 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f3dc4010ac0 con 0x7f3dd0102570 2024-09-19T08:46:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.541+0000 7f3dd8b09740 1 Processor -- start 2024-09-19T08:46:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.541+0000 7f3dd8b09740 1 -- start start 2024-09-19T08:46:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.541+0000 7f3dd8b09740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dd51129360 0x55dd51129740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.541+0000 7f3dcd7fa640 1 --2- 172.21.15.7:0/4169687043 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3db80a3430 0x7f3db80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.541+0000 7f3dd8b09740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51129c80 0x55dd51138550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.541+0000 7f3dd8b09740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd51138a90 0x55dd5113ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.541+0000 7f3dd8b09740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55dd5108f2e0 con 0x55dd51129c80 2024-09-19T08:46:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.541+0000 7f3dd8b09740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55dd51036ce0 con 0x55dd51129360 2024-09-19T08:46:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.541+0000 7f3dd8b09740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55dd5108b2a0 con 0x55dd51138a90 2024-09-19T08:46:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.541+0000 7f3dcf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51129c80 0x55dd51138550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.541+0000 7f3dcd7fa640 1 -- 172.21.15.7:0/4169687043 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f3dc40d0050 con 0x7f3dd0102570 2024-09-19T08:46:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.541+0000 7f3dcffff640 1 --2- 172.21.15.7:0/4169687043 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3db80a3430 0x7f3db80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.541+0000 7f3dcf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51129c80 0x55dd51138550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57926/0 (socket says 172.21.15.7:57926) 2024-09-19T08:46:58.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.541+0000 7f3dcf7fe640 1 -- 172.21.15.7:0/2485444133 learned_addr learned my addr 172.21.15.7:0/2485444133 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.541+0000 7f3dd4ccd640 1 --2- 172.21.15.7:0/2485444133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dd51129360 0x55dd51129740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.541+0000 7f3dd4ccd640 1 --2- 172.21.15.7:0/2485444133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd51138a90 0x55dd5113ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.542+0000 7f3dcf7fe640 1 -- 172.21.15.7:0/2485444133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd51138a90 msgr2=0x55dd5113ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.542+0000 7f3dcf7fe640 1 --2- 172.21.15.7:0/2485444133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd51138a90 0x55dd5113ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.542+0000 7f3dcf7fe640 1 -- 172.21.15.7:0/2485444133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dd51129360 msgr2=0x55dd51129740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.542+0000 7f3dcf7fe640 1 --2- 172.21.15.7:0/2485444133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dd51129360 0x55dd51129740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.542+0000 7f3dcf7fe640 1 -- 172.21.15.7:0/2485444133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd5101b440 con 0x55dd51129c80 2024-09-19T08:46:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.542+0000 7f3dd4ccd640 1 --2- 172.21.15.7:0/2485444133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd51138a90 0x55dd5113ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:46:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.542+0000 7f3dcf7fe640 1 --2- 172.21.15.7:0/2485444133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51129c80 0x55dd51138550 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4098cf0 tx=0x7f3dc4014cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9282d8044e5f20a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.542+0000 7f3dcffff640 1 --2- 172.21.15.7:0/4169687043 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3db80a3430 0x7f3db80a58f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009230 tx=0x7f3dc00058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.542+0000 7f3db67fc640 1 -- 172.21.15.7:0/2485444133 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc40aee60 con 0x55dd51129c80 2024-09-19T08:46:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.542+0000 7f3db67fc640 1 -- 172.21.15.7:0/2485444133 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dc409ca20 con 0x55dd51129c80 2024-09-19T08:46:58.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.542+0000 7f3db67fc640 1 -- 172.21.15.7:0/2485444133 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc40b0bf0 con 0x55dd51129c80 2024-09-19T08:46:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.543+0000 7f3dd8b09740 1 -- 172.21.15.7:0/2485444133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51129c80 msgr2=0x55dd51138550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.543+0000 7f3dd8b09740 1 --2- 172.21.15.7:0/2485444133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51129c80 0x55dd51138550 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4098cf0 tx=0x7f3dc4014cb0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.543+0000 7f3dd8b09740 1 -- 172.21.15.7:0/2485444133 shutdown_connections 2024-09-19T08:46:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.543+0000 7f3dd8b09740 1 --2- 172.21.15.7:0/2485444133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd51138a90 0x55dd5113ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.543+0000 7f3dd8b09740 1 --2- 172.21.15.7:0/2485444133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51129c80 0x55dd51138550 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.543+0000 7f3dd8b09740 1 --2- 172.21.15.7:0/2485444133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dd51129360 0x55dd51129740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.543+0000 7f3dd8b09740 1 -- 172.21.15.7:0/2485444133 >> 172.21.15.7:0/2485444133 conn(0x55dd51125a30 msgr2=0x55dd51125e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.543+0000 7f3dd8b09740 1 -- 172.21.15.7:0/2485444133 shutdown_connections 2024-09-19T08:46:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.543+0000 7f3dd8b09740 1 -- 172.21.15.7:0/2485444133 wait complete. 2024-09-19T08:46:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.544+0000 7f3dd8b09740 1 -- start start 2024-09-19T08:46:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.544+0000 7f3dd8b09740 1 Processor -- start 2024-09-19T08:46:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.544+0000 7f3dd8b09740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dd51129360 0x55dd511384d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.545+0000 7f3dd8b09740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd51129c80 0x55dd51135780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.545+0000 7f3dd8b09740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51138a90 0x55dd51135f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.545+0000 7f3dd8b09740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55dd5113b600 con 0x55dd51138a90 2024-09-19T08:46:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.545+0000 7f3dd8b09740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55dd5104a050 con 0x55dd51129360 2024-09-19T08:46:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.545+0000 7f3dd8b09740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55dd5113b780 con 0x55dd51129c80 2024-09-19T08:46:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.545+0000 7f3dd8b09740 10 client.0 _ll_register_callbacks cb 0x55dd5108a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.545+0000 7f3dd4ccd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51138a90 0x55dd51135f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.545+0000 7f3dd4ccd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51138a90 0x55dd51135f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57928/0 (socket says 172.21.15.7:57928) 2024-09-19T08:46:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.545+0000 7f3dd4ccd640 1 -- 172.21.15.7:0/815159210 learned_addr learned my addr 172.21.15.7:0/815159210 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.545+0000 7f3dcffff640 1 --2- 172.21.15.7:0/815159210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dd51129360 0x55dd511384d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.545+0000 7f3dcf7fe640 1 --2- 172.21.15.7:0/815159210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd51129c80 0x55dd51135780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.545+0000 7f3dd4ccd640 1 -- 172.21.15.7:0/815159210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd51129c80 msgr2=0x55dd51135780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.545+0000 7f3dd4ccd640 1 --2- 172.21.15.7:0/815159210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd51129c80 0x55dd51135780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.545+0000 7f3dd4ccd640 1 -- 172.21.15.7:0/815159210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dd51129360 msgr2=0x55dd511384d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.545+0000 7f3dd4ccd640 1 --2- 172.21.15.7:0/815159210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dd51129360 0x55dd511384d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.545+0000 7f3dd4ccd640 1 -- 172.21.15.7:0/815159210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd50e003c0 con 0x55dd51138a90 2024-09-19T08:46:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.545+0000 7f3dcffff640 1 --2- 172.21.15.7:0/815159210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dd51129360 0x55dd511384d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.545+0000 7f3dd4ccd640 1 --2- 172.21.15.7:0/815159210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51138a90 0x55dd51135f10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8012920 tx=0x7f3dc8012de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce7a3cee3c9acbb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.545+0000 7f3daf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:46:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.545+0000 7f3daf7fe640 1 -- 172.21.15.7:0/815159210 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8011e30 con 0x55dd51138a90 2024-09-19T08:46:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.546+0000 7f3dd8b09740 1 -- 172.21.15.7:0/815159210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dc409ca20 con 0x55dd51138a90 2024-09-19T08:46:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.546+0000 7f3daf7fe640 1 -- 172.21.15.7:0/815159210 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f3dc8004b20 con 0x55dd51138a90 2024-09-19T08:46:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.546+0000 7f3daf7fe640 1 -- 172.21.15.7:0/815159210 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3dc8004d20 con 0x55dd51138a90 2024-09-19T08:46:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.546+0000 7f3dd8b09740 10 client.15900 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.546+0000 7f3dd8b09740 1 -- 172.21.15.7:0/815159210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dd51147150 con 0x55dd51138a90 2024-09-19T08:46:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.546+0000 7f3daf7fe640 1 -- 172.21.15.7:0/815159210 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dc409ca20 con 0x55dd51138a90 2024-09-19T08:46:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.546+0000 7f3daf7fe640 1 -- 172.21.15.7:0/815159210 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3dc801c070 con 0x55dd51138a90 2024-09-19T08:46:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.546+0000 7f3dd8b09740 10 client.15900 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.546+0000 7f3dd8b09740 10 client.15900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.546+0000 7f3dd8b09740 20 client.15900 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.546+0000 7f3dd8b09740 1 --2- 172.21.15.7:0/815159210 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55dd51148610 0x55dd5114aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.546+0000 7f3dd8b09740 4 client.15900 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:46:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.546+0000 7f3dd8b09740 1 -- 172.21.15.7:0/815159210 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd5109c850 con 0x55dd51148610 2024-09-19T08:46:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.547+0000 7f3dcffff640 1 --2- 172.21.15.7:0/815159210 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55dd51148610 0x55dd5114aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.548+0000 7f3daf7fe640 10 client.15900 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.548+0000 7f3dcffff640 1 --2- 172.21.15.7:0/815159210 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55dd51148610 0x55dd5114aa00 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c1706b9a719e0b4 server_cookie=33d31445fe6466b1 in_seq=0 out_seq=0 2024-09-19T08:46:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.549+0000 7f3daf7fe640 1 -- 172.21.15.7:0/815159210 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dd5109c850 con 0x55dd51148610 2024-09-19T08:46:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.549+0000 7f3daf7fe640 10 client.15900 handle_command_reply: tid=0 2024-09-19T08:46:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.549+0000 7f3dd8b09740 1 client.15900 shutdown 2024-09-19T08:46:58.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.549+0000 7f3dd8b09740 1 -- 172.21.15.7:0/815159210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51138a90 msgr2=0x55dd51135f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:58.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.549+0000 7f3dd8b09740 1 --2- 172.21.15.7:0/815159210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51138a90 0x55dd51135f10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8012920 tx=0x7f3dc8012de0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.549+0000 7f3dd8b09740 1 -- 172.21.15.7:0/815159210 shutdown_connections 2024-09-19T08:46:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.549+0000 7f3dd8b09740 1 --2- 172.21.15.7:0/815159210 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55dd51148610 0x55dd5114aa00 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.549+0000 7f3daf7fe640 0 client.15900 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.549+0000 7f3dd8b09740 1 --2- 172.21.15.7:0/815159210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51138a90 0x55dd51135f10 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.549+0000 7f3dd8b09740 1 --2- 172.21.15.7:0/815159210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd51129c80 0x55dd51135780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.549+0000 7f3dd8b09740 1 --2- 172.21.15.7:0/815159210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dd51129360 0x55dd511384d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.549+0000 7f3dd8b09740 1 -- 172.21.15.7:0/815159210 >> 172.21.15.7:0/815159210 conn(0x55dd51125a30 msgr2=0x55dd5112b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.549+0000 7f3dd8b09740 1 -- 172.21.15.7:0/815159210 shutdown_connections 2024-09-19T08:46:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.549+0000 7f3dd8b09740 1 -- 172.21.15.7:0/815159210 wait complete. 2024-09-19T08:46:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.549+0000 7f3dd8b09740 20 client.15900 trim_cache size 0 max 16384 2024-09-19T08:46:58.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.582+0000 7f3dd8b09740 1 Processor -- start 2024-09-19T08:46:58.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.582+0000 7f3dd8b09740 1 -- start start 2024-09-19T08:46:58.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.583+0000 7f3dd8b09740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51129360 0x55dd51135040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.583+0000 7f3dd8b09740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd51129c80 0x55dd51130c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.583+0000 7f3dd8b09740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dd51138a90 0x55dd511502b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.583+0000 7f3dd8b09740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd01ae000 con 0x55dd51129360 2024-09-19T08:46:58.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.583+0000 7f3dd8b09740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd01ab8d0 con 0x55dd51138a90 2024-09-19T08:46:58.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.583+0000 7f3dd8b09740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd01a9720 con 0x55dd51129c80 2024-09-19T08:46:58.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.583+0000 7f3dcffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51129360 0x55dd51135040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.583+0000 7f3dcffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51129360 0x55dd51135040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57942/0 (socket says 172.21.15.7:57942) 2024-09-19T08:46:58.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.583+0000 7f3dcffff640 1 -- 172.21.15.7:0/3676171726 learned_addr learned my addr 172.21.15.7:0/3676171726 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:58.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.583+0000 7f3dd4ccd640 1 --2- 172.21.15.7:0/3676171726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dd51138a90 0x55dd511502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.583+0000 7f3dcf7fe640 1 --2- 172.21.15.7:0/3676171726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd51129c80 0x55dd51130c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.583+0000 7f3dcffff640 1 -- 172.21.15.7:0/3676171726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd51129c80 msgr2=0x55dd51130c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:58.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.583+0000 7f3dcffff640 1 --2- 172.21.15.7:0/3676171726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd51129c80 0x55dd51130c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.583+0000 7f3dcffff640 1 -- 172.21.15.7:0/3676171726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dd51138a90 msgr2=0x55dd511502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:58.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.583+0000 7f3dcffff640 1 --2- 172.21.15.7:0/3676171726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dd51138a90 0x55dd511502b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.583+0000 7f3dcffff640 1 -- 172.21.15.7:0/3676171726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd51129ab0 con 0x55dd51129360 2024-09-19T08:46:58.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.584+0000 7f3dcffff640 1 --2- 172.21.15.7:0/3676171726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51129360 0x55dd51135040 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0000c00 tx=0x7f3dc003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7742c157223d2ab9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:58.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.584+0000 7f3db5ffb640 1 -- 172.21.15.7:0/3676171726 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0035050 con 0x55dd51129360 2024-09-19T08:46:58.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.584+0000 7f3db5ffb640 1 -- 172.21.15.7:0/3676171726 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dc0058070 con 0x55dd51129360 2024-09-19T08:46:58.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.584+0000 7f3db5ffb640 1 -- 172.21.15.7:0/3676171726 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0053cb0 con 0x55dd51129360 2024-09-19T08:46:58.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.585+0000 7f3dd8b09740 1 -- 172.21.15.7:0/3676171726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51129360 msgr2=0x55dd51135040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:58.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.585+0000 7f3dd8b09740 1 --2- 172.21.15.7:0/3676171726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51129360 0x55dd51135040 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0000c00 tx=0x7f3dc003e000 comp rx=0 tx=0).stop 2024-09-19T08:46:58.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.585+0000 7f3dd8b09740 1 -- 172.21.15.7:0/3676171726 shutdown_connections 2024-09-19T08:46:58.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.585+0000 7f3dd8b09740 1 --2- 172.21.15.7:0/3676171726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dd51138a90 0x55dd511502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.585+0000 7f3dd8b09740 1 --2- 172.21.15.7:0/3676171726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd51129c80 0x55dd51130c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.585+0000 7f3dd8b09740 1 --2- 172.21.15.7:0/3676171726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51129360 0x55dd51135040 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.585+0000 7f3dd8b09740 1 -- 172.21.15.7:0/3676171726 >> 172.21.15.7:0/3676171726 conn(0x55dd51125a30 msgr2=0x55dd511304f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:58.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.585+0000 7f3dd8b09740 1 -- 172.21.15.7:0/3676171726 shutdown_connections 2024-09-19T08:46:58.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.585+0000 7f3dd8b09740 1 -- 172.21.15.7:0/3676171726 wait complete. 2024-09-19T08:46:58.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.586+0000 7f3dd8b09740 1 -- start start 2024-09-19T08:46:58.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.586+0000 7f3dd8b09740 1 Processor -- start 2024-09-19T08:46:58.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.586+0000 7f3dd8b09740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dd51129360 0x55dd51141240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.586+0000 7f3dd8b09740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd51129c80 0x55dd51132580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.586+0000 7f3dd8b09740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51138a90 0x55dd51132b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.587+0000 7f3dd8b09740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd01a9d90 con 0x55dd51138a90 2024-09-19T08:46:58.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.587+0000 7f3dd8b09740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd01ab200 con 0x55dd51129360 2024-09-19T08:46:58.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.587+0000 7f3dd8b09740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd01aa460 con 0x55dd51129c80 2024-09-19T08:46:58.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.587+0000 7f3dd4ccd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51138a90 0x55dd51132b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.587+0000 7f3dd8b09740 10 client.0 _ll_register_callbacks cb 0x7f3dc8012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:46:58.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.587+0000 7f3dd4ccd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51138a90 0x55dd51132b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57948/0 (socket says 172.21.15.7:57948) 2024-09-19T08:46:58.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.587+0000 7f3dd4ccd640 1 -- 172.21.15.7:0/813501717 learned_addr learned my addr 172.21.15.7:0/813501717 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:46:58.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.587+0000 7f3dcf7fe640 1 --2- 172.21.15.7:0/813501717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd51129c80 0x55dd51132580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.587+0000 7f3dcffff640 1 --2- 172.21.15.7:0/813501717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dd51129360 0x55dd51141240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.587+0000 7f3dcf7fe640 1 -- 172.21.15.7:0/813501717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dd51129360 msgr2=0x55dd51141240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:58.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.587+0000 7f3dcf7fe640 1 --2- 172.21.15.7:0/813501717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dd51129360 0x55dd51141240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.587+0000 7f3dcf7fe640 1 -- 172.21.15.7:0/813501717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51138a90 msgr2=0x55dd51132b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:46:58.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.587+0000 7f3dcf7fe640 1 --2- 172.21.15.7:0/813501717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51138a90 0x55dd51132b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.587+0000 7f3dcf7fe640 1 -- 172.21.15.7:0/813501717 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd511333a0 con 0x55dd51129c80 2024-09-19T08:46:58.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.587+0000 7f3dd4ccd640 1 --2- 172.21.15.7:0/813501717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51138a90 0x55dd51132b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:58.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.587+0000 7f3dcf7fe640 1 --2- 172.21.15.7:0/813501717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd51129c80 0x55dd51132580 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40a5150 tx=0x7f3dc4018420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2b704193003b4ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:58.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.587+0000 7f3daf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-19T08:46:58.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.588+0000 7f3daf7fe640 1 -- 172.21.15.7:0/813501717 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc409c320 con 0x55dd51129c80 2024-09-19T08:46:58.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.588+0000 7f3dd8b09740 1 -- 172.21.15.7:0/813501717 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dc0058070 con 0x55dd51129c80 2024-09-19T08:46:58.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.588+0000 7f3daf7fe640 1 -- 172.21.15.7:0/813501717 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f3dc40b5120 con 0x55dd51129c80 2024-09-19T08:46:58.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.588+0000 7f3daf7fe640 1 -- 172.21.15.7:0/813501717 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3dc40b5320 con 0x55dd51129c80 2024-09-19T08:46:58.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.588+0000 7f3dd8b09740 10 client.25450 fetch_fsmap learned FSMap version 25 2024-09-19T08:46:58.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.588+0000 7f3dd8b09740 1 -- 172.21.15.7:0/813501717 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dd511b3370 con 0x55dd51129c80 2024-09-19T08:46:58.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.588+0000 7f3daf7fe640 1 -- 172.21.15.7:0/813501717 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dc0058070 con 0x55dd51129c80 2024-09-19T08:46:58.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.588+0000 7f3daf7fe640 1 -- 172.21.15.7:0/813501717 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3dc40aed10 con 0x55dd51129c80 2024-09-19T08:46:58.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.588+0000 7f3dd8b09740 10 client.25450 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:46:58.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.588+0000 7f3dd8b09740 10 client.25450 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:46:58.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.589+0000 7f3dd8b09740 20 client.25450 populate_metadata read hostname 'smithi007' 2024-09-19T08:46:58.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.589+0000 7f3dd8b09740 1 --2- 172.21.15.7:0/813501717 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55dd51148610 0x55dd511b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:58.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.589+0000 7f3dd8b09740 4 client.25450 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:46:58.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.589+0000 7f3dd8b09740 1 -- 172.21.15.7:0/813501717 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dd51096d60 con 0x55dd51148610 2024-09-19T08:46:58.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.589+0000 7f3dcffff640 1 --2- 172.21.15.7:0/813501717 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55dd51148610 0x55dd511b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:58.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.589+0000 7f3dcffff640 1 --2- 172.21.15.7:0/813501717 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55dd51148610 0x55dd511b55b0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7103422d55d025d2 server_cookie=5759126bd42efe1 in_seq=0 out_seq=0 2024-09-19T08:46:58.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.589+0000 7f3daf7fe640 10 client.25450 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:58.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.589+0000 7f3daf7fe640 1 -- 172.21.15.7:0/813501717 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55dd51096d60 con 0x55dd51148610 2024-09-19T08:46:58.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.589+0000 7f3daf7fe640 10 client.25450 handle_command_reply: tid=0 2024-09-19T08:46:58.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.589+0000 7f3dd8b09740 1 client.25450 shutdown 2024-09-19T08:46:58.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.590+0000 7f3dd8b09740 1 -- 172.21.15.7:0/813501717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd51129c80 msgr2=0x55dd51132580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:58.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.590+0000 7f3dd8b09740 1 --2- 172.21.15.7:0/813501717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd51129c80 0x55dd51132580 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40a5150 tx=0x7f3dc4018420 comp rx=0 tx=0).stop 2024-09-19T08:46:58.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.590+0000 7f3dd8b09740 1 -- 172.21.15.7:0/813501717 shutdown_connections 2024-09-19T08:46:58.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.590+0000 7f3dd8b09740 1 --2- 172.21.15.7:0/813501717 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55dd51148610 0x55dd511b55b0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.590+0000 7f3dd8b09740 1 --2- 172.21.15.7:0/813501717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dd51138a90 0x55dd51132b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.590+0000 7f3dd8b09740 1 --2- 172.21.15.7:0/813501717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dd51129c80 0x55dd51132580 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.590+0000 7f3daf7fe640 0 client.25450 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:46:58.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.590+0000 7f3dd8b09740 1 --2- 172.21.15.7:0/813501717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dd51129360 0x55dd51141240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.590+0000 7f3dd8b09740 1 -- 172.21.15.7:0/813501717 >> 172.21.15.7:0/813501717 conn(0x55dd51125a30 msgr2=0x55dd51137800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:58.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.590+0000 7f3dd8b09740 1 -- 172.21.15.7:0/813501717 shutdown_connections 2024-09-19T08:46:58.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.590+0000 7f3dd8b09740 1 -- 172.21.15.7:0/813501717 wait complete. 2024-09-19T08:46:58.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.590+0000 7f3dd8b09740 20 client.25450 trim_cache size 0 max 16384 2024-09-19T08:46:58.603 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:46:58.603 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:46:58.603 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-19T08:46:58.603 INFO:teuthology.orchestra.run.smithi007.stdout: "9870567b-035e-4e9a-87df-b6cb5a2d51f5": { 2024-09-19T08:46:58.603 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-19T08:46:58.603 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "9870567b-035e-4e9a-87df-b6cb5a2d51f5", 2024-09-19T08:46:58.604 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-19T08:46:58.604 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:46:58.604 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:46:58.604 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:46:58.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.591+0000 7f3dd6730640 1 -- 172.21.15.7:0/4169687043 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3db80a3430 msgr2=0x7f3db80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:58.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.591+0000 7f3dd6730640 1 --2- 172.21.15.7:0/4169687043 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3db80a3430 0x7f3db80a58f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009230 tx=0x7f3dc00058d0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.591+0000 7f3dd6730640 1 -- 172.21.15.7:0/4169687043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dd0102570 msgr2=0x7f3dd0198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:58.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.591+0000 7f3dd6730640 1 --2- 172.21.15.7:0/4169687043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dd0102570 0x7f3dd0198a40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400e9f0 tx=0x7f3dc400eeb0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.591+0000 7f3dd6730640 1 -- 172.21.15.7:0/4169687043 shutdown_connections 2024-09-19T08:46:58.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.591+0000 7f3dd6730640 1 --2- 172.21.15.7:0/4169687043 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3db80a3430 0x7f3db80a58f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.591+0000 7f3dd6730640 1 --2- 172.21.15.7:0/4169687043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dd0102ef0 0x7f3dd019cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.591+0000 7f3dd6730640 1 --2- 172.21.15.7:0/4169687043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dd0102570 0x7f3dd0198a40 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.591+0000 7f3dd6730640 1 --2- 172.21.15.7:0/4169687043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dd0100e20 0x7f3dd0198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:58.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.591+0000 7f3dd6730640 1 -- 172.21.15.7:0/4169687043 >> 172.21.15.7:0/4169687043 conn(0x7f3dd00fc7d0 msgr2=0x7f3dd006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:58.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.591+0000 7f3dd6730640 1 -- 172.21.15.7:0/4169687043 shutdown_connections 2024-09-19T08:46:58.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:46:58.591+0000 7f3dd6730640 1 -- 172.21.15.7:0/4169687043 wait complete. 2024-09-19T08:46:59.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:58 smithi007 ceph-mon[31221]: pgmap v76: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-19T08:46:59.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:46:58 smithi007 ceph-mon[31221]: scrub summary: idle 2024-09-19T08:46:59.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:58 smithi044 ceph-mon[35072]: pgmap v76: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-19T08:46:59.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:46:58 smithi044 ceph-mon[35072]: scrub summary: idle 2024-09-19T08:46:59.367 INFO:tasks.cephfs.filesystem:scrub status for tag:9870567b-035e-4e9a-87df-b6cb5a2d51f5 - {'path': '/', 'tag': '9870567b-035e-4e9a-87df-b6cb5a2d51f5', 'options': 'recursive,force'} 2024-09-19T08:46:59.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:58 smithi175 ceph-mon[35688]: pgmap v76: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-19T08:46:59.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:46:58 smithi175 ceph-mon[35688]: scrub summary: idle 2024-09-19T08:47:01.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:00 smithi007 ceph-mon[31221]: pgmap v77: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 864 KiB/s wr, 7 op/s 2024-09-19T08:47:01.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:00 smithi044 ceph-mon[35072]: pgmap v77: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 864 KiB/s wr, 7 op/s 2024-09-19T08:47:01.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:00 smithi175 ceph-mon[35688]: pgmap v77: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 864 KiB/s wr, 7 op/s 2024-09-19T08:47:03.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:02 smithi007 ceph-mon[31221]: pgmap v78: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 864 KiB/s wr, 7 op/s 2024-09-19T08:47:03.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:02 smithi044 ceph-mon[35072]: pgmap v78: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 864 KiB/s wr, 7 op/s 2024-09-19T08:47:03.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:02 smithi175 ceph-mon[35688]: pgmap v78: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 864 KiB/s wr, 7 op/s 2024-09-19T08:47:04.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:04 smithi175 ceph-mon[35688]: pgmap v79: 97 pgs: 97 active+clean; 260 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 1.8 MiB/s wr, 149 op/s 2024-09-19T08:47:04.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:04 smithi007 ceph-mon[31221]: pgmap v79: 97 pgs: 97 active+clean; 260 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 1.8 MiB/s wr, 149 op/s 2024-09-19T08:47:04.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:04 smithi044 ceph-mon[35072]: pgmap v79: 97 pgs: 97 active+clean; 260 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 1.8 MiB/s wr, 149 op/s 2024-09-19T08:47:06.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:06 smithi007 ceph-mon[31221]: pgmap v80: 97 pgs: 97 active+clean; 260 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2024-09-19T08:47:06.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:06 smithi044 ceph-mon[35072]: pgmap v80: 97 pgs: 97 active+clean; 260 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2024-09-19T08:47:06.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:06 smithi175 ceph-mon[35688]: pgmap v80: 97 pgs: 97 active+clean; 260 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2024-09-19T08:47:08.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:08 smithi007 ceph-mon[31221]: pgmap v81: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.1 MiB/s wr, 494 op/s 2024-09-19T08:47:08.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:08 smithi044 ceph-mon[35072]: pgmap v81: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.1 MiB/s wr, 494 op/s 2024-09-19T08:47:08.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:08 smithi175 ceph-mon[35688]: pgmap v81: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.1 MiB/s wr, 494 op/s 2024-09-19T08:47:10.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:10 smithi007 ceph-mon[31221]: pgmap v82: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 2.7 MiB/s wr, 490 op/s 2024-09-19T08:47:10.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:10 smithi044 ceph-mon[35072]: pgmap v82: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 2.7 MiB/s wr, 490 op/s 2024-09-19T08:47:10.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:10 smithi175 ceph-mon[35688]: pgmap v82: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 2.7 MiB/s wr, 490 op/s 2024-09-19T08:47:12.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:12 smithi007 ceph-mon[31221]: pgmap v83: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 2.7 MiB/s wr, 490 op/s 2024-09-19T08:47:12.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:12 smithi044 ceph-mon[35072]: pgmap v83: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 2.7 MiB/s wr, 490 op/s 2024-09-19T08:47:12.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:12 smithi175 ceph-mon[35688]: pgmap v83: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 2.7 MiB/s wr, 490 op/s 2024-09-19T08:47:14.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:14 smithi007 ceph-mon[31221]: pgmap v84: 97 pgs: 97 active+clean; 260 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 21 MiB/s wr, 1.34k op/s 2024-09-19T08:47:14.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:14 smithi044 ceph-mon[35072]: pgmap v84: 97 pgs: 97 active+clean; 260 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 21 MiB/s wr, 1.34k op/s 2024-09-19T08:47:14.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:14 smithi175 ceph-mon[35688]: pgmap v84: 97 pgs: 97 active+clean; 260 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 21 MiB/s wr, 1.34k op/s 2024-09-19T08:47:16.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:16 smithi007 ceph-mon[31221]: pgmap v85: 97 pgs: 97 active+clean; 260 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 1.20k op/s 2024-09-19T08:47:16.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:16 smithi044 ceph-mon[35072]: pgmap v85: 97 pgs: 97 active+clean; 260 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 1.20k op/s 2024-09-19T08:47:16.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:16 smithi175 ceph-mon[35688]: pgmap v85: 97 pgs: 97 active+clean; 260 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 1.20k op/s 2024-09-19T08:47:16.980 INFO:tasks.workunit.client.0.smithi007.stdout:setting up random write file 2024-09-19T08:47:16.980 INFO:tasks.workunit.client.0.smithi007.stdout:done setting up random write file 2024-09-19T08:47:16.980 INFO:tasks.workunit.client.0.smithi007.stdout:starting fsync run 2024-09-19T08:47:16.980 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0087s 2024-09-19T08:47:16.980 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0004s fsync time: 0.0066s 2024-09-19T08:47:16.980 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0004s fsync time: 0.0063s 2024-09-19T08:47:16.980 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0068s 2024-09-19T08:47:16.980 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 19.3987s fsync time: 0.0052s 2024-09-19T08:47:16.981 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0045s 2024-09-19T08:47:16.981 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0050s 2024-09-19T08:47:16.981 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0049s 2024-09-19T08:47:16.981 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0052s 2024-09-19T08:47:16.981 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0047s 2024-09-19T08:47:16.981 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0046s 2024-09-19T08:47:16.981 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0047s 2024-09-19T08:47:16.981 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0050s 2024-09-19T08:47:16.981 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0047s 2024-09-19T08:47:16.981 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0046s 2024-09-19T08:47:16.981 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0055s 2024-09-19T08:47:16.981 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0045s 2024-09-19T08:47:16.982 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0052s 2024-09-19T08:47:16.982 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0052s 2024-09-19T08:47:16.982 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0046s 2024-09-19T08:47:16.982 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0047s 2024-09-19T08:47:16.982 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0050s 2024-09-19T08:47:16.982 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0049s 2024-09-19T08:47:16.982 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0050s 2024-09-19T08:47:16.982 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0045s 2024-09-19T08:47:16.982 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0057s 2024-09-19T08:47:16.982 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0049s 2024-09-19T08:47:16.982 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0059s 2024-09-19T08:47:16.982 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0044s 2024-09-19T08:47:16.982 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0054s 2024-09-19T08:47:16.982 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0050s 2024-09-19T08:47:16.983 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0052s 2024-09-19T08:47:16.983 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0046s 2024-09-19T08:47:16.983 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0055s 2024-09-19T08:47:16.983 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0044s 2024-09-19T08:47:16.983 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0475s 2024-09-19T08:47:16.983 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0063s 2024-09-19T08:47:16.983 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0051s 2024-09-19T08:47:16.983 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0004s fsync time: 0.0040s 2024-09-19T08:47:16.983 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0052s 2024-09-19T08:47:16.983 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0003s fsync time: 0.0041s 2024-09-19T08:47:16.983 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0002s fsync time: 0.0050s 2024-09-19T08:47:16.983 INFO:tasks.workunit.client.0.smithi007.stdout:run done 42 fsyncs total, killing random writer 2024-09-19T08:47:16.984 INFO:tasks.workunit.client.0.smithi007.stderr:+ echo /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-19T08:47:16.984 INFO:tasks.workunit.client.0.smithi007.stdout:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-19T08:47:16.984 INFO:tasks.workunit.client.0.smithi007.stderr:+ whereis lsof 2024-09-19T08:47:17.026 INFO:tasks.workunit.client.0.smithi007.stdout:lsof: /usr/bin/lsof /usr/share/man/man1/lsof.1.gz 2024-09-19T08:47:17.026 INFO:tasks.workunit.client.0.smithi007.stderr:+ lsof 2024-09-19T08:47:17.046 INFO:tasks.workunit.client.0.smithi007.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/2589b4aae89350cc6c39b36a26a7f6767ff3d869a43670ab4e007b4faede1a4e/merged 2024-09-19T08:47:17.046 INFO:tasks.workunit.client.0.smithi007.stderr: Output information may be incomplete. 2024-09-19T08:47:17.046 INFO:tasks.workunit.client.0.smithi007.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/d1c7a655ef44169c43b4cf2e06d9485d757581ccca77eb1c1ef9797a215ae359/merged 2024-09-19T08:47:17.046 INFO:tasks.workunit.client.0.smithi007.stderr: Output information may be incomplete. 2024-09-19T08:47:17.046 INFO:tasks.workunit.client.0.smithi007.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/70d4333e3625c30e51a8b951ad0e5f0dc6e26d44ffe3889f63bb53a47fa74516/merged 2024-09-19T08:47:17.046 INFO:tasks.workunit.client.0.smithi007.stderr: Output information may be incomplete. 2024-09-19T08:47:17.046 INFO:tasks.workunit.client.0.smithi007.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/aa7dcdd9edc45ffd065edf79532ba82a25bb858b08b2f94d97073855f184c688/merged 2024-09-19T08:47:17.046 INFO:tasks.workunit.client.0.smithi007.stderr: Output information may be incomplete. 2024-09-19T08:47:17.046 INFO:tasks.workunit.client.0.smithi007.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/d3ca4600f37551548fab521f5fd27b9b7fbdcb87249275bbfbd3a98800d12070/merged 2024-09-19T08:47:17.047 INFO:tasks.workunit.client.0.smithi007.stderr: Output information may be incomplete. 2024-09-19T08:47:17.047 INFO:tasks.workunit.client.0.smithi007.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/2c0203754e9abf5ddef23702b2cbdc05d216c5d1f38cdd31e5893d8d8bbdfe96/merged 2024-09-19T08:47:17.047 INFO:tasks.workunit.client.0.smithi007.stderr: Output information may be incomplete. 2024-09-19T08:47:17.047 INFO:tasks.workunit.client.0.smithi007.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/b4f4227e294b3429d540d8c300b5e6b80d9704688c4d22e48801f507fdcf97c8/merged 2024-09-19T08:47:17.047 INFO:tasks.workunit.client.0.smithi007.stderr: Output information may be incomplete. 2024-09-19T08:47:17.047 INFO:tasks.workunit.client.0.smithi007.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/c954dc38fc719dc246a7925d3dcb673eb799a5608766f6d701990de8e2821038/merged 2024-09-19T08:47:17.047 INFO:tasks.workunit.client.0.smithi007.stderr: Output information may be incomplete. 2024-09-19T08:47:17.047 INFO:tasks.workunit.client.0.smithi007.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/09de034113d7dce7362625c3f80a2a13468747a028c57ea27985cdf02d9d90ec/merged 2024-09-19T08:47:17.047 INFO:tasks.workunit.client.0.smithi007.stderr: Output information may be incomplete. 2024-09-19T08:47:17.047 INFO:tasks.workunit.client.0.smithi007.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/e55334fdb1c9b109eb7e4e12599b72e5ca8ee5e7ef8f75bfb17f7f6798888bd4/merged 2024-09-19T08:47:17.047 INFO:tasks.workunit.client.0.smithi007.stderr: Output information may be incomplete. 2024-09-19T08:47:17.109 INFO:tasks.workunit.client.0.smithi007.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2024-09-19T08:47:17.110 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1 root cwd unknown /proc/1/cwd (readlink: Permission denied) 2024-09-19T08:47:17.110 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1 root rtd unknown /proc/1/root (readlink: Permission denied) 2024-09-19T08:47:17.110 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1 root txt unknown /proc/1/exe (readlink: Permission denied) 2024-09-19T08:47:17.110 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1 root NOFD /proc/1/fd (opendir: Permission denied) 2024-09-19T08:47:17.110 INFO:tasks.workunit.client.0.smithi007.stdout:kthreadd 2 root cwd unknown /proc/2/cwd (readlink: Permission denied) 2024-09-19T08:47:17.110 INFO:tasks.workunit.client.0.smithi007.stdout:kthreadd 2 root rtd unknown /proc/2/root (readlink: Permission denied) 2024-09-19T08:47:17.110 INFO:tasks.workunit.client.0.smithi007.stdout:kthreadd 2 root txt unknown /proc/2/exe (readlink: Permission denied) 2024-09-19T08:47:17.110 INFO:tasks.workunit.client.0.smithi007.stdout:kthreadd 2 root NOFD /proc/2/fd (opendir: Permission denied) 2024-09-19T08:47:17.110 INFO:tasks.workunit.client.0.smithi007.stdout:pool_work 3 root cwd unknown /proc/3/cwd (readlink: Permission denied) 2024-09-19T08:47:17.110 INFO:tasks.workunit.client.0.smithi007.stdout:pool_work 3 root rtd unknown /proc/3/root (readlink: Permission denied) 2024-09-19T08:47:17.110 INFO:tasks.workunit.client.0.smithi007.stdout:pool_work 3 root txt unknown /proc/3/exe (readlink: Permission denied) 2024-09-19T08:47:17.110 INFO:tasks.workunit.client.0.smithi007.stdout:pool_work 3 root NOFD /proc/3/fd (opendir: Permission denied) 2024-09-19T08:47:17.111 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 4 root cwd unknown /proc/4/cwd (readlink: Permission denied) 2024-09-19T08:47:17.111 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 4 root rtd unknown /proc/4/root (readlink: Permission denied) 2024-09-19T08:47:17.111 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 4 root txt unknown /proc/4/exe (readlink: Permission denied) 2024-09-19T08:47:17.111 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 4 root NOFD /proc/4/fd (opendir: Permission denied) 2024-09-19T08:47:17.111 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 5 root cwd unknown /proc/5/cwd (readlink: Permission denied) 2024-09-19T08:47:17.111 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 5 root rtd unknown /proc/5/root (readlink: Permission denied) 2024-09-19T08:47:17.111 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 5 root txt unknown /proc/5/exe (readlink: Permission denied) 2024-09-19T08:47:17.111 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 5 root NOFD /proc/5/fd (opendir: Permission denied) 2024-09-19T08:47:17.111 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 6 root cwd unknown /proc/6/cwd (readlink: Permission denied) 2024-09-19T08:47:17.111 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 6 root rtd unknown /proc/6/root (readlink: Permission denied) 2024-09-19T08:47:17.111 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 6 root txt unknown /proc/6/exe (readlink: Permission denied) 2024-09-19T08:47:17.111 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 6 root NOFD /proc/6/fd (opendir: Permission denied) 2024-09-19T08:47:17.112 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 7 root cwd unknown /proc/7/cwd (readlink: Permission denied) 2024-09-19T08:47:17.112 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 7 root rtd unknown /proc/7/root (readlink: Permission denied) 2024-09-19T08:47:17.112 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 7 root txt unknown /proc/7/exe (readlink: Permission denied) 2024-09-19T08:47:17.112 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 7 root NOFD /proc/7/fd (opendir: Permission denied) 2024-09-19T08:47:17.112 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 8 root cwd unknown /proc/8/cwd (readlink: Permission denied) 2024-09-19T08:47:17.112 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 8 root rtd unknown /proc/8/root (readlink: Permission denied) 2024-09-19T08:47:17.112 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 8 root txt unknown /proc/8/exe (readlink: Permission denied) 2024-09-19T08:47:17.112 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 8 root NOFD /proc/8/fd (opendir: Permission denied) 2024-09-19T08:47:17.112 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 9 root cwd unknown /proc/9/cwd (readlink: Permission denied) 2024-09-19T08:47:17.112 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 9 root rtd unknown /proc/9/root (readlink: Permission denied) 2024-09-19T08:47:17.112 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 9 root txt unknown /proc/9/exe (readlink: Permission denied) 2024-09-19T08:47:17.112 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 9 root NOFD /proc/9/fd (opendir: Permission denied) 2024-09-19T08:47:17.112 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 10 root cwd unknown /proc/10/cwd (readlink: Permission denied) 2024-09-19T08:47:17.113 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 10 root rtd unknown /proc/10/root (readlink: Permission denied) 2024-09-19T08:47:17.113 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 10 root txt unknown /proc/10/exe (readlink: Permission denied) 2024-09-19T08:47:17.113 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 10 root NOFD /proc/10/fd (opendir: Permission denied) 2024-09-19T08:47:17.113 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 11 root cwd unknown /proc/11/cwd (readlink: Permission denied) 2024-09-19T08:47:17.113 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 11 root rtd unknown /proc/11/root (readlink: Permission denied) 2024-09-19T08:47:17.113 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 11 root txt unknown /proc/11/exe (readlink: Permission denied) 2024-09-19T08:47:17.113 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 11 root NOFD /proc/11/fd (opendir: Permission denied) 2024-09-19T08:47:17.113 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 13 root cwd unknown /proc/13/cwd (readlink: Permission denied) 2024-09-19T08:47:17.113 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 13 root rtd unknown /proc/13/root (readlink: Permission denied) 2024-09-19T08:47:17.113 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 13 root txt unknown /proc/13/exe (readlink: Permission denied) 2024-09-19T08:47:17.113 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 13 root NOFD /proc/13/fd (opendir: Permission denied) 2024-09-19T08:47:17.113 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 14 root cwd unknown /proc/14/cwd (readlink: Permission denied) 2024-09-19T08:47:17.114 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 14 root rtd unknown /proc/14/root (readlink: Permission denied) 2024-09-19T08:47:17.114 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 14 root txt unknown /proc/14/exe (readlink: Permission denied) 2024-09-19T08:47:17.114 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 14 root NOFD /proc/14/fd (opendir: Permission denied) 2024-09-19T08:47:17.114 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 15 root cwd unknown /proc/15/cwd (readlink: Permission denied) 2024-09-19T08:47:17.114 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 15 root rtd unknown /proc/15/root (readlink: Permission denied) 2024-09-19T08:47:17.114 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 15 root txt unknown /proc/15/exe (readlink: Permission denied) 2024-09-19T08:47:17.114 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 15 root NOFD /proc/15/fd (opendir: Permission denied) 2024-09-19T08:47:17.114 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 16 root cwd unknown /proc/16/cwd (readlink: Permission denied) 2024-09-19T08:47:17.114 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 16 root rtd unknown /proc/16/root (readlink: Permission denied) 2024-09-19T08:47:17.114 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 16 root txt unknown /proc/16/exe (readlink: Permission denied) 2024-09-19T08:47:17.114 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 16 root NOFD /proc/16/fd (opendir: Permission denied) 2024-09-19T08:47:17.114 INFO:tasks.workunit.client.0.smithi007.stdout:pr/ttyS1 17 root cwd unknown /proc/17/cwd (readlink: Permission denied) 2024-09-19T08:47:17.114 INFO:tasks.workunit.client.0.smithi007.stdout:pr/ttyS1 17 root rtd unknown /proc/17/root (readlink: Permission denied) 2024-09-19T08:47:17.115 INFO:tasks.workunit.client.0.smithi007.stdout:pr/ttyS1 17 root txt unknown /proc/17/exe (readlink: Permission denied) 2024-09-19T08:47:17.115 INFO:tasks.workunit.client.0.smithi007.stdout:pr/ttyS1 17 root NOFD /proc/17/fd (opendir: Permission denied) 2024-09-19T08:47:17.115 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_preem 18 root cwd unknown /proc/18/cwd (readlink: Permission denied) 2024-09-19T08:47:17.115 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_preem 18 root rtd unknown /proc/18/root (readlink: Permission denied) 2024-09-19T08:47:17.115 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_preem 18 root txt unknown /proc/18/exe (readlink: Permission denied) 2024-09-19T08:47:17.115 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_preem 18 root NOFD /proc/18/fd (opendir: Permission denied) 2024-09-19T08:47:17.115 INFO:tasks.workunit.client.0.smithi007.stdout:migration 19 root cwd unknown /proc/19/cwd (readlink: Permission denied) 2024-09-19T08:47:17.115 INFO:tasks.workunit.client.0.smithi007.stdout:migration 19 root rtd unknown /proc/19/root (readlink: Permission denied) 2024-09-19T08:47:17.115 INFO:tasks.workunit.client.0.smithi007.stdout:migration 19 root txt unknown /proc/19/exe (readlink: Permission denied) 2024-09-19T08:47:17.115 INFO:tasks.workunit.client.0.smithi007.stdout:migration 19 root NOFD /proc/19/fd (opendir: Permission denied) 2024-09-19T08:47:17.115 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 20 root cwd unknown /proc/20/cwd (readlink: Permission denied) 2024-09-19T08:47:17.115 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 20 root rtd unknown /proc/20/root (readlink: Permission denied) 2024-09-19T08:47:17.115 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 20 root txt unknown /proc/20/exe (readlink: Permission denied) 2024-09-19T08:47:17.116 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 20 root NOFD /proc/20/fd (opendir: Permission denied) 2024-09-19T08:47:17.116 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/0 22 root cwd unknown /proc/22/cwd (readlink: Permission denied) 2024-09-19T08:47:17.116 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/0 22 root rtd unknown /proc/22/root (readlink: Permission denied) 2024-09-19T08:47:17.116 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/0 22 root txt unknown /proc/22/exe (readlink: Permission denied) 2024-09-19T08:47:17.116 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/0 22 root NOFD /proc/22/fd (opendir: Permission denied) 2024-09-19T08:47:17.116 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/1 23 root cwd unknown /proc/23/cwd (readlink: Permission denied) 2024-09-19T08:47:17.116 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/1 23 root rtd unknown /proc/23/root (readlink: Permission denied) 2024-09-19T08:47:17.116 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/1 23 root txt unknown /proc/23/exe (readlink: Permission denied) 2024-09-19T08:47:17.116 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/1 23 root NOFD /proc/23/fd (opendir: Permission denied) 2024-09-19T08:47:17.116 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 24 root cwd unknown /proc/24/cwd (readlink: Permission denied) 2024-09-19T08:47:17.116 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 24 root rtd unknown /proc/24/root (readlink: Permission denied) 2024-09-19T08:47:17.116 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 24 root txt unknown /proc/24/exe (readlink: Permission denied) 2024-09-19T08:47:17.116 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 24 root NOFD /proc/24/fd (opendir: Permission denied) 2024-09-19T08:47:17.116 INFO:tasks.workunit.client.0.smithi007.stdout:migration 25 root cwd unknown /proc/25/cwd (readlink: Permission denied) 2024-09-19T08:47:17.117 INFO:tasks.workunit.client.0.smithi007.stdout:migration 25 root rtd unknown /proc/25/root (readlink: Permission denied) 2024-09-19T08:47:17.117 INFO:tasks.workunit.client.0.smithi007.stdout:migration 25 root txt unknown /proc/25/exe (readlink: Permission denied) 2024-09-19T08:47:17.117 INFO:tasks.workunit.client.0.smithi007.stdout:migration 25 root NOFD /proc/25/fd (opendir: Permission denied) 2024-09-19T08:47:17.117 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 26 root cwd unknown /proc/26/cwd (readlink: Permission denied) 2024-09-19T08:47:17.117 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 26 root rtd unknown /proc/26/root (readlink: Permission denied) 2024-09-19T08:47:17.117 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 26 root txt unknown /proc/26/exe (readlink: Permission denied) 2024-09-19T08:47:17.117 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 26 root NOFD /proc/26/fd (opendir: Permission denied) 2024-09-19T08:47:17.117 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 28 root cwd unknown /proc/28/cwd (readlink: Permission denied) 2024-09-19T08:47:17.117 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 28 root rtd unknown /proc/28/root (readlink: Permission denied) 2024-09-19T08:47:17.117 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 28 root txt unknown /proc/28/exe (readlink: Permission denied) 2024-09-19T08:47:17.117 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 28 root NOFD /proc/28/fd (opendir: Permission denied) 2024-09-19T08:47:17.117 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/2 29 root cwd unknown /proc/29/cwd (readlink: Permission denied) 2024-09-19T08:47:17.117 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/2 29 root rtd unknown /proc/29/root (readlink: Permission denied) 2024-09-19T08:47:17.118 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/2 29 root txt unknown /proc/29/exe (readlink: Permission denied) 2024-09-19T08:47:17.118 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/2 29 root NOFD /proc/29/fd (opendir: Permission denied) 2024-09-19T08:47:17.118 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 30 root cwd unknown /proc/30/cwd (readlink: Permission denied) 2024-09-19T08:47:17.118 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 30 root rtd unknown /proc/30/root (readlink: Permission denied) 2024-09-19T08:47:17.118 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 30 root txt unknown /proc/30/exe (readlink: Permission denied) 2024-09-19T08:47:17.118 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 30 root NOFD /proc/30/fd (opendir: Permission denied) 2024-09-19T08:47:17.118 INFO:tasks.workunit.client.0.smithi007.stdout:migration 31 root cwd unknown /proc/31/cwd (readlink: Permission denied) 2024-09-19T08:47:17.118 INFO:tasks.workunit.client.0.smithi007.stdout:migration 31 root rtd unknown /proc/31/root (readlink: Permission denied) 2024-09-19T08:47:17.118 INFO:tasks.workunit.client.0.smithi007.stdout:migration 31 root txt unknown /proc/31/exe (readlink: Permission denied) 2024-09-19T08:47:17.118 INFO:tasks.workunit.client.0.smithi007.stdout:migration 31 root NOFD /proc/31/fd (opendir: Permission denied) 2024-09-19T08:47:17.118 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 32 root cwd unknown /proc/32/cwd (readlink: Permission denied) 2024-09-19T08:47:17.119 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 32 root rtd unknown /proc/32/root (readlink: Permission denied) 2024-09-19T08:47:17.119 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 32 root txt unknown /proc/32/exe (readlink: Permission denied) 2024-09-19T08:47:17.119 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 32 root NOFD /proc/32/fd (opendir: Permission denied) 2024-09-19T08:47:17.119 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 34 root cwd unknown /proc/34/cwd (readlink: Permission denied) 2024-09-19T08:47:17.119 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 34 root rtd unknown /proc/34/root (readlink: Permission denied) 2024-09-19T08:47:17.119 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 34 root txt unknown /proc/34/exe (readlink: Permission denied) 2024-09-19T08:47:17.119 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 34 root NOFD /proc/34/fd (opendir: Permission denied) 2024-09-19T08:47:17.119 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/3 35 root cwd unknown /proc/35/cwd (readlink: Permission denied) 2024-09-19T08:47:17.119 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/3 35 root rtd unknown /proc/35/root (readlink: Permission denied) 2024-09-19T08:47:17.119 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/3 35 root txt unknown /proc/35/exe (readlink: Permission denied) 2024-09-19T08:47:17.119 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/3 35 root NOFD /proc/35/fd (opendir: Permission denied) 2024-09-19T08:47:17.119 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 36 root cwd unknown /proc/36/cwd (readlink: Permission denied) 2024-09-19T08:47:17.120 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 36 root rtd unknown /proc/36/root (readlink: Permission denied) 2024-09-19T08:47:17.120 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 36 root txt unknown /proc/36/exe (readlink: Permission denied) 2024-09-19T08:47:17.120 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 36 root NOFD /proc/36/fd (opendir: Permission denied) 2024-09-19T08:47:17.120 INFO:tasks.workunit.client.0.smithi007.stdout:migration 37 root cwd unknown /proc/37/cwd (readlink: Permission denied) 2024-09-19T08:47:17.120 INFO:tasks.workunit.client.0.smithi007.stdout:migration 37 root rtd unknown /proc/37/root (readlink: Permission denied) 2024-09-19T08:47:17.120 INFO:tasks.workunit.client.0.smithi007.stdout:migration 37 root txt unknown /proc/37/exe (readlink: Permission denied) 2024-09-19T08:47:17.120 INFO:tasks.workunit.client.0.smithi007.stdout:migration 37 root NOFD /proc/37/fd (opendir: Permission denied) 2024-09-19T08:47:17.120 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 38 root cwd unknown /proc/38/cwd (readlink: Permission denied) 2024-09-19T08:47:17.120 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 38 root rtd unknown /proc/38/root (readlink: Permission denied) 2024-09-19T08:47:17.120 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 38 root txt unknown /proc/38/exe (readlink: Permission denied) 2024-09-19T08:47:17.120 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 38 root NOFD /proc/38/fd (opendir: Permission denied) 2024-09-19T08:47:17.120 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 40 root cwd unknown /proc/40/cwd (readlink: Permission denied) 2024-09-19T08:47:17.121 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 40 root rtd unknown /proc/40/root (readlink: Permission denied) 2024-09-19T08:47:17.121 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 40 root txt unknown /proc/40/exe (readlink: Permission denied) 2024-09-19T08:47:17.121 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 40 root NOFD /proc/40/fd (opendir: Permission denied) 2024-09-19T08:47:17.121 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/4 41 root cwd unknown /proc/41/cwd (readlink: Permission denied) 2024-09-19T08:47:17.121 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/4 41 root rtd unknown /proc/41/root (readlink: Permission denied) 2024-09-19T08:47:17.121 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/4 41 root txt unknown /proc/41/exe (readlink: Permission denied) 2024-09-19T08:47:17.121 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/4 41 root NOFD /proc/41/fd (opendir: Permission denied) 2024-09-19T08:47:17.121 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 42 root cwd unknown /proc/42/cwd (readlink: Permission denied) 2024-09-19T08:47:17.121 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 42 root rtd unknown /proc/42/root (readlink: Permission denied) 2024-09-19T08:47:17.121 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 42 root txt unknown /proc/42/exe (readlink: Permission denied) 2024-09-19T08:47:17.121 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 42 root NOFD /proc/42/fd (opendir: Permission denied) 2024-09-19T08:47:17.121 INFO:tasks.workunit.client.0.smithi007.stdout:migration 43 root cwd unknown /proc/43/cwd (readlink: Permission denied) 2024-09-19T08:47:17.121 INFO:tasks.workunit.client.0.smithi007.stdout:migration 43 root rtd unknown /proc/43/root (readlink: Permission denied) 2024-09-19T08:47:17.122 INFO:tasks.workunit.client.0.smithi007.stdout:migration 43 root txt unknown /proc/43/exe (readlink: Permission denied) 2024-09-19T08:47:17.122 INFO:tasks.workunit.client.0.smithi007.stdout:migration 43 root NOFD /proc/43/fd (opendir: Permission denied) 2024-09-19T08:47:17.122 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 44 root cwd unknown /proc/44/cwd (readlink: Permission denied) 2024-09-19T08:47:17.122 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 44 root rtd unknown /proc/44/root (readlink: Permission denied) 2024-09-19T08:47:17.122 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 44 root txt unknown /proc/44/exe (readlink: Permission denied) 2024-09-19T08:47:17.122 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 44 root NOFD /proc/44/fd (opendir: Permission denied) 2024-09-19T08:47:17.122 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 46 root cwd unknown /proc/46/cwd (readlink: Permission denied) 2024-09-19T08:47:17.122 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 46 root rtd unknown /proc/46/root (readlink: Permission denied) 2024-09-19T08:47:17.122 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 46 root txt unknown /proc/46/exe (readlink: Permission denied) 2024-09-19T08:47:17.122 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 46 root NOFD /proc/46/fd (opendir: Permission denied) 2024-09-19T08:47:17.122 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/5 47 root cwd unknown /proc/47/cwd (readlink: Permission denied) 2024-09-19T08:47:17.123 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/5 47 root rtd unknown /proc/47/root (readlink: Permission denied) 2024-09-19T08:47:17.123 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/5 47 root txt unknown /proc/47/exe (readlink: Permission denied) 2024-09-19T08:47:17.123 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/5 47 root NOFD /proc/47/fd (opendir: Permission denied) 2024-09-19T08:47:17.123 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 48 root cwd unknown /proc/48/cwd (readlink: Permission denied) 2024-09-19T08:47:17.123 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 48 root rtd unknown /proc/48/root (readlink: Permission denied) 2024-09-19T08:47:17.123 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 48 root txt unknown /proc/48/exe (readlink: Permission denied) 2024-09-19T08:47:17.123 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 48 root NOFD /proc/48/fd (opendir: Permission denied) 2024-09-19T08:47:17.123 INFO:tasks.workunit.client.0.smithi007.stdout:migration 49 root cwd unknown /proc/49/cwd (readlink: Permission denied) 2024-09-19T08:47:17.123 INFO:tasks.workunit.client.0.smithi007.stdout:migration 49 root rtd unknown /proc/49/root (readlink: Permission denied) 2024-09-19T08:47:17.123 INFO:tasks.workunit.client.0.smithi007.stdout:migration 49 root txt unknown /proc/49/exe (readlink: Permission denied) 2024-09-19T08:47:17.123 INFO:tasks.workunit.client.0.smithi007.stdout:migration 49 root NOFD /proc/49/fd (opendir: Permission denied) 2024-09-19T08:47:17.124 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 50 root cwd unknown /proc/50/cwd (readlink: Permission denied) 2024-09-19T08:47:17.124 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 50 root rtd unknown /proc/50/root (readlink: Permission denied) 2024-09-19T08:47:17.124 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 50 root txt unknown /proc/50/exe (readlink: Permission denied) 2024-09-19T08:47:17.124 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 50 root NOFD /proc/50/fd (opendir: Permission denied) 2024-09-19T08:47:17.124 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 52 root cwd unknown /proc/52/cwd (readlink: Permission denied) 2024-09-19T08:47:17.124 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 52 root rtd unknown /proc/52/root (readlink: Permission denied) 2024-09-19T08:47:17.124 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 52 root txt unknown /proc/52/exe (readlink: Permission denied) 2024-09-19T08:47:17.124 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 52 root NOFD /proc/52/fd (opendir: Permission denied) 2024-09-19T08:47:17.124 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/6 53 root cwd unknown /proc/53/cwd (readlink: Permission denied) 2024-09-19T08:47:17.124 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/6 53 root rtd unknown /proc/53/root (readlink: Permission denied) 2024-09-19T08:47:17.124 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/6 53 root txt unknown /proc/53/exe (readlink: Permission denied) 2024-09-19T08:47:17.124 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/6 53 root NOFD /proc/53/fd (opendir: Permission denied) 2024-09-19T08:47:17.125 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 54 root cwd unknown /proc/54/cwd (readlink: Permission denied) 2024-09-19T08:47:17.125 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 54 root rtd unknown /proc/54/root (readlink: Permission denied) 2024-09-19T08:47:17.125 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 54 root txt unknown /proc/54/exe (readlink: Permission denied) 2024-09-19T08:47:17.125 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 54 root NOFD /proc/54/fd (opendir: Permission denied) 2024-09-19T08:47:17.125 INFO:tasks.workunit.client.0.smithi007.stdout:migration 55 root cwd unknown /proc/55/cwd (readlink: Permission denied) 2024-09-19T08:47:17.125 INFO:tasks.workunit.client.0.smithi007.stdout:migration 55 root rtd unknown /proc/55/root (readlink: Permission denied) 2024-09-19T08:47:17.125 INFO:tasks.workunit.client.0.smithi007.stdout:migration 55 root txt unknown /proc/55/exe (readlink: Permission denied) 2024-09-19T08:47:17.125 INFO:tasks.workunit.client.0.smithi007.stdout:migration 55 root NOFD /proc/55/fd (opendir: Permission denied) 2024-09-19T08:47:17.125 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 56 root cwd unknown /proc/56/cwd (readlink: Permission denied) 2024-09-19T08:47:17.125 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 56 root rtd unknown /proc/56/root (readlink: Permission denied) 2024-09-19T08:47:17.125 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 56 root txt unknown /proc/56/exe (readlink: Permission denied) 2024-09-19T08:47:17.126 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 56 root NOFD /proc/56/fd (opendir: Permission denied) 2024-09-19T08:47:17.126 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 57 root cwd unknown /proc/57/cwd (readlink: Permission denied) 2024-09-19T08:47:17.126 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 57 root rtd unknown /proc/57/root (readlink: Permission denied) 2024-09-19T08:47:17.126 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 57 root txt unknown /proc/57/exe (readlink: Permission denied) 2024-09-19T08:47:17.126 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 57 root NOFD /proc/57/fd (opendir: Permission denied) 2024-09-19T08:47:17.126 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 58 root cwd unknown /proc/58/cwd (readlink: Permission denied) 2024-09-19T08:47:17.126 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 58 root rtd unknown /proc/58/root (readlink: Permission denied) 2024-09-19T08:47:17.126 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 58 root txt unknown /proc/58/exe (readlink: Permission denied) 2024-09-19T08:47:17.126 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 58 root NOFD /proc/58/fd (opendir: Permission denied) 2024-09-19T08:47:17.126 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/7 59 root cwd unknown /proc/59/cwd (readlink: Permission denied) 2024-09-19T08:47:17.126 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/7 59 root rtd unknown /proc/59/root (readlink: Permission denied) 2024-09-19T08:47:17.126 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/7 59 root txt unknown /proc/59/exe (readlink: Permission denied) 2024-09-19T08:47:17.127 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/7 59 root NOFD /proc/59/fd (opendir: Permission denied) 2024-09-19T08:47:17.127 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 60 root cwd unknown /proc/60/cwd (readlink: Permission denied) 2024-09-19T08:47:17.127 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 60 root rtd unknown /proc/60/root (readlink: Permission denied) 2024-09-19T08:47:17.127 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 60 root txt unknown /proc/60/exe (readlink: Permission denied) 2024-09-19T08:47:17.127 INFO:tasks.workunit.client.0.smithi007.stdout:idle_inje 60 root NOFD /proc/60/fd (opendir: Permission denied) 2024-09-19T08:47:17.127 INFO:tasks.workunit.client.0.smithi007.stdout:migration 61 root cwd unknown /proc/61/cwd (readlink: Permission denied) 2024-09-19T08:47:17.127 INFO:tasks.workunit.client.0.smithi007.stdout:migration 61 root rtd unknown /proc/61/root (readlink: Permission denied) 2024-09-19T08:47:17.127 INFO:tasks.workunit.client.0.smithi007.stdout:migration 61 root txt unknown /proc/61/exe (readlink: Permission denied) 2024-09-19T08:47:17.127 INFO:tasks.workunit.client.0.smithi007.stdout:migration 61 root NOFD /proc/61/fd (opendir: Permission denied) 2024-09-19T08:47:17.127 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 62 root cwd unknown /proc/62/cwd (readlink: Permission denied) 2024-09-19T08:47:17.127 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 62 root rtd unknown /proc/62/root (readlink: Permission denied) 2024-09-19T08:47:17.127 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 62 root txt unknown /proc/62/exe (readlink: Permission denied) 2024-09-19T08:47:17.128 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 62 root NOFD /proc/62/fd (opendir: Permission denied) 2024-09-19T08:47:17.128 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 64 root cwd unknown /proc/64/cwd (readlink: Permission denied) 2024-09-19T08:47:17.128 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 64 root rtd unknown /proc/64/root (readlink: Permission denied) 2024-09-19T08:47:17.128 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 64 root txt unknown /proc/64/exe (readlink: Permission denied) 2024-09-19T08:47:17.128 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 64 root NOFD /proc/64/fd (opendir: Permission denied) 2024-09-19T08:47:17.128 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 68 root cwd unknown /proc/68/cwd (readlink: Permission denied) 2024-09-19T08:47:17.128 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 68 root rtd unknown /proc/68/root (readlink: Permission denied) 2024-09-19T08:47:17.128 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 68 root txt unknown /proc/68/exe (readlink: Permission denied) 2024-09-19T08:47:17.128 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 68 root NOFD /proc/68/fd (opendir: Permission denied) 2024-09-19T08:47:17.128 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 69 root cwd unknown /proc/69/cwd (readlink: Permission denied) 2024-09-19T08:47:17.128 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 69 root rtd unknown /proc/69/root (readlink: Permission denied) 2024-09-19T08:47:17.128 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 69 root txt unknown /proc/69/exe (readlink: Permission denied) 2024-09-19T08:47:17.129 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 69 root NOFD /proc/69/fd (opendir: Permission denied) 2024-09-19T08:47:17.129 INFO:tasks.workunit.client.0.smithi007.stdout:kdevtmpfs 72 root cwd unknown /proc/72/cwd (readlink: Permission denied) 2024-09-19T08:47:17.129 INFO:tasks.workunit.client.0.smithi007.stdout:kdevtmpfs 72 root rtd unknown /proc/72/root (readlink: Permission denied) 2024-09-19T08:47:17.129 INFO:tasks.workunit.client.0.smithi007.stdout:kdevtmpfs 72 root txt unknown /proc/72/exe (readlink: Permission denied) 2024-09-19T08:47:17.129 INFO:tasks.workunit.client.0.smithi007.stdout:kdevtmpfs 72 root NOFD /proc/72/fd (opendir: Permission denied) 2024-09-19T08:47:17.129 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 73 root cwd unknown /proc/73/cwd (readlink: Permission denied) 2024-09-19T08:47:17.129 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 73 root rtd unknown /proc/73/root (readlink: Permission denied) 2024-09-19T08:47:17.129 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 73 root txt unknown /proc/73/exe (readlink: Permission denied) 2024-09-19T08:47:17.129 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 73 root NOFD /proc/73/fd (opendir: Permission denied) 2024-09-19T08:47:17.129 INFO:tasks.workunit.client.0.smithi007.stdout:kauditd 74 root cwd unknown /proc/74/cwd (readlink: Permission denied) 2024-09-19T08:47:17.129 INFO:tasks.workunit.client.0.smithi007.stdout:kauditd 74 root rtd unknown /proc/74/root (readlink: Permission denied) 2024-09-19T08:47:17.129 INFO:tasks.workunit.client.0.smithi007.stdout:kauditd 74 root txt unknown /proc/74/exe (readlink: Permission denied) 2024-09-19T08:47:17.129 INFO:tasks.workunit.client.0.smithi007.stdout:kauditd 74 root NOFD /proc/74/fd (opendir: Permission denied) 2024-09-19T08:47:17.130 INFO:tasks.workunit.client.0.smithi007.stdout:khungtask 76 root cwd unknown /proc/76/cwd (readlink: Permission denied) 2024-09-19T08:47:17.130 INFO:tasks.workunit.client.0.smithi007.stdout:khungtask 76 root rtd unknown /proc/76/root (readlink: Permission denied) 2024-09-19T08:47:17.130 INFO:tasks.workunit.client.0.smithi007.stdout:khungtask 76 root txt unknown /proc/76/exe (readlink: Permission denied) 2024-09-19T08:47:17.130 INFO:tasks.workunit.client.0.smithi007.stdout:khungtask 76 root NOFD /proc/76/fd (opendir: Permission denied) 2024-09-19T08:47:17.130 INFO:tasks.workunit.client.0.smithi007.stdout:oom_reape 77 root cwd unknown /proc/77/cwd (readlink: Permission denied) 2024-09-19T08:47:17.130 INFO:tasks.workunit.client.0.smithi007.stdout:oom_reape 77 root rtd unknown /proc/77/root (readlink: Permission denied) 2024-09-19T08:47:17.130 INFO:tasks.workunit.client.0.smithi007.stdout:oom_reape 77 root txt unknown /proc/77/exe (readlink: Permission denied) 2024-09-19T08:47:17.130 INFO:tasks.workunit.client.0.smithi007.stdout:oom_reape 77 root NOFD /proc/77/fd (opendir: Permission denied) 2024-09-19T08:47:17.130 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 78 root cwd unknown /proc/78/cwd (readlink: Permission denied) 2024-09-19T08:47:17.130 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 78 root rtd unknown /proc/78/root (readlink: Permission denied) 2024-09-19T08:47:17.130 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 78 root txt unknown /proc/78/exe (readlink: Permission denied) 2024-09-19T08:47:17.130 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 78 root NOFD /proc/78/fd (opendir: Permission denied) 2024-09-19T08:47:17.131 INFO:tasks.workunit.client.0.smithi007.stdout:kcompactd 79 root cwd unknown /proc/79/cwd (readlink: Permission denied) 2024-09-19T08:47:17.131 INFO:tasks.workunit.client.0.smithi007.stdout:kcompactd 79 root rtd unknown /proc/79/root (readlink: Permission denied) 2024-09-19T08:47:17.131 INFO:tasks.workunit.client.0.smithi007.stdout:kcompactd 79 root txt unknown /proc/79/exe (readlink: Permission denied) 2024-09-19T08:47:17.131 INFO:tasks.workunit.client.0.smithi007.stdout:kcompactd 79 root NOFD /proc/79/fd (opendir: Permission denied) 2024-09-19T08:47:17.131 INFO:tasks.workunit.client.0.smithi007.stdout:ksmd 80 root cwd unknown /proc/80/cwd (readlink: Permission denied) 2024-09-19T08:47:17.131 INFO:tasks.workunit.client.0.smithi007.stdout:ksmd 80 root rtd unknown /proc/80/root (readlink: Permission denied) 2024-09-19T08:47:17.131 INFO:tasks.workunit.client.0.smithi007.stdout:ksmd 80 root txt unknown /proc/80/exe (readlink: Permission denied) 2024-09-19T08:47:17.131 INFO:tasks.workunit.client.0.smithi007.stdout:ksmd 80 root NOFD /proc/80/fd (opendir: Permission denied) 2024-09-19T08:47:17.131 INFO:tasks.workunit.client.0.smithi007.stdout:khugepage 81 root cwd unknown /proc/81/cwd (readlink: Permission denied) 2024-09-19T08:47:17.131 INFO:tasks.workunit.client.0.smithi007.stdout:khugepage 81 root rtd unknown /proc/81/root (readlink: Permission denied) 2024-09-19T08:47:17.131 INFO:tasks.workunit.client.0.smithi007.stdout:khugepage 81 root txt unknown /proc/81/exe (readlink: Permission denied) 2024-09-19T08:47:17.131 INFO:tasks.workunit.client.0.smithi007.stdout:khugepage 81 root NOFD /proc/81/fd (opendir: Permission denied) 2024-09-19T08:47:17.132 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 82 root cwd unknown /proc/82/cwd (readlink: Permission denied) 2024-09-19T08:47:17.132 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 82 root rtd unknown /proc/82/root (readlink: Permission denied) 2024-09-19T08:47:17.132 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 82 root txt unknown /proc/82/exe (readlink: Permission denied) 2024-09-19T08:47:17.132 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 82 root NOFD /proc/82/fd (opendir: Permission denied) 2024-09-19T08:47:17.132 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 83 root cwd unknown /proc/83/cwd (readlink: Permission denied) 2024-09-19T08:47:17.132 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 83 root rtd unknown /proc/83/root (readlink: Permission denied) 2024-09-19T08:47:17.132 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 83 root txt unknown /proc/83/exe (readlink: Permission denied) 2024-09-19T08:47:17.132 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 83 root NOFD /proc/83/fd (opendir: Permission denied) 2024-09-19T08:47:17.132 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 84 root cwd unknown /proc/84/cwd (readlink: Permission denied) 2024-09-19T08:47:17.132 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 84 root rtd unknown /proc/84/root (readlink: Permission denied) 2024-09-19T08:47:17.132 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 84 root txt unknown /proc/84/exe (readlink: Permission denied) 2024-09-19T08:47:17.133 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 84 root NOFD /proc/84/fd (opendir: Permission denied) 2024-09-19T08:47:17.133 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 85 root cwd unknown /proc/85/cwd (readlink: Permission denied) 2024-09-19T08:47:17.133 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 85 root rtd unknown /proc/85/root (readlink: Permission denied) 2024-09-19T08:47:17.137 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 85 root txt unknown /proc/85/exe (readlink: Permission denied) 2024-09-19T08:47:17.137 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 85 root NOFD /proc/85/fd (opendir: Permission denied) 2024-09-19T08:47:17.137 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 86 root cwd unknown /proc/86/cwd (readlink: Permission denied) 2024-09-19T08:47:17.137 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 86 root rtd unknown /proc/86/root (readlink: Permission denied) 2024-09-19T08:47:17.138 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 86 root txt unknown /proc/86/exe (readlink: Permission denied) 2024-09-19T08:47:17.138 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 86 root NOFD /proc/86/fd (opendir: Permission denied) 2024-09-19T08:47:17.138 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 87 root cwd unknown /proc/87/cwd (readlink: Permission denied) 2024-09-19T08:47:17.138 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 87 root rtd unknown /proc/87/root (readlink: Permission denied) 2024-09-19T08:47:17.138 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 87 root txt unknown /proc/87/exe (readlink: Permission denied) 2024-09-19T08:47:17.138 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 87 root NOFD /proc/87/fd (opendir: Permission denied) 2024-09-19T08:47:17.138 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 88 root cwd unknown /proc/88/cwd (readlink: Permission denied) 2024-09-19T08:47:17.138 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 88 root rtd unknown /proc/88/root (readlink: Permission denied) 2024-09-19T08:47:17.138 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 88 root txt unknown /proc/88/exe (readlink: Permission denied) 2024-09-19T08:47:17.138 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 88 root NOFD /proc/88/fd (opendir: Permission denied) 2024-09-19T08:47:17.139 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 89 root cwd unknown /proc/89/cwd (readlink: Permission denied) 2024-09-19T08:47:17.139 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 89 root rtd unknown /proc/89/root (readlink: Permission denied) 2024-09-19T08:47:17.139 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 89 root txt unknown /proc/89/exe (readlink: Permission denied) 2024-09-19T08:47:17.139 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 89 root NOFD /proc/89/fd (opendir: Permission denied) 2024-09-19T08:47:17.139 INFO:tasks.workunit.client.0.smithi007.stdout:watchdogd 90 root cwd unknown /proc/90/cwd (readlink: Permission denied) 2024-09-19T08:47:17.139 INFO:tasks.workunit.client.0.smithi007.stdout:watchdogd 90 root rtd unknown /proc/90/root (readlink: Permission denied) 2024-09-19T08:47:17.139 INFO:tasks.workunit.client.0.smithi007.stdout:watchdogd 90 root txt unknown /proc/90/exe (readlink: Permission denied) 2024-09-19T08:47:17.139 INFO:tasks.workunit.client.0.smithi007.stdout:watchdogd 90 root NOFD /proc/90/fd (opendir: Permission denied) 2024-09-19T08:47:17.139 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 92 root cwd unknown /proc/92/cwd (readlink: Permission denied) 2024-09-19T08:47:17.139 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 92 root rtd unknown /proc/92/root (readlink: Permission denied) 2024-09-19T08:47:17.139 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 92 root txt unknown /proc/92/exe (readlink: Permission denied) 2024-09-19T08:47:17.139 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 92 root NOFD /proc/92/fd (opendir: Permission denied) 2024-09-19T08:47:17.139 INFO:tasks.workunit.client.0.smithi007.stdout:kswapd0 94 root cwd unknown /proc/94/cwd (readlink: Permission denied) 2024-09-19T08:47:17.139 INFO:tasks.workunit.client.0.smithi007.stdout:kswapd0 94 root rtd unknown /proc/94/root (readlink: Permission denied) 2024-09-19T08:47:17.140 INFO:tasks.workunit.client.0.smithi007.stdout:kswapd0 94 root txt unknown /proc/94/exe (readlink: Permission denied) 2024-09-19T08:47:17.140 INFO:tasks.workunit.client.0.smithi007.stdout:kswapd0 94 root NOFD /proc/94/fd (opendir: Permission denied) 2024-09-19T08:47:17.140 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 100 root cwd unknown /proc/100/cwd (readlink: Permission denied) 2024-09-19T08:47:17.140 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 100 root rtd unknown /proc/100/root (readlink: Permission denied) 2024-09-19T08:47:17.140 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 100 root txt unknown /proc/100/exe (readlink: Permission denied) 2024-09-19T08:47:17.140 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 100 root NOFD /proc/100/fd (opendir: Permission denied) 2024-09-19T08:47:17.140 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 108 root cwd unknown /proc/108/cwd (readlink: Permission denied) 2024-09-19T08:47:17.140 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 108 root rtd unknown /proc/108/root (readlink: Permission denied) 2024-09-19T08:47:17.140 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 108 root txt unknown /proc/108/exe (readlink: Permission denied) 2024-09-19T08:47:17.140 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 108 root NOFD /proc/108/fd (opendir: Permission denied) 2024-09-19T08:47:17.140 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 111 root cwd unknown /proc/111/cwd (readlink: Permission denied) 2024-09-19T08:47:17.140 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 111 root rtd unknown /proc/111/root (readlink: Permission denied) 2024-09-19T08:47:17.140 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 111 root txt unknown /proc/111/exe (readlink: Permission denied) 2024-09-19T08:47:17.141 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 111 root NOFD /proc/111/fd (opendir: Permission denied) 2024-09-19T08:47:17.141 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 112 root cwd unknown /proc/112/cwd (readlink: Permission denied) 2024-09-19T08:47:17.141 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 112 root rtd unknown /proc/112/root (readlink: Permission denied) 2024-09-19T08:47:17.141 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 112 root txt unknown /proc/112/exe (readlink: Permission denied) 2024-09-19T08:47:17.141 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 112 root NOFD /proc/112/fd (opendir: Permission denied) 2024-09-19T08:47:17.141 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 113 root cwd unknown /proc/113/cwd (readlink: Permission denied) 2024-09-19T08:47:17.141 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 113 root rtd unknown /proc/113/root (readlink: Permission denied) 2024-09-19T08:47:17.141 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 113 root txt unknown /proc/113/exe (readlink: Permission denied) 2024-09-19T08:47:17.141 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 113 root NOFD /proc/113/fd (opendir: Permission denied) 2024-09-19T08:47:17.141 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 114 root cwd unknown /proc/114/cwd (readlink: Permission denied) 2024-09-19T08:47:17.141 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 114 root rtd unknown /proc/114/root (readlink: Permission denied) 2024-09-19T08:47:17.141 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 114 root txt unknown /proc/114/exe (readlink: Permission denied) 2024-09-19T08:47:17.142 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 114 root NOFD /proc/114/fd (opendir: Permission denied) 2024-09-19T08:47:17.142 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 115 root cwd unknown /proc/115/cwd (readlink: Permission denied) 2024-09-19T08:47:17.142 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 115 root rtd unknown /proc/115/root (readlink: Permission denied) 2024-09-19T08:47:17.142 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 115 root txt unknown /proc/115/exe (readlink: Permission denied) 2024-09-19T08:47:17.142 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 115 root NOFD /proc/115/fd (opendir: Permission denied) 2024-09-19T08:47:17.142 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 116 root cwd unknown /proc/116/cwd (readlink: Permission denied) 2024-09-19T08:47:17.142 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 116 root rtd unknown /proc/116/root (readlink: Permission denied) 2024-09-19T08:47:17.142 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 116 root txt unknown /proc/116/exe (readlink: Permission denied) 2024-09-19T08:47:17.142 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 116 root NOFD /proc/116/fd (opendir: Permission denied) 2024-09-19T08:47:17.142 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 125 root cwd unknown /proc/125/cwd (readlink: Permission denied) 2024-09-19T08:47:17.142 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 125 root rtd unknown /proc/125/root (readlink: Permission denied) 2024-09-19T08:47:17.142 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 125 root txt unknown /proc/125/exe (readlink: Permission denied) 2024-09-19T08:47:17.142 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 125 root NOFD /proc/125/fd (opendir: Permission denied) 2024-09-19T08:47:17.143 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 238 root cwd unknown /proc/238/cwd (readlink: Permission denied) 2024-09-19T08:47:17.143 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 238 root rtd unknown /proc/238/root (readlink: Permission denied) 2024-09-19T08:47:17.143 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 238 root txt unknown /proc/238/exe (readlink: Permission denied) 2024-09-19T08:47:17.143 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 238 root NOFD /proc/238/fd (opendir: Permission denied) 2024-09-19T08:47:17.143 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 239 root cwd unknown /proc/239/cwd (readlink: Permission denied) 2024-09-19T08:47:17.143 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 239 root rtd unknown /proc/239/root (readlink: Permission denied) 2024-09-19T08:47:17.143 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 239 root txt unknown /proc/239/exe (readlink: Permission denied) 2024-09-19T08:47:17.143 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 239 root NOFD /proc/239/fd (opendir: Permission denied) 2024-09-19T08:47:17.143 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 241 root cwd unknown /proc/241/cwd (readlink: Permission denied) 2024-09-19T08:47:17.143 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 241 root rtd unknown /proc/241/root (readlink: Permission denied) 2024-09-19T08:47:17.143 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 241 root txt unknown /proc/241/exe (readlink: Permission denied) 2024-09-19T08:47:17.143 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 241 root NOFD /proc/241/fd (opendir: Permission denied) 2024-09-19T08:47:17.143 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 280 root cwd unknown /proc/280/cwd (readlink: Permission denied) 2024-09-19T08:47:17.144 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 280 root rtd unknown /proc/280/root (readlink: Permission denied) 2024-09-19T08:47:17.144 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 280 root txt unknown /proc/280/exe (readlink: Permission denied) 2024-09-19T08:47:17.144 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 280 root NOFD /proc/280/fd (opendir: Permission denied) 2024-09-19T08:47:17.144 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 282 root cwd unknown /proc/282/cwd (readlink: Permission denied) 2024-09-19T08:47:17.144 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 282 root rtd unknown /proc/282/root (readlink: Permission denied) 2024-09-19T08:47:17.144 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 282 root txt unknown /proc/282/exe (readlink: Permission denied) 2024-09-19T08:47:17.144 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 282 root NOFD /proc/282/fd (opendir: Permission denied) 2024-09-19T08:47:17.144 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 285 root cwd unknown /proc/285/cwd (readlink: Permission denied) 2024-09-19T08:47:17.144 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 285 root rtd unknown /proc/285/root (readlink: Permission denied) 2024-09-19T08:47:17.144 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 285 root txt unknown /proc/285/exe (readlink: Permission denied) 2024-09-19T08:47:17.144 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 285 root NOFD /proc/285/fd (opendir: Permission denied) 2024-09-19T08:47:17.144 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 288 root cwd unknown /proc/288/cwd (readlink: Permission denied) 2024-09-19T08:47:17.144 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 288 root rtd unknown /proc/288/root (readlink: Permission denied) 2024-09-19T08:47:17.144 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 288 root txt unknown /proc/288/exe (readlink: Permission denied) 2024-09-19T08:47:17.145 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 288 root NOFD /proc/288/fd (opendir: Permission denied) 2024-09-19T08:47:17.145 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 363 root cwd unknown /proc/363/cwd (readlink: Permission denied) 2024-09-19T08:47:17.145 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 363 root rtd unknown /proc/363/root (readlink: Permission denied) 2024-09-19T08:47:17.145 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 363 root txt unknown /proc/363/exe (readlink: Permission denied) 2024-09-19T08:47:17.145 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 363 root NOFD /proc/363/fd (opendir: Permission denied) 2024-09-19T08:47:17.145 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 429 root cwd unknown /proc/429/cwd (readlink: Permission denied) 2024-09-19T08:47:17.145 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 429 root rtd unknown /proc/429/root (readlink: Permission denied) 2024-09-19T08:47:17.145 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 429 root txt unknown /proc/429/exe (readlink: Permission denied) 2024-09-19T08:47:17.145 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 429 root NOFD /proc/429/fd (opendir: Permission denied) 2024-09-19T08:47:17.145 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 431 root cwd unknown /proc/431/cwd (readlink: Permission denied) 2024-09-19T08:47:17.145 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 431 root rtd unknown /proc/431/root (readlink: Permission denied) 2024-09-19T08:47:17.145 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 431 root txt unknown /proc/431/exe (readlink: Permission denied) 2024-09-19T08:47:17.145 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 431 root NOFD /proc/431/fd (opendir: Permission denied) 2024-09-19T08:47:17.146 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 433 root cwd unknown /proc/433/cwd (readlink: Permission denied) 2024-09-19T08:47:17.146 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 433 root rtd unknown /proc/433/root (readlink: Permission denied) 2024-09-19T08:47:17.146 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 433 root txt unknown /proc/433/exe (readlink: Permission denied) 2024-09-19T08:47:17.146 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 433 root NOFD /proc/433/fd (opendir: Permission denied) 2024-09-19T08:47:17.146 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 436 root cwd unknown /proc/436/cwd (readlink: Permission denied) 2024-09-19T08:47:17.146 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 436 root rtd unknown /proc/436/root (readlink: Permission denied) 2024-09-19T08:47:17.146 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 436 root txt unknown /proc/436/exe (readlink: Permission denied) 2024-09-19T08:47:17.146 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 436 root NOFD /proc/436/fd (opendir: Permission denied) 2024-09-19T08:47:17.146 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 437 root cwd unknown /proc/437/cwd (readlink: Permission denied) 2024-09-19T08:47:17.146 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 437 root rtd unknown /proc/437/root (readlink: Permission denied) 2024-09-19T08:47:17.146 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 437 root txt unknown /proc/437/exe (readlink: Permission denied) 2024-09-19T08:47:17.146 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 437 root NOFD /proc/437/fd (opendir: Permission denied) 2024-09-19T08:47:17.146 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 442 root cwd unknown /proc/442/cwd (readlink: Permission denied) 2024-09-19T08:47:17.147 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 442 root rtd unknown /proc/442/root (readlink: Permission denied) 2024-09-19T08:47:17.147 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 442 root txt unknown /proc/442/exe (readlink: Permission denied) 2024-09-19T08:47:17.147 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 442 root NOFD /proc/442/fd (opendir: Permission denied) 2024-09-19T08:47:17.147 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_0 445 root cwd unknown /proc/445/cwd (readlink: Permission denied) 2024-09-19T08:47:17.147 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_0 445 root rtd unknown /proc/445/root (readlink: Permission denied) 2024-09-19T08:47:17.147 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_0 445 root txt unknown /proc/445/exe (readlink: Permission denied) 2024-09-19T08:47:17.147 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_0 445 root NOFD /proc/445/fd (opendir: Permission denied) 2024-09-19T08:47:17.147 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 446 root cwd unknown /proc/446/cwd (readlink: Permission denied) 2024-09-19T08:47:17.147 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 446 root rtd unknown /proc/446/root (readlink: Permission denied) 2024-09-19T08:47:17.147 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 446 root txt unknown /proc/446/exe (readlink: Permission denied) 2024-09-19T08:47:17.147 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 446 root NOFD /proc/446/fd (opendir: Permission denied) 2024-09-19T08:47:17.147 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_1 447 root cwd unknown /proc/447/cwd (readlink: Permission denied) 2024-09-19T08:47:17.147 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_1 447 root rtd unknown /proc/447/root (readlink: Permission denied) 2024-09-19T08:47:17.148 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_1 447 root txt unknown /proc/447/exe (readlink: Permission denied) 2024-09-19T08:47:17.148 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_1 447 root NOFD /proc/447/fd (opendir: Permission denied) 2024-09-19T08:47:17.148 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 448 root cwd unknown /proc/448/cwd (readlink: Permission denied) 2024-09-19T08:47:17.148 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 448 root rtd unknown /proc/448/root (readlink: Permission denied) 2024-09-19T08:47:17.148 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 448 root txt unknown /proc/448/exe (readlink: Permission denied) 2024-09-19T08:47:17.148 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 448 root NOFD /proc/448/fd (opendir: Permission denied) 2024-09-19T08:47:17.148 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_2 449 root cwd unknown /proc/449/cwd (readlink: Permission denied) 2024-09-19T08:47:17.148 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_2 449 root rtd unknown /proc/449/root (readlink: Permission denied) 2024-09-19T08:47:17.148 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_2 449 root txt unknown /proc/449/exe (readlink: Permission denied) 2024-09-19T08:47:17.148 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_2 449 root NOFD /proc/449/fd (opendir: Permission denied) 2024-09-19T08:47:17.148 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 450 root cwd unknown /proc/450/cwd (readlink: Permission denied) 2024-09-19T08:47:17.148 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 450 root rtd unknown /proc/450/root (readlink: Permission denied) 2024-09-19T08:47:17.148 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 450 root txt unknown /proc/450/exe (readlink: Permission denied) 2024-09-19T08:47:17.149 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 450 root NOFD /proc/450/fd (opendir: Permission denied) 2024-09-19T08:47:17.149 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_3 451 root cwd unknown /proc/451/cwd (readlink: Permission denied) 2024-09-19T08:47:17.149 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_3 451 root rtd unknown /proc/451/root (readlink: Permission denied) 2024-09-19T08:47:17.149 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_3 451 root txt unknown /proc/451/exe (readlink: Permission denied) 2024-09-19T08:47:17.149 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_3 451 root NOFD /proc/451/fd (opendir: Permission denied) 2024-09-19T08:47:17.149 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 452 root cwd unknown /proc/452/cwd (readlink: Permission denied) 2024-09-19T08:47:17.149 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 452 root rtd unknown /proc/452/root (readlink: Permission denied) 2024-09-19T08:47:17.149 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 452 root txt unknown /proc/452/exe (readlink: Permission denied) 2024-09-19T08:47:17.149 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 452 root NOFD /proc/452/fd (opendir: Permission denied) 2024-09-19T08:47:17.149 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_4 456 root cwd unknown /proc/456/cwd (readlink: Permission denied) 2024-09-19T08:47:17.149 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_4 456 root rtd unknown /proc/456/root (readlink: Permission denied) 2024-09-19T08:47:17.149 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_4 456 root txt unknown /proc/456/exe (readlink: Permission denied) 2024-09-19T08:47:17.149 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_4 456 root NOFD /proc/456/fd (opendir: Permission denied) 2024-09-19T08:47:17.149 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 457 root cwd unknown /proc/457/cwd (readlink: Permission denied) 2024-09-19T08:47:17.150 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 457 root rtd unknown /proc/457/root (readlink: Permission denied) 2024-09-19T08:47:17.150 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 457 root txt unknown /proc/457/exe (readlink: Permission denied) 2024-09-19T08:47:17.150 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 457 root NOFD /proc/457/fd (opendir: Permission denied) 2024-09-19T08:47:17.150 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_5 458 root cwd unknown /proc/458/cwd (readlink: Permission denied) 2024-09-19T08:47:17.150 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_5 458 root rtd unknown /proc/458/root (readlink: Permission denied) 2024-09-19T08:47:17.150 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_5 458 root txt unknown /proc/458/exe (readlink: Permission denied) 2024-09-19T08:47:17.150 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_5 458 root NOFD /proc/458/fd (opendir: Permission denied) 2024-09-19T08:47:17.150 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 459 root cwd unknown /proc/459/cwd (readlink: Permission denied) 2024-09-19T08:47:17.150 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 459 root rtd unknown /proc/459/root (readlink: Permission denied) 2024-09-19T08:47:17.150 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 459 root txt unknown /proc/459/exe (readlink: Permission denied) 2024-09-19T08:47:17.150 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 459 root NOFD /proc/459/fd (opendir: Permission denied) 2024-09-19T08:47:17.150 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_6 460 root cwd unknown /proc/460/cwd (readlink: Permission denied) 2024-09-19T08:47:17.151 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_6 460 root rtd unknown /proc/460/root (readlink: Permission denied) 2024-09-19T08:47:17.151 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_6 460 root txt unknown /proc/460/exe (readlink: Permission denied) 2024-09-19T08:47:17.151 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_6 460 root NOFD /proc/460/fd (opendir: Permission denied) 2024-09-19T08:47:17.151 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 461 root cwd unknown /proc/461/cwd (readlink: Permission denied) 2024-09-19T08:47:17.151 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 461 root rtd unknown /proc/461/root (readlink: Permission denied) 2024-09-19T08:47:17.151 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 461 root txt unknown /proc/461/exe (readlink: Permission denied) 2024-09-19T08:47:17.151 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 461 root NOFD /proc/461/fd (opendir: Permission denied) 2024-09-19T08:47:17.151 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_7 462 root cwd unknown /proc/462/cwd (readlink: Permission denied) 2024-09-19T08:47:17.151 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_7 462 root rtd unknown /proc/462/root (readlink: Permission denied) 2024-09-19T08:47:17.151 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_7 462 root txt unknown /proc/462/exe (readlink: Permission denied) 2024-09-19T08:47:17.151 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_7 462 root NOFD /proc/462/fd (opendir: Permission denied) 2024-09-19T08:47:17.151 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 463 root cwd unknown /proc/463/cwd (readlink: Permission denied) 2024-09-19T08:47:17.151 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 463 root rtd unknown /proc/463/root (readlink: Permission denied) 2024-09-19T08:47:17.151 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 463 root txt unknown /proc/463/exe (readlink: Permission denied) 2024-09-19T08:47:17.152 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 463 root NOFD /proc/463/fd (opendir: Permission denied) 2024-09-19T08:47:17.152 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_8 464 root cwd unknown /proc/464/cwd (readlink: Permission denied) 2024-09-19T08:47:17.152 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_8 464 root rtd unknown /proc/464/root (readlink: Permission denied) 2024-09-19T08:47:17.152 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_8 464 root txt unknown /proc/464/exe (readlink: Permission denied) 2024-09-19T08:47:17.152 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_8 464 root NOFD /proc/464/fd (opendir: Permission denied) 2024-09-19T08:47:17.152 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 465 root cwd unknown /proc/465/cwd (readlink: Permission denied) 2024-09-19T08:47:17.152 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 465 root rtd unknown /proc/465/root (readlink: Permission denied) 2024-09-19T08:47:17.152 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 465 root txt unknown /proc/465/exe (readlink: Permission denied) 2024-09-19T08:47:17.152 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 465 root NOFD /proc/465/fd (opendir: Permission denied) 2024-09-19T08:47:17.152 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_9 466 root cwd unknown /proc/466/cwd (readlink: Permission denied) 2024-09-19T08:47:17.152 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_9 466 root rtd unknown /proc/466/root (readlink: Permission denied) 2024-09-19T08:47:17.152 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_9 466 root txt unknown /proc/466/exe (readlink: Permission denied) 2024-09-19T08:47:17.152 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_9 466 root NOFD /proc/466/fd (opendir: Permission denied) 2024-09-19T08:47:17.153 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 467 root cwd unknown /proc/467/cwd (readlink: Permission denied) 2024-09-19T08:47:17.153 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 467 root rtd unknown /proc/467/root (readlink: Permission denied) 2024-09-19T08:47:17.153 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 467 root txt unknown /proc/467/exe (readlink: Permission denied) 2024-09-19T08:47:17.153 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 467 root NOFD /proc/467/fd (opendir: Permission denied) 2024-09-19T08:47:17.153 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 469 root cwd unknown /proc/469/cwd (readlink: Permission denied) 2024-09-19T08:47:17.153 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 469 root rtd unknown /proc/469/root (readlink: Permission denied) 2024-09-19T08:47:17.153 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 469 root txt unknown /proc/469/exe (readlink: Permission denied) 2024-09-19T08:47:17.153 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 469 root NOFD /proc/469/fd (opendir: Permission denied) 2024-09-19T08:47:17.153 INFO:tasks.workunit.client.0.smithi007.stdout:jbd2/sda1 502 root cwd unknown /proc/502/cwd (readlink: Permission denied) 2024-09-19T08:47:17.153 INFO:tasks.workunit.client.0.smithi007.stdout:jbd2/sda1 502 root rtd unknown /proc/502/root (readlink: Permission denied) 2024-09-19T08:47:17.153 INFO:tasks.workunit.client.0.smithi007.stdout:jbd2/sda1 502 root txt unknown /proc/502/exe (readlink: Permission denied) 2024-09-19T08:47:17.153 INFO:tasks.workunit.client.0.smithi007.stdout:jbd2/sda1 502 root NOFD /proc/502/fd (opendir: Permission denied) 2024-09-19T08:47:17.153 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 503 root cwd unknown /proc/503/cwd (readlink: Permission denied) 2024-09-19T08:47:17.154 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 503 root rtd unknown /proc/503/root (readlink: Permission denied) 2024-09-19T08:47:17.154 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 503 root txt unknown /proc/503/exe (readlink: Permission denied) 2024-09-19T08:47:17.154 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 503 root NOFD /proc/503/fd (opendir: Permission denied) 2024-09-19T08:47:17.154 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-j 578 root cwd unknown /proc/578/cwd (readlink: Permission denied) 2024-09-19T08:47:17.154 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-j 578 root rtd unknown /proc/578/root (readlink: Permission denied) 2024-09-19T08:47:17.154 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-j 578 root txt unknown /proc/578/exe (readlink: Permission denied) 2024-09-19T08:47:17.154 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-j 578 root NOFD /proc/578/fd (opendir: Permission denied) 2024-09-19T08:47:17.154 INFO:tasks.workunit.client.0.smithi007.stdout:ext4lazyi 587 root cwd unknown /proc/587/cwd (readlink: Permission denied) 2024-09-19T08:47:17.154 INFO:tasks.workunit.client.0.smithi007.stdout:ext4lazyi 587 root rtd unknown /proc/587/root (readlink: Permission denied) 2024-09-19T08:47:17.154 INFO:tasks.workunit.client.0.smithi007.stdout:ext4lazyi 587 root txt unknown /proc/587/exe (readlink: Permission denied) 2024-09-19T08:47:17.154 INFO:tasks.workunit.client.0.smithi007.stdout:ext4lazyi 587 root NOFD /proc/587/fd (opendir: Permission denied) 2024-09-19T08:47:17.154 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-u 593 root cwd unknown /proc/593/cwd (readlink: Permission denied) 2024-09-19T08:47:17.154 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-u 593 root rtd unknown /proc/593/root (readlink: Permission denied) 2024-09-19T08:47:17.155 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-u 593 root txt unknown /proc/593/exe (readlink: Permission denied) 2024-09-19T08:47:17.155 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-u 593 root NOFD /proc/593/fd (opendir: Permission denied) 2024-09-19T08:47:17.155 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 644 root cwd unknown /proc/644/cwd (readlink: Permission denied) 2024-09-19T08:47:17.155 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 644 root rtd unknown /proc/644/root (readlink: Permission denied) 2024-09-19T08:47:17.155 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 644 root txt unknown /proc/644/exe (readlink: Permission denied) 2024-09-19T08:47:17.155 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 644 root NOFD /proc/644/fd (opendir: Permission denied) 2024-09-19T08:47:17.155 INFO:tasks.workunit.client.0.smithi007.stdout:kipmi0 654 root cwd unknown /proc/654/cwd (readlink: Permission denied) 2024-09-19T08:47:17.155 INFO:tasks.workunit.client.0.smithi007.stdout:kipmi0 654 root rtd unknown /proc/654/root (readlink: Permission denied) 2024-09-19T08:47:17.155 INFO:tasks.workunit.client.0.smithi007.stdout:kipmi0 654 root txt unknown /proc/654/exe (readlink: Permission denied) 2024-09-19T08:47:17.155 INFO:tasks.workunit.client.0.smithi007.stdout:kipmi0 654 root NOFD /proc/654/fd (opendir: Permission denied) 2024-09-19T08:47:17.156 INFO:tasks.workunit.client.0.smithi007.stdout:rpcbind 665 rpc cwd unknown /proc/665/cwd (readlink: Permission denied) 2024-09-19T08:47:17.156 INFO:tasks.workunit.client.0.smithi007.stdout:rpcbind 665 rpc rtd unknown /proc/665/root (readlink: Permission denied) 2024-09-19T08:47:17.156 INFO:tasks.workunit.client.0.smithi007.stdout:rpcbind 665 rpc txt unknown /proc/665/exe (readlink: Permission denied) 2024-09-19T08:47:17.156 INFO:tasks.workunit.client.0.smithi007.stdout:rpcbind 665 rpc NOFD /proc/665/fd (opendir: Permission denied) 2024-09-19T08:47:17.156 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 671 root cwd unknown /proc/671/cwd (readlink: Permission denied) 2024-09-19T08:47:17.156 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 671 root rtd unknown /proc/671/root (readlink: Permission denied) 2024-09-19T08:47:17.156 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 671 root txt unknown /proc/671/exe (readlink: Permission denied) 2024-09-19T08:47:17.156 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 671 root NOFD /proc/671/fd (opendir: Permission denied) 2024-09-19T08:47:17.156 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 672 root cwd unknown /proc/672/cwd (readlink: Permission denied) 2024-09-19T08:47:17.157 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 672 root rtd unknown /proc/672/root (readlink: Permission denied) 2024-09-19T08:47:17.157 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 672 root txt unknown /proc/672/exe (readlink: Permission denied) 2024-09-19T08:47:17.157 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 672 root NOFD /proc/672/fd (opendir: Permission denied) 2024-09-19T08:47:17.157 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 673 root cwd unknown /proc/673/cwd (readlink: Permission denied) 2024-09-19T08:47:17.157 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 673 root rtd unknown /proc/673/root (readlink: Permission denied) 2024-09-19T08:47:17.157 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 673 root txt unknown /proc/673/exe (readlink: Permission denied) 2024-09-19T08:47:17.157 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 673 root NOFD /proc/673/fd (opendir: Permission denied) 2024-09-19T08:47:17.157 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 673 674 auditd root cwd unknown /proc/673/task/674/cwd (readlink: Permission denied) 2024-09-19T08:47:17.157 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 673 674 auditd root rtd unknown /proc/673/task/674/root (readlink: Permission denied) 2024-09-19T08:47:17.157 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 673 674 auditd root txt unknown /proc/673/task/674/exe (readlink: Permission denied) 2024-09-19T08:47:17.157 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 673 674 auditd root NOFD /proc/673/task/674/fd (opendir: Permission denied) 2024-09-19T08:47:17.157 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 673 678 auditd root cwd unknown /proc/673/task/678/cwd (readlink: Permission denied) 2024-09-19T08:47:17.157 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 673 678 auditd root rtd unknown /proc/673/task/678/root (readlink: Permission denied) 2024-09-19T08:47:17.157 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 673 678 auditd root txt unknown /proc/673/task/678/exe (readlink: Permission denied) 2024-09-19T08:47:17.158 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 673 678 auditd root NOFD /proc/673/task/678/fd (opendir: Permission denied) 2024-09-19T08:47:17.158 INFO:tasks.workunit.client.0.smithi007.stdout:sedispatc 677 root cwd unknown /proc/677/cwd (readlink: Permission denied) 2024-09-19T08:47:17.158 INFO:tasks.workunit.client.0.smithi007.stdout:sedispatc 677 root rtd unknown /proc/677/root (readlink: Permission denied) 2024-09-19T08:47:17.158 INFO:tasks.workunit.client.0.smithi007.stdout:sedispatc 677 root txt unknown /proc/677/exe (readlink: Permission denied) 2024-09-19T08:47:17.158 INFO:tasks.workunit.client.0.smithi007.stdout:sedispatc 677 root NOFD /proc/677/fd (opendir: Permission denied) 2024-09-19T08:47:17.158 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-brok 719 dbus cwd unknown /proc/719/cwd (readlink: Permission denied) 2024-09-19T08:47:17.158 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-brok 719 dbus rtd unknown /proc/719/root (readlink: Permission denied) 2024-09-19T08:47:17.158 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-brok 719 dbus txt unknown /proc/719/exe (readlink: Permission denied) 2024-09-19T08:47:17.158 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-brok 719 dbus NOFD /proc/719/fd (opendir: Permission denied) 2024-09-19T08:47:17.158 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-brok 720 dbus cwd unknown /proc/720/cwd (readlink: Permission denied) 2024-09-19T08:47:17.158 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-brok 720 dbus rtd unknown /proc/720/root (readlink: Permission denied) 2024-09-19T08:47:17.158 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-brok 720 dbus txt unknown /proc/720/exe (readlink: Permission denied) 2024-09-19T08:47:17.158 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-brok 720 dbus NOFD /proc/720/fd (opendir: Permission denied) 2024-09-19T08:47:17.158 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 721 root cwd unknown /proc/721/cwd (readlink: Permission denied) 2024-09-19T08:47:17.159 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 721 root rtd unknown /proc/721/root (readlink: Permission denied) 2024-09-19T08:47:17.159 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 721 root txt unknown /proc/721/exe (readlink: Permission denied) 2024-09-19T08:47:17.159 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 721 root NOFD /proc/721/fd (opendir: Permission denied) 2024-09-19T08:47:17.159 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 721 738 gmain root cwd unknown /proc/721/task/738/cwd (readlink: Permission denied) 2024-09-19T08:47:17.159 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 721 738 gmain root rtd unknown /proc/721/task/738/root (readlink: Permission denied) 2024-09-19T08:47:17.159 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 721 738 gmain root txt unknown /proc/721/task/738/exe (readlink: Permission denied) 2024-09-19T08:47:17.159 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 721 738 gmain root NOFD /proc/721/task/738/fd (opendir: Permission denied) 2024-09-19T08:47:17.159 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 721 739 gdbus root cwd unknown /proc/721/task/739/cwd (readlink: Permission denied) 2024-09-19T08:47:17.159 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 721 739 gdbus root rtd unknown /proc/721/task/739/root (readlink: Permission denied) 2024-09-19T08:47:17.159 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 721 739 gdbus root txt unknown /proc/721/task/739/exe (readlink: Permission denied) 2024-09-19T08:47:17.159 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 721 739 gdbus root NOFD /proc/721/task/739/fd (opendir: Permission denied) 2024-09-19T08:47:17.159 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 724 root cwd unknown /proc/724/cwd (readlink: Permission denied) 2024-09-19T08:47:17.159 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 724 root rtd unknown /proc/724/root (readlink: Permission denied) 2024-09-19T08:47:17.160 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 724 root txt unknown /proc/724/exe (readlink: Permission denied) 2024-09-19T08:47:17.160 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 724 root NOFD /proc/724/fd (opendir: Permission denied) 2024-09-19T08:47:17.160 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 724 731 gmain root cwd unknown /proc/724/task/731/cwd (readlink: Permission denied) 2024-09-19T08:47:17.160 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 724 731 gmain root rtd unknown /proc/724/task/731/root (readlink: Permission denied) 2024-09-19T08:47:17.160 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 724 731 gmain root txt unknown /proc/724/task/731/exe (readlink: Permission denied) 2024-09-19T08:47:17.160 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 724 731 gmain root NOFD /proc/724/task/731/fd (opendir: Permission denied) 2024-09-19T08:47:17.160 INFO:tasks.workunit.client.0.smithi007.stdout:lsmd 725 libstoragemgmt cwd unknown /proc/725/cwd (readlink: Permission denied) 2024-09-19T08:47:17.160 INFO:tasks.workunit.client.0.smithi007.stdout:lsmd 725 libstoragemgmt rtd unknown /proc/725/root (readlink: Permission denied) 2024-09-19T08:47:17.160 INFO:tasks.workunit.client.0.smithi007.stdout:lsmd 725 libstoragemgmt txt unknown /proc/725/exe (readlink: Permission denied) 2024-09-19T08:47:17.161 INFO:tasks.workunit.client.0.smithi007.stdout:lsmd 725 libstoragemgmt NOFD /proc/725/fd (opendir: Permission denied) 2024-09-19T08:47:17.161 INFO:tasks.workunit.client.0.smithi007.stdout:mcelog 726 root cwd unknown /proc/726/cwd (readlink: Permission denied) 2024-09-19T08:47:17.161 INFO:tasks.workunit.client.0.smithi007.stdout:mcelog 726 root rtd unknown /proc/726/root (readlink: Permission denied) 2024-09-19T08:47:17.161 INFO:tasks.workunit.client.0.smithi007.stdout:mcelog 726 root txt unknown /proc/726/exe (readlink: Permission denied) 2024-09-19T08:47:17.161 INFO:tasks.workunit.client.0.smithi007.stdout:mcelog 726 root NOFD /proc/726/fd (opendir: Permission denied) 2024-09-19T08:47:17.161 INFO:tasks.workunit.client.0.smithi007.stdout:smartd 728 root cwd unknown /proc/728/cwd (readlink: Permission denied) 2024-09-19T08:47:17.161 INFO:tasks.workunit.client.0.smithi007.stdout:smartd 728 root rtd unknown /proc/728/root (readlink: Permission denied) 2024-09-19T08:47:17.161 INFO:tasks.workunit.client.0.smithi007.stdout:smartd 728 root txt unknown /proc/728/exe (readlink: Permission denied) 2024-09-19T08:47:17.161 INFO:tasks.workunit.client.0.smithi007.stdout:smartd 728 root NOFD /proc/728/fd (opendir: Permission denied) 2024-09-19T08:47:17.161 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-l 730 root cwd unknown /proc/730/cwd (readlink: Permission denied) 2024-09-19T08:47:17.161 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-l 730 root rtd unknown /proc/730/root (readlink: Permission denied) 2024-09-19T08:47:17.161 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-l 730 root txt unknown /proc/730/exe (readlink: Permission denied) 2024-09-19T08:47:17.161 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-l 730 root NOFD /proc/730/fd (opendir: Permission denied) 2024-09-19T08:47:17.162 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 773 root cwd unknown /proc/773/cwd (readlink: Permission denied) 2024-09-19T08:47:17.162 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 773 root rtd unknown /proc/773/root (readlink: Permission denied) 2024-09-19T08:47:17.162 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 773 root txt unknown /proc/773/exe (readlink: Permission denied) 2024-09-19T08:47:17.162 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 773 root NOFD /proc/773/fd (opendir: Permission denied) 2024-09-19T08:47:17.162 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 root cwd unknown /proc/777/cwd (readlink: Permission denied) 2024-09-19T08:47:17.162 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 root rtd unknown /proc/777/root (readlink: Permission denied) 2024-09-19T08:47:17.162 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 root txt unknown /proc/777/exe (readlink: Permission denied) 2024-09-19T08:47:17.162 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 root NOFD /proc/777/fd (opendir: Permission denied) 2024-09-19T08:47:17.162 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 778 gssproxy root cwd unknown /proc/777/task/778/cwd (readlink: Permission denied) 2024-09-19T08:47:17.162 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 778 gssproxy root rtd unknown /proc/777/task/778/root (readlink: Permission denied) 2024-09-19T08:47:17.162 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 778 gssproxy root txt unknown /proc/777/task/778/exe (readlink: Permission denied) 2024-09-19T08:47:17.162 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 778 gssproxy root NOFD /proc/777/task/778/fd (opendir: Permission denied) 2024-09-19T08:47:17.163 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 779 gssproxy root cwd unknown /proc/777/task/779/cwd (readlink: Permission denied) 2024-09-19T08:47:17.163 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 779 gssproxy root rtd unknown /proc/777/task/779/root (readlink: Permission denied) 2024-09-19T08:47:17.163 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 779 gssproxy root txt unknown /proc/777/task/779/exe (readlink: Permission denied) 2024-09-19T08:47:17.163 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 779 gssproxy root NOFD /proc/777/task/779/fd (opendir: Permission denied) 2024-09-19T08:47:17.163 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 780 gssproxy root cwd unknown /proc/777/task/780/cwd (readlink: Permission denied) 2024-09-19T08:47:17.163 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 780 gssproxy root rtd unknown /proc/777/task/780/root (readlink: Permission denied) 2024-09-19T08:47:17.163 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 780 gssproxy root txt unknown /proc/777/task/780/exe (readlink: Permission denied) 2024-09-19T08:47:17.163 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 780 gssproxy root NOFD /proc/777/task/780/fd (opendir: Permission denied) 2024-09-19T08:47:17.163 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 781 gssproxy root cwd unknown /proc/777/task/781/cwd (readlink: Permission denied) 2024-09-19T08:47:17.163 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 781 gssproxy root rtd unknown /proc/777/task/781/root (readlink: Permission denied) 2024-09-19T08:47:17.164 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 781 gssproxy root txt unknown /proc/777/task/781/exe (readlink: Permission denied) 2024-09-19T08:47:17.164 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 781 gssproxy root NOFD /proc/777/task/781/fd (opendir: Permission denied) 2024-09-19T08:47:17.164 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 782 gssproxy root cwd unknown /proc/777/task/782/cwd (readlink: Permission denied) 2024-09-19T08:47:17.164 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 782 gssproxy root rtd unknown /proc/777/task/782/root (readlink: Permission denied) 2024-09-19T08:47:17.164 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 782 gssproxy root txt unknown /proc/777/task/782/exe (readlink: Permission denied) 2024-09-19T08:47:17.164 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 777 782 gssproxy root NOFD /proc/777/task/782/fd (opendir: Permission denied) 2024-09-19T08:47:17.164 INFO:tasks.workunit.client.0.smithi007.stdout:atd 784 root cwd unknown /proc/784/cwd (readlink: Permission denied) 2024-09-19T08:47:17.164 INFO:tasks.workunit.client.0.smithi007.stdout:atd 784 root rtd unknown /proc/784/root (readlink: Permission denied) 2024-09-19T08:47:17.164 INFO:tasks.workunit.client.0.smithi007.stdout:atd 784 root txt unknown /proc/784/exe (readlink: Permission denied) 2024-09-19T08:47:17.164 INFO:tasks.workunit.client.0.smithi007.stdout:atd 784 root NOFD /proc/784/fd (opendir: Permission denied) 2024-09-19T08:47:17.164 INFO:tasks.workunit.client.0.smithi007.stdout:crond 785 root cwd unknown /proc/785/cwd (readlink: Permission denied) 2024-09-19T08:47:17.164 INFO:tasks.workunit.client.0.smithi007.stdout:crond 785 root rtd unknown /proc/785/root (readlink: Permission denied) 2024-09-19T08:47:17.164 INFO:tasks.workunit.client.0.smithi007.stdout:crond 785 root txt unknown /proc/785/exe (readlink: Permission denied) 2024-09-19T08:47:17.164 INFO:tasks.workunit.client.0.smithi007.stdout:crond 785 root NOFD /proc/785/fd (opendir: Permission denied) 2024-09-19T08:47:17.165 INFO:tasks.workunit.client.0.smithi007.stdout:nrpe 810 nrpe cwd unknown /proc/810/cwd (readlink: Permission denied) 2024-09-19T08:47:17.165 INFO:tasks.workunit.client.0.smithi007.stdout:nrpe 810 nrpe rtd unknown /proc/810/root (readlink: Permission denied) 2024-09-19T08:47:17.165 INFO:tasks.workunit.client.0.smithi007.stdout:nrpe 810 nrpe txt unknown /proc/810/exe (readlink: Permission denied) 2024-09-19T08:47:17.165 INFO:tasks.workunit.client.0.smithi007.stdout:nrpe 810 nrpe NOFD /proc/810/fd (opendir: Permission denied) 2024-09-19T08:47:17.165 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1190 root cwd unknown /proc/1190/cwd (readlink: Permission denied) 2024-09-19T08:47:17.165 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1190 root rtd unknown /proc/1190/root (readlink: Permission denied) 2024-09-19T08:47:17.165 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1190 root txt unknown /proc/1190/exe (readlink: Permission denied) 2024-09-19T08:47:17.165 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1190 root NOFD /proc/1190/fd (opendir: Permission denied) 2024-09-19T08:47:17.165 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1195 root cwd unknown /proc/1195/cwd (readlink: Permission denied) 2024-09-19T08:47:17.165 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1195 root rtd unknown /proc/1195/root (readlink: Permission denied) 2024-09-19T08:47:17.165 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1195 root txt unknown /proc/1195/exe (readlink: Permission denied) 2024-09-19T08:47:17.165 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1195 root NOFD /proc/1195/fd (opendir: Permission denied) 2024-09-19T08:47:17.165 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu cwd DIR 8,1 4096 2 / 2024-09-19T08:47:17.166 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu rtd DIR 8,1 4096 2 / 2024-09-19T08:47:17.166 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu txt REG 8,1 98208 22394 /usr/lib/systemd/systemd 2024-09-19T08:47:17.166 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu DEL REG 8,1 2232 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-09-19T08:47:17.166 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu DEL REG 8,1 2229 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-09-19T08:47:17.166 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 44784 11373 /usr/lib64/libffi.so.8.1.0 2024-09-19T08:47:17.166 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 153600 11397 /usr/lib64/libgpg-error.so.0.32.0 2024-09-19T08:47:17.166 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 912440 11215 /usr/lib64/libm.so.6 2024-09-19T08:47:17.166 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 1714208 11376 /usr/lib64/libp11-kit.so.0.3.1 2024-09-19T08:47:17.166 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu DEL REG 8,1 11595 /usr/lib64/libcrypto.so.3.2.2 2024-09-19T08:47:17.166 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 28552 11392 /usr/lib64/libattr.so.1.1.2501 2024-09-19T08:47:17.166 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 882376 11287 /usr/lib64/libzstd.so.1.5.1 2024-09-19T08:47:17.166 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-19T08:47:17.167 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-19T08:47:17.167 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-19T08:47:17.167 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 1304864 11471 /usr/lib64/libgcrypt.so.20.4.0 2024-09-19T08:47:17.167 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 3826840 50305 /usr/lib64/systemd/libsystemd-shared-252.so 2024-09-19T08:47:17.167 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 32528 11311 /usr/lib64/libcap-ng.so.0.0.0 2024-09-19T08:47:17.167 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 40520 12544 /usr/lib64/libeconf.so.0.4.1 2024-09-19T08:47:17.167 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 178728 11282 /usr/lib64/liblzma.so.5.2.5 2024-09-19T08:47:17.167 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 144120 11455 /usr/lib64/liblz4.so.1.9.3 2024-09-19T08:47:17.167 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 2162040 50302 /usr/lib64/systemd/libsystemd-core-252.so 2024-09-19T08:47:17.167 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 201808 11284 /usr/lib64/libcrypt.so.2.0.0 2024-09-19T08:47:17.167 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 36296 11290 /usr/lib64/libcap.so.2.48 2024-09-19T08:47:17.167 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 229424 11714 /usr/lib64/libblkid.so.1.1.0 2024-09-19T08:47:17.167 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 40496 11393 /usr/lib64/libacl.so.1.1.2301 2024-09-19T08:47:17.168 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 291496 11744 /usr/lib64/libmount.so.1.1.0 2024-09-19T08:47:17.168 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-19T08:47:17.168 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 107528 11768 /usr/lib64/libkmod.so.2.3.6 2024-09-19T08:47:17.168 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 163464 11315 /usr/lib64/libaudit.so.1.0.0 2024-09-19T08:47:17.168 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 69592 12553 /usr/lib64/libpam.so.0.85.1 2024-09-19T08:47:17.168 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 127680 11560 /usr/lib64/libseccomp.so.2.5.2 2024-09-19T08:47:17.168 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 108136 14698 /usr/lib64/libgcc_s-11-20240719.so.1 2024-09-19T08:47:17.168 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2024-09-19T08:47:17.168 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-19T08:47:17.168 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2024-09-19T08:47:17.168 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu 1u unix 0x0000000000000000 0t0 21980 type=STREAM (CONNECTED) 2024-09-19T08:47:17.169 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu 2u unix 0x0000000000000000 0t0 21980 type=STREAM (CONNECTED) 2024-09-19T08:47:17.169 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu 3u unix 0x0000000000000000 0t0 23240 type=DGRAM (CONNECTED) 2024-09-19T08:47:17.169 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu 4u a_inode 0,14 0 1085 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2024-09-19T08:47:17.169 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu 5u a_inode 0,14 0 1085 [signalfd] 2024-09-19T08:47:17.169 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu 6r a_inode 0,14 0 1085 inotify 2024-09-19T08:47:17.169 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu 7r DIR 0,25 0 3417 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2024-09-19T08:47:17.169 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu 8u a_inode 0,14 0 1085 [timerfd] 2024-09-19T08:47:17.169 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu 9u a_inode 0,14 0 1085 [eventpoll:10,13] 2024-09-19T08:47:17.169 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu 10r REG 0,20 0 23229 /proc/1595/mountinfo 2024-09-19T08:47:17.169 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu 11r a_inode 0,14 0 1085 inotify 2024-09-19T08:47:17.169 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu 12u unix 0x0000000000000000 0t0 23562 /run/user/1000/bus type=STREAM (LISTEN) 2024-09-19T08:47:17.169 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu 13r a_inode 0,14 0 1085 inotify 2024-09-19T08:47:17.169 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu 14r REG 0,20 0 4026532068 /proc/swaps 2024-09-19T08:47:17.169 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu 15u netlink 0t0 23244 KOBJECT_UEVENT 2024-09-19T08:47:17.170 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu 16u unix 0x0000000000000000 0t0 23250 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2024-09-19T08:47:17.170 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu 17u unix 0x0000000000000000 0t0 23251 type=DGRAM (CONNECTED) 2024-09-19T08:47:17.170 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu 18u unix 0x0000000000000000 0t0 23252 type=DGRAM (CONNECTED) 2024-09-19T08:47:17.170 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu 19u unix 0x0000000000000000 0t0 23253 /run/user/1000/systemd/private type=STREAM (LISTEN) 2024-09-19T08:47:17.170 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu 20u unix 0x0000000000000000 0t0 23255 type=STREAM (CONNECTED) 2024-09-19T08:47:17.170 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1595 ubuntu 21u a_inode 0,14 0 1085 [timerfd] 2024-09-19T08:47:17.170 INFO:tasks.workunit.client.0.smithi007.stdout:(sd-pam) 1612 ubuntu cwd unknown /proc/1612/cwd (readlink: Permission denied) 2024-09-19T08:47:17.170 INFO:tasks.workunit.client.0.smithi007.stdout:(sd-pam) 1612 ubuntu rtd unknown /proc/1612/root (readlink: Permission denied) 2024-09-19T08:47:17.170 INFO:tasks.workunit.client.0.smithi007.stdout:(sd-pam) 1612 ubuntu txt unknown /proc/1612/exe (readlink: Permission denied) 2024-09-19T08:47:17.171 INFO:tasks.workunit.client.0.smithi007.stdout:(sd-pam) 1612 ubuntu NOFD /proc/1612/fd (opendir: Permission denied) 2024-09-19T08:47:17.171 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 3721 root cwd unknown /proc/3721/cwd (readlink: Permission denied) 2024-09-19T08:47:17.171 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 3721 root rtd unknown /proc/3721/root (readlink: Permission denied) 2024-09-19T08:47:17.171 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 3721 root txt unknown /proc/3721/exe (readlink: Permission denied) 2024-09-19T08:47:17.171 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 3721 root NOFD /proc/3721/fd (opendir: Permission denied) 2024-09-19T08:47:17.171 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 3721 3755 in:imjour root cwd unknown /proc/3721/task/3755/cwd (readlink: Permission denied) 2024-09-19T08:47:17.171 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 3721 3755 in:imjour root rtd unknown /proc/3721/task/3755/root (readlink: Permission denied) 2024-09-19T08:47:17.171 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 3721 3755 in:imjour root txt unknown /proc/3721/task/3755/exe (readlink: Permission denied) 2024-09-19T08:47:17.171 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 3721 3755 in:imjour root NOFD /proc/3721/task/3755/fd (opendir: Permission denied) 2024-09-19T08:47:17.171 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 3721 3756 rs:main root cwd unknown /proc/3721/task/3756/cwd (readlink: Permission denied) 2024-09-19T08:47:17.171 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 3721 3756 rs:main root rtd unknown /proc/3721/task/3756/root (readlink: Permission denied) 2024-09-19T08:47:17.171 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 3721 3756 rs:main root txt unknown /proc/3721/task/3756/exe (readlink: Permission denied) 2024-09-19T08:47:17.171 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 3721 3756 rs:main root NOFD /proc/3721/task/3756/fd (opendir: Permission denied) 2024-09-19T08:47:17.171 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 18664 root cwd unknown /proc/18664/cwd (readlink: Permission denied) 2024-09-19T08:47:17.172 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 18664 root rtd unknown /proc/18664/root (readlink: Permission denied) 2024-09-19T08:47:17.172 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 18664 root txt unknown /proc/18664/exe (readlink: Permission denied) 2024-09-19T08:47:17.172 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 18664 root NOFD /proc/18664/fd (opendir: Permission denied) 2024-09-19T08:47:17.172 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 polkitd cwd unknown /proc/19227/cwd (readlink: Permission denied) 2024-09-19T08:47:17.172 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 polkitd rtd unknown /proc/19227/root (readlink: Permission denied) 2024-09-19T08:47:17.172 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 polkitd txt unknown /proc/19227/exe (readlink: Permission denied) 2024-09-19T08:47:17.172 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 polkitd NOFD /proc/19227/fd (opendir: Permission denied) 2024-09-19T08:47:17.172 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19229 gmain polkitd cwd unknown /proc/19227/task/19229/cwd (readlink: Permission denied) 2024-09-19T08:47:17.172 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19229 gmain polkitd rtd unknown /proc/19227/task/19229/root (readlink: Permission denied) 2024-09-19T08:47:17.172 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19229 gmain polkitd txt unknown /proc/19227/task/19229/exe (readlink: Permission denied) 2024-09-19T08:47:17.172 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19229 gmain polkitd NOFD /proc/19227/task/19229/fd (opendir: Permission denied) 2024-09-19T08:47:17.172 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19230 gdbus polkitd cwd unknown /proc/19227/task/19230/cwd (readlink: Permission denied) 2024-09-19T08:47:17.172 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19230 gdbus polkitd rtd unknown /proc/19227/task/19230/root (readlink: Permission denied) 2024-09-19T08:47:17.172 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19230 gdbus polkitd txt unknown /proc/19227/task/19230/exe (readlink: Permission denied) 2024-09-19T08:47:17.173 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19230 gdbus polkitd NOFD /proc/19227/task/19230/fd (opendir: Permission denied) 2024-09-19T08:47:17.173 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19231 JS\x20Hel polkitd cwd unknown /proc/19227/task/19231/cwd (readlink: Permission denied) 2024-09-19T08:47:17.173 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19231 JS\x20Hel polkitd rtd unknown /proc/19227/task/19231/root (readlink: Permission denied) 2024-09-19T08:47:17.173 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19231 JS\x20Hel polkitd txt unknown /proc/19227/task/19231/exe (readlink: Permission denied) 2024-09-19T08:47:17.173 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19231 JS\x20Hel polkitd NOFD /proc/19227/task/19231/fd (opendir: Permission denied) 2024-09-19T08:47:17.173 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19232 JS\x20Hel polkitd cwd unknown /proc/19227/task/19232/cwd (readlink: Permission denied) 2024-09-19T08:47:17.173 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19232 JS\x20Hel polkitd rtd unknown /proc/19227/task/19232/root (readlink: Permission denied) 2024-09-19T08:47:17.173 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19232 JS\x20Hel polkitd txt unknown /proc/19227/task/19232/exe (readlink: Permission denied) 2024-09-19T08:47:17.173 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19232 JS\x20Hel polkitd NOFD /proc/19227/task/19232/fd (opendir: Permission denied) 2024-09-19T08:47:17.173 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19233 JS\x20Hel polkitd cwd unknown /proc/19227/task/19233/cwd (readlink: Permission denied) 2024-09-19T08:47:17.173 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19233 JS\x20Hel polkitd rtd unknown /proc/19227/task/19233/root (readlink: Permission denied) 2024-09-19T08:47:17.173 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19233 JS\x20Hel polkitd txt unknown /proc/19227/task/19233/exe (readlink: Permission denied) 2024-09-19T08:47:17.173 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19233 JS\x20Hel polkitd NOFD /proc/19227/task/19233/fd (opendir: Permission denied) 2024-09-19T08:47:17.174 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19234 JS\x20Hel polkitd cwd unknown /proc/19227/task/19234/cwd (readlink: Permission denied) 2024-09-19T08:47:17.174 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19234 JS\x20Hel polkitd rtd unknown /proc/19227/task/19234/root (readlink: Permission denied) 2024-09-19T08:47:17.174 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19234 JS\x20Hel polkitd txt unknown /proc/19227/task/19234/exe (readlink: Permission denied) 2024-09-19T08:47:17.174 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19234 JS\x20Hel polkitd NOFD /proc/19227/task/19234/fd (opendir: Permission denied) 2024-09-19T08:47:17.174 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19235 JS\x20Hel polkitd cwd unknown /proc/19227/task/19235/cwd (readlink: Permission denied) 2024-09-19T08:47:17.174 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19235 JS\x20Hel polkitd rtd unknown /proc/19227/task/19235/root (readlink: Permission denied) 2024-09-19T08:47:17.174 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19235 JS\x20Hel polkitd txt unknown /proc/19227/task/19235/exe (readlink: Permission denied) 2024-09-19T08:47:17.174 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19235 JS\x20Hel polkitd NOFD /proc/19227/task/19235/fd (opendir: Permission denied) 2024-09-19T08:47:17.174 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19236 JS\x20Hel polkitd cwd unknown /proc/19227/task/19236/cwd (readlink: Permission denied) 2024-09-19T08:47:17.174 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19236 JS\x20Hel polkitd rtd unknown /proc/19227/task/19236/root (readlink: Permission denied) 2024-09-19T08:47:17.174 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19236 JS\x20Hel polkitd txt unknown /proc/19227/task/19236/exe (readlink: Permission denied) 2024-09-19T08:47:17.174 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19236 JS\x20Hel polkitd NOFD /proc/19227/task/19236/fd (opendir: Permission denied) 2024-09-19T08:47:17.174 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19237 JS\x20Hel polkitd cwd unknown /proc/19227/task/19237/cwd (readlink: Permission denied) 2024-09-19T08:47:17.174 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19237 JS\x20Hel polkitd rtd unknown /proc/19227/task/19237/root (readlink: Permission denied) 2024-09-19T08:47:17.175 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19237 JS\x20Hel polkitd txt unknown /proc/19227/task/19237/exe (readlink: Permission denied) 2024-09-19T08:47:17.175 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19237 JS\x20Hel polkitd NOFD /proc/19227/task/19237/fd (opendir: Permission denied) 2024-09-19T08:47:17.175 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19238 JS\x20Hel polkitd cwd unknown /proc/19227/task/19238/cwd (readlink: Permission denied) 2024-09-19T08:47:17.175 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19238 JS\x20Hel polkitd rtd unknown /proc/19227/task/19238/root (readlink: Permission denied) 2024-09-19T08:47:17.175 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19238 JS\x20Hel polkitd txt unknown /proc/19227/task/19238/exe (readlink: Permission denied) 2024-09-19T08:47:17.175 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19238 JS\x20Hel polkitd NOFD /proc/19227/task/19238/fd (opendir: Permission denied) 2024-09-19T08:47:17.175 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19239 polkitd polkitd cwd unknown /proc/19227/task/19239/cwd (readlink: Permission denied) 2024-09-19T08:47:17.175 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19239 polkitd polkitd rtd unknown /proc/19227/task/19239/root (readlink: Permission denied) 2024-09-19T08:47:17.175 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19239 polkitd polkitd txt unknown /proc/19227/task/19239/exe (readlink: Permission denied) 2024-09-19T08:47:17.175 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 19227 19239 polkitd polkitd NOFD /proc/19227/task/19239/fd (opendir: Permission denied) 2024-09-19T08:47:17.175 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21137 root cwd unknown /proc/21137/cwd (readlink: Permission denied) 2024-09-19T08:47:17.175 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21137 root rtd unknown /proc/21137/root (readlink: Permission denied) 2024-09-19T08:47:17.175 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21137 root txt unknown /proc/21137/exe (readlink: Permission denied) 2024-09-19T08:47:17.175 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21137 root NOFD /proc/21137/fd (opendir: Permission denied) 2024-09-19T08:47:17.176 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21166 root cwd unknown /proc/21166/cwd (readlink: Permission denied) 2024-09-19T08:47:17.176 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21166 root rtd unknown /proc/21166/root (readlink: Permission denied) 2024-09-19T08:47:17.176 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21166 root txt unknown /proc/21166/exe (readlink: Permission denied) 2024-09-19T08:47:17.176 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21166 root NOFD /proc/21166/fd (opendir: Permission denied) 2024-09-19T08:47:17.176 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21195 root cwd unknown /proc/21195/cwd (readlink: Permission denied) 2024-09-19T08:47:17.176 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21195 root rtd unknown /proc/21195/root (readlink: Permission denied) 2024-09-19T08:47:17.176 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21195 root txt unknown /proc/21195/exe (readlink: Permission denied) 2024-09-19T08:47:17.176 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21195 root NOFD /proc/21195/fd (opendir: Permission denied) 2024-09-19T08:47:17.176 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21224 root cwd unknown /proc/21224/cwd (readlink: Permission denied) 2024-09-19T08:47:17.176 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21224 root rtd unknown /proc/21224/root (readlink: Permission denied) 2024-09-19T08:47:17.176 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21224 root txt unknown /proc/21224/exe (readlink: Permission denied) 2024-09-19T08:47:17.176 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21224 root NOFD /proc/21224/fd (opendir: Permission denied) 2024-09-19T08:47:17.176 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21253 root cwd unknown /proc/21253/cwd (readlink: Permission denied) 2024-09-19T08:47:17.177 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21253 root rtd unknown /proc/21253/root (readlink: Permission denied) 2024-09-19T08:47:17.177 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21253 root txt unknown /proc/21253/exe (readlink: Permission denied) 2024-09-19T08:47:17.177 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21253 root NOFD /proc/21253/fd (opendir: Permission denied) 2024-09-19T08:47:17.177 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21417 root cwd unknown /proc/21417/cwd (readlink: Permission denied) 2024-09-19T08:47:17.177 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21417 root rtd unknown /proc/21417/root (readlink: Permission denied) 2024-09-19T08:47:17.177 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21417 root txt unknown /proc/21417/exe (readlink: Permission denied) 2024-09-19T08:47:17.177 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21417 root NOFD /proc/21417/fd (opendir: Permission denied) 2024-09-19T08:47:17.177 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21418 root cwd unknown /proc/21418/cwd (readlink: Permission denied) 2024-09-19T08:47:17.177 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21418 root rtd unknown /proc/21418/root (readlink: Permission denied) 2024-09-19T08:47:17.177 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21418 root txt unknown /proc/21418/exe (readlink: Permission denied) 2024-09-19T08:47:17.177 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21418 root NOFD /proc/21418/fd (opendir: Permission denied) 2024-09-19T08:47:17.177 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21419 root cwd unknown /proc/21419/cwd (readlink: Permission denied) 2024-09-19T08:47:17.177 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21419 root rtd unknown /proc/21419/root (readlink: Permission denied) 2024-09-19T08:47:17.177 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21419 root txt unknown /proc/21419/exe (readlink: Permission denied) 2024-09-19T08:47:17.178 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21419 root NOFD /proc/21419/fd (opendir: Permission denied) 2024-09-19T08:47:17.178 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21420 root cwd unknown /proc/21420/cwd (readlink: Permission denied) 2024-09-19T08:47:17.178 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21420 root rtd unknown /proc/21420/root (readlink: Permission denied) 2024-09-19T08:47:17.178 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21420 root txt unknown /proc/21420/exe (readlink: Permission denied) 2024-09-19T08:47:17.178 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21420 root NOFD /proc/21420/fd (opendir: Permission denied) 2024-09-19T08:47:17.178 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21421 root cwd unknown /proc/21421/cwd (readlink: Permission denied) 2024-09-19T08:47:17.178 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21421 root rtd unknown /proc/21421/root (readlink: Permission denied) 2024-09-19T08:47:17.178 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21421 root txt unknown /proc/21421/exe (readlink: Permission denied) 2024-09-19T08:47:17.178 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21421 root NOFD /proc/21421/fd (opendir: Permission denied) 2024-09-19T08:47:17.178 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21422 root cwd unknown /proc/21422/cwd (readlink: Permission denied) 2024-09-19T08:47:17.178 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21422 root rtd unknown /proc/21422/root (readlink: Permission denied) 2024-09-19T08:47:17.178 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21422 root txt unknown /proc/21422/exe (readlink: Permission denied) 2024-09-19T08:47:17.178 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21422 root NOFD /proc/21422/fd (opendir: Permission denied) 2024-09-19T08:47:17.178 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21423 root cwd unknown /proc/21423/cwd (readlink: Permission denied) 2024-09-19T08:47:17.179 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21423 root rtd unknown /proc/21423/root (readlink: Permission denied) 2024-09-19T08:47:17.179 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21423 root txt unknown /proc/21423/exe (readlink: Permission denied) 2024-09-19T08:47:17.179 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21423 root NOFD /proc/21423/fd (opendir: Permission denied) 2024-09-19T08:47:17.179 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21424 root cwd unknown /proc/21424/cwd (readlink: Permission denied) 2024-09-19T08:47:17.179 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21424 root rtd unknown /proc/21424/root (readlink: Permission denied) 2024-09-19T08:47:17.179 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21424 root txt unknown /proc/21424/exe (readlink: Permission denied) 2024-09-19T08:47:17.179 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21424 root NOFD /proc/21424/fd (opendir: Permission denied) 2024-09-19T08:47:17.179 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21425 root cwd unknown /proc/21425/cwd (readlink: Permission denied) 2024-09-19T08:47:17.179 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21425 root rtd unknown /proc/21425/root (readlink: Permission denied) 2024-09-19T08:47:17.179 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21425 root txt unknown /proc/21425/exe (readlink: Permission denied) 2024-09-19T08:47:17.179 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 21425 root NOFD /proc/21425/fd (opendir: Permission denied) 2024-09-19T08:47:17.179 INFO:tasks.workunit.client.0.smithi007.stdout:xfsaild/d 21426 root cwd unknown /proc/21426/cwd (readlink: Permission denied) 2024-09-19T08:47:17.179 INFO:tasks.workunit.client.0.smithi007.stdout:xfsaild/d 21426 root rtd unknown /proc/21426/root (readlink: Permission denied) 2024-09-19T08:47:17.179 INFO:tasks.workunit.client.0.smithi007.stdout:xfsaild/d 21426 root txt unknown /proc/21426/exe (readlink: Permission denied) 2024-09-19T08:47:17.180 INFO:tasks.workunit.client.0.smithi007.stdout:xfsaild/d 21426 root NOFD /proc/21426/fd (opendir: Permission denied) 2024-09-19T08:47:17.180 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 22358 root cwd unknown /proc/22358/cwd (readlink: Permission denied) 2024-09-19T08:47:17.180 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 22358 root rtd unknown /proc/22358/root (readlink: Permission denied) 2024-09-19T08:47:17.180 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 22358 root txt unknown /proc/22358/exe (readlink: Permission denied) 2024-09-19T08:47:17.180 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 22358 root NOFD /proc/22358/fd (opendir: Permission denied) 2024-09-19T08:47:17.180 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 22361 ubuntu cwd unknown /proc/22361/cwd (readlink: Permission denied) 2024-09-19T08:47:17.180 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 22361 ubuntu rtd unknown /proc/22361/root (readlink: Permission denied) 2024-09-19T08:47:17.180 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 22361 ubuntu txt unknown /proc/22361/exe (readlink: Permission denied) 2024-09-19T08:47:17.180 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 22361 ubuntu NOFD /proc/22361/fd (opendir: Permission denied) 2024-09-19T08:47:17.180 INFO:tasks.workunit.client.0.smithi007.stdout:chronyd 22421 chrony cwd unknown /proc/22421/cwd (readlink: Permission denied) 2024-09-19T08:47:17.180 INFO:tasks.workunit.client.0.smithi007.stdout:chronyd 22421 chrony rtd unknown /proc/22421/root (readlink: Permission denied) 2024-09-19T08:47:17.180 INFO:tasks.workunit.client.0.smithi007.stdout:chronyd 22421 chrony txt unknown /proc/22421/exe (readlink: Permission denied) 2024-09-19T08:47:17.180 INFO:tasks.workunit.client.0.smithi007.stdout:chronyd 22421 chrony NOFD /proc/22421/fd (opendir: Permission denied) 2024-09-19T08:47:17.181 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-cras 22733 ceph cwd unknown /proc/22733/cwd (readlink: Permission denied) 2024-09-19T08:47:17.181 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-cras 22733 ceph rtd unknown /proc/22733/root (readlink: Permission denied) 2024-09-19T08:47:17.181 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-cras 22733 ceph txt unknown /proc/22733/exe (readlink: Permission denied) 2024-09-19T08:47:17.181 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-cras 22733 ceph NOFD /proc/22733/fd (opendir: Permission denied) 2024-09-19T08:47:17.181 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 23257 root cwd unknown /proc/23257/cwd (readlink: Permission denied) 2024-09-19T08:47:17.181 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 23257 root rtd unknown /proc/23257/root (readlink: Permission denied) 2024-09-19T08:47:17.181 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 23257 root txt unknown /proc/23257/exe (readlink: Permission denied) 2024-09-19T08:47:17.181 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 23257 root NOFD /proc/23257/fd (opendir: Permission denied) 2024-09-19T08:47:17.181 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 24424 root cwd unknown /proc/24424/cwd (readlink: Permission denied) 2024-09-19T08:47:17.181 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 24424 root rtd unknown /proc/24424/root (readlink: Permission denied) 2024-09-19T08:47:17.181 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 24424 root txt unknown /proc/24424/exe (readlink: Permission denied) 2024-09-19T08:47:17.181 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 24424 root NOFD /proc/24424/fd (opendir: Permission denied) 2024-09-19T08:47:17.181 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 25402 root cwd unknown /proc/25402/cwd (readlink: Permission denied) 2024-09-19T08:47:17.181 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 25402 root rtd unknown /proc/25402/root (readlink: Permission denied) 2024-09-19T08:47:17.182 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 25402 root txt unknown /proc/25402/exe (readlink: Permission denied) 2024-09-19T08:47:17.182 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 25402 root NOFD /proc/25402/fd (opendir: Permission denied) 2024-09-19T08:47:17.182 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 29803 root cwd unknown /proc/29803/cwd (readlink: Permission denied) 2024-09-19T08:47:17.182 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 29803 root rtd unknown /proc/29803/root (readlink: Permission denied) 2024-09-19T08:47:17.182 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 29803 root txt unknown /proc/29803/exe (readlink: Permission denied) 2024-09-19T08:47:17.182 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 29803 root NOFD /proc/29803/fd (opendir: Permission denied) 2024-09-19T08:47:17.182 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 29804 root cwd unknown /proc/29804/cwd (readlink: Permission denied) 2024-09-19T08:47:17.182 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 29804 root rtd unknown /proc/29804/root (readlink: Permission denied) 2024-09-19T08:47:17.182 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 29804 root txt unknown /proc/29804/exe (readlink: Permission denied) 2024-09-19T08:47:17.182 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 29804 root NOFD /proc/29804/fd (opendir: Permission denied) 2024-09-19T08:47:17.182 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 30204 root cwd unknown /proc/30204/cwd (readlink: Permission denied) 2024-09-19T08:47:17.182 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 30204 root rtd unknown /proc/30204/root (readlink: Permission denied) 2024-09-19T08:47:17.182 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 30204 root txt unknown /proc/30204/exe (readlink: Permission denied) 2024-09-19T08:47:17.183 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 30204 root NOFD /proc/30204/fd (opendir: Permission denied) 2024-09-19T08:47:17.183 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 30221 root cwd unknown /proc/30221/cwd (readlink: Permission denied) 2024-09-19T08:47:17.183 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 30221 root rtd unknown /proc/30221/root (readlink: Permission denied) 2024-09-19T08:47:17.183 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 30221 root txt unknown /proc/30221/exe (readlink: Permission denied) 2024-09-19T08:47:17.183 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 30221 root NOFD /proc/30221/fd (opendir: Permission denied) 2024-09-19T08:47:17.183 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 30222 root cwd unknown /proc/30222/cwd (readlink: Permission denied) 2024-09-19T08:47:17.183 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 30222 root rtd unknown /proc/30222/root (readlink: Permission denied) 2024-09-19T08:47:17.183 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 30222 root txt unknown /proc/30222/exe (readlink: Permission denied) 2024-09-19T08:47:17.183 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 30222 root NOFD /proc/30222/fd (opendir: Permission denied) 2024-09-19T08:47:17.183 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 30239 root cwd unknown /proc/30239/cwd (readlink: Permission denied) 2024-09-19T08:47:17.183 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 30239 root rtd unknown /proc/30239/root (readlink: Permission denied) 2024-09-19T08:47:17.183 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 30239 root txt unknown /proc/30239/exe (readlink: Permission denied) 2024-09-19T08:47:17.183 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 30239 root NOFD /proc/30239/fd (opendir: Permission denied) 2024-09-19T08:47:17.183 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 31167 root cwd unknown /proc/31167/cwd (readlink: Permission denied) 2024-09-19T08:47:17.183 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 31167 root rtd unknown /proc/31167/root (readlink: Permission denied) 2024-09-19T08:47:17.184 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 31167 root txt unknown /proc/31167/exe (readlink: Permission denied) 2024-09-19T08:47:17.184 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 31167 root NOFD /proc/31167/fd (opendir: Permission denied) 2024-09-19T08:47:17.184 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 31217 root cwd unknown /proc/31217/cwd (readlink: Permission denied) 2024-09-19T08:47:17.184 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 31217 root rtd unknown /proc/31217/root (readlink: Permission denied) 2024-09-19T08:47:17.184 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 31217 root txt unknown /proc/31217/exe (readlink: Permission denied) 2024-09-19T08:47:17.184 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 31217 root NOFD /proc/31217/fd (opendir: Permission denied) 2024-09-19T08:47:17.184 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 31219 root cwd unknown /proc/31219/cwd (readlink: Permission denied) 2024-09-19T08:47:17.184 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 31219 root rtd unknown /proc/31219/root (readlink: Permission denied) 2024-09-19T08:47:17.185 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 31219 root txt unknown /proc/31219/exe (readlink: Permission denied) 2024-09-19T08:47:17.185 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 31219 root NOFD /proc/31219/fd (opendir: Permission denied) 2024-09-19T08:47:17.185 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 ceph cwd unknown /proc/31221/cwd (readlink: Permission denied) 2024-09-19T08:47:17.185 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 ceph rtd unknown /proc/31221/root (readlink: Permission denied) 2024-09-19T08:47:17.185 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 ceph txt unknown /proc/31221/exe (readlink: Permission denied) 2024-09-19T08:47:17.185 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 ceph NOFD /proc/31221/fd (opendir: Permission denied) 2024-09-19T08:47:17.185 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31222 log ceph cwd unknown /proc/31221/task/31222/cwd (readlink: Permission denied) 2024-09-19T08:47:17.185 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31222 log ceph rtd unknown /proc/31221/task/31222/root (readlink: Permission denied) 2024-09-19T08:47:17.185 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31222 log ceph txt unknown /proc/31221/task/31222/exe (readlink: Permission denied) 2024-09-19T08:47:17.185 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31222 log ceph NOFD /proc/31221/task/31222/fd (opendir: Permission denied) 2024-09-19T08:47:17.185 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31223 service ceph cwd unknown /proc/31221/task/31223/cwd (readlink: Permission denied) 2024-09-19T08:47:17.185 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31223 service ceph rtd unknown /proc/31221/task/31223/root (readlink: Permission denied) 2024-09-19T08:47:17.185 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31223 service ceph txt unknown /proc/31221/task/31223/exe (readlink: Permission denied) 2024-09-19T08:47:17.186 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31223 service ceph NOFD /proc/31221/task/31223/fd (opendir: Permission denied) 2024-09-19T08:47:17.186 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31224 admin_soc ceph cwd unknown /proc/31221/task/31224/cwd (readlink: Permission denied) 2024-09-19T08:47:17.186 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31224 admin_soc ceph rtd unknown /proc/31221/task/31224/root (readlink: Permission denied) 2024-09-19T08:47:17.186 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31224 admin_soc ceph txt unknown /proc/31221/task/31224/exe (readlink: Permission denied) 2024-09-19T08:47:17.186 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31224 admin_soc ceph NOFD /proc/31221/task/31224/fd (opendir: Permission denied) 2024-09-19T08:47:17.186 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31225 signal_ha ceph cwd unknown /proc/31221/task/31225/cwd (readlink: Permission denied) 2024-09-19T08:47:17.186 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31225 signal_ha ceph rtd unknown /proc/31221/task/31225/root (readlink: Permission denied) 2024-09-19T08:47:17.186 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31225 signal_ha ceph txt unknown /proc/31221/task/31225/exe (readlink: Permission denied) 2024-09-19T08:47:17.186 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31225 signal_ha ceph NOFD /proc/31221/task/31225/fd (opendir: Permission denied) 2024-09-19T08:47:17.187 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31226 rocksdb:l ceph cwd unknown /proc/31221/task/31226/cwd (readlink: Permission denied) 2024-09-19T08:47:17.187 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31226 rocksdb:l ceph rtd unknown /proc/31221/task/31226/root (readlink: Permission denied) 2024-09-19T08:47:17.187 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31226 rocksdb:l ceph txt unknown /proc/31221/task/31226/exe (readlink: Permission denied) 2024-09-19T08:47:17.187 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31226 rocksdb:l ceph NOFD /proc/31221/task/31226/fd (opendir: Permission denied) 2024-09-19T08:47:17.187 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31227 rocksdb:h ceph cwd unknown /proc/31221/task/31227/cwd (readlink: Permission denied) 2024-09-19T08:47:17.187 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31227 rocksdb:h ceph rtd unknown /proc/31221/task/31227/root (readlink: Permission denied) 2024-09-19T08:47:17.187 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31227 rocksdb:h ceph txt unknown /proc/31221/task/31227/exe (readlink: Permission denied) 2024-09-19T08:47:17.187 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31227 rocksdb:h ceph NOFD /proc/31221/task/31227/fd (opendir: Permission denied) 2024-09-19T08:47:17.187 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31243 ceph-mon ceph cwd unknown /proc/31221/task/31243/cwd (readlink: Permission denied) 2024-09-19T08:47:17.187 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31243 ceph-mon ceph rtd unknown /proc/31221/task/31243/root (readlink: Permission denied) 2024-09-19T08:47:17.187 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31243 ceph-mon ceph txt unknown /proc/31221/task/31243/exe (readlink: Permission denied) 2024-09-19T08:47:17.187 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31243 ceph-mon ceph NOFD /proc/31221/task/31243/fd (opendir: Permission denied) 2024-09-19T08:47:17.187 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31244 fn_monsto ceph cwd unknown /proc/31221/task/31244/cwd (readlink: Permission denied) 2024-09-19T08:47:17.187 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31244 fn_monsto ceph rtd unknown /proc/31221/task/31244/root (readlink: Permission denied) 2024-09-19T08:47:17.188 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31244 fn_monsto ceph txt unknown /proc/31221/task/31244/exe (readlink: Permission denied) 2024-09-19T08:47:17.188 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31244 fn_monsto ceph NOFD /proc/31221/task/31244/fd (opendir: Permission denied) 2024-09-19T08:47:17.188 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31245 msgr-work ceph cwd unknown /proc/31221/task/31245/cwd (readlink: Permission denied) 2024-09-19T08:47:17.188 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31245 msgr-work ceph rtd unknown /proc/31221/task/31245/root (readlink: Permission denied) 2024-09-19T08:47:17.188 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31245 msgr-work ceph txt unknown /proc/31221/task/31245/exe (readlink: Permission denied) 2024-09-19T08:47:17.188 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31245 msgr-work ceph NOFD /proc/31221/task/31245/fd (opendir: Permission denied) 2024-09-19T08:47:17.188 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31246 msgr-work ceph cwd unknown /proc/31221/task/31246/cwd (readlink: Permission denied) 2024-09-19T08:47:17.188 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31246 msgr-work ceph rtd unknown /proc/31221/task/31246/root (readlink: Permission denied) 2024-09-19T08:47:17.188 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31246 msgr-work ceph txt unknown /proc/31221/task/31246/exe (readlink: Permission denied) 2024-09-19T08:47:17.188 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31246 msgr-work ceph NOFD /proc/31221/task/31246/fd (opendir: Permission denied) 2024-09-19T08:47:17.188 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31247 msgr-work ceph cwd unknown /proc/31221/task/31247/cwd (readlink: Permission denied) 2024-09-19T08:47:17.188 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31247 msgr-work ceph rtd unknown /proc/31221/task/31247/root (readlink: Permission denied) 2024-09-19T08:47:17.188 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31247 msgr-work ceph txt unknown /proc/31221/task/31247/exe (readlink: Permission denied) 2024-09-19T08:47:17.188 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31247 msgr-work ceph NOFD /proc/31221/task/31247/fd (opendir: Permission denied) 2024-09-19T08:47:17.189 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31248 OpHistory ceph cwd unknown /proc/31221/task/31248/cwd (readlink: Permission denied) 2024-09-19T08:47:17.189 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31248 OpHistory ceph rtd unknown /proc/31221/task/31248/root (readlink: Permission denied) 2024-09-19T08:47:17.189 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31248 OpHistory ceph txt unknown /proc/31221/task/31248/exe (readlink: Permission denied) 2024-09-19T08:47:17.189 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31248 OpHistory ceph NOFD /proc/31221/task/31248/fd (opendir: Permission denied) 2024-09-19T08:47:17.189 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31249 fin ceph cwd unknown /proc/31221/task/31249/cwd (readlink: Permission denied) 2024-09-19T08:47:17.189 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31249 fin ceph rtd unknown /proc/31221/task/31249/root (readlink: Permission denied) 2024-09-19T08:47:17.189 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31249 fin ceph txt unknown /proc/31221/task/31249/exe (readlink: Permission denied) 2024-09-19T08:47:17.189 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31249 fin ceph NOFD /proc/31221/task/31249/fd (opendir: Permission denied) 2024-09-19T08:47:17.189 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31250 safe_time ceph cwd unknown /proc/31221/task/31250/cwd (readlink: Permission denied) 2024-09-19T08:47:17.189 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31250 safe_time ceph rtd unknown /proc/31221/task/31250/root (readlink: Permission denied) 2024-09-19T08:47:17.189 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31250 safe_time ceph txt unknown /proc/31221/task/31250/exe (readlink: Permission denied) 2024-09-19T08:47:17.189 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31250 safe_time ceph NOFD /proc/31221/task/31250/fd (opendir: Permission denied) 2024-09-19T08:47:17.189 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31251 cpu_tp ceph cwd unknown /proc/31221/task/31251/cwd (readlink: Permission denied) 2024-09-19T08:47:17.190 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31251 cpu_tp ceph rtd unknown /proc/31221/task/31251/root (readlink: Permission denied) 2024-09-19T08:47:17.190 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31251 cpu_tp ceph txt unknown /proc/31221/task/31251/exe (readlink: Permission denied) 2024-09-19T08:47:17.190 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31251 cpu_tp ceph NOFD /proc/31221/task/31251/fd (opendir: Permission denied) 2024-09-19T08:47:17.190 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31252 cpu_tp ceph cwd unknown /proc/31221/task/31252/cwd (readlink: Permission denied) 2024-09-19T08:47:17.190 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31252 cpu_tp ceph rtd unknown /proc/31221/task/31252/root (readlink: Permission denied) 2024-09-19T08:47:17.190 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31252 cpu_tp ceph txt unknown /proc/31221/task/31252/exe (readlink: Permission denied) 2024-09-19T08:47:17.190 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31252 cpu_tp ceph NOFD /proc/31221/task/31252/fd (opendir: Permission denied) 2024-09-19T08:47:17.190 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31253 cpu_tp ceph cwd unknown /proc/31221/task/31253/cwd (readlink: Permission denied) 2024-09-19T08:47:17.190 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31253 cpu_tp ceph rtd unknown /proc/31221/task/31253/root (readlink: Permission denied) 2024-09-19T08:47:17.190 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31253 cpu_tp ceph txt unknown /proc/31221/task/31253/exe (readlink: Permission denied) 2024-09-19T08:47:17.190 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31253 cpu_tp ceph NOFD /proc/31221/task/31253/fd (opendir: Permission denied) 2024-09-19T08:47:17.190 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31254 cpu_tp ceph cwd unknown /proc/31221/task/31254/cwd (readlink: Permission denied) 2024-09-19T08:47:17.190 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31254 cpu_tp ceph rtd unknown /proc/31221/task/31254/root (readlink: Permission denied) 2024-09-19T08:47:17.190 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31254 cpu_tp ceph txt unknown /proc/31221/task/31254/exe (readlink: Permission denied) 2024-09-19T08:47:17.191 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31254 cpu_tp ceph NOFD /proc/31221/task/31254/fd (opendir: Permission denied) 2024-09-19T08:47:17.191 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31255 ms_dispat ceph cwd unknown /proc/31221/task/31255/cwd (readlink: Permission denied) 2024-09-19T08:47:17.191 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31255 ms_dispat ceph rtd unknown /proc/31221/task/31255/root (readlink: Permission denied) 2024-09-19T08:47:17.191 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31255 ms_dispat ceph txt unknown /proc/31221/task/31255/exe (readlink: Permission denied) 2024-09-19T08:47:17.191 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31255 ms_dispat ceph NOFD /proc/31221/task/31255/fd (opendir: Permission denied) 2024-09-19T08:47:17.191 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31256 ms_local ceph cwd unknown /proc/31221/task/31256/cwd (readlink: Permission denied) 2024-09-19T08:47:17.191 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31256 ms_local ceph rtd unknown /proc/31221/task/31256/root (readlink: Permission denied) 2024-09-19T08:47:17.191 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31256 ms_local ceph txt unknown /proc/31221/task/31256/exe (readlink: Permission denied) 2024-09-19T08:47:17.191 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31256 ms_local ceph NOFD /proc/31221/task/31256/fd (opendir: Permission denied) 2024-09-19T08:47:17.191 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31257 safe_time ceph cwd unknown /proc/31221/task/31257/cwd (readlink: Permission denied) 2024-09-19T08:47:17.191 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31257 safe_time ceph rtd unknown /proc/31221/task/31257/root (readlink: Permission denied) 2024-09-19T08:47:17.191 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31257 safe_time ceph txt unknown /proc/31221/task/31257/exe (readlink: Permission denied) 2024-09-19T08:47:17.191 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31257 safe_time ceph NOFD /proc/31221/task/31257/fd (opendir: Permission denied) 2024-09-19T08:47:17.191 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31258 ms_dispat ceph cwd unknown /proc/31221/task/31258/cwd (readlink: Permission denied) 2024-09-19T08:47:17.192 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31258 ms_dispat ceph rtd unknown /proc/31221/task/31258/root (readlink: Permission denied) 2024-09-19T08:47:17.192 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31258 ms_dispat ceph txt unknown /proc/31221/task/31258/exe (readlink: Permission denied) 2024-09-19T08:47:17.192 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31258 ms_dispat ceph NOFD /proc/31221/task/31258/fd (opendir: Permission denied) 2024-09-19T08:47:17.192 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31259 ms_local ceph cwd unknown /proc/31221/task/31259/cwd (readlink: Permission denied) 2024-09-19T08:47:17.192 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31259 ms_local ceph rtd unknown /proc/31221/task/31259/root (readlink: Permission denied) 2024-09-19T08:47:17.192 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31259 ms_local ceph txt unknown /proc/31221/task/31259/exe (readlink: Permission denied) 2024-09-19T08:47:17.192 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 31259 ms_local ceph NOFD /proc/31221/task/31259/fd (opendir: Permission denied) 2024-09-19T08:47:17.192 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 69952 rstore_co ceph cwd unknown /proc/31221/task/69952/cwd (readlink: Permission denied) 2024-09-19T08:47:17.192 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 69952 rstore_co ceph rtd unknown /proc/31221/task/69952/root (readlink: Permission denied) 2024-09-19T08:47:17.192 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 69952 rstore_co ceph txt unknown /proc/31221/task/69952/exe (readlink: Permission denied) 2024-09-19T08:47:17.192 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 31221 69952 rstore_co ceph NOFD /proc/31221/task/69952/fd (opendir: Permission denied) 2024-09-19T08:47:17.192 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 31445 root cwd unknown /proc/31445/cwd (readlink: Permission denied) 2024-09-19T08:47:17.192 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 31445 root rtd unknown /proc/31445/root (readlink: Permission denied) 2024-09-19T08:47:17.192 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 31445 root txt unknown /proc/31445/exe (readlink: Permission denied) 2024-09-19T08:47:17.193 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 31445 root NOFD /proc/31445/fd (opendir: Permission denied) 2024-09-19T08:47:17.193 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 31447 root cwd unknown /proc/31447/cwd (readlink: Permission denied) 2024-09-19T08:47:17.193 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 31447 root rtd unknown /proc/31447/root (readlink: Permission denied) 2024-09-19T08:47:17.193 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 31447 root txt unknown /proc/31447/exe (readlink: Permission denied) 2024-09-19T08:47:17.193 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 31447 root NOFD /proc/31447/fd (opendir: Permission denied) 2024-09-19T08:47:17.193 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 ceph cwd unknown /proc/31449/cwd (readlink: Permission denied) 2024-09-19T08:47:17.193 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 ceph rtd unknown /proc/31449/root (readlink: Permission denied) 2024-09-19T08:47:17.193 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 ceph txt unknown /proc/31449/exe (readlink: Permission denied) 2024-09-19T08:47:17.193 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 ceph NOFD /proc/31449/fd (opendir: Permission denied) 2024-09-19T08:47:17.193 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82429 log ceph cwd unknown /proc/31449/task/82429/cwd (readlink: Permission denied) 2024-09-19T08:47:17.193 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82429 log ceph rtd unknown /proc/31449/task/82429/root (readlink: Permission denied) 2024-09-19T08:47:17.193 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82429 log ceph txt unknown /proc/31449/task/82429/exe (readlink: Permission denied) 2024-09-19T08:47:17.193 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82429 log ceph NOFD /proc/31449/task/82429/fd (opendir: Permission denied) 2024-09-19T08:47:17.194 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82431 msgr-work ceph cwd unknown /proc/31449/task/82431/cwd (readlink: Permission denied) 2024-09-19T08:47:17.194 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82431 msgr-work ceph rtd unknown /proc/31449/task/82431/root (readlink: Permission denied) 2024-09-19T08:47:17.194 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82431 msgr-work ceph txt unknown /proc/31449/task/82431/exe (readlink: Permission denied) 2024-09-19T08:47:17.194 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82431 msgr-work ceph NOFD /proc/31449/task/82431/fd (opendir: Permission denied) 2024-09-19T08:47:17.194 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82432 msgr-work ceph cwd unknown /proc/31449/task/82432/cwd (readlink: Permission denied) 2024-09-19T08:47:17.194 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82432 msgr-work ceph rtd unknown /proc/31449/task/82432/root (readlink: Permission denied) 2024-09-19T08:47:17.194 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82432 msgr-work ceph txt unknown /proc/31449/task/82432/exe (readlink: Permission denied) 2024-09-19T08:47:17.194 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82432 msgr-work ceph NOFD /proc/31449/task/82432/fd (opendir: Permission denied) 2024-09-19T08:47:17.194 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82433 msgr-work ceph cwd unknown /proc/31449/task/82433/cwd (readlink: Permission denied) 2024-09-19T08:47:17.194 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82433 msgr-work ceph rtd unknown /proc/31449/task/82433/root (readlink: Permission denied) 2024-09-19T08:47:17.194 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82433 msgr-work ceph txt unknown /proc/31449/task/82433/exe (readlink: Permission denied) 2024-09-19T08:47:17.194 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82433 msgr-work ceph NOFD /proc/31449/task/82433/fd (opendir: Permission denied) 2024-09-19T08:47:17.194 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82444 service ceph cwd unknown /proc/31449/task/82444/cwd (readlink: Permission denied) 2024-09-19T08:47:17.194 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82444 service ceph rtd unknown /proc/31449/task/82444/root (readlink: Permission denied) 2024-09-19T08:47:17.195 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82444 service ceph txt unknown /proc/31449/task/82444/exe (readlink: Permission denied) 2024-09-19T08:47:17.195 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82444 service ceph NOFD /proc/31449/task/82444/fd (opendir: Permission denied) 2024-09-19T08:47:17.195 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82445 admin_soc ceph cwd unknown /proc/31449/task/82445/cwd (readlink: Permission denied) 2024-09-19T08:47:17.195 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82445 admin_soc ceph rtd unknown /proc/31449/task/82445/root (readlink: Permission denied) 2024-09-19T08:47:17.195 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82445 admin_soc ceph txt unknown /proc/31449/task/82445/exe (readlink: Permission denied) 2024-09-19T08:47:17.195 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82445 admin_soc ceph NOFD /proc/31449/task/82445/fd (opendir: Permission denied) 2024-09-19T08:47:17.195 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82447 ceph_time ceph cwd unknown /proc/31449/task/82447/cwd (readlink: Permission denied) 2024-09-19T08:47:17.195 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82447 ceph_time ceph rtd unknown /proc/31449/task/82447/root (readlink: Permission denied) 2024-09-19T08:47:17.195 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82447 ceph_time ceph txt unknown /proc/31449/task/82447/exe (readlink: Permission denied) 2024-09-19T08:47:17.195 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82447 ceph_time ceph NOFD /proc/31449/task/82447/fd (opendir: Permission denied) 2024-09-19T08:47:17.195 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82448 fn_anonym ceph cwd unknown /proc/31449/task/82448/cwd (readlink: Permission denied) 2024-09-19T08:47:17.195 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82448 fn_anonym ceph rtd unknown /proc/31449/task/82448/root (readlink: Permission denied) 2024-09-19T08:47:17.195 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82448 fn_anonym ceph txt unknown /proc/31449/task/82448/exe (readlink: Permission denied) 2024-09-19T08:47:17.195 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82448 fn_anonym ceph NOFD /proc/31449/task/82448/fd (opendir: Permission denied) 2024-09-19T08:47:17.196 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82449 signal_ha ceph cwd unknown /proc/31449/task/82449/cwd (readlink: Permission denied) 2024-09-19T08:47:17.196 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82449 signal_ha ceph rtd unknown /proc/31449/task/82449/root (readlink: Permission denied) 2024-09-19T08:47:17.196 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82449 signal_ha ceph txt unknown /proc/31449/task/82449/exe (readlink: Permission denied) 2024-09-19T08:47:17.196 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82449 signal_ha ceph NOFD /proc/31449/task/82449/fd (opendir: Permission denied) 2024-09-19T08:47:17.196 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82450 mgrsb-fin ceph cwd unknown /proc/31449/task/82450/cwd (readlink: Permission denied) 2024-09-19T08:47:17.196 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82450 mgrsb-fin ceph rtd unknown /proc/31449/task/82450/root (readlink: Permission denied) 2024-09-19T08:47:17.196 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82450 mgrsb-fin ceph txt unknown /proc/31449/task/82450/exe (readlink: Permission denied) 2024-09-19T08:47:17.196 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82450 mgrsb-fin ceph NOFD /proc/31449/task/82450/fd (opendir: Permission denied) 2024-09-19T08:47:17.196 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82451 ms_dispat ceph cwd unknown /proc/31449/task/82451/cwd (readlink: Permission denied) 2024-09-19T08:47:17.196 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82451 ms_dispat ceph rtd unknown /proc/31449/task/82451/root (readlink: Permission denied) 2024-09-19T08:47:17.196 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82451 ms_dispat ceph txt unknown /proc/31449/task/82451/exe (readlink: Permission denied) 2024-09-19T08:47:17.196 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82451 ms_dispat ceph NOFD /proc/31449/task/82451/fd (opendir: Permission denied) 2024-09-19T08:47:17.196 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82452 ms_local ceph cwd unknown /proc/31449/task/82452/cwd (readlink: Permission denied) 2024-09-19T08:47:17.197 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82452 ms_local ceph rtd unknown /proc/31449/task/82452/root (readlink: Permission denied) 2024-09-19T08:47:17.197 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82452 ms_local ceph txt unknown /proc/31449/task/82452/exe (readlink: Permission denied) 2024-09-19T08:47:17.197 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82452 ms_local ceph NOFD /proc/31449/task/82452/fd (opendir: Permission denied) 2024-09-19T08:47:17.197 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82453 io_contex ceph cwd unknown /proc/31449/task/82453/cwd (readlink: Permission denied) 2024-09-19T08:47:17.197 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82453 io_contex ceph rtd unknown /proc/31449/task/82453/root (readlink: Permission denied) 2024-09-19T08:47:17.197 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82453 io_contex ceph txt unknown /proc/31449/task/82453/exe (readlink: Permission denied) 2024-09-19T08:47:17.197 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82453 io_contex ceph NOFD /proc/31449/task/82453/fd (opendir: Permission denied) 2024-09-19T08:47:17.197 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82454 io_contex ceph cwd unknown /proc/31449/task/82454/cwd (readlink: Permission denied) 2024-09-19T08:47:17.197 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82454 io_contex ceph rtd unknown /proc/31449/task/82454/root (readlink: Permission denied) 2024-09-19T08:47:17.198 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82454 io_contex ceph txt unknown /proc/31449/task/82454/exe (readlink: Permission denied) 2024-09-19T08:47:17.198 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82454 io_contex ceph NOFD /proc/31449/task/82454/fd (opendir: Permission denied) 2024-09-19T08:47:17.198 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82455 safe_time ceph cwd unknown /proc/31449/task/82455/cwd (readlink: Permission denied) 2024-09-19T08:47:17.198 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82455 safe_time ceph rtd unknown /proc/31449/task/82455/root (readlink: Permission denied) 2024-09-19T08:47:17.198 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82455 safe_time ceph txt unknown /proc/31449/task/82455/exe (readlink: Permission denied) 2024-09-19T08:47:17.198 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82455 safe_time ceph NOFD /proc/31449/task/82455/fd (opendir: Permission denied) 2024-09-19T08:47:17.198 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82456 safe_time ceph cwd unknown /proc/31449/task/82456/cwd (readlink: Permission denied) 2024-09-19T08:47:17.198 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82456 safe_time ceph rtd unknown /proc/31449/task/82456/root (readlink: Permission denied) 2024-09-19T08:47:17.198 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82456 safe_time ceph txt unknown /proc/31449/task/82456/exe (readlink: Permission denied) 2024-09-19T08:47:17.198 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82456 safe_time ceph NOFD /proc/31449/task/82456/fd (opendir: Permission denied) 2024-09-19T08:47:17.198 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82459 safe_time ceph cwd unknown /proc/31449/task/82459/cwd (readlink: Permission denied) 2024-09-19T08:47:17.198 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82459 safe_time ceph rtd unknown /proc/31449/task/82459/root (readlink: Permission denied) 2024-09-19T08:47:17.198 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82459 safe_time ceph txt unknown /proc/31449/task/82459/exe (readlink: Permission denied) 2024-09-19T08:47:17.199 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82459 safe_time ceph NOFD /proc/31449/task/82459/fd (opendir: Permission denied) 2024-09-19T08:47:17.199 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82460 fn_anonym ceph cwd unknown /proc/31449/task/82460/cwd (readlink: Permission denied) 2024-09-19T08:47:17.199 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82460 fn_anonym ceph rtd unknown /proc/31449/task/82460/root (readlink: Permission denied) 2024-09-19T08:47:17.199 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82460 fn_anonym ceph txt unknown /proc/31449/task/82460/exe (readlink: Permission denied) 2024-09-19T08:47:17.199 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82460 fn_anonym ceph NOFD /proc/31449/task/82460/fd (opendir: Permission denied) 2024-09-19T08:47:17.199 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82461 flusher ceph cwd unknown /proc/31449/task/82461/cwd (readlink: Permission denied) 2024-09-19T08:47:17.199 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82461 flusher ceph rtd unknown /proc/31449/task/82461/root (readlink: Permission denied) 2024-09-19T08:47:17.199 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82461 flusher ceph txt unknown /proc/31449/task/82461/exe (readlink: Permission denied) 2024-09-19T08:47:17.199 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82461 flusher ceph NOFD /proc/31449/task/82461/fd (opendir: Permission denied) 2024-09-19T08:47:17.199 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82462 safe_time ceph cwd unknown /proc/31449/task/82462/cwd (readlink: Permission denied) 2024-09-19T08:47:17.199 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82462 safe_time ceph rtd unknown /proc/31449/task/82462/root (readlink: Permission denied) 2024-09-19T08:47:17.199 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82462 safe_time ceph txt unknown /proc/31449/task/82462/exe (readlink: Permission denied) 2024-09-19T08:47:17.199 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82462 safe_time ceph NOFD /proc/31449/task/82462/fd (opendir: Permission denied) 2024-09-19T08:47:17.199 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82949 OpHistory ceph cwd unknown /proc/31449/task/82949/cwd (readlink: Permission denied) 2024-09-19T08:47:17.200 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82949 OpHistory ceph rtd unknown /proc/31449/task/82949/root (readlink: Permission denied) 2024-09-19T08:47:17.200 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82949 OpHistory ceph txt unknown /proc/31449/task/82949/exe (readlink: Permission denied) 2024-09-19T08:47:17.200 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82949 OpHistory ceph NOFD /proc/31449/task/82949/fd (opendir: Permission denied) 2024-09-19T08:47:17.200 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82950 mgr-fin ceph cwd unknown /proc/31449/task/82950/cwd (readlink: Permission denied) 2024-09-19T08:47:17.200 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82950 mgr-fin ceph rtd unknown /proc/31449/task/82950/root (readlink: Permission denied) 2024-09-19T08:47:17.200 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82950 mgr-fin ceph txt unknown /proc/31449/task/82950/exe (readlink: Permission denied) 2024-09-19T08:47:17.200 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82950 mgr-fin ceph NOFD /proc/31449/task/82950/fd (opendir: Permission denied) 2024-09-19T08:47:17.200 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82951 ms_dispat ceph cwd unknown /proc/31449/task/82951/cwd (readlink: Permission denied) 2024-09-19T08:47:17.200 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82951 ms_dispat ceph rtd unknown /proc/31449/task/82951/root (readlink: Permission denied) 2024-09-19T08:47:17.200 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82951 ms_dispat ceph txt unknown /proc/31449/task/82951/exe (readlink: Permission denied) 2024-09-19T08:47:17.200 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82951 ms_dispat ceph NOFD /proc/31449/task/82951/fd (opendir: Permission denied) 2024-09-19T08:47:17.200 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82952 ms_local ceph cwd unknown /proc/31449/task/82952/cwd (readlink: Permission denied) 2024-09-19T08:47:17.200 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82952 ms_local ceph rtd unknown /proc/31449/task/82952/root (readlink: Permission denied) 2024-09-19T08:47:17.201 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82952 ms_local ceph txt unknown /proc/31449/task/82952/exe (readlink: Permission denied) 2024-09-19T08:47:17.201 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82952 ms_local ceph NOFD /proc/31449/task/82952/fd (opendir: Permission denied) 2024-09-19T08:47:17.201 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82953 safe_time ceph cwd unknown /proc/31449/task/82953/cwd (readlink: Permission denied) 2024-09-19T08:47:17.201 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82953 safe_time ceph rtd unknown /proc/31449/task/82953/root (readlink: Permission denied) 2024-09-19T08:47:17.201 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82953 safe_time ceph txt unknown /proc/31449/task/82953/exe (readlink: Permission denied) 2024-09-19T08:47:17.201 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82953 safe_time ceph NOFD /proc/31449/task/82953/fd (opendir: Permission denied) 2024-09-19T08:47:17.201 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82954 cmdfin ceph cwd unknown /proc/31449/task/82954/cwd (readlink: Permission denied) 2024-09-19T08:47:17.201 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82954 cmdfin ceph rtd unknown /proc/31449/task/82954/root (readlink: Permission denied) 2024-09-19T08:47:17.201 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82954 cmdfin ceph txt unknown /proc/31449/task/82954/exe (readlink: Permission denied) 2024-09-19T08:47:17.201 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82954 cmdfin ceph NOFD /proc/31449/task/82954/fd (opendir: Permission denied) 2024-09-19T08:47:17.201 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82961 io_contex ceph cwd unknown /proc/31449/task/82961/cwd (readlink: Permission denied) 2024-09-19T08:47:17.201 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82961 io_contex ceph rtd unknown /proc/31449/task/82961/root (readlink: Permission denied) 2024-09-19T08:47:17.201 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82961 io_contex ceph txt unknown /proc/31449/task/82961/exe (readlink: Permission denied) 2024-09-19T08:47:17.202 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82961 io_contex ceph NOFD /proc/31449/task/82961/fd (opendir: Permission denied) 2024-09-19T08:47:17.202 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82962 io_contex ceph cwd unknown /proc/31449/task/82962/cwd (readlink: Permission denied) 2024-09-19T08:47:17.202 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82962 io_contex ceph rtd unknown /proc/31449/task/82962/root (readlink: Permission denied) 2024-09-19T08:47:17.202 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82962 io_contex ceph txt unknown /proc/31449/task/82962/exe (readlink: Permission denied) 2024-09-19T08:47:17.202 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82962 io_contex ceph NOFD /proc/31449/task/82962/fd (opendir: Permission denied) 2024-09-19T08:47:17.202 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82963 ceph_time ceph cwd unknown /proc/31449/task/82963/cwd (readlink: Permission denied) 2024-09-19T08:47:17.202 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82963 ceph_time ceph rtd unknown /proc/31449/task/82963/root (readlink: Permission denied) 2024-09-19T08:47:17.202 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82963 ceph_time ceph txt unknown /proc/31449/task/82963/exe (readlink: Permission denied) 2024-09-19T08:47:17.202 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82963 ceph_time ceph NOFD /proc/31449/task/82963/fd (opendir: Permission denied) 2024-09-19T08:47:17.202 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82964 ms_dispat ceph cwd unknown /proc/31449/task/82964/cwd (readlink: Permission denied) 2024-09-19T08:47:17.202 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82964 ms_dispat ceph rtd unknown /proc/31449/task/82964/root (readlink: Permission denied) 2024-09-19T08:47:17.202 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82964 ms_dispat ceph txt unknown /proc/31449/task/82964/exe (readlink: Permission denied) 2024-09-19T08:47:17.202 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82964 ms_dispat ceph NOFD /proc/31449/task/82964/fd (opendir: Permission denied) 2024-09-19T08:47:17.202 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82965 ms_local ceph cwd unknown /proc/31449/task/82965/cwd (readlink: Permission denied) 2024-09-19T08:47:17.203 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82965 ms_local ceph rtd unknown /proc/31449/task/82965/root (readlink: Permission denied) 2024-09-19T08:47:17.203 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82965 ms_local ceph txt unknown /proc/31449/task/82965/exe (readlink: Permission denied) 2024-09-19T08:47:17.203 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82965 ms_local ceph NOFD /proc/31449/task/82965/fd (opendir: Permission denied) 2024-09-19T08:47:17.203 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82966 safe_time ceph cwd unknown /proc/31449/task/82966/cwd (readlink: Permission denied) 2024-09-19T08:47:17.203 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82966 safe_time ceph rtd unknown /proc/31449/task/82966/root (readlink: Permission denied) 2024-09-19T08:47:17.203 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82966 safe_time ceph txt unknown /proc/31449/task/82966/exe (readlink: Permission denied) 2024-09-19T08:47:17.203 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82966 safe_time ceph NOFD /proc/31449/task/82966/fd (opendir: Permission denied) 2024-09-19T08:47:17.203 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82970 safe_time ceph cwd unknown /proc/31449/task/82970/cwd (readlink: Permission denied) 2024-09-19T08:47:17.203 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82970 safe_time ceph rtd unknown /proc/31449/task/82970/root (readlink: Permission denied) 2024-09-19T08:47:17.203 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82970 safe_time ceph txt unknown /proc/31449/task/82970/exe (readlink: Permission denied) 2024-09-19T08:47:17.203 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82970 safe_time ceph NOFD /proc/31449/task/82970/fd (opendir: Permission denied) 2024-09-19T08:47:17.203 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82972 balancer ceph cwd unknown /proc/31449/task/82972/cwd (readlink: Permission denied) 2024-09-19T08:47:17.203 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82972 balancer ceph rtd unknown /proc/31449/task/82972/root (readlink: Permission denied) 2024-09-19T08:47:17.203 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82972 balancer ceph txt unknown /proc/31449/task/82972/exe (readlink: Permission denied) 2024-09-19T08:47:17.204 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82972 balancer ceph NOFD /proc/31449/task/82972/fd (opendir: Permission denied) 2024-09-19T08:47:17.204 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82973 m-fin-bal ceph cwd unknown /proc/31449/task/82973/cwd (readlink: Permission denied) 2024-09-19T08:47:17.204 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82973 m-fin-bal ceph rtd unknown /proc/31449/task/82973/root (readlink: Permission denied) 2024-09-19T08:47:17.204 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82973 m-fin-bal ceph txt unknown /proc/31449/task/82973/exe (readlink: Permission denied) 2024-09-19T08:47:17.204 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82973 m-fin-bal ceph NOFD /proc/31449/task/82973/fd (opendir: Permission denied) 2024-09-19T08:47:17.204 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82984 mgr-fin ceph cwd unknown /proc/31449/task/82984/cwd (readlink: Permission denied) 2024-09-19T08:47:17.204 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82984 mgr-fin ceph rtd unknown /proc/31449/task/82984/root (readlink: Permission denied) 2024-09-19T08:47:17.204 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82984 mgr-fin ceph txt unknown /proc/31449/task/82984/exe (readlink: Permission denied) 2024-09-19T08:47:17.204 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82984 mgr-fin ceph NOFD /proc/31449/task/82984/fd (opendir: Permission denied) 2024-09-19T08:47:17.204 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82985 mgr-fin ceph cwd unknown /proc/31449/task/82985/cwd (readlink: Permission denied) 2024-09-19T08:47:17.204 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82985 mgr-fin ceph rtd unknown /proc/31449/task/82985/root (readlink: Permission denied) 2024-09-19T08:47:17.204 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82985 mgr-fin ceph txt unknown /proc/31449/task/82985/exe (readlink: Permission denied) 2024-09-19T08:47:17.205 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82985 mgr-fin ceph NOFD /proc/31449/task/82985/fd (opendir: Permission denied) 2024-09-19T08:47:17.205 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82986 mgr-fin ceph cwd unknown /proc/31449/task/82986/cwd (readlink: Permission denied) 2024-09-19T08:47:17.205 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82986 mgr-fin ceph rtd unknown /proc/31449/task/82986/root (readlink: Permission denied) 2024-09-19T08:47:17.205 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82986 mgr-fin ceph txt unknown /proc/31449/task/82986/exe (readlink: Permission denied) 2024-09-19T08:47:17.205 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82986 mgr-fin ceph NOFD /proc/31449/task/82986/fd (opendir: Permission denied) 2024-09-19T08:47:17.205 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82987 mgr-fin ceph cwd unknown /proc/31449/task/82987/cwd (readlink: Permission denied) 2024-09-19T08:47:17.205 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82987 mgr-fin ceph rtd unknown /proc/31449/task/82987/root (readlink: Permission denied) 2024-09-19T08:47:17.205 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82987 mgr-fin ceph txt unknown /proc/31449/task/82987/exe (readlink: Permission denied) 2024-09-19T08:47:17.205 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82987 mgr-fin ceph NOFD /proc/31449/task/82987/fd (opendir: Permission denied) 2024-09-19T08:47:17.205 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82988 mgr-fin ceph cwd unknown /proc/31449/task/82988/cwd (readlink: Permission denied) 2024-09-19T08:47:17.205 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82988 mgr-fin ceph rtd unknown /proc/31449/task/82988/root (readlink: Permission denied) 2024-09-19T08:47:17.205 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82988 mgr-fin ceph txt unknown /proc/31449/task/82988/exe (readlink: Permission denied) 2024-09-19T08:47:17.205 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82988 mgr-fin ceph NOFD /proc/31449/task/82988/fd (opendir: Permission denied) 2024-09-19T08:47:17.206 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82989 mgr-fin ceph cwd unknown /proc/31449/task/82989/cwd (readlink: Permission denied) 2024-09-19T08:47:17.206 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82989 mgr-fin ceph rtd unknown /proc/31449/task/82989/root (readlink: Permission denied) 2024-09-19T08:47:17.206 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82989 mgr-fin ceph txt unknown /proc/31449/task/82989/exe (readlink: Permission denied) 2024-09-19T08:47:17.206 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82989 mgr-fin ceph NOFD /proc/31449/task/82989/fd (opendir: Permission denied) 2024-09-19T08:47:17.206 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82990 mgr-fin ceph cwd unknown /proc/31449/task/82990/cwd (readlink: Permission denied) 2024-09-19T08:47:17.206 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82990 mgr-fin ceph rtd unknown /proc/31449/task/82990/root (readlink: Permission denied) 2024-09-19T08:47:17.206 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82990 mgr-fin ceph txt unknown /proc/31449/task/82990/exe (readlink: Permission denied) 2024-09-19T08:47:17.206 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82990 mgr-fin ceph NOFD /proc/31449/task/82990/fd (opendir: Permission denied) 2024-09-19T08:47:17.206 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82991 mgr-fin ceph cwd unknown /proc/31449/task/82991/cwd (readlink: Permission denied) 2024-09-19T08:47:17.206 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82991 mgr-fin ceph rtd unknown /proc/31449/task/82991/root (readlink: Permission denied) 2024-09-19T08:47:17.206 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82991 mgr-fin ceph txt unknown /proc/31449/task/82991/exe (readlink: Permission denied) 2024-09-19T08:47:17.206 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82991 mgr-fin ceph NOFD /proc/31449/task/82991/fd (opendir: Permission denied) 2024-09-19T08:47:17.206 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82992 mgr-fin ceph cwd unknown /proc/31449/task/82992/cwd (readlink: Permission denied) 2024-09-19T08:47:17.206 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82992 mgr-fin ceph rtd unknown /proc/31449/task/82992/root (readlink: Permission denied) 2024-09-19T08:47:17.207 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82992 mgr-fin ceph txt unknown /proc/31449/task/82992/exe (readlink: Permission denied) 2024-09-19T08:47:17.207 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82992 mgr-fin ceph NOFD /proc/31449/task/82992/fd (opendir: Permission denied) 2024-09-19T08:47:17.207 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82993 mgr-fin ceph cwd unknown /proc/31449/task/82993/cwd (readlink: Permission denied) 2024-09-19T08:47:17.207 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82993 mgr-fin ceph rtd unknown /proc/31449/task/82993/root (readlink: Permission denied) 2024-09-19T08:47:17.207 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82993 mgr-fin ceph txt unknown /proc/31449/task/82993/exe (readlink: Permission denied) 2024-09-19T08:47:17.207 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82993 mgr-fin ceph NOFD /proc/31449/task/82993/fd (opendir: Permission denied) 2024-09-19T08:47:17.207 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82994 mgr-fin ceph cwd unknown /proc/31449/task/82994/cwd (readlink: Permission denied) 2024-09-19T08:47:17.207 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82994 mgr-fin ceph rtd unknown /proc/31449/task/82994/root (readlink: Permission denied) 2024-09-19T08:47:17.207 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82994 mgr-fin ceph txt unknown /proc/31449/task/82994/exe (readlink: Permission denied) 2024-09-19T08:47:17.207 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82994 mgr-fin ceph NOFD /proc/31449/task/82994/fd (opendir: Permission denied) 2024-09-19T08:47:17.207 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82995 mgr-fin ceph cwd unknown /proc/31449/task/82995/cwd (readlink: Permission denied) 2024-09-19T08:47:17.207 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82995 mgr-fin ceph rtd unknown /proc/31449/task/82995/root (readlink: Permission denied) 2024-09-19T08:47:17.207 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82995 mgr-fin ceph txt unknown /proc/31449/task/82995/exe (readlink: Permission denied) 2024-09-19T08:47:17.207 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82995 mgr-fin ceph NOFD /proc/31449/task/82995/fd (opendir: Permission denied) 2024-09-19T08:47:17.208 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82996 mgr-fin ceph cwd unknown /proc/31449/task/82996/cwd (readlink: Permission denied) 2024-09-19T08:47:17.208 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82996 mgr-fin ceph rtd unknown /proc/31449/task/82996/root (readlink: Permission denied) 2024-09-19T08:47:17.208 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82996 mgr-fin ceph txt unknown /proc/31449/task/82996/exe (readlink: Permission denied) 2024-09-19T08:47:17.208 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82996 mgr-fin ceph NOFD /proc/31449/task/82996/fd (opendir: Permission denied) 2024-09-19T08:47:17.208 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82997 mgr-fin ceph cwd unknown /proc/31449/task/82997/cwd (readlink: Permission denied) 2024-09-19T08:47:17.208 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82997 mgr-fin ceph rtd unknown /proc/31449/task/82997/root (readlink: Permission denied) 2024-09-19T08:47:17.208 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82997 mgr-fin ceph txt unknown /proc/31449/task/82997/exe (readlink: Permission denied) 2024-09-19T08:47:17.208 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82997 mgr-fin ceph NOFD /proc/31449/task/82997/fd (opendir: Permission denied) 2024-09-19T08:47:17.208 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82998 mgr-fin ceph cwd unknown /proc/31449/task/82998/cwd (readlink: Permission denied) 2024-09-19T08:47:17.208 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82998 mgr-fin ceph rtd unknown /proc/31449/task/82998/root (readlink: Permission denied) 2024-09-19T08:47:17.208 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82998 mgr-fin ceph txt unknown /proc/31449/task/82998/exe (readlink: Permission denied) 2024-09-19T08:47:17.208 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82998 mgr-fin ceph NOFD /proc/31449/task/82998/fd (opendir: Permission denied) 2024-09-19T08:47:17.209 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82999 mgr-fin ceph cwd unknown /proc/31449/task/82999/cwd (readlink: Permission denied) 2024-09-19T08:47:17.209 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82999 mgr-fin ceph rtd unknown /proc/31449/task/82999/root (readlink: Permission denied) 2024-09-19T08:47:17.209 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82999 mgr-fin ceph txt unknown /proc/31449/task/82999/exe (readlink: Permission denied) 2024-09-19T08:47:17.209 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 82999 mgr-fin ceph NOFD /proc/31449/task/82999/fd (opendir: Permission denied) 2024-09-19T08:47:17.209 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83000 mgr-fin ceph cwd unknown /proc/31449/task/83000/cwd (readlink: Permission denied) 2024-09-19T08:47:17.209 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83000 mgr-fin ceph rtd unknown /proc/31449/task/83000/root (readlink: Permission denied) 2024-09-19T08:47:17.209 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83000 mgr-fin ceph txt unknown /proc/31449/task/83000/exe (readlink: Permission denied) 2024-09-19T08:47:17.209 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83000 mgr-fin ceph NOFD /proc/31449/task/83000/fd (opendir: Permission denied) 2024-09-19T08:47:17.209 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83001 mgr-fin ceph cwd unknown /proc/31449/task/83001/cwd (readlink: Permission denied) 2024-09-19T08:47:17.209 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83001 mgr-fin ceph rtd unknown /proc/31449/task/83001/root (readlink: Permission denied) 2024-09-19T08:47:17.209 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83001 mgr-fin ceph txt unknown /proc/31449/task/83001/exe (readlink: Permission denied) 2024-09-19T08:47:17.209 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83001 mgr-fin ceph NOFD /proc/31449/task/83001/fd (opendir: Permission denied) 2024-09-19T08:47:17.209 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83002 cephadm ceph cwd unknown /proc/31449/task/83002/cwd (readlink: Permission denied) 2024-09-19T08:47:17.209 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83002 cephadm ceph rtd unknown /proc/31449/task/83002/root (readlink: Permission denied) 2024-09-19T08:47:17.210 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83002 cephadm ceph txt unknown /proc/31449/task/83002/exe (readlink: Permission denied) 2024-09-19T08:47:17.210 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83002 cephadm ceph NOFD /proc/31449/task/83002/fd (opendir: Permission denied) 2024-09-19T08:47:17.210 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83003 mgr-fin ceph cwd unknown /proc/31449/task/83003/cwd (readlink: Permission denied) 2024-09-19T08:47:17.210 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83003 mgr-fin ceph rtd unknown /proc/31449/task/83003/root (readlink: Permission denied) 2024-09-19T08:47:17.210 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83003 mgr-fin ceph txt unknown /proc/31449/task/83003/exe (readlink: Permission denied) 2024-09-19T08:47:17.210 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83003 mgr-fin ceph NOFD /proc/31449/task/83003/fd (opendir: Permission denied) 2024-09-19T08:47:17.210 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83004 m-fin-cep ceph cwd unknown /proc/31449/task/83004/cwd (readlink: Permission denied) 2024-09-19T08:47:17.210 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83004 m-fin-cep ceph rtd unknown /proc/31449/task/83004/root (readlink: Permission denied) 2024-09-19T08:47:17.210 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83004 m-fin-cep ceph txt unknown /proc/31449/task/83004/exe (readlink: Permission denied) 2024-09-19T08:47:17.210 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83004 m-fin-cep ceph NOFD /proc/31449/task/83004/fd (opendir: Permission denied) 2024-09-19T08:47:17.210 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83005 mgr-fin ceph cwd unknown /proc/31449/task/83005/cwd (readlink: Permission denied) 2024-09-19T08:47:17.210 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83005 mgr-fin ceph rtd unknown /proc/31449/task/83005/root (readlink: Permission denied) 2024-09-19T08:47:17.210 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83005 mgr-fin ceph txt unknown /proc/31449/task/83005/exe (readlink: Permission denied) 2024-09-19T08:47:17.210 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83005 mgr-fin ceph NOFD /proc/31449/task/83005/fd (opendir: Permission denied) 2024-09-19T08:47:17.211 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83006 mgr-fin ceph cwd unknown /proc/31449/task/83006/cwd (readlink: Permission denied) 2024-09-19T08:47:17.211 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83006 mgr-fin ceph rtd unknown /proc/31449/task/83006/root (readlink: Permission denied) 2024-09-19T08:47:17.211 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83006 mgr-fin ceph txt unknown /proc/31449/task/83006/exe (readlink: Permission denied) 2024-09-19T08:47:17.211 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83006 mgr-fin ceph NOFD /proc/31449/task/83006/fd (opendir: Permission denied) 2024-09-19T08:47:17.211 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83007 mgr-fin ceph cwd unknown /proc/31449/task/83007/cwd (readlink: Permission denied) 2024-09-19T08:47:17.211 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83007 mgr-fin ceph rtd unknown /proc/31449/task/83007/root (readlink: Permission denied) 2024-09-19T08:47:17.211 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83007 mgr-fin ceph txt unknown /proc/31449/task/83007/exe (readlink: Permission denied) 2024-09-19T08:47:17.211 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83007 mgr-fin ceph NOFD /proc/31449/task/83007/fd (opendir: Permission denied) 2024-09-19T08:47:17.211 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83008 crash ceph cwd unknown /proc/31449/task/83008/cwd (readlink: Permission denied) 2024-09-19T08:47:17.211 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83008 crash ceph rtd unknown /proc/31449/task/83008/root (readlink: Permission denied) 2024-09-19T08:47:17.211 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83008 crash ceph txt unknown /proc/31449/task/83008/exe (readlink: Permission denied) 2024-09-19T08:47:17.211 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83008 crash ceph NOFD /proc/31449/task/83008/fd (opendir: Permission denied) 2024-09-19T08:47:17.211 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83009 mgr-fin ceph cwd unknown /proc/31449/task/83009/cwd (readlink: Permission denied) 2024-09-19T08:47:17.212 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83009 mgr-fin ceph rtd unknown /proc/31449/task/83009/root (readlink: Permission denied) 2024-09-19T08:47:17.212 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83009 mgr-fin ceph txt unknown /proc/31449/task/83009/exe (readlink: Permission denied) 2024-09-19T08:47:17.212 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83009 mgr-fin ceph NOFD /proc/31449/task/83009/fd (opendir: Permission denied) 2024-09-19T08:47:17.212 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83010 m-fin-cra ceph cwd unknown /proc/31449/task/83010/cwd (readlink: Permission denied) 2024-09-19T08:47:17.212 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83010 m-fin-cra ceph rtd unknown /proc/31449/task/83010/root (readlink: Permission denied) 2024-09-19T08:47:17.212 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83010 m-fin-cra ceph txt unknown /proc/31449/task/83010/exe (readlink: Permission denied) 2024-09-19T08:47:17.212 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83010 m-fin-cra ceph NOFD /proc/31449/task/83010/fd (opendir: Permission denied) 2024-09-19T08:47:17.212 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83011 cephadm ceph cwd unknown /proc/31449/task/83011/cwd (readlink: Permission denied) 2024-09-19T08:47:17.212 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83011 cephadm ceph rtd unknown /proc/31449/task/83011/root (readlink: Permission denied) 2024-09-19T08:47:17.212 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83011 cephadm ceph txt unknown /proc/31449/task/83011/exe (readlink: Permission denied) 2024-09-19T08:47:17.212 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83011 cephadm ceph NOFD /proc/31449/task/83011/fd (opendir: Permission denied) 2024-09-19T08:47:17.212 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83012 mgr-fin ceph cwd unknown /proc/31449/task/83012/cwd (readlink: Permission denied) 2024-09-19T08:47:17.212 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83012 mgr-fin ceph rtd unknown /proc/31449/task/83012/root (readlink: Permission denied) 2024-09-19T08:47:17.213 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83012 mgr-fin ceph txt unknown /proc/31449/task/83012/exe (readlink: Permission denied) 2024-09-19T08:47:17.213 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83012 mgr-fin ceph NOFD /proc/31449/task/83012/fd (opendir: Permission denied) 2024-09-19T08:47:17.213 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83013 dashboard ceph cwd unknown /proc/31449/task/83013/cwd (readlink: Permission denied) 2024-09-19T08:47:17.213 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83013 dashboard ceph rtd unknown /proc/31449/task/83013/root (readlink: Permission denied) 2024-09-19T08:47:17.213 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83013 dashboard ceph txt unknown /proc/31449/task/83013/exe (readlink: Permission denied) 2024-09-19T08:47:17.213 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83013 dashboard ceph NOFD /proc/31449/task/83013/fd (opendir: Permission denied) 2024-09-19T08:47:17.213 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83014 mgr-fin ceph cwd unknown /proc/31449/task/83014/cwd (readlink: Permission denied) 2024-09-19T08:47:17.213 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83014 mgr-fin ceph rtd unknown /proc/31449/task/83014/root (readlink: Permission denied) 2024-09-19T08:47:17.213 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83014 mgr-fin ceph txt unknown /proc/31449/task/83014/exe (readlink: Permission denied) 2024-09-19T08:47:17.213 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83014 mgr-fin ceph NOFD /proc/31449/task/83014/fd (opendir: Permission denied) 2024-09-19T08:47:17.213 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83015 m-fin-das ceph cwd unknown /proc/31449/task/83015/cwd (readlink: Permission denied) 2024-09-19T08:47:17.213 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83015 m-fin-das ceph rtd unknown /proc/31449/task/83015/root (readlink: Permission denied) 2024-09-19T08:47:17.213 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83015 m-fin-das ceph txt unknown /proc/31449/task/83015/exe (readlink: Permission denied) 2024-09-19T08:47:17.213 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83015 m-fin-das ceph NOFD /proc/31449/task/83015/fd (opendir: Permission denied) 2024-09-19T08:47:17.214 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83016 mgr-fin ceph cwd unknown /proc/31449/task/83016/cwd (readlink: Permission denied) 2024-09-19T08:47:17.214 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83016 mgr-fin ceph rtd unknown /proc/31449/task/83016/root (readlink: Permission denied) 2024-09-19T08:47:17.214 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83016 mgr-fin ceph txt unknown /proc/31449/task/83016/exe (readlink: Permission denied) 2024-09-19T08:47:17.214 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83016 mgr-fin ceph NOFD /proc/31449/task/83016/fd (opendir: Permission denied) 2024-09-19T08:47:17.214 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83017 devicehea ceph cwd unknown /proc/31449/task/83017/cwd (readlink: Permission denied) 2024-09-19T08:47:17.214 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83017 devicehea ceph rtd unknown /proc/31449/task/83017/root (readlink: Permission denied) 2024-09-19T08:47:17.214 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83017 devicehea ceph txt unknown /proc/31449/task/83017/exe (readlink: Permission denied) 2024-09-19T08:47:17.214 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83017 devicehea ceph NOFD /proc/31449/task/83017/fd (opendir: Permission denied) 2024-09-19T08:47:17.214 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83018 mgr-fin ceph cwd unknown /proc/31449/task/83018/cwd (readlink: Permission denied) 2024-09-19T08:47:17.214 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83018 mgr-fin ceph rtd unknown /proc/31449/task/83018/root (readlink: Permission denied) 2024-09-19T08:47:17.214 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83018 mgr-fin ceph txt unknown /proc/31449/task/83018/exe (readlink: Permission denied) 2024-09-19T08:47:17.214 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83018 mgr-fin ceph NOFD /proc/31449/task/83018/fd (opendir: Permission denied) 2024-09-19T08:47:17.214 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83019 m-fin-dev ceph cwd unknown /proc/31449/task/83019/cwd (readlink: Permission denied) 2024-09-19T08:47:17.214 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83019 m-fin-dev ceph rtd unknown /proc/31449/task/83019/root (readlink: Permission denied) 2024-09-19T08:47:17.215 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83019 m-fin-dev ceph txt unknown /proc/31449/task/83019/exe (readlink: Permission denied) 2024-09-19T08:47:17.215 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83019 m-fin-dev ceph NOFD /proc/31449/task/83019/fd (opendir: Permission denied) 2024-09-19T08:47:17.215 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83020 mgr-fin ceph cwd unknown /proc/31449/task/83020/cwd (readlink: Permission denied) 2024-09-19T08:47:17.215 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83020 mgr-fin ceph rtd unknown /proc/31449/task/83020/root (readlink: Permission denied) 2024-09-19T08:47:17.215 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83020 mgr-fin ceph txt unknown /proc/31449/task/83020/exe (readlink: Permission denied) 2024-09-19T08:47:17.215 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83020 mgr-fin ceph NOFD /proc/31449/task/83020/fd (opendir: Permission denied) 2024-09-19T08:47:17.215 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83022 m-fin-ios ceph cwd unknown /proc/31449/task/83022/cwd (readlink: Permission denied) 2024-09-19T08:47:17.215 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83022 m-fin-ios ceph rtd unknown /proc/31449/task/83022/root (readlink: Permission denied) 2024-09-19T08:47:17.215 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83022 m-fin-ios ceph txt unknown /proc/31449/task/83022/exe (readlink: Permission denied) 2024-09-19T08:47:17.215 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83022 m-fin-ios ceph NOFD /proc/31449/task/83022/fd (opendir: Permission denied) 2024-09-19T08:47:17.215 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83024 m-fin-nfs ceph cwd unknown /proc/31449/task/83024/cwd (readlink: Permission denied) 2024-09-19T08:47:17.215 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83024 m-fin-nfs ceph rtd unknown /proc/31449/task/83024/root (readlink: Permission denied) 2024-09-19T08:47:17.215 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83024 m-fin-nfs ceph txt unknown /proc/31449/task/83024/exe (readlink: Permission denied) 2024-09-19T08:47:17.215 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83024 m-fin-nfs ceph NOFD /proc/31449/task/83024/fd (opendir: Permission denied) 2024-09-19T08:47:17.216 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83025 cephadm ceph cwd unknown /proc/31449/task/83025/cwd (readlink: Permission denied) 2024-09-19T08:47:17.216 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83025 cephadm ceph rtd unknown /proc/31449/task/83025/root (readlink: Permission denied) 2024-09-19T08:47:17.216 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83025 cephadm ceph txt unknown /proc/31449/task/83025/exe (readlink: Permission denied) 2024-09-19T08:47:17.216 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83025 cephadm ceph NOFD /proc/31449/task/83025/fd (opendir: Permission denied) 2024-09-19T08:47:17.216 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83027 m-fin-orc ceph cwd unknown /proc/31449/task/83027/cwd (readlink: Permission denied) 2024-09-19T08:47:17.216 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83027 m-fin-orc ceph rtd unknown /proc/31449/task/83027/root (readlink: Permission denied) 2024-09-19T08:47:17.216 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83027 m-fin-orc ceph txt unknown /proc/31449/task/83027/exe (readlink: Permission denied) 2024-09-19T08:47:17.216 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83027 m-fin-orc ceph NOFD /proc/31449/task/83027/fd (opendir: Permission denied) 2024-09-19T08:47:17.216 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83029 pg_autosc ceph cwd unknown /proc/31449/task/83029/cwd (readlink: Permission denied) 2024-09-19T08:47:17.216 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83029 pg_autosc ceph rtd unknown /proc/31449/task/83029/root (readlink: Permission denied) 2024-09-19T08:47:17.216 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83029 pg_autosc ceph txt unknown /proc/31449/task/83029/exe (readlink: Permission denied) 2024-09-19T08:47:17.216 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83029 pg_autosc ceph NOFD /proc/31449/task/83029/fd (opendir: Permission denied) 2024-09-19T08:47:17.216 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83030 m-fin-pg_ ceph cwd unknown /proc/31449/task/83030/cwd (readlink: Permission denied) 2024-09-19T08:47:17.217 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83030 m-fin-pg_ ceph rtd unknown /proc/31449/task/83030/root (readlink: Permission denied) 2024-09-19T08:47:17.217 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83030 m-fin-pg_ ceph txt unknown /proc/31449/task/83030/exe (readlink: Permission denied) 2024-09-19T08:47:17.217 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83030 m-fin-pg_ ceph NOFD /proc/31449/task/83030/fd (opendir: Permission denied) 2024-09-19T08:47:17.217 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83031 progress ceph cwd unknown /proc/31449/task/83031/cwd (readlink: Permission denied) 2024-09-19T08:47:17.217 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83031 progress ceph rtd unknown /proc/31449/task/83031/root (readlink: Permission denied) 2024-09-19T08:47:17.217 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83031 progress ceph txt unknown /proc/31449/task/83031/exe (readlink: Permission denied) 2024-09-19T08:47:17.217 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83031 progress ceph NOFD /proc/31449/task/83031/fd (opendir: Permission denied) 2024-09-19T08:47:17.217 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83032 m-fin-pro ceph cwd unknown /proc/31449/task/83032/cwd (readlink: Permission denied) 2024-09-19T08:47:17.217 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83032 m-fin-pro ceph rtd unknown /proc/31449/task/83032/root (readlink: Permission denied) 2024-09-19T08:47:17.217 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83032 m-fin-pro ceph txt unknown /proc/31449/task/83032/exe (readlink: Permission denied) 2024-09-19T08:47:17.217 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83032 m-fin-pro ceph NOFD /proc/31449/task/83032/fd (opendir: Permission denied) 2024-09-19T08:47:17.217 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83033 cephadm ceph cwd unknown /proc/31449/task/83033/cwd (readlink: Permission denied) 2024-09-19T08:47:17.217 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83033 cephadm ceph rtd unknown /proc/31449/task/83033/root (readlink: Permission denied) 2024-09-19T08:47:17.218 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83033 cephadm ceph txt unknown /proc/31449/task/83033/exe (readlink: Permission denied) 2024-09-19T08:47:17.218 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83033 cephadm ceph NOFD /proc/31449/task/83033/fd (opendir: Permission denied) 2024-09-19T08:47:17.218 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83037 cephadm ceph cwd unknown /proc/31449/task/83037/cwd (readlink: Permission denied) 2024-09-19T08:47:17.218 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83037 cephadm ceph rtd unknown /proc/31449/task/83037/root (readlink: Permission denied) 2024-09-19T08:47:17.218 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83037 cephadm ceph txt unknown /proc/31449/task/83037/exe (readlink: Permission denied) 2024-09-19T08:47:17.218 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83037 cephadm ceph NOFD /proc/31449/task/83037/fd (opendir: Permission denied) 2024-09-19T08:47:17.218 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83038 io_contex ceph cwd unknown /proc/31449/task/83038/cwd (readlink: Permission denied) 2024-09-19T08:47:17.218 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83038 io_contex ceph rtd unknown /proc/31449/task/83038/root (readlink: Permission denied) 2024-09-19T08:47:17.218 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83038 io_contex ceph txt unknown /proc/31449/task/83038/exe (readlink: Permission denied) 2024-09-19T08:47:17.218 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83038 io_contex ceph NOFD /proc/31449/task/83038/fd (opendir: Permission denied) 2024-09-19T08:47:17.218 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83039 io_contex ceph cwd unknown /proc/31449/task/83039/cwd (readlink: Permission denied) 2024-09-19T08:47:17.218 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83039 io_contex ceph rtd unknown /proc/31449/task/83039/root (readlink: Permission denied) 2024-09-19T08:47:17.218 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83039 io_contex ceph txt unknown /proc/31449/task/83039/exe (readlink: Permission denied) 2024-09-19T08:47:17.219 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83039 io_contex ceph NOFD /proc/31449/task/83039/fd (opendir: Permission denied) 2024-09-19T08:47:17.219 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83040 ceph_time ceph cwd unknown /proc/31449/task/83040/cwd (readlink: Permission denied) 2024-09-19T08:47:17.219 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83040 ceph_time ceph rtd unknown /proc/31449/task/83040/root (readlink: Permission denied) 2024-09-19T08:47:17.219 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83040 ceph_time ceph txt unknown /proc/31449/task/83040/exe (readlink: Permission denied) 2024-09-19T08:47:17.219 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83040 ceph_time ceph NOFD /proc/31449/task/83040/fd (opendir: Permission denied) 2024-09-19T08:47:17.219 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83041 ms_dispat ceph cwd unknown /proc/31449/task/83041/cwd (readlink: Permission denied) 2024-09-19T08:47:17.219 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83041 ms_dispat ceph rtd unknown /proc/31449/task/83041/root (readlink: Permission denied) 2024-09-19T08:47:17.219 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83041 ms_dispat ceph txt unknown /proc/31449/task/83041/exe (readlink: Permission denied) 2024-09-19T08:47:17.219 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83041 ms_dispat ceph NOFD /proc/31449/task/83041/fd (opendir: Permission denied) 2024-09-19T08:47:17.219 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83042 ms_local ceph cwd unknown /proc/31449/task/83042/cwd (readlink: Permission denied) 2024-09-19T08:47:17.219 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83042 ms_local ceph rtd unknown /proc/31449/task/83042/root (readlink: Permission denied) 2024-09-19T08:47:17.219 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83042 ms_local ceph txt unknown /proc/31449/task/83042/exe (readlink: Permission denied) 2024-09-19T08:47:17.219 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83042 ms_local ceph NOFD /proc/31449/task/83042/fd (opendir: Permission denied) 2024-09-19T08:47:17.219 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83043 safe_time ceph cwd unknown /proc/31449/task/83043/cwd (readlink: Permission denied) 2024-09-19T08:47:17.220 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83043 safe_time ceph rtd unknown /proc/31449/task/83043/root (readlink: Permission denied) 2024-09-19T08:47:17.220 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83043 safe_time ceph txt unknown /proc/31449/task/83043/exe (readlink: Permission denied) 2024-09-19T08:47:17.220 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83043 safe_time ceph NOFD /proc/31449/task/83043/fd (opendir: Permission denied) 2024-09-19T08:47:17.220 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83044 safe_time ceph cwd unknown /proc/31449/task/83044/cwd (readlink: Permission denied) 2024-09-19T08:47:17.220 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83044 safe_time ceph rtd unknown /proc/31449/task/83044/root (readlink: Permission denied) 2024-09-19T08:47:17.220 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83044 safe_time ceph txt unknown /proc/31449/task/83044/exe (readlink: Permission denied) 2024-09-19T08:47:17.220 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83044 safe_time ceph NOFD /proc/31449/task/83044/fd (opendir: Permission denied) 2024-09-19T08:47:17.220 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83045 mgr-fin ceph cwd unknown /proc/31449/task/83045/cwd (readlink: Permission denied) 2024-09-19T08:47:17.220 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83045 mgr-fin ceph rtd unknown /proc/31449/task/83045/root (readlink: Permission denied) 2024-09-19T08:47:17.220 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83045 mgr-fin ceph txt unknown /proc/31449/task/83045/exe (readlink: Permission denied) 2024-09-19T08:47:17.220 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83045 mgr-fin ceph NOFD /proc/31449/task/83045/fd (opendir: Permission denied) 2024-09-19T08:47:17.220 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83047 m-fin-rbd ceph cwd unknown /proc/31449/task/83047/cwd (readlink: Permission denied) 2024-09-19T08:47:17.220 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83047 m-fin-rbd ceph rtd unknown /proc/31449/task/83047/root (readlink: Permission denied) 2024-09-19T08:47:17.220 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83047 m-fin-rbd ceph txt unknown /proc/31449/task/83047/exe (readlink: Permission denied) 2024-09-19T08:47:17.221 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83047 m-fin-rbd ceph NOFD /proc/31449/task/83047/fd (opendir: Permission denied) 2024-09-19T08:47:17.221 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83049 restful ceph cwd unknown /proc/31449/task/83049/cwd (readlink: Permission denied) 2024-09-19T08:47:17.221 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83049 restful ceph rtd unknown /proc/31449/task/83049/root (readlink: Permission denied) 2024-09-19T08:47:17.221 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83049 restful ceph txt unknown /proc/31449/task/83049/exe (readlink: Permission denied) 2024-09-19T08:47:17.221 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83049 restful ceph NOFD /proc/31449/task/83049/fd (opendir: Permission denied) 2024-09-19T08:47:17.221 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83050 m-fin-res ceph cwd unknown /proc/31449/task/83050/cwd (readlink: Permission denied) 2024-09-19T08:47:17.221 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83050 m-fin-res ceph rtd unknown /proc/31449/task/83050/root (readlink: Permission denied) 2024-09-19T08:47:17.221 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83050 m-fin-res ceph txt unknown /proc/31449/task/83050/exe (readlink: Permission denied) 2024-09-19T08:47:17.221 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83050 m-fin-res ceph NOFD /proc/31449/task/83050/fd (opendir: Permission denied) 2024-09-19T08:47:17.221 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83053 mgr-fin ceph cwd unknown /proc/31449/task/83053/cwd (readlink: Permission denied) 2024-09-19T08:47:17.221 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83053 mgr-fin ceph rtd unknown /proc/31449/task/83053/root (readlink: Permission denied) 2024-09-19T08:47:17.221 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83053 mgr-fin ceph txt unknown /proc/31449/task/83053/exe (readlink: Permission denied) 2024-09-19T08:47:17.221 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83053 mgr-fin ceph NOFD /proc/31449/task/83053/fd (opendir: Permission denied) 2024-09-19T08:47:17.221 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83058 mgr-fin ceph cwd unknown /proc/31449/task/83058/cwd (readlink: Permission denied) 2024-09-19T08:47:17.222 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83058 mgr-fin ceph rtd unknown /proc/31449/task/83058/root (readlink: Permission denied) 2024-09-19T08:47:17.222 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83058 mgr-fin ceph txt unknown /proc/31449/task/83058/exe (readlink: Permission denied) 2024-09-19T08:47:17.222 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83058 mgr-fin ceph NOFD /proc/31449/task/83058/fd (opendir: Permission denied) 2024-09-19T08:47:17.222 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83060 mgr-fin ceph cwd unknown /proc/31449/task/83060/cwd (readlink: Permission denied) 2024-09-19T08:47:17.222 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83060 mgr-fin ceph rtd unknown /proc/31449/task/83060/root (readlink: Permission denied) 2024-09-19T08:47:17.222 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83060 mgr-fin ceph txt unknown /proc/31449/task/83060/exe (readlink: Permission denied) 2024-09-19T08:47:17.222 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83060 mgr-fin ceph NOFD /proc/31449/task/83060/fd (opendir: Permission denied) 2024-09-19T08:47:17.222 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83066 mgr-fin ceph cwd unknown /proc/31449/task/83066/cwd (readlink: Permission denied) 2024-09-19T08:47:17.222 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83066 mgr-fin ceph rtd unknown /proc/31449/task/83066/root (readlink: Permission denied) 2024-09-19T08:47:17.222 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83066 mgr-fin ceph txt unknown /proc/31449/task/83066/exe (readlink: Permission denied) 2024-09-19T08:47:17.222 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83066 mgr-fin ceph NOFD /proc/31449/task/83066/fd (opendir: Permission denied) 2024-09-19T08:47:17.222 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83068 mgr-fin ceph cwd unknown /proc/31449/task/83068/cwd (readlink: Permission denied) 2024-09-19T08:47:17.222 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83068 mgr-fin ceph rtd unknown /proc/31449/task/83068/root (readlink: Permission denied) 2024-09-19T08:47:17.222 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83068 mgr-fin ceph txt unknown /proc/31449/task/83068/exe (readlink: Permission denied) 2024-09-19T08:47:17.223 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83068 mgr-fin ceph NOFD /proc/31449/task/83068/fd (opendir: Permission denied) 2024-09-19T08:47:17.223 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83071 mgr-fin ceph cwd unknown /proc/31449/task/83071/cwd (readlink: Permission denied) 2024-09-19T08:47:17.223 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83071 mgr-fin ceph rtd unknown /proc/31449/task/83071/root (readlink: Permission denied) 2024-09-19T08:47:17.223 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83071 mgr-fin ceph txt unknown /proc/31449/task/83071/exe (readlink: Permission denied) 2024-09-19T08:47:17.223 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83071 mgr-fin ceph NOFD /proc/31449/task/83071/fd (opendir: Permission denied) 2024-09-19T08:47:17.223 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83075 io_contex ceph cwd unknown /proc/31449/task/83075/cwd (readlink: Permission denied) 2024-09-19T08:47:17.223 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83075 io_contex ceph rtd unknown /proc/31449/task/83075/root (readlink: Permission denied) 2024-09-19T08:47:17.223 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83075 io_contex ceph txt unknown /proc/31449/task/83075/exe (readlink: Permission denied) 2024-09-19T08:47:17.223 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83075 io_contex ceph NOFD /proc/31449/task/83075/fd (opendir: Permission denied) 2024-09-19T08:47:17.223 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83076 io_contex ceph cwd unknown /proc/31449/task/83076/cwd (readlink: Permission denied) 2024-09-19T08:47:17.223 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83076 io_contex ceph rtd unknown /proc/31449/task/83076/root (readlink: Permission denied) 2024-09-19T08:47:17.223 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83076 io_contex ceph txt unknown /proc/31449/task/83076/exe (readlink: Permission denied) 2024-09-19T08:47:17.223 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83076 io_contex ceph NOFD /proc/31449/task/83076/fd (opendir: Permission denied) 2024-09-19T08:47:17.224 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83077 ceph_time ceph cwd unknown /proc/31449/task/83077/cwd (readlink: Permission denied) 2024-09-19T08:47:17.224 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83077 ceph_time ceph rtd unknown /proc/31449/task/83077/root (readlink: Permission denied) 2024-09-19T08:47:17.224 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83077 ceph_time ceph txt unknown /proc/31449/task/83077/exe (readlink: Permission denied) 2024-09-19T08:47:17.224 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83077 ceph_time ceph NOFD /proc/31449/task/83077/fd (opendir: Permission denied) 2024-09-19T08:47:17.224 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83078 ms_dispat ceph cwd unknown /proc/31449/task/83078/cwd (readlink: Permission denied) 2024-09-19T08:47:17.224 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83078 ms_dispat ceph rtd unknown /proc/31449/task/83078/root (readlink: Permission denied) 2024-09-19T08:47:17.224 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83078 ms_dispat ceph txt unknown /proc/31449/task/83078/exe (readlink: Permission denied) 2024-09-19T08:47:17.224 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83078 ms_dispat ceph NOFD /proc/31449/task/83078/fd (opendir: Permission denied) 2024-09-19T08:47:17.224 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83079 ms_local ceph cwd unknown /proc/31449/task/83079/cwd (readlink: Permission denied) 2024-09-19T08:47:17.224 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83079 ms_local ceph rtd unknown /proc/31449/task/83079/root (readlink: Permission denied) 2024-09-19T08:47:17.224 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83079 ms_local ceph txt unknown /proc/31449/task/83079/exe (readlink: Permission denied) 2024-09-19T08:47:17.224 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83079 ms_local ceph NOFD /proc/31449/task/83079/fd (opendir: Permission denied) 2024-09-19T08:47:17.224 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83080 safe_time ceph cwd unknown /proc/31449/task/83080/cwd (readlink: Permission denied) 2024-09-19T08:47:17.225 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83080 safe_time ceph rtd unknown /proc/31449/task/83080/root (readlink: Permission denied) 2024-09-19T08:47:17.225 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83080 safe_time ceph txt unknown /proc/31449/task/83080/exe (readlink: Permission denied) 2024-09-19T08:47:17.225 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83080 safe_time ceph NOFD /proc/31449/task/83080/fd (opendir: Permission denied) 2024-09-19T08:47:17.225 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83081 safe_time ceph cwd unknown /proc/31449/task/83081/cwd (readlink: Permission denied) 2024-09-19T08:47:17.225 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83081 safe_time ceph rtd unknown /proc/31449/task/83081/root (readlink: Permission denied) 2024-09-19T08:47:17.225 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83081 safe_time ceph txt unknown /proc/31449/task/83081/exe (readlink: Permission denied) 2024-09-19T08:47:17.225 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83081 safe_time ceph NOFD /proc/31449/task/83081/fd (opendir: Permission denied) 2024-09-19T08:47:17.225 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83118 m-fin-sna ceph cwd unknown /proc/31449/task/83118/cwd (readlink: Permission denied) 2024-09-19T08:47:17.225 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83118 m-fin-sna ceph rtd unknown /proc/31449/task/83118/root (readlink: Permission denied) 2024-09-19T08:47:17.225 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83118 m-fin-sna ceph txt unknown /proc/31449/task/83118/exe (readlink: Permission denied) 2024-09-19T08:47:17.225 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83118 m-fin-sna ceph NOFD /proc/31449/task/83118/fd (opendir: Permission denied) 2024-09-19T08:47:17.225 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83120 m-fin-sta ceph cwd unknown /proc/31449/task/83120/cwd (readlink: Permission denied) 2024-09-19T08:47:17.225 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83120 m-fin-sta ceph rtd unknown /proc/31449/task/83120/root (readlink: Permission denied) 2024-09-19T08:47:17.225 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83120 m-fin-sta ceph txt unknown /proc/31449/task/83120/exe (readlink: Permission denied) 2024-09-19T08:47:17.226 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83120 m-fin-sta ceph NOFD /proc/31449/task/83120/fd (opendir: Permission denied) 2024-09-19T08:47:17.226 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83121 telemetry ceph cwd unknown /proc/31449/task/83121/cwd (readlink: Permission denied) 2024-09-19T08:47:17.226 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83121 telemetry ceph rtd unknown /proc/31449/task/83121/root (readlink: Permission denied) 2024-09-19T08:47:17.226 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83121 telemetry ceph txt unknown /proc/31449/task/83121/exe (readlink: Permission denied) 2024-09-19T08:47:17.226 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83121 telemetry ceph NOFD /proc/31449/task/83121/fd (opendir: Permission denied) 2024-09-19T08:47:17.226 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83122 m-fin-tel ceph cwd unknown /proc/31449/task/83122/cwd (readlink: Permission denied) 2024-09-19T08:47:17.226 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83122 m-fin-tel ceph rtd unknown /proc/31449/task/83122/root (readlink: Permission denied) 2024-09-19T08:47:17.226 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83122 m-fin-tel ceph txt unknown /proc/31449/task/83122/exe (readlink: Permission denied) 2024-09-19T08:47:17.226 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83122 m-fin-tel ceph NOFD /proc/31449/task/83122/fd (opendir: Permission denied) 2024-09-19T08:47:17.226 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83123 mgr-fin ceph cwd unknown /proc/31449/task/83123/cwd (readlink: Permission denied) 2024-09-19T08:47:17.226 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83123 mgr-fin ceph rtd unknown /proc/31449/task/83123/root (readlink: Permission denied) 2024-09-19T08:47:17.226 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83123 mgr-fin ceph txt unknown /proc/31449/task/83123/exe (readlink: Permission denied) 2024-09-19T08:47:17.226 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83123 mgr-fin ceph NOFD /proc/31449/task/83123/fd (opendir: Permission denied) 2024-09-19T08:47:17.226 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83127 io_contex ceph cwd unknown /proc/31449/task/83127/cwd (readlink: Permission denied) 2024-09-19T08:47:17.226 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83127 io_contex ceph rtd unknown /proc/31449/task/83127/root (readlink: Permission denied) 2024-09-19T08:47:17.227 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83127 io_contex ceph txt unknown /proc/31449/task/83127/exe (readlink: Permission denied) 2024-09-19T08:47:17.227 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83127 io_contex ceph NOFD /proc/31449/task/83127/fd (opendir: Permission denied) 2024-09-19T08:47:17.227 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83128 io_contex ceph cwd unknown /proc/31449/task/83128/cwd (readlink: Permission denied) 2024-09-19T08:47:17.227 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83128 io_contex ceph rtd unknown /proc/31449/task/83128/root (readlink: Permission denied) 2024-09-19T08:47:17.227 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83128 io_contex ceph txt unknown /proc/31449/task/83128/exe (readlink: Permission denied) 2024-09-19T08:47:17.227 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83128 io_contex ceph NOFD /proc/31449/task/83128/fd (opendir: Permission denied) 2024-09-19T08:47:17.227 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83129 ceph_time ceph cwd unknown /proc/31449/task/83129/cwd (readlink: Permission denied) 2024-09-19T08:47:17.227 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83129 ceph_time ceph rtd unknown /proc/31449/task/83129/root (readlink: Permission denied) 2024-09-19T08:47:17.227 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83129 ceph_time ceph txt unknown /proc/31449/task/83129/exe (readlink: Permission denied) 2024-09-19T08:47:17.227 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83129 ceph_time ceph NOFD /proc/31449/task/83129/fd (opendir: Permission denied) 2024-09-19T08:47:17.227 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83130 ms_dispat ceph cwd unknown /proc/31449/task/83130/cwd (readlink: Permission denied) 2024-09-19T08:47:17.227 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83130 ms_dispat ceph rtd unknown /proc/31449/task/83130/root (readlink: Permission denied) 2024-09-19T08:47:17.227 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83130 ms_dispat ceph txt unknown /proc/31449/task/83130/exe (readlink: Permission denied) 2024-09-19T08:47:17.228 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83130 ms_dispat ceph NOFD /proc/31449/task/83130/fd (opendir: Permission denied) 2024-09-19T08:47:17.228 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83131 ms_local ceph cwd unknown /proc/31449/task/83131/cwd (readlink: Permission denied) 2024-09-19T08:47:17.228 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83131 ms_local ceph rtd unknown /proc/31449/task/83131/root (readlink: Permission denied) 2024-09-19T08:47:17.228 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83131 ms_local ceph txt unknown /proc/31449/task/83131/exe (readlink: Permission denied) 2024-09-19T08:47:17.228 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83131 ms_local ceph NOFD /proc/31449/task/83131/fd (opendir: Permission denied) 2024-09-19T08:47:17.228 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83132 safe_time ceph cwd unknown /proc/31449/task/83132/cwd (readlink: Permission denied) 2024-09-19T08:47:17.228 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83132 safe_time ceph rtd unknown /proc/31449/task/83132/root (readlink: Permission denied) 2024-09-19T08:47:17.228 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83132 safe_time ceph txt unknown /proc/31449/task/83132/exe (readlink: Permission denied) 2024-09-19T08:47:17.228 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83132 safe_time ceph NOFD /proc/31449/task/83132/fd (opendir: Permission denied) 2024-09-19T08:47:17.228 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83133 safe_time ceph cwd unknown /proc/31449/task/83133/cwd (readlink: Permission denied) 2024-09-19T08:47:17.228 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83133 safe_time ceph rtd unknown /proc/31449/task/83133/root (readlink: Permission denied) 2024-09-19T08:47:17.228 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83133 safe_time ceph txt unknown /proc/31449/task/83133/exe (readlink: Permission denied) 2024-09-19T08:47:17.228 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83133 safe_time ceph NOFD /proc/31449/task/83133/fd (opendir: Permission denied) 2024-09-19T08:47:17.229 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83134 mgr-fin ceph cwd unknown /proc/31449/task/83134/cwd (readlink: Permission denied) 2024-09-19T08:47:17.229 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83134 mgr-fin ceph rtd unknown /proc/31449/task/83134/root (readlink: Permission denied) 2024-09-19T08:47:17.229 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83134 mgr-fin ceph txt unknown /proc/31449/task/83134/exe (readlink: Permission denied) 2024-09-19T08:47:17.229 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83134 mgr-fin ceph NOFD /proc/31449/task/83134/fd (opendir: Permission denied) 2024-09-19T08:47:17.229 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83135 mgr-fin ceph cwd unknown /proc/31449/task/83135/cwd (readlink: Permission denied) 2024-09-19T08:47:17.229 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83135 mgr-fin ceph rtd unknown /proc/31449/task/83135/root (readlink: Permission denied) 2024-09-19T08:47:17.229 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83135 mgr-fin ceph txt unknown /proc/31449/task/83135/exe (readlink: Permission denied) 2024-09-19T08:47:17.229 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83135 mgr-fin ceph NOFD /proc/31449/task/83135/fd (opendir: Permission denied) 2024-09-19T08:47:17.229 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83136 mgr-fin ceph cwd unknown /proc/31449/task/83136/cwd (readlink: Permission denied) 2024-09-19T08:47:17.229 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83136 mgr-fin ceph rtd unknown /proc/31449/task/83136/root (readlink: Permission denied) 2024-09-19T08:47:17.229 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83136 mgr-fin ceph txt unknown /proc/31449/task/83136/exe (readlink: Permission denied) 2024-09-19T08:47:17.229 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83136 mgr-fin ceph NOFD /proc/31449/task/83136/fd (opendir: Permission denied) 2024-09-19T08:47:17.229 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83137 mgr-fin ceph cwd unknown /proc/31449/task/83137/cwd (readlink: Permission denied) 2024-09-19T08:47:17.229 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83137 mgr-fin ceph rtd unknown /proc/31449/task/83137/root (readlink: Permission denied) 2024-09-19T08:47:17.230 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83137 mgr-fin ceph txt unknown /proc/31449/task/83137/exe (readlink: Permission denied) 2024-09-19T08:47:17.230 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83137 mgr-fin ceph NOFD /proc/31449/task/83137/fd (opendir: Permission denied) 2024-09-19T08:47:17.230 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83138 mgr-fin ceph cwd unknown /proc/31449/task/83138/cwd (readlink: Permission denied) 2024-09-19T08:47:17.230 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83138 mgr-fin ceph rtd unknown /proc/31449/task/83138/root (readlink: Permission denied) 2024-09-19T08:47:17.230 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83138 mgr-fin ceph txt unknown /proc/31449/task/83138/exe (readlink: Permission denied) 2024-09-19T08:47:17.230 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83138 mgr-fin ceph NOFD /proc/31449/task/83138/fd (opendir: Permission denied) 2024-09-19T08:47:17.230 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83139 mgr-fin ceph cwd unknown /proc/31449/task/83139/cwd (readlink: Permission denied) 2024-09-19T08:47:17.230 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83139 mgr-fin ceph rtd unknown /proc/31449/task/83139/root (readlink: Permission denied) 2024-09-19T08:47:17.230 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83139 mgr-fin ceph txt unknown /proc/31449/task/83139/exe (readlink: Permission denied) 2024-09-19T08:47:17.230 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83139 mgr-fin ceph NOFD /proc/31449/task/83139/fd (opendir: Permission denied) 2024-09-19T08:47:17.230 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83140 mgr-fin ceph cwd unknown /proc/31449/task/83140/cwd (readlink: Permission denied) 2024-09-19T08:47:17.230 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83140 mgr-fin ceph rtd unknown /proc/31449/task/83140/root (readlink: Permission denied) 2024-09-19T08:47:17.230 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83140 mgr-fin ceph txt unknown /proc/31449/task/83140/exe (readlink: Permission denied) 2024-09-19T08:47:17.230 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83140 mgr-fin ceph NOFD /proc/31449/task/83140/fd (opendir: Permission denied) 2024-09-19T08:47:17.231 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83141 mgr-fin ceph cwd unknown /proc/31449/task/83141/cwd (readlink: Permission denied) 2024-09-19T08:47:17.231 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83141 mgr-fin ceph rtd unknown /proc/31449/task/83141/root (readlink: Permission denied) 2024-09-19T08:47:17.231 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83141 mgr-fin ceph txt unknown /proc/31449/task/83141/exe (readlink: Permission denied) 2024-09-19T08:47:17.231 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83141 mgr-fin ceph NOFD /proc/31449/task/83141/fd (opendir: Permission denied) 2024-09-19T08:47:17.231 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83142 mgr-fin ceph cwd unknown /proc/31449/task/83142/cwd (readlink: Permission denied) 2024-09-19T08:47:17.231 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83142 mgr-fin ceph rtd unknown /proc/31449/task/83142/root (readlink: Permission denied) 2024-09-19T08:47:17.231 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83142 mgr-fin ceph txt unknown /proc/31449/task/83142/exe (readlink: Permission denied) 2024-09-19T08:47:17.231 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83142 mgr-fin ceph NOFD /proc/31449/task/83142/fd (opendir: Permission denied) 2024-09-19T08:47:17.231 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83143 mgr-fin ceph cwd unknown /proc/31449/task/83143/cwd (readlink: Permission denied) 2024-09-19T08:47:17.231 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83143 mgr-fin ceph rtd unknown /proc/31449/task/83143/root (readlink: Permission denied) 2024-09-19T08:47:17.231 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83143 mgr-fin ceph txt unknown /proc/31449/task/83143/exe (readlink: Permission denied) 2024-09-19T08:47:17.231 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83143 mgr-fin ceph NOFD /proc/31449/task/83143/fd (opendir: Permission denied) 2024-09-19T08:47:17.231 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83144 mgr-fin ceph cwd unknown /proc/31449/task/83144/cwd (readlink: Permission denied) 2024-09-19T08:47:17.232 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83144 mgr-fin ceph rtd unknown /proc/31449/task/83144/root (readlink: Permission denied) 2024-09-19T08:47:17.232 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83144 mgr-fin ceph txt unknown /proc/31449/task/83144/exe (readlink: Permission denied) 2024-09-19T08:47:17.232 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83144 mgr-fin ceph NOFD /proc/31449/task/83144/fd (opendir: Permission denied) 2024-09-19T08:47:17.232 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83145 mgr-fin ceph cwd unknown /proc/31449/task/83145/cwd (readlink: Permission denied) 2024-09-19T08:47:17.232 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83145 mgr-fin ceph rtd unknown /proc/31449/task/83145/root (readlink: Permission denied) 2024-09-19T08:47:17.232 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83145 mgr-fin ceph txt unknown /proc/31449/task/83145/exe (readlink: Permission denied) 2024-09-19T08:47:17.232 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83145 mgr-fin ceph NOFD /proc/31449/task/83145/fd (opendir: Permission denied) 2024-09-19T08:47:17.232 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83147 m-fin-vol ceph cwd unknown /proc/31449/task/83147/cwd (readlink: Permission denied) 2024-09-19T08:47:17.232 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83147 m-fin-vol ceph rtd unknown /proc/31449/task/83147/root (readlink: Permission denied) 2024-09-19T08:47:17.232 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83147 m-fin-vol ceph txt unknown /proc/31449/task/83147/exe (readlink: Permission denied) 2024-09-19T08:47:17.232 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83147 m-fin-vol ceph NOFD /proc/31449/task/83147/fd (opendir: Permission denied) 2024-09-19T08:47:17.232 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83148 io_contex ceph cwd unknown /proc/31449/task/83148/cwd (readlink: Permission denied) 2024-09-19T08:47:17.233 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83148 io_contex ceph rtd unknown /proc/31449/task/83148/root (readlink: Permission denied) 2024-09-19T08:47:17.233 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83148 io_contex ceph txt unknown /proc/31449/task/83148/exe (readlink: Permission denied) 2024-09-19T08:47:17.233 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83148 io_contex ceph NOFD /proc/31449/task/83148/fd (opendir: Permission denied) 2024-09-19T08:47:17.233 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83149 io_contex ceph cwd unknown /proc/31449/task/83149/cwd (readlink: Permission denied) 2024-09-19T08:47:17.233 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83149 io_contex ceph rtd unknown /proc/31449/task/83149/root (readlink: Permission denied) 2024-09-19T08:47:17.233 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83149 io_contex ceph txt unknown /proc/31449/task/83149/exe (readlink: Permission denied) 2024-09-19T08:47:17.233 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83149 io_contex ceph NOFD /proc/31449/task/83149/fd (opendir: Permission denied) 2024-09-19T08:47:17.233 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83235 dashboard ceph cwd unknown /proc/31449/task/83235/cwd (readlink: Permission denied) 2024-09-19T08:47:17.233 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83235 dashboard ceph rtd unknown /proc/31449/task/83235/root (readlink: Permission denied) 2024-09-19T08:47:17.233 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83235 dashboard ceph txt unknown /proc/31449/task/83235/exe (readlink: Permission denied) 2024-09-19T08:47:17.233 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83235 dashboard ceph NOFD /proc/31449/task/83235/fd (opendir: Permission denied) 2024-09-19T08:47:17.233 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83236 dashboard ceph cwd unknown /proc/31449/task/83236/cwd (readlink: Permission denied) 2024-09-19T08:47:17.233 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83236 dashboard ceph rtd unknown /proc/31449/task/83236/root (readlink: Permission denied) 2024-09-19T08:47:17.233 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83236 dashboard ceph txt unknown /proc/31449/task/83236/exe (readlink: Permission denied) 2024-09-19T08:47:17.234 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83236 dashboard ceph NOFD /proc/31449/task/83236/fd (opendir: Permission denied) 2024-09-19T08:47:17.234 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83237 dashboard ceph cwd unknown /proc/31449/task/83237/cwd (readlink: Permission denied) 2024-09-19T08:47:17.234 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83237 dashboard ceph rtd unknown /proc/31449/task/83237/root (readlink: Permission denied) 2024-09-19T08:47:17.234 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83237 dashboard ceph txt unknown /proc/31449/task/83237/exe (readlink: Permission denied) 2024-09-19T08:47:17.234 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83237 dashboard ceph NOFD /proc/31449/task/83237/fd (opendir: Permission denied) 2024-09-19T08:47:17.234 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83238 dashboard ceph cwd unknown /proc/31449/task/83238/cwd (readlink: Permission denied) 2024-09-19T08:47:17.234 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83238 dashboard ceph rtd unknown /proc/31449/task/83238/root (readlink: Permission denied) 2024-09-19T08:47:17.234 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83238 dashboard ceph txt unknown /proc/31449/task/83238/exe (readlink: Permission denied) 2024-09-19T08:47:17.234 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83238 dashboard ceph NOFD /proc/31449/task/83238/fd (opendir: Permission denied) 2024-09-19T08:47:17.234 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83239 dashboard ceph cwd unknown /proc/31449/task/83239/cwd (readlink: Permission denied) 2024-09-19T08:47:17.234 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83239 dashboard ceph rtd unknown /proc/31449/task/83239/root (readlink: Permission denied) 2024-09-19T08:47:17.234 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83239 dashboard ceph txt unknown /proc/31449/task/83239/exe (readlink: Permission denied) 2024-09-19T08:47:17.234 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83239 dashboard ceph NOFD /proc/31449/task/83239/fd (opendir: Permission denied) 2024-09-19T08:47:17.235 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83240 dashboard ceph cwd unknown /proc/31449/task/83240/cwd (readlink: Permission denied) 2024-09-19T08:47:17.235 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83240 dashboard ceph rtd unknown /proc/31449/task/83240/root (readlink: Permission denied) 2024-09-19T08:47:17.235 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83240 dashboard ceph txt unknown /proc/31449/task/83240/exe (readlink: Permission denied) 2024-09-19T08:47:17.235 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83240 dashboard ceph NOFD /proc/31449/task/83240/fd (opendir: Permission denied) 2024-09-19T08:47:17.235 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83241 dashboard ceph cwd unknown /proc/31449/task/83241/cwd (readlink: Permission denied) 2024-09-19T08:47:17.235 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83241 dashboard ceph rtd unknown /proc/31449/task/83241/root (readlink: Permission denied) 2024-09-19T08:47:17.235 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83241 dashboard ceph txt unknown /proc/31449/task/83241/exe (readlink: Permission denied) 2024-09-19T08:47:17.235 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83241 dashboard ceph NOFD /proc/31449/task/83241/fd (opendir: Permission denied) 2024-09-19T08:47:17.235 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83242 dashboard ceph cwd unknown /proc/31449/task/83242/cwd (readlink: Permission denied) 2024-09-19T08:47:17.235 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83242 dashboard ceph rtd unknown /proc/31449/task/83242/root (readlink: Permission denied) 2024-09-19T08:47:17.235 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83242 dashboard ceph txt unknown /proc/31449/task/83242/exe (readlink: Permission denied) 2024-09-19T08:47:17.235 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83242 dashboard ceph NOFD /proc/31449/task/83242/fd (opendir: Permission denied) 2024-09-19T08:47:17.235 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83243 dashboard ceph cwd unknown /proc/31449/task/83243/cwd (readlink: Permission denied) 2024-09-19T08:47:17.235 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83243 dashboard ceph rtd unknown /proc/31449/task/83243/root (readlink: Permission denied) 2024-09-19T08:47:17.236 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83243 dashboard ceph txt unknown /proc/31449/task/83243/exe (readlink: Permission denied) 2024-09-19T08:47:17.236 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83243 dashboard ceph NOFD /proc/31449/task/83243/fd (opendir: Permission denied) 2024-09-19T08:47:17.236 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83244 dashboard ceph cwd unknown /proc/31449/task/83244/cwd (readlink: Permission denied) 2024-09-19T08:47:17.236 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83244 dashboard ceph rtd unknown /proc/31449/task/83244/root (readlink: Permission denied) 2024-09-19T08:47:17.236 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83244 dashboard ceph txt unknown /proc/31449/task/83244/exe (readlink: Permission denied) 2024-09-19T08:47:17.236 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83244 dashboard ceph NOFD /proc/31449/task/83244/fd (opendir: Permission denied) 2024-09-19T08:47:17.236 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83245 dashboard ceph cwd unknown /proc/31449/task/83245/cwd (readlink: Permission denied) 2024-09-19T08:47:17.236 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83245 dashboard ceph rtd unknown /proc/31449/task/83245/root (readlink: Permission denied) 2024-09-19T08:47:17.236 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83245 dashboard ceph txt unknown /proc/31449/task/83245/exe (readlink: Permission denied) 2024-09-19T08:47:17.236 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83245 dashboard ceph NOFD /proc/31449/task/83245/fd (opendir: Permission denied) 2024-09-19T08:47:17.236 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83248 dashboard ceph cwd unknown /proc/31449/task/83248/cwd (readlink: Permission denied) 2024-09-19T08:47:17.236 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83248 dashboard ceph rtd unknown /proc/31449/task/83248/root (readlink: Permission denied) 2024-09-19T08:47:17.236 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83248 dashboard ceph txt unknown /proc/31449/task/83248/exe (readlink: Permission denied) 2024-09-19T08:47:17.237 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83248 dashboard ceph NOFD /proc/31449/task/83248/fd (opendir: Permission denied) 2024-09-19T08:47:17.237 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83545 devicehea ceph cwd unknown /proc/31449/task/83545/cwd (readlink: Permission denied) 2024-09-19T08:47:17.237 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83545 devicehea ceph rtd unknown /proc/31449/task/83545/root (readlink: Permission denied) 2024-09-19T08:47:17.237 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83545 devicehea ceph txt unknown /proc/31449/task/83545/exe (readlink: Permission denied) 2024-09-19T08:47:17.237 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83545 devicehea ceph NOFD /proc/31449/task/83545/fd (opendir: Permission denied) 2024-09-19T08:47:17.237 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83571 io_contex ceph cwd unknown /proc/31449/task/83571/cwd (readlink: Permission denied) 2024-09-19T08:47:17.237 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83571 io_contex ceph rtd unknown /proc/31449/task/83571/root (readlink: Permission denied) 2024-09-19T08:47:17.237 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83571 io_contex ceph txt unknown /proc/31449/task/83571/exe (readlink: Permission denied) 2024-09-19T08:47:17.237 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83571 io_contex ceph NOFD /proc/31449/task/83571/fd (opendir: Permission denied) 2024-09-19T08:47:17.237 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83572 io_contex ceph cwd unknown /proc/31449/task/83572/cwd (readlink: Permission denied) 2024-09-19T08:47:17.238 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83572 io_contex ceph rtd unknown /proc/31449/task/83572/root (readlink: Permission denied) 2024-09-19T08:47:17.238 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83572 io_contex ceph txt unknown /proc/31449/task/83572/exe (readlink: Permission denied) 2024-09-19T08:47:17.238 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83572 io_contex ceph NOFD /proc/31449/task/83572/fd (opendir: Permission denied) 2024-09-19T08:47:17.238 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83573 ceph_time ceph cwd unknown /proc/31449/task/83573/cwd (readlink: Permission denied) 2024-09-19T08:47:17.238 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83573 ceph_time ceph rtd unknown /proc/31449/task/83573/root (readlink: Permission denied) 2024-09-19T08:47:17.238 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83573 ceph_time ceph txt unknown /proc/31449/task/83573/exe (readlink: Permission denied) 2024-09-19T08:47:17.238 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83573 ceph_time ceph NOFD /proc/31449/task/83573/fd (opendir: Permission denied) 2024-09-19T08:47:17.238 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83575 ms_dispat ceph cwd unknown /proc/31449/task/83575/cwd (readlink: Permission denied) 2024-09-19T08:47:17.238 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83575 ms_dispat ceph rtd unknown /proc/31449/task/83575/root (readlink: Permission denied) 2024-09-19T08:47:17.238 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83575 ms_dispat ceph txt unknown /proc/31449/task/83575/exe (readlink: Permission denied) 2024-09-19T08:47:17.238 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83575 ms_dispat ceph NOFD /proc/31449/task/83575/fd (opendir: Permission denied) 2024-09-19T08:47:17.238 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83576 ms_local ceph cwd unknown /proc/31449/task/83576/cwd (readlink: Permission denied) 2024-09-19T08:47:17.238 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83576 ms_local ceph rtd unknown /proc/31449/task/83576/root (readlink: Permission denied) 2024-09-19T08:47:17.239 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83576 ms_local ceph txt unknown /proc/31449/task/83576/exe (readlink: Permission denied) 2024-09-19T08:47:17.239 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83576 ms_local ceph NOFD /proc/31449/task/83576/fd (opendir: Permission denied) 2024-09-19T08:47:17.239 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83577 safe_time ceph cwd unknown /proc/31449/task/83577/cwd (readlink: Permission denied) 2024-09-19T08:47:17.239 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83577 safe_time ceph rtd unknown /proc/31449/task/83577/root (readlink: Permission denied) 2024-09-19T08:47:17.239 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83577 safe_time ceph txt unknown /proc/31449/task/83577/exe (readlink: Permission denied) 2024-09-19T08:47:17.239 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83577 safe_time ceph NOFD /proc/31449/task/83577/fd (opendir: Permission denied) 2024-09-19T08:47:17.239 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83578 safe_time ceph cwd unknown /proc/31449/task/83578/cwd (readlink: Permission denied) 2024-09-19T08:47:17.239 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83578 safe_time ceph rtd unknown /proc/31449/task/83578/root (readlink: Permission denied) 2024-09-19T08:47:17.239 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83578 safe_time ceph txt unknown /proc/31449/task/83578/exe (readlink: Permission denied) 2024-09-19T08:47:17.239 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83578 safe_time ceph NOFD /proc/31449/task/83578/fd (opendir: Permission denied) 2024-09-19T08:47:17.239 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83659 mgr-fin ceph cwd unknown /proc/31449/task/83659/cwd (readlink: Permission denied) 2024-09-19T08:47:17.239 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83659 mgr-fin ceph rtd unknown /proc/31449/task/83659/root (readlink: Permission denied) 2024-09-19T08:47:17.239 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83659 mgr-fin ceph txt unknown /proc/31449/task/83659/exe (readlink: Permission denied) 2024-09-19T08:47:17.240 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83659 mgr-fin ceph NOFD /proc/31449/task/83659/fd (opendir: Permission denied) 2024-09-19T08:47:17.240 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83660 mgr-fin ceph cwd unknown /proc/31449/task/83660/cwd (readlink: Permission denied) 2024-09-19T08:47:17.240 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83660 mgr-fin ceph rtd unknown /proc/31449/task/83660/root (readlink: Permission denied) 2024-09-19T08:47:17.240 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83660 mgr-fin ceph txt unknown /proc/31449/task/83660/exe (readlink: Permission denied) 2024-09-19T08:47:17.240 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83660 mgr-fin ceph NOFD /proc/31449/task/83660/fd (opendir: Permission denied) 2024-09-19T08:47:17.240 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83661 mgr-fin ceph cwd unknown /proc/31449/task/83661/cwd (readlink: Permission denied) 2024-09-19T08:47:17.240 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83661 mgr-fin ceph rtd unknown /proc/31449/task/83661/root (readlink: Permission denied) 2024-09-19T08:47:17.240 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83661 mgr-fin ceph txt unknown /proc/31449/task/83661/exe (readlink: Permission denied) 2024-09-19T08:47:17.240 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83661 mgr-fin ceph NOFD /proc/31449/task/83661/fd (opendir: Permission denied) 2024-09-19T08:47:17.240 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83662 mgr-fin ceph cwd unknown /proc/31449/task/83662/cwd (readlink: Permission denied) 2024-09-19T08:47:17.240 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83662 mgr-fin ceph rtd unknown /proc/31449/task/83662/root (readlink: Permission denied) 2024-09-19T08:47:17.240 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83662 mgr-fin ceph txt unknown /proc/31449/task/83662/exe (readlink: Permission denied) 2024-09-19T08:47:17.240 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83662 mgr-fin ceph NOFD /proc/31449/task/83662/fd (opendir: Permission denied) 2024-09-19T08:47:17.241 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83663 mgr-fin ceph cwd unknown /proc/31449/task/83663/cwd (readlink: Permission denied) 2024-09-19T08:47:17.241 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83663 mgr-fin ceph rtd unknown /proc/31449/task/83663/root (readlink: Permission denied) 2024-09-19T08:47:17.241 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83663 mgr-fin ceph txt unknown /proc/31449/task/83663/exe (readlink: Permission denied) 2024-09-19T08:47:17.241 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83663 mgr-fin ceph NOFD /proc/31449/task/83663/fd (opendir: Permission denied) 2024-09-19T08:47:17.241 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83664 mgr-fin ceph cwd unknown /proc/31449/task/83664/cwd (readlink: Permission denied) 2024-09-19T08:47:17.241 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83664 mgr-fin ceph rtd unknown /proc/31449/task/83664/root (readlink: Permission denied) 2024-09-19T08:47:17.241 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83664 mgr-fin ceph txt unknown /proc/31449/task/83664/exe (readlink: Permission denied) 2024-09-19T08:47:17.241 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83664 mgr-fin ceph NOFD /proc/31449/task/83664/fd (opendir: Permission denied) 2024-09-19T08:47:17.241 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83665 mgr-fin ceph cwd unknown /proc/31449/task/83665/cwd (readlink: Permission denied) 2024-09-19T08:47:17.241 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83665 mgr-fin ceph rtd unknown /proc/31449/task/83665/root (readlink: Permission denied) 2024-09-19T08:47:17.241 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83665 mgr-fin ceph txt unknown /proc/31449/task/83665/exe (readlink: Permission denied) 2024-09-19T08:47:17.241 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83665 mgr-fin ceph NOFD /proc/31449/task/83665/fd (opendir: Permission denied) 2024-09-19T08:47:17.241 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83666 mgr-fin ceph cwd unknown /proc/31449/task/83666/cwd (readlink: Permission denied) 2024-09-19T08:47:17.241 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83666 mgr-fin ceph rtd unknown /proc/31449/task/83666/root (readlink: Permission denied) 2024-09-19T08:47:17.242 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83666 mgr-fin ceph txt unknown /proc/31449/task/83666/exe (readlink: Permission denied) 2024-09-19T08:47:17.242 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83666 mgr-fin ceph NOFD /proc/31449/task/83666/fd (opendir: Permission denied) 2024-09-19T08:47:17.242 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83667 mgr-fin ceph cwd unknown /proc/31449/task/83667/cwd (readlink: Permission denied) 2024-09-19T08:47:17.242 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83667 mgr-fin ceph rtd unknown /proc/31449/task/83667/root (readlink: Permission denied) 2024-09-19T08:47:17.242 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83667 mgr-fin ceph txt unknown /proc/31449/task/83667/exe (readlink: Permission denied) 2024-09-19T08:47:17.242 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83667 mgr-fin ceph NOFD /proc/31449/task/83667/fd (opendir: Permission denied) 2024-09-19T08:47:17.242 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83668 mgr-fin ceph cwd unknown /proc/31449/task/83668/cwd (readlink: Permission denied) 2024-09-19T08:47:17.242 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83668 mgr-fin ceph rtd unknown /proc/31449/task/83668/root (readlink: Permission denied) 2024-09-19T08:47:17.242 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83668 mgr-fin ceph txt unknown /proc/31449/task/83668/exe (readlink: Permission denied) 2024-09-19T08:47:17.242 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83668 mgr-fin ceph NOFD /proc/31449/task/83668/fd (opendir: Permission denied) 2024-09-19T08:47:17.242 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83669 mgr-fin ceph cwd unknown /proc/31449/task/83669/cwd (readlink: Permission denied) 2024-09-19T08:47:17.242 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83669 mgr-fin ceph rtd unknown /proc/31449/task/83669/root (readlink: Permission denied) 2024-09-19T08:47:17.242 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83669 mgr-fin ceph txt unknown /proc/31449/task/83669/exe (readlink: Permission denied) 2024-09-19T08:47:17.242 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83669 mgr-fin ceph NOFD /proc/31449/task/83669/fd (opendir: Permission denied) 2024-09-19T08:47:17.243 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83728 mgr-fin ceph cwd unknown /proc/31449/task/83728/cwd (readlink: Permission denied) 2024-09-19T08:47:17.243 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83728 mgr-fin ceph rtd unknown /proc/31449/task/83728/root (readlink: Permission denied) 2024-09-19T08:47:17.243 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83728 mgr-fin ceph txt unknown /proc/31449/task/83728/exe (readlink: Permission denied) 2024-09-19T08:47:17.243 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83728 mgr-fin ceph NOFD /proc/31449/task/83728/fd (opendir: Permission denied) 2024-09-19T08:47:17.243 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83729 mgr-fin ceph cwd unknown /proc/31449/task/83729/cwd (readlink: Permission denied) 2024-09-19T08:47:17.243 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83729 mgr-fin ceph rtd unknown /proc/31449/task/83729/root (readlink: Permission denied) 2024-09-19T08:47:17.243 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83729 mgr-fin ceph txt unknown /proc/31449/task/83729/exe (readlink: Permission denied) 2024-09-19T08:47:17.243 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83729 mgr-fin ceph NOFD /proc/31449/task/83729/fd (opendir: Permission denied) 2024-09-19T08:47:17.243 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83730 mgr-fin ceph cwd unknown /proc/31449/task/83730/cwd (readlink: Permission denied) 2024-09-19T08:47:17.243 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83730 mgr-fin ceph rtd unknown /proc/31449/task/83730/root (readlink: Permission denied) 2024-09-19T08:47:17.243 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83730 mgr-fin ceph txt unknown /proc/31449/task/83730/exe (readlink: Permission denied) 2024-09-19T08:47:17.243 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83730 mgr-fin ceph NOFD /proc/31449/task/83730/fd (opendir: Permission denied) 2024-09-19T08:47:17.243 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83731 mgr-fin ceph cwd unknown /proc/31449/task/83731/cwd (readlink: Permission denied) 2024-09-19T08:47:17.243 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83731 mgr-fin ceph rtd unknown /proc/31449/task/83731/root (readlink: Permission denied) 2024-09-19T08:47:17.244 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83731 mgr-fin ceph txt unknown /proc/31449/task/83731/exe (readlink: Permission denied) 2024-09-19T08:47:17.244 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83731 mgr-fin ceph NOFD /proc/31449/task/83731/fd (opendir: Permission denied) 2024-09-19T08:47:17.244 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83732 mgr-fin ceph cwd unknown /proc/31449/task/83732/cwd (readlink: Permission denied) 2024-09-19T08:47:17.244 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83732 mgr-fin ceph rtd unknown /proc/31449/task/83732/root (readlink: Permission denied) 2024-09-19T08:47:17.244 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83732 mgr-fin ceph txt unknown /proc/31449/task/83732/exe (readlink: Permission denied) 2024-09-19T08:47:17.244 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83732 mgr-fin ceph NOFD /proc/31449/task/83732/fd (opendir: Permission denied) 2024-09-19T08:47:17.244 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83733 mgr-fin ceph cwd unknown /proc/31449/task/83733/cwd (readlink: Permission denied) 2024-09-19T08:47:17.244 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83733 mgr-fin ceph rtd unknown /proc/31449/task/83733/root (readlink: Permission denied) 2024-09-19T08:47:17.244 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83733 mgr-fin ceph txt unknown /proc/31449/task/83733/exe (readlink: Permission denied) 2024-09-19T08:47:17.244 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83733 mgr-fin ceph NOFD /proc/31449/task/83733/fd (opendir: Permission denied) 2024-09-19T08:47:17.244 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83734 mgr-fin ceph cwd unknown /proc/31449/task/83734/cwd (readlink: Permission denied) 2024-09-19T08:47:17.244 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83734 mgr-fin ceph rtd unknown /proc/31449/task/83734/root (readlink: Permission denied) 2024-09-19T08:47:17.244 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83734 mgr-fin ceph txt unknown /proc/31449/task/83734/exe (readlink: Permission denied) 2024-09-19T08:47:17.244 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83734 mgr-fin ceph NOFD /proc/31449/task/83734/fd (opendir: Permission denied) 2024-09-19T08:47:17.245 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83735 mgr-fin ceph cwd unknown /proc/31449/task/83735/cwd (readlink: Permission denied) 2024-09-19T08:47:17.245 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83735 mgr-fin ceph rtd unknown /proc/31449/task/83735/root (readlink: Permission denied) 2024-09-19T08:47:17.245 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83735 mgr-fin ceph txt unknown /proc/31449/task/83735/exe (readlink: Permission denied) 2024-09-19T08:47:17.245 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83735 mgr-fin ceph NOFD /proc/31449/task/83735/fd (opendir: Permission denied) 2024-09-19T08:47:17.245 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83736 mgr-fin ceph cwd unknown /proc/31449/task/83736/cwd (readlink: Permission denied) 2024-09-19T08:47:17.245 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83736 mgr-fin ceph rtd unknown /proc/31449/task/83736/root (readlink: Permission denied) 2024-09-19T08:47:17.245 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83736 mgr-fin ceph txt unknown /proc/31449/task/83736/exe (readlink: Permission denied) 2024-09-19T08:47:17.245 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83736 mgr-fin ceph NOFD /proc/31449/task/83736/fd (opendir: Permission denied) 2024-09-19T08:47:17.245 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83737 mgr-fin ceph cwd unknown /proc/31449/task/83737/cwd (readlink: Permission denied) 2024-09-19T08:47:17.245 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83737 mgr-fin ceph rtd unknown /proc/31449/task/83737/root (readlink: Permission denied) 2024-09-19T08:47:17.245 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83737 mgr-fin ceph txt unknown /proc/31449/task/83737/exe (readlink: Permission denied) 2024-09-19T08:47:17.245 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83737 mgr-fin ceph NOFD /proc/31449/task/83737/fd (opendir: Permission denied) 2024-09-19T08:47:17.245 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83738 mgr-fin ceph cwd unknown /proc/31449/task/83738/cwd (readlink: Permission denied) 2024-09-19T08:47:17.245 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83738 mgr-fin ceph rtd unknown /proc/31449/task/83738/root (readlink: Permission denied) 2024-09-19T08:47:17.246 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83738 mgr-fin ceph txt unknown /proc/31449/task/83738/exe (readlink: Permission denied) 2024-09-19T08:47:17.246 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 83738 mgr-fin ceph NOFD /proc/31449/task/83738/fd (opendir: Permission denied) 2024-09-19T08:47:17.246 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87349 ceph_time ceph cwd unknown /proc/31449/task/87349/cwd (readlink: Permission denied) 2024-09-19T08:47:17.246 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87349 ceph_time ceph rtd unknown /proc/31449/task/87349/root (readlink: Permission denied) 2024-09-19T08:47:17.246 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87349 ceph_time ceph txt unknown /proc/31449/task/87349/exe (readlink: Permission denied) 2024-09-19T08:47:17.246 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87349 ceph_time ceph NOFD /proc/31449/task/87349/fd (opendir: Permission denied) 2024-09-19T08:47:17.246 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87350 fn_anonym ceph cwd unknown /proc/31449/task/87350/cwd (readlink: Permission denied) 2024-09-19T08:47:17.246 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87350 fn_anonym ceph rtd unknown /proc/31449/task/87350/root (readlink: Permission denied) 2024-09-19T08:47:17.246 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87350 fn_anonym ceph txt unknown /proc/31449/task/87350/exe (readlink: Permission denied) 2024-09-19T08:47:17.246 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87350 fn_anonym ceph NOFD /proc/31449/task/87350/fd (opendir: Permission denied) 2024-09-19T08:47:17.246 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87351 safe_time ceph cwd unknown /proc/31449/task/87351/cwd (readlink: Permission denied) 2024-09-19T08:47:17.246 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87351 safe_time ceph rtd unknown /proc/31449/task/87351/root (readlink: Permission denied) 2024-09-19T08:47:17.246 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87351 safe_time ceph txt unknown /proc/31449/task/87351/exe (readlink: Permission denied) 2024-09-19T08:47:17.247 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87351 safe_time ceph NOFD /proc/31449/task/87351/fd (opendir: Permission denied) 2024-09-19T08:47:17.247 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87352 fn_anonym ceph cwd unknown /proc/31449/task/87352/cwd (readlink: Permission denied) 2024-09-19T08:47:17.247 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87352 fn_anonym ceph rtd unknown /proc/31449/task/87352/root (readlink: Permission denied) 2024-09-19T08:47:17.247 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87352 fn_anonym ceph txt unknown /proc/31449/task/87352/exe (readlink: Permission denied) 2024-09-19T08:47:17.247 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87352 fn_anonym ceph NOFD /proc/31449/task/87352/fd (opendir: Permission denied) 2024-09-19T08:47:17.247 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87353 flusher ceph cwd unknown /proc/31449/task/87353/cwd (readlink: Permission denied) 2024-09-19T08:47:17.247 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87353 flusher ceph rtd unknown /proc/31449/task/87353/root (readlink: Permission denied) 2024-09-19T08:47:17.247 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87353 flusher ceph txt unknown /proc/31449/task/87353/exe (readlink: Permission denied) 2024-09-19T08:47:17.247 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87353 flusher ceph NOFD /proc/31449/task/87353/fd (opendir: Permission denied) 2024-09-19T08:47:17.247 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87354 ms_dispat ceph cwd unknown /proc/31449/task/87354/cwd (readlink: Permission denied) 2024-09-19T08:47:17.247 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87354 ms_dispat ceph rtd unknown /proc/31449/task/87354/root (readlink: Permission denied) 2024-09-19T08:47:17.247 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87354 ms_dispat ceph txt unknown /proc/31449/task/87354/exe (readlink: Permission denied) 2024-09-19T08:47:17.247 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87354 ms_dispat ceph NOFD /proc/31449/task/87354/fd (opendir: Permission denied) 2024-09-19T08:47:17.248 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87355 ms_local ceph cwd unknown /proc/31449/task/87355/cwd (readlink: Permission denied) 2024-09-19T08:47:17.248 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87355 ms_local ceph rtd unknown /proc/31449/task/87355/root (readlink: Permission denied) 2024-09-19T08:47:17.248 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87355 ms_local ceph txt unknown /proc/31449/task/87355/exe (readlink: Permission denied) 2024-09-19T08:47:17.248 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87355 ms_local ceph NOFD /proc/31449/task/87355/fd (opendir: Permission denied) 2024-09-19T08:47:17.248 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87356 safe_time ceph cwd unknown /proc/31449/task/87356/cwd (readlink: Permission denied) 2024-09-19T08:47:17.248 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87356 safe_time ceph rtd unknown /proc/31449/task/87356/root (readlink: Permission denied) 2024-09-19T08:47:17.248 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87356 safe_time ceph txt unknown /proc/31449/task/87356/exe (readlink: Permission denied) 2024-09-19T08:47:17.248 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87356 safe_time ceph NOFD /proc/31449/task/87356/fd (opendir: Permission denied) 2024-09-19T08:47:17.248 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87359 m-fin-sna ceph cwd unknown /proc/31449/task/87359/cwd (readlink: Permission denied) 2024-09-19T08:47:17.248 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87359 m-fin-sna ceph rtd unknown /proc/31449/task/87359/root (readlink: Permission denied) 2024-09-19T08:47:17.248 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87359 m-fin-sna ceph txt unknown /proc/31449/task/87359/exe (readlink: Permission denied) 2024-09-19T08:47:17.248 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 87359 m-fin-sna ceph NOFD /proc/31449/task/87359/fd (opendir: Permission denied) 2024-09-19T08:47:17.248 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 92186 m-fin-sna ceph cwd unknown /proc/31449/task/92186/cwd (readlink: Permission denied) 2024-09-19T08:47:17.249 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 92186 m-fin-sna ceph rtd unknown /proc/31449/task/92186/root (readlink: Permission denied) 2024-09-19T08:47:17.249 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 92186 m-fin-sna ceph txt unknown /proc/31449/task/92186/exe (readlink: Permission denied) 2024-09-19T08:47:17.249 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 31449 92186 m-fin-sna ceph NOFD /proc/31449/task/92186/fd (opendir: Permission denied) 2024-09-19T08:47:17.249 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 32416 root cwd unknown /proc/32416/cwd (readlink: Permission denied) 2024-09-19T08:47:17.249 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 32416 root rtd unknown /proc/32416/root (readlink: Permission denied) 2024-09-19T08:47:17.249 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 32416 root txt unknown /proc/32416/exe (readlink: Permission denied) 2024-09-19T08:47:17.249 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 32416 root NOFD /proc/32416/fd (opendir: Permission denied) 2024-09-19T08:47:17.249 INFO:tasks.workunit.client.0.smithi007.stdout:(sd-pam) 32418 root cwd unknown /proc/32418/cwd (readlink: Permission denied) 2024-09-19T08:47:17.249 INFO:tasks.workunit.client.0.smithi007.stdout:(sd-pam) 32418 root rtd unknown /proc/32418/root (readlink: Permission denied) 2024-09-19T08:47:17.249 INFO:tasks.workunit.client.0.smithi007.stdout:(sd-pam) 32418 root txt unknown /proc/32418/exe (readlink: Permission denied) 2024-09-19T08:47:17.249 INFO:tasks.workunit.client.0.smithi007.stdout:(sd-pam) 32418 root NOFD /proc/32418/fd (opendir: Permission denied) 2024-09-19T08:47:17.249 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 33799 root cwd unknown /proc/33799/cwd (readlink: Permission denied) 2024-09-19T08:47:17.249 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 33799 root rtd unknown /proc/33799/root (readlink: Permission denied) 2024-09-19T08:47:17.249 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 33799 root txt unknown /proc/33799/exe (readlink: Permission denied) 2024-09-19T08:47:17.250 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 33799 root NOFD /proc/33799/fd (opendir: Permission denied) 2024-09-19T08:47:17.250 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 41168 root cwd unknown /proc/41168/cwd (readlink: Permission denied) 2024-09-19T08:47:17.250 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 41168 root rtd unknown /proc/41168/root (readlink: Permission denied) 2024-09-19T08:47:17.250 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 41168 root txt unknown /proc/41168/exe (readlink: Permission denied) 2024-09-19T08:47:17.250 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 41168 root NOFD /proc/41168/fd (opendir: Permission denied) 2024-09-19T08:47:17.250 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 44953 root cwd unknown /proc/44953/cwd (readlink: Permission denied) 2024-09-19T08:47:17.250 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 44953 root rtd unknown /proc/44953/root (readlink: Permission denied) 2024-09-19T08:47:17.250 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 44953 root txt unknown /proc/44953/exe (readlink: Permission denied) 2024-09-19T08:47:17.250 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 44953 root NOFD /proc/44953/fd (opendir: Permission denied) 2024-09-19T08:47:17.250 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 44955 root cwd unknown /proc/44955/cwd (readlink: Permission denied) 2024-09-19T08:47:17.250 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 44955 root rtd unknown /proc/44955/root (readlink: Permission denied) 2024-09-19T08:47:17.250 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 44955 root txt unknown /proc/44955/exe (readlink: Permission denied) 2024-09-19T08:47:17.250 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 44955 root NOFD /proc/44955/fd (opendir: Permission denied) 2024-09-19T08:47:17.251 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 ceph cwd unknown /proc/44957/cwd (readlink: Permission denied) 2024-09-19T08:47:17.251 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 ceph rtd unknown /proc/44957/root (readlink: Permission denied) 2024-09-19T08:47:17.251 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 ceph txt unknown /proc/44957/exe (readlink: Permission denied) 2024-09-19T08:47:17.251 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 ceph NOFD /proc/44957/fd (opendir: Permission denied) 2024-09-19T08:47:17.251 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44958 log ceph cwd unknown /proc/44957/task/44958/cwd (readlink: Permission denied) 2024-09-19T08:47:17.251 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44958 log ceph rtd unknown /proc/44957/task/44958/root (readlink: Permission denied) 2024-09-19T08:47:17.251 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44958 log ceph txt unknown /proc/44957/task/44958/exe (readlink: Permission denied) 2024-09-19T08:47:17.251 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44958 log ceph NOFD /proc/44957/task/44958/fd (opendir: Permission denied) 2024-09-19T08:47:17.251 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44960 msgr-work ceph cwd unknown /proc/44957/task/44960/cwd (readlink: Permission denied) 2024-09-19T08:47:17.251 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44960 msgr-work ceph rtd unknown /proc/44957/task/44960/root (readlink: Permission denied) 2024-09-19T08:47:17.251 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44960 msgr-work ceph txt unknown /proc/44957/task/44960/exe (readlink: Permission denied) 2024-09-19T08:47:17.251 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44960 msgr-work ceph NOFD /proc/44957/task/44960/fd (opendir: Permission denied) 2024-09-19T08:47:17.251 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44961 msgr-work ceph cwd unknown /proc/44957/task/44961/cwd (readlink: Permission denied) 2024-09-19T08:47:17.251 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44961 msgr-work ceph rtd unknown /proc/44957/task/44961/root (readlink: Permission denied) 2024-09-19T08:47:17.252 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44961 msgr-work ceph txt unknown /proc/44957/task/44961/exe (readlink: Permission denied) 2024-09-19T08:47:17.252 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44961 msgr-work ceph NOFD /proc/44957/task/44961/fd (opendir: Permission denied) 2024-09-19T08:47:17.252 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44962 msgr-work ceph cwd unknown /proc/44957/task/44962/cwd (readlink: Permission denied) 2024-09-19T08:47:17.252 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44962 msgr-work ceph rtd unknown /proc/44957/task/44962/root (readlink: Permission denied) 2024-09-19T08:47:17.252 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44962 msgr-work ceph txt unknown /proc/44957/task/44962/exe (readlink: Permission denied) 2024-09-19T08:47:17.252 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44962 msgr-work ceph NOFD /proc/44957/task/44962/fd (opendir: Permission denied) 2024-09-19T08:47:17.252 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44966 service ceph cwd unknown /proc/44957/task/44966/cwd (readlink: Permission denied) 2024-09-19T08:47:17.252 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44966 service ceph rtd unknown /proc/44957/task/44966/root (readlink: Permission denied) 2024-09-19T08:47:17.252 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44966 service ceph txt unknown /proc/44957/task/44966/exe (readlink: Permission denied) 2024-09-19T08:47:17.252 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44966 service ceph NOFD /proc/44957/task/44966/fd (opendir: Permission denied) 2024-09-19T08:47:17.252 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44967 admin_soc ceph cwd unknown /proc/44957/task/44967/cwd (readlink: Permission denied) 2024-09-19T08:47:17.252 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44967 admin_soc ceph rtd unknown /proc/44957/task/44967/root (readlink: Permission denied) 2024-09-19T08:47:17.252 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44967 admin_soc ceph txt unknown /proc/44957/task/44967/exe (readlink: Permission denied) 2024-09-19T08:47:17.253 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 44967 admin_soc ceph NOFD /proc/44957/task/44967/fd (opendir: Permission denied) 2024-09-19T08:47:17.253 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45322 signal_ha ceph cwd unknown /proc/44957/task/45322/cwd (readlink: Permission denied) 2024-09-19T08:47:17.253 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45322 signal_ha ceph rtd unknown /proc/44957/task/45322/root (readlink: Permission denied) 2024-09-19T08:47:17.253 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45322 signal_ha ceph txt unknown /proc/44957/task/45322/exe (readlink: Permission denied) 2024-09-19T08:47:17.253 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45322 signal_ha ceph NOFD /proc/44957/task/45322/fd (opendir: Permission denied) 2024-09-19T08:47:17.253 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45323 io_contex ceph cwd unknown /proc/44957/task/45323/cwd (readlink: Permission denied) 2024-09-19T08:47:17.253 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45323 io_contex ceph rtd unknown /proc/44957/task/45323/root (readlink: Permission denied) 2024-09-19T08:47:17.253 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45323 io_contex ceph txt unknown /proc/44957/task/45323/exe (readlink: Permission denied) 2024-09-19T08:47:17.253 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45323 io_contex ceph NOFD /proc/44957/task/45323/fd (opendir: Permission denied) 2024-09-19T08:47:17.253 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45324 io_contex ceph cwd unknown /proc/44957/task/45324/cwd (readlink: Permission denied) 2024-09-19T08:47:17.253 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45324 io_contex ceph rtd unknown /proc/44957/task/45324/root (readlink: Permission denied) 2024-09-19T08:47:17.253 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45324 io_contex ceph txt unknown /proc/44957/task/45324/exe (readlink: Permission denied) 2024-09-19T08:47:17.253 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45324 io_contex ceph NOFD /proc/44957/task/45324/fd (opendir: Permission denied) 2024-09-19T08:47:17.253 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45332 OpHistory ceph cwd unknown /proc/44957/task/45332/cwd (readlink: Permission denied) 2024-09-19T08:47:17.253 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45332 OpHistory ceph rtd unknown /proc/44957/task/45332/root (readlink: Permission denied) 2024-09-19T08:47:17.254 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45332 OpHistory ceph txt unknown /proc/44957/task/45332/exe (readlink: Permission denied) 2024-09-19T08:47:17.254 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45332 OpHistory ceph NOFD /proc/44957/task/45332/fd (opendir: Permission denied) 2024-09-19T08:47:17.254 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45333 ceph_time ceph cwd unknown /proc/44957/task/45333/cwd (readlink: Permission denied) 2024-09-19T08:47:17.254 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45333 ceph_time ceph rtd unknown /proc/44957/task/45333/root (readlink: Permission denied) 2024-09-19T08:47:17.254 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45333 ceph_time ceph txt unknown /proc/44957/task/45333/exe (readlink: Permission denied) 2024-09-19T08:47:17.254 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45333 ceph_time ceph NOFD /proc/44957/task/45333/fd (opendir: Permission denied) 2024-09-19T08:47:17.254 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45666 ceph-osd ceph cwd unknown /proc/44957/task/45666/cwd (readlink: Permission denied) 2024-09-19T08:47:17.254 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45666 ceph-osd ceph rtd unknown /proc/44957/task/45666/root (readlink: Permission denied) 2024-09-19T08:47:17.254 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45666 ceph-osd ceph txt unknown /proc/44957/task/45666/exe (readlink: Permission denied) 2024-09-19T08:47:17.254 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45666 ceph-osd ceph NOFD /proc/44957/task/45666/fd (opendir: Permission denied) 2024-09-19T08:47:17.254 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45667 safe_time ceph cwd unknown /proc/44957/task/45667/cwd (readlink: Permission denied) 2024-09-19T08:47:17.254 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45667 safe_time ceph rtd unknown /proc/44957/task/45667/root (readlink: Permission denied) 2024-09-19T08:47:17.254 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45667 safe_time ceph txt unknown /proc/44957/task/45667/exe (readlink: Permission denied) 2024-09-19T08:47:17.255 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45667 safe_time ceph NOFD /proc/44957/task/45667/fd (opendir: Permission denied) 2024-09-19T08:47:17.255 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45668 safe_time ceph cwd unknown /proc/44957/task/45668/cwd (readlink: Permission denied) 2024-09-19T08:47:17.255 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45668 safe_time ceph rtd unknown /proc/44957/task/45668/root (readlink: Permission denied) 2024-09-19T08:47:17.255 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45668 safe_time ceph txt unknown /proc/44957/task/45668/exe (readlink: Permission denied) 2024-09-19T08:47:17.255 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45668 safe_time ceph NOFD /proc/44957/task/45668/fd (opendir: Permission denied) 2024-09-19T08:47:17.255 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45669 safe_time ceph cwd unknown /proc/44957/task/45669/cwd (readlink: Permission denied) 2024-09-19T08:47:17.255 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45669 safe_time ceph rtd unknown /proc/44957/task/45669/root (readlink: Permission denied) 2024-09-19T08:47:17.255 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45669 safe_time ceph txt unknown /proc/44957/task/45669/exe (readlink: Permission denied) 2024-09-19T08:47:17.255 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45669 safe_time ceph NOFD /proc/44957/task/45669/fd (opendir: Permission denied) 2024-09-19T08:47:17.255 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45670 safe_time ceph cwd unknown /proc/44957/task/45670/cwd (readlink: Permission denied) 2024-09-19T08:47:17.255 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45670 safe_time ceph rtd unknown /proc/44957/task/45670/root (readlink: Permission denied) 2024-09-19T08:47:17.255 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45670 safe_time ceph txt unknown /proc/44957/task/45670/exe (readlink: Permission denied) 2024-09-19T08:47:17.255 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45670 safe_time ceph NOFD /proc/44957/task/45670/fd (opendir: Permission denied) 2024-09-19T08:47:17.255 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45671 fn_anonym ceph cwd unknown /proc/44957/task/45671/cwd (readlink: Permission denied) 2024-09-19T08:47:17.256 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45671 fn_anonym ceph rtd unknown /proc/44957/task/45671/root (readlink: Permission denied) 2024-09-19T08:47:17.256 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45671 fn_anonym ceph txt unknown /proc/44957/task/45671/exe (readlink: Permission denied) 2024-09-19T08:47:17.256 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45671 fn_anonym ceph NOFD /proc/44957/task/45671/fd (opendir: Permission denied) 2024-09-19T08:47:17.256 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45760 rocksdb:l ceph cwd unknown /proc/44957/task/45760/cwd (readlink: Permission denied) 2024-09-19T08:47:17.256 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45760 rocksdb:l ceph rtd unknown /proc/44957/task/45760/root (readlink: Permission denied) 2024-09-19T08:47:17.256 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45760 rocksdb:l ceph txt unknown /proc/44957/task/45760/exe (readlink: Permission denied) 2024-09-19T08:47:17.256 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45760 rocksdb:l ceph NOFD /proc/44957/task/45760/fd (opendir: Permission denied) 2024-09-19T08:47:17.256 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45761 rocksdb:l ceph cwd unknown /proc/44957/task/45761/cwd (readlink: Permission denied) 2024-09-19T08:47:17.256 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45761 rocksdb:l ceph rtd unknown /proc/44957/task/45761/root (readlink: Permission denied) 2024-09-19T08:47:17.256 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45761 rocksdb:l ceph txt unknown /proc/44957/task/45761/exe (readlink: Permission denied) 2024-09-19T08:47:17.256 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45761 rocksdb:l ceph NOFD /proc/44957/task/45761/fd (opendir: Permission denied) 2024-09-19T08:47:17.256 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45762 rocksdb:l ceph cwd unknown /proc/44957/task/45762/cwd (readlink: Permission denied) 2024-09-19T08:47:17.256 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45762 rocksdb:l ceph rtd unknown /proc/44957/task/45762/root (readlink: Permission denied) 2024-09-19T08:47:17.256 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45762 rocksdb:l ceph txt unknown /proc/44957/task/45762/exe (readlink: Permission denied) 2024-09-19T08:47:17.257 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45762 rocksdb:l ceph NOFD /proc/44957/task/45762/fd (opendir: Permission denied) 2024-09-19T08:47:17.257 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45763 rocksdb:h ceph cwd unknown /proc/44957/task/45763/cwd (readlink: Permission denied) 2024-09-19T08:47:17.257 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45763 rocksdb:h ceph rtd unknown /proc/44957/task/45763/root (readlink: Permission denied) 2024-09-19T08:47:17.257 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45763 rocksdb:h ceph txt unknown /proc/44957/task/45763/exe (readlink: Permission denied) 2024-09-19T08:47:17.257 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 45763 rocksdb:h ceph NOFD /proc/44957/task/45763/fd (opendir: Permission denied) 2024-09-19T08:47:17.257 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46162 bstore_ai ceph cwd unknown /proc/44957/task/46162/cwd (readlink: Permission denied) 2024-09-19T08:47:17.257 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46162 bstore_ai ceph rtd unknown /proc/44957/task/46162/root (readlink: Permission denied) 2024-09-19T08:47:17.257 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46162 bstore_ai ceph txt unknown /proc/44957/task/46162/exe (readlink: Permission denied) 2024-09-19T08:47:17.257 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46162 bstore_ai ceph NOFD /proc/44957/task/46162/fd (opendir: Permission denied) 2024-09-19T08:47:17.257 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46163 bstore_di ceph cwd unknown /proc/44957/task/46163/cwd (readlink: Permission denied) 2024-09-19T08:47:17.257 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46163 bstore_di ceph rtd unknown /proc/44957/task/46163/root (readlink: Permission denied) 2024-09-19T08:47:17.257 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46163 bstore_di ceph txt unknown /proc/44957/task/46163/exe (readlink: Permission denied) 2024-09-19T08:47:17.257 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46163 bstore_di ceph NOFD /proc/44957/task/46163/fd (opendir: Permission denied) 2024-09-19T08:47:17.257 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46356 bstore_ai ceph cwd unknown /proc/44957/task/46356/cwd (readlink: Permission denied) 2024-09-19T08:47:17.258 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46356 bstore_ai ceph rtd unknown /proc/44957/task/46356/root (readlink: Permission denied) 2024-09-19T08:47:17.258 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46356 bstore_ai ceph txt unknown /proc/44957/task/46356/exe (readlink: Permission denied) 2024-09-19T08:47:17.258 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46356 bstore_ai ceph NOFD /proc/44957/task/46356/fd (opendir: Permission denied) 2024-09-19T08:47:17.258 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46357 bstore_di ceph cwd unknown /proc/44957/task/46357/cwd (readlink: Permission denied) 2024-09-19T08:47:17.258 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46357 bstore_di ceph rtd unknown /proc/44957/task/46357/root (readlink: Permission denied) 2024-09-19T08:47:17.258 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46357 bstore_di ceph txt unknown /proc/44957/task/46357/exe (readlink: Permission denied) 2024-09-19T08:47:17.258 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46357 bstore_di ceph NOFD /proc/44957/task/46357/fd (opendir: Permission denied) 2024-09-19T08:47:17.258 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46541 ceph-osd ceph cwd unknown /proc/44957/task/46541/cwd (readlink: Permission denied) 2024-09-19T08:47:17.258 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46541 ceph-osd ceph rtd unknown /proc/44957/task/46541/root (readlink: Permission denied) 2024-09-19T08:47:17.258 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46541 ceph-osd ceph txt unknown /proc/44957/task/46541/exe (readlink: Permission denied) 2024-09-19T08:47:17.258 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46541 ceph-osd ceph NOFD /proc/44957/task/46541/fd (opendir: Permission denied) 2024-09-19T08:47:17.258 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46542 cfin ceph cwd unknown /proc/44957/task/46542/cwd (readlink: Permission denied) 2024-09-19T08:47:17.258 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46542 cfin ceph rtd unknown /proc/44957/task/46542/root (readlink: Permission denied) 2024-09-19T08:47:17.259 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46542 cfin ceph txt unknown /proc/44957/task/46542/exe (readlink: Permission denied) 2024-09-19T08:47:17.259 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46542 cfin ceph NOFD /proc/44957/task/46542/fd (opendir: Permission denied) 2024-09-19T08:47:17.259 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46543 bstore_kv ceph cwd unknown /proc/44957/task/46543/cwd (readlink: Permission denied) 2024-09-19T08:47:17.259 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46543 bstore_kv ceph rtd unknown /proc/44957/task/46543/root (readlink: Permission denied) 2024-09-19T08:47:17.259 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46543 bstore_kv ceph txt unknown /proc/44957/task/46543/exe (readlink: Permission denied) 2024-09-19T08:47:17.259 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46543 bstore_kv ceph NOFD /proc/44957/task/46543/fd (opendir: Permission denied) 2024-09-19T08:47:17.259 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46544 bstore_kv ceph cwd unknown /proc/44957/task/46544/cwd (readlink: Permission denied) 2024-09-19T08:47:17.259 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46544 bstore_kv ceph rtd unknown /proc/44957/task/46544/root (readlink: Permission denied) 2024-09-19T08:47:17.259 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46544 bstore_kv ceph txt unknown /proc/44957/task/46544/exe (readlink: Permission denied) 2024-09-19T08:47:17.259 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46544 bstore_kv ceph NOFD /proc/44957/task/46544/fd (opendir: Permission denied) 2024-09-19T08:47:17.259 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46545 bstore_me ceph cwd unknown /proc/44957/task/46545/cwd (readlink: Permission denied) 2024-09-19T08:47:17.259 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46545 bstore_me ceph rtd unknown /proc/44957/task/46545/root (readlink: Permission denied) 2024-09-19T08:47:17.259 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46545 bstore_me ceph txt unknown /proc/44957/task/46545/exe (readlink: Permission denied) 2024-09-19T08:47:17.259 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46545 bstore_me ceph NOFD /proc/44957/task/46545/fd (opendir: Permission denied) 2024-09-19T08:47:17.260 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46550 ms_dispat ceph cwd unknown /proc/44957/task/46550/cwd (readlink: Permission denied) 2024-09-19T08:47:17.260 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46550 ms_dispat ceph rtd unknown /proc/44957/task/46550/root (readlink: Permission denied) 2024-09-19T08:47:17.260 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46550 ms_dispat ceph txt unknown /proc/44957/task/46550/exe (readlink: Permission denied) 2024-09-19T08:47:17.260 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46550 ms_dispat ceph NOFD /proc/44957/task/46550/fd (opendir: Permission denied) 2024-09-19T08:47:17.260 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46551 ms_local ceph cwd unknown /proc/44957/task/46551/cwd (readlink: Permission denied) 2024-09-19T08:47:17.260 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46551 ms_local ceph rtd unknown /proc/44957/task/46551/root (readlink: Permission denied) 2024-09-19T08:47:17.260 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46551 ms_local ceph txt unknown /proc/44957/task/46551/exe (readlink: Permission denied) 2024-09-19T08:47:17.260 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46551 ms_local ceph NOFD /proc/44957/task/46551/fd (opendir: Permission denied) 2024-09-19T08:47:17.260 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46552 safe_time ceph cwd unknown /proc/44957/task/46552/cwd (readlink: Permission denied) 2024-09-19T08:47:17.260 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46552 safe_time ceph rtd unknown /proc/44957/task/46552/root (readlink: Permission denied) 2024-09-19T08:47:17.261 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46552 safe_time ceph txt unknown /proc/44957/task/46552/exe (readlink: Permission denied) 2024-09-19T08:47:17.261 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46552 safe_time ceph NOFD /proc/44957/task/46552/fd (opendir: Permission denied) 2024-09-19T08:47:17.261 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46553 safe_time ceph cwd unknown /proc/44957/task/46553/cwd (readlink: Permission denied) 2024-09-19T08:47:17.261 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46553 safe_time ceph rtd unknown /proc/44957/task/46553/root (readlink: Permission denied) 2024-09-19T08:47:17.261 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46553 safe_time ceph txt unknown /proc/44957/task/46553/exe (readlink: Permission denied) 2024-09-19T08:47:17.261 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46553 safe_time ceph NOFD /proc/44957/task/46553/fd (opendir: Permission denied) 2024-09-19T08:47:17.261 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46554 ms_dispat ceph cwd unknown /proc/44957/task/46554/cwd (readlink: Permission denied) 2024-09-19T08:47:17.261 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46554 ms_dispat ceph rtd unknown /proc/44957/task/46554/root (readlink: Permission denied) 2024-09-19T08:47:17.261 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46554 ms_dispat ceph txt unknown /proc/44957/task/46554/exe (readlink: Permission denied) 2024-09-19T08:47:17.261 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46554 ms_dispat ceph NOFD /proc/44957/task/46554/fd (opendir: Permission denied) 2024-09-19T08:47:17.261 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46555 ms_local ceph cwd unknown /proc/44957/task/46555/cwd (readlink: Permission denied) 2024-09-19T08:47:17.261 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46555 ms_local ceph rtd unknown /proc/44957/task/46555/root (readlink: Permission denied) 2024-09-19T08:47:17.261 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46555 ms_local ceph txt unknown /proc/44957/task/46555/exe (readlink: Permission denied) 2024-09-19T08:47:17.262 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46555 ms_local ceph NOFD /proc/44957/task/46555/fd (opendir: Permission denied) 2024-09-19T08:47:17.262 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46556 ms_dispat ceph cwd unknown /proc/44957/task/46556/cwd (readlink: Permission denied) 2024-09-19T08:47:17.262 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46556 ms_dispat ceph rtd unknown /proc/44957/task/46556/root (readlink: Permission denied) 2024-09-19T08:47:17.262 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46556 ms_dispat ceph txt unknown /proc/44957/task/46556/exe (readlink: Permission denied) 2024-09-19T08:47:17.262 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46556 ms_dispat ceph NOFD /proc/44957/task/46556/fd (opendir: Permission denied) 2024-09-19T08:47:17.262 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46557 ms_local ceph cwd unknown /proc/44957/task/46557/cwd (readlink: Permission denied) 2024-09-19T08:47:17.262 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46557 ms_local ceph rtd unknown /proc/44957/task/46557/root (readlink: Permission denied) 2024-09-19T08:47:17.262 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46557 ms_local ceph txt unknown /proc/44957/task/46557/exe (readlink: Permission denied) 2024-09-19T08:47:17.262 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46557 ms_local ceph NOFD /proc/44957/task/46557/fd (opendir: Permission denied) 2024-09-19T08:47:17.262 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46558 ms_dispat ceph cwd unknown /proc/44957/task/46558/cwd (readlink: Permission denied) 2024-09-19T08:47:17.262 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46558 ms_dispat ceph rtd unknown /proc/44957/task/46558/root (readlink: Permission denied) 2024-09-19T08:47:17.262 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46558 ms_dispat ceph txt unknown /proc/44957/task/46558/exe (readlink: Permission denied) 2024-09-19T08:47:17.262 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46558 ms_dispat ceph NOFD /proc/44957/task/46558/fd (opendir: Permission denied) 2024-09-19T08:47:17.263 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46559 ms_local ceph cwd unknown /proc/44957/task/46559/cwd (readlink: Permission denied) 2024-09-19T08:47:17.263 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46559 ms_local ceph rtd unknown /proc/44957/task/46559/root (readlink: Permission denied) 2024-09-19T08:47:17.263 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46559 ms_local ceph txt unknown /proc/44957/task/46559/exe (readlink: Permission denied) 2024-09-19T08:47:17.263 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46559 ms_local ceph NOFD /proc/44957/task/46559/fd (opendir: Permission denied) 2024-09-19T08:47:17.263 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46560 ms_dispat ceph cwd unknown /proc/44957/task/46560/cwd (readlink: Permission denied) 2024-09-19T08:47:17.263 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46560 ms_dispat ceph rtd unknown /proc/44957/task/46560/root (readlink: Permission denied) 2024-09-19T08:47:17.263 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46560 ms_dispat ceph txt unknown /proc/44957/task/46560/exe (readlink: Permission denied) 2024-09-19T08:47:17.263 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46560 ms_dispat ceph NOFD /proc/44957/task/46560/fd (opendir: Permission denied) 2024-09-19T08:47:17.263 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46561 ms_local ceph cwd unknown /proc/44957/task/46561/cwd (readlink: Permission denied) 2024-09-19T08:47:17.263 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46561 ms_local ceph rtd unknown /proc/44957/task/46561/root (readlink: Permission denied) 2024-09-19T08:47:17.263 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46561 ms_local ceph txt unknown /proc/44957/task/46561/exe (readlink: Permission denied) 2024-09-19T08:47:17.263 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46561 ms_local ceph NOFD /proc/44957/task/46561/fd (opendir: Permission denied) 2024-09-19T08:47:17.263 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46562 ms_dispat ceph cwd unknown /proc/44957/task/46562/cwd (readlink: Permission denied) 2024-09-19T08:47:17.264 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46562 ms_dispat ceph rtd unknown /proc/44957/task/46562/root (readlink: Permission denied) 2024-09-19T08:47:17.264 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46562 ms_dispat ceph txt unknown /proc/44957/task/46562/exe (readlink: Permission denied) 2024-09-19T08:47:17.264 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46562 ms_dispat ceph NOFD /proc/44957/task/46562/fd (opendir: Permission denied) 2024-09-19T08:47:17.264 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46563 ms_local ceph cwd unknown /proc/44957/task/46563/cwd (readlink: Permission denied) 2024-09-19T08:47:17.264 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46563 ms_local ceph rtd unknown /proc/44957/task/46563/root (readlink: Permission denied) 2024-09-19T08:47:17.264 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46563 ms_local ceph txt unknown /proc/44957/task/46563/exe (readlink: Permission denied) 2024-09-19T08:47:17.264 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46563 ms_local ceph NOFD /proc/44957/task/46563/fd (opendir: Permission denied) 2024-09-19T08:47:17.264 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46564 ms_dispat ceph cwd unknown /proc/44957/task/46564/cwd (readlink: Permission denied) 2024-09-19T08:47:17.264 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46564 ms_dispat ceph rtd unknown /proc/44957/task/46564/root (readlink: Permission denied) 2024-09-19T08:47:17.264 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46564 ms_dispat ceph txt unknown /proc/44957/task/46564/exe (readlink: Permission denied) 2024-09-19T08:47:17.264 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46564 ms_dispat ceph NOFD /proc/44957/task/46564/fd (opendir: Permission denied) 2024-09-19T08:47:17.264 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46565 ms_local ceph cwd unknown /proc/44957/task/46565/cwd (readlink: Permission denied) 2024-09-19T08:47:17.264 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46565 ms_local ceph rtd unknown /proc/44957/task/46565/root (readlink: Permission denied) 2024-09-19T08:47:17.265 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46565 ms_local ceph txt unknown /proc/44957/task/46565/exe (readlink: Permission denied) 2024-09-19T08:47:17.265 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46565 ms_local ceph NOFD /proc/44957/task/46565/fd (opendir: Permission denied) 2024-09-19T08:47:17.265 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46566 fn_anonym ceph cwd unknown /proc/44957/task/46566/cwd (readlink: Permission denied) 2024-09-19T08:47:17.265 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46566 fn_anonym ceph rtd unknown /proc/44957/task/46566/root (readlink: Permission denied) 2024-09-19T08:47:17.265 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46566 fn_anonym ceph txt unknown /proc/44957/task/46566/exe (readlink: Permission denied) 2024-09-19T08:47:17.265 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46566 fn_anonym ceph NOFD /proc/44957/task/46566/fd (opendir: Permission denied) 2024-09-19T08:47:17.265 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46567 finisher ceph cwd unknown /proc/44957/task/46567/cwd (readlink: Permission denied) 2024-09-19T08:47:17.265 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46567 finisher ceph rtd unknown /proc/44957/task/46567/root (readlink: Permission denied) 2024-09-19T08:47:17.265 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46567 finisher ceph txt unknown /proc/44957/task/46567/exe (readlink: Permission denied) 2024-09-19T08:47:17.265 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46567 finisher ceph NOFD /proc/44957/task/46567/fd (opendir: Permission denied) 2024-09-19T08:47:17.265 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46568 safe_time ceph cwd unknown /proc/44957/task/46568/cwd (readlink: Permission denied) 2024-09-19T08:47:17.265 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46568 safe_time ceph rtd unknown /proc/44957/task/46568/root (readlink: Permission denied) 2024-09-19T08:47:17.265 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46568 safe_time ceph txt unknown /proc/44957/task/46568/exe (readlink: Permission denied) 2024-09-19T08:47:17.266 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46568 safe_time ceph NOFD /proc/44957/task/46568/fd (opendir: Permission denied) 2024-09-19T08:47:17.266 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46569 safe_time ceph cwd unknown /proc/44957/task/46569/cwd (readlink: Permission denied) 2024-09-19T08:47:17.266 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46569 safe_time ceph rtd unknown /proc/44957/task/46569/root (readlink: Permission denied) 2024-09-19T08:47:17.266 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46569 safe_time ceph txt unknown /proc/44957/task/46569/exe (readlink: Permission denied) 2024-09-19T08:47:17.266 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46569 safe_time ceph NOFD /proc/44957/task/46569/fd (opendir: Permission denied) 2024-09-19T08:47:17.266 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46570 ceph-osd ceph cwd unknown /proc/44957/task/46570/cwd (readlink: Permission denied) 2024-09-19T08:47:17.266 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46570 ceph-osd ceph rtd unknown /proc/44957/task/46570/root (readlink: Permission denied) 2024-09-19T08:47:17.266 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46570 ceph-osd ceph txt unknown /proc/44957/task/46570/exe (readlink: Permission denied) 2024-09-19T08:47:17.266 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46570 ceph-osd ceph NOFD /proc/44957/task/46570/fd (opendir: Permission denied) 2024-09-19T08:47:17.266 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46571 osd_srv_a ceph cwd unknown /proc/44957/task/46571/cwd (readlink: Permission denied) 2024-09-19T08:47:17.266 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46571 osd_srv_a ceph rtd unknown /proc/44957/task/46571/root (readlink: Permission denied) 2024-09-19T08:47:17.266 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46571 osd_srv_a ceph txt unknown /proc/44957/task/46571/exe (readlink: Permission denied) 2024-09-19T08:47:17.266 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46571 osd_srv_a ceph NOFD /proc/44957/task/46571/fd (opendir: Permission denied) 2024-09-19T08:47:17.267 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46572 tp_osd_tp ceph cwd unknown /proc/44957/task/46572/cwd (readlink: Permission denied) 2024-09-19T08:47:17.267 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46572 tp_osd_tp ceph rtd unknown /proc/44957/task/46572/root (readlink: Permission denied) 2024-09-19T08:47:17.267 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46572 tp_osd_tp ceph txt unknown /proc/44957/task/46572/exe (readlink: Permission denied) 2024-09-19T08:47:17.267 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46572 tp_osd_tp ceph NOFD /proc/44957/task/46572/fd (opendir: Permission denied) 2024-09-19T08:47:17.267 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46573 tp_osd_tp ceph cwd unknown /proc/44957/task/46573/cwd (readlink: Permission denied) 2024-09-19T08:47:17.267 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46573 tp_osd_tp ceph rtd unknown /proc/44957/task/46573/root (readlink: Permission denied) 2024-09-19T08:47:17.267 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46573 tp_osd_tp ceph txt unknown /proc/44957/task/46573/exe (readlink: Permission denied) 2024-09-19T08:47:17.267 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46573 tp_osd_tp ceph NOFD /proc/44957/task/46573/fd (opendir: Permission denied) 2024-09-19T08:47:17.267 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46574 tp_osd_tp ceph cwd unknown /proc/44957/task/46574/cwd (readlink: Permission denied) 2024-09-19T08:47:17.267 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46574 tp_osd_tp ceph rtd unknown /proc/44957/task/46574/root (readlink: Permission denied) 2024-09-19T08:47:17.267 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46574 tp_osd_tp ceph txt unknown /proc/44957/task/46574/exe (readlink: Permission denied) 2024-09-19T08:47:17.267 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46574 tp_osd_tp ceph NOFD /proc/44957/task/46574/fd (opendir: Permission denied) 2024-09-19T08:47:17.267 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46575 tp_osd_tp ceph cwd unknown /proc/44957/task/46575/cwd (readlink: Permission denied) 2024-09-19T08:47:17.268 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46575 tp_osd_tp ceph rtd unknown /proc/44957/task/46575/root (readlink: Permission denied) 2024-09-19T08:47:17.268 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46575 tp_osd_tp ceph txt unknown /proc/44957/task/46575/exe (readlink: Permission denied) 2024-09-19T08:47:17.268 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46575 tp_osd_tp ceph NOFD /proc/44957/task/46575/fd (opendir: Permission denied) 2024-09-19T08:47:17.268 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46576 tp_osd_tp ceph cwd unknown /proc/44957/task/46576/cwd (readlink: Permission denied) 2024-09-19T08:47:17.268 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46576 tp_osd_tp ceph rtd unknown /proc/44957/task/46576/root (readlink: Permission denied) 2024-09-19T08:47:17.268 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46576 tp_osd_tp ceph txt unknown /proc/44957/task/46576/exe (readlink: Permission denied) 2024-09-19T08:47:17.268 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46576 tp_osd_tp ceph NOFD /proc/44957/task/46576/fd (opendir: Permission denied) 2024-09-19T08:47:17.268 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46577 tp_osd_tp ceph cwd unknown /proc/44957/task/46577/cwd (readlink: Permission denied) 2024-09-19T08:47:17.268 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46577 tp_osd_tp ceph rtd unknown /proc/44957/task/46577/root (readlink: Permission denied) 2024-09-19T08:47:17.268 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46577 tp_osd_tp ceph txt unknown /proc/44957/task/46577/exe (readlink: Permission denied) 2024-09-19T08:47:17.268 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46577 tp_osd_tp ceph NOFD /proc/44957/task/46577/fd (opendir: Permission denied) 2024-09-19T08:47:17.268 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46578 tp_osd_tp ceph cwd unknown /proc/44957/task/46578/cwd (readlink: Permission denied) 2024-09-19T08:47:17.268 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46578 tp_osd_tp ceph rtd unknown /proc/44957/task/46578/root (readlink: Permission denied) 2024-09-19T08:47:17.269 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46578 tp_osd_tp ceph txt unknown /proc/44957/task/46578/exe (readlink: Permission denied) 2024-09-19T08:47:17.269 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46578 tp_osd_tp ceph NOFD /proc/44957/task/46578/fd (opendir: Permission denied) 2024-09-19T08:47:17.269 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46579 tp_osd_tp ceph cwd unknown /proc/44957/task/46579/cwd (readlink: Permission denied) 2024-09-19T08:47:17.269 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46579 tp_osd_tp ceph rtd unknown /proc/44957/task/46579/root (readlink: Permission denied) 2024-09-19T08:47:17.269 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46579 tp_osd_tp ceph txt unknown /proc/44957/task/46579/exe (readlink: Permission denied) 2024-09-19T08:47:17.269 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46579 tp_osd_tp ceph NOFD /proc/44957/task/46579/fd (opendir: Permission denied) 2024-09-19T08:47:17.269 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46580 tp_osd_tp ceph cwd unknown /proc/44957/task/46580/cwd (readlink: Permission denied) 2024-09-19T08:47:17.269 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46580 tp_osd_tp ceph rtd unknown /proc/44957/task/46580/root (readlink: Permission denied) 2024-09-19T08:47:17.269 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46580 tp_osd_tp ceph txt unknown /proc/44957/task/46580/exe (readlink: Permission denied) 2024-09-19T08:47:17.269 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46580 tp_osd_tp ceph NOFD /proc/44957/task/46580/fd (opendir: Permission denied) 2024-09-19T08:47:17.269 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46581 tp_osd_tp ceph cwd unknown /proc/44957/task/46581/cwd (readlink: Permission denied) 2024-09-19T08:47:17.269 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46581 tp_osd_tp ceph rtd unknown /proc/44957/task/46581/root (readlink: Permission denied) 2024-09-19T08:47:17.269 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46581 tp_osd_tp ceph txt unknown /proc/44957/task/46581/exe (readlink: Permission denied) 2024-09-19T08:47:17.270 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46581 tp_osd_tp ceph NOFD /proc/44957/task/46581/fd (opendir: Permission denied) 2024-09-19T08:47:17.270 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46582 tp_osd_tp ceph cwd unknown /proc/44957/task/46582/cwd (readlink: Permission denied) 2024-09-19T08:47:17.270 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46582 tp_osd_tp ceph rtd unknown /proc/44957/task/46582/root (readlink: Permission denied) 2024-09-19T08:47:17.270 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46582 tp_osd_tp ceph txt unknown /proc/44957/task/46582/exe (readlink: Permission denied) 2024-09-19T08:47:17.270 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46582 tp_osd_tp ceph NOFD /proc/44957/task/46582/fd (opendir: Permission denied) 2024-09-19T08:47:17.270 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46583 tp_osd_tp ceph cwd unknown /proc/44957/task/46583/cwd (readlink: Permission denied) 2024-09-19T08:47:17.270 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46583 tp_osd_tp ceph rtd unknown /proc/44957/task/46583/root (readlink: Permission denied) 2024-09-19T08:47:17.270 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46583 tp_osd_tp ceph txt unknown /proc/44957/task/46583/exe (readlink: Permission denied) 2024-09-19T08:47:17.270 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46583 tp_osd_tp ceph NOFD /proc/44957/task/46583/fd (opendir: Permission denied) 2024-09-19T08:47:17.270 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46584 tp_osd_tp ceph cwd unknown /proc/44957/task/46584/cwd (readlink: Permission denied) 2024-09-19T08:47:17.270 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46584 tp_osd_tp ceph rtd unknown /proc/44957/task/46584/root (readlink: Permission denied) 2024-09-19T08:47:17.270 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46584 tp_osd_tp ceph txt unknown /proc/44957/task/46584/exe (readlink: Permission denied) 2024-09-19T08:47:17.270 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46584 tp_osd_tp ceph NOFD /proc/44957/task/46584/fd (opendir: Permission denied) 2024-09-19T08:47:17.271 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46585 tp_osd_tp ceph cwd unknown /proc/44957/task/46585/cwd (readlink: Permission denied) 2024-09-19T08:47:17.271 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46585 tp_osd_tp ceph rtd unknown /proc/44957/task/46585/root (readlink: Permission denied) 2024-09-19T08:47:17.271 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46585 tp_osd_tp ceph txt unknown /proc/44957/task/46585/exe (readlink: Permission denied) 2024-09-19T08:47:17.271 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46585 tp_osd_tp ceph NOFD /proc/44957/task/46585/fd (opendir: Permission denied) 2024-09-19T08:47:17.271 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46586 tp_osd_tp ceph cwd unknown /proc/44957/task/46586/cwd (readlink: Permission denied) 2024-09-19T08:47:17.271 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46586 tp_osd_tp ceph rtd unknown /proc/44957/task/46586/root (readlink: Permission denied) 2024-09-19T08:47:17.271 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46586 tp_osd_tp ceph txt unknown /proc/44957/task/46586/exe (readlink: Permission denied) 2024-09-19T08:47:17.271 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46586 tp_osd_tp ceph NOFD /proc/44957/task/46586/fd (opendir: Permission denied) 2024-09-19T08:47:17.271 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46587 tp_osd_tp ceph cwd unknown /proc/44957/task/46587/cwd (readlink: Permission denied) 2024-09-19T08:47:17.271 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46587 tp_osd_tp ceph rtd unknown /proc/44957/task/46587/root (readlink: Permission denied) 2024-09-19T08:47:17.271 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46587 tp_osd_tp ceph txt unknown /proc/44957/task/46587/exe (readlink: Permission denied) 2024-09-19T08:47:17.271 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46587 tp_osd_tp ceph NOFD /proc/44957/task/46587/fd (opendir: Permission denied) 2024-09-19T08:47:17.271 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46588 osd_srv_h ceph cwd unknown /proc/44957/task/46588/cwd (readlink: Permission denied) 2024-09-19T08:47:17.272 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46588 osd_srv_h ceph rtd unknown /proc/44957/task/46588/root (readlink: Permission denied) 2024-09-19T08:47:17.272 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46588 osd_srv_h ceph txt unknown /proc/44957/task/46588/exe (readlink: Permission denied) 2024-09-19T08:47:17.272 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 44957 46588 osd_srv_h ceph NOFD /proc/44957/task/46588/fd (opendir: Permission denied) 2024-09-19T08:47:17.272 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 45674 root cwd unknown /proc/45674/cwd (readlink: Permission denied) 2024-09-19T08:47:17.272 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 45674 root rtd unknown /proc/45674/root (readlink: Permission denied) 2024-09-19T08:47:17.272 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 45674 root txt unknown /proc/45674/exe (readlink: Permission denied) 2024-09-19T08:47:17.272 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 45674 root NOFD /proc/45674/fd (opendir: Permission denied) 2024-09-19T08:47:17.272 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 45694 root cwd unknown /proc/45694/cwd (readlink: Permission denied) 2024-09-19T08:47:17.272 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 45694 root rtd unknown /proc/45694/root (readlink: Permission denied) 2024-09-19T08:47:17.272 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 45694 root txt unknown /proc/45694/exe (readlink: Permission denied) 2024-09-19T08:47:17.272 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 45694 root NOFD /proc/45694/fd (opendir: Permission denied) 2024-09-19T08:47:17.272 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 51872 root cwd unknown /proc/51872/cwd (readlink: Permission denied) 2024-09-19T08:47:17.272 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 51872 root rtd unknown /proc/51872/root (readlink: Permission denied) 2024-09-19T08:47:17.273 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 51872 root txt unknown /proc/51872/exe (readlink: Permission denied) 2024-09-19T08:47:17.273 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 51872 root NOFD /proc/51872/fd (opendir: Permission denied) 2024-09-19T08:47:17.273 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 51874 root cwd unknown /proc/51874/cwd (readlink: Permission denied) 2024-09-19T08:47:17.273 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 51874 root rtd unknown /proc/51874/root (readlink: Permission denied) 2024-09-19T08:47:17.273 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 51874 root txt unknown /proc/51874/exe (readlink: Permission denied) 2024-09-19T08:47:17.273 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 51874 root NOFD /proc/51874/fd (opendir: Permission denied) 2024-09-19T08:47:17.273 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 ceph cwd unknown /proc/51876/cwd (readlink: Permission denied) 2024-09-19T08:47:17.273 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 ceph rtd unknown /proc/51876/root (readlink: Permission denied) 2024-09-19T08:47:17.273 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 ceph txt unknown /proc/51876/exe (readlink: Permission denied) 2024-09-19T08:47:17.273 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 ceph NOFD /proc/51876/fd (opendir: Permission denied) 2024-09-19T08:47:17.273 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51877 log ceph cwd unknown /proc/51876/task/51877/cwd (readlink: Permission denied) 2024-09-19T08:47:17.273 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51877 log ceph rtd unknown /proc/51876/task/51877/root (readlink: Permission denied) 2024-09-19T08:47:17.273 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51877 log ceph txt unknown /proc/51876/task/51877/exe (readlink: Permission denied) 2024-09-19T08:47:17.273 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51877 log ceph NOFD /proc/51876/task/51877/fd (opendir: Permission denied) 2024-09-19T08:47:17.274 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51879 msgr-work ceph cwd unknown /proc/51876/task/51879/cwd (readlink: Permission denied) 2024-09-19T08:47:17.274 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51879 msgr-work ceph rtd unknown /proc/51876/task/51879/root (readlink: Permission denied) 2024-09-19T08:47:17.274 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51879 msgr-work ceph txt unknown /proc/51876/task/51879/exe (readlink: Permission denied) 2024-09-19T08:47:17.274 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51879 msgr-work ceph NOFD /proc/51876/task/51879/fd (opendir: Permission denied) 2024-09-19T08:47:17.274 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51880 msgr-work ceph cwd unknown /proc/51876/task/51880/cwd (readlink: Permission denied) 2024-09-19T08:47:17.274 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51880 msgr-work ceph rtd unknown /proc/51876/task/51880/root (readlink: Permission denied) 2024-09-19T08:47:17.274 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51880 msgr-work ceph txt unknown /proc/51876/task/51880/exe (readlink: Permission denied) 2024-09-19T08:47:17.274 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51880 msgr-work ceph NOFD /proc/51876/task/51880/fd (opendir: Permission denied) 2024-09-19T08:47:17.274 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51881 msgr-work ceph cwd unknown /proc/51876/task/51881/cwd (readlink: Permission denied) 2024-09-19T08:47:17.274 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51881 msgr-work ceph rtd unknown /proc/51876/task/51881/root (readlink: Permission denied) 2024-09-19T08:47:17.274 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51881 msgr-work ceph txt unknown /proc/51876/task/51881/exe (readlink: Permission denied) 2024-09-19T08:47:17.274 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51881 msgr-work ceph NOFD /proc/51876/task/51881/fd (opendir: Permission denied) 2024-09-19T08:47:17.274 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51885 service ceph cwd unknown /proc/51876/task/51885/cwd (readlink: Permission denied) 2024-09-19T08:47:17.275 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51885 service ceph rtd unknown /proc/51876/task/51885/root (readlink: Permission denied) 2024-09-19T08:47:17.275 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51885 service ceph txt unknown /proc/51876/task/51885/exe (readlink: Permission denied) 2024-09-19T08:47:17.275 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51885 service ceph NOFD /proc/51876/task/51885/fd (opendir: Permission denied) 2024-09-19T08:47:17.275 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51886 admin_soc ceph cwd unknown /proc/51876/task/51886/cwd (readlink: Permission denied) 2024-09-19T08:47:17.275 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51886 admin_soc ceph rtd unknown /proc/51876/task/51886/root (readlink: Permission denied) 2024-09-19T08:47:17.275 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51886 admin_soc ceph txt unknown /proc/51876/task/51886/exe (readlink: Permission denied) 2024-09-19T08:47:17.275 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 51886 admin_soc ceph NOFD /proc/51876/task/51886/fd (opendir: Permission denied) 2024-09-19T08:47:17.275 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52221 signal_ha ceph cwd unknown /proc/51876/task/52221/cwd (readlink: Permission denied) 2024-09-19T08:47:17.275 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52221 signal_ha ceph rtd unknown /proc/51876/task/52221/root (readlink: Permission denied) 2024-09-19T08:47:17.275 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52221 signal_ha ceph txt unknown /proc/51876/task/52221/exe (readlink: Permission denied) 2024-09-19T08:47:17.275 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52221 signal_ha ceph NOFD /proc/51876/task/52221/fd (opendir: Permission denied) 2024-09-19T08:47:17.275 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52222 io_contex ceph cwd unknown /proc/51876/task/52222/cwd (readlink: Permission denied) 2024-09-19T08:47:17.275 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52222 io_contex ceph rtd unknown /proc/51876/task/52222/root (readlink: Permission denied) 2024-09-19T08:47:17.276 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52222 io_contex ceph txt unknown /proc/51876/task/52222/exe (readlink: Permission denied) 2024-09-19T08:47:17.276 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52222 io_contex ceph NOFD /proc/51876/task/52222/fd (opendir: Permission denied) 2024-09-19T08:47:17.276 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52223 io_contex ceph cwd unknown /proc/51876/task/52223/cwd (readlink: Permission denied) 2024-09-19T08:47:17.276 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52223 io_contex ceph rtd unknown /proc/51876/task/52223/root (readlink: Permission denied) 2024-09-19T08:47:17.276 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52223 io_contex ceph txt unknown /proc/51876/task/52223/exe (readlink: Permission denied) 2024-09-19T08:47:17.276 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52223 io_contex ceph NOFD /proc/51876/task/52223/fd (opendir: Permission denied) 2024-09-19T08:47:17.276 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52245 OpHistory ceph cwd unknown /proc/51876/task/52245/cwd (readlink: Permission denied) 2024-09-19T08:47:17.276 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52245 OpHistory ceph rtd unknown /proc/51876/task/52245/root (readlink: Permission denied) 2024-09-19T08:47:17.276 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52245 OpHistory ceph txt unknown /proc/51876/task/52245/exe (readlink: Permission denied) 2024-09-19T08:47:17.276 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52245 OpHistory ceph NOFD /proc/51876/task/52245/fd (opendir: Permission denied) 2024-09-19T08:47:17.276 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52246 ceph_time ceph cwd unknown /proc/51876/task/52246/cwd (readlink: Permission denied) 2024-09-19T08:47:17.276 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52246 ceph_time ceph rtd unknown /proc/51876/task/52246/root (readlink: Permission denied) 2024-09-19T08:47:17.276 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52246 ceph_time ceph txt unknown /proc/51876/task/52246/exe (readlink: Permission denied) 2024-09-19T08:47:17.276 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52246 ceph_time ceph NOFD /proc/51876/task/52246/fd (opendir: Permission denied) 2024-09-19T08:47:17.277 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52274 ceph-osd ceph cwd unknown /proc/51876/task/52274/cwd (readlink: Permission denied) 2024-09-19T08:47:17.277 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52274 ceph-osd ceph rtd unknown /proc/51876/task/52274/root (readlink: Permission denied) 2024-09-19T08:47:17.277 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52274 ceph-osd ceph txt unknown /proc/51876/task/52274/exe (readlink: Permission denied) 2024-09-19T08:47:17.277 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52274 ceph-osd ceph NOFD /proc/51876/task/52274/fd (opendir: Permission denied) 2024-09-19T08:47:17.277 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52284 ceph-osd ceph cwd unknown /proc/51876/task/52284/cwd (readlink: Permission denied) 2024-09-19T08:47:17.277 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52284 ceph-osd ceph rtd unknown /proc/51876/task/52284/root (readlink: Permission denied) 2024-09-19T08:47:17.277 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52284 ceph-osd ceph txt unknown /proc/51876/task/52284/exe (readlink: Permission denied) 2024-09-19T08:47:17.277 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52284 ceph-osd ceph NOFD /proc/51876/task/52284/fd (opendir: Permission denied) 2024-09-19T08:47:17.277 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52343 ceph-osd ceph cwd unknown /proc/51876/task/52343/cwd (readlink: Permission denied) 2024-09-19T08:47:17.277 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52343 ceph-osd ceph rtd unknown /proc/51876/task/52343/root (readlink: Permission denied) 2024-09-19T08:47:17.277 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52343 ceph-osd ceph txt unknown /proc/51876/task/52343/exe (readlink: Permission denied) 2024-09-19T08:47:17.277 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52343 ceph-osd ceph NOFD /proc/51876/task/52343/fd (opendir: Permission denied) 2024-09-19T08:47:17.278 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52429 ceph-osd ceph cwd unknown /proc/51876/task/52429/cwd (readlink: Permission denied) 2024-09-19T08:47:17.278 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52429 ceph-osd ceph rtd unknown /proc/51876/task/52429/root (readlink: Permission denied) 2024-09-19T08:47:17.278 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52429 ceph-osd ceph txt unknown /proc/51876/task/52429/exe (readlink: Permission denied) 2024-09-19T08:47:17.278 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52429 ceph-osd ceph NOFD /proc/51876/task/52429/fd (opendir: Permission denied) 2024-09-19T08:47:17.278 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52487 ceph-osd ceph cwd unknown /proc/51876/task/52487/cwd (readlink: Permission denied) 2024-09-19T08:47:17.278 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52487 ceph-osd ceph rtd unknown /proc/51876/task/52487/root (readlink: Permission denied) 2024-09-19T08:47:17.278 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52487 ceph-osd ceph txt unknown /proc/51876/task/52487/exe (readlink: Permission denied) 2024-09-19T08:47:17.278 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52487 ceph-osd ceph NOFD /proc/51876/task/52487/fd (opendir: Permission denied) 2024-09-19T08:47:17.278 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52511 ceph-osd ceph cwd unknown /proc/51876/task/52511/cwd (readlink: Permission denied) 2024-09-19T08:47:17.278 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52511 ceph-osd ceph rtd unknown /proc/51876/task/52511/root (readlink: Permission denied) 2024-09-19T08:47:17.278 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52511 ceph-osd ceph txt unknown /proc/51876/task/52511/exe (readlink: Permission denied) 2024-09-19T08:47:17.278 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52511 ceph-osd ceph NOFD /proc/51876/task/52511/fd (opendir: Permission denied) 2024-09-19T08:47:17.278 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52516 ceph-osd ceph cwd unknown /proc/51876/task/52516/cwd (readlink: Permission denied) 2024-09-19T08:47:17.278 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52516 ceph-osd ceph rtd unknown /proc/51876/task/52516/root (readlink: Permission denied) 2024-09-19T08:47:17.279 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52516 ceph-osd ceph txt unknown /proc/51876/task/52516/exe (readlink: Permission denied) 2024-09-19T08:47:17.279 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52516 ceph-osd ceph NOFD /proc/51876/task/52516/fd (opendir: Permission denied) 2024-09-19T08:47:17.279 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52523 ceph-osd ceph cwd unknown /proc/51876/task/52523/cwd (readlink: Permission denied) 2024-09-19T08:47:17.279 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52523 ceph-osd ceph rtd unknown /proc/51876/task/52523/root (readlink: Permission denied) 2024-09-19T08:47:17.279 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52523 ceph-osd ceph txt unknown /proc/51876/task/52523/exe (readlink: Permission denied) 2024-09-19T08:47:17.279 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52523 ceph-osd ceph NOFD /proc/51876/task/52523/fd (opendir: Permission denied) 2024-09-19T08:47:17.279 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52524 ceph-osd ceph cwd unknown /proc/51876/task/52524/cwd (readlink: Permission denied) 2024-09-19T08:47:17.279 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52524 ceph-osd ceph rtd unknown /proc/51876/task/52524/root (readlink: Permission denied) 2024-09-19T08:47:17.279 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52524 ceph-osd ceph txt unknown /proc/51876/task/52524/exe (readlink: Permission denied) 2024-09-19T08:47:17.279 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52524 ceph-osd ceph NOFD /proc/51876/task/52524/fd (opendir: Permission denied) 2024-09-19T08:47:17.279 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52525 safe_time ceph cwd unknown /proc/51876/task/52525/cwd (readlink: Permission denied) 2024-09-19T08:47:17.279 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52525 safe_time ceph rtd unknown /proc/51876/task/52525/root (readlink: Permission denied) 2024-09-19T08:47:17.279 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52525 safe_time ceph txt unknown /proc/51876/task/52525/exe (readlink: Permission denied) 2024-09-19T08:47:17.279 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52525 safe_time ceph NOFD /proc/51876/task/52525/fd (opendir: Permission denied) 2024-09-19T08:47:17.280 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52526 safe_time ceph cwd unknown /proc/51876/task/52526/cwd (readlink: Permission denied) 2024-09-19T08:47:17.280 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52526 safe_time ceph rtd unknown /proc/51876/task/52526/root (readlink: Permission denied) 2024-09-19T08:47:17.280 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52526 safe_time ceph txt unknown /proc/51876/task/52526/exe (readlink: Permission denied) 2024-09-19T08:47:17.280 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52526 safe_time ceph NOFD /proc/51876/task/52526/fd (opendir: Permission denied) 2024-09-19T08:47:17.280 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52527 safe_time ceph cwd unknown /proc/51876/task/52527/cwd (readlink: Permission denied) 2024-09-19T08:47:17.280 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52527 safe_time ceph rtd unknown /proc/51876/task/52527/root (readlink: Permission denied) 2024-09-19T08:47:17.280 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52527 safe_time ceph txt unknown /proc/51876/task/52527/exe (readlink: Permission denied) 2024-09-19T08:47:17.280 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52527 safe_time ceph NOFD /proc/51876/task/52527/fd (opendir: Permission denied) 2024-09-19T08:47:17.280 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52528 safe_time ceph cwd unknown /proc/51876/task/52528/cwd (readlink: Permission denied) 2024-09-19T08:47:17.280 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52528 safe_time ceph rtd unknown /proc/51876/task/52528/root (readlink: Permission denied) 2024-09-19T08:47:17.280 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52528 safe_time ceph txt unknown /proc/51876/task/52528/exe (readlink: Permission denied) 2024-09-19T08:47:17.280 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52528 safe_time ceph NOFD /proc/51876/task/52528/fd (opendir: Permission denied) 2024-09-19T08:47:17.280 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52529 fn_anonym ceph cwd unknown /proc/51876/task/52529/cwd (readlink: Permission denied) 2024-09-19T08:47:17.281 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52529 fn_anonym ceph rtd unknown /proc/51876/task/52529/root (readlink: Permission denied) 2024-09-19T08:47:17.281 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52529 fn_anonym ceph txt unknown /proc/51876/task/52529/exe (readlink: Permission denied) 2024-09-19T08:47:17.281 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52529 fn_anonym ceph NOFD /proc/51876/task/52529/fd (opendir: Permission denied) 2024-09-19T08:47:17.281 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52696 rocksdb:l ceph cwd unknown /proc/51876/task/52696/cwd (readlink: Permission denied) 2024-09-19T08:47:17.281 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52696 rocksdb:l ceph rtd unknown /proc/51876/task/52696/root (readlink: Permission denied) 2024-09-19T08:47:17.281 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52696 rocksdb:l ceph txt unknown /proc/51876/task/52696/exe (readlink: Permission denied) 2024-09-19T08:47:17.281 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52696 rocksdb:l ceph NOFD /proc/51876/task/52696/fd (opendir: Permission denied) 2024-09-19T08:47:17.281 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52697 rocksdb:l ceph cwd unknown /proc/51876/task/52697/cwd (readlink: Permission denied) 2024-09-19T08:47:17.281 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52697 rocksdb:l ceph rtd unknown /proc/51876/task/52697/root (readlink: Permission denied) 2024-09-19T08:47:17.281 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52697 rocksdb:l ceph txt unknown /proc/51876/task/52697/exe (readlink: Permission denied) 2024-09-19T08:47:17.281 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52697 rocksdb:l ceph NOFD /proc/51876/task/52697/fd (opendir: Permission denied) 2024-09-19T08:47:17.281 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52698 rocksdb:l ceph cwd unknown /proc/51876/task/52698/cwd (readlink: Permission denied) 2024-09-19T08:47:17.281 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52698 rocksdb:l ceph rtd unknown /proc/51876/task/52698/root (readlink: Permission denied) 2024-09-19T08:47:17.282 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52698 rocksdb:l ceph txt unknown /proc/51876/task/52698/exe (readlink: Permission denied) 2024-09-19T08:47:17.282 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52698 rocksdb:l ceph NOFD /proc/51876/task/52698/fd (opendir: Permission denied) 2024-09-19T08:47:17.282 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52699 rocksdb:h ceph cwd unknown /proc/51876/task/52699/cwd (readlink: Permission denied) 2024-09-19T08:47:17.282 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52699 rocksdb:h ceph rtd unknown /proc/51876/task/52699/root (readlink: Permission denied) 2024-09-19T08:47:17.282 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52699 rocksdb:h ceph txt unknown /proc/51876/task/52699/exe (readlink: Permission denied) 2024-09-19T08:47:17.282 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 52699 rocksdb:h ceph NOFD /proc/51876/task/52699/fd (opendir: Permission denied) 2024-09-19T08:47:17.282 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53108 bstore_ai ceph cwd unknown /proc/51876/task/53108/cwd (readlink: Permission denied) 2024-09-19T08:47:17.282 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53108 bstore_ai ceph rtd unknown /proc/51876/task/53108/root (readlink: Permission denied) 2024-09-19T08:47:17.282 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53108 bstore_ai ceph txt unknown /proc/51876/task/53108/exe (readlink: Permission denied) 2024-09-19T08:47:17.282 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53108 bstore_ai ceph NOFD /proc/51876/task/53108/fd (opendir: Permission denied) 2024-09-19T08:47:17.282 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53109 bstore_di ceph cwd unknown /proc/51876/task/53109/cwd (readlink: Permission denied) 2024-09-19T08:47:17.282 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53109 bstore_di ceph rtd unknown /proc/51876/task/53109/root (readlink: Permission denied) 2024-09-19T08:47:17.282 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53109 bstore_di ceph txt unknown /proc/51876/task/53109/exe (readlink: Permission denied) 2024-09-19T08:47:17.282 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53109 bstore_di ceph NOFD /proc/51876/task/53109/fd (opendir: Permission denied) 2024-09-19T08:47:17.283 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53301 bstore_ai ceph cwd unknown /proc/51876/task/53301/cwd (readlink: Permission denied) 2024-09-19T08:47:17.283 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53301 bstore_ai ceph rtd unknown /proc/51876/task/53301/root (readlink: Permission denied) 2024-09-19T08:47:17.283 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53301 bstore_ai ceph txt unknown /proc/51876/task/53301/exe (readlink: Permission denied) 2024-09-19T08:47:17.283 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53301 bstore_ai ceph NOFD /proc/51876/task/53301/fd (opendir: Permission denied) 2024-09-19T08:47:17.283 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53302 bstore_di ceph cwd unknown /proc/51876/task/53302/cwd (readlink: Permission denied) 2024-09-19T08:47:17.283 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53302 bstore_di ceph rtd unknown /proc/51876/task/53302/root (readlink: Permission denied) 2024-09-19T08:47:17.283 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53302 bstore_di ceph txt unknown /proc/51876/task/53302/exe (readlink: Permission denied) 2024-09-19T08:47:17.283 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53302 bstore_di ceph NOFD /proc/51876/task/53302/fd (opendir: Permission denied) 2024-09-19T08:47:17.283 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53486 ceph-osd ceph cwd unknown /proc/51876/task/53486/cwd (readlink: Permission denied) 2024-09-19T08:47:17.283 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53486 ceph-osd ceph rtd unknown /proc/51876/task/53486/root (readlink: Permission denied) 2024-09-19T08:47:17.283 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53486 ceph-osd ceph txt unknown /proc/51876/task/53486/exe (readlink: Permission denied) 2024-09-19T08:47:17.283 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53486 ceph-osd ceph NOFD /proc/51876/task/53486/fd (opendir: Permission denied) 2024-09-19T08:47:17.283 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53487 cfin ceph cwd unknown /proc/51876/task/53487/cwd (readlink: Permission denied) 2024-09-19T08:47:17.284 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53487 cfin ceph rtd unknown /proc/51876/task/53487/root (readlink: Permission denied) 2024-09-19T08:47:17.284 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53487 cfin ceph txt unknown /proc/51876/task/53487/exe (readlink: Permission denied) 2024-09-19T08:47:17.284 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53487 cfin ceph NOFD /proc/51876/task/53487/fd (opendir: Permission denied) 2024-09-19T08:47:17.284 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53488 bstore_kv ceph cwd unknown /proc/51876/task/53488/cwd (readlink: Permission denied) 2024-09-19T08:47:17.284 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53488 bstore_kv ceph rtd unknown /proc/51876/task/53488/root (readlink: Permission denied) 2024-09-19T08:47:17.284 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53488 bstore_kv ceph txt unknown /proc/51876/task/53488/exe (readlink: Permission denied) 2024-09-19T08:47:17.284 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53488 bstore_kv ceph NOFD /proc/51876/task/53488/fd (opendir: Permission denied) 2024-09-19T08:47:17.284 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53489 bstore_kv ceph cwd unknown /proc/51876/task/53489/cwd (readlink: Permission denied) 2024-09-19T08:47:17.284 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53489 bstore_kv ceph rtd unknown /proc/51876/task/53489/root (readlink: Permission denied) 2024-09-19T08:47:17.284 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53489 bstore_kv ceph txt unknown /proc/51876/task/53489/exe (readlink: Permission denied) 2024-09-19T08:47:17.285 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53489 bstore_kv ceph NOFD /proc/51876/task/53489/fd (opendir: Permission denied) 2024-09-19T08:47:17.285 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53490 bstore_me ceph cwd unknown /proc/51876/task/53490/cwd (readlink: Permission denied) 2024-09-19T08:47:17.285 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53490 bstore_me ceph rtd unknown /proc/51876/task/53490/root (readlink: Permission denied) 2024-09-19T08:47:17.285 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53490 bstore_me ceph txt unknown /proc/51876/task/53490/exe (readlink: Permission denied) 2024-09-19T08:47:17.285 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53490 bstore_me ceph NOFD /proc/51876/task/53490/fd (opendir: Permission denied) 2024-09-19T08:47:17.285 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53491 ms_dispat ceph cwd unknown /proc/51876/task/53491/cwd (readlink: Permission denied) 2024-09-19T08:47:17.285 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53491 ms_dispat ceph rtd unknown /proc/51876/task/53491/root (readlink: Permission denied) 2024-09-19T08:47:17.285 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53491 ms_dispat ceph txt unknown /proc/51876/task/53491/exe (readlink: Permission denied) 2024-09-19T08:47:17.285 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53491 ms_dispat ceph NOFD /proc/51876/task/53491/fd (opendir: Permission denied) 2024-09-19T08:47:17.285 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53492 ms_local ceph cwd unknown /proc/51876/task/53492/cwd (readlink: Permission denied) 2024-09-19T08:47:17.285 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53492 ms_local ceph rtd unknown /proc/51876/task/53492/root (readlink: Permission denied) 2024-09-19T08:47:17.285 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53492 ms_local ceph txt unknown /proc/51876/task/53492/exe (readlink: Permission denied) 2024-09-19T08:47:17.285 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53492 ms_local ceph NOFD /proc/51876/task/53492/fd (opendir: Permission denied) 2024-09-19T08:47:17.286 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53493 safe_time ceph cwd unknown /proc/51876/task/53493/cwd (readlink: Permission denied) 2024-09-19T08:47:17.286 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53493 safe_time ceph rtd unknown /proc/51876/task/53493/root (readlink: Permission denied) 2024-09-19T08:47:17.286 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53493 safe_time ceph txt unknown /proc/51876/task/53493/exe (readlink: Permission denied) 2024-09-19T08:47:17.286 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53493 safe_time ceph NOFD /proc/51876/task/53493/fd (opendir: Permission denied) 2024-09-19T08:47:17.286 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53494 safe_time ceph cwd unknown /proc/51876/task/53494/cwd (readlink: Permission denied) 2024-09-19T08:47:17.286 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53494 safe_time ceph rtd unknown /proc/51876/task/53494/root (readlink: Permission denied) 2024-09-19T08:47:17.286 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53494 safe_time ceph txt unknown /proc/51876/task/53494/exe (readlink: Permission denied) 2024-09-19T08:47:17.286 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53494 safe_time ceph NOFD /proc/51876/task/53494/fd (opendir: Permission denied) 2024-09-19T08:47:17.286 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53495 ms_dispat ceph cwd unknown /proc/51876/task/53495/cwd (readlink: Permission denied) 2024-09-19T08:47:17.286 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53495 ms_dispat ceph rtd unknown /proc/51876/task/53495/root (readlink: Permission denied) 2024-09-19T08:47:17.287 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53495 ms_dispat ceph txt unknown /proc/51876/task/53495/exe (readlink: Permission denied) 2024-09-19T08:47:17.287 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53495 ms_dispat ceph NOFD /proc/51876/task/53495/fd (opendir: Permission denied) 2024-09-19T08:47:17.287 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53496 ms_local ceph cwd unknown /proc/51876/task/53496/cwd (readlink: Permission denied) 2024-09-19T08:47:17.287 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53496 ms_local ceph rtd unknown /proc/51876/task/53496/root (readlink: Permission denied) 2024-09-19T08:47:17.287 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53496 ms_local ceph txt unknown /proc/51876/task/53496/exe (readlink: Permission denied) 2024-09-19T08:47:17.287 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53496 ms_local ceph NOFD /proc/51876/task/53496/fd (opendir: Permission denied) 2024-09-19T08:47:17.287 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53497 ms_dispat ceph cwd unknown /proc/51876/task/53497/cwd (readlink: Permission denied) 2024-09-19T08:47:17.287 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53497 ms_dispat ceph rtd unknown /proc/51876/task/53497/root (readlink: Permission denied) 2024-09-19T08:47:17.287 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53497 ms_dispat ceph txt unknown /proc/51876/task/53497/exe (readlink: Permission denied) 2024-09-19T08:47:17.287 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53497 ms_dispat ceph NOFD /proc/51876/task/53497/fd (opendir: Permission denied) 2024-09-19T08:47:17.287 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53498 ms_local ceph cwd unknown /proc/51876/task/53498/cwd (readlink: Permission denied) 2024-09-19T08:47:17.287 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53498 ms_local ceph rtd unknown /proc/51876/task/53498/root (readlink: Permission denied) 2024-09-19T08:47:17.287 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53498 ms_local ceph txt unknown /proc/51876/task/53498/exe (readlink: Permission denied) 2024-09-19T08:47:17.287 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53498 ms_local ceph NOFD /proc/51876/task/53498/fd (opendir: Permission denied) 2024-09-19T08:47:17.288 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53499 ms_dispat ceph cwd unknown /proc/51876/task/53499/cwd (readlink: Permission denied) 2024-09-19T08:47:17.288 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53499 ms_dispat ceph rtd unknown /proc/51876/task/53499/root (readlink: Permission denied) 2024-09-19T08:47:17.288 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53499 ms_dispat ceph txt unknown /proc/51876/task/53499/exe (readlink: Permission denied) 2024-09-19T08:47:17.288 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53499 ms_dispat ceph NOFD /proc/51876/task/53499/fd (opendir: Permission denied) 2024-09-19T08:47:17.288 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53500 ms_local ceph cwd unknown /proc/51876/task/53500/cwd (readlink: Permission denied) 2024-09-19T08:47:17.288 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53500 ms_local ceph rtd unknown /proc/51876/task/53500/root (readlink: Permission denied) 2024-09-19T08:47:17.288 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53500 ms_local ceph txt unknown /proc/51876/task/53500/exe (readlink: Permission denied) 2024-09-19T08:47:17.288 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53500 ms_local ceph NOFD /proc/51876/task/53500/fd (opendir: Permission denied) 2024-09-19T08:47:17.288 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53501 ms_dispat ceph cwd unknown /proc/51876/task/53501/cwd (readlink: Permission denied) 2024-09-19T08:47:17.288 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53501 ms_dispat ceph rtd unknown /proc/51876/task/53501/root (readlink: Permission denied) 2024-09-19T08:47:17.288 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53501 ms_dispat ceph txt unknown /proc/51876/task/53501/exe (readlink: Permission denied) 2024-09-19T08:47:17.288 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53501 ms_dispat ceph NOFD /proc/51876/task/53501/fd (opendir: Permission denied) 2024-09-19T08:47:17.288 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53502 ms_local ceph cwd unknown /proc/51876/task/53502/cwd (readlink: Permission denied) 2024-09-19T08:47:17.289 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53502 ms_local ceph rtd unknown /proc/51876/task/53502/root (readlink: Permission denied) 2024-09-19T08:47:17.289 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53502 ms_local ceph txt unknown /proc/51876/task/53502/exe (readlink: Permission denied) 2024-09-19T08:47:17.289 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53502 ms_local ceph NOFD /proc/51876/task/53502/fd (opendir: Permission denied) 2024-09-19T08:47:17.289 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53503 ms_dispat ceph cwd unknown /proc/51876/task/53503/cwd (readlink: Permission denied) 2024-09-19T08:47:17.289 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53503 ms_dispat ceph rtd unknown /proc/51876/task/53503/root (readlink: Permission denied) 2024-09-19T08:47:17.289 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53503 ms_dispat ceph txt unknown /proc/51876/task/53503/exe (readlink: Permission denied) 2024-09-19T08:47:17.289 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53503 ms_dispat ceph NOFD /proc/51876/task/53503/fd (opendir: Permission denied) 2024-09-19T08:47:17.289 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53504 ms_local ceph cwd unknown /proc/51876/task/53504/cwd (readlink: Permission denied) 2024-09-19T08:47:17.289 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53504 ms_local ceph rtd unknown /proc/51876/task/53504/root (readlink: Permission denied) 2024-09-19T08:47:17.289 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53504 ms_local ceph txt unknown /proc/51876/task/53504/exe (readlink: Permission denied) 2024-09-19T08:47:17.289 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53504 ms_local ceph NOFD /proc/51876/task/53504/fd (opendir: Permission denied) 2024-09-19T08:47:17.289 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53505 ms_dispat ceph cwd unknown /proc/51876/task/53505/cwd (readlink: Permission denied) 2024-09-19T08:47:17.289 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53505 ms_dispat ceph rtd unknown /proc/51876/task/53505/root (readlink: Permission denied) 2024-09-19T08:47:17.290 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53505 ms_dispat ceph txt unknown /proc/51876/task/53505/exe (readlink: Permission denied) 2024-09-19T08:47:17.290 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53505 ms_dispat ceph NOFD /proc/51876/task/53505/fd (opendir: Permission denied) 2024-09-19T08:47:17.290 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53506 ms_local ceph cwd unknown /proc/51876/task/53506/cwd (readlink: Permission denied) 2024-09-19T08:47:17.290 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53506 ms_local ceph rtd unknown /proc/51876/task/53506/root (readlink: Permission denied) 2024-09-19T08:47:17.290 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53506 ms_local ceph txt unknown /proc/51876/task/53506/exe (readlink: Permission denied) 2024-09-19T08:47:17.290 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53506 ms_local ceph NOFD /proc/51876/task/53506/fd (opendir: Permission denied) 2024-09-19T08:47:17.290 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53507 fn_anonym ceph cwd unknown /proc/51876/task/53507/cwd (readlink: Permission denied) 2024-09-19T08:47:17.290 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53507 fn_anonym ceph rtd unknown /proc/51876/task/53507/root (readlink: Permission denied) 2024-09-19T08:47:17.290 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53507 fn_anonym ceph txt unknown /proc/51876/task/53507/exe (readlink: Permission denied) 2024-09-19T08:47:17.290 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53507 fn_anonym ceph NOFD /proc/51876/task/53507/fd (opendir: Permission denied) 2024-09-19T08:47:17.290 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53508 finisher ceph cwd unknown /proc/51876/task/53508/cwd (readlink: Permission denied) 2024-09-19T08:47:17.290 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53508 finisher ceph rtd unknown /proc/51876/task/53508/root (readlink: Permission denied) 2024-09-19T08:47:17.290 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53508 finisher ceph txt unknown /proc/51876/task/53508/exe (readlink: Permission denied) 2024-09-19T08:47:17.290 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53508 finisher ceph NOFD /proc/51876/task/53508/fd (opendir: Permission denied) 2024-09-19T08:47:17.291 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53509 safe_time ceph cwd unknown /proc/51876/task/53509/cwd (readlink: Permission denied) 2024-09-19T08:47:17.291 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53509 safe_time ceph rtd unknown /proc/51876/task/53509/root (readlink: Permission denied) 2024-09-19T08:47:17.291 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53509 safe_time ceph txt unknown /proc/51876/task/53509/exe (readlink: Permission denied) 2024-09-19T08:47:17.291 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53509 safe_time ceph NOFD /proc/51876/task/53509/fd (opendir: Permission denied) 2024-09-19T08:47:17.291 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53510 safe_time ceph cwd unknown /proc/51876/task/53510/cwd (readlink: Permission denied) 2024-09-19T08:47:17.291 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53510 safe_time ceph rtd unknown /proc/51876/task/53510/root (readlink: Permission denied) 2024-09-19T08:47:17.291 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53510 safe_time ceph txt unknown /proc/51876/task/53510/exe (readlink: Permission denied) 2024-09-19T08:47:17.291 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53510 safe_time ceph NOFD /proc/51876/task/53510/fd (opendir: Permission denied) 2024-09-19T08:47:17.291 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53511 ceph-osd ceph cwd unknown /proc/51876/task/53511/cwd (readlink: Permission denied) 2024-09-19T08:47:17.291 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53511 ceph-osd ceph rtd unknown /proc/51876/task/53511/root (readlink: Permission denied) 2024-09-19T08:47:17.291 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53511 ceph-osd ceph txt unknown /proc/51876/task/53511/exe (readlink: Permission denied) 2024-09-19T08:47:17.291 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53511 ceph-osd ceph NOFD /proc/51876/task/53511/fd (opendir: Permission denied) 2024-09-19T08:47:17.291 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53512 osd_srv_a ceph cwd unknown /proc/51876/task/53512/cwd (readlink: Permission denied) 2024-09-19T08:47:17.291 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53512 osd_srv_a ceph rtd unknown /proc/51876/task/53512/root (readlink: Permission denied) 2024-09-19T08:47:17.291 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53512 osd_srv_a ceph txt unknown /proc/51876/task/53512/exe (readlink: Permission denied) 2024-09-19T08:47:17.292 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53512 osd_srv_a ceph NOFD /proc/51876/task/53512/fd (opendir: Permission denied) 2024-09-19T08:47:17.292 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53513 tp_osd_tp ceph cwd unknown /proc/51876/task/53513/cwd (readlink: Permission denied) 2024-09-19T08:47:17.292 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53513 tp_osd_tp ceph rtd unknown /proc/51876/task/53513/root (readlink: Permission denied) 2024-09-19T08:47:17.292 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53513 tp_osd_tp ceph txt unknown /proc/51876/task/53513/exe (readlink: Permission denied) 2024-09-19T08:47:17.292 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53513 tp_osd_tp ceph NOFD /proc/51876/task/53513/fd (opendir: Permission denied) 2024-09-19T08:47:17.292 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53514 tp_osd_tp ceph cwd unknown /proc/51876/task/53514/cwd (readlink: Permission denied) 2024-09-19T08:47:17.292 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53514 tp_osd_tp ceph rtd unknown /proc/51876/task/53514/root (readlink: Permission denied) 2024-09-19T08:47:17.292 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53514 tp_osd_tp ceph txt unknown /proc/51876/task/53514/exe (readlink: Permission denied) 2024-09-19T08:47:17.292 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53514 tp_osd_tp ceph NOFD /proc/51876/task/53514/fd (opendir: Permission denied) 2024-09-19T08:47:17.292 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53515 tp_osd_tp ceph cwd unknown /proc/51876/task/53515/cwd (readlink: Permission denied) 2024-09-19T08:47:17.292 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53515 tp_osd_tp ceph rtd unknown /proc/51876/task/53515/root (readlink: Permission denied) 2024-09-19T08:47:17.292 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53515 tp_osd_tp ceph txt unknown /proc/51876/task/53515/exe (readlink: Permission denied) 2024-09-19T08:47:17.292 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53515 tp_osd_tp ceph NOFD /proc/51876/task/53515/fd (opendir: Permission denied) 2024-09-19T08:47:17.293 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53516 tp_osd_tp ceph cwd unknown /proc/51876/task/53516/cwd (readlink: Permission denied) 2024-09-19T08:47:17.293 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53516 tp_osd_tp ceph rtd unknown /proc/51876/task/53516/root (readlink: Permission denied) 2024-09-19T08:47:17.293 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53516 tp_osd_tp ceph txt unknown /proc/51876/task/53516/exe (readlink: Permission denied) 2024-09-19T08:47:17.293 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53516 tp_osd_tp ceph NOFD /proc/51876/task/53516/fd (opendir: Permission denied) 2024-09-19T08:47:17.293 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53517 tp_osd_tp ceph cwd unknown /proc/51876/task/53517/cwd (readlink: Permission denied) 2024-09-19T08:47:17.293 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53517 tp_osd_tp ceph rtd unknown /proc/51876/task/53517/root (readlink: Permission denied) 2024-09-19T08:47:17.293 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53517 tp_osd_tp ceph txt unknown /proc/51876/task/53517/exe (readlink: Permission denied) 2024-09-19T08:47:17.293 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53517 tp_osd_tp ceph NOFD /proc/51876/task/53517/fd (opendir: Permission denied) 2024-09-19T08:47:17.293 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53518 tp_osd_tp ceph cwd unknown /proc/51876/task/53518/cwd (readlink: Permission denied) 2024-09-19T08:47:17.293 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53518 tp_osd_tp ceph rtd unknown /proc/51876/task/53518/root (readlink: Permission denied) 2024-09-19T08:47:17.293 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53518 tp_osd_tp ceph txt unknown /proc/51876/task/53518/exe (readlink: Permission denied) 2024-09-19T08:47:17.293 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53518 tp_osd_tp ceph NOFD /proc/51876/task/53518/fd (opendir: Permission denied) 2024-09-19T08:47:17.293 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53519 tp_osd_tp ceph cwd unknown /proc/51876/task/53519/cwd (readlink: Permission denied) 2024-09-19T08:47:17.293 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53519 tp_osd_tp ceph rtd unknown /proc/51876/task/53519/root (readlink: Permission denied) 2024-09-19T08:47:17.294 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53519 tp_osd_tp ceph txt unknown /proc/51876/task/53519/exe (readlink: Permission denied) 2024-09-19T08:47:17.294 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53519 tp_osd_tp ceph NOFD /proc/51876/task/53519/fd (opendir: Permission denied) 2024-09-19T08:47:17.294 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53520 tp_osd_tp ceph cwd unknown /proc/51876/task/53520/cwd (readlink: Permission denied) 2024-09-19T08:47:17.294 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53520 tp_osd_tp ceph rtd unknown /proc/51876/task/53520/root (readlink: Permission denied) 2024-09-19T08:47:17.294 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53520 tp_osd_tp ceph txt unknown /proc/51876/task/53520/exe (readlink: Permission denied) 2024-09-19T08:47:17.294 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53520 tp_osd_tp ceph NOFD /proc/51876/task/53520/fd (opendir: Permission denied) 2024-09-19T08:47:17.294 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53521 tp_osd_tp ceph cwd unknown /proc/51876/task/53521/cwd (readlink: Permission denied) 2024-09-19T08:47:17.294 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53521 tp_osd_tp ceph rtd unknown /proc/51876/task/53521/root (readlink: Permission denied) 2024-09-19T08:47:17.294 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53521 tp_osd_tp ceph txt unknown /proc/51876/task/53521/exe (readlink: Permission denied) 2024-09-19T08:47:17.294 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53521 tp_osd_tp ceph NOFD /proc/51876/task/53521/fd (opendir: Permission denied) 2024-09-19T08:47:17.294 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53522 tp_osd_tp ceph cwd unknown /proc/51876/task/53522/cwd (readlink: Permission denied) 2024-09-19T08:47:17.294 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53522 tp_osd_tp ceph rtd unknown /proc/51876/task/53522/root (readlink: Permission denied) 2024-09-19T08:47:17.294 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53522 tp_osd_tp ceph txt unknown /proc/51876/task/53522/exe (readlink: Permission denied) 2024-09-19T08:47:17.294 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53522 tp_osd_tp ceph NOFD /proc/51876/task/53522/fd (opendir: Permission denied) 2024-09-19T08:47:17.295 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53523 tp_osd_tp ceph cwd unknown /proc/51876/task/53523/cwd (readlink: Permission denied) 2024-09-19T08:47:17.295 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53523 tp_osd_tp ceph rtd unknown /proc/51876/task/53523/root (readlink: Permission denied) 2024-09-19T08:47:17.295 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53523 tp_osd_tp ceph txt unknown /proc/51876/task/53523/exe (readlink: Permission denied) 2024-09-19T08:47:17.295 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53523 tp_osd_tp ceph NOFD /proc/51876/task/53523/fd (opendir: Permission denied) 2024-09-19T08:47:17.295 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53524 tp_osd_tp ceph cwd unknown /proc/51876/task/53524/cwd (readlink: Permission denied) 2024-09-19T08:47:17.295 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53524 tp_osd_tp ceph rtd unknown /proc/51876/task/53524/root (readlink: Permission denied) 2024-09-19T08:47:17.295 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53524 tp_osd_tp ceph txt unknown /proc/51876/task/53524/exe (readlink: Permission denied) 2024-09-19T08:47:17.295 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53524 tp_osd_tp ceph NOFD /proc/51876/task/53524/fd (opendir: Permission denied) 2024-09-19T08:47:17.295 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53525 tp_osd_tp ceph cwd unknown /proc/51876/task/53525/cwd (readlink: Permission denied) 2024-09-19T08:47:17.295 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53525 tp_osd_tp ceph rtd unknown /proc/51876/task/53525/root (readlink: Permission denied) 2024-09-19T08:47:17.295 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53525 tp_osd_tp ceph txt unknown /proc/51876/task/53525/exe (readlink: Permission denied) 2024-09-19T08:47:17.295 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53525 tp_osd_tp ceph NOFD /proc/51876/task/53525/fd (opendir: Permission denied) 2024-09-19T08:47:17.295 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53526 tp_osd_tp ceph cwd unknown /proc/51876/task/53526/cwd (readlink: Permission denied) 2024-09-19T08:47:17.295 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53526 tp_osd_tp ceph rtd unknown /proc/51876/task/53526/root (readlink: Permission denied) 2024-09-19T08:47:17.296 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53526 tp_osd_tp ceph txt unknown /proc/51876/task/53526/exe (readlink: Permission denied) 2024-09-19T08:47:17.296 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53526 tp_osd_tp ceph NOFD /proc/51876/task/53526/fd (opendir: Permission denied) 2024-09-19T08:47:17.296 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53527 tp_osd_tp ceph cwd unknown /proc/51876/task/53527/cwd (readlink: Permission denied) 2024-09-19T08:47:17.296 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53527 tp_osd_tp ceph rtd unknown /proc/51876/task/53527/root (readlink: Permission denied) 2024-09-19T08:47:17.296 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53527 tp_osd_tp ceph txt unknown /proc/51876/task/53527/exe (readlink: Permission denied) 2024-09-19T08:47:17.296 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53527 tp_osd_tp ceph NOFD /proc/51876/task/53527/fd (opendir: Permission denied) 2024-09-19T08:47:17.296 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53528 tp_osd_tp ceph cwd unknown /proc/51876/task/53528/cwd (readlink: Permission denied) 2024-09-19T08:47:17.296 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53528 tp_osd_tp ceph rtd unknown /proc/51876/task/53528/root (readlink: Permission denied) 2024-09-19T08:47:17.296 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53528 tp_osd_tp ceph txt unknown /proc/51876/task/53528/exe (readlink: Permission denied) 2024-09-19T08:47:17.296 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53528 tp_osd_tp ceph NOFD /proc/51876/task/53528/fd (opendir: Permission denied) 2024-09-19T08:47:17.296 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53529 osd_srv_h ceph cwd unknown /proc/51876/task/53529/cwd (readlink: Permission denied) 2024-09-19T08:47:17.296 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53529 osd_srv_h ceph rtd unknown /proc/51876/task/53529/root (readlink: Permission denied) 2024-09-19T08:47:17.296 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53529 osd_srv_h ceph txt unknown /proc/51876/task/53529/exe (readlink: Permission denied) 2024-09-19T08:47:17.297 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 51876 53529 osd_srv_h ceph NOFD /proc/51876/task/53529/fd (opendir: Permission denied) 2024-09-19T08:47:17.297 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 52659 root cwd unknown /proc/52659/cwd (readlink: Permission denied) 2024-09-19T08:47:17.297 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 52659 root rtd unknown /proc/52659/root (readlink: Permission denied) 2024-09-19T08:47:17.297 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 52659 root txt unknown /proc/52659/exe (readlink: Permission denied) 2024-09-19T08:47:17.297 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 52659 root NOFD /proc/52659/fd (opendir: Permission denied) 2024-09-19T08:47:17.297 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 52676 root cwd unknown /proc/52676/cwd (readlink: Permission denied) 2024-09-19T08:47:17.297 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 52676 root rtd unknown /proc/52676/root (readlink: Permission denied) 2024-09-19T08:47:17.297 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 52676 root txt unknown /proc/52676/exe (readlink: Permission denied) 2024-09-19T08:47:17.297 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 52676 root NOFD /proc/52676/fd (opendir: Permission denied) 2024-09-19T08:47:17.297 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 56100 root cwd unknown /proc/56100/cwd (readlink: Permission denied) 2024-09-19T08:47:17.297 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 56100 root rtd unknown /proc/56100/root (readlink: Permission denied) 2024-09-19T08:47:17.297 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 56100 root txt unknown /proc/56100/exe (readlink: Permission denied) 2024-09-19T08:47:17.297 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 56100 root NOFD /proc/56100/fd (opendir: Permission denied) 2024-09-19T08:47:17.297 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 58834 root cwd unknown /proc/58834/cwd (readlink: Permission denied) 2024-09-19T08:47:17.298 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 58834 root rtd unknown /proc/58834/root (readlink: Permission denied) 2024-09-19T08:47:17.298 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 58834 root txt unknown /proc/58834/exe (readlink: Permission denied) 2024-09-19T08:47:17.298 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 58834 root NOFD /proc/58834/fd (opendir: Permission denied) 2024-09-19T08:47:17.298 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 58836 root cwd unknown /proc/58836/cwd (readlink: Permission denied) 2024-09-19T08:47:17.298 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 58836 root rtd unknown /proc/58836/root (readlink: Permission denied) 2024-09-19T08:47:17.298 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 58836 root txt unknown /proc/58836/exe (readlink: Permission denied) 2024-09-19T08:47:17.298 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 58836 root NOFD /proc/58836/fd (opendir: Permission denied) 2024-09-19T08:47:17.298 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 ceph cwd unknown /proc/58838/cwd (readlink: Permission denied) 2024-09-19T08:47:17.298 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 ceph rtd unknown /proc/58838/root (readlink: Permission denied) 2024-09-19T08:47:17.298 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 ceph txt unknown /proc/58838/exe (readlink: Permission denied) 2024-09-19T08:47:17.298 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 ceph NOFD /proc/58838/fd (opendir: Permission denied) 2024-09-19T08:47:17.298 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58839 log ceph cwd unknown /proc/58838/task/58839/cwd (readlink: Permission denied) 2024-09-19T08:47:17.298 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58839 log ceph rtd unknown /proc/58838/task/58839/root (readlink: Permission denied) 2024-09-19T08:47:17.298 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58839 log ceph txt unknown /proc/58838/task/58839/exe (readlink: Permission denied) 2024-09-19T08:47:17.299 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58839 log ceph NOFD /proc/58838/task/58839/fd (opendir: Permission denied) 2024-09-19T08:47:17.299 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58841 msgr-work ceph cwd unknown /proc/58838/task/58841/cwd (readlink: Permission denied) 2024-09-19T08:47:17.299 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58841 msgr-work ceph rtd unknown /proc/58838/task/58841/root (readlink: Permission denied) 2024-09-19T08:47:17.299 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58841 msgr-work ceph txt unknown /proc/58838/task/58841/exe (readlink: Permission denied) 2024-09-19T08:47:17.299 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58841 msgr-work ceph NOFD /proc/58838/task/58841/fd (opendir: Permission denied) 2024-09-19T08:47:17.299 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58842 msgr-work ceph cwd unknown /proc/58838/task/58842/cwd (readlink: Permission denied) 2024-09-19T08:47:17.299 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58842 msgr-work ceph rtd unknown /proc/58838/task/58842/root (readlink: Permission denied) 2024-09-19T08:47:17.299 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58842 msgr-work ceph txt unknown /proc/58838/task/58842/exe (readlink: Permission denied) 2024-09-19T08:47:17.299 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58842 msgr-work ceph NOFD /proc/58838/task/58842/fd (opendir: Permission denied) 2024-09-19T08:47:17.299 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58843 msgr-work ceph cwd unknown /proc/58838/task/58843/cwd (readlink: Permission denied) 2024-09-19T08:47:17.299 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58843 msgr-work ceph rtd unknown /proc/58838/task/58843/root (readlink: Permission denied) 2024-09-19T08:47:17.299 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58843 msgr-work ceph txt unknown /proc/58838/task/58843/exe (readlink: Permission denied) 2024-09-19T08:47:17.299 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58843 msgr-work ceph NOFD /proc/58838/task/58843/fd (opendir: Permission denied) 2024-09-19T08:47:17.299 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58847 service ceph cwd unknown /proc/58838/task/58847/cwd (readlink: Permission denied) 2024-09-19T08:47:17.300 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58847 service ceph rtd unknown /proc/58838/task/58847/root (readlink: Permission denied) 2024-09-19T08:47:17.300 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58847 service ceph txt unknown /proc/58838/task/58847/exe (readlink: Permission denied) 2024-09-19T08:47:17.300 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58847 service ceph NOFD /proc/58838/task/58847/fd (opendir: Permission denied) 2024-09-19T08:47:17.300 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58848 admin_soc ceph cwd unknown /proc/58838/task/58848/cwd (readlink: Permission denied) 2024-09-19T08:47:17.300 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58848 admin_soc ceph rtd unknown /proc/58838/task/58848/root (readlink: Permission denied) 2024-09-19T08:47:17.300 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58848 admin_soc ceph txt unknown /proc/58838/task/58848/exe (readlink: Permission denied) 2024-09-19T08:47:17.300 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 58848 admin_soc ceph NOFD /proc/58838/task/58848/fd (opendir: Permission denied) 2024-09-19T08:47:17.300 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59208 signal_ha ceph cwd unknown /proc/58838/task/59208/cwd (readlink: Permission denied) 2024-09-19T08:47:17.300 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59208 signal_ha ceph rtd unknown /proc/58838/task/59208/root (readlink: Permission denied) 2024-09-19T08:47:17.300 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59208 signal_ha ceph txt unknown /proc/58838/task/59208/exe (readlink: Permission denied) 2024-09-19T08:47:17.300 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59208 signal_ha ceph NOFD /proc/58838/task/59208/fd (opendir: Permission denied) 2024-09-19T08:47:17.300 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59209 io_contex ceph cwd unknown /proc/58838/task/59209/cwd (readlink: Permission denied) 2024-09-19T08:47:17.300 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59209 io_contex ceph rtd unknown /proc/58838/task/59209/root (readlink: Permission denied) 2024-09-19T08:47:17.301 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59209 io_contex ceph txt unknown /proc/58838/task/59209/exe (readlink: Permission denied) 2024-09-19T08:47:17.301 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59209 io_contex ceph NOFD /proc/58838/task/59209/fd (opendir: Permission denied) 2024-09-19T08:47:17.301 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59210 io_contex ceph cwd unknown /proc/58838/task/59210/cwd (readlink: Permission denied) 2024-09-19T08:47:17.301 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59210 io_contex ceph rtd unknown /proc/58838/task/59210/root (readlink: Permission denied) 2024-09-19T08:47:17.301 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59210 io_contex ceph txt unknown /proc/58838/task/59210/exe (readlink: Permission denied) 2024-09-19T08:47:17.301 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59210 io_contex ceph NOFD /proc/58838/task/59210/fd (opendir: Permission denied) 2024-09-19T08:47:17.301 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59221 OpHistory ceph cwd unknown /proc/58838/task/59221/cwd (readlink: Permission denied) 2024-09-19T08:47:17.301 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59221 OpHistory ceph rtd unknown /proc/58838/task/59221/root (readlink: Permission denied) 2024-09-19T08:47:17.301 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59221 OpHistory ceph txt unknown /proc/58838/task/59221/exe (readlink: Permission denied) 2024-09-19T08:47:17.301 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59221 OpHistory ceph NOFD /proc/58838/task/59221/fd (opendir: Permission denied) 2024-09-19T08:47:17.301 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59222 ceph_time ceph cwd unknown /proc/58838/task/59222/cwd (readlink: Permission denied) 2024-09-19T08:47:17.301 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59222 ceph_time ceph rtd unknown /proc/58838/task/59222/root (readlink: Permission denied) 2024-09-19T08:47:17.301 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59222 ceph_time ceph txt unknown /proc/58838/task/59222/exe (readlink: Permission denied) 2024-09-19T08:47:17.301 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59222 ceph_time ceph NOFD /proc/58838/task/59222/fd (opendir: Permission denied) 2024-09-19T08:47:17.302 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59608 ceph-osd ceph cwd unknown /proc/58838/task/59608/cwd (readlink: Permission denied) 2024-09-19T08:47:17.302 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59608 ceph-osd ceph rtd unknown /proc/58838/task/59608/root (readlink: Permission denied) 2024-09-19T08:47:17.302 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59608 ceph-osd ceph txt unknown /proc/58838/task/59608/exe (readlink: Permission denied) 2024-09-19T08:47:17.302 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59608 ceph-osd ceph NOFD /proc/58838/task/59608/fd (opendir: Permission denied) 2024-09-19T08:47:17.302 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59609 safe_time ceph cwd unknown /proc/58838/task/59609/cwd (readlink: Permission denied) 2024-09-19T08:47:17.302 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59609 safe_time ceph rtd unknown /proc/58838/task/59609/root (readlink: Permission denied) 2024-09-19T08:47:17.302 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59609 safe_time ceph txt unknown /proc/58838/task/59609/exe (readlink: Permission denied) 2024-09-19T08:47:17.302 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59609 safe_time ceph NOFD /proc/58838/task/59609/fd (opendir: Permission denied) 2024-09-19T08:47:17.302 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59610 safe_time ceph cwd unknown /proc/58838/task/59610/cwd (readlink: Permission denied) 2024-09-19T08:47:17.302 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59610 safe_time ceph rtd unknown /proc/58838/task/59610/root (readlink: Permission denied) 2024-09-19T08:47:17.302 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59610 safe_time ceph txt unknown /proc/58838/task/59610/exe (readlink: Permission denied) 2024-09-19T08:47:17.302 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59610 safe_time ceph NOFD /proc/58838/task/59610/fd (opendir: Permission denied) 2024-09-19T08:47:17.302 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59611 safe_time ceph cwd unknown /proc/58838/task/59611/cwd (readlink: Permission denied) 2024-09-19T08:47:17.303 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59611 safe_time ceph rtd unknown /proc/58838/task/59611/root (readlink: Permission denied) 2024-09-19T08:47:17.303 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59611 safe_time ceph txt unknown /proc/58838/task/59611/exe (readlink: Permission denied) 2024-09-19T08:47:17.303 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59611 safe_time ceph NOFD /proc/58838/task/59611/fd (opendir: Permission denied) 2024-09-19T08:47:17.303 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59612 safe_time ceph cwd unknown /proc/58838/task/59612/cwd (readlink: Permission denied) 2024-09-19T08:47:17.303 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59612 safe_time ceph rtd unknown /proc/58838/task/59612/root (readlink: Permission denied) 2024-09-19T08:47:17.303 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59612 safe_time ceph txt unknown /proc/58838/task/59612/exe (readlink: Permission denied) 2024-09-19T08:47:17.303 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59612 safe_time ceph NOFD /proc/58838/task/59612/fd (opendir: Permission denied) 2024-09-19T08:47:17.303 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59613 fn_anonym ceph cwd unknown /proc/58838/task/59613/cwd (readlink: Permission denied) 2024-09-19T08:47:17.303 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59613 fn_anonym ceph rtd unknown /proc/58838/task/59613/root (readlink: Permission denied) 2024-09-19T08:47:17.303 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59613 fn_anonym ceph txt unknown /proc/58838/task/59613/exe (readlink: Permission denied) 2024-09-19T08:47:17.303 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59613 fn_anonym ceph NOFD /proc/58838/task/59613/fd (opendir: Permission denied) 2024-09-19T08:47:17.303 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59696 rocksdb:l ceph cwd unknown /proc/58838/task/59696/cwd (readlink: Permission denied) 2024-09-19T08:47:17.303 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59696 rocksdb:l ceph rtd unknown /proc/58838/task/59696/root (readlink: Permission denied) 2024-09-19T08:47:17.303 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59696 rocksdb:l ceph txt unknown /proc/58838/task/59696/exe (readlink: Permission denied) 2024-09-19T08:47:17.303 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59696 rocksdb:l ceph NOFD /proc/58838/task/59696/fd (opendir: Permission denied) 2024-09-19T08:47:17.304 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59697 rocksdb:l ceph cwd unknown /proc/58838/task/59697/cwd (readlink: Permission denied) 2024-09-19T08:47:17.304 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59697 rocksdb:l ceph rtd unknown /proc/58838/task/59697/root (readlink: Permission denied) 2024-09-19T08:47:17.304 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59697 rocksdb:l ceph txt unknown /proc/58838/task/59697/exe (readlink: Permission denied) 2024-09-19T08:47:17.304 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59697 rocksdb:l ceph NOFD /proc/58838/task/59697/fd (opendir: Permission denied) 2024-09-19T08:47:17.304 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59698 rocksdb:l ceph cwd unknown /proc/58838/task/59698/cwd (readlink: Permission denied) 2024-09-19T08:47:17.304 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59698 rocksdb:l ceph rtd unknown /proc/58838/task/59698/root (readlink: Permission denied) 2024-09-19T08:47:17.304 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59698 rocksdb:l ceph txt unknown /proc/58838/task/59698/exe (readlink: Permission denied) 2024-09-19T08:47:17.304 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59698 rocksdb:l ceph NOFD /proc/58838/task/59698/fd (opendir: Permission denied) 2024-09-19T08:47:17.304 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59699 rocksdb:h ceph cwd unknown /proc/58838/task/59699/cwd (readlink: Permission denied) 2024-09-19T08:47:17.304 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59699 rocksdb:h ceph rtd unknown /proc/58838/task/59699/root (readlink: Permission denied) 2024-09-19T08:47:17.304 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59699 rocksdb:h ceph txt unknown /proc/58838/task/59699/exe (readlink: Permission denied) 2024-09-19T08:47:17.304 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 59699 rocksdb:h ceph NOFD /proc/58838/task/59699/fd (opendir: Permission denied) 2024-09-19T08:47:17.304 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60093 bstore_ai ceph cwd unknown /proc/58838/task/60093/cwd (readlink: Permission denied) 2024-09-19T08:47:17.305 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60093 bstore_ai ceph rtd unknown /proc/58838/task/60093/root (readlink: Permission denied) 2024-09-19T08:47:17.305 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60093 bstore_ai ceph txt unknown /proc/58838/task/60093/exe (readlink: Permission denied) 2024-09-19T08:47:17.305 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60093 bstore_ai ceph NOFD /proc/58838/task/60093/fd (opendir: Permission denied) 2024-09-19T08:47:17.305 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60094 bstore_di ceph cwd unknown /proc/58838/task/60094/cwd (readlink: Permission denied) 2024-09-19T08:47:17.305 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60094 bstore_di ceph rtd unknown /proc/58838/task/60094/root (readlink: Permission denied) 2024-09-19T08:47:17.305 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60094 bstore_di ceph txt unknown /proc/58838/task/60094/exe (readlink: Permission denied) 2024-09-19T08:47:17.305 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60094 bstore_di ceph NOFD /proc/58838/task/60094/fd (opendir: Permission denied) 2024-09-19T08:47:17.305 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60286 bstore_ai ceph cwd unknown /proc/58838/task/60286/cwd (readlink: Permission denied) 2024-09-19T08:47:17.305 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60286 bstore_ai ceph rtd unknown /proc/58838/task/60286/root (readlink: Permission denied) 2024-09-19T08:47:17.305 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60286 bstore_ai ceph txt unknown /proc/58838/task/60286/exe (readlink: Permission denied) 2024-09-19T08:47:17.305 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60286 bstore_ai ceph NOFD /proc/58838/task/60286/fd (opendir: Permission denied) 2024-09-19T08:47:17.305 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60287 bstore_di ceph cwd unknown /proc/58838/task/60287/cwd (readlink: Permission denied) 2024-09-19T08:47:17.305 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60287 bstore_di ceph rtd unknown /proc/58838/task/60287/root (readlink: Permission denied) 2024-09-19T08:47:17.306 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60287 bstore_di ceph txt unknown /proc/58838/task/60287/exe (readlink: Permission denied) 2024-09-19T08:47:17.306 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60287 bstore_di ceph NOFD /proc/58838/task/60287/fd (opendir: Permission denied) 2024-09-19T08:47:17.306 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60469 ceph-osd ceph cwd unknown /proc/58838/task/60469/cwd (readlink: Permission denied) 2024-09-19T08:47:17.306 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60469 ceph-osd ceph rtd unknown /proc/58838/task/60469/root (readlink: Permission denied) 2024-09-19T08:47:17.306 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60469 ceph-osd ceph txt unknown /proc/58838/task/60469/exe (readlink: Permission denied) 2024-09-19T08:47:17.306 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60469 ceph-osd ceph NOFD /proc/58838/task/60469/fd (opendir: Permission denied) 2024-09-19T08:47:17.306 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60470 cfin ceph cwd unknown /proc/58838/task/60470/cwd (readlink: Permission denied) 2024-09-19T08:47:17.306 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60470 cfin ceph rtd unknown /proc/58838/task/60470/root (readlink: Permission denied) 2024-09-19T08:47:17.306 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60470 cfin ceph txt unknown /proc/58838/task/60470/exe (readlink: Permission denied) 2024-09-19T08:47:17.306 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60470 cfin ceph NOFD /proc/58838/task/60470/fd (opendir: Permission denied) 2024-09-19T08:47:17.306 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60471 bstore_kv ceph cwd unknown /proc/58838/task/60471/cwd (readlink: Permission denied) 2024-09-19T08:47:17.306 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60471 bstore_kv ceph rtd unknown /proc/58838/task/60471/root (readlink: Permission denied) 2024-09-19T08:47:17.306 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60471 bstore_kv ceph txt unknown /proc/58838/task/60471/exe (readlink: Permission denied) 2024-09-19T08:47:17.307 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60471 bstore_kv ceph NOFD /proc/58838/task/60471/fd (opendir: Permission denied) 2024-09-19T08:47:17.307 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60472 bstore_kv ceph cwd unknown /proc/58838/task/60472/cwd (readlink: Permission denied) 2024-09-19T08:47:17.307 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60472 bstore_kv ceph rtd unknown /proc/58838/task/60472/root (readlink: Permission denied) 2024-09-19T08:47:17.307 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60472 bstore_kv ceph txt unknown /proc/58838/task/60472/exe (readlink: Permission denied) 2024-09-19T08:47:17.307 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60472 bstore_kv ceph NOFD /proc/58838/task/60472/fd (opendir: Permission denied) 2024-09-19T08:47:17.307 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60473 bstore_me ceph cwd unknown /proc/58838/task/60473/cwd (readlink: Permission denied) 2024-09-19T08:47:17.307 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60473 bstore_me ceph rtd unknown /proc/58838/task/60473/root (readlink: Permission denied) 2024-09-19T08:47:17.307 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60473 bstore_me ceph txt unknown /proc/58838/task/60473/exe (readlink: Permission denied) 2024-09-19T08:47:17.307 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60473 bstore_me ceph NOFD /proc/58838/task/60473/fd (opendir: Permission denied) 2024-09-19T08:47:17.307 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60474 ms_dispat ceph cwd unknown /proc/58838/task/60474/cwd (readlink: Permission denied) 2024-09-19T08:47:17.307 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60474 ms_dispat ceph rtd unknown /proc/58838/task/60474/root (readlink: Permission denied) 2024-09-19T08:47:17.307 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60474 ms_dispat ceph txt unknown /proc/58838/task/60474/exe (readlink: Permission denied) 2024-09-19T08:47:17.307 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60474 ms_dispat ceph NOFD /proc/58838/task/60474/fd (opendir: Permission denied) 2024-09-19T08:47:17.307 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60475 ms_local ceph cwd unknown /proc/58838/task/60475/cwd (readlink: Permission denied) 2024-09-19T08:47:17.308 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60475 ms_local ceph rtd unknown /proc/58838/task/60475/root (readlink: Permission denied) 2024-09-19T08:47:17.308 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60475 ms_local ceph txt unknown /proc/58838/task/60475/exe (readlink: Permission denied) 2024-09-19T08:47:17.308 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60475 ms_local ceph NOFD /proc/58838/task/60475/fd (opendir: Permission denied) 2024-09-19T08:47:17.308 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60476 safe_time ceph cwd unknown /proc/58838/task/60476/cwd (readlink: Permission denied) 2024-09-19T08:47:17.308 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60476 safe_time ceph rtd unknown /proc/58838/task/60476/root (readlink: Permission denied) 2024-09-19T08:47:17.308 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60476 safe_time ceph txt unknown /proc/58838/task/60476/exe (readlink: Permission denied) 2024-09-19T08:47:17.308 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60476 safe_time ceph NOFD /proc/58838/task/60476/fd (opendir: Permission denied) 2024-09-19T08:47:17.308 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60477 safe_time ceph cwd unknown /proc/58838/task/60477/cwd (readlink: Permission denied) 2024-09-19T08:47:17.308 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60477 safe_time ceph rtd unknown /proc/58838/task/60477/root (readlink: Permission denied) 2024-09-19T08:47:17.308 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60477 safe_time ceph txt unknown /proc/58838/task/60477/exe (readlink: Permission denied) 2024-09-19T08:47:17.308 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60477 safe_time ceph NOFD /proc/58838/task/60477/fd (opendir: Permission denied) 2024-09-19T08:47:17.308 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60478 ms_dispat ceph cwd unknown /proc/58838/task/60478/cwd (readlink: Permission denied) 2024-09-19T08:47:17.308 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60478 ms_dispat ceph rtd unknown /proc/58838/task/60478/root (readlink: Permission denied) 2024-09-19T08:47:17.309 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60478 ms_dispat ceph txt unknown /proc/58838/task/60478/exe (readlink: Permission denied) 2024-09-19T08:47:17.309 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60478 ms_dispat ceph NOFD /proc/58838/task/60478/fd (opendir: Permission denied) 2024-09-19T08:47:17.309 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60479 ms_local ceph cwd unknown /proc/58838/task/60479/cwd (readlink: Permission denied) 2024-09-19T08:47:17.309 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60479 ms_local ceph rtd unknown /proc/58838/task/60479/root (readlink: Permission denied) 2024-09-19T08:47:17.309 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60479 ms_local ceph txt unknown /proc/58838/task/60479/exe (readlink: Permission denied) 2024-09-19T08:47:17.309 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60479 ms_local ceph NOFD /proc/58838/task/60479/fd (opendir: Permission denied) 2024-09-19T08:47:17.309 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60480 ms_dispat ceph cwd unknown /proc/58838/task/60480/cwd (readlink: Permission denied) 2024-09-19T08:47:17.309 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60480 ms_dispat ceph rtd unknown /proc/58838/task/60480/root (readlink: Permission denied) 2024-09-19T08:47:17.309 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60480 ms_dispat ceph txt unknown /proc/58838/task/60480/exe (readlink: Permission denied) 2024-09-19T08:47:17.309 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60480 ms_dispat ceph NOFD /proc/58838/task/60480/fd (opendir: Permission denied) 2024-09-19T08:47:17.309 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60481 ms_local ceph cwd unknown /proc/58838/task/60481/cwd (readlink: Permission denied) 2024-09-19T08:47:17.309 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60481 ms_local ceph rtd unknown /proc/58838/task/60481/root (readlink: Permission denied) 2024-09-19T08:47:17.309 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60481 ms_local ceph txt unknown /proc/58838/task/60481/exe (readlink: Permission denied) 2024-09-19T08:47:17.309 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60481 ms_local ceph NOFD /proc/58838/task/60481/fd (opendir: Permission denied) 2024-09-19T08:47:17.310 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60482 ms_dispat ceph cwd unknown /proc/58838/task/60482/cwd (readlink: Permission denied) 2024-09-19T08:47:17.310 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60482 ms_dispat ceph rtd unknown /proc/58838/task/60482/root (readlink: Permission denied) 2024-09-19T08:47:17.310 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60482 ms_dispat ceph txt unknown /proc/58838/task/60482/exe (readlink: Permission denied) 2024-09-19T08:47:17.310 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60482 ms_dispat ceph NOFD /proc/58838/task/60482/fd (opendir: Permission denied) 2024-09-19T08:47:17.310 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60483 ms_local ceph cwd unknown /proc/58838/task/60483/cwd (readlink: Permission denied) 2024-09-19T08:47:17.310 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60483 ms_local ceph rtd unknown /proc/58838/task/60483/root (readlink: Permission denied) 2024-09-19T08:47:17.310 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60483 ms_local ceph txt unknown /proc/58838/task/60483/exe (readlink: Permission denied) 2024-09-19T08:47:17.310 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60483 ms_local ceph NOFD /proc/58838/task/60483/fd (opendir: Permission denied) 2024-09-19T08:47:17.310 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60484 ms_dispat ceph cwd unknown /proc/58838/task/60484/cwd (readlink: Permission denied) 2024-09-19T08:47:17.310 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60484 ms_dispat ceph rtd unknown /proc/58838/task/60484/root (readlink: Permission denied) 2024-09-19T08:47:17.310 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60484 ms_dispat ceph txt unknown /proc/58838/task/60484/exe (readlink: Permission denied) 2024-09-19T08:47:17.310 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60484 ms_dispat ceph NOFD /proc/58838/task/60484/fd (opendir: Permission denied) 2024-09-19T08:47:17.310 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60485 ms_local ceph cwd unknown /proc/58838/task/60485/cwd (readlink: Permission denied) 2024-09-19T08:47:17.311 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60485 ms_local ceph rtd unknown /proc/58838/task/60485/root (readlink: Permission denied) 2024-09-19T08:47:17.311 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60485 ms_local ceph txt unknown /proc/58838/task/60485/exe (readlink: Permission denied) 2024-09-19T08:47:17.311 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60485 ms_local ceph NOFD /proc/58838/task/60485/fd (opendir: Permission denied) 2024-09-19T08:47:17.311 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60486 ms_dispat ceph cwd unknown /proc/58838/task/60486/cwd (readlink: Permission denied) 2024-09-19T08:47:17.311 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60486 ms_dispat ceph rtd unknown /proc/58838/task/60486/root (readlink: Permission denied) 2024-09-19T08:47:17.311 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60486 ms_dispat ceph txt unknown /proc/58838/task/60486/exe (readlink: Permission denied) 2024-09-19T08:47:17.311 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60486 ms_dispat ceph NOFD /proc/58838/task/60486/fd (opendir: Permission denied) 2024-09-19T08:47:17.311 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60487 ms_local ceph cwd unknown /proc/58838/task/60487/cwd (readlink: Permission denied) 2024-09-19T08:47:17.311 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60487 ms_local ceph rtd unknown /proc/58838/task/60487/root (readlink: Permission denied) 2024-09-19T08:47:17.311 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60487 ms_local ceph txt unknown /proc/58838/task/60487/exe (readlink: Permission denied) 2024-09-19T08:47:17.311 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60487 ms_local ceph NOFD /proc/58838/task/60487/fd (opendir: Permission denied) 2024-09-19T08:47:17.311 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60488 ms_dispat ceph cwd unknown /proc/58838/task/60488/cwd (readlink: Permission denied) 2024-09-19T08:47:17.311 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60488 ms_dispat ceph rtd unknown /proc/58838/task/60488/root (readlink: Permission denied) 2024-09-19T08:47:17.311 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60488 ms_dispat ceph txt unknown /proc/58838/task/60488/exe (readlink: Permission denied) 2024-09-19T08:47:17.312 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60488 ms_dispat ceph NOFD /proc/58838/task/60488/fd (opendir: Permission denied) 2024-09-19T08:47:17.312 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60489 ms_local ceph cwd unknown /proc/58838/task/60489/cwd (readlink: Permission denied) 2024-09-19T08:47:17.312 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60489 ms_local ceph rtd unknown /proc/58838/task/60489/root (readlink: Permission denied) 2024-09-19T08:47:17.312 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60489 ms_local ceph txt unknown /proc/58838/task/60489/exe (readlink: Permission denied) 2024-09-19T08:47:17.312 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60489 ms_local ceph NOFD /proc/58838/task/60489/fd (opendir: Permission denied) 2024-09-19T08:47:17.312 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60490 fn_anonym ceph cwd unknown /proc/58838/task/60490/cwd (readlink: Permission denied) 2024-09-19T08:47:17.312 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60490 fn_anonym ceph rtd unknown /proc/58838/task/60490/root (readlink: Permission denied) 2024-09-19T08:47:17.312 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60490 fn_anonym ceph txt unknown /proc/58838/task/60490/exe (readlink: Permission denied) 2024-09-19T08:47:17.312 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60490 fn_anonym ceph NOFD /proc/58838/task/60490/fd (opendir: Permission denied) 2024-09-19T08:47:17.312 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60491 finisher ceph cwd unknown /proc/58838/task/60491/cwd (readlink: Permission denied) 2024-09-19T08:47:17.312 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60491 finisher ceph rtd unknown /proc/58838/task/60491/root (readlink: Permission denied) 2024-09-19T08:47:17.312 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60491 finisher ceph txt unknown /proc/58838/task/60491/exe (readlink: Permission denied) 2024-09-19T08:47:17.312 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60491 finisher ceph NOFD /proc/58838/task/60491/fd (opendir: Permission denied) 2024-09-19T08:47:17.313 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60492 safe_time ceph cwd unknown /proc/58838/task/60492/cwd (readlink: Permission denied) 2024-09-19T08:47:17.313 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60492 safe_time ceph rtd unknown /proc/58838/task/60492/root (readlink: Permission denied) 2024-09-19T08:47:17.313 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60492 safe_time ceph txt unknown /proc/58838/task/60492/exe (readlink: Permission denied) 2024-09-19T08:47:17.313 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60492 safe_time ceph NOFD /proc/58838/task/60492/fd (opendir: Permission denied) 2024-09-19T08:47:17.313 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60493 safe_time ceph cwd unknown /proc/58838/task/60493/cwd (readlink: Permission denied) 2024-09-19T08:47:17.313 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60493 safe_time ceph rtd unknown /proc/58838/task/60493/root (readlink: Permission denied) 2024-09-19T08:47:17.313 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60493 safe_time ceph txt unknown /proc/58838/task/60493/exe (readlink: Permission denied) 2024-09-19T08:47:17.313 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60493 safe_time ceph NOFD /proc/58838/task/60493/fd (opendir: Permission denied) 2024-09-19T08:47:17.313 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60494 ceph-osd ceph cwd unknown /proc/58838/task/60494/cwd (readlink: Permission denied) 2024-09-19T08:47:17.313 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60494 ceph-osd ceph rtd unknown /proc/58838/task/60494/root (readlink: Permission denied) 2024-09-19T08:47:17.313 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60494 ceph-osd ceph txt unknown /proc/58838/task/60494/exe (readlink: Permission denied) 2024-09-19T08:47:17.313 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60494 ceph-osd ceph NOFD /proc/58838/task/60494/fd (opendir: Permission denied) 2024-09-19T08:47:17.313 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60495 osd_srv_a ceph cwd unknown /proc/58838/task/60495/cwd (readlink: Permission denied) 2024-09-19T08:47:17.313 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60495 osd_srv_a ceph rtd unknown /proc/58838/task/60495/root (readlink: Permission denied) 2024-09-19T08:47:17.314 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60495 osd_srv_a ceph txt unknown /proc/58838/task/60495/exe (readlink: Permission denied) 2024-09-19T08:47:17.314 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60495 osd_srv_a ceph NOFD /proc/58838/task/60495/fd (opendir: Permission denied) 2024-09-19T08:47:17.314 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60496 tp_osd_tp ceph cwd unknown /proc/58838/task/60496/cwd (readlink: Permission denied) 2024-09-19T08:47:17.314 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60496 tp_osd_tp ceph rtd unknown /proc/58838/task/60496/root (readlink: Permission denied) 2024-09-19T08:47:17.314 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60496 tp_osd_tp ceph txt unknown /proc/58838/task/60496/exe (readlink: Permission denied) 2024-09-19T08:47:17.314 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60496 tp_osd_tp ceph NOFD /proc/58838/task/60496/fd (opendir: Permission denied) 2024-09-19T08:47:17.314 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60497 tp_osd_tp ceph cwd unknown /proc/58838/task/60497/cwd (readlink: Permission denied) 2024-09-19T08:47:17.314 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60497 tp_osd_tp ceph rtd unknown /proc/58838/task/60497/root (readlink: Permission denied) 2024-09-19T08:47:17.314 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60497 tp_osd_tp ceph txt unknown /proc/58838/task/60497/exe (readlink: Permission denied) 2024-09-19T08:47:17.314 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60497 tp_osd_tp ceph NOFD /proc/58838/task/60497/fd (opendir: Permission denied) 2024-09-19T08:47:17.314 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60498 tp_osd_tp ceph cwd unknown /proc/58838/task/60498/cwd (readlink: Permission denied) 2024-09-19T08:47:17.314 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60498 tp_osd_tp ceph rtd unknown /proc/58838/task/60498/root (readlink: Permission denied) 2024-09-19T08:47:17.314 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60498 tp_osd_tp ceph txt unknown /proc/58838/task/60498/exe (readlink: Permission denied) 2024-09-19T08:47:17.314 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60498 tp_osd_tp ceph NOFD /proc/58838/task/60498/fd (opendir: Permission denied) 2024-09-19T08:47:17.315 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60499 tp_osd_tp ceph cwd unknown /proc/58838/task/60499/cwd (readlink: Permission denied) 2024-09-19T08:47:17.315 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60499 tp_osd_tp ceph rtd unknown /proc/58838/task/60499/root (readlink: Permission denied) 2024-09-19T08:47:17.315 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60499 tp_osd_tp ceph txt unknown /proc/58838/task/60499/exe (readlink: Permission denied) 2024-09-19T08:47:17.315 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60499 tp_osd_tp ceph NOFD /proc/58838/task/60499/fd (opendir: Permission denied) 2024-09-19T08:47:17.315 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60500 tp_osd_tp ceph cwd unknown /proc/58838/task/60500/cwd (readlink: Permission denied) 2024-09-19T08:47:17.315 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60500 tp_osd_tp ceph rtd unknown /proc/58838/task/60500/root (readlink: Permission denied) 2024-09-19T08:47:17.315 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60500 tp_osd_tp ceph txt unknown /proc/58838/task/60500/exe (readlink: Permission denied) 2024-09-19T08:47:17.315 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60500 tp_osd_tp ceph NOFD /proc/58838/task/60500/fd (opendir: Permission denied) 2024-09-19T08:47:17.315 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60501 tp_osd_tp ceph cwd unknown /proc/58838/task/60501/cwd (readlink: Permission denied) 2024-09-19T08:47:17.315 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60501 tp_osd_tp ceph rtd unknown /proc/58838/task/60501/root (readlink: Permission denied) 2024-09-19T08:47:17.315 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60501 tp_osd_tp ceph txt unknown /proc/58838/task/60501/exe (readlink: Permission denied) 2024-09-19T08:47:17.315 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60501 tp_osd_tp ceph NOFD /proc/58838/task/60501/fd (opendir: Permission denied) 2024-09-19T08:47:17.315 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60502 tp_osd_tp ceph cwd unknown /proc/58838/task/60502/cwd (readlink: Permission denied) 2024-09-19T08:47:17.316 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60502 tp_osd_tp ceph rtd unknown /proc/58838/task/60502/root (readlink: Permission denied) 2024-09-19T08:47:17.316 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60502 tp_osd_tp ceph txt unknown /proc/58838/task/60502/exe (readlink: Permission denied) 2024-09-19T08:47:17.316 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60502 tp_osd_tp ceph NOFD /proc/58838/task/60502/fd (opendir: Permission denied) 2024-09-19T08:47:17.316 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60503 tp_osd_tp ceph cwd unknown /proc/58838/task/60503/cwd (readlink: Permission denied) 2024-09-19T08:47:17.316 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60503 tp_osd_tp ceph rtd unknown /proc/58838/task/60503/root (readlink: Permission denied) 2024-09-19T08:47:17.316 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60503 tp_osd_tp ceph txt unknown /proc/58838/task/60503/exe (readlink: Permission denied) 2024-09-19T08:47:17.316 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60503 tp_osd_tp ceph NOFD /proc/58838/task/60503/fd (opendir: Permission denied) 2024-09-19T08:47:17.316 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60504 tp_osd_tp ceph cwd unknown /proc/58838/task/60504/cwd (readlink: Permission denied) 2024-09-19T08:47:17.316 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60504 tp_osd_tp ceph rtd unknown /proc/58838/task/60504/root (readlink: Permission denied) 2024-09-19T08:47:17.316 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60504 tp_osd_tp ceph txt unknown /proc/58838/task/60504/exe (readlink: Permission denied) 2024-09-19T08:47:17.316 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60504 tp_osd_tp ceph NOFD /proc/58838/task/60504/fd (opendir: Permission denied) 2024-09-19T08:47:17.316 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60505 tp_osd_tp ceph cwd unknown /proc/58838/task/60505/cwd (readlink: Permission denied) 2024-09-19T08:47:17.317 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60505 tp_osd_tp ceph rtd unknown /proc/58838/task/60505/root (readlink: Permission denied) 2024-09-19T08:47:17.317 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60505 tp_osd_tp ceph txt unknown /proc/58838/task/60505/exe (readlink: Permission denied) 2024-09-19T08:47:17.317 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60505 tp_osd_tp ceph NOFD /proc/58838/task/60505/fd (opendir: Permission denied) 2024-09-19T08:47:17.317 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60506 tp_osd_tp ceph cwd unknown /proc/58838/task/60506/cwd (readlink: Permission denied) 2024-09-19T08:47:17.317 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60506 tp_osd_tp ceph rtd unknown /proc/58838/task/60506/root (readlink: Permission denied) 2024-09-19T08:47:17.317 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60506 tp_osd_tp ceph txt unknown /proc/58838/task/60506/exe (readlink: Permission denied) 2024-09-19T08:47:17.317 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60506 tp_osd_tp ceph NOFD /proc/58838/task/60506/fd (opendir: Permission denied) 2024-09-19T08:47:17.317 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60507 tp_osd_tp ceph cwd unknown /proc/58838/task/60507/cwd (readlink: Permission denied) 2024-09-19T08:47:17.317 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60507 tp_osd_tp ceph rtd unknown /proc/58838/task/60507/root (readlink: Permission denied) 2024-09-19T08:47:17.317 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60507 tp_osd_tp ceph txt unknown /proc/58838/task/60507/exe (readlink: Permission denied) 2024-09-19T08:47:17.317 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60507 tp_osd_tp ceph NOFD /proc/58838/task/60507/fd (opendir: Permission denied) 2024-09-19T08:47:17.317 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60508 tp_osd_tp ceph cwd unknown /proc/58838/task/60508/cwd (readlink: Permission denied) 2024-09-19T08:47:17.317 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60508 tp_osd_tp ceph rtd unknown /proc/58838/task/60508/root (readlink: Permission denied) 2024-09-19T08:47:17.317 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60508 tp_osd_tp ceph txt unknown /proc/58838/task/60508/exe (readlink: Permission denied) 2024-09-19T08:47:17.318 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60508 tp_osd_tp ceph NOFD /proc/58838/task/60508/fd (opendir: Permission denied) 2024-09-19T08:47:17.318 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60509 tp_osd_tp ceph cwd unknown /proc/58838/task/60509/cwd (readlink: Permission denied) 2024-09-19T08:47:17.318 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60509 tp_osd_tp ceph rtd unknown /proc/58838/task/60509/root (readlink: Permission denied) 2024-09-19T08:47:17.318 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60509 tp_osd_tp ceph txt unknown /proc/58838/task/60509/exe (readlink: Permission denied) 2024-09-19T08:47:17.318 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60509 tp_osd_tp ceph NOFD /proc/58838/task/60509/fd (opendir: Permission denied) 2024-09-19T08:47:17.318 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60510 tp_osd_tp ceph cwd unknown /proc/58838/task/60510/cwd (readlink: Permission denied) 2024-09-19T08:47:17.318 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60510 tp_osd_tp ceph rtd unknown /proc/58838/task/60510/root (readlink: Permission denied) 2024-09-19T08:47:17.318 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60510 tp_osd_tp ceph txt unknown /proc/58838/task/60510/exe (readlink: Permission denied) 2024-09-19T08:47:17.318 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60510 tp_osd_tp ceph NOFD /proc/58838/task/60510/fd (opendir: Permission denied) 2024-09-19T08:47:17.318 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60511 tp_osd_tp ceph cwd unknown /proc/58838/task/60511/cwd (readlink: Permission denied) 2024-09-19T08:47:17.318 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60511 tp_osd_tp ceph rtd unknown /proc/58838/task/60511/root (readlink: Permission denied) 2024-09-19T08:47:17.318 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60511 tp_osd_tp ceph txt unknown /proc/58838/task/60511/exe (readlink: Permission denied) 2024-09-19T08:47:17.318 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60511 tp_osd_tp ceph NOFD /proc/58838/task/60511/fd (opendir: Permission denied) 2024-09-19T08:47:17.318 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60512 osd_srv_h ceph cwd unknown /proc/58838/task/60512/cwd (readlink: Permission denied) 2024-09-19T08:47:17.318 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60512 osd_srv_h ceph rtd unknown /proc/58838/task/60512/root (readlink: Permission denied) 2024-09-19T08:47:17.319 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60512 osd_srv_h ceph txt unknown /proc/58838/task/60512/exe (readlink: Permission denied) 2024-09-19T08:47:17.319 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 58838 60512 osd_srv_h ceph NOFD /proc/58838/task/60512/fd (opendir: Permission denied) 2024-09-19T08:47:17.319 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 59594 root cwd unknown /proc/59594/cwd (readlink: Permission denied) 2024-09-19T08:47:17.319 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 59594 root rtd unknown /proc/59594/root (readlink: Permission denied) 2024-09-19T08:47:17.319 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 59594 root txt unknown /proc/59594/exe (readlink: Permission denied) 2024-09-19T08:47:17.319 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 59594 root NOFD /proc/59594/fd (opendir: Permission denied) 2024-09-19T08:47:17.319 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 59622 root cwd unknown /proc/59622/cwd (readlink: Permission denied) 2024-09-19T08:47:17.319 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 59622 root rtd unknown /proc/59622/root (readlink: Permission denied) 2024-09-19T08:47:17.319 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 59622 root txt unknown /proc/59622/exe (readlink: Permission denied) 2024-09-19T08:47:17.319 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 59622 root NOFD /proc/59622/fd (opendir: Permission denied) 2024-09-19T08:47:17.319 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 63081 root cwd unknown /proc/63081/cwd (readlink: Permission denied) 2024-09-19T08:47:17.319 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 63081 root rtd unknown /proc/63081/root (readlink: Permission denied) 2024-09-19T08:47:17.319 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 63081 root txt unknown /proc/63081/exe (readlink: Permission denied) 2024-09-19T08:47:17.320 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 63081 root NOFD /proc/63081/fd (opendir: Permission denied) 2024-09-19T08:47:17.320 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 63158 root cwd unknown /proc/63158/cwd (readlink: Permission denied) 2024-09-19T08:47:17.320 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 63158 root rtd unknown /proc/63158/root (readlink: Permission denied) 2024-09-19T08:47:17.320 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 63158 root txt unknown /proc/63158/exe (readlink: Permission denied) 2024-09-19T08:47:17.320 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 63158 root NOFD /proc/63158/fd (opendir: Permission denied) 2024-09-19T08:47:17.320 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 63191 root cwd unknown /proc/63191/cwd (readlink: Permission denied) 2024-09-19T08:47:17.320 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 63191 root rtd unknown /proc/63191/root (readlink: Permission denied) 2024-09-19T08:47:17.320 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 63191 root txt unknown /proc/63191/exe (readlink: Permission denied) 2024-09-19T08:47:17.320 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 63191 root NOFD /proc/63191/fd (opendir: Permission denied) 2024-09-19T08:47:17.320 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 63429 root cwd unknown /proc/63429/cwd (readlink: Permission denied) 2024-09-19T08:47:17.320 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 63429 root rtd unknown /proc/63429/root (readlink: Permission denied) 2024-09-19T08:47:17.320 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 63429 root txt unknown /proc/63429/exe (readlink: Permission denied) 2024-09-19T08:47:17.320 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 63429 root NOFD /proc/63429/fd (opendir: Permission denied) 2024-09-19T08:47:17.321 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 65852 root cwd unknown /proc/65852/cwd (readlink: Permission denied) 2024-09-19T08:47:17.321 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 65852 root rtd unknown /proc/65852/root (readlink: Permission denied) 2024-09-19T08:47:17.321 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 65852 root txt unknown /proc/65852/exe (readlink: Permission denied) 2024-09-19T08:47:17.321 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 65852 root NOFD /proc/65852/fd (opendir: Permission denied) 2024-09-19T08:47:17.321 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 65854 root cwd unknown /proc/65854/cwd (readlink: Permission denied) 2024-09-19T08:47:17.321 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 65854 root rtd unknown /proc/65854/root (readlink: Permission denied) 2024-09-19T08:47:17.321 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 65854 root txt unknown /proc/65854/exe (readlink: Permission denied) 2024-09-19T08:47:17.321 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 65854 root NOFD /proc/65854/fd (opendir: Permission denied) 2024-09-19T08:47:17.321 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 ceph cwd unknown /proc/65857/cwd (readlink: Permission denied) 2024-09-19T08:47:17.321 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 ceph rtd unknown /proc/65857/root (readlink: Permission denied) 2024-09-19T08:47:17.321 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 ceph txt unknown /proc/65857/exe (readlink: Permission denied) 2024-09-19T08:47:17.321 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 ceph NOFD /proc/65857/fd (opendir: Permission denied) 2024-09-19T08:47:17.321 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65858 log ceph cwd unknown /proc/65857/task/65858/cwd (readlink: Permission denied) 2024-09-19T08:47:17.321 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65858 log ceph rtd unknown /proc/65857/task/65858/root (readlink: Permission denied) 2024-09-19T08:47:17.322 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65858 log ceph txt unknown /proc/65857/task/65858/exe (readlink: Permission denied) 2024-09-19T08:47:17.322 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65858 log ceph NOFD /proc/65857/task/65858/fd (opendir: Permission denied) 2024-09-19T08:47:17.322 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65860 msgr-work ceph cwd unknown /proc/65857/task/65860/cwd (readlink: Permission denied) 2024-09-19T08:47:17.322 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65860 msgr-work ceph rtd unknown /proc/65857/task/65860/root (readlink: Permission denied) 2024-09-19T08:47:17.322 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65860 msgr-work ceph txt unknown /proc/65857/task/65860/exe (readlink: Permission denied) 2024-09-19T08:47:17.322 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65860 msgr-work ceph NOFD /proc/65857/task/65860/fd (opendir: Permission denied) 2024-09-19T08:47:17.322 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65861 msgr-work ceph cwd unknown /proc/65857/task/65861/cwd (readlink: Permission denied) 2024-09-19T08:47:17.322 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65861 msgr-work ceph rtd unknown /proc/65857/task/65861/root (readlink: Permission denied) 2024-09-19T08:47:17.322 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65861 msgr-work ceph txt unknown /proc/65857/task/65861/exe (readlink: Permission denied) 2024-09-19T08:47:17.322 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65861 msgr-work ceph NOFD /proc/65857/task/65861/fd (opendir: Permission denied) 2024-09-19T08:47:17.322 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65862 msgr-work ceph cwd unknown /proc/65857/task/65862/cwd (readlink: Permission denied) 2024-09-19T08:47:17.322 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65862 msgr-work ceph rtd unknown /proc/65857/task/65862/root (readlink: Permission denied) 2024-09-19T08:47:17.322 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65862 msgr-work ceph txt unknown /proc/65857/task/65862/exe (readlink: Permission denied) 2024-09-19T08:47:17.322 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65862 msgr-work ceph NOFD /proc/65857/task/65862/fd (opendir: Permission denied) 2024-09-19T08:47:17.323 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65866 service ceph cwd unknown /proc/65857/task/65866/cwd (readlink: Permission denied) 2024-09-19T08:47:17.323 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65866 service ceph rtd unknown /proc/65857/task/65866/root (readlink: Permission denied) 2024-09-19T08:47:17.323 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65866 service ceph txt unknown /proc/65857/task/65866/exe (readlink: Permission denied) 2024-09-19T08:47:17.323 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65866 service ceph NOFD /proc/65857/task/65866/fd (opendir: Permission denied) 2024-09-19T08:47:17.323 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65867 admin_soc ceph cwd unknown /proc/65857/task/65867/cwd (readlink: Permission denied) 2024-09-19T08:47:17.323 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65867 admin_soc ceph rtd unknown /proc/65857/task/65867/root (readlink: Permission denied) 2024-09-19T08:47:17.323 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65867 admin_soc ceph txt unknown /proc/65857/task/65867/exe (readlink: Permission denied) 2024-09-19T08:47:17.323 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 65867 admin_soc ceph NOFD /proc/65857/task/65867/fd (opendir: Permission denied) 2024-09-19T08:47:17.323 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66197 signal_ha ceph cwd unknown /proc/65857/task/66197/cwd (readlink: Permission denied) 2024-09-19T08:47:17.323 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66197 signal_ha ceph rtd unknown /proc/65857/task/66197/root (readlink: Permission denied) 2024-09-19T08:47:17.323 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66197 signal_ha ceph txt unknown /proc/65857/task/66197/exe (readlink: Permission denied) 2024-09-19T08:47:17.323 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66197 signal_ha ceph NOFD /proc/65857/task/66197/fd (opendir: Permission denied) 2024-09-19T08:47:17.323 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66198 io_contex ceph cwd unknown /proc/65857/task/66198/cwd (readlink: Permission denied) 2024-09-19T08:47:17.324 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66198 io_contex ceph rtd unknown /proc/65857/task/66198/root (readlink: Permission denied) 2024-09-19T08:47:17.324 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66198 io_contex ceph txt unknown /proc/65857/task/66198/exe (readlink: Permission denied) 2024-09-19T08:47:17.324 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66198 io_contex ceph NOFD /proc/65857/task/66198/fd (opendir: Permission denied) 2024-09-19T08:47:17.324 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66199 io_contex ceph cwd unknown /proc/65857/task/66199/cwd (readlink: Permission denied) 2024-09-19T08:47:17.324 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66199 io_contex ceph rtd unknown /proc/65857/task/66199/root (readlink: Permission denied) 2024-09-19T08:47:17.324 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66199 io_contex ceph txt unknown /proc/65857/task/66199/exe (readlink: Permission denied) 2024-09-19T08:47:17.324 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66199 io_contex ceph NOFD /proc/65857/task/66199/fd (opendir: Permission denied) 2024-09-19T08:47:17.324 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66239 OpHistory ceph cwd unknown /proc/65857/task/66239/cwd (readlink: Permission denied) 2024-09-19T08:47:17.324 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66239 OpHistory ceph rtd unknown /proc/65857/task/66239/root (readlink: Permission denied) 2024-09-19T08:47:17.324 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66239 OpHistory ceph txt unknown /proc/65857/task/66239/exe (readlink: Permission denied) 2024-09-19T08:47:17.324 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66239 OpHistory ceph NOFD /proc/65857/task/66239/fd (opendir: Permission denied) 2024-09-19T08:47:17.324 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66240 ceph_time ceph cwd unknown /proc/65857/task/66240/cwd (readlink: Permission denied) 2024-09-19T08:47:17.324 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66240 ceph_time ceph rtd unknown /proc/65857/task/66240/root (readlink: Permission denied) 2024-09-19T08:47:17.325 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66240 ceph_time ceph txt unknown /proc/65857/task/66240/exe (readlink: Permission denied) 2024-09-19T08:47:17.325 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66240 ceph_time ceph NOFD /proc/65857/task/66240/fd (opendir: Permission denied) 2024-09-19T08:47:17.325 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66247 ceph-osd ceph cwd unknown /proc/65857/task/66247/cwd (readlink: Permission denied) 2024-09-19T08:47:17.325 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66247 ceph-osd ceph rtd unknown /proc/65857/task/66247/root (readlink: Permission denied) 2024-09-19T08:47:17.325 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66247 ceph-osd ceph txt unknown /proc/65857/task/66247/exe (readlink: Permission denied) 2024-09-19T08:47:17.325 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66247 ceph-osd ceph NOFD /proc/65857/task/66247/fd (opendir: Permission denied) 2024-09-19T08:47:17.325 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66274 ceph-osd ceph cwd unknown /proc/65857/task/66274/cwd (readlink: Permission denied) 2024-09-19T08:47:17.325 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66274 ceph-osd ceph rtd unknown /proc/65857/task/66274/root (readlink: Permission denied) 2024-09-19T08:47:17.325 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66274 ceph-osd ceph txt unknown /proc/65857/task/66274/exe (readlink: Permission denied) 2024-09-19T08:47:17.325 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66274 ceph-osd ceph NOFD /proc/65857/task/66274/fd (opendir: Permission denied) 2024-09-19T08:47:17.325 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66309 ceph-osd ceph cwd unknown /proc/65857/task/66309/cwd (readlink: Permission denied) 2024-09-19T08:47:17.325 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66309 ceph-osd ceph rtd unknown /proc/65857/task/66309/root (readlink: Permission denied) 2024-09-19T08:47:17.325 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66309 ceph-osd ceph txt unknown /proc/65857/task/66309/exe (readlink: Permission denied) 2024-09-19T08:47:17.326 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66309 ceph-osd ceph NOFD /proc/65857/task/66309/fd (opendir: Permission denied) 2024-09-19T08:47:17.326 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66447 ceph-osd ceph cwd unknown /proc/65857/task/66447/cwd (readlink: Permission denied) 2024-09-19T08:47:17.326 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66447 ceph-osd ceph rtd unknown /proc/65857/task/66447/root (readlink: Permission denied) 2024-09-19T08:47:17.326 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66447 ceph-osd ceph txt unknown /proc/65857/task/66447/exe (readlink: Permission denied) 2024-09-19T08:47:17.326 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66447 ceph-osd ceph NOFD /proc/65857/task/66447/fd (opendir: Permission denied) 2024-09-19T08:47:17.326 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66484 ceph-osd ceph cwd unknown /proc/65857/task/66484/cwd (readlink: Permission denied) 2024-09-19T08:47:17.326 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66484 ceph-osd ceph rtd unknown /proc/65857/task/66484/root (readlink: Permission denied) 2024-09-19T08:47:17.326 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66484 ceph-osd ceph txt unknown /proc/65857/task/66484/exe (readlink: Permission denied) 2024-09-19T08:47:17.326 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66484 ceph-osd ceph NOFD /proc/65857/task/66484/fd (opendir: Permission denied) 2024-09-19T08:47:17.326 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66520 ceph-osd ceph cwd unknown /proc/65857/task/66520/cwd (readlink: Permission denied) 2024-09-19T08:47:17.326 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66520 ceph-osd ceph rtd unknown /proc/65857/task/66520/root (readlink: Permission denied) 2024-09-19T08:47:17.326 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66520 ceph-osd ceph txt unknown /proc/65857/task/66520/exe (readlink: Permission denied) 2024-09-19T08:47:17.326 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66520 ceph-osd ceph NOFD /proc/65857/task/66520/fd (opendir: Permission denied) 2024-09-19T08:47:17.326 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66605 ceph-osd ceph cwd unknown /proc/65857/task/66605/cwd (readlink: Permission denied) 2024-09-19T08:47:17.327 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66605 ceph-osd ceph rtd unknown /proc/65857/task/66605/root (readlink: Permission denied) 2024-09-19T08:47:17.327 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66605 ceph-osd ceph txt unknown /proc/65857/task/66605/exe (readlink: Permission denied) 2024-09-19T08:47:17.327 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66605 ceph-osd ceph NOFD /proc/65857/task/66605/fd (opendir: Permission denied) 2024-09-19T08:47:17.327 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66623 ceph-osd ceph cwd unknown /proc/65857/task/66623/cwd (readlink: Permission denied) 2024-09-19T08:47:17.327 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66623 ceph-osd ceph rtd unknown /proc/65857/task/66623/root (readlink: Permission denied) 2024-09-19T08:47:17.327 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66623 ceph-osd ceph txt unknown /proc/65857/task/66623/exe (readlink: Permission denied) 2024-09-19T08:47:17.327 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66623 ceph-osd ceph NOFD /proc/65857/task/66623/fd (opendir: Permission denied) 2024-09-19T08:47:17.327 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66624 ceph-osd ceph cwd unknown /proc/65857/task/66624/cwd (readlink: Permission denied) 2024-09-19T08:47:17.327 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66624 ceph-osd ceph rtd unknown /proc/65857/task/66624/root (readlink: Permission denied) 2024-09-19T08:47:17.327 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66624 ceph-osd ceph txt unknown /proc/65857/task/66624/exe (readlink: Permission denied) 2024-09-19T08:47:17.327 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66624 ceph-osd ceph NOFD /proc/65857/task/66624/fd (opendir: Permission denied) 2024-09-19T08:47:17.327 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66625 safe_time ceph cwd unknown /proc/65857/task/66625/cwd (readlink: Permission denied) 2024-09-19T08:47:17.327 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66625 safe_time ceph rtd unknown /proc/65857/task/66625/root (readlink: Permission denied) 2024-09-19T08:47:17.327 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66625 safe_time ceph txt unknown /proc/65857/task/66625/exe (readlink: Permission denied) 2024-09-19T08:47:17.328 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66625 safe_time ceph NOFD /proc/65857/task/66625/fd (opendir: Permission denied) 2024-09-19T08:47:17.328 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66626 safe_time ceph cwd unknown /proc/65857/task/66626/cwd (readlink: Permission denied) 2024-09-19T08:47:17.328 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66626 safe_time ceph rtd unknown /proc/65857/task/66626/root (readlink: Permission denied) 2024-09-19T08:47:17.328 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66626 safe_time ceph txt unknown /proc/65857/task/66626/exe (readlink: Permission denied) 2024-09-19T08:47:17.328 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66626 safe_time ceph NOFD /proc/65857/task/66626/fd (opendir: Permission denied) 2024-09-19T08:47:17.328 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66627 safe_time ceph cwd unknown /proc/65857/task/66627/cwd (readlink: Permission denied) 2024-09-19T08:47:17.328 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66627 safe_time ceph rtd unknown /proc/65857/task/66627/root (readlink: Permission denied) 2024-09-19T08:47:17.328 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66627 safe_time ceph txt unknown /proc/65857/task/66627/exe (readlink: Permission denied) 2024-09-19T08:47:17.328 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66627 safe_time ceph NOFD /proc/65857/task/66627/fd (opendir: Permission denied) 2024-09-19T08:47:17.328 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66628 safe_time ceph cwd unknown /proc/65857/task/66628/cwd (readlink: Permission denied) 2024-09-19T08:47:17.328 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66628 safe_time ceph rtd unknown /proc/65857/task/66628/root (readlink: Permission denied) 2024-09-19T08:47:17.328 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66628 safe_time ceph txt unknown /proc/65857/task/66628/exe (readlink: Permission denied) 2024-09-19T08:47:17.328 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66628 safe_time ceph NOFD /proc/65857/task/66628/fd (opendir: Permission denied) 2024-09-19T08:47:17.329 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66629 fn_anonym ceph cwd unknown /proc/65857/task/66629/cwd (readlink: Permission denied) 2024-09-19T08:47:17.329 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66629 fn_anonym ceph rtd unknown /proc/65857/task/66629/root (readlink: Permission denied) 2024-09-19T08:47:17.329 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66629 fn_anonym ceph txt unknown /proc/65857/task/66629/exe (readlink: Permission denied) 2024-09-19T08:47:17.329 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66629 fn_anonym ceph NOFD /proc/65857/task/66629/fd (opendir: Permission denied) 2024-09-19T08:47:17.329 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66727 rocksdb:l ceph cwd unknown /proc/65857/task/66727/cwd (readlink: Permission denied) 2024-09-19T08:47:17.329 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66727 rocksdb:l ceph rtd unknown /proc/65857/task/66727/root (readlink: Permission denied) 2024-09-19T08:47:17.329 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66727 rocksdb:l ceph txt unknown /proc/65857/task/66727/exe (readlink: Permission denied) 2024-09-19T08:47:17.329 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66727 rocksdb:l ceph NOFD /proc/65857/task/66727/fd (opendir: Permission denied) 2024-09-19T08:47:17.329 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66728 rocksdb:l ceph cwd unknown /proc/65857/task/66728/cwd (readlink: Permission denied) 2024-09-19T08:47:17.329 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66728 rocksdb:l ceph rtd unknown /proc/65857/task/66728/root (readlink: Permission denied) 2024-09-19T08:47:17.329 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66728 rocksdb:l ceph txt unknown /proc/65857/task/66728/exe (readlink: Permission denied) 2024-09-19T08:47:17.329 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66728 rocksdb:l ceph NOFD /proc/65857/task/66728/fd (opendir: Permission denied) 2024-09-19T08:47:17.329 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66729 rocksdb:l ceph cwd unknown /proc/65857/task/66729/cwd (readlink: Permission denied) 2024-09-19T08:47:17.329 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66729 rocksdb:l ceph rtd unknown /proc/65857/task/66729/root (readlink: Permission denied) 2024-09-19T08:47:17.330 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66729 rocksdb:l ceph txt unknown /proc/65857/task/66729/exe (readlink: Permission denied) 2024-09-19T08:47:17.330 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66729 rocksdb:l ceph NOFD /proc/65857/task/66729/fd (opendir: Permission denied) 2024-09-19T08:47:17.330 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66730 rocksdb:h ceph cwd unknown /proc/65857/task/66730/cwd (readlink: Permission denied) 2024-09-19T08:47:17.330 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66730 rocksdb:h ceph rtd unknown /proc/65857/task/66730/root (readlink: Permission denied) 2024-09-19T08:47:17.330 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66730 rocksdb:h ceph txt unknown /proc/65857/task/66730/exe (readlink: Permission denied) 2024-09-19T08:47:17.330 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 66730 rocksdb:h ceph NOFD /proc/65857/task/66730/fd (opendir: Permission denied) 2024-09-19T08:47:17.330 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67129 bstore_ai ceph cwd unknown /proc/65857/task/67129/cwd (readlink: Permission denied) 2024-09-19T08:47:17.330 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67129 bstore_ai ceph rtd unknown /proc/65857/task/67129/root (readlink: Permission denied) 2024-09-19T08:47:17.330 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67129 bstore_ai ceph txt unknown /proc/65857/task/67129/exe (readlink: Permission denied) 2024-09-19T08:47:17.330 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67129 bstore_ai ceph NOFD /proc/65857/task/67129/fd (opendir: Permission denied) 2024-09-19T08:47:17.330 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67130 bstore_di ceph cwd unknown /proc/65857/task/67130/cwd (readlink: Permission denied) 2024-09-19T08:47:17.330 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67130 bstore_di ceph rtd unknown /proc/65857/task/67130/root (readlink: Permission denied) 2024-09-19T08:47:17.330 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67130 bstore_di ceph txt unknown /proc/65857/task/67130/exe (readlink: Permission denied) 2024-09-19T08:47:17.330 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67130 bstore_di ceph NOFD /proc/65857/task/67130/fd (opendir: Permission denied) 2024-09-19T08:47:17.331 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67319 bstore_ai ceph cwd unknown /proc/65857/task/67319/cwd (readlink: Permission denied) 2024-09-19T08:47:17.331 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67319 bstore_ai ceph rtd unknown /proc/65857/task/67319/root (readlink: Permission denied) 2024-09-19T08:47:17.331 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67319 bstore_ai ceph txt unknown /proc/65857/task/67319/exe (readlink: Permission denied) 2024-09-19T08:47:17.331 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67319 bstore_ai ceph NOFD /proc/65857/task/67319/fd (opendir: Permission denied) 2024-09-19T08:47:17.331 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67320 bstore_di ceph cwd unknown /proc/65857/task/67320/cwd (readlink: Permission denied) 2024-09-19T08:47:17.331 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67320 bstore_di ceph rtd unknown /proc/65857/task/67320/root (readlink: Permission denied) 2024-09-19T08:47:17.331 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67320 bstore_di ceph txt unknown /proc/65857/task/67320/exe (readlink: Permission denied) 2024-09-19T08:47:17.331 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67320 bstore_di ceph NOFD /proc/65857/task/67320/fd (opendir: Permission denied) 2024-09-19T08:47:17.331 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67504 ceph-osd ceph cwd unknown /proc/65857/task/67504/cwd (readlink: Permission denied) 2024-09-19T08:47:17.331 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67504 ceph-osd ceph rtd unknown /proc/65857/task/67504/root (readlink: Permission denied) 2024-09-19T08:47:17.331 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67504 ceph-osd ceph txt unknown /proc/65857/task/67504/exe (readlink: Permission denied) 2024-09-19T08:47:17.331 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67504 ceph-osd ceph NOFD /proc/65857/task/67504/fd (opendir: Permission denied) 2024-09-19T08:47:17.331 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67505 cfin ceph cwd unknown /proc/65857/task/67505/cwd (readlink: Permission denied) 2024-09-19T08:47:17.331 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67505 cfin ceph rtd unknown /proc/65857/task/67505/root (readlink: Permission denied) 2024-09-19T08:47:17.332 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67505 cfin ceph txt unknown /proc/65857/task/67505/exe (readlink: Permission denied) 2024-09-19T08:47:17.332 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67505 cfin ceph NOFD /proc/65857/task/67505/fd (opendir: Permission denied) 2024-09-19T08:47:17.332 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67506 bstore_kv ceph cwd unknown /proc/65857/task/67506/cwd (readlink: Permission denied) 2024-09-19T08:47:17.332 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67506 bstore_kv ceph rtd unknown /proc/65857/task/67506/root (readlink: Permission denied) 2024-09-19T08:47:17.332 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67506 bstore_kv ceph txt unknown /proc/65857/task/67506/exe (readlink: Permission denied) 2024-09-19T08:47:17.332 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67506 bstore_kv ceph NOFD /proc/65857/task/67506/fd (opendir: Permission denied) 2024-09-19T08:47:17.332 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67507 bstore_kv ceph cwd unknown /proc/65857/task/67507/cwd (readlink: Permission denied) 2024-09-19T08:47:17.332 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67507 bstore_kv ceph rtd unknown /proc/65857/task/67507/root (readlink: Permission denied) 2024-09-19T08:47:17.332 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67507 bstore_kv ceph txt unknown /proc/65857/task/67507/exe (readlink: Permission denied) 2024-09-19T08:47:17.332 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67507 bstore_kv ceph NOFD /proc/65857/task/67507/fd (opendir: Permission denied) 2024-09-19T08:47:17.332 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67508 bstore_me ceph cwd unknown /proc/65857/task/67508/cwd (readlink: Permission denied) 2024-09-19T08:47:17.332 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67508 bstore_me ceph rtd unknown /proc/65857/task/67508/root (readlink: Permission denied) 2024-09-19T08:47:17.332 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67508 bstore_me ceph txt unknown /proc/65857/task/67508/exe (readlink: Permission denied) 2024-09-19T08:47:17.333 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67508 bstore_me ceph NOFD /proc/65857/task/67508/fd (opendir: Permission denied) 2024-09-19T08:47:17.333 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67509 ms_dispat ceph cwd unknown /proc/65857/task/67509/cwd (readlink: Permission denied) 2024-09-19T08:47:17.333 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67509 ms_dispat ceph rtd unknown /proc/65857/task/67509/root (readlink: Permission denied) 2024-09-19T08:47:17.333 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67509 ms_dispat ceph txt unknown /proc/65857/task/67509/exe (readlink: Permission denied) 2024-09-19T08:47:17.333 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67509 ms_dispat ceph NOFD /proc/65857/task/67509/fd (opendir: Permission denied) 2024-09-19T08:47:17.333 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67510 ms_local ceph cwd unknown /proc/65857/task/67510/cwd (readlink: Permission denied) 2024-09-19T08:47:17.333 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67510 ms_local ceph rtd unknown /proc/65857/task/67510/root (readlink: Permission denied) 2024-09-19T08:47:17.333 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67510 ms_local ceph txt unknown /proc/65857/task/67510/exe (readlink: Permission denied) 2024-09-19T08:47:17.333 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67510 ms_local ceph NOFD /proc/65857/task/67510/fd (opendir: Permission denied) 2024-09-19T08:47:17.333 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67511 safe_time ceph cwd unknown /proc/65857/task/67511/cwd (readlink: Permission denied) 2024-09-19T08:47:17.333 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67511 safe_time ceph rtd unknown /proc/65857/task/67511/root (readlink: Permission denied) 2024-09-19T08:47:17.333 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67511 safe_time ceph txt unknown /proc/65857/task/67511/exe (readlink: Permission denied) 2024-09-19T08:47:17.333 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67511 safe_time ceph NOFD /proc/65857/task/67511/fd (opendir: Permission denied) 2024-09-19T08:47:17.333 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67512 safe_time ceph cwd unknown /proc/65857/task/67512/cwd (readlink: Permission denied) 2024-09-19T08:47:17.334 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67512 safe_time ceph rtd unknown /proc/65857/task/67512/root (readlink: Permission denied) 2024-09-19T08:47:17.334 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67512 safe_time ceph txt unknown /proc/65857/task/67512/exe (readlink: Permission denied) 2024-09-19T08:47:17.334 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67512 safe_time ceph NOFD /proc/65857/task/67512/fd (opendir: Permission denied) 2024-09-19T08:47:17.334 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67513 ms_dispat ceph cwd unknown /proc/65857/task/67513/cwd (readlink: Permission denied) 2024-09-19T08:47:17.334 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67513 ms_dispat ceph rtd unknown /proc/65857/task/67513/root (readlink: Permission denied) 2024-09-19T08:47:17.334 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67513 ms_dispat ceph txt unknown /proc/65857/task/67513/exe (readlink: Permission denied) 2024-09-19T08:47:17.334 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67513 ms_dispat ceph NOFD /proc/65857/task/67513/fd (opendir: Permission denied) 2024-09-19T08:47:17.334 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67514 ms_local ceph cwd unknown /proc/65857/task/67514/cwd (readlink: Permission denied) 2024-09-19T08:47:17.334 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67514 ms_local ceph rtd unknown /proc/65857/task/67514/root (readlink: Permission denied) 2024-09-19T08:47:17.334 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67514 ms_local ceph txt unknown /proc/65857/task/67514/exe (readlink: Permission denied) 2024-09-19T08:47:17.334 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67514 ms_local ceph NOFD /proc/65857/task/67514/fd (opendir: Permission denied) 2024-09-19T08:47:17.334 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67515 ms_dispat ceph cwd unknown /proc/65857/task/67515/cwd (readlink: Permission denied) 2024-09-19T08:47:17.334 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67515 ms_dispat ceph rtd unknown /proc/65857/task/67515/root (readlink: Permission denied) 2024-09-19T08:47:17.335 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67515 ms_dispat ceph txt unknown /proc/65857/task/67515/exe (readlink: Permission denied) 2024-09-19T08:47:17.335 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67515 ms_dispat ceph NOFD /proc/65857/task/67515/fd (opendir: Permission denied) 2024-09-19T08:47:17.335 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67516 ms_local ceph cwd unknown /proc/65857/task/67516/cwd (readlink: Permission denied) 2024-09-19T08:47:17.335 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67516 ms_local ceph rtd unknown /proc/65857/task/67516/root (readlink: Permission denied) 2024-09-19T08:47:17.335 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67516 ms_local ceph txt unknown /proc/65857/task/67516/exe (readlink: Permission denied) 2024-09-19T08:47:17.335 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67516 ms_local ceph NOFD /proc/65857/task/67516/fd (opendir: Permission denied) 2024-09-19T08:47:17.335 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67517 ms_dispat ceph cwd unknown /proc/65857/task/67517/cwd (readlink: Permission denied) 2024-09-19T08:47:17.335 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67517 ms_dispat ceph rtd unknown /proc/65857/task/67517/root (readlink: Permission denied) 2024-09-19T08:47:17.335 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67517 ms_dispat ceph txt unknown /proc/65857/task/67517/exe (readlink: Permission denied) 2024-09-19T08:47:17.335 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67517 ms_dispat ceph NOFD /proc/65857/task/67517/fd (opendir: Permission denied) 2024-09-19T08:47:17.335 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67518 ms_local ceph cwd unknown /proc/65857/task/67518/cwd (readlink: Permission denied) 2024-09-19T08:47:17.335 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67518 ms_local ceph rtd unknown /proc/65857/task/67518/root (readlink: Permission denied) 2024-09-19T08:47:17.335 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67518 ms_local ceph txt unknown /proc/65857/task/67518/exe (readlink: Permission denied) 2024-09-19T08:47:17.336 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67518 ms_local ceph NOFD /proc/65857/task/67518/fd (opendir: Permission denied) 2024-09-19T08:47:17.336 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67519 ms_dispat ceph cwd unknown /proc/65857/task/67519/cwd (readlink: Permission denied) 2024-09-19T08:47:17.336 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67519 ms_dispat ceph rtd unknown /proc/65857/task/67519/root (readlink: Permission denied) 2024-09-19T08:47:17.336 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67519 ms_dispat ceph txt unknown /proc/65857/task/67519/exe (readlink: Permission denied) 2024-09-19T08:47:17.336 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67519 ms_dispat ceph NOFD /proc/65857/task/67519/fd (opendir: Permission denied) 2024-09-19T08:47:17.336 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67520 ms_local ceph cwd unknown /proc/65857/task/67520/cwd (readlink: Permission denied) 2024-09-19T08:47:17.336 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67520 ms_local ceph rtd unknown /proc/65857/task/67520/root (readlink: Permission denied) 2024-09-19T08:47:17.336 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67520 ms_local ceph txt unknown /proc/65857/task/67520/exe (readlink: Permission denied) 2024-09-19T08:47:17.336 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67520 ms_local ceph NOFD /proc/65857/task/67520/fd (opendir: Permission denied) 2024-09-19T08:47:17.336 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67521 ms_dispat ceph cwd unknown /proc/65857/task/67521/cwd (readlink: Permission denied) 2024-09-19T08:47:17.336 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67521 ms_dispat ceph rtd unknown /proc/65857/task/67521/root (readlink: Permission denied) 2024-09-19T08:47:17.336 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67521 ms_dispat ceph txt unknown /proc/65857/task/67521/exe (readlink: Permission denied) 2024-09-19T08:47:17.336 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67521 ms_dispat ceph NOFD /proc/65857/task/67521/fd (opendir: Permission denied) 2024-09-19T08:47:17.336 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67522 ms_local ceph cwd unknown /proc/65857/task/67522/cwd (readlink: Permission denied) 2024-09-19T08:47:17.337 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67522 ms_local ceph rtd unknown /proc/65857/task/67522/root (readlink: Permission denied) 2024-09-19T08:47:17.337 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67522 ms_local ceph txt unknown /proc/65857/task/67522/exe (readlink: Permission denied) 2024-09-19T08:47:17.337 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67522 ms_local ceph NOFD /proc/65857/task/67522/fd (opendir: Permission denied) 2024-09-19T08:47:17.337 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67523 ms_dispat ceph cwd unknown /proc/65857/task/67523/cwd (readlink: Permission denied) 2024-09-19T08:47:17.337 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67523 ms_dispat ceph rtd unknown /proc/65857/task/67523/root (readlink: Permission denied) 2024-09-19T08:47:17.337 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67523 ms_dispat ceph txt unknown /proc/65857/task/67523/exe (readlink: Permission denied) 2024-09-19T08:47:17.341 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67523 ms_dispat ceph NOFD /proc/65857/task/67523/fd (opendir: Permission denied) 2024-09-19T08:47:17.341 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67524 ms_local ceph cwd unknown /proc/65857/task/67524/cwd (readlink: Permission denied) 2024-09-19T08:47:17.341 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67524 ms_local ceph rtd unknown /proc/65857/task/67524/root (readlink: Permission denied) 2024-09-19T08:47:17.341 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67524 ms_local ceph txt unknown /proc/65857/task/67524/exe (readlink: Permission denied) 2024-09-19T08:47:17.341 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67524 ms_local ceph NOFD /proc/65857/task/67524/fd (opendir: Permission denied) 2024-09-19T08:47:17.341 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67525 fn_anonym ceph cwd unknown /proc/65857/task/67525/cwd (readlink: Permission denied) 2024-09-19T08:47:17.341 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67525 fn_anonym ceph rtd unknown /proc/65857/task/67525/root (readlink: Permission denied) 2024-09-19T08:47:17.342 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67525 fn_anonym ceph txt unknown /proc/65857/task/67525/exe (readlink: Permission denied) 2024-09-19T08:47:17.342 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67525 fn_anonym ceph NOFD /proc/65857/task/67525/fd (opendir: Permission denied) 2024-09-19T08:47:17.342 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67526 finisher ceph cwd unknown /proc/65857/task/67526/cwd (readlink: Permission denied) 2024-09-19T08:47:17.342 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67526 finisher ceph rtd unknown /proc/65857/task/67526/root (readlink: Permission denied) 2024-09-19T08:47:17.342 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67526 finisher ceph txt unknown /proc/65857/task/67526/exe (readlink: Permission denied) 2024-09-19T08:47:17.342 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67526 finisher ceph NOFD /proc/65857/task/67526/fd (opendir: Permission denied) 2024-09-19T08:47:17.342 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67527 safe_time ceph cwd unknown /proc/65857/task/67527/cwd (readlink: Permission denied) 2024-09-19T08:47:17.342 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67527 safe_time ceph rtd unknown /proc/65857/task/67527/root (readlink: Permission denied) 2024-09-19T08:47:17.342 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67527 safe_time ceph txt unknown /proc/65857/task/67527/exe (readlink: Permission denied) 2024-09-19T08:47:17.342 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67527 safe_time ceph NOFD /proc/65857/task/67527/fd (opendir: Permission denied) 2024-09-19T08:47:17.342 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67528 safe_time ceph cwd unknown /proc/65857/task/67528/cwd (readlink: Permission denied) 2024-09-19T08:47:17.342 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67528 safe_time ceph rtd unknown /proc/65857/task/67528/root (readlink: Permission denied) 2024-09-19T08:47:17.342 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67528 safe_time ceph txt unknown /proc/65857/task/67528/exe (readlink: Permission denied) 2024-09-19T08:47:17.343 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67528 safe_time ceph NOFD /proc/65857/task/67528/fd (opendir: Permission denied) 2024-09-19T08:47:17.343 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67529 ceph-osd ceph cwd unknown /proc/65857/task/67529/cwd (readlink: Permission denied) 2024-09-19T08:47:17.343 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67529 ceph-osd ceph rtd unknown /proc/65857/task/67529/root (readlink: Permission denied) 2024-09-19T08:47:17.343 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67529 ceph-osd ceph txt unknown /proc/65857/task/67529/exe (readlink: Permission denied) 2024-09-19T08:47:17.343 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67529 ceph-osd ceph NOFD /proc/65857/task/67529/fd (opendir: Permission denied) 2024-09-19T08:47:17.343 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67530 osd_srv_a ceph cwd unknown /proc/65857/task/67530/cwd (readlink: Permission denied) 2024-09-19T08:47:17.343 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67530 osd_srv_a ceph rtd unknown /proc/65857/task/67530/root (readlink: Permission denied) 2024-09-19T08:47:17.343 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67530 osd_srv_a ceph txt unknown /proc/65857/task/67530/exe (readlink: Permission denied) 2024-09-19T08:47:17.343 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67530 osd_srv_a ceph NOFD /proc/65857/task/67530/fd (opendir: Permission denied) 2024-09-19T08:47:17.343 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67531 tp_osd_tp ceph cwd unknown /proc/65857/task/67531/cwd (readlink: Permission denied) 2024-09-19T08:47:17.343 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67531 tp_osd_tp ceph rtd unknown /proc/65857/task/67531/root (readlink: Permission denied) 2024-09-19T08:47:17.343 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67531 tp_osd_tp ceph txt unknown /proc/65857/task/67531/exe (readlink: Permission denied) 2024-09-19T08:47:17.343 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67531 tp_osd_tp ceph NOFD /proc/65857/task/67531/fd (opendir: Permission denied) 2024-09-19T08:47:17.344 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67532 tp_osd_tp ceph cwd unknown /proc/65857/task/67532/cwd (readlink: Permission denied) 2024-09-19T08:47:17.344 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67532 tp_osd_tp ceph rtd unknown /proc/65857/task/67532/root (readlink: Permission denied) 2024-09-19T08:47:17.344 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67532 tp_osd_tp ceph txt unknown /proc/65857/task/67532/exe (readlink: Permission denied) 2024-09-19T08:47:17.344 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67532 tp_osd_tp ceph NOFD /proc/65857/task/67532/fd (opendir: Permission denied) 2024-09-19T08:47:17.344 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67533 tp_osd_tp ceph cwd unknown /proc/65857/task/67533/cwd (readlink: Permission denied) 2024-09-19T08:47:17.344 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67533 tp_osd_tp ceph rtd unknown /proc/65857/task/67533/root (readlink: Permission denied) 2024-09-19T08:47:17.344 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67533 tp_osd_tp ceph txt unknown /proc/65857/task/67533/exe (readlink: Permission denied) 2024-09-19T08:47:17.344 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67533 tp_osd_tp ceph NOFD /proc/65857/task/67533/fd (opendir: Permission denied) 2024-09-19T08:47:17.344 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67534 tp_osd_tp ceph cwd unknown /proc/65857/task/67534/cwd (readlink: Permission denied) 2024-09-19T08:47:17.344 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67534 tp_osd_tp ceph rtd unknown /proc/65857/task/67534/root (readlink: Permission denied) 2024-09-19T08:47:17.344 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67534 tp_osd_tp ceph txt unknown /proc/65857/task/67534/exe (readlink: Permission denied) 2024-09-19T08:47:17.344 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67534 tp_osd_tp ceph NOFD /proc/65857/task/67534/fd (opendir: Permission denied) 2024-09-19T08:47:17.344 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67535 tp_osd_tp ceph cwd unknown /proc/65857/task/67535/cwd (readlink: Permission denied) 2024-09-19T08:47:17.345 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67535 tp_osd_tp ceph rtd unknown /proc/65857/task/67535/root (readlink: Permission denied) 2024-09-19T08:47:17.345 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67535 tp_osd_tp ceph txt unknown /proc/65857/task/67535/exe (readlink: Permission denied) 2024-09-19T08:47:17.345 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67535 tp_osd_tp ceph NOFD /proc/65857/task/67535/fd (opendir: Permission denied) 2024-09-19T08:47:17.345 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67536 tp_osd_tp ceph cwd unknown /proc/65857/task/67536/cwd (readlink: Permission denied) 2024-09-19T08:47:17.345 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67536 tp_osd_tp ceph rtd unknown /proc/65857/task/67536/root (readlink: Permission denied) 2024-09-19T08:47:17.345 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67536 tp_osd_tp ceph txt unknown /proc/65857/task/67536/exe (readlink: Permission denied) 2024-09-19T08:47:17.345 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67536 tp_osd_tp ceph NOFD /proc/65857/task/67536/fd (opendir: Permission denied) 2024-09-19T08:47:17.345 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67537 tp_osd_tp ceph cwd unknown /proc/65857/task/67537/cwd (readlink: Permission denied) 2024-09-19T08:47:17.345 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67537 tp_osd_tp ceph rtd unknown /proc/65857/task/67537/root (readlink: Permission denied) 2024-09-19T08:47:17.345 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67537 tp_osd_tp ceph txt unknown /proc/65857/task/67537/exe (readlink: Permission denied) 2024-09-19T08:47:17.345 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67537 tp_osd_tp ceph NOFD /proc/65857/task/67537/fd (opendir: Permission denied) 2024-09-19T08:47:17.345 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67538 tp_osd_tp ceph cwd unknown /proc/65857/task/67538/cwd (readlink: Permission denied) 2024-09-19T08:47:17.345 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67538 tp_osd_tp ceph rtd unknown /proc/65857/task/67538/root (readlink: Permission denied) 2024-09-19T08:47:17.345 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67538 tp_osd_tp ceph txt unknown /proc/65857/task/67538/exe (readlink: Permission denied) 2024-09-19T08:47:17.346 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67538 tp_osd_tp ceph NOFD /proc/65857/task/67538/fd (opendir: Permission denied) 2024-09-19T08:47:17.346 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67539 tp_osd_tp ceph cwd unknown /proc/65857/task/67539/cwd (readlink: Permission denied) 2024-09-19T08:47:17.346 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67539 tp_osd_tp ceph rtd unknown /proc/65857/task/67539/root (readlink: Permission denied) 2024-09-19T08:47:17.346 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67539 tp_osd_tp ceph txt unknown /proc/65857/task/67539/exe (readlink: Permission denied) 2024-09-19T08:47:17.346 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67539 tp_osd_tp ceph NOFD /proc/65857/task/67539/fd (opendir: Permission denied) 2024-09-19T08:47:17.346 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67540 tp_osd_tp ceph cwd unknown /proc/65857/task/67540/cwd (readlink: Permission denied) 2024-09-19T08:47:17.346 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67540 tp_osd_tp ceph rtd unknown /proc/65857/task/67540/root (readlink: Permission denied) 2024-09-19T08:47:17.346 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67540 tp_osd_tp ceph txt unknown /proc/65857/task/67540/exe (readlink: Permission denied) 2024-09-19T08:47:17.346 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67540 tp_osd_tp ceph NOFD /proc/65857/task/67540/fd (opendir: Permission denied) 2024-09-19T08:47:17.346 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67541 tp_osd_tp ceph cwd unknown /proc/65857/task/67541/cwd (readlink: Permission denied) 2024-09-19T08:47:17.346 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67541 tp_osd_tp ceph rtd unknown /proc/65857/task/67541/root (readlink: Permission denied) 2024-09-19T08:47:17.346 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67541 tp_osd_tp ceph txt unknown /proc/65857/task/67541/exe (readlink: Permission denied) 2024-09-19T08:47:17.346 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67541 tp_osd_tp ceph NOFD /proc/65857/task/67541/fd (opendir: Permission denied) 2024-09-19T08:47:17.347 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67542 tp_osd_tp ceph cwd unknown /proc/65857/task/67542/cwd (readlink: Permission denied) 2024-09-19T08:47:17.347 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67542 tp_osd_tp ceph rtd unknown /proc/65857/task/67542/root (readlink: Permission denied) 2024-09-19T08:47:17.347 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67542 tp_osd_tp ceph txt unknown /proc/65857/task/67542/exe (readlink: Permission denied) 2024-09-19T08:47:17.347 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67542 tp_osd_tp ceph NOFD /proc/65857/task/67542/fd (opendir: Permission denied) 2024-09-19T08:47:17.347 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67543 tp_osd_tp ceph cwd unknown /proc/65857/task/67543/cwd (readlink: Permission denied) 2024-09-19T08:47:17.347 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67543 tp_osd_tp ceph rtd unknown /proc/65857/task/67543/root (readlink: Permission denied) 2024-09-19T08:47:17.347 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67543 tp_osd_tp ceph txt unknown /proc/65857/task/67543/exe (readlink: Permission denied) 2024-09-19T08:47:17.347 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67543 tp_osd_tp ceph NOFD /proc/65857/task/67543/fd (opendir: Permission denied) 2024-09-19T08:47:17.347 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67544 tp_osd_tp ceph cwd unknown /proc/65857/task/67544/cwd (readlink: Permission denied) 2024-09-19T08:47:17.347 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67544 tp_osd_tp ceph rtd unknown /proc/65857/task/67544/root (readlink: Permission denied) 2024-09-19T08:47:17.347 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67544 tp_osd_tp ceph txt unknown /proc/65857/task/67544/exe (readlink: Permission denied) 2024-09-19T08:47:17.347 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67544 tp_osd_tp ceph NOFD /proc/65857/task/67544/fd (opendir: Permission denied) 2024-09-19T08:47:17.347 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67545 tp_osd_tp ceph cwd unknown /proc/65857/task/67545/cwd (readlink: Permission denied) 2024-09-19T08:47:17.347 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67545 tp_osd_tp ceph rtd unknown /proc/65857/task/67545/root (readlink: Permission denied) 2024-09-19T08:47:17.348 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67545 tp_osd_tp ceph txt unknown /proc/65857/task/67545/exe (readlink: Permission denied) 2024-09-19T08:47:17.348 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67545 tp_osd_tp ceph NOFD /proc/65857/task/67545/fd (opendir: Permission denied) 2024-09-19T08:47:17.348 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67546 tp_osd_tp ceph cwd unknown /proc/65857/task/67546/cwd (readlink: Permission denied) 2024-09-19T08:47:17.348 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67546 tp_osd_tp ceph rtd unknown /proc/65857/task/67546/root (readlink: Permission denied) 2024-09-19T08:47:17.348 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67546 tp_osd_tp ceph txt unknown /proc/65857/task/67546/exe (readlink: Permission denied) 2024-09-19T08:47:17.348 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67546 tp_osd_tp ceph NOFD /proc/65857/task/67546/fd (opendir: Permission denied) 2024-09-19T08:47:17.348 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67547 osd_srv_h ceph cwd unknown /proc/65857/task/67547/cwd (readlink: Permission denied) 2024-09-19T08:47:17.348 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67547 osd_srv_h ceph rtd unknown /proc/65857/task/67547/root (readlink: Permission denied) 2024-09-19T08:47:17.348 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67547 osd_srv_h ceph txt unknown /proc/65857/task/67547/exe (readlink: Permission denied) 2024-09-19T08:47:17.348 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-osd 65857 67547 osd_srv_h ceph NOFD /proc/65857/task/67547/fd (opendir: Permission denied) 2024-09-19T08:47:17.348 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 66641 root cwd unknown /proc/66641/cwd (readlink: Permission denied) 2024-09-19T08:47:17.348 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 66641 root rtd unknown /proc/66641/root (readlink: Permission denied) 2024-09-19T08:47:17.348 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 66641 root txt unknown /proc/66641/exe (readlink: Permission denied) 2024-09-19T08:47:17.349 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 66641 root NOFD /proc/66641/fd (opendir: Permission denied) 2024-09-19T08:47:17.349 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 66658 root cwd unknown /proc/66658/cwd (readlink: Permission denied) 2024-09-19T08:47:17.349 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 66658 root rtd unknown /proc/66658/root (readlink: Permission denied) 2024-09-19T08:47:17.349 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 66658 root txt unknown /proc/66658/exe (readlink: Permission denied) 2024-09-19T08:47:17.349 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 66658 root NOFD /proc/66658/fd (opendir: Permission denied) 2024-09-19T08:47:17.349 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 69951 root cwd unknown /proc/69951/cwd (readlink: Permission denied) 2024-09-19T08:47:17.349 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 69951 root rtd unknown /proc/69951/root (readlink: Permission denied) 2024-09-19T08:47:17.349 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 69951 root txt unknown /proc/69951/exe (readlink: Permission denied) 2024-09-19T08:47:17.349 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 69951 root NOFD /proc/69951/fd (opendir: Permission denied) 2024-09-19T08:47:17.349 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 70683 root cwd unknown /proc/70683/cwd (readlink: Permission denied) 2024-09-19T08:47:17.349 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 70683 root rtd unknown /proc/70683/root (readlink: Permission denied) 2024-09-19T08:47:17.349 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 70683 root txt unknown /proc/70683/exe (readlink: Permission denied) 2024-09-19T08:47:17.349 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 70683 root NOFD /proc/70683/fd (opendir: Permission denied) 2024-09-19T08:47:17.349 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 70700 root cwd unknown /proc/70700/cwd (readlink: Permission denied) 2024-09-19T08:47:17.350 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 70700 root rtd unknown /proc/70700/root (readlink: Permission denied) 2024-09-19T08:47:17.350 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 70700 root txt unknown /proc/70700/exe (readlink: Permission denied) 2024-09-19T08:47:17.350 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 70700 root NOFD /proc/70700/fd (opendir: Permission denied) 2024-09-19T08:47:17.350 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 70701 root cwd unknown /proc/70701/cwd (readlink: Permission denied) 2024-09-19T08:47:17.350 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 70701 root rtd unknown /proc/70701/root (readlink: Permission denied) 2024-09-19T08:47:17.350 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 70701 root txt unknown /proc/70701/exe (readlink: Permission denied) 2024-09-19T08:47:17.350 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 70701 root NOFD /proc/70701/fd (opendir: Permission denied) 2024-09-19T08:47:17.350 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 70718 root cwd unknown /proc/70718/cwd (readlink: Permission denied) 2024-09-19T08:47:17.350 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 70718 root rtd unknown /proc/70718/root (readlink: Permission denied) 2024-09-19T08:47:17.350 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 70718 root txt unknown /proc/70718/exe (readlink: Permission denied) 2024-09-19T08:47:17.350 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 70718 root NOFD /proc/70718/fd (opendir: Permission denied) 2024-09-19T08:47:17.350 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 70719 root cwd unknown /proc/70719/cwd (readlink: Permission denied) 2024-09-19T08:47:17.350 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 70719 root rtd unknown /proc/70719/root (readlink: Permission denied) 2024-09-19T08:47:17.351 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 70719 root txt unknown /proc/70719/exe (readlink: Permission denied) 2024-09-19T08:47:17.351 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 70719 root NOFD /proc/70719/fd (opendir: Permission denied) 2024-09-19T08:47:17.351 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 70736 root cwd unknown /proc/70736/cwd (readlink: Permission denied) 2024-09-19T08:47:17.351 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 70736 root rtd unknown /proc/70736/root (readlink: Permission denied) 2024-09-19T08:47:17.351 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 70736 root txt unknown /proc/70736/exe (readlink: Permission denied) 2024-09-19T08:47:17.351 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 70736 root NOFD /proc/70736/fd (opendir: Permission denied) 2024-09-19T08:47:17.351 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 70737 root cwd unknown /proc/70737/cwd (readlink: Permission denied) 2024-09-19T08:47:17.351 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 70737 root rtd unknown /proc/70737/root (readlink: Permission denied) 2024-09-19T08:47:17.351 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 70737 root txt unknown /proc/70737/exe (readlink: Permission denied) 2024-09-19T08:47:17.351 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 70737 root NOFD /proc/70737/fd (opendir: Permission denied) 2024-09-19T08:47:17.351 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 70754 root cwd unknown /proc/70754/cwd (readlink: Permission denied) 2024-09-19T08:47:17.351 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 70754 root rtd unknown /proc/70754/root (readlink: Permission denied) 2024-09-19T08:47:17.351 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 70754 root txt unknown /proc/70754/exe (readlink: Permission denied) 2024-09-19T08:47:17.351 INFO:tasks.workunit.client.0.smithi007.stdout:journalct 70754 root NOFD /proc/70754/fd (opendir: Permission denied) 2024-09-19T08:47:17.352 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 71249 root cwd unknown /proc/71249/cwd (readlink: Permission denied) 2024-09-19T08:47:17.352 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 71249 root rtd unknown /proc/71249/root (readlink: Permission denied) 2024-09-19T08:47:17.352 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 71249 root txt unknown /proc/71249/exe (readlink: Permission denied) 2024-09-19T08:47:17.352 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 71249 root NOFD /proc/71249/fd (opendir: Permission denied) 2024-09-19T08:47:17.352 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 71251 root cwd unknown /proc/71251/cwd (readlink: Permission denied) 2024-09-19T08:47:17.352 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 71251 root rtd unknown /proc/71251/root (readlink: Permission denied) 2024-09-19T08:47:17.352 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 71251 root txt unknown /proc/71251/exe (readlink: Permission denied) 2024-09-19T08:47:17.352 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 71251 root NOFD /proc/71251/fd (opendir: Permission denied) 2024-09-19T08:47:17.352 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 ceph cwd unknown /proc/71253/cwd (readlink: Permission denied) 2024-09-19T08:47:17.352 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 ceph rtd unknown /proc/71253/root (readlink: Permission denied) 2024-09-19T08:47:17.352 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 ceph txt unknown /proc/71253/exe (readlink: Permission denied) 2024-09-19T08:47:17.352 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 ceph NOFD /proc/71253/fd (opendir: Permission denied) 2024-09-19T08:47:17.352 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71254 log ceph cwd unknown /proc/71253/task/71254/cwd (readlink: Permission denied) 2024-09-19T08:47:17.353 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71254 log ceph rtd unknown /proc/71253/task/71254/root (readlink: Permission denied) 2024-09-19T08:47:17.353 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71254 log ceph txt unknown /proc/71253/task/71254/exe (readlink: Permission denied) 2024-09-19T08:47:17.353 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71254 log ceph NOFD /proc/71253/task/71254/fd (opendir: Permission denied) 2024-09-19T08:47:17.353 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71256 msgr-work ceph cwd unknown /proc/71253/task/71256/cwd (readlink: Permission denied) 2024-09-19T08:47:17.353 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71256 msgr-work ceph rtd unknown /proc/71253/task/71256/root (readlink: Permission denied) 2024-09-19T08:47:17.353 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71256 msgr-work ceph txt unknown /proc/71253/task/71256/exe (readlink: Permission denied) 2024-09-19T08:47:17.353 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71256 msgr-work ceph NOFD /proc/71253/task/71256/fd (opendir: Permission denied) 2024-09-19T08:47:17.353 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71257 msgr-work ceph cwd unknown /proc/71253/task/71257/cwd (readlink: Permission denied) 2024-09-19T08:47:17.353 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71257 msgr-work ceph rtd unknown /proc/71253/task/71257/root (readlink: Permission denied) 2024-09-19T08:47:17.353 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71257 msgr-work ceph txt unknown /proc/71253/task/71257/exe (readlink: Permission denied) 2024-09-19T08:47:17.353 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71257 msgr-work ceph NOFD /proc/71253/task/71257/fd (opendir: Permission denied) 2024-09-19T08:47:17.353 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71258 msgr-work ceph cwd unknown /proc/71253/task/71258/cwd (readlink: Permission denied) 2024-09-19T08:47:17.353 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71258 msgr-work ceph rtd unknown /proc/71253/task/71258/root (readlink: Permission denied) 2024-09-19T08:47:17.353 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71258 msgr-work ceph txt unknown /proc/71253/task/71258/exe (readlink: Permission denied) 2024-09-19T08:47:17.354 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71258 msgr-work ceph NOFD /proc/71253/task/71258/fd (opendir: Permission denied) 2024-09-19T08:47:17.354 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71262 service ceph cwd unknown /proc/71253/task/71262/cwd (readlink: Permission denied) 2024-09-19T08:47:17.354 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71262 service ceph rtd unknown /proc/71253/task/71262/root (readlink: Permission denied) 2024-09-19T08:47:17.354 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71262 service ceph txt unknown /proc/71253/task/71262/exe (readlink: Permission denied) 2024-09-19T08:47:17.354 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71262 service ceph NOFD /proc/71253/task/71262/fd (opendir: Permission denied) 2024-09-19T08:47:17.354 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71263 admin_soc ceph cwd unknown /proc/71253/task/71263/cwd (readlink: Permission denied) 2024-09-19T08:47:17.354 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71263 admin_soc ceph rtd unknown /proc/71253/task/71263/root (readlink: Permission denied) 2024-09-19T08:47:17.354 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71263 admin_soc ceph txt unknown /proc/71253/task/71263/exe (readlink: Permission denied) 2024-09-19T08:47:17.354 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71263 admin_soc ceph NOFD /proc/71253/task/71263/fd (opendir: Permission denied) 2024-09-19T08:47:17.354 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71264 signal_ha ceph cwd unknown /proc/71253/task/71264/cwd (readlink: Permission denied) 2024-09-19T08:47:17.354 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71264 signal_ha ceph rtd unknown /proc/71253/task/71264/root (readlink: Permission denied) 2024-09-19T08:47:17.354 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71264 signal_ha ceph txt unknown /proc/71253/task/71264/exe (readlink: Permission denied) 2024-09-19T08:47:17.354 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71264 signal_ha ceph NOFD /proc/71253/task/71264/fd (opendir: Permission denied) 2024-09-19T08:47:17.355 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71265 io_contex ceph cwd unknown /proc/71253/task/71265/cwd (readlink: Permission denied) 2024-09-19T08:47:17.355 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71265 io_contex ceph rtd unknown /proc/71253/task/71265/root (readlink: Permission denied) 2024-09-19T08:47:17.355 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71265 io_contex ceph txt unknown /proc/71253/task/71265/exe (readlink: Permission denied) 2024-09-19T08:47:17.355 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71265 io_contex ceph NOFD /proc/71253/task/71265/fd (opendir: Permission denied) 2024-09-19T08:47:17.355 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71266 io_contex ceph cwd unknown /proc/71253/task/71266/cwd (readlink: Permission denied) 2024-09-19T08:47:17.355 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71266 io_contex ceph rtd unknown /proc/71253/task/71266/root (readlink: Permission denied) 2024-09-19T08:47:17.355 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71266 io_contex ceph txt unknown /proc/71253/task/71266/exe (readlink: Permission denied) 2024-09-19T08:47:17.355 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71266 io_contex ceph NOFD /proc/71253/task/71266/fd (opendir: Permission denied) 2024-09-19T08:47:17.355 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71267 ms_dispat ceph cwd unknown /proc/71253/task/71267/cwd (readlink: Permission denied) 2024-09-19T08:47:17.355 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71267 ms_dispat ceph rtd unknown /proc/71253/task/71267/root (readlink: Permission denied) 2024-09-19T08:47:17.355 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71267 ms_dispat ceph txt unknown /proc/71253/task/71267/exe (readlink: Permission denied) 2024-09-19T08:47:17.355 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71267 ms_dispat ceph NOFD /proc/71253/task/71267/fd (opendir: Permission denied) 2024-09-19T08:47:17.355 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71268 ms_local ceph cwd unknown /proc/71253/task/71268/cwd (readlink: Permission denied) 2024-09-19T08:47:17.356 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71268 ms_local ceph rtd unknown /proc/71253/task/71268/root (readlink: Permission denied) 2024-09-19T08:47:17.356 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71268 ms_local ceph txt unknown /proc/71253/task/71268/exe (readlink: Permission denied) 2024-09-19T08:47:17.356 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71268 ms_local ceph NOFD /proc/71253/task/71268/fd (opendir: Permission denied) 2024-09-19T08:47:17.356 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71269 safe_time ceph cwd unknown /proc/71253/task/71269/cwd (readlink: Permission denied) 2024-09-19T08:47:17.356 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71269 safe_time ceph rtd unknown /proc/71253/task/71269/root (readlink: Permission denied) 2024-09-19T08:47:17.356 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71269 safe_time ceph txt unknown /proc/71253/task/71269/exe (readlink: Permission denied) 2024-09-19T08:47:17.356 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71269 safe_time ceph NOFD /proc/71253/task/71269/fd (opendir: Permission denied) 2024-09-19T08:47:17.356 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71270 safe_time ceph cwd unknown /proc/71253/task/71270/cwd (readlink: Permission denied) 2024-09-19T08:47:17.356 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71270 safe_time ceph rtd unknown /proc/71253/task/71270/root (readlink: Permission denied) 2024-09-19T08:47:17.356 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71270 safe_time ceph txt unknown /proc/71253/task/71270/exe (readlink: Permission denied) 2024-09-19T08:47:17.356 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71270 safe_time ceph NOFD /proc/71253/task/71270/fd (opendir: Permission denied) 2024-09-19T08:47:17.356 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71271 ceph-mds ceph cwd unknown /proc/71253/task/71271/cwd (readlink: Permission denied) 2024-09-19T08:47:17.356 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71271 ceph-mds ceph rtd unknown /proc/71253/task/71271/root (readlink: Permission denied) 2024-09-19T08:47:17.356 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71271 ceph-mds ceph txt unknown /proc/71253/task/71271/exe (readlink: Permission denied) 2024-09-19T08:47:17.357 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71271 ceph-mds ceph NOFD /proc/71253/task/71271/fd (opendir: Permission denied) 2024-09-19T08:47:17.357 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71312 safe_time ceph cwd unknown /proc/71253/task/71312/cwd (readlink: Permission denied) 2024-09-19T08:47:17.357 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71312 safe_time ceph rtd unknown /proc/71253/task/71312/root (readlink: Permission denied) 2024-09-19T08:47:17.357 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71312 safe_time ceph txt unknown /proc/71253/task/71312/exe (readlink: Permission denied) 2024-09-19T08:47:17.357 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71253 71312 safe_time ceph NOFD /proc/71253/task/71312/fd (opendir: Permission denied) 2024-09-19T08:47:17.357 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 71662 root cwd unknown /proc/71662/cwd (readlink: Permission denied) 2024-09-19T08:47:17.357 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 71662 root rtd unknown /proc/71662/root (readlink: Permission denied) 2024-09-19T08:47:17.357 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 71662 root txt unknown /proc/71662/exe (readlink: Permission denied) 2024-09-19T08:47:17.357 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 71662 root NOFD /proc/71662/fd (opendir: Permission denied) 2024-09-19T08:47:17.357 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 71664 root cwd unknown /proc/71664/cwd (readlink: Permission denied) 2024-09-19T08:47:17.357 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 71664 root rtd unknown /proc/71664/root (readlink: Permission denied) 2024-09-19T08:47:17.357 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 71664 root txt unknown /proc/71664/exe (readlink: Permission denied) 2024-09-19T08:47:17.357 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 71664 root NOFD /proc/71664/fd (opendir: Permission denied) 2024-09-19T08:47:17.357 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 ceph cwd unknown /proc/71670/cwd (readlink: Permission denied) 2024-09-19T08:47:17.358 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 ceph rtd unknown /proc/71670/root (readlink: Permission denied) 2024-09-19T08:47:17.358 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 ceph txt unknown /proc/71670/exe (readlink: Permission denied) 2024-09-19T08:47:17.358 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 ceph NOFD /proc/71670/fd (opendir: Permission denied) 2024-09-19T08:47:17.358 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71671 log ceph cwd unknown /proc/71670/task/71671/cwd (readlink: Permission denied) 2024-09-19T08:47:17.358 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71671 log ceph rtd unknown /proc/71670/task/71671/root (readlink: Permission denied) 2024-09-19T08:47:17.358 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71671 log ceph txt unknown /proc/71670/task/71671/exe (readlink: Permission denied) 2024-09-19T08:47:17.358 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71671 log ceph NOFD /proc/71670/task/71671/fd (opendir: Permission denied) 2024-09-19T08:47:17.358 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71673 msgr-work ceph cwd unknown /proc/71670/task/71673/cwd (readlink: Permission denied) 2024-09-19T08:47:17.358 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71673 msgr-work ceph rtd unknown /proc/71670/task/71673/root (readlink: Permission denied) 2024-09-19T08:47:17.358 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71673 msgr-work ceph txt unknown /proc/71670/task/71673/exe (readlink: Permission denied) 2024-09-19T08:47:17.358 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71673 msgr-work ceph NOFD /proc/71670/task/71673/fd (opendir: Permission denied) 2024-09-19T08:47:17.358 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71674 msgr-work ceph cwd unknown /proc/71670/task/71674/cwd (readlink: Permission denied) 2024-09-19T08:47:17.358 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71674 msgr-work ceph rtd unknown /proc/71670/task/71674/root (readlink: Permission denied) 2024-09-19T08:47:17.359 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71674 msgr-work ceph txt unknown /proc/71670/task/71674/exe (readlink: Permission denied) 2024-09-19T08:47:17.359 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71674 msgr-work ceph NOFD /proc/71670/task/71674/fd (opendir: Permission denied) 2024-09-19T08:47:17.359 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71675 msgr-work ceph cwd unknown /proc/71670/task/71675/cwd (readlink: Permission denied) 2024-09-19T08:47:17.359 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71675 msgr-work ceph rtd unknown /proc/71670/task/71675/root (readlink: Permission denied) 2024-09-19T08:47:17.359 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71675 msgr-work ceph txt unknown /proc/71670/task/71675/exe (readlink: Permission denied) 2024-09-19T08:47:17.359 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71675 msgr-work ceph NOFD /proc/71670/task/71675/fd (opendir: Permission denied) 2024-09-19T08:47:17.359 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71679 service ceph cwd unknown /proc/71670/task/71679/cwd (readlink: Permission denied) 2024-09-19T08:47:17.359 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71679 service ceph rtd unknown /proc/71670/task/71679/root (readlink: Permission denied) 2024-09-19T08:47:17.359 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71679 service ceph txt unknown /proc/71670/task/71679/exe (readlink: Permission denied) 2024-09-19T08:47:17.359 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71679 service ceph NOFD /proc/71670/task/71679/fd (opendir: Permission denied) 2024-09-19T08:47:17.359 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71680 admin_soc ceph cwd unknown /proc/71670/task/71680/cwd (readlink: Permission denied) 2024-09-19T08:47:17.359 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71680 admin_soc ceph rtd unknown /proc/71670/task/71680/root (readlink: Permission denied) 2024-09-19T08:47:17.359 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71680 admin_soc ceph txt unknown /proc/71670/task/71680/exe (readlink: Permission denied) 2024-09-19T08:47:17.360 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71680 admin_soc ceph NOFD /proc/71670/task/71680/fd (opendir: Permission denied) 2024-09-19T08:47:17.360 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71681 signal_ha ceph cwd unknown /proc/71670/task/71681/cwd (readlink: Permission denied) 2024-09-19T08:47:17.360 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71681 signal_ha ceph rtd unknown /proc/71670/task/71681/root (readlink: Permission denied) 2024-09-19T08:47:17.360 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71681 signal_ha ceph txt unknown /proc/71670/task/71681/exe (readlink: Permission denied) 2024-09-19T08:47:17.360 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71681 signal_ha ceph NOFD /proc/71670/task/71681/fd (opendir: Permission denied) 2024-09-19T08:47:17.360 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71682 io_contex ceph cwd unknown /proc/71670/task/71682/cwd (readlink: Permission denied) 2024-09-19T08:47:17.360 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71682 io_contex ceph rtd unknown /proc/71670/task/71682/root (readlink: Permission denied) 2024-09-19T08:47:17.360 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71682 io_contex ceph txt unknown /proc/71670/task/71682/exe (readlink: Permission denied) 2024-09-19T08:47:17.360 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71682 io_contex ceph NOFD /proc/71670/task/71682/fd (opendir: Permission denied) 2024-09-19T08:47:17.360 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71683 io_contex ceph cwd unknown /proc/71670/task/71683/cwd (readlink: Permission denied) 2024-09-19T08:47:17.360 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71683 io_contex ceph rtd unknown /proc/71670/task/71683/root (readlink: Permission denied) 2024-09-19T08:47:17.361 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71683 io_contex ceph txt unknown /proc/71670/task/71683/exe (readlink: Permission denied) 2024-09-19T08:47:17.361 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71683 io_contex ceph NOFD /proc/71670/task/71683/fd (opendir: Permission denied) 2024-09-19T08:47:17.361 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71684 ms_dispat ceph cwd unknown /proc/71670/task/71684/cwd (readlink: Permission denied) 2024-09-19T08:47:17.361 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71684 ms_dispat ceph rtd unknown /proc/71670/task/71684/root (readlink: Permission denied) 2024-09-19T08:47:17.361 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71684 ms_dispat ceph txt unknown /proc/71670/task/71684/exe (readlink: Permission denied) 2024-09-19T08:47:17.361 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71684 ms_dispat ceph NOFD /proc/71670/task/71684/fd (opendir: Permission denied) 2024-09-19T08:47:17.361 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71685 ms_local ceph cwd unknown /proc/71670/task/71685/cwd (readlink: Permission denied) 2024-09-19T08:47:17.361 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71685 ms_local ceph rtd unknown /proc/71670/task/71685/root (readlink: Permission denied) 2024-09-19T08:47:17.361 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71685 ms_local ceph txt unknown /proc/71670/task/71685/exe (readlink: Permission denied) 2024-09-19T08:47:17.361 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71685 ms_local ceph NOFD /proc/71670/task/71685/fd (opendir: Permission denied) 2024-09-19T08:47:17.361 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71686 safe_time ceph cwd unknown /proc/71670/task/71686/cwd (readlink: Permission denied) 2024-09-19T08:47:17.361 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71686 safe_time ceph rtd unknown /proc/71670/task/71686/root (readlink: Permission denied) 2024-09-19T08:47:17.362 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71686 safe_time ceph txt unknown /proc/71670/task/71686/exe (readlink: Permission denied) 2024-09-19T08:47:17.362 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71686 safe_time ceph NOFD /proc/71670/task/71686/fd (opendir: Permission denied) 2024-09-19T08:47:17.362 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71687 safe_time ceph cwd unknown /proc/71670/task/71687/cwd (readlink: Permission denied) 2024-09-19T08:47:17.362 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71687 safe_time ceph rtd unknown /proc/71670/task/71687/root (readlink: Permission denied) 2024-09-19T08:47:17.362 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71687 safe_time ceph txt unknown /proc/71670/task/71687/exe (readlink: Permission denied) 2024-09-19T08:47:17.362 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71687 safe_time ceph NOFD /proc/71670/task/71687/fd (opendir: Permission denied) 2024-09-19T08:47:17.362 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71688 ceph-mds ceph cwd unknown /proc/71670/task/71688/cwd (readlink: Permission denied) 2024-09-19T08:47:17.362 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71688 ceph-mds ceph rtd unknown /proc/71670/task/71688/root (readlink: Permission denied) 2024-09-19T08:47:17.362 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71688 ceph-mds ceph txt unknown /proc/71670/task/71688/exe (readlink: Permission denied) 2024-09-19T08:47:17.362 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71688 ceph-mds ceph NOFD /proc/71670/task/71688/fd (opendir: Permission denied) 2024-09-19T08:47:17.362 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71693 safe_time ceph cwd unknown /proc/71670/task/71693/cwd (readlink: Permission denied) 2024-09-19T08:47:17.362 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71693 safe_time ceph rtd unknown /proc/71670/task/71693/root (readlink: Permission denied) 2024-09-19T08:47:17.362 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71693 safe_time ceph txt unknown /proc/71670/task/71693/exe (readlink: Permission denied) 2024-09-19T08:47:17.363 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 71670 71693 safe_time ceph NOFD /proc/71670/task/71693/fd (opendir: Permission denied) 2024-09-19T08:47:17.363 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 72440 root cwd unknown /proc/72440/cwd (readlink: Permission denied) 2024-09-19T08:47:17.363 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 72440 root rtd unknown /proc/72440/root (readlink: Permission denied) 2024-09-19T08:47:17.363 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 72440 root txt unknown /proc/72440/exe (readlink: Permission denied) 2024-09-19T08:47:17.363 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 72440 root NOFD /proc/72440/fd (opendir: Permission denied) 2024-09-19T08:47:17.363 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 72442 root cwd unknown /proc/72442/cwd (readlink: Permission denied) 2024-09-19T08:47:17.363 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 72442 root rtd unknown /proc/72442/root (readlink: Permission denied) 2024-09-19T08:47:17.363 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 72442 root txt unknown /proc/72442/exe (readlink: Permission denied) 2024-09-19T08:47:17.363 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 72442 root NOFD /proc/72442/fd (opendir: Permission denied) 2024-09-19T08:47:17.363 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 ceph cwd unknown /proc/72449/cwd (readlink: Permission denied) 2024-09-19T08:47:17.363 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 ceph rtd unknown /proc/72449/root (readlink: Permission denied) 2024-09-19T08:47:17.363 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 ceph txt unknown /proc/72449/exe (readlink: Permission denied) 2024-09-19T08:47:17.363 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 ceph NOFD /proc/72449/fd (opendir: Permission denied) 2024-09-19T08:47:17.363 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72450 log ceph cwd unknown /proc/72449/task/72450/cwd (readlink: Permission denied) 2024-09-19T08:47:17.364 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72450 log ceph rtd unknown /proc/72449/task/72450/root (readlink: Permission denied) 2024-09-19T08:47:17.364 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72450 log ceph txt unknown /proc/72449/task/72450/exe (readlink: Permission denied) 2024-09-19T08:47:17.364 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72450 log ceph NOFD /proc/72449/task/72450/fd (opendir: Permission denied) 2024-09-19T08:47:17.364 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72452 msgr-work ceph cwd unknown /proc/72449/task/72452/cwd (readlink: Permission denied) 2024-09-19T08:47:17.364 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72452 msgr-work ceph rtd unknown /proc/72449/task/72452/root (readlink: Permission denied) 2024-09-19T08:47:17.364 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72452 msgr-work ceph txt unknown /proc/72449/task/72452/exe (readlink: Permission denied) 2024-09-19T08:47:17.364 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72452 msgr-work ceph NOFD /proc/72449/task/72452/fd (opendir: Permission denied) 2024-09-19T08:47:17.364 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72453 msgr-work ceph cwd unknown /proc/72449/task/72453/cwd (readlink: Permission denied) 2024-09-19T08:47:17.364 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72453 msgr-work ceph rtd unknown /proc/72449/task/72453/root (readlink: Permission denied) 2024-09-19T08:47:17.364 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72453 msgr-work ceph txt unknown /proc/72449/task/72453/exe (readlink: Permission denied) 2024-09-19T08:47:17.364 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72453 msgr-work ceph NOFD /proc/72449/task/72453/fd (opendir: Permission denied) 2024-09-19T08:47:17.364 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72454 msgr-work ceph cwd unknown /proc/72449/task/72454/cwd (readlink: Permission denied) 2024-09-19T08:47:17.364 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72454 msgr-work ceph rtd unknown /proc/72449/task/72454/root (readlink: Permission denied) 2024-09-19T08:47:17.364 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72454 msgr-work ceph txt unknown /proc/72449/task/72454/exe (readlink: Permission denied) 2024-09-19T08:47:17.365 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72454 msgr-work ceph NOFD /proc/72449/task/72454/fd (opendir: Permission denied) 2024-09-19T08:47:17.365 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72458 service ceph cwd unknown /proc/72449/task/72458/cwd (readlink: Permission denied) 2024-09-19T08:47:17.365 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72458 service ceph rtd unknown /proc/72449/task/72458/root (readlink: Permission denied) 2024-09-19T08:47:17.365 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72458 service ceph txt unknown /proc/72449/task/72458/exe (readlink: Permission denied) 2024-09-19T08:47:17.365 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72458 service ceph NOFD /proc/72449/task/72458/fd (opendir: Permission denied) 2024-09-19T08:47:17.365 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72459 admin_soc ceph cwd unknown /proc/72449/task/72459/cwd (readlink: Permission denied) 2024-09-19T08:47:17.365 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72459 admin_soc ceph rtd unknown /proc/72449/task/72459/root (readlink: Permission denied) 2024-09-19T08:47:17.365 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72459 admin_soc ceph txt unknown /proc/72449/task/72459/exe (readlink: Permission denied) 2024-09-19T08:47:17.365 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72459 admin_soc ceph NOFD /proc/72449/task/72459/fd (opendir: Permission denied) 2024-09-19T08:47:17.365 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72460 signal_ha ceph cwd unknown /proc/72449/task/72460/cwd (readlink: Permission denied) 2024-09-19T08:47:17.365 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72460 signal_ha ceph rtd unknown /proc/72449/task/72460/root (readlink: Permission denied) 2024-09-19T08:47:17.365 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72460 signal_ha ceph txt unknown /proc/72449/task/72460/exe (readlink: Permission denied) 2024-09-19T08:47:17.365 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72460 signal_ha ceph NOFD /proc/72449/task/72460/fd (opendir: Permission denied) 2024-09-19T08:47:17.365 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72461 io_contex ceph cwd unknown /proc/72449/task/72461/cwd (readlink: Permission denied) 2024-09-19T08:47:17.366 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72461 io_contex ceph rtd unknown /proc/72449/task/72461/root (readlink: Permission denied) 2024-09-19T08:47:17.366 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72461 io_contex ceph txt unknown /proc/72449/task/72461/exe (readlink: Permission denied) 2024-09-19T08:47:17.366 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72461 io_contex ceph NOFD /proc/72449/task/72461/fd (opendir: Permission denied) 2024-09-19T08:47:17.366 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72462 io_contex ceph cwd unknown /proc/72449/task/72462/cwd (readlink: Permission denied) 2024-09-19T08:47:17.366 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72462 io_contex ceph rtd unknown /proc/72449/task/72462/root (readlink: Permission denied) 2024-09-19T08:47:17.366 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72462 io_contex ceph txt unknown /proc/72449/task/72462/exe (readlink: Permission denied) 2024-09-19T08:47:17.366 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72462 io_contex ceph NOFD /proc/72449/task/72462/fd (opendir: Permission denied) 2024-09-19T08:47:17.366 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72463 ms_dispat ceph cwd unknown /proc/72449/task/72463/cwd (readlink: Permission denied) 2024-09-19T08:47:17.366 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72463 ms_dispat ceph rtd unknown /proc/72449/task/72463/root (readlink: Permission denied) 2024-09-19T08:47:17.366 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72463 ms_dispat ceph txt unknown /proc/72449/task/72463/exe (readlink: Permission denied) 2024-09-19T08:47:17.366 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72463 ms_dispat ceph NOFD /proc/72449/task/72463/fd (opendir: Permission denied) 2024-09-19T08:47:17.366 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72464 ms_local ceph cwd unknown /proc/72449/task/72464/cwd (readlink: Permission denied) 2024-09-19T08:47:17.366 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72464 ms_local ceph rtd unknown /proc/72449/task/72464/root (readlink: Permission denied) 2024-09-19T08:47:17.367 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72464 ms_local ceph txt unknown /proc/72449/task/72464/exe (readlink: Permission denied) 2024-09-19T08:47:17.367 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72464 ms_local ceph NOFD /proc/72449/task/72464/fd (opendir: Permission denied) 2024-09-19T08:47:17.367 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72465 safe_time ceph cwd unknown /proc/72449/task/72465/cwd (readlink: Permission denied) 2024-09-19T08:47:17.367 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72465 safe_time ceph rtd unknown /proc/72449/task/72465/root (readlink: Permission denied) 2024-09-19T08:47:17.367 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72465 safe_time ceph txt unknown /proc/72449/task/72465/exe (readlink: Permission denied) 2024-09-19T08:47:17.367 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72465 safe_time ceph NOFD /proc/72449/task/72465/fd (opendir: Permission denied) 2024-09-19T08:47:17.367 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72466 safe_time ceph cwd unknown /proc/72449/task/72466/cwd (readlink: Permission denied) 2024-09-19T08:47:17.367 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72466 safe_time ceph rtd unknown /proc/72449/task/72466/root (readlink: Permission denied) 2024-09-19T08:47:17.367 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72466 safe_time ceph txt unknown /proc/72449/task/72466/exe (readlink: Permission denied) 2024-09-19T08:47:17.367 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72466 safe_time ceph NOFD /proc/72449/task/72466/fd (opendir: Permission denied) 2024-09-19T08:47:17.367 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72467 ceph-mds ceph cwd unknown /proc/72449/task/72467/cwd (readlink: Permission denied) 2024-09-19T08:47:17.367 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72467 ceph-mds ceph rtd unknown /proc/72449/task/72467/root (readlink: Permission denied) 2024-09-19T08:47:17.367 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72467 ceph-mds ceph txt unknown /proc/72449/task/72467/exe (readlink: Permission denied) 2024-09-19T08:47:17.367 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72467 ceph-mds ceph NOFD /proc/72449/task/72467/fd (opendir: Permission denied) 2024-09-19T08:47:17.368 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72610 safe_time ceph cwd unknown /proc/72449/task/72610/cwd (readlink: Permission denied) 2024-09-19T08:47:17.368 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72610 safe_time ceph rtd unknown /proc/72449/task/72610/root (readlink: Permission denied) 2024-09-19T08:47:17.368 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72610 safe_time ceph txt unknown /proc/72449/task/72610/exe (readlink: Permission denied) 2024-09-19T08:47:17.368 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72449 72610 safe_time ceph NOFD /proc/72449/task/72610/fd (opendir: Permission denied) 2024-09-19T08:47:17.368 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 72780 root cwd unknown /proc/72780/cwd (readlink: Permission denied) 2024-09-19T08:47:17.368 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 72780 root rtd unknown /proc/72780/root (readlink: Permission denied) 2024-09-19T08:47:17.368 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 72780 root txt unknown /proc/72780/exe (readlink: Permission denied) 2024-09-19T08:47:17.368 INFO:tasks.workunit.client.0.smithi007.stdout:conmon 72780 root NOFD /proc/72780/fd (opendir: Permission denied) 2024-09-19T08:47:17.368 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 72782 root cwd unknown /proc/72782/cwd (readlink: Permission denied) 2024-09-19T08:47:17.368 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 72782 root rtd unknown /proc/72782/root (readlink: Permission denied) 2024-09-19T08:47:17.368 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 72782 root txt unknown /proc/72782/exe (readlink: Permission denied) 2024-09-19T08:47:17.368 INFO:tasks.workunit.client.0.smithi007.stdout:podman-in 72782 root NOFD /proc/72782/fd (opendir: Permission denied) 2024-09-19T08:47:17.368 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 ceph cwd unknown /proc/72797/cwd (readlink: Permission denied) 2024-09-19T08:47:17.369 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 ceph rtd unknown /proc/72797/root (readlink: Permission denied) 2024-09-19T08:47:17.369 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 ceph txt unknown /proc/72797/exe (readlink: Permission denied) 2024-09-19T08:47:17.369 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 ceph NOFD /proc/72797/fd (opendir: Permission denied) 2024-09-19T08:47:17.369 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72798 log ceph cwd unknown /proc/72797/task/72798/cwd (readlink: Permission denied) 2024-09-19T08:47:17.369 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72798 log ceph rtd unknown /proc/72797/task/72798/root (readlink: Permission denied) 2024-09-19T08:47:17.369 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72798 log ceph txt unknown /proc/72797/task/72798/exe (readlink: Permission denied) 2024-09-19T08:47:17.369 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72798 log ceph NOFD /proc/72797/task/72798/fd (opendir: Permission denied) 2024-09-19T08:47:17.369 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72800 msgr-work ceph cwd unknown /proc/72797/task/72800/cwd (readlink: Permission denied) 2024-09-19T08:47:17.369 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72800 msgr-work ceph rtd unknown /proc/72797/task/72800/root (readlink: Permission denied) 2024-09-19T08:47:17.369 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72800 msgr-work ceph txt unknown /proc/72797/task/72800/exe (readlink: Permission denied) 2024-09-19T08:47:17.369 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72800 msgr-work ceph NOFD /proc/72797/task/72800/fd (opendir: Permission denied) 2024-09-19T08:47:17.369 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72801 msgr-work ceph cwd unknown /proc/72797/task/72801/cwd (readlink: Permission denied) 2024-09-19T08:47:17.369 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72801 msgr-work ceph rtd unknown /proc/72797/task/72801/root (readlink: Permission denied) 2024-09-19T08:47:17.369 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72801 msgr-work ceph txt unknown /proc/72797/task/72801/exe (readlink: Permission denied) 2024-09-19T08:47:17.370 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72801 msgr-work ceph NOFD /proc/72797/task/72801/fd (opendir: Permission denied) 2024-09-19T08:47:17.370 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72802 msgr-work ceph cwd unknown /proc/72797/task/72802/cwd (readlink: Permission denied) 2024-09-19T08:47:17.370 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72802 msgr-work ceph rtd unknown /proc/72797/task/72802/root (readlink: Permission denied) 2024-09-19T08:47:17.370 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72802 msgr-work ceph txt unknown /proc/72797/task/72802/exe (readlink: Permission denied) 2024-09-19T08:47:17.370 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72802 msgr-work ceph NOFD /proc/72797/task/72802/fd (opendir: Permission denied) 2024-09-19T08:47:17.370 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72806 service ceph cwd unknown /proc/72797/task/72806/cwd (readlink: Permission denied) 2024-09-19T08:47:17.370 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72806 service ceph rtd unknown /proc/72797/task/72806/root (readlink: Permission denied) 2024-09-19T08:47:17.370 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72806 service ceph txt unknown /proc/72797/task/72806/exe (readlink: Permission denied) 2024-09-19T08:47:17.370 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72806 service ceph NOFD /proc/72797/task/72806/fd (opendir: Permission denied) 2024-09-19T08:47:17.370 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72807 admin_soc ceph cwd unknown /proc/72797/task/72807/cwd (readlink: Permission denied) 2024-09-19T08:47:17.370 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72807 admin_soc ceph rtd unknown /proc/72797/task/72807/root (readlink: Permission denied) 2024-09-19T08:47:17.370 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72807 admin_soc ceph txt unknown /proc/72797/task/72807/exe (readlink: Permission denied) 2024-09-19T08:47:17.370 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72807 admin_soc ceph NOFD /proc/72797/task/72807/fd (opendir: Permission denied) 2024-09-19T08:47:17.371 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72808 signal_ha ceph cwd unknown /proc/72797/task/72808/cwd (readlink: Permission denied) 2024-09-19T08:47:17.371 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72808 signal_ha ceph rtd unknown /proc/72797/task/72808/root (readlink: Permission denied) 2024-09-19T08:47:17.371 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72808 signal_ha ceph txt unknown /proc/72797/task/72808/exe (readlink: Permission denied) 2024-09-19T08:47:17.371 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72808 signal_ha ceph NOFD /proc/72797/task/72808/fd (opendir: Permission denied) 2024-09-19T08:47:17.371 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72809 io_contex ceph cwd unknown /proc/72797/task/72809/cwd (readlink: Permission denied) 2024-09-19T08:47:17.371 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72809 io_contex ceph rtd unknown /proc/72797/task/72809/root (readlink: Permission denied) 2024-09-19T08:47:17.371 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72809 io_contex ceph txt unknown /proc/72797/task/72809/exe (readlink: Permission denied) 2024-09-19T08:47:17.371 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72809 io_contex ceph NOFD /proc/72797/task/72809/fd (opendir: Permission denied) 2024-09-19T08:47:17.371 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72810 io_contex ceph cwd unknown /proc/72797/task/72810/cwd (readlink: Permission denied) 2024-09-19T08:47:17.371 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72810 io_contex ceph rtd unknown /proc/72797/task/72810/root (readlink: Permission denied) 2024-09-19T08:47:17.371 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72810 io_contex ceph txt unknown /proc/72797/task/72810/exe (readlink: Permission denied) 2024-09-19T08:47:17.371 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72810 io_contex ceph NOFD /proc/72797/task/72810/fd (opendir: Permission denied) 2024-09-19T08:47:17.371 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72811 ms_dispat ceph cwd unknown /proc/72797/task/72811/cwd (readlink: Permission denied) 2024-09-19T08:47:17.371 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72811 ms_dispat ceph rtd unknown /proc/72797/task/72811/root (readlink: Permission denied) 2024-09-19T08:47:17.372 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72811 ms_dispat ceph txt unknown /proc/72797/task/72811/exe (readlink: Permission denied) 2024-09-19T08:47:17.372 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72811 ms_dispat ceph NOFD /proc/72797/task/72811/fd (opendir: Permission denied) 2024-09-19T08:47:17.372 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72812 ms_local ceph cwd unknown /proc/72797/task/72812/cwd (readlink: Permission denied) 2024-09-19T08:47:17.372 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72812 ms_local ceph rtd unknown /proc/72797/task/72812/root (readlink: Permission denied) 2024-09-19T08:47:17.372 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72812 ms_local ceph txt unknown /proc/72797/task/72812/exe (readlink: Permission denied) 2024-09-19T08:47:17.372 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72812 ms_local ceph NOFD /proc/72797/task/72812/fd (opendir: Permission denied) 2024-09-19T08:47:17.372 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72813 safe_time ceph cwd unknown /proc/72797/task/72813/cwd (readlink: Permission denied) 2024-09-19T08:47:17.372 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72813 safe_time ceph rtd unknown /proc/72797/task/72813/root (readlink: Permission denied) 2024-09-19T08:47:17.372 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72813 safe_time ceph txt unknown /proc/72797/task/72813/exe (readlink: Permission denied) 2024-09-19T08:47:17.372 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72813 safe_time ceph NOFD /proc/72797/task/72813/fd (opendir: Permission denied) 2024-09-19T08:47:17.372 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72814 safe_time ceph cwd unknown /proc/72797/task/72814/cwd (readlink: Permission denied) 2024-09-19T08:47:17.372 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72814 safe_time ceph rtd unknown /proc/72797/task/72814/root (readlink: Permission denied) 2024-09-19T08:47:17.372 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72814 safe_time ceph txt unknown /proc/72797/task/72814/exe (readlink: Permission denied) 2024-09-19T08:47:17.372 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72814 safe_time ceph NOFD /proc/72797/task/72814/fd (opendir: Permission denied) 2024-09-19T08:47:17.373 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72815 ceph-mds ceph cwd unknown /proc/72797/task/72815/cwd (readlink: Permission denied) 2024-09-19T08:47:17.373 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72815 ceph-mds ceph rtd unknown /proc/72797/task/72815/root (readlink: Permission denied) 2024-09-19T08:47:17.373 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72815 ceph-mds ceph txt unknown /proc/72797/task/72815/exe (readlink: Permission denied) 2024-09-19T08:47:17.373 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72815 ceph-mds ceph NOFD /proc/72797/task/72815/fd (opendir: Permission denied) 2024-09-19T08:47:17.373 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72853 safe_time ceph cwd unknown /proc/72797/task/72853/cwd (readlink: Permission denied) 2024-09-19T08:47:17.373 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72853 safe_time ceph rtd unknown /proc/72797/task/72853/root (readlink: Permission denied) 2024-09-19T08:47:17.373 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72853 safe_time ceph txt unknown /proc/72797/task/72853/exe (readlink: Permission denied) 2024-09-19T08:47:17.373 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 72797 72853 safe_time ceph NOFD /proc/72797/task/72853/fd (opendir: Permission denied) 2024-09-19T08:47:17.373 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 72891 root cwd unknown /proc/72891/cwd (readlink: Permission denied) 2024-09-19T08:47:17.373 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 72891 root rtd unknown /proc/72891/root (readlink: Permission denied) 2024-09-19T08:47:17.373 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 72891 root txt unknown /proc/72891/exe (readlink: Permission denied) 2024-09-19T08:47:17.373 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 72891 root NOFD /proc/72891/fd (opendir: Permission denied) 2024-09-19T08:47:17.373 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 74584 root cwd unknown /proc/74584/cwd (readlink: Permission denied) 2024-09-19T08:47:17.374 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 74584 root rtd unknown /proc/74584/root (readlink: Permission denied) 2024-09-19T08:47:17.374 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 74584 root txt unknown /proc/74584/exe (readlink: Permission denied) 2024-09-19T08:47:17.374 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 74584 root NOFD /proc/74584/fd (opendir: Permission denied) 2024-09-19T08:47:17.374 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 78201 root cwd unknown /proc/78201/cwd (readlink: Permission denied) 2024-09-19T08:47:17.374 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 78201 root rtd unknown /proc/78201/root (readlink: Permission denied) 2024-09-19T08:47:17.374 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 78201 root txt unknown /proc/78201/exe (readlink: Permission denied) 2024-09-19T08:47:17.374 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 78201 root NOFD /proc/78201/fd (opendir: Permission denied) 2024-09-19T08:47:17.374 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 78715 root cwd unknown /proc/78715/cwd (readlink: Permission denied) 2024-09-19T08:47:17.374 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 78715 root rtd unknown /proc/78715/root (readlink: Permission denied) 2024-09-19T08:47:17.374 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 78715 root txt unknown /proc/78715/exe (readlink: Permission denied) 2024-09-19T08:47:17.374 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 78715 root NOFD /proc/78715/fd (opendir: Permission denied) 2024-09-19T08:47:17.374 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 82927 root cwd unknown /proc/82927/cwd (readlink: Permission denied) 2024-09-19T08:47:17.374 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 82927 root rtd unknown /proc/82927/root (readlink: Permission denied) 2024-09-19T08:47:17.375 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 82927 root txt unknown /proc/82927/exe (readlink: Permission denied) 2024-09-19T08:47:17.375 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 82927 root NOFD /proc/82927/fd (opendir: Permission denied) 2024-09-19T08:47:17.375 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 82928 root cwd unknown /proc/82928/cwd (readlink: Permission denied) 2024-09-19T08:47:17.375 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 82928 root rtd unknown /proc/82928/root (readlink: Permission denied) 2024-09-19T08:47:17.375 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 82928 root txt unknown /proc/82928/exe (readlink: Permission denied) 2024-09-19T08:47:17.375 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 82928 root NOFD /proc/82928/fd (opendir: Permission denied) 2024-09-19T08:47:17.375 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 82929 root cwd unknown /proc/82929/cwd (readlink: Permission denied) 2024-09-19T08:47:17.375 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 82929 root rtd unknown /proc/82929/root (readlink: Permission denied) 2024-09-19T08:47:17.375 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 82929 root txt unknown /proc/82929/exe (readlink: Permission denied) 2024-09-19T08:47:17.375 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/R 82929 root NOFD /proc/82929/fd (opendir: Permission denied) 2024-09-19T08:47:17.375 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 83212 root cwd unknown /proc/83212/cwd (readlink: Permission denied) 2024-09-19T08:47:17.375 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 83212 root rtd unknown /proc/83212/root (readlink: Permission denied) 2024-09-19T08:47:17.375 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 83212 root txt unknown /proc/83212/exe (readlink: Permission denied) 2024-09-19T08:47:17.375 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 83212 root NOFD /proc/83212/fd (opendir: Permission denied) 2024-09-19T08:47:17.376 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 83247 root cwd unknown /proc/83247/cwd (readlink: Permission denied) 2024-09-19T08:47:17.376 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 83247 root rtd unknown /proc/83247/root (readlink: Permission denied) 2024-09-19T08:47:17.376 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 83247 root txt unknown /proc/83247/exe (readlink: Permission denied) 2024-09-19T08:47:17.376 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 83247 root NOFD /proc/83247/fd (opendir: Permission denied) 2024-09-19T08:47:17.376 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 84928 root cwd unknown /proc/84928/cwd (readlink: Permission denied) 2024-09-19T08:47:17.376 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 84928 root rtd unknown /proc/84928/root (readlink: Permission denied) 2024-09-19T08:47:17.376 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 84928 root txt unknown /proc/84928/exe (readlink: Permission denied) 2024-09-19T08:47:17.376 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 84928 root NOFD /proc/84928/fd (opendir: Permission denied) 2024-09-19T08:47:17.376 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 88778 root cwd unknown /proc/88778/cwd (readlink: Permission denied) 2024-09-19T08:47:17.376 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 88778 root rtd unknown /proc/88778/root (readlink: Permission denied) 2024-09-19T08:47:17.376 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 88778 root txt unknown /proc/88778/exe (readlink: Permission denied) 2024-09-19T08:47:17.376 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 88778 root NOFD /proc/88778/fd (opendir: Permission denied) 2024-09-19T08:47:17.376 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 89271 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T08:47:17.377 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 89271 ubuntu rtd DIR 8,1 4096 2 / 2024-09-19T08:47:17.377 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 89271 ubuntu txt REG 8,1 41128 11685 /usr/bin/timeout 2024-09-19T08:47:17.377 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 89271 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-19T08:47:17.377 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 89271 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-19T08:47:17.377 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 89271 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-19T08:47:17.377 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 89271 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-19T08:47:17.377 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 89271 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-19T08:47:17.377 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 89271 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-19T08:47:17.377 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 89271 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-19T08:47:17.377 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 89271 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-19T08:47:17.377 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 89271 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-19T08:47:17.377 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 89271 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-19T08:47:17.377 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 89271 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-19T08:47:17.378 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 89271 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-19T08:47:17.378 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 89271 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-19T08:47:17.378 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 89271 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-19T08:47:17.378 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 89271 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-19T08:47:17.378 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 89271 ubuntu 0r FIFO 0,13 0t0 234858 pipe 2024-09-19T08:47:17.378 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 89271 ubuntu 1w FIFO 0,13 0t0 234859 pipe 2024-09-19T08:47:17.378 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 89271 ubuntu 2w FIFO 0,13 0t0 234860 pipe 2024-09-19T08:47:17.378 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 89289 root cwd unknown /proc/89289/cwd (readlink: Permission denied) 2024-09-19T08:47:17.378 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 89289 root rtd unknown /proc/89289/root (readlink: Permission denied) 2024-09-19T08:47:17.378 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 89289 root txt unknown /proc/89289/exe (readlink: Permission denied) 2024-09-19T08:47:17.378 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 89289 root NOFD /proc/89289/fd (opendir: Permission denied) 2024-09-19T08:47:17.378 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T08:47:17.378 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu rtd DIR 8,1 4096 2 / 2024-09-19T08:47:17.379 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu txt REG 8,1 1389072 11254 /usr/bin/bash 2024-09-19T08:47:17.379 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-19T08:47:17.379 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-19T08:47:17.379 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-19T08:47:17.379 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-19T08:47:17.379 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-19T08:47:17.379 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-19T08:47:17.379 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-19T08:47:17.379 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-19T08:47:17.379 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-19T08:47:17.379 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-19T08:47:17.379 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-19T08:47:17.379 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-19T08:47:17.379 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu mem REG 8,1 195080 11252 /usr/lib64/libtinfo.so.6.2 2024-09-19T08:47:17.380 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-19T08:47:17.380 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-19T08:47:17.380 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-19T08:47:17.380 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu 0r FIFO 0,13 0t0 234858 pipe 2024-09-19T08:47:17.380 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu 1w FIFO 0,13 0t0 234859 pipe 2024-09-19T08:47:17.380 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu 2w FIFO 0,13 0t0 234860 pipe 2024-09-19T08:47:17.380 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 90415 ubuntu 255r REG 8,1 207 530946 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-09-19T08:47:17.380 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 90428 root cwd unknown /proc/90428/cwd (readlink: Permission denied) 2024-09-19T08:47:17.380 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 90428 root rtd unknown /proc/90428/root (readlink: Permission denied) 2024-09-19T08:47:17.380 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 90428 root txt unknown /proc/90428/exe (readlink: Permission denied) 2024-09-19T08:47:17.380 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 90428 root NOFD /proc/90428/fd (opendir: Permission denied) 2024-09-19T08:47:17.380 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 90770 root cwd unknown /proc/90770/cwd (readlink: Permission denied) 2024-09-19T08:47:17.380 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 90770 root rtd unknown /proc/90770/root (readlink: Permission denied) 2024-09-19T08:47:17.381 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 90770 root txt unknown /proc/90770/exe (readlink: Permission denied) 2024-09-19T08:47:17.381 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 90770 root NOFD /proc/90770/fd (opendir: Permission denied) 2024-09-19T08:47:17.381 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 90771 root cwd unknown /proc/90771/cwd (readlink: Permission denied) 2024-09-19T08:47:17.381 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 90771 root rtd unknown /proc/90771/root (readlink: Permission denied) 2024-09-19T08:47:17.381 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 90771 root txt unknown /proc/90771/exe (readlink: Permission denied) 2024-09-19T08:47:17.381 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 90771 root NOFD /proc/90771/fd (opendir: Permission denied) 2024-09-19T08:47:17.381 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 92124 root cwd unknown /proc/92124/cwd (readlink: Permission denied) 2024-09-19T08:47:17.381 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 92124 root rtd unknown /proc/92124/root (readlink: Permission denied) 2024-09-19T08:47:17.381 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 92124 root txt unknown /proc/92124/exe (readlink: Permission denied) 2024-09-19T08:47:17.381 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 92124 root NOFD /proc/92124/fd (opendir: Permission denied) 2024-09-19T08:47:17.381 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T08:47:17.381 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu rtd DIR 8,1 4096 2 / 2024-09-19T08:47:17.381 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-09-19T08:47:17.382 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-19T08:47:17.382 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu mem REG 8,1 5436544 2391 /usr/lib64/libcrypto.so.3.2.2 2024-09-19T08:47:17.382 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-09-19T08:47:17.382 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-19T08:47:17.382 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-19T08:47:17.382 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-09-19T08:47:17.382 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-09-19T08:47:17.382 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-09-19T08:47:17.382 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-09-19T08:47:17.382 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-09-19T08:47:17.382 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-09-19T08:47:17.382 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-19T08:47:17.382 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-09-19T08:47:17.383 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-19T08:47:17.383 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-19T08:47:17.383 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-19T08:47:17.383 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu 0r FIFO 0,13 0t0 234858 pipe 2024-09-19T08:47:17.383 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu 1w FIFO 0,13 0t0 234859 pipe 2024-09-19T08:47:17.383 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu 2w FIFO 0,13 0t0 234860 pipe 2024-09-19T08:47:17.383 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu 3r DIR 0,20 0 1 /proc 2024-09-19T08:47:17.383 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu 4r DIR 0,20 0 238340 /proc/92188/fd 2024-09-19T08:47:17.383 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu 5w FIFO 0,13 0t0 238345 pipe 2024-09-19T08:47:17.383 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92188 ubuntu 6r FIFO 0,13 0t0 238346 pipe 2024-09-19T08:47:17.383 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92189 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T08:47:17.383 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92189 ubuntu rtd DIR 8,1 4096 2 / 2024-09-19T08:47:17.383 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92189 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-09-19T08:47:17.383 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92189 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-19T08:47:17.384 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92189 ubuntu mem REG 8,1 5436544 2391 /usr/lib64/libcrypto.so.3.2.2 2024-09-19T08:47:17.384 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92189 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-09-19T08:47:17.384 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92189 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-19T08:47:17.384 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92189 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-19T08:47:17.384 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92189 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-09-19T08:47:17.384 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92189 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-09-19T08:47:17.384 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92189 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-09-19T08:47:17.384 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92189 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-09-19T08:47:17.384 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92189 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-09-19T08:47:17.384 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92189 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-09-19T08:47:17.384 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92189 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-19T08:47:17.384 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92189 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-09-19T08:47:17.385 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92189 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-19T08:47:17.385 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92189 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-19T08:47:17.385 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92189 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-19T08:47:17.385 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92189 ubuntu 4r FIFO 0,13 0t0 238345 pipe 2024-09-19T08:47:17.385 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 92189 ubuntu 7w FIFO 0,13 0t0 238346 pipe 2024-09-19T08:47:17.385 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T08:47:17.386 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T08:47:17.433 INFO:tasks.workunit:Stopping ['suites/fsync-tester.sh'] on client.0... 2024-09-19T08:47:17.434 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T08:47:17.745 DEBUG:teuthology.parallel:result is None 2024-09-19T08:47:17.746 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T08:47:17.780 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T08:47:17.780 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-19T08:47:17.791 INFO:tasks.quiescer:joining Quiescers 2024-09-19T08:47:17.791 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-19T08:47:17.791 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:47:18.073 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:47:18.507 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:18 smithi007 ceph-mon[31221]: pgmap v86: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 22 MiB/s wr, 1.55k op/s 2024-09-19T08:47:18.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.517+0000 7fc521a97640 1 -- 172.21.15.7:0/1865905149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc51c101420 msgr2=0x7fc51c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:18.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.517+0000 7fc521a97640 1 --2- 172.21.15.7:0/1865905149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc51c101420 0x7fc51c10d950 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc514009cd0 tx=0x7fc51402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:47:18.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.517+0000 7fc521a97640 1 -- 172.21.15.7:0/1865905149 shutdown_connections 2024-09-19T08:47:18.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.517+0000 7fc521a97640 1 --2- 172.21.15.7:0/1865905149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc51c101420 0x7fc51c10d950 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:18.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.517+0000 7fc521a97640 1 --2- 172.21.15.7:0/1865905149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc51c100a80 0x7fc51c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:18.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.517+0000 7fc521a97640 1 --2- 172.21.15.7:0/1865905149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc51c106a80 0x7fc51c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:18.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.517+0000 7fc521a97640 1 -- 172.21.15.7:0/1865905149 >> 172.21.15.7:0/1865905149 conn(0x7fc51c0fc7a0 msgr2=0x7fc51c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:18.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.517+0000 7fc521a97640 1 -- 172.21.15.7:0/1865905149 shutdown_connections 2024-09-19T08:47:18.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.517+0000 7fc521a97640 1 -- 172.21.15.7:0/1865905149 wait complete. 2024-09-19T08:47:18.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.518+0000 7fc521a97640 1 Processor -- start 2024-09-19T08:47:18.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.518+0000 7fc521a97640 1 -- start start 2024-09-19T08:47:18.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.518+0000 7fc521a97640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc51c100a80 0x7fc51c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:18.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.518+0000 7fc521a97640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc51c101420 0x7fc51c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:18.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.519+0000 7fc521a97640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc51c106a80 0x7fc51c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:18.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.519+0000 7fc521a97640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc51c110e80 con 0x7fc51c106a80 2024-09-19T08:47:18.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.519+0000 7fc521a97640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc51c110d00 con 0x7fc51c101420 2024-09-19T08:47:18.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.519+0000 7fc521a97640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc51c111000 con 0x7fc51c100a80 2024-09-19T08:47:18.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.519+0000 7fc51bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc51c106a80 0x7fc51c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:18.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.519+0000 7fc51bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc51c106a80 0x7fc51c19cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37620/0 (socket says 172.21.15.7:37620) 2024-09-19T08:47:18.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.519+0000 7fc51bfff640 1 -- 172.21.15.7:0/3735468918 learned_addr learned my addr 172.21.15.7:0/3735468918 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:18.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.519+0000 7fc51b7fe640 1 --2- 172.21.15.7:0/3735468918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc51c100a80 0x7fc51c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:18.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.519+0000 7fc51affd640 1 --2- 172.21.15.7:0/3735468918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc51c101420 0x7fc51c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:18.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.519+0000 7fc51bfff640 1 -- 172.21.15.7:0/3735468918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc51c100a80 msgr2=0x7fc51c198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:18.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.519+0000 7fc51bfff640 1 --2- 172.21.15.7:0/3735468918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc51c100a80 0x7fc51c198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:18.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.519+0000 7fc51bfff640 1 -- 172.21.15.7:0/3735468918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc51c101420 msgr2=0x7fc51c1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:18.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.519+0000 7fc51bfff640 1 --2- 172.21.15.7:0/3735468918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc51c101420 0x7fc51c1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:18.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.519+0000 7fc51bfff640 1 -- 172.21.15.7:0/3735468918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc51c19d410 con 0x7fc51c106a80 2024-09-19T08:47:18.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.519+0000 7fc51bfff640 1 --2- 172.21.15.7:0/3735468918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc51c106a80 0x7fc51c19cd30 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc514005cc0 tx=0x7fc514003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:18.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.519+0000 7fc518ff9640 1 -- 172.21.15.7:0/3735468918 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc514004040 con 0x7fc51c106a80 2024-09-19T08:47:18.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.520+0000 7fc521a97640 1 -- 172.21.15.7:0/3735468918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc51c19d6a0 con 0x7fc51c106a80 2024-09-19T08:47:18.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.520+0000 7fc518ff9640 1 -- 172.21.15.7:0/3735468918 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5140046c0 con 0x7fc51c106a80 2024-09-19T08:47:18.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.520+0000 7fc518ff9640 1 -- 172.21.15.7:0/3735468918 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc514046480 con 0x7fc51c106a80 2024-09-19T08:47:18.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.520+0000 7fc521a97640 1 -- 172.21.15.7:0/3735468918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc51c1a4fe0 con 0x7fc51c106a80 2024-09-19T08:47:18.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.521+0000 7fc521a97640 1 -- 172.21.15.7:0/3735468918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc51c100ee0 con 0x7fc51c106a80 2024-09-19T08:47:18.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.522+0000 7fc518ff9640 1 -- 172.21.15.7:0/3735468918 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fc5140305a0 con 0x7fc51c106a80 2024-09-19T08:47:18.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.523+0000 7fc518ff9640 1 --2- 172.21.15.7:0/3735468918 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc5080a33b0 0x7fc5080a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:18.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.523+0000 7fc518ff9640 1 -- 172.21.15.7:0/3735468918 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fc51402e030 con 0x7fc51c106a80 2024-09-19T08:47:18.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.523+0000 7fc51b7fe640 1 --2- 172.21.15.7:0/3735468918 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc5080a33b0 0x7fc5080a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:18.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.523+0000 7fc51b7fe640 1 --2- 172.21.15.7:0/3735468918 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc5080a33b0 0x7fc5080a5870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc50c005d00 tx=0x7fc50c00b410 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:18.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.526+0000 7fc518ff9640 1 -- 172.21.15.7:0/3735468918 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc51404b060 con 0x7fc51c106a80 2024-09-19T08:47:18.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:18 smithi044 ceph-mon[35072]: pgmap v86: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 22 MiB/s wr, 1.55k op/s 2024-09-19T08:47:18.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:18 smithi175 ceph-mon[35688]: pgmap v86: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 22 MiB/s wr, 1.55k op/s 2024-09-19T08:47:18.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.738+0000 7fc521a97640 1 -- 172.21.15.7:0/3735468918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc51c1a51b0 con 0x7fc51c106a80 2024-09-19T08:47:18.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.739+0000 7fc518ff9640 1 -- 172.21.15.7:0/3735468918 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7fc5140bddd0 con 0x7fc51c106a80 2024-09-19T08:47:18.739 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:47:18.739 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:47:18.739 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:47:18.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.741+0000 7fc521a97640 1 -- 172.21.15.7:0/3735468918 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc5080a33b0 msgr2=0x7fc5080a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:18.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.741+0000 7fc521a97640 1 --2- 172.21.15.7:0/3735468918 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc5080a33b0 0x7fc5080a5870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc50c005d00 tx=0x7fc50c00b410 comp rx=0 tx=0).stop 2024-09-19T08:47:18.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.741+0000 7fc521a97640 1 -- 172.21.15.7:0/3735468918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc51c106a80 msgr2=0x7fc51c19cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:18.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.741+0000 7fc521a97640 1 --2- 172.21.15.7:0/3735468918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc51c106a80 0x7fc51c19cd30 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc514005cc0 tx=0x7fc514003970 comp rx=0 tx=0).stop 2024-09-19T08:47:18.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.741+0000 7fc521a97640 1 -- 172.21.15.7:0/3735468918 shutdown_connections 2024-09-19T08:47:18.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.741+0000 7fc521a97640 1 --2- 172.21.15.7:0/3735468918 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc5080a33b0 0x7fc5080a5870 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:18.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.741+0000 7fc521a97640 1 --2- 172.21.15.7:0/3735468918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc51c106a80 0x7fc51c19cd30 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:18.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.741+0000 7fc521a97640 1 --2- 172.21.15.7:0/3735468918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc51c101420 0x7fc51c1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:18.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.741+0000 7fc521a97640 1 --2- 172.21.15.7:0/3735468918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc51c100a80 0x7fc51c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:18.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.741+0000 7fc521a97640 1 -- 172.21.15.7:0/3735468918 >> 172.21.15.7:0/3735468918 conn(0x7fc51c0fc7a0 msgr2=0x7fc51c06a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:18.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.742+0000 7fc521a97640 1 -- 172.21.15.7:0/3735468918 shutdown_connections 2024-09-19T08:47:18.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:18.742+0000 7fc521a97640 1 -- 172.21.15.7:0/3735468918 wait complete. 2024-09-19T08:47:19.529 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:19 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3735468918' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:47:19.553 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:19 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3735468918' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:47:19.557 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24491 quiesce db --cancel --all' 2024-09-19T08:47:19.558 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24491 quiesce db --cancel --all 2024-09-19T08:47:19.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:19 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3735468918' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:47:19.813 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:47:20.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.260+0000 7f6e9c480640 1 -- 172.21.15.7:0/272358562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e94102d90 msgr2=0x7f6e94103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:20.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.260+0000 7f6e9c480640 1 --2- 172.21.15.7:0/272358562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e94102d90 0x7f6e94103170 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009930 tx=0x7f6e9002a420 comp rx=0 tx=0).stop 2024-09-19T08:47:20.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.260+0000 7f6e9c480640 1 -- 172.21.15.7:0/272358562 shutdown_connections 2024-09-19T08:47:20.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.260+0000 7f6e9c480640 1 --2- 172.21.15.7:0/272358562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e94108290 0x7f6e9410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.260+0000 7f6e9c480640 1 --2- 172.21.15.7:0/272358562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e94103740 0x7f6e94107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.260+0000 7f6e9c480640 1 --2- 172.21.15.7:0/272358562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e94102d90 0x7f6e94103170 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.260+0000 7f6e9c480640 1 -- 172.21.15.7:0/272358562 >> 172.21.15.7:0/272358562 conn(0x7f6e940fc7d0 msgr2=0x7f6e940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:20.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.260+0000 7f6e9c480640 1 -- 172.21.15.7:0/272358562 shutdown_connections 2024-09-19T08:47:20.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.260+0000 7f6e9c480640 1 -- 172.21.15.7:0/272358562 wait complete. 2024-09-19T08:47:20.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.261+0000 7f6e9c480640 1 Processor -- start 2024-09-19T08:47:20.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.261+0000 7f6e9c480640 1 -- start start 2024-09-19T08:47:20.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.261+0000 7f6e9c480640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e94102d90 0x7f6e941009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:20.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.261+0000 7f6e9c480640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e94103740 0x7f6e94100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:20.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.261+0000 7f6e9c480640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e94108290 0x7f6e94101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:20.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.261+0000 7f6e9c480640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6e94112090 con 0x7f6e94108290 2024-09-19T08:47:20.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.261+0000 7f6e9c480640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6e94111f10 con 0x7f6e94103740 2024-09-19T08:47:20.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.261+0000 7f6e9c480640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6e94112210 con 0x7f6e94102d90 2024-09-19T08:47:20.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.261+0000 7f6e9aa1d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e94108290 0x7f6e94101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:20.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.261+0000 7f6e9aa1d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e94108290 0x7f6e94101470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37642/0 (socket says 172.21.15.7:37642) 2024-09-19T08:47:20.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.261+0000 7f6e9aa1d640 1 -- 172.21.15.7:0/1285521905 learned_addr learned my addr 172.21.15.7:0/1285521905 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:20.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.261+0000 7f6e99a1b640 1 --2- 172.21.15.7:0/1285521905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e94103740 0x7f6e94100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:20.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.261+0000 7f6e9a21c640 1 --2- 172.21.15.7:0/1285521905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e94102d90 0x7f6e941009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:20.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.261+0000 7f6e9aa1d640 1 -- 172.21.15.7:0/1285521905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e94102d90 msgr2=0x7f6e941009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:20.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.261+0000 7f6e9aa1d640 1 --2- 172.21.15.7:0/1285521905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e94102d90 0x7f6e941009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.261+0000 7f6e9aa1d640 1 -- 172.21.15.7:0/1285521905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e94103740 msgr2=0x7f6e94100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.261+0000 7f6e9aa1d640 1 --2- 172.21.15.7:0/1285521905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e94103740 0x7f6e94100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.261+0000 7f6e9aa1d640 1 -- 172.21.15.7:0/1285521905 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e941a6a60 con 0x7f6e94108290 2024-09-19T08:47:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.262+0000 7f6e9aa1d640 1 --2- 172.21.15.7:0/1285521905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e94108290 0x7f6e94101470 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00eaa0 tx=0x7f6e8c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.262+0000 7f6e8b7fe640 1 -- 172.21.15.7:0/1285521905 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c00cdb0 con 0x7f6e94108290 2024-09-19T08:47:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.262+0000 7f6e8b7fe640 1 -- 172.21.15.7:0/1285521905 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e8c005020 con 0x7f6e94108290 2024-09-19T08:47:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.262+0000 7f6e8b7fe640 1 -- 172.21.15.7:0/1285521905 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c0116b0 con 0x7f6e94108290 2024-09-19T08:47:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.262+0000 7f6e9c480640 1 -- 172.21.15.7:0/1285521905 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e941a6d50 con 0x7f6e94108290 2024-09-19T08:47:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.262+0000 7f6e9c480640 1 -- 172.21.15.7:0/1285521905 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e941a7290 con 0x7f6e94108290 2024-09-19T08:47:20.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.264+0000 7f6e8b7fe640 1 -- 172.21.15.7:0/1285521905 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f6e8c005560 con 0x7f6e94108290 2024-09-19T08:47:20.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.264+0000 7f6e9e859740 1 Processor -- start 2024-09-19T08:47:20.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.265+0000 7f6e9e859740 1 -- start start 2024-09-19T08:47:20.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.265+0000 7f6e9e859740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b783964a00 0x55b783964de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:20.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.265+0000 7f6e9e859740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b783965320 0x55b78396f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:20.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.265+0000 7f6e9e859740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b78396fbe0 0x55b783971fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:20.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.265+0000 7f6e9e859740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b7838c9200 con 0x55b783964a00 2024-09-19T08:47:20.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.265+0000 7f6e9e859740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b78386fdc0 con 0x55b78396fbe0 2024-09-19T08:47:20.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.265+0000 7f6e9e859740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b7838c51c0 con 0x55b783965320 2024-09-19T08:47:20.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.265+0000 7f6e99a1b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b783964a00 0x55b783964de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:20.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.265+0000 7f6e8b7fe640 1 --2- 172.21.15.7:0/1285521905 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6e800a33b0 0x7f6e800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:20.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.265+0000 7f6e99a1b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b783964a00 0x55b783964de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37646/0 (socket says 172.21.15.7:37646) 2024-09-19T08:47:20.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.265+0000 7f6e99a1b640 1 -- 172.21.15.7:0/3282974378 learned_addr learned my addr 172.21.15.7:0/3282974378 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:20.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.265+0000 7f6e9a21c640 1 --2- 172.21.15.7:0/3282974378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b783965320 0x55b78396f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:20.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.265+0000 7f6e9aa1d640 1 --2- 172.21.15.7:0/1285521905 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6e800a33b0 0x7f6e800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:20.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.265+0000 7f6e99a1b640 1 --2- 172.21.15.7:0/3282974378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b78396fbe0 0x55b783971fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:20.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.265+0000 7f6e8b7fe640 1 -- 172.21.15.7:0/1285521905 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f6e8c0cfed0 con 0x7f6e94108290 2024-09-19T08:47:20.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.265+0000 7f6e99a1b640 1 -- 172.21.15.7:0/3282974378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b783965320 msgr2=0x55b78396f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:20.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.265+0000 7f6e99a1b640 1 --2- 172.21.15.7:0/3282974378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b783965320 0x55b78396f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.266+0000 7f6e99a1b640 1 -- 172.21.15.7:0/3282974378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b78396fbe0 msgr2=0x55b783971fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:20.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.266+0000 7f6e99a1b640 1 --2- 172.21.15.7:0/3282974378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b78396fbe0 0x55b783971fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.266+0000 7f6e99a1b640 1 -- 172.21.15.7:0/3282974378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b78363a620 con 0x55b783964a00 2024-09-19T08:47:20.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.266+0000 7f6e9a21c640 1 --2- 172.21.15.7:0/3282974378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b783965320 0x55b78396f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:47:20.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.266+0000 7f6e99a1b640 1 --2- 172.21.15.7:0/3282974378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b783964a00 0x55b783964de0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400bfd0 tx=0x7f6e8400b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ba4c78deff7f08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:20.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.266+0000 7f6e88ff9640 1 -- 172.21.15.7:0/3282974378 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e84004030 con 0x55b783964a00 2024-09-19T08:47:20.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.266+0000 7f6e9aa1d640 1 --2- 172.21.15.7:0/1285521905 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6e800a33b0 0x7f6e800a5870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c0cd6c0 tx=0x7f6e8c009270 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:20.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.266+0000 7f6e88ff9640 1 -- 172.21.15.7:0/3282974378 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e84005500 con 0x55b783964a00 2024-09-19T08:47:20.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.266+0000 7f6e88ff9640 1 -- 172.21.15.7:0/3282974378 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e84004ca0 con 0x55b783964a00 2024-09-19T08:47:20.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.267+0000 7f6e9e859740 1 -- 172.21.15.7:0/3282974378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b783964a00 msgr2=0x55b783964de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:20.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.267+0000 7f6e9e859740 1 --2- 172.21.15.7:0/3282974378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b783964a00 0x55b783964de0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400bfd0 tx=0x7f6e8400b820 comp rx=0 tx=0).stop 2024-09-19T08:47:20.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.267+0000 7f6e9e859740 1 -- 172.21.15.7:0/3282974378 shutdown_connections 2024-09-19T08:47:20.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.267+0000 7f6e9e859740 1 --2- 172.21.15.7:0/3282974378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b78396fbe0 0x55b783971fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.267+0000 7f6e9e859740 1 --2- 172.21.15.7:0/3282974378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b783965320 0x55b78396f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.267+0000 7f6e9e859740 1 --2- 172.21.15.7:0/3282974378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b783964a00 0x55b783964de0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.267+0000 7f6e9e859740 1 -- 172.21.15.7:0/3282974378 >> 172.21.15.7:0/3282974378 conn(0x55b783960f90 msgr2=0x55b783961370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:20.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.267+0000 7f6e9e859740 1 -- 172.21.15.7:0/3282974378 shutdown_connections 2024-09-19T08:47:20.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.267+0000 7f6e9e859740 1 -- 172.21.15.7:0/3282974378 wait complete. 2024-09-19T08:47:20.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.267+0000 7f6e9e859740 1 -- start start 2024-09-19T08:47:20.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.267+0000 7f6e9e859740 1 Processor -- start 2024-09-19T08:47:20.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.268+0000 7f6e9e859740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b783964a00 0x55b78396f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:20.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.268+0000 7f6e9e859740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b783965320 0x55b78396c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:20.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.268+0000 7f6e9e859740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78396fbe0 0x55b78396ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:20.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.268+0000 7f6e9e859740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b7839727b0 con 0x55b78396fbe0 2024-09-19T08:47:20.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.268+0000 7f6e9e859740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b783863c50 con 0x55b783965320 2024-09-19T08:47:20.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.268+0000 7f6e9e859740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b783972930 con 0x55b783964a00 2024-09-19T08:47:20.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.268+0000 7f6e9e859740 10 client.0 _ll_register_callbacks cb 0x55b783875ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:47:20.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.268+0000 7f6e99a1b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78396fbe0 0x55b78396ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:20.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.268+0000 7f6e99a1b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78396fbe0 0x55b78396ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37662/0 (socket says 172.21.15.7:37662) 2024-09-19T08:47:20.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.268+0000 7f6e99a1b640 1 -- 172.21.15.7:0/2963340259 learned_addr learned my addr 172.21.15.7:0/2963340259 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:20.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.268+0000 7f6e9a21c640 1 --2- 172.21.15.7:0/2963340259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b783965320 0x55b78396c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:20.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.268+0000 7f6e99a1b640 1 --2- 172.21.15.7:0/2963340259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b783964a00 0x55b78396f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:20.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.268+0000 7f6e99a1b640 1 -- 172.21.15.7:0/2963340259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b783964a00 msgr2=0x55b78396f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:20.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.268+0000 7f6e99a1b640 1 --2- 172.21.15.7:0/2963340259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b783964a00 0x55b78396f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.268+0000 7f6e99a1b640 1 -- 172.21.15.7:0/2963340259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b783965320 msgr2=0x55b78396c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:20.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.268+0000 7f6e99a1b640 1 --2- 172.21.15.7:0/2963340259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b783965320 0x55b78396c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.268+0000 7f6e99a1b640 1 -- 172.21.15.7:0/2963340259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b78396d490 con 0x55b78396fbe0 2024-09-19T08:47:20.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.268+0000 7f6e99a1b640 1 --2- 172.21.15.7:0/2963340259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78396fbe0 0x55b78396ccb0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f6e840057a0 tx=0x7f6e840048e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b47f36a945e36b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:20.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.268+0000 7f6e7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:47:20.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.268+0000 7f6e7dffb640 1 -- 172.21.15.7:0/2963340259 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e84004c40 con 0x55b78396fbe0 2024-09-19T08:47:20.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.269+0000 7f6e7dffb640 1 -- 172.21.15.7:0/2963340259 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f6e84004de0 con 0x55b78396fbe0 2024-09-19T08:47:20.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.269+0000 7f6e9e859740 1 -- 172.21.15.7:0/2963340259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e84005500 con 0x55b78396fbe0 2024-09-19T08:47:20.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.269+0000 7f6e7dffb640 1 -- 172.21.15.7:0/2963340259 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6e84031050 con 0x55b78396fbe0 2024-09-19T08:47:20.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.269+0000 7f6e9e859740 10 client.15924 fetch_fsmap learned FSMap version 25 2024-09-19T08:47:20.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.269+0000 7f6e9e859740 1 -- 172.21.15.7:0/2963340259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b78397e310 con 0x55b78396fbe0 2024-09-19T08:47:20.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.269+0000 7f6e7dffb640 1 -- 172.21.15.7:0/2963340259 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e84005500 con 0x55b78396fbe0 2024-09-19T08:47:20.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.269+0000 7f6e7dffb640 1 -- 172.21.15.7:0/2963340259 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6e8401c070 con 0x55b78396fbe0 2024-09-19T08:47:20.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.269+0000 7f6e9e859740 10 client.15924 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:47:20.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.269+0000 7f6e9e859740 10 client.15924 resolve_mds: validated gid 24491 aka daemon mds.b 2024-09-19T08:47:20.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.269+0000 7f6e9e859740 20 client.15924 populate_metadata read hostname 'smithi007' 2024-09-19T08:47:20.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.269+0000 7f6e9e859740 1 --2- 172.21.15.7:0/2963340259 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b78397f6c0 0x55b783981ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:20.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.269+0000 7f6e9e859740 4 client.15924 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:47:20.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.269+0000 7f6e9e859740 1 -- 172.21.15.7:0/2963340259 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7838d6770 con 0x55b78397f6c0 2024-09-19T08:47:20.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.270+0000 7f6e9a21c640 1 --2- 172.21.15.7:0/2963340259 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b78397f6c0 0x55b783981ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:20.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.270+0000 7f6e7dffb640 10 client.15924 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:47:20.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.270+0000 7f6e9a21c640 1 --2- 172.21.15.7:0/2963340259 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b78397f6c0 0x55b783981ab0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52746b41688d2f8 server_cookie=452f405ead9a4461 in_seq=0 out_seq=0 2024-09-19T08:47:20.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.271+0000 7f6e7dffb640 1 -- 172.21.15.7:0/2963340259 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b7838d6770 con 0x55b78397f6c0 2024-09-19T08:47:20.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.271+0000 7f6e7dffb640 10 client.15924 handle_command_reply: tid=0 2024-09-19T08:47:20.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.271+0000 7f6e9e859740 1 client.15924 shutdown 2024-09-19T08:47:20.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.271+0000 7f6e9e859740 1 -- 172.21.15.7:0/2963340259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78396fbe0 msgr2=0x55b78396ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:20.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.271+0000 7f6e9e859740 1 --2- 172.21.15.7:0/2963340259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78396fbe0 0x55b78396ccb0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f6e840057a0 tx=0x7f6e840048e0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.271+0000 7f6e9e859740 1 -- 172.21.15.7:0/2963340259 shutdown_connections 2024-09-19T08:47:20.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.271+0000 7f6e9e859740 1 --2- 172.21.15.7:0/2963340259 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b78397f6c0 0x55b783981ab0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.271+0000 7f6e9e859740 1 --2- 172.21.15.7:0/2963340259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78396fbe0 0x55b78396ccb0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.271+0000 7f6e9e859740 1 --2- 172.21.15.7:0/2963340259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b783965320 0x55b78396c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.271+0000 7f6e9e859740 1 --2- 172.21.15.7:0/2963340259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b783964a00 0x55b78396f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.271+0000 7f6e9e859740 1 -- 172.21.15.7:0/2963340259 >> 172.21.15.7:0/2963340259 conn(0x55b783960f90 msgr2=0x55b7839601d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:20.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.271+0000 7f6e7dffb640 0 client.15924 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:47:20.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.271+0000 7f6e9e859740 1 -- 172.21.15.7:0/2963340259 shutdown_connections 2024-09-19T08:47:20.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.271+0000 7f6e9e859740 1 -- 172.21.15.7:0/2963340259 wait complete. 2024-09-19T08:47:20.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.271+0000 7f6e9e859740 20 client.15924 trim_cache size 0 max 16384 2024-09-19T08:47:20.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.288+0000 7f6e9e859740 1 Processor -- start 2024-09-19T08:47:20.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.288+0000 7f6e9e859740 1 -- start start 2024-09-19T08:47:20.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.289+0000 7f6e9e859740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b783964a00 0x55b783967cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:20.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.289+0000 7f6e9e859740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b783965320 0x55b78396c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:20.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.289+0000 7f6e9e859740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78396fbe0 0x55b78396c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:20.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.289+0000 7f6e9e859740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6e941b23e0 con 0x55b78396fbe0 2024-09-19T08:47:20.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.289+0000 7f6e9e859740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6e941afcb0 con 0x55b783965320 2024-09-19T08:47:20.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.289+0000 7f6e9e859740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6e941adb00 con 0x55b783964a00 2024-09-19T08:47:20.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.289+0000 7f6e99a1b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78396fbe0 0x55b78396c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:20.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.289+0000 7f6e99a1b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78396fbe0 0x55b78396c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37674/0 (socket says 172.21.15.7:37674) 2024-09-19T08:47:20.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.289+0000 7f6e9a21c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b783965320 0x55b78396c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:20.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.289+0000 7f6e99a1b640 1 -- 172.21.15.7:0/4050091796 learned_addr learned my addr 172.21.15.7:0/4050091796 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:20.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.289+0000 7f6e99a1b640 1 --2- 172.21.15.7:0/4050091796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b783964a00 0x55b783967cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:20.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.289+0000 7f6e99a1b640 1 -- 172.21.15.7:0/4050091796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b783964a00 msgr2=0x55b783967cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:20.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.289+0000 7f6e99a1b640 1 --2- 172.21.15.7:0/4050091796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b783964a00 0x55b783967cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.289+0000 7f6e99a1b640 1 -- 172.21.15.7:0/4050091796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b783965320 msgr2=0x55b78396c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:20.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.289+0000 7f6e99a1b640 1 --2- 172.21.15.7:0/4050091796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b783965320 0x55b78396c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.289+0000 7f6e99a1b640 1 -- 172.21.15.7:0/4050091796 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b783960dc0 con 0x55b78396fbe0 2024-09-19T08:47:20.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.289+0000 7f6e9a21c640 1 --2- 172.21.15.7:0/4050091796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b783965320 0x55b78396c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:47:20.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.289+0000 7f6e99a1b640 1 --2- 172.21.15.7:0/4050091796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78396fbe0 0x55b78396c070 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400b620 tx=0x7f6e840058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8cdd5b7fff2518 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:20.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.290+0000 7f6e7ffff640 1 -- 172.21.15.7:0/4050091796 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8400b770 con 0x55b78396fbe0 2024-09-19T08:47:20.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.290+0000 7f6e7ffff640 1 -- 172.21.15.7:0/4050091796 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e84023070 con 0x55b78396fbe0 2024-09-19T08:47:20.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.290+0000 7f6e7ffff640 1 -- 172.21.15.7:0/4050091796 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8400fe20 con 0x55b78396fbe0 2024-09-19T08:47:20.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.291+0000 7f6e9e859740 1 -- 172.21.15.7:0/4050091796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78396fbe0 msgr2=0x55b78396c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:20.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.291+0000 7f6e9e859740 1 --2- 172.21.15.7:0/4050091796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78396fbe0 0x55b78396c070 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400b620 tx=0x7f6e840058d0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.291+0000 7f6e9e859740 1 -- 172.21.15.7:0/4050091796 shutdown_connections 2024-09-19T08:47:20.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.291+0000 7f6e9e859740 1 --2- 172.21.15.7:0/4050091796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b78396fbe0 0x55b78396c070 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.291+0000 7f6e9e859740 1 --2- 172.21.15.7:0/4050091796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b783965320 0x55b78396c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.291+0000 7f6e9e859740 1 --2- 172.21.15.7:0/4050091796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b783964a00 0x55b783967cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.291+0000 7f6e9e859740 1 -- 172.21.15.7:0/4050091796 >> 172.21.15.7:0/4050091796 conn(0x55b783960f90 msgr2=0x55b78396e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:20.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.291+0000 7f6e9e859740 1 -- 172.21.15.7:0/4050091796 shutdown_connections 2024-09-19T08:47:20.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.291+0000 7f6e9e859740 1 -- 172.21.15.7:0/4050091796 wait complete. 2024-09-19T08:47:20.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.292+0000 7f6e9e859740 1 -- start start 2024-09-19T08:47:20.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.292+0000 7f6e9e859740 1 Processor -- start 2024-09-19T08:47:20.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.292+0000 7f6e9e859740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b783964a00 0x55b78396a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:20.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.292+0000 7f6e9e859740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b783965320 0x55b783968a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:20.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.292+0000 7f6e9e859740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b78396fbe0 0x55b783969060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:20.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.292+0000 7f6e9e859740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6e941ae170 con 0x55b783964a00 2024-09-19T08:47:20.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.292+0000 7f6e9e859740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6e941af5e0 con 0x55b783965320 2024-09-19T08:47:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.292+0000 7f6e9e859740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6e941ae840 con 0x55b78396fbe0 2024-09-19T08:47:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.292+0000 7f6e9e859740 10 client.0 _ll_register_callbacks cb 0x7f6e840056b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:47:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.292+0000 7f6e99a1b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b783964a00 0x55b78396a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.292+0000 7f6e99a1b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b783964a00 0x55b78396a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37678/0 (socket says 172.21.15.7:37678) 2024-09-19T08:47:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.292+0000 7f6e99a1b640 1 -- 172.21.15.7:0/2987575404 learned_addr learned my addr 172.21.15.7:0/2987575404 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.292+0000 7f6e9a21c640 1 --2- 172.21.15.7:0/2987575404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b783965320 0x55b783968a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.292+0000 7f6e99a1b640 1 --2- 172.21.15.7:0/2987575404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b78396fbe0 0x55b783969060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.292+0000 7f6e99a1b640 1 -- 172.21.15.7:0/2987575404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b78396fbe0 msgr2=0x55b783969060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.292+0000 7f6e99a1b640 1 --2- 172.21.15.7:0/2987575404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b78396fbe0 0x55b783969060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.292+0000 7f6e99a1b640 1 -- 172.21.15.7:0/2987575404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b783965320 msgr2=0x55b783968a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.292+0000 7f6e99a1b640 1 --2- 172.21.15.7:0/2987575404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b783965320 0x55b783968a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.292+0000 7f6e99a1b640 1 -- 172.21.15.7:0/2987575404 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7839e8120 con 0x55b783964a00 2024-09-19T08:47:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.293+0000 7f6e99a1b640 1 --2- 172.21.15.7:0/2987575404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b783964a00 0x55b78396a420 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6e84010d70 tx=0x7f6e8400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ba87999b521a2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.293+0000 7f6e7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:47:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.293+0000 7f6e7dffb640 1 -- 172.21.15.7:0/2987575404 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8403c040 con 0x55b783964a00 2024-09-19T08:47:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.293+0000 7f6e7dffb640 1 -- 172.21.15.7:0/2987575404 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f6e8400faa0 con 0x55b783964a00 2024-09-19T08:47:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.293+0000 7f6e9e859740 1 -- 172.21.15.7:0/2987575404 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e84023070 con 0x55b783964a00 2024-09-19T08:47:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.293+0000 7f6e7dffb640 1 -- 172.21.15.7:0/2987575404 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6e8400f750 con 0x55b783964a00 2024-09-19T08:47:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.293+0000 7f6e9e859740 10 client.15930 fetch_fsmap learned FSMap version 25 2024-09-19T08:47:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.293+0000 7f6e9e859740 1 -- 172.21.15.7:0/2987575404 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b7839e9280 con 0x55b783964a00 2024-09-19T08:47:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.293+0000 7f6e7dffb640 1 -- 172.21.15.7:0/2987575404 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e84023070 con 0x55b783964a00 2024-09-19T08:47:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.293+0000 7f6e7dffb640 1 -- 172.21.15.7:0/2987575404 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6e84042030 con 0x55b783964a00 2024-09-19T08:47:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.293+0000 7f6e9e859740 10 client.15930 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:47:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.293+0000 7f6e9e859740 10 client.15930 resolve_mds: validated gid 24491 aka daemon mds.b 2024-09-19T08:47:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.293+0000 7f6e9e859740 20 client.15930 populate_metadata read hostname 'smithi007' 2024-09-19T08:47:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.293+0000 7f6e9e859740 1 --2- 172.21.15.7:0/2987575404 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b7839e9900 0x55b7839ebcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.293+0000 7f6e9e859740 4 client.15930 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-19T08:47:20.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.293+0000 7f6e9e859740 1 -- 172.21.15.7:0/2987575404 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55b7838d0c80 con 0x55b7839e9900 2024-09-19T08:47:20.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.294+0000 7f6e9a21c640 1 --2- 172.21.15.7:0/2987575404 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b7839e9900 0x55b7839ebcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:20.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.294+0000 7f6e9a21c640 1 --2- 172.21.15.7:0/2987575404 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b7839e9900 0x55b7839ebcf0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=931852b1775b1e3c server_cookie=425825f8c8ea6dfb in_seq=0 out_seq=0 2024-09-19T08:47:20.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.294+0000 7f6e7dffb640 10 client.15930 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:47:20.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.294+0000 7f6e7dffb640 1 -- 172.21.15.7:0/2987575404 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55b7838d0c80 con 0x55b7839e9900 2024-09-19T08:47:20.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.294+0000 7f6e7dffb640 10 client.15930 handle_command_reply: tid=0 2024-09-19T08:47:20.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.294+0000 7f6e9e859740 1 client.15930 shutdown 2024-09-19T08:47:20.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.295+0000 7f6e9e859740 1 -- 172.21.15.7:0/2987575404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b783964a00 msgr2=0x55b78396a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:20.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.295+0000 7f6e9e859740 1 --2- 172.21.15.7:0/2987575404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b783964a00 0x55b78396a420 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6e84010d70 tx=0x7f6e8400fa00 comp rx=0 tx=0).stop 2024-09-19T08:47:20.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.295+0000 7f6e9e859740 1 -- 172.21.15.7:0/2987575404 shutdown_connections 2024-09-19T08:47:20.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.295+0000 7f6e9e859740 1 --2- 172.21.15.7:0/2987575404 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b7839e9900 0x55b7839ebcf0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.295+0000 7f6e9e859740 1 --2- 172.21.15.7:0/2987575404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b78396fbe0 0x55b783969060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.295+0000 7f6e9e859740 1 --2- 172.21.15.7:0/2987575404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b783965320 0x55b783968a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.295+0000 7f6e9e859740 1 --2- 172.21.15.7:0/2987575404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b783964a00 0x55b78396a420 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.295+0000 7f6e7dffb640 0 client.15930 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:47:20.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.295+0000 7f6e9e859740 1 -- 172.21.15.7:0/2987575404 >> 172.21.15.7:0/2987575404 conn(0x55b783960f90 msgr2=0x55b78395f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:20.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.295+0000 7f6e9e859740 1 -- 172.21.15.7:0/2987575404 shutdown_connections 2024-09-19T08:47:20.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.295+0000 7f6e9e859740 1 -- 172.21.15.7:0/2987575404 wait complete. 2024-09-19T08:47:20.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.295+0000 7f6e9e859740 20 client.15930 trim_cache size 0 max 16384 2024-09-19T08:47:20.299 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:47:20.300 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 25, 2024-09-19T08:47:20.300 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24491, 2024-09-19T08:47:20.300 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 12, 2024-09-19T08:47:20.300 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": {} 2024-09-19T08:47:20.300 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:47:20.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.295+0000 7f6e9c480640 1 -- 172.21.15.7:0/1285521905 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6e800a33b0 msgr2=0x7f6e800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:20.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.295+0000 7f6e9c480640 1 --2- 172.21.15.7:0/1285521905 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6e800a33b0 0x7f6e800a5870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c0cd6c0 tx=0x7f6e8c009270 comp rx=0 tx=0).stop 2024-09-19T08:47:20.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.295+0000 7f6e9c480640 1 -- 172.21.15.7:0/1285521905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e94108290 msgr2=0x7f6e94101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:20.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.295+0000 7f6e9c480640 1 --2- 172.21.15.7:0/1285521905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e94108290 0x7f6e94101470 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00eaa0 tx=0x7f6e8c00ef60 comp rx=0 tx=0).stop 2024-09-19T08:47:20.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.295+0000 7f6e9c480640 1 -- 172.21.15.7:0/1285521905 shutdown_connections 2024-09-19T08:47:20.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.295+0000 7f6e9c480640 1 --2- 172.21.15.7:0/1285521905 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6e800a33b0 0x7f6e800a5870 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.295+0000 7f6e9c480640 1 --2- 172.21.15.7:0/1285521905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e94108290 0x7f6e94101470 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.295+0000 7f6e9c480640 1 --2- 172.21.15.7:0/1285521905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e94103740 0x7f6e94100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.295+0000 7f6e9c480640 1 --2- 172.21.15.7:0/1285521905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e94102d90 0x7f6e941009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:20.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.295+0000 7f6e9c480640 1 -- 172.21.15.7:0/1285521905 >> 172.21.15.7:0/1285521905 conn(0x7f6e940fc7d0 msgr2=0x7f6e94105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:20.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.296+0000 7f6e9c480640 1 -- 172.21.15.7:0/1285521905 shutdown_connections 2024-09-19T08:47:20.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:20.296+0000 7f6e9c480640 1 -- 172.21.15.7:0/1285521905 wait complete. 2024-09-19T08:47:20.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:20 smithi007 ceph-mon[31221]: pgmap v87: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 1.20k op/s 2024-09-19T08:47:20.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:20 smithi044 ceph-mon[35072]: pgmap v87: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 1.20k op/s 2024-09-19T08:47:20.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:20 smithi175 ceph-mon[35688]: pgmap v87: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 1.20k op/s 2024-09-19T08:47:21.211 INFO:tasks.quiescer:done joining Quiescers 2024-09-19T08:47:21.211 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-19T08:47:21.221 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-19T08:47:21.221 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T08:47:21.221 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-19T08:47:21.222 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-19T08:47:21.253 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-19T08:47:22.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:22 smithi044 ceph-mon[35072]: pgmap v88: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 1.20k op/s 2024-09-19T08:47:22.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:22 smithi175 ceph-mon[35688]: pgmap v88: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 1.20k op/s 2024-09-19T08:47:22.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:22 smithi007 ceph-mon[31221]: pgmap v88: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 1.20k op/s 2024-09-19T08:47:24.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:24 smithi044 ceph-mon[35072]: pgmap v89: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 MiB/s wr, 1.21k op/s 2024-09-19T08:47:24.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:24 smithi175 ceph-mon[35688]: pgmap v89: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 MiB/s wr, 1.21k op/s 2024-09-19T08:47:24.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:24 smithi007 ceph-mon[31221]: pgmap v89: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 MiB/s wr, 1.21k op/s 2024-09-19T08:47:26.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:26 smithi175 ceph-mon[35688]: pgmap v90: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.9 MiB/s wr, 351 op/s 2024-09-19T08:47:26.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:26 smithi007 ceph-mon[31221]: pgmap v90: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.9 MiB/s wr, 351 op/s 2024-09-19T08:47:26.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:26 smithi044 ceph-mon[35072]: pgmap v90: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.9 MiB/s wr, 351 op/s 2024-09-19T08:47:28.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:28 smithi175 ceph-mon[35688]: pgmap v91: 97 pgs: 97 active+clean; 476 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 1.11k op/s 2024-09-19T08:47:28.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:28 smithi007 ceph-mon[31221]: pgmap v91: 97 pgs: 97 active+clean; 476 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 1.11k op/s 2024-09-19T08:47:28.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:28 smithi044 ceph-mon[35072]: pgmap v91: 97 pgs: 97 active+clean; 476 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 20 MiB/s wr, 1.11k op/s 2024-09-19T08:47:29.368 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:47:29.636 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:47:30.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.105+0000 7efda2072640 1 -- 172.21.15.7:0/635404994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd9c10c170 msgr2=0x7efd9c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:30.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.105+0000 7efda2072640 1 --2- 172.21.15.7:0/635404994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd9c10c170 0x7efd9c10e610 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efd94009ca0 tx=0x7efd9402a950 comp rx=0 tx=0).stop 2024-09-19T08:47:30.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.105+0000 7efda2072640 1 -- 172.21.15.7:0/635404994 shutdown_connections 2024-09-19T08:47:30.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.105+0000 7efda2072640 1 --2- 172.21.15.7:0/635404994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd9c10c170 0x7efd9c10e610 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.105+0000 7efda2072640 1 --2- 172.21.15.7:0/635404994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c103660 0x7efd9c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.105+0000 7efda2072640 1 --2- 172.21.15.7:0/635404994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd9c102d40 0x7efd9c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.105+0000 7efda2072640 1 -- 172.21.15.7:0/635404994 >> 172.21.15.7:0/635404994 conn(0x7efd9c0fc7a0 msgr2=0x7efd9c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:30.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.106+0000 7efda2072640 1 -- 172.21.15.7:0/635404994 shutdown_connections 2024-09-19T08:47:30.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.106+0000 7efda2072640 1 -- 172.21.15.7:0/635404994 wait complete. 2024-09-19T08:47:30.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.106+0000 7efda2072640 1 Processor -- start 2024-09-19T08:47:30.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.106+0000 7efda2072640 1 -- start start 2024-09-19T08:47:30.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.107+0000 7efda2072640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c102d40 0x7efd9c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:30.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.107+0000 7efda2072640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd9c103660 0x7efd9c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:30.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.107+0000 7efda2072640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd9c10c170 0x7efd9c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:30.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.107+0000 7efda2072640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c111f70 con 0x7efd9c10c170 2024-09-19T08:47:30.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.107+0000 7efda2072640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c111df0 con 0x7efd9c102d40 2024-09-19T08:47:30.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.107+0000 7efda2072640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c1120f0 con 0x7efd9c103660 2024-09-19T08:47:30.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.107+0000 7efd9bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd9c10c170 0x7efd9c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:30.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.107+0000 7efd9b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c102d40 0x7efd9c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:30.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.107+0000 7efd9bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd9c10c170 0x7efd9c19ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35424/0 (socket says 172.21.15.7:35424) 2024-09-19T08:47:30.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.107+0000 7efd9bfff640 1 -- 172.21.15.7:0/891753879 learned_addr learned my addr 172.21.15.7:0/891753879 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:30.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.107+0000 7efd9affd640 1 --2- 172.21.15.7:0/891753879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd9c103660 0x7efd9c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:30.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.107+0000 7efd9bfff640 1 -- 172.21.15.7:0/891753879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd9c103660 msgr2=0x7efd9c19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:30.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.107+0000 7efd9bfff640 1 --2- 172.21.15.7:0/891753879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd9c103660 0x7efd9c19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.107+0000 7efd9bfff640 1 -- 172.21.15.7:0/891753879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c102d40 msgr2=0x7efd9c19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:30.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.107+0000 7efd9bfff640 1 --2- 172.21.15.7:0/891753879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c102d40 0x7efd9c19a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.107+0000 7efd9bfff640 1 -- 172.21.15.7:0/891753879 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c19f620 con 0x7efd9c10c170 2024-09-19T08:47:30.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.107+0000 7efd9b7fe640 1 --2- 172.21.15.7:0/891753879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c102d40 0x7efd9c19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:47:30.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.108+0000 7efd9bfff640 1 --2- 172.21.15.7:0/891753879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd9c10c170 0x7efd9c19ef40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7efd9402ae70 tx=0x7efd9402f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:30.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.108+0000 7efd98ff9640 1 -- 172.21.15.7:0/891753879 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd94034040 con 0x7efd9c10c170 2024-09-19T08:47:30.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.108+0000 7efda2072640 1 -- 172.21.15.7:0/891753879 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd9c19f8b0 con 0x7efd9c10c170 2024-09-19T08:47:30.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.108+0000 7efd98ff9640 1 -- 172.21.15.7:0/891753879 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd94030920 con 0x7efd9c10c170 2024-09-19T08:47:30.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.108+0000 7efd98ff9640 1 -- 172.21.15.7:0/891753879 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd94045480 con 0x7efd9c10c170 2024-09-19T08:47:30.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.108+0000 7efda2072640 1 -- 172.21.15.7:0/891753879 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd9c1a71f0 con 0x7efd9c10c170 2024-09-19T08:47:30.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.110+0000 7efd98ff9640 1 -- 172.21.15.7:0/891753879 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7efd94037020 con 0x7efd9c10c170 2024-09-19T08:47:30.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.110+0000 7efda444b740 1 Processor -- start 2024-09-19T08:47:30.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.110+0000 7efda444b740 1 -- start start 2024-09-19T08:47:30.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.111+0000 7efda444b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9f4a0 0x560d45e9f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:30.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.111+0000 7efda444b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560d45e9fdc0 0x560d45eaa140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:30.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.111+0000 7efda444b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d45eaa680 0x560d45eaca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:30.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.111+0000 7efda444b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560d45e052e0 con 0x560d45e9f4a0 2024-09-19T08:47:30.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.111+0000 7efda444b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560d45dacce0 con 0x560d45e9fdc0 2024-09-19T08:47:30.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.111+0000 7efda444b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560d45e012a0 con 0x560d45eaa680 2024-09-19T08:47:30.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.111+0000 7efd9affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9f4a0 0x560d45e9f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:30.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.111+0000 7efd9affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9f4a0 0x560d45e9f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35432/0 (socket says 172.21.15.7:35432) 2024-09-19T08:47:30.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.111+0000 7efd9affd640 1 -- 172.21.15.7:0/2101612439 learned_addr learned my addr 172.21.15.7:0/2101612439 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:30.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.111+0000 7efd9b7fe640 1 --2- 172.21.15.7:0/2101612439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560d45e9fdc0 0x560d45eaa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:30.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.111+0000 7efd98ff9640 1 --2- 172.21.15.7:0/891753879 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7efd840a33b0 0x7efd840a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:30.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.111+0000 7efd9affd640 1 --2- 172.21.15.7:0/2101612439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d45eaa680 0x560d45eaca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:30.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.111+0000 7efd9affd640 1 -- 172.21.15.7:0/2101612439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d45eaa680 msgr2=0x560d45eaca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:30.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.111+0000 7efd9affd640 1 --2- 172.21.15.7:0/2101612439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d45eaa680 0x560d45eaca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.111+0000 7efd9bfff640 1 --2- 172.21.15.7:0/891753879 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7efd840a33b0 0x7efd840a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:30.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.111+0000 7efd9affd640 1 -- 172.21.15.7:0/2101612439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560d45e9fdc0 msgr2=0x560d45eaa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:30.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.111+0000 7efd9affd640 1 --2- 172.21.15.7:0/2101612439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560d45e9fdc0 0x560d45eaa140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.111+0000 7efd9affd640 1 -- 172.21.15.7:0/2101612439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d45d91440 con 0x560d45e9f4a0 2024-09-19T08:47:30.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.112+0000 7efd98ff9640 1 -- 172.21.15.7:0/891753879 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7efd940f0a90 con 0x7efd9c10c170 2024-09-19T08:47:30.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.112+0000 7efd9affd640 1 --2- 172.21.15.7:0/2101612439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9f4a0 0x560d45e9f880 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7efd9000bf60 tx=0x7efd9000b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0169d8e192c8a92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:30.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.112+0000 7efd81ffb640 1 -- 172.21.15.7:0/2101612439 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90005020 con 0x560d45e9f4a0 2024-09-19T08:47:30.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.112+0000 7efd81ffb640 1 -- 172.21.15.7:0/2101612439 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd900047a0 con 0x560d45e9f4a0 2024-09-19T08:47:30.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.113+0000 7efd81ffb640 1 -- 172.21.15.7:0/2101612439 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9000f6e0 con 0x560d45e9f4a0 2024-09-19T08:47:30.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.113+0000 7efda444b740 1 -- 172.21.15.7:0/2101612439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9f4a0 msgr2=0x560d45e9f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:30.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.113+0000 7efda444b740 1 --2- 172.21.15.7:0/2101612439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9f4a0 0x560d45e9f880 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7efd9000bf60 tx=0x7efd9000b7d0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.113+0000 7efd9bfff640 1 --2- 172.21.15.7:0/891753879 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7efd840a33b0 0x7efd840a5870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efd94032000 tx=0x7efd9404e000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:30.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.113+0000 7efda444b740 1 -- 172.21.15.7:0/2101612439 shutdown_connections 2024-09-19T08:47:30.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.113+0000 7efda444b740 1 --2- 172.21.15.7:0/2101612439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d45eaa680 0x560d45eaca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.113+0000 7efda444b740 1 --2- 172.21.15.7:0/2101612439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560d45e9fdc0 0x560d45eaa140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.113+0000 7efda444b740 1 --2- 172.21.15.7:0/2101612439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9f4a0 0x560d45e9f880 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.113+0000 7efda444b740 1 -- 172.21.15.7:0/2101612439 >> 172.21.15.7:0/2101612439 conn(0x560d45e9ba30 msgr2=0x560d45e9be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:30.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.113+0000 7efda444b740 1 -- 172.21.15.7:0/2101612439 shutdown_connections 2024-09-19T08:47:30.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.113+0000 7efda444b740 1 -- 172.21.15.7:0/2101612439 wait complete. 2024-09-19T08:47:30.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.113+0000 7efda444b740 1 -- start start 2024-09-19T08:47:30.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.114+0000 7efda444b740 1 Processor -- start 2024-09-19T08:47:30.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.114+0000 7efda444b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d45e9f4a0 0x560d45ea9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:30.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.114+0000 7efda444b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9fdc0 0x560d45ea71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:30.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.114+0000 7efda444b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560d45eaa680 0x560d45ea76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:30.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.114+0000 7efda444b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560d45ead2f0 con 0x560d45e9fdc0 2024-09-19T08:47:30.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.114+0000 7efda444b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560d45dc0050 con 0x560d45eaa680 2024-09-19T08:47:30.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.114+0000 7efda444b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560d45ead470 con 0x560d45e9f4a0 2024-09-19T08:47:30.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.114+0000 7efda444b740 10 client.0 _ll_register_callbacks cb 0x560d45e00160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:47:30.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.114+0000 7efd9b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9fdc0 0x560d45ea71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:30.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.114+0000 7efd9affd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d45e9f4a0 0x560d45ea9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:30.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.114+0000 7efd9b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9fdc0 0x560d45ea71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35440/0 (socket says 172.21.15.7:35440) 2024-09-19T08:47:30.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.114+0000 7efd9b7fe640 1 -- 172.21.15.7:0/3363072535 learned_addr learned my addr 172.21.15.7:0/3363072535 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:30.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.114+0000 7efd9affd640 1 --2- 172.21.15.7:0/3363072535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560d45eaa680 0x560d45ea76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:30.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.115+0000 7efd9b7fe640 1 -- 172.21.15.7:0/3363072535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d45e9f4a0 msgr2=0x560d45ea9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:30.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.115+0000 7efd9b7fe640 1 --2- 172.21.15.7:0/3363072535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d45e9f4a0 0x560d45ea9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.115+0000 7efd9b7fe640 1 -- 172.21.15.7:0/3363072535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560d45eaa680 msgr2=0x560d45ea76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:30.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.115+0000 7efd9b7fe640 1 --2- 172.21.15.7:0/3363072535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560d45eaa680 0x560d45ea76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.115+0000 7efd9b7fe640 1 -- 172.21.15.7:0/3363072535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d45b763c0 con 0x560d45e9fdc0 2024-09-19T08:47:30.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.115+0000 7efd9b7fe640 1 --2- 172.21.15.7:0/3363072535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9fdc0 0x560d45ea71a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7efd8c010f10 tx=0x7efd8c00f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54bfde9eae63147e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:30.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.115+0000 7efd7affd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:47:30.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.115+0000 7efd7affd640 1 -- 172.21.15.7:0/3363072535 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c004020 con 0x560d45e9fdc0 2024-09-19T08:47:30.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.115+0000 7efd7affd640 1 -- 172.21.15.7:0/3363072535 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7efd8c0041c0 con 0x560d45e9fdc0 2024-09-19T08:47:30.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.115+0000 7efda444b740 1 -- 172.21.15.7:0/3363072535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd900047a0 con 0x560d45e9fdc0 2024-09-19T08:47:30.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.115+0000 7efd7affd640 1 -- 172.21.15.7:0/3363072535 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efd8c004400 con 0x560d45e9fdc0 2024-09-19T08:47:30.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.115+0000 7efda444b740 10 client.15942 fetch_fsmap learned FSMap version 25 2024-09-19T08:47:30.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.115+0000 7efda444b740 1 -- 172.21.15.7:0/3363072535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560d45eb8c90 con 0x560d45e9fdc0 2024-09-19T08:47:30.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.115+0000 7efd7affd640 1 -- 172.21.15.7:0/3363072535 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd900047a0 con 0x560d45e9fdc0 2024-09-19T08:47:30.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.116+0000 7efd7affd640 1 -- 172.21.15.7:0/3363072535 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efd8c0196e0 con 0x560d45e9fdc0 2024-09-19T08:47:30.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.116+0000 7efda444b740 10 client.15942 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:47:30.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.116+0000 7efda444b740 10 client.15942 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:47:30.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.116+0000 7efda444b740 20 client.15942 populate_metadata read hostname 'smithi007' 2024-09-19T08:47:30.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.116+0000 7efda444b740 1 --2- 172.21.15.7:0/3363072535 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x560d45eba330 0x560d45ebc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:30.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.116+0000 7efda444b740 4 client.15942 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:47:30.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.116+0000 7efda444b740 1 -- 172.21.15.7:0/3363072535 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d45e12850 con 0x560d45eba330 2024-09-19T08:47:30.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.116+0000 7efd9affd640 1 --2- 172.21.15.7:0/3363072535 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x560d45eba330 0x560d45ebc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:30.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.116+0000 7efd9affd640 1 --2- 172.21.15.7:0/3363072535 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x560d45eba330 0x560d45ebc720 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b249687799b01d1c server_cookie=be6f4f6a81d344d0 in_seq=0 out_seq=0 2024-09-19T08:47:30.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.116+0000 7efd7affd640 10 client.15942 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:47:30.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.117+0000 7efd7affd640 1 -- 172.21.15.7:0/3363072535 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560d45e12850 con 0x560d45eba330 2024-09-19T08:47:30.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.117+0000 7efd7affd640 10 client.15942 handle_command_reply: tid=0 2024-09-19T08:47:30.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.117+0000 7efda444b740 1 client.15942 shutdown 2024-09-19T08:47:30.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.117+0000 7efda444b740 1 -- 172.21.15.7:0/3363072535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9fdc0 msgr2=0x560d45ea71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:30.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.117+0000 7efda444b740 1 --2- 172.21.15.7:0/3363072535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9fdc0 0x560d45ea71a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7efd8c010f10 tx=0x7efd8c00f7f0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.117+0000 7efda444b740 1 -- 172.21.15.7:0/3363072535 shutdown_connections 2024-09-19T08:47:30.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.117+0000 7efda444b740 1 --2- 172.21.15.7:0/3363072535 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x560d45eba330 0x560d45ebc720 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.117+0000 7efda444b740 1 --2- 172.21.15.7:0/3363072535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560d45eaa680 0x560d45ea76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.117+0000 7efd7affd640 0 client.15942 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:47:30.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.117+0000 7efda444b740 1 --2- 172.21.15.7:0/3363072535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9fdc0 0x560d45ea71a0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.117+0000 7efda444b740 1 --2- 172.21.15.7:0/3363072535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d45e9f4a0 0x560d45ea9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.117+0000 7efda444b740 1 -- 172.21.15.7:0/3363072535 >> 172.21.15.7:0/3363072535 conn(0x560d45e9ba30 msgr2=0x560d45e9ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:30.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.118+0000 7efda444b740 1 -- 172.21.15.7:0/3363072535 shutdown_connections 2024-09-19T08:47:30.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.118+0000 7efda444b740 1 -- 172.21.15.7:0/3363072535 wait complete. 2024-09-19T08:47:30.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.118+0000 7efda444b740 20 client.15942 trim_cache size 0 max 16384 2024-09-19T08:47:30.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.135+0000 7efda444b740 1 Processor -- start 2024-09-19T08:47:30.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.135+0000 7efda444b740 1 -- start start 2024-09-19T08:47:30.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.135+0000 7efda444b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d45e9f4a0 0x560d45ea2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:30.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.135+0000 7efda444b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9fdc0 0x560d45ea9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:30.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.135+0000 7efda444b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560d45eaa680 0x560d45ec1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:30.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.135+0000 7efda444b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c1b2320 con 0x560d45e9fdc0 2024-09-19T08:47:30.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.135+0000 7efda444b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c1afbf0 con 0x560d45eaa680 2024-09-19T08:47:30.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.135+0000 7efda444b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c1ada40 con 0x560d45e9f4a0 2024-09-19T08:47:30.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.135+0000 7efd9b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9fdc0 0x560d45ea9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:30.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.135+0000 7efd9b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9fdc0 0x560d45ea9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35446/0 (socket says 172.21.15.7:35446) 2024-09-19T08:47:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.135+0000 7efd9b7fe640 1 -- 172.21.15.7:0/634546913 learned_addr learned my addr 172.21.15.7:0/634546913 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.135+0000 7efd9affd640 1 --2- 172.21.15.7:0/634546913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d45e9f4a0 0x560d45ea2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.136+0000 7efd9affd640 1 --2- 172.21.15.7:0/634546913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560d45eaa680 0x560d45ec1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.136+0000 7efd9b7fe640 1 -- 172.21.15.7:0/634546913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d45e9f4a0 msgr2=0x560d45ea2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.136+0000 7efd9b7fe640 1 --2- 172.21.15.7:0/634546913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d45e9f4a0 0x560d45ea2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.136+0000 7efd9b7fe640 1 -- 172.21.15.7:0/634546913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560d45eaa680 msgr2=0x560d45ec1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.136+0000 7efd9b7fe640 1 --2- 172.21.15.7:0/634546913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560d45eaa680 0x560d45ec1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.136+0000 7efd9b7fe640 1 -- 172.21.15.7:0/634546913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d45eaa260 con 0x560d45e9fdc0 2024-09-19T08:47:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.136+0000 7efd9affd640 1 --2- 172.21.15.7:0/634546913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d45e9f4a0 0x560d45ea2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:47:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.136+0000 7efd9b7fe640 1 --2- 172.21.15.7:0/634546913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9fdc0 0x560d45ea9110 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7efd8c019cf0 tx=0x7efd8c01af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac01c31e9f70fba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.136+0000 7efd817fa640 1 -- 172.21.15.7:0/634546913 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c019410 con 0x560d45e9fdc0 2024-09-19T08:47:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.136+0000 7efd817fa640 1 -- 172.21.15.7:0/634546913 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd8c005030 con 0x560d45e9fdc0 2024-09-19T08:47:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.136+0000 7efd817fa640 1 -- 172.21.15.7:0/634546913 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c0048c0 con 0x560d45e9fdc0 2024-09-19T08:47:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.137+0000 7efda444b740 1 -- 172.21.15.7:0/634546913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9fdc0 msgr2=0x560d45ea9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.137+0000 7efda444b740 1 --2- 172.21.15.7:0/634546913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9fdc0 0x560d45ea9110 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7efd8c019cf0 tx=0x7efd8c01af90 comp rx=0 tx=0).stop 2024-09-19T08:47:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.137+0000 7efda444b740 1 -- 172.21.15.7:0/634546913 shutdown_connections 2024-09-19T08:47:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.137+0000 7efda444b740 1 --2- 172.21.15.7:0/634546913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560d45eaa680 0x560d45ec1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.137+0000 7efda444b740 1 --2- 172.21.15.7:0/634546913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9fdc0 0x560d45ea9110 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.137+0000 7efda444b740 1 --2- 172.21.15.7:0/634546913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d45e9f4a0 0x560d45ea2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.137+0000 7efda444b740 1 -- 172.21.15.7:0/634546913 >> 172.21.15.7:0/634546913 conn(0x560d45e9ba30 msgr2=0x560d45ea8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:30.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.137+0000 7efda444b740 1 -- 172.21.15.7:0/634546913 shutdown_connections 2024-09-19T08:47:30.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.137+0000 7efda444b740 1 -- 172.21.15.7:0/634546913 wait complete. 2024-09-19T08:47:30.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.137+0000 7efda444b740 1 -- start start 2024-09-19T08:47:30.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.137+0000 7efda444b740 1 Processor -- start 2024-09-19T08:47:30.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.137+0000 7efda444b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9f4a0 0x560d45eb2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:30.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.137+0000 7efda444b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560d45e9fdc0 0x560d45eb3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:30.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.137+0000 7efda444b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d45eaa680 0x560d45ea3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.137+0000 7efda444b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c1ae0b0 con 0x560d45e9f4a0 2024-09-19T08:47:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.138+0000 7efda444b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c1af520 con 0x560d45e9fdc0 2024-09-19T08:47:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.138+0000 7efda444b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c1ae780 con 0x560d45eaa680 2024-09-19T08:47:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.138+0000 7efda444b740 10 client.0 _ll_register_callbacks cb 0x7efd8c00ab90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:47:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.138+0000 7efd9affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9f4a0 0x560d45eb2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.138+0000 7efd9affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9f4a0 0x560d45eb2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35448/0 (socket says 172.21.15.7:35448) 2024-09-19T08:47:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.138+0000 7efd9affd640 1 -- 172.21.15.7:0/287801628 learned_addr learned my addr 172.21.15.7:0/287801628 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.138+0000 7efd9b7fe640 1 --2- 172.21.15.7:0/287801628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560d45e9fdc0 0x560d45eb3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.138+0000 7efd9affd640 1 -- 172.21.15.7:0/287801628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d45eaa680 msgr2=0x560d45ea3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.138+0000 7efd9affd640 1 --2- 172.21.15.7:0/287801628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d45eaa680 0x560d45ea3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.138+0000 7efd9affd640 1 -- 172.21.15.7:0/287801628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560d45e9fdc0 msgr2=0x560d45eb3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.138+0000 7efd9affd640 1 --2- 172.21.15.7:0/287801628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560d45e9fdc0 0x560d45eb3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.138+0000 7efd9affd640 1 -- 172.21.15.7:0/287801628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d45ea45e0 con 0x560d45e9f4a0 2024-09-19T08:47:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.138+0000 7efd9affd640 1 --2- 172.21.15.7:0/287801628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9f4a0 0x560d45eb2b00 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7efd9000b8f0 tx=0x7efd9000b580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e841667c9a5d15dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:30.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.138+0000 7efd7affd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:47:30.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.138+0000 7efd7affd640 1 -- 172.21.15.7:0/287801628 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90027040 con 0x560d45e9f4a0 2024-09-19T08:47:30.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.138+0000 7efd7affd640 1 -- 172.21.15.7:0/287801628 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7efd90004c30 con 0x560d45e9f4a0 2024-09-19T08:47:30.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.138+0000 7efda444b740 1 -- 172.21.15.7:0/287801628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd8c005030 con 0x560d45e9f4a0 2024-09-19T08:47:30.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.138+0000 7efd7affd640 1 -- 172.21.15.7:0/287801628 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efd90004020 con 0x560d45e9f4a0 2024-09-19T08:47:30.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.139+0000 7efda444b740 10 client.15948 fetch_fsmap learned FSMap version 25 2024-09-19T08:47:30.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.139+0000 7efda444b740 1 -- 172.21.15.7:0/287801628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560d45f24bb0 con 0x560d45e9f4a0 2024-09-19T08:47:30.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.139+0000 7efd7affd640 1 -- 172.21.15.7:0/287801628 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd8c005030 con 0x560d45e9f4a0 2024-09-19T08:47:30.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.139+0000 7efd7affd640 1 -- 172.21.15.7:0/287801628 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efd900035f0 con 0x560d45e9f4a0 2024-09-19T08:47:30.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.139+0000 7efda444b740 10 client.15948 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:47:30.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.139+0000 7efda444b740 10 client.15948 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:47:30.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.139+0000 7efda444b740 20 client.15948 populate_metadata read hostname 'smithi007' 2024-09-19T08:47:30.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.139+0000 7efda444b740 1 --2- 172.21.15.7:0/287801628 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x560d45f25110 0x560d45f27530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:30.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.139+0000 7efda444b740 4 client.15948 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:47:30.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.139+0000 7efda444b740 1 -- 172.21.15.7:0/287801628 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560d45e0cd60 con 0x560d45f25110 2024-09-19T08:47:30.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.139+0000 7efd9b7fe640 1 --2- 172.21.15.7:0/287801628 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x560d45f25110 0x560d45f27530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:30.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.140+0000 7efd9b7fe640 1 --2- 172.21.15.7:0/287801628 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x560d45f25110 0x560d45f27530 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=117230d3f9feecd4 server_cookie=bd9ad285087db91f in_seq=0 out_seq=0 2024-09-19T08:47:30.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.140+0000 7efd7affd640 10 client.15948 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:47:30.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.140+0000 7efd7affd640 1 -- 172.21.15.7:0/287801628 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560d45e0cd60 con 0x560d45f25110 2024-09-19T08:47:30.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.140+0000 7efd7affd640 10 client.15948 handle_command_reply: tid=0 2024-09-19T08:47:30.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.140+0000 7efda444b740 1 client.15948 shutdown 2024-09-19T08:47:30.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.140+0000 7efda444b740 1 -- 172.21.15.7:0/287801628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9f4a0 msgr2=0x560d45eb2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:30.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.140+0000 7efda444b740 1 --2- 172.21.15.7:0/287801628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9f4a0 0x560d45eb2b00 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7efd9000b8f0 tx=0x7efd9000b580 comp rx=0 tx=0).stop 2024-09-19T08:47:30.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.140+0000 7efda444b740 1 -- 172.21.15.7:0/287801628 shutdown_connections 2024-09-19T08:47:30.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.140+0000 7efda444b740 1 --2- 172.21.15.7:0/287801628 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x560d45f25110 0x560d45f27530 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.140+0000 7efda444b740 1 --2- 172.21.15.7:0/287801628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560d45eaa680 0x560d45ea3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.140+0000 7efda444b740 1 --2- 172.21.15.7:0/287801628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560d45e9fdc0 0x560d45eb3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.140+0000 7efda444b740 1 --2- 172.21.15.7:0/287801628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d45e9f4a0 0x560d45eb2b00 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.140+0000 7efd7affd640 0 client.15948 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:47:30.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.140+0000 7efda444b740 1 -- 172.21.15.7:0/287801628 >> 172.21.15.7:0/287801628 conn(0x560d45e9ba30 msgr2=0x560d45e9a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:30.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.140+0000 7efda444b740 1 -- 172.21.15.7:0/287801628 shutdown_connections 2024-09-19T08:47:30.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.140+0000 7efda444b740 1 -- 172.21.15.7:0/287801628 wait complete. 2024-09-19T08:47:30.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.140+0000 7efda444b740 20 client.15948 trim_cache size 0 max 16384 2024-09-19T08:47:30.149 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:47:30.149 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-19T08:47:30.149 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-09-19T08:47:30.149 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:47:30.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.141+0000 7efda2072640 1 -- 172.21.15.7:0/891753879 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7efd840a33b0 msgr2=0x7efd840a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:30.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.141+0000 7efda2072640 1 --2- 172.21.15.7:0/891753879 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7efd840a33b0 0x7efd840a5870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efd94032000 tx=0x7efd9404e000 comp rx=0 tx=0).stop 2024-09-19T08:47:30.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.141+0000 7efda2072640 1 -- 172.21.15.7:0/891753879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd9c10c170 msgr2=0x7efd9c19ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:30.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.141+0000 7efda2072640 1 --2- 172.21.15.7:0/891753879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd9c10c170 0x7efd9c19ef40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7efd9402ae70 tx=0x7efd9402f5b0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.141+0000 7efda2072640 1 -- 172.21.15.7:0/891753879 shutdown_connections 2024-09-19T08:47:30.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.141+0000 7efda2072640 1 --2- 172.21.15.7:0/891753879 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7efd840a33b0 0x7efd840a5870 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.141+0000 7efda2072640 1 --2- 172.21.15.7:0/891753879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd9c10c170 0x7efd9c19ef40 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.141+0000 7efda2072640 1 --2- 172.21.15.7:0/891753879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd9c103660 0x7efd9c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.141+0000 7efda2072640 1 --2- 172.21.15.7:0/891753879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c102d40 0x7efd9c19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:30.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.141+0000 7efda2072640 1 -- 172.21.15.7:0/891753879 >> 172.21.15.7:0/891753879 conn(0x7efd9c0fc7a0 msgr2=0x7efd9c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:30.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.141+0000 7efda2072640 1 -- 172.21.15.7:0/891753879 shutdown_connections 2024-09-19T08:47:30.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:30.141+0000 7efda2072640 1 -- 172.21.15.7:0/891753879 wait complete. 2024-09-19T08:47:30.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:30 smithi175 ceph-mon[35688]: pgmap v92: 97 pgs: 97 active+clean; 476 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 18 MiB/s wr, 765 op/s 2024-09-19T08:47:30.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:30 smithi007 ceph-mon[31221]: pgmap v92: 97 pgs: 97 active+clean; 476 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 18 MiB/s wr, 765 op/s 2024-09-19T08:47:30.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:30 smithi044 ceph-mon[35072]: pgmap v92: 97 pgs: 97 active+clean; 476 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 18 MiB/s wr, 765 op/s 2024-09-19T08:47:30.997 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:47:30.997 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:47:31.302 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:47:31.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.861+0000 7f46221ed640 1 -- 172.21.15.7:0/808439006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f461c102d40 msgr2=0x7f461c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:31.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.861+0000 7f46221ed640 1 --2- 172.21.15.7:0/808439006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f461c102d40 0x7f461c103120 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f460c009ca0 tx=0x7f460c02a950 comp rx=0 tx=0).stop 2024-09-19T08:47:31.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.861+0000 7f46221ed640 1 -- 172.21.15.7:0/808439006 shutdown_connections 2024-09-19T08:47:31.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.861+0000 7f46221ed640 1 --2- 172.21.15.7:0/808439006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f461c10c170 0x7f461c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:31.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.861+0000 7f46221ed640 1 --2- 172.21.15.7:0/808439006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f461c103660 0x7f461c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:31.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.861+0000 7f46221ed640 1 --2- 172.21.15.7:0/808439006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f461c102d40 0x7f461c103120 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:31.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.861+0000 7f46221ed640 1 -- 172.21.15.7:0/808439006 >> 172.21.15.7:0/808439006 conn(0x7f461c0fc7a0 msgr2=0x7f461c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:31.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.861+0000 7f46221ed640 1 -- 172.21.15.7:0/808439006 shutdown_connections 2024-09-19T08:47:31.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.861+0000 7f46221ed640 1 -- 172.21.15.7:0/808439006 wait complete. 2024-09-19T08:47:31.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.862+0000 7f46221ed640 1 Processor -- start 2024-09-19T08:47:31.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.862+0000 7f46221ed640 1 -- start start 2024-09-19T08:47:31.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.862+0000 7f46221ed640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f461c102d40 0x7f461c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:31.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.862+0000 7f46221ed640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f461c103660 0x7f461c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:31.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.862+0000 7f46221ed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f461c10c170 0x7f461c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:31.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.863+0000 7f46221ed640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f461c111f70 con 0x7f461c10c170 2024-09-19T08:47:31.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.863+0000 7f46221ed640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f461c111df0 con 0x7f461c103660 2024-09-19T08:47:31.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.863+0000 7f46221ed640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f461c1120f0 con 0x7f461c102d40 2024-09-19T08:47:31.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.863+0000 7f461bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f461c10c170 0x7f461c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:31.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.863+0000 7f461bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f461c10c170 0x7f461c19cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35464/0 (socket says 172.21.15.7:35464) 2024-09-19T08:47:31.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.863+0000 7f461b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f461c102d40 0x7f461c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:31.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.863+0000 7f461bfff640 1 -- 172.21.15.7:0/1821188710 learned_addr learned my addr 172.21.15.7:0/1821188710 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:31.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.863+0000 7f461affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f461c103660 0x7f461c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:31.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.863+0000 7f461bfff640 1 -- 172.21.15.7:0/1821188710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f461c102d40 msgr2=0x7f461c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:31.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.863+0000 7f461bfff640 1 --2- 172.21.15.7:0/1821188710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f461c102d40 0x7f461c198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:31.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.863+0000 7f461bfff640 1 -- 172.21.15.7:0/1821188710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f461c103660 msgr2=0x7f461c1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:31.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.863+0000 7f461bfff640 1 --2- 172.21.15.7:0/1821188710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f461c103660 0x7f461c1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:31.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.863+0000 7f461bfff640 1 -- 172.21.15.7:0/1821188710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461c19d420 con 0x7f461c10c170 2024-09-19T08:47:31.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.863+0000 7f461bfff640 1 --2- 172.21.15.7:0/1821188710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f461c10c170 0x7f461c19cd40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f461400d950 tx=0x7f461400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:31.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.863+0000 7f4618ff9640 1 -- 172.21.15.7:0/1821188710 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4614017030 con 0x7f461c10c170 2024-09-19T08:47:31.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.863+0000 7f46221ed640 1 -- 172.21.15.7:0/1821188710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f461c19d710 con 0x7f461c10c170 2024-09-19T08:47:31.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.863+0000 7f4618ff9640 1 -- 172.21.15.7:0/1821188710 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4614004020 con 0x7f461c10c170 2024-09-19T08:47:31.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.863+0000 7f4618ff9640 1 -- 172.21.15.7:0/1821188710 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4614003c00 con 0x7f461c10c170 2024-09-19T08:47:31.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.864+0000 7f46221ed640 1 -- 172.21.15.7:0/1821188710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f461c1a4ff0 con 0x7f461c10c170 2024-09-19T08:47:31.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.865+0000 7f46221ed640 1 -- 172.21.15.7:0/1821188710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f461c103120 con 0x7f461c10c170 2024-09-19T08:47:31.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.866+0000 7f4618ff9640 1 -- 172.21.15.7:0/1821188710 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f461401a070 con 0x7f461c10c170 2024-09-19T08:47:31.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.866+0000 7f4618ff9640 1 --2- 172.21.15.7:0/1821188710 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f46080a33b0 0x7f46080a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:31.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.867+0000 7f461b7fe640 1 --2- 172.21.15.7:0/1821188710 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f46080a33b0 0x7f46080a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:31.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.867+0000 7f4618ff9640 1 -- 172.21.15.7:0/1821188710 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f46140cf4d0 con 0x7f461c10c170 2024-09-19T08:47:31.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.867+0000 7f461b7fe640 1 --2- 172.21.15.7:0/1821188710 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f46080a33b0 0x7f46080a5870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f460c004ad0 tx=0x7f460c004a60 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:31.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:31.871+0000 7f4618ff9640 1 -- 172.21.15.7:0/1821188710 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4614021070 con 0x7f461c10c170 2024-09-19T08:47:32.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:32.086+0000 7f46221ed640 1 -- 172.21.15.7:0/1821188710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f461c107240 con 0x7f461c10c170 2024-09-19T08:47:32.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:32.087+0000 7f4618ff9640 1 -- 172.21.15.7:0/1821188710 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f461409bea0 con 0x7f461c10c170 2024-09-19T08:47:32.088 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:47:32.088 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:47:32.088 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:47:32.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:32.089+0000 7f46221ed640 1 -- 172.21.15.7:0/1821188710 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f46080a33b0 msgr2=0x7f46080a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:32.089+0000 7f46221ed640 1 --2- 172.21.15.7:0/1821188710 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f46080a33b0 0x7f46080a5870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f460c004ad0 tx=0x7f460c004a60 comp rx=0 tx=0).stop 2024-09-19T08:47:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:32.089+0000 7f46221ed640 1 -- 172.21.15.7:0/1821188710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f461c10c170 msgr2=0x7f461c19cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:32.089+0000 7f46221ed640 1 --2- 172.21.15.7:0/1821188710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f461c10c170 0x7f461c19cd40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f461400d950 tx=0x7f461400de10 comp rx=0 tx=0).stop 2024-09-19T08:47:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:32.089+0000 7f46221ed640 1 -- 172.21.15.7:0/1821188710 shutdown_connections 2024-09-19T08:47:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:32.089+0000 7f46221ed640 1 --2- 172.21.15.7:0/1821188710 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f46080a33b0 0x7f46080a5870 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:32.089+0000 7f46221ed640 1 --2- 172.21.15.7:0/1821188710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f461c10c170 0x7f461c19cd40 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:32.089+0000 7f46221ed640 1 --2- 172.21.15.7:0/1821188710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f461c103660 0x7f461c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:32.089+0000 7f46221ed640 1 --2- 172.21.15.7:0/1821188710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f461c102d40 0x7f461c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:32.089+0000 7f46221ed640 1 -- 172.21.15.7:0/1821188710 >> 172.21.15.7:0/1821188710 conn(0x7f461c0fc7a0 msgr2=0x7f461c0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:32.089+0000 7f46221ed640 1 -- 172.21.15.7:0/1821188710 shutdown_connections 2024-09-19T08:47:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:32.089+0000 7f46221ed640 1 -- 172.21.15.7:0/1821188710 wait complete. 2024-09-19T08:47:32.442 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:32 smithi007 ceph-mon[31221]: pgmap v93: 97 pgs: 97 active+clean; 476 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 18 MiB/s wr, 765 op/s 2024-09-19T08:47:32.442 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:32 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1821188710' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:47:32.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:32 smithi175 ceph-mon[35688]: pgmap v93: 97 pgs: 97 active+clean; 476 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 18 MiB/s wr, 765 op/s 2024-09-19T08:47:32.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:32 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1821188710' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:47:32.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:32 smithi044 ceph-mon[35072]: pgmap v93: 97 pgs: 97 active+clean; 476 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 18 MiB/s wr, 765 op/s 2024-09-19T08:47:32.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:32 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1821188710' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:47:32.938 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:47:33.200 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:47:33.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.729+0000 7fc23d261640 1 -- 172.21.15.7:0/3017206311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc23810c1a0 msgr2=0x7fc23810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:33.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.730+0000 7fc23d261640 1 --2- 172.21.15.7:0/3017206311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc23810c1a0 0x7fc23810e610 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc230009ca0 tx=0x7fc23002a950 comp rx=0 tx=0).stop 2024-09-19T08:47:33.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.730+0000 7fc23d261640 1 -- 172.21.15.7:0/3017206311 shutdown_connections 2024-09-19T08:47:33.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.730+0000 7fc23d261640 1 --2- 172.21.15.7:0/3017206311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc23810c1a0 0x7fc23810e610 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.730+0000 7fc23d261640 1 --2- 172.21.15.7:0/3017206311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2381036e0 0x7fc23810bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.730+0000 7fc23d261640 1 --2- 172.21.15.7:0/3017206311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc238102dc0 0x7fc2381031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.730+0000 7fc23d261640 1 -- 172.21.15.7:0/3017206311 >> 172.21.15.7:0/3017206311 conn(0x7fc2380fc7a0 msgr2=0x7fc2380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:33.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.730+0000 7fc23d261640 1 -- 172.21.15.7:0/3017206311 shutdown_connections 2024-09-19T08:47:33.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.730+0000 7fc23d261640 1 -- 172.21.15.7:0/3017206311 wait complete. 2024-09-19T08:47:33.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.730+0000 7fc23d261640 1 Processor -- start 2024-09-19T08:47:33.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.730+0000 7fc23d261640 1 -- start start 2024-09-19T08:47:33.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.731+0000 7fc23d261640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc238102dc0 0x7fc2381983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:33.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.731+0000 7fc23d261640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2381036e0 0x7fc238198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:33.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.731+0000 7fc23d261640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc23810c1a0 0x7fc23819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:33.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.731+0000 7fc23d261640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc238111f70 con 0x7fc2381036e0 2024-09-19T08:47:33.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.731+0000 7fc23d261640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc238111df0 con 0x7fc238102dc0 2024-09-19T08:47:33.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.731+0000 7fc23d261640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc2381120f0 con 0x7fc23810c1a0 2024-09-19T08:47:33.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.731+0000 7fc2367fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2381036e0 0x7fc238198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:33.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.731+0000 7fc2367fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2381036e0 0x7fc238198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58072/0 (socket says 172.21.15.7:58072) 2024-09-19T08:47:33.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.731+0000 7fc2367fc640 1 -- 172.21.15.7:0/3141350628 learned_addr learned my addr 172.21.15.7:0/3141350628 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:33.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.731+0000 7fc236ffd640 1 --2- 172.21.15.7:0/3141350628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc238102dc0 0x7fc2381983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:33.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.731+0000 7fc2377fe640 1 --2- 172.21.15.7:0/3141350628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc23810c1a0 0x7fc23819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:33.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.731+0000 7fc2367fc640 1 -- 172.21.15.7:0/3141350628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc23810c1a0 msgr2=0x7fc23819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:33.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.731+0000 7fc2367fc640 1 --2- 172.21.15.7:0/3141350628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc23810c1a0 0x7fc23819ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.731+0000 7fc2367fc640 1 -- 172.21.15.7:0/3141350628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc238102dc0 msgr2=0x7fc2381983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:33.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.731+0000 7fc2367fc640 1 --2- 172.21.15.7:0/3141350628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc238102dc0 0x7fc2381983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.731+0000 7fc2367fc640 1 -- 172.21.15.7:0/3141350628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc23819d3a0 con 0x7fc2381036e0 2024-09-19T08:47:33.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.731+0000 7fc2377fe640 1 --2- 172.21.15.7:0/3141350628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc23810c1a0 0x7fc23819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:47:33.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.731+0000 7fc2367fc640 1 --2- 172.21.15.7:0/3141350628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2381036e0 0x7fc238198930 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00d770 tx=0x7fc22c00db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:33.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.731+0000 7fc21ffff640 1 -- 172.21.15.7:0/3141350628 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c017070 con 0x7fc2381036e0 2024-09-19T08:47:33.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.731+0000 7fc21ffff640 1 -- 172.21.15.7:0/3141350628 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc22c009820 con 0x7fc2381036e0 2024-09-19T08:47:33.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.731+0000 7fc23d261640 1 -- 172.21.15.7:0/3141350628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc23819d690 con 0x7fc2381036e0 2024-09-19T08:47:33.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.731+0000 7fc21ffff640 1 -- 172.21.15.7:0/3141350628 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c004cd0 con 0x7fc2381036e0 2024-09-19T08:47:33.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.732+0000 7fc23d261640 1 -- 172.21.15.7:0/3141350628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2381a4f70 con 0x7fc2381036e0 2024-09-19T08:47:33.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.734+0000 7fc21ffff640 1 -- 172.21.15.7:0/3141350628 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fc22c0099d0 con 0x7fc2381036e0 2024-09-19T08:47:33.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.734+0000 7fc23f63a740 1 Processor -- start 2024-09-19T08:47:33.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.734+0000 7fc23f63a740 1 -- start start 2024-09-19T08:47:33.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.734+0000 7fc23f63a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb6ab40 0x56369eb69090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:33.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.734+0000 7fc23f63a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56369eb695d0 0x56369eb69a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:33.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.734+0000 7fc23f63a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56369eb74370 0x56369eb76760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:33.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.734+0000 7fc23f63a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56369eacf2f0 con 0x56369eb6ab40 2024-09-19T08:47:33.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.734+0000 7fc23f63a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56369ea76cf0 con 0x56369eb695d0 2024-09-19T08:47:33.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.734+0000 7fc23f63a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56369eacb2b0 con 0x56369eb74370 2024-09-19T08:47:33.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.735+0000 7fc2377fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb6ab40 0x56369eb69090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:33.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.735+0000 7fc21ffff640 1 --2- 172.21.15.7:0/3141350628 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc2200a33b0 0x7fc2200a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:33.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.735+0000 7fc236ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56369eb695d0 0x56369eb69a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:33.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.735+0000 7fc2377fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb6ab40 0x56369eb69090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58080/0 (socket says 172.21.15.7:58080) 2024-09-19T08:47:33.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.735+0000 7fc2377fe640 1 -- 172.21.15.7:0/1188191074 learned_addr learned my addr 172.21.15.7:0/1188191074 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:33.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.735+0000 7fc2367fc640 1 --2- 172.21.15.7:0/1188191074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56369eb74370 0x56369eb76760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:33.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.735+0000 7fc2377fe640 1 --2- 172.21.15.7:0/3141350628 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc2200a33b0 0x7fc2200a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:33.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.735+0000 7fc21ffff640 1 -- 172.21.15.7:0/3141350628 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fc22c0cf760 con 0x7fc2381036e0 2024-09-19T08:47:33.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.735+0000 7fc236ffd640 1 -- 172.21.15.7:0/1188191074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56369eb74370 msgr2=0x56369eb76760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:33.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.735+0000 7fc236ffd640 1 --2- 172.21.15.7:0/1188191074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56369eb74370 0x56369eb76760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.735+0000 7fc236ffd640 1 -- 172.21.15.7:0/1188191074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb6ab40 msgr2=0x56369eb69090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:33.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.735+0000 7fc236ffd640 1 --2- 172.21.15.7:0/1188191074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb6ab40 0x56369eb69090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.735+0000 7fc236ffd640 1 -- 172.21.15.7:0/1188191074 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56369ea5b3a0 con 0x56369eb695d0 2024-09-19T08:47:33.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.735+0000 7fc2377fe640 1 --2- 172.21.15.7:0/1188191074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb6ab40 0x56369eb69090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:47:33.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.735+0000 7fc236ffd640 1 --2- 172.21.15.7:0/1188191074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56369eb695d0 0x56369eb69a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc228011c90 tx=0x7fc22800aa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1e8c5878a603359 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:33.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.735+0000 7fc2377fe640 1 --2- 172.21.15.7:0/3141350628 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc2200a33b0 0x7fc2200a5870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc23002fd90 tx=0x7fc23002a950 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:33.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.736+0000 7fc21d7fa640 1 -- 172.21.15.7:0/1188191074 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc228005020 con 0x56369eb695d0 2024-09-19T08:47:33.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.736+0000 7fc21d7fa640 1 -- 172.21.15.7:0/1188191074 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2280056a0 con 0x56369eb695d0 2024-09-19T08:47:33.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.736+0000 7fc21d7fa640 1 -- 172.21.15.7:0/1188191074 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22800c880 con 0x56369eb695d0 2024-09-19T08:47:33.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.736+0000 7fc23f63a740 1 -- 172.21.15.7:0/1188191074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56369eb695d0 msgr2=0x56369eb69a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:33.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.736+0000 7fc23f63a740 1 --2- 172.21.15.7:0/1188191074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56369eb695d0 0x56369eb69a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc228011c90 tx=0x7fc22800aa00 comp rx=0 tx=0).stop 2024-09-19T08:47:33.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.736+0000 7fc23f63a740 1 -- 172.21.15.7:0/1188191074 shutdown_connections 2024-09-19T08:47:33.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.736+0000 7fc23f63a740 1 --2- 172.21.15.7:0/1188191074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56369eb74370 0x56369eb76760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.736+0000 7fc23f63a740 1 --2- 172.21.15.7:0/1188191074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56369eb695d0 0x56369eb69a10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.736+0000 7fc23f63a740 1 --2- 172.21.15.7:0/1188191074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb6ab40 0x56369eb69090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.736+0000 7fc23f63a740 1 -- 172.21.15.7:0/1188191074 >> 172.21.15.7:0/1188191074 conn(0x56369eb32310 msgr2=0x56369eb65c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:33.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.736+0000 7fc23f63a740 1 -- 172.21.15.7:0/1188191074 shutdown_connections 2024-09-19T08:47:33.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.737+0000 7fc23f63a740 1 -- 172.21.15.7:0/1188191074 wait complete. 2024-09-19T08:47:33.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.737+0000 7fc23f63a740 1 -- start start 2024-09-19T08:47:33.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.737+0000 7fc23f63a740 1 Processor -- start 2024-09-19T08:47:33.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.737+0000 7fc23f63a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb695d0 0x56369eb73d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:33.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.737+0000 7fc23f63a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56369eb6ab40 0x56369eb71000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:33.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.737+0000 7fc23f63a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56369eb74370 0x56369eb715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:33.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.737+0000 7fc23f63a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56369eb77070 con 0x56369eb695d0 2024-09-19T08:47:33.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.737+0000 7fc23f63a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56369ea8a060 con 0x56369eb6ab40 2024-09-19T08:47:33.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.737+0000 7fc23f63a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56369eb771f0 con 0x56369eb74370 2024-09-19T08:47:33.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.737+0000 7fc236ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb695d0 0x56369eb73d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:33.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.737+0000 7fc23f63a740 10 client.0 _ll_register_callbacks cb 0x56369e7dd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:47:33.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.737+0000 7fc236ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb695d0 0x56369eb73d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58090/0 (socket says 172.21.15.7:58090) 2024-09-19T08:47:33.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.737+0000 7fc236ffd640 1 -- 172.21.15.7:0/3743019656 learned_addr learned my addr 172.21.15.7:0/3743019656 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:33.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.738+0000 7fc2377fe640 1 --2- 172.21.15.7:0/3743019656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56369eb74370 0x56369eb715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:33.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.738+0000 7fc236ffd640 1 -- 172.21.15.7:0/3743019656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56369eb74370 msgr2=0x56369eb715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:33.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.738+0000 7fc236ffd640 1 --2- 172.21.15.7:0/3743019656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56369eb74370 0x56369eb715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.738+0000 7fc236ffd640 1 -- 172.21.15.7:0/3743019656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56369eb6ab40 msgr2=0x56369eb71000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:47:33.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.738+0000 7fc236ffd640 1 --2- 172.21.15.7:0/3743019656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56369eb6ab40 0x56369eb71000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.738+0000 7fc236ffd640 1 -- 172.21.15.7:0/3743019656 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56369e8403c0 con 0x56369eb695d0 2024-09-19T08:47:33.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.738+0000 7fc236ffd640 1 --2- 172.21.15.7:0/3743019656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb695d0 0x56369eb73d50 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc228005f00 tx=0x7fc228004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7624f2cd11d8d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:33.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.738+0000 7fc21aff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:47:33.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.738+0000 7fc21aff5640 1 -- 172.21.15.7:0/3743019656 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc228028020 con 0x56369eb695d0 2024-09-19T08:47:33.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.738+0000 7fc23f63a740 1 -- 172.21.15.7:0/3743019656 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2280056a0 con 0x56369eb695d0 2024-09-19T08:47:33.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.738+0000 7fc21aff5640 1 -- 172.21.15.7:0/3743019656 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fc228005180 con 0x56369eb695d0 2024-09-19T08:47:33.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.738+0000 7fc21aff5640 1 -- 172.21.15.7:0/3743019656 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc228033050 con 0x56369eb695d0 2024-09-19T08:47:33.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.738+0000 7fc23f63a740 10 client.15966 fetch_fsmap learned FSMap version 25 2024-09-19T08:47:33.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.738+0000 7fc23f63a740 1 -- 172.21.15.7:0/3743019656 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56369eb82af0 con 0x56369eb695d0 2024-09-19T08:47:33.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.739+0000 7fc21aff5640 1 -- 172.21.15.7:0/3743019656 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2280056a0 con 0x56369eb695d0 2024-09-19T08:47:33.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.739+0000 7fc21aff5640 1 -- 172.21.15.7:0/3743019656 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc228024580 con 0x56369eb695d0 2024-09-19T08:47:33.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.739+0000 7fc23f63a740 10 client.15966 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:47:33.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.739+0000 7fc23f63a740 10 client.15966 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:47:33.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.739+0000 7fc23f63a740 20 client.15966 populate_metadata read hostname 'smithi007' 2024-09-19T08:47:33.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.739+0000 7fc23f63a740 1 --2- 172.21.15.7:0/3743019656 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x56369eb83ea0 0x56369eb86290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:33.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.739+0000 7fc23f63a740 4 client.15966 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:47:33.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.739+0000 7fc23f63a740 1 -- 172.21.15.7:0/3743019656 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56369eadc860 con 0x56369eb83ea0 2024-09-19T08:47:33.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.739+0000 7fc2367fc640 1 --2- 172.21.15.7:0/3743019656 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x56369eb83ea0 0x56369eb86290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:33.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.740+0000 7fc2367fc640 1 --2- 172.21.15.7:0/3743019656 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x56369eb83ea0 0x56369eb86290 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2fcc20b045bc78d9 server_cookie=a64bcf245cec042c in_seq=0 out_seq=0 2024-09-19T08:47:33.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.740+0000 7fc21aff5640 10 client.15966 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:47:33.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.740+0000 7fc21aff5640 1 -- 172.21.15.7:0/3743019656 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56369eadc860 con 0x56369eb83ea0 2024-09-19T08:47:33.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.740+0000 7fc21aff5640 10 client.15966 handle_command_reply: tid=0 2024-09-19T08:47:33.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.740+0000 7fc23f63a740 1 client.15966 shutdown 2024-09-19T08:47:33.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.741+0000 7fc23f63a740 1 -- 172.21.15.7:0/3743019656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb695d0 msgr2=0x56369eb73d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:33.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.741+0000 7fc23f63a740 1 --2- 172.21.15.7:0/3743019656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb695d0 0x56369eb73d50 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc228005f00 tx=0x7fc228004d30 comp rx=0 tx=0).stop 2024-09-19T08:47:33.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.741+0000 7fc23f63a740 1 -- 172.21.15.7:0/3743019656 shutdown_connections 2024-09-19T08:47:33.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.741+0000 7fc23f63a740 1 --2- 172.21.15.7:0/3743019656 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x56369eb83ea0 0x56369eb86290 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.741+0000 7fc23f63a740 1 --2- 172.21.15.7:0/3743019656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56369eb74370 0x56369eb715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.741+0000 7fc23f63a740 1 --2- 172.21.15.7:0/3743019656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56369eb6ab40 0x56369eb71000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.741+0000 7fc23f63a740 1 --2- 172.21.15.7:0/3743019656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb695d0 0x56369eb73d50 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.741+0000 7fc21aff5640 0 client.15966 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:47:33.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.741+0000 7fc23f63a740 1 -- 172.21.15.7:0/3743019656 >> 172.21.15.7:0/3743019656 conn(0x56369eb32310 msgr2=0x56369eb6b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:33.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.741+0000 7fc23f63a740 1 -- 172.21.15.7:0/3743019656 shutdown_connections 2024-09-19T08:47:33.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.741+0000 7fc23f63a740 1 -- 172.21.15.7:0/3743019656 wait complete. 2024-09-19T08:47:33.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.741+0000 7fc23f63a740 20 client.15966 trim_cache size 0 max 16384 2024-09-19T08:47:33.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.754+0000 7fc23f63a740 1 Processor -- start 2024-09-19T08:47:33.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.754+0000 7fc23f63a740 1 -- start start 2024-09-19T08:47:33.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.754+0000 7fc23f63a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56369eb695d0 0x56369eb80310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:33.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.754+0000 7fc23f63a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56369eb6ab40 0x56369eb6c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:33.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.754+0000 7fc23f63a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb74370 0x56369eb6c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:33.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.754+0000 7fc23f63a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc2381adf50 con 0x56369eb74370 2024-09-19T08:47:33.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.754+0000 7fc23f63a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc2381ab820 con 0x56369eb6ab40 2024-09-19T08:47:33.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.754+0000 7fc23f63a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc2381a9670 con 0x56369eb695d0 2024-09-19T08:47:33.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.754+0000 7fc2377fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb74370 0x56369eb6c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:33.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.754+0000 7fc2377fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb74370 0x56369eb6c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58104/0 (socket says 172.21.15.7:58104) 2024-09-19T08:47:33.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.754+0000 7fc2377fe640 1 -- 172.21.15.7:0/3383892913 learned_addr learned my addr 172.21.15.7:0/3383892913 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:33.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.754+0000 7fc236ffd640 1 --2- 172.21.15.7:0/3383892913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56369eb695d0 0x56369eb80310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:33.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.754+0000 7fc2367fc640 1 --2- 172.21.15.7:0/3383892913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56369eb6ab40 0x56369eb6c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:33.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.755+0000 7fc2377fe640 1 -- 172.21.15.7:0/3383892913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56369eb695d0 msgr2=0x56369eb80310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:33.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.755+0000 7fc2377fe640 1 --2- 172.21.15.7:0/3383892913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56369eb695d0 0x56369eb80310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.755+0000 7fc2377fe640 1 -- 172.21.15.7:0/3383892913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56369eb6ab40 msgr2=0x56369eb6c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:33.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.755+0000 7fc2377fe640 1 --2- 172.21.15.7:0/3383892913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56369eb6ab40 0x56369eb6c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.755+0000 7fc2377fe640 1 -- 172.21.15.7:0/3383892913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56369eb71940 con 0x56369eb74370 2024-09-19T08:47:33.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.755+0000 7fc2367fc640 1 --2- 172.21.15.7:0/3383892913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56369eb6ab40 0x56369eb6c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:47:33.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.755+0000 7fc2377fe640 1 --2- 172.21.15.7:0/3383892913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb74370 0x56369eb6c660 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc23002fd10 tx=0x7fc23003a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684d53a538294fed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:33.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.755+0000 7fc21cff9640 1 -- 172.21.15.7:0/3383892913 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc230050070 con 0x56369eb74370 2024-09-19T08:47:33.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.755+0000 7fc21cff9640 1 -- 172.21.15.7:0/3383892913 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc23002f550 con 0x56369eb74370 2024-09-19T08:47:33.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.755+0000 7fc21cff9640 1 -- 172.21.15.7:0/3383892913 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc230034040 con 0x56369eb74370 2024-09-19T08:47:33.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.756+0000 7fc23f63a740 1 -- 172.21.15.7:0/3383892913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb74370 msgr2=0x56369eb6c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:33.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.756+0000 7fc23f63a740 1 --2- 172.21.15.7:0/3383892913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb74370 0x56369eb6c660 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc23002fd10 tx=0x7fc23003a000 comp rx=0 tx=0).stop 2024-09-19T08:47:33.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.756+0000 7fc23f63a740 1 -- 172.21.15.7:0/3383892913 shutdown_connections 2024-09-19T08:47:33.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.756+0000 7fc23f63a740 1 --2- 172.21.15.7:0/3383892913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb74370 0x56369eb6c660 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.756+0000 7fc23f63a740 1 --2- 172.21.15.7:0/3383892913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56369eb6ab40 0x56369eb6c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.756+0000 7fc23f63a740 1 --2- 172.21.15.7:0/3383892913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56369eb695d0 0x56369eb80310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.756+0000 7fc23f63a740 1 -- 172.21.15.7:0/3383892913 >> 172.21.15.7:0/3383892913 conn(0x56369eb32310 msgr2=0x56369eb6ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:33.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.756+0000 7fc23f63a740 1 -- 172.21.15.7:0/3383892913 shutdown_connections 2024-09-19T08:47:33.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.756+0000 7fc23f63a740 1 -- 172.21.15.7:0/3383892913 wait complete. 2024-09-19T08:47:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.756+0000 7fc23f63a740 1 -- start start 2024-09-19T08:47:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.756+0000 7fc23f63a740 1 Processor -- start 2024-09-19T08:47:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.756+0000 7fc23f63a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56369eb695d0 0x56369eb7caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.756+0000 7fc23f63a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb6ab40 0x56369eb6dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.756+0000 7fc23f63a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56369eb74370 0x56369eb6e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.756+0000 7fc23f63a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc2381a9ce0 con 0x56369eb6ab40 2024-09-19T08:47:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.756+0000 7fc23f63a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc2381ab150 con 0x56369eb74370 2024-09-19T08:47:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.756+0000 7fc23f63a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc2381aa3b0 con 0x56369eb695d0 2024-09-19T08:47:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.756+0000 7fc23f63a740 10 client.0 _ll_register_callbacks cb 0x7fc230009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:47:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.757+0000 7fc2367fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb6ab40 0x56369eb6dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.757+0000 7fc2367fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb6ab40 0x56369eb6dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58114/0 (socket says 172.21.15.7:58114) 2024-09-19T08:47:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.757+0000 7fc2367fc640 1 -- 172.21.15.7:0/477557488 learned_addr learned my addr 172.21.15.7:0/477557488 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.757+0000 7fc2377fe640 1 --2- 172.21.15.7:0/477557488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56369eb74370 0x56369eb6e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.757+0000 7fc236ffd640 1 --2- 172.21.15.7:0/477557488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56369eb695d0 0x56369eb7caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.757+0000 7fc2367fc640 1 -- 172.21.15.7:0/477557488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56369eb695d0 msgr2=0x56369eb7caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.757+0000 7fc2367fc640 1 --2- 172.21.15.7:0/477557488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56369eb695d0 0x56369eb7caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.757+0000 7fc2367fc640 1 -- 172.21.15.7:0/477557488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56369eb74370 msgr2=0x56369eb6e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.757+0000 7fc2367fc640 1 --2- 172.21.15.7:0/477557488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56369eb74370 0x56369eb6e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.757+0000 7fc2367fc640 1 -- 172.21.15.7:0/477557488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56369eb6e840 con 0x56369eb6ab40 2024-09-19T08:47:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.757+0000 7fc236ffd640 1 --2- 172.21.15.7:0/477557488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56369eb695d0 0x56369eb7caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:47:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.757+0000 7fc2367fc640 1 --2- 172.21.15.7:0/477557488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb6ab40 0x56369eb6dc10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0ccea0 tx=0x7fc22c017c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f0e80faa66beed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.757+0000 7fc21aff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:47:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.757+0000 7fc21aff5640 1 -- 172.21.15.7:0/477557488 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c020040 con 0x56369eb6ab40 2024-09-19T08:47:33.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.757+0000 7fc21aff5640 1 -- 172.21.15.7:0/477557488 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fc22c009d60 con 0x56369eb6ab40 2024-09-19T08:47:33.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.757+0000 7fc23f63a740 1 -- 172.21.15.7:0/477557488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc23002f550 con 0x56369eb6ab40 2024-09-19T08:47:33.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.757+0000 7fc21aff5640 1 -- 172.21.15.7:0/477557488 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc22c0a4640 con 0x56369eb6ab40 2024-09-19T08:47:33.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.757+0000 7fc23f63a740 10 client.15972 fetch_fsmap learned FSMap version 25 2024-09-19T08:47:33.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.757+0000 7fc23f63a740 1 -- 172.21.15.7:0/477557488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56369ebee6c0 con 0x56369eb6ab40 2024-09-19T08:47:33.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.758+0000 7fc21aff5640 1 -- 172.21.15.7:0/477557488 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc23002f550 con 0x56369eb6ab40 2024-09-19T08:47:33.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.758+0000 7fc21aff5640 1 -- 172.21.15.7:0/477557488 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc22c098040 con 0x56369eb6ab40 2024-09-19T08:47:33.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.758+0000 7fc23f63a740 10 client.15972 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:47:33.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.758+0000 7fc23f63a740 10 client.15972 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:47:33.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.758+0000 7fc23f63a740 20 client.15972 populate_metadata read hostname 'smithi007' 2024-09-19T08:47:33.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.758+0000 7fc23f63a740 1 --2- 172.21.15.7:0/477557488 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x56369ebeee20 0x56369ebf1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:33.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.758+0000 7fc23f63a740 4 client.15972 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:47:33.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.758+0000 7fc23f63a740 1 -- 172.21.15.7:0/477557488 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56369ead6d70 con 0x56369ebeee20 2024-09-19T08:47:33.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.758+0000 7fc236ffd640 1 --2- 172.21.15.7:0/477557488 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x56369ebeee20 0x56369ebf1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:33.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.758+0000 7fc21aff5640 10 client.15972 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:47:33.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.758+0000 7fc236ffd640 1 --2- 172.21.15.7:0/477557488 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x56369ebeee20 0x56369ebf1240 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c937a28722436ee9 server_cookie=c2d5a7c626a02993 in_seq=0 out_seq=0 2024-09-19T08:47:33.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.759+0000 7fc21aff5640 1 -- 172.21.15.7:0/477557488 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56369ead6d70 con 0x56369ebeee20 2024-09-19T08:47:33.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.759+0000 7fc21aff5640 10 client.15972 handle_command_reply: tid=0 2024-09-19T08:47:33.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.759+0000 7fc23f63a740 1 client.15972 shutdown 2024-09-19T08:47:33.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.759+0000 7fc23f63a740 1 -- 172.21.15.7:0/477557488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb6ab40 msgr2=0x56369eb6dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:33.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.759+0000 7fc23f63a740 1 --2- 172.21.15.7:0/477557488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb6ab40 0x56369eb6dc10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0ccea0 tx=0x7fc22c017c90 comp rx=0 tx=0).stop 2024-09-19T08:47:33.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.759+0000 7fc23f63a740 1 -- 172.21.15.7:0/477557488 shutdown_connections 2024-09-19T08:47:33.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.759+0000 7fc23f63a740 1 --2- 172.21.15.7:0/477557488 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x56369ebeee20 0x56369ebf1240 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.759+0000 7fc23f63a740 1 --2- 172.21.15.7:0/477557488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56369eb74370 0x56369eb6e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.759+0000 7fc23f63a740 1 --2- 172.21.15.7:0/477557488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56369eb6ab40 0x56369eb6dc10 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.759+0000 7fc21aff5640 0 client.15972 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:47:33.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.759+0000 7fc23f63a740 1 --2- 172.21.15.7:0/477557488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56369eb695d0 0x56369eb7caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.759+0000 7fc23f63a740 1 -- 172.21.15.7:0/477557488 >> 172.21.15.7:0/477557488 conn(0x56369eb32310 msgr2=0x56369eb644e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:33.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.759+0000 7fc23f63a740 1 -- 172.21.15.7:0/477557488 shutdown_connections 2024-09-19T08:47:33.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.759+0000 7fc23f63a740 1 -- 172.21.15.7:0/477557488 wait complete. 2024-09-19T08:47:33.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.759+0000 7fc23f63a740 20 client.15972 trim_cache size 0 max 16384 2024-09-19T08:47:33.766 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:47:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.760+0000 7fc23d261640 1 -- 172.21.15.7:0/3141350628 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc2200a33b0 msgr2=0x7fc2200a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.760+0000 7fc23d261640 1 --2- 172.21.15.7:0/3141350628 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc2200a33b0 0x7fc2200a5870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc23002fd90 tx=0x7fc23002a950 comp rx=0 tx=0).stop 2024-09-19T08:47:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.760+0000 7fc23d261640 1 -- 172.21.15.7:0/3141350628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2381036e0 msgr2=0x7fc238198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.760+0000 7fc23d261640 1 --2- 172.21.15.7:0/3141350628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2381036e0 0x7fc238198930 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00d770 tx=0x7fc22c00db70 comp rx=0 tx=0).stop 2024-09-19T08:47:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.760+0000 7fc23d261640 1 -- 172.21.15.7:0/3141350628 shutdown_connections 2024-09-19T08:47:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.760+0000 7fc23d261640 1 --2- 172.21.15.7:0/3141350628 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc2200a33b0 0x7fc2200a5870 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.760+0000 7fc23d261640 1 --2- 172.21.15.7:0/3141350628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc23810c1a0 0x7fc23819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.760+0000 7fc23d261640 1 --2- 172.21.15.7:0/3141350628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2381036e0 0x7fc238198930 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.760+0000 7fc23d261640 1 --2- 172.21.15.7:0/3141350628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc238102dc0 0x7fc2381983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.760+0000 7fc23d261640 1 -- 172.21.15.7:0/3141350628 >> 172.21.15.7:0/3141350628 conn(0x7fc2380fc7a0 msgr2=0x7fc2380fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.760+0000 7fc23d261640 1 -- 172.21.15.7:0/3141350628 shutdown_connections 2024-09-19T08:47:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:33.760+0000 7fc23d261640 1 -- 172.21.15.7:0/3141350628 wait complete. 2024-09-19T08:47:34.493 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:34 smithi007 ceph-mon[31221]: pgmap v94: 97 pgs: 97 active+clean; 259 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 MiB/s wr, 773 op/s 2024-09-19T08:47:34.523 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:47:34.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:34 smithi175 ceph-mon[35688]: pgmap v94: 97 pgs: 97 active+clean; 259 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 MiB/s wr, 773 op/s 2024-09-19T08:47:34.781 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:47:34.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:34 smithi044 ceph-mon[35072]: pgmap v94: 97 pgs: 97 active+clean; 259 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 MiB/s wr, 773 op/s 2024-09-19T08:47:35.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.245+0000 7f641bdb8640 1 -- 172.21.15.7:0/2944946491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6414100d00 msgr2=0x7f6414106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:35.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.245+0000 7f641bdb8640 1 --2- 172.21.15.7:0/2944946491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6414100d00 0x7f6414106840 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6404009930 tx=0x7f640402a420 comp rx=0 tx=0).stop 2024-09-19T08:47:35.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.245+0000 7f641bdb8640 1 -- 172.21.15.7:0/2944946491 shutdown_connections 2024-09-19T08:47:35.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.245+0000 7f641bdb8640 1 --2- 172.21.15.7:0/2944946491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6414106f50 0x7f641410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.245+0000 7f641bdb8640 1 --2- 172.21.15.7:0/2944946491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6414100d00 0x7f6414106840 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.245+0000 7f641bdb8640 1 --2- 172.21.15.7:0/2944946491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6414100350 0x7f6414100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.245+0000 7f641bdb8640 1 -- 172.21.15.7:0/2944946491 >> 172.21.15.7:0/2944946491 conn(0x7f6414077210 msgr2=0x7f64140fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:35.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.245+0000 7f641bdb8640 1 -- 172.21.15.7:0/2944946491 shutdown_connections 2024-09-19T08:47:35.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.246+0000 7f641bdb8640 1 -- 172.21.15.7:0/2944946491 wait complete. 2024-09-19T08:47:35.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.246+0000 7f641bdb8640 1 Processor -- start 2024-09-19T08:47:35.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.246+0000 7f641bdb8640 1 -- start start 2024-09-19T08:47:35.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.246+0000 7f641bdb8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6414100350 0x7f64141012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:35.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.246+0000 7f641bdb8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6414100d00 0x7f6414101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:35.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.246+0000 7f641bdb8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6414106f50 0x7f6414101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:35.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.246+0000 7f641bdb8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6414111fa0 con 0x7f6414100d00 2024-09-19T08:47:35.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.246+0000 7f641bdb8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6414111e20 con 0x7f6414100350 2024-09-19T08:47:35.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.246+0000 7f641bdb8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6414112120 con 0x7f6414106f50 2024-09-19T08:47:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.247+0000 7f6419353640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6414100d00 0x7f6414101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.247+0000 7f6419353640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6414100d00 0x7f6414101810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58134/0 (socket says 172.21.15.7:58134) 2024-09-19T08:47:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.247+0000 7f6419353640 1 -- 172.21.15.7:0/1863004304 learned_addr learned my addr 172.21.15.7:0/1863004304 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.247+0000 7f641a355640 1 --2- 172.21.15.7:0/1863004304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6414106f50 0x7f6414101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.247+0000 7f6419b54640 1 --2- 172.21.15.7:0/1863004304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6414100350 0x7f64141012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.247+0000 7f6419353640 1 -- 172.21.15.7:0/1863004304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6414106f50 msgr2=0x7f6414101d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.247+0000 7f6419353640 1 --2- 172.21.15.7:0/1863004304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6414106f50 0x7f6414101d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.247+0000 7f6419353640 1 -- 172.21.15.7:0/1863004304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6414100350 msgr2=0x7f64141012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.247+0000 7f6419353640 1 --2- 172.21.15.7:0/1863004304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6414100350 0x7f64141012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.247+0000 7f6419353640 1 -- 172.21.15.7:0/1863004304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64141a6980 con 0x7f6414100d00 2024-09-19T08:47:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.247+0000 7f6419b54640 1 --2- 172.21.15.7:0/1863004304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6414100350 0x7f64141012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:47:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.247+0000 7f6419353640 1 --2- 172.21.15.7:0/1863004304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6414100d00 0x7f6414101810 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6404005940 tx=0x7f6404004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.247+0000 7f640affd640 1 -- 172.21.15.7:0/1863004304 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640403f030 con 0x7f6414100d00 2024-09-19T08:47:35.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.247+0000 7f640affd640 1 -- 172.21.15.7:0/1863004304 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6404003ad0 con 0x7f6414100d00 2024-09-19T08:47:35.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.247+0000 7f641bdb8640 1 -- 172.21.15.7:0/1863004304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64141a6c10 con 0x7f6414100d00 2024-09-19T08:47:35.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.247+0000 7f640affd640 1 -- 172.21.15.7:0/1863004304 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6404035070 con 0x7f6414100d00 2024-09-19T08:47:35.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.247+0000 7f641bdb8640 1 -- 172.21.15.7:0/1863004304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64141a7140 con 0x7f6414100d00 2024-09-19T08:47:35.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.250+0000 7f640affd640 1 -- 172.21.15.7:0/1863004304 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f6404042030 con 0x7f6414100d00 2024-09-19T08:47:35.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.250+0000 7f641e191740 1 Processor -- start 2024-09-19T08:47:35.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.250+0000 7f641e191740 1 -- start start 2024-09-19T08:47:35.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.250+0000 7f641e191740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638f30e9b40 0x5638f30e8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:35.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.250+0000 7f641e191740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638f30e85d0 0x5638f30e8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:35.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.250+0000 7f641e191740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30f3370 0x5638f30f5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:35.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.250+0000 7f641e191740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5638f304e2f0 con 0x5638f30f3370 2024-09-19T08:47:35.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.250+0000 7f641e191740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5638f2ff5cf0 con 0x5638f30e9b40 2024-09-19T08:47:35.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.250+0000 7f641e191740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5638f304a2b0 con 0x5638f30e85d0 2024-09-19T08:47:35.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.251+0000 7f6419353640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30f3370 0x5638f30f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:35.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.251+0000 7f6419353640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30f3370 0x5638f30f5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58144/0 (socket says 172.21.15.7:58144) 2024-09-19T08:47:35.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.251+0000 7f6419b54640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638f30e85d0 0x5638f30e8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:35.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.251+0000 7f6419353640 1 -- 172.21.15.7:0/2597216425 learned_addr learned my addr 172.21.15.7:0/2597216425 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:35.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.251+0000 7f641a355640 1 --2- 172.21.15.7:0/2597216425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638f30e9b40 0x5638f30e8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:35.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.251+0000 7f640affd640 1 --2- 172.21.15.7:0/1863004304 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f64000a3430 0x7f64000a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:35.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.251+0000 7f6419353640 1 -- 172.21.15.7:0/2597216425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638f30e85d0 msgr2=0x5638f30e8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:35.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.251+0000 7f6419353640 1 --2- 172.21.15.7:0/2597216425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638f30e85d0 0x5638f30e8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.251+0000 7f6419353640 1 -- 172.21.15.7:0/2597216425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638f30e9b40 msgr2=0x5638f30e8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:35.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.251+0000 7f6419353640 1 --2- 172.21.15.7:0/2597216425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638f30e9b40 0x5638f30e8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.251+0000 7f6419353640 1 -- 172.21.15.7:0/2597216425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638f2fda3a0 con 0x5638f30f3370 2024-09-19T08:47:35.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.251+0000 7f6419b54640 1 --2- 172.21.15.7:0/2597216425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638f30e85d0 0x5638f30e8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:47:35.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.251+0000 7f641a355640 1 --2- 172.21.15.7:0/1863004304 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f64000a3430 0x7f64000a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:35.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.251+0000 7f640affd640 1 -- 172.21.15.7:0/1863004304 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f64040f0470 con 0x7f6414100d00 2024-09-19T08:47:35.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.251+0000 7f6419353640 1 --2- 172.21.15.7:0/2597216425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30f3370 0x5638f30f5760 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f64040eda90 tx=0x7f64040e74b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5bd7294fa93ff9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:35.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.252+0000 7f63fffff640 1 -- 172.21.15.7:0/2597216425 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64040bc040 con 0x5638f30f3370 2024-09-19T08:47:35.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.252+0000 7f63fffff640 1 -- 172.21.15.7:0/2597216425 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64040eadd0 con 0x5638f30f3370 2024-09-19T08:47:35.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.252+0000 7f63fffff640 1 -- 172.21.15.7:0/2597216425 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64040c0a90 con 0x5638f30f3370 2024-09-19T08:47:35.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.252+0000 7f641e191740 1 -- 172.21.15.7:0/2597216425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30f3370 msgr2=0x5638f30f5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:35.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.252+0000 7f641a355640 1 --2- 172.21.15.7:0/1863004304 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f64000a3430 0x7f64000a58f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f640c005fd0 tx=0x7f640c004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:35.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.252+0000 7f641e191740 1 --2- 172.21.15.7:0/2597216425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30f3370 0x5638f30f5760 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f64040eda90 tx=0x7f64040e74b0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.252+0000 7f641e191740 1 -- 172.21.15.7:0/2597216425 shutdown_connections 2024-09-19T08:47:35.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.252+0000 7f641e191740 1 --2- 172.21.15.7:0/2597216425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30f3370 0x5638f30f5760 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.252+0000 7f641e191740 1 --2- 172.21.15.7:0/2597216425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638f30e85d0 0x5638f30e8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.253+0000 7f641e191740 1 --2- 172.21.15.7:0/2597216425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638f30e9b40 0x5638f30e8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.253+0000 7f641e191740 1 -- 172.21.15.7:0/2597216425 >> 172.21.15.7:0/2597216425 conn(0x5638f30b1310 msgr2=0x5638f30e4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:35.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.253+0000 7f641e191740 1 -- 172.21.15.7:0/2597216425 shutdown_connections 2024-09-19T08:47:35.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.253+0000 7f641e191740 1 -- 172.21.15.7:0/2597216425 wait complete. 2024-09-19T08:47:35.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.253+0000 7f641e191740 1 -- start start 2024-09-19T08:47:35.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.253+0000 7f641e191740 1 Processor -- start 2024-09-19T08:47:35.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.253+0000 7f641e191740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638f30e85d0 0x5638f30f2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:35.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.253+0000 7f641e191740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30e9b40 0x5638f30eff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:35.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.254+0000 7f641e191740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638f30f3370 0x5638f30f04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:35.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.254+0000 7f641e191740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5638f30f5e30 con 0x5638f30e9b40 2024-09-19T08:47:35.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.254+0000 7f641e191740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5638f3009060 con 0x5638f30f3370 2024-09-19T08:47:35.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.254+0000 7f641e191740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5638f30f5fb0 con 0x5638f30e85d0 2024-09-19T08:47:35.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.254+0000 7f641e191740 10 client.0 _ll_register_callbacks cb 0x5638f2d5c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:47:35.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.254+0000 7f6419353640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30e9b40 0x5638f30eff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:35.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.254+0000 7f6419353640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30e9b40 0x5638f30eff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58150/0 (socket says 172.21.15.7:58150) 2024-09-19T08:47:35.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.254+0000 7f6419353640 1 -- 172.21.15.7:0/763519323 learned_addr learned my addr 172.21.15.7:0/763519323 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:35.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.254+0000 7f641a355640 1 --2- 172.21.15.7:0/763519323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638f30f3370 0x5638f30f04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:35.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.254+0000 7f6419b54640 1 --2- 172.21.15.7:0/763519323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638f30e85d0 0x5638f30f2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.254+0000 7f6419353640 1 -- 172.21.15.7:0/763519323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638f30e85d0 msgr2=0x5638f30f2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.254+0000 7f6419353640 1 --2- 172.21.15.7:0/763519323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638f30e85d0 0x5638f30f2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.254+0000 7f6419353640 1 -- 172.21.15.7:0/763519323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638f30f3370 msgr2=0x5638f30f04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.254+0000 7f6419353640 1 --2- 172.21.15.7:0/763519323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638f30f3370 0x5638f30f04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.254+0000 7f6419353640 1 -- 172.21.15.7:0/763519323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638f2dbf3c0 con 0x5638f30e9b40 2024-09-19T08:47:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.254+0000 7f6419353640 1 --2- 172.21.15.7:0/763519323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30e9b40 0x5638f30eff60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6404032c00 tx=0x7f64040edaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85c3235585a5c34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.254+0000 7f63fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:47:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.254+0000 7f63fd7fa640 1 -- 172.21.15.7:0/763519323 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6404049040 con 0x5638f30e9b40 2024-09-19T08:47:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.254+0000 7f63fd7fa640 1 -- 172.21.15.7:0/763519323 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f64040d08c0 con 0x5638f30e9b40 2024-09-19T08:47:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.254+0000 7f641e191740 1 -- 172.21.15.7:0/763519323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5638f305b860 con 0x5638f30e9b40 2024-09-19T08:47:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.255+0000 7f63fd7fa640 1 -- 172.21.15.7:0/763519323 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f64040bc040 con 0x5638f30e9b40 2024-09-19T08:47:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.255+0000 7f641e191740 10 client.15984 fetch_fsmap learned FSMap version 25 2024-09-19T08:47:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.255+0000 7f641e191740 1 -- 172.21.15.7:0/763519323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5638f30f5e30 con 0x5638f30e9b40 2024-09-19T08:47:35.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.255+0000 7f63fd7fa640 1 -- 172.21.15.7:0/763519323 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5638f305b860 con 0x5638f30e9b40 2024-09-19T08:47:35.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.255+0000 7f63fd7fa640 1 -- 172.21.15.7:0/763519323 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f64040ed010 con 0x5638f30e9b40 2024-09-19T08:47:35.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.255+0000 7f641e191740 10 client.15984 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:47:35.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.255+0000 7f641e191740 10 client.15984 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:47:35.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.255+0000 7f641e191740 20 client.15984 populate_metadata read hostname 'smithi007' 2024-09-19T08:47:35.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.255+0000 7f641e191740 1 --2- 172.21.15.7:0/763519323 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5638f3102a80 0x5638f3104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:35.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.255+0000 7f641e191740 4 client.15984 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:47:35.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.255+0000 7f641e191740 1 -- 172.21.15.7:0/763519323 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638f3055d70 con 0x5638f3102a80 2024-09-19T08:47:35.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.255+0000 7f6419b54640 1 --2- 172.21.15.7:0/763519323 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5638f3102a80 0x5638f3104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:35.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.256+0000 7f6419b54640 1 --2- 172.21.15.7:0/763519323 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5638f3102a80 0x5638f3104ea0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a331a273127c82d4 server_cookie=382310f22bd2096 in_seq=0 out_seq=0 2024-09-19T08:47:35.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.256+0000 7f63fd7fa640 10 client.15984 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:47:35.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.256+0000 7f63fd7fa640 1 -- 172.21.15.7:0/763519323 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5638f3055d70 con 0x5638f3102a80 2024-09-19T08:47:35.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.256+0000 7f63fd7fa640 10 client.15984 handle_command_reply: tid=0 2024-09-19T08:47:35.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.257+0000 7f641e191740 1 client.15984 shutdown 2024-09-19T08:47:35.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.257+0000 7f641e191740 1 -- 172.21.15.7:0/763519323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30e9b40 msgr2=0x5638f30eff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:35.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.257+0000 7f641e191740 1 --2- 172.21.15.7:0/763519323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30e9b40 0x5638f30eff60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6404032c00 tx=0x7f64040edaf0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.257+0000 7f641e191740 1 -- 172.21.15.7:0/763519323 shutdown_connections 2024-09-19T08:47:35.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.257+0000 7f641e191740 1 --2- 172.21.15.7:0/763519323 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5638f3102a80 0x5638f3104ea0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.257+0000 7f641e191740 1 --2- 172.21.15.7:0/763519323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638f30f3370 0x5638f30f04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.257+0000 7f63fd7fa640 0 client.15984 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:47:35.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.257+0000 7f641e191740 1 --2- 172.21.15.7:0/763519323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30e9b40 0x5638f30eff60 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.257+0000 7f641e191740 1 --2- 172.21.15.7:0/763519323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638f30e85d0 0x5638f30f2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.257+0000 7f641e191740 1 -- 172.21.15.7:0/763519323 >> 172.21.15.7:0/763519323 conn(0x5638f30b1310 msgr2=0x5638f30ea960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:35.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.257+0000 7f641e191740 1 -- 172.21.15.7:0/763519323 shutdown_connections 2024-09-19T08:47:35.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.257+0000 7f641e191740 1 -- 172.21.15.7:0/763519323 wait complete. 2024-09-19T08:47:35.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.257+0000 7f641e191740 20 client.15984 trim_cache size 0 max 16384 2024-09-19T08:47:35.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.270+0000 7f641e191740 1 Processor -- start 2024-09-19T08:47:35.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.270+0000 7f641e191740 1 -- start start 2024-09-19T08:47:35.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.270+0000 7f641e191740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30e85d0 0x5638f30f2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:35.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.270+0000 7f641e191740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638f30e9b40 0x5638f30eb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:35.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.270+0000 7f641e191740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638f30f3370 0x5638f30eb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:35.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.270+0000 7f641e191740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f64141b23a0 con 0x5638f30e85d0 2024-09-19T08:47:35.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.270+0000 7f641e191740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f64141afc70 con 0x5638f30f3370 2024-09-19T08:47:35.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.270+0000 7f641e191740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f64141adac0 con 0x5638f30e9b40 2024-09-19T08:47:35.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.270+0000 7f6419b54640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30e85d0 0x5638f30f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:35.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.270+0000 7f6419b54640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30e85d0 0x5638f30f2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58156/0 (socket says 172.21.15.7:58156) 2024-09-19T08:47:35.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.270+0000 7f6419b54640 1 -- 172.21.15.7:0/1028803872 learned_addr learned my addr 172.21.15.7:0/1028803872 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:35.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.270+0000 7f641a355640 1 --2- 172.21.15.7:0/1028803872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638f30f3370 0x5638f30eb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:35.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.270+0000 7f6419353640 1 --2- 172.21.15.7:0/1028803872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638f30e9b40 0x5638f30eb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:35.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.271+0000 7f6419b54640 1 -- 172.21.15.7:0/1028803872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638f30e9b40 msgr2=0x5638f30eb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:35.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.271+0000 7f6419b54640 1 --2- 172.21.15.7:0/1028803872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638f30e9b40 0x5638f30eb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.271+0000 7f6419b54640 1 -- 172.21.15.7:0/1028803872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638f30f3370 msgr2=0x5638f30eb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:35.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.271+0000 7f6419b54640 1 --2- 172.21.15.7:0/1028803872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638f30f3370 0x5638f30eb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.271+0000 7f6419b54640 1 -- 172.21.15.7:0/1028803872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638f30f3020 con 0x5638f30e85d0 2024-09-19T08:47:35.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.271+0000 7f6419353640 1 --2- 172.21.15.7:0/1028803872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638f30e9b40 0x5638f30eb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:47:35.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.271+0000 7f641a355640 1 --2- 172.21.15.7:0/1028803872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638f30f3370 0x5638f30eb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:47:35.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.271+0000 7f6419b54640 1 --2- 172.21.15.7:0/1028803872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30e85d0 0x5638f30f2290 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x5638f3105710 tx=0x7f64100118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f6d24586f4ad8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:35.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.271+0000 7f63ff7fe640 1 -- 172.21.15.7:0/1028803872 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6410004230 con 0x5638f30e85d0 2024-09-19T08:47:35.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.271+0000 7f63ff7fe640 1 -- 172.21.15.7:0/1028803872 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64100043d0 con 0x5638f30e85d0 2024-09-19T08:47:35.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.271+0000 7f63ff7fe640 1 -- 172.21.15.7:0/1028803872 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641001da00 con 0x5638f30e85d0 2024-09-19T08:47:35.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.272+0000 7f641e191740 1 -- 172.21.15.7:0/1028803872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30e85d0 msgr2=0x5638f30f2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:35.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.272+0000 7f641e191740 1 --2- 172.21.15.7:0/1028803872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30e85d0 0x5638f30f2290 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x5638f3105710 tx=0x7f64100118d0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.272+0000 7f641e191740 1 -- 172.21.15.7:0/1028803872 shutdown_connections 2024-09-19T08:47:35.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.272+0000 7f641e191740 1 --2- 172.21.15.7:0/1028803872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638f30f3370 0x5638f30eb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.272+0000 7f641e191740 1 --2- 172.21.15.7:0/1028803872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638f30e9b40 0x5638f30eb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.272+0000 7f641e191740 1 --2- 172.21.15.7:0/1028803872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30e85d0 0x5638f30f2290 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.272+0000 7f641e191740 1 -- 172.21.15.7:0/1028803872 >> 172.21.15.7:0/1028803872 conn(0x5638f30b1310 msgr2=0x5638f30e3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:35.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.272+0000 7f641e191740 1 -- 172.21.15.7:0/1028803872 shutdown_connections 2024-09-19T08:47:35.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.272+0000 7f641e191740 1 -- 172.21.15.7:0/1028803872 wait complete. 2024-09-19T08:47:35.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.272+0000 7f641e191740 1 -- start start 2024-09-19T08:47:35.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.272+0000 7f641e191740 1 Processor -- start 2024-09-19T08:47:35.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.273+0000 7f641e191740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638f30e85d0 0x5638f30f6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:35.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.273+0000 7f641e191740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30e9b40 0x5638f30f73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:35.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.273+0000 7f641e191740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638f30f3370 0x5638f30f7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:35.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.273+0000 7f641e191740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f64141ae130 con 0x5638f30e9b40 2024-09-19T08:47:35.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.273+0000 7f641e191740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f64141af5a0 con 0x5638f30f3370 2024-09-19T08:47:35.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.273+0000 7f641e191740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f64141ae800 con 0x5638f30e85d0 2024-09-19T08:47:35.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.273+0000 7f641e191740 10 client.0 _ll_register_callbacks cb 0x7f640c0099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:47:35.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.273+0000 7f6419353640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30e9b40 0x5638f30f73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:35.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.273+0000 7f6419353640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30e9b40 0x5638f30f73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58166/0 (socket says 172.21.15.7:58166) 2024-09-19T08:47:35.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.273+0000 7f6419353640 1 -- 172.21.15.7:0/1383893857 learned_addr learned my addr 172.21.15.7:0/1383893857 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:35.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.273+0000 7f6419b54640 1 --2- 172.21.15.7:0/1383893857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638f30e85d0 0x5638f30f6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:35.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.273+0000 7f641a355640 1 --2- 172.21.15.7:0/1383893857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638f30f3370 0x5638f30f7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:35.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.273+0000 7f6419353640 1 -- 172.21.15.7:0/1383893857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638f30e85d0 msgr2=0x5638f30f6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:35.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.273+0000 7f6419353640 1 --2- 172.21.15.7:0/1383893857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638f30e85d0 0x5638f30f6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.273+0000 7f6419353640 1 -- 172.21.15.7:0/1383893857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638f30f3370 msgr2=0x5638f30f7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:35.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.273+0000 7f6419353640 1 --2- 172.21.15.7:0/1383893857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638f30f3370 0x5638f30f7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.273+0000 7f6419353640 1 -- 172.21.15.7:0/1383893857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638f316c740 con 0x5638f30e9b40 2024-09-19T08:47:35.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.273+0000 7f641a355640 1 --2- 172.21.15.7:0/1383893857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638f30f3370 0x5638f30f7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:47:35.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.273+0000 7f6419353640 1 --2- 172.21.15.7:0/1383893857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30e9b40 0x5638f30f73d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f64040bc670 tx=0x7f64040bc570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fef59a31616974 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:35.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.273+0000 7f63fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:47:35.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.273+0000 7f63fd7fa640 1 -- 172.21.15.7:0/1383893857 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6404049040 con 0x5638f30e9b40 2024-09-19T08:47:35.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.274+0000 7f63fd7fa640 1 -- 172.21.15.7:0/1383893857 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f64040035f0 con 0x5638f30e9b40 2024-09-19T08:47:35.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.274+0000 7f641e191740 1 -- 172.21.15.7:0/1383893857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64100043d0 con 0x5638f30e9b40 2024-09-19T08:47:35.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.274+0000 7f63fd7fa640 1 -- 172.21.15.7:0/1383893857 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f64040bc220 con 0x5638f30e9b40 2024-09-19T08:47:35.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.274+0000 7f641e191740 10 client.15990 fetch_fsmap learned FSMap version 25 2024-09-19T08:47:35.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.274+0000 7f641e191740 1 -- 172.21.15.7:0/1383893857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5638f316c740 con 0x5638f30e9b40 2024-09-19T08:47:35.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.274+0000 7f63fd7fa640 1 -- 172.21.15.7:0/1383893857 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64100043d0 con 0x5638f30e9b40 2024-09-19T08:47:35.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.274+0000 7f63fd7fa640 1 -- 172.21.15.7:0/1383893857 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f64040b8d50 con 0x5638f30e9b40 2024-09-19T08:47:35.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.274+0000 7f641e191740 10 client.15990 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:47:35.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.274+0000 7f641e191740 10 client.15990 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:47:35.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.274+0000 7f641e191740 20 client.15990 populate_metadata read hostname 'smithi007' 2024-09-19T08:47:35.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.274+0000 7f641e191740 1 --2- 172.21.15.7:0/1383893857 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5638f316dd40 0x5638f3170160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:35.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.274+0000 7f641e191740 4 client.15990 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:47:35.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.274+0000 7f641e191740 1 -- 172.21.15.7:0/1383893857 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5638f2fd2170 con 0x5638f316dd40 2024-09-19T08:47:35.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.274+0000 7f6419b54640 1 --2- 172.21.15.7:0/1383893857 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5638f316dd40 0x5638f3170160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:35.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.275+0000 7f6419b54640 1 --2- 172.21.15.7:0/1383893857 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5638f316dd40 0x5638f3170160 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1487c0c066e08fdb server_cookie=170d2dcd683fbf33 in_seq=0 out_seq=0 2024-09-19T08:47:35.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.275+0000 7f63fd7fa640 10 client.15990 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:47:35.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.275+0000 7f63fd7fa640 1 -- 172.21.15.7:0/1383893857 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5638f2fd2170 con 0x5638f316dd40 2024-09-19T08:47:35.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.275+0000 7f63fd7fa640 10 client.15990 handle_command_reply: tid=0 2024-09-19T08:47:35.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.275+0000 7f641e191740 1 client.15990 shutdown 2024-09-19T08:47:35.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.275+0000 7f641e191740 1 -- 172.21.15.7:0/1383893857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30e9b40 msgr2=0x5638f30f73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:35.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.275+0000 7f641e191740 1 --2- 172.21.15.7:0/1383893857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30e9b40 0x5638f30f73d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f64040bc670 tx=0x7f64040bc570 comp rx=0 tx=0).stop 2024-09-19T08:47:35.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.275+0000 7f641e191740 1 -- 172.21.15.7:0/1383893857 shutdown_connections 2024-09-19T08:47:35.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.275+0000 7f641e191740 1 --2- 172.21.15.7:0/1383893857 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5638f316dd40 0x5638f3170160 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.275+0000 7f641e191740 1 --2- 172.21.15.7:0/1383893857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638f30f3370 0x5638f30f7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.275+0000 7f641e191740 1 --2- 172.21.15.7:0/1383893857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638f30e9b40 0x5638f30f73d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.275+0000 7f641e191740 1 --2- 172.21.15.7:0/1383893857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638f30e85d0 0x5638f30f6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.275+0000 7f63fd7fa640 0 client.15990 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:47:35.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.275+0000 7f641e191740 1 -- 172.21.15.7:0/1383893857 >> 172.21.15.7:0/1383893857 conn(0x5638f30b1310 msgr2=0x5638f30e34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:35.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.275+0000 7f641e191740 1 -- 172.21.15.7:0/1383893857 shutdown_connections 2024-09-19T08:47:35.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.275+0000 7f641e191740 1 -- 172.21.15.7:0/1383893857 wait complete. 2024-09-19T08:47:35.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.275+0000 7f641e191740 20 client.15990 trim_cache size 0 max 16384 2024-09-19T08:47:35.283 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:47:35.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.276+0000 7f641bdb8640 1 -- 172.21.15.7:0/1863004304 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f64000a3430 msgr2=0x7f64000a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:35.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.276+0000 7f641bdb8640 1 --2- 172.21.15.7:0/1863004304 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f64000a3430 0x7f64000a58f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f640c005fd0 tx=0x7f640c004a40 comp rx=0 tx=0).stop 2024-09-19T08:47:35.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.276+0000 7f641bdb8640 1 -- 172.21.15.7:0/1863004304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6414100d00 msgr2=0x7f6414101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:35.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.276+0000 7f641bdb8640 1 --2- 172.21.15.7:0/1863004304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6414100d00 0x7f6414101810 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6404005940 tx=0x7f6404004270 comp rx=0 tx=0).stop 2024-09-19T08:47:35.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.276+0000 7f641bdb8640 1 -- 172.21.15.7:0/1863004304 shutdown_connections 2024-09-19T08:47:35.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.276+0000 7f641bdb8640 1 --2- 172.21.15.7:0/1863004304 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f64000a3430 0x7f64000a58f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.276+0000 7f641bdb8640 1 --2- 172.21.15.7:0/1863004304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6414106f50 0x7f6414101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.276+0000 7f641bdb8640 1 --2- 172.21.15.7:0/1863004304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6414100d00 0x7f6414101810 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.276+0000 7f641bdb8640 1 --2- 172.21.15.7:0/1863004304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6414100350 0x7f64141012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:35.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.276+0000 7f641bdb8640 1 -- 172.21.15.7:0/1863004304 >> 172.21.15.7:0/1863004304 conn(0x7f6414077210 msgr2=0x7f64140fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:35.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.276+0000 7f641bdb8640 1 -- 172.21.15.7:0/1863004304 shutdown_connections 2024-09-19T08:47:35.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:35.276+0000 7f641bdb8640 1 -- 172.21.15.7:0/1863004304 wait complete. 2024-09-19T08:47:36.030 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:47:36.285 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:47:36.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:36 smithi007 ceph-mon[31221]: pgmap v95: 97 pgs: 97 active+clean; 259 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 18 MiB/s wr, 769 op/s 2024-09-19T08:47:36.603 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:36 smithi044 ceph-mon[35072]: pgmap v95: 97 pgs: 97 active+clean; 259 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 18 MiB/s wr, 769 op/s 2024-09-19T08:47:36.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:36 smithi175 ceph-mon[35688]: pgmap v95: 97 pgs: 97 active+clean; 259 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 18 MiB/s wr, 769 op/s 2024-09-19T08:47:36.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.753+0000 7f91486a9640 1 -- 172.21.15.7:0/1235701587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f914010c180 msgr2=0x7f914010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:36.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.753+0000 7f91486a9640 1 --2- 172.21.15.7:0/1235701587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f914010c180 0x7f914010e610 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9138009ca0 tx=0x7f913802a950 comp rx=0 tx=0).stop 2024-09-19T08:47:36.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.753+0000 7f91486a9640 1 -- 172.21.15.7:0/1235701587 shutdown_connections 2024-09-19T08:47:36.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.753+0000 7f91486a9640 1 --2- 172.21.15.7:0/1235701587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f914010c180 0x7f914010e610 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.753+0000 7f91486a9640 1 --2- 172.21.15.7:0/1235701587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9140103700 0x7f914010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.753+0000 7f91486a9640 1 --2- 172.21.15.7:0/1235701587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9140102de0 0x7f91401031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.753+0000 7f91486a9640 1 -- 172.21.15.7:0/1235701587 >> 172.21.15.7:0/1235701587 conn(0x7f91400fc7a0 msgr2=0x7f91400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:36.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.753+0000 7f91486a9640 1 -- 172.21.15.7:0/1235701587 shutdown_connections 2024-09-19T08:47:36.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.753+0000 7f91486a9640 1 -- 172.21.15.7:0/1235701587 wait complete. 2024-09-19T08:47:36.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.753+0000 7f91486a9640 1 Processor -- start 2024-09-19T08:47:36.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.753+0000 7f91486a9640 1 -- start start 2024-09-19T08:47:36.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.754+0000 7f91486a9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9140102de0 0x7f9140100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:36.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.754+0000 7f91486a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9140103700 0x7f9140100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:36.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.754+0000 7f91486a9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f914010c180 0x7f91401014c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:36.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.754+0000 7f91486a9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9140111f70 con 0x7f9140102de0 2024-09-19T08:47:36.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.754+0000 7f91486a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9140111df0 con 0x7f9140103700 2024-09-19T08:47:36.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.754+0000 7f91486a9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f91401120f0 con 0x7f914010c180 2024-09-19T08:47:36.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.754+0000 7f9146445640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9140102de0 0x7f9140100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:36.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.754+0000 7f9146445640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9140102de0 0x7f9140100a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58186/0 (socket says 172.21.15.7:58186) 2024-09-19T08:47:36.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.754+0000 7f9146445640 1 -- 172.21.15.7:0/3253937924 learned_addr learned my addr 172.21.15.7:0/3253937924 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:36.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.754+0000 7f9145c44640 1 --2- 172.21.15.7:0/3253937924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9140103700 0x7f9140100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:36.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.754+0000 7f9146c46640 1 --2- 172.21.15.7:0/3253937924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f914010c180 0x7f91401014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:36.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.754+0000 7f9146445640 1 -- 172.21.15.7:0/3253937924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f914010c180 msgr2=0x7f91401014c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:36.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.754+0000 7f9146445640 1 --2- 172.21.15.7:0/3253937924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f914010c180 0x7f91401014c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.754+0000 7f9146445640 1 -- 172.21.15.7:0/3253937924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9140103700 msgr2=0x7f9140100f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:36.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.754+0000 7f9146445640 1 --2- 172.21.15.7:0/3253937924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9140103700 0x7f9140100f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.754+0000 7f9146445640 1 -- 172.21.15.7:0/3253937924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91401a68b0 con 0x7f9140102de0 2024-09-19T08:47:36.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.754+0000 7f9146445640 1 --2- 172.21.15.7:0/3253937924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9140102de0 0x7f9140100a40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f913c00d950 tx=0x7f913c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:36.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.755+0000 7f91377fe640 1 -- 172.21.15.7:0/3253937924 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c017070 con 0x7f9140102de0 2024-09-19T08:47:36.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.755+0000 7f91486a9640 1 -- 172.21.15.7:0/3253937924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91401a6ba0 con 0x7f9140102de0 2024-09-19T08:47:36.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.755+0000 7f91377fe640 1 -- 172.21.15.7:0/3253937924 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f913c009c30 con 0x7f9140102de0 2024-09-19T08:47:36.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.755+0000 7f91377fe640 1 -- 172.21.15.7:0/3253937924 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c00f6b0 con 0x7f9140102de0 2024-09-19T08:47:36.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.755+0000 7f91486a9640 1 -- 172.21.15.7:0/3253937924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91401a7130 con 0x7f9140102de0 2024-09-19T08:47:36.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.757+0000 7f91377fe640 1 -- 172.21.15.7:0/3253937924 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f913c0109d0 con 0x7f9140102de0 2024-09-19T08:47:36.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.757+0000 7f914aa82740 1 Processor -- start 2024-09-19T08:47:36.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.757+0000 7f914aa82740 1 -- start start 2024-09-19T08:47:36.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.758+0000 7f914aa82740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5a4762b40 0x55e5a4761090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:36.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.758+0000 7f914aa82740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a47615d0 0x55e5a4761a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:36.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.758+0000 7f914aa82740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5a476c370 0x55e5a476e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:36.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.758+0000 7f914aa82740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e5a46c72f0 con 0x55e5a47615d0 2024-09-19T08:47:36.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.758+0000 7f914aa82740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e5a466ecf0 con 0x55e5a4762b40 2024-09-19T08:47:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.758+0000 7f914aa82740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e5a46c32b0 con 0x55e5a476c370 2024-09-19T08:47:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.758+0000 7f9146445640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a47615d0 0x55e5a4761a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.758+0000 7f9146445640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a47615d0 0x55e5a4761a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58194/0 (socket says 172.21.15.7:58194) 2024-09-19T08:47:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.758+0000 7f9146c46640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5a4762b40 0x55e5a4761090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.758+0000 7f9146445640 1 -- 172.21.15.7:0/1639269279 learned_addr learned my addr 172.21.15.7:0/1639269279 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.758+0000 7f9145c44640 1 --2- 172.21.15.7:0/1639269279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5a476c370 0x55e5a476e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.758+0000 7f91377fe640 1 --2- 172.21.15.7:0/3253937924 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f912c0a3430 0x7f912c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.758+0000 7f9146445640 1 -- 172.21.15.7:0/1639269279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5a476c370 msgr2=0x55e5a476e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.758+0000 7f9146445640 1 --2- 172.21.15.7:0/1639269279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5a476c370 0x55e5a476e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.758+0000 7f9146445640 1 -- 172.21.15.7:0/1639269279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5a4762b40 msgr2=0x55e5a4761090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:36.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.758+0000 7f9146445640 1 --2- 172.21.15.7:0/1639269279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5a4762b40 0x55e5a4761090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.758+0000 7f9146445640 1 -- 172.21.15.7:0/1639269279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5a46533a0 con 0x55e5a47615d0 2024-09-19T08:47:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.758+0000 7f9146c46640 1 --2- 172.21.15.7:0/3253937924 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f912c0a3430 0x7f912c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.759+0000 7f91377fe640 1 -- 172.21.15.7:0/3253937924 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f913c0cf4f0 con 0x7f9140102de0 2024-09-19T08:47:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.759+0000 7f9146445640 1 --2- 172.21.15.7:0/1639269279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a47615d0 0x55e5a4761a10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f913c0ccba0 tx=0x7f913c06e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e97296011e0738e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.759+0000 7f9134ff9640 1 -- 172.21.15.7:0/1639269279 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c020070 con 0x55e5a47615d0 2024-09-19T08:47:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.759+0000 7f9134ff9640 1 -- 172.21.15.7:0/1639269279 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f913c009de0 con 0x55e5a47615d0 2024-09-19T08:47:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.759+0000 7f9134ff9640 1 -- 172.21.15.7:0/1639269279 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c0bbb80 con 0x55e5a47615d0 2024-09-19T08:47:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.760+0000 7f914aa82740 1 -- 172.21.15.7:0/1639269279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a47615d0 msgr2=0x55e5a4761a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.760+0000 7f914aa82740 1 --2- 172.21.15.7:0/1639269279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a47615d0 0x55e5a4761a10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f913c0ccba0 tx=0x7f913c06e720 comp rx=0 tx=0).stop 2024-09-19T08:47:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.760+0000 7f9146c46640 1 --2- 172.21.15.7:0/3253937924 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f912c0a3430 0x7f912c0a58f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9138009430 tx=0x7f913803c040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.760+0000 7f914aa82740 1 -- 172.21.15.7:0/1639269279 shutdown_connections 2024-09-19T08:47:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.760+0000 7f914aa82740 1 --2- 172.21.15.7:0/1639269279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5a476c370 0x55e5a476e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.760+0000 7f914aa82740 1 --2- 172.21.15.7:0/1639269279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a47615d0 0x55e5a4761a10 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.760+0000 7f914aa82740 1 --2- 172.21.15.7:0/1639269279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5a4762b40 0x55e5a4761090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.760+0000 7f914aa82740 1 -- 172.21.15.7:0/1639269279 >> 172.21.15.7:0/1639269279 conn(0x55e5a472a310 msgr2=0x55e5a475dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.760+0000 7f914aa82740 1 -- 172.21.15.7:0/1639269279 shutdown_connections 2024-09-19T08:47:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.760+0000 7f914aa82740 1 -- 172.21.15.7:0/1639269279 wait complete. 2024-09-19T08:47:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.760+0000 7f914aa82740 1 -- start start 2024-09-19T08:47:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.760+0000 7f914aa82740 1 Processor -- start 2024-09-19T08:47:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.761+0000 7f914aa82740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5a47615d0 0x55e5a476bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.761+0000 7f914aa82740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a4762b40 0x55e5a4768fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.761+0000 7f914aa82740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5a476c370 0x55e5a4769560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.761+0000 7f914aa82740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e5a476efb0 con 0x55e5a4762b40 2024-09-19T08:47:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.761+0000 7f914aa82740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e5a4682060 con 0x55e5a47615d0 2024-09-19T08:47:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.761+0000 7f914aa82740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e5a476f130 con 0x55e5a476c370 2024-09-19T08:47:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.761+0000 7f914aa82740 10 client.0 _ll_register_callbacks cb 0x55e5a43d58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:47:36.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.761+0000 7f9145c44640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a4762b40 0x55e5a4768fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.761+0000 7f9145c44640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a4762b40 0x55e5a4768fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58208/0 (socket says 172.21.15.7:58208) 2024-09-19T08:47:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.761+0000 7f9145c44640 1 -- 172.21.15.7:0/897858199 learned_addr learned my addr 172.21.15.7:0/897858199 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.761+0000 7f9146c46640 1 --2- 172.21.15.7:0/897858199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5a476c370 0x55e5a4769560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.761+0000 7f9146445640 1 --2- 172.21.15.7:0/897858199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5a47615d0 0x55e5a476bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.761+0000 7f9145c44640 1 -- 172.21.15.7:0/897858199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5a476c370 msgr2=0x55e5a4769560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.761+0000 7f9145c44640 1 --2- 172.21.15.7:0/897858199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5a476c370 0x55e5a4769560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.761+0000 7f9145c44640 1 -- 172.21.15.7:0/897858199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5a47615d0 msgr2=0x55e5a476bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.761+0000 7f9145c44640 1 --2- 172.21.15.7:0/897858199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5a47615d0 0x55e5a476bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.761+0000 7f9145c44640 1 -- 172.21.15.7:0/897858199 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5a44383c0 con 0x55e5a4762b40 2024-09-19T08:47:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.761+0000 7f9146445640 1 --2- 172.21.15.7:0/897858199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5a47615d0 0x55e5a476bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:47:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.761+0000 7f9145c44640 1 --2- 172.21.15.7:0/897858199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a4762b40 0x55e5a4768fc0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f913000b9f0 tx=0x7f913000beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b7da1ff1c5c0ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:36.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.761+0000 7f9129ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:47:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.761+0000 7f9129ffb640 1 -- 172.21.15.7:0/897858199 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130003e20 con 0x55e5a4762b40 2024-09-19T08:47:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.762+0000 7f9129ffb640 1 -- 172.21.15.7:0/897858199 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f9130005020 con 0x55e5a4762b40 2024-09-19T08:47:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.762+0000 7f914aa82740 1 -- 172.21.15.7:0/897858199 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f913c009de0 con 0x55e5a4762b40 2024-09-19T08:47:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.762+0000 7f9129ffb640 1 -- 172.21.15.7:0/897858199 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9130005220 con 0x55e5a4762b40 2024-09-19T08:47:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.762+0000 7f914aa82740 10 client.16002 fetch_fsmap learned FSMap version 25 2024-09-19T08:47:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.762+0000 7f914aa82740 1 -- 172.21.15.7:0/897858199 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e5a477aae0 con 0x55e5a4762b40 2024-09-19T08:47:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.762+0000 7f9129ffb640 1 -- 172.21.15.7:0/897858199 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f913c009de0 con 0x55e5a4762b40 2024-09-19T08:47:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.762+0000 7f9129ffb640 1 -- 172.21.15.7:0/897858199 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f913001b5f0 con 0x55e5a4762b40 2024-09-19T08:47:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.762+0000 7f914aa82740 10 client.16002 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:47:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.762+0000 7f914aa82740 10 client.16002 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:47:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.762+0000 7f914aa82740 20 client.16002 populate_metadata read hostname 'smithi007' 2024-09-19T08:47:36.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.762+0000 7f914aa82740 1 --2- 172.21.15.7:0/897858199 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e5a477bff0 0x55e5a477e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:36.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.762+0000 7f914aa82740 4 client.16002 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:47:36.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.762+0000 7f914aa82740 1 -- 172.21.15.7:0/897858199 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5a46d4860 con 0x55e5a477bff0 2024-09-19T08:47:36.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.763+0000 7f9146445640 1 --2- 172.21.15.7:0/897858199 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e5a477bff0 0x55e5a477e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:36.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.763+0000 7f9129ffb640 10 client.16002 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:47:36.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.763+0000 7f9146445640 1 --2- 172.21.15.7:0/897858199 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e5a477bff0 0x55e5a477e430 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98e4c49342bab583 server_cookie=4a5bbd81707f5ece in_seq=0 out_seq=0 2024-09-19T08:47:36.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.764+0000 7f9129ffb640 1 -- 172.21.15.7:0/897858199 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e5a46d4860 con 0x55e5a477bff0 2024-09-19T08:47:36.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.764+0000 7f9129ffb640 10 client.16002 handle_command_reply: tid=0 2024-09-19T08:47:36.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.764+0000 7f914aa82740 1 client.16002 shutdown 2024-09-19T08:47:36.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.764+0000 7f914aa82740 1 -- 172.21.15.7:0/897858199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a4762b40 msgr2=0x55e5a4768fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:36.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.764+0000 7f914aa82740 1 --2- 172.21.15.7:0/897858199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a4762b40 0x55e5a4768fc0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f913000b9f0 tx=0x7f913000beb0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.764+0000 7f914aa82740 1 -- 172.21.15.7:0/897858199 shutdown_connections 2024-09-19T08:47:36.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.764+0000 7f914aa82740 1 --2- 172.21.15.7:0/897858199 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e5a477bff0 0x55e5a477e430 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.764+0000 7f914aa82740 1 --2- 172.21.15.7:0/897858199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5a476c370 0x55e5a4769560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.764+0000 7f914aa82740 1 --2- 172.21.15.7:0/897858199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a4762b40 0x55e5a4768fc0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.764+0000 7f914aa82740 1 --2- 172.21.15.7:0/897858199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5a47615d0 0x55e5a476bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.764+0000 7f914aa82740 1 -- 172.21.15.7:0/897858199 >> 172.21.15.7:0/897858199 conn(0x55e5a472a310 msgr2=0x55e5a4763930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:36.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.764+0000 7f9129ffb640 0 client.16002 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:47:36.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.764+0000 7f914aa82740 1 -- 172.21.15.7:0/897858199 shutdown_connections 2024-09-19T08:47:36.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.764+0000 7f914aa82740 1 -- 172.21.15.7:0/897858199 wait complete. 2024-09-19T08:47:36.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.764+0000 7f914aa82740 20 client.16002 trim_cache size 0 max 16384 2024-09-19T08:47:36.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.777+0000 7f914aa82740 1 Processor -- start 2024-09-19T08:47:36.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.777+0000 7f914aa82740 1 -- start start 2024-09-19T08:47:36.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.777+0000 7f914aa82740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5a47615d0 0x55e5a475de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:36.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.777+0000 7f914aa82740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a4762b40 0x55e5a4778280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:36.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.777+0000 7f914aa82740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5a476c370 0x55e5a4764120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:36.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.777+0000 7f914aa82740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f91401b23d0 con 0x55e5a4762b40 2024-09-19T08:47:36.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.777+0000 7f914aa82740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f91401afca0 con 0x55e5a47615d0 2024-09-19T08:47:36.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.777+0000 7f914aa82740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f91401adaf0 con 0x55e5a476c370 2024-09-19T08:47:36.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.777+0000 7f9145c44640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a4762b40 0x55e5a4778280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:36.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.777+0000 7f9145c44640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a4762b40 0x55e5a4778280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58216/0 (socket says 172.21.15.7:58216) 2024-09-19T08:47:36.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.777+0000 7f9145c44640 1 -- 172.21.15.7:0/2592475176 learned_addr learned my addr 172.21.15.7:0/2592475176 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:36.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.778+0000 7f9146445640 1 --2- 172.21.15.7:0/2592475176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5a47615d0 0x55e5a475de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:36.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.778+0000 7f9146c46640 1 --2- 172.21.15.7:0/2592475176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5a476c370 0x55e5a4764120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:36.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.778+0000 7f9145c44640 1 -- 172.21.15.7:0/2592475176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5a476c370 msgr2=0x55e5a4764120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:36.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.778+0000 7f9145c44640 1 --2- 172.21.15.7:0/2592475176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5a476c370 0x55e5a4764120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.778+0000 7f9145c44640 1 -- 172.21.15.7:0/2592475176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5a47615d0 msgr2=0x55e5a475de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:36.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.778+0000 7f9145c44640 1 --2- 172.21.15.7:0/2592475176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5a47615d0 0x55e5a475de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.778+0000 7f9145c44640 1 -- 172.21.15.7:0/2592475176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5a4767510 con 0x55e5a4762b40 2024-09-19T08:47:36.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.778+0000 7f9145c44640 1 --2- 172.21.15.7:0/2592475176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a4762b40 0x55e5a4778280 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f913001ba90 tx=0x7f9130003e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df0308f7048ce86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:36.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.778+0000 7f912bfff640 1 -- 172.21.15.7:0/2592475176 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130030070 con 0x55e5a4762b40 2024-09-19T08:47:36.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.778+0000 7f912bfff640 1 -- 172.21.15.7:0/2592475176 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91300053c0 con 0x55e5a4762b40 2024-09-19T08:47:36.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.778+0000 7f912bfff640 1 -- 172.21.15.7:0/2592475176 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130027040 con 0x55e5a4762b40 2024-09-19T08:47:36.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.779+0000 7f914aa82740 1 -- 172.21.15.7:0/2592475176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a4762b40 msgr2=0x55e5a4778280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:36.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.779+0000 7f914aa82740 1 --2- 172.21.15.7:0/2592475176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a4762b40 0x55e5a4778280 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f913001ba90 tx=0x7f9130003e20 comp rx=0 tx=0).stop 2024-09-19T08:47:36.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.779+0000 7f914aa82740 1 -- 172.21.15.7:0/2592475176 shutdown_connections 2024-09-19T08:47:36.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.779+0000 7f914aa82740 1 --2- 172.21.15.7:0/2592475176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5a476c370 0x55e5a4764120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.779+0000 7f914aa82740 1 --2- 172.21.15.7:0/2592475176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a4762b40 0x55e5a4778280 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.779+0000 7f914aa82740 1 --2- 172.21.15.7:0/2592475176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5a47615d0 0x55e5a475de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.779+0000 7f914aa82740 1 -- 172.21.15.7:0/2592475176 >> 172.21.15.7:0/2592475176 conn(0x55e5a472a310 msgr2=0x55e5a475d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:36.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.779+0000 7f914aa82740 1 -- 172.21.15.7:0/2592475176 shutdown_connections 2024-09-19T08:47:36.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.779+0000 7f914aa82740 1 -- 172.21.15.7:0/2592475176 wait complete. 2024-09-19T08:47:36.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.779+0000 7f914aa82740 1 -- start start 2024-09-19T08:47:36.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.779+0000 7f914aa82740 1 Processor -- start 2024-09-19T08:47:36.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.779+0000 7f914aa82740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5a47615d0 0x55e5a4774710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:36.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.779+0000 7f914aa82740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a4762b40 0x55e5a4774c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:36.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.779+0000 7f914aa82740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5a476c370 0x55e5a4765a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:36.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.779+0000 7f914aa82740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f91401ae160 con 0x55e5a4762b40 2024-09-19T08:47:36.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.779+0000 7f914aa82740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f91401af5d0 con 0x55e5a476c370 2024-09-19T08:47:36.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.779+0000 7f914aa82740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f91401ae830 con 0x55e5a47615d0 2024-09-19T08:47:36.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.779+0000 7f9145c44640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a4762b40 0x55e5a4774c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:36.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.779+0000 7f914aa82740 10 client.0 _ll_register_callbacks cb 0x7f9130004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:47:36.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.780+0000 7f9145c44640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a4762b40 0x55e5a4774c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58218/0 (socket says 172.21.15.7:58218) 2024-09-19T08:47:36.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.780+0000 7f9145c44640 1 -- 172.21.15.7:0/2957706700 learned_addr learned my addr 172.21.15.7:0/2957706700 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:36.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.780+0000 7f9146445640 1 --2- 172.21.15.7:0/2957706700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5a47615d0 0x55e5a4774710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:36.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.780+0000 7f9146c46640 1 --2- 172.21.15.7:0/2957706700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5a476c370 0x55e5a4765a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:36.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.780+0000 7f9145c44640 1 -- 172.21.15.7:0/2957706700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5a47615d0 msgr2=0x55e5a4774710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:36.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.780+0000 7f9145c44640 1 --2- 172.21.15.7:0/2957706700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5a47615d0 0x55e5a4774710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.780+0000 7f9145c44640 1 -- 172.21.15.7:0/2957706700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5a476c370 msgr2=0x55e5a4765a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:36.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.780+0000 7f9145c44640 1 --2- 172.21.15.7:0/2957706700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5a476c370 0x55e5a4765a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.780+0000 7f9145c44640 1 -- 172.21.15.7:0/2957706700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5a4766250 con 0x55e5a4762b40 2024-09-19T08:47:36.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.780+0000 7f9145c44640 1 --2- 172.21.15.7:0/2957706700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a4762b40 0x55e5a4774c50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x55e5a4752290 tx=0x7f9130003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7b8fc08c4969c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:36.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.780+0000 7f9129ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:47:36.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.780+0000 7f9129ffb640 1 -- 172.21.15.7:0/2957706700 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130027070 con 0x55e5a4762b40 2024-09-19T08:47:36.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.780+0000 7f9129ffb640 1 -- 172.21.15.7:0/2957706700 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f913001b470 con 0x55e5a4762b40 2024-09-19T08:47:36.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.780+0000 7f914aa82740 1 -- 172.21.15.7:0/2957706700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91300053c0 con 0x55e5a4762b40 2024-09-19T08:47:36.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.780+0000 7f9129ffb640 1 -- 172.21.15.7:0/2957706700 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9130030070 con 0x55e5a4762b40 2024-09-19T08:47:36.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.780+0000 7f914aa82740 10 client.16008 fetch_fsmap learned FSMap version 25 2024-09-19T08:47:36.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.780+0000 7f914aa82740 1 -- 172.21.15.7:0/2957706700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e5a47e6890 con 0x55e5a4762b40 2024-09-19T08:47:36.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.781+0000 7f9129ffb640 1 -- 172.21.15.7:0/2957706700 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91300053c0 con 0x55e5a4762b40 2024-09-19T08:47:36.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.781+0000 7f9129ffb640 1 -- 172.21.15.7:0/2957706700 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f913003d620 con 0x55e5a4762b40 2024-09-19T08:47:36.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.781+0000 7f914aa82740 10 client.16008 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:47:36.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.781+0000 7f914aa82740 10 client.16008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:47:36.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.781+0000 7f914aa82740 20 client.16008 populate_metadata read hostname 'smithi007' 2024-09-19T08:47:36.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.781+0000 7f914aa82740 1 --2- 172.21.15.7:0/2957706700 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e5a47e6ee0 0x55e5a47e92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:36.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.781+0000 7f914aa82740 4 client.16008 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:47:36.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.781+0000 7f914aa82740 1 -- 172.21.15.7:0/2957706700 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e5a46ced70 con 0x55e5a47e6ee0 2024-09-19T08:47:36.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.781+0000 7f9146445640 1 --2- 172.21.15.7:0/2957706700 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e5a47e6ee0 0x55e5a47e92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:36.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.782+0000 7f9146445640 1 --2- 172.21.15.7:0/2957706700 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e5a47e6ee0 0x55e5a47e92d0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=232af2802482405f server_cookie=f2d85ba6e974be82 in_seq=0 out_seq=0 2024-09-19T08:47:36.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.782+0000 7f9129ffb640 10 client.16008 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:47:36.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.782+0000 7f9129ffb640 1 -- 172.21.15.7:0/2957706700 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e5a46ced70 con 0x55e5a47e6ee0 2024-09-19T08:47:36.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.782+0000 7f9129ffb640 10 client.16008 handle_command_reply: tid=0 2024-09-19T08:47:36.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.782+0000 7f914aa82740 1 client.16008 shutdown 2024-09-19T08:47:36.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.782+0000 7f914aa82740 1 -- 172.21.15.7:0/2957706700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a4762b40 msgr2=0x55e5a4774c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:36.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.782+0000 7f914aa82740 1 --2- 172.21.15.7:0/2957706700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a4762b40 0x55e5a4774c50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x55e5a4752290 tx=0x7f9130003a50 comp rx=0 tx=0).stop 2024-09-19T08:47:36.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.782+0000 7f914aa82740 1 -- 172.21.15.7:0/2957706700 shutdown_connections 2024-09-19T08:47:36.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.782+0000 7f914aa82740 1 --2- 172.21.15.7:0/2957706700 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e5a47e6ee0 0x55e5a47e92d0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.782+0000 7f914aa82740 1 --2- 172.21.15.7:0/2957706700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5a476c370 0x55e5a4765a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.782+0000 7f914aa82740 1 --2- 172.21.15.7:0/2957706700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5a4762b40 0x55e5a4774c50 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.782+0000 7f914aa82740 1 --2- 172.21.15.7:0/2957706700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5a47615d0 0x55e5a4774710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.782+0000 7f914aa82740 1 -- 172.21.15.7:0/2957706700 >> 172.21.15.7:0/2957706700 conn(0x55e5a472a310 msgr2=0x55e5a476a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:36.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.782+0000 7f9129ffb640 0 client.16008 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:47:36.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.782+0000 7f914aa82740 1 -- 172.21.15.7:0/2957706700 shutdown_connections 2024-09-19T08:47:36.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.782+0000 7f914aa82740 1 -- 172.21.15.7:0/2957706700 wait complete. 2024-09-19T08:47:36.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.782+0000 7f914aa82740 20 client.16008 trim_cache size 0 max 16384 2024-09-19T08:47:36.790 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:47:36.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.783+0000 7f91486a9640 1 -- 172.21.15.7:0/3253937924 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f912c0a3430 msgr2=0x7f912c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:36.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.783+0000 7f91486a9640 1 --2- 172.21.15.7:0/3253937924 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f912c0a3430 0x7f912c0a58f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9138009430 tx=0x7f913803c040 comp rx=0 tx=0).stop 2024-09-19T08:47:36.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.783+0000 7f91486a9640 1 -- 172.21.15.7:0/3253937924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9140102de0 msgr2=0x7f9140100a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:36.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.783+0000 7f91486a9640 1 --2- 172.21.15.7:0/3253937924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9140102de0 0x7f9140100a40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f913c00d950 tx=0x7f913c00de10 comp rx=0 tx=0).stop 2024-09-19T08:47:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.783+0000 7f91486a9640 1 -- 172.21.15.7:0/3253937924 shutdown_connections 2024-09-19T08:47:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.783+0000 7f91486a9640 1 --2- 172.21.15.7:0/3253937924 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f912c0a3430 0x7f912c0a58f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.783+0000 7f91486a9640 1 --2- 172.21.15.7:0/3253937924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f914010c180 0x7f91401014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.783+0000 7f91486a9640 1 --2- 172.21.15.7:0/3253937924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9140103700 0x7f9140100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.783+0000 7f91486a9640 1 --2- 172.21.15.7:0/3253937924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9140102de0 0x7f9140100a40 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.783+0000 7f91486a9640 1 -- 172.21.15.7:0/3253937924 >> 172.21.15.7:0/3253937924 conn(0x7f91400fc7a0 msgr2=0x7f91400fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.783+0000 7f91486a9640 1 -- 172.21.15.7:0/3253937924 shutdown_connections 2024-09-19T08:47:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:36.783+0000 7f91486a9640 1 -- 172.21.15.7:0/3253937924 wait complete. 2024-09-19T08:47:38.473 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:47:38.474 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:47:38.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:38 smithi175 ceph-mon[35688]: pgmap v96: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 18 MiB/s wr, 772 op/s 2024-09-19T08:47:38.742 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:47:38.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:38 smithi007 ceph-mon[31221]: pgmap v96: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 18 MiB/s wr, 772 op/s 2024-09-19T08:47:38.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:38 smithi044 ceph-mon[35072]: pgmap v96: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 18 MiB/s wr, 772 op/s 2024-09-19T08:47:39.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.215+0000 7f9212a38640 1 -- 172.21.15.7:0/491257925 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f920c106f10 msgr2=0x7f920c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:39.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.215+0000 7f9212a38640 1 --2- 172.21.15.7:0/491257925 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f920c106f10 0x7f920c10ea90 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9204009ca0 tx=0x7f920402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.215+0000 7f9212a38640 1 -- 172.21.15.7:0/491257925 shutdown_connections 2024-09-19T08:47:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.215+0000 7f9212a38640 1 --2- 172.21.15.7:0/491257925 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f920c106f10 0x7f920c10ea90 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.215+0000 7f9212a38640 1 --2- 172.21.15.7:0/491257925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f920c102790 0x7f920c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.215+0000 7f9212a38640 1 --2- 172.21.15.7:0/491257925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f920c101de0 0x7f920c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.215+0000 7f9212a38640 1 -- 172.21.15.7:0/491257925 >> 172.21.15.7:0/491257925 conn(0x7f920c0fd8c0 msgr2=0x7f920c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.215+0000 7f9212a38640 1 -- 172.21.15.7:0/491257925 shutdown_connections 2024-09-19T08:47:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.215+0000 7f9212a38640 1 -- 172.21.15.7:0/491257925 wait complete. 2024-09-19T08:47:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.216+0000 7f9212a38640 1 Processor -- start 2024-09-19T08:47:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.216+0000 7f9212a38640 1 -- start start 2024-09-19T08:47:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.216+0000 7f9212a38640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f920c101de0 0x7f920c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.216+0000 7f9212a38640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f920c102790 0x7f920c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.216+0000 7f9212a38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f920c106f10 0x7f920c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.216+0000 7f9212a38640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f920c111f70 con 0x7f920c106f10 2024-09-19T08:47:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.216+0000 7f9212a38640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f920c111df0 con 0x7f920c102790 2024-09-19T08:47:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.216+0000 7f9212a38640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f920c1120f0 con 0x7f920c101de0 2024-09-19T08:47:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.216+0000 7f9210fd5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f920c106f10 0x7f920c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.216+0000 7f9210fd5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f920c106f10 0x7f920c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58238/0 (socket says 172.21.15.7:58238) 2024-09-19T08:47:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.216+0000 7f9210fd5640 1 -- 172.21.15.7:0/310172332 learned_addr learned my addr 172.21.15.7:0/310172332 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.216+0000 7f920b7fe640 1 --2- 172.21.15.7:0/310172332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f920c102790 0x7f920c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.216+0000 7f920bfff640 1 --2- 172.21.15.7:0/310172332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f920c101de0 0x7f920c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.217+0000 7f9210fd5640 1 -- 172.21.15.7:0/310172332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f920c101de0 msgr2=0x7f920c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:39.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.217+0000 7f9210fd5640 1 --2- 172.21.15.7:0/310172332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f920c101de0 0x7f920c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.217+0000 7f9210fd5640 1 -- 172.21.15.7:0/310172332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f920c102790 msgr2=0x7f920c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:39.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.217+0000 7f9210fd5640 1 --2- 172.21.15.7:0/310172332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f920c102790 0x7f920c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.217+0000 7f9210fd5640 1 -- 172.21.15.7:0/310172332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920c1a6890 con 0x7f920c106f10 2024-09-19T08:47:39.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.217+0000 7f9210fd5640 1 --2- 172.21.15.7:0/310172332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f920c106f10 0x7f920c074f70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9204031a20 tx=0x7f9204031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:39.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.217+0000 7f92097fa640 1 -- 172.21.15.7:0/310172332 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9204003c30 con 0x7f920c106f10 2024-09-19T08:47:39.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.217+0000 7f9212a38640 1 -- 172.21.15.7:0/310172332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f920c1a6b20 con 0x7f920c106f10 2024-09-19T08:47:39.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.217+0000 7f92097fa640 1 -- 172.21.15.7:0/310172332 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9204003dd0 con 0x7f920c106f10 2024-09-19T08:47:39.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.217+0000 7f92097fa640 1 -- 172.21.15.7:0/310172332 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920402fc40 con 0x7f920c106f10 2024-09-19T08:47:39.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.217+0000 7f9212a38640 1 -- 172.21.15.7:0/310172332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f920c1a7060 con 0x7f920c106f10 2024-09-19T08:47:39.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.219+0000 7f92097fa640 1 -- 172.21.15.7:0/310172332 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f9204004050 con 0x7f920c106f10 2024-09-19T08:47:39.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.219+0000 7f9214e11740 1 Processor -- start 2024-09-19T08:47:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.219+0000 7f9214e11740 1 -- start start 2024-09-19T08:47:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.220+0000 7f9214e11740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c47401eb60 0x55c47401ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.220+0000 7f9214e11740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c47401f480 0x55c474029800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.220+0000 7f9214e11740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c474029d40 0x55c47402c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:39.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.220+0000 7f9214e11740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c473f84280 con 0x55c47401eb60 2024-09-19T08:47:39.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.220+0000 7f9214e11740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c473f2bb10 con 0x55c47401f480 2024-09-19T08:47:39.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.220+0000 7f9214e11740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c473f80240 con 0x55c474029d40 2024-09-19T08:47:39.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.220+0000 7f920b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c47401eb60 0x55c47401ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:39.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.220+0000 7f920b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c47401eb60 0x55c47401ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58254/0 (socket says 172.21.15.7:58254) 2024-09-19T08:47:39.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.220+0000 7f920b7fe640 1 -- 172.21.15.7:0/155749546 learned_addr learned my addr 172.21.15.7:0/155749546 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:39.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.220+0000 7f920bfff640 1 --2- 172.21.15.7:0/155749546 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c47401f480 0x55c474029800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:39.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.220+0000 7f92097fa640 1 --2- 172.21.15.7:0/310172332 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f91f40a33b0 0x7f91f40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:39.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.220+0000 7f920b7fe640 1 --2- 172.21.15.7:0/155749546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c474029d40 0x55c47402c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:39.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.220+0000 7f9210fd5640 1 --2- 172.21.15.7:0/310172332 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f91f40a33b0 0x7f91f40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:39.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.220+0000 7f920b7fe640 1 -- 172.21.15.7:0/155749546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c474029d40 msgr2=0x55c47402c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:39.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.220+0000 7f920b7fe640 1 --2- 172.21.15.7:0/155749546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c474029d40 0x55c47402c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.220+0000 7f920b7fe640 1 -- 172.21.15.7:0/155749546 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c47401f480 msgr2=0x55c474029800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:39.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.220+0000 7f920b7fe640 1 --2- 172.21.15.7:0/155749546 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c47401f480 0x55c474029800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.220+0000 7f920b7fe640 1 -- 172.21.15.7:0/155749546 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c473f381f0 con 0x55c47401eb60 2024-09-19T08:47:39.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.220+0000 7f92097fa640 1 -- 172.21.15.7:0/310172332 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f92040f0e60 con 0x7f920c106f10 2024-09-19T08:47:39.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.220+0000 7f920b7fe640 1 --2- 172.21.15.7:0/155749546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c47401eb60 0x55c47401ef40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f92000058a0 tx=0x7f920000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa44c82a0a532cfd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:39.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.221+0000 7f91f27fc640 1 -- 172.21.15.7:0/155749546 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9200004030 con 0x55c47401eb60 2024-09-19T08:47:39.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.221+0000 7f9210fd5640 1 --2- 172.21.15.7:0/310172332 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f91f40a33b0 0x7f91f40a5870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f92040eeba0 tx=0x7f920408f290 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:39.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.221+0000 7f91f27fc640 1 -- 172.21.15.7:0/155749546 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92000041d0 con 0x55c47401eb60 2024-09-19T08:47:39.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.221+0000 7f91f27fc640 1 -- 172.21.15.7:0/155749546 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920000f6e0 con 0x55c47401eb60 2024-09-19T08:47:39.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.221+0000 7f9214e11740 1 -- 172.21.15.7:0/155749546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c47401eb60 msgr2=0x55c47401ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:39.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.221+0000 7f9214e11740 1 --2- 172.21.15.7:0/155749546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c47401eb60 0x55c47401ef40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f92000058a0 tx=0x7f920000b7c0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.221+0000 7f9214e11740 1 -- 172.21.15.7:0/155749546 shutdown_connections 2024-09-19T08:47:39.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.221+0000 7f9214e11740 1 --2- 172.21.15.7:0/155749546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c474029d40 0x55c47402c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.221+0000 7f9214e11740 1 --2- 172.21.15.7:0/155749546 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c47401f480 0x55c474029800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.221+0000 7f9214e11740 1 --2- 172.21.15.7:0/155749546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c47401eb60 0x55c47401ef40 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.221+0000 7f9214e11740 1 -- 172.21.15.7:0/155749546 >> 172.21.15.7:0/155749546 conn(0x55c47401b0f0 msgr2=0x55c47401b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:39.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.221+0000 7f9214e11740 1 -- 172.21.15.7:0/155749546 shutdown_connections 2024-09-19T08:47:39.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.221+0000 7f9214e11740 1 -- 172.21.15.7:0/155749546 wait complete. 2024-09-19T08:47:39.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.222+0000 7f9214e11740 1 -- start start 2024-09-19T08:47:39.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.222+0000 7f9214e11740 1 Processor -- start 2024-09-19T08:47:39.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.222+0000 7f9214e11740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c47401eb60 0x55c474026bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:39.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.222+0000 7f9214e11740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c47401f480 0x55c474027100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:39.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.223+0000 7f9214e11740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c474029d40 0x55c474027640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:39.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.223+0000 7f9214e11740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c47402c910 con 0x55c474029d40 2024-09-19T08:47:39.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.223+0000 7f9214e11740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c473f3ef10 con 0x55c47401f480 2024-09-19T08:47:39.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.223+0000 7f9214e11740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c47402ca90 con 0x55c47401eb60 2024-09-19T08:47:39.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.223+0000 7f9214e11740 10 client.0 _ll_register_callbacks cb 0x55c473f07a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:47:39.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.223+0000 7f920b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c474029d40 0x55c474027640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:39.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.223+0000 7f920b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c474029d40 0x55c474027640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58260/0 (socket says 172.21.15.7:58260) 2024-09-19T08:47:39.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.223+0000 7f920b7fe640 1 -- 172.21.15.7:0/710831969 learned_addr learned my addr 172.21.15.7:0/710831969 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:39.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.223+0000 7f920b7fe640 1 --2- 172.21.15.7:0/710831969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c47401eb60 0x55c474026bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:39.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.223+0000 7f920bfff640 1 --2- 172.21.15.7:0/710831969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c47401f480 0x55c474027100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:39.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.223+0000 7f920b7fe640 1 -- 172.21.15.7:0/710831969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c47401eb60 msgr2=0x55c474026bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:39.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.223+0000 7f920b7fe640 1 --2- 172.21.15.7:0/710831969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c47401eb60 0x55c474026bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.223+0000 7f920b7fe640 1 -- 172.21.15.7:0/710831969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c47401f480 msgr2=0x55c474027100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:39.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.223+0000 7f920b7fe640 1 --2- 172.21.15.7:0/710831969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c47401f480 0x55c474027100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.223+0000 7f920b7fe640 1 -- 172.21.15.7:0/710831969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c473cf56a0 con 0x55c474029d40 2024-09-19T08:47:39.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.223+0000 7f920b7fe640 1 --2- 172.21.15.7:0/710831969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c474029d40 0x55c474027640 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f920000b8b0 tx=0x7f9200003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4293017279a724 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:39.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.223+0000 7f91eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:47:39.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.224+0000 7f91eb7fe640 1 -- 172.21.15.7:0/710831969 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9200004440 con 0x55c474029d40 2024-09-19T08:47:39.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.224+0000 7f91eb7fe640 1 -- 172.21.15.7:0/710831969 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f92000035f0 con 0x55c474029d40 2024-09-19T08:47:39.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.224+0000 7f9214e11740 1 -- 172.21.15.7:0/710831969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92000041d0 con 0x55c474029d40 2024-09-19T08:47:39.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.224+0000 7f91eb7fe640 1 -- 172.21.15.7:0/710831969 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9200003810 con 0x55c474029d40 2024-09-19T08:47:39.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.224+0000 7f9214e11740 10 client.16020 fetch_fsmap learned FSMap version 25 2024-09-19T08:47:39.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.224+0000 7f9214e11740 1 -- 172.21.15.7:0/710831969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c4740384c0 con 0x55c474029d40 2024-09-19T08:47:39.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.224+0000 7f91eb7fe640 1 -- 172.21.15.7:0/710831969 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92000041d0 con 0x55c474029d40 2024-09-19T08:47:39.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.224+0000 7f91eb7fe640 1 -- 172.21.15.7:0/710831969 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f920001d070 con 0x55c474029d40 2024-09-19T08:47:39.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.224+0000 7f9214e11740 10 client.16020 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:47:39.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.224+0000 7f9214e11740 10 client.16020 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:47:39.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.224+0000 7f9214e11740 20 client.16020 populate_metadata read hostname 'smithi007' 2024-09-19T08:47:39.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.224+0000 7f9214e11740 1 --2- 172.21.15.7:0/710831969 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c474039810 0x55c47403bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:39.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.224+0000 7f9214e11740 4 client.16020 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:47:39.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.224+0000 7f9214e11740 1 -- 172.21.15.7:0/710831969 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c473f917f0 con 0x55c474039810 2024-09-19T08:47:39.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.225+0000 7f920bfff640 1 --2- 172.21.15.7:0/710831969 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c474039810 0x55c47403bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:39.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.225+0000 7f920bfff640 1 --2- 172.21.15.7:0/710831969 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c474039810 0x55c47403bc00 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef8a5ba18ae5e907 server_cookie=e6cbd9358716e8d7 in_seq=0 out_seq=0 2024-09-19T08:47:39.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.225+0000 7f91eb7fe640 10 client.16020 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:47:39.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.226+0000 7f91eb7fe640 1 -- 172.21.15.7:0/710831969 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c473f917f0 con 0x55c474039810 2024-09-19T08:47:39.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.226+0000 7f91eb7fe640 10 client.16020 handle_command_reply: tid=0 2024-09-19T08:47:39.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.226+0000 7f9214e11740 1 client.16020 shutdown 2024-09-19T08:47:39.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.226+0000 7f9214e11740 1 -- 172.21.15.7:0/710831969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c474029d40 msgr2=0x55c474027640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:39.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.226+0000 7f9214e11740 1 --2- 172.21.15.7:0/710831969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c474029d40 0x55c474027640 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f920000b8b0 tx=0x7f9200003d80 comp rx=0 tx=0).stop 2024-09-19T08:47:39.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.226+0000 7f9214e11740 1 -- 172.21.15.7:0/710831969 shutdown_connections 2024-09-19T08:47:39.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.226+0000 7f9214e11740 1 --2- 172.21.15.7:0/710831969 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c474039810 0x55c47403bc00 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.226+0000 7f9214e11740 1 --2- 172.21.15.7:0/710831969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c474029d40 0x55c474027640 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.226+0000 7f9214e11740 1 --2- 172.21.15.7:0/710831969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c47401f480 0x55c474027100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.226+0000 7f9214e11740 1 --2- 172.21.15.7:0/710831969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c47401eb60 0x55c474026bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.226+0000 7f9214e11740 1 -- 172.21.15.7:0/710831969 >> 172.21.15.7:0/710831969 conn(0x55c47401b0f0 msgr2=0x55c474020e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:39.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.226+0000 7f91eb7fe640 0 client.16020 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:47:39.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.226+0000 7f9214e11740 1 -- 172.21.15.7:0/710831969 shutdown_connections 2024-09-19T08:47:39.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.226+0000 7f9214e11740 1 -- 172.21.15.7:0/710831969 wait complete. 2024-09-19T08:47:39.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.226+0000 7f9214e11740 20 client.16020 trim_cache size 0 max 16384 2024-09-19T08:47:39.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.244+0000 7f9214e11740 1 Processor -- start 2024-09-19T08:47:39.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.244+0000 7f9214e11740 1 -- start start 2024-09-19T08:47:39.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.244+0000 7f9214e11740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c47401eb60 0x55c4740215c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:39.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.244+0000 7f9214e11740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c47401f480 0x55c47401a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:39.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.244+0000 7f9214e11740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c474029d40 0x55c474041430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:39.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.244+0000 7f9214e11740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f920c1b2330 con 0x55c47401f480 2024-09-19T08:47:39.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.244+0000 7f9214e11740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f920c1afc00 con 0x55c474029d40 2024-09-19T08:47:39.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.244+0000 7f9214e11740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f920c1ada50 con 0x55c47401eb60 2024-09-19T08:47:39.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.244+0000 7f920bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c47401f480 0x55c47401a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:39.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.244+0000 7f920bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c47401f480 0x55c47401a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58276/0 (socket says 172.21.15.7:58276) 2024-09-19T08:47:39.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.244+0000 7f920bfff640 1 -- 172.21.15.7:0/3593894674 learned_addr learned my addr 172.21.15.7:0/3593894674 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:39.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.244+0000 7f920b7fe640 1 --2- 172.21.15.7:0/3593894674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c474029d40 0x55c474041430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:39.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.244+0000 7f920b7fe640 1 --2- 172.21.15.7:0/3593894674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c47401eb60 0x55c4740215c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:39.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.245+0000 7f920bfff640 1 -- 172.21.15.7:0/3593894674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c47401eb60 msgr2=0x55c4740215c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:39.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.245+0000 7f920bfff640 1 --2- 172.21.15.7:0/3593894674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c47401eb60 0x55c4740215c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.245+0000 7f920bfff640 1 -- 172.21.15.7:0/3593894674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c474029d40 msgr2=0x55c474041430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:39.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.245+0000 7f920bfff640 1 --2- 172.21.15.7:0/3593894674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c474029d40 0x55c474041430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.245+0000 7f920bfff640 1 -- 172.21.15.7:0/3593894674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c47401f2b0 con 0x55c47401f480 2024-09-19T08:47:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.245+0000 7f920bfff640 1 --2- 172.21.15.7:0/3593894674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c47401f480 0x55c47401a160 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x55c47401bf50 tx=0x7f91fc005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d480e8686434122c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.245+0000 7f91f1ffb640 1 -- 172.21.15.7:0/3593894674 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc01f630 con 0x55c47401f480 2024-09-19T08:47:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.245+0000 7f91f1ffb640 1 -- 172.21.15.7:0/3593894674 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91fc012e50 con 0x55c47401f480 2024-09-19T08:47:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.245+0000 7f91f1ffb640 1 -- 172.21.15.7:0/3593894674 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc027d50 con 0x55c47401f480 2024-09-19T08:47:39.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.246+0000 7f9214e11740 1 -- 172.21.15.7:0/3593894674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c47401f480 msgr2=0x55c47401a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:39.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.246+0000 7f9214e11740 1 --2- 172.21.15.7:0/3593894674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c47401f480 0x55c47401a160 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x55c47401bf50 tx=0x7f91fc005f90 comp rx=0 tx=0).stop 2024-09-19T08:47:39.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.246+0000 7f9214e11740 1 -- 172.21.15.7:0/3593894674 shutdown_connections 2024-09-19T08:47:39.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.246+0000 7f9214e11740 1 --2- 172.21.15.7:0/3593894674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c474029d40 0x55c474041430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.246+0000 7f9214e11740 1 --2- 172.21.15.7:0/3593894674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c47401f480 0x55c47401a160 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.246+0000 7f9214e11740 1 --2- 172.21.15.7:0/3593894674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c47401eb60 0x55c4740215c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.246+0000 7f9214e11740 1 -- 172.21.15.7:0/3593894674 >> 172.21.15.7:0/3593894674 conn(0x55c47401b0f0 msgr2=0x55c474019a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:39.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.246+0000 7f9214e11740 1 -- 172.21.15.7:0/3593894674 shutdown_connections 2024-09-19T08:47:39.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.246+0000 7f9214e11740 1 -- 172.21.15.7:0/3593894674 wait complete. 2024-09-19T08:47:39.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.246+0000 7f9214e11740 1 -- start start 2024-09-19T08:47:39.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.246+0000 7f9214e11740 1 Processor -- start 2024-09-19T08:47:39.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.247+0000 7f9214e11740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c47401eb60 0x55c474023b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:39.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.247+0000 7f9214e11740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c47401f480 0x55c4740240d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:39.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.247+0000 7f9214e11740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c474029d40 0x55c474024610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:39.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.247+0000 7f9214e11740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f920c1ae0c0 con 0x55c47401f480 2024-09-19T08:47:39.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.247+0000 7f9214e11740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f920c1af530 con 0x55c47401eb60 2024-09-19T08:47:39.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.247+0000 7f9214e11740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f920c1ae790 con 0x55c474029d40 2024-09-19T08:47:39.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.247+0000 7f9214e11740 10 client.0 _ll_register_callbacks cb 0x7f91fc009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:47:39.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.247+0000 7f920bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c47401f480 0x55c4740240d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:39.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.247+0000 7f920bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c47401f480 0x55c4740240d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58282/0 (socket says 172.21.15.7:58282) 2024-09-19T08:47:39.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.247+0000 7f920bfff640 1 -- 172.21.15.7:0/33329030 learned_addr learned my addr 172.21.15.7:0/33329030 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:39.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.247+0000 7f920b7fe640 1 --2- 172.21.15.7:0/33329030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c47401eb60 0x55c474023b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:39.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.247+0000 7f920b7fe640 1 --2- 172.21.15.7:0/33329030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c474029d40 0x55c474024610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:39.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.247+0000 7f920bfff640 1 -- 172.21.15.7:0/33329030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c474029d40 msgr2=0x55c474024610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:39.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.247+0000 7f920bfff640 1 --2- 172.21.15.7:0/33329030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c474029d40 0x55c474024610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.247+0000 7f920bfff640 1 -- 172.21.15.7:0/33329030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c47401eb60 msgr2=0x55c474023b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:39.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.247+0000 7f920bfff640 1 --2- 172.21.15.7:0/33329030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c47401eb60 0x55c474023b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.247+0000 7f920bfff640 1 -- 172.21.15.7:0/33329030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4740a3400 con 0x55c47401f480 2024-09-19T08:47:39.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.247+0000 7f920bfff640 1 --2- 172.21.15.7:0/33329030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c47401f480 0x55c4740240d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x55c47401bf50 tx=0x7f91fc027470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65bb68a3ceb99a5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.247+0000 7f91eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:47:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.247+0000 7f91eb7fe640 1 -- 172.21.15.7:0/33329030 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc027660 con 0x55c47401f480 2024-09-19T08:47:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.248+0000 7f9214e11740 1 -- 172.21.15.7:0/33329030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91fc012e50 con 0x55c47401f480 2024-09-19T08:47:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.248+0000 7f91eb7fe640 1 -- 172.21.15.7:0/33329030 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f91fc027a90 con 0x55c47401f480 2024-09-19T08:47:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.248+0000 7f91eb7fe640 1 -- 172.21.15.7:0/33329030 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f91fc027c90 con 0x55c47401f480 2024-09-19T08:47:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.248+0000 7f9214e11740 10 client.16026 fetch_fsmap learned FSMap version 25 2024-09-19T08:47:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.248+0000 7f9214e11740 1 -- 172.21.15.7:0/33329030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c4740a46e0 con 0x55c47401f480 2024-09-19T08:47:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.248+0000 7f91eb7fe640 1 -- 172.21.15.7:0/33329030 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91fc012e50 con 0x55c47401f480 2024-09-19T08:47:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.248+0000 7f91eb7fe640 1 -- 172.21.15.7:0/33329030 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f91fc004b70 con 0x55c47401f480 2024-09-19T08:47:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.248+0000 7f9214e11740 10 client.16026 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:47:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.248+0000 7f9214e11740 10 client.16026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:47:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.248+0000 7f9214e11740 20 client.16026 populate_metadata read hostname 'smithi007' 2024-09-19T08:47:39.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.248+0000 7f9214e11740 1 --2- 172.21.15.7:0/33329030 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c4740a4d30 0x55c4740a7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.248+0000 7f9214e11740 4 client.16026 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:47:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.248+0000 7f9214e11740 1 -- 172.21.15.7:0/33329030 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c473f8bd00 con 0x55c4740a4d30 2024-09-19T08:47:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.248+0000 7f920b7fe640 1 --2- 172.21.15.7:0/33329030 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c4740a4d30 0x55c4740a7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.249+0000 7f920b7fe640 1 --2- 172.21.15.7:0/33329030 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c4740a4d30 0x55c4740a7150 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3a88972ad111eaa server_cookie=b04fd904d3250c7d in_seq=0 out_seq=0 2024-09-19T08:47:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.249+0000 7f91eb7fe640 10 client.16026 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:47:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.250+0000 7f91eb7fe640 1 -- 172.21.15.7:0/33329030 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c473f8bd00 con 0x55c4740a4d30 2024-09-19T08:47:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.250+0000 7f91eb7fe640 10 client.16026 handle_command_reply: tid=0 2024-09-19T08:47:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.250+0000 7f9214e11740 1 client.16026 shutdown 2024-09-19T08:47:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.250+0000 7f9214e11740 1 -- 172.21.15.7:0/33329030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c47401f480 msgr2=0x55c4740240d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.250+0000 7f9214e11740 1 --2- 172.21.15.7:0/33329030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c47401f480 0x55c4740240d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x55c47401bf50 tx=0x7f91fc027470 comp rx=0 tx=0).stop 2024-09-19T08:47:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.250+0000 7f9214e11740 1 -- 172.21.15.7:0/33329030 shutdown_connections 2024-09-19T08:47:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.250+0000 7f9214e11740 1 --2- 172.21.15.7:0/33329030 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c4740a4d30 0x55c4740a7150 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.250+0000 7f9214e11740 1 --2- 172.21.15.7:0/33329030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c474029d40 0x55c474024610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.250+0000 7f9214e11740 1 --2- 172.21.15.7:0/33329030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c47401f480 0x55c4740240d0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.250+0000 7f9214e11740 1 --2- 172.21.15.7:0/33329030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c47401eb60 0x55c474023b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.250+0000 7f9214e11740 1 -- 172.21.15.7:0/33329030 >> 172.21.15.7:0/33329030 conn(0x55c47401b0f0 msgr2=0x55c4740273a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.250+0000 7f91eb7fe640 0 client.16026 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:47:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.250+0000 7f9214e11740 1 -- 172.21.15.7:0/33329030 shutdown_connections 2024-09-19T08:47:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.250+0000 7f9214e11740 1 -- 172.21.15.7:0/33329030 wait complete. 2024-09-19T08:47:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.250+0000 7f9214e11740 20 client.16026 trim_cache size 0 max 16384 2024-09-19T08:47:39.277 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:47:39.277 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-19T08:47:39.278 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "62418a2e-3076-4e4e-ac15-72ac94fd1fe4", 2024-09-19T08:47:39.278 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-19T08:47:39.278 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:47:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.251+0000 7f9212a38640 1 -- 172.21.15.7:0/310172332 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f91f40a33b0 msgr2=0x7f91f40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.251+0000 7f9212a38640 1 --2- 172.21.15.7:0/310172332 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f91f40a33b0 0x7f91f40a5870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f92040eeba0 tx=0x7f920408f290 comp rx=0 tx=0).stop 2024-09-19T08:47:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.251+0000 7f9212a38640 1 -- 172.21.15.7:0/310172332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f920c106f10 msgr2=0x7f920c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.251+0000 7f9212a38640 1 --2- 172.21.15.7:0/310172332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f920c106f10 0x7f920c074f70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9204031a20 tx=0x7f9204031a50 comp rx=0 tx=0).stop 2024-09-19T08:47:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.251+0000 7f9212a38640 1 -- 172.21.15.7:0/310172332 shutdown_connections 2024-09-19T08:47:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.251+0000 7f9212a38640 1 --2- 172.21.15.7:0/310172332 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f91f40a33b0 0x7f91f40a5870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.251+0000 7f9212a38640 1 --2- 172.21.15.7:0/310172332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f920c106f10 0x7f920c074f70 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.251+0000 7f9212a38640 1 --2- 172.21.15.7:0/310172332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f920c102790 0x7f920c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.251+0000 7f9212a38640 1 --2- 172.21.15.7:0/310172332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f920c101de0 0x7f920c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.251+0000 7f9212a38640 1 -- 172.21.15.7:0/310172332 >> 172.21.15.7:0/310172332 conn(0x7f920c0fd8c0 msgr2=0x7f920c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.251+0000 7f9212a38640 1 -- 172.21.15.7:0/310172332 shutdown_connections 2024-09-19T08:47:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:39.251+0000 7f9212a38640 1 -- 172.21.15.7:0/310172332 wait complete. 2024-09-19T08:47:40.130 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:47:40.390 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:47:40.513 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:40 smithi007 ceph-mon[31221]: pgmap v97: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T08:47:40.513 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:40 smithi007 ceph-mon[31221]: scrub queued for path: / 2024-09-19T08:47:40.513 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:40 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:47:40.513 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:40 smithi007 ceph-mon[31221]: scrub summary: active paths [/] 2024-09-19T08:47:40.513 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:40 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:47:40.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:40 smithi175 ceph-mon[35688]: pgmap v97: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T08:47:40.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:40 smithi175 ceph-mon[35688]: scrub queued for path: / 2024-09-19T08:47:40.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:40 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:47:40.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:40 smithi175 ceph-mon[35688]: scrub summary: active paths [/] 2024-09-19T08:47:40.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:40 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:47:40.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:40 smithi044 ceph-mon[35072]: pgmap v97: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T08:47:40.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:40 smithi044 ceph-mon[35072]: scrub queued for path: / 2024-09-19T08:47:40.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:40 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:47:40.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:40 smithi044 ceph-mon[35072]: scrub summary: active paths [/] 2024-09-19T08:47:40.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:40 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:47:40.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.830+0000 7fc8b7fe1640 1 -- 172.21.15.7:0/2921063657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8b01082a0 msgr2=0x7fc8b010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:40.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.830+0000 7fc8b7fe1640 1 --2- 172.21.15.7:0/2921063657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8b01082a0 0x7fc8b010ec40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009cd0 tx=0x7fc8a802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.830+0000 7fc8b7fe1640 1 -- 172.21.15.7:0/2921063657 shutdown_connections 2024-09-19T08:47:40.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.830+0000 7fc8b7fe1640 1 --2- 172.21.15.7:0/2921063657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8b01082a0 0x7fc8b010ec40 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.830+0000 7fc8b7fe1640 1 --2- 172.21.15.7:0/2921063657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8b01036e0 0x7fc8b0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.830+0000 7fc8b7fe1640 1 --2- 172.21.15.7:0/2921063657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8b0102d30 0x7fc8b0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.830+0000 7fc8b7fe1640 1 -- 172.21.15.7:0/2921063657 >> 172.21.15.7:0/2921063657 conn(0x7fc8b00fc7d0 msgr2=0x7fc8b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:40.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.830+0000 7fc8b7fe1640 1 -- 172.21.15.7:0/2921063657 shutdown_connections 2024-09-19T08:47:40.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.830+0000 7fc8b7fe1640 1 -- 172.21.15.7:0/2921063657 wait complete. 2024-09-19T08:47:40.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.831+0000 7fc8b7fe1640 1 Processor -- start 2024-09-19T08:47:40.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.831+0000 7fc8b7fe1640 1 -- start start 2024-09-19T08:47:40.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.831+0000 7fc8b7fe1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8b0102d30 0x7fc8b0198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.831+0000 7fc8b7fe1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8b01036e0 0x7fc8b0198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.831+0000 7fc8b7fe1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8b01082a0 0x7fc8b019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.831+0000 7fc8b7fe1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b0112100 con 0x7fc8b01036e0 2024-09-19T08:47:40.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.831+0000 7fc8b7fe1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b0111f80 con 0x7fc8b0102d30 2024-09-19T08:47:40.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.831+0000 7fc8b7fe1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b0112280 con 0x7fc8b01082a0 2024-09-19T08:47:40.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.831+0000 7fc8b557c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8b01036e0 0x7fc8b0198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.831+0000 7fc8b557c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8b01036e0 0x7fc8b0198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58292/0 (socket says 172.21.15.7:58292) 2024-09-19T08:47:40.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.831+0000 7fc8b557c640 1 -- 172.21.15.7:0/2932619130 learned_addr learned my addr 172.21.15.7:0/2932619130 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:40.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.831+0000 7fc8b5d7d640 1 --2- 172.21.15.7:0/2932619130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8b0102d30 0x7fc8b0198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.831+0000 7fc8b657e640 1 --2- 172.21.15.7:0/2932619130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8b01082a0 0x7fc8b019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.831+0000 7fc8b557c640 1 -- 172.21.15.7:0/2932619130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8b01082a0 msgr2=0x7fc8b019ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:40.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.831+0000 7fc8b557c640 1 --2- 172.21.15.7:0/2932619130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8b01082a0 0x7fc8b019ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.831+0000 7fc8b557c640 1 -- 172.21.15.7:0/2932619130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8b0102d30 msgr2=0x7fc8b0198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:40.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.831+0000 7fc8b557c640 1 --2- 172.21.15.7:0/2932619130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8b0102d30 0x7fc8b0198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.831+0000 7fc8b557c640 1 -- 172.21.15.7:0/2932619130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b019d540 con 0x7fc8b01036e0 2024-09-19T08:47:40.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.831+0000 7fc8b657e640 1 --2- 172.21.15.7:0/2932619130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8b01082a0 0x7fc8b019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:47:40.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.832+0000 7fc8b557c640 1 --2- 172.21.15.7:0/2932619130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8b01036e0 0x7fc8b0198ad0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000c970 tx=0x7fc8a000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:40.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.832+0000 7fc8a6ffd640 1 -- 172.21.15.7:0/2932619130 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0007bb0 con 0x7fc8b01036e0 2024-09-19T08:47:40.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.832+0000 7fc8a6ffd640 1 -- 172.21.15.7:0/2932619130 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8a0007d50 con 0x7fc8b01036e0 2024-09-19T08:47:40.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.832+0000 7fc8b7fe1640 1 -- 172.21.15.7:0/2932619130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b019d830 con 0x7fc8b01036e0 2024-09-19T08:47:40.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.832+0000 7fc8a6ffd640 1 -- 172.21.15.7:0/2932619130 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a000f450 con 0x7fc8b01036e0 2024-09-19T08:47:40.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.832+0000 7fc8b7fe1640 1 -- 172.21.15.7:0/2932619130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b01a5110 con 0x7fc8b01036e0 2024-09-19T08:47:40.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.834+0000 7fc8a6ffd640 1 -- 172.21.15.7:0/2932619130 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fc8a0004eb0 con 0x7fc8b01036e0 2024-09-19T08:47:40.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.834+0000 7fc8ba3ba740 1 Processor -- start 2024-09-19T08:47:40.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.835+0000 7fc8ba3ba740 1 -- start start 2024-09-19T08:47:40.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.835+0000 7fc8ba3ba740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b05d2eb4a0 0x55b05d2eb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.835+0000 7fc8ba3ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2ebdc0 0x55b05d2f6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.835+0000 7fc8ba3ba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b05d2f6680 0x55b05d2f8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.835+0000 7fc8ba3ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b05d2512e0 con 0x55b05d2ebdc0 2024-09-19T08:47:40.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.835+0000 7fc8ba3ba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b05d1f8ce0 con 0x55b05d2f6680 2024-09-19T08:47:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.835+0000 7fc8ba3ba740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b05d24d2a0 con 0x55b05d2eb4a0 2024-09-19T08:47:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.835+0000 7fc8a6ffd640 1 --2- 172.21.15.7:0/2932619130 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc89c0a3430 0x7fc89c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.835+0000 7fc8b557c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b05d2f6680 0x55b05d2f8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.835+0000 7fc8b657e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b05d2eb4a0 0x55b05d2eb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.835+0000 7fc8b657e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b05d2eb4a0 0x55b05d2eb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.7:42072/0 (socket says 172.21.15.7:42072) 2024-09-19T08:47:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.835+0000 7fc8b657e640 1 -- 172.21.15.7:0/2979597676 learned_addr learned my addr 172.21.15.7:0/2979597676 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.835+0000 7fc8b657e640 1 --2- 172.21.15.7:0/2932619130 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc89c0a3430 0x7fc89c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.835+0000 7fc8a6ffd640 1 -- 172.21.15.7:0/2932619130 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fc8a00cf930 con 0x7fc8b01036e0 2024-09-19T08:47:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.836+0000 7fc8b5d7d640 1 --2- 172.21.15.7:0/2979597676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2ebdc0 0x55b05d2f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.836+0000 7fc8b557c640 1 -- 172.21.15.7:0/2979597676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b05d2eb4a0 msgr2=0x55b05d2eb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.836+0000 7fc8b557c640 1 --2- 172.21.15.7:0/2979597676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b05d2eb4a0 0x55b05d2eb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.836+0000 7fc8b557c640 1 -- 172.21.15.7:0/2979597676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2ebdc0 msgr2=0x55b05d2f6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.836+0000 7fc8b557c640 1 --2- 172.21.15.7:0/2979597676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2ebdc0 0x55b05d2f6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.836+0000 7fc8b557c640 1 -- 172.21.15.7:0/2979597676 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b05d1dd440 con 0x55b05d2f6680 2024-09-19T08:47:40.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.836+0000 7fc8b5d7d640 1 --2- 172.21.15.7:0/2979597676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2ebdc0 0x55b05d2f6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:47:40.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.836+0000 7fc8b657e640 1 --2- 172.21.15.7:0/2932619130 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc89c0a3430 0x7fc89c0a58f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8035000 tx=0x7fc8a80095c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:40.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.836+0000 7fc8b557c640 1 --2- 172.21.15.7:0/2979597676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b05d2f6680 0x55b05d2f8a70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00cd070 tx=0x7fc8a006ea30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93306394cef46a98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:40.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.836+0000 7fc89bfff640 1 -- 172.21.15.7:0/2979597676 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a001d070 con 0x55b05d2f6680 2024-09-19T08:47:40.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.836+0000 7fc89bfff640 1 -- 172.21.15.7:0/2979597676 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8a009c300 con 0x55b05d2f6680 2024-09-19T08:47:40.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.836+0000 7fc89bfff640 1 -- 172.21.15.7:0/2979597676 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0099fd0 con 0x55b05d2f6680 2024-09-19T08:47:40.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.837+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/2979597676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b05d2f6680 msgr2=0x55b05d2f8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:40.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.837+0000 7fc8ba3ba740 1 --2- 172.21.15.7:0/2979597676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b05d2f6680 0x55b05d2f8a70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00cd070 tx=0x7fc8a006ea30 comp rx=0 tx=0).stop 2024-09-19T08:47:40.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.837+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/2979597676 shutdown_connections 2024-09-19T08:47:40.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.837+0000 7fc8ba3ba740 1 --2- 172.21.15.7:0/2979597676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b05d2f6680 0x55b05d2f8a70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.837+0000 7fc8ba3ba740 1 --2- 172.21.15.7:0/2979597676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2ebdc0 0x55b05d2f6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.837+0000 7fc8ba3ba740 1 --2- 172.21.15.7:0/2979597676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b05d2eb4a0 0x55b05d2eb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.837+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/2979597676 >> 172.21.15.7:0/2979597676 conn(0x55b05d2e7a30 msgr2=0x55b05d2e7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:40.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.837+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/2979597676 shutdown_connections 2024-09-19T08:47:40.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.837+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/2979597676 wait complete. 2024-09-19T08:47:40.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.837+0000 7fc8ba3ba740 1 -- start start 2024-09-19T08:47:40.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.837+0000 7fc8ba3ba740 1 Processor -- start 2024-09-19T08:47:40.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.838+0000 7fc8ba3ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2eb4a0 0x55b05d2f6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.838+0000 7fc8ba3ba740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b05d2ebdc0 0x55b05d2f3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.838+0000 7fc8ba3ba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b05d2f6680 0x55b05d2f3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.838+0000 7fc8ba3ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b05d2f9250 con 0x55b05d2eb4a0 2024-09-19T08:47:40.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.838+0000 7fc8ba3ba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b05d20c050 con 0x55b05d2f6680 2024-09-19T08:47:40.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.838+0000 7fc8ba3ba740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b05d2f93d0 con 0x55b05d2ebdc0 2024-09-19T08:47:40.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.838+0000 7fc8ba3ba740 10 client.0 _ll_register_callbacks cb 0x55b05d24c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:47:40.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.838+0000 7fc8b5d7d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2eb4a0 0x55b05d2f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.838+0000 7fc8b5d7d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2eb4a0 0x55b05d2f6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58316/0 (socket says 172.21.15.7:58316) 2024-09-19T08:47:40.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.838+0000 7fc8b5d7d640 1 -- 172.21.15.7:0/3690958007 learned_addr learned my addr 172.21.15.7:0/3690958007 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:40.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.838+0000 7fc8b557c640 1 --2- 172.21.15.7:0/3690958007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b05d2ebdc0 0x55b05d2f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.838+0000 7fc8b657e640 1 --2- 172.21.15.7:0/3690958007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b05d2f6680 0x55b05d2f3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.838+0000 7fc8b5d7d640 1 -- 172.21.15.7:0/3690958007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b05d2ebdc0 msgr2=0x55b05d2f3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:40.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.838+0000 7fc8b5d7d640 1 --2- 172.21.15.7:0/3690958007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b05d2ebdc0 0x55b05d2f3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.838+0000 7fc8b5d7d640 1 -- 172.21.15.7:0/3690958007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b05d2f6680 msgr2=0x55b05d2f3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:40.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.838+0000 7fc8b5d7d640 1 --2- 172.21.15.7:0/3690958007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b05d2f6680 0x55b05d2f3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.838+0000 7fc8b5d7d640 1 -- 172.21.15.7:0/3690958007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b05cfc23c0 con 0x55b05d2eb4a0 2024-09-19T08:47:40.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.838+0000 7fc8b5d7d640 1 --2- 172.21.15.7:0/3690958007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2eb4a0 0x55b05d2f6080 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009fd0 tx=0x7fc8ac0116f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9b33b3fc5467c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:40.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.838+0000 7fc8997fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:47:40.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.839+0000 7fc8997fa640 1 -- 172.21.15.7:0/3690958007 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac019070 con 0x55b05d2eb4a0 2024-09-19T08:47:40.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.839+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/3690958007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8a009c300 con 0x55b05d2eb4a0 2024-09-19T08:47:40.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.839+0000 7fc8997fa640 1 -- 172.21.15.7:0/3690958007 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fc8ac015870 con 0x55b05d2eb4a0 2024-09-19T08:47:40.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.839+0000 7fc8997fa640 1 -- 172.21.15.7:0/3690958007 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc8ac025050 con 0x55b05d2eb4a0 2024-09-19T08:47:40.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.839+0000 7fc8ba3ba740 10 client.16038 fetch_fsmap learned FSMap version 25 2024-09-19T08:47:40.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.839+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/3690958007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b05d304d10 con 0x55b05d2eb4a0 2024-09-19T08:47:40.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.839+0000 7fc8997fa640 1 -- 172.21.15.7:0/3690958007 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8a009c300 con 0x55b05d2eb4a0 2024-09-19T08:47:40.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.839+0000 7fc8997fa640 1 -- 172.21.15.7:0/3690958007 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc8ac014c10 con 0x55b05d2eb4a0 2024-09-19T08:47:40.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.839+0000 7fc8ba3ba740 10 client.16038 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:47:40.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.839+0000 7fc8ba3ba740 10 client.16038 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:47:40.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.839+0000 7fc8ba3ba740 20 client.16038 populate_metadata read hostname 'smithi007' 2024-09-19T08:47:40.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.839+0000 7fc8ba3ba740 1 --2- 172.21.15.7:0/3690958007 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b05d306300 0x55b05d3086f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.839+0000 7fc8ba3ba740 4 client.16038 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:47:40.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.839+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/3690958007 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b05d25e850 con 0x55b05d306300 2024-09-19T08:47:40.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.840+0000 7fc8b557c640 1 --2- 172.21.15.7:0/3690958007 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b05d306300 0x55b05d3086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.840+0000 7fc8b557c640 1 --2- 172.21.15.7:0/3690958007 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b05d306300 0x55b05d3086f0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73d990c651fb2bf5 server_cookie=e428e7a0625d906b in_seq=0 out_seq=0 2024-09-19T08:47:40.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.840+0000 7fc8997fa640 10 client.16038 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:47:40.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.841+0000 7fc8997fa640 1 -- 172.21.15.7:0/3690958007 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b05d25e850 con 0x55b05d306300 2024-09-19T08:47:40.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.841+0000 7fc8997fa640 10 client.16038 handle_command_reply: tid=0 2024-09-19T08:47:40.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.841+0000 7fc8ba3ba740 1 client.16038 shutdown 2024-09-19T08:47:40.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.841+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/3690958007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2eb4a0 msgr2=0x55b05d2f6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:40.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.841+0000 7fc8ba3ba740 1 --2- 172.21.15.7:0/3690958007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2eb4a0 0x55b05d2f6080 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009fd0 tx=0x7fc8ac0116f0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.841+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/3690958007 shutdown_connections 2024-09-19T08:47:40.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.841+0000 7fc8ba3ba740 1 --2- 172.21.15.7:0/3690958007 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b05d306300 0x55b05d3086f0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.841+0000 7fc8ba3ba740 1 --2- 172.21.15.7:0/3690958007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b05d2f6680 0x55b05d2f3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.841+0000 7fc8ba3ba740 1 --2- 172.21.15.7:0/3690958007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b05d2ebdc0 0x55b05d2f3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.841+0000 7fc8997fa640 0 client.16038 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:47:40.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.841+0000 7fc8ba3ba740 1 --2- 172.21.15.7:0/3690958007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2eb4a0 0x55b05d2f6080 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.841+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/3690958007 >> 172.21.15.7:0/3690958007 conn(0x55b05d2e7a30 msgr2=0x55b05d2ed760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:40.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.841+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/3690958007 shutdown_connections 2024-09-19T08:47:40.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.841+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/3690958007 wait complete. 2024-09-19T08:47:40.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.841+0000 7fc8ba3ba740 20 client.16038 trim_cache size 0 max 16384 2024-09-19T08:47:40.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.858+0000 7fc8ba3ba740 1 Processor -- start 2024-09-19T08:47:40.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.858+0000 7fc8ba3ba740 1 -- start start 2024-09-19T08:47:40.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.858+0000 7fc8ba3ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2eb4a0 0x55b05d3024b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.858+0000 7fc8ba3ba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b05d2ebdc0 0x55b05d2f1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.859+0000 7fc8ba3ba740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b05d2f6680 0x55b05d30de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.859+0000 7fc8ba3ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b01ae030 con 0x55b05d2eb4a0 2024-09-19T08:47:40.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.859+0000 7fc8ba3ba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b01ab900 con 0x55b05d2ebdc0 2024-09-19T08:47:40.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.859+0000 7fc8ba3ba740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b01a9750 con 0x55b05d2f6680 2024-09-19T08:47:40.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.859+0000 7fc8b5d7d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2eb4a0 0x55b05d3024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.859+0000 7fc8b5d7d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2eb4a0 0x55b05d3024b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58328/0 (socket says 172.21.15.7:58328) 2024-09-19T08:47:40.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.859+0000 7fc8b5d7d640 1 -- 172.21.15.7:0/2287395260 learned_addr learned my addr 172.21.15.7:0/2287395260 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:40.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.859+0000 7fc8b557c640 1 --2- 172.21.15.7:0/2287395260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b05d2ebdc0 0x55b05d2f1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.859+0000 7fc8b5d7d640 1 -- 172.21.15.7:0/2287395260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b05d2f6680 msgr2=0x55b05d30de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:40.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.859+0000 7fc8b5d7d640 1 --2- 172.21.15.7:0/2287395260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b05d2f6680 0x55b05d30de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.859+0000 7fc8b5d7d640 1 -- 172.21.15.7:0/2287395260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b05d2ebdc0 msgr2=0x55b05d2f1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:40.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.859+0000 7fc8b5d7d640 1 --2- 172.21.15.7:0/2287395260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b05d2ebdc0 0x55b05d2f1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.859+0000 7fc8b5d7d640 1 -- 172.21.15.7:0/2287395260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b05d2f22e0 con 0x55b05d2eb4a0 2024-09-19T08:47:40.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.859+0000 7fc8b5d7d640 1 --2- 172.21.15.7:0/2287395260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2eb4a0 0x55b05d3024b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac000c00 tx=0x7fc8ac009420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f109dad7b84691 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:40.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.859+0000 7fc89b7fe640 1 -- 172.21.15.7:0/2287395260 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac02d020 con 0x55b05d2eb4a0 2024-09-19T08:47:40.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.859+0000 7fc89b7fe640 1 -- 172.21.15.7:0/2287395260 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8ac015b50 con 0x55b05d2eb4a0 2024-09-19T08:47:40.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.859+0000 7fc89b7fe640 1 -- 172.21.15.7:0/2287395260 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac019040 con 0x55b05d2eb4a0 2024-09-19T08:47:40.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.860+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/2287395260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2eb4a0 msgr2=0x55b05d3024b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:40.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.860+0000 7fc8ba3ba740 1 --2- 172.21.15.7:0/2287395260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2eb4a0 0x55b05d3024b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac000c00 tx=0x7fc8ac009420 comp rx=0 tx=0).stop 2024-09-19T08:47:40.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.860+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/2287395260 shutdown_connections 2024-09-19T08:47:40.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.860+0000 7fc8ba3ba740 1 --2- 172.21.15.7:0/2287395260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b05d2f6680 0x55b05d30de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.860+0000 7fc8ba3ba740 1 --2- 172.21.15.7:0/2287395260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b05d2ebdc0 0x55b05d2f1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.860+0000 7fc8ba3ba740 1 --2- 172.21.15.7:0/2287395260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2eb4a0 0x55b05d3024b0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.860+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/2287395260 >> 172.21.15.7:0/2287395260 conn(0x55b05d2e7a30 msgr2=0x55b05d2ee8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:40.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.860+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/2287395260 shutdown_connections 2024-09-19T08:47:40.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.860+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/2287395260 wait complete. 2024-09-19T08:47:40.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.860+0000 7fc8ba3ba740 1 -- start start 2024-09-19T08:47:40.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.860+0000 7fc8ba3ba740 1 Processor -- start 2024-09-19T08:47:40.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.861+0000 7fc8ba3ba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b05d2eb4a0 0x55b05d2fa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.861+0000 7fc8ba3ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2ebdc0 0x55b05d2fac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.861+0000 7fc8ba3ba740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b05d2f6680 0x55b05d36fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.861+0000 7fc8ba3ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b01a9dc0 con 0x55b05d2ebdc0 2024-09-19T08:47:40.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.861+0000 7fc8ba3ba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b01ab230 con 0x55b05d2eb4a0 2024-09-19T08:47:40.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.861+0000 7fc8ba3ba740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b01aa490 con 0x55b05d2f6680 2024-09-19T08:47:40.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.861+0000 7fc8ba3ba740 10 client.0 _ll_register_callbacks cb 0x7fc8ac009500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:47:40.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.861+0000 7fc8b557c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2ebdc0 0x55b05d2fac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.861+0000 7fc8b5d7d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b05d2eb4a0 0x55b05d2fa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.861+0000 7fc8b557c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2ebdc0 0x55b05d2fac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58340/0 (socket says 172.21.15.7:58340) 2024-09-19T08:47:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.861+0000 7fc8b557c640 1 -- 172.21.15.7:0/231999651 learned_addr learned my addr 172.21.15.7:0/231999651 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:47:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.861+0000 7fc8b657e640 1 --2- 172.21.15.7:0/231999651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b05d2f6680 0x55b05d36fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.861+0000 7fc8b557c640 1 -- 172.21.15.7:0/231999651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b05d2f6680 msgr2=0x55b05d36fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.861+0000 7fc8b557c640 1 --2- 172.21.15.7:0/231999651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b05d2f6680 0x55b05d36fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.861+0000 7fc8b557c640 1 -- 172.21.15.7:0/231999651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b05d2eb4a0 msgr2=0x55b05d2fa6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:47:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.861+0000 7fc8b557c640 1 --2- 172.21.15.7:0/231999651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b05d2eb4a0 0x55b05d2fa6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.861+0000 7fc8b557c640 1 -- 172.21.15.7:0/231999651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b05d2fb510 con 0x55b05d2ebdc0 2024-09-19T08:47:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.862+0000 7fc8b557c640 1 --2- 172.21.15.7:0/231999651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2ebdc0 0x55b05d2fac30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00cd670 tx=0x7fc8a00669e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15812e4752378b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.862+0000 7fc8997fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:47:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.862+0000 7fc8997fa640 1 -- 172.21.15.7:0/231999651 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a00b9060 con 0x55b05d2ebdc0 2024-09-19T08:47:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.862+0000 7fc8997fa640 1 -- 172.21.15.7:0/231999651 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fc8a00046c0 con 0x55b05d2ebdc0 2024-09-19T08:47:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.862+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/231999651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8ac015b50 con 0x55b05d2ebdc0 2024-09-19T08:47:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.862+0000 7fc8997fa640 1 -- 172.21.15.7:0/231999651 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc8a006a030 con 0x55b05d2ebdc0 2024-09-19T08:47:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.862+0000 7fc8ba3ba740 10 client.16044 fetch_fsmap learned FSMap version 25 2024-09-19T08:47:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.862+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/231999651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b05d371490 con 0x55b05d2ebdc0 2024-09-19T08:47:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.862+0000 7fc8997fa640 1 -- 172.21.15.7:0/231999651 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8ac015b50 con 0x55b05d2ebdc0 2024-09-19T08:47:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.862+0000 7fc8997fa640 1 -- 172.21.15.7:0/231999651 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc8a0066ce0 con 0x55b05d2ebdc0 2024-09-19T08:47:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.862+0000 7fc8ba3ba740 10 client.16044 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:47:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.862+0000 7fc8ba3ba740 10 client.16044 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:47:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.862+0000 7fc8ba3ba740 20 client.16044 populate_metadata read hostname 'smithi007' 2024-09-19T08:47:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.862+0000 7fc8ba3ba740 1 --2- 172.21.15.7:0/231999651 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b05d371780 0x55b05d373b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.862+0000 7fc8ba3ba740 4 client.16044 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:47:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.862+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/231999651 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b05d258d60 con 0x55b05d371780 2024-09-19T08:47:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.863+0000 7fc8b5d7d640 1 --2- 172.21.15.7:0/231999651 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b05d371780 0x55b05d373b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.863+0000 7fc8b5d7d640 1 --2- 172.21.15.7:0/231999651 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b05d371780 0x55b05d373b70 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6765d240fe3c4e1 server_cookie=f60421943a6480ea in_seq=0 out_seq=0 2024-09-19T08:47:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.863+0000 7fc8997fa640 10 client.16044 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:47:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.863+0000 7fc8997fa640 1 -- 172.21.15.7:0/231999651 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b05d258d60 con 0x55b05d371780 2024-09-19T08:47:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.863+0000 7fc8997fa640 10 client.16044 handle_command_reply: tid=0 2024-09-19T08:47:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.863+0000 7fc8ba3ba740 1 client.16044 shutdown 2024-09-19T08:47:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.863+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/231999651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2ebdc0 msgr2=0x55b05d2fac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.863+0000 7fc8ba3ba740 1 --2- 172.21.15.7:0/231999651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2ebdc0 0x55b05d2fac30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00cd670 tx=0x7fc8a00669e0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.864+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/231999651 shutdown_connections 2024-09-19T08:47:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.864+0000 7fc8ba3ba740 1 --2- 172.21.15.7:0/231999651 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b05d371780 0x55b05d373b70 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.864+0000 7fc8ba3ba740 1 --2- 172.21.15.7:0/231999651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b05d2f6680 0x55b05d36fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.864+0000 7fc8ba3ba740 1 --2- 172.21.15.7:0/231999651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b05d2ebdc0 0x55b05d2fac30 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.864+0000 7fc8ba3ba740 1 --2- 172.21.15.7:0/231999651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b05d2eb4a0 0x55b05d2fa6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.864+0000 7fc8997fa640 0 client.16044 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:47:40.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.864+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/231999651 >> 172.21.15.7:0/231999651 conn(0x55b05d2e7a30 msgr2=0x55b05d2f4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:40.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.864+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/231999651 shutdown_connections 2024-09-19T08:47:40.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.864+0000 7fc8ba3ba740 1 -- 172.21.15.7:0/231999651 wait complete. 2024-09-19T08:47:40.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.864+0000 7fc8ba3ba740 20 client.16044 trim_cache size 0 max 16384 2024-09-19T08:47:40.871 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:47:40.872 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:47:40.872 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-19T08:47:40.872 INFO:teuthology.orchestra.run.smithi007.stdout: "62418a2e-3076-4e4e-ac15-72ac94fd1fe4": { 2024-09-19T08:47:40.872 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-19T08:47:40.872 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "62418a2e-3076-4e4e-ac15-72ac94fd1fe4", 2024-09-19T08:47:40.872 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-19T08:47:40.872 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:47:40.872 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:47:40.872 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:47:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.864+0000 7fc8b7fe1640 1 -- 172.21.15.7:0/2932619130 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc89c0a3430 msgr2=0x7fc89c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.864+0000 7fc8b7fe1640 1 --2- 172.21.15.7:0/2932619130 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc89c0a3430 0x7fc89c0a58f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8035000 tx=0x7fc8a80095c0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.864+0000 7fc8b7fe1640 1 -- 172.21.15.7:0/2932619130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8b01036e0 msgr2=0x7fc8b0198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.864+0000 7fc8b7fe1640 1 --2- 172.21.15.7:0/2932619130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8b01036e0 0x7fc8b0198ad0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000c970 tx=0x7fc8a000cd70 comp rx=0 tx=0).stop 2024-09-19T08:47:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.864+0000 7fc8b7fe1640 1 -- 172.21.15.7:0/2932619130 shutdown_connections 2024-09-19T08:47:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.864+0000 7fc8b7fe1640 1 --2- 172.21.15.7:0/2932619130 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc89c0a3430 0x7fc89c0a58f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.864+0000 7fc8b7fe1640 1 --2- 172.21.15.7:0/2932619130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8b01082a0 0x7fc8b019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.864+0000 7fc8b7fe1640 1 --2- 172.21.15.7:0/2932619130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8b01036e0 0x7fc8b0198ad0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.864+0000 7fc8b7fe1640 1 --2- 172.21.15.7:0/2932619130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8b0102d30 0x7fc8b0198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.864+0000 7fc8b7fe1640 1 -- 172.21.15.7:0/2932619130 >> 172.21.15.7:0/2932619130 conn(0x7fc8b00fc7d0 msgr2=0x7fc8b0105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.865+0000 7fc8b7fe1640 1 -- 172.21.15.7:0/2932619130 shutdown_connections 2024-09-19T08:47:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:47:40.865+0000 7fc8b7fe1640 1 -- 172.21.15.7:0/2932619130 wait complete. 2024-09-19T08:47:41.724 INFO:tasks.cephfs.filesystem:scrub status for tag:62418a2e-3076-4e4e-ac15-72ac94fd1fe4 - {'path': '/', 'tag': '62418a2e-3076-4e4e-ac15-72ac94fd1fe4', 'options': 'recursive,force'} 2024-09-19T08:47:42.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:42 smithi175 ceph-mon[35688]: pgmap v98: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T08:47:42.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:42 smithi007 ceph-mon[31221]: pgmap v98: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T08:47:42.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:42 smithi044 ceph-mon[35072]: pgmap v98: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T08:47:43.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:43 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:43.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:43 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:43.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:43 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:44.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:44 smithi175 ceph-mon[35688]: pgmap v99: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-19T08:47:44.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:44 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:44.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:44 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:47:44.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:44 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:47:44.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:44 smithi175 ceph-mon[35688]: scrub summary: idle 2024-09-19T08:47:44.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:44 smithi007 ceph-mon[31221]: pgmap v99: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-19T08:47:44.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:44 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:44.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:44 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:47:44.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:44 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:47:44.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:44 smithi007 ceph-mon[31221]: scrub summary: idle 2024-09-19T08:47:44.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:44 smithi044 ceph-mon[35072]: pgmap v99: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-19T08:47:44.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:44 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:44.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:44 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:47:44.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:44 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:47:44.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:44 smithi044 ceph-mon[35072]: scrub summary: idle 2024-09-19T08:47:46.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:46 smithi175 ceph-mon[35688]: pgmap v100: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T08:47:46.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:46 smithi007 ceph-mon[31221]: pgmap v100: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T08:47:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:46 smithi044 ceph-mon[35072]: pgmap v100: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T08:47:48.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:48 smithi175 ceph-mon[35688]: pgmap v101: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T08:47:48.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:48 smithi007 ceph-mon[31221]: pgmap v101: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T08:47:48.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:48 smithi044 ceph-mon[35072]: pgmap v101: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T08:47:50.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:50 smithi007 ceph-mon[31221]: pgmap v102: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:47:50.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:50 smithi175 ceph-mon[35688]: pgmap v102: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:47:50.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:50 smithi044 ceph-mon[35072]: pgmap v102: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:47:52.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:52 smithi175 ceph-mon[35688]: pgmap v103: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:47:52.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:52 smithi007 ceph-mon[31221]: pgmap v103: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:47:52.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:52 smithi044 ceph-mon[35072]: pgmap v103: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:47:54.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:54 smithi175 ceph-mon[35688]: pgmap v104: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:47:54.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:54 smithi007 ceph-mon[31221]: pgmap v104: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:47:54.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:54 smithi044 ceph-mon[35072]: pgmap v104: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:47:56.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:56 smithi175 ceph-mon[35688]: pgmap v105: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:47:56.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:56 smithi007 ceph-mon[31221]: pgmap v105: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:47:56.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:56 smithi044 ceph-mon[35072]: pgmap v105: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:47:58.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:47:58 smithi175 ceph-mon[35688]: pgmap v106: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:47:58.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:47:58 smithi007 ceph-mon[31221]: pgmap v106: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:47:58.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:47:58 smithi044 ceph-mon[35072]: pgmap v106: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:48:00.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:00 smithi175 ceph-mon[35688]: pgmap v107: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:48:00.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:00 smithi007 ceph-mon[31221]: pgmap v107: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:48:00.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:00 smithi044 ceph-mon[35072]: pgmap v107: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:48:02.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:02 smithi175 ceph-mon[35688]: pgmap v108: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:48:02.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:02 smithi007 ceph-mon[31221]: pgmap v108: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:48:02.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:02 smithi044 ceph-mon[35072]: pgmap v108: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:48:04.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:04 smithi175 ceph-mon[35688]: pgmap v109: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:48:04.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:04 smithi007 ceph-mon[31221]: pgmap v109: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:48:04.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:04 smithi044 ceph-mon[35072]: pgmap v109: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:48:06.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:06 smithi175 ceph-mon[35688]: pgmap v110: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T08:48:06.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:06 smithi007 ceph-mon[31221]: pgmap v110: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T08:48:06.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:06 smithi044 ceph-mon[35072]: pgmap v110: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T08:48:08.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:08 smithi175 ceph-mon[35688]: pgmap v111: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:48:08.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:08 smithi007 ceph-mon[31221]: pgmap v111: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:48:08.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:08 smithi044 ceph-mon[35072]: pgmap v111: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:48:10.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:10 smithi175 ceph-mon[35688]: pgmap v112: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T08:48:10.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:10 smithi007 ceph-mon[31221]: pgmap v112: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T08:48:10.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:10 smithi044 ceph-mon[35072]: pgmap v112: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T08:48:11.725 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:48:11.983 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:12.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.492+0000 7f8d2e7db640 1 -- 172.21.15.7:0/1410799431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d2810c170 msgr2=0x7f8d2810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:12.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.492+0000 7f8d2e7db640 1 --2- 172.21.15.7:0/1410799431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d2810c170 0x7f8d2810e610 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009ca0 tx=0x7f8d2002a950 comp rx=0 tx=0).stop 2024-09-19T08:48:12.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.492+0000 7f8d2e7db640 1 -- 172.21.15.7:0/1410799431 shutdown_connections 2024-09-19T08:48:12.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.492+0000 7f8d2e7db640 1 --2- 172.21.15.7:0/1410799431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d2810c170 0x7f8d2810e610 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.492+0000 7f8d2e7db640 1 --2- 172.21.15.7:0/1410799431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d28103660 0x7f8d2810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.492+0000 7f8d2e7db640 1 --2- 172.21.15.7:0/1410799431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d28102d40 0x7f8d28103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.492+0000 7f8d2e7db640 1 -- 172.21.15.7:0/1410799431 >> 172.21.15.7:0/1410799431 conn(0x7f8d280fc7a0 msgr2=0x7f8d280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:12.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.492+0000 7f8d2e7db640 1 -- 172.21.15.7:0/1410799431 shutdown_connections 2024-09-19T08:48:12.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.492+0000 7f8d2e7db640 1 -- 172.21.15.7:0/1410799431 wait complete. 2024-09-19T08:48:12.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.493+0000 7f8d2e7db640 1 Processor -- start 2024-09-19T08:48:12.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.493+0000 7f8d2e7db640 1 -- start start 2024-09-19T08:48:12.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.493+0000 7f8d2e7db640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d28102d40 0x7f8d28198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:12.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.493+0000 7f8d2e7db640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d28103660 0x7f8d28198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:12.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.493+0000 7f8d2e7db640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d2810c170 0x7f8d2819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:12.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.493+0000 7f8d2e7db640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8d28111fb0 con 0x7f8d28102d40 2024-09-19T08:48:12.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.493+0000 7f8d2e7db640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8d28111e30 con 0x7f8d28103660 2024-09-19T08:48:12.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.493+0000 7f8d2e7db640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8d28112130 con 0x7f8d2810c170 2024-09-19T08:48:12.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.493+0000 7f8d27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d28102d40 0x7f8d28198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:12.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.493+0000 7f8d27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d28102d40 0x7f8d28198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54438/0 (socket says 172.21.15.7:54438) 2024-09-19T08:48:12.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.493+0000 7f8d27fff640 1 -- 172.21.15.7:0/74839898 learned_addr learned my addr 172.21.15.7:0/74839898 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:12.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.494+0000 7f8d2cd78640 1 --2- 172.21.15.7:0/74839898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d2810c170 0x7f8d2819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:12.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.494+0000 7f8d277fe640 1 --2- 172.21.15.7:0/74839898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d28103660 0x7f8d28198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:12.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.494+0000 7f8d27fff640 1 -- 172.21.15.7:0/74839898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d2810c170 msgr2=0x7f8d2819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:12.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.494+0000 7f8d27fff640 1 --2- 172.21.15.7:0/74839898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d2810c170 0x7f8d2819cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.494+0000 7f8d27fff640 1 -- 172.21.15.7:0/74839898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d28103660 msgr2=0x7f8d28198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:12.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.494+0000 7f8d27fff640 1 --2- 172.21.15.7:0/74839898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d28103660 0x7f8d28198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.494+0000 7f8d27fff640 1 -- 172.21.15.7:0/74839898 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d2819d3e0 con 0x7f8d28102d40 2024-09-19T08:48:12.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.494+0000 7f8d27fff640 1 --2- 172.21.15.7:0/74839898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d28102d40 0x7f8d28198430 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800d950 tx=0x7f8d1800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:12.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.494+0000 7f8d257fa640 1 -- 172.21.15.7:0/74839898 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d18017070 con 0x7f8d28102d40 2024-09-19T08:48:12.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.494+0000 7f8d257fa640 1 -- 172.21.15.7:0/74839898 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d18009c30 con 0x7f8d28102d40 2024-09-19T08:48:12.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.494+0000 7f8d2e7db640 1 -- 172.21.15.7:0/74839898 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d2819d6d0 con 0x7f8d28102d40 2024-09-19T08:48:12.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.494+0000 7f8d257fa640 1 -- 172.21.15.7:0/74839898 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1800f6b0 con 0x7f8d28102d40 2024-09-19T08:48:12.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.494+0000 7f8d2e7db640 1 -- 172.21.15.7:0/74839898 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d281a4fb0 con 0x7f8d28102d40 2024-09-19T08:48:12.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.496+0000 7f8d257fa640 1 -- 172.21.15.7:0/74839898 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8d180109d0 con 0x7f8d28102d40 2024-09-19T08:48:12.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.497+0000 7f8d30bb4740 1 Processor -- start 2024-09-19T08:48:12.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.497+0000 7f8d30bb4740 1 -- start start 2024-09-19T08:48:12.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.497+0000 7f8d257fa640 1 --2- 172.21.15.7:0/74839898 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8d100a3430 0x7f8d100a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:12.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.497+0000 7f8d30bb4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f335a4a0 0x5635f335a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:12.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.498+0000 7f8d30bb4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635f335adc0 0x5635f3365140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:12.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.498+0000 7f8d30bb4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f3365680 0x5635f3367a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:12.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.498+0000 7f8d30bb4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5635f32c02e0 con 0x5635f3365680 2024-09-19T08:48:12.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.498+0000 7f8d30bb4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5635f3267ce0 con 0x5635f335a4a0 2024-09-19T08:48:12.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.498+0000 7f8d30bb4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5635f32bc2a0 con 0x5635f335adc0 2024-09-19T08:48:12.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.498+0000 7f8d2cd78640 1 --2- 172.21.15.7:0/74839898 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8d100a3430 0x7f8d100a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:12.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.498+0000 7f8d257fa640 1 -- 172.21.15.7:0/74839898 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f8d180cfa30 con 0x7f8d28102d40 2024-09-19T08:48:12.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.498+0000 7f8d27fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f335a4a0 0x5635f335a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:12.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.498+0000 7f8d2cd78640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f3365680 0x5635f3367a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:12.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.498+0000 7f8d2cd78640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f3365680 0x5635f3367a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54444/0 (socket says 172.21.15.7:54444) 2024-09-19T08:48:12.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.498+0000 7f8d27fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f335a4a0 0x5635f335a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:33540/0 (socket says 172.21.15.7:33540) 2024-09-19T08:48:12.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.498+0000 7f8d2cd78640 1 -- 172.21.15.7:0/2678954133 learned_addr learned my addr 172.21.15.7:0/2678954133 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:12.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.498+0000 7f8d277fe640 1 --2- 172.21.15.7:0/2678954133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635f335adc0 0x5635f3365140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:12.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.498+0000 7f8d2cd78640 1 -- 172.21.15.7:0/2678954133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635f335adc0 msgr2=0x5635f3365140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:12.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.498+0000 7f8d2cd78640 1 --2- 172.21.15.7:0/2678954133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635f335adc0 0x5635f3365140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.498+0000 7f8d2cd78640 1 -- 172.21.15.7:0/2678954133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f335a4a0 msgr2=0x5635f335a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:12.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.498+0000 7f8d2cd78640 1 --2- 172.21.15.7:0/2678954133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f335a4a0 0x5635f335a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.498+0000 7f8d2cd78640 1 -- 172.21.15.7:0/2678954133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635f324c440 con 0x5635f3365680 2024-09-19T08:48:12.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.498+0000 7f8d27fff640 1 --2- 172.21.15.7:0/2678954133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f335a4a0 0x5635f335a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:48:12.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.498+0000 7f8d277fe640 1 --2- 172.21.15.7:0/2678954133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635f335adc0 0x5635f3365140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:48:12.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.498+0000 7f8d2cd78640 1 --2- 172.21.15.7:0/74839898 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8d100a3430 0x7f8d100a58f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8d20035000 tx=0x7f8d20009800 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:12.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.498+0000 7f8d2cd78640 1 --2- 172.21.15.7:0/2678954133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f3365680 0x5635f3367a70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f8d2002fd90 tx=0x7f8d20047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f679d02f98d61 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:12.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.499+0000 7f8d0e7fc640 1 -- 172.21.15.7:0/2678954133 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20034040 con 0x5635f3365680 2024-09-19T08:48:12.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.499+0000 7f8d0e7fc640 1 -- 172.21.15.7:0/2678954133 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d20003d70 con 0x5635f3365680 2024-09-19T08:48:12.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.499+0000 7f8d0e7fc640 1 -- 172.21.15.7:0/2678954133 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20004760 con 0x5635f3365680 2024-09-19T08:48:12.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.499+0000 7f8d30bb4740 1 -- 172.21.15.7:0/2678954133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f3365680 msgr2=0x5635f3367a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:12.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.499+0000 7f8d30bb4740 1 --2- 172.21.15.7:0/2678954133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f3365680 0x5635f3367a70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f8d2002fd90 tx=0x7f8d20047000 comp rx=0 tx=0).stop 2024-09-19T08:48:12.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.499+0000 7f8d30bb4740 1 -- 172.21.15.7:0/2678954133 shutdown_connections 2024-09-19T08:48:12.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.499+0000 7f8d30bb4740 1 --2- 172.21.15.7:0/2678954133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f3365680 0x5635f3367a70 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.499+0000 7f8d30bb4740 1 --2- 172.21.15.7:0/2678954133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635f335adc0 0x5635f3365140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.499+0000 7f8d30bb4740 1 --2- 172.21.15.7:0/2678954133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f335a4a0 0x5635f335a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.499+0000 7f8d30bb4740 1 -- 172.21.15.7:0/2678954133 >> 172.21.15.7:0/2678954133 conn(0x5635f3356a30 msgr2=0x5635f3356e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:12.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.499+0000 7f8d30bb4740 1 -- 172.21.15.7:0/2678954133 shutdown_connections 2024-09-19T08:48:12.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.499+0000 7f8d30bb4740 1 -- 172.21.15.7:0/2678954133 wait complete. 2024-09-19T08:48:12.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.500+0000 7f8d30bb4740 1 -- start start 2024-09-19T08:48:12.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.500+0000 7f8d30bb4740 1 Processor -- start 2024-09-19T08:48:12.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.500+0000 7f8d30bb4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f335a4a0 0x5635f3364f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:12.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.500+0000 7f8d30bb4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635f335adc0 0x5635f3362220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:12.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.500+0000 7f8d30bb4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f3365680 0x5635f3362760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:12.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.500+0000 7f8d30bb4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5635f3368250 con 0x5635f335a4a0 2024-09-19T08:48:12.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.500+0000 7f8d30bb4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5635f327b050 con 0x5635f3365680 2024-09-19T08:48:12.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.500+0000 7f8d30bb4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5635f33683d0 con 0x5635f335adc0 2024-09-19T08:48:12.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.500+0000 7f8d30bb4740 10 client.0 _ll_register_callbacks cb 0x5635f32bb160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:12.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.500+0000 7f8d27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f335a4a0 0x5635f3364f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:12.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.500+0000 7f8d27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f335a4a0 0x5635f3364f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54450/0 (socket says 172.21.15.7:54450) 2024-09-19T08:48:12.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.500+0000 7f8d27fff640 1 -- 172.21.15.7:0/1169014795 learned_addr learned my addr 172.21.15.7:0/1169014795 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:12.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.501+0000 7f8d2cd78640 1 --2- 172.21.15.7:0/1169014795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f3365680 0x5635f3362760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:12.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.501+0000 7f8d277fe640 1 --2- 172.21.15.7:0/1169014795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635f335adc0 0x5635f3362220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:12.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.501+0000 7f8d27fff640 1 -- 172.21.15.7:0/1169014795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635f335adc0 msgr2=0x5635f3362220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:12.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.501+0000 7f8d27fff640 1 --2- 172.21.15.7:0/1169014795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635f335adc0 0x5635f3362220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.501+0000 7f8d27fff640 1 -- 172.21.15.7:0/1169014795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f3365680 msgr2=0x5635f3362760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:12.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.501+0000 7f8d27fff640 1 --2- 172.21.15.7:0/1169014795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f3365680 0x5635f3362760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.501+0000 7f8d27fff640 1 -- 172.21.15.7:0/1169014795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635f30313c0 con 0x5635f335a4a0 2024-09-19T08:48:12.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.501+0000 7f8d2cd78640 1 --2- 172.21.15.7:0/1169014795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f3365680 0x5635f3362760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:48:12.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.501+0000 7f8d27fff640 1 --2- 172.21.15.7:0/1169014795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f335a4a0 0x5635f3364f70 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8d1809bc30 tx=0x7f8d18005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9e3be69265494e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:12.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.501+0000 7f8d077fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:48:12.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.501+0000 7f8d077fe640 1 -- 172.21.15.7:0/1169014795 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d18020040 con 0x5635f335a4a0 2024-09-19T08:48:12.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.501+0000 7f8d077fe640 1 -- 172.21.15.7:0/1169014795 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f8d18099650 con 0x5635f335a4a0 2024-09-19T08:48:12.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.501+0000 7f8d30bb4740 1 -- 172.21.15.7:0/1169014795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d20003d70 con 0x5635f335a4a0 2024-09-19T08:48:12.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.501+0000 7f8d077fe640 1 -- 172.21.15.7:0/1169014795 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8d180b9050 con 0x5635f335a4a0 2024-09-19T08:48:12.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.501+0000 7f8d30bb4740 10 client.16056 fetch_fsmap learned FSMap version 25 2024-09-19T08:48:12.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.501+0000 7f8d30bb4740 1 -- 172.21.15.7:0/1169014795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5635f3373c10 con 0x5635f335a4a0 2024-09-19T08:48:12.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.501+0000 7f8d077fe640 1 -- 172.21.15.7:0/1169014795 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d20003d70 con 0x5635f335a4a0 2024-09-19T08:48:12.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.501+0000 7f8d077fe640 1 -- 172.21.15.7:0/1169014795 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8d180b3030 con 0x5635f335a4a0 2024-09-19T08:48:12.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.501+0000 7f8d30bb4740 10 client.16056 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:48:12.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.501+0000 7f8d30bb4740 10 client.16056 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:48:12.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.502+0000 7f8d30bb4740 20 client.16056 populate_metadata read hostname 'smithi007' 2024-09-19T08:48:12.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.502+0000 7f8d30bb4740 1 --2- 172.21.15.7:0/1169014795 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5635f3375020 0x5635f3377470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:12.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.502+0000 7f8d30bb4740 4 client.16056 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:48:12.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.502+0000 7f8d30bb4740 1 -- 172.21.15.7:0/1169014795 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635f32cd850 con 0x5635f3375020 2024-09-19T08:48:12.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.502+0000 7f8d277fe640 1 --2- 172.21.15.7:0/1169014795 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5635f3375020 0x5635f3377470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:12.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.502+0000 7f8d277fe640 1 --2- 172.21.15.7:0/1169014795 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5635f3375020 0x5635f3377470 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffe589106d80e8e4 server_cookie=8f0e12d90db8dc02 in_seq=0 out_seq=0 2024-09-19T08:48:12.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.502+0000 7f8d077fe640 10 client.16056 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:48:12.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.503+0000 7f8d077fe640 1 -- 172.21.15.7:0/1169014795 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5635f32cd850 con 0x5635f3375020 2024-09-19T08:48:12.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.503+0000 7f8d077fe640 10 client.16056 handle_command_reply: tid=0 2024-09-19T08:48:12.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.503+0000 7f8d30bb4740 1 client.16056 shutdown 2024-09-19T08:48:12.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.503+0000 7f8d30bb4740 1 -- 172.21.15.7:0/1169014795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f335a4a0 msgr2=0x5635f3364f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:12.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.503+0000 7f8d30bb4740 1 --2- 172.21.15.7:0/1169014795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f335a4a0 0x5635f3364f70 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8d1809bc30 tx=0x7f8d18005d30 comp rx=0 tx=0).stop 2024-09-19T08:48:12.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.503+0000 7f8d30bb4740 1 -- 172.21.15.7:0/1169014795 shutdown_connections 2024-09-19T08:48:12.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.503+0000 7f8d30bb4740 1 --2- 172.21.15.7:0/1169014795 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5635f3375020 0x5635f3377470 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.503+0000 7f8d30bb4740 1 --2- 172.21.15.7:0/1169014795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f3365680 0x5635f3362760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.503+0000 7f8d30bb4740 1 --2- 172.21.15.7:0/1169014795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635f335adc0 0x5635f3362220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.503+0000 7f8d077fe640 0 client.16056 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:48:12.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.503+0000 7f8d30bb4740 1 --2- 172.21.15.7:0/1169014795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f335a4a0 0x5635f3364f70 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.503+0000 7f8d30bb4740 1 -- 172.21.15.7:0/1169014795 >> 172.21.15.7:0/1169014795 conn(0x5635f3356a30 msgr2=0x5635f335c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:12.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.503+0000 7f8d30bb4740 1 -- 172.21.15.7:0/1169014795 shutdown_connections 2024-09-19T08:48:12.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.503+0000 7f8d30bb4740 1 -- 172.21.15.7:0/1169014795 wait complete. 2024-09-19T08:48:12.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.503+0000 7f8d30bb4740 20 client.16056 trim_cache size 0 max 16384 2024-09-19T08:48:12.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.520+0000 7f8d30bb4740 1 Processor -- start 2024-09-19T08:48:12.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.520+0000 7f8d30bb4740 1 -- start start 2024-09-19T08:48:12.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.521+0000 7f8d30bb4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635f335a4a0 0x5635f3371500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:12.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.521+0000 7f8d30bb4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f335adc0 0x5635f337cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:12.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.521+0000 7f8d30bb4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f3365680 0x5635f337d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:12.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.521+0000 7f8d30bb4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8d281b0230 con 0x5635f3365680 2024-09-19T08:48:12.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.521+0000 7f8d30bb4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8d281adb00 con 0x5635f335adc0 2024-09-19T08:48:12.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.521+0000 7f8d30bb4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8d281ab950 con 0x5635f335a4a0 2024-09-19T08:48:12.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.521+0000 7f8d2cd78640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f3365680 0x5635f337d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:12.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.521+0000 7f8d2cd78640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f3365680 0x5635f337d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54452/0 (socket says 172.21.15.7:54452) 2024-09-19T08:48:12.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.521+0000 7f8d2cd78640 1 -- 172.21.15.7:0/1851861901 learned_addr learned my addr 172.21.15.7:0/1851861901 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:12.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.521+0000 7f8d277fe640 1 --2- 172.21.15.7:0/1851861901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f335adc0 0x5635f337cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:12.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.521+0000 7f8d27fff640 1 --2- 172.21.15.7:0/1851861901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635f335a4a0 0x5635f3371500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:12.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.521+0000 7f8d2cd78640 1 -- 172.21.15.7:0/1851861901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635f335a4a0 msgr2=0x5635f3371500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:12.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.521+0000 7f8d2cd78640 1 --2- 172.21.15.7:0/1851861901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635f335a4a0 0x5635f3371500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.521+0000 7f8d2cd78640 1 -- 172.21.15.7:0/1851861901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f335adc0 msgr2=0x5635f337cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:12.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.521+0000 7f8d2cd78640 1 --2- 172.21.15.7:0/1851861901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f335adc0 0x5635f337cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.521+0000 7f8d2cd78640 1 -- 172.21.15.7:0/1851861901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635f3360770 con 0x5635f3365680 2024-09-19T08:48:12.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.521+0000 7f8d277fe640 1 --2- 172.21.15.7:0/1851861901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f335adc0 0x5635f337cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:48:12.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.521+0000 7f8d2cd78640 1 --2- 172.21.15.7:0/1851861901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f3365680 0x5635f337d280 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8d2002a990 tx=0x7f8d20004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3f82aa0a3a17f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:12.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.521+0000 7f8d0dffb640 1 -- 172.21.15.7:0/1851861901 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2005a070 con 0x5635f3365680 2024-09-19T08:48:12.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.522+0000 7f8d0dffb640 1 -- 172.21.15.7:0/1851861901 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d20009540 con 0x5635f3365680 2024-09-19T08:48:12.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.522+0000 7f8d0dffb640 1 -- 172.21.15.7:0/1851861901 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20034050 con 0x5635f3365680 2024-09-19T08:48:12.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.522+0000 7f8d30bb4740 1 -- 172.21.15.7:0/1851861901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f3365680 msgr2=0x5635f337d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:12.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.522+0000 7f8d30bb4740 1 --2- 172.21.15.7:0/1851861901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f3365680 0x5635f337d280 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8d2002a990 tx=0x7f8d20004a80 comp rx=0 tx=0).stop 2024-09-19T08:48:12.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.522+0000 7f8d30bb4740 1 -- 172.21.15.7:0/1851861901 shutdown_connections 2024-09-19T08:48:12.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.522+0000 7f8d30bb4740 1 --2- 172.21.15.7:0/1851861901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f3365680 0x5635f337d280 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.522+0000 7f8d30bb4740 1 --2- 172.21.15.7:0/1851861901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f335adc0 0x5635f337cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.522+0000 7f8d30bb4740 1 --2- 172.21.15.7:0/1851861901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635f335a4a0 0x5635f3371500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.522+0000 7f8d30bb4740 1 -- 172.21.15.7:0/1851861901 >> 172.21.15.7:0/1851861901 conn(0x5635f3356a30 msgr2=0x5635f3360af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:12.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.522+0000 7f8d30bb4740 1 -- 172.21.15.7:0/1851861901 shutdown_connections 2024-09-19T08:48:12.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.522+0000 7f8d30bb4740 1 -- 172.21.15.7:0/1851861901 wait complete. 2024-09-19T08:48:12.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.523+0000 7f8d30bb4740 1 -- start start 2024-09-19T08:48:12.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.523+0000 7f8d30bb4740 1 Processor -- start 2024-09-19T08:48:12.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.523+0000 7f8d30bb4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635f335a4a0 0x5635f33693e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:12.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.523+0000 7f8d30bb4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f335adc0 0x5635f3369920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:12.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.523+0000 7f8d30bb4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f3365680 0x5635f3369e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:12.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.523+0000 7f8d30bb4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8d281abfc0 con 0x5635f335adc0 2024-09-19T08:48:12.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.523+0000 7f8d30bb4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8d281ad430 con 0x5635f3365680 2024-09-19T08:48:12.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.523+0000 7f8d30bb4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8d281ac690 con 0x5635f335a4a0 2024-09-19T08:48:12.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.523+0000 7f8d30bb4740 10 client.0 _ll_register_callbacks cb 0x7f8d1809bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:12.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.523+0000 7f8d277fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f335adc0 0x5635f3369920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:12.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.523+0000 7f8d277fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f335adc0 0x5635f3369920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54462/0 (socket says 172.21.15.7:54462) 2024-09-19T08:48:12.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.523+0000 7f8d277fe640 1 -- 172.21.15.7:0/1835241855 learned_addr learned my addr 172.21.15.7:0/1835241855 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:12.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.523+0000 7f8d2cd78640 1 --2- 172.21.15.7:0/1835241855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f3365680 0x5635f3369e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:12.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.523+0000 7f8d27fff640 1 --2- 172.21.15.7:0/1835241855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635f335a4a0 0x5635f33693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:12.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.524+0000 7f8d277fe640 1 -- 172.21.15.7:0/1835241855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635f335a4a0 msgr2=0x5635f33693e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:12.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.524+0000 7f8d277fe640 1 --2- 172.21.15.7:0/1835241855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635f335a4a0 0x5635f33693e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.524+0000 7f8d277fe640 1 -- 172.21.15.7:0/1835241855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f3365680 msgr2=0x5635f3369e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:12.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.524+0000 7f8d277fe640 1 --2- 172.21.15.7:0/1835241855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f3365680 0x5635f3369e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.524+0000 7f8d277fe640 1 -- 172.21.15.7:0/1835241855 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635f33ded40 con 0x5635f335adc0 2024-09-19T08:48:12.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.524+0000 7f8d27fff640 1 --2- 172.21.15.7:0/1835241855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635f335a4a0 0x5635f33693e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:48:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.524+0000 7f8d277fe640 1 --2- 172.21.15.7:0/1835241855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f335adc0 0x5635f3369920 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00b990 tx=0x7f8d1c0157f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89bbf4d0fec7dcf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.524+0000 7f8d077fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:48:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.524+0000 7f8d077fe640 1 -- 172.21.15.7:0/1835241855 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c00be00 con 0x5635f335adc0 2024-09-19T08:48:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.524+0000 7f8d077fe640 1 -- 172.21.15.7:0/1835241855 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f8d1c0145c0 con 0x5635f335adc0 2024-09-19T08:48:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.524+0000 7f8d30bb4740 1 -- 172.21.15.7:0/1835241855 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d20009540 con 0x5635f335adc0 2024-09-19T08:48:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.524+0000 7f8d077fe640 1 -- 172.21.15.7:0/1835241855 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8d1c0147c0 con 0x5635f335adc0 2024-09-19T08:48:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.524+0000 7f8d30bb4740 10 client.16062 fetch_fsmap learned FSMap version 25 2024-09-19T08:48:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.524+0000 7f8d30bb4740 1 -- 172.21.15.7:0/1835241855 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5635f33e0070 con 0x5635f335adc0 2024-09-19T08:48:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.524+0000 7f8d077fe640 1 -- 172.21.15.7:0/1835241855 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d20009540 con 0x5635f335adc0 2024-09-19T08:48:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.525+0000 7f8d077fe640 1 -- 172.21.15.7:0/1835241855 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8d1c024af0 con 0x5635f335adc0 2024-09-19T08:48:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.525+0000 7f8d30bb4740 10 client.16062 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:48:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.525+0000 7f8d30bb4740 10 client.16062 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:48:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.525+0000 7f8d30bb4740 20 client.16062 populate_metadata read hostname 'smithi007' 2024-09-19T08:48:12.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.525+0000 7f8d30bb4740 1 --2- 172.21.15.7:0/1835241855 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5635f33e0810 0x5635f33e2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:12.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.525+0000 7f8d30bb4740 4 client.16062 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:48:12.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.525+0000 7f8d30bb4740 1 -- 172.21.15.7:0/1835241855 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5635f3362af0 con 0x5635f33e0810 2024-09-19T08:48:12.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.525+0000 7f8d27fff640 1 --2- 172.21.15.7:0/1835241855 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5635f33e0810 0x5635f33e2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:12.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.525+0000 7f8d27fff640 1 --2- 172.21.15.7:0/1835241855 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5635f33e0810 0x5635f33e2c30 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfc854c7734d6a14 server_cookie=ef0cbdf21ee5854b in_seq=0 out_seq=0 2024-09-19T08:48:12.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.525+0000 7f8d077fe640 10 client.16062 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:48:12.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.525+0000 7f8d077fe640 1 -- 172.21.15.7:0/1835241855 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5635f3362af0 con 0x5635f33e0810 2024-09-19T08:48:12.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.525+0000 7f8d077fe640 10 client.16062 handle_command_reply: tid=0 2024-09-19T08:48:12.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.525+0000 7f8d30bb4740 1 client.16062 shutdown 2024-09-19T08:48:12.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.526+0000 7f8d30bb4740 1 -- 172.21.15.7:0/1835241855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f335adc0 msgr2=0x5635f3369920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:12.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.526+0000 7f8d30bb4740 1 --2- 172.21.15.7:0/1835241855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f335adc0 0x5635f3369920 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00b990 tx=0x7f8d1c0157f0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.526+0000 7f8d30bb4740 1 -- 172.21.15.7:0/1835241855 shutdown_connections 2024-09-19T08:48:12.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.526+0000 7f8d30bb4740 1 --2- 172.21.15.7:0/1835241855 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5635f33e0810 0x5635f33e2c30 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.526+0000 7f8d30bb4740 1 --2- 172.21.15.7:0/1835241855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5635f3365680 0x5635f3369e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.526+0000 7f8d30bb4740 1 --2- 172.21.15.7:0/1835241855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635f335adc0 0x5635f3369920 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.526+0000 7f8d30bb4740 1 --2- 172.21.15.7:0/1835241855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635f335a4a0 0x5635f33693e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.526+0000 7f8d30bb4740 1 -- 172.21.15.7:0/1835241855 >> 172.21.15.7:0/1835241855 conn(0x5635f3356a30 msgr2=0x5635f3355b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:12.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.526+0000 7f8d077fe640 0 client.16062 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:48:12.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.526+0000 7f8d30bb4740 1 -- 172.21.15.7:0/1835241855 shutdown_connections 2024-09-19T08:48:12.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.526+0000 7f8d30bb4740 1 -- 172.21.15.7:0/1835241855 wait complete. 2024-09-19T08:48:12.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.526+0000 7f8d30bb4740 20 client.16062 trim_cache size 0 max 16384 2024-09-19T08:48:12.532 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:48:12.532 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-19T08:48:12.533 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-09-19T08:48:12.533 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:48:12.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.526+0000 7f8d2e7db640 1 -- 172.21.15.7:0/74839898 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8d100a3430 msgr2=0x7f8d100a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:12.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.526+0000 7f8d2e7db640 1 --2- 172.21.15.7:0/74839898 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8d100a3430 0x7f8d100a58f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8d20035000 tx=0x7f8d20009800 comp rx=0 tx=0).stop 2024-09-19T08:48:12.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.526+0000 7f8d2e7db640 1 -- 172.21.15.7:0/74839898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d28102d40 msgr2=0x7f8d28198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:12.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.526+0000 7f8d2e7db640 1 --2- 172.21.15.7:0/74839898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d28102d40 0x7f8d28198430 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800d950 tx=0x7f8d1800de10 comp rx=0 tx=0).stop 2024-09-19T08:48:12.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.527+0000 7f8d2e7db640 1 -- 172.21.15.7:0/74839898 shutdown_connections 2024-09-19T08:48:12.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.527+0000 7f8d2e7db640 1 --2- 172.21.15.7:0/74839898 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8d100a3430 0x7f8d100a58f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.527+0000 7f8d2e7db640 1 --2- 172.21.15.7:0/74839898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d2810c170 0x7f8d2819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.527+0000 7f8d2e7db640 1 --2- 172.21.15.7:0/74839898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d28103660 0x7f8d28198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.527+0000 7f8d2e7db640 1 --2- 172.21.15.7:0/74839898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d28102d40 0x7f8d28198430 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:12.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.527+0000 7f8d2e7db640 1 -- 172.21.15.7:0/74839898 >> 172.21.15.7:0/74839898 conn(0x7f8d280fc7a0 msgr2=0x7f8d280fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:12.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.527+0000 7f8d2e7db640 1 -- 172.21.15.7:0/74839898 shutdown_connections 2024-09-19T08:48:12.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:12.527+0000 7f8d2e7db640 1 -- 172.21.15.7:0/74839898 wait complete. 2024-09-19T08:48:12.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:12 smithi175 ceph-mon[35688]: pgmap v113: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T08:48:12.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:12 smithi007 ceph-mon[31221]: pgmap v113: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T08:48:12.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:12 smithi044 ceph-mon[35072]: pgmap v113: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T08:48:13.355 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:48:13.356 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:48:13.618 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:14.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.033+0000 7fa4d3dda640 1 -- 172.21.15.7:0/2915196197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4cc106f10 msgr2=0x7fa4cc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:14.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.033+0000 7fa4d3dda640 1 --2- 172.21.15.7:0/2915196197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4cc106f10 0x7fa4cc10ea90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009ca0 tx=0x7fa4c402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:48:14.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.033+0000 7fa4d3dda640 1 -- 172.21.15.7:0/2915196197 shutdown_connections 2024-09-19T08:48:14.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.033+0000 7fa4d3dda640 1 --2- 172.21.15.7:0/2915196197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4cc106f10 0x7fa4cc10ea90 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:14.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.033+0000 7fa4d3dda640 1 --2- 172.21.15.7:0/2915196197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4cc102790 0x7fa4cc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:14.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.033+0000 7fa4d3dda640 1 --2- 172.21.15.7:0/2915196197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4cc101de0 0x7fa4cc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:14.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.033+0000 7fa4d3dda640 1 -- 172.21.15.7:0/2915196197 >> 172.21.15.7:0/2915196197 conn(0x7fa4cc0fd8c0 msgr2=0x7fa4cc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:14.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.033+0000 7fa4d3dda640 1 -- 172.21.15.7:0/2915196197 shutdown_connections 2024-09-19T08:48:14.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.033+0000 7fa4d3dda640 1 -- 172.21.15.7:0/2915196197 wait complete. 2024-09-19T08:48:14.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.034+0000 7fa4d3dda640 1 Processor -- start 2024-09-19T08:48:14.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.034+0000 7fa4d3dda640 1 -- start start 2024-09-19T08:48:14.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.034+0000 7fa4d3dda640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4cc101de0 0x7fa4cc19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:14.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.034+0000 7fa4d3dda640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4cc102790 0x7fa4cc19ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:14.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.034+0000 7fa4d3dda640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4cc106f10 0x7fa4cc19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:14.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.034+0000 7fa4d3dda640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc111f90 con 0x7fa4cc106f10 2024-09-19T08:48:14.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.034+0000 7fa4d3dda640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc111e10 con 0x7fa4cc101de0 2024-09-19T08:48:14.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.034+0000 7fa4d3dda640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc112110 con 0x7fa4cc102790 2024-09-19T08:48:14.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.034+0000 7fa4d2377640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4cc106f10 0x7fa4cc19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:14.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.034+0000 7fa4d2377640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4cc106f10 0x7fa4cc19efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35208/0 (socket says 172.21.15.7:35208) 2024-09-19T08:48:14.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.034+0000 7fa4d2377640 1 -- 172.21.15.7:0/2399697123 learned_addr learned my addr 172.21.15.7:0/2399697123 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:14.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.034+0000 7fa4d1b76640 1 --2- 172.21.15.7:0/2399697123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4cc101de0 0x7fa4cc19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:14.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.035+0000 7fa4d1375640 1 --2- 172.21.15.7:0/2399697123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4cc102790 0x7fa4cc19ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:14.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.035+0000 7fa4d2377640 1 -- 172.21.15.7:0/2399697123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4cc102790 msgr2=0x7fa4cc19ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:14.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.035+0000 7fa4d2377640 1 --2- 172.21.15.7:0/2399697123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4cc102790 0x7fa4cc19ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:14.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.035+0000 7fa4d2377640 1 -- 172.21.15.7:0/2399697123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4cc101de0 msgr2=0x7fa4cc19a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:14.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.035+0000 7fa4d2377640 1 --2- 172.21.15.7:0/2399697123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4cc101de0 0x7fa4cc19a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:14.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.035+0000 7fa4d2377640 1 -- 172.21.15.7:0/2399697123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4cc19f680 con 0x7fa4cc106f10 2024-09-19T08:48:14.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.035+0000 7fa4d2377640 1 --2- 172.21.15.7:0/2399697123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4cc106f10 0x7fa4cc19efa0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4031a20 tx=0x7fa4c4031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:14.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.035+0000 7fa4c2ffd640 1 -- 172.21.15.7:0/2399697123 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4003c30 con 0x7fa4cc106f10 2024-09-19T08:48:14.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.036+0000 7fa4c2ffd640 1 -- 172.21.15.7:0/2399697123 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4c4003dd0 con 0x7fa4cc106f10 2024-09-19T08:48:14.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.036+0000 7fa4d3dda640 1 -- 172.21.15.7:0/2399697123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4cc19f910 con 0x7fa4cc106f10 2024-09-19T08:48:14.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.036+0000 7fa4c2ffd640 1 -- 172.21.15.7:0/2399697123 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c402fcf0 con 0x7fa4cc106f10 2024-09-19T08:48:14.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.036+0000 7fa4d3dda640 1 -- 172.21.15.7:0/2399697123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4cc1a7250 con 0x7fa4cc106f10 2024-09-19T08:48:14.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.037+0000 7fa4d3dda640 1 -- 172.21.15.7:0/2399697123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4cc1032c0 con 0x7fa4cc106f10 2024-09-19T08:48:14.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.038+0000 7fa4c2ffd640 1 -- 172.21.15.7:0/2399697123 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa4c4004050 con 0x7fa4cc106f10 2024-09-19T08:48:14.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.039+0000 7fa4c2ffd640 1 --2- 172.21.15.7:0/2399697123 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa4b80a33b0 0x7fa4b80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:14.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.039+0000 7fa4d1b76640 1 --2- 172.21.15.7:0/2399697123 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa4b80a33b0 0x7fa4b80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:14.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.039+0000 7fa4c2ffd640 1 -- 172.21.15.7:0/2399697123 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fa4c40f1230 con 0x7fa4cc106f10 2024-09-19T08:48:14.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.039+0000 7fa4d1b76640 1 --2- 172.21.15.7:0/2399697123 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa4b80a33b0 0x7fa4b80a5870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009890 tx=0x7fa4c8008040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:14.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.043+0000 7fa4c2ffd640 1 -- 172.21.15.7:0/2399697123 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa4c40bdda0 con 0x7fa4cc106f10 2024-09-19T08:48:14.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.257+0000 7fa4d3dda640 1 -- 172.21.15.7:0/2399697123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4cc1a7420 con 0x7fa4cc106f10 2024-09-19T08:48:14.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.258+0000 7fa4c2ffd640 1 -- 172.21.15.7:0/2399697123 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7fa4c402fe90 con 0x7fa4cc106f10 2024-09-19T08:48:14.261 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:48:14.261 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:48:14.262 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:48:14.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.260+0000 7fa4d3dda640 1 -- 172.21.15.7:0/2399697123 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa4b80a33b0 msgr2=0x7fa4b80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:14.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.260+0000 7fa4d3dda640 1 --2- 172.21.15.7:0/2399697123 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa4b80a33b0 0x7fa4b80a5870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009890 tx=0x7fa4c8008040 comp rx=0 tx=0).stop 2024-09-19T08:48:14.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.260+0000 7fa4d3dda640 1 -- 172.21.15.7:0/2399697123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4cc106f10 msgr2=0x7fa4cc19efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:14.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.260+0000 7fa4d3dda640 1 --2- 172.21.15.7:0/2399697123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4cc106f10 0x7fa4cc19efa0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4031a20 tx=0x7fa4c4031a50 comp rx=0 tx=0).stop 2024-09-19T08:48:14.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.260+0000 7fa4d3dda640 1 -- 172.21.15.7:0/2399697123 shutdown_connections 2024-09-19T08:48:14.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.260+0000 7fa4d3dda640 1 --2- 172.21.15.7:0/2399697123 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa4b80a33b0 0x7fa4b80a5870 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:14.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.260+0000 7fa4d3dda640 1 --2- 172.21.15.7:0/2399697123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4cc106f10 0x7fa4cc19efa0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:14.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.260+0000 7fa4d3dda640 1 --2- 172.21.15.7:0/2399697123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4cc102790 0x7fa4cc19ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:14.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.260+0000 7fa4d3dda640 1 --2- 172.21.15.7:0/2399697123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4cc101de0 0x7fa4cc19a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:14.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.260+0000 7fa4d3dda640 1 -- 172.21.15.7:0/2399697123 >> 172.21.15.7:0/2399697123 conn(0x7fa4cc0fd8c0 msgr2=0x7fa4cc0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:14.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.260+0000 7fa4d3dda640 1 -- 172.21.15.7:0/2399697123 shutdown_connections 2024-09-19T08:48:14.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:14.260+0000 7fa4d3dda640 1 -- 172.21.15.7:0/2399697123 wait complete. 2024-09-19T08:48:14.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:14 smithi007 ceph-mon[31221]: pgmap v114: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:48:14.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:14 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2399697123' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:48:14.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:14 smithi175 ceph-mon[35688]: pgmap v114: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:48:14.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:14 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/2399697123' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:48:14.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:14 smithi044 ceph-mon[35072]: pgmap v114: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:48:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:14 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/2399697123' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:48:15.009 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:48:15.267 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:15.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.734+0000 7f9b80e48640 1 -- 172.21.15.7:0/3141110527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b7c106f10 msgr2=0x7f9b7c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:15.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.734+0000 7f9b80e48640 1 --2- 172.21.15.7:0/3141110527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b7c106f10 0x7f9b7c10ea90 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9b74009ca0 tx=0x7f9b7402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.734+0000 7f9b80e48640 1 -- 172.21.15.7:0/3141110527 shutdown_connections 2024-09-19T08:48:15.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.734+0000 7f9b80e48640 1 --2- 172.21.15.7:0/3141110527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b7c106f10 0x7f9b7c10ea90 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.734+0000 7f9b80e48640 1 --2- 172.21.15.7:0/3141110527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b7c102790 0x7f9b7c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.734+0000 7f9b80e48640 1 --2- 172.21.15.7:0/3141110527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b7c101de0 0x7f9b7c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.734+0000 7f9b80e48640 1 -- 172.21.15.7:0/3141110527 >> 172.21.15.7:0/3141110527 conn(0x7f9b7c0fd8c0 msgr2=0x7f9b7c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:15.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.734+0000 7f9b80e48640 1 -- 172.21.15.7:0/3141110527 shutdown_connections 2024-09-19T08:48:15.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.734+0000 7f9b80e48640 1 -- 172.21.15.7:0/3141110527 wait complete. 2024-09-19T08:48:15.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.735+0000 7f9b80e48640 1 Processor -- start 2024-09-19T08:48:15.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.735+0000 7f9b80e48640 1 -- start start 2024-09-19T08:48:15.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.735+0000 7f9b80e48640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b7c101de0 0x7f9b7c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:15.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.735+0000 7f9b80e48640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b7c102790 0x7f9b7c198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:15.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.735+0000 7f9b80e48640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b7c106f10 0x7f9b7c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:15.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.735+0000 7f9b80e48640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c111f70 con 0x7f9b7c106f10 2024-09-19T08:48:15.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.735+0000 7f9b80e48640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c111df0 con 0x7f9b7c102790 2024-09-19T08:48:15.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.735+0000 7f9b80e48640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c1120f0 con 0x7f9b7c101de0 2024-09-19T08:48:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.736+0000 7f9b7ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b7c106f10 0x7f9b7c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.736+0000 7f9b7ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b7c106f10 0x7f9b7c19ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35226/0 (socket says 172.21.15.7:35226) 2024-09-19T08:48:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.736+0000 7f9b7ad9d640 1 -- 172.21.15.7:0/2631893924 learned_addr learned my addr 172.21.15.7:0/2631893924 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.736+0000 7f9b7a59c640 1 --2- 172.21.15.7:0/2631893924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b7c101de0 0x7f9b7c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.736+0000 7f9b79d9b640 1 --2- 172.21.15.7:0/2631893924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b7c102790 0x7f9b7c198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.736+0000 7f9b7ad9d640 1 -- 172.21.15.7:0/2631893924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b7c101de0 msgr2=0x7f9b7c1983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.736+0000 7f9b7ad9d640 1 --2- 172.21.15.7:0/2631893924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b7c101de0 0x7f9b7c1983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.736+0000 7f9b7ad9d640 1 -- 172.21.15.7:0/2631893924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b7c102790 msgr2=0x7f9b7c198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.736+0000 7f9b7ad9d640 1 --2- 172.21.15.7:0/2631893924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b7c102790 0x7f9b7c198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.736+0000 7f9b7ad9d640 1 -- 172.21.15.7:0/2631893924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7c19d3a0 con 0x7f9b7c106f10 2024-09-19T08:48:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.736+0000 7f9b7a59c640 1 --2- 172.21.15.7:0/2631893924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b7c101de0 0x7f9b7c1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:48:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.736+0000 7f9b7ad9d640 1 --2- 172.21.15.7:0/2631893924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b7c106f10 0x7f9b7c19ccc0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9b74031a20 tx=0x7f9b74031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:15.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.736+0000 7f9b6b7fe640 1 -- 172.21.15.7:0/2631893924 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b74003c30 con 0x7f9b7c106f10 2024-09-19T08:48:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.736+0000 7f9b6b7fe640 1 -- 172.21.15.7:0/2631893924 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b74003dd0 con 0x7f9b7c106f10 2024-09-19T08:48:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.736+0000 7f9b80e48640 1 -- 172.21.15.7:0/2631893924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b7c19d630 con 0x7f9b7c106f10 2024-09-19T08:48:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.736+0000 7f9b6b7fe640 1 -- 172.21.15.7:0/2631893924 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7402fc40 con 0x7f9b7c106f10 2024-09-19T08:48:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.736+0000 7f9b80e48640 1 -- 172.21.15.7:0/2631893924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b7c1a4f70 con 0x7f9b7c106f10 2024-09-19T08:48:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.739+0000 7f9b6b7fe640 1 -- 172.21.15.7:0/2631893924 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f9b74004050 con 0x7f9b7c106f10 2024-09-19T08:48:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.739+0000 7f9b83221740 1 Processor -- start 2024-09-19T08:48:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.739+0000 7f9b83221740 1 -- start start 2024-09-19T08:48:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.739+0000 7f9b83221740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c1f02ef50 0x558c1f02d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.739+0000 7f9b83221740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f02d9e0 0x558c1f02de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.739+0000 7f9b83221740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c1f038780 0x558c1f03ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.740+0000 7f9b83221740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558c1ef8f2f0 con 0x558c1f02d9e0 2024-09-19T08:48:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.740+0000 7f9b83221740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558c1ef36cf0 con 0x558c1f02ef50 2024-09-19T08:48:15.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.740+0000 7f9b83221740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558c1ef8b2b0 con 0x558c1f038780 2024-09-19T08:48:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.740+0000 7f9b6b7fe640 1 --2- 172.21.15.7:0/2631893924 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9b640a33b0 0x7f9b640a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.740+0000 7f9b7a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f02d9e0 0x558c1f02de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.740+0000 7f9b7ad9d640 1 --2- 172.21.15.7:0/2631893924 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9b640a33b0 0x7f9b640a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.740+0000 7f9b7a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f02d9e0 0x558c1f02de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35238/0 (socket says 172.21.15.7:35238) 2024-09-19T08:48:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.740+0000 7f9b7a59c640 1 -- 172.21.15.7:0/4055159458 learned_addr learned my addr 172.21.15.7:0/4055159458 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.740+0000 7f9b79d9b640 1 --2- 172.21.15.7:0/4055159458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c1f02ef50 0x558c1f02d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.740+0000 7f9b79d9b640 1 --2- 172.21.15.7:0/4055159458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c1f038780 0x558c1f03ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.740+0000 7f9b6b7fe640 1 -- 172.21.15.7:0/2631893924 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f9b740f0db0 con 0x7f9b7c106f10 2024-09-19T08:48:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.740+0000 7f9b7a59c640 1 -- 172.21.15.7:0/4055159458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c1f038780 msgr2=0x558c1f03ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.740+0000 7f9b7a59c640 1 --2- 172.21.15.7:0/4055159458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c1f038780 0x558c1f03ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.740+0000 7f9b7a59c640 1 -- 172.21.15.7:0/4055159458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c1f02ef50 msgr2=0x558c1f02d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.740+0000 7f9b7a59c640 1 --2- 172.21.15.7:0/4055159458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c1f02ef50 0x558c1f02d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.740+0000 7f9b7a59c640 1 -- 172.21.15.7:0/4055159458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c1ef1b3a0 con 0x558c1f02d9e0 2024-09-19T08:48:15.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.740+0000 7f9b79d9b640 1 --2- 172.21.15.7:0/4055159458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c1f02ef50 0x558c1f02d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:48:15.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.740+0000 7f9b7ad9d640 1 --2- 172.21.15.7:0/2631893924 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9b640a33b0 0x7f9b640a5870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9b740ee6b0 tx=0x7f9b7408f1e0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:15.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.740+0000 7f9b7a59c640 1 --2- 172.21.15.7:0/4055159458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f02d9e0 0x558c1f02de20 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c010480 tx=0x7f9b6c010940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a820c9a1613fa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:15.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.741+0000 7f9b68ff9640 1 -- 172.21.15.7:0/4055159458 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c011760 con 0x558c1f02d9e0 2024-09-19T08:48:15.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.741+0000 7f9b68ff9640 1 -- 172.21.15.7:0/4055159458 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b6c011de0 con 0x558c1f02d9e0 2024-09-19T08:48:15.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.741+0000 7f9b68ff9640 1 -- 172.21.15.7:0/4055159458 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c0193d0 con 0x558c1f02d9e0 2024-09-19T08:48:15.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.741+0000 7f9b83221740 1 -- 172.21.15.7:0/4055159458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f02d9e0 msgr2=0x558c1f02de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:15.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.741+0000 7f9b83221740 1 --2- 172.21.15.7:0/4055159458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f02d9e0 0x558c1f02de20 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c010480 tx=0x7f9b6c010940 comp rx=0 tx=0).stop 2024-09-19T08:48:15.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.741+0000 7f9b83221740 1 -- 172.21.15.7:0/4055159458 shutdown_connections 2024-09-19T08:48:15.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.741+0000 7f9b83221740 1 --2- 172.21.15.7:0/4055159458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c1f038780 0x558c1f03ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.741+0000 7f9b83221740 1 --2- 172.21.15.7:0/4055159458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f02d9e0 0x558c1f02de20 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.741+0000 7f9b83221740 1 --2- 172.21.15.7:0/4055159458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c1f02ef50 0x558c1f02d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.742+0000 7f9b83221740 1 -- 172.21.15.7:0/4055159458 >> 172.21.15.7:0/4055159458 conn(0x558c1eff2310 msgr2=0x558c1f02a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:15.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.742+0000 7f9b83221740 1 -- 172.21.15.7:0/4055159458 shutdown_connections 2024-09-19T08:48:15.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.742+0000 7f9b83221740 1 -- 172.21.15.7:0/4055159458 wait complete. 2024-09-19T08:48:15.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.742+0000 7f9b83221740 1 -- start start 2024-09-19T08:48:15.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.742+0000 7f9b83221740 1 Processor -- start 2024-09-19T08:48:15.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.742+0000 7f9b83221740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c1f02d9e0 0x558c1f0380e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:15.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.742+0000 7f9b83221740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f02ef50 0x558c1f035390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:15.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.742+0000 7f9b83221740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c1f038780 0x558c1f0358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:15.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.742+0000 7f9b83221740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558c1f03b480 con 0x558c1f02ef50 2024-09-19T08:48:15.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.742+0000 7f9b83221740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558c1ef4a060 con 0x558c1f038780 2024-09-19T08:48:15.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.742+0000 7f9b83221740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558c1f03b600 con 0x558c1f02d9e0 2024-09-19T08:48:15.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.742+0000 7f9b83221740 10 client.0 _ll_register_callbacks cb 0x558c1ec9d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:15.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.742+0000 7f9b7a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f02ef50 0x558c1f035390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:15.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.742+0000 7f9b7a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f02ef50 0x558c1f035390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35248/0 (socket says 172.21.15.7:35248) 2024-09-19T08:48:15.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.742+0000 7f9b7a59c640 1 -- 172.21.15.7:0/1127620175 learned_addr learned my addr 172.21.15.7:0/1127620175 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:15.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.743+0000 7f9b7a59c640 1 -- 172.21.15.7:0/1127620175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c1f02d9e0 msgr2=0x558c1f0380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:15.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.743+0000 7f9b7a59c640 1 --2- 172.21.15.7:0/1127620175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c1f02d9e0 0x558c1f0380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.743+0000 7f9b79d9b640 1 --2- 172.21.15.7:0/1127620175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c1f038780 0x558c1f0358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:15.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.743+0000 7f9b7a59c640 1 -- 172.21.15.7:0/1127620175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c1f038780 msgr2=0x558c1f0358f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:15.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.743+0000 7f9b7a59c640 1 --2- 172.21.15.7:0/1127620175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c1f038780 0x558c1f0358f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.743+0000 7f9b7a59c640 1 -- 172.21.15.7:0/1127620175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c1ed003c0 con 0x558c1f02ef50 2024-09-19T08:48:15.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.743+0000 7f9b7a59c640 1 --2- 172.21.15.7:0/1127620175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f02ef50 0x558c1f035390 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c010e40 tx=0x7f9b6c00e8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20bcce32144ba26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:15.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.743+0000 7f9b61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:48:15.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.743+0000 7f9b61ffb640 1 -- 172.21.15.7:0/1127620175 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c00e4f0 con 0x558c1f02ef50 2024-09-19T08:48:15.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.743+0000 7f9b61ffb640 1 -- 172.21.15.7:0/1127620175 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f9b6c01f030 con 0x558c1f02ef50 2024-09-19T08:48:15.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.743+0000 7f9b83221740 1 -- 172.21.15.7:0/1127620175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b6c011de0 con 0x558c1f02ef50 2024-09-19T08:48:15.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.743+0000 7f9b61ffb640 1 -- 172.21.15.7:0/1127620175 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9b6c00ec10 con 0x558c1f02ef50 2024-09-19T08:48:15.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.743+0000 7f9b83221740 10 client.16080 fetch_fsmap learned FSMap version 25 2024-09-19T08:48:15.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.743+0000 7f9b83221740 1 -- 172.21.15.7:0/1127620175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558c1f046ec0 con 0x558c1f02ef50 2024-09-19T08:48:15.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.743+0000 7f9b61ffb640 1 -- 172.21.15.7:0/1127620175 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b6c011de0 con 0x558c1f02ef50 2024-09-19T08:48:15.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.744+0000 7f9b61ffb640 1 -- 172.21.15.7:0/1127620175 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9b6c011720 con 0x558c1f02ef50 2024-09-19T08:48:15.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.744+0000 7f9b83221740 10 client.16080 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:48:15.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.744+0000 7f9b83221740 10 client.16080 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:48:15.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.744+0000 7f9b83221740 20 client.16080 populate_metadata read hostname 'smithi007' 2024-09-19T08:48:15.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.744+0000 7f9b83221740 1 --2- 172.21.15.7:0/1127620175 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x558c1f048270 0x558c1f04a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:15.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.744+0000 7f9b83221740 4 client.16080 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:48:15.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.744+0000 7f9b83221740 1 -- 172.21.15.7:0/1127620175 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c1ef9c860 con 0x558c1f048270 2024-09-19T08:48:15.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.744+0000 7f9b79d9b640 1 --2- 172.21.15.7:0/1127620175 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x558c1f048270 0x558c1f04a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:15.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.744+0000 7f9b61ffb640 10 client.16080 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:48:15.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.744+0000 7f9b79d9b640 1 --2- 172.21.15.7:0/1127620175 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x558c1f048270 0x558c1f04a660 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e543214f1f76cb23 server_cookie=992c717704eb1a0f in_seq=0 out_seq=0 2024-09-19T08:48:15.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.745+0000 7f9b61ffb640 1 -- 172.21.15.7:0/1127620175 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c1ef9c860 con 0x558c1f048270 2024-09-19T08:48:15.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.745+0000 7f9b61ffb640 10 client.16080 handle_command_reply: tid=0 2024-09-19T08:48:15.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.745+0000 7f9b83221740 1 client.16080 shutdown 2024-09-19T08:48:15.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.745+0000 7f9b83221740 1 -- 172.21.15.7:0/1127620175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f02ef50 msgr2=0x558c1f035390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:15.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.745+0000 7f9b83221740 1 --2- 172.21.15.7:0/1127620175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f02ef50 0x558c1f035390 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c010e40 tx=0x7f9b6c00e8c0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.745+0000 7f9b83221740 1 -- 172.21.15.7:0/1127620175 shutdown_connections 2024-09-19T08:48:15.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.745+0000 7f9b83221740 1 --2- 172.21.15.7:0/1127620175 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x558c1f048270 0x558c1f04a660 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.745+0000 7f9b83221740 1 --2- 172.21.15.7:0/1127620175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c1f038780 0x558c1f0358f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.745+0000 7f9b83221740 1 --2- 172.21.15.7:0/1127620175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f02ef50 0x558c1f035390 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.745+0000 7f9b61ffb640 0 client.16080 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:48:15.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.745+0000 7f9b83221740 1 --2- 172.21.15.7:0/1127620175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c1f02d9e0 0x558c1f0380e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.745+0000 7f9b83221740 1 -- 172.21.15.7:0/1127620175 >> 172.21.15.7:0/1127620175 conn(0x558c1eff2310 msgr2=0x558c1f02fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:15.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.745+0000 7f9b83221740 1 -- 172.21.15.7:0/1127620175 shutdown_connections 2024-09-19T08:48:15.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.745+0000 7f9b83221740 1 -- 172.21.15.7:0/1127620175 wait complete. 2024-09-19T08:48:15.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.746+0000 7f9b83221740 20 client.16080 trim_cache size 0 max 16384 2024-09-19T08:48:15.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.759+0000 7f9b83221740 1 Processor -- start 2024-09-19T08:48:15.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.759+0000 7f9b83221740 1 -- start start 2024-09-19T08:48:15.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.759+0000 7f9b83221740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c1f02d9e0 0x558c1f044750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:15.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.759+0000 7f9b83221740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f02ef50 0x558c1f04fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:15.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.759+0000 7f9b83221740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c1f038780 0x558c1f050230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:15.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.759+0000 7f9b83221740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c1adf50 con 0x558c1f02ef50 2024-09-19T08:48:15.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.759+0000 7f9b83221740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c1ab820 con 0x558c1f02d9e0 2024-09-19T08:48:15.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.759+0000 7f9b83221740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c1a9670 con 0x558c1f038780 2024-09-19T08:48:15.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.759+0000 7f9b7a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f02ef50 0x558c1f04fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:15.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.759+0000 7f9b7a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f02ef50 0x558c1f04fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35254/0 (socket says 172.21.15.7:35254) 2024-09-19T08:48:15.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.759+0000 7f9b7a59c640 1 -- 172.21.15.7:0/1764427463 learned_addr learned my addr 172.21.15.7:0/1764427463 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:15.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.760+0000 7f9b79d9b640 1 --2- 172.21.15.7:0/1764427463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c1f038780 0x558c1f050230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:15.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.760+0000 7f9b79d9b640 1 --2- 172.21.15.7:0/1764427463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c1f02d9e0 0x558c1f044750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:15.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.760+0000 7f9b7a59c640 1 -- 172.21.15.7:0/1764427463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c1f038780 msgr2=0x558c1f050230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:15.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.760+0000 7f9b7a59c640 1 --2- 172.21.15.7:0/1764427463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c1f038780 0x558c1f050230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.760+0000 7f9b7a59c640 1 -- 172.21.15.7:0/1764427463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c1f02d9e0 msgr2=0x558c1f044750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:15.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.760+0000 7f9b7a59c640 1 --2- 172.21.15.7:0/1764427463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c1f02d9e0 0x558c1f044750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.760+0000 7f9b7a59c640 1 -- 172.21.15.7:0/1764427463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c1f033920 con 0x558c1f02ef50 2024-09-19T08:48:15.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.760+0000 7f9b79d9b640 1 --2- 172.21.15.7:0/1764427463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c1f02d9e0 0x558c1f044750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:48:15.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.760+0000 7f9b7a59c640 1 --2- 172.21.15.7:0/1764427463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f02ef50 0x558c1f04fcf0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c02d040 tx=0x7f9b6c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=debfdfe5930cdf76 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:15.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.760+0000 7f9b63fff640 1 -- 172.21.15.7:0/1764427463 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c010e70 con 0x558c1f02ef50 2024-09-19T08:48:15.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.760+0000 7f9b63fff640 1 -- 172.21.15.7:0/1764427463 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b6c00e930 con 0x558c1f02ef50 2024-09-19T08:48:15.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.760+0000 7f9b63fff640 1 -- 172.21.15.7:0/1764427463 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c02b420 con 0x558c1f02ef50 2024-09-19T08:48:15.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.761+0000 7f9b83221740 1 -- 172.21.15.7:0/1764427463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f02ef50 msgr2=0x558c1f04fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:15.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.761+0000 7f9b83221740 1 --2- 172.21.15.7:0/1764427463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f02ef50 0x558c1f04fcf0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c02d040 tx=0x7f9b6c001e70 comp rx=0 tx=0).stop 2024-09-19T08:48:15.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.761+0000 7f9b83221740 1 -- 172.21.15.7:0/1764427463 shutdown_connections 2024-09-19T08:48:15.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.761+0000 7f9b83221740 1 --2- 172.21.15.7:0/1764427463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c1f038780 0x558c1f050230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.761+0000 7f9b83221740 1 --2- 172.21.15.7:0/1764427463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f02ef50 0x558c1f04fcf0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.761+0000 7f9b83221740 1 --2- 172.21.15.7:0/1764427463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c1f02d9e0 0x558c1f044750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.761+0000 7f9b83221740 1 -- 172.21.15.7:0/1764427463 >> 172.21.15.7:0/1764427463 conn(0x558c1eff2310 msgr2=0x558c1f034390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:15.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.761+0000 7f9b83221740 1 -- 172.21.15.7:0/1764427463 shutdown_connections 2024-09-19T08:48:15.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.761+0000 7f9b83221740 1 -- 172.21.15.7:0/1764427463 wait complete. 2024-09-19T08:48:15.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.761+0000 7f9b83221740 1 -- start start 2024-09-19T08:48:15.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.761+0000 7f9b83221740 1 Processor -- start 2024-09-19T08:48:15.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.762+0000 7f9b83221740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c1f02d9e0 0x558c1f040f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:15.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.762+0000 7f9b83221740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c1f02ef50 0x558c1f0320c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:15.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.762+0000 7f9b83221740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f038780 0x558c1f032600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:15.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.762+0000 7f9b83221740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c1a9ce0 con 0x558c1f038780 2024-09-19T08:48:15.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.762+0000 7f9b83221740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c1ab150 con 0x558c1f02d9e0 2024-09-19T08:48:15.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.762+0000 7f9b83221740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c1aa3b0 con 0x558c1f02ef50 2024-09-19T08:48:15.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.762+0000 7f9b83221740 10 client.0 _ll_register_callbacks cb 0x7f9b70009970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:15.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.762+0000 7f9b79d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f038780 0x558c1f032600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:15.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.762+0000 7f9b79d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f038780 0x558c1f032600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35262/0 (socket says 172.21.15.7:35262) 2024-09-19T08:48:15.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.762+0000 7f9b79d9b640 1 -- 172.21.15.7:0/340739998 learned_addr learned my addr 172.21.15.7:0/340739998 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:15.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.762+0000 7f9b79d9b640 1 --2- 172.21.15.7:0/340739998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c1f02d9e0 0x558c1f040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:15.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.762+0000 7f9b7a59c640 1 --2- 172.21.15.7:0/340739998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c1f02ef50 0x558c1f0320c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:15.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.762+0000 7f9b79d9b640 1 -- 172.21.15.7:0/340739998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c1f02ef50 msgr2=0x558c1f0320c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:15.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.762+0000 7f9b79d9b640 1 --2- 172.21.15.7:0/340739998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c1f02ef50 0x558c1f0320c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.762+0000 7f9b79d9b640 1 -- 172.21.15.7:0/340739998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c1f02d9e0 msgr2=0x558c1f040f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:15.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.762+0000 7f9b79d9b640 1 --2- 172.21.15.7:0/340739998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c1f02d9e0 0x558c1f040f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.762+0000 7f9b79d9b640 1 -- 172.21.15.7:0/340739998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c1f032d90 con 0x558c1f038780 2024-09-19T08:48:15.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.762+0000 7f9b79d9b640 1 --2- 172.21.15.7:0/340739998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f038780 0x558c1f032600 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9b70000c00 tx=0x7f9b70005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3042f6ceb7a7b7fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:15.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.762+0000 7f9b61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:48:15.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.763+0000 7f9b61ffb640 1 -- 172.21.15.7:0/340739998 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b70019040 con 0x558c1f038780 2024-09-19T08:48:15.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.763+0000 7f9b61ffb640 1 -- 172.21.15.7:0/340739998 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f9b70004020 con 0x558c1f038780 2024-09-19T08:48:15.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.763+0000 7f9b83221740 1 -- 172.21.15.7:0/340739998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b6c00e930 con 0x558c1f038780 2024-09-19T08:48:15.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.763+0000 7f9b61ffb640 1 -- 172.21.15.7:0/340739998 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9b70004220 con 0x558c1f038780 2024-09-19T08:48:15.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.763+0000 7f9b83221740 10 client.16086 fetch_fsmap learned FSMap version 25 2024-09-19T08:48:15.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.763+0000 7f9b83221740 1 -- 172.21.15.7:0/340739998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558c1f0b2cf0 con 0x558c1f038780 2024-09-19T08:48:15.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.763+0000 7f9b61ffb640 1 -- 172.21.15.7:0/340739998 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b6c00e930 con 0x558c1f038780 2024-09-19T08:48:15.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.763+0000 7f9b61ffb640 1 -- 172.21.15.7:0/340739998 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9b7001f040 con 0x558c1f038780 2024-09-19T08:48:15.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.763+0000 7f9b83221740 10 client.16086 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:48:15.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.763+0000 7f9b83221740 10 client.16086 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:48:15.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.763+0000 7f9b83221740 20 client.16086 populate_metadata read hostname 'smithi007' 2024-09-19T08:48:15.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.763+0000 7f9b83221740 1 --2- 172.21.15.7:0/340739998 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x558c1f0b3440 0x558c1f0b5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:15.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.763+0000 7f9b83221740 4 client.16086 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:48:15.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.763+0000 7f9b83221740 1 -- 172.21.15.7:0/340739998 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558c1ef96d70 con 0x558c1f0b3440 2024-09-19T08:48:15.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.764+0000 7f9b7a59c640 1 --2- 172.21.15.7:0/340739998 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x558c1f0b3440 0x558c1f0b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:15.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.764+0000 7f9b61ffb640 10 client.16086 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:48:15.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.764+0000 7f9b7a59c640 1 --2- 172.21.15.7:0/340739998 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x558c1f0b3440 0x558c1f0b5860 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d4633d3bad08900b server_cookie=b539204f9e0ecc8f in_seq=0 out_seq=0 2024-09-19T08:48:15.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.764+0000 7f9b61ffb640 1 -- 172.21.15.7:0/340739998 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558c1ef96d70 con 0x558c1f0b3440 2024-09-19T08:48:15.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.764+0000 7f9b61ffb640 10 client.16086 handle_command_reply: tid=0 2024-09-19T08:48:15.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.764+0000 7f9b83221740 1 client.16086 shutdown 2024-09-19T08:48:15.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.764+0000 7f9b83221740 1 -- 172.21.15.7:0/340739998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f038780 msgr2=0x558c1f032600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:15.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.764+0000 7f9b83221740 1 --2- 172.21.15.7:0/340739998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f038780 0x558c1f032600 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9b70000c00 tx=0x7f9b70005f90 comp rx=0 tx=0).stop 2024-09-19T08:48:15.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.764+0000 7f9b83221740 1 -- 172.21.15.7:0/340739998 shutdown_connections 2024-09-19T08:48:15.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.764+0000 7f9b83221740 1 --2- 172.21.15.7:0/340739998 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x558c1f0b3440 0x558c1f0b5860 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.765+0000 7f9b61ffb640 0 client.16086 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:48:15.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.765+0000 7f9b83221740 1 --2- 172.21.15.7:0/340739998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c1f038780 0x558c1f032600 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.765+0000 7f9b83221740 1 --2- 172.21.15.7:0/340739998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c1f02ef50 0x558c1f0320c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.765+0000 7f9b83221740 1 --2- 172.21.15.7:0/340739998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c1f02d9e0 0x558c1f040f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.765+0000 7f9b83221740 1 -- 172.21.15.7:0/340739998 >> 172.21.15.7:0/340739998 conn(0x558c1eff2310 msgr2=0x558c1f033b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:15.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.765+0000 7f9b83221740 1 -- 172.21.15.7:0/340739998 shutdown_connections 2024-09-19T08:48:15.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.765+0000 7f9b83221740 1 -- 172.21.15.7:0/340739998 wait complete. 2024-09-19T08:48:15.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.765+0000 7f9b83221740 20 client.16086 trim_cache size 0 max 16384 2024-09-19T08:48:15.776 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:48:15.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.765+0000 7f9b80e48640 1 -- 172.21.15.7:0/2631893924 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9b640a33b0 msgr2=0x7f9b640a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:15.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.765+0000 7f9b80e48640 1 --2- 172.21.15.7:0/2631893924 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9b640a33b0 0x7f9b640a5870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9b740ee6b0 tx=0x7f9b7408f1e0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.765+0000 7f9b80e48640 1 -- 172.21.15.7:0/2631893924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b7c106f10 msgr2=0x7f9b7c19ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:15.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.765+0000 7f9b80e48640 1 --2- 172.21.15.7:0/2631893924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b7c106f10 0x7f9b7c19ccc0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9b74031a20 tx=0x7f9b74031a50 comp rx=0 tx=0).stop 2024-09-19T08:48:15.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.765+0000 7f9b80e48640 1 -- 172.21.15.7:0/2631893924 shutdown_connections 2024-09-19T08:48:15.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.765+0000 7f9b80e48640 1 --2- 172.21.15.7:0/2631893924 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f9b640a33b0 0x7f9b640a5870 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.765+0000 7f9b80e48640 1 --2- 172.21.15.7:0/2631893924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b7c106f10 0x7f9b7c19ccc0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.765+0000 7f9b80e48640 1 --2- 172.21.15.7:0/2631893924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b7c102790 0x7f9b7c198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.765+0000 7f9b80e48640 1 --2- 172.21.15.7:0/2631893924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b7c101de0 0x7f9b7c1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:15.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.765+0000 7f9b80e48640 1 -- 172.21.15.7:0/2631893924 >> 172.21.15.7:0/2631893924 conn(0x7f9b7c0fd8c0 msgr2=0x7f9b7c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:15.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.766+0000 7f9b80e48640 1 -- 172.21.15.7:0/2631893924 shutdown_connections 2024-09-19T08:48:15.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:15.766+0000 7f9b80e48640 1 -- 172.21.15.7:0/2631893924 wait complete. 2024-09-19T08:48:16.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:16 smithi007 ceph-mon[31221]: pgmap v115: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T08:48:16.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:16 smithi175 ceph-mon[35688]: pgmap v115: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T08:48:16.679 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:48:16.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:16 smithi044 ceph-mon[35072]: pgmap v115: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T08:48:16.935 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:17.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.552+0000 7f0a2b598640 1 -- 172.21.15.7:0/458482652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a24101420 msgr2=0x7f0a2410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:17.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.552+0000 7f0a2b598640 1 --2- 172.21.15.7:0/458482652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a24101420 0x7f0a2410d950 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c009cd0 tx=0x7f0a1c02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.552+0000 7f0a2b598640 1 -- 172.21.15.7:0/458482652 shutdown_connections 2024-09-19T08:48:17.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.552+0000 7f0a2b598640 1 --2- 172.21.15.7:0/458482652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a24101420 0x7f0a2410d950 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.552+0000 7f0a2b598640 1 --2- 172.21.15.7:0/458482652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a24100a80 0x7f0a24100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.553+0000 7f0a2b598640 1 --2- 172.21.15.7:0/458482652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a24106a80 0x7f0a24106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.553+0000 7f0a2b598640 1 -- 172.21.15.7:0/458482652 >> 172.21.15.7:0/458482652 conn(0x7f0a240fc7a0 msgr2=0x7f0a240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:17.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.553+0000 7f0a2b598640 1 -- 172.21.15.7:0/458482652 shutdown_connections 2024-09-19T08:48:17.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.553+0000 7f0a2b598640 1 -- 172.21.15.7:0/458482652 wait complete. 2024-09-19T08:48:17.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.553+0000 7f0a2b598640 1 Processor -- start 2024-09-19T08:48:17.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.553+0000 7f0a2b598640 1 -- start start 2024-09-19T08:48:17.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.553+0000 7f0a2b598640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a24100a80 0x7f0a24198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:17.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.553+0000 7f0a2b598640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a24101420 0x7f0a24198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:17.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.554+0000 7f0a2b598640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a24106a80 0x7f0a2419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:17.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.554+0000 7f0a2b598640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0a24110e80 con 0x7f0a24101420 2024-09-19T08:48:17.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.554+0000 7f0a2b598640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0a24110d00 con 0x7f0a24100a80 2024-09-19T08:48:17.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.554+0000 7f0a2b598640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0a24111000 con 0x7f0a24106a80 2024-09-19T08:48:17.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.554+0000 7f0a28b33640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a24101420 0x7f0a24198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:17.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.554+0000 7f0a28b33640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a24101420 0x7f0a24198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35272/0 (socket says 172.21.15.7:35272) 2024-09-19T08:48:17.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.554+0000 7f0a28b33640 1 -- 172.21.15.7:0/3642252618 learned_addr learned my addr 172.21.15.7:0/3642252618 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:17.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.554+0000 7f0a29334640 1 --2- 172.21.15.7:0/3642252618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a24100a80 0x7f0a24198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:17.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.554+0000 7f0a29b35640 1 --2- 172.21.15.7:0/3642252618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a24106a80 0x7f0a2419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:17.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.554+0000 7f0a28b33640 1 -- 172.21.15.7:0/3642252618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a24106a80 msgr2=0x7f0a2419ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:17.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.554+0000 7f0a28b33640 1 --2- 172.21.15.7:0/3642252618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a24106a80 0x7f0a2419ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.554+0000 7f0a28b33640 1 -- 172.21.15.7:0/3642252618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a24100a80 msgr2=0x7f0a24198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:17.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.554+0000 7f0a28b33640 1 --2- 172.21.15.7:0/3642252618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a24100a80 0x7f0a24198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.554+0000 7f0a28b33640 1 -- 172.21.15.7:0/3642252618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2419d3b0 con 0x7f0a24101420 2024-09-19T08:48:17.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.554+0000 7f0a28b33640 1 --2- 172.21.15.7:0/3642252618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a24101420 0x7f0a24198940 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400d950 tx=0x7f0a1400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:17.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.554+0000 7f0a1a7fc640 1 -- 172.21.15.7:0/3642252618 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a14017070 con 0x7f0a24101420 2024-09-19T08:48:17.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.554+0000 7f0a2b598640 1 -- 172.21.15.7:0/3642252618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a2419d6a0 con 0x7f0a24101420 2024-09-19T08:48:17.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.554+0000 7f0a1a7fc640 1 -- 172.21.15.7:0/3642252618 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a14009c30 con 0x7f0a24101420 2024-09-19T08:48:17.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.554+0000 7f0a1a7fc640 1 -- 172.21.15.7:0/3642252618 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1400f6b0 con 0x7f0a24101420 2024-09-19T08:48:17.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.554+0000 7f0a2b598640 1 -- 172.21.15.7:0/3642252618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a241a4f80 con 0x7f0a24101420 2024-09-19T08:48:17.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.557+0000 7f0a1a7fc640 1 -- 172.21.15.7:0/3642252618 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f0a140109d0 con 0x7f0a24101420 2024-09-19T08:48:17.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.557+0000 7f0a2d971740 1 Processor -- start 2024-09-19T08:48:17.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.557+0000 7f0a2d971740 1 -- start start 2024-09-19T08:48:17.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.557+0000 7f0a2d971740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e1bb40 0x555bd0e1a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:17.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.557+0000 7f0a2d971740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555bd0e1a5d0 0x555bd0e1aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:17.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.557+0000 7f0a2d971740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e25370 0x555bd0e27760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:17.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.557+0000 7f0a2d971740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555bd0d802f0 con 0x555bd0e1bb40 2024-09-19T08:48:17.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.557+0000 7f0a2d971740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555bd0d27cf0 con 0x555bd0e25370 2024-09-19T08:48:17.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.557+0000 7f0a2d971740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555bd0d7c2b0 con 0x555bd0e1a5d0 2024-09-19T08:48:17.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.557+0000 7f0a29b35640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e1bb40 0x555bd0e1a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:17.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.557+0000 7f0a1a7fc640 1 --2- 172.21.15.7:0/3642252618 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0a100a33b0 0x7f0a100a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:17.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.557+0000 7f0a29b35640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e1bb40 0x555bd0e1a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35276/0 (socket says 172.21.15.7:35276) 2024-09-19T08:48:17.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.557+0000 7f0a29b35640 1 -- 172.21.15.7:0/4046804712 learned_addr learned my addr 172.21.15.7:0/4046804712 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:17.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.558+0000 7f0a29b35640 1 --2- 172.21.15.7:0/3642252618 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0a100a33b0 0x7f0a100a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:17.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.558+0000 7f0a29334640 1 --2- 172.21.15.7:0/4046804712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555bd0e1a5d0 0x555bd0e1aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:17.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.558+0000 7f0a1a7fc640 1 -- 172.21.15.7:0/3642252618 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f0a140cf9c0 con 0x7f0a24101420 2024-09-19T08:48:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.558+0000 7f0a29b35640 1 -- 172.21.15.7:0/4046804712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555bd0e1a5d0 msgr2=0x555bd0e1aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.558+0000 7f0a29b35640 1 --2- 172.21.15.7:0/4046804712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555bd0e1a5d0 0x555bd0e1aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.558+0000 7f0a29b35640 1 -- 172.21.15.7:0/4046804712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e25370 msgr2=0x555bd0e27760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.558+0000 7f0a28b33640 1 --2- 172.21.15.7:0/4046804712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e25370 0x555bd0e27760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.558+0000 7f0a29b35640 1 --2- 172.21.15.7:0/4046804712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e25370 0x555bd0e27760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.558+0000 7f0a29b35640 1 -- 172.21.15.7:0/4046804712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bd0d0c3a0 con 0x555bd0e1bb40 2024-09-19T08:48:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.558+0000 7f0a28b33640 1 --2- 172.21.15.7:0/4046804712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e25370 0x555bd0e27760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:48:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.558+0000 7f0a29b35640 1 --2- 172.21.15.7:0/4046804712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e1bb40 0x555bd0e1a090 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c004af0 tx=0x7f0a1c031a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49fe8e6aa6cef3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.558+0000 7f0a0f7fe640 1 -- 172.21.15.7:0/4046804712 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c04f070 con 0x555bd0e1bb40 2024-09-19T08:48:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.558+0000 7f0a0f7fe640 1 -- 172.21.15.7:0/4046804712 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a1c036040 con 0x555bd0e1bb40 2024-09-19T08:48:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.558+0000 7f0a0f7fe640 1 -- 172.21.15.7:0/4046804712 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c030850 con 0x555bd0e1bb40 2024-09-19T08:48:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.558+0000 7f0a29b35640 1 --2- 172.21.15.7:0/3642252618 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0a100a33b0 0x7f0a100a5870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c04c000 tx=0x7f0a1c048000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.559+0000 7f0a2d971740 1 -- 172.21.15.7:0/4046804712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e1bb40 msgr2=0x555bd0e1a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:17.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.559+0000 7f0a2d971740 1 --2- 172.21.15.7:0/4046804712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e1bb40 0x555bd0e1a090 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c004af0 tx=0x7f0a1c031a70 comp rx=0 tx=0).stop 2024-09-19T08:48:17.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.559+0000 7f0a2d971740 1 -- 172.21.15.7:0/4046804712 shutdown_connections 2024-09-19T08:48:17.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.559+0000 7f0a2d971740 1 --2- 172.21.15.7:0/4046804712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e25370 0x555bd0e27760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.559+0000 7f0a2d971740 1 --2- 172.21.15.7:0/4046804712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555bd0e1a5d0 0x555bd0e1aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.559+0000 7f0a2d971740 1 --2- 172.21.15.7:0/4046804712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e1bb40 0x555bd0e1a090 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.559+0000 7f0a2d971740 1 -- 172.21.15.7:0/4046804712 >> 172.21.15.7:0/4046804712 conn(0x555bd0de3310 msgr2=0x555bd0e16c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:17.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.559+0000 7f0a2d971740 1 -- 172.21.15.7:0/4046804712 shutdown_connections 2024-09-19T08:48:17.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.559+0000 7f0a2d971740 1 -- 172.21.15.7:0/4046804712 wait complete. 2024-09-19T08:48:17.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.559+0000 7f0a2d971740 1 -- start start 2024-09-19T08:48:17.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.560+0000 7f0a2d971740 1 Processor -- start 2024-09-19T08:48:17.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.560+0000 7f0a2d971740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555bd0e1a5d0 0x555bd0e24da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:17.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.560+0000 7f0a2d971740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e1bb40 0x555bd0e22050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:17.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.560+0000 7f0a2d971740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e25370 0x555bd0e227e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:17.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.560+0000 7f0a2d971740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555bd0e28070 con 0x555bd0e25370 2024-09-19T08:48:17.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.560+0000 7f0a2d971740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555bd0d3b060 con 0x555bd0e1bb40 2024-09-19T08:48:17.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.560+0000 7f0a2d971740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555bd0e281f0 con 0x555bd0e1a5d0 2024-09-19T08:48:17.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.560+0000 7f0a2d971740 10 client.0 _ll_register_callbacks cb 0x555bd0a8e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:17.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.560+0000 7f0a29b35640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e25370 0x555bd0e227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:17.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.560+0000 7f0a29b35640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e25370 0x555bd0e227e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35280/0 (socket says 172.21.15.7:35280) 2024-09-19T08:48:17.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.560+0000 7f0a29b35640 1 -- 172.21.15.7:0/4207951488 learned_addr learned my addr 172.21.15.7:0/4207951488 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:17.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.560+0000 7f0a28b33640 1 --2- 172.21.15.7:0/4207951488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e1bb40 0x555bd0e22050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:17.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.560+0000 7f0a29334640 1 --2- 172.21.15.7:0/4207951488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555bd0e1a5d0 0x555bd0e24da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:17.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.560+0000 7f0a29b35640 1 -- 172.21.15.7:0/4207951488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555bd0e1a5d0 msgr2=0x555bd0e24da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:17.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.560+0000 7f0a29b35640 1 --2- 172.21.15.7:0/4207951488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555bd0e1a5d0 0x555bd0e24da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.560+0000 7f0a29b35640 1 -- 172.21.15.7:0/4207951488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e1bb40 msgr2=0x555bd0e22050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:17.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.560+0000 7f0a29b35640 1 --2- 172.21.15.7:0/4207951488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e1bb40 0x555bd0e22050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.560+0000 7f0a29b35640 1 -- 172.21.15.7:0/4207951488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bd0af13c0 con 0x555bd0e25370 2024-09-19T08:48:17.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.560+0000 7f0a28b33640 1 --2- 172.21.15.7:0/4207951488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e1bb40 0x555bd0e22050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:48:17.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.560+0000 7f0a29334640 1 --2- 172.21.15.7:0/4207951488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555bd0e1a5d0 0x555bd0e24da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:48:17.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.561+0000 7f0a29b35640 1 --2- 172.21.15.7:0/4207951488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e25370 0x555bd0e227e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c031eb0 tx=0x7f0a1c030e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9f7ddb0f843eec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:17.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.561+0000 7f0a0cff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:48:17.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.561+0000 7f0a0cff9640 1 -- 172.21.15.7:0/4207951488 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c057020 con 0x555bd0e25370 2024-09-19T08:48:17.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.561+0000 7f0a0cff9640 1 -- 172.21.15.7:0/4207951488 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f0a1c003e00 con 0x555bd0e25370 2024-09-19T08:48:17.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.561+0000 7f0a2d971740 1 -- 172.21.15.7:0/4207951488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a1c036040 con 0x555bd0e25370 2024-09-19T08:48:17.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.561+0000 7f0a0cff9640 1 -- 172.21.15.7:0/4207951488 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0a1c062050 con 0x555bd0e25370 2024-09-19T08:48:17.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.561+0000 7f0a2d971740 10 client.16098 fetch_fsmap learned FSMap version 25 2024-09-19T08:48:17.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.561+0000 7f0a2d971740 1 -- 172.21.15.7:0/4207951488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555bd0e28070 con 0x555bd0e25370 2024-09-19T08:48:17.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.561+0000 7f0a0cff9640 1 -- 172.21.15.7:0/4207951488 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a1c036040 con 0x555bd0e25370 2024-09-19T08:48:17.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.561+0000 7f0a0cff9640 1 -- 172.21.15.7:0/4207951488 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0a1c030070 con 0x555bd0e25370 2024-09-19T08:48:17.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.561+0000 7f0a2d971740 10 client.16098 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:48:17.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.561+0000 7f0a2d971740 10 client.16098 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:48:17.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.561+0000 7f0a2d971740 20 client.16098 populate_metadata read hostname 'smithi007' 2024-09-19T08:48:17.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.561+0000 7f0a2d971740 1 --2- 172.21.15.7:0/4207951488 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x555bd0e34c40 0x555bd0e37030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:17.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.561+0000 7f0a2d971740 4 client.16098 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:48:17.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.561+0000 7f0a2d971740 1 -- 172.21.15.7:0/4207951488 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555bd0d8d860 con 0x555bd0e34c40 2024-09-19T08:48:17.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.562+0000 7f0a29334640 1 --2- 172.21.15.7:0/4207951488 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x555bd0e34c40 0x555bd0e37030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:17.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.562+0000 7f0a29334640 1 --2- 172.21.15.7:0/4207951488 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x555bd0e34c40 0x555bd0e37030 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=20649fe45ae8886e server_cookie=b49f31ebac92b709 in_seq=0 out_seq=0 2024-09-19T08:48:17.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.562+0000 7f0a0cff9640 10 client.16098 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:48:17.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.563+0000 7f0a0cff9640 1 -- 172.21.15.7:0/4207951488 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555bd0d8d860 con 0x555bd0e34c40 2024-09-19T08:48:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.563+0000 7f0a0cff9640 10 client.16098 handle_command_reply: tid=0 2024-09-19T08:48:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.563+0000 7f0a2d971740 1 client.16098 shutdown 2024-09-19T08:48:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.563+0000 7f0a2d971740 1 -- 172.21.15.7:0/4207951488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e25370 msgr2=0x555bd0e227e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.563+0000 7f0a2d971740 1 --2- 172.21.15.7:0/4207951488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e25370 0x555bd0e227e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c031eb0 tx=0x7f0a1c030e40 comp rx=0 tx=0).stop 2024-09-19T08:48:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.563+0000 7f0a2d971740 1 -- 172.21.15.7:0/4207951488 shutdown_connections 2024-09-19T08:48:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.563+0000 7f0a2d971740 1 --2- 172.21.15.7:0/4207951488 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x555bd0e34c40 0x555bd0e37030 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.563+0000 7f0a2d971740 1 --2- 172.21.15.7:0/4207951488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e25370 0x555bd0e227e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.563+0000 7f0a2d971740 1 --2- 172.21.15.7:0/4207951488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e1bb40 0x555bd0e22050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.563+0000 7f0a0cff9640 0 client.16098 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:48:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.563+0000 7f0a2d971740 1 --2- 172.21.15.7:0/4207951488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555bd0e1a5d0 0x555bd0e24da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.563+0000 7f0a2d971740 1 -- 172.21.15.7:0/4207951488 >> 172.21.15.7:0/4207951488 conn(0x555bd0de3310 msgr2=0x555bd0e1c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.563+0000 7f0a2d971740 1 -- 172.21.15.7:0/4207951488 shutdown_connections 2024-09-19T08:48:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.563+0000 7f0a2d971740 1 -- 172.21.15.7:0/4207951488 wait complete. 2024-09-19T08:48:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.563+0000 7f0a2d971740 20 client.16098 trim_cache size 0 max 16384 2024-09-19T08:48:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.577+0000 7f0a2d971740 1 Processor -- start 2024-09-19T08:48:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.577+0000 7f0a2d971740 1 -- start start 2024-09-19T08:48:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.577+0000 7f0a2d971740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e1a5d0 0x555bd0e22020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.577+0000 7f0a2d971740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e1bb40 0x555bd0e1d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.577+0000 7f0a2d971740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555bd0e25370 0x555bd0e1d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.577+0000 7f0a2d971740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0a241b0110 con 0x555bd0e1bb40 2024-09-19T08:48:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.577+0000 7f0a2d971740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0a241ad9e0 con 0x555bd0e1a5d0 2024-09-19T08:48:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.577+0000 7f0a2d971740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0a241ab830 con 0x555bd0e25370 2024-09-19T08:48:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.577+0000 7f0a28b33640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e1bb40 0x555bd0e1d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.577+0000 7f0a28b33640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e1bb40 0x555bd0e1d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35292/0 (socket says 172.21.15.7:35292) 2024-09-19T08:48:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.577+0000 7f0a28b33640 1 -- 172.21.15.7:0/3349324918 learned_addr learned my addr 172.21.15.7:0/3349324918 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.577+0000 7f0a29334640 1 --2- 172.21.15.7:0/3349324918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e1a5d0 0x555bd0e22020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.578+0000 7f0a29b35640 1 --2- 172.21.15.7:0/3349324918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555bd0e25370 0x555bd0e1d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.578+0000 7f0a28b33640 1 -- 172.21.15.7:0/3349324918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555bd0e25370 msgr2=0x555bd0e1d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.578+0000 7f0a28b33640 1 --2- 172.21.15.7:0/3349324918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555bd0e25370 0x555bd0e1d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.578+0000 7f0a28b33640 1 -- 172.21.15.7:0/3349324918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e1a5d0 msgr2=0x555bd0e22020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.578+0000 7f0a28b33640 1 --2- 172.21.15.7:0/3349324918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e1a5d0 0x555bd0e22020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.578+0000 7f0a28b33640 1 -- 172.21.15.7:0/3349324918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bd0e16510 con 0x555bd0e1bb40 2024-09-19T08:48:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.578+0000 7f0a29334640 1 --2- 172.21.15.7:0/3349324918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e1a5d0 0x555bd0e22020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:48:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.578+0000 7f0a28b33640 1 --2- 172.21.15.7:0/3349324918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e1bb40 0x555bd0e1d120 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0a14098660 tx=0x7f0a14084f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb3f494c02ede3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.578+0000 7f0a0effd640 1 -- 172.21.15.7:0/3349324918 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a14020040 con 0x555bd0e1bb40 2024-09-19T08:48:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.578+0000 7f0a0effd640 1 -- 172.21.15.7:0/3349324918 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a140a0040 con 0x555bd0e1bb40 2024-09-19T08:48:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.578+0000 7f0a0effd640 1 -- 172.21.15.7:0/3349324918 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1409b340 con 0x555bd0e1bb40 2024-09-19T08:48:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.579+0000 7f0a2d971740 1 -- 172.21.15.7:0/3349324918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e1bb40 msgr2=0x555bd0e1d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:17.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.579+0000 7f0a2d971740 1 --2- 172.21.15.7:0/3349324918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e1bb40 0x555bd0e1d120 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0a14098660 tx=0x7f0a14084f90 comp rx=0 tx=0).stop 2024-09-19T08:48:17.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.579+0000 7f0a2d971740 1 -- 172.21.15.7:0/3349324918 shutdown_connections 2024-09-19T08:48:17.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.579+0000 7f0a2d971740 1 --2- 172.21.15.7:0/3349324918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555bd0e25370 0x555bd0e1d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.579+0000 7f0a2d971740 1 --2- 172.21.15.7:0/3349324918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e1bb40 0x555bd0e1d120 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.579+0000 7f0a2d971740 1 --2- 172.21.15.7:0/3349324918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e1a5d0 0x555bd0e22020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.579+0000 7f0a2d971740 1 -- 172.21.15.7:0/3349324918 >> 172.21.15.7:0/3349324918 conn(0x555bd0de3310 msgr2=0x555bd0e21910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:17.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.579+0000 7f0a2d971740 1 -- 172.21.15.7:0/3349324918 shutdown_connections 2024-09-19T08:48:17.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.579+0000 7f0a2d971740 1 -- 172.21.15.7:0/3349324918 wait complete. 2024-09-19T08:48:17.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.579+0000 7f0a2d971740 1 -- start start 2024-09-19T08:48:17.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.579+0000 7f0a2d971740 1 Processor -- start 2024-09-19T08:48:17.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.580+0000 7f0a2d971740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555bd0e1a5d0 0x555bd0e2d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:17.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.580+0000 7f0a2d971740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e1bb40 0x555bd0e1ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:17.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.580+0000 7f0a2d971740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e25370 0x555bd0e1f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:17.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.580+0000 7f0a2d971740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0a241abea0 con 0x555bd0e1bb40 2024-09-19T08:48:17.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.580+0000 7f0a2d971740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0a241ad310 con 0x555bd0e25370 2024-09-19T08:48:17.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.580+0000 7f0a2d971740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0a241ac570 con 0x555bd0e1a5d0 2024-09-19T08:48:17.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.580+0000 7f0a2d971740 10 client.0 _ll_register_callbacks cb 0x7f0a1c04d070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:17.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.580+0000 7f0a28b33640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e1bb40 0x555bd0e1ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:17.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.580+0000 7f0a28b33640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e1bb40 0x555bd0e1ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35308/0 (socket says 172.21.15.7:35308) 2024-09-19T08:48:17.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.580+0000 7f0a28b33640 1 -- 172.21.15.7:0/1099524500 learned_addr learned my addr 172.21.15.7:0/1099524500 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:17.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.580+0000 7f0a29334640 1 --2- 172.21.15.7:0/1099524500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555bd0e1a5d0 0x555bd0e2d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:17.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.580+0000 7f0a29b35640 1 --2- 172.21.15.7:0/1099524500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e25370 0x555bd0e1f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:17.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.580+0000 7f0a28b33640 1 -- 172.21.15.7:0/1099524500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555bd0e1a5d0 msgr2=0x555bd0e2d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:17.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.580+0000 7f0a28b33640 1 --2- 172.21.15.7:0/1099524500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555bd0e1a5d0 0x555bd0e2d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.580+0000 7f0a28b33640 1 -- 172.21.15.7:0/1099524500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e25370 msgr2=0x555bd0e1f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:17.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.580+0000 7f0a28b33640 1 --2- 172.21.15.7:0/1099524500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e25370 0x555bd0e1f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.580+0000 7f0a28b33640 1 -- 172.21.15.7:0/1099524500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bd0e1f7d0 con 0x555bd0e1bb40 2024-09-19T08:48:17.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.580+0000 7f0a28b33640 1 --2- 172.21.15.7:0/1099524500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e1bb40 0x555bd0e1ec50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0a1409b990 tx=0x7f0a14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2736504320c627e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:17.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.580+0000 7f0a0cff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:48:17.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.580+0000 7f0a0cff9640 1 -- 172.21.15.7:0/1099524500 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a14020070 con 0x555bd0e1bb40 2024-09-19T08:48:17.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.580+0000 7f0a0cff9640 1 -- 172.21.15.7:0/1099524500 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f0a1409b2e0 con 0x555bd0e1bb40 2024-09-19T08:48:17.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.580+0000 7f0a2d971740 1 -- 172.21.15.7:0/1099524500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a140a0040 con 0x555bd0e1bb40 2024-09-19T08:48:17.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.581+0000 7f0a0cff9640 1 -- 172.21.15.7:0/1099524500 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0a14098300 con 0x555bd0e1bb40 2024-09-19T08:48:17.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.581+0000 7f0a2d971740 10 client.16104 fetch_fsmap learned FSMap version 25 2024-09-19T08:48:17.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.581+0000 7f0a2d971740 1 -- 172.21.15.7:0/1099524500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555bd0e9f610 con 0x555bd0e1bb40 2024-09-19T08:48:17.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.581+0000 7f0a0cff9640 1 -- 172.21.15.7:0/1099524500 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a140a0040 con 0x555bd0e1bb40 2024-09-19T08:48:17.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.581+0000 7f0a0cff9640 1 -- 172.21.15.7:0/1099524500 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0a140860b0 con 0x555bd0e1bb40 2024-09-19T08:48:17.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.581+0000 7f0a2d971740 10 client.16104 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:48:17.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.581+0000 7f0a2d971740 10 client.16104 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:48:17.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.581+0000 7f0a2d971740 20 client.16104 populate_metadata read hostname 'smithi007' 2024-09-19T08:48:17.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.581+0000 7f0a2d971740 1 --2- 172.21.15.7:0/1099524500 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x555bd0eb0fa0 0x555bd0eb3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:17.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.581+0000 7f0a2d971740 4 client.16104 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:48:17.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.581+0000 7f0a2d971740 1 -- 172.21.15.7:0/1099524500 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555bd0d87d70 con 0x555bd0eb0fa0 2024-09-19T08:48:17.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.581+0000 7f0a29334640 1 --2- 172.21.15.7:0/1099524500 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x555bd0eb0fa0 0x555bd0eb3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:17.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.582+0000 7f0a0cff9640 10 client.16104 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:48:17.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.582+0000 7f0a29334640 1 --2- 172.21.15.7:0/1099524500 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x555bd0eb0fa0 0x555bd0eb3390 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=59c92514621f981f server_cookie=db2d52f30c8fc48d in_seq=0 out_seq=0 2024-09-19T08:48:17.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.582+0000 7f0a0cff9640 1 -- 172.21.15.7:0/1099524500 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555bd0d87d70 con 0x555bd0eb0fa0 2024-09-19T08:48:17.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.582+0000 7f0a0cff9640 10 client.16104 handle_command_reply: tid=0 2024-09-19T08:48:17.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.582+0000 7f0a2d971740 1 client.16104 shutdown 2024-09-19T08:48:17.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.582+0000 7f0a2d971740 1 -- 172.21.15.7:0/1099524500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e1bb40 msgr2=0x555bd0e1ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:17.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.582+0000 7f0a2d971740 1 --2- 172.21.15.7:0/1099524500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e1bb40 0x555bd0e1ec50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0a1409b990 tx=0x7f0a14005880 comp rx=0 tx=0).stop 2024-09-19T08:48:17.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.582+0000 7f0a2d971740 1 -- 172.21.15.7:0/1099524500 shutdown_connections 2024-09-19T08:48:17.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.582+0000 7f0a2d971740 1 --2- 172.21.15.7:0/1099524500 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x555bd0eb0fa0 0x555bd0eb3390 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.582+0000 7f0a2d971740 1 --2- 172.21.15.7:0/1099524500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555bd0e25370 0x555bd0e1f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.582+0000 7f0a2d971740 1 --2- 172.21.15.7:0/1099524500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555bd0e1bb40 0x555bd0e1ec50 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.582+0000 7f0a2d971740 1 --2- 172.21.15.7:0/1099524500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555bd0e1a5d0 0x555bd0e2d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.582+0000 7f0a2d971740 1 -- 172.21.15.7:0/1099524500 >> 172.21.15.7:0/1099524500 conn(0x555bd0de3310 msgr2=0x555bd0e238b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:17.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.582+0000 7f0a0cff9640 0 client.16104 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:48:17.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.583+0000 7f0a2d971740 1 -- 172.21.15.7:0/1099524500 shutdown_connections 2024-09-19T08:48:17.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.583+0000 7f0a2d971740 1 -- 172.21.15.7:0/1099524500 wait complete. 2024-09-19T08:48:17.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.583+0000 7f0a2d971740 20 client.16104 trim_cache size 0 max 16384 2024-09-19T08:48:17.600 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:48:17.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.583+0000 7f0a2b598640 1 -- 172.21.15.7:0/3642252618 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0a100a33b0 msgr2=0x7f0a100a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:17.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.583+0000 7f0a2b598640 1 --2- 172.21.15.7:0/3642252618 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0a100a33b0 0x7f0a100a5870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c04c000 tx=0x7f0a1c048000 comp rx=0 tx=0).stop 2024-09-19T08:48:17.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.583+0000 7f0a2b598640 1 -- 172.21.15.7:0/3642252618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a24101420 msgr2=0x7f0a24198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:17.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.583+0000 7f0a2b598640 1 --2- 172.21.15.7:0/3642252618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a24101420 0x7f0a24198940 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400d950 tx=0x7f0a1400de10 comp rx=0 tx=0).stop 2024-09-19T08:48:17.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.583+0000 7f0a2b598640 1 -- 172.21.15.7:0/3642252618 shutdown_connections 2024-09-19T08:48:17.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.583+0000 7f0a2b598640 1 --2- 172.21.15.7:0/3642252618 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0a100a33b0 0x7f0a100a5870 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.583+0000 7f0a2b598640 1 --2- 172.21.15.7:0/3642252618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a24106a80 0x7f0a2419ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.583+0000 7f0a2b598640 1 --2- 172.21.15.7:0/3642252618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a24101420 0x7f0a24198940 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.583+0000 7f0a2b598640 1 --2- 172.21.15.7:0/3642252618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a24100a80 0x7f0a24198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.583+0000 7f0a2b598640 1 -- 172.21.15.7:0/3642252618 >> 172.21.15.7:0/3642252618 conn(0x7f0a240fc7a0 msgr2=0x7f0a2406a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:17.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.583+0000 7f0a2b598640 1 -- 172.21.15.7:0/3642252618 shutdown_connections 2024-09-19T08:48:17.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:17.583+0000 7f0a2b598640 1 -- 172.21.15.7:0/3642252618 wait complete. 2024-09-19T08:48:18.357 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:48:18.617 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:18.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:18 smithi175 ceph-mon[35688]: pgmap v116: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T08:48:18.738 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:18 smithi007 ceph-mon[31221]: pgmap v116: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T08:48:18.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:18 smithi044 ceph-mon[35072]: pgmap v116: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T08:48:19.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.102+0000 7fcbc2db7640 1 -- 172.21.15.7:0/3993199467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbbc102570 msgr2=0x7fcbbc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:19.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.102+0000 7fcbc2db7640 1 --2- 172.21.15.7:0/3993199467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbbc102570 0x7fcbbc1029b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fcba8009900 tx=0x7fcba802a480 comp rx=0 tx=0).stop 2024-09-19T08:48:19.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.102+0000 7fcbc2db7640 1 -- 172.21.15.7:0/3993199467 shutdown_connections 2024-09-19T08:48:19.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.102+0000 7fcbc2db7640 1 --2- 172.21.15.7:0/3993199467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbbc102ef0 0x7fcbbc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.102+0000 7fcbc2db7640 1 --2- 172.21.15.7:0/3993199467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbbc102570 0x7fcbbc1029b0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.102+0000 7fcbc2db7640 1 --2- 172.21.15.7:0/3993199467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbbc100e20 0x7fcbbc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.102+0000 7fcbc2db7640 1 -- 172.21.15.7:0/3993199467 >> 172.21.15.7:0/3993199467 conn(0x7fcbbc0fc7d0 msgr2=0x7fcbbc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:19.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.102+0000 7fcbc2db7640 1 -- 172.21.15.7:0/3993199467 shutdown_connections 2024-09-19T08:48:19.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.102+0000 7fcbc2db7640 1 -- 172.21.15.7:0/3993199467 wait complete. 2024-09-19T08:48:19.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.102+0000 7fcbc2db7640 1 Processor -- start 2024-09-19T08:48:19.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.102+0000 7fcbc2db7640 1 -- start start 2024-09-19T08:48:19.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.103+0000 7fcbc2db7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbbc100e20 0x7fcbbc1970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:19.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.103+0000 7fcbc2db7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbbc102570 0x7fcbbc1975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:19.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.103+0000 7fcbc2db7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbbc102ef0 0x7fcbbc19c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:19.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.103+0000 7fcbc2db7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcbbc110f80 con 0x7fcbbc102570 2024-09-19T08:48:19.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.103+0000 7fcbc2db7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcbbc110e00 con 0x7fcbbc102ef0 2024-09-19T08:48:19.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.103+0000 7fcbc2db7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcbbc111100 con 0x7fcbbc100e20 2024-09-19T08:48:19.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.103+0000 7fcbbbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbbc102570 0x7fcbbc1975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:19.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.103+0000 7fcbbbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbbc102570 0x7fcbbc1975e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35322/0 (socket says 172.21.15.7:35322) 2024-09-19T08:48:19.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.103+0000 7fcbbbfff640 1 -- 172.21.15.7:0/3355083930 learned_addr learned my addr 172.21.15.7:0/3355083930 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:19.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.103+0000 7fcbc0b53640 1 --2- 172.21.15.7:0/3355083930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbbc100e20 0x7fcbbc1970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:19.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.103+0000 7fcbc1354640 1 --2- 172.21.15.7:0/3355083930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbbc102ef0 0x7fcbbc19c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:19.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.103+0000 7fcbbbfff640 1 -- 172.21.15.7:0/3355083930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbbc100e20 msgr2=0x7fcbbc1970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:19.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.103+0000 7fcbbbfff640 1 --2- 172.21.15.7:0/3355083930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbbc100e20 0x7fcbbc1970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.103+0000 7fcbbbfff640 1 -- 172.21.15.7:0/3355083930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbbc102ef0 msgr2=0x7fcbbc19c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:19.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.103+0000 7fcbbbfff640 1 --2- 172.21.15.7:0/3355083930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbbc102ef0 0x7fcbbc19c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.103+0000 7fcbbbfff640 1 -- 172.21.15.7:0/3355083930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbbc19c630 con 0x7fcbbc102570 2024-09-19T08:48:19.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.103+0000 7fcbbbfff640 1 --2- 172.21.15.7:0/3355083930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbbc102570 0x7fcbbc1975e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcba8006010 tx=0x7fcba8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:19.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.103+0000 7fcbb9ffb640 1 -- 172.21.15.7:0/3355083930 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba803f070 con 0x7fcbbc102570 2024-09-19T08:48:19.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.103+0000 7fcbb9ffb640 1 -- 172.21.15.7:0/3355083930 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcba8031c30 con 0x7fcbbc102570 2024-09-19T08:48:19.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.103+0000 7fcbc2db7640 1 -- 172.21.15.7:0/3355083930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbbc19c8c0 con 0x7fcbbc102570 2024-09-19T08:48:19.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.104+0000 7fcbb9ffb640 1 -- 172.21.15.7:0/3355083930 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba8035030 con 0x7fcbbc102570 2024-09-19T08:48:19.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.104+0000 7fcbc2db7640 1 -- 172.21.15.7:0/3355083930 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbbc19cdf0 con 0x7fcbbc102570 2024-09-19T08:48:19.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.106+0000 7fcbb9ffb640 1 -- 172.21.15.7:0/3355083930 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fcba8042070 con 0x7fcbbc102570 2024-09-19T08:48:19.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.106+0000 7fcbc5190740 1 Processor -- start 2024-09-19T08:48:19.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.106+0000 7fcbc5190740 1 -- start start 2024-09-19T08:48:19.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbc5190740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1a7b40 0x563bca1a6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:19.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbc5190740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1a65d0 0x563bca1a6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:19.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbc5190740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563bca1b1370 0x563bca1b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:19.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbc5190740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563bca10c2f0 con 0x563bca1a65d0 2024-09-19T08:48:19.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbc5190740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563bca0b3cf0 con 0x563bca1a7b40 2024-09-19T08:48:19.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbc5190740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563bca1082b0 con 0x563bca1b1370 2024-09-19T08:48:19.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbb9ffb640 1 --2- 172.21.15.7:0/3355083930 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fcbac0a3430 0x7fcbac0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:19.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbc0b53640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1a65d0 0x563bca1a6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:19.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbc0b53640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1a65d0 0x563bca1a6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35334/0 (socket says 172.21.15.7:35334) 2024-09-19T08:48:19.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbc1354640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1a7b40 0x563bca1a6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:19.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbc0b53640 1 -- 172.21.15.7:0/3417414232 learned_addr learned my addr 172.21.15.7:0/3417414232 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:19.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbc1354640 1 --2- 172.21.15.7:0/3355083930 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fcbac0a3430 0x7fcbac0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:19.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbbbfff640 1 --2- 172.21.15.7:0/3417414232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563bca1b1370 0x563bca1b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:19.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbb9ffb640 1 -- 172.21.15.7:0/3355083930 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fcba80f0370 con 0x7fcbbc102570 2024-09-19T08:48:19.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbc0b53640 1 -- 172.21.15.7:0/3417414232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563bca1b1370 msgr2=0x563bca1b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:19.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbc0b53640 1 --2- 172.21.15.7:0/3417414232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563bca1b1370 0x563bca1b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbc0b53640 1 -- 172.21.15.7:0/3417414232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1a7b40 msgr2=0x563bca1a6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:19.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbc0b53640 1 --2- 172.21.15.7:0/3417414232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1a7b40 0x563bca1a6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbc0b53640 1 -- 172.21.15.7:0/3417414232 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bca0983a0 con 0x563bca1a65d0 2024-09-19T08:48:19.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbbbfff640 1 --2- 172.21.15.7:0/3417414232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563bca1b1370 0x563bca1b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:48:19.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbc1354640 1 --2- 172.21.15.7:0/3417414232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1a7b40 0x563bca1a6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:48:19.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbc0b53640 1 --2- 172.21.15.7:0/3417414232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1a65d0 0x563bca1a6a10 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000bd10 tx=0x7fcbb00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766b9daacccbd625 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:19.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.107+0000 7fcbc1354640 1 --2- 172.21.15.7:0/3355083930 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fcbac0a3430 0x7fcbac0a58f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4005fd0 tx=0x7fcbb4009500 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:19.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.108+0000 7fcba6ffd640 1 -- 172.21.15.7:0/3417414232 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0004030 con 0x563bca1a65d0 2024-09-19T08:48:19.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.108+0000 7fcba6ffd640 1 -- 172.21.15.7:0/3417414232 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbb00041d0 con 0x563bca1a65d0 2024-09-19T08:48:19.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.108+0000 7fcba6ffd640 1 -- 172.21.15.7:0/3417414232 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0011840 con 0x563bca1a65d0 2024-09-19T08:48:19.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.108+0000 7fcbc5190740 1 -- 172.21.15.7:0/3417414232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1a65d0 msgr2=0x563bca1a6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:19.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.108+0000 7fcbc5190740 1 --2- 172.21.15.7:0/3417414232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1a65d0 0x563bca1a6a10 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000bd10 tx=0x7fcbb00107a0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.108+0000 7fcbc5190740 1 -- 172.21.15.7:0/3417414232 shutdown_connections 2024-09-19T08:48:19.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.108+0000 7fcbc5190740 1 --2- 172.21.15.7:0/3417414232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563bca1b1370 0x563bca1b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.108+0000 7fcbc5190740 1 --2- 172.21.15.7:0/3417414232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1a65d0 0x563bca1a6a10 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.108+0000 7fcbc5190740 1 --2- 172.21.15.7:0/3417414232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1a7b40 0x563bca1a6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.108+0000 7fcbc5190740 1 -- 172.21.15.7:0/3417414232 >> 172.21.15.7:0/3417414232 conn(0x563bca16f310 msgr2=0x563bca1a2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:19.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.108+0000 7fcbc5190740 1 -- 172.21.15.7:0/3417414232 shutdown_connections 2024-09-19T08:48:19.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.108+0000 7fcbc5190740 1 -- 172.21.15.7:0/3417414232 wait complete. 2024-09-19T08:48:19.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.109+0000 7fcbc5190740 1 -- start start 2024-09-19T08:48:19.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.109+0000 7fcbc5190740 1 Processor -- start 2024-09-19T08:48:19.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.109+0000 7fcbc5190740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563bca1a65d0 0x563bca1b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:19.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.109+0000 7fcbc5190740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1a7b40 0x563bca1ae030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:19.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.109+0000 7fcbc5190740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1b1370 0x563bca1ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:19.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.109+0000 7fcbc5190740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563bca1b4070 con 0x563bca1a7b40 2024-09-19T08:48:19.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.109+0000 7fcbc5190740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563bca0c7060 con 0x563bca1b1370 2024-09-19T08:48:19.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.109+0000 7fcbc5190740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563bca1b41f0 con 0x563bca1a65d0 2024-09-19T08:48:19.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.109+0000 7fcbc5190740 10 client.0 _ll_register_callbacks cb 0x563bc9e1a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:19.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.109+0000 7fcbbbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1a7b40 0x563bca1ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:19.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.109+0000 7fcbbbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1a7b40 0x563bca1ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35344/0 (socket says 172.21.15.7:35344) 2024-09-19T08:48:19.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.109+0000 7fcbbbfff640 1 -- 172.21.15.7:0/3339368803 learned_addr learned my addr 172.21.15.7:0/3339368803 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:19.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.109+0000 7fcbc0b53640 1 --2- 172.21.15.7:0/3339368803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563bca1a65d0 0x563bca1b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:19.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.110+0000 7fcbc1354640 1 --2- 172.21.15.7:0/3339368803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1b1370 0x563bca1ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:19.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.110+0000 7fcbbbfff640 1 -- 172.21.15.7:0/3339368803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563bca1a65d0 msgr2=0x563bca1b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:19.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.110+0000 7fcbbbfff640 1 --2- 172.21.15.7:0/3339368803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563bca1a65d0 0x563bca1b0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.110+0000 7fcbbbfff640 1 -- 172.21.15.7:0/3339368803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1b1370 msgr2=0x563bca1ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:19.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.110+0000 7fcbbbfff640 1 --2- 172.21.15.7:0/3339368803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1b1370 0x563bca1ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.110+0000 7fcbbbfff640 1 -- 172.21.15.7:0/3339368803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bc9e7d3c0 con 0x563bca1a7b40 2024-09-19T08:48:19.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.110+0000 7fcbbbfff640 1 --2- 172.21.15.7:0/3339368803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1a7b40 0x563bca1ae030 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fcba80b8af0 tx=0x7fcba802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392686efbc308f4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:19.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.110+0000 7fcb9bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:48:19.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.110+0000 7fcb9bfff640 1 -- 172.21.15.7:0/3339368803 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba80d5060 con 0x563bca1a7b40 2024-09-19T08:48:19.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.110+0000 7fcb9bfff640 1 -- 172.21.15.7:0/3339368803 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fcba80b8d00 con 0x563bca1a7b40 2024-09-19T08:48:19.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.110+0000 7fcbc5190740 1 -- 172.21.15.7:0/3339368803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbb00041d0 con 0x563bca1a7b40 2024-09-19T08:48:19.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.110+0000 7fcb9bfff640 1 -- 172.21.15.7:0/3339368803 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcba8049e80 con 0x563bca1a7b40 2024-09-19T08:48:19.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.110+0000 7fcbc5190740 10 client.16116 fetch_fsmap learned FSMap version 25 2024-09-19T08:48:19.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.110+0000 7fcbc5190740 1 -- 172.21.15.7:0/3339368803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563bca1bfb40 con 0x563bca1a7b40 2024-09-19T08:48:19.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.110+0000 7fcb9bfff640 1 -- 172.21.15.7:0/3339368803 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbb00041d0 con 0x563bca1a7b40 2024-09-19T08:48:19.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.111+0000 7fcb9bfff640 1 -- 172.21.15.7:0/3339368803 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcba809d070 con 0x563bca1a7b40 2024-09-19T08:48:19.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.111+0000 7fcbc5190740 10 client.16116 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:48:19.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.111+0000 7fcbc5190740 10 client.16116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:48:19.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.111+0000 7fcbc5190740 20 client.16116 populate_metadata read hostname 'smithi007' 2024-09-19T08:48:19.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.111+0000 7fcbc5190740 1 --2- 172.21.15.7:0/3339368803 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563bca1c0fa0 0x563bca1c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:19.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.111+0000 7fcbc5190740 4 client.16116 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:48:19.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.111+0000 7fcbc5190740 1 -- 172.21.15.7:0/3339368803 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563bca119860 con 0x563bca1c0fa0 2024-09-19T08:48:19.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.111+0000 7fcbc0b53640 1 --2- 172.21.15.7:0/3339368803 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563bca1c0fa0 0x563bca1c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:19.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.111+0000 7fcb9bfff640 10 client.16116 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:48:19.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.111+0000 7fcbc0b53640 1 --2- 172.21.15.7:0/3339368803 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563bca1c0fa0 0x563bca1c33b0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e57d07a5512ac57 server_cookie=41fc664a3b4eb9ac in_seq=0 out_seq=0 2024-09-19T08:48:19.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.112+0000 7fcb9bfff640 1 -- 172.21.15.7:0/3339368803 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563bca119860 con 0x563bca1c0fa0 2024-09-19T08:48:19.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.112+0000 7fcb9bfff640 10 client.16116 handle_command_reply: tid=0 2024-09-19T08:48:19.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.112+0000 7fcbc5190740 1 client.16116 shutdown 2024-09-19T08:48:19.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.112+0000 7fcbc5190740 1 -- 172.21.15.7:0/3339368803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1a7b40 msgr2=0x563bca1ae030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:19.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.112+0000 7fcbc5190740 1 --2- 172.21.15.7:0/3339368803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1a7b40 0x563bca1ae030 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fcba80b8af0 tx=0x7fcba802a480 comp rx=0 tx=0).stop 2024-09-19T08:48:19.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.112+0000 7fcbc5190740 1 -- 172.21.15.7:0/3339368803 shutdown_connections 2024-09-19T08:48:19.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.112+0000 7fcbc5190740 1 --2- 172.21.15.7:0/3339368803 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563bca1c0fa0 0x563bca1c33b0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.112+0000 7fcbc5190740 1 --2- 172.21.15.7:0/3339368803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1b1370 0x563bca1ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.112+0000 7fcbc5190740 1 --2- 172.21.15.7:0/3339368803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1a7b40 0x563bca1ae030 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.112+0000 7fcb9bfff640 0 client.16116 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:48:19.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.112+0000 7fcbc5190740 1 --2- 172.21.15.7:0/3339368803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563bca1a65d0 0x563bca1b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.112+0000 7fcbc5190740 1 -- 172.21.15.7:0/3339368803 >> 172.21.15.7:0/3339368803 conn(0x563bca16f310 msgr2=0x563bca1a8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:19.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.112+0000 7fcbc5190740 1 -- 172.21.15.7:0/3339368803 shutdown_connections 2024-09-19T08:48:19.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.112+0000 7fcbc5190740 1 -- 172.21.15.7:0/3339368803 wait complete. 2024-09-19T08:48:19.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.113+0000 7fcbc5190740 20 client.16116 trim_cache size 0 max 16384 2024-09-19T08:48:19.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.126+0000 7fcbc5190740 1 Processor -- start 2024-09-19T08:48:19.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.126+0000 7fcbc5190740 1 -- start start 2024-09-19T08:48:19.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.126+0000 7fcbc5190740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1a65d0 0x563bca1a7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:19.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.126+0000 7fcbc5190740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1a7b40 0x563bca1bd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:19.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.126+0000 7fcbc5190740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563bca1b1370 0x563bca1a2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:19.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.126+0000 7fcbc5190740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcbbc1b6780 con 0x563bca1a65d0 2024-09-19T08:48:19.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.126+0000 7fcbc5190740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcbbc1b4050 con 0x563bca1a7b40 2024-09-19T08:48:19.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.126+0000 7fcbc5190740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcbbc1b1ea0 con 0x563bca1b1370 2024-09-19T08:48:19.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.126+0000 7fcbc0b53640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1a65d0 0x563bca1a7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:19.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.126+0000 7fcbc0b53640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1a65d0 0x563bca1a7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35356/0 (socket says 172.21.15.7:35356) 2024-09-19T08:48:19.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.126+0000 7fcbc0b53640 1 -- 172.21.15.7:0/111758224 learned_addr learned my addr 172.21.15.7:0/111758224 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:19.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.126+0000 7fcbbbfff640 1 --2- 172.21.15.7:0/111758224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1a7b40 0x563bca1bd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:19.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.126+0000 7fcbc1354640 1 --2- 172.21.15.7:0/111758224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563bca1b1370 0x563bca1a2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:19.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.126+0000 7fcbc0b53640 1 -- 172.21.15.7:0/111758224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563bca1b1370 msgr2=0x563bca1a2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:19.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.126+0000 7fcbc0b53640 1 --2- 172.21.15.7:0/111758224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563bca1b1370 0x563bca1a2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.126+0000 7fcbc0b53640 1 -- 172.21.15.7:0/111758224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1a7b40 msgr2=0x563bca1bd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:19.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.126+0000 7fcbc0b53640 1 --2- 172.21.15.7:0/111758224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1a7b40 0x563bca1bd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.126+0000 7fcbc0b53640 1 -- 172.21.15.7:0/111758224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bca1a9120 con 0x563bca1a65d0 2024-09-19T08:48:19.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.126+0000 7fcbbbfff640 1 --2- 172.21.15.7:0/111758224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1a7b40 0x563bca1bd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:48:19.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.126+0000 7fcbc1354640 1 --2- 172.21.15.7:0/111758224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563bca1b1370 0x563bca1a2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:48:19.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.126+0000 7fcbc0b53640 1 --2- 172.21.15.7:0/111758224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1a65d0 0x563bca1a7300 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000baa0 tx=0x7fcbb0005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33c71f61dcc87bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:19.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.127+0000 7fcba67fc640 1 -- 172.21.15.7:0/111758224 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0005240 con 0x563bca1a65d0 2024-09-19T08:48:19.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.127+0000 7fcba67fc640 1 -- 172.21.15.7:0/111758224 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbb00053e0 con 0x563bca1a65d0 2024-09-19T08:48:19.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.127+0000 7fcba67fc640 1 -- 172.21.15.7:0/111758224 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb00117c0 con 0x563bca1a65d0 2024-09-19T08:48:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.127+0000 7fcbc5190740 1 -- 172.21.15.7:0/111758224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1a65d0 msgr2=0x563bca1a7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.127+0000 7fcbc5190740 1 --2- 172.21.15.7:0/111758224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1a65d0 0x563bca1a7300 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000baa0 tx=0x7fcbb0005e50 comp rx=0 tx=0).stop 2024-09-19T08:48:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.127+0000 7fcbc5190740 1 -- 172.21.15.7:0/111758224 shutdown_connections 2024-09-19T08:48:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.127+0000 7fcbc5190740 1 --2- 172.21.15.7:0/111758224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563bca1b1370 0x563bca1a2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.127+0000 7fcbc5190740 1 --2- 172.21.15.7:0/111758224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1a7b40 0x563bca1bd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.127+0000 7fcbc5190740 1 --2- 172.21.15.7:0/111758224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1a65d0 0x563bca1a7300 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.127+0000 7fcbc5190740 1 -- 172.21.15.7:0/111758224 >> 172.21.15.7:0/111758224 conn(0x563bca16f310 msgr2=0x563bca19da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.127+0000 7fcbc5190740 1 -- 172.21.15.7:0/111758224 shutdown_connections 2024-09-19T08:48:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.127+0000 7fcbc5190740 1 -- 172.21.15.7:0/111758224 wait complete. 2024-09-19T08:48:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.128+0000 7fcbc5190740 1 -- start start 2024-09-19T08:48:19.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.128+0000 7fcbc5190740 1 Processor -- start 2024-09-19T08:48:19.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.128+0000 7fcbc5190740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563bca1a65d0 0x563bca1aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:19.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.128+0000 7fcbc5190740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1a7b40 0x563bca1ab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:19.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.128+0000 7fcbc5190740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1b1370 0x563bca1ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:19.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.128+0000 7fcbc5190740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcbbc1b2510 con 0x563bca1b1370 2024-09-19T08:48:19.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.128+0000 7fcbc5190740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcbbc1b3980 con 0x563bca1a7b40 2024-09-19T08:48:19.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.128+0000 7fcbc5190740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcbbc1b2be0 con 0x563bca1a65d0 2024-09-19T08:48:19.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.128+0000 7fcbc5190740 10 client.0 _ll_register_callbacks cb 0x7fcba80b8930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:19.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.128+0000 7fcbc1354640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1b1370 0x563bca1ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:19.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.129+0000 7fcbc1354640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1b1370 0x563bca1ab9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35364/0 (socket says 172.21.15.7:35364) 2024-09-19T08:48:19.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.129+0000 7fcbc1354640 1 -- 172.21.15.7:0/638686281 learned_addr learned my addr 172.21.15.7:0/638686281 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:19.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.129+0000 7fcbbbfff640 1 --2- 172.21.15.7:0/638686281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1a7b40 0x563bca1ab4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:19.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.129+0000 7fcbc0b53640 1 --2- 172.21.15.7:0/638686281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563bca1a65d0 0x563bca1aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:19.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.129+0000 7fcbc1354640 1 -- 172.21.15.7:0/638686281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563bca1a65d0 msgr2=0x563bca1aaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:19.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.129+0000 7fcbc1354640 1 --2- 172.21.15.7:0/638686281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563bca1a65d0 0x563bca1aaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.129+0000 7fcbc1354640 1 -- 172.21.15.7:0/638686281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1a7b40 msgr2=0x563bca1ab4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:19.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.129+0000 7fcbc1354640 1 --2- 172.21.15.7:0/638686281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1a7b40 0x563bca1ab4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.129+0000 7fcbc1354640 1 -- 172.21.15.7:0/638686281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bca22ac90 con 0x563bca1b1370 2024-09-19T08:48:19.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.129+0000 7fcbbbfff640 1 --2- 172.21.15.7:0/638686281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1a7b40 0x563bca1ab4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:48:19.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.129+0000 7fcbc1354640 1 --2- 172.21.15.7:0/638686281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1b1370 0x563bca1ab9f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4011fd0 tx=0x7fcbb4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13777316406c1da0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:19.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.129+0000 7fcb9bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:48:19.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.129+0000 7fcb9bfff640 1 -- 172.21.15.7:0/638686281 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4010bb0 con 0x563bca1b1370 2024-09-19T08:48:19.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.129+0000 7fcb9bfff640 1 -- 172.21.15.7:0/638686281 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fcbb4010d50 con 0x563bca1b1370 2024-09-19T08:48:19.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.129+0000 7fcbc5190740 1 -- 172.21.15.7:0/638686281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbb00053e0 con 0x563bca1b1370 2024-09-19T08:48:19.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.129+0000 7fcb9bfff640 1 -- 172.21.15.7:0/638686281 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcbb4036050 con 0x563bca1b1370 2024-09-19T08:48:19.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.129+0000 7fcbc5190740 10 client.16122 fetch_fsmap learned FSMap version 25 2024-09-19T08:48:19.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.129+0000 7fcbc5190740 1 -- 172.21.15.7:0/638686281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563bca22bde0 con 0x563bca1b1370 2024-09-19T08:48:19.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.130+0000 7fcb9bfff640 1 -- 172.21.15.7:0/638686281 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbb00053e0 con 0x563bca1b1370 2024-09-19T08:48:19.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.130+0000 7fcb9bfff640 1 -- 172.21.15.7:0/638686281 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcbb401d070 con 0x563bca1b1370 2024-09-19T08:48:19.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.130+0000 7fcbc5190740 10 client.16122 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:48:19.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.130+0000 7fcbc5190740 10 client.16122 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:48:19.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.130+0000 7fcbc5190740 20 client.16122 populate_metadata read hostname 'smithi007' 2024-09-19T08:48:19.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.130+0000 7fcbc5190740 1 --2- 172.21.15.7:0/638686281 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563bca22c5b0 0x563bca22e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:19.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.130+0000 7fcbc5190740 4 client.16122 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:48:19.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.130+0000 7fcbc5190740 1 -- 172.21.15.7:0/638686281 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563bca113d70 con 0x563bca22c5b0 2024-09-19T08:48:19.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.130+0000 7fcbc0b53640 1 --2- 172.21.15.7:0/638686281 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563bca22c5b0 0x563bca22e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:19.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.131+0000 7fcbc0b53640 1 --2- 172.21.15.7:0/638686281 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563bca22c5b0 0x563bca22e9d0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afde273a044cc65a server_cookie=95ddc315ccf10ba1 in_seq=0 out_seq=0 2024-09-19T08:48:19.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.131+0000 7fcb9bfff640 10 client.16122 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:48:19.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.131+0000 7fcb9bfff640 1 -- 172.21.15.7:0/638686281 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563bca113d70 con 0x563bca22c5b0 2024-09-19T08:48:19.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.131+0000 7fcb9bfff640 10 client.16122 handle_command_reply: tid=0 2024-09-19T08:48:19.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.131+0000 7fcbc5190740 1 client.16122 shutdown 2024-09-19T08:48:19.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.131+0000 7fcbc5190740 1 -- 172.21.15.7:0/638686281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1b1370 msgr2=0x563bca1ab9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:19.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.131+0000 7fcbc5190740 1 --2- 172.21.15.7:0/638686281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1b1370 0x563bca1ab9f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4011fd0 tx=0x7fcbb4004a40 comp rx=0 tx=0).stop 2024-09-19T08:48:19.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.131+0000 7fcbc5190740 1 -- 172.21.15.7:0/638686281 shutdown_connections 2024-09-19T08:48:19.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.131+0000 7fcbc5190740 1 --2- 172.21.15.7:0/638686281 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563bca22c5b0 0x563bca22e9d0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.131+0000 7fcbc5190740 1 --2- 172.21.15.7:0/638686281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bca1b1370 0x563bca1ab9f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.131+0000 7fcb9bfff640 0 client.16122 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:48:19.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.131+0000 7fcbc5190740 1 --2- 172.21.15.7:0/638686281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563bca1a7b40 0x563bca1ab4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.131+0000 7fcbc5190740 1 --2- 172.21.15.7:0/638686281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563bca1a65d0 0x563bca1aaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.131+0000 7fcbc5190740 1 -- 172.21.15.7:0/638686281 >> 172.21.15.7:0/638686281 conn(0x563bca16f310 msgr2=0x563bca1a2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:19.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.131+0000 7fcbc5190740 1 -- 172.21.15.7:0/638686281 shutdown_connections 2024-09-19T08:48:19.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.131+0000 7fcbc5190740 1 -- 172.21.15.7:0/638686281 wait complete. 2024-09-19T08:48:19.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.131+0000 7fcbc5190740 20 client.16122 trim_cache size 0 max 16384 2024-09-19T08:48:19.137 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:48:19.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.132+0000 7fcbc2db7640 1 -- 172.21.15.7:0/3355083930 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fcbac0a3430 msgr2=0x7fcbac0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:19.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.132+0000 7fcbc2db7640 1 --2- 172.21.15.7:0/3355083930 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fcbac0a3430 0x7fcbac0a58f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4005fd0 tx=0x7fcbb4009500 comp rx=0 tx=0).stop 2024-09-19T08:48:19.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.132+0000 7fcbc2db7640 1 -- 172.21.15.7:0/3355083930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbbc102570 msgr2=0x7fcbbc1975e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:19.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.132+0000 7fcbc2db7640 1 --2- 172.21.15.7:0/3355083930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbbc102570 0x7fcbbc1975e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcba8006010 tx=0x7fcba8003c10 comp rx=0 tx=0).stop 2024-09-19T08:48:19.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.132+0000 7fcbc2db7640 1 -- 172.21.15.7:0/3355083930 shutdown_connections 2024-09-19T08:48:19.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.132+0000 7fcbc2db7640 1 --2- 172.21.15.7:0/3355083930 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fcbac0a3430 0x7fcbac0a58f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.132+0000 7fcbc2db7640 1 --2- 172.21.15.7:0/3355083930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbbc102ef0 0x7fcbbc19c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.132+0000 7fcbc2db7640 1 --2- 172.21.15.7:0/3355083930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbbc102570 0x7fcbbc1975e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.132+0000 7fcbc2db7640 1 --2- 172.21.15.7:0/3355083930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbbc100e20 0x7fcbbc1970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:19.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.132+0000 7fcbc2db7640 1 -- 172.21.15.7:0/3355083930 >> 172.21.15.7:0/3355083930 conn(0x7fcbbc0fc7d0 msgr2=0x7fcbbc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:19.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.132+0000 7fcbc2db7640 1 -- 172.21.15.7:0/3355083930 shutdown_connections 2024-09-19T08:48:19.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:19.132+0000 7fcbc2db7640 1 -- 172.21.15.7:0/3355083930 wait complete. 2024-09-19T08:48:20.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:20 smithi175 ceph-mon[35688]: pgmap v117: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:48:20.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:20 smithi007 ceph-mon[31221]: pgmap v117: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:48:20.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:20 smithi044 ceph-mon[35072]: pgmap v117: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:48:20.905 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:48:20.905 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:48:21.174 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.595+0000 7f27a96a4640 1 -- 172.21.15.7:0/563141533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27a4100b20 msgr2=0x7f27a4100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.595+0000 7f27a96a4640 1 --2- 172.21.15.7:0/563141533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27a4100b20 0x7f27a4100f00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f2794009900 tx=0x7f279402a410 comp rx=0 tx=0).stop 2024-09-19T08:48:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.595+0000 7f27a96a4640 1 -- 172.21.15.7:0/563141533 shutdown_connections 2024-09-19T08:48:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.595+0000 7f27a96a4640 1 --2- 172.21.15.7:0/563141533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27a410e500 0x7f27a4110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.595+0000 7f27a96a4640 1 --2- 172.21.15.7:0/563141533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a4101440 0x7f27a410df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.595+0000 7f27a96a4640 1 --2- 172.21.15.7:0/563141533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27a4100b20 0x7f27a4100f00 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.595+0000 7f27a96a4640 1 -- 172.21.15.7:0/563141533 >> 172.21.15.7:0/563141533 conn(0x7f27a40fc7d0 msgr2=0x7f27a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:21.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.595+0000 7f27a96a4640 1 -- 172.21.15.7:0/563141533 shutdown_connections 2024-09-19T08:48:21.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.595+0000 7f27a96a4640 1 -- 172.21.15.7:0/563141533 wait complete. 2024-09-19T08:48:21.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.596+0000 7f27a96a4640 1 Processor -- start 2024-09-19T08:48:21.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.596+0000 7f27a96a4640 1 -- start start 2024-09-19T08:48:21.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.596+0000 7f27a96a4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a4100b20 0x7f27a41a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:21.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.596+0000 7f27a96a4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27a4101440 0x7f27a41a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:21.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.596+0000 7f27a96a4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27a410e500 0x7f27a419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:21.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.596+0000 7f27a96a4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41142f0 con 0x7f27a410e500 2024-09-19T08:48:21.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.596+0000 7f27a96a4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f27a4114170 con 0x7f27a4101440 2024-09-19T08:48:21.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.596+0000 7f27a96a4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27a4114470 con 0x7f27a4100b20 2024-09-19T08:48:21.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.596+0000 7f27a37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27a410e500 0x7f27a419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:21.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.596+0000 7f27a37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27a410e500 0x7f27a419a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35396/0 (socket says 172.21.15.7:35396) 2024-09-19T08:48:21.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.596+0000 7f27a37fe640 1 -- 172.21.15.7:0/1467637663 learned_addr learned my addr 172.21.15.7:0/1467637663 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:21.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.596+0000 7f27a27fc640 1 --2- 172.21.15.7:0/1467637663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27a4101440 0x7f27a41a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:21.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.597+0000 7f27a2ffd640 1 --2- 172.21.15.7:0/1467637663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a4100b20 0x7f27a41a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:21.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.597+0000 7f27a37fe640 1 -- 172.21.15.7:0/1467637663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a4100b20 msgr2=0x7f27a41a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:21.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.597+0000 7f27a37fe640 1 --2- 172.21.15.7:0/1467637663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a4100b20 0x7f27a41a0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.597+0000 7f27a37fe640 1 -- 172.21.15.7:0/1467637663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27a4101440 msgr2=0x7f27a41a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:21.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.597+0000 7f27a37fe640 1 --2- 172.21.15.7:0/1467637663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27a4101440 0x7f27a41a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.597+0000 7f27a37fe640 1 -- 172.21.15.7:0/1467637663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a419acf0 con 0x7f27a410e500 2024-09-19T08:48:21.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.597+0000 7f27a37fe640 1 --2- 172.21.15.7:0/1467637663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27a410e500 0x7f27a419a5c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f279c00ccb0 tx=0x7f279c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:21.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.597+0000 7f278bfff640 1 -- 172.21.15.7:0/1467637663 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c00f450 con 0x7f27a410e500 2024-09-19T08:48:21.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.597+0000 7f278bfff640 1 -- 172.21.15.7:0/1467637663 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f279c00fad0 con 0x7f27a410e500 2024-09-19T08:48:21.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.597+0000 7f27a96a4640 1 -- 172.21.15.7:0/1467637663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a419afe0 con 0x7f27a410e500 2024-09-19T08:48:21.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.597+0000 7f278bfff640 1 -- 172.21.15.7:0/1467637663 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c018ac0 con 0x7f27a410e500 2024-09-19T08:48:21.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.597+0000 7f27a96a4640 1 -- 172.21.15.7:0/1467637663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a41a72d0 con 0x7f27a410e500 2024-09-19T08:48:21.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.599+0000 7f278bfff640 1 -- 172.21.15.7:0/1467637663 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f279c00fc80 con 0x7f27a410e500 2024-09-19T08:48:21.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.600+0000 7f27aba7d740 1 Processor -- start 2024-09-19T08:48:21.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.600+0000 7f27aba7d740 1 -- start start 2024-09-19T08:48:21.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.600+0000 7f27aba7d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc58b60 0x55752dc58f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:21.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.600+0000 7f27aba7d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55752dc59480 0x55752dc63800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:21.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.600+0000 7f27aba7d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55752dc63d40 0x55752dc66130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:21.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.600+0000 7f27aba7d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55752dbbe280 con 0x55752dc58b60 2024-09-19T08:48:21.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.600+0000 7f27aba7d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55752db65b10 con 0x55752dc63d40 2024-09-19T08:48:21.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.600+0000 7f27aba7d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55752dbba240 con 0x55752dc59480 2024-09-19T08:48:21.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.600+0000 7f27a27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc58b60 0x55752dc58f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:21.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.600+0000 7f278bfff640 1 --2- 172.21.15.7:0/1467637663 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f278c0a33b0 0x7f278c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.600+0000 7f27a27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc58b60 0x55752dc58f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35408/0 (socket says 172.21.15.7:35408) 2024-09-19T08:48:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.600+0000 7f27a27fc640 1 -- 172.21.15.7:0/3701766002 learned_addr learned my addr 172.21.15.7:0/3701766002 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.600+0000 7f27a2ffd640 1 --2- 172.21.15.7:0/3701766002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55752dc59480 0x55752dc63800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.600+0000 7f27a27fc640 1 --2- 172.21.15.7:0/3701766002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55752dc63d40 0x55752dc66130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.600+0000 7f27a37fe640 1 --2- 172.21.15.7:0/1467637663 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f278c0a33b0 0x7f278c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.600+0000 7f27a27fc640 1 -- 172.21.15.7:0/3701766002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55752dc59480 msgr2=0x55752dc63800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.600+0000 7f27a27fc640 1 --2- 172.21.15.7:0/3701766002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55752dc59480 0x55752dc63800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.600+0000 7f27a27fc640 1 -- 172.21.15.7:0/3701766002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55752dc63d40 msgr2=0x55752dc66130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.600+0000 7f27a27fc640 1 --2- 172.21.15.7:0/3701766002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55752dc63d40 0x55752dc66130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.601+0000 7f27a27fc640 1 -- 172.21.15.7:0/3701766002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55752db721f0 con 0x55752dc58b60 2024-09-19T08:48:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.601+0000 7f278bfff640 1 -- 172.21.15.7:0/1467637663 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f279c0d0260 con 0x7f27a410e500 2024-09-19T08:48:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.601+0000 7f27a27fc640 1 --2- 172.21.15.7:0/3701766002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc58b60 0x55752dc58f40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f2798009330 tx=0x7f2798009690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec0a7d01990a561 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.601+0000 7f27a37fe640 1 --2- 172.21.15.7:0/1467637663 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f278c0a33b0 0x7f278c0a5870 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f279c098ea0 tx=0x7f279c06b1c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.601+0000 7f27897fa640 1 -- 172.21.15.7:0/3701766002 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279800ee70 con 0x55752dc58b60 2024-09-19T08:48:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.601+0000 7f27897fa640 1 -- 172.21.15.7:0/3701766002 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f279801c070 con 0x55752dc58b60 2024-09-19T08:48:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.601+0000 7f27897fa640 1 -- 172.21.15.7:0/3701766002 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798015750 con 0x55752dc58b60 2024-09-19T08:48:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.602+0000 7f27aba7d740 1 -- 172.21.15.7:0/3701766002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc58b60 msgr2=0x55752dc58f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.602+0000 7f27aba7d740 1 --2- 172.21.15.7:0/3701766002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc58b60 0x55752dc58f40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f2798009330 tx=0x7f2798009690 comp rx=0 tx=0).stop 2024-09-19T08:48:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.602+0000 7f27aba7d740 1 -- 172.21.15.7:0/3701766002 shutdown_connections 2024-09-19T08:48:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.602+0000 7f27aba7d740 1 --2- 172.21.15.7:0/3701766002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55752dc63d40 0x55752dc66130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.602+0000 7f27aba7d740 1 --2- 172.21.15.7:0/3701766002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55752dc59480 0x55752dc63800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.602+0000 7f27aba7d740 1 --2- 172.21.15.7:0/3701766002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc58b60 0x55752dc58f40 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.602+0000 7f27aba7d740 1 -- 172.21.15.7:0/3701766002 >> 172.21.15.7:0/3701766002 conn(0x55752dc550f0 msgr2=0x55752dc554d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.602+0000 7f27aba7d740 1 -- 172.21.15.7:0/3701766002 shutdown_connections 2024-09-19T08:48:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.602+0000 7f27aba7d740 1 -- 172.21.15.7:0/3701766002 wait complete. 2024-09-19T08:48:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.602+0000 7f27aba7d740 1 -- start start 2024-09-19T08:48:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.602+0000 7f27aba7d740 1 Processor -- start 2024-09-19T08:48:21.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.603+0000 7f27aba7d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55752dc58b60 0x55752dc60c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:21.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.603+0000 7f27aba7d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc59480 0x55752dc61140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:21.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.603+0000 7f27aba7d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55752dc63d40 0x55752dc61680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:21.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.603+0000 7f27aba7d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55752dc66910 con 0x55752dc59480 2024-09-19T08:48:21.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.603+0000 7f27aba7d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55752db78f10 con 0x55752dc63d40 2024-09-19T08:48:21.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.603+0000 7f27aba7d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55752dc66a90 con 0x55752dc58b60 2024-09-19T08:48:21.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.603+0000 7f27aba7d740 10 client.0 _ll_register_callbacks cb 0x55752db41a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:21.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.603+0000 7f27a2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc59480 0x55752dc61140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:21.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.603+0000 7f27a2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc59480 0x55752dc61140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35420/0 (socket says 172.21.15.7:35420) 2024-09-19T08:48:21.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.603+0000 7f27a2ffd640 1 -- 172.21.15.7:0/2931345358 learned_addr learned my addr 172.21.15.7:0/2931345358 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:21.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.603+0000 7f27a27fc640 1 --2- 172.21.15.7:0/2931345358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55752dc58b60 0x55752dc60c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:21.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.603+0000 7f27a27fc640 1 --2- 172.21.15.7:0/2931345358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55752dc63d40 0x55752dc61680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:21.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.603+0000 7f27a2ffd640 1 -- 172.21.15.7:0/2931345358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55752dc58b60 msgr2=0x55752dc60c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:21.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.603+0000 7f27a2ffd640 1 --2- 172.21.15.7:0/2931345358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55752dc58b60 0x55752dc60c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.603+0000 7f27a2ffd640 1 -- 172.21.15.7:0/2931345358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55752dc63d40 msgr2=0x55752dc61680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:21.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.603+0000 7f27a2ffd640 1 --2- 172.21.15.7:0/2931345358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55752dc63d40 0x55752dc61680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.603+0000 7f27a2ffd640 1 -- 172.21.15.7:0/2931345358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55752d92f6a0 con 0x55752dc59480 2024-09-19T08:48:21.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.603+0000 7f27a27fc640 1 --2- 172.21.15.7:0/2931345358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55752dc63d40 0x55752dc61680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:48:21.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.603+0000 7f27a2ffd640 1 --2- 172.21.15.7:0/2931345358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc59480 0x55752dc61140 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2794009900 tx=0x7f2794004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6afe41250913406 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:21.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.603+0000 7f2786ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:48:21.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.603+0000 7f2786ff5640 1 -- 172.21.15.7:0/2931345358 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2794035040 con 0x55752dc59480 2024-09-19T08:48:21.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.604+0000 7f2786ff5640 1 -- 172.21.15.7:0/2931345358 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f2794005020 con 0x55752dc59480 2024-09-19T08:48:21.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.604+0000 7f27aba7d740 1 -- 172.21.15.7:0/2931345358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f279801c070 con 0x55752dc59480 2024-09-19T08:48:21.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.604+0000 7f2786ff5640 1 -- 172.21.15.7:0/2931345358 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2794005d50 con 0x55752dc59480 2024-09-19T08:48:21.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.604+0000 7f27aba7d740 10 client.16134 fetch_fsmap learned FSMap version 25 2024-09-19T08:48:21.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.604+0000 7f27aba7d740 1 -- 172.21.15.7:0/2931345358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55752dc724f0 con 0x55752dc59480 2024-09-19T08:48:21.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.604+0000 7f2786ff5640 1 -- 172.21.15.7:0/2931345358 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f279801c070 con 0x55752dc59480 2024-09-19T08:48:21.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.604+0000 7f2786ff5640 1 -- 172.21.15.7:0/2931345358 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f27940035f0 con 0x55752dc59480 2024-09-19T08:48:21.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.604+0000 7f27aba7d740 10 client.16134 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:48:21.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.604+0000 7f27aba7d740 10 client.16134 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:48:21.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.604+0000 7f27aba7d740 20 client.16134 populate_metadata read hostname 'smithi007' 2024-09-19T08:48:21.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.604+0000 7f27aba7d740 1 --2- 172.21.15.7:0/2931345358 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55752dc73a00 0x55752dc75e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:21.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.604+0000 7f27aba7d740 4 client.16134 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:48:21.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.604+0000 7f27aba7d740 1 -- 172.21.15.7:0/2931345358 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55752dbcb7f0 con 0x55752dc73a00 2024-09-19T08:48:21.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.605+0000 7f27a27fc640 1 --2- 172.21.15.7:0/2931345358 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55752dc73a00 0x55752dc75e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:21.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.605+0000 7f27a27fc640 1 --2- 172.21.15.7:0/2931345358 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55752dc73a00 0x55752dc75e20 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc94097643a8009 server_cookie=4087625c6e78cb61 in_seq=0 out_seq=0 2024-09-19T08:48:21.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.605+0000 7f2786ff5640 10 client.16134 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:48:21.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.606+0000 7f2786ff5640 1 -- 172.21.15.7:0/2931345358 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55752dbcb7f0 con 0x55752dc73a00 2024-09-19T08:48:21.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.606+0000 7f2786ff5640 10 client.16134 handle_command_reply: tid=0 2024-09-19T08:48:21.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.606+0000 7f27aba7d740 1 client.16134 shutdown 2024-09-19T08:48:21.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.606+0000 7f27aba7d740 1 -- 172.21.15.7:0/2931345358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc59480 msgr2=0x55752dc61140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:21.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.606+0000 7f27aba7d740 1 --2- 172.21.15.7:0/2931345358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc59480 0x55752dc61140 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2794009900 tx=0x7f2794004270 comp rx=0 tx=0).stop 2024-09-19T08:48:21.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.606+0000 7f27aba7d740 1 -- 172.21.15.7:0/2931345358 shutdown_connections 2024-09-19T08:48:21.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.606+0000 7f27aba7d740 1 --2- 172.21.15.7:0/2931345358 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55752dc73a00 0x55752dc75e20 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.606+0000 7f27aba7d740 1 --2- 172.21.15.7:0/2931345358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55752dc63d40 0x55752dc61680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.606+0000 7f27aba7d740 1 --2- 172.21.15.7:0/2931345358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc59480 0x55752dc61140 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.606+0000 7f2786ff5640 0 client.16134 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:48:21.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.606+0000 7f27aba7d740 1 --2- 172.21.15.7:0/2931345358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55752dc58b60 0x55752dc60c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.606+0000 7f27aba7d740 1 -- 172.21.15.7:0/2931345358 >> 172.21.15.7:0/2931345358 conn(0x55752dc550f0 msgr2=0x55752dc5add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:21.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.606+0000 7f27aba7d740 1 -- 172.21.15.7:0/2931345358 shutdown_connections 2024-09-19T08:48:21.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.606+0000 7f27aba7d740 1 -- 172.21.15.7:0/2931345358 wait complete. 2024-09-19T08:48:21.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.606+0000 7f27aba7d740 20 client.16134 trim_cache size 0 max 16384 2024-09-19T08:48:21.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.624+0000 7f27aba7d740 1 Processor -- start 2024-09-19T08:48:21.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.624+0000 7f27aba7d740 1 -- start start 2024-09-19T08:48:21.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.624+0000 7f27aba7d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc58b60 0x55752dc5fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:21.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.624+0000 7f27aba7d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55752dc59480 0x55752dc614d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:21.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.624+0000 7f27aba7d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55752dc63d40 0x55752dc7b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:21.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.624+0000 7f27aba7d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41b2370 con 0x55752dc58b60 2024-09-19T08:48:21.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.624+0000 7f27aba7d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41afc40 con 0x55752dc59480 2024-09-19T08:48:21.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.624+0000 7f27aba7d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41ada90 con 0x55752dc63d40 2024-09-19T08:48:21.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.624+0000 7f27a27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc58b60 0x55752dc5fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:21.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.624+0000 7f27a27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc58b60 0x55752dc5fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35430/0 (socket says 172.21.15.7:35430) 2024-09-19T08:48:21.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.624+0000 7f27a27fc640 1 -- 172.21.15.7:0/2400952252 learned_addr learned my addr 172.21.15.7:0/2400952252 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:21.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.624+0000 7f27a2ffd640 1 --2- 172.21.15.7:0/2400952252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55752dc59480 0x55752dc614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:21.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.624+0000 7f27a27fc640 1 -- 172.21.15.7:0/2400952252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55752dc63d40 msgr2=0x55752dc7b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:21.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.624+0000 7f27a27fc640 1 --2- 172.21.15.7:0/2400952252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55752dc63d40 0x55752dc7b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.624+0000 7f27a27fc640 1 -- 172.21.15.7:0/2400952252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55752dc59480 msgr2=0x55752dc614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:21.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.624+0000 7f27a27fc640 1 --2- 172.21.15.7:0/2400952252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55752dc59480 0x55752dc614d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.624+0000 7f27a27fc640 1 -- 172.21.15.7:0/2400952252 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55752dc5b9d0 con 0x55752dc58b60 2024-09-19T08:48:21.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.624+0000 7f27a27fc640 1 --2- 172.21.15.7:0/2400952252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc58b60 0x55752dc5fab0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2798006aa0 tx=0x7f2798006a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc608e6fdccf4acb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:21.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.625+0000 7f2788ff9640 1 -- 172.21.15.7:0/2400952252 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798015850 con 0x55752dc58b60 2024-09-19T08:48:21.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.625+0000 7f2788ff9640 1 -- 172.21.15.7:0/2400952252 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f279801c070 con 0x55752dc58b60 2024-09-19T08:48:21.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.625+0000 7f2788ff9640 1 -- 172.21.15.7:0/2400952252 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798024ab0 con 0x55752dc58b60 2024-09-19T08:48:21.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.625+0000 7f27aba7d740 1 -- 172.21.15.7:0/2400952252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc58b60 msgr2=0x55752dc5fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:21.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.625+0000 7f27aba7d740 1 --2- 172.21.15.7:0/2400952252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc58b60 0x55752dc5fab0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2798006aa0 tx=0x7f2798006a30 comp rx=0 tx=0).stop 2024-09-19T08:48:21.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.625+0000 7f27aba7d740 1 -- 172.21.15.7:0/2400952252 shutdown_connections 2024-09-19T08:48:21.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.625+0000 7f27aba7d740 1 --2- 172.21.15.7:0/2400952252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55752dc63d40 0x55752dc7b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.625+0000 7f27aba7d740 1 --2- 172.21.15.7:0/2400952252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55752dc59480 0x55752dc614d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.625+0000 7f27aba7d740 1 --2- 172.21.15.7:0/2400952252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc58b60 0x55752dc5fab0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.625+0000 7f27aba7d740 1 -- 172.21.15.7:0/2400952252 >> 172.21.15.7:0/2400952252 conn(0x55752dc550f0 msgr2=0x55752dc5f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:21.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.625+0000 7f27aba7d740 1 -- 172.21.15.7:0/2400952252 shutdown_connections 2024-09-19T08:48:21.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.625+0000 7f27aba7d740 1 -- 172.21.15.7:0/2400952252 wait complete. 2024-09-19T08:48:21.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.626+0000 7f27aba7d740 1 -- start start 2024-09-19T08:48:21.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.626+0000 7f27aba7d740 1 Processor -- start 2024-09-19T08:48:21.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.626+0000 7f27aba7d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55752dc58b60 0x55752dc67a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:21.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.626+0000 7f27aba7d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55752dc59480 0x55752dc67fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:21.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.626+0000 7f27aba7d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc63d40 0x55752dc68510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:21.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.626+0000 7f27aba7d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41ae100 con 0x55752dc63d40 2024-09-19T08:48:21.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.626+0000 7f27aba7d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41af570 con 0x55752dc59480 2024-09-19T08:48:21.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.626+0000 7f27aba7d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41ae7d0 con 0x55752dc58b60 2024-09-19T08:48:21.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.626+0000 7f27aba7d740 10 client.0 _ll_register_callbacks cb 0x7f2794009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:21.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.626+0000 7f27a27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc63d40 0x55752dc68510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:21.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.626+0000 7f27a27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc63d40 0x55752dc68510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35438/0 (socket says 172.21.15.7:35438) 2024-09-19T08:48:21.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.626+0000 7f27a27fc640 1 -- 172.21.15.7:0/2939639049 learned_addr learned my addr 172.21.15.7:0/2939639049 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:21.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.626+0000 7f27a27fc640 1 --2- 172.21.15.7:0/2939639049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55752dc58b60 0x55752dc67a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:21.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.626+0000 7f27a2ffd640 1 --2- 172.21.15.7:0/2939639049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55752dc59480 0x55752dc67fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:21.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.626+0000 7f27a27fc640 1 -- 172.21.15.7:0/2939639049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55752dc58b60 msgr2=0x55752dc67a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:21.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.626+0000 7f27a27fc640 1 --2- 172.21.15.7:0/2939639049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55752dc58b60 0x55752dc67a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.626+0000 7f27a27fc640 1 -- 172.21.15.7:0/2939639049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55752dc59480 msgr2=0x55752dc67fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:21.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.626+0000 7f27a27fc640 1 --2- 172.21.15.7:0/2939639049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55752dc59480 0x55752dc67fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.627+0000 7f27a27fc640 1 -- 172.21.15.7:0/2939639049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55752dcdd6f0 con 0x55752dc63d40 2024-09-19T08:48:21.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.627+0000 7f27a27fc640 1 --2- 172.21.15.7:0/2939639049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc63d40 0x55752dc68510 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f279800b010 tx=0x7f2798024830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b5484440655bfa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:21.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.627+0000 7f2786ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:48:21.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.627+0000 7f2786ff5640 1 -- 172.21.15.7:0/2939639049 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798024b30 con 0x55752dc63d40 2024-09-19T08:48:21.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.627+0000 7f2786ff5640 1 -- 172.21.15.7:0/2939639049 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f2798024430 con 0x55752dc63d40 2024-09-19T08:48:21.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.627+0000 7f27aba7d740 1 -- 172.21.15.7:0/2939639049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f279801c070 con 0x55752dc63d40 2024-09-19T08:48:21.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.627+0000 7f2786ff5640 1 -- 172.21.15.7:0/2939639049 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f27980059c0 con 0x55752dc63d40 2024-09-19T08:48:21.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.627+0000 7f27aba7d740 10 client.16140 fetch_fsmap learned FSMap version 25 2024-09-19T08:48:21.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.627+0000 7f27aba7d740 1 -- 172.21.15.7:0/2939639049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55752dcdea10 con 0x55752dc63d40 2024-09-19T08:48:21.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.627+0000 7f2786ff5640 1 -- 172.21.15.7:0/2939639049 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f279801c070 con 0x55752dc63d40 2024-09-19T08:48:21.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.627+0000 7f2786ff5640 1 -- 172.21.15.7:0/2939639049 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2798006030 con 0x55752dc63d40 2024-09-19T08:48:21.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.627+0000 7f27aba7d740 10 client.16140 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:48:21.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.627+0000 7f27aba7d740 10 client.16140 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:48:21.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.627+0000 7f27aba7d740 20 client.16140 populate_metadata read hostname 'smithi007' 2024-09-19T08:48:21.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.628+0000 7f27aba7d740 1 --2- 172.21.15.7:0/2939639049 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55752dcdeda0 0x55752dce1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:21.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.628+0000 7f27aba7d740 4 client.16140 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:48:21.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.628+0000 7f27aba7d740 1 -- 172.21.15.7:0/2939639049 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55752dbc5d00 con 0x55752dcdeda0 2024-09-19T08:48:21.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.628+0000 7f27a2ffd640 1 --2- 172.21.15.7:0/2939639049 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55752dcdeda0 0x55752dce1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:21.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.628+0000 7f27a2ffd640 1 --2- 172.21.15.7:0/2939639049 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55752dcdeda0 0x55752dce1190 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fe65ffd7bb8d6ed server_cookie=6acdac239e8ba28f in_seq=0 out_seq=0 2024-09-19T08:48:21.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.628+0000 7f2786ff5640 10 client.16140 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:48:21.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.629+0000 7f2786ff5640 1 -- 172.21.15.7:0/2939639049 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55752dbc5d00 con 0x55752dcdeda0 2024-09-19T08:48:21.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.629+0000 7f2786ff5640 10 client.16140 handle_command_reply: tid=0 2024-09-19T08:48:21.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.629+0000 7f27aba7d740 1 client.16140 shutdown 2024-09-19T08:48:21.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.629+0000 7f27aba7d740 1 -- 172.21.15.7:0/2939639049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc63d40 msgr2=0x55752dc68510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:21.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.629+0000 7f27aba7d740 1 --2- 172.21.15.7:0/2939639049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc63d40 0x55752dc68510 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f279800b010 tx=0x7f2798024830 comp rx=0 tx=0).stop 2024-09-19T08:48:21.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.629+0000 7f27aba7d740 1 -- 172.21.15.7:0/2939639049 shutdown_connections 2024-09-19T08:48:21.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.629+0000 7f27aba7d740 1 --2- 172.21.15.7:0/2939639049 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55752dcdeda0 0x55752dce1190 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.629+0000 7f27aba7d740 1 --2- 172.21.15.7:0/2939639049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55752dc63d40 0x55752dc68510 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.629+0000 7f27aba7d740 1 --2- 172.21.15.7:0/2939639049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55752dc59480 0x55752dc67fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.629+0000 7f27aba7d740 1 --2- 172.21.15.7:0/2939639049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55752dc58b60 0x55752dc67a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.629+0000 7f27aba7d740 1 -- 172.21.15.7:0/2939639049 >> 172.21.15.7:0/2939639049 conn(0x55752dc550f0 msgr2=0x55752dc54270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:21.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.629+0000 7f2786ff5640 0 client.16140 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:48:21.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.629+0000 7f27aba7d740 1 -- 172.21.15.7:0/2939639049 shutdown_connections 2024-09-19T08:48:21.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.629+0000 7f27aba7d740 1 -- 172.21.15.7:0/2939639049 wait complete. 2024-09-19T08:48:21.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.630+0000 7f27aba7d740 20 client.16140 trim_cache size 0 max 16384 2024-09-19T08:48:21.635 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:48:21.635 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-19T08:48:21.635 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "fad1a660-8a7f-4c10-a6bb-0bf76155084b", 2024-09-19T08:48:21.636 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-19T08:48:21.636 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:48:21.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.630+0000 7f27a96a4640 1 -- 172.21.15.7:0/1467637663 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f278c0a33b0 msgr2=0x7f278c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:21.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.630+0000 7f27a96a4640 1 --2- 172.21.15.7:0/1467637663 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f278c0a33b0 0x7f278c0a5870 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f279c098ea0 tx=0x7f279c06b1c0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.630+0000 7f27a96a4640 1 -- 172.21.15.7:0/1467637663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27a410e500 msgr2=0x7f27a419a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:21.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.630+0000 7f27a96a4640 1 --2- 172.21.15.7:0/1467637663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27a410e500 0x7f27a419a5c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f279c00ccb0 tx=0x7f279c00a620 comp rx=0 tx=0).stop 2024-09-19T08:48:21.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.630+0000 7f27a96a4640 1 -- 172.21.15.7:0/1467637663 shutdown_connections 2024-09-19T08:48:21.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.630+0000 7f27a96a4640 1 --2- 172.21.15.7:0/1467637663 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f278c0a33b0 0x7f278c0a5870 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.630+0000 7f27a96a4640 1 --2- 172.21.15.7:0/1467637663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27a410e500 0x7f27a419a5c0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.630+0000 7f27a96a4640 1 --2- 172.21.15.7:0/1467637663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27a4101440 0x7f27a41a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.630+0000 7f27a96a4640 1 --2- 172.21.15.7:0/1467637663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a4100b20 0x7f27a41a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:21.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.630+0000 7f27a96a4640 1 -- 172.21.15.7:0/1467637663 >> 172.21.15.7:0/1467637663 conn(0x7f27a40fc7d0 msgr2=0x7f27a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:21.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.630+0000 7f27a96a4640 1 -- 172.21.15.7:0/1467637663 shutdown_connections 2024-09-19T08:48:21.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:21.630+0000 7f27a96a4640 1 -- 172.21.15.7:0/1467637663 wait complete. 2024-09-19T08:48:22.484 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:48:22.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:22 smithi175 ceph-mon[35688]: pgmap v118: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:48:22.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:22 smithi175 ceph-mon[35688]: scrub queued for path: / 2024-09-19T08:48:22.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:22 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:48:22.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:22 smithi175 ceph-mon[35688]: scrub summary: active paths [/] 2024-09-19T08:48:22.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:22 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:48:22.740 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:22.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:22 smithi007 ceph-mon[31221]: pgmap v118: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:48:22.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:22 smithi007 ceph-mon[31221]: scrub queued for path: / 2024-09-19T08:48:22.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:22 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:48:22.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:22 smithi007 ceph-mon[31221]: scrub summary: active paths [/] 2024-09-19T08:48:22.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:22 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:48:22.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:22 smithi044 ceph-mon[35072]: pgmap v118: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:48:22.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:22 smithi044 ceph-mon[35072]: scrub queued for path: / 2024-09-19T08:48:22.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:22 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:48:22.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:22 smithi044 ceph-mon[35072]: scrub summary: active paths [/] 2024-09-19T08:48:22.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:22 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:48:23.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.359+0000 7fee3e43a640 1 -- 172.21.15.7:0/3302717781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee38100a80 msgr2=0x7fee38100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:23.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.359+0000 7fee3e43a640 1 --2- 172.21.15.7:0/3302717781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee38100a80 0x7fee38100ee0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fee2c009930 tx=0x7fee2c02a420 comp rx=0 tx=0).stop 2024-09-19T08:48:23.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.359+0000 7fee3e43a640 1 -- 172.21.15.7:0/3302717781 shutdown_connections 2024-09-19T08:48:23.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.359+0000 7fee3e43a640 1 --2- 172.21.15.7:0/3302717781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee38101420 0x7fee3810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.359+0000 7fee3e43a640 1 --2- 172.21.15.7:0/3302717781 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee38100a80 0x7fee38100ee0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.359+0000 7fee3e43a640 1 --2- 172.21.15.7:0/3302717781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee38106a80 0x7fee38106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.359+0000 7fee3e43a640 1 -- 172.21.15.7:0/3302717781 >> 172.21.15.7:0/3302717781 conn(0x7fee380fc7a0 msgr2=0x7fee380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:23.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.359+0000 7fee3e43a640 1 -- 172.21.15.7:0/3302717781 shutdown_connections 2024-09-19T08:48:23.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.359+0000 7fee3e43a640 1 -- 172.21.15.7:0/3302717781 wait complete. 2024-09-19T08:48:23.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.360+0000 7fee3e43a640 1 Processor -- start 2024-09-19T08:48:23.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.360+0000 7fee3e43a640 1 -- start start 2024-09-19T08:48:23.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.360+0000 7fee3e43a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee38100a80 0x7fee3819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.360+0000 7fee3e43a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee38101420 0x7fee3819ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.361+0000 7fee3e43a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee38106a80 0x7fee3819efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.361+0000 7fee3e43a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fee38110ef0 con 0x7fee38106a80 2024-09-19T08:48:23.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.361+0000 7fee3e43a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fee38110d70 con 0x7fee38101420 2024-09-19T08:48:23.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.361+0000 7fee3e43a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fee38111070 con 0x7fee38100a80 2024-09-19T08:48:23.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.361+0000 7fee3c9d7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee38106a80 0x7fee3819efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.361+0000 7fee37fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee38100a80 0x7fee3819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.361+0000 7fee3c9d7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee38106a80 0x7fee3819efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41430/0 (socket says 172.21.15.7:41430) 2024-09-19T08:48:23.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.361+0000 7fee3c9d7640 1 -- 172.21.15.7:0/1069743765 learned_addr learned my addr 172.21.15.7:0/1069743765 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:23.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.361+0000 7fee377fe640 1 --2- 172.21.15.7:0/1069743765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee38101420 0x7fee3819ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.361+0000 7fee3c9d7640 1 -- 172.21.15.7:0/1069743765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee38100a80 msgr2=0x7fee3819a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:23.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.361+0000 7fee3c9d7640 1 --2- 172.21.15.7:0/1069743765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee38100a80 0x7fee3819a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.361+0000 7fee3c9d7640 1 -- 172.21.15.7:0/1069743765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee38101420 msgr2=0x7fee3819ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:23.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.361+0000 7fee3c9d7640 1 --2- 172.21.15.7:0/1069743765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee38101420 0x7fee3819ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.361+0000 7fee3c9d7640 1 -- 172.21.15.7:0/1069743765 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3819f6b0 con 0x7fee38106a80 2024-09-19T08:48:23.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.361+0000 7fee3c9d7640 1 --2- 172.21.15.7:0/1069743765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee38106a80 0x7fee3819efd0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fee3000b970 tx=0x7fee3000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:23.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.361+0000 7fee357fa640 1 -- 172.21.15.7:0/1069743765 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee30019070 con 0x7fee38106a80 2024-09-19T08:48:23.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.361+0000 7fee3e43a640 1 -- 172.21.15.7:0/1069743765 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee3819f9a0 con 0x7fee38106a80 2024-09-19T08:48:23.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.361+0000 7fee357fa640 1 -- 172.21.15.7:0/1069743765 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee3000cb40 con 0x7fee38106a80 2024-09-19T08:48:23.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.362+0000 7fee3e43a640 1 -- 172.21.15.7:0/1069743765 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee381a7280 con 0x7fee38106a80 2024-09-19T08:48:23.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.362+0000 7fee357fa640 1 -- 172.21.15.7:0/1069743765 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee30007670 con 0x7fee38106a80 2024-09-19T08:48:23.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.364+0000 7fee357fa640 1 -- 172.21.15.7:0/1069743765 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fee3001c070 con 0x7fee38106a80 2024-09-19T08:48:23.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.364+0000 7fee40813740 1 Processor -- start 2024-09-19T08:48:23.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.364+0000 7fee40813740 1 -- start start 2024-09-19T08:48:23.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.364+0000 7fee40813740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56180fd064a0 0x56180fd06880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.364+0000 7fee40813740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56180fd06dc0 0x56180fd11140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.364+0000 7fee40813740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd11680 0x56180fd13a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.364+0000 7fee40813740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56180fc6c2e0 con 0x56180fd11680 2024-09-19T08:48:23.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.364+0000 7fee40813740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56180fc13ce0 con 0x56180fd064a0 2024-09-19T08:48:23.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.364+0000 7fee40813740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56180fc682a0 con 0x56180fd06dc0 2024-09-19T08:48:23.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.365+0000 7fee377fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd11680 0x56180fd13a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.365+0000 7fee377fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd11680 0x56180fd13a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41436/0 (socket says 172.21.15.7:41436) 2024-09-19T08:48:23.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.365+0000 7fee377fe640 1 -- 172.21.15.7:0/2379021189 learned_addr learned my addr 172.21.15.7:0/2379021189 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:23.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.365+0000 7fee37fff640 1 --2- 172.21.15.7:0/2379021189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56180fd06dc0 0x56180fd11140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.365+0000 7fee357fa640 1 --2- 172.21.15.7:0/1069743765 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fee200a33b0 0x7fee200a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.365+0000 7fee377fe640 1 --2- 172.21.15.7:0/2379021189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56180fd064a0 0x56180fd06880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.365+0000 7fee377fe640 1 -- 172.21.15.7:0/2379021189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56180fd06dc0 msgr2=0x56180fd11140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:23.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.365+0000 7fee377fe640 1 --2- 172.21.15.7:0/2379021189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56180fd06dc0 0x56180fd11140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.365+0000 7fee3c9d7640 1 --2- 172.21.15.7:0/1069743765 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fee200a33b0 0x7fee200a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.365+0000 7fee377fe640 1 -- 172.21.15.7:0/2379021189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56180fd064a0 msgr2=0x56180fd06880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:23.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.365+0000 7fee377fe640 1 --2- 172.21.15.7:0/2379021189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56180fd064a0 0x56180fd06880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.365+0000 7fee377fe640 1 -- 172.21.15.7:0/2379021189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56180fbf8440 con 0x56180fd11680 2024-09-19T08:48:23.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.365+0000 7fee357fa640 1 -- 172.21.15.7:0/1069743765 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fee300cf100 con 0x7fee38106a80 2024-09-19T08:48:23.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.365+0000 7fee377fe640 1 --2- 172.21.15.7:0/2379021189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd11680 0x56180fd13a70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fee2c009930 tx=0x7fee2c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9406c3113fc8baf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:23.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.365+0000 7fee1e7fc640 1 -- 172.21.15.7:0/2379021189 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c044020 con 0x56180fd11680 2024-09-19T08:48:23.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.365+0000 7fee3c9d7640 1 --2- 172.21.15.7:0/1069743765 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fee200a33b0 0x7fee200a5870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fee300ccaa0 tx=0x7fee3006d3b0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:23.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.365+0000 7fee1e7fc640 1 -- 172.21.15.7:0/2379021189 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee2c004700 con 0x56180fd11680 2024-09-19T08:48:23.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.365+0000 7fee1e7fc640 1 -- 172.21.15.7:0/2379021189 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c035070 con 0x56180fd11680 2024-09-19T08:48:23.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.366+0000 7fee40813740 1 -- 172.21.15.7:0/2379021189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd11680 msgr2=0x56180fd13a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:23.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.366+0000 7fee40813740 1 --2- 172.21.15.7:0/2379021189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd11680 0x56180fd13a70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fee2c009930 tx=0x7fee2c005d50 comp rx=0 tx=0).stop 2024-09-19T08:48:23.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.366+0000 7fee40813740 1 -- 172.21.15.7:0/2379021189 shutdown_connections 2024-09-19T08:48:23.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.366+0000 7fee40813740 1 --2- 172.21.15.7:0/2379021189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd11680 0x56180fd13a70 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.366+0000 7fee40813740 1 --2- 172.21.15.7:0/2379021189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56180fd06dc0 0x56180fd11140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.366+0000 7fee40813740 1 --2- 172.21.15.7:0/2379021189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56180fd064a0 0x56180fd06880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.366+0000 7fee40813740 1 -- 172.21.15.7:0/2379021189 >> 172.21.15.7:0/2379021189 conn(0x56180fd02a30 msgr2=0x56180fd02e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:23.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.366+0000 7fee40813740 1 -- 172.21.15.7:0/2379021189 shutdown_connections 2024-09-19T08:48:23.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.366+0000 7fee40813740 1 -- 172.21.15.7:0/2379021189 wait complete. 2024-09-19T08:48:23.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.366+0000 7fee40813740 1 -- start start 2024-09-19T08:48:23.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.367+0000 7fee40813740 1 Processor -- start 2024-09-19T08:48:23.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.367+0000 7fee40813740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56180fd064a0 0x56180fd11010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.367+0000 7fee40813740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd06dc0 0x56180fd0e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.367+0000 7fee40813740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56180fd11680 0x56180fd0e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.367+0000 7fee40813740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56180fd14250 con 0x56180fd06dc0 2024-09-19T08:48:23.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.367+0000 7fee40813740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56180fc27050 con 0x56180fd11680 2024-09-19T08:48:23.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.367+0000 7fee40813740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56180fd143d0 con 0x56180fd064a0 2024-09-19T08:48:23.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.367+0000 7fee40813740 10 client.0 _ll_register_callbacks cb 0x56180fc67160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:23.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.367+0000 7fee37fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd06dc0 0x56180fd0e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.367+0000 7fee37fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd06dc0 0x56180fd0e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41446/0 (socket says 172.21.15.7:41446) 2024-09-19T08:48:23.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.367+0000 7fee37fff640 1 -- 172.21.15.7:0/1051245020 learned_addr learned my addr 172.21.15.7:0/1051245020 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:23.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.367+0000 7fee37fff640 1 -- 172.21.15.7:0/1051245020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56180fd064a0 msgr2=0x56180fd11010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:23.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.367+0000 7fee377fe640 1 --2- 172.21.15.7:0/1051245020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56180fd064a0 0x56180fd11010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.367+0000 7fee37fff640 1 --2- 172.21.15.7:0/1051245020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56180fd064a0 0x56180fd11010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.367+0000 7fee37fff640 1 -- 172.21.15.7:0/1051245020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56180fd11680 msgr2=0x56180fd0e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:23.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.367+0000 7fee37fff640 1 --2- 172.21.15.7:0/1051245020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56180fd11680 0x56180fd0e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.367+0000 7fee37fff640 1 -- 172.21.15.7:0/1051245020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56180f9dd3c0 con 0x56180fd06dc0 2024-09-19T08:48:23.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.367+0000 7fee377fe640 1 --2- 172.21.15.7:0/1051245020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56180fd064a0 0x56180fd11010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:48:23.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.368+0000 7fee37fff640 1 --2- 172.21.15.7:0/1051245020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd06dc0 0x56180fd0e2c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fee2800bad0 tx=0x7fee2800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc83fcc688847a08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:23.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.368+0000 7fee177fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:48:23.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.368+0000 7fee177fe640 1 -- 172.21.15.7:0/1051245020 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee28005020 con 0x56180fd06dc0 2024-09-19T08:48:23.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.368+0000 7fee177fe640 1 -- 172.21.15.7:0/1051245020 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fee280051c0 con 0x56180fd06dc0 2024-09-19T08:48:23.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.368+0000 7fee40813740 1 -- 172.21.15.7:0/1051245020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee2c004700 con 0x56180fd06dc0 2024-09-19T08:48:23.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.368+0000 7fee177fe640 1 -- 172.21.15.7:0/1051245020 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fee28005400 con 0x56180fd06dc0 2024-09-19T08:48:23.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.368+0000 7fee40813740 10 client.16152 fetch_fsmap learned FSMap version 25 2024-09-19T08:48:23.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.368+0000 7fee40813740 1 -- 172.21.15.7:0/1051245020 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56180fd1fca0 con 0x56180fd06dc0 2024-09-19T08:48:23.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.368+0000 7fee177fe640 1 -- 172.21.15.7:0/1051245020 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee2c004700 con 0x56180fd06dc0 2024-09-19T08:48:23.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.368+0000 7fee177fe640 1 -- 172.21.15.7:0/1051245020 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fee2801b740 con 0x56180fd06dc0 2024-09-19T08:48:23.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.368+0000 7fee40813740 10 client.16152 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:48:23.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.368+0000 7fee40813740 10 client.16152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:48:23.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.368+0000 7fee40813740 20 client.16152 populate_metadata read hostname 'smithi007' 2024-09-19T08:48:23.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.368+0000 7fee40813740 1 --2- 172.21.15.7:0/1051245020 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56180fd211b0 0x56180fd235f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.368+0000 7fee40813740 4 client.16152 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:48:23.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.368+0000 7fee40813740 1 -- 172.21.15.7:0/1051245020 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56180fc79850 con 0x56180fd211b0 2024-09-19T08:48:23.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.369+0000 7fee377fe640 1 --2- 172.21.15.7:0/1051245020 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56180fd211b0 0x56180fd235f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.369+0000 7fee377fe640 1 --2- 172.21.15.7:0/1051245020 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56180fd211b0 0x56180fd235f0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48a9f4a9f9550846 server_cookie=c6ad5494a065ccb5 in_seq=0 out_seq=0 2024-09-19T08:48:23.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.369+0000 7fee177fe640 10 client.16152 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:48:23.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.370+0000 7fee177fe640 1 -- 172.21.15.7:0/1051245020 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56180fc79850 con 0x56180fd211b0 2024-09-19T08:48:23.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.370+0000 7fee177fe640 10 client.16152 handle_command_reply: tid=0 2024-09-19T08:48:23.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.370+0000 7fee40813740 1 client.16152 shutdown 2024-09-19T08:48:23.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.370+0000 7fee40813740 1 -- 172.21.15.7:0/1051245020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd06dc0 msgr2=0x56180fd0e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:23.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.370+0000 7fee40813740 1 --2- 172.21.15.7:0/1051245020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd06dc0 0x56180fd0e2c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fee2800bad0 tx=0x7fee2800bed0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.370+0000 7fee40813740 1 -- 172.21.15.7:0/1051245020 shutdown_connections 2024-09-19T08:48:23.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.370+0000 7fee40813740 1 --2- 172.21.15.7:0/1051245020 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56180fd211b0 0x56180fd235f0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.370+0000 7fee40813740 1 --2- 172.21.15.7:0/1051245020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56180fd11680 0x56180fd0e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.370+0000 7fee40813740 1 --2- 172.21.15.7:0/1051245020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd06dc0 0x56180fd0e2c0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.370+0000 7fee40813740 1 --2- 172.21.15.7:0/1051245020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56180fd064a0 0x56180fd11010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.370+0000 7fee177fe640 0 client.16152 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:48:23.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.370+0000 7fee40813740 1 -- 172.21.15.7:0/1051245020 >> 172.21.15.7:0/1051245020 conn(0x56180fd02a30 msgr2=0x56180fd08710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:23.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.370+0000 7fee40813740 1 -- 172.21.15.7:0/1051245020 shutdown_connections 2024-09-19T08:48:23.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.370+0000 7fee40813740 1 -- 172.21.15.7:0/1051245020 wait complete. 2024-09-19T08:48:23.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.370+0000 7fee40813740 20 client.16152 trim_cache size 0 max 16384 2024-09-19T08:48:23.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.388+0000 7fee40813740 1 Processor -- start 2024-09-19T08:48:23.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.388+0000 7fee40813740 1 -- start start 2024-09-19T08:48:23.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.388+0000 7fee40813740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56180fd064a0 0x56180fd1d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.388+0000 7fee40813740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd06dc0 0x56180fd0db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.388+0000 7fee40813740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56180fd11680 0x56180fd28ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.388+0000 7fee40813740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fee381b2450 con 0x56180fd06dc0 2024-09-19T08:48:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.388+0000 7fee40813740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fee381afd20 con 0x56180fd11680 2024-09-19T08:48:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.388+0000 7fee40813740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fee381adb70 con 0x56180fd064a0 2024-09-19T08:48:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.388+0000 7fee37fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd06dc0 0x56180fd0db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.388+0000 7fee37fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd06dc0 0x56180fd0db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41456/0 (socket says 172.21.15.7:41456) 2024-09-19T08:48:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.388+0000 7fee37fff640 1 -- 172.21.15.7:0/1045762112 learned_addr learned my addr 172.21.15.7:0/1045762112 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.389+0000 7fee377fe640 1 --2- 172.21.15.7:0/1045762112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56180fd11680 0x56180fd28ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.389+0000 7fee377fe640 1 --2- 172.21.15.7:0/1045762112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56180fd064a0 0x56180fd1d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.389+0000 7fee37fff640 1 -- 172.21.15.7:0/1045762112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56180fd064a0 msgr2=0x56180fd1d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:23.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.389+0000 7fee37fff640 1 --2- 172.21.15.7:0/1045762112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56180fd064a0 0x56180fd1d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.389+0000 7fee37fff640 1 -- 172.21.15.7:0/1045762112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56180fd11680 msgr2=0x56180fd28ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:23.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.389+0000 7fee37fff640 1 --2- 172.21.15.7:0/1045762112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56180fd11680 0x56180fd28ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.389+0000 7fee37fff640 1 -- 172.21.15.7:0/1045762112 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56180fd0ebb0 con 0x56180fd06dc0 2024-09-19T08:48:23.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.389+0000 7fee37fff640 1 --2- 172.21.15.7:0/1045762112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd06dc0 0x56180fd0db80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fee28005d00 tx=0x7fee280055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0759c711110c40a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.390+0000 7fee1dffb640 1 -- 172.21.15.7:0/1045762112 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee28031070 con 0x56180fd06dc0 2024-09-19T08:48:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.390+0000 7fee1dffb640 1 -- 172.21.15.7:0/1045762112 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee28028040 con 0x56180fd06dc0 2024-09-19T08:48:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.390+0000 7fee1dffb640 1 -- 172.21.15.7:0/1045762112 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee28027070 con 0x56180fd06dc0 2024-09-19T08:48:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.391+0000 7fee40813740 1 -- 172.21.15.7:0/1045762112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd06dc0 msgr2=0x56180fd0db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.391+0000 7fee40813740 1 --2- 172.21.15.7:0/1045762112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd06dc0 0x56180fd0db80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fee28005d00 tx=0x7fee280055a0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.391+0000 7fee40813740 1 -- 172.21.15.7:0/1045762112 shutdown_connections 2024-09-19T08:48:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.391+0000 7fee40813740 1 --2- 172.21.15.7:0/1045762112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56180fd11680 0x56180fd28ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.391+0000 7fee40813740 1 --2- 172.21.15.7:0/1045762112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd06dc0 0x56180fd0db80 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.391+0000 7fee40813740 1 --2- 172.21.15.7:0/1045762112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56180fd064a0 0x56180fd1d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.391+0000 7fee40813740 1 -- 172.21.15.7:0/1045762112 >> 172.21.15.7:0/1045762112 conn(0x56180fd02a30 msgr2=0x56180fd0d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.391+0000 7fee40813740 1 -- 172.21.15.7:0/1045762112 shutdown_connections 2024-09-19T08:48:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.391+0000 7fee40813740 1 -- 172.21.15.7:0/1045762112 wait complete. 2024-09-19T08:48:23.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.392+0000 7fee40813740 1 -- start start 2024-09-19T08:48:23.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.392+0000 7fee40813740 1 Processor -- start 2024-09-19T08:48:23.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.392+0000 7fee40813740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56180fd064a0 0x56180fd19800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.392+0000 7fee40813740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56180fd06dc0 0x56180fd19d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.392+0000 7fee40813740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd11680 0x56180fd0a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.392+0000 7fee40813740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fee381ae1e0 con 0x56180fd11680 2024-09-19T08:48:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.392+0000 7fee40813740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fee381af650 con 0x56180fd06dc0 2024-09-19T08:48:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.392+0000 7fee40813740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fee381ae8b0 con 0x56180fd064a0 2024-09-19T08:48:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.392+0000 7fee40813740 10 client.0 _ll_register_callbacks cb 0x7fee280040a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.392+0000 7fee377fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd11680 0x56180fd0a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.392+0000 7fee377fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd11680 0x56180fd0a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41464/0 (socket says 172.21.15.7:41464) 2024-09-19T08:48:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.392+0000 7fee377fe640 1 -- 172.21.15.7:0/45237189 learned_addr learned my addr 172.21.15.7:0/45237189 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.392+0000 7fee37fff640 1 --2- 172.21.15.7:0/45237189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56180fd06dc0 0x56180fd19d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.392+0000 7fee377fe640 1 --2- 172.21.15.7:0/45237189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56180fd064a0 0x56180fd19800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.393+0000 7fee377fe640 1 -- 172.21.15.7:0/45237189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56180fd064a0 msgr2=0x56180fd19800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.393+0000 7fee377fe640 1 --2- 172.21.15.7:0/45237189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56180fd064a0 0x56180fd19800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.393+0000 7fee377fe640 1 -- 172.21.15.7:0/45237189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56180fd06dc0 msgr2=0x56180fd19d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.393+0000 7fee377fe640 1 --2- 172.21.15.7:0/45237189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56180fd06dc0 0x56180fd19d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.393+0000 7fee377fe640 1 -- 172.21.15.7:0/45237189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56180fd0af60 con 0x56180fd11680 2024-09-19T08:48:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.393+0000 7fee37fff640 1 --2- 172.21.15.7:0/45237189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56180fd06dc0 0x56180fd19d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:48:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.393+0000 7fee377fe640 1 --2- 172.21.15.7:0/45237189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd11680 0x56180fd0a8f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fee2c005ec0 tx=0x7fee2c040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2accb9e5a24edc0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.393+0000 7fee177fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:48:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.393+0000 7fee177fe640 1 -- 172.21.15.7:0/45237189 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c044040 con 0x56180fd11680 2024-09-19T08:48:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.393+0000 7fee177fe640 1 -- 172.21.15.7:0/45237189 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fee2c003bb0 con 0x56180fd11680 2024-09-19T08:48:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.393+0000 7fee40813740 1 -- 172.21.15.7:0/45237189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee28028040 con 0x56180fd11680 2024-09-19T08:48:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.393+0000 7fee177fe640 1 -- 172.21.15.7:0/45237189 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fee2c062050 con 0x56180fd11680 2024-09-19T08:48:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.393+0000 7fee40813740 10 client.16158 fetch_fsmap learned FSMap version 25 2024-09-19T08:48:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.393+0000 7fee40813740 1 -- 172.21.15.7:0/45237189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56180fd8b800 con 0x56180fd11680 2024-09-19T08:48:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.393+0000 7fee177fe640 1 -- 172.21.15.7:0/45237189 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee28028040 con 0x56180fd11680 2024-09-19T08:48:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.393+0000 7fee177fe640 1 -- 172.21.15.7:0/45237189 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fee2c03d4e0 con 0x56180fd11680 2024-09-19T08:48:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.393+0000 7fee40813740 10 client.16158 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:48:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.393+0000 7fee40813740 10 client.16158 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:48:23.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.393+0000 7fee40813740 20 client.16158 populate_metadata read hostname 'smithi007' 2024-09-19T08:48:23.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.394+0000 7fee40813740 1 --2- 172.21.15.7:0/45237189 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56180fd8ba80 0x56180fd8de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:23.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.394+0000 7fee40813740 4 client.16158 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:48:23.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.394+0000 7fee40813740 1 -- 172.21.15.7:0/45237189 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56180fc73d60 con 0x56180fd8ba80 2024-09-19T08:48:23.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.394+0000 7fee37fff640 1 --2- 172.21.15.7:0/45237189 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56180fd8ba80 0x56180fd8de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:23.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.394+0000 7fee37fff640 1 --2- 172.21.15.7:0/45237189 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56180fd8ba80 0x56180fd8de70 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d50be4f22b9b6ef9 server_cookie=ecb9708dd236f801 in_seq=0 out_seq=0 2024-09-19T08:48:23.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.394+0000 7fee177fe640 10 client.16158 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:48:23.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.394+0000 7fee177fe640 1 -- 172.21.15.7:0/45237189 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56180fc73d60 con 0x56180fd8ba80 2024-09-19T08:48:23.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.394+0000 7fee177fe640 10 client.16158 handle_command_reply: tid=0 2024-09-19T08:48:23.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.394+0000 7fee40813740 1 client.16158 shutdown 2024-09-19T08:48:23.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.395+0000 7fee40813740 1 -- 172.21.15.7:0/45237189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd11680 msgr2=0x56180fd0a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:23.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.395+0000 7fee40813740 1 --2- 172.21.15.7:0/45237189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd11680 0x56180fd0a8f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fee2c005ec0 tx=0x7fee2c040040 comp rx=0 tx=0).stop 2024-09-19T08:48:23.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.395+0000 7fee40813740 1 -- 172.21.15.7:0/45237189 shutdown_connections 2024-09-19T08:48:23.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.395+0000 7fee40813740 1 --2- 172.21.15.7:0/45237189 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56180fd8ba80 0x56180fd8de70 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.395+0000 7fee40813740 1 --2- 172.21.15.7:0/45237189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56180fd11680 0x56180fd0a8f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.395+0000 7fee40813740 1 --2- 172.21.15.7:0/45237189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56180fd06dc0 0x56180fd19d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.395+0000 7fee40813740 1 --2- 172.21.15.7:0/45237189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56180fd064a0 0x56180fd19800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.395+0000 7fee177fe640 0 client.16158 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:48:23.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.395+0000 7fee40813740 1 -- 172.21.15.7:0/45237189 >> 172.21.15.7:0/45237189 conn(0x56180fd02a30 msgr2=0x56180fd0d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:23.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.395+0000 7fee40813740 1 -- 172.21.15.7:0/45237189 shutdown_connections 2024-09-19T08:48:23.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.395+0000 7fee40813740 1 -- 172.21.15.7:0/45237189 wait complete. 2024-09-19T08:48:23.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.395+0000 7fee40813740 20 client.16158 trim_cache size 0 max 16384 2024-09-19T08:48:23.401 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:48:23.401 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:48:23.401 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-19T08:48:23.401 INFO:teuthology.orchestra.run.smithi007.stdout: "fad1a660-8a7f-4c10-a6bb-0bf76155084b": { 2024-09-19T08:48:23.401 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-19T08:48:23.402 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "fad1a660-8a7f-4c10-a6bb-0bf76155084b", 2024-09-19T08:48:23.402 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-19T08:48:23.402 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:48:23.402 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:48:23.402 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:48:23.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.395+0000 7fee3e43a640 1 -- 172.21.15.7:0/1069743765 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fee200a33b0 msgr2=0x7fee200a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:23.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.395+0000 7fee3e43a640 1 --2- 172.21.15.7:0/1069743765 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fee200a33b0 0x7fee200a5870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fee300ccaa0 tx=0x7fee3006d3b0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.395+0000 7fee3e43a640 1 -- 172.21.15.7:0/1069743765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee38106a80 msgr2=0x7fee3819efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.395+0000 7fee3e43a640 1 --2- 172.21.15.7:0/1069743765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee38106a80 0x7fee3819efd0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fee3000b970 tx=0x7fee3000be30 comp rx=0 tx=0).stop 2024-09-19T08:48:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.395+0000 7fee3e43a640 1 -- 172.21.15.7:0/1069743765 shutdown_connections 2024-09-19T08:48:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.395+0000 7fee3e43a640 1 --2- 172.21.15.7:0/1069743765 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fee200a33b0 0x7fee200a5870 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.395+0000 7fee3e43a640 1 --2- 172.21.15.7:0/1069743765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee38106a80 0x7fee3819efd0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.395+0000 7fee3e43a640 1 --2- 172.21.15.7:0/1069743765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee38101420 0x7fee3819ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.395+0000 7fee3e43a640 1 --2- 172.21.15.7:0/1069743765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee38100a80 0x7fee3819a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.395+0000 7fee3e43a640 1 -- 172.21.15.7:0/1069743765 >> 172.21.15.7:0/1069743765 conn(0x7fee380fc7a0 msgr2=0x7fee3806a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.396+0000 7fee3e43a640 1 -- 172.21.15.7:0/1069743765 shutdown_connections 2024-09-19T08:48:23.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:23.396+0000 7fee3e43a640 1 -- 172.21.15.7:0/1069743765 wait complete. 2024-09-19T08:48:24.159 INFO:tasks.cephfs.filesystem:scrub status for tag:fad1a660-8a7f-4c10-a6bb-0bf76155084b - {'path': '/', 'tag': 'fad1a660-8a7f-4c10-a6bb-0bf76155084b', 'options': 'recursive,force'} 2024-09-19T08:48:24.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:24 smithi175 ceph-mon[35688]: pgmap v119: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T08:48:24.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:24 smithi175 ceph-mon[35688]: scrub summary: idle 2024-09-19T08:48:24.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:24 smithi007 ceph-mon[31221]: pgmap v119: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T08:48:24.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:24 smithi007 ceph-mon[31221]: scrub summary: idle 2024-09-19T08:48:24.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:24 smithi044 ceph-mon[35072]: pgmap v119: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T08:48:24.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:24 smithi044 ceph-mon[35072]: scrub summary: idle 2024-09-19T08:48:26.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:26 smithi175 ceph-mon[35688]: pgmap v120: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:48:26.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:26 smithi007 ceph-mon[31221]: pgmap v120: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:48:26.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:26 smithi044 ceph-mon[35072]: pgmap v120: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:48:28.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:28 smithi175 ceph-mon[35688]: pgmap v121: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:48:28.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:28 smithi007 ceph-mon[31221]: pgmap v121: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:48:28.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:28 smithi044 ceph-mon[35072]: pgmap v121: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:48:30.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:30 smithi175 ceph-mon[35688]: pgmap v122: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:48:30.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:30 smithi007 ceph-mon[31221]: pgmap v122: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:48:30.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:30 smithi044 ceph-mon[35072]: pgmap v122: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:48:32.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:32 smithi175 ceph-mon[35688]: pgmap v123: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:48:32.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:32 smithi007 ceph-mon[31221]: pgmap v123: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:48:32.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:32 smithi044 ceph-mon[35072]: pgmap v123: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:48:34.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:34 smithi175 ceph-mon[35688]: pgmap v124: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:48:34.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:34 smithi007 ceph-mon[31221]: pgmap v124: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:48:34.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:34 smithi044 ceph-mon[35072]: pgmap v124: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:48:36.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:36 smithi175 ceph-mon[35688]: pgmap v125: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:48:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:36 smithi007 ceph-mon[31221]: pgmap v125: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:48:36.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:36 smithi044 ceph-mon[35072]: pgmap v125: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:48:38.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:38 smithi175 ceph-mon[35688]: pgmap v126: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:48:38.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:38 smithi007 ceph-mon[31221]: pgmap v126: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:48:38.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:38 smithi044 ceph-mon[35072]: pgmap v126: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:48:40.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:40 smithi175 ceph-mon[35688]: pgmap v127: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:48:40.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:40 smithi007 ceph-mon[31221]: pgmap v127: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:48:40.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:40 smithi044 ceph-mon[35072]: pgmap v127: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:48:42.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:42 smithi175 ceph-mon[35688]: pgmap v128: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:48:42.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:42 smithi007 ceph-mon[31221]: pgmap v128: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:48:42.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:42 smithi044 ceph-mon[35072]: pgmap v128: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:48:44.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:44 smithi175 ceph-mon[35688]: pgmap v129: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:48:44.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:44 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:44.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:44 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:44.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:44 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:44.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:44 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:48:44.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:44 smithi007 ceph-mon[31221]: pgmap v129: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:48:44.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:44 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:44.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:44 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:44.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:44 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:44.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:44 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:48:44.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:44 smithi044 ceph-mon[35072]: pgmap v129: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:48:44.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:44 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:44.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:44 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:44.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:44 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:44.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:44 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:48:46.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:46 smithi175 ceph-mon[35688]: pgmap v130: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T08:48:46.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:46 smithi007 ceph-mon[31221]: pgmap v130: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T08:48:46.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:46 smithi044 ceph-mon[35072]: pgmap v130: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T08:48:48.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:48 smithi175 ceph-mon[35688]: pgmap v131: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:48:48.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:48 smithi007 ceph-mon[31221]: pgmap v131: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:48:48.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:48 smithi044 ceph-mon[35072]: pgmap v131: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:48:50.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:50 smithi175 ceph-mon[35688]: pgmap v132: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T08:48:50.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:50 smithi007 ceph-mon[31221]: pgmap v132: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T08:48:50.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:50 smithi044 ceph-mon[35072]: pgmap v132: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T08:48:52.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:52 smithi007 ceph-mon[31221]: pgmap v133: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T08:48:52.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:52 smithi044 ceph-mon[35072]: pgmap v133: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T08:48:52.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:52 smithi175 ceph-mon[35688]: pgmap v133: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T08:48:54.161 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:48:54.432 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:54.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:54 smithi007 ceph-mon[31221]: pgmap v134: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:48:54.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:54 smithi044 ceph-mon[35072]: pgmap v134: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:48:54.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.903+0000 7f51a5867640 1 -- 172.21.15.7:0/1562750982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51a0103650 msgr2=0x7f51a010bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:54.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.903+0000 7f51a5867640 1 --2- 172.21.15.7:0/1562750982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51a0103650 0x7f51a010bb40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5194009ca0 tx=0x7f519402a950 comp rx=0 tx=0).stop 2024-09-19T08:48:54.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.903+0000 7f51a5867640 1 -- 172.21.15.7:0/1562750982 shutdown_connections 2024-09-19T08:48:54.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.903+0000 7f51a5867640 1 --2- 172.21.15.7:0/1562750982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51a010c160 0x7f51a010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.903+0000 7f51a5867640 1 --2- 172.21.15.7:0/1562750982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51a0103650 0x7f51a010bb40 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.903+0000 7f51a5867640 1 --2- 172.21.15.7:0/1562750982 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51a0102d30 0x7f51a0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.903+0000 7f51a5867640 1 -- 172.21.15.7:0/1562750982 >> 172.21.15.7:0/1562750982 conn(0x7f51a00fc790 msgr2=0x7f51a00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:54.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.903+0000 7f51a5867640 1 -- 172.21.15.7:0/1562750982 shutdown_connections 2024-09-19T08:48:54.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.903+0000 7f51a5867640 1 -- 172.21.15.7:0/1562750982 wait complete. 2024-09-19T08:48:54.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.903+0000 7f51a5867640 1 Processor -- start 2024-09-19T08:48:54.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.904+0000 7f51a5867640 1 -- start start 2024-09-19T08:48:54.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.904+0000 7f51a5867640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51a0102d30 0x7f51a0100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:54.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.904+0000 7f51a5867640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51a0103650 0x7f51a0100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:54.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.904+0000 7f51a5867640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51a010c160 0x7f51a0101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:54.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.904+0000 7f51a5867640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f51a0111f60 con 0x7f51a0103650 2024-09-19T08:48:54.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.904+0000 7f51a5867640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f51a0111de0 con 0x7f51a0102d30 2024-09-19T08:48:54.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.904+0000 7f51a5867640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f51a01120e0 con 0x7f51a010c160 2024-09-19T08:48:54.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.904+0000 7f519e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51a0103650 0x7f51a0100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:54.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.904+0000 7f519e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51a0103650 0x7f51a0100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57034/0 (socket says 172.21.15.7:57034) 2024-09-19T08:48:54.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.904+0000 7f519e7fc640 1 -- 172.21.15.7:0/2046672243 learned_addr learned my addr 172.21.15.7:0/2046672243 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:54.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.904+0000 7f519f7fe640 1 --2- 172.21.15.7:0/2046672243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51a010c160 0x7f51a0101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:54.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.904+0000 7f519effd640 1 --2- 172.21.15.7:0/2046672243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51a0102d30 0x7f51a0100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:54.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.904+0000 7f519e7fc640 1 -- 172.21.15.7:0/2046672243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51a010c160 msgr2=0x7f51a0101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:54.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.905+0000 7f519e7fc640 1 --2- 172.21.15.7:0/2046672243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51a010c160 0x7f51a0101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.905+0000 7f519e7fc640 1 -- 172.21.15.7:0/2046672243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51a0102d30 msgr2=0x7f51a0100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:54.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.905+0000 7f519e7fc640 1 --2- 172.21.15.7:0/2046672243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51a0102d30 0x7f51a0100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.905+0000 7f519e7fc640 1 -- 172.21.15.7:0/2046672243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a01a6940 con 0x7f51a0103650 2024-09-19T08:48:54.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.905+0000 7f519e7fc640 1 --2- 172.21.15.7:0/2046672243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51a0103650 0x7f51a0100ed0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5194005cc0 tx=0x7f519402f630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:54.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.905+0000 7f51a4865640 1 -- 172.21.15.7:0/2046672243 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5194034040 con 0x7f51a0103650 2024-09-19T08:48:54.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.905+0000 7f51a5867640 1 -- 172.21.15.7:0/2046672243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a01a6bd0 con 0x7f51a0103650 2024-09-19T08:48:54.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.905+0000 7f51a4865640 1 -- 172.21.15.7:0/2046672243 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5194030920 con 0x7f51a0103650 2024-09-19T08:48:54.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.905+0000 7f51a4865640 1 -- 172.21.15.7:0/2046672243 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5194004780 con 0x7f51a0103650 2024-09-19T08:48:54.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.905+0000 7f51a5867640 1 -- 172.21.15.7:0/2046672243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a01a7100 con 0x7f51a0103650 2024-09-19T08:48:54.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.908+0000 7f51a7c40740 1 Processor -- start 2024-09-19T08:48:54.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.908+0000 7f51a7c40740 1 -- start start 2024-09-19T08:48:54.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.908+0000 7f51a7c40740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe652334a0 0x55fe65233880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:54.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.908+0000 7f51a7c40740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe65233dc0 0x55fe6523e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:54.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.908+0000 7f51a4865640 1 -- 172.21.15.7:0/2046672243 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f5194037020 con 0x7f51a0103650 2024-09-19T08:48:54.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.908+0000 7f51a7c40740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe6523e680 0x55fe65240a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:54.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.908+0000 7f51a7c40740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fe651992e0 con 0x55fe6523e680 2024-09-19T08:48:54.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.908+0000 7f51a7c40740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fe65140ce0 con 0x55fe652334a0 2024-09-19T08:48:54.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.908+0000 7f51a7c40740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fe651952a0 con 0x55fe65233dc0 2024-09-19T08:48:54.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.908+0000 7f519e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe6523e680 0x55fe65240a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:54.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.908+0000 7f519f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe652334a0 0x55fe65233880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:54.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.908+0000 7f519e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe6523e680 0x55fe65240a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57044/0 (socket says 172.21.15.7:57044) 2024-09-19T08:48:54.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.908+0000 7f519f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe652334a0 0x55fe65233880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:36554/0 (socket says 172.21.15.7:36554) 2024-09-19T08:48:54.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.908+0000 7f519e7fc640 1 -- 172.21.15.7:0/3064727208 learned_addr learned my addr 172.21.15.7:0/3064727208 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:54.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.908+0000 7f519effd640 1 --2- 172.21.15.7:0/3064727208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe65233dc0 0x55fe6523e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:54.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.909+0000 7f519effd640 1 -- 172.21.15.7:0/3064727208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe652334a0 msgr2=0x55fe65233880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:54.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.909+0000 7f519effd640 1 --2- 172.21.15.7:0/3064727208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe652334a0 0x55fe65233880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.909+0000 7f519effd640 1 -- 172.21.15.7:0/3064727208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe6523e680 msgr2=0x55fe65240a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:54.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.909+0000 7f519effd640 1 --2- 172.21.15.7:0/3064727208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe6523e680 0x55fe65240a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.909+0000 7f519effd640 1 -- 172.21.15.7:0/3064727208 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe65125440 con 0x55fe65233dc0 2024-09-19T08:48:54.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.909+0000 7f51a4865640 1 --2- 172.21.15.7:0/2046672243 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f51880a33b0 0x7f51880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:54.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.909+0000 7f519effd640 1 --2- 172.21.15.7:0/3064727208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe65233dc0 0x55fe6523e140 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f519000ab40 tx=0x7f519000f3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cabaf85247372bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:54.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.909+0000 7f519f7fe640 1 --2- 172.21.15.7:0/2046672243 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f51880a33b0 0x7f51880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:54.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.909+0000 7f51a4865640 1 -- 172.21.15.7:0/2046672243 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f51940f0a20 con 0x7f51a0103650 2024-09-19T08:48:54.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.909+0000 7f5185ffb640 1 -- 172.21.15.7:0/3064727208 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5190004020 con 0x55fe65233dc0 2024-09-19T08:48:54.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.909+0000 7f5185ffb640 1 -- 172.21.15.7:0/3064727208 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51900041c0 con 0x55fe65233dc0 2024-09-19T08:48:54.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.909+0000 7f5185ffb640 1 -- 172.21.15.7:0/3064727208 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5190018800 con 0x55fe65233dc0 2024-09-19T08:48:54.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.910+0000 7f51a7c40740 1 -- 172.21.15.7:0/3064727208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe65233dc0 msgr2=0x55fe6523e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:54.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.910+0000 7f519f7fe640 1 --2- 172.21.15.7:0/2046672243 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f51880a33b0 0x7f51880a5870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f519800b6c0 tx=0x7f519800b2e0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:54.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.910+0000 7f51a7c40740 1 --2- 172.21.15.7:0/3064727208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe65233dc0 0x55fe6523e140 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f519000ab40 tx=0x7f519000f3c0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.910+0000 7f51a7c40740 1 -- 172.21.15.7:0/3064727208 shutdown_connections 2024-09-19T08:48:54.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.910+0000 7f51a7c40740 1 --2- 172.21.15.7:0/3064727208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe6523e680 0x55fe65240a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.910+0000 7f51a7c40740 1 --2- 172.21.15.7:0/3064727208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe65233dc0 0x55fe6523e140 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.910+0000 7f51a7c40740 1 --2- 172.21.15.7:0/3064727208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe652334a0 0x55fe65233880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.910+0000 7f51a7c40740 1 -- 172.21.15.7:0/3064727208 >> 172.21.15.7:0/3064727208 conn(0x55fe6522fa30 msgr2=0x55fe6522fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:54.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.910+0000 7f51a7c40740 1 -- 172.21.15.7:0/3064727208 shutdown_connections 2024-09-19T08:48:54.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.910+0000 7f51a7c40740 1 -- 172.21.15.7:0/3064727208 wait complete. 2024-09-19T08:48:54.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.910+0000 7f51a7c40740 1 -- start start 2024-09-19T08:48:54.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.911+0000 7f51a7c40740 1 Processor -- start 2024-09-19T08:48:54.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.911+0000 7f51a7c40740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe652334a0 0x55fe6523df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:54.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.911+0000 7f51a7c40740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe65233dc0 0x55fe6523b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:54.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.911+0000 7f51a7c40740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe6523e680 0x55fe6523b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:54.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.911+0000 7f51a7c40740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fe65241250 con 0x55fe652334a0 2024-09-19T08:48:54.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.911+0000 7f51a7c40740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fe65154050 con 0x55fe65233dc0 2024-09-19T08:48:54.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.911+0000 7f51a7c40740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fe652413d0 con 0x55fe6523e680 2024-09-19T08:48:54.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.911+0000 7f51a7c40740 10 client.0 _ll_register_callbacks cb 0x55fe65194160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:54.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.911+0000 7f519effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe652334a0 0x55fe6523df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:54.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.911+0000 7f519effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe652334a0 0x55fe6523df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57048/0 (socket says 172.21.15.7:57048) 2024-09-19T08:48:54.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.911+0000 7f519effd640 1 -- 172.21.15.7:0/2376501577 learned_addr learned my addr 172.21.15.7:0/2376501577 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:54.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.911+0000 7f519e7fc640 1 --2- 172.21.15.7:0/2376501577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe65233dc0 0x55fe6523b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:54.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.911+0000 7f519f7fe640 1 --2- 172.21.15.7:0/2376501577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe6523e680 0x55fe6523b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:54.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.911+0000 7f519effd640 1 -- 172.21.15.7:0/2376501577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe6523e680 msgr2=0x55fe6523b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:54.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.911+0000 7f519effd640 1 --2- 172.21.15.7:0/2376501577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe6523e680 0x55fe6523b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.911+0000 7f519effd640 1 -- 172.21.15.7:0/2376501577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe65233dc0 msgr2=0x55fe6523b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:54.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.911+0000 7f519effd640 1 --2- 172.21.15.7:0/2376501577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe65233dc0 0x55fe6523b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.912+0000 7f519effd640 1 -- 172.21.15.7:0/2376501577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe64f0a3c0 con 0x55fe652334a0 2024-09-19T08:48:54.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.912+0000 7f519f7fe640 1 --2- 172.21.15.7:0/2376501577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe6523e680 0x55fe6523b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:48:54.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.912+0000 7f519e7fc640 1 --2- 172.21.15.7:0/2376501577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe65233dc0 0x55fe6523b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:48:54.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.912+0000 7f519effd640 1 --2- 172.21.15.7:0/2376501577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe652334a0 0x55fe6523df50 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f519001a040 tx=0x7f5190003cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1209b0222d8496 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:54.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.912+0000 7f517effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:48:54.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.912+0000 7f517effd640 1 -- 172.21.15.7:0/2376501577 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5190027020 con 0x55fe652334a0 2024-09-19T08:48:54.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.912+0000 7f517effd640 1 -- 172.21.15.7:0/2376501577 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f519000fe00 con 0x55fe652334a0 2024-09-19T08:48:54.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.912+0000 7f51a7c40740 1 -- 172.21.15.7:0/2376501577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51900041c0 con 0x55fe652334a0 2024-09-19T08:48:54.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.912+0000 7f517effd640 1 -- 172.21.15.7:0/2376501577 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5190032050 con 0x55fe652334a0 2024-09-19T08:48:54.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.912+0000 7f51a7c40740 10 client.16170 fetch_fsmap learned FSMap version 25 2024-09-19T08:48:54.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.912+0000 7f51a7c40740 1 -- 172.21.15.7:0/2376501577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fe6524cbd0 con 0x55fe652334a0 2024-09-19T08:48:54.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.912+0000 7f517effd640 1 -- 172.21.15.7:0/2376501577 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51900041c0 con 0x55fe652334a0 2024-09-19T08:48:54.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.913+0000 7f517effd640 1 -- 172.21.15.7:0/2376501577 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5190004c80 con 0x55fe652334a0 2024-09-19T08:48:54.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.913+0000 7f51a7c40740 10 client.16170 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:48:54.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.913+0000 7f51a7c40740 10 client.16170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:48:54.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.913+0000 7f51a7c40740 20 client.16170 populate_metadata read hostname 'smithi007' 2024-09-19T08:48:54.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.913+0000 7f51a7c40740 1 --2- 172.21.15.7:0/2376501577 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fe6524e030 0x55fe65250420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:54.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.913+0000 7f51a7c40740 4 client.16170 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:48:54.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.913+0000 7f51a7c40740 1 -- 172.21.15.7:0/2376501577 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe651a6850 con 0x55fe6524e030 2024-09-19T08:48:54.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.913+0000 7f519e7fc640 1 --2- 172.21.15.7:0/2376501577 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fe6524e030 0x55fe65250420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:54.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.913+0000 7f519e7fc640 1 --2- 172.21.15.7:0/2376501577 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fe6524e030 0x55fe65250420 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6deac5b3e909fb06 server_cookie=7d22cc3d7a944ae1 in_seq=0 out_seq=0 2024-09-19T08:48:54.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.913+0000 7f517effd640 10 client.16170 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:48:54.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.914+0000 7f517effd640 1 -- 172.21.15.7:0/2376501577 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fe651a6850 con 0x55fe6524e030 2024-09-19T08:48:54.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.914+0000 7f517effd640 10 client.16170 handle_command_reply: tid=0 2024-09-19T08:48:54.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.914+0000 7f51a7c40740 1 client.16170 shutdown 2024-09-19T08:48:54.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.914+0000 7f51a7c40740 1 -- 172.21.15.7:0/2376501577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe652334a0 msgr2=0x55fe6523df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:54.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.914+0000 7f51a7c40740 1 --2- 172.21.15.7:0/2376501577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe652334a0 0x55fe6523df50 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f519001a040 tx=0x7f5190003cc0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.914+0000 7f51a7c40740 1 -- 172.21.15.7:0/2376501577 shutdown_connections 2024-09-19T08:48:54.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.914+0000 7f51a7c40740 1 --2- 172.21.15.7:0/2376501577 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fe6524e030 0x55fe65250420 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.914+0000 7f51a7c40740 1 --2- 172.21.15.7:0/2376501577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe6523e680 0x55fe6523b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.914+0000 7f51a7c40740 1 --2- 172.21.15.7:0/2376501577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe65233dc0 0x55fe6523b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.914+0000 7f51a7c40740 1 --2- 172.21.15.7:0/2376501577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe652334a0 0x55fe6523df50 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.914+0000 7f51a7c40740 1 -- 172.21.15.7:0/2376501577 >> 172.21.15.7:0/2376501577 conn(0x55fe6522fa30 msgr2=0x55fe65235710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:54.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.914+0000 7f517effd640 0 client.16170 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:48:54.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.914+0000 7f51a7c40740 1 -- 172.21.15.7:0/2376501577 shutdown_connections 2024-09-19T08:48:54.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.914+0000 7f51a7c40740 1 -- 172.21.15.7:0/2376501577 wait complete. 2024-09-19T08:48:54.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.915+0000 7f51a7c40740 20 client.16170 trim_cache size 0 max 16384 2024-09-19T08:48:54.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:54 smithi175 ceph-mon[35688]: pgmap v134: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:48:54.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.932+0000 7f51a7c40740 1 Processor -- start 2024-09-19T08:48:54.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.932+0000 7f51a7c40740 1 -- start start 2024-09-19T08:48:54.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.933+0000 7f51a7c40740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe652334a0 0x55fe65239ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:54.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.933+0000 7f51a7c40740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe65233dc0 0x55fe65255a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:54.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.933+0000 7f51a7c40740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe6523e680 0x55fe65255fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:54.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.933+0000 7f51a7c40740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f51a01b2380 con 0x55fe65233dc0 2024-09-19T08:48:54.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.933+0000 7f51a7c40740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f51a01afc50 con 0x55fe6523e680 2024-09-19T08:48:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.933+0000 7f51a7c40740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f51a01adaa0 con 0x55fe652334a0 2024-09-19T08:48:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.933+0000 7f519e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe65233dc0 0x55fe65255a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.933+0000 7f519e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe65233dc0 0x55fe65255a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57056/0 (socket says 172.21.15.7:57056) 2024-09-19T08:48:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.933+0000 7f519e7fc640 1 -- 172.21.15.7:0/1066982214 learned_addr learned my addr 172.21.15.7:0/1066982214 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.933+0000 7f519effd640 1 --2- 172.21.15.7:0/1066982214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe652334a0 0x55fe65239ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.933+0000 7f519f7fe640 1 --2- 172.21.15.7:0/1066982214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe6523e680 0x55fe65255fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.933+0000 7f519e7fc640 1 -- 172.21.15.7:0/1066982214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe652334a0 msgr2=0x55fe65239ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.933+0000 7f519e7fc640 1 --2- 172.21.15.7:0/1066982214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe652334a0 0x55fe65239ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.933+0000 7f519e7fc640 1 -- 172.21.15.7:0/1066982214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe6523e680 msgr2=0x55fe65255fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.933+0000 7f519e7fc640 1 --2- 172.21.15.7:0/1066982214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe6523e680 0x55fe65255fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.933+0000 7f519e7fc640 1 -- 172.21.15.7:0/1066982214 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe6522f4d0 con 0x55fe65233dc0 2024-09-19T08:48:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.933+0000 7f519f7fe640 1 --2- 172.21.15.7:0/1066982214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe6523e680 0x55fe65255fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:48:54.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.933+0000 7f519e7fc640 1 --2- 172.21.15.7:0/1066982214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe65233dc0 0x55fe65255a80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f51940ee2d0 tx=0x7f51940f44c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc201dad507c3168 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:54.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.934+0000 7f51857fa640 1 -- 172.21.15.7:0/1066982214 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5194003e10 con 0x55fe65233dc0 2024-09-19T08:48:54.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.934+0000 7f51857fa640 1 -- 172.21.15.7:0/1066982214 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51940f9040 con 0x55fe65233dc0 2024-09-19T08:48:54.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.934+0000 7f51857fa640 1 -- 172.21.15.7:0/1066982214 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51940c5a70 con 0x55fe65233dc0 2024-09-19T08:48:54.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.934+0000 7f51a7c40740 1 -- 172.21.15.7:0/1066982214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe65233dc0 msgr2=0x55fe65255a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:54.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.934+0000 7f51a7c40740 1 --2- 172.21.15.7:0/1066982214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe65233dc0 0x55fe65255a80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f51940ee2d0 tx=0x7f51940f44c0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.934+0000 7f51a7c40740 1 -- 172.21.15.7:0/1066982214 shutdown_connections 2024-09-19T08:48:54.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.934+0000 7f51a7c40740 1 --2- 172.21.15.7:0/1066982214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe6523e680 0x55fe65255fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.934+0000 7f51a7c40740 1 --2- 172.21.15.7:0/1066982214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe65233dc0 0x55fe65255a80 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.934+0000 7f51a7c40740 1 --2- 172.21.15.7:0/1066982214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe652334a0 0x55fe65239ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.934+0000 7f51a7c40740 1 -- 172.21.15.7:0/1066982214 >> 172.21.15.7:0/1066982214 conn(0x55fe6522fa30 msgr2=0x55fe6522ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:54.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.935+0000 7f51a7c40740 1 -- 172.21.15.7:0/1066982214 shutdown_connections 2024-09-19T08:48:54.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.935+0000 7f51a7c40740 1 -- 172.21.15.7:0/1066982214 wait complete. 2024-09-19T08:48:54.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.935+0000 7f51a7c40740 1 -- start start 2024-09-19T08:48:54.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.935+0000 7f51a7c40740 1 Processor -- start 2024-09-19T08:48:54.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.935+0000 7f51a7c40740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe652334a0 0x55fe65244330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:54.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.935+0000 7f51a7c40740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe65233dc0 0x55fe65244870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:54.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.935+0000 7f51a7c40740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe6523e680 0x55fe65244db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:54.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.936+0000 7f51a7c40740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f51a01ae110 con 0x55fe652334a0 2024-09-19T08:48:54.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.936+0000 7f51a7c40740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f51a01af580 con 0x55fe65233dc0 2024-09-19T08:48:54.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.936+0000 7f51a7c40740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f51a01ae7e0 con 0x55fe6523e680 2024-09-19T08:48:54.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.936+0000 7f519effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe652334a0 0x55fe65244330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:54.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.936+0000 7f51a7c40740 10 client.0 _ll_register_callbacks cb 0x7f51940f5040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:54.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.936+0000 7f519effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe652334a0 0x55fe65244330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57070/0 (socket says 172.21.15.7:57070) 2024-09-19T08:48:54.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.936+0000 7f519effd640 1 -- 172.21.15.7:0/3124944063 learned_addr learned my addr 172.21.15.7:0/3124944063 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:54.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.936+0000 7f519e7fc640 1 --2- 172.21.15.7:0/3124944063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe65233dc0 0x55fe65244870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:54.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.936+0000 7f519effd640 1 -- 172.21.15.7:0/3124944063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe6523e680 msgr2=0x55fe65244db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:54.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.936+0000 7f519effd640 1 --2- 172.21.15.7:0/3124944063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe6523e680 0x55fe65244db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.936+0000 7f519effd640 1 -- 172.21.15.7:0/3124944063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe65233dc0 msgr2=0x55fe65244870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:54.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.936+0000 7f519effd640 1 --2- 172.21.15.7:0/3124944063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe65233dc0 0x55fe65244870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.936+0000 7f519effd640 1 -- 172.21.15.7:0/3124944063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe652b7a60 con 0x55fe652334a0 2024-09-19T08:48:54.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.936+0000 7f519e7fc640 1 --2- 172.21.15.7:0/3124944063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe65233dc0 0x55fe65244870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:48:54.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.936+0000 7f519effd640 1 --2- 172.21.15.7:0/3124944063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe652334a0 0x55fe65244330 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f519000a3c0 tx=0x7f5190005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e9827abd471f4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:54.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.936+0000 7f517effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:48:54.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.936+0000 7f517effd640 1 -- 172.21.15.7:0/3124944063 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519003a070 con 0x55fe652334a0 2024-09-19T08:48:54.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.936+0000 7f517effd640 1 -- 172.21.15.7:0/3124944063 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f5190018780 con 0x55fe652334a0 2024-09-19T08:48:54.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.936+0000 7f51a7c40740 1 -- 172.21.15.7:0/3124944063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51940f9040 con 0x55fe652334a0 2024-09-19T08:48:54.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.937+0000 7f517effd640 1 -- 172.21.15.7:0/3124944063 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5190045050 con 0x55fe652334a0 2024-09-19T08:48:54.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.937+0000 7f51a7c40740 10 client.16176 fetch_fsmap learned FSMap version 25 2024-09-19T08:48:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.937+0000 7f51a7c40740 1 -- 172.21.15.7:0/3124944063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fe652b8cb0 con 0x55fe652334a0 2024-09-19T08:48:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.937+0000 7f517effd640 1 -- 172.21.15.7:0/3124944063 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51940f9040 con 0x55fe652334a0 2024-09-19T08:48:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.937+0000 7f517effd640 1 -- 172.21.15.7:0/3124944063 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5190004780 con 0x55fe652334a0 2024-09-19T08:48:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.937+0000 7f51a7c40740 10 client.16176 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:48:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.937+0000 7f51a7c40740 10 client.16176 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:48:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.937+0000 7f51a7c40740 20 client.16176 populate_metadata read hostname 'smithi007' 2024-09-19T08:48:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.937+0000 7f51a7c40740 1 --2- 172.21.15.7:0/3124944063 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fe652b9370 0x55fe652bb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:54.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.937+0000 7f51a7c40740 4 client.16176 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:48:54.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.937+0000 7f51a7c40740 1 -- 172.21.15.7:0/3124944063 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fe651a0d60 con 0x55fe652b9370 2024-09-19T08:48:54.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.937+0000 7f519e7fc640 1 --2- 172.21.15.7:0/3124944063 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fe652b9370 0x55fe652bb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:54.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.938+0000 7f519e7fc640 1 --2- 172.21.15.7:0/3124944063 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fe652b9370 0x55fe652bb7d0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24a45162ad2596db server_cookie=6988fbaf9a68579 in_seq=0 out_seq=0 2024-09-19T08:48:54.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.938+0000 7f517effd640 10 client.16176 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:48:54.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.938+0000 7f517effd640 1 -- 172.21.15.7:0/3124944063 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55fe651a0d60 con 0x55fe652b9370 2024-09-19T08:48:54.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.938+0000 7f517effd640 10 client.16176 handle_command_reply: tid=0 2024-09-19T08:48:54.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.938+0000 7f51a7c40740 1 client.16176 shutdown 2024-09-19T08:48:54.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.938+0000 7f51a7c40740 1 -- 172.21.15.7:0/3124944063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe652334a0 msgr2=0x55fe65244330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:54.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.938+0000 7f51a7c40740 1 --2- 172.21.15.7:0/3124944063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe652334a0 0x55fe65244330 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f519000a3c0 tx=0x7f5190005e10 comp rx=0 tx=0).stop 2024-09-19T08:48:54.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.938+0000 7f51a7c40740 1 -- 172.21.15.7:0/3124944063 shutdown_connections 2024-09-19T08:48:54.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.938+0000 7f51a7c40740 1 --2- 172.21.15.7:0/3124944063 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fe652b9370 0x55fe652bb7d0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.938+0000 7f51a7c40740 1 --2- 172.21.15.7:0/3124944063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe6523e680 0x55fe65244db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.938+0000 7f51a7c40740 1 --2- 172.21.15.7:0/3124944063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe65233dc0 0x55fe65244870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.938+0000 7f51a7c40740 1 --2- 172.21.15.7:0/3124944063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe652334a0 0x55fe65244330 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.938+0000 7f51a7c40740 1 -- 172.21.15.7:0/3124944063 >> 172.21.15.7:0/3124944063 conn(0x55fe6522fa30 msgr2=0x55fe6523ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:54.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.938+0000 7f517effd640 0 client.16176 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:48:54.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.938+0000 7f51a7c40740 1 -- 172.21.15.7:0/3124944063 shutdown_connections 2024-09-19T08:48:54.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.938+0000 7f51a7c40740 1 -- 172.21.15.7:0/3124944063 wait complete. 2024-09-19T08:48:54.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.938+0000 7f51a7c40740 20 client.16176 trim_cache size 0 max 16384 2024-09-19T08:48:54.946 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:48:54.946 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-19T08:48:54.946 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-09-19T08:48:54.946 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:48:54.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.939+0000 7f51a5867640 1 -- 172.21.15.7:0/2046672243 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f51880a33b0 msgr2=0x7f51880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:54.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.939+0000 7f51a5867640 1 --2- 172.21.15.7:0/2046672243 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f51880a33b0 0x7f51880a5870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f519800b6c0 tx=0x7f519800b2e0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.939+0000 7f51a5867640 1 -- 172.21.15.7:0/2046672243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51a0103650 msgr2=0x7f51a0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:54.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.939+0000 7f51a5867640 1 --2- 172.21.15.7:0/2046672243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51a0103650 0x7f51a0100ed0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5194005cc0 tx=0x7f519402f630 comp rx=0 tx=0).stop 2024-09-19T08:48:54.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.939+0000 7f51a5867640 1 -- 172.21.15.7:0/2046672243 shutdown_connections 2024-09-19T08:48:54.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.939+0000 7f51a5867640 1 --2- 172.21.15.7:0/2046672243 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f51880a33b0 0x7f51880a5870 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.939+0000 7f51a5867640 1 --2- 172.21.15.7:0/2046672243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51a010c160 0x7f51a0101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.939+0000 7f51a5867640 1 --2- 172.21.15.7:0/2046672243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51a0103650 0x7f51a0100ed0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.939+0000 7f51a5867640 1 --2- 172.21.15.7:0/2046672243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51a0102d30 0x7f51a0100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:54.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.939+0000 7f51a5867640 1 -- 172.21.15.7:0/2046672243 >> 172.21.15.7:0/2046672243 conn(0x7f51a00fc790 msgr2=0x7f51a00fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:54.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.939+0000 7f51a5867640 1 -- 172.21.15.7:0/2046672243 shutdown_connections 2024-09-19T08:48:54.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:54.939+0000 7f51a5867640 1 -- 172.21.15.7:0/2046672243 wait complete. 2024-09-19T08:48:55.882 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:48:55.882 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:48:56.146 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:56.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.634+0000 7f7151b0b640 1 -- 172.21.15.7:0/1702593966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f714c102df0 msgr2=0x7f714c1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:56.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.634+0000 7f7151b0b640 1 --2- 172.21.15.7:0/1702593966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f714c102df0 0x7f714c1031d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f713c009900 tx=0x7f713c02a410 comp rx=0 tx=0).stop 2024-09-19T08:48:56.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.634+0000 7f7151b0b640 1 -- 172.21.15.7:0/1702593966 shutdown_connections 2024-09-19T08:48:56.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.634+0000 7f7151b0b640 1 --2- 172.21.15.7:0/1702593966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f714c10c2f0 0x7f714c10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:56.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.634+0000 7f7151b0b640 1 --2- 172.21.15.7:0/1702593966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f714c1037a0 0x7f714c10bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:56.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.634+0000 7f7151b0b640 1 --2- 172.21.15.7:0/1702593966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f714c102df0 0x7f714c1031d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:56.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.634+0000 7f7151b0b640 1 -- 172.21.15.7:0/1702593966 >> 172.21.15.7:0/1702593966 conn(0x7f714c0fc7d0 msgr2=0x7f714c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:56.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.634+0000 7f7151b0b640 1 -- 172.21.15.7:0/1702593966 shutdown_connections 2024-09-19T08:48:56.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.634+0000 7f7151b0b640 1 -- 172.21.15.7:0/1702593966 wait complete. 2024-09-19T08:48:56.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.635+0000 7f7151b0b640 1 Processor -- start 2024-09-19T08:48:56.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.635+0000 7f7151b0b640 1 -- start start 2024-09-19T08:48:56.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.635+0000 7f7151b0b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f714c102df0 0x7f714c100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:56.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.635+0000 7f7151b0b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f714c1037a0 0x7f714c100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:56.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.635+0000 7f7151b0b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f714c10c2f0 0x7f714c1014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:56.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.635+0000 7f7151b0b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f714c112110 con 0x7f714c102df0 2024-09-19T08:48:56.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.635+0000 7f7151b0b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f714c111f90 con 0x7f714c1037a0 2024-09-19T08:48:56.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.635+0000 7f7151b0b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f714c112290 con 0x7f714c10c2f0 2024-09-19T08:48:56.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.636+0000 7f714b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f714c102df0 0x7f714c100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:56.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.636+0000 7f714b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f714c102df0 0x7f714c100a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57078/0 (socket says 172.21.15.7:57078) 2024-09-19T08:48:56.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.636+0000 7f714b7fe640 1 -- 172.21.15.7:0/4251874776 learned_addr learned my addr 172.21.15.7:0/4251874776 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:56.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.636+0000 7f714affd640 1 --2- 172.21.15.7:0/4251874776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f714c1037a0 0x7f714c100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:56.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.636+0000 7f714bfff640 1 --2- 172.21.15.7:0/4251874776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f714c10c2f0 0x7f714c1014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:56.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.636+0000 7f714b7fe640 1 -- 172.21.15.7:0/4251874776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f714c10c2f0 msgr2=0x7f714c1014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:56.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.636+0000 7f714b7fe640 1 --2- 172.21.15.7:0/4251874776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f714c10c2f0 0x7f714c1014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:56.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.636+0000 7f714b7fe640 1 -- 172.21.15.7:0/4251874776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f714c1037a0 msgr2=0x7f714c100f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:56.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.636+0000 7f714b7fe640 1 --2- 172.21.15.7:0/4251874776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f714c1037a0 0x7f714c100f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:56.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.636+0000 7f714b7fe640 1 -- 172.21.15.7:0/4251874776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f714c1a6ad0 con 0x7f714c102df0 2024-09-19T08:48:56.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.636+0000 7f714b7fe640 1 --2- 172.21.15.7:0/4251874776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f714c102df0 0x7f714c100a50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f713c006010 tx=0x7f713c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:56.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.636+0000 7f7148ff9640 1 -- 172.21.15.7:0/4251874776 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c03f030 con 0x7f714c102df0 2024-09-19T08:48:56.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.636+0000 7f7148ff9640 1 -- 172.21.15.7:0/4251874776 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f713c004440 con 0x7f714c102df0 2024-09-19T08:48:56.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.636+0000 7f7151b0b640 1 -- 172.21.15.7:0/4251874776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f714c1a6d60 con 0x7f714c102df0 2024-09-19T08:48:56.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.636+0000 7f7148ff9640 1 -- 172.21.15.7:0/4251874776 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c035070 con 0x7f714c102df0 2024-09-19T08:48:56.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.636+0000 7f7151b0b640 1 -- 172.21.15.7:0/4251874776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f714c1a71e0 con 0x7f714c102df0 2024-09-19T08:48:56.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.638+0000 7f7151b0b640 1 -- 172.21.15.7:0/4251874776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f714c1031d0 con 0x7f714c102df0 2024-09-19T08:48:56.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.639+0000 7f7148ff9640 1 -- 172.21.15.7:0/4251874776 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f713c042030 con 0x7f714c102df0 2024-09-19T08:48:56.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.639+0000 7f7148ff9640 1 --2- 172.21.15.7:0/4251874776 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f71340a33b0 0x7f71340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:56.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.639+0000 7f7148ff9640 1 -- 172.21.15.7:0/4251874776 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f713c0f0070 con 0x7f714c102df0 2024-09-19T08:48:56.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.640+0000 7f714affd640 1 --2- 172.21.15.7:0/4251874776 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f71340a33b0 0x7f71340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:56.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.640+0000 7f714affd640 1 --2- 172.21.15.7:0/4251874776 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f71340a33b0 0x7f71340a5870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f714c1024e0 tx=0x7f7140005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:56.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.644+0000 7f7148ff9640 1 -- 172.21.15.7:0/4251874776 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f713c0bc3f0 con 0x7f714c102df0 2024-09-19T08:48:56.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:56 smithi007 ceph-mon[31221]: pgmap v135: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:48:56.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:56 smithi044 ceph-mon[35072]: pgmap v135: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:48:56.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.855+0000 7f7151b0b640 1 -- 172.21.15.7:0/4251874776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f714c1072c0 con 0x7f714c102df0 2024-09-19T08:48:56.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.856+0000 7f7148ff9640 1 -- 172.21.15.7:0/4251874776 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f713c0c06f0 con 0x7f714c102df0 2024-09-19T08:48:56.856 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:48:56.856 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:48:56.856 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:48:56.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.858+0000 7f7151b0b640 1 -- 172.21.15.7:0/4251874776 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f71340a33b0 msgr2=0x7f71340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:56.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.858+0000 7f7151b0b640 1 --2- 172.21.15.7:0/4251874776 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f71340a33b0 0x7f71340a5870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f714c1024e0 tx=0x7f7140005f90 comp rx=0 tx=0).stop 2024-09-19T08:48:56.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.858+0000 7f7151b0b640 1 -- 172.21.15.7:0/4251874776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f714c102df0 msgr2=0x7f714c100a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:56.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.858+0000 7f7151b0b640 1 --2- 172.21.15.7:0/4251874776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f714c102df0 0x7f714c100a50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f713c006010 tx=0x7f713c004040 comp rx=0 tx=0).stop 2024-09-19T08:48:56.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.858+0000 7f7151b0b640 1 -- 172.21.15.7:0/4251874776 shutdown_connections 2024-09-19T08:48:56.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.858+0000 7f7151b0b640 1 --2- 172.21.15.7:0/4251874776 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f71340a33b0 0x7f71340a5870 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:56.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.858+0000 7f7151b0b640 1 --2- 172.21.15.7:0/4251874776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f714c10c2f0 0x7f714c1014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:56.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.858+0000 7f7151b0b640 1 --2- 172.21.15.7:0/4251874776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f714c1037a0 0x7f714c100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:56.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.858+0000 7f7151b0b640 1 --2- 172.21.15.7:0/4251874776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f714c102df0 0x7f714c100a50 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:56.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.858+0000 7f7151b0b640 1 -- 172.21.15.7:0/4251874776 >> 172.21.15.7:0/4251874776 conn(0x7f714c0fc7d0 msgr2=0x7f714c0fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:56.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.858+0000 7f7151b0b640 1 -- 172.21.15.7:0/4251874776 shutdown_connections 2024-09-19T08:48:56.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:56.858+0000 7f7151b0b640 1 -- 172.21.15.7:0/4251874776 wait complete. 2024-09-19T08:48:56.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:56 smithi175 ceph-mon[35688]: pgmap v135: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:48:57.647 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:48:57.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:57 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/4251874776' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:48:57.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:57 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/4251874776' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:48:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:57.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:57 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/4251874776' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:48:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.396+0000 7f861b180640 1 -- 172.21.15.7:0/2081963260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f861410c180 msgr2=0x7f861410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.396+0000 7f861b180640 1 --2- 172.21.15.7:0/2081963260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f861410c180 0x7f861410e600 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f860c009ca0 tx=0x7f860c02a950 comp rx=0 tx=0).stop 2024-09-19T08:48:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.396+0000 7f861b180640 1 -- 172.21.15.7:0/2081963260 shutdown_connections 2024-09-19T08:48:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.396+0000 7f861b180640 1 --2- 172.21.15.7:0/2081963260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f861410c180 0x7f861410e600 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.396+0000 7f861b180640 1 --2- 172.21.15.7:0/2081963260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86141036c0 0x7f861410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.396+0000 7f861b180640 1 --2- 172.21.15.7:0/2081963260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8614102da0 0x7f8614103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.396+0000 7f861b180640 1 -- 172.21.15.7:0/2081963260 >> 172.21.15.7:0/2081963260 conn(0x7f86140fc7a0 msgr2=0x7f86140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.396+0000 7f861b180640 1 -- 172.21.15.7:0/2081963260 shutdown_connections 2024-09-19T08:48:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.396+0000 7f861b180640 1 -- 172.21.15.7:0/2081963260 wait complete. 2024-09-19T08:48:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.397+0000 7f861b180640 1 Processor -- start 2024-09-19T08:48:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.397+0000 7f861b180640 1 -- start start 2024-09-19T08:48:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.397+0000 7f861b180640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8614102da0 0x7f86141983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.397+0000 7f861b180640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86141036c0 0x7f86141988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.397+0000 7f861b180640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f861410c180 0x7f861419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.397+0000 7f861b180640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8614111f60 con 0x7f8614102da0 2024-09-19T08:48:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.397+0000 7f861b180640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8614111de0 con 0x7f861410c180 2024-09-19T08:48:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.397+0000 7f861b180640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f86141120e0 con 0x7f86141036c0 2024-09-19T08:48:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.397+0000 7f8618f1c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8614102da0 0x7f86141983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.397+0000 7f8618f1c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8614102da0 0x7f86141983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57090/0 (socket says 172.21.15.7:57090) 2024-09-19T08:48:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.397+0000 7f8618f1c640 1 -- 172.21.15.7:0/723465347 learned_addr learned my addr 172.21.15.7:0/723465347 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.397+0000 7f861971d640 1 --2- 172.21.15.7:0/723465347 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f861410c180 0x7f861419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.397+0000 7f860bfff640 1 --2- 172.21.15.7:0/723465347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86141036c0 0x7f86141988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.397+0000 7f8618f1c640 1 -- 172.21.15.7:0/723465347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86141036c0 msgr2=0x7f86141988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.397+0000 7f8618f1c640 1 --2- 172.21.15.7:0/723465347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86141036c0 0x7f86141988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.397+0000 7f8618f1c640 1 -- 172.21.15.7:0/723465347 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f861410c180 msgr2=0x7f861419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.397+0000 7f8618f1c640 1 --2- 172.21.15.7:0/723465347 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f861410c180 0x7f861419cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.397+0000 7f8618f1c640 1 -- 172.21.15.7:0/723465347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861419d350 con 0x7f8614102da0 2024-09-19T08:48:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.397+0000 7f861971d640 1 --2- 172.21.15.7:0/723465347 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f861410c180 0x7f861419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:48:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.397+0000 7f860bfff640 1 --2- 172.21.15.7:0/723465347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86141036c0 0x7f86141988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:48:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.398+0000 7f8618f1c640 1 --2- 172.21.15.7:0/723465347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8614102da0 0x7f86141983a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f861000d950 tx=0x7f861000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.398+0000 7f8609ffb640 1 -- 172.21.15.7:0/723465347 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8610017030 con 0x7f8614102da0 2024-09-19T08:48:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.398+0000 7f8609ffb640 1 -- 172.21.15.7:0/723465347 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8610004020 con 0x7f8614102da0 2024-09-19T08:48:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.398+0000 7f861b180640 1 -- 172.21.15.7:0/723465347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f861419d640 con 0x7f8614102da0 2024-09-19T08:48:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.398+0000 7f8609ffb640 1 -- 172.21.15.7:0/723465347 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86100047a0 con 0x7f8614102da0 2024-09-19T08:48:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.398+0000 7f861b180640 1 -- 172.21.15.7:0/723465347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86141a4f20 con 0x7f8614102da0 2024-09-19T08:48:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.400+0000 7f8609ffb640 1 -- 172.21.15.7:0/723465347 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f86100041d0 con 0x7f8614102da0 2024-09-19T08:48:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.400+0000 7f861d559740 1 Processor -- start 2024-09-19T08:48:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.400+0000 7f861d559740 1 -- start start 2024-09-19T08:48:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.401+0000 7f861d559740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32dcb40 0x5606c32db090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.401+0000 7f8609ffb640 1 --2- 172.21.15.7:0/723465347 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f85fc0a33b0 0x7f85fc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.401+0000 7f861d559740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606c32db5d0 0x5606c32dba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.401+0000 7f861d559740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606c32e6370 0x5606c32e8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.401+0000 7f861d559740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5606c32412f0 con 0x5606c32dcb40 2024-09-19T08:48:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.401+0000 7f861d559740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5606c31e8cf0 con 0x5606c32db5d0 2024-09-19T08:48:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.401+0000 7f861d559740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5606c323d2b0 con 0x5606c32e6370 2024-09-19T08:48:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.401+0000 7f861971d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32dcb40 0x5606c32db090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.401+0000 7f8618f1c640 1 --2- 172.21.15.7:0/723465347 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f85fc0a33b0 0x7f85fc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.401+0000 7f861971d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32dcb40 0x5606c32db090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57094/0 (socket says 172.21.15.7:57094) 2024-09-19T08:48:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.401+0000 7f861971d640 1 -- 172.21.15.7:0/3092802110 learned_addr learned my addr 172.21.15.7:0/3092802110 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.401+0000 7f8609ffb640 1 -- 172.21.15.7:0/723465347 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f86100cf7d0 con 0x7f8614102da0 2024-09-19T08:48:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.401+0000 7f860bfff640 1 --2- 172.21.15.7:0/3092802110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606c32db5d0 0x5606c32dba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.401+0000 7f861971d640 1 --2- 172.21.15.7:0/3092802110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606c32e6370 0x5606c32e8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.401+0000 7f861971d640 1 -- 172.21.15.7:0/3092802110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606c32e6370 msgr2=0x5606c32e8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.401+0000 7f861971d640 1 --2- 172.21.15.7:0/3092802110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606c32e6370 0x5606c32e8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.401+0000 7f861971d640 1 -- 172.21.15.7:0/3092802110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606c32db5d0 msgr2=0x5606c32dba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.401+0000 7f861971d640 1 --2- 172.21.15.7:0/3092802110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606c32db5d0 0x5606c32dba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.401+0000 7f861971d640 1 -- 172.21.15.7:0/3092802110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606c31cd3a0 con 0x5606c32dcb40 2024-09-19T08:48:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.401+0000 7f8618f1c640 1 --2- 172.21.15.7:0/723465347 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f85fc0a33b0 0x7f85fc0a5870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f86100cd510 tx=0x7f8610090f30 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.401+0000 7f861971d640 1 --2- 172.21.15.7:0/3092802110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32dcb40 0x5606c32db090 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f860c030040 tx=0x7f860c009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5386c7821d0e8dda server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.402+0000 7f85faffd640 1 -- 172.21.15.7:0/3092802110 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c034050 con 0x5606c32dcb40 2024-09-19T08:48:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.402+0000 7f85faffd640 1 -- 172.21.15.7:0/3092802110 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f860c003e50 con 0x5606c32dcb40 2024-09-19T08:48:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.402+0000 7f85faffd640 1 -- 172.21.15.7:0/3092802110 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c004720 con 0x5606c32dcb40 2024-09-19T08:48:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.402+0000 7f861d559740 1 -- 172.21.15.7:0/3092802110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32dcb40 msgr2=0x5606c32db090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.402+0000 7f861d559740 1 --2- 172.21.15.7:0/3092802110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32dcb40 0x5606c32db090 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f860c030040 tx=0x7f860c009360 comp rx=0 tx=0).stop 2024-09-19T08:48:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.402+0000 7f861d559740 1 -- 172.21.15.7:0/3092802110 shutdown_connections 2024-09-19T08:48:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.402+0000 7f861d559740 1 --2- 172.21.15.7:0/3092802110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606c32e6370 0x5606c32e8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.402+0000 7f861d559740 1 --2- 172.21.15.7:0/3092802110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606c32db5d0 0x5606c32dba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.402+0000 7f861d559740 1 --2- 172.21.15.7:0/3092802110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32dcb40 0x5606c32db090 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.402+0000 7f861d559740 1 -- 172.21.15.7:0/3092802110 >> 172.21.15.7:0/3092802110 conn(0x5606c32a4310 msgr2=0x5606c32d7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.402+0000 7f861d559740 1 -- 172.21.15.7:0/3092802110 shutdown_connections 2024-09-19T08:48:58.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.403+0000 7f861d559740 1 -- 172.21.15.7:0/3092802110 wait complete. 2024-09-19T08:48:58.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.403+0000 7f861d559740 1 -- start start 2024-09-19T08:48:58.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.403+0000 7f861d559740 1 Processor -- start 2024-09-19T08:48:58.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.403+0000 7f861d559740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32db5d0 0x5606c32e5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:58.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.403+0000 7f861d559740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606c32dcb40 0x5606c32e2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:58.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.403+0000 7f861d559740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606c32e6370 0x5606c32e3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:58.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.403+0000 7f861d559740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5606c32e9010 con 0x5606c32db5d0 2024-09-19T08:48:58.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.403+0000 7f861d559740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5606c31fc060 con 0x5606c32dcb40 2024-09-19T08:48:58.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.403+0000 7f861d559740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5606c32e9190 con 0x5606c32e6370 2024-09-19T08:48:58.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.403+0000 7f861d559740 10 client.0 _ll_register_callbacks cb 0x5606c2f4f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:58.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.403+0000 7f861971d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32db5d0 0x5606c32e5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:58.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.403+0000 7f861971d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32db5d0 0x5606c32e5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57102/0 (socket says 172.21.15.7:57102) 2024-09-19T08:48:58.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.403+0000 7f861971d640 1 -- 172.21.15.7:0/3318318857 learned_addr learned my addr 172.21.15.7:0/3318318857 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:58.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.404+0000 7f860bfff640 1 --2- 172.21.15.7:0/3318318857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606c32dcb40 0x5606c32e2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:58.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.404+0000 7f861971d640 1 --2- 172.21.15.7:0/3318318857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606c32e6370 0x5606c32e3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:58.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.404+0000 7f861971d640 1 -- 172.21.15.7:0/3318318857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606c32e6370 msgr2=0x5606c32e3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:58.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.404+0000 7f861971d640 1 --2- 172.21.15.7:0/3318318857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606c32e6370 0x5606c32e3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.404+0000 7f861971d640 1 -- 172.21.15.7:0/3318318857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606c32dcb40 msgr2=0x5606c32e2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:58.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.404+0000 7f861971d640 1 --2- 172.21.15.7:0/3318318857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606c32dcb40 0x5606c32e2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.404+0000 7f861971d640 1 -- 172.21.15.7:0/3318318857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606c2fb23c0 con 0x5606c32db5d0 2024-09-19T08:48:58.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.404+0000 7f861971d640 1 --2- 172.21.15.7:0/3318318857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32db5d0 0x5606c32e5d00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f860c005fc0 tx=0x7f860c004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754a67abfa90bc46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:58.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.404+0000 7f85f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:48:58.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.404+0000 7f85f3fff640 1 -- 172.21.15.7:0/3318318857 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c051030 con 0x5606c32db5d0 2024-09-19T08:48:58.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.404+0000 7f85f3fff640 1 -- 172.21.15.7:0/3318318857 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f860c0046b0 con 0x5606c32db5d0 2024-09-19T08:48:58.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.404+0000 7f861d559740 1 -- 172.21.15.7:0/3318318857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f860c003e50 con 0x5606c32db5d0 2024-09-19T08:48:58.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.404+0000 7f85f3fff640 1 -- 172.21.15.7:0/3318318857 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f860c034070 con 0x5606c32db5d0 2024-09-19T08:48:58.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.404+0000 7f861d559740 10 client.16194 fetch_fsmap learned FSMap version 25 2024-09-19T08:48:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.404+0000 7f861d559740 1 -- 172.21.15.7:0/3318318857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5606c32e9010 con 0x5606c32db5d0 2024-09-19T08:48:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.405+0000 7f85f3fff640 1 -- 172.21.15.7:0/3318318857 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f860c003e50 con 0x5606c32db5d0 2024-09-19T08:48:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.405+0000 7f85f3fff640 1 -- 172.21.15.7:0/3318318857 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f860c047070 con 0x5606c32db5d0 2024-09-19T08:48:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.405+0000 7f861d559740 10 client.16194 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:48:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.405+0000 7f861d559740 10 client.16194 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:48:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.405+0000 7f861d559740 20 client.16194 populate_metadata read hostname 'smithi007' 2024-09-19T08:48:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.405+0000 7f861d559740 1 --2- 172.21.15.7:0/3318318857 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5606c32f5bc0 0x5606c32f7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.405+0000 7f861d559740 4 client.16194 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:48:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.405+0000 7f861d559740 1 -- 172.21.15.7:0/3318318857 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606c324e860 con 0x5606c32f5bc0 2024-09-19T08:48:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.405+0000 7f860bfff640 1 --2- 172.21.15.7:0/3318318857 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5606c32f5bc0 0x5606c32f7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.405+0000 7f85f3fff640 10 client.16194 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:48:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.405+0000 7f860bfff640 1 --2- 172.21.15.7:0/3318318857 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5606c32f5bc0 0x5606c32f7fb0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=76bb738dbe52d315 server_cookie=b3c3e565b5064712 in_seq=0 out_seq=0 2024-09-19T08:48:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.406+0000 7f85f3fff640 1 -- 172.21.15.7:0/3318318857 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5606c324e860 con 0x5606c32f5bc0 2024-09-19T08:48:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.406+0000 7f85f3fff640 10 client.16194 handle_command_reply: tid=0 2024-09-19T08:48:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.406+0000 7f861d559740 1 client.16194 shutdown 2024-09-19T08:48:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.406+0000 7f861d559740 1 -- 172.21.15.7:0/3318318857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32db5d0 msgr2=0x5606c32e5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.406+0000 7f861d559740 1 --2- 172.21.15.7:0/3318318857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32db5d0 0x5606c32e5d00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f860c005fc0 tx=0x7f860c004300 comp rx=0 tx=0).stop 2024-09-19T08:48:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.406+0000 7f861d559740 1 -- 172.21.15.7:0/3318318857 shutdown_connections 2024-09-19T08:48:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.406+0000 7f861d559740 1 --2- 172.21.15.7:0/3318318857 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5606c32f5bc0 0x5606c32f7fb0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.406+0000 7f861d559740 1 --2- 172.21.15.7:0/3318318857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606c32e6370 0x5606c32e3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.406+0000 7f861d559740 1 --2- 172.21.15.7:0/3318318857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606c32dcb40 0x5606c32e2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.406+0000 7f861d559740 1 --2- 172.21.15.7:0/3318318857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32db5d0 0x5606c32e5d00 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.406+0000 7f861d559740 1 -- 172.21.15.7:0/3318318857 >> 172.21.15.7:0/3318318857 conn(0x5606c32a4310 msgr2=0x5606c32dd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.406+0000 7f85f3fff640 0 client.16194 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:48:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.407+0000 7f861d559740 1 -- 172.21.15.7:0/3318318857 shutdown_connections 2024-09-19T08:48:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.407+0000 7f861d559740 1 -- 172.21.15.7:0/3318318857 wait complete. 2024-09-19T08:48:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.407+0000 7f861d559740 20 client.16194 trim_cache size 0 max 16384 2024-09-19T08:48:58.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.420+0000 7f861d559740 1 Processor -- start 2024-09-19T08:48:58.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.420+0000 7f861d559740 1 -- start start 2024-09-19T08:48:58.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.420+0000 7f861d559740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606c32db5d0 0x5606c32f22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:58.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.420+0000 7f861d559740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606c32dcb40 0x5606c32fd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:58.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.420+0000 7f861d559740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32e6370 0x5606c32fdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:58.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.420+0000 7f861d559740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f86141b0030 con 0x5606c32e6370 2024-09-19T08:48:58.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.420+0000 7f861d559740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f86141ad900 con 0x5606c32db5d0 2024-09-19T08:48:58.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.420+0000 7f861d559740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f86141ab750 con 0x5606c32dcb40 2024-09-19T08:48:58.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.420+0000 7f861971d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32e6370 0x5606c32fdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:58.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.421+0000 7f860bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606c32dcb40 0x5606c32fd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:58.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.421+0000 7f861971d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32e6370 0x5606c32fdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57118/0 (socket says 172.21.15.7:57118) 2024-09-19T08:48:58.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.421+0000 7f861971d640 1 -- 172.21.15.7:0/3913839251 learned_addr learned my addr 172.21.15.7:0/3913839251 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:58.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.421+0000 7f861971d640 1 --2- 172.21.15.7:0/3913839251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606c32db5d0 0x5606c32f22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:58.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.421+0000 7f860bfff640 1 -- 172.21.15.7:0/3913839251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606c32db5d0 msgr2=0x5606c32f22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:58.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.421+0000 7f860bfff640 1 --2- 172.21.15.7:0/3913839251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606c32db5d0 0x5606c32f22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.421+0000 7f860bfff640 1 -- 172.21.15.7:0/3913839251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32e6370 msgr2=0x5606c32fdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:58.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.421+0000 7f860bfff640 1 --2- 172.21.15.7:0/3913839251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32e6370 0x5606c32fdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.421+0000 7f860bfff640 1 -- 172.21.15.7:0/3913839251 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606c32e1500 con 0x5606c32dcb40 2024-09-19T08:48:58.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.421+0000 7f861971d640 1 --2- 172.21.15.7:0/3913839251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32e6370 0x5606c32fdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:48:58.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.421+0000 7f860bfff640 1 --2- 172.21.15.7:0/3913839251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606c32dcb40 0x5606c32fd5e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x5606c32f8580 tx=0x7f860400f7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3db2e5a46168bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:58.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.421+0000 7f85fa7fc640 1 -- 172.21.15.7:0/3913839251 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8604005020 con 0x5606c32dcb40 2024-09-19T08:48:58.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.421+0000 7f85fa7fc640 1 -- 172.21.15.7:0/3913839251 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86040047a0 con 0x5606c32dcb40 2024-09-19T08:48:58.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.421+0000 7f85fa7fc640 1 -- 172.21.15.7:0/3913839251 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860401b680 con 0x5606c32dcb40 2024-09-19T08:48:58.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.422+0000 7f861d559740 1 -- 172.21.15.7:0/3913839251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606c32dcb40 msgr2=0x5606c32fd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:58.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.422+0000 7f861d559740 1 --2- 172.21.15.7:0/3913839251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606c32dcb40 0x5606c32fd5e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x5606c32f8580 tx=0x7f860400f7f0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.422+0000 7f861d559740 1 -- 172.21.15.7:0/3913839251 shutdown_connections 2024-09-19T08:48:58.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.422+0000 7f861d559740 1 --2- 172.21.15.7:0/3913839251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32e6370 0x5606c32fdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.422+0000 7f861d559740 1 --2- 172.21.15.7:0/3913839251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606c32dcb40 0x5606c32fd5e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.422+0000 7f861d559740 1 --2- 172.21.15.7:0/3913839251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606c32db5d0 0x5606c32f22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.422+0000 7f861d559740 1 -- 172.21.15.7:0/3913839251 >> 172.21.15.7:0/3913839251 conn(0x5606c32a4310 msgr2=0x5606c32d6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:58.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.422+0000 7f861d559740 1 -- 172.21.15.7:0/3913839251 shutdown_connections 2024-09-19T08:48:58.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.422+0000 7f861d559740 1 -- 172.21.15.7:0/3913839251 wait complete. 2024-09-19T08:48:58.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.422+0000 7f861d559740 1 -- start start 2024-09-19T08:48:58.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.422+0000 7f861d559740 1 Processor -- start 2024-09-19T08:48:58.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.423+0000 7f861d559740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606c32db5d0 0x5606c32eea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:58.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.423+0000 7f861d559740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606c32dcb40 0x5606c32e9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:58.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.423+0000 7f861d559740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32e6370 0x5606c32ea2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:58.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.423+0000 7f861d559740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f86141abdc0 con 0x5606c32e6370 2024-09-19T08:48:58.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.423+0000 7f861d559740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f86141ad230 con 0x5606c32db5d0 2024-09-19T08:48:58.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.423+0000 7f861d559740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f86141ac490 con 0x5606c32dcb40 2024-09-19T08:48:58.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.423+0000 7f861d559740 10 client.0 _ll_register_callbacks cb 0x7f860400b2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:58.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.423+0000 7f861971d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32e6370 0x5606c32ea2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:58.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.423+0000 7f861971d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32e6370 0x5606c32ea2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57132/0 (socket says 172.21.15.7:57132) 2024-09-19T08:48:58.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.423+0000 7f861971d640 1 -- 172.21.15.7:0/2682209734 learned_addr learned my addr 172.21.15.7:0/2682209734 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:58.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.423+0000 7f860bfff640 1 --2- 172.21.15.7:0/2682209734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606c32dcb40 0x5606c32e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:58.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.423+0000 7f861971d640 1 --2- 172.21.15.7:0/2682209734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606c32db5d0 0x5606c32eea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:58.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.423+0000 7f861971d640 1 -- 172.21.15.7:0/2682209734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606c32dcb40 msgr2=0x5606c32e9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:58.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.423+0000 7f861971d640 1 --2- 172.21.15.7:0/2682209734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606c32dcb40 0x5606c32e9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.423+0000 7f861971d640 1 -- 172.21.15.7:0/2682209734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606c32db5d0 msgr2=0x5606c32eea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:58.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.423+0000 7f861971d640 1 --2- 172.21.15.7:0/2682209734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606c32db5d0 0x5606c32eea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.423+0000 7f861971d640 1 -- 172.21.15.7:0/2682209734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606c32eab10 con 0x5606c32e6370 2024-09-19T08:48:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.424+0000 7f861971d640 1 --2- 172.21.15.7:0/2682209734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32e6370 0x5606c32ea2e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f860c030d10 tx=0x7f860c003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b5c3baa1b66b02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.424+0000 7f85f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:48:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.424+0000 7f85f3fff640 1 -- 172.21.15.7:0/2682209734 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c062040 con 0x5606c32e6370 2024-09-19T08:48:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.424+0000 7f85f3fff640 1 -- 172.21.15.7:0/2682209734 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f860c05a020 con 0x5606c32e6370 2024-09-19T08:48:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.424+0000 7f861d559740 1 -- 172.21.15.7:0/2682209734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86040047a0 con 0x5606c32e6370 2024-09-19T08:48:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.424+0000 7f85f3fff640 1 -- 172.21.15.7:0/2682209734 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f860c051040 con 0x5606c32e6370 2024-09-19T08:48:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.424+0000 7f861d559740 10 client.16200 fetch_fsmap learned FSMap version 25 2024-09-19T08:48:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.424+0000 7f861d559740 1 -- 172.21.15.7:0/2682209734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5606c33604b0 con 0x5606c32e6370 2024-09-19T08:48:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.424+0000 7f85f3fff640 1 -- 172.21.15.7:0/2682209734 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86040047a0 con 0x5606c32e6370 2024-09-19T08:48:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.424+0000 7f85f3fff640 1 -- 172.21.15.7:0/2682209734 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f860c065020 con 0x5606c32e6370 2024-09-19T08:48:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.424+0000 7f861d559740 10 client.16200 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:48:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.424+0000 7f861d559740 10 client.16200 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:48:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.424+0000 7f861d559740 20 client.16200 populate_metadata read hostname 'smithi007' 2024-09-19T08:48:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.424+0000 7f861d559740 1 --2- 172.21.15.7:0/2682209734 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5606c3360ac0 0x5606c3362eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.424+0000 7f861d559740 4 client.16200 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:48:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.424+0000 7f861d559740 1 -- 172.21.15.7:0/2682209734 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5606c3248d70 con 0x5606c3360ac0 2024-09-19T08:48:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.425+0000 7f860bfff640 1 --2- 172.21.15.7:0/2682209734 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5606c3360ac0 0x5606c3362eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.425+0000 7f860bfff640 1 --2- 172.21.15.7:0/2682209734 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5606c3360ac0 0x5606c3362eb0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=53fd221d4fa251c7 server_cookie=85cb8fb8576507f8 in_seq=0 out_seq=0 2024-09-19T08:48:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.425+0000 7f85f3fff640 10 client.16200 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:48:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.425+0000 7f85f3fff640 1 -- 172.21.15.7:0/2682209734 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5606c3248d70 con 0x5606c3360ac0 2024-09-19T08:48:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.425+0000 7f85f3fff640 10 client.16200 handle_command_reply: tid=0 2024-09-19T08:48:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.425+0000 7f861d559740 1 client.16200 shutdown 2024-09-19T08:48:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.425+0000 7f861d559740 1 -- 172.21.15.7:0/2682209734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32e6370 msgr2=0x5606c32ea2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.425+0000 7f861d559740 1 --2- 172.21.15.7:0/2682209734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32e6370 0x5606c32ea2e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f860c030d10 tx=0x7f860c003c80 comp rx=0 tx=0).stop 2024-09-19T08:48:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.425+0000 7f861d559740 1 -- 172.21.15.7:0/2682209734 shutdown_connections 2024-09-19T08:48:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.425+0000 7f861d559740 1 --2- 172.21.15.7:0/2682209734 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5606c3360ac0 0x5606c3362eb0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.425+0000 7f861d559740 1 --2- 172.21.15.7:0/2682209734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5606c32e6370 0x5606c32ea2e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.425+0000 7f861d559740 1 --2- 172.21.15.7:0/2682209734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5606c32dcb40 0x5606c32e9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.425+0000 7f861d559740 1 --2- 172.21.15.7:0/2682209734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606c32db5d0 0x5606c32eea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.425+0000 7f861d559740 1 -- 172.21.15.7:0/2682209734 >> 172.21.15.7:0/2682209734 conn(0x5606c32a4310 msgr2=0x5606c32e1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.425+0000 7f85f3fff640 0 client.16200 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:48:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.426+0000 7f861d559740 1 -- 172.21.15.7:0/2682209734 shutdown_connections 2024-09-19T08:48:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.426+0000 7f861d559740 1 -- 172.21.15.7:0/2682209734 wait complete. 2024-09-19T08:48:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.426+0000 7f861d559740 20 client.16200 trim_cache size 0 max 16384 2024-09-19T08:48:58.439 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:48:58.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.426+0000 7f861b180640 1 -- 172.21.15.7:0/723465347 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f85fc0a33b0 msgr2=0x7f85fc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:58.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.426+0000 7f861b180640 1 --2- 172.21.15.7:0/723465347 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f85fc0a33b0 0x7f85fc0a5870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f86100cd510 tx=0x7f8610090f30 comp rx=0 tx=0).stop 2024-09-19T08:48:58.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.426+0000 7f861b180640 1 -- 172.21.15.7:0/723465347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8614102da0 msgr2=0x7f86141983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:58.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.426+0000 7f861b180640 1 --2- 172.21.15.7:0/723465347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8614102da0 0x7f86141983a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f861000d950 tx=0x7f861000de10 comp rx=0 tx=0).stop 2024-09-19T08:48:58.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.426+0000 7f861b180640 1 -- 172.21.15.7:0/723465347 shutdown_connections 2024-09-19T08:48:58.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.426+0000 7f861b180640 1 --2- 172.21.15.7:0/723465347 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f85fc0a33b0 0x7f85fc0a5870 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.426+0000 7f861b180640 1 --2- 172.21.15.7:0/723465347 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f861410c180 0x7f861419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.426+0000 7f861b180640 1 --2- 172.21.15.7:0/723465347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86141036c0 0x7f86141988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.426+0000 7f861b180640 1 --2- 172.21.15.7:0/723465347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8614102da0 0x7f86141983a0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.426+0000 7f861b180640 1 -- 172.21.15.7:0/723465347 >> 172.21.15.7:0/723465347 conn(0x7f86140fc7a0 msgr2=0x7f86140fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:58.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.427+0000 7f861b180640 1 -- 172.21.15.7:0/723465347 shutdown_connections 2024-09-19T08:48:58.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:58.427+0000 7f861b180640 1 -- 172.21.15.7:0/723465347 wait complete. 2024-09-19T08:48:58.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:48:58 smithi007 ceph-mon[31221]: pgmap v136: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:48:58.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:48:58 smithi044 ceph-mon[35072]: pgmap v136: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:48:58.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:48:58 smithi175 ceph-mon[35688]: pgmap v136: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:48:59.134 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:48:59.392 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:59.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.874+0000 7f3d5a255640 1 -- 172.21.15.7:0/2939297807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d5410e3c0 msgr2=0x7f3d54110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:59.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.874+0000 7f3d5a255640 1 --2- 172.21.15.7:0/2939297807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d5410e3c0 0x7f3d54110810 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009ca0 tx=0x7f3d4c02a950 comp rx=0 tx=0).stop 2024-09-19T08:48:59.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.874+0000 7f3d5a255640 1 -- 172.21.15.7:0/2939297807 shutdown_connections 2024-09-19T08:48:59.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.874+0000 7f3d5a255640 1 --2- 172.21.15.7:0/2939297807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d5410e3c0 0x7f3d54110810 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.874+0000 7f3d5a255640 1 --2- 172.21.15.7:0/2939297807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d54074f40 0x7f3d5410de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.874+0000 7f3d5a255640 1 --2- 172.21.15.7:0/2939297807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d54074620 0x7f3d54074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.874+0000 7f3d5a255640 1 -- 172.21.15.7:0/2939297807 >> 172.21.15.7:0/2939297807 conn(0x7f3d540fd8c0 msgr2=0x7f3d540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.874+0000 7f3d5a255640 1 -- 172.21.15.7:0/2939297807 shutdown_connections 2024-09-19T08:48:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.874+0000 7f3d5a255640 1 -- 172.21.15.7:0/2939297807 wait complete. 2024-09-19T08:48:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.874+0000 7f3d5a255640 1 Processor -- start 2024-09-19T08:48:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.875+0000 7f3d5a255640 1 -- start start 2024-09-19T08:48:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.875+0000 7f3d5a255640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d54074620 0x7f3d5419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.875+0000 7f3d5a255640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d54074f40 0x7f3d5419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.875+0000 7f3d5a255640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d5410e3c0 0x7f3d5419ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.875+0000 7f3d5a255640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3d54114150 con 0x7f3d54074620 2024-09-19T08:48:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.875+0000 7f3d5a255640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3d54113fd0 con 0x7f3d5410e3c0 2024-09-19T08:48:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.875+0000 7f3d5a255640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541142d0 con 0x7f3d54074f40 2024-09-19T08:48:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.875+0000 7f3d537fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d54074620 0x7f3d5419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.875+0000 7f3d537fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d54074620 0x7f3d5419a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57152/0 (socket says 172.21.15.7:57152) 2024-09-19T08:48:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.875+0000 7f3d537fe640 1 -- 172.21.15.7:0/2568717583 learned_addr learned my addr 172.21.15.7:0/2568717583 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.875+0000 7f3d53fff640 1 --2- 172.21.15.7:0/2568717583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d5410e3c0 0x7f3d5419ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.875+0000 7f3d52ffd640 1 --2- 172.21.15.7:0/2568717583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d54074f40 0x7f3d5419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.875+0000 7f3d537fe640 1 -- 172.21.15.7:0/2568717583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d54074f40 msgr2=0x7f3d5419aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.875+0000 7f3d537fe640 1 --2- 172.21.15.7:0/2568717583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d54074f40 0x7f3d5419aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.875+0000 7f3d537fe640 1 -- 172.21.15.7:0/2568717583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d5410e3c0 msgr2=0x7f3d5419ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.875+0000 7f3d537fe640 1 --2- 172.21.15.7:0/2568717583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d5410e3c0 0x7f3d5419ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.875+0000 7f3d537fe640 1 -- 172.21.15.7:0/2568717583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5419f520 con 0x7f3d54074620 2024-09-19T08:48:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.875+0000 7f3d52ffd640 1 --2- 172.21.15.7:0/2568717583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d54074f40 0x7f3d5419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:48:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.876+0000 7f3d537fe640 1 --2- 172.21.15.7:0/2568717583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d54074620 0x7f3d5419a570 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400c920 tx=0x7f3d4400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.876+0000 7f3d50ff9640 1 -- 172.21.15.7:0/2568717583 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d44007c70 con 0x7f3d54074620 2024-09-19T08:48:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.876+0000 7f3d50ff9640 1 -- 172.21.15.7:0/2568717583 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d44007e10 con 0x7f3d54074620 2024-09-19T08:48:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.876+0000 7f3d50ff9640 1 -- 172.21.15.7:0/2568717583 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d44018890 con 0x7f3d54074620 2024-09-19T08:48:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.876+0000 7f3d5a255640 1 -- 172.21.15.7:0/2568717583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d5419f810 con 0x7f3d54074620 2024-09-19T08:48:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.876+0000 7f3d5a255640 1 -- 172.21.15.7:0/2568717583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d541a70f0 con 0x7f3d54074620 2024-09-19T08:48:59.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.878+0000 7f3d50ff9640 1 -- 172.21.15.7:0/2568717583 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f3d44018a70 con 0x7f3d54074620 2024-09-19T08:48:59.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.878+0000 7f3d5c62e740 1 Processor -- start 2024-09-19T08:48:59.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.878+0000 7f3d5c62e740 1 -- start start 2024-09-19T08:48:59.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.879+0000 7f3d5c62e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f4410b40 0x5626f440f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:59.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.879+0000 7f3d5c62e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f440f5d0 0x5626f440fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:59.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.879+0000 7f3d5c62e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626f441a370 0x5626f441c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:59.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.879+0000 7f3d5c62e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5626f43752f0 con 0x5626f440f5d0 2024-09-19T08:48:59.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.879+0000 7f3d5c62e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5626f431ccf0 con 0x5626f4410b40 2024-09-19T08:48:59.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.879+0000 7f3d5c62e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5626f43712b0 con 0x5626f441a370 2024-09-19T08:48:59.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.879+0000 7f3d537fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f440f5d0 0x5626f440fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:59.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.879+0000 7f3d537fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f440f5d0 0x5626f440fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57158/0 (socket says 172.21.15.7:57158) 2024-09-19T08:48:59.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.879+0000 7f3d537fe640 1 -- 172.21.15.7:0/703219025 learned_addr learned my addr 172.21.15.7:0/703219025 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.879+0000 7f3d53fff640 1 --2- 172.21.15.7:0/703219025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f4410b40 0x5626f440f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.879+0000 7f3d52ffd640 1 --2- 172.21.15.7:0/703219025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626f441a370 0x5626f441c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.879+0000 7f3d50ff9640 1 --2- 172.21.15.7:0/2568717583 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3d3c0a3430 0x7f3d3c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.879+0000 7f3d537fe640 1 -- 172.21.15.7:0/703219025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626f441a370 msgr2=0x5626f441c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.879+0000 7f3d537fe640 1 --2- 172.21.15.7:0/703219025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626f441a370 0x5626f441c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.879+0000 7f3d537fe640 1 -- 172.21.15.7:0/703219025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f4410b40 msgr2=0x5626f440f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.879+0000 7f3d537fe640 1 --2- 172.21.15.7:0/703219025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f4410b40 0x5626f440f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.879+0000 7f3d537fe640 1 -- 172.21.15.7:0/703219025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626f43013a0 con 0x5626f440f5d0 2024-09-19T08:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.879+0000 7f3d53fff640 1 --2- 172.21.15.7:0/2568717583 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3d3c0a3430 0x7f3d3c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.879+0000 7f3d50ff9640 1 -- 172.21.15.7:0/2568717583 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f3d440cfe20 con 0x7f3d54074620 2024-09-19T08:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.879+0000 7f3d537fe640 1 --2- 172.21.15.7:0/703219025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f440f5d0 0x5626f440fa10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3d440cd4d0 tx=0x7f3d44066a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2511174275d86a0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.880+0000 7f3d39ffb640 1 -- 172.21.15.7:0/703219025 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4409ba50 con 0x5626f440f5d0 2024-09-19T08:48:59.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.880+0000 7f3d39ffb640 1 -- 172.21.15.7:0/703219025 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d44066f40 con 0x5626f440f5d0 2024-09-19T08:48:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.880+0000 7f3d39ffb640 1 -- 172.21.15.7:0/703219025 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4406abf0 con 0x5626f440f5d0 2024-09-19T08:48:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.880+0000 7f3d5c62e740 1 -- 172.21.15.7:0/703219025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f440f5d0 msgr2=0x5626f440fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.880+0000 7f3d53fff640 1 --2- 172.21.15.7:0/2568717583 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3d3c0a3430 0x7f3d3c0a58f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c005fe0 tx=0x7f3d4c03c040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.880+0000 7f3d5c62e740 1 --2- 172.21.15.7:0/703219025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f440f5d0 0x5626f440fa10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3d440cd4d0 tx=0x7f3d44066a30 comp rx=0 tx=0).stop 2024-09-19T08:48:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.880+0000 7f3d5c62e740 1 -- 172.21.15.7:0/703219025 shutdown_connections 2024-09-19T08:48:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.880+0000 7f3d5c62e740 1 --2- 172.21.15.7:0/703219025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626f441a370 0x5626f441c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.880+0000 7f3d5c62e740 1 --2- 172.21.15.7:0/703219025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f440f5d0 0x5626f440fa10 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.880+0000 7f3d5c62e740 1 --2- 172.21.15.7:0/703219025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f4410b40 0x5626f440f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.880+0000 7f3d5c62e740 1 -- 172.21.15.7:0/703219025 >> 172.21.15.7:0/703219025 conn(0x5626f43d8310 msgr2=0x5626f440bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.881+0000 7f3d5c62e740 1 -- 172.21.15.7:0/703219025 shutdown_connections 2024-09-19T08:48:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.881+0000 7f3d5c62e740 1 -- 172.21.15.7:0/703219025 wait complete. 2024-09-19T08:48:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.881+0000 7f3d5c62e740 1 -- start start 2024-09-19T08:48:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.881+0000 7f3d5c62e740 1 Processor -- start 2024-09-19T08:48:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.881+0000 7f3d5c62e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f440f5d0 0x5626f4419d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.881+0000 7f3d5c62e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f4410b40 0x5626f4417000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.881+0000 7f3d5c62e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626f441a370 0x5626f44175d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.881+0000 7f3d5c62e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5626f441cfb0 con 0x5626f440f5d0 2024-09-19T08:48:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.881+0000 7f3d5c62e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5626f4330060 con 0x5626f4410b40 2024-09-19T08:48:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.881+0000 7f3d5c62e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5626f441d130 con 0x5626f441a370 2024-09-19T08:48:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.881+0000 7f3d5c62e740 10 client.0 _ll_register_callbacks cb 0x5626f40838c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.881+0000 7f3d537fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f440f5d0 0x5626f4419d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:59.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.882+0000 7f3d537fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f440f5d0 0x5626f4419d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57166/0 (socket says 172.21.15.7:57166) 2024-09-19T08:48:59.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.882+0000 7f3d537fe640 1 -- 172.21.15.7:0/816747336 learned_addr learned my addr 172.21.15.7:0/816747336 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:59.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.882+0000 7f3d52ffd640 1 --2- 172.21.15.7:0/816747336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f4410b40 0x5626f4417000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:59.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.882+0000 7f3d53fff640 1 --2- 172.21.15.7:0/816747336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626f441a370 0x5626f44175d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:59.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.882+0000 7f3d537fe640 1 -- 172.21.15.7:0/816747336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626f441a370 msgr2=0x5626f44175d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:59.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.882+0000 7f3d537fe640 1 --2- 172.21.15.7:0/816747336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626f441a370 0x5626f44175d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.882+0000 7f3d537fe640 1 -- 172.21.15.7:0/816747336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f4410b40 msgr2=0x5626f4417000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:59.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.882+0000 7f3d537fe640 1 --2- 172.21.15.7:0/816747336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f4410b40 0x5626f4417000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.882+0000 7f3d537fe640 1 -- 172.21.15.7:0/816747336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626f40e63c0 con 0x5626f440f5d0 2024-09-19T08:48:59.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.882+0000 7f3d52ffd640 1 --2- 172.21.15.7:0/816747336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f4410b40 0x5626f4417000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:48:59.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.882+0000 7f3d537fe640 1 --2- 172.21.15.7:0/816747336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f440f5d0 0x5626f4419d50 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3d440a4830 tx=0x7f3d4400ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3651c3918ab6b793 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:59.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.882+0000 7f3d32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:48:59.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.882+0000 7f3d32ffd640 1 -- 172.21.15.7:0/816747336 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4409ba50 con 0x5626f440f5d0 2024-09-19T08:48:59.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.882+0000 7f3d32ffd640 1 -- 172.21.15.7:0/816747336 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f3d4409a3f0 con 0x5626f440f5d0 2024-09-19T08:48:59.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.882+0000 7f3d5c62e740 1 -- 172.21.15.7:0/816747336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d44066f40 con 0x5626f440f5d0 2024-09-19T08:48:59.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.882+0000 7f3d32ffd640 1 -- 172.21.15.7:0/816747336 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3d4406f420 con 0x5626f440f5d0 2024-09-19T08:48:59.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.882+0000 7f3d5c62e740 10 client.16212 fetch_fsmap learned FSMap version 25 2024-09-19T08:48:59.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.882+0000 7f3d5c62e740 1 -- 172.21.15.7:0/816747336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5626f4428a30 con 0x5626f440f5d0 2024-09-19T08:48:59.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.882+0000 7f3d32ffd640 1 -- 172.21.15.7:0/816747336 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d44066f40 con 0x5626f440f5d0 2024-09-19T08:48:59.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.883+0000 7f3d32ffd640 1 -- 172.21.15.7:0/816747336 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3d44098760 con 0x5626f440f5d0 2024-09-19T08:48:59.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.883+0000 7f3d5c62e740 10 client.16212 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:48:59.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.883+0000 7f3d5c62e740 10 client.16212 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:48:59.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.883+0000 7f3d5c62e740 20 client.16212 populate_metadata read hostname 'smithi007' 2024-09-19T08:48:59.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.883+0000 7f3d5c62e740 1 --2- 172.21.15.7:0/816747336 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5626f4429d80 0x5626f442c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:59.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.883+0000 7f3d5c62e740 4 client.16212 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:48:59.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.883+0000 7f3d5c62e740 1 -- 172.21.15.7:0/816747336 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626f4382860 con 0x5626f4429d80 2024-09-19T08:48:59.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.883+0000 7f3d52ffd640 1 --2- 172.21.15.7:0/816747336 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5626f4429d80 0x5626f442c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:59.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.883+0000 7f3d52ffd640 1 --2- 172.21.15.7:0/816747336 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5626f4429d80 0x5626f442c170 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=57fde11ad99543a9 server_cookie=720e7534de29bd8f in_seq=0 out_seq=0 2024-09-19T08:48:59.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.883+0000 7f3d32ffd640 10 client.16212 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:48:59.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.884+0000 7f3d32ffd640 1 -- 172.21.15.7:0/816747336 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5626f4382860 con 0x5626f4429d80 2024-09-19T08:48:59.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.884+0000 7f3d32ffd640 10 client.16212 handle_command_reply: tid=0 2024-09-19T08:48:59.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.884+0000 7f3d5c62e740 1 client.16212 shutdown 2024-09-19T08:48:59.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.885+0000 7f3d5c62e740 1 -- 172.21.15.7:0/816747336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f440f5d0 msgr2=0x5626f4419d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:59.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.885+0000 7f3d5c62e740 1 --2- 172.21.15.7:0/816747336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f440f5d0 0x5626f4419d50 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3d440a4830 tx=0x7f3d4400ff30 comp rx=0 tx=0).stop 2024-09-19T08:48:59.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.885+0000 7f3d5c62e740 1 -- 172.21.15.7:0/816747336 shutdown_connections 2024-09-19T08:48:59.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.885+0000 7f3d5c62e740 1 --2- 172.21.15.7:0/816747336 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5626f4429d80 0x5626f442c170 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.885+0000 7f3d32ffd640 0 client.16212 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:48:59.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.885+0000 7f3d5c62e740 1 --2- 172.21.15.7:0/816747336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626f441a370 0x5626f44175d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.885+0000 7f3d5c62e740 1 --2- 172.21.15.7:0/816747336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f4410b40 0x5626f4417000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.885+0000 7f3d5c62e740 1 --2- 172.21.15.7:0/816747336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f440f5d0 0x5626f4419d50 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.885+0000 7f3d5c62e740 1 -- 172.21.15.7:0/816747336 >> 172.21.15.7:0/816747336 conn(0x5626f43d8310 msgr2=0x5626f4411930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.885+0000 7f3d5c62e740 1 -- 172.21.15.7:0/816747336 shutdown_connections 2024-09-19T08:48:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.885+0000 7f3d5c62e740 1 -- 172.21.15.7:0/816747336 wait complete. 2024-09-19T08:48:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.885+0000 7f3d5c62e740 20 client.16212 trim_cache size 0 max 16384 2024-09-19T08:48:59.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.898+0000 7f3d5c62e740 1 Processor -- start 2024-09-19T08:48:59.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.898+0000 7f3d5c62e740 1 -- start start 2024-09-19T08:48:59.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.899+0000 7f3d5c62e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f440f5d0 0x5626f4426250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:59.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.899+0000 7f3d5c62e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f4410b40 0x5626f4415fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:59.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.899+0000 7f3d5c62e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626f441a370 0x5626f4431710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:59.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.899+0000 7f3d5c62e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541b2350 con 0x5626f440f5d0 2024-09-19T08:48:59.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.899+0000 7f3d5c62e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541afc20 con 0x5626f4410b40 2024-09-19T08:48:59.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.899+0000 7f3d5c62e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541ada70 con 0x5626f441a370 2024-09-19T08:48:59.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.899+0000 7f3d537fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f440f5d0 0x5626f4426250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:59.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.899+0000 7f3d537fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f440f5d0 0x5626f4426250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57174/0 (socket says 172.21.15.7:57174) 2024-09-19T08:48:59.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.899+0000 7f3d537fe640 1 -- 172.21.15.7:0/1715698295 learned_addr learned my addr 172.21.15.7:0/1715698295 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:59.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.899+0000 7f3d52ffd640 1 --2- 172.21.15.7:0/1715698295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f4410b40 0x5626f4415fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:59.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.899+0000 7f3d53fff640 1 --2- 172.21.15.7:0/1715698295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626f441a370 0x5626f4431710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:59.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.899+0000 7f3d537fe640 1 -- 172.21.15.7:0/1715698295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626f441a370 msgr2=0x5626f4431710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:59.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.899+0000 7f3d537fe640 1 --2- 172.21.15.7:0/1715698295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626f441a370 0x5626f4431710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.899+0000 7f3d537fe640 1 -- 172.21.15.7:0/1715698295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f4410b40 msgr2=0x5626f4415fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:59.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.899+0000 7f3d537fe640 1 --2- 172.21.15.7:0/1715698295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f4410b40 0x5626f4415fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.899+0000 7f3d537fe640 1 -- 172.21.15.7:0/1715698295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626f4417940 con 0x5626f440f5d0 2024-09-19T08:48:59.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.899+0000 7f3d537fe640 1 --2- 172.21.15.7:0/1715698295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f440f5d0 0x5626f4426250 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f3d44098190 tx=0x7f3d440cd610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ecd3c0a8d41ffd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:59.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.900+0000 7f3d397fa640 1 -- 172.21.15.7:0/1715698295 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4409ba50 con 0x5626f440f5d0 2024-09-19T08:48:59.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.900+0000 7f3d397fa640 1 -- 172.21.15.7:0/1715698295 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d4409c7f0 con 0x5626f440f5d0 2024-09-19T08:48:59.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.900+0000 7f3d397fa640 1 -- 172.21.15.7:0/1715698295 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4409bc30 con 0x5626f440f5d0 2024-09-19T08:48:59.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.900+0000 7f3d5c62e740 1 -- 172.21.15.7:0/1715698295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f440f5d0 msgr2=0x5626f4426250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:59.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.900+0000 7f3d5c62e740 1 --2- 172.21.15.7:0/1715698295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f440f5d0 0x5626f4426250 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f3d44098190 tx=0x7f3d440cd610 comp rx=0 tx=0).stop 2024-09-19T08:48:59.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.900+0000 7f3d5c62e740 1 -- 172.21.15.7:0/1715698295 shutdown_connections 2024-09-19T08:48:59.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.900+0000 7f3d5c62e740 1 --2- 172.21.15.7:0/1715698295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626f441a370 0x5626f4431710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.900+0000 7f3d5c62e740 1 --2- 172.21.15.7:0/1715698295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f4410b40 0x5626f4415fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.900+0000 7f3d5c62e740 1 --2- 172.21.15.7:0/1715698295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f440f5d0 0x5626f4426250 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.900+0000 7f3d5c62e740 1 -- 172.21.15.7:0/1715698295 >> 172.21.15.7:0/1715698295 conn(0x5626f43d8310 msgr2=0x5626f44158d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:59.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.900+0000 7f3d5c62e740 1 -- 172.21.15.7:0/1715698295 shutdown_connections 2024-09-19T08:48:59.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.900+0000 7f3d5c62e740 1 -- 172.21.15.7:0/1715698295 wait complete. 2024-09-19T08:48:59.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.901+0000 7f3d5c62e740 1 -- start start 2024-09-19T08:48:59.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.901+0000 7f3d5c62e740 1 Processor -- start 2024-09-19T08:48:59.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.901+0000 7f3d5c62e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f440f5d0 0x5626f4422c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.901+0000 7f3d5c62e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626f4410b40 0x5626f4413e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.901+0000 7f3d5c62e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f441a370 0x5626f4414470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.901+0000 7f3d5c62e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541ae0e0 con 0x5626f441a370 2024-09-19T08:48:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.901+0000 7f3d5c62e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541af550 con 0x5626f440f5d0 2024-09-19T08:48:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.901+0000 7f3d5c62e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541ae7b0 con 0x5626f4410b40 2024-09-19T08:48:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.901+0000 7f3d5c62e740 10 client.0 _ll_register_callbacks cb 0x7f3d4c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:48:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.901+0000 7f3d53fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f441a370 0x5626f4414470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.901+0000 7f3d537fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f440f5d0 0x5626f4422c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.901+0000 7f3d53fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f441a370 0x5626f4414470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57188/0 (socket says 172.21.15.7:57188) 2024-09-19T08:48:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.901+0000 7f3d53fff640 1 -- 172.21.15.7:0/262967881 learned_addr learned my addr 172.21.15.7:0/262967881 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:48:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.901+0000 7f3d537fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f440f5d0 0x5626f4422c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:36704/0 (socket says 172.21.15.7:36704) 2024-09-19T08:48:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.902+0000 7f3d52ffd640 1 --2- 172.21.15.7:0/262967881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626f4410b40 0x5626f4413e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:59.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.902+0000 7f3d53fff640 1 -- 172.21.15.7:0/262967881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626f4410b40 msgr2=0x5626f4413e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:59.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.902+0000 7f3d53fff640 1 --2- 172.21.15.7:0/262967881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626f4410b40 0x5626f4413e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.902+0000 7f3d53fff640 1 -- 172.21.15.7:0/262967881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f440f5d0 msgr2=0x5626f4422c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:48:59.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.902+0000 7f3d53fff640 1 --2- 172.21.15.7:0/262967881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f440f5d0 0x5626f4422c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.902+0000 7f3d53fff640 1 -- 172.21.15.7:0/262967881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626f4414ca0 con 0x5626f441a370 2024-09-19T08:48:59.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.902+0000 7f3d537fe640 1 --2- 172.21.15.7:0/262967881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f440f5d0 0x5626f4422c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:48:59.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.902+0000 7f3d53fff640 1 --2- 172.21.15.7:0/262967881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f441a370 0x5626f4414470 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009ca0 tx=0x7f3d4c005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b2636d907417c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:59.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.902+0000 7f3d32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:48:59.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.902+0000 7f3d32ffd640 1 -- 172.21.15.7:0/262967881 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c055030 con 0x5626f441a370 2024-09-19T08:48:59.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.902+0000 7f3d32ffd640 1 -- 172.21.15.7:0/262967881 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f3d4c04e040 con 0x5626f441a370 2024-09-19T08:48:59.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.902+0000 7f3d5c62e740 1 -- 172.21.15.7:0/262967881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d4409c7f0 con 0x5626f441a370 2024-09-19T08:48:59.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.902+0000 7f3d32ffd640 1 -- 172.21.15.7:0/262967881 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3d4c05f050 con 0x5626f441a370 2024-09-19T08:48:59.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.902+0000 7f3d5c62e740 10 client.16218 fetch_fsmap learned FSMap version 25 2024-09-19T08:48:59.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.902+0000 7f3d5c62e740 1 -- 172.21.15.7:0/262967881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5626f4494810 con 0x5626f441a370 2024-09-19T08:48:59.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.903+0000 7f3d32ffd640 1 -- 172.21.15.7:0/262967881 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d4409c7f0 con 0x5626f441a370 2024-09-19T08:48:59.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.903+0000 7f3d32ffd640 1 -- 172.21.15.7:0/262967881 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3d4c004320 con 0x5626f441a370 2024-09-19T08:48:59.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.903+0000 7f3d5c62e740 10 client.16218 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:48:59.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.903+0000 7f3d5c62e740 10 client.16218 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:48:59.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.903+0000 7f3d5c62e740 20 client.16218 populate_metadata read hostname 'smithi007' 2024-09-19T08:48:59.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.903+0000 7f3d5c62e740 1 --2- 172.21.15.7:0/262967881 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5626f4494fe0 0x5626f4497400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:59.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.903+0000 7f3d5c62e740 4 client.16218 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:48:59.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.903+0000 7f3d5c62e740 1 -- 172.21.15.7:0/262967881 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5626f437cd70 con 0x5626f4494fe0 2024-09-19T08:48:59.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.903+0000 7f3d537fe640 1 --2- 172.21.15.7:0/262967881 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5626f4494fe0 0x5626f4497400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:59.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.904+0000 7f3d537fe640 1 --2- 172.21.15.7:0/262967881 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5626f4494fe0 0x5626f4497400 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b24819e36e19aa53 server_cookie=d5dda89f3f5fc878 in_seq=0 out_seq=0 2024-09-19T08:48:59.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.904+0000 7f3d32ffd640 10 client.16218 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:48:59.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.904+0000 7f3d32ffd640 1 -- 172.21.15.7:0/262967881 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5626f437cd70 con 0x5626f4494fe0 2024-09-19T08:48:59.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.904+0000 7f3d32ffd640 10 client.16218 handle_command_reply: tid=0 2024-09-19T08:48:59.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.904+0000 7f3d5c62e740 1 client.16218 shutdown 2024-09-19T08:48:59.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.904+0000 7f3d5c62e740 1 -- 172.21.15.7:0/262967881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f441a370 msgr2=0x5626f4414470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:59.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.904+0000 7f3d5c62e740 1 --2- 172.21.15.7:0/262967881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f441a370 0x5626f4414470 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009ca0 tx=0x7f3d4c005c50 comp rx=0 tx=0).stop 2024-09-19T08:48:59.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.904+0000 7f3d5c62e740 1 -- 172.21.15.7:0/262967881 shutdown_connections 2024-09-19T08:48:59.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.904+0000 7f3d5c62e740 1 --2- 172.21.15.7:0/262967881 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5626f4494fe0 0x5626f4497400 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.904+0000 7f3d5c62e740 1 --2- 172.21.15.7:0/262967881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f441a370 0x5626f4414470 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.904+0000 7f3d5c62e740 1 --2- 172.21.15.7:0/262967881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626f4410b40 0x5626f4413e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.904+0000 7f3d5c62e740 1 --2- 172.21.15.7:0/262967881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5626f440f5d0 0x5626f4422c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.904+0000 7f3d5c62e740 1 -- 172.21.15.7:0/262967881 >> 172.21.15.7:0/262967881 conn(0x5626f43d8310 msgr2=0x5626f44160f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:59.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.904+0000 7f3d32ffd640 0 client.16218 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:48:59.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.904+0000 7f3d5c62e740 1 -- 172.21.15.7:0/262967881 shutdown_connections 2024-09-19T08:48:59.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.904+0000 7f3d5c62e740 1 -- 172.21.15.7:0/262967881 wait complete. 2024-09-19T08:48:59.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.904+0000 7f3d5c62e740 20 client.16218 trim_cache size 0 max 16384 2024-09-19T08:48:59.910 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:48:59.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.905+0000 7f3d5a255640 1 -- 172.21.15.7:0/2568717583 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3d3c0a3430 msgr2=0x7f3d3c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:59.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.905+0000 7f3d5a255640 1 --2- 172.21.15.7:0/2568717583 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3d3c0a3430 0x7f3d3c0a58f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c005fe0 tx=0x7f3d4c03c040 comp rx=0 tx=0).stop 2024-09-19T08:48:59.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.905+0000 7f3d5a255640 1 -- 172.21.15.7:0/2568717583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d54074620 msgr2=0x7f3d5419a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:59.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.905+0000 7f3d5a255640 1 --2- 172.21.15.7:0/2568717583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d54074620 0x7f3d5419a570 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400c920 tx=0x7f3d4400cde0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.905+0000 7f3d5a255640 1 -- 172.21.15.7:0/2568717583 shutdown_connections 2024-09-19T08:48:59.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.905+0000 7f3d5a255640 1 --2- 172.21.15.7:0/2568717583 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3d3c0a3430 0x7f3d3c0a58f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.905+0000 7f3d5a255640 1 --2- 172.21.15.7:0/2568717583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d5410e3c0 0x7f3d5419ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.905+0000 7f3d5a255640 1 --2- 172.21.15.7:0/2568717583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d54074f40 0x7f3d5419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.905+0000 7f3d5a255640 1 --2- 172.21.15.7:0/2568717583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d54074620 0x7f3d5419a570 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:59.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.905+0000 7f3d5a255640 1 -- 172.21.15.7:0/2568717583 >> 172.21.15.7:0/2568717583 conn(0x7f3d540fd8c0 msgr2=0x7f3d540fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:59.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.905+0000 7f3d5a255640 1 -- 172.21.15.7:0/2568717583 shutdown_connections 2024-09-19T08:48:59.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:48:59.905+0000 7f3d5a255640 1 -- 172.21.15.7:0/2568717583 wait complete. 2024-09-19T08:49:00.723 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:00 smithi007 ceph-mon[31221]: pgmap v137: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:00.724 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:49:00.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:00 smithi044 ceph-mon[35072]: pgmap v137: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:00.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:00 smithi175 ceph-mon[35688]: pgmap v137: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:00.976 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:01.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.503+0000 7fd03fe51640 1 -- 172.21.15.7:0/1268589831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0381036e0 msgr2=0x7fd038107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:01.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.503+0000 7fd03fe51640 1 --2- 172.21.15.7:0/1268589831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0381036e0 0x7fd038107b90 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd028009930 tx=0x7fd02802a420 comp rx=0 tx=0).stop 2024-09-19T08:49:01.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.503+0000 7fd03fe51640 1 -- 172.21.15.7:0/1268589831 shutdown_connections 2024-09-19T08:49:01.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.503+0000 7fd03fe51640 1 --2- 172.21.15.7:0/1268589831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0381082a0 0x7fd03810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.503+0000 7fd03fe51640 1 --2- 172.21.15.7:0/1268589831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0381036e0 0x7fd038107b90 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.503+0000 7fd03fe51640 1 --2- 172.21.15.7:0/1268589831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd038102d30 0x7fd038103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.503+0000 7fd03fe51640 1 -- 172.21.15.7:0/1268589831 >> 172.21.15.7:0/1268589831 conn(0x7fd0380fc7d0 msgr2=0x7fd0380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:01.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.503+0000 7fd03fe51640 1 -- 172.21.15.7:0/1268589831 shutdown_connections 2024-09-19T08:49:01.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.503+0000 7fd03fe51640 1 -- 172.21.15.7:0/1268589831 wait complete. 2024-09-19T08:49:01.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.504+0000 7fd03fe51640 1 Processor -- start 2024-09-19T08:49:01.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.504+0000 7fd03fe51640 1 -- start start 2024-09-19T08:49:01.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.504+0000 7fd03fe51640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd038102d30 0x7fd0381985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:01.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.504+0000 7fd03fe51640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0381036e0 0x7fd038198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:01.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.504+0000 7fd03fe51640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0381082a0 0x7fd03819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:01.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.504+0000 7fd03fe51640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd038112060 con 0x7fd0381036e0 2024-09-19T08:49:01.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.504+0000 7fd03fe51640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd038111ee0 con 0x7fd038102d30 2024-09-19T08:49:01.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.504+0000 7fd03fe51640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd0381121e0 con 0x7fd0381082a0 2024-09-19T08:49:01.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.504+0000 7fd03d3ec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0381036e0 0x7fd038198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:01.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.504+0000 7fd03d3ec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0381036e0 0x7fd038198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57216/0 (socket says 172.21.15.7:57216) 2024-09-19T08:49:01.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.504+0000 7fd03d3ec640 1 -- 172.21.15.7:0/350530673 learned_addr learned my addr 172.21.15.7:0/350530673 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:01.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.504+0000 7fd03dbed640 1 --2- 172.21.15.7:0/350530673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd038102d30 0x7fd0381985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:01.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.504+0000 7fd03e3ee640 1 --2- 172.21.15.7:0/350530673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0381082a0 0x7fd03819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:01.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.504+0000 7fd03d3ec640 1 -- 172.21.15.7:0/350530673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0381082a0 msgr2=0x7fd03819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:01.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.504+0000 7fd03d3ec640 1 --2- 172.21.15.7:0/350530673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0381082a0 0x7fd03819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.504+0000 7fd03d3ec640 1 -- 172.21.15.7:0/350530673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd038102d30 msgr2=0x7fd0381985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:01.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.504+0000 7fd03d3ec640 1 --2- 172.21.15.7:0/350530673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd038102d30 0x7fd0381985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.504+0000 7fd03d3ec640 1 -- 172.21.15.7:0/350530673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03819d550 con 0x7fd0381036e0 2024-09-19T08:49:01.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.505+0000 7fd03d3ec640 1 --2- 172.21.15.7:0/350530673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0381036e0 0x7fd038198ae0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd028005940 tx=0x7fd0280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:01.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.505+0000 7fd02effd640 1 -- 172.21.15.7:0/350530673 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02803f030 con 0x7fd0381036e0 2024-09-19T08:49:01.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.505+0000 7fd02effd640 1 -- 172.21.15.7:0/350530673 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd028003ce0 con 0x7fd0381036e0 2024-09-19T08:49:01.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.505+0000 7fd03fe51640 1 -- 172.21.15.7:0/350530673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd03819d7e0 con 0x7fd0381036e0 2024-09-19T08:49:01.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.505+0000 7fd02effd640 1 -- 172.21.15.7:0/350530673 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028035070 con 0x7fd0381036e0 2024-09-19T08:49:01.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.505+0000 7fd03fe51640 1 -- 172.21.15.7:0/350530673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0381a5120 con 0x7fd0381036e0 2024-09-19T08:49:01.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.507+0000 7fd02effd640 1 -- 172.21.15.7:0/350530673 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fd028042030 con 0x7fd0381036e0 2024-09-19T08:49:01.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.507+0000 7fd04222a740 1 Processor -- start 2024-09-19T08:49:01.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.507+0000 7fd04222a740 1 -- start start 2024-09-19T08:49:01.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.508+0000 7fd04222a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea79a13b40 0x55ea79a12090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:01.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.508+0000 7fd04222a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a125d0 0x55ea79a12a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:01.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.508+0000 7fd04222a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea79a1d370 0x55ea79a1f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:01.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.508+0000 7fd04222a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ea799782f0 con 0x55ea79a125d0 2024-09-19T08:49:01.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.508+0000 7fd04222a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ea7991fcf0 con 0x55ea79a1d370 2024-09-19T08:49:01.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.508+0000 7fd04222a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ea799742b0 con 0x55ea79a13b40 2024-09-19T08:49:01.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.508+0000 7fd03dbed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a125d0 0x55ea79a12a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:01.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.508+0000 7fd03dbed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a125d0 0x55ea79a12a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57226/0 (socket says 172.21.15.7:57226) 2024-09-19T08:49:01.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.508+0000 7fd03dbed640 1 -- 172.21.15.7:0/191181106 learned_addr learned my addr 172.21.15.7:0/191181106 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:01.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.508+0000 7fd03d3ec640 1 --2- 172.21.15.7:0/191181106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea79a1d370 0x55ea79a1f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:01.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.508+0000 7fd03e3ee640 1 --2- 172.21.15.7:0/191181106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea79a13b40 0x55ea79a12090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:01.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.508+0000 7fd02effd640 1 --2- 172.21.15.7:0/350530673 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd0240a3430 0x7fd0240a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:01.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.508+0000 7fd03dbed640 1 -- 172.21.15.7:0/191181106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea79a13b40 msgr2=0x55ea79a12090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:01.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.508+0000 7fd03dbed640 1 --2- 172.21.15.7:0/191181106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea79a13b40 0x55ea79a12090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.508+0000 7fd03dbed640 1 -- 172.21.15.7:0/191181106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea79a1d370 msgr2=0x55ea79a1f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:01.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.508+0000 7fd03dbed640 1 --2- 172.21.15.7:0/191181106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea79a1d370 0x55ea79a1f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.508+0000 7fd03dbed640 1 -- 172.21.15.7:0/191181106 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea799043a0 con 0x55ea79a125d0 2024-09-19T08:49:01.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.508+0000 7fd03e3ee640 1 --2- 172.21.15.7:0/350530673 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd0240a3430 0x7fd0240a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:01.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.508+0000 7fd02effd640 1 -- 172.21.15.7:0/350530673 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fd0280f0130 con 0x7fd0381036e0 2024-09-19T08:49:01.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.508+0000 7fd03dbed640 1 --2- 172.21.15.7:0/191181106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a125d0 0x55ea79a12a10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd03400bd10 tx=0x7fd0340107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8f7abfb94b2f67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:01.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.509+0000 7fd023fff640 1 -- 172.21.15.7:0/191181106 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd034004030 con 0x55ea79a125d0 2024-09-19T08:49:01.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.509+0000 7fd023fff640 1 -- 172.21.15.7:0/191181106 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0340041d0 con 0x55ea79a125d0 2024-09-19T08:49:01.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.509+0000 7fd023fff640 1 -- 172.21.15.7:0/191181106 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd034011820 con 0x55ea79a125d0 2024-09-19T08:49:01.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.509+0000 7fd04222a740 1 -- 172.21.15.7:0/191181106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a125d0 msgr2=0x55ea79a12a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:01.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.509+0000 7fd04222a740 1 --2- 172.21.15.7:0/191181106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a125d0 0x55ea79a12a10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd03400bd10 tx=0x7fd0340107a0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.509+0000 7fd03e3ee640 1 --2- 172.21.15.7:0/350530673 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd0240a3430 0x7fd0240a58f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd030005fd0 tx=0x7fd030004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:01.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.509+0000 7fd04222a740 1 -- 172.21.15.7:0/191181106 shutdown_connections 2024-09-19T08:49:01.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.509+0000 7fd04222a740 1 --2- 172.21.15.7:0/191181106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea79a1d370 0x55ea79a1f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.509+0000 7fd04222a740 1 --2- 172.21.15.7:0/191181106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a125d0 0x55ea79a12a10 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.509+0000 7fd04222a740 1 --2- 172.21.15.7:0/191181106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea79a13b40 0x55ea79a12090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.509+0000 7fd04222a740 1 -- 172.21.15.7:0/191181106 >> 172.21.15.7:0/191181106 conn(0x55ea799db310 msgr2=0x55ea79a0ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:01.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.509+0000 7fd04222a740 1 -- 172.21.15.7:0/191181106 shutdown_connections 2024-09-19T08:49:01.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.509+0000 7fd04222a740 1 -- 172.21.15.7:0/191181106 wait complete. 2024-09-19T08:49:01.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.510+0000 7fd04222a740 1 -- start start 2024-09-19T08:49:01.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.510+0000 7fd04222a740 1 Processor -- start 2024-09-19T08:49:01.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.510+0000 7fd04222a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea79a125d0 0x55ea79a1cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:01.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.510+0000 7fd04222a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a13b40 0x55ea79a19ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:01.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.510+0000 7fd04222a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea79a1d370 0x55ea79a1a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:01.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.510+0000 7fd04222a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ea79a20070 con 0x55ea79a13b40 2024-09-19T08:49:01.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.510+0000 7fd04222a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ea79933060 con 0x55ea79a1d370 2024-09-19T08:49:01.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.510+0000 7fd04222a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ea79a201f0 con 0x55ea79a125d0 2024-09-19T08:49:01.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.510+0000 7fd04222a740 10 client.0 _ll_register_callbacks cb 0x55ea796868c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:01.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.510+0000 7fd03d3ec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a13b40 0x55ea79a19ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:01.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.511+0000 7fd03d3ec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a13b40 0x55ea79a19ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57228/0 (socket says 172.21.15.7:57228) 2024-09-19T08:49:01.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.511+0000 7fd03d3ec640 1 -- 172.21.15.7:0/3486415255 learned_addr learned my addr 172.21.15.7:0/3486415255 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:01.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.511+0000 7fd03dbed640 1 --2- 172.21.15.7:0/3486415255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea79a125d0 0x55ea79a1cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:01.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.511+0000 7fd03e3ee640 1 --2- 172.21.15.7:0/3486415255 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea79a1d370 0x55ea79a1a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:01.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.511+0000 7fd03d3ec640 1 -- 172.21.15.7:0/3486415255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea79a125d0 msgr2=0x55ea79a1cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:01.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.511+0000 7fd03d3ec640 1 --2- 172.21.15.7:0/3486415255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea79a125d0 0x55ea79a1cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.511+0000 7fd03d3ec640 1 -- 172.21.15.7:0/3486415255 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea79a1d370 msgr2=0x55ea79a1a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:01.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.511+0000 7fd03d3ec640 1 --2- 172.21.15.7:0/3486415255 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea79a1d370 0x55ea79a1a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.511+0000 7fd03d3ec640 1 -- 172.21.15.7:0/3486415255 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea796e93c0 con 0x55ea79a13b40 2024-09-19T08:49:01.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.511+0000 7fd03e3ee640 1 --2- 172.21.15.7:0/3486415255 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea79a1d370 0x55ea79a1a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:01.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.511+0000 7fd03d3ec640 1 --2- 172.21.15.7:0/3486415255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a13b40 0x55ea79a19ff0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd0280ed8d0 tx=0x7fd028005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec33220c713c1bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:01.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.511+0000 7fd0217fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:49:01.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.511+0000 7fd0217fa640 1 -- 172.21.15.7:0/3486415255 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028049040 con 0x55ea79a13b40 2024-09-19T08:49:01.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.511+0000 7fd0217fa640 1 -- 172.21.15.7:0/3486415255 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fd0280edaf0 con 0x55ea79a13b40 2024-09-19T08:49:01.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.511+0000 7fd04222a740 1 -- 172.21.15.7:0/3486415255 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0340041d0 con 0x55ea79a13b40 2024-09-19T08:49:01.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.511+0000 7fd0217fa640 1 -- 172.21.15.7:0/3486415255 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd0280bbf40 con 0x55ea79a13b40 2024-09-19T08:49:01.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.511+0000 7fd04222a740 10 client.16230 fetch_fsmap learned FSMap version 25 2024-09-19T08:49:01.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.511+0000 7fd04222a740 1 -- 172.21.15.7:0/3486415255 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ea79a2bae0 con 0x55ea79a13b40 2024-09-19T08:49:01.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.511+0000 7fd0217fa640 1 -- 172.21.15.7:0/3486415255 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0340041d0 con 0x55ea79a13b40 2024-09-19T08:49:01.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.512+0000 7fd0217fa640 1 -- 172.21.15.7:0/3486415255 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd0280b8a70 con 0x55ea79a13b40 2024-09-19T08:49:01.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.512+0000 7fd04222a740 10 client.16230 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:49:01.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.512+0000 7fd04222a740 10 client.16230 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:01.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.512+0000 7fd04222a740 20 client.16230 populate_metadata read hostname 'smithi007' 2024-09-19T08:49:01.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.512+0000 7fd04222a740 1 --2- 172.21.15.7:0/3486415255 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ea79a2cef0 0x55ea79a2f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:01.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.512+0000 7fd04222a740 4 client.16230 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:49:01.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.512+0000 7fd04222a740 1 -- 172.21.15.7:0/3486415255 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea79985860 con 0x55ea79a2cef0 2024-09-19T08:49:01.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.512+0000 7fd03dbed640 1 --2- 172.21.15.7:0/3486415255 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ea79a2cef0 0x55ea79a2f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:01.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.512+0000 7fd0217fa640 10 client.16230 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:01.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.512+0000 7fd03dbed640 1 --2- 172.21.15.7:0/3486415255 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ea79a2cef0 0x55ea79a2f2e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de82334071e046df server_cookie=abe832bc8317dd83 in_seq=0 out_seq=0 2024-09-19T08:49:01.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.513+0000 7fd0217fa640 1 -- 172.21.15.7:0/3486415255 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ea79985860 con 0x55ea79a2cef0 2024-09-19T08:49:01.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.513+0000 7fd0217fa640 10 client.16230 handle_command_reply: tid=0 2024-09-19T08:49:01.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.513+0000 7fd04222a740 1 client.16230 shutdown 2024-09-19T08:49:01.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.513+0000 7fd04222a740 1 -- 172.21.15.7:0/3486415255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a13b40 msgr2=0x55ea79a19ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:01.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.513+0000 7fd04222a740 1 --2- 172.21.15.7:0/3486415255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a13b40 0x55ea79a19ff0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd0280ed8d0 tx=0x7fd028005b70 comp rx=0 tx=0).stop 2024-09-19T08:49:01.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.513+0000 7fd04222a740 1 -- 172.21.15.7:0/3486415255 shutdown_connections 2024-09-19T08:49:01.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.513+0000 7fd04222a740 1 --2- 172.21.15.7:0/3486415255 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ea79a2cef0 0x55ea79a2f2e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.513+0000 7fd04222a740 1 --2- 172.21.15.7:0/3486415255 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea79a1d370 0x55ea79a1a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.513+0000 7fd04222a740 1 --2- 172.21.15.7:0/3486415255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a13b40 0x55ea79a19ff0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.513+0000 7fd04222a740 1 --2- 172.21.15.7:0/3486415255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea79a125d0 0x55ea79a1cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.513+0000 7fd04222a740 1 -- 172.21.15.7:0/3486415255 >> 172.21.15.7:0/3486415255 conn(0x55ea799db310 msgr2=0x55ea79a14960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:01.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.513+0000 7fd0217fa640 0 client.16230 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:01.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.513+0000 7fd04222a740 1 -- 172.21.15.7:0/3486415255 shutdown_connections 2024-09-19T08:49:01.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.513+0000 7fd04222a740 1 -- 172.21.15.7:0/3486415255 wait complete. 2024-09-19T08:49:01.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.514+0000 7fd04222a740 20 client.16230 trim_cache size 0 max 16384 2024-09-19T08:49:01.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.527+0000 7fd04222a740 1 Processor -- start 2024-09-19T08:49:01.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.527+0000 7fd04222a740 1 -- start start 2024-09-19T08:49:01.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.527+0000 7fd04222a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea79a125d0 0x55ea79a0ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:01.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.527+0000 7fd04222a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a13b40 0x55ea79a29310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:01.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.527+0000 7fd04222a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea79a1d370 0x55ea79a34bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:01.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.527+0000 7fd04222a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd0381b0220 con 0x55ea79a13b40 2024-09-19T08:49:01.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.527+0000 7fd04222a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd0381adaf0 con 0x55ea79a1d370 2024-09-19T08:49:01.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.527+0000 7fd04222a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd0381ab940 con 0x55ea79a125d0 2024-09-19T08:49:01.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.527+0000 7fd03d3ec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a13b40 0x55ea79a29310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:01.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.527+0000 7fd03d3ec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a13b40 0x55ea79a29310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57240/0 (socket says 172.21.15.7:57240) 2024-09-19T08:49:01.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.527+0000 7fd03d3ec640 1 -- 172.21.15.7:0/2228084380 learned_addr learned my addr 172.21.15.7:0/2228084380 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:01.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.527+0000 7fd03dbed640 1 --2- 172.21.15.7:0/2228084380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea79a125d0 0x55ea79a0ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:01.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.527+0000 7fd03e3ee640 1 --2- 172.21.15.7:0/2228084380 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea79a1d370 0x55ea79a34bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:01.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.528+0000 7fd03d3ec640 1 -- 172.21.15.7:0/2228084380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea79a125d0 msgr2=0x55ea79a0ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:01.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.528+0000 7fd03d3ec640 1 --2- 172.21.15.7:0/2228084380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea79a125d0 0x55ea79a0ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.528+0000 7fd03d3ec640 1 -- 172.21.15.7:0/2228084380 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea79a1d370 msgr2=0x55ea79a34bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:01.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.528+0000 7fd03d3ec640 1 --2- 172.21.15.7:0/2228084380 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea79a1d370 0x55ea79a34bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.528+0000 7fd03d3ec640 1 -- 172.21.15.7:0/2228084380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea79a15120 con 0x55ea79a13b40 2024-09-19T08:49:01.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.528+0000 7fd03d3ec640 1 --2- 172.21.15.7:0/2228084380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a13b40 0x55ea79a29310 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd028009900 tx=0x7fd028009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a357dccf2d7a763 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:01.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.528+0000 7fd0237fe640 1 -- 172.21.15.7:0/2228084380 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0280da070 con 0x55ea79a13b40 2024-09-19T08:49:01.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.528+0000 7fd0237fe640 1 -- 172.21.15.7:0/2228084380 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0280c07b0 con 0x55ea79a13b40 2024-09-19T08:49:01.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.528+0000 7fd0237fe640 1 -- 172.21.15.7:0/2228084380 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028049070 con 0x55ea79a13b40 2024-09-19T08:49:01.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.529+0000 7fd04222a740 1 -- 172.21.15.7:0/2228084380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a13b40 msgr2=0x55ea79a29310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:01.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.529+0000 7fd04222a740 1 --2- 172.21.15.7:0/2228084380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a13b40 0x55ea79a29310 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd028009900 tx=0x7fd028009680 comp rx=0 tx=0).stop 2024-09-19T08:49:01.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.529+0000 7fd04222a740 1 -- 172.21.15.7:0/2228084380 shutdown_connections 2024-09-19T08:49:01.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.529+0000 7fd04222a740 1 --2- 172.21.15.7:0/2228084380 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea79a1d370 0x55ea79a34bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.529+0000 7fd04222a740 1 --2- 172.21.15.7:0/2228084380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a13b40 0x55ea79a29310 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.529+0000 7fd04222a740 1 --2- 172.21.15.7:0/2228084380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea79a125d0 0x55ea79a0ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.529+0000 7fd04222a740 1 -- 172.21.15.7:0/2228084380 >> 172.21.15.7:0/2228084380 conn(0x55ea799db310 msgr2=0x55ea79a0e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:01.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.529+0000 7fd04222a740 1 -- 172.21.15.7:0/2228084380 shutdown_connections 2024-09-19T08:49:01.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.529+0000 7fd04222a740 1 -- 172.21.15.7:0/2228084380 wait complete. 2024-09-19T08:49:01.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.529+0000 7fd04222a740 1 -- start start 2024-09-19T08:49:01.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.529+0000 7fd04222a740 1 Processor -- start 2024-09-19T08:49:01.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.530+0000 7fd04222a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea79a125d0 0x55ea79a25660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:01.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.530+0000 7fd04222a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a13b40 0x55ea79a25ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:01.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.530+0000 7fd04222a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea79a1d370 0x55ea79a22470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:01.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.530+0000 7fd04222a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd0381abfb0 con 0x55ea79a13b40 2024-09-19T08:49:01.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.530+0000 7fd04222a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd0381ad420 con 0x55ea79a1d370 2024-09-19T08:49:01.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.530+0000 7fd04222a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd0381ac680 con 0x55ea79a125d0 2024-09-19T08:49:01.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.530+0000 7fd04222a740 10 client.0 _ll_register_callbacks cb 0x7fd028031a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:01.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.530+0000 7fd03d3ec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a13b40 0x55ea79a25ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:01.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.530+0000 7fd03d3ec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a13b40 0x55ea79a25ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57248/0 (socket says 172.21.15.7:57248) 2024-09-19T08:49:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.530+0000 7fd03d3ec640 1 -- 172.21.15.7:0/1204319313 learned_addr learned my addr 172.21.15.7:0/1204319313 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.530+0000 7fd03dbed640 1 --2- 172.21.15.7:0/1204319313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea79a125d0 0x55ea79a25660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.530+0000 7fd03e3ee640 1 --2- 172.21.15.7:0/1204319313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea79a1d370 0x55ea79a22470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.530+0000 7fd03d3ec640 1 -- 172.21.15.7:0/1204319313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea79a125d0 msgr2=0x55ea79a25660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.530+0000 7fd03d3ec640 1 --2- 172.21.15.7:0/1204319313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea79a125d0 0x55ea79a25660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.530+0000 7fd03d3ec640 1 -- 172.21.15.7:0/1204319313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea79a1d370 msgr2=0x55ea79a22470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.530+0000 7fd03d3ec640 1 --2- 172.21.15.7:0/1204319313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea79a1d370 0x55ea79a22470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.530+0000 7fd03d3ec640 1 -- 172.21.15.7:0/1204319313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea79a22ca0 con 0x55ea79a13b40 2024-09-19T08:49:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.530+0000 7fd03d3ec640 1 --2- 172.21.15.7:0/1204319313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a13b40 0x55ea79a25ba0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fd0280b8dd0 tx=0x7fd0280ba910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318717edf24c6ae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.530+0000 7fd0217fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:49:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.530+0000 7fd0217fa640 1 -- 172.21.15.7:0/1204319313 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028049050 con 0x55ea79a13b40 2024-09-19T08:49:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.531+0000 7fd0217fa640 1 -- 172.21.15.7:0/1204319313 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fd0280b8a70 con 0x55ea79a13b40 2024-09-19T08:49:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.531+0000 7fd04222a740 1 -- 172.21.15.7:0/1204319313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0280c07b0 con 0x55ea79a13b40 2024-09-19T08:49:01.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.531+0000 7fd0217fa640 1 -- 172.21.15.7:0/1204319313 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd0280da070 con 0x55ea79a13b40 2024-09-19T08:49:01.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.531+0000 7fd04222a740 10 client.16236 fetch_fsmap learned FSMap version 25 2024-09-19T08:49:01.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.531+0000 7fd04222a740 1 -- 172.21.15.7:0/1204319313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ea79a22ca0 con 0x55ea79a13b40 2024-09-19T08:49:01.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.531+0000 7fd0217fa640 1 -- 172.21.15.7:0/1204319313 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0280c07b0 con 0x55ea79a13b40 2024-09-19T08:49:01.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.531+0000 7fd0217fa640 1 -- 172.21.15.7:0/1204319313 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd0280bb850 con 0x55ea79a13b40 2024-09-19T08:49:01.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.531+0000 7fd04222a740 10 client.16236 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:49:01.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.531+0000 7fd04222a740 10 client.16236 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:01.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.531+0000 7fd04222a740 20 client.16236 populate_metadata read hostname 'smithi007' 2024-09-19T08:49:01.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.531+0000 7fd04222a740 1 --2- 172.21.15.7:0/1204319313 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ea79a9ce20 0x55ea79a9f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:01.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.531+0000 7fd04222a740 4 client.16236 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:49:01.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.531+0000 7fd04222a740 1 -- 172.21.15.7:0/1204319313 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ea7997fd70 con 0x55ea79a9ce20 2024-09-19T08:49:01.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.531+0000 7fd03dbed640 1 --2- 172.21.15.7:0/1204319313 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ea79a9ce20 0x55ea79a9f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:01.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.532+0000 7fd03dbed640 1 --2- 172.21.15.7:0/1204319313 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ea79a9ce20 0x55ea79a9f210 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be9be5745f7dc1e2 server_cookie=bca0018a670d2035 in_seq=0 out_seq=0 2024-09-19T08:49:01.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.532+0000 7fd0217fa640 10 client.16236 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:01.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.532+0000 7fd0217fa640 1 -- 172.21.15.7:0/1204319313 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ea7997fd70 con 0x55ea79a9ce20 2024-09-19T08:49:01.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.532+0000 7fd0217fa640 10 client.16236 handle_command_reply: tid=0 2024-09-19T08:49:01.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.532+0000 7fd04222a740 1 client.16236 shutdown 2024-09-19T08:49:01.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.532+0000 7fd04222a740 1 -- 172.21.15.7:0/1204319313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a13b40 msgr2=0x55ea79a25ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:01.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.532+0000 7fd04222a740 1 --2- 172.21.15.7:0/1204319313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a13b40 0x55ea79a25ba0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fd0280b8dd0 tx=0x7fd0280ba910 comp rx=0 tx=0).stop 2024-09-19T08:49:01.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.532+0000 7fd04222a740 1 -- 172.21.15.7:0/1204319313 shutdown_connections 2024-09-19T08:49:01.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.532+0000 7fd04222a740 1 --2- 172.21.15.7:0/1204319313 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ea79a9ce20 0x55ea79a9f210 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.532+0000 7fd04222a740 1 --2- 172.21.15.7:0/1204319313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea79a1d370 0x55ea79a22470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.532+0000 7fd0217fa640 0 client.16236 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:01.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.532+0000 7fd04222a740 1 --2- 172.21.15.7:0/1204319313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ea79a13b40 0x55ea79a25ba0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.532+0000 7fd04222a740 1 --2- 172.21.15.7:0/1204319313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea79a125d0 0x55ea79a25660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.532+0000 7fd04222a740 1 -- 172.21.15.7:0/1204319313 >> 172.21.15.7:0/1204319313 conn(0x55ea799db310 msgr2=0x55ea79a1b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:01.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.532+0000 7fd04222a740 1 -- 172.21.15.7:0/1204319313 shutdown_connections 2024-09-19T08:49:01.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.532+0000 7fd04222a740 1 -- 172.21.15.7:0/1204319313 wait complete. 2024-09-19T08:49:01.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.532+0000 7fd04222a740 20 client.16236 trim_cache size 0 max 16384 2024-09-19T08:49:01.541 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:49:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.533+0000 7fd03fe51640 1 -- 172.21.15.7:0/350530673 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd0240a3430 msgr2=0x7fd0240a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.533+0000 7fd03fe51640 1 --2- 172.21.15.7:0/350530673 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd0240a3430 0x7fd0240a58f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd030005fd0 tx=0x7fd030004a40 comp rx=0 tx=0).stop 2024-09-19T08:49:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.533+0000 7fd03fe51640 1 -- 172.21.15.7:0/350530673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0381036e0 msgr2=0x7fd038198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.533+0000 7fd03fe51640 1 --2- 172.21.15.7:0/350530673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0381036e0 0x7fd038198ae0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd028005940 tx=0x7fd0280042f0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.533+0000 7fd03fe51640 1 -- 172.21.15.7:0/350530673 shutdown_connections 2024-09-19T08:49:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.533+0000 7fd03fe51640 1 --2- 172.21.15.7:0/350530673 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd0240a3430 0x7fd0240a58f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.533+0000 7fd03fe51640 1 --2- 172.21.15.7:0/350530673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0381082a0 0x7fd03819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.533+0000 7fd03fe51640 1 --2- 172.21.15.7:0/350530673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0381036e0 0x7fd038198ae0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.533+0000 7fd03fe51640 1 --2- 172.21.15.7:0/350530673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd038102d30 0x7fd0381985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.533+0000 7fd03fe51640 1 -- 172.21.15.7:0/350530673 >> 172.21.15.7:0/350530673 conn(0x7fd0380fc7d0 msgr2=0x7fd038105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.533+0000 7fd03fe51640 1 -- 172.21.15.7:0/350530673 shutdown_connections 2024-09-19T08:49:01.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:01.533+0000 7fd03fe51640 1 -- 172.21.15.7:0/350530673 wait complete. 2024-09-19T08:49:02.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:02 smithi007 ceph-mon[31221]: pgmap v138: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:02.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:02 smithi044 ceph-mon[35072]: pgmap v138: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:02.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:02 smithi175 ceph-mon[35688]: pgmap v138: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:03.339 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:49:03.340 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:49:03.611 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.081+0000 7f4a8e1e1640 1 -- 172.21.15.7:0/2775065646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a88103740 msgr2=0x7f4a88107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.081+0000 7f4a8e1e1640 1 --2- 172.21.15.7:0/2775065646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a88103740 0x7f4a88107b80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c009930 tx=0x7f4a7c02a420 comp rx=0 tx=0).stop 2024-09-19T08:49:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.081+0000 7f4a8e1e1640 1 -- 172.21.15.7:0/2775065646 shutdown_connections 2024-09-19T08:49:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.081+0000 7f4a8e1e1640 1 --2- 172.21.15.7:0/2775065646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a88108290 0x7f4a8810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.081+0000 7f4a8e1e1640 1 --2- 172.21.15.7:0/2775065646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a88103740 0x7f4a88107b80 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.081+0000 7f4a8e1e1640 1 --2- 172.21.15.7:0/2775065646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a88102d90 0x7f4a88103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.081+0000 7f4a8e1e1640 1 -- 172.21.15.7:0/2775065646 >> 172.21.15.7:0/2775065646 conn(0x7f4a880fc7d0 msgr2=0x7f4a880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.081+0000 7f4a8e1e1640 1 -- 172.21.15.7:0/2775065646 shutdown_connections 2024-09-19T08:49:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.081+0000 7f4a8e1e1640 1 -- 172.21.15.7:0/2775065646 wait complete. 2024-09-19T08:49:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.081+0000 7f4a8e1e1640 1 Processor -- start 2024-09-19T08:49:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.082+0000 7f4a8e1e1640 1 -- start start 2024-09-19T08:49:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.082+0000 7f4a8e1e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a88102d90 0x7f4a881009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.082+0000 7f4a8e1e1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a88103740 0x7f4a88100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.082+0000 7f4a8e1e1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a88108290 0x7f4a88101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.082+0000 7f4a8e1e1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4a88112080 con 0x7f4a88102d90 2024-09-19T08:49:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.082+0000 7f4a8e1e1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4a88111f00 con 0x7f4a88103740 2024-09-19T08:49:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.082+0000 7f4a8e1e1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4a88112200 con 0x7f4a88108290 2024-09-19T08:49:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.082+0000 7f4a877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a88102d90 0x7f4a881009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.082+0000 7f4a877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a88102d90 0x7f4a881009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41080/0 (socket says 172.21.15.7:41080) 2024-09-19T08:49:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.082+0000 7f4a877fe640 1 -- 172.21.15.7:0/4605933 learned_addr learned my addr 172.21.15.7:0/4605933 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.082+0000 7f4a86ffd640 1 --2- 172.21.15.7:0/4605933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a88103740 0x7f4a88100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.082+0000 7f4a87fff640 1 --2- 172.21.15.7:0/4605933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a88108290 0x7f4a88101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.082+0000 7f4a877fe640 1 -- 172.21.15.7:0/4605933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a88108290 msgr2=0x7f4a88101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.082+0000 7f4a877fe640 1 --2- 172.21.15.7:0/4605933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a88108290 0x7f4a88101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.082+0000 7f4a877fe640 1 -- 172.21.15.7:0/4605933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a88103740 msgr2=0x7f4a88100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.082+0000 7f4a877fe640 1 --2- 172.21.15.7:0/4605933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a88103740 0x7f4a88100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.082+0000 7f4a877fe640 1 -- 172.21.15.7:0/4605933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a881a6a60 con 0x7f4a88102d90 2024-09-19T08:49:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.083+0000 7f4a877fe640 1 --2- 172.21.15.7:0/4605933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a88102d90 0x7f4a881009f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4a7800cce0 tx=0x7f4a7800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:04.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.083+0000 7f4a84ff9640 1 -- 172.21.15.7:0/4605933 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a78004b20 con 0x7f4a88102d90 2024-09-19T08:49:04.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.083+0000 7f4a84ff9640 1 -- 172.21.15.7:0/4605933 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a78004cc0 con 0x7f4a88102d90 2024-09-19T08:49:04.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.083+0000 7f4a8e1e1640 1 -- 172.21.15.7:0/4605933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a881a6d50 con 0x7f4a88102d90 2024-09-19T08:49:04.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.083+0000 7f4a84ff9640 1 -- 172.21.15.7:0/4605933 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7800f7d0 con 0x7f4a88102d90 2024-09-19T08:49:04.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.083+0000 7f4a8e1e1640 1 -- 172.21.15.7:0/4605933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a881a7250 con 0x7f4a88102d90 2024-09-19T08:49:04.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.085+0000 7f4a84ff9640 1 -- 172.21.15.7:0/4605933 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f4a7800f970 con 0x7f4a88102d90 2024-09-19T08:49:04.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.085+0000 7f4a905ba740 1 Processor -- start 2024-09-19T08:49:04.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.085+0000 7f4a905ba740 1 -- start start 2024-09-19T08:49:04.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.086+0000 7f4a905ba740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d573c34b60 0x55d573c34f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:04.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.086+0000 7f4a905ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c35480 0x55d573c3f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:04.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.086+0000 7f4a905ba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d573c3fd40 0x55d573c42130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:04.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.086+0000 7f4a905ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d573b9a280 con 0x55d573c35480 2024-09-19T08:49:04.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.086+0000 7f4a905ba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d573b41b10 con 0x55d573c3fd40 2024-09-19T08:49:04.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.086+0000 7f4a905ba740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d573b96240 con 0x55d573c34b60 2024-09-19T08:49:04.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.086+0000 7f4a877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c35480 0x55d573c3f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:04.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.086+0000 7f4a877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c35480 0x55d573c3f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41086/0 (socket says 172.21.15.7:41086) 2024-09-19T08:49:04.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.086+0000 7f4a86ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d573c3fd40 0x55d573c42130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:04.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.086+0000 7f4a877fe640 1 -- 172.21.15.7:0/713171649 learned_addr learned my addr 172.21.15.7:0/713171649 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:04.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.086+0000 7f4a87fff640 1 --2- 172.21.15.7:0/713171649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d573c34b60 0x55d573c34f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:04.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.086+0000 7f4a86ffd640 1 -- 172.21.15.7:0/713171649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d573c34b60 msgr2=0x55d573c34f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:04.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.086+0000 7f4a86ffd640 1 --2- 172.21.15.7:0/713171649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d573c34b60 0x55d573c34f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.086+0000 7f4a86ffd640 1 -- 172.21.15.7:0/713171649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c35480 msgr2=0x55d573c3f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:04.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.086+0000 7f4a86ffd640 1 --2- 172.21.15.7:0/713171649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c35480 0x55d573c3f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.086+0000 7f4a86ffd640 1 -- 172.21.15.7:0/713171649 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d573b4e1f0 con 0x55d573c3fd40 2024-09-19T08:49:04.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.086+0000 7f4a84ff9640 1 --2- 172.21.15.7:0/4605933 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4a700a3430 0x7f4a700a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:04.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.086+0000 7f4a87fff640 1 --2- 172.21.15.7:0/713171649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d573c34b60 0x55d573c34f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:04.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.086+0000 7f4a84ff9640 1 -- 172.21.15.7:0/4605933 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f4a780cfdf0 con 0x7f4a88102d90 2024-09-19T08:49:04.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.086+0000 7f4a87fff640 1 --2- 172.21.15.7:0/4605933 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4a700a3430 0x7f4a700a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:04.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.086+0000 7f4a86ffd640 1 --2- 172.21.15.7:0/713171649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d573c3fd40 0x55d573c42130 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c009230 tx=0x7f4a7c005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de426644b98a536b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:04.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.087+0000 7f4a6dffb640 1 -- 172.21.15.7:0/713171649 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c035040 con 0x55d573c3fd40 2024-09-19T08:49:04.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.087+0000 7f4a6dffb640 1 -- 172.21.15.7:0/713171649 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a7c005520 con 0x55d573c3fd40 2024-09-19T08:49:04.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.087+0000 7f4a6dffb640 1 -- 172.21.15.7:0/713171649 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c003850 con 0x55d573c3fd40 2024-09-19T08:49:04.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.087+0000 7f4a905ba740 1 -- 172.21.15.7:0/713171649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d573c3fd40 msgr2=0x55d573c42130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:04.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.087+0000 7f4a87fff640 1 --2- 172.21.15.7:0/4605933 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4a700a3430 0x7f4a700a58f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4a80005fd0 tx=0x7f4a80005cf0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:04.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.087+0000 7f4a905ba740 1 --2- 172.21.15.7:0/713171649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d573c3fd40 0x55d573c42130 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c009230 tx=0x7f4a7c005fd0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.087+0000 7f4a905ba740 1 -- 172.21.15.7:0/713171649 shutdown_connections 2024-09-19T08:49:04.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.087+0000 7f4a905ba740 1 --2- 172.21.15.7:0/713171649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d573c3fd40 0x55d573c42130 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.087+0000 7f4a905ba740 1 --2- 172.21.15.7:0/713171649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c35480 0x55d573c3f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.087+0000 7f4a905ba740 1 --2- 172.21.15.7:0/713171649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d573c34b60 0x55d573c34f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.087+0000 7f4a905ba740 1 -- 172.21.15.7:0/713171649 >> 172.21.15.7:0/713171649 conn(0x55d573c310f0 msgr2=0x55d573c314d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:04.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.088+0000 7f4a905ba740 1 -- 172.21.15.7:0/713171649 shutdown_connections 2024-09-19T08:49:04.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.088+0000 7f4a905ba740 1 -- 172.21.15.7:0/713171649 wait complete. 2024-09-19T08:49:04.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.088+0000 7f4a905ba740 1 -- start start 2024-09-19T08:49:04.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.088+0000 7f4a905ba740 1 Processor -- start 2024-09-19T08:49:04.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.088+0000 7f4a905ba740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d573c34b60 0x55d573c3cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:04.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.088+0000 7f4a905ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c35480 0x55d573c3d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:04.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.088+0000 7f4a905ba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d573c3fd40 0x55d573c3d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:04.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.088+0000 7f4a905ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d573c42910 con 0x55d573c35480 2024-09-19T08:49:04.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.088+0000 7f4a905ba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d573b54f10 con 0x55d573c3fd40 2024-09-19T08:49:04.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.088+0000 7f4a905ba740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d573c42a90 con 0x55d573c34b60 2024-09-19T08:49:04.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.088+0000 7f4a905ba740 10 client.0 _ll_register_callbacks cb 0x55d573b1da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:04.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.089+0000 7f4a86ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c35480 0x55d573c3d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:04.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.089+0000 7f4a86ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c35480 0x55d573c3d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41088/0 (socket says 172.21.15.7:41088) 2024-09-19T08:49:04.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.089+0000 7f4a86ffd640 1 -- 172.21.15.7:0/3913918333 learned_addr learned my addr 172.21.15.7:0/3913918333 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:04.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.089+0000 7f4a87fff640 1 --2- 172.21.15.7:0/3913918333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d573c3fd40 0x55d573c3d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:04.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.089+0000 7f4a877fe640 1 --2- 172.21.15.7:0/3913918333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d573c34b60 0x55d573c3cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:04.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.089+0000 7f4a86ffd640 1 -- 172.21.15.7:0/3913918333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d573c34b60 msgr2=0x55d573c3cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:04.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.089+0000 7f4a86ffd640 1 --2- 172.21.15.7:0/3913918333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d573c34b60 0x55d573c3cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.089+0000 7f4a86ffd640 1 -- 172.21.15.7:0/3913918333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d573c3fd40 msgr2=0x55d573c3d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:04.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.089+0000 7f4a86ffd640 1 --2- 172.21.15.7:0/3913918333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d573c3fd40 0x55d573c3d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.089+0000 7f4a86ffd640 1 -- 172.21.15.7:0/3913918333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d57390b6a0 con 0x55d573c35480 2024-09-19T08:49:04.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.089+0000 7f4a877fe640 1 --2- 172.21.15.7:0/3913918333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d573c34b60 0x55d573c3cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:04.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.089+0000 7f4a86ffd640 1 --2- 172.21.15.7:0/3913918333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c35480 0x55d573c3d120 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c004530 tx=0x7f4a7c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d615b30cfcecef4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:04.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.089+0000 7f4a66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:49:04.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.089+0000 7f4a66ffd640 1 -- 172.21.15.7:0/3913918333 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c035070 con 0x55d573c35480 2024-09-19T08:49:04.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.089+0000 7f4a66ffd640 1 -- 172.21.15.7:0/3913918333 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f4a7c0049d0 con 0x55d573c35480 2024-09-19T08:49:04.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.089+0000 7f4a905ba740 1 -- 172.21.15.7:0/3913918333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a7c005520 con 0x55d573c35480 2024-09-19T08:49:04.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.090+0000 7f4a66ffd640 1 -- 172.21.15.7:0/3913918333 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4a7c004e30 con 0x55d573c35480 2024-09-19T08:49:04.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.090+0000 7f4a905ba740 10 client.16248 fetch_fsmap learned FSMap version 25 2024-09-19T08:49:04.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.090+0000 7f4a905ba740 1 -- 172.21.15.7:0/3913918333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d573c4e4e0 con 0x55d573c35480 2024-09-19T08:49:04.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.090+0000 7f4a66ffd640 1 -- 172.21.15.7:0/3913918333 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a7c005520 con 0x55d573c35480 2024-09-19T08:49:04.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.090+0000 7f4a66ffd640 1 -- 172.21.15.7:0/3913918333 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4a7c0315b0 con 0x55d573c35480 2024-09-19T08:49:04.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.090+0000 7f4a905ba740 10 client.16248 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:49:04.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.090+0000 7f4a905ba740 10 client.16248 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:04.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.090+0000 7f4a905ba740 20 client.16248 populate_metadata read hostname 'smithi007' 2024-09-19T08:49:04.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.090+0000 7f4a905ba740 1 --2- 172.21.15.7:0/3913918333 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d573c4f830 0x55d573c51c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:04.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.090+0000 7f4a905ba740 4 client.16248 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:49:04.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.090+0000 7f4a905ba740 1 -- 172.21.15.7:0/3913918333 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d573ba77f0 con 0x55d573c4f830 2024-09-19T08:49:04.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.090+0000 7f4a877fe640 1 --2- 172.21.15.7:0/3913918333 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d573c4f830 0x55d573c51c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:04.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.091+0000 7f4a66ffd640 10 client.16248 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:04.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.091+0000 7f4a877fe640 1 --2- 172.21.15.7:0/3913918333 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d573c4f830 0x55d573c51c20 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3784b5fdf57e51ab server_cookie=80113c6b56e886d6 in_seq=0 out_seq=0 2024-09-19T08:49:04.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.091+0000 7f4a66ffd640 1 -- 172.21.15.7:0/3913918333 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d573ba77f0 con 0x55d573c4f830 2024-09-19T08:49:04.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.091+0000 7f4a66ffd640 10 client.16248 handle_command_reply: tid=0 2024-09-19T08:49:04.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.091+0000 7f4a905ba740 1 client.16248 shutdown 2024-09-19T08:49:04.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.092+0000 7f4a905ba740 1 -- 172.21.15.7:0/3913918333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c35480 msgr2=0x55d573c3d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:04.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.092+0000 7f4a905ba740 1 --2- 172.21.15.7:0/3913918333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c35480 0x55d573c3d120 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c004530 tx=0x7f4a7c009260 comp rx=0 tx=0).stop 2024-09-19T08:49:04.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.092+0000 7f4a905ba740 1 -- 172.21.15.7:0/3913918333 shutdown_connections 2024-09-19T08:49:04.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.092+0000 7f4a905ba740 1 --2- 172.21.15.7:0/3913918333 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d573c4f830 0x55d573c51c20 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.092+0000 7f4a905ba740 1 --2- 172.21.15.7:0/3913918333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d573c3fd40 0x55d573c3d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.092+0000 7f4a66ffd640 0 client.16248 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:04.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.092+0000 7f4a905ba740 1 --2- 172.21.15.7:0/3913918333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c35480 0x55d573c3d120 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.092+0000 7f4a905ba740 1 --2- 172.21.15.7:0/3913918333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d573c34b60 0x55d573c3cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.092+0000 7f4a905ba740 1 -- 172.21.15.7:0/3913918333 >> 172.21.15.7:0/3913918333 conn(0x55d573c310f0 msgr2=0x55d573c36e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:04.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.092+0000 7f4a905ba740 1 -- 172.21.15.7:0/3913918333 shutdown_connections 2024-09-19T08:49:04.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.092+0000 7f4a905ba740 1 -- 172.21.15.7:0/3913918333 wait complete. 2024-09-19T08:49:04.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.092+0000 7f4a905ba740 20 client.16248 trim_cache size 0 max 16384 2024-09-19T08:49:04.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.109+0000 7f4a905ba740 1 Processor -- start 2024-09-19T08:49:04.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.109+0000 7f4a905ba740 1 -- start start 2024-09-19T08:49:04.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.109+0000 7f4a905ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c34b60 0x55d573c3d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:04.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.109+0000 7f4a905ba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d573c35480 0x55d573c571c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:04.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.109+0000 7f4a905ba740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d573c3fd40 0x55d573c57700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:04.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.109+0000 7f4a905ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4a881b2380 con 0x55d573c34b60 2024-09-19T08:49:04.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.109+0000 7f4a905ba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4a881afc50 con 0x55d573c35480 2024-09-19T08:49:04.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.109+0000 7f4a905ba740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4a881adaa0 con 0x55d573c3fd40 2024-09-19T08:49:04.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.110+0000 7f4a877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c34b60 0x55d573c3d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:04.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.110+0000 7f4a877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c34b60 0x55d573c3d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41094/0 (socket says 172.21.15.7:41094) 2024-09-19T08:49:04.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.110+0000 7f4a877fe640 1 -- 172.21.15.7:0/1003121165 learned_addr learned my addr 172.21.15.7:0/1003121165 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:04.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.110+0000 7f4a86ffd640 1 --2- 172.21.15.7:0/1003121165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d573c35480 0x55d573c571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:04.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.110+0000 7f4a87fff640 1 --2- 172.21.15.7:0/1003121165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d573c3fd40 0x55d573c57700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:04.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.110+0000 7f4a877fe640 1 -- 172.21.15.7:0/1003121165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d573c3fd40 msgr2=0x55d573c57700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:04.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.110+0000 7f4a877fe640 1 --2- 172.21.15.7:0/1003121165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d573c3fd40 0x55d573c57700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.110+0000 7f4a877fe640 1 -- 172.21.15.7:0/1003121165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d573c35480 msgr2=0x55d573c571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:04.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.110+0000 7f4a877fe640 1 --2- 172.21.15.7:0/1003121165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d573c35480 0x55d573c571c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.110+0000 7f4a877fe640 1 -- 172.21.15.7:0/1003121165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d573c30f20 con 0x55d573c34b60 2024-09-19T08:49:04.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.110+0000 7f4a877fe640 1 --2- 172.21.15.7:0/1003121165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c34b60 0x55d573c3d4b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4a78098a30 tx=0x7f4a780cf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12823d75ff6c50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:04.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.110+0000 7f4a6d7fa640 1 -- 172.21.15.7:0/1003121165 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7801d040 con 0x55d573c34b60 2024-09-19T08:49:04.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.110+0000 7f4a6d7fa640 1 -- 172.21.15.7:0/1003121165 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a7809c760 con 0x55d573c34b60 2024-09-19T08:49:04.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.110+0000 7f4a6d7fa640 1 -- 172.21.15.7:0/1003121165 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7809a360 con 0x55d573c34b60 2024-09-19T08:49:04.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.111+0000 7f4a905ba740 1 -- 172.21.15.7:0/1003121165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c34b60 msgr2=0x55d573c3d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:04.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.111+0000 7f4a905ba740 1 --2- 172.21.15.7:0/1003121165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c34b60 0x55d573c3d4b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4a78098a30 tx=0x7f4a780cf040 comp rx=0 tx=0).stop 2024-09-19T08:49:04.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.111+0000 7f4a905ba740 1 -- 172.21.15.7:0/1003121165 shutdown_connections 2024-09-19T08:49:04.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.111+0000 7f4a905ba740 1 --2- 172.21.15.7:0/1003121165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d573c3fd40 0x55d573c57700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.111+0000 7f4a905ba740 1 --2- 172.21.15.7:0/1003121165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d573c35480 0x55d573c571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.111+0000 7f4a905ba740 1 --2- 172.21.15.7:0/1003121165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c34b60 0x55d573c3d4b0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.111+0000 7f4a905ba740 1 -- 172.21.15.7:0/1003121165 >> 172.21.15.7:0/1003121165 conn(0x55d573c310f0 msgr2=0x55d573c36dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:04.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.111+0000 7f4a905ba740 1 -- 172.21.15.7:0/1003121165 shutdown_connections 2024-09-19T08:49:04.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.111+0000 7f4a905ba740 1 -- 172.21.15.7:0/1003121165 wait complete. 2024-09-19T08:49:04.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.111+0000 7f4a905ba740 1 -- start start 2024-09-19T08:49:04.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.112+0000 7f4a905ba740 1 Processor -- start 2024-09-19T08:49:04.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.112+0000 7f4a905ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c34b60 0x55d573c43eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:04.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.112+0000 7f4a905ba740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d573c35480 0x55d573c443f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:04.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.112+0000 7f4a905ba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d573c3fd40 0x55d573cb9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:04.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.112+0000 7f4a905ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4a881ae110 con 0x55d573c34b60 2024-09-19T08:49:04.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.112+0000 7f4a905ba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4a881af580 con 0x55d573c3fd40 2024-09-19T08:49:04.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.112+0000 7f4a905ba740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4a881ae7e0 con 0x55d573c35480 2024-09-19T08:49:04.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.112+0000 7f4a905ba740 10 client.0 _ll_register_callbacks cb 0x7f4a780d3770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:04.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.112+0000 7f4a877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c34b60 0x55d573c43eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:04.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.112+0000 7f4a877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c34b60 0x55d573c43eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41108/0 (socket says 172.21.15.7:41108) 2024-09-19T08:49:04.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.112+0000 7f4a877fe640 1 -- 172.21.15.7:0/3321835418 learned_addr learned my addr 172.21.15.7:0/3321835418 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:04.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.112+0000 7f4a86ffd640 1 --2- 172.21.15.7:0/3321835418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d573c35480 0x55d573c443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:04.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.112+0000 7f4a87fff640 1 --2- 172.21.15.7:0/3321835418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d573c3fd40 0x55d573cb9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:04.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.112+0000 7f4a877fe640 1 -- 172.21.15.7:0/3321835418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d573c35480 msgr2=0x55d573c443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:04.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.112+0000 7f4a877fe640 1 --2- 172.21.15.7:0/3321835418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d573c35480 0x55d573c443f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.112+0000 7f4a877fe640 1 -- 172.21.15.7:0/3321835418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d573c3fd40 msgr2=0x55d573cb9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:04.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.112+0000 7f4a877fe640 1 --2- 172.21.15.7:0/3321835418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d573c3fd40 0x55d573cb9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.112+0000 7f4a877fe640 1 -- 172.21.15.7:0/3321835418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d573cb96d0 con 0x55d573c34b60 2024-09-19T08:49:04.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.112+0000 7f4a87fff640 1 --2- 172.21.15.7:0/3321835418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d573c3fd40 0x55d573cb9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:04.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.112+0000 7f4a877fe640 1 --2- 172.21.15.7:0/3321835418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c34b60 0x55d573c43eb0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4a78005bc0 tx=0x7f4a7809bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9773e6dc16a5f83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:04.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.112+0000 7f4a66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:49:04.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.113+0000 7f4a66ffd640 1 -- 172.21.15.7:0/3321835418 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7807f060 con 0x55d573c34b60 2024-09-19T08:49:04.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.113+0000 7f4a66ffd640 1 -- 172.21.15.7:0/3321835418 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f4a780bc050 con 0x55d573c34b60 2024-09-19T08:49:04.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.113+0000 7f4a905ba740 1 -- 172.21.15.7:0/3321835418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a7809c760 con 0x55d573c34b60 2024-09-19T08:49:04.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.113+0000 7f4a66ffd640 1 -- 172.21.15.7:0/3321835418 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4a7801d040 con 0x55d573c34b60 2024-09-19T08:49:04.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.113+0000 7f4a905ba740 10 client.16254 fetch_fsmap learned FSMap version 25 2024-09-19T08:49:04.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.113+0000 7f4a905ba740 1 -- 172.21.15.7:0/3321835418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d573cba8d0 con 0x55d573c34b60 2024-09-19T08:49:04.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.113+0000 7f4a66ffd640 1 -- 172.21.15.7:0/3321835418 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a7809c760 con 0x55d573c34b60 2024-09-19T08:49:04.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.113+0000 7f4a66ffd640 1 -- 172.21.15.7:0/3321835418 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4a780986d0 con 0x55d573c34b60 2024-09-19T08:49:04.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.113+0000 7f4a905ba740 10 client.16254 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:49:04.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.113+0000 7f4a905ba740 10 client.16254 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:04.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.113+0000 7f4a905ba740 20 client.16254 populate_metadata read hostname 'smithi007' 2024-09-19T08:49:04.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.113+0000 7f4a905ba740 1 --2- 172.21.15.7:0/3321835418 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d573c4f830 0x55d573cbd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:04.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.113+0000 7f4a905ba740 4 client.16254 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:49:04.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.113+0000 7f4a905ba740 1 -- 172.21.15.7:0/3321835418 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d573ba1d00 con 0x55d573c4f830 2024-09-19T08:49:04.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.113+0000 7f4a86ffd640 1 --2- 172.21.15.7:0/3321835418 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d573c4f830 0x55d573cbd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:04.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.114+0000 7f4a86ffd640 1 --2- 172.21.15.7:0/3321835418 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d573c4f830 0x55d573cbd090 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef4f445fbcea69b6 server_cookie=4a5513e985c990d7 in_seq=0 out_seq=0 2024-09-19T08:49:04.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.114+0000 7f4a66ffd640 10 client.16254 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:04.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.115+0000 7f4a66ffd640 1 -- 172.21.15.7:0/3321835418 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d573ba1d00 con 0x55d573c4f830 2024-09-19T08:49:04.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.115+0000 7f4a66ffd640 10 client.16254 handle_command_reply: tid=0 2024-09-19T08:49:04.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.115+0000 7f4a905ba740 1 client.16254 shutdown 2024-09-19T08:49:04.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.115+0000 7f4a905ba740 1 -- 172.21.15.7:0/3321835418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c34b60 msgr2=0x55d573c43eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:04.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.115+0000 7f4a905ba740 1 --2- 172.21.15.7:0/3321835418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c34b60 0x55d573c43eb0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4a78005bc0 tx=0x7f4a7809bc20 comp rx=0 tx=0).stop 2024-09-19T08:49:04.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.115+0000 7f4a905ba740 1 -- 172.21.15.7:0/3321835418 shutdown_connections 2024-09-19T08:49:04.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.115+0000 7f4a905ba740 1 --2- 172.21.15.7:0/3321835418 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d573c4f830 0x55d573cbd090 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.115+0000 7f4a905ba740 1 --2- 172.21.15.7:0/3321835418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d573c3fd40 0x55d573cb9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.115+0000 7f4a905ba740 1 --2- 172.21.15.7:0/3321835418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d573c35480 0x55d573c443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.115+0000 7f4a905ba740 1 --2- 172.21.15.7:0/3321835418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d573c34b60 0x55d573c43eb0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.115+0000 7f4a905ba740 1 -- 172.21.15.7:0/3321835418 >> 172.21.15.7:0/3321835418 conn(0x55d573c310f0 msgr2=0x55d573c2fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:04.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.115+0000 7f4a66ffd640 0 client.16254 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:04.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.115+0000 7f4a905ba740 1 -- 172.21.15.7:0/3321835418 shutdown_connections 2024-09-19T08:49:04.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.115+0000 7f4a905ba740 1 -- 172.21.15.7:0/3321835418 wait complete. 2024-09-19T08:49:04.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.116+0000 7f4a905ba740 20 client.16254 trim_cache size 0 max 16384 2024-09-19T08:49:04.121 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:49:04.121 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-19T08:49:04.121 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "da6f28b2-5f83-4c91-bdb9-663008d568e3", 2024-09-19T08:49:04.121 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-19T08:49:04.121 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:49:04.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.116+0000 7f4a8e1e1640 1 -- 172.21.15.7:0/4605933 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4a700a3430 msgr2=0x7f4a700a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:04.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.116+0000 7f4a8e1e1640 1 --2- 172.21.15.7:0/4605933 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4a700a3430 0x7f4a700a58f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4a80005fd0 tx=0x7f4a80005cf0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.116+0000 7f4a8e1e1640 1 -- 172.21.15.7:0/4605933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a88102d90 msgr2=0x7f4a881009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:04.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.116+0000 7f4a8e1e1640 1 --2- 172.21.15.7:0/4605933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a88102d90 0x7f4a881009f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4a7800cce0 tx=0x7f4a7800a620 comp rx=0 tx=0).stop 2024-09-19T08:49:04.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.116+0000 7f4a8e1e1640 1 -- 172.21.15.7:0/4605933 shutdown_connections 2024-09-19T08:49:04.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.116+0000 7f4a8e1e1640 1 --2- 172.21.15.7:0/4605933 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4a700a3430 0x7f4a700a58f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.116+0000 7f4a8e1e1640 1 --2- 172.21.15.7:0/4605933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a88108290 0x7f4a88101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.116+0000 7f4a8e1e1640 1 --2- 172.21.15.7:0/4605933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a88103740 0x7f4a88100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.116+0000 7f4a8e1e1640 1 --2- 172.21.15.7:0/4605933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a88102d90 0x7f4a881009f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:04.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.116+0000 7f4a8e1e1640 1 -- 172.21.15.7:0/4605933 >> 172.21.15.7:0/4605933 conn(0x7f4a880fc7d0 msgr2=0x7f4a88106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:04.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.116+0000 7f4a8e1e1640 1 -- 172.21.15.7:0/4605933 shutdown_connections 2024-09-19T08:49:04.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:04.116+0000 7f4a8e1e1640 1 -- 172.21.15.7:0/4605933 wait complete. 2024-09-19T08:49:04.753 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:04 smithi007 ceph-mon[31221]: pgmap v139: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:49:04.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:04 smithi044 ceph-mon[35072]: pgmap v139: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:49:04.853 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:49:04.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:04 smithi175 ceph-mon[35688]: pgmap v139: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:49:05.109 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:05.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:05 smithi007 ceph-mon[31221]: scrub queued for path: / 2024-09-19T08:49:05.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:05 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:49:05.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:05 smithi007 ceph-mon[31221]: scrub summary: active paths [/] 2024-09-19T08:49:05.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:05 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:49:05.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.615+0000 7f09e6743640 1 -- 172.21.15.7:0/290391797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09e0109120 msgr2=0x7f09e0110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:05.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.615+0000 7f09e6743640 1 --2- 172.21.15.7:0/290391797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09e0109120 0x7f09e0110ca0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009ca0 tx=0x7f09d802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.615+0000 7f09e6743640 1 -- 172.21.15.7:0/290391797 shutdown_connections 2024-09-19T08:49:05.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.615+0000 7f09e6743640 1 --2- 172.21.15.7:0/290391797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09e0109120 0x7f09e0110ca0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.615+0000 7f09e6743640 1 --2- 172.21.15.7:0/290391797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09e01049a0 0x7f09e01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.615+0000 7f09e6743640 1 --2- 172.21.15.7:0/290391797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09e0103ff0 0x7f09e01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.615+0000 7f09e6743640 1 -- 172.21.15.7:0/290391797 >> 172.21.15.7:0/290391797 conn(0x7f09e00ffab0 msgr2=0x7f09e0101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.615+0000 7f09e6743640 1 -- 172.21.15.7:0/290391797 shutdown_connections 2024-09-19T08:49:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.615+0000 7f09e6743640 1 -- 172.21.15.7:0/290391797 wait complete. 2024-09-19T08:49:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.615+0000 7f09e6743640 1 Processor -- start 2024-09-19T08:49:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.616+0000 7f09e6743640 1 -- start start 2024-09-19T08:49:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.616+0000 7f09e6743640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09e0103ff0 0x7f09e019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.616+0000 7f09e6743640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09e01049a0 0x7f09e019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.616+0000 7f09e6743640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09e0109120 0x7f09e019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.616+0000 7f09e6743640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f09e01141a0 con 0x7f09e0109120 2024-09-19T08:49:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.616+0000 7f09e6743640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f09e0114020 con 0x7f09e0103ff0 2024-09-19T08:49:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.616+0000 7f09e6743640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f09e0114320 con 0x7f09e01049a0 2024-09-19T08:49:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.616+0000 7f09e4ce0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09e0109120 0x7f09e019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.616+0000 7f09e4ce0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09e0109120 0x7f09e019eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41134/0 (socket says 172.21.15.7:41134) 2024-09-19T08:49:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.616+0000 7f09e4ce0640 1 -- 172.21.15.7:0/3391680624 learned_addr learned my addr 172.21.15.7:0/3391680624 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.616+0000 7f09dffff640 1 --2- 172.21.15.7:0/3391680624 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09e0103ff0 0x7f09e019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.616+0000 7f09df7fe640 1 --2- 172.21.15.7:0/3391680624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09e01049a0 0x7f09e019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.616+0000 7f09e4ce0640 1 -- 172.21.15.7:0/3391680624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09e01049a0 msgr2=0x7f09e019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.616+0000 7f09e4ce0640 1 --2- 172.21.15.7:0/3391680624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09e01049a0 0x7f09e019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.616+0000 7f09e4ce0640 1 -- 172.21.15.7:0/3391680624 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09e0103ff0 msgr2=0x7f09e019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.616+0000 7f09e4ce0640 1 --2- 172.21.15.7:0/3391680624 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09e0103ff0 0x7f09e019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.616+0000 7f09e4ce0640 1 -- 172.21.15.7:0/3391680624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e019f5b0 con 0x7f09e0109120 2024-09-19T08:49:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.616+0000 7f09df7fe640 1 --2- 172.21.15.7:0/3391680624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09e01049a0 0x7f09e019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:49:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.617+0000 7f09e4ce0640 1 --2- 172.21.15.7:0/3391680624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09e0109120 0x7f09e019eed0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f09d8031a20 tx=0x7f09d8031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:05.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.617+0000 7f09dd7fa640 1 -- 172.21.15.7:0/3391680624 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d8003c30 con 0x7f09e0109120 2024-09-19T08:49:05.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.617+0000 7f09e6743640 1 -- 172.21.15.7:0/3391680624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09e019f840 con 0x7f09e0109120 2024-09-19T08:49:05.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.617+0000 7f09dd7fa640 1 -- 172.21.15.7:0/3391680624 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09d8003dd0 con 0x7f09e0109120 2024-09-19T08:49:05.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.617+0000 7f09dd7fa640 1 -- 172.21.15.7:0/3391680624 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d802fcf0 con 0x7f09e0109120 2024-09-19T08:49:05.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.617+0000 7f09e6743640 1 -- 172.21.15.7:0/3391680624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09e01a7180 con 0x7f09e0109120 2024-09-19T08:49:05.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.619+0000 7f09dd7fa640 1 -- 172.21.15.7:0/3391680624 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f09d8004050 con 0x7f09e0109120 2024-09-19T08:49:05.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.619+0000 7f09e8b1c740 1 Processor -- start 2024-09-19T08:49:05.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.620+0000 7f09e8b1c740 1 -- start start 2024-09-19T08:49:05.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.620+0000 7f09e8b1c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae8b4a0 0x5596fae8b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:05.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.620+0000 7f09e8b1c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fae8bdc0 0x5596fae96140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:05.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.620+0000 7f09e8b1c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5596fae96680 0x5596fae98a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:05.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.620+0000 7f09e8b1c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5596fadf12e0 con 0x5596fae8b4a0 2024-09-19T08:49:05.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.620+0000 7f09e8b1c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5596fad98ce0 con 0x5596fae96680 2024-09-19T08:49:05.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.620+0000 7f09e8b1c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5596faded2a0 con 0x5596fae8bdc0 2024-09-19T08:49:05.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.620+0000 7f09df7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae8b4a0 0x5596fae8b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:05.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.621+0000 7f09df7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae8b4a0 0x5596fae8b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41150/0 (socket says 172.21.15.7:41150) 2024-09-19T08:49:05.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.621+0000 7f09df7fe640 1 -- 172.21.15.7:0/3088776601 learned_addr learned my addr 172.21.15.7:0/3088776601 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:05.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.621+0000 7f09dd7fa640 1 --2- 172.21.15.7:0/3391680624 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f09c80a33b0 0x7f09c80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:05.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.621+0000 7f09df7fe640 1 --2- 172.21.15.7:0/3088776601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5596fae96680 0x5596fae98a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:05.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.621+0000 7f09dffff640 1 --2- 172.21.15.7:0/3088776601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fae8bdc0 0x5596fae96140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:05.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.621+0000 7f09df7fe640 1 -- 172.21.15.7:0/3088776601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fae8bdc0 msgr2=0x5596fae96140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:05.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.621+0000 7f09df7fe640 1 --2- 172.21.15.7:0/3088776601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fae8bdc0 0x5596fae96140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.621+0000 7f09e4ce0640 1 --2- 172.21.15.7:0/3391680624 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f09c80a33b0 0x7f09c80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:05.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.621+0000 7f09df7fe640 1 -- 172.21.15.7:0/3088776601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5596fae96680 msgr2=0x5596fae98a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:05.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.621+0000 7f09df7fe640 1 --2- 172.21.15.7:0/3088776601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5596fae96680 0x5596fae98a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.621+0000 7f09dd7fa640 1 -- 172.21.15.7:0/3391680624 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f09d80f10e0 con 0x7f09e0109120 2024-09-19T08:49:05.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.621+0000 7f09df7fe640 1 -- 172.21.15.7:0/3088776601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596fad7d440 con 0x5596fae8b4a0 2024-09-19T08:49:05.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.621+0000 7f09df7fe640 1 --2- 172.21.15.7:0/3088776601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae8b4a0 0x5596fae8b880 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f09d400af90 tx=0x7f09d400a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac749182002a53aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:05.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.621+0000 7f09c67fc640 1 -- 172.21.15.7:0/3088776601 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d401b070 con 0x5596fae8b4a0 2024-09-19T08:49:05.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.622+0000 7f09c67fc640 1 -- 172.21.15.7:0/3088776601 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09d40168d0 con 0x5596fae8b4a0 2024-09-19T08:49:05.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.622+0000 7f09e4ce0640 1 --2- 172.21.15.7:0/3391680624 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f09c80a33b0 0x7f09c80a5870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f09d80eea80 tx=0x7f09d8005d80 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:05.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.622+0000 7f09c67fc640 1 -- 172.21.15.7:0/3088776601 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d400f040 con 0x5596fae8b4a0 2024-09-19T08:49:05.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.622+0000 7f09e8b1c740 1 -- 172.21.15.7:0/3088776601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae8b4a0 msgr2=0x5596fae8b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:05.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.622+0000 7f09e8b1c740 1 --2- 172.21.15.7:0/3088776601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae8b4a0 0x5596fae8b880 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f09d400af90 tx=0x7f09d400a410 comp rx=0 tx=0).stop 2024-09-19T08:49:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.622+0000 7f09e8b1c740 1 -- 172.21.15.7:0/3088776601 shutdown_connections 2024-09-19T08:49:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.622+0000 7f09e8b1c740 1 --2- 172.21.15.7:0/3088776601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5596fae96680 0x5596fae98a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.622+0000 7f09e8b1c740 1 --2- 172.21.15.7:0/3088776601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fae8bdc0 0x5596fae96140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.622+0000 7f09e8b1c740 1 --2- 172.21.15.7:0/3088776601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae8b4a0 0x5596fae8b880 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.622+0000 7f09e8b1c740 1 -- 172.21.15.7:0/3088776601 >> 172.21.15.7:0/3088776601 conn(0x5596fae87a30 msgr2=0x5596fae87e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.622+0000 7f09e8b1c740 1 -- 172.21.15.7:0/3088776601 shutdown_connections 2024-09-19T08:49:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.622+0000 7f09e8b1c740 1 -- 172.21.15.7:0/3088776601 wait complete. 2024-09-19T08:49:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.623+0000 7f09e8b1c740 1 -- start start 2024-09-19T08:49:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.623+0000 7f09e8b1c740 1 Processor -- start 2024-09-19T08:49:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.623+0000 7f09e8b1c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fae8b4a0 0x5596fae96030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.623+0000 7f09e8b1c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5596fae8bdc0 0x5596fae932e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.623+0000 7f09e8b1c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae96680 0x5596fae93880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.623+0000 7f09e8b1c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5596fae99250 con 0x5596fae96680 2024-09-19T08:49:05.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.623+0000 7f09e8b1c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5596fadac050 con 0x5596fae8bdc0 2024-09-19T08:49:05.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.623+0000 7f09e8b1c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5596fae993d0 con 0x5596fae8b4a0 2024-09-19T08:49:05.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.623+0000 7f09e8b1c740 10 client.0 _ll_register_callbacks cb 0x5596fadec160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:05.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.623+0000 7f09df7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae96680 0x5596fae93880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:05.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.623+0000 7f09df7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae96680 0x5596fae93880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41154/0 (socket says 172.21.15.7:41154) 2024-09-19T08:49:05.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.623+0000 7f09df7fe640 1 -- 172.21.15.7:0/3216602661 learned_addr learned my addr 172.21.15.7:0/3216602661 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:05.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.624+0000 7f09df7fe640 1 --2- 172.21.15.7:0/3216602661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fae8b4a0 0x5596fae96030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:05.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.624+0000 7f09dffff640 1 --2- 172.21.15.7:0/3216602661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5596fae8bdc0 0x5596fae932e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:05.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.624+0000 7f09df7fe640 1 -- 172.21.15.7:0/3216602661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fae8b4a0 msgr2=0x5596fae96030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:05.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.624+0000 7f09df7fe640 1 --2- 172.21.15.7:0/3216602661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fae8b4a0 0x5596fae96030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.624+0000 7f09df7fe640 1 -- 172.21.15.7:0/3216602661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5596fae8bdc0 msgr2=0x5596fae932e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:05.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.624+0000 7f09df7fe640 1 --2- 172.21.15.7:0/3216602661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5596fae8bdc0 0x5596fae932e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.624+0000 7f09df7fe640 1 -- 172.21.15.7:0/3216602661 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596fab623c0 con 0x5596fae96680 2024-09-19T08:49:05.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.624+0000 7f09dffff640 1 --2- 172.21.15.7:0/3216602661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5596fae8bdc0 0x5596fae932e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:05.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.624+0000 7f09df7fe640 1 --2- 172.21.15.7:0/3216602661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae96680 0x5596fae93880 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f09d4013450 tx=0x7f09d400a370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454508e3d98249e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:05.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.624+0000 7f09bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:49:05.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.624+0000 7f09bf7fe640 1 -- 172.21.15.7:0/3216602661 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d4029020 con 0x5596fae96680 2024-09-19T08:49:05.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.624+0000 7f09bf7fe640 1 -- 172.21.15.7:0/3216602661 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f09d40135b0 con 0x5596fae96680 2024-09-19T08:49:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.624+0000 7f09e8b1c740 1 -- 172.21.15.7:0/3216602661 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09d40168d0 con 0x5596fae96680 2024-09-19T08:49:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.624+0000 7f09bf7fe640 1 -- 172.21.15.7:0/3216602661 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f09d4034050 con 0x5596fae96680 2024-09-19T08:49:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.625+0000 7f09e8b1c740 10 client.16266 fetch_fsmap learned FSMap version 25 2024-09-19T08:49:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.625+0000 7f09e8b1c740 1 -- 172.21.15.7:0/3216602661 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5596faea4c60 con 0x5596fae96680 2024-09-19T08:49:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.625+0000 7f09bf7fe640 1 -- 172.21.15.7:0/3216602661 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09d40168d0 con 0x5596fae96680 2024-09-19T08:49:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.625+0000 7f09bf7fe640 1 -- 172.21.15.7:0/3216602661 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f09d4015030 con 0x5596fae96680 2024-09-19T08:49:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.625+0000 7f09e8b1c740 10 client.16266 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:49:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.625+0000 7f09e8b1c740 10 client.16266 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.625+0000 7f09e8b1c740 20 client.16266 populate_metadata read hostname 'smithi007' 2024-09-19T08:49:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.625+0000 7f09e8b1c740 1 --2- 172.21.15.7:0/3216602661 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5596faea6010 0x5596faea8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.625+0000 7f09e8b1c740 4 client.16266 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:49:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.625+0000 7f09e8b1c740 1 -- 172.21.15.7:0/3216602661 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596fadfe850 con 0x5596faea6010 2024-09-19T08:49:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.625+0000 7f09dffff640 1 --2- 172.21.15.7:0/3216602661 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5596faea6010 0x5596faea8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.626+0000 7f09dffff640 1 --2- 172.21.15.7:0/3216602661 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5596faea6010 0x5596faea8400 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=408b7b770880de34 server_cookie=f103158bbeeea7d3 in_seq=0 out_seq=0 2024-09-19T08:49:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.626+0000 7f09bf7fe640 10 client.16266 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.626+0000 7f09bf7fe640 1 -- 172.21.15.7:0/3216602661 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5596fadfe850 con 0x5596faea6010 2024-09-19T08:49:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.626+0000 7f09bf7fe640 10 client.16266 handle_command_reply: tid=0 2024-09-19T08:49:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.626+0000 7f09e8b1c740 1 client.16266 shutdown 2024-09-19T08:49:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.626+0000 7f09e8b1c740 1 -- 172.21.15.7:0/3216602661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae96680 msgr2=0x5596fae93880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.626+0000 7f09e8b1c740 1 --2- 172.21.15.7:0/3216602661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae96680 0x5596fae93880 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f09d4013450 tx=0x7f09d400a370 comp rx=0 tx=0).stop 2024-09-19T08:49:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.627+0000 7f09e8b1c740 1 -- 172.21.15.7:0/3216602661 shutdown_connections 2024-09-19T08:49:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.627+0000 7f09e8b1c740 1 --2- 172.21.15.7:0/3216602661 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5596faea6010 0x5596faea8400 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.627+0000 7f09e8b1c740 1 --2- 172.21.15.7:0/3216602661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae96680 0x5596fae93880 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.627+0000 7f09e8b1c740 1 --2- 172.21.15.7:0/3216602661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5596fae8bdc0 0x5596fae932e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.627+0000 7f09e8b1c740 1 --2- 172.21.15.7:0/3216602661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fae8b4a0 0x5596fae96030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.627+0000 7f09e8b1c740 1 -- 172.21.15.7:0/3216602661 >> 172.21.15.7:0/3216602661 conn(0x5596fae87a30 msgr2=0x5596fae8d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.627+0000 7f09bf7fe640 0 client.16266 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:05.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.627+0000 7f09e8b1c740 1 -- 172.21.15.7:0/3216602661 shutdown_connections 2024-09-19T08:49:05.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.627+0000 7f09e8b1c740 1 -- 172.21.15.7:0/3216602661 wait complete. 2024-09-19T08:49:05.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.627+0000 7f09e8b1c740 20 client.16266 trim_cache size 0 max 16384 2024-09-19T08:49:05.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.644+0000 7f09e8b1c740 1 Processor -- start 2024-09-19T08:49:05.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.644+0000 7f09e8b1c740 1 -- start start 2024-09-19T08:49:05.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.644+0000 7f09e8b1c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5596fae8b4a0 0x5596faea24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:05.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.644+0000 7f09e8b1c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae8bdc0 0x5596fae91bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:05.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.644+0000 7f09e8b1c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fae96680 0x5596fae95250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:05.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.644+0000 7f09e8b1c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f09e01b23a0 con 0x5596fae8bdc0 2024-09-19T08:49:05.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.644+0000 7f09e8b1c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f09e01afc70 con 0x5596fae8b4a0 2024-09-19T08:49:05.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.644+0000 7f09e8b1c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f09e01adac0 con 0x5596fae96680 2024-09-19T08:49:05.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.644+0000 7f09dffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae8bdc0 0x5596fae91bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:05.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.644+0000 7f09dffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae8bdc0 0x5596fae91bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41158/0 (socket says 172.21.15.7:41158) 2024-09-19T08:49:05.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.644+0000 7f09dffff640 1 -- 172.21.15.7:0/1656762759 learned_addr learned my addr 172.21.15.7:0/1656762759 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:05.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.644+0000 7f09df7fe640 1 --2- 172.21.15.7:0/1656762759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5596fae8b4a0 0x5596faea24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:05.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.644+0000 7f09dffff640 1 -- 172.21.15.7:0/1656762759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fae96680 msgr2=0x5596fae95250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:05.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.644+0000 7f09dffff640 1 --2- 172.21.15.7:0/1656762759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fae96680 0x5596fae95250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.644+0000 7f09dffff640 1 -- 172.21.15.7:0/1656762759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5596fae8b4a0 msgr2=0x5596faea24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:05.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.644+0000 7f09dffff640 1 --2- 172.21.15.7:0/1656762759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5596fae8b4a0 0x5596faea24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.645+0000 7f09dffff640 1 -- 172.21.15.7:0/1656762759 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596fae98de0 con 0x5596fae8bdc0 2024-09-19T08:49:05.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.645+0000 7f09df7fe640 1 --2- 172.21.15.7:0/1656762759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5596fae8b4a0 0x5596faea24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:05.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.645+0000 7f09dffff640 1 --2- 172.21.15.7:0/1656762759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae8bdc0 0x5596fae91bd0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x5596fae88890 tx=0x7f09d000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3157861a0d16528 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:05.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.645+0000 7f09c5ffb640 1 -- 172.21.15.7:0/1656762759 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d0003ed0 con 0x5596fae8bdc0 2024-09-19T08:49:05.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.645+0000 7f09c5ffb640 1 -- 172.21.15.7:0/1656762759 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09d0005500 con 0x5596fae8bdc0 2024-09-19T08:49:05.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.645+0000 7f09c5ffb640 1 -- 172.21.15.7:0/1656762759 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d0011710 con 0x5596fae8bdc0 2024-09-19T08:49:05.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.646+0000 7f09e8b1c740 1 -- 172.21.15.7:0/1656762759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae8bdc0 msgr2=0x5596fae91bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:05.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.646+0000 7f09e8b1c740 1 --2- 172.21.15.7:0/1656762759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae8bdc0 0x5596fae91bd0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x5596fae88890 tx=0x7f09d000b390 comp rx=0 tx=0).stop 2024-09-19T08:49:05.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.646+0000 7f09e8b1c740 1 -- 172.21.15.7:0/1656762759 shutdown_connections 2024-09-19T08:49:05.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.646+0000 7f09e8b1c740 1 --2- 172.21.15.7:0/1656762759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fae96680 0x5596fae95250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.646+0000 7f09e8b1c740 1 --2- 172.21.15.7:0/1656762759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae8bdc0 0x5596fae91bd0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.646+0000 7f09e8b1c740 1 --2- 172.21.15.7:0/1656762759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5596fae8b4a0 0x5596faea24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.646+0000 7f09e8b1c740 1 -- 172.21.15.7:0/1656762759 >> 172.21.15.7:0/1656762759 conn(0x5596fae87a30 msgr2=0x5596fae94b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.646+0000 7f09e8b1c740 1 -- 172.21.15.7:0/1656762759 shutdown_connections 2024-09-19T08:49:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.646+0000 7f09e8b1c740 1 -- 172.21.15.7:0/1656762759 wait complete. 2024-09-19T08:49:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.646+0000 7f09e8b1c740 1 -- start start 2024-09-19T08:49:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.646+0000 7f09e8b1c740 1 Processor -- start 2024-09-19T08:49:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.646+0000 7f09e8b1c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae8b4a0 0x5596fae90510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.646+0000 7f09e8b1c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fae8bdc0 0x5596fae90a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.647+0000 7f09e8b1c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5596fae96680 0x5596fae90f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.647+0000 7f09e8b1c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f09e01ae130 con 0x5596fae8b4a0 2024-09-19T08:49:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.647+0000 7f09e8b1c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f09e01af5a0 con 0x5596fae96680 2024-09-19T08:49:05.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.647+0000 7f09e8b1c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f09e01ae800 con 0x5596fae8bdc0 2024-09-19T08:49:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.647+0000 7f09e8b1c740 10 client.0 _ll_register_callbacks cb 0x7f09d4019070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.647+0000 7f09df7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae8b4a0 0x5596fae90510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.647+0000 7f09df7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae8b4a0 0x5596fae90510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41166/0 (socket says 172.21.15.7:41166) 2024-09-19T08:49:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.647+0000 7f09df7fe640 1 -- 172.21.15.7:0/3729003725 learned_addr learned my addr 172.21.15.7:0/3729003725 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.647+0000 7f09dffff640 1 --2- 172.21.15.7:0/3729003725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fae8bdc0 0x5596fae90a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.647+0000 7f09df7fe640 1 -- 172.21.15.7:0/3729003725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fae8bdc0 msgr2=0x5596fae90a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.647+0000 7f09df7fe640 1 --2- 172.21.15.7:0/3729003725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fae8bdc0 0x5596fae90a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.647+0000 7f09df7fe640 1 -- 172.21.15.7:0/3729003725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5596fae96680 msgr2=0x5596fae90f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.647+0000 7f09df7fe640 1 --2- 172.21.15.7:0/3729003725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5596fae96680 0x5596fae90f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.647+0000 7f09df7fe640 1 -- 172.21.15.7:0/3729003725 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596fae963a0 con 0x5596fae8b4a0 2024-09-19T08:49:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.647+0000 7f09df7fe640 1 --2- 172.21.15.7:0/3729003725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae8b4a0 0x5596fae90510 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f09d4013450 tx=0x7f09d400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460e31de03a052a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:05.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.647+0000 7f09bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:49:05.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.647+0000 7f09bf7fe640 1 -- 172.21.15.7:0/3729003725 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d403d060 con 0x5596fae8b4a0 2024-09-19T08:49:05.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.647+0000 7f09bf7fe640 1 -- 172.21.15.7:0/3729003725 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f09d4016700 con 0x5596fae8b4a0 2024-09-19T08:49:05.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.647+0000 7f09e8b1c740 1 -- 172.21.15.7:0/3729003725 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09d0005500 con 0x5596fae8b4a0 2024-09-19T08:49:05.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.648+0000 7f09bf7fe640 1 -- 172.21.15.7:0/3729003725 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f09d4029030 con 0x5596fae8b4a0 2024-09-19T08:49:05.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.648+0000 7f09e8b1c740 10 client.16272 fetch_fsmap learned FSMap version 25 2024-09-19T08:49:05.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.648+0000 7f09e8b1c740 1 -- 172.21.15.7:0/3729003725 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5596faf10e60 con 0x5596fae8b4a0 2024-09-19T08:49:05.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.648+0000 7f09bf7fe640 1 -- 172.21.15.7:0/3729003725 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09d0005500 con 0x5596fae8b4a0 2024-09-19T08:49:05.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.648+0000 7f09bf7fe640 1 -- 172.21.15.7:0/3729003725 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f09d4015040 con 0x5596fae8b4a0 2024-09-19T08:49:05.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.648+0000 7f09e8b1c740 10 client.16272 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:49:05.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.648+0000 7f09e8b1c740 10 client.16272 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:05.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.648+0000 7f09e8b1c740 20 client.16272 populate_metadata read hostname 'smithi007' 2024-09-19T08:49:05.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.648+0000 7f09e8b1c740 1 --2- 172.21.15.7:0/3729003725 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5596faf11520 0x5596faf13910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:05.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.648+0000 7f09e8b1c740 4 client.16272 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:49:05.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.648+0000 7f09e8b1c740 1 -- 172.21.15.7:0/3729003725 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5596fadf8d60 con 0x5596faf11520 2024-09-19T08:49:05.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.648+0000 7f09dffff640 1 --2- 172.21.15.7:0/3729003725 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5596faf11520 0x5596faf13910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:05.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.649+0000 7f09dffff640 1 --2- 172.21.15.7:0/3729003725 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5596faf11520 0x5596faf13910 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c247f20179a610b5 server_cookie=4f39b25eecf58453 in_seq=0 out_seq=0 2024-09-19T08:49:05.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.649+0000 7f09bf7fe640 10 client.16272 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.649+0000 7f09bf7fe640 1 -- 172.21.15.7:0/3729003725 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5596fadf8d60 con 0x5596faf11520 2024-09-19T08:49:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.649+0000 7f09bf7fe640 10 client.16272 handle_command_reply: tid=0 2024-09-19T08:49:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.649+0000 7f09e8b1c740 1 client.16272 shutdown 2024-09-19T08:49:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.649+0000 7f09e8b1c740 1 -- 172.21.15.7:0/3729003725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae8b4a0 msgr2=0x5596fae90510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.649+0000 7f09e8b1c740 1 --2- 172.21.15.7:0/3729003725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae8b4a0 0x5596fae90510 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f09d4013450 tx=0x7f09d400ed10 comp rx=0 tx=0).stop 2024-09-19T08:49:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.649+0000 7f09e8b1c740 1 -- 172.21.15.7:0/3729003725 shutdown_connections 2024-09-19T08:49:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.649+0000 7f09e8b1c740 1 --2- 172.21.15.7:0/3729003725 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5596faf11520 0x5596faf13910 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.649+0000 7f09e8b1c740 1 --2- 172.21.15.7:0/3729003725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5596fae96680 0x5596fae90f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.649+0000 7f09e8b1c740 1 --2- 172.21.15.7:0/3729003725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5596fae8bdc0 0x5596fae90a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.649+0000 7f09e8b1c740 1 --2- 172.21.15.7:0/3729003725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5596fae8b4a0 0x5596fae90510 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.649+0000 7f09e8b1c740 1 -- 172.21.15.7:0/3729003725 >> 172.21.15.7:0/3729003725 conn(0x5596fae87a30 msgr2=0x5596faea14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.649+0000 7f09bf7fe640 0 client.16272 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.649+0000 7f09e8b1c740 1 -- 172.21.15.7:0/3729003725 shutdown_connections 2024-09-19T08:49:05.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.649+0000 7f09e8b1c740 1 -- 172.21.15.7:0/3729003725 wait complete. 2024-09-19T08:49:05.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.649+0000 7f09e8b1c740 20 client.16272 trim_cache size 0 max 16384 2024-09-19T08:49:05.656 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:49:05.656 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:49:05.656 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-19T08:49:05.656 INFO:teuthology.orchestra.run.smithi007.stdout: "da6f28b2-5f83-4c91-bdb9-663008d568e3": { 2024-09-19T08:49:05.656 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-19T08:49:05.656 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "da6f28b2-5f83-4c91-bdb9-663008d568e3", 2024-09-19T08:49:05.656 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-19T08:49:05.656 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:49:05.657 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:49:05.657 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:49:05.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.650+0000 7f09e6743640 1 -- 172.21.15.7:0/3391680624 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f09c80a33b0 msgr2=0x7f09c80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:05.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.650+0000 7f09e6743640 1 --2- 172.21.15.7:0/3391680624 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f09c80a33b0 0x7f09c80a5870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f09d80eea80 tx=0x7f09d8005d80 comp rx=0 tx=0).stop 2024-09-19T08:49:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.650+0000 7f09e6743640 1 -- 172.21.15.7:0/3391680624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09e0109120 msgr2=0x7f09e019eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.650+0000 7f09e6743640 1 --2- 172.21.15.7:0/3391680624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09e0109120 0x7f09e019eed0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f09d8031a20 tx=0x7f09d8031a50 comp rx=0 tx=0).stop 2024-09-19T08:49:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.650+0000 7f09e6743640 1 -- 172.21.15.7:0/3391680624 shutdown_connections 2024-09-19T08:49:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.650+0000 7f09e6743640 1 --2- 172.21.15.7:0/3391680624 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f09c80a33b0 0x7f09c80a5870 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.650+0000 7f09e6743640 1 --2- 172.21.15.7:0/3391680624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09e0109120 0x7f09e019eed0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.650+0000 7f09e6743640 1 --2- 172.21.15.7:0/3391680624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09e01049a0 0x7f09e019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.650+0000 7f09e6743640 1 --2- 172.21.15.7:0/3391680624 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09e0103ff0 0x7f09e019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.650+0000 7f09e6743640 1 -- 172.21.15.7:0/3391680624 >> 172.21.15.7:0/3391680624 conn(0x7f09e00ffab0 msgr2=0x7f09e0101dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.650+0000 7f09e6743640 1 -- 172.21.15.7:0/3391680624 shutdown_connections 2024-09-19T08:49:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:05.650+0000 7f09e6743640 1 -- 172.21.15.7:0/3391680624 wait complete. 2024-09-19T08:49:05.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:05 smithi044 ceph-mon[35072]: scrub queued for path: / 2024-09-19T08:49:05.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:05 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:49:05.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:05 smithi044 ceph-mon[35072]: scrub summary: active paths [/] 2024-09-19T08:49:05.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:05 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:49:05.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:05 smithi175 ceph-mon[35688]: scrub queued for path: / 2024-09-19T08:49:05.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:05 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:49:05.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:05 smithi175 ceph-mon[35688]: scrub summary: active paths [/] 2024-09-19T08:49:05.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:05 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:49:06.512 INFO:tasks.cephfs.filesystem:scrub status for tag:da6f28b2-5f83-4c91-bdb9-663008d568e3 - {'path': '/', 'tag': 'da6f28b2-5f83-4c91-bdb9-663008d568e3', 'options': 'recursive,force'} 2024-09-19T08:49:06.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:06 smithi007 ceph-mon[31221]: pgmap v140: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T08:49:06.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:06 smithi044 ceph-mon[35072]: pgmap v140: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T08:49:06.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:06 smithi175 ceph-mon[35688]: pgmap v140: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T08:49:08.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:08 smithi007 ceph-mon[31221]: pgmap v141: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:49:08.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:08 smithi044 ceph-mon[35072]: pgmap v141: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:49:08.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:08 smithi175 ceph-mon[35688]: pgmap v141: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:49:09.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:09 smithi007 ceph-mon[31221]: scrub summary: idle 2024-09-19T08:49:09.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:09 smithi044 ceph-mon[35072]: scrub summary: idle 2024-09-19T08:49:09.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:09 smithi175 ceph-mon[35688]: scrub summary: idle 2024-09-19T08:49:10.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:10 smithi007 ceph-mon[31221]: pgmap v142: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T08:49:10.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:10 smithi044 ceph-mon[35072]: pgmap v142: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T08:49:10.829 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:10 smithi175 ceph-mon[35688]: pgmap v142: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T08:49:12.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:12 smithi007 ceph-mon[31221]: pgmap v143: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T08:49:12.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:12 smithi044 ceph-mon[35072]: pgmap v143: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T08:49:12.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:12 smithi175 ceph-mon[35688]: pgmap v143: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T08:49:14.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:14 smithi007 ceph-mon[31221]: pgmap v144: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:49:14.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:14 smithi044 ceph-mon[35072]: pgmap v144: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:49:14.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:14 smithi175 ceph-mon[35688]: pgmap v144: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:49:16.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:16 smithi007 ceph-mon[31221]: pgmap v145: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T08:49:16.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:16 smithi044 ceph-mon[35072]: pgmap v145: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T08:49:16.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:16 smithi175 ceph-mon[35688]: pgmap v145: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T08:49:18.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:18 smithi007 ceph-mon[31221]: pgmap v146: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T08:49:18.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:18 smithi044 ceph-mon[35072]: pgmap v146: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T08:49:18.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:18 smithi175 ceph-mon[35688]: pgmap v146: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T08:49:20.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:20 smithi007 ceph-mon[31221]: pgmap v147: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:49:20.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:20 smithi044 ceph-mon[35072]: pgmap v147: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:49:20.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:20 smithi175 ceph-mon[35688]: pgmap v147: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:49:22.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:22 smithi007 ceph-mon[31221]: pgmap v148: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:49:22.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:22 smithi044 ceph-mon[35072]: pgmap v148: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:49:22.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:22 smithi175 ceph-mon[35688]: pgmap v148: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:49:24.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:24 smithi007 ceph-mon[31221]: pgmap v149: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T08:49:24.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:24 smithi044 ceph-mon[35072]: pgmap v149: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T08:49:24.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:24 smithi175 ceph-mon[35688]: pgmap v149: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T08:49:26.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:26 smithi007 ceph-mon[31221]: pgmap v150: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:26.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:26 smithi044 ceph-mon[35072]: pgmap v150: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:26.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:26 smithi175 ceph-mon[35688]: pgmap v150: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:28.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:28 smithi007 ceph-mon[31221]: pgmap v151: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:49:28.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:28 smithi044 ceph-mon[35072]: pgmap v151: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:49:28.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:28 smithi175 ceph-mon[35688]: pgmap v151: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:49:30.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:30 smithi007 ceph-mon[31221]: pgmap v152: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:30.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:30 smithi044 ceph-mon[35072]: pgmap v152: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:30.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:30 smithi175 ceph-mon[35688]: pgmap v152: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:32.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:32 smithi007 ceph-mon[31221]: pgmap v153: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:32.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:32 smithi044 ceph-mon[35072]: pgmap v153: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:32.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:32 smithi175 ceph-mon[35688]: pgmap v153: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:34.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:34 smithi007 ceph-mon[31221]: pgmap v154: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:49:34.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:34 smithi044 ceph-mon[35072]: pgmap v154: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:49:34.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:34 smithi175 ceph-mon[35688]: pgmap v154: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:49:36.514 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:49:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:36 smithi007 ceph-mon[31221]: pgmap v155: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:36.789 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:36.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:36 smithi044 ceph-mon[35072]: pgmap v155: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:36.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:36 smithi175 ceph-mon[35688]: pgmap v155: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.363+0000 7f0caee1d640 1 -- 172.21.15.7:0/995671125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ca8102570 msgr2=0x7f0ca81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.363+0000 7f0caee1d640 1 --2- 172.21.15.7:0/995671125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ca8102570 0x7f0ca81029b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009900 tx=0x7f0c9402a480 comp rx=0 tx=0).stop 2024-09-19T08:49:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.363+0000 7f0caee1d640 1 -- 172.21.15.7:0/995671125 shutdown_connections 2024-09-19T08:49:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.363+0000 7f0caee1d640 1 --2- 172.21.15.7:0/995671125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ca8102ef0 0x7f0ca810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.363+0000 7f0caee1d640 1 --2- 172.21.15.7:0/995671125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ca8102570 0x7f0ca81029b0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.363+0000 7f0caee1d640 1 --2- 172.21.15.7:0/995671125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ca8100e20 0x7f0ca8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.363+0000 7f0caee1d640 1 -- 172.21.15.7:0/995671125 >> 172.21.15.7:0/995671125 conn(0x7f0ca80fc7d0 msgr2=0x7f0ca80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:37.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.363+0000 7f0caee1d640 1 -- 172.21.15.7:0/995671125 shutdown_connections 2024-09-19T08:49:37.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.363+0000 7f0caee1d640 1 -- 172.21.15.7:0/995671125 wait complete. 2024-09-19T08:49:37.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.364+0000 7f0caee1d640 1 Processor -- start 2024-09-19T08:49:37.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.364+0000 7f0caee1d640 1 -- start start 2024-09-19T08:49:37.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.364+0000 7f0caee1d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ca8100e20 0x7f0ca819e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:37.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.364+0000 7f0caee1d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ca8102570 0x7f0ca819e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:37.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.364+0000 7f0caee1d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ca8102ef0 0x7f0ca8198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:37.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.364+0000 7f0caee1d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca8110f80 con 0x7f0ca8102570 2024-09-19T08:49:37.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.364+0000 7f0caee1d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca8110e00 con 0x7f0ca8100e20 2024-09-19T08:49:37.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.364+0000 7f0caee1d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca8111100 con 0x7f0ca8102ef0 2024-09-19T08:49:37.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.364+0000 7f0ca7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ca8102570 0x7f0ca819e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:37.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.364+0000 7f0ca7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ca8102570 0x7f0ca819e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40782/0 (socket says 172.21.15.7:40782) 2024-09-19T08:49:37.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.364+0000 7f0ca7fff640 1 -- 172.21.15.7:0/967035259 learned_addr learned my addr 172.21.15.7:0/967035259 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:37.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.365+0000 7f0cacbb9640 1 --2- 172.21.15.7:0/967035259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ca8100e20 0x7f0ca819e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:37.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.365+0000 7f0cad3ba640 1 --2- 172.21.15.7:0/967035259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ca8102ef0 0x7f0ca8198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:37.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.365+0000 7f0ca7fff640 1 -- 172.21.15.7:0/967035259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ca8102ef0 msgr2=0x7f0ca8198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:37.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.365+0000 7f0ca7fff640 1 --2- 172.21.15.7:0/967035259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ca8102ef0 0x7f0ca8198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.365+0000 7f0ca7fff640 1 -- 172.21.15.7:0/967035259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ca8100e20 msgr2=0x7f0ca819e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:37.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.365+0000 7f0ca7fff640 1 --2- 172.21.15.7:0/967035259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ca8100e20 0x7f0ca819e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.365+0000 7f0ca7fff640 1 -- 172.21.15.7:0/967035259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca8198e50 con 0x7f0ca8102570 2024-09-19T08:49:37.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.365+0000 7f0cad3ba640 1 --2- 172.21.15.7:0/967035259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ca8102ef0 0x7f0ca8198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:49:37.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.365+0000 7f0cacbb9640 1 --2- 172.21.15.7:0/967035259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ca8100e20 0x7f0ca819e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:37.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.365+0000 7f0ca7fff640 1 --2- 172.21.15.7:0/967035259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ca8102570 0x7f0ca819e740 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0c94006010 tx=0x7f0c94003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:37.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.365+0000 7f0ca5ffb640 1 -- 172.21.15.7:0/967035259 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9403f070 con 0x7f0ca8102570 2024-09-19T08:49:37.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.365+0000 7f0caee1d640 1 -- 172.21.15.7:0/967035259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ca81990e0 con 0x7f0ca8102570 2024-09-19T08:49:37.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.365+0000 7f0ca5ffb640 1 -- 172.21.15.7:0/967035259 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c94031c30 con 0x7f0ca8102570 2024-09-19T08:49:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.365+0000 7f0ca5ffb640 1 -- 172.21.15.7:0/967035259 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c94035030 con 0x7f0ca8102570 2024-09-19T08:49:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.365+0000 7f0caee1d640 1 -- 172.21.15.7:0/967035259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ca81a4ff0 con 0x7f0ca8102570 2024-09-19T08:49:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.368+0000 7f0ca5ffb640 1 -- 172.21.15.7:0/967035259 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f0c94042070 con 0x7f0ca8102570 2024-09-19T08:49:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.368+0000 7f0cb11f6740 1 Processor -- start 2024-09-19T08:49:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.369+0000 7f0cb11f6740 1 -- start start 2024-09-19T08:49:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.369+0000 7f0cb11f6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3e8bcb4a0 0x55e3e8bcb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.369+0000 7f0cb11f6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3e8bcbdc0 0x55e3e8bd6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.369+0000 7f0cb11f6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bd6680 0x55e3e8bd8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.369+0000 7f0cb11f6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e3e8b312e0 con 0x55e3e8bd6680 2024-09-19T08:49:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.369+0000 7f0cb11f6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e3e8ad8ce0 con 0x55e3e8bcb4a0 2024-09-19T08:49:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.369+0000 7f0cb11f6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e3e8b2d2a0 con 0x55e3e8bcbdc0 2024-09-19T08:49:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.369+0000 7f0ca7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bd6680 0x55e3e8bd8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.369+0000 7f0cacbb9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3e8bcbdc0 0x55e3e8bd6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.369+0000 7f0ca7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bd6680 0x55e3e8bd8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40784/0 (socket says 172.21.15.7:40784) 2024-09-19T08:49:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.369+0000 7f0cad3ba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3e8bcb4a0 0x55e3e8bcb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.369+0000 7f0ca7fff640 1 -- 172.21.15.7:0/3515667432 learned_addr learned my addr 172.21.15.7:0/3515667432 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.369+0000 7f0ca5ffb640 1 --2- 172.21.15.7:0/967035259 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0c980a33b0 0x7f0c980a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.369+0000 7f0ca7fff640 1 -- 172.21.15.7:0/3515667432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3e8bcbdc0 msgr2=0x55e3e8bd6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.369+0000 7f0ca7fff640 1 --2- 172.21.15.7:0/3515667432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3e8bcbdc0 0x55e3e8bd6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.369+0000 7f0ca7fff640 1 -- 172.21.15.7:0/3515667432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3e8bcb4a0 msgr2=0x55e3e8bcb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.369+0000 7f0ca7fff640 1 --2- 172.21.15.7:0/3515667432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3e8bcb4a0 0x55e3e8bcb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.369+0000 7f0ca7fff640 1 -- 172.21.15.7:0/3515667432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3e8abd440 con 0x55e3e8bd6680 2024-09-19T08:49:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.369+0000 7f0cacbb9640 1 --2- 172.21.15.7:0/3515667432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3e8bcbdc0 0x55e3e8bd6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:49:37.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.369+0000 7f0cad3ba640 1 --2- 172.21.15.7:0/967035259 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0c980a33b0 0x7f0c980a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:37.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.370+0000 7f0ca5ffb640 1 -- 172.21.15.7:0/967035259 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f0c940f04f0 con 0x7f0ca8102570 2024-09-19T08:49:37.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.370+0000 7f0ca7fff640 1 --2- 172.21.15.7:0/3515667432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bd6680 0x55e3e8bd8a70 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f0c940edba0 tx=0x7f0c94087100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8b9a35da469258 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:37.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.370+0000 7f0c92ffd640 1 -- 172.21.15.7:0/3515667432 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c940bc300 con 0x55e3e8bd6680 2024-09-19T08:49:37.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.370+0000 7f0cad3ba640 1 --2- 172.21.15.7:0/967035259 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0c980a33b0 0x7f0c980a5870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0005fd0 tx=0x7f0ca0004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:37.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.370+0000 7f0c92ffd640 1 -- 172.21.15.7:0/3515667432 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c94087610 con 0x55e3e8bd6680 2024-09-19T08:49:37.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.370+0000 7f0c92ffd640 1 -- 172.21.15.7:0/3515667432 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c940bc120 con 0x55e3e8bd6680 2024-09-19T08:49:37.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.371+0000 7f0cb11f6740 1 -- 172.21.15.7:0/3515667432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bd6680 msgr2=0x55e3e8bd8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:37.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.371+0000 7f0cb11f6740 1 --2- 172.21.15.7:0/3515667432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bd6680 0x55e3e8bd8a70 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f0c940edba0 tx=0x7f0c94087100 comp rx=0 tx=0).stop 2024-09-19T08:49:37.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.371+0000 7f0cb11f6740 1 -- 172.21.15.7:0/3515667432 shutdown_connections 2024-09-19T08:49:37.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.371+0000 7f0cb11f6740 1 --2- 172.21.15.7:0/3515667432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bd6680 0x55e3e8bd8a70 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.371+0000 7f0cb11f6740 1 --2- 172.21.15.7:0/3515667432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3e8bcbdc0 0x55e3e8bd6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.371+0000 7f0cb11f6740 1 --2- 172.21.15.7:0/3515667432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3e8bcb4a0 0x55e3e8bcb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.371+0000 7f0cb11f6740 1 -- 172.21.15.7:0/3515667432 >> 172.21.15.7:0/3515667432 conn(0x55e3e8bc7a30 msgr2=0x55e3e8bc7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:37.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.371+0000 7f0cb11f6740 1 -- 172.21.15.7:0/3515667432 shutdown_connections 2024-09-19T08:49:37.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.371+0000 7f0cb11f6740 1 -- 172.21.15.7:0/3515667432 wait complete. 2024-09-19T08:49:37.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.371+0000 7f0cb11f6740 1 -- start start 2024-09-19T08:49:37.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.371+0000 7f0cb11f6740 1 Processor -- start 2024-09-19T08:49:37.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0cb11f6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3e8bcb4a0 0x55e3e8bd5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:37.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0cb11f6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3e8bcbdc0 0x55e3e8bd3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:37.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0cb11f6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bd6680 0x55e3e8bd3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:37.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0cb11f6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e3e8bd9010 con 0x55e3e8bd6680 2024-09-19T08:49:37.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0cb11f6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e3e8aec050 con 0x55e3e8bcbdc0 2024-09-19T08:49:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0cb11f6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e3e8bd9190 con 0x55e3e8bcb4a0 2024-09-19T08:49:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0cb11f6740 10 client.0 _ll_register_callbacks cb 0x55e3e8b2c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0cad3ba640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bd6680 0x55e3e8bd3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0cad3ba640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bd6680 0x55e3e8bd3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40790/0 (socket says 172.21.15.7:40790) 2024-09-19T08:49:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0cad3ba640 1 -- 172.21.15.7:0/2524870456 learned_addr learned my addr 172.21.15.7:0/2524870456 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0ca7fff640 1 --2- 172.21.15.7:0/2524870456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3e8bcbdc0 0x55e3e8bd3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0cacbb9640 1 --2- 172.21.15.7:0/2524870456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3e8bcb4a0 0x55e3e8bd5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0cad3ba640 1 -- 172.21.15.7:0/2524870456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3e8bcb4a0 msgr2=0x55e3e8bd5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0cad3ba640 1 --2- 172.21.15.7:0/2524870456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3e8bcb4a0 0x55e3e8bd5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0cad3ba640 1 -- 172.21.15.7:0/2524870456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3e8bcbdc0 msgr2=0x55e3e8bd3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0cad3ba640 1 --2- 172.21.15.7:0/2524870456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3e8bcbdc0 0x55e3e8bd3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0cad3ba640 1 -- 172.21.15.7:0/2524870456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3e88a23c0 con 0x55e3e8bd6680 2024-09-19T08:49:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0ca7fff640 1 --2- 172.21.15.7:0/2524870456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3e8bcbdc0 0x55e3e8bd3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:49:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0cad3ba640 1 --2- 172.21.15.7:0/2524870456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bd6680 0x55e3e8bd3760 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f0ca000fa10 tx=0x7f0ca0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9d26047be29def server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0c87fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:49:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0c87fff640 1 -- 172.21.15.7:0/2524870456 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0003970 con 0x55e3e8bd6680 2024-09-19T08:49:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0c87fff640 1 -- 172.21.15.7:0/2524870456 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f0ca0017070 con 0x55e3e8bd6680 2024-09-19T08:49:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.372+0000 7f0cb11f6740 1 -- 172.21.15.7:0/2524870456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c94087610 con 0x55e3e8bd6680 2024-09-19T08:49:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.373+0000 7f0c87fff640 1 -- 172.21.15.7:0/2524870456 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0ca0003b10 con 0x55e3e8bd6680 2024-09-19T08:49:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.373+0000 7f0cb11f6740 10 client.16284 fetch_fsmap learned FSMap version 25 2024-09-19T08:49:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.373+0000 7f0cb11f6740 1 -- 172.21.15.7:0/2524870456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e3e8be48f0 con 0x55e3e8bd6680 2024-09-19T08:49:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.373+0000 7f0c87fff640 1 -- 172.21.15.7:0/2524870456 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c94087610 con 0x55e3e8bd6680 2024-09-19T08:49:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.373+0000 7f0c87fff640 1 -- 172.21.15.7:0/2524870456 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0ca00043c0 con 0x55e3e8bd6680 2024-09-19T08:49:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.373+0000 7f0cb11f6740 10 client.16284 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:49:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.373+0000 7f0cb11f6740 10 client.16284 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.373+0000 7f0cb11f6740 20 client.16284 populate_metadata read hostname 'smithi007' 2024-09-19T08:49:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.373+0000 7f0cb11f6740 1 --2- 172.21.15.7:0/2524870456 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e3e8be5d00 0x55e3e8be8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.373+0000 7f0cb11f6740 4 client.16284 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:49:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.373+0000 7f0cb11f6740 1 -- 172.21.15.7:0/2524870456 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3e8b3e850 con 0x55e3e8be5d00 2024-09-19T08:49:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.374+0000 7f0cacbb9640 1 --2- 172.21.15.7:0/2524870456 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e3e8be5d00 0x55e3e8be8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.374+0000 7f0cacbb9640 1 --2- 172.21.15.7:0/2524870456 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e3e8be5d00 0x55e3e8be8130 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4e92656da070508 server_cookie=8af55576b5a8b1d5 in_seq=0 out_seq=0 2024-09-19T08:49:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.374+0000 7f0c87fff640 10 client.16284 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.375+0000 7f0c87fff640 1 -- 172.21.15.7:0/2524870456 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e3e8b3e850 con 0x55e3e8be5d00 2024-09-19T08:49:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.375+0000 7f0c87fff640 10 client.16284 handle_command_reply: tid=0 2024-09-19T08:49:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.375+0000 7f0cb11f6740 1 client.16284 shutdown 2024-09-19T08:49:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.375+0000 7f0cb11f6740 1 -- 172.21.15.7:0/2524870456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bd6680 msgr2=0x55e3e8bd3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.375+0000 7f0cb11f6740 1 --2- 172.21.15.7:0/2524870456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bd6680 0x55e3e8bd3760 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f0ca000fa10 tx=0x7f0ca0004ab0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.375+0000 7f0cb11f6740 1 -- 172.21.15.7:0/2524870456 shutdown_connections 2024-09-19T08:49:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.375+0000 7f0cb11f6740 1 --2- 172.21.15.7:0/2524870456 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e3e8be5d00 0x55e3e8be8130 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.375+0000 7f0cb11f6740 1 --2- 172.21.15.7:0/2524870456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bd6680 0x55e3e8bd3760 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.375+0000 7f0cb11f6740 1 --2- 172.21.15.7:0/2524870456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3e8bcbdc0 0x55e3e8bd3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.375+0000 7f0cb11f6740 1 --2- 172.21.15.7:0/2524870456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3e8bcb4a0 0x55e3e8bd5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.375+0000 7f0c87fff640 0 client.16284 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.375+0000 7f0cb11f6740 1 -- 172.21.15.7:0/2524870456 >> 172.21.15.7:0/2524870456 conn(0x55e3e8bc7a30 msgr2=0x55e3e8bcd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.375+0000 7f0cb11f6740 1 -- 172.21.15.7:0/2524870456 shutdown_connections 2024-09-19T08:49:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.375+0000 7f0cb11f6740 1 -- 172.21.15.7:0/2524870456 wait complete. 2024-09-19T08:49:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.375+0000 7f0cb11f6740 20 client.16284 trim_cache size 0 max 16384 2024-09-19T08:49:37.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.393+0000 7f0cb11f6740 1 Processor -- start 2024-09-19T08:49:37.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.393+0000 7f0cb11f6740 1 -- start start 2024-09-19T08:49:37.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.393+0000 7f0cb11f6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3e8bc7a30 0x55e3e8be21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:37.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.393+0000 7f0cb11f6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bcb4a0 0x55e3e8bd31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:37.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.393+0000 7f0cb11f6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3e8bcbdc0 0x55e3e8bce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:37.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.393+0000 7f0cb11f6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca81b01a0 con 0x55e3e8bcb4a0 2024-09-19T08:49:37.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.393+0000 7f0cb11f6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca81ada70 con 0x55e3e8bc7a30 2024-09-19T08:49:37.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.393+0000 7f0cb11f6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca81ab8c0 con 0x55e3e8bcbdc0 2024-09-19T08:49:37.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.393+0000 7f0ca7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bcb4a0 0x55e3e8bd31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:37.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.393+0000 7f0ca7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bcb4a0 0x55e3e8bd31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40792/0 (socket says 172.21.15.7:40792) 2024-09-19T08:49:37.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.393+0000 7f0ca7fff640 1 -- 172.21.15.7:0/1874685652 learned_addr learned my addr 172.21.15.7:0/1874685652 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:37.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.393+0000 7f0cacbb9640 1 --2- 172.21.15.7:0/1874685652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3e8bc7a30 0x55e3e8be21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:37.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.393+0000 7f0cad3ba640 1 --2- 172.21.15.7:0/1874685652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3e8bcbdc0 0x55e3e8bce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:37.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.393+0000 7f0ca7fff640 1 -- 172.21.15.7:0/1874685652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3e8bcbdc0 msgr2=0x55e3e8bce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:37.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.393+0000 7f0ca7fff640 1 --2- 172.21.15.7:0/1874685652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3e8bcbdc0 0x55e3e8bce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.393+0000 7f0ca7fff640 1 -- 172.21.15.7:0/1874685652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3e8bc7a30 msgr2=0x55e3e8be21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:37.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.393+0000 7f0ca7fff640 1 --2- 172.21.15.7:0/1874685652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3e8bc7a30 0x55e3e8be21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.393+0000 7f0ca7fff640 1 -- 172.21.15.7:0/1874685652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3e8bd62e0 con 0x55e3e8bcb4a0 2024-09-19T08:49:37.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.393+0000 7f0ca7fff640 1 --2- 172.21.15.7:0/1874685652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bcb4a0 0x55e3e8bd31e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f0c940b9190 tx=0x7f0c940a7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672f23e773018981 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:37.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.394+0000 7f0c927fc640 1 -- 172.21.15.7:0/1874685652 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c94049040 con 0x55e3e8bcb4a0 2024-09-19T08:49:37.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.394+0000 7f0c927fc640 1 -- 172.21.15.7:0/1874685652 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c94031de0 con 0x55e3e8bcb4a0 2024-09-19T08:49:37.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.394+0000 7f0c927fc640 1 -- 172.21.15.7:0/1874685652 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c940c0b70 con 0x55e3e8bcb4a0 2024-09-19T08:49:37.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.394+0000 7f0cb11f6740 1 -- 172.21.15.7:0/1874685652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bcb4a0 msgr2=0x55e3e8bd31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:37.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.394+0000 7f0cb11f6740 1 --2- 172.21.15.7:0/1874685652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bcb4a0 0x55e3e8bd31e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f0c940b9190 tx=0x7f0c940a7040 comp rx=0 tx=0).stop 2024-09-19T08:49:37.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.394+0000 7f0cb11f6740 1 -- 172.21.15.7:0/1874685652 shutdown_connections 2024-09-19T08:49:37.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.394+0000 7f0cb11f6740 1 --2- 172.21.15.7:0/1874685652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3e8bcbdc0 0x55e3e8bce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.394+0000 7f0cb11f6740 1 --2- 172.21.15.7:0/1874685652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bcb4a0 0x55e3e8bd31e0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.394+0000 7f0cb11f6740 1 --2- 172.21.15.7:0/1874685652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3e8bc7a30 0x55e3e8be21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.394+0000 7f0cb11f6740 1 -- 172.21.15.7:0/1874685652 >> 172.21.15.7:0/1874685652 conn(0x55e3e8bd38c0 msgr2=0x55e3e8bce090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:37.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.394+0000 7f0cb11f6740 1 -- 172.21.15.7:0/1874685652 shutdown_connections 2024-09-19T08:49:37.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.394+0000 7f0cb11f6740 1 -- 172.21.15.7:0/1874685652 wait complete. 2024-09-19T08:49:37.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.395+0000 7f0cb11f6740 1 -- start start 2024-09-19T08:49:37.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.395+0000 7f0cb11f6740 1 Processor -- start 2024-09-19T08:49:37.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.395+0000 7f0cb11f6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bc7a30 0x55e3e8bde9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:37.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.395+0000 7f0cb11f6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3e8bcb4a0 0x55e3e8bd9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:37.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.395+0000 7f0cb11f6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3e8bcbdc0 0x55e3e8bda210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:37.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.395+0000 7f0cb11f6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca81abf30 con 0x55e3e8bc7a30 2024-09-19T08:49:37.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.395+0000 7f0cb11f6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca81ad3a0 con 0x55e3e8bcbdc0 2024-09-19T08:49:37.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.395+0000 7f0cb11f6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca81ac600 con 0x55e3e8bcb4a0 2024-09-19T08:49:37.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.395+0000 7f0cb11f6740 10 client.0 _ll_register_callbacks cb 0x7f0ca0009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:37.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.395+0000 7f0cacbb9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bc7a30 0x55e3e8bde9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:37.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.395+0000 7f0cacbb9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bc7a30 0x55e3e8bde9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40796/0 (socket says 172.21.15.7:40796) 2024-09-19T08:49:37.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.395+0000 7f0cacbb9640 1 -- 172.21.15.7:0/361711540 learned_addr learned my addr 172.21.15.7:0/361711540 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:37.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.396+0000 7f0ca7fff640 1 --2- 172.21.15.7:0/361711540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3e8bcb4a0 0x55e3e8bd9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:37.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.396+0000 7f0cad3ba640 1 --2- 172.21.15.7:0/361711540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3e8bcbdc0 0x55e3e8bda210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:37.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.396+0000 7f0cacbb9640 1 -- 172.21.15.7:0/361711540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3e8bcb4a0 msgr2=0x55e3e8bd9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:37.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.396+0000 7f0cacbb9640 1 --2- 172.21.15.7:0/361711540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3e8bcb4a0 0x55e3e8bd9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.396+0000 7f0cacbb9640 1 -- 172.21.15.7:0/361711540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3e8bcbdc0 msgr2=0x55e3e8bda210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:37.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.396+0000 7f0cacbb9640 1 --2- 172.21.15.7:0/361711540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3e8bcbdc0 0x55e3e8bda210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.396+0000 7f0cacbb9640 1 -- 172.21.15.7:0/361711540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3e8bdaa40 con 0x55e3e8bc7a30 2024-09-19T08:49:37.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.396+0000 7f0cacbb9640 1 --2- 172.21.15.7:0/361711540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bc7a30 0x55e3e8bde9a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x55e3e8be8940 tx=0x7f0c9c012a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c43d33580b604a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:37.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.396+0000 7f0c87fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:49:37.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.396+0000 7f0c87fff640 1 -- 172.21.15.7:0/361711540 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c01fa70 con 0x55e3e8bc7a30 2024-09-19T08:49:37.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.396+0000 7f0c87fff640 1 -- 172.21.15.7:0/361711540 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f0c9c01fc10 con 0x55e3e8bc7a30 2024-09-19T08:49:37.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.396+0000 7f0cb11f6740 1 -- 172.21.15.7:0/361711540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c94031de0 con 0x55e3e8bc7a30 2024-09-19T08:49:37.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.396+0000 7f0c87fff640 1 -- 172.21.15.7:0/361711540 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0c9c034050 con 0x55e3e8bc7a30 2024-09-19T08:49:37.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.396+0000 7f0cb11f6740 10 client.16290 fetch_fsmap learned FSMap version 25 2024-09-19T08:49:37.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.396+0000 7f0cb11f6740 1 -- 172.21.15.7:0/361711540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e3e8c50990 con 0x55e3e8bc7a30 2024-09-19T08:49:37.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.396+0000 7f0c87fff640 1 -- 172.21.15.7:0/361711540 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c94031de0 con 0x55e3e8bc7a30 2024-09-19T08:49:37.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.397+0000 7f0c87fff640 1 -- 172.21.15.7:0/361711540 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0c9c026400 con 0x55e3e8bc7a30 2024-09-19T08:49:37.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.397+0000 7f0cb11f6740 10 client.16290 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:49:37.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.397+0000 7f0cb11f6740 10 client.16290 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:37.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.397+0000 7f0cb11f6740 20 client.16290 populate_metadata read hostname 'smithi007' 2024-09-19T08:49:37.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.397+0000 7f0cb11f6740 1 --2- 172.21.15.7:0/361711540 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e3e8bd6680 0x55e3e8c53190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:37.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.397+0000 7f0cb11f6740 4 client.16290 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:49:37.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.397+0000 7f0cb11f6740 1 -- 172.21.15.7:0/361711540 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e3e8b38d60 con 0x55e3e8bd6680 2024-09-19T08:49:37.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.397+0000 7f0ca7fff640 1 --2- 172.21.15.7:0/361711540 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e3e8bd6680 0x55e3e8c53190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:37.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.397+0000 7f0ca7fff640 1 --2- 172.21.15.7:0/361711540 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e3e8bd6680 0x55e3e8c53190 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=477d293c3648ef45 server_cookie=2298d2eab41b9e12 in_seq=0 out_seq=0 2024-09-19T08:49:37.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.397+0000 7f0c87fff640 10 client.16290 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:37.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.397+0000 7f0c87fff640 1 -- 172.21.15.7:0/361711540 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e3e8b38d60 con 0x55e3e8bd6680 2024-09-19T08:49:37.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.398+0000 7f0c87fff640 10 client.16290 handle_command_reply: tid=0 2024-09-19T08:49:37.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.398+0000 7f0cb11f6740 1 client.16290 shutdown 2024-09-19T08:49:37.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.398+0000 7f0cb11f6740 1 -- 172.21.15.7:0/361711540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bc7a30 msgr2=0x55e3e8bde9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:37.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.398+0000 7f0cb11f6740 1 --2- 172.21.15.7:0/361711540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bc7a30 0x55e3e8bde9a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x55e3e8be8940 tx=0x7f0c9c012a80 comp rx=0 tx=0).stop 2024-09-19T08:49:37.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.398+0000 7f0cb11f6740 1 -- 172.21.15.7:0/361711540 shutdown_connections 2024-09-19T08:49:37.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.398+0000 7f0cb11f6740 1 --2- 172.21.15.7:0/361711540 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e3e8bd6680 0x55e3e8c53190 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.398+0000 7f0cb11f6740 1 --2- 172.21.15.7:0/361711540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3e8bcbdc0 0x55e3e8bda210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.398+0000 7f0cb11f6740 1 --2- 172.21.15.7:0/361711540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3e8bcb4a0 0x55e3e8bd9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.398+0000 7f0cb11f6740 1 --2- 172.21.15.7:0/361711540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e8bc7a30 0x55e3e8bde9a0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.398+0000 7f0cb11f6740 1 -- 172.21.15.7:0/361711540 >> 172.21.15.7:0/361711540 conn(0x55e3e8bd38c0 msgr2=0x55e3e8bce870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:37.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.398+0000 7f0c87fff640 0 client.16290 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:37.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.398+0000 7f0cb11f6740 1 -- 172.21.15.7:0/361711540 shutdown_connections 2024-09-19T08:49:37.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.398+0000 7f0cb11f6740 1 -- 172.21.15.7:0/361711540 wait complete. 2024-09-19T08:49:37.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.398+0000 7f0cb11f6740 20 client.16290 trim_cache size 0 max 16384 2024-09-19T08:49:37.410 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:49:37.411 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-19T08:49:37.411 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-09-19T08:49:37.411 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:49:37.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.399+0000 7f0caee1d640 1 -- 172.21.15.7:0/967035259 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0c980a33b0 msgr2=0x7f0c980a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:37.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.399+0000 7f0caee1d640 1 --2- 172.21.15.7:0/967035259 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0c980a33b0 0x7f0c980a5870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0005fd0 tx=0x7f0ca0004a40 comp rx=0 tx=0).stop 2024-09-19T08:49:37.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.399+0000 7f0caee1d640 1 -- 172.21.15.7:0/967035259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ca8102570 msgr2=0x7f0ca819e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:37.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.399+0000 7f0caee1d640 1 --2- 172.21.15.7:0/967035259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ca8102570 0x7f0ca819e740 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0c94006010 tx=0x7f0c94003c10 comp rx=0 tx=0).stop 2024-09-19T08:49:37.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.399+0000 7f0caee1d640 1 -- 172.21.15.7:0/967035259 shutdown_connections 2024-09-19T08:49:37.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.399+0000 7f0caee1d640 1 --2- 172.21.15.7:0/967035259 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0c980a33b0 0x7f0c980a5870 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.399+0000 7f0caee1d640 1 --2- 172.21.15.7:0/967035259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ca8102ef0 0x7f0ca8198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.399+0000 7f0caee1d640 1 --2- 172.21.15.7:0/967035259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ca8102570 0x7f0ca819e740 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.399+0000 7f0caee1d640 1 --2- 172.21.15.7:0/967035259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ca8100e20 0x7f0ca819e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.399+0000 7f0caee1d640 1 -- 172.21.15.7:0/967035259 >> 172.21.15.7:0/967035259 conn(0x7f0ca80fc7d0 msgr2=0x7f0ca8103910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:37.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.399+0000 7f0caee1d640 1 -- 172.21.15.7:0/967035259 shutdown_connections 2024-09-19T08:49:37.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:37.399+0000 7f0caee1d640 1 -- 172.21.15.7:0/967035259 wait complete. 2024-09-19T08:49:38.222 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:49:38.222 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:49:38.481 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:38.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:38 smithi044 ceph-mon[35072]: pgmap v156: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:49:38.802 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:38 smithi007 ceph-mon[31221]: pgmap v156: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:49:38.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:38 smithi175 ceph-mon[35688]: pgmap v156: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:49:38.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.934+0000 7f67a3e97640 1 -- 172.21.15.7:0/93566066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f679c102570 msgr2=0x7f679c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:38.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.934+0000 7f67a3e97640 1 --2- 172.21.15.7:0/93566066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f679c102570 0x7f679c1029b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f678c009900 tx=0x7f678c02a480 comp rx=0 tx=0).stop 2024-09-19T08:49:38.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.934+0000 7f67a3e97640 1 -- 172.21.15.7:0/93566066 shutdown_connections 2024-09-19T08:49:38.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.934+0000 7f67a3e97640 1 --2- 172.21.15.7:0/93566066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f679c102ef0 0x7f679c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:38.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.934+0000 7f67a3e97640 1 --2- 172.21.15.7:0/93566066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f679c102570 0x7f679c1029b0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:38.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.934+0000 7f67a3e97640 1 --2- 172.21.15.7:0/93566066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f679c100e20 0x7f679c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:38.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.934+0000 7f67a3e97640 1 -- 172.21.15.7:0/93566066 >> 172.21.15.7:0/93566066 conn(0x7f679c0fc7d0 msgr2=0x7f679c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:38.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.934+0000 7f67a3e97640 1 -- 172.21.15.7:0/93566066 shutdown_connections 2024-09-19T08:49:38.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.934+0000 7f67a3e97640 1 -- 172.21.15.7:0/93566066 wait complete. 2024-09-19T08:49:38.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.934+0000 7f67a3e97640 1 Processor -- start 2024-09-19T08:49:38.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.934+0000 7f67a3e97640 1 -- start start 2024-09-19T08:49:38.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.935+0000 7f67a3e97640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f679c100e20 0x7f679c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:38.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.935+0000 7f67a3e97640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f679c102570 0x7f679c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:38.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.935+0000 7f67a3e97640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f679c102ef0 0x7f679c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:38.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.935+0000 7f67a3e97640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f679c110f50 con 0x7f679c102ef0 2024-09-19T08:49:38.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.935+0000 7f67a3e97640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f679c110dd0 con 0x7f679c100e20 2024-09-19T08:49:38.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.935+0000 7f67a3e97640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f679c1110d0 con 0x7f679c102570 2024-09-19T08:49:38.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.935+0000 7f67a2434640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f679c102ef0 0x7f679c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:38.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.935+0000 7f67a2434640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f679c102ef0 0x7f679c0fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40814/0 (socket says 172.21.15.7:40814) 2024-09-19T08:49:38.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.935+0000 7f67a2434640 1 -- 172.21.15.7:0/3486616994 learned_addr learned my addr 172.21.15.7:0/3486616994 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:38.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.935+0000 7f67a1c33640 1 --2- 172.21.15.7:0/3486616994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f679c100e20 0x7f679c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:38.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.935+0000 7f67a1432640 1 --2- 172.21.15.7:0/3486616994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f679c102570 0x7f679c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:38.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.935+0000 7f67a2434640 1 -- 172.21.15.7:0/3486616994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f679c102570 msgr2=0x7f679c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:38.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.935+0000 7f67a2434640 1 --2- 172.21.15.7:0/3486616994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f679c102570 0x7f679c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:38.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.935+0000 7f67a2434640 1 -- 172.21.15.7:0/3486616994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f679c100e20 msgr2=0x7f679c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:38.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.935+0000 7f67a2434640 1 --2- 172.21.15.7:0/3486616994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f679c100e20 0x7f679c0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:38.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.935+0000 7f67a2434640 1 -- 172.21.15.7:0/3486616994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679c1a6a60 con 0x7f679c102ef0 2024-09-19T08:49:38.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.935+0000 7f67a1432640 1 --2- 172.21.15.7:0/3486616994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f679c102570 0x7f679c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:38.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.935+0000 7f67a2434640 1 --2- 172.21.15.7:0/3486616994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f679c102ef0 0x7f679c0fd700 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f679400eb10 tx=0x7f679400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:38.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.936+0000 7f6792ffd640 1 -- 172.21.15.7:0/3486616994 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794004b20 con 0x7f679c102ef0 2024-09-19T08:49:38.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.936+0000 7f6792ffd640 1 -- 172.21.15.7:0/3486616994 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6794004cc0 con 0x7f679c102ef0 2024-09-19T08:49:38.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.936+0000 7f67a3e97640 1 -- 172.21.15.7:0/3486616994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679c1a6d50 con 0x7f679c102ef0 2024-09-19T08:49:38.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.936+0000 7f6792ffd640 1 -- 172.21.15.7:0/3486616994 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794010760 con 0x7f679c102ef0 2024-09-19T08:49:38.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.936+0000 7f67a3e97640 1 -- 172.21.15.7:0/3486616994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f679c1a7290 con 0x7f679c102ef0 2024-09-19T08:49:38.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.937+0000 7f67a3e97640 1 -- 172.21.15.7:0/3486616994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f679c101200 con 0x7f679c102ef0 2024-09-19T08:49:38.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.938+0000 7f6792ffd640 1 -- 172.21.15.7:0/3486616994 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f6794010900 con 0x7f679c102ef0 2024-09-19T08:49:38.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.939+0000 7f6792ffd640 1 --2- 172.21.15.7:0/3486616994 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f67880a3430 0x7f67880a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:38.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.939+0000 7f6792ffd640 1 -- 172.21.15.7:0/3486616994 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f67940d0460 con 0x7f679c102ef0 2024-09-19T08:49:38.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.939+0000 7f67a1c33640 1 --2- 172.21.15.7:0/3486616994 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f67880a3430 0x7f67880a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:38.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.939+0000 7f67a1c33640 1 --2- 172.21.15.7:0/3486616994 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f67880a3430 0x7f67880a58f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6798005d00 tx=0x7f679800b410 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:38.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:38.942+0000 7f6792ffd640 1 -- 172.21.15.7:0/3486616994 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6794054210 con 0x7f679c102ef0 2024-09-19T08:49:39.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:39.156+0000 7f67a3e97640 1 -- 172.21.15.7:0/3486616994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f679c0fe1b0 con 0x7f679c102ef0 2024-09-19T08:49:39.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:39.156+0000 7f6792ffd640 1 -- 172.21.15.7:0/3486616994 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f679c0fe1b0 con 0x7f679c102ef0 2024-09-19T08:49:39.157 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:49:39.158 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:49:39.158 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:49:39.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:39.159+0000 7f67a3e97640 1 -- 172.21.15.7:0/3486616994 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f67880a3430 msgr2=0x7f67880a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:39.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:39.159+0000 7f67a3e97640 1 --2- 172.21.15.7:0/3486616994 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f67880a3430 0x7f67880a58f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6798005d00 tx=0x7f679800b410 comp rx=0 tx=0).stop 2024-09-19T08:49:39.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:39.159+0000 7f67a3e97640 1 -- 172.21.15.7:0/3486616994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f679c102ef0 msgr2=0x7f679c0fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:39.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:39.159+0000 7f67a3e97640 1 --2- 172.21.15.7:0/3486616994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f679c102ef0 0x7f679c0fd700 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f679400eb10 tx=0x7f679400c2d0 comp rx=0 tx=0).stop 2024-09-19T08:49:39.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:39.159+0000 7f67a3e97640 1 -- 172.21.15.7:0/3486616994 shutdown_connections 2024-09-19T08:49:39.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:39.159+0000 7f67a3e97640 1 --2- 172.21.15.7:0/3486616994 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f67880a3430 0x7f67880a58f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:39.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:39.159+0000 7f67a3e97640 1 --2- 172.21.15.7:0/3486616994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f679c102ef0 0x7f679c0fd700 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:39.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:39.159+0000 7f67a3e97640 1 --2- 172.21.15.7:0/3486616994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f679c102570 0x7f679c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:39.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:39.159+0000 7f67a3e97640 1 --2- 172.21.15.7:0/3486616994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f679c100e20 0x7f679c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:39.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:39.159+0000 7f67a3e97640 1 -- 172.21.15.7:0/3486616994 >> 172.21.15.7:0/3486616994 conn(0x7f679c0fc7d0 msgr2=0x7f679c06a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:39.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:39.159+0000 7f67a3e97640 1 -- 172.21.15.7:0/3486616994 shutdown_connections 2024-09-19T08:49:39.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:39.159+0000 7f67a3e97640 1 -- 172.21.15.7:0/3486616994 wait complete. 2024-09-19T08:49:39.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:39 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3486616994' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:39.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:39 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3486616994' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:39.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:39 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3486616994' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:39.947 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:49:40.206 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:40.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:40 smithi007 ceph-mon[31221]: pgmap v157: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:40.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.712+0000 7feb32566640 1 -- 172.21.15.7:0/1939742790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb2c100a70 msgr2=0x7feb2c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:40.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.712+0000 7feb32566640 1 --2- 172.21.15.7:0/1939742790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb2c100a70 0x7feb2c100ed0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7feb20009930 tx=0x7feb2002a420 comp rx=0 tx=0).stop 2024-09-19T08:49:40.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.712+0000 7feb32566640 1 -- 172.21.15.7:0/1939742790 shutdown_connections 2024-09-19T08:49:40.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.712+0000 7feb32566640 1 --2- 172.21.15.7:0/1939742790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb2c101410 0x7feb2c10d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.712+0000 7feb32566640 1 --2- 172.21.15.7:0/1939742790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb2c100a70 0x7feb2c100ed0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.712+0000 7feb32566640 1 --2- 172.21.15.7:0/1939742790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb2c106a70 0x7feb2c106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.712+0000 7feb32566640 1 -- 172.21.15.7:0/1939742790 >> 172.21.15.7:0/1939742790 conn(0x7feb2c0fc790 msgr2=0x7feb2c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:40.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.712+0000 7feb32566640 1 -- 172.21.15.7:0/1939742790 shutdown_connections 2024-09-19T08:49:40.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.712+0000 7feb32566640 1 -- 172.21.15.7:0/1939742790 wait complete. 2024-09-19T08:49:40.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.713+0000 7feb32566640 1 Processor -- start 2024-09-19T08:49:40.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.713+0000 7feb32566640 1 -- start start 2024-09-19T08:49:40.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.713+0000 7feb32566640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb2c100a70 0x7feb2c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:40.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.713+0000 7feb32566640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb2c101410 0x7feb2c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:40.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.713+0000 7feb32566640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb2c106a70 0x7feb2c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:40.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.713+0000 7feb32566640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c110e70 con 0x7feb2c106a70 2024-09-19T08:49:40.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.713+0000 7feb32566640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c110cf0 con 0x7feb2c100a70 2024-09-19T08:49:40.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.713+0000 7feb32566640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c110ff0 con 0x7feb2c101410 2024-09-19T08:49:40.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.713+0000 7feb30b03640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb2c106a70 0x7feb2c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:40.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.713+0000 7feb30b03640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb2c106a70 0x7feb2c19ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40828/0 (socket says 172.21.15.7:40828) 2024-09-19T08:49:40.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.713+0000 7feb30b03640 1 -- 172.21.15.7:0/2700223295 learned_addr learned my addr 172.21.15.7:0/2700223295 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:40.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.713+0000 7feb2bfff640 1 --2- 172.21.15.7:0/2700223295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb2c100a70 0x7feb2c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:40.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.713+0000 7feb2b7fe640 1 --2- 172.21.15.7:0/2700223295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb2c101410 0x7feb2c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:40.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.714+0000 7feb30b03640 1 -- 172.21.15.7:0/2700223295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb2c101410 msgr2=0x7feb2c19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:40.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.714+0000 7feb30b03640 1 --2- 172.21.15.7:0/2700223295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb2c101410 0x7feb2c19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.714+0000 7feb30b03640 1 -- 172.21.15.7:0/2700223295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb2c100a70 msgr2=0x7feb2c19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:40.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.714+0000 7feb30b03640 1 --2- 172.21.15.7:0/2700223295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb2c100a70 0x7feb2c19a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.714+0000 7feb30b03640 1 -- 172.21.15.7:0/2700223295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2c19f620 con 0x7feb2c106a70 2024-09-19T08:49:40.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.714+0000 7feb30b03640 1 --2- 172.21.15.7:0/2700223295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb2c106a70 0x7feb2c19ef40 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7feb2400cad0 tx=0x7feb2400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:40.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.714+0000 7feb297fa640 1 -- 172.21.15.7:0/2700223295 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2400ae20 con 0x7feb2c106a70 2024-09-19T08:49:40.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.714+0000 7feb32566640 1 -- 172.21.15.7:0/2700223295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb2c19f910 con 0x7feb2c106a70 2024-09-19T08:49:40.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.714+0000 7feb297fa640 1 -- 172.21.15.7:0/2700223295 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb24005020 con 0x7feb2c106a70 2024-09-19T08:49:40.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.714+0000 7feb297fa640 1 -- 172.21.15.7:0/2700223295 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2400f6b0 con 0x7feb2c106a70 2024-09-19T08:49:40.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.714+0000 7feb32566640 1 -- 172.21.15.7:0/2700223295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb2c1a71f0 con 0x7feb2c106a70 2024-09-19T08:49:40.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.717+0000 7feb3493f740 1 Processor -- start 2024-09-19T08:49:40.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.717+0000 7feb297fa640 1 -- 172.21.15.7:0/2700223295 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7feb2400f910 con 0x7feb2c106a70 2024-09-19T08:49:40.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.717+0000 7feb3493f740 1 -- start start 2024-09-19T08:49:40.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.717+0000 7feb3493f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996a6b40 0x55f0996a5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:40.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.717+0000 7feb3493f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0996a55d0 0x55f0996a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:40.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.717+0000 7feb3493f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0996b0370 0x55f0996b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:40.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.717+0000 7feb3493f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f09960b2f0 con 0x55f0996a6b40 2024-09-19T08:49:40.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.717+0000 7feb3493f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f0995b2cf0 con 0x55f0996a55d0 2024-09-19T08:49:40.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.717+0000 7feb3493f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f0996072b0 con 0x55f0996b0370 2024-09-19T08:49:40.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.717+0000 7feb2b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996a6b40 0x55f0996a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:40.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.717+0000 7feb2b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996a6b40 0x55f0996a5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40830/0 (socket says 172.21.15.7:40830) 2024-09-19T08:49:40.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.717+0000 7feb2b7fe640 1 -- 172.21.15.7:0/4201024612 learned_addr learned my addr 172.21.15.7:0/4201024612 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:40.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.717+0000 7feb2bfff640 1 --2- 172.21.15.7:0/4201024612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0996a55d0 0x55f0996a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:40.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.717+0000 7feb2b7fe640 1 --2- 172.21.15.7:0/4201024612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0996b0370 0x55f0996b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:40.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.718+0000 7feb2b7fe640 1 -- 172.21.15.7:0/4201024612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0996b0370 msgr2=0x55f0996b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:40.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.718+0000 7feb2b7fe640 1 --2- 172.21.15.7:0/4201024612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0996b0370 0x55f0996b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.718+0000 7feb2b7fe640 1 -- 172.21.15.7:0/4201024612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0996a55d0 msgr2=0x55f0996a5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:40.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.718+0000 7feb2b7fe640 1 --2- 172.21.15.7:0/4201024612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0996a55d0 0x55f0996a5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.718+0000 7feb2b7fe640 1 -- 172.21.15.7:0/4201024612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0995973a0 con 0x55f0996a6b40 2024-09-19T08:49:40.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.718+0000 7feb297fa640 1 --2- 172.21.15.7:0/2700223295 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7feb140a33b0 0x7feb140a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:40.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.718+0000 7feb297fa640 1 -- 172.21.15.7:0/2700223295 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7feb240cffe0 con 0x7feb2c106a70 2024-09-19T08:49:40.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.718+0000 7feb2bfff640 1 --2- 172.21.15.7:0/2700223295 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7feb140a33b0 0x7feb140a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:40.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.718+0000 7feb2b7fe640 1 --2- 172.21.15.7:0/4201024612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996a6b40 0x55f0996a5090 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7feb2002a940 tx=0x7feb20000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde041114421e594 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:40.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.718+0000 7feb127fc640 1 -- 172.21.15.7:0/4201024612 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb20044030 con 0x55f0996a6b40 2024-09-19T08:49:40.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.718+0000 7feb127fc640 1 -- 172.21.15.7:0/4201024612 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb20005020 con 0x55f0996a6b40 2024-09-19T08:49:40.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.718+0000 7feb127fc640 1 -- 172.21.15.7:0/4201024612 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb20035040 con 0x55f0996a6b40 2024-09-19T08:49:40.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.719+0000 7feb3493f740 1 -- 172.21.15.7:0/4201024612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996a6b40 msgr2=0x55f0996a5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:40.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.719+0000 7feb3493f740 1 --2- 172.21.15.7:0/4201024612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996a6b40 0x55f0996a5090 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7feb2002a940 tx=0x7feb20000bc0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.719+0000 7feb2bfff640 1 --2- 172.21.15.7:0/2700223295 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7feb140a33b0 0x7feb140a5870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55f0996a2ac0 tx=0x7feb1c005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:40.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.719+0000 7feb3493f740 1 -- 172.21.15.7:0/4201024612 shutdown_connections 2024-09-19T08:49:40.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.719+0000 7feb3493f740 1 --2- 172.21.15.7:0/4201024612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0996b0370 0x55f0996b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.719+0000 7feb3493f740 1 --2- 172.21.15.7:0/4201024612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0996a55d0 0x55f0996a5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.719+0000 7feb3493f740 1 --2- 172.21.15.7:0/4201024612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996a6b40 0x55f0996a5090 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.719+0000 7feb3493f740 1 -- 172.21.15.7:0/4201024612 >> 172.21.15.7:0/4201024612 conn(0x55f09966e310 msgr2=0x55f0996a1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:40.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.719+0000 7feb3493f740 1 -- 172.21.15.7:0/4201024612 shutdown_connections 2024-09-19T08:49:40.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.719+0000 7feb3493f740 1 -- 172.21.15.7:0/4201024612 wait complete. 2024-09-19T08:49:40.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.719+0000 7feb3493f740 1 -- start start 2024-09-19T08:49:40.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.720+0000 7feb3493f740 1 Processor -- start 2024-09-19T08:49:40.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.720+0000 7feb3493f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0996a55d0 0x55f0996afd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:40.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.720+0000 7feb3493f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0996a6b40 0x55f0996acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:40.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.720+0000 7feb3493f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996b0370 0x55f0996ad530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:40.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.720+0000 7feb3493f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f0996b3010 con 0x55f0996b0370 2024-09-19T08:49:40.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.720+0000 7feb3493f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f0995c6060 con 0x55f0996a6b40 2024-09-19T08:49:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.720+0000 7feb3493f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f0996b3190 con 0x55f0996a55d0 2024-09-19T08:49:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.720+0000 7feb3493f740 10 client.0 _ll_register_callbacks cb 0x55f0993198c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.720+0000 7feb30b03640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996b0370 0x55f0996ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.720+0000 7feb30b03640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996b0370 0x55f0996ad530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40842/0 (socket says 172.21.15.7:40842) 2024-09-19T08:49:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.720+0000 7feb30b03640 1 -- 172.21.15.7:0/3075756197 learned_addr learned my addr 172.21.15.7:0/3075756197 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.720+0000 7feb2bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0996a55d0 0x55f0996afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.720+0000 7feb2b7fe640 1 --2- 172.21.15.7:0/3075756197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0996a6b40 0x55f0996acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.720+0000 7feb30b03640 1 -- 172.21.15.7:0/3075756197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0996a55d0 msgr2=0x55f0996afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.720+0000 7feb30b03640 1 --2- 172.21.15.7:0/3075756197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0996a55d0 0x55f0996afd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.720+0000 7feb30b03640 1 -- 172.21.15.7:0/3075756197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0996a6b40 msgr2=0x55f0996acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.720+0000 7feb30b03640 1 --2- 172.21.15.7:0/3075756197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0996a6b40 0x55f0996acfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.720+0000 7feb30b03640 1 -- 172.21.15.7:0/3075756197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f09937c3c0 con 0x55f0996b0370 2024-09-19T08:49:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.721+0000 7feb30b03640 1 --2- 172.21.15.7:0/3075756197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996b0370 0x55f0996ad530 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7feb240987c0 tx=0x7feb240a0660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81c66d7e0d9a031 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.721+0000 7feb0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:49:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.721+0000 7feb0b7fe640 1 -- 172.21.15.7:0/3075756197 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2401d040 con 0x55f0996b0370 2024-09-19T08:49:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.721+0000 7feb0b7fe640 1 -- 172.21.15.7:0/3075756197 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7feb2409c5c0 con 0x55f0996b0370 2024-09-19T08:49:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.721+0000 7feb3493f740 1 -- 172.21.15.7:0/3075756197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb20005020 con 0x55f0996b0370 2024-09-19T08:49:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.721+0000 7feb0b7fe640 1 -- 172.21.15.7:0/3075756197 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7feb2409c7e0 con 0x55f0996b0370 2024-09-19T08:49:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.721+0000 7feb3493f740 10 client.16308 fetch_fsmap learned FSMap version 25 2024-09-19T08:49:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.721+0000 7feb3493f740 1 -- 172.21.15.7:0/3075756197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f0996beaa0 con 0x55f0996b0370 2024-09-19T08:49:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.721+0000 7feb0b7fe640 1 -- 172.21.15.7:0/3075756197 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb20005020 con 0x55f0996b0370 2024-09-19T08:49:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.721+0000 7feb0b7fe640 1 -- 172.21.15.7:0/3075756197 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7feb240bc0c0 con 0x55f0996b0370 2024-09-19T08:49:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.721+0000 7feb3493f740 10 client.16308 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:49:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.721+0000 7feb3493f740 10 client.16308 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:49:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.721+0000 7feb3493f740 20 client.16308 populate_metadata read hostname 'smithi007' 2024-09-19T08:49:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.721+0000 7feb3493f740 1 --2- 172.21.15.7:0/3075756197 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f0996c01f0 0x55f0996c2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.721+0000 7feb3493f740 4 client.16308 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:49:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.721+0000 7feb3493f740 1 -- 172.21.15.7:0/3075756197 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f099618860 con 0x55f0996c01f0 2024-09-19T08:49:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.722+0000 7feb2bfff640 1 --2- 172.21.15.7:0/3075756197 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f0996c01f0 0x55f0996c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.722+0000 7feb2bfff640 1 --2- 172.21.15.7:0/3075756197 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f0996c01f0 0x55f0996c2650 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3ac8f5f3d3f3b421 server_cookie=223ff96fa322cf29 in_seq=0 out_seq=0 2024-09-19T08:49:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.722+0000 7feb0b7fe640 10 client.16308 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:49:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.723+0000 7feb0b7fe640 1 -- 172.21.15.7:0/3075756197 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f099618860 con 0x55f0996c01f0 2024-09-19T08:49:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.723+0000 7feb0b7fe640 10 client.16308 handle_command_reply: tid=0 2024-09-19T08:49:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.723+0000 7feb3493f740 1 client.16308 shutdown 2024-09-19T08:49:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.723+0000 7feb3493f740 1 -- 172.21.15.7:0/3075756197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996b0370 msgr2=0x55f0996ad530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.723+0000 7feb3493f740 1 --2- 172.21.15.7:0/3075756197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996b0370 0x55f0996ad530 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7feb240987c0 tx=0x7feb240a0660 comp rx=0 tx=0).stop 2024-09-19T08:49:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.723+0000 7feb3493f740 1 -- 172.21.15.7:0/3075756197 shutdown_connections 2024-09-19T08:49:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.723+0000 7feb3493f740 1 --2- 172.21.15.7:0/3075756197 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f0996c01f0 0x55f0996c2650 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.723+0000 7feb3493f740 1 --2- 172.21.15.7:0/3075756197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996b0370 0x55f0996ad530 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.723+0000 7feb3493f740 1 --2- 172.21.15.7:0/3075756197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0996a6b40 0x55f0996acfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.723+0000 7feb3493f740 1 --2- 172.21.15.7:0/3075756197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0996a55d0 0x55f0996afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.723+0000 7feb3493f740 1 -- 172.21.15.7:0/3075756197 >> 172.21.15.7:0/3075756197 conn(0x55f09966e310 msgr2=0x55f0996a7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.723+0000 7feb0b7fe640 0 client.16308 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:49:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.723+0000 7feb3493f740 1 -- 172.21.15.7:0/3075756197 shutdown_connections 2024-09-19T08:49:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.723+0000 7feb3493f740 1 -- 172.21.15.7:0/3075756197 wait complete. 2024-09-19T08:49:40.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.723+0000 7feb3493f740 20 client.16308 trim_cache size 0 max 16384 2024-09-19T08:49:40.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.736+0000 7feb3493f740 1 Processor -- start 2024-09-19T08:49:40.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.736+0000 7feb3493f740 1 -- start start 2024-09-19T08:49:40.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.737+0000 7feb3493f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0996a55d0 0x55f0996aef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:40.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.737+0000 7feb3493f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0996a6b40 0x55f0996a8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:40.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.737+0000 7feb3493f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996b0370 0x55f0996a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:40.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.737+0000 7feb3493f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c1b23f0 con 0x55f0996b0370 2024-09-19T08:49:40.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.737+0000 7feb3493f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c1afcc0 con 0x55f0996a6b40 2024-09-19T08:49:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.737+0000 7feb3493f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c1adb10 con 0x55f0996a55d0 2024-09-19T08:49:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.737+0000 7feb30b03640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996b0370 0x55f0996a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.737+0000 7feb30b03640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996b0370 0x55f0996a8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40846/0 (socket says 172.21.15.7:40846) 2024-09-19T08:49:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.737+0000 7feb30b03640 1 -- 172.21.15.7:0/344222793 learned_addr learned my addr 172.21.15.7:0/344222793 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.737+0000 7feb2b7fe640 1 --2- 172.21.15.7:0/344222793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0996a6b40 0x55f0996a8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.737+0000 7feb2bfff640 1 --2- 172.21.15.7:0/344222793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0996a55d0 0x55f0996aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.737+0000 7feb30b03640 1 -- 172.21.15.7:0/344222793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0996a55d0 msgr2=0x55f0996aef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.737+0000 7feb30b03640 1 --2- 172.21.15.7:0/344222793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0996a55d0 0x55f0996aef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.737+0000 7feb30b03640 1 -- 172.21.15.7:0/344222793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0996a6b40 msgr2=0x55f0996a8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.737+0000 7feb30b03640 1 --2- 172.21.15.7:0/344222793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0996a6b40 0x55f0996a8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.737+0000 7feb30b03640 1 -- 172.21.15.7:0/344222793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0996a1ed0 con 0x55f0996b0370 2024-09-19T08:49:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.737+0000 7feb30b03640 1 --2- 172.21.15.7:0/344222793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996b0370 0x55f0996a8660 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7feb240a50e0 tx=0x7feb2409c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5555fbcfaab79842 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.738+0000 7feb11ffb640 1 -- 172.21.15.7:0/344222793 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2401d070 con 0x55f0996b0370 2024-09-19T08:49:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.738+0000 7feb11ffb640 1 -- 172.21.15.7:0/344222793 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb240a4a90 con 0x55f0996b0370 2024-09-19T08:49:40.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.738+0000 7feb11ffb640 1 -- 172.21.15.7:0/344222793 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb240051d0 con 0x55f0996b0370 2024-09-19T08:49:40.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.738+0000 7feb3493f740 1 -- 172.21.15.7:0/344222793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996b0370 msgr2=0x55f0996a8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:40.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.738+0000 7feb3493f740 1 --2- 172.21.15.7:0/344222793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996b0370 0x55f0996a8660 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7feb240a50e0 tx=0x7feb2409c980 comp rx=0 tx=0).stop 2024-09-19T08:49:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.738+0000 7feb3493f740 1 -- 172.21.15.7:0/344222793 shutdown_connections 2024-09-19T08:49:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.738+0000 7feb3493f740 1 --2- 172.21.15.7:0/344222793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996b0370 0x55f0996a8660 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.738+0000 7feb3493f740 1 --2- 172.21.15.7:0/344222793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0996a6b40 0x55f0996a8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.738+0000 7feb3493f740 1 --2- 172.21.15.7:0/344222793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0996a55d0 0x55f0996aef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.738+0000 7feb3493f740 1 -- 172.21.15.7:0/344222793 >> 172.21.15.7:0/344222793 conn(0x55f09966e310 msgr2=0x55f0996ae810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.738+0000 7feb3493f740 1 -- 172.21.15.7:0/344222793 shutdown_connections 2024-09-19T08:49:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.738+0000 7feb3493f740 1 -- 172.21.15.7:0/344222793 wait complete. 2024-09-19T08:49:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.739+0000 7feb3493f740 1 -- start start 2024-09-19T08:49:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.739+0000 7feb3493f740 1 Processor -- start 2024-09-19T08:49:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.739+0000 7feb3493f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0996a55d0 0x55f0996b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.739+0000 7feb3493f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0996a6b40 0x55f0996b8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:40.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.739+0000 7feb3493f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996b0370 0x55f0996b3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.739+0000 7feb3493f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c1ae180 con 0x55f0996b0370 2024-09-19T08:49:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.739+0000 7feb3493f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c1af5f0 con 0x55f0996a6b40 2024-09-19T08:49:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.739+0000 7feb3493f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c1ae850 con 0x55f0996a55d0 2024-09-19T08:49:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.739+0000 7feb3493f740 10 client.0 _ll_register_callbacks cb 0x7feb24005860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.739+0000 7feb30b03640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996b0370 0x55f0996b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.739+0000 7feb2b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0996a6b40 0x55f0996b8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.739+0000 7feb30b03640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996b0370 0x55f0996b3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40858/0 (socket says 172.21.15.7:40858) 2024-09-19T08:49:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.739+0000 7feb30b03640 1 -- 172.21.15.7:0/1473186343 learned_addr learned my addr 172.21.15.7:0/1473186343 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.739+0000 7feb2bfff640 1 --2- 172.21.15.7:0/1473186343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0996a55d0 0x55f0996b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.740+0000 7feb2b7fe640 1 -- 172.21.15.7:0/1473186343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0996a55d0 msgr2=0x55f0996b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.740+0000 7feb2b7fe640 1 --2- 172.21.15.7:0/1473186343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0996a55d0 0x55f0996b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.740+0000 7feb2b7fe640 1 -- 172.21.15.7:0/1473186343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996b0370 msgr2=0x55f0996b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.740+0000 7feb2b7fe640 1 --2- 172.21.15.7:0/1473186343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996b0370 0x55f0996b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.740+0000 7feb2b7fe640 1 -- 172.21.15.7:0/1473186343 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0996b4160 con 0x55f0996a6b40 2024-09-19T08:49:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.740+0000 7feb2bfff640 1 --2- 172.21.15.7:0/1473186343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0996a55d0 0x55f0996b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.740+0000 7feb2b7fe640 1 --2- 172.21.15.7:0/1473186343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0996a6b40 0x55f0996b8940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55f0996ac840 tx=0x7feb2002aae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=455fe23b1e7ce3d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.740+0000 7feb0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-19T08:49:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.740+0000 7feb0b7fe640 1 -- 172.21.15.7:0/1473186343 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2004e020 con 0x55f0996a6b40 2024-09-19T08:49:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.740+0000 7feb3493f740 1 -- 172.21.15.7:0/1473186343 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb240a4a90 con 0x55f0996a6b40 2024-09-19T08:49:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.740+0000 7feb0b7fe640 1 -- 172.21.15.7:0/1473186343 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7feb20004440 con 0x55f0996a6b40 2024-09-19T08:49:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.740+0000 7feb0b7fe640 1 -- 172.21.15.7:0/1473186343 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7feb20059050 con 0x55f0996a6b40 2024-09-19T08:49:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.740+0000 7feb3493f740 10 client.25982 fetch_fsmap learned FSMap version 25 2024-09-19T08:49:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.740+0000 7feb3493f740 1 -- 172.21.15.7:0/1473186343 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f09972a980 con 0x55f0996a6b40 2024-09-19T08:49:40.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.741+0000 7feb0b7fe640 1 -- 172.21.15.7:0/1473186343 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb240a4a90 con 0x55f0996a6b40 2024-09-19T08:49:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.741+0000 7feb0b7fe640 1 -- 172.21.15.7:0/1473186343 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7feb200486a0 con 0x55f0996a6b40 2024-09-19T08:49:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.741+0000 7feb3493f740 10 client.25982 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:49:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.741+0000 7feb3493f740 10 client.25982 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:49:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.741+0000 7feb3493f740 20 client.25982 populate_metadata read hostname 'smithi007' 2024-09-19T08:49:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.741+0000 7feb3493f740 1 --2- 172.21.15.7:0/1473186343 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f09972ac50 0x55f09972d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.741+0000 7feb3493f740 4 client.25982 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:49:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.741+0000 7feb3493f740 1 -- 172.21.15.7:0/1473186343 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f099612d70 con 0x55f09972ac50 2024-09-19T08:49:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.741+0000 7feb2bfff640 1 --2- 172.21.15.7:0/1473186343 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f09972ac50 0x55f09972d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.741+0000 7feb2bfff640 1 --2- 172.21.15.7:0/1473186343 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f09972ac50 0x55f09972d040 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2b0fe51a14d536fc server_cookie=5d1ea7249a65a5d0 in_seq=0 out_seq=0 2024-09-19T08:49:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.741+0000 7feb0b7fe640 10 client.25982 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:49:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.742+0000 7feb0b7fe640 1 -- 172.21.15.7:0/1473186343 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f099612d70 con 0x55f09972ac50 2024-09-19T08:49:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.742+0000 7feb0b7fe640 10 client.25982 handle_command_reply: tid=0 2024-09-19T08:49:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.742+0000 7feb3493f740 1 client.25982 shutdown 2024-09-19T08:49:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.742+0000 7feb3493f740 1 -- 172.21.15.7:0/1473186343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0996a6b40 msgr2=0x55f0996b8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.742+0000 7feb3493f740 1 --2- 172.21.15.7:0/1473186343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0996a6b40 0x55f0996b8940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55f0996ac840 tx=0x7feb2002aae0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.742+0000 7feb3493f740 1 -- 172.21.15.7:0/1473186343 shutdown_connections 2024-09-19T08:49:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.742+0000 7feb3493f740 1 --2- 172.21.15.7:0/1473186343 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f09972ac50 0x55f09972d040 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.742+0000 7feb3493f740 1 --2- 172.21.15.7:0/1473186343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f0996b0370 0x55f0996b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.742+0000 7feb3493f740 1 --2- 172.21.15.7:0/1473186343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0996a6b40 0x55f0996b8940 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.742+0000 7feb0b7fe640 0 client.25982 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:49:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.742+0000 7feb3493f740 1 --2- 172.21.15.7:0/1473186343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0996a55d0 0x55f0996b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.742+0000 7feb3493f740 1 -- 172.21.15.7:0/1473186343 >> 172.21.15.7:0/1473186343 conn(0x55f09966e310 msgr2=0x55f0996af030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.742+0000 7feb3493f740 1 -- 172.21.15.7:0/1473186343 shutdown_connections 2024-09-19T08:49:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.742+0000 7feb3493f740 1 -- 172.21.15.7:0/1473186343 wait complete. 2024-09-19T08:49:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.742+0000 7feb3493f740 20 client.25982 trim_cache size 0 max 16384 2024-09-19T08:49:40.749 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:49:40.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.743+0000 7feb32566640 1 -- 172.21.15.7:0/2700223295 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7feb140a33b0 msgr2=0x7feb140a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:40.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.743+0000 7feb32566640 1 --2- 172.21.15.7:0/2700223295 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7feb140a33b0 0x7feb140a5870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55f0996a2ac0 tx=0x7feb1c005f90 comp rx=0 tx=0).stop 2024-09-19T08:49:40.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.743+0000 7feb32566640 1 -- 172.21.15.7:0/2700223295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb2c106a70 msgr2=0x7feb2c19ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:40.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.743+0000 7feb32566640 1 --2- 172.21.15.7:0/2700223295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb2c106a70 0x7feb2c19ef40 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7feb2400cad0 tx=0x7feb2400cf90 comp rx=0 tx=0).stop 2024-09-19T08:49:40.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.743+0000 7feb32566640 1 -- 172.21.15.7:0/2700223295 shutdown_connections 2024-09-19T08:49:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.743+0000 7feb32566640 1 --2- 172.21.15.7:0/2700223295 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7feb140a33b0 0x7feb140a5870 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.743+0000 7feb32566640 1 --2- 172.21.15.7:0/2700223295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb2c106a70 0x7feb2c19ef40 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.743+0000 7feb32566640 1 --2- 172.21.15.7:0/2700223295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb2c101410 0x7feb2c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.743+0000 7feb32566640 1 --2- 172.21.15.7:0/2700223295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb2c100a70 0x7feb2c19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.743+0000 7feb32566640 1 -- 172.21.15.7:0/2700223295 >> 172.21.15.7:0/2700223295 conn(0x7feb2c0fc790 msgr2=0x7feb2c06a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.743+0000 7feb32566640 1 -- 172.21.15.7:0/2700223295 shutdown_connections 2024-09-19T08:49:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:40.743+0000 7feb32566640 1 -- 172.21.15.7:0/2700223295 wait complete. 2024-09-19T08:49:40.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:40 smithi044 ceph-mon[35072]: pgmap v157: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:40.829 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:40 smithi175 ceph-mon[35688]: pgmap v157: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:41.550 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:49:41.819 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:42.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.290+0000 7f30cf100640 1 -- 172.21.15.7:0/677071931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30c810c2f0 msgr2=0x7f30c810e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:42.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.290+0000 7f30cf100640 1 --2- 172.21.15.7:0/677071931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30c810c2f0 0x7f30c810e790 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009900 tx=0x7f30c002a410 comp rx=0 tx=0).stop 2024-09-19T08:49:42.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.290+0000 7f30cf100640 1 -- 172.21.15.7:0/677071931 shutdown_connections 2024-09-19T08:49:42.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.290+0000 7f30cf100640 1 --2- 172.21.15.7:0/677071931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30c810c2f0 0x7f30c810e790 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.290+0000 7f30cf100640 1 --2- 172.21.15.7:0/677071931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30c81037a0 0x7f30c810bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.290+0000 7f30cf100640 1 --2- 172.21.15.7:0/677071931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30c8102df0 0x7f30c81031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.290+0000 7f30cf100640 1 -- 172.21.15.7:0/677071931 >> 172.21.15.7:0/677071931 conn(0x7f30c80fc7d0 msgr2=0x7f30c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:42.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.290+0000 7f30cf100640 1 -- 172.21.15.7:0/677071931 shutdown_connections 2024-09-19T08:49:42.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.290+0000 7f30cf100640 1 -- 172.21.15.7:0/677071931 wait complete. 2024-09-19T08:49:42.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.291+0000 7f30cf100640 1 Processor -- start 2024-09-19T08:49:42.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.291+0000 7f30cf100640 1 -- start start 2024-09-19T08:49:42.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.291+0000 7f30cf100640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30c8102df0 0x7f30c8198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.291+0000 7f30cf100640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30c81037a0 0x7f30c8198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.291+0000 7f30cf100640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30c810c2f0 0x7f30c819cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.291+0000 7f30cf100640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f30c8112170 con 0x7f30c810c2f0 2024-09-19T08:49:42.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.291+0000 7f30cf100640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f30c8111ff0 con 0x7f30c8102df0 2024-09-19T08:49:42.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.291+0000 7f30cf100640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f30c81122f0 con 0x7f30c81037a0 2024-09-19T08:49:42.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.291+0000 7f30cd69d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30c810c2f0 0x7f30c819cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.291+0000 7f30cd69d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30c810c2f0 0x7f30c819cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40868/0 (socket says 172.21.15.7:40868) 2024-09-19T08:49:42.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.291+0000 7f30cd69d640 1 -- 172.21.15.7:0/2230884137 learned_addr learned my addr 172.21.15.7:0/2230884137 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:42.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.291+0000 7f30cce9c640 1 --2- 172.21.15.7:0/2230884137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30c8102df0 0x7f30c8198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.291+0000 7f30c7fff640 1 --2- 172.21.15.7:0/2230884137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30c81037a0 0x7f30c8198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.292+0000 7f30cd69d640 1 -- 172.21.15.7:0/2230884137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30c81037a0 msgr2=0x7f30c8198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:42.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.292+0000 7f30cd69d640 1 --2- 172.21.15.7:0/2230884137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30c81037a0 0x7f30c8198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.292+0000 7f30cd69d640 1 -- 172.21.15.7:0/2230884137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30c8102df0 msgr2=0x7f30c8198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:42.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.292+0000 7f30cd69d640 1 --2- 172.21.15.7:0/2230884137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30c8102df0 0x7f30c8198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.292+0000 7f30cd69d640 1 -- 172.21.15.7:0/2230884137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c819d5e0 con 0x7f30c810c2f0 2024-09-19T08:49:42.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.292+0000 7f30c7fff640 1 --2- 172.21.15.7:0/2230884137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30c81037a0 0x7f30c8198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:42.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.292+0000 7f30cd69d640 1 --2- 172.21.15.7:0/2230884137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30c810c2f0 0x7f30c819cf00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009230 tx=0x7f30c00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:42.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.292+0000 7f30c5ffb640 1 -- 172.21.15.7:0/2230884137 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c003f030 con 0x7f30c810c2f0 2024-09-19T08:49:42.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.292+0000 7f30cf100640 1 -- 172.21.15.7:0/2230884137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30c819d870 con 0x7f30c810c2f0 2024-09-19T08:49:42.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.292+0000 7f30c5ffb640 1 -- 172.21.15.7:0/2230884137 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30c0003ce0 con 0x7f30c810c2f0 2024-09-19T08:49:42.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.292+0000 7f30c5ffb640 1 -- 172.21.15.7:0/2230884137 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c0035070 con 0x7f30c810c2f0 2024-09-19T08:49:42.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.292+0000 7f30cf100640 1 -- 172.21.15.7:0/2230884137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30c81a51b0 con 0x7f30c810c2f0 2024-09-19T08:49:42.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.294+0000 7f30c5ffb640 1 -- 172.21.15.7:0/2230884137 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f30c0042030 con 0x7f30c810c2f0 2024-09-19T08:49:42.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.295+0000 7f30d14d9740 1 Processor -- start 2024-09-19T08:49:42.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.295+0000 7f30d14d9740 1 -- start start 2024-09-19T08:49:42.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.295+0000 7f30c5ffb640 1 --2- 172.21.15.7:0/2230884137 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f30b40a33b0 0x7f30b40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.295+0000 7f30d14d9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca34b40 0x56552ca33090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.295+0000 7f30d14d9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56552ca335d0 0x56552ca33a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.295+0000 7f30d14d9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56552ca3e370 0x56552ca40760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.295+0000 7f30d14d9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56552c9992f0 con 0x56552ca34b40 2024-09-19T08:49:42.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.295+0000 7f30d14d9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56552c940cf0 con 0x56552ca335d0 2024-09-19T08:49:42.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.295+0000 7f30d14d9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56552c9952b0 con 0x56552ca3e370 2024-09-19T08:49:42.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.295+0000 7f30c5ffb640 1 -- 172.21.15.7:0/2230884137 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f30c00f0650 con 0x7f30c810c2f0 2024-09-19T08:49:42.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.295+0000 7f30c7fff640 1 --2- 172.21.15.7:0/2230884137 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f30b40a33b0 0x7f30b40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.295+0000 7f30cce9c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca34b40 0x56552ca33090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.296+0000 7f30cce9c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca34b40 0x56552ca33090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40874/0 (socket says 172.21.15.7:40874) 2024-09-19T08:49:42.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.296+0000 7f30cce9c640 1 -- 172.21.15.7:0/848620317 learned_addr learned my addr 172.21.15.7:0/848620317 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:42.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.296+0000 7f30c7fff640 1 --2- 172.21.15.7:0/848620317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56552ca335d0 0x56552ca33a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.296+0000 7f30cce9c640 1 -- 172.21.15.7:0/848620317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56552ca3e370 msgr2=0x56552ca40760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:42.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.296+0000 7f30cd69d640 1 --2- 172.21.15.7:0/848620317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56552ca3e370 0x56552ca40760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.296+0000 7f30cce9c640 1 --2- 172.21.15.7:0/848620317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56552ca3e370 0x56552ca40760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.296+0000 7f30cce9c640 1 -- 172.21.15.7:0/848620317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56552ca335d0 msgr2=0x56552ca33a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:42.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.296+0000 7f30cce9c640 1 --2- 172.21.15.7:0/848620317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56552ca335d0 0x56552ca33a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.296+0000 7f30cce9c640 1 -- 172.21.15.7:0/848620317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56552c9253a0 con 0x56552ca34b40 2024-09-19T08:49:42.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.296+0000 7f30c7fff640 1 --2- 172.21.15.7:0/848620317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56552ca335d0 0x56552ca33a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:42.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.296+0000 7f30cd69d640 1 --2- 172.21.15.7:0/848620317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56552ca3e370 0x56552ca40760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:49:42.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.296+0000 7f30c7fff640 1 --2- 172.21.15.7:0/2230884137 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f30b40a33b0 0x7f30b40a5870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f30c810d610 tx=0x7f30b8013b00 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:42.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.296+0000 7f30cce9c640 1 --2- 172.21.15.7:0/848620317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca34b40 0x56552ca33090 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f30b0009a70 tx=0x7f30b0009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367a51e15742cadd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:42.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.296+0000 7f30beffd640 1 -- 172.21.15.7:0/848620317 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b0017070 con 0x56552ca34b40 2024-09-19T08:49:42.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.296+0000 7f30beffd640 1 -- 172.21.15.7:0/848620317 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30b0013470 con 0x56552ca34b40 2024-09-19T08:49:42.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.296+0000 7f30beffd640 1 -- 172.21.15.7:0/848620317 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b0012610 con 0x56552ca34b40 2024-09-19T08:49:42.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.297+0000 7f30d14d9740 1 -- 172.21.15.7:0/848620317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca34b40 msgr2=0x56552ca33090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:42.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.297+0000 7f30d14d9740 1 --2- 172.21.15.7:0/848620317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca34b40 0x56552ca33090 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f30b0009a70 tx=0x7f30b0009f30 comp rx=0 tx=0).stop 2024-09-19T08:49:42.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.297+0000 7f30d14d9740 1 -- 172.21.15.7:0/848620317 shutdown_connections 2024-09-19T08:49:42.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.297+0000 7f30d14d9740 1 --2- 172.21.15.7:0/848620317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56552ca3e370 0x56552ca40760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.297+0000 7f30d14d9740 1 --2- 172.21.15.7:0/848620317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56552ca335d0 0x56552ca33a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.297+0000 7f30d14d9740 1 --2- 172.21.15.7:0/848620317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca34b40 0x56552ca33090 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.297+0000 7f30d14d9740 1 -- 172.21.15.7:0/848620317 >> 172.21.15.7:0/848620317 conn(0x56552c9fc310 msgr2=0x56552ca2fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:42.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.297+0000 7f30d14d9740 1 -- 172.21.15.7:0/848620317 shutdown_connections 2024-09-19T08:49:42.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.297+0000 7f30d14d9740 1 -- 172.21.15.7:0/848620317 wait complete. 2024-09-19T08:49:42.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.298+0000 7f30d14d9740 1 -- start start 2024-09-19T08:49:42.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.298+0000 7f30d14d9740 1 Processor -- start 2024-09-19T08:49:42.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.298+0000 7f30d14d9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56552ca335d0 0x56552ca3dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.298+0000 7f30d14d9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56552ca34b40 0x56552ca3af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.298+0000 7f30d14d9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca3e370 0x56552ca3b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.298+0000 7f30d14d9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56552ca41070 con 0x56552ca3e370 2024-09-19T08:49:42.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.298+0000 7f30d14d9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56552c954060 con 0x56552ca34b40 2024-09-19T08:49:42.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.298+0000 7f30d14d9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56552ca411f0 con 0x56552ca335d0 2024-09-19T08:49:42.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.298+0000 7f30d14d9740 10 client.0 _ll_register_callbacks cb 0x56552c6a78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:42.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.298+0000 7f30cd69d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca3e370 0x56552ca3b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.299+0000 7f30c7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56552ca34b40 0x56552ca3af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.299+0000 7f30cd69d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca3e370 0x56552ca3b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40884/0 (socket says 172.21.15.7:40884) 2024-09-19T08:49:42.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.299+0000 7f30cd69d640 1 -- 172.21.15.7:0/947443985 learned_addr learned my addr 172.21.15.7:0/947443985 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:42.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.299+0000 7f30cce9c640 1 --2- 172.21.15.7:0/947443985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56552ca335d0 0x56552ca3dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.299+0000 7f30cd69d640 1 -- 172.21.15.7:0/947443985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56552ca335d0 msgr2=0x56552ca3dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:42.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.299+0000 7f30cd69d640 1 --2- 172.21.15.7:0/947443985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56552ca335d0 0x56552ca3dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.299+0000 7f30cd69d640 1 -- 172.21.15.7:0/947443985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56552ca34b40 msgr2=0x56552ca3af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:42.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.299+0000 7f30cd69d640 1 --2- 172.21.15.7:0/947443985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56552ca34b40 0x56552ca3af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.299+0000 7f30cd69d640 1 -- 172.21.15.7:0/947443985 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56552c70a3c0 con 0x56552ca3e370 2024-09-19T08:49:42.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.299+0000 7f30c7fff640 1 --2- 172.21.15.7:0/947443985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56552ca34b40 0x56552ca3af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:49:42.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.299+0000 7f30cd69d640 1 --2- 172.21.15.7:0/947443985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca3e370 0x56552ca3b4e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f30c0031550 tx=0x7f30c00b84c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ce09cb86956426 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:42.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.299+0000 7f30a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:49:42.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.299+0000 7f30a7fff640 1 -- 172.21.15.7:0/947443985 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c0049040 con 0x56552ca3e370 2024-09-19T08:49:42.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.299+0000 7f30a7fff640 1 -- 172.21.15.7:0/947443985 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f30c00b8f30 con 0x56552ca3e370 2024-09-19T08:49:42.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.299+0000 7f30d14d9740 1 -- 172.21.15.7:0/947443985 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30b0013470 con 0x56552ca3e370 2024-09-19T08:49:42.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.299+0000 7f30a7fff640 1 -- 172.21.15.7:0/947443985 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f30c00bc400 con 0x56552ca3e370 2024-09-19T08:49:42.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.299+0000 7f30d14d9740 10 client.16326 fetch_fsmap learned FSMap version 25 2024-09-19T08:49:42.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.299+0000 7f30d14d9740 1 -- 172.21.15.7:0/947443985 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56552ca4c9f0 con 0x56552ca3e370 2024-09-19T08:49:42.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.300+0000 7f30a7fff640 1 -- 172.21.15.7:0/947443985 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30b0013470 con 0x56552ca3e370 2024-09-19T08:49:42.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.300+0000 7f30a7fff640 1 -- 172.21.15.7:0/947443985 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f30c003bca0 con 0x56552ca3e370 2024-09-19T08:49:42.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.300+0000 7f30d14d9740 10 client.16326 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:49:42.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.300+0000 7f30d14d9740 10 client.16326 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:49:42.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.300+0000 7f30d14d9740 20 client.16326 populate_metadata read hostname 'smithi007' 2024-09-19T08:49:42.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.300+0000 7f30d14d9740 1 --2- 172.21.15.7:0/947443985 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x56552ca4de30 0x56552ca50240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.300+0000 7f30d14d9740 4 client.16326 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:49:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.300+0000 7f30d14d9740 1 -- 172.21.15.7:0/947443985 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56552c9a6860 con 0x56552ca4de30 2024-09-19T08:49:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.300+0000 7f30cce9c640 1 --2- 172.21.15.7:0/947443985 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x56552ca4de30 0x56552ca50240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.301+0000 7f30cce9c640 1 --2- 172.21.15.7:0/947443985 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x56552ca4de30 0x56552ca50240 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=768786b39d1c8c36 server_cookie=d5631b99e5c933e3 in_seq=0 out_seq=0 2024-09-19T08:49:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.301+0000 7f30a7fff640 10 client.16326 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:49:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.301+0000 7f30a7fff640 1 -- 172.21.15.7:0/947443985 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56552c9a6860 con 0x56552ca4de30 2024-09-19T08:49:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.301+0000 7f30a7fff640 10 client.16326 handle_command_reply: tid=0 2024-09-19T08:49:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.301+0000 7f30d14d9740 1 client.16326 shutdown 2024-09-19T08:49:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.302+0000 7f30d14d9740 1 -- 172.21.15.7:0/947443985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca3e370 msgr2=0x56552ca3b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.302+0000 7f30d14d9740 1 --2- 172.21.15.7:0/947443985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca3e370 0x56552ca3b4e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f30c0031550 tx=0x7f30c00b84c0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.302+0000 7f30d14d9740 1 -- 172.21.15.7:0/947443985 shutdown_connections 2024-09-19T08:49:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.302+0000 7f30d14d9740 1 --2- 172.21.15.7:0/947443985 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x56552ca4de30 0x56552ca50240 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.302+0000 7f30d14d9740 1 --2- 172.21.15.7:0/947443985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca3e370 0x56552ca3b4e0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.302+0000 7f30d14d9740 1 --2- 172.21.15.7:0/947443985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56552ca34b40 0x56552ca3af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.302+0000 7f30d14d9740 1 --2- 172.21.15.7:0/947443985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56552ca335d0 0x56552ca3dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.302+0000 7f30a7fff640 0 client.16326 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:49:42.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.302+0000 7f30d14d9740 1 -- 172.21.15.7:0/947443985 >> 172.21.15.7:0/947443985 conn(0x56552c9fc310 msgr2=0x56552ca35930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:42.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.302+0000 7f30d14d9740 1 -- 172.21.15.7:0/947443985 shutdown_connections 2024-09-19T08:49:42.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.302+0000 7f30d14d9740 1 -- 172.21.15.7:0/947443985 wait complete. 2024-09-19T08:49:42.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.302+0000 7f30d14d9740 20 client.16326 trim_cache size 0 max 16384 2024-09-19T08:49:42.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.315+0000 7f30d14d9740 1 Processor -- start 2024-09-19T08:49:42.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.315+0000 7f30d14d9740 1 -- start start 2024-09-19T08:49:42.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.316+0000 7f30d14d9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56552ca335d0 0x56552ca4a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.316+0000 7f30d14d9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca34b40 0x56552ca3cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.316+0000 7f30d14d9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56552ca3e370 0x56552ca55b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.316+0000 7f30d14d9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f30c81b0240 con 0x56552ca34b40 2024-09-19T08:49:42.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.316+0000 7f30d14d9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f30c81adb10 con 0x56552ca335d0 2024-09-19T08:49:42.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.316+0000 7f30d14d9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f30c81ab960 con 0x56552ca3e370 2024-09-19T08:49:42.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.316+0000 7f30c7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca34b40 0x56552ca3cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.316+0000 7f30cd69d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56552ca3e370 0x56552ca55b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.316+0000 7f30cce9c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56552ca335d0 0x56552ca4a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.316+0000 7f30c7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca34b40 0x56552ca3cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40894/0 (socket says 172.21.15.7:40894) 2024-09-19T08:49:42.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.316+0000 7f30c7fff640 1 -- 172.21.15.7:0/1556500542 learned_addr learned my addr 172.21.15.7:0/1556500542 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:42.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.316+0000 7f30c7fff640 1 -- 172.21.15.7:0/1556500542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56552ca3e370 msgr2=0x56552ca55b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:42.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.316+0000 7f30c7fff640 1 --2- 172.21.15.7:0/1556500542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56552ca3e370 0x56552ca55b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.316+0000 7f30c7fff640 1 -- 172.21.15.7:0/1556500542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56552ca335d0 msgr2=0x56552ca4a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:42.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.316+0000 7f30c7fff640 1 --2- 172.21.15.7:0/1556500542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56552ca335d0 0x56552ca4a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.316+0000 7f30c7fff640 1 -- 172.21.15.7:0/1556500542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56552ca2f4f0 con 0x56552ca34b40 2024-09-19T08:49:42.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.317+0000 7f30c7fff640 1 --2- 172.21.15.7:0/1556500542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca34b40 0x56552ca3cef0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f30c806a2b0 tx=0x7f30b801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27401e05280de93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:42.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.317+0000 7f30be7fc640 1 -- 172.21.15.7:0/1556500542 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b8004d20 con 0x56552ca34b40 2024-09-19T08:49:42.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.317+0000 7f30be7fc640 1 -- 172.21.15.7:0/1556500542 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30b8020d40 con 0x56552ca34b40 2024-09-19T08:49:42.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.317+0000 7f30be7fc640 1 -- 172.21.15.7:0/1556500542 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b8005950 con 0x56552ca34b40 2024-09-19T08:49:42.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.318+0000 7f30d14d9740 1 -- 172.21.15.7:0/1556500542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca34b40 msgr2=0x56552ca3cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:42.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.318+0000 7f30d14d9740 1 --2- 172.21.15.7:0/1556500542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca34b40 0x56552ca3cef0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f30c806a2b0 tx=0x7f30b801c000 comp rx=0 tx=0).stop 2024-09-19T08:49:42.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.318+0000 7f30d14d9740 1 -- 172.21.15.7:0/1556500542 shutdown_connections 2024-09-19T08:49:42.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.318+0000 7f30d14d9740 1 --2- 172.21.15.7:0/1556500542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56552ca3e370 0x56552ca55b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.318+0000 7f30d14d9740 1 --2- 172.21.15.7:0/1556500542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca34b40 0x56552ca3cef0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.318+0000 7f30d14d9740 1 --2- 172.21.15.7:0/1556500542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56552ca335d0 0x56552ca4a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.318+0000 7f30d14d9740 1 -- 172.21.15.7:0/1556500542 >> 172.21.15.7:0/1556500542 conn(0x56552c9fc310 msgr2=0x56552ca3c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:42.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.318+0000 7f30d14d9740 1 -- 172.21.15.7:0/1556500542 shutdown_connections 2024-09-19T08:49:42.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.318+0000 7f30d14d9740 1 -- 172.21.15.7:0/1556500542 wait complete. 2024-09-19T08:49:42.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.318+0000 7f30d14d9740 1 -- start start 2024-09-19T08:49:42.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.318+0000 7f30d14d9740 1 Processor -- start 2024-09-19T08:49:42.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.319+0000 7f30d14d9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca335d0 0x56552ca46d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.319+0000 7f30d14d9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56552ca34b40 0x56552ca42080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.319+0000 7f30d14d9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56552ca3e370 0x56552ca42690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.319+0000 7f30d14d9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f30c81abfd0 con 0x56552ca335d0 2024-09-19T08:49:42.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.319+0000 7f30d14d9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f30c81ad440 con 0x56552ca3e370 2024-09-19T08:49:42.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.319+0000 7f30d14d9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f30c81ac6a0 con 0x56552ca34b40 2024-09-19T08:49:42.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.319+0000 7f30d14d9740 10 client.0 _ll_register_callbacks cb 0x7f30c0004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:42.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.319+0000 7f30cce9c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca335d0 0x56552ca46d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.319+0000 7f30cce9c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca335d0 0x56552ca46d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40900/0 (socket says 172.21.15.7:40900) 2024-09-19T08:49:42.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.319+0000 7f30cce9c640 1 -- 172.21.15.7:0/2578213070 learned_addr learned my addr 172.21.15.7:0/2578213070 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:42.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.319+0000 7f30c7fff640 1 --2- 172.21.15.7:0/2578213070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56552ca34b40 0x56552ca42080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.319+0000 7f30cd69d640 1 --2- 172.21.15.7:0/2578213070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56552ca3e370 0x56552ca42690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.319+0000 7f30cce9c640 1 -- 172.21.15.7:0/2578213070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56552ca34b40 msgr2=0x56552ca42080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:42.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.319+0000 7f30cce9c640 1 --2- 172.21.15.7:0/2578213070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56552ca34b40 0x56552ca42080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.319+0000 7f30cce9c640 1 -- 172.21.15.7:0/2578213070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56552ca3e370 msgr2=0x56552ca42690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:42.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.319+0000 7f30cce9c640 1 --2- 172.21.15.7:0/2578213070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56552ca3e370 0x56552ca42690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.319+0000 7f30cce9c640 1 -- 172.21.15.7:0/2578213070 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56552ca42ec0 con 0x56552ca335d0 2024-09-19T08:49:42.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.319+0000 7f30cce9c640 1 --2- 172.21.15.7:0/2578213070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca335d0 0x56552ca46d00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f30b0008010 tx=0x7f30b0013eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a79eb2eca98ce76 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:42.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.319+0000 7f30a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:49:42.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.320+0000 7f30a7fff640 1 -- 172.21.15.7:0/2578213070 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b0017040 con 0x56552ca335d0 2024-09-19T08:49:42.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.320+0000 7f30a7fff640 1 -- 172.21.15.7:0/2578213070 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f30b00059c0 con 0x56552ca335d0 2024-09-19T08:49:42.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.320+0000 7f30d14d9740 1 -- 172.21.15.7:0/2578213070 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30b8020d40 con 0x56552ca335d0 2024-09-19T08:49:42.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.320+0000 7f30a7fff640 1 -- 172.21.15.7:0/2578213070 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f30b00094a0 con 0x56552ca335d0 2024-09-19T08:49:42.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.320+0000 7f30d14d9740 10 client.16332 fetch_fsmap learned FSMap version 25 2024-09-19T08:49:42.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.320+0000 7f30d14d9740 1 -- 172.21.15.7:0/2578213070 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56552cab8c50 con 0x56552ca335d0 2024-09-19T08:49:42.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.320+0000 7f30a7fff640 1 -- 172.21.15.7:0/2578213070 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30b8020d40 con 0x56552ca335d0 2024-09-19T08:49:42.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.320+0000 7f30a7fff640 1 -- 172.21.15.7:0/2578213070 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f30b00061d0 con 0x56552ca335d0 2024-09-19T08:49:42.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.320+0000 7f30d14d9740 10 client.16332 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:49:42.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.320+0000 7f30d14d9740 10 client.16332 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:49:42.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.320+0000 7f30d14d9740 20 client.16332 populate_metadata read hostname 'smithi007' 2024-09-19T08:49:42.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.320+0000 7f30d14d9740 1 --2- 172.21.15.7:0/2578213070 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x56552cab90a0 0x56552cabb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:42.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.320+0000 7f30d14d9740 4 client.16332 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:49:42.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.320+0000 7f30d14d9740 1 -- 172.21.15.7:0/2578213070 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56552c9a0d70 con 0x56552cab90a0 2024-09-19T08:49:42.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.321+0000 7f30c7fff640 1 --2- 172.21.15.7:0/2578213070 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x56552cab90a0 0x56552cabb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:42.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.321+0000 7f30c7fff640 1 --2- 172.21.15.7:0/2578213070 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x56552cab90a0 0x56552cabb490 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d327b59edb6e460b server_cookie=6c313844f6074a2b in_seq=0 out_seq=0 2024-09-19T08:49:42.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.321+0000 7f30a7fff640 10 client.16332 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:49:42.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.321+0000 7f30a7fff640 1 -- 172.21.15.7:0/2578213070 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56552c9a0d70 con 0x56552cab90a0 2024-09-19T08:49:42.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.321+0000 7f30a7fff640 10 client.16332 handle_command_reply: tid=0 2024-09-19T08:49:42.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.321+0000 7f30d14d9740 1 client.16332 shutdown 2024-09-19T08:49:42.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.322+0000 7f30d14d9740 1 -- 172.21.15.7:0/2578213070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca335d0 msgr2=0x56552ca46d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:42.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.322+0000 7f30d14d9740 1 --2- 172.21.15.7:0/2578213070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca335d0 0x56552ca46d00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f30b0008010 tx=0x7f30b0013eb0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.322+0000 7f30d14d9740 1 -- 172.21.15.7:0/2578213070 shutdown_connections 2024-09-19T08:49:42.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.322+0000 7f30d14d9740 1 --2- 172.21.15.7:0/2578213070 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x56552cab90a0 0x56552cabb490 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.322+0000 7f30d14d9740 1 --2- 172.21.15.7:0/2578213070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56552ca3e370 0x56552ca42690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.322+0000 7f30d14d9740 1 --2- 172.21.15.7:0/2578213070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56552ca34b40 0x56552ca42080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.322+0000 7f30d14d9740 1 --2- 172.21.15.7:0/2578213070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56552ca335d0 0x56552ca46d00 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.322+0000 7f30d14d9740 1 -- 172.21.15.7:0/2578213070 >> 172.21.15.7:0/2578213070 conn(0x56552c9fc310 msgr2=0x56552ca2ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:42.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.322+0000 7f30a7fff640 0 client.16332 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:49:42.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.322+0000 7f30d14d9740 1 -- 172.21.15.7:0/2578213070 shutdown_connections 2024-09-19T08:49:42.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.322+0000 7f30d14d9740 1 -- 172.21.15.7:0/2578213070 wait complete. 2024-09-19T08:49:42.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.322+0000 7f30d14d9740 20 client.16332 trim_cache size 0 max 16384 2024-09-19T08:49:42.339 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:49:42.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.323+0000 7f30cf100640 1 -- 172.21.15.7:0/2230884137 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f30b40a33b0 msgr2=0x7f30b40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:42.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.323+0000 7f30cf100640 1 --2- 172.21.15.7:0/2230884137 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f30b40a33b0 0x7f30b40a5870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f30c810d610 tx=0x7f30b8013b00 comp rx=0 tx=0).stop 2024-09-19T08:49:42.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.323+0000 7f30cf100640 1 -- 172.21.15.7:0/2230884137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30c810c2f0 msgr2=0x7f30c819cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:42.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.323+0000 7f30cf100640 1 --2- 172.21.15.7:0/2230884137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30c810c2f0 0x7f30c819cf00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009230 tx=0x7f30c00042f0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.323+0000 7f30cf100640 1 -- 172.21.15.7:0/2230884137 shutdown_connections 2024-09-19T08:49:42.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.323+0000 7f30cf100640 1 --2- 172.21.15.7:0/2230884137 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f30b40a33b0 0x7f30b40a5870 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.323+0000 7f30cf100640 1 --2- 172.21.15.7:0/2230884137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30c810c2f0 0x7f30c819cf00 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.323+0000 7f30cf100640 1 --2- 172.21.15.7:0/2230884137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30c81037a0 0x7f30c8198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.323+0000 7f30cf100640 1 --2- 172.21.15.7:0/2230884137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30c8102df0 0x7f30c8198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:42.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.323+0000 7f30cf100640 1 -- 172.21.15.7:0/2230884137 >> 172.21.15.7:0/2230884137 conn(0x7f30c80fc7d0 msgr2=0x7f30c80fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:42.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.323+0000 7f30cf100640 1 -- 172.21.15.7:0/2230884137 shutdown_connections 2024-09-19T08:49:42.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:42.323+0000 7f30cf100640 1 -- 172.21.15.7:0/2230884137 wait complete. 2024-09-19T08:49:42.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:42 smithi007 ceph-mon[31221]: pgmap v158: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:42.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:42 smithi044 ceph-mon[35072]: pgmap v158: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:42.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:42 smithi175 ceph-mon[35688]: pgmap v158: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:43.121 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:49:43.378 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:43.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.811+0000 7fdb8bae6640 1 -- 172.21.15.7:0/2838588331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb84074eb0 msgr2=0x7fdb84112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:43.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.811+0000 7fdb8bae6640 1 --2- 172.21.15.7:0/2838588331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb84074eb0 0x7fdb84112650 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009900 tx=0x7fdb7402a480 comp rx=0 tx=0).stop 2024-09-19T08:49:43.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.812+0000 7fdb8bae6640 1 -- 172.21.15.7:0/2838588331 shutdown_connections 2024-09-19T08:49:43.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.812+0000 7fdb8bae6640 1 --2- 172.21.15.7:0/2838588331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb84112b90 0x7fdb84114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.812+0000 7fdb8bae6640 1 --2- 172.21.15.7:0/2838588331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb84074eb0 0x7fdb84112650 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.812+0000 7fdb8bae6640 1 --2- 172.21.15.7:0/2838588331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb84074590 0x7fdb84074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.812+0000 7fdb8bae6640 1 -- 172.21.15.7:0/2838588331 >> 172.21.15.7:0/2838588331 conn(0x7fdb840fd8c0 msgr2=0x7fdb840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:43.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.812+0000 7fdb8bae6640 1 -- 172.21.15.7:0/2838588331 shutdown_connections 2024-09-19T08:49:43.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.812+0000 7fdb8bae6640 1 -- 172.21.15.7:0/2838588331 wait complete. 2024-09-19T08:49:43.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.812+0000 7fdb8bae6640 1 Processor -- start 2024-09-19T08:49:43.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.812+0000 7fdb8bae6640 1 -- start start 2024-09-19T08:49:43.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.812+0000 7fdb8bae6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb84074590 0x7fdb841a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:43.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb8bae6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb84074eb0 0x7fdb841a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:43.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb8bae6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb84112b90 0x7fdb8419e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:43.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb8bae6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb84118560 con 0x7fdb84074eb0 2024-09-19T08:49:43.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb8bae6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdb841183e0 con 0x7fdb84074590 2024-09-19T08:49:43.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb8bae6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdb841186e0 con 0x7fdb84112b90 2024-09-19T08:49:43.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb89081640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb84074eb0 0x7fdb841a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:43.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb89081640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb84074eb0 0x7fdb841a4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44828/0 (socket says 172.21.15.7:44828) 2024-09-19T08:49:43.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb89081640 1 -- 172.21.15.7:0/863063663 learned_addr learned my addr 172.21.15.7:0/863063663 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:43.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb89882640 1 --2- 172.21.15.7:0/863063663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb84074590 0x7fdb841a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:43.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb8a083640 1 --2- 172.21.15.7:0/863063663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb84112b90 0x7fdb8419e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:43.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb89081640 1 -- 172.21.15.7:0/863063663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb84112b90 msgr2=0x7fdb8419e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:43.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb89081640 1 --2- 172.21.15.7:0/863063663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb84112b90 0x7fdb8419e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb89081640 1 -- 172.21.15.7:0/863063663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb84074590 msgr2=0x7fdb841a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:43.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb89081640 1 --2- 172.21.15.7:0/863063663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb84074590 0x7fdb841a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb89081640 1 -- 172.21.15.7:0/863063663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8419f000 con 0x7fdb84074eb0 2024-09-19T08:49:43.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb8a083640 1 --2- 172.21.15.7:0/863063663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb84112b90 0x7fdb8419e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:43.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb89882640 1 --2- 172.21.15.7:0/863063663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb84074590 0x7fdb841a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:43.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb89081640 1 --2- 172.21.15.7:0/863063663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb84074eb0 0x7fdb841a4c50 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fdb74006010 tx=0x7fdb740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:43.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb7affd640 1 -- 172.21.15.7:0/863063663 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7403f030 con 0x7fdb84074eb0 2024-09-19T08:49:43.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb8bae6640 1 -- 172.21.15.7:0/863063663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb8419f290 con 0x7fdb84074eb0 2024-09-19T08:49:43.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb7affd640 1 -- 172.21.15.7:0/863063663 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb74003ce0 con 0x7fdb84074eb0 2024-09-19T08:49:43.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb7affd640 1 -- 172.21.15.7:0/863063663 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb74035070 con 0x7fdb84074eb0 2024-09-19T08:49:43.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.813+0000 7fdb8bae6640 1 -- 172.21.15.7:0/863063663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb841ab5e0 con 0x7fdb84074eb0 2024-09-19T08:49:43.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.816+0000 7fdb7affd640 1 -- 172.21.15.7:0/863063663 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fdb74042030 con 0x7fdb84074eb0 2024-09-19T08:49:43.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.816+0000 7fdb8debf740 1 Processor -- start 2024-09-19T08:49:43.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.816+0000 7fdb8debf740 1 -- start start 2024-09-19T08:49:43.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.817+0000 7fdb8debf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561962a55b40 0x561962a54090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:43.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.817+0000 7fdb8debf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a545d0 0x561962a54a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:43.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.817+0000 7fdb8debf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561962a5f370 0x561962a61760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:43.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.817+0000 7fdb8debf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5619629ba2f0 con 0x561962a545d0 2024-09-19T08:49:43.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.817+0000 7fdb8debf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561962961cf0 con 0x561962a55b40 2024-09-19T08:49:43.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.817+0000 7fdb8debf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5619629b62b0 con 0x561962a5f370 2024-09-19T08:49:43.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.817+0000 7fdb89882640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a545d0 0x561962a54a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:43.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.817+0000 7fdb89882640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a545d0 0x561962a54a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44834/0 (socket says 172.21.15.7:44834) 2024-09-19T08:49:43.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.817+0000 7fdb89882640 1 -- 172.21.15.7:0/1197781044 learned_addr learned my addr 172.21.15.7:0/1197781044 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:43.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.817+0000 7fdb8a083640 1 --2- 172.21.15.7:0/1197781044 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561962a55b40 0x561962a54090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:43.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.817+0000 7fdb89081640 1 --2- 172.21.15.7:0/1197781044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561962a5f370 0x561962a61760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:43.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.817+0000 7fdb7affd640 1 --2- 172.21.15.7:0/863063663 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdb700a33b0 0x7fdb700a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:43.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.817+0000 7fdb89882640 1 -- 172.21.15.7:0/1197781044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561962a5f370 msgr2=0x561962a61760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:43.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.817+0000 7fdb89882640 1 --2- 172.21.15.7:0/1197781044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561962a5f370 0x561962a61760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.817+0000 7fdb89882640 1 -- 172.21.15.7:0/1197781044 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561962a55b40 msgr2=0x561962a54090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:43.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.817+0000 7fdb89882640 1 --2- 172.21.15.7:0/1197781044 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561962a55b40 0x561962a54090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.817+0000 7fdb89882640 1 -- 172.21.15.7:0/1197781044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619629463a0 con 0x561962a545d0 2024-09-19T08:49:43.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.817+0000 7fdb89081640 1 --2- 172.21.15.7:0/1197781044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561962a5f370 0x561962a61760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:49:43.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.817+0000 7fdb8a083640 1 --2- 172.21.15.7:0/863063663 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdb700a33b0 0x7fdb700a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:43.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.817+0000 7fdb7affd640 1 -- 172.21.15.7:0/863063663 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fdb740f0420 con 0x7fdb84074eb0 2024-09-19T08:49:43.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.817+0000 7fdb89882640 1 --2- 172.21.15.7:0/1197781044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a545d0 0x561962a54a10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fdb80009cf0 tx=0x7fdb800117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f0bcdc543e8511 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:43.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.818+0000 7fdb6ffff640 1 -- 172.21.15.7:0/1197781044 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb80012450 con 0x561962a545d0 2024-09-19T08:49:43.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.818+0000 7fdb6ffff640 1 -- 172.21.15.7:0/1197781044 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb80012ad0 con 0x561962a545d0 2024-09-19T08:49:43.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.818+0000 7fdb8debf740 1 -- 172.21.15.7:0/1197781044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a545d0 msgr2=0x561962a54a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:43.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.818+0000 7fdb8a083640 1 --2- 172.21.15.7:0/863063663 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdb700a33b0 0x7fdb700a5870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c005c40 tx=0x7fdb7c004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:43.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.818+0000 7fdb8debf740 1 --2- 172.21.15.7:0/1197781044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a545d0 0x561962a54a10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fdb80009cf0 tx=0x7fdb800117b0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.818+0000 7fdb8debf740 1 -- 172.21.15.7:0/1197781044 shutdown_connections 2024-09-19T08:49:43.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.818+0000 7fdb8debf740 1 --2- 172.21.15.7:0/1197781044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561962a5f370 0x561962a61760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.818+0000 7fdb8debf740 1 --2- 172.21.15.7:0/1197781044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a545d0 0x561962a54a10 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.818+0000 7fdb8debf740 1 --2- 172.21.15.7:0/1197781044 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561962a55b40 0x561962a54090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.818+0000 7fdb8debf740 1 -- 172.21.15.7:0/1197781044 >> 172.21.15.7:0/1197781044 conn(0x561962a1d310 msgr2=0x561962a50c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:43.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.818+0000 7fdb8debf740 1 -- 172.21.15.7:0/1197781044 shutdown_connections 2024-09-19T08:49:43.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.818+0000 7fdb8debf740 1 -- 172.21.15.7:0/1197781044 wait complete. 2024-09-19T08:49:43.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.819+0000 7fdb8debf740 1 -- start start 2024-09-19T08:49:43.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.819+0000 7fdb8debf740 1 Processor -- start 2024-09-19T08:49:43.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.819+0000 7fdb8debf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561962a545d0 0x561962a5ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:43.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.819+0000 7fdb8debf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561962a55b40 0x561962a5be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:43.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.819+0000 7fdb8debf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a5f370 0x561962a5c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:43.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.819+0000 7fdb8debf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561962a620c0 con 0x561962a5f370 2024-09-19T08:49:43.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.819+0000 7fdb8debf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561962975060 con 0x561962a545d0 2024-09-19T08:49:43.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.819+0000 7fdb8debf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561962a62240 con 0x561962a55b40 2024-09-19T08:49:43.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.819+0000 7fdb8debf740 10 client.0 _ll_register_callbacks cb 0x5619626c88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:43.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.819+0000 7fdb8a083640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a5f370 0x561962a5c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:43.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.819+0000 7fdb8a083640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a5f370 0x561962a5c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44848/0 (socket says 172.21.15.7:44848) 2024-09-19T08:49:43.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.819+0000 7fdb8a083640 1 -- 172.21.15.7:0/246252064 learned_addr learned my addr 172.21.15.7:0/246252064 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:43.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.820+0000 7fdb89081640 1 --2- 172.21.15.7:0/246252064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561962a55b40 0x561962a5be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:43.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.820+0000 7fdb89882640 1 --2- 172.21.15.7:0/246252064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561962a545d0 0x561962a5ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:43.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.820+0000 7fdb8a083640 1 -- 172.21.15.7:0/246252064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561962a55b40 msgr2=0x561962a5be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:43.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.820+0000 7fdb8a083640 1 --2- 172.21.15.7:0/246252064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561962a55b40 0x561962a5be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.820+0000 7fdb8a083640 1 -- 172.21.15.7:0/246252064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561962a545d0 msgr2=0x561962a5ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:43.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.820+0000 7fdb8a083640 1 --2- 172.21.15.7:0/246252064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561962a545d0 0x561962a5ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.820+0000 7fdb8a083640 1 -- 172.21.15.7:0/246252064 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56196272b3c0 con 0x561962a5f370 2024-09-19T08:49:43.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.820+0000 7fdb8a083640 1 --2- 172.21.15.7:0/246252064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a5f370 0x561962a5c3d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c0116e0 tx=0x7fdb7c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3896b9a78095a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:43.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.820+0000 7fdb6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:49:43.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.820+0000 7fdb6d7fa640 1 -- 172.21.15.7:0/246252064 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c013970 con 0x561962a5f370 2024-09-19T08:49:43.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.820+0000 7fdb6d7fa640 1 -- 172.21.15.7:0/246252064 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fdb7c013b10 con 0x561962a5f370 2024-09-19T08:49:43.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.820+0000 7fdb8debf740 1 -- 172.21.15.7:0/246252064 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb80012ad0 con 0x561962a5f370 2024-09-19T08:49:43.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.820+0000 7fdb6d7fa640 1 -- 172.21.15.7:0/246252064 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdb7c02f050 con 0x561962a5f370 2024-09-19T08:49:43.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.820+0000 7fdb8debf740 10 client.16344 fetch_fsmap learned FSMap version 25 2024-09-19T08:49:43.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.820+0000 7fdb8debf740 1 -- 172.21.15.7:0/246252064 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561962a6da10 con 0x561962a5f370 2024-09-19T08:49:43.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.821+0000 7fdb6d7fa640 1 -- 172.21.15.7:0/246252064 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb80012ad0 con 0x561962a5f370 2024-09-19T08:49:43.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.821+0000 7fdb6d7fa640 1 -- 172.21.15.7:0/246252064 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdb7c00f3f0 con 0x561962a5f370 2024-09-19T08:49:43.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.821+0000 7fdb8debf740 10 client.16344 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:49:43.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.821+0000 7fdb8debf740 10 client.16344 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:43.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.821+0000 7fdb8debf740 20 client.16344 populate_metadata read hostname 'smithi007' 2024-09-19T08:49:43.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.821+0000 7fdb8debf740 1 --2- 172.21.15.7:0/246252064 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561962a6eed0 0x561962a71340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:43.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.821+0000 7fdb8debf740 4 client.16344 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:49:43.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.821+0000 7fdb8debf740 1 -- 172.21.15.7:0/246252064 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619629c7860 con 0x561962a6eed0 2024-09-19T08:49:43.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.821+0000 7fdb89882640 1 --2- 172.21.15.7:0/246252064 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561962a6eed0 0x561962a71340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:43.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.821+0000 7fdb89882640 1 --2- 172.21.15.7:0/246252064 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561962a6eed0 0x561962a71340 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c918514412a0a86b server_cookie=8fe3943a0ca4e5e7 in_seq=0 out_seq=0 2024-09-19T08:49:43.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.821+0000 7fdb6d7fa640 10 client.16344 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:43.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.822+0000 7fdb6d7fa640 1 -- 172.21.15.7:0/246252064 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5619629c7860 con 0x561962a6eed0 2024-09-19T08:49:43.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.822+0000 7fdb6d7fa640 10 client.16344 handle_command_reply: tid=0 2024-09-19T08:49:43.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.822+0000 7fdb8debf740 1 client.16344 shutdown 2024-09-19T08:49:43.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.822+0000 7fdb8debf740 1 -- 172.21.15.7:0/246252064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a5f370 msgr2=0x561962a5c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:43.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.822+0000 7fdb8debf740 1 --2- 172.21.15.7:0/246252064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a5f370 0x561962a5c3d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c0116e0 tx=0x7fdb7c004ab0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.822+0000 7fdb8debf740 1 -- 172.21.15.7:0/246252064 shutdown_connections 2024-09-19T08:49:43.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.822+0000 7fdb8debf740 1 --2- 172.21.15.7:0/246252064 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561962a6eed0 0x561962a71340 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.822+0000 7fdb8debf740 1 --2- 172.21.15.7:0/246252064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a5f370 0x561962a5c3d0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.822+0000 7fdb8debf740 1 --2- 172.21.15.7:0/246252064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561962a55b40 0x561962a5be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.822+0000 7fdb8debf740 1 --2- 172.21.15.7:0/246252064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561962a545d0 0x561962a5ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.822+0000 7fdb8debf740 1 -- 172.21.15.7:0/246252064 >> 172.21.15.7:0/246252064 conn(0x561962a1d310 msgr2=0x561962a56930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:43.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.822+0000 7fdb6d7fa640 0 client.16344 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:43.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.822+0000 7fdb8debf740 1 -- 172.21.15.7:0/246252064 shutdown_connections 2024-09-19T08:49:43.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.823+0000 7fdb8debf740 1 -- 172.21.15.7:0/246252064 wait complete. 2024-09-19T08:49:43.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.823+0000 7fdb8debf740 20 client.16344 trim_cache size 0 max 16384 2024-09-19T08:49:43.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.835+0000 7fdb8debf740 1 Processor -- start 2024-09-19T08:49:43.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.836+0000 7fdb8debf740 1 -- start start 2024-09-19T08:49:43.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.836+0000 7fdb8debf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561962a545d0 0x561962a5add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:43.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.836+0000 7fdb8debf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a55b40 0x561962a5c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:43.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.836+0000 7fdb8debf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561962a5f370 0x561962a5de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:43.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.836+0000 7fdb8debf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb841b6840 con 0x561962a55b40 2024-09-19T08:49:43.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.836+0000 7fdb8debf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdb841b4110 con 0x561962a545d0 2024-09-19T08:49:43.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.836+0000 7fdb8debf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdb841b1f60 con 0x561962a5f370 2024-09-19T08:49:43.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.836+0000 7fdb89081640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a55b40 0x561962a5c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:43.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.836+0000 7fdb89081640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a55b40 0x561962a5c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44856/0 (socket says 172.21.15.7:44856) 2024-09-19T08:49:43.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.836+0000 7fdb89081640 1 -- 172.21.15.7:0/3444260379 learned_addr learned my addr 172.21.15.7:0/3444260379 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:43.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.836+0000 7fdb89882640 1 --2- 172.21.15.7:0/3444260379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561962a545d0 0x561962a5add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:43.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.836+0000 7fdb89081640 1 -- 172.21.15.7:0/3444260379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561962a5f370 msgr2=0x561962a5de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:43.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.836+0000 7fdb89081640 1 --2- 172.21.15.7:0/3444260379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561962a5f370 0x561962a5de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.836+0000 7fdb89081640 1 -- 172.21.15.7:0/3444260379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561962a545d0 msgr2=0x561962a5add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:43.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.836+0000 7fdb89081640 1 --2- 172.21.15.7:0/3444260379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561962a545d0 0x561962a5add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.836+0000 7fdb89081640 1 -- 172.21.15.7:0/3444260379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561962a55780 con 0x561962a55b40 2024-09-19T08:49:43.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.836+0000 7fdb89882640 1 --2- 172.21.15.7:0/3444260379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561962a545d0 0x561962a5add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:49:43.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.836+0000 7fdb89081640 1 --2- 172.21.15.7:0/3444260379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a55b40 0x561962a5c2b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fdb74005940 tx=0x7fdb7403b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61903111fccc1186 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:43.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.836+0000 7fdb6f7fe640 1 -- 172.21.15.7:0/3444260379 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb74049040 con 0x561962a55b40 2024-09-19T08:49:43.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.836+0000 7fdb6f7fe640 1 -- 172.21.15.7:0/3444260379 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb740bce50 con 0x561962a55b40 2024-09-19T08:49:43.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.836+0000 7fdb6f7fe640 1 -- 172.21.15.7:0/3444260379 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb740edd80 con 0x561962a55b40 2024-09-19T08:49:43.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.837+0000 7fdb8debf740 1 -- 172.21.15.7:0/3444260379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a55b40 msgr2=0x561962a5c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:43.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.837+0000 7fdb8debf740 1 --2- 172.21.15.7:0/3444260379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a55b40 0x561962a5c2b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fdb74005940 tx=0x7fdb7403b5d0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.837+0000 7fdb8debf740 1 -- 172.21.15.7:0/3444260379 shutdown_connections 2024-09-19T08:49:43.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.837+0000 7fdb8debf740 1 --2- 172.21.15.7:0/3444260379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561962a5f370 0x561962a5de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.837+0000 7fdb8debf740 1 --2- 172.21.15.7:0/3444260379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a55b40 0x561962a5c2b0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.837+0000 7fdb8debf740 1 --2- 172.21.15.7:0/3444260379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561962a545d0 0x561962a5add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.837+0000 7fdb8debf740 1 -- 172.21.15.7:0/3444260379 >> 172.21.15.7:0/3444260379 conn(0x561962a1d310 msgr2=0x561962a5d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:43.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.837+0000 7fdb8debf740 1 -- 172.21.15.7:0/3444260379 shutdown_connections 2024-09-19T08:49:43.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.837+0000 7fdb8debf740 1 -- 172.21.15.7:0/3444260379 wait complete. 2024-09-19T08:49:43.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.837+0000 7fdb8debf740 1 -- start start 2024-09-19T08:49:43.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.837+0000 7fdb8debf740 1 Processor -- start 2024-09-19T08:49:43.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.838+0000 7fdb8debf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561962a545d0 0x561962a67700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:43.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.838+0000 7fdb8debf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561962a55b40 0x561962a67c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:43.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.838+0000 7fdb8debf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a5f370 0x561962a584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:43.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.838+0000 7fdb8debf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb841b25d0 con 0x561962a5f370 2024-09-19T08:49:43.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.838+0000 7fdb8debf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdb841b3a40 con 0x561962a545d0 2024-09-19T08:49:43.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.838+0000 7fdb8debf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdb841b2ca0 con 0x561962a55b40 2024-09-19T08:49:43.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.838+0000 7fdb8debf740 10 client.0 _ll_register_callbacks cb 0x7fdb7c00aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:43.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.838+0000 7fdb8a083640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a5f370 0x561962a584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:43.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.838+0000 7fdb8a083640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a5f370 0x561962a584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44872/0 (socket says 172.21.15.7:44872) 2024-09-19T08:49:43.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.838+0000 7fdb8a083640 1 -- 172.21.15.7:0/3188233825 learned_addr learned my addr 172.21.15.7:0/3188233825 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:43.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.838+0000 7fdb89882640 1 --2- 172.21.15.7:0/3188233825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561962a545d0 0x561962a67700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:43.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.838+0000 7fdb89081640 1 --2- 172.21.15.7:0/3188233825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561962a55b40 0x561962a67c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:43.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.838+0000 7fdb8a083640 1 -- 172.21.15.7:0/3188233825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561962a55b40 msgr2=0x561962a67c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:43.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.838+0000 7fdb8a083640 1 --2- 172.21.15.7:0/3188233825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561962a55b40 0x561962a67c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.838+0000 7fdb8a083640 1 -- 172.21.15.7:0/3188233825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561962a545d0 msgr2=0x561962a67700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:43.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.838+0000 7fdb8a083640 1 --2- 172.21.15.7:0/3188233825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561962a545d0 0x561962a67700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.838+0000 7fdb8a083640 1 -- 172.21.15.7:0/3188233825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561962a58b00 con 0x561962a5f370 2024-09-19T08:49:43.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.838+0000 7fdb89081640 1 --2- 172.21.15.7:0/3188233825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561962a55b40 0x561962a67c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:49:43.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.838+0000 7fdb89882640 1 --2- 172.21.15.7:0/3188233825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561962a545d0 0x561962a67700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:43.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.838+0000 7fdb8a083640 1 --2- 172.21.15.7:0/3188233825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a5f370 0x561962a584c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c00ab10 tx=0x7fdb7c005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3683c90bb1f9fcb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:43.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.838+0000 7fdb6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:49:43.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.839+0000 7fdb6d7fa640 1 -- 172.21.15.7:0/3188233825 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c038060 con 0x561962a5f370 2024-09-19T08:49:43.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.839+0000 7fdb8debf740 1 -- 172.21.15.7:0/3188233825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb740bce50 con 0x561962a5f370 2024-09-19T08:49:43.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.839+0000 7fdb6d7fa640 1 -- 172.21.15.7:0/3188233825 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fdb7c013970 con 0x561962a5f370 2024-09-19T08:49:43.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.839+0000 7fdb6d7fa640 1 -- 172.21.15.7:0/3188233825 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdb7c023020 con 0x561962a5f370 2024-09-19T08:49:43.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.839+0000 7fdb8debf740 10 client.16350 fetch_fsmap learned FSMap version 25 2024-09-19T08:49:43.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.839+0000 7fdb8debf740 1 -- 172.21.15.7:0/3188233825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561962ad94a0 con 0x561962a5f370 2024-09-19T08:49:43.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.839+0000 7fdb6d7fa640 1 -- 172.21.15.7:0/3188233825 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb740bce50 con 0x561962a5f370 2024-09-19T08:49:43.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.839+0000 7fdb6d7fa640 1 -- 172.21.15.7:0/3188233825 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdb7c032040 con 0x561962a5f370 2024-09-19T08:49:43.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.839+0000 7fdb8debf740 10 client.16350 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:49:43.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.839+0000 7fdb8debf740 10 client.16350 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:43.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.839+0000 7fdb8debf740 20 client.16350 populate_metadata read hostname 'smithi007' 2024-09-19T08:49:43.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.839+0000 7fdb8debf740 1 --2- 172.21.15.7:0/3188233825 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561962ad9bc0 0x561962adbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:43.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.839+0000 7fdb8debf740 4 client.16350 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:49:43.903 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:49:43.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.839+0000 7fdb8debf740 1 -- 172.21.15.7:0/3188233825 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5619629c1d70 con 0x561962ad9bc0 2024-09-19T08:49:43.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.840+0000 7fdb89882640 1 --2- 172.21.15.7:0/3188233825 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561962ad9bc0 0x561962adbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:43.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.840+0000 7fdb6d7fa640 10 client.16350 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:43.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.840+0000 7fdb89882640 1 --2- 172.21.15.7:0/3188233825 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561962ad9bc0 0x561962adbfe0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5bc02383db6c02 server_cookie=9431a2f73cc02599 in_seq=0 out_seq=0 2024-09-19T08:49:43.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.840+0000 7fdb6d7fa640 1 -- 172.21.15.7:0/3188233825 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5619629c1d70 con 0x561962ad9bc0 2024-09-19T08:49:43.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.840+0000 7fdb6d7fa640 10 client.16350 handle_command_reply: tid=0 2024-09-19T08:49:43.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.840+0000 7fdb8debf740 1 client.16350 shutdown 2024-09-19T08:49:43.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.841+0000 7fdb8debf740 1 -- 172.21.15.7:0/3188233825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a5f370 msgr2=0x561962a584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:43.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.841+0000 7fdb8debf740 1 --2- 172.21.15.7:0/3188233825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a5f370 0x561962a584c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c00ab10 tx=0x7fdb7c005b50 comp rx=0 tx=0).stop 2024-09-19T08:49:43.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.841+0000 7fdb8debf740 1 -- 172.21.15.7:0/3188233825 shutdown_connections 2024-09-19T08:49:43.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.841+0000 7fdb8debf740 1 --2- 172.21.15.7:0/3188233825 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561962ad9bc0 0x561962adbfe0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.841+0000 7fdb8debf740 1 --2- 172.21.15.7:0/3188233825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561962a5f370 0x561962a584c0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.841+0000 7fdb8debf740 1 --2- 172.21.15.7:0/3188233825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561962a55b40 0x561962a67c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.841+0000 7fdb6d7fa640 0 client.16350 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:43.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.841+0000 7fdb8debf740 1 --2- 172.21.15.7:0/3188233825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561962a545d0 0x561962a67700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.841+0000 7fdb8debf740 1 -- 172.21.15.7:0/3188233825 >> 172.21.15.7:0/3188233825 conn(0x561962a1d310 msgr2=0x561962a6a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:43.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.841+0000 7fdb8debf740 1 -- 172.21.15.7:0/3188233825 shutdown_connections 2024-09-19T08:49:43.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.841+0000 7fdb8debf740 1 -- 172.21.15.7:0/3188233825 wait complete. 2024-09-19T08:49:43.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.841+0000 7fdb8debf740 20 client.16350 trim_cache size 0 max 16384 2024-09-19T08:49:43.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.842+0000 7fdb8bae6640 1 -- 172.21.15.7:0/863063663 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdb700a33b0 msgr2=0x7fdb700a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:43.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.842+0000 7fdb8bae6640 1 --2- 172.21.15.7:0/863063663 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdb700a33b0 0x7fdb700a5870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c005c40 tx=0x7fdb7c004a40 comp rx=0 tx=0).stop 2024-09-19T08:49:43.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.842+0000 7fdb8bae6640 1 -- 172.21.15.7:0/863063663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb84074eb0 msgr2=0x7fdb841a4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:43.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.842+0000 7fdb8bae6640 1 --2- 172.21.15.7:0/863063663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb84074eb0 0x7fdb841a4c50 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fdb74006010 tx=0x7fdb740042f0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.842+0000 7fdb8bae6640 1 -- 172.21.15.7:0/863063663 shutdown_connections 2024-09-19T08:49:43.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.842+0000 7fdb8bae6640 1 --2- 172.21.15.7:0/863063663 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdb700a33b0 0x7fdb700a5870 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.842+0000 7fdb8bae6640 1 --2- 172.21.15.7:0/863063663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb84112b90 0x7fdb8419e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.842+0000 7fdb8bae6640 1 --2- 172.21.15.7:0/863063663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb84074eb0 0x7fdb841a4c50 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.842+0000 7fdb8bae6640 1 --2- 172.21.15.7:0/863063663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb84074590 0x7fdb841a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:43.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.842+0000 7fdb8bae6640 1 -- 172.21.15.7:0/863063663 >> 172.21.15.7:0/863063663 conn(0x7fdb840fd8c0 msgr2=0x7fdb840ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:43.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.842+0000 7fdb8bae6640 1 -- 172.21.15.7:0/863063663 shutdown_connections 2024-09-19T08:49:43.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:43.842+0000 7fdb8bae6640 1 -- 172.21.15.7:0/863063663 wait complete. 2024-09-19T08:49:44.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:44 smithi007 ceph-mon[31221]: pgmap v159: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:49:44.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:44 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:44.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:44 smithi044 ceph-mon[35072]: pgmap v159: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:49:44.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:44 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:44.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:44 smithi175 ceph-mon[35688]: pgmap v159: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:49:44.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:44 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:45.663 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:49:45.663 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:49:45.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:45 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:45.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:45 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:45.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:45 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:49:45.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:45 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:45.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:45 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:45.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:45 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:49:45.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:45 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:45.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:45 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:45.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:45 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:49:45.935 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:46.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.398+0000 7f3ea2c7b640 1 -- 172.21.15.7:0/1767290839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e9c102ef0 msgr2=0x7f3e9c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:46.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.398+0000 7f3ea2c7b640 1 --2- 172.21.15.7:0/1767290839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e9c102ef0 0x7f3e9c10da40 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009ca0 tx=0x7f3e9402a950 comp rx=0 tx=0).stop 2024-09-19T08:49:46.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.398+0000 7f3ea2c7b640 1 -- 172.21.15.7:0/1767290839 shutdown_connections 2024-09-19T08:49:46.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.398+0000 7f3ea2c7b640 1 --2- 172.21.15.7:0/1767290839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e9c102ef0 0x7f3e9c10da40 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.398+0000 7f3ea2c7b640 1 --2- 172.21.15.7:0/1767290839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e9c102570 0x7f3e9c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.398+0000 7f3ea2c7b640 1 --2- 172.21.15.7:0/1767290839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e9c100e20 0x7f3e9c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.398+0000 7f3ea2c7b640 1 -- 172.21.15.7:0/1767290839 >> 172.21.15.7:0/1767290839 conn(0x7f3e9c0fc7d0 msgr2=0x7f3e9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:46.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.398+0000 7f3ea2c7b640 1 -- 172.21.15.7:0/1767290839 shutdown_connections 2024-09-19T08:49:46.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.398+0000 7f3ea2c7b640 1 -- 172.21.15.7:0/1767290839 wait complete. 2024-09-19T08:49:46.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.399+0000 7f3ea2c7b640 1 Processor -- start 2024-09-19T08:49:46.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.399+0000 7f3ea2c7b640 1 -- start start 2024-09-19T08:49:46.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.399+0000 7f3ea2c7b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e9c100e20 0x7f3e9c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:46.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.399+0000 7f3ea2c7b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e9c102570 0x7f3e9c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:46.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.399+0000 7f3ea2c7b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e9c102ef0 0x7f3e9c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:46.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.399+0000 7f3ea2c7b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c110f80 con 0x7f3e9c102ef0 2024-09-19T08:49:46.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.399+0000 7f3ea2c7b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c110e00 con 0x7f3e9c102570 2024-09-19T08:49:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.399+0000 7f3ea2c7b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c111100 con 0x7f3e9c100e20 2024-09-19T08:49:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.399+0000 7f3ea1218640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e9c102ef0 0x7f3e9c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.399+0000 7f3ea1218640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e9c102ef0 0x7f3e9c0fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44886/0 (socket says 172.21.15.7:44886) 2024-09-19T08:49:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.399+0000 7f3ea1218640 1 -- 172.21.15.7:0/2703407835 learned_addr learned my addr 172.21.15.7:0/2703407835 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.399+0000 7f3e93fff640 1 --2- 172.21.15.7:0/2703407835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e9c102570 0x7f3e9c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.399+0000 7f3ea0a17640 1 --2- 172.21.15.7:0/2703407835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e9c100e20 0x7f3e9c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.400+0000 7f3ea1218640 1 -- 172.21.15.7:0/2703407835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e9c100e20 msgr2=0x7f3e9c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.400+0000 7f3ea1218640 1 --2- 172.21.15.7:0/2703407835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e9c100e20 0x7f3e9c0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.400+0000 7f3ea1218640 1 -- 172.21.15.7:0/2703407835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e9c102570 msgr2=0x7f3e9c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.400+0000 7f3ea1218640 1 --2- 172.21.15.7:0/2703407835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e9c102570 0x7f3e9c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.400+0000 7f3ea1218640 1 -- 172.21.15.7:0/2703407835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9c1a6950 con 0x7f3e9c102ef0 2024-09-19T08:49:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.400+0000 7f3ea1218640 1 --2- 172.21.15.7:0/2703407835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e9c102ef0 0x7f3e9c0fd700 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f3e94004af0 tx=0x7f3e9402f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:46.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.400+0000 7f3e91ffb640 1 -- 172.21.15.7:0/2703407835 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94034040 con 0x7f3e9c102ef0 2024-09-19T08:49:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.400+0000 7f3ea2c7b640 1 -- 172.21.15.7:0/2703407835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e9c1a6be0 con 0x7f3e9c102ef0 2024-09-19T08:49:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.400+0000 7f3e91ffb640 1 -- 172.21.15.7:0/2703407835 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e94030920 con 0x7f3e9c102ef0 2024-09-19T08:49:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.400+0000 7f3ea2c7b640 1 -- 172.21.15.7:0/2703407835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e9c1a7110 con 0x7f3e9c102ef0 2024-09-19T08:49:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.400+0000 7f3e91ffb640 1 -- 172.21.15.7:0/2703407835 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e940045d0 con 0x7f3e9c102ef0 2024-09-19T08:49:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.403+0000 7f3e91ffb640 1 -- 172.21.15.7:0/2703407835 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f3e94037020 con 0x7f3e9c102ef0 2024-09-19T08:49:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.403+0000 7f3ea5054740 1 Processor -- start 2024-09-19T08:49:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.403+0000 7f3ea5054740 1 -- start start 2024-09-19T08:49:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.403+0000 7f3ea5054740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 0x560a6e7eaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.403+0000 7f3ea5054740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7eb480 0x560a6e7f5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.403+0000 7f3ea5054740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a6e7f5d40 0x560a6e7f8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.403+0000 7f3ea5054740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560a6e750280 con 0x560a6e7eb480 2024-09-19T08:49:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.403+0000 7f3ea5054740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560a6e6f7b10 con 0x560a6e7eab60 2024-09-19T08:49:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.403+0000 7f3ea5054740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560a6e74c240 con 0x560a6e7f5d40 2024-09-19T08:49:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.403+0000 7f3ea0a17640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7eb480 0x560a6e7f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.404+0000 7f3ea0a17640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7eb480 0x560a6e7f5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44902/0 (socket says 172.21.15.7:44902) 2024-09-19T08:49:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.404+0000 7f3e93fff640 1 --2- 172.21.15.7:0/3160146314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 0x560a6e7eaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.404+0000 7f3ea0a17640 1 -- 172.21.15.7:0/3160146314 learned_addr learned my addr 172.21.15.7:0/3160146314 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.404+0000 7f3e91ffb640 1 --2- 172.21.15.7:0/2703407835 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3e840a33b0 0x7f3e840a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.404+0000 7f3ea1218640 1 --2- 172.21.15.7:0/2703407835 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3e840a33b0 0x7f3e840a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.404+0000 7f3e93fff640 1 --2- 172.21.15.7:0/3160146314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a6e7f5d40 0x560a6e7f8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.404+0000 7f3e93fff640 1 -- 172.21.15.7:0/3160146314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a6e7f5d40 msgr2=0x560a6e7f8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.404+0000 7f3e93fff640 1 --2- 172.21.15.7:0/3160146314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a6e7f5d40 0x560a6e7f8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.404+0000 7f3e93fff640 1 -- 172.21.15.7:0/3160146314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7eb480 msgr2=0x560a6e7f5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.404+0000 7f3e91ffb640 1 -- 172.21.15.7:0/2703407835 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f3e940f08f0 con 0x7f3e9c102ef0 2024-09-19T08:49:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.404+0000 7f3e93fff640 1 --2- 172.21.15.7:0/3160146314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7eb480 0x560a6e7f5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.404+0000 7f3e93fff640 1 -- 172.21.15.7:0/3160146314 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a6e7041f0 con 0x560a6e7eab60 2024-09-19T08:49:46.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.404+0000 7f3e93fff640 1 --2- 172.21.15.7:0/3160146314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 0x560a6e7eaf40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c0fe710 tx=0x7f3e8c0098c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dc4975ad4490a25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:46.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.404+0000 7f3ea1218640 1 --2- 172.21.15.7:0/2703407835 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3e840a33b0 0x7f3e840a5870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3e940a5fd0 tx=0x7f3e9408ea50 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:46.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.404+0000 7f3e82ffd640 1 -- 172.21.15.7:0/3160146314 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c005020 con 0x560a6e7eab60 2024-09-19T08:49:46.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.404+0000 7f3e82ffd640 1 -- 172.21.15.7:0/3160146314 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e8c0047a0 con 0x560a6e7eab60 2024-09-19T08:49:46.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.404+0000 7f3e82ffd640 1 -- 172.21.15.7:0/3160146314 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c010720 con 0x560a6e7eab60 2024-09-19T08:49:46.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.405+0000 7f3ea5054740 1 -- 172.21.15.7:0/3160146314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 msgr2=0x560a6e7eaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:46.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.405+0000 7f3ea5054740 1 --2- 172.21.15.7:0/3160146314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 0x560a6e7eaf40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c0fe710 tx=0x7f3e8c0098c0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.405+0000 7f3ea5054740 1 -- 172.21.15.7:0/3160146314 shutdown_connections 2024-09-19T08:49:46.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.405+0000 7f3ea5054740 1 --2- 172.21.15.7:0/3160146314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a6e7f5d40 0x560a6e7f8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.405+0000 7f3ea5054740 1 --2- 172.21.15.7:0/3160146314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7eb480 0x560a6e7f5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.405+0000 7f3ea5054740 1 --2- 172.21.15.7:0/3160146314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 0x560a6e7eaf40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.405+0000 7f3ea5054740 1 -- 172.21.15.7:0/3160146314 >> 172.21.15.7:0/3160146314 conn(0x560a6e7e70f0 msgr2=0x560a6e7e74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:46.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.405+0000 7f3ea5054740 1 -- 172.21.15.7:0/3160146314 shutdown_connections 2024-09-19T08:49:46.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.405+0000 7f3ea5054740 1 -- 172.21.15.7:0/3160146314 wait complete. 2024-09-19T08:49:46.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.406+0000 7f3ea5054740 1 -- start start 2024-09-19T08:49:46.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.406+0000 7f3ea5054740 1 Processor -- start 2024-09-19T08:49:46.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.406+0000 7f3ea5054740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 0x560a6e7f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:46.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.406+0000 7f3ea5054740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a6e7eb480 0x560a6e7f3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:46.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.406+0000 7f3ea5054740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7f5d40 0x560a6e7f3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:46.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.406+0000 7f3ea5054740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560a6e7f8910 con 0x560a6e7f5d40 2024-09-19T08:49:46.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.406+0000 7f3ea5054740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560a6e70af10 con 0x560a6e7eab60 2024-09-19T08:49:46.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.406+0000 7f3ea5054740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560a6e7f8a90 con 0x560a6e7eb480 2024-09-19T08:49:46.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.406+0000 7f3ea5054740 10 client.0 _ll_register_callbacks cb 0x560a6e6d3a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:46.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.406+0000 7f3e93fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7f5d40 0x560a6e7f3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:46.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.406+0000 7f3e93fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7f5d40 0x560a6e7f3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44910/0 (socket says 172.21.15.7:44910) 2024-09-19T08:49:46.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.406+0000 7f3e93fff640 1 -- 172.21.15.7:0/852466209 learned_addr learned my addr 172.21.15.7:0/852466209 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:46.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.406+0000 7f3ea0a17640 1 --2- 172.21.15.7:0/852466209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a6e7eb480 0x560a6e7f3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:46.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.406+0000 7f3e93fff640 1 --2- 172.21.15.7:0/852466209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 0x560a6e7f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:46.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.407+0000 7f3ea0a17640 1 -- 172.21.15.7:0/852466209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 msgr2=0x560a6e7f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:46.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.407+0000 7f3ea0a17640 1 --2- 172.21.15.7:0/852466209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 0x560a6e7f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.407+0000 7f3ea0a17640 1 -- 172.21.15.7:0/852466209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7f5d40 msgr2=0x560a6e7f3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:46.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.407+0000 7f3ea0a17640 1 --2- 172.21.15.7:0/852466209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7f5d40 0x560a6e7f3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.407+0000 7f3ea0a17640 1 -- 172.21.15.7:0/852466209 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a6e4c16a0 con 0x560a6e7eb480 2024-09-19T08:49:46.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.407+0000 7f3e93fff640 1 --2- 172.21.15.7:0/852466209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7f5d40 0x560a6e7f3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:49:46.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.407+0000 7f3ea0a17640 1 --2- 172.21.15.7:0/852466209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a6e7eb480 0x560a6e7f3110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3e98005bc0 tx=0x7f3e98012b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d03c644518dc34f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:46.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.407+0000 7f3e7bfff640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-19T08:49:46.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.407+0000 7f3e7bfff640 1 -- 172.21.15.7:0/852466209 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e98004050 con 0x560a6e7eb480 2024-09-19T08:49:46.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.407+0000 7f3ea5054740 1 -- 172.21.15.7:0/852466209 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e8c0047a0 con 0x560a6e7eb480 2024-09-19T08:49:46.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.407+0000 7f3e7bfff640 1 -- 172.21.15.7:0/852466209 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f3e980041f0 con 0x560a6e7eb480 2024-09-19T08:49:46.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.408+0000 7f3e7bfff640 1 -- 172.21.15.7:0/852466209 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3e980043f0 con 0x560a6e7eb480 2024-09-19T08:49:46.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.408+0000 7f3ea5054740 10 client.25801 fetch_fsmap learned FSMap version 25 2024-09-19T08:49:46.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.408+0000 7f3ea5054740 1 -- 172.21.15.7:0/852466209 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560a6e8045a0 con 0x560a6e7eb480 2024-09-19T08:49:46.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.408+0000 7f3e7bfff640 1 -- 172.21.15.7:0/852466209 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e8c0047a0 con 0x560a6e7eb480 2024-09-19T08:49:46.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.408+0000 7f3e7bfff640 1 -- 172.21.15.7:0/852466209 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3e98003c20 con 0x560a6e7eb480 2024-09-19T08:49:46.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.408+0000 7f3ea5054740 10 client.25801 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:49:46.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.408+0000 7f3ea5054740 10 client.25801 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:46.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.408+0000 7f3ea5054740 20 client.25801 populate_metadata read hostname 'smithi007' 2024-09-19T08:49:46.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.408+0000 7f3ea5054740 1 --2- 172.21.15.7:0/852466209 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x560a6e8059b0 0x560a6e807dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:46.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.408+0000 7f3ea5054740 4 client.25801 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:49:46.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.408+0000 7f3ea5054740 1 -- 172.21.15.7:0/852466209 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a6e75d7f0 con 0x560a6e8059b0 2024-09-19T08:49:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.408+0000 7f3e93fff640 1 --2- 172.21.15.7:0/852466209 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x560a6e8059b0 0x560a6e807dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.409+0000 7f3e7bfff640 10 client.25801 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.409+0000 7f3e93fff640 1 --2- 172.21.15.7:0/852466209 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x560a6e8059b0 0x560a6e807dd0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f38ee96388c12d3a server_cookie=8faac145e84864a in_seq=0 out_seq=0 2024-09-19T08:49:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.409+0000 7f3e7bfff640 1 -- 172.21.15.7:0/852466209 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560a6e75d7f0 con 0x560a6e8059b0 2024-09-19T08:49:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.409+0000 7f3e7bfff640 10 client.25801 handle_command_reply: tid=0 2024-09-19T08:49:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.409+0000 7f3ea5054740 1 client.25801 shutdown 2024-09-19T08:49:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.410+0000 7f3ea5054740 1 -- 172.21.15.7:0/852466209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a6e7eb480 msgr2=0x560a6e7f3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.410+0000 7f3ea5054740 1 --2- 172.21.15.7:0/852466209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a6e7eb480 0x560a6e7f3110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3e98005bc0 tx=0x7f3e98012b80 comp rx=0 tx=0).stop 2024-09-19T08:49:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.410+0000 7f3ea5054740 1 -- 172.21.15.7:0/852466209 shutdown_connections 2024-09-19T08:49:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.410+0000 7f3ea5054740 1 --2- 172.21.15.7:0/852466209 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x560a6e8059b0 0x560a6e807dd0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.410+0000 7f3ea5054740 1 --2- 172.21.15.7:0/852466209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7f5d40 0x560a6e7f3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.410+0000 7f3ea5054740 1 --2- 172.21.15.7:0/852466209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a6e7eb480 0x560a6e7f3110 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.410+0000 7f3e7bfff640 0 client.25801 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:46.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.410+0000 7f3ea5054740 1 --2- 172.21.15.7:0/852466209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 0x560a6e7f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.410+0000 7f3ea5054740 1 -- 172.21.15.7:0/852466209 >> 172.21.15.7:0/852466209 conn(0x560a6e7e70f0 msgr2=0x560a6e7ece20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:46.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.410+0000 7f3ea5054740 1 -- 172.21.15.7:0/852466209 shutdown_connections 2024-09-19T08:49:46.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.410+0000 7f3ea5054740 1 -- 172.21.15.7:0/852466209 wait complete. 2024-09-19T08:49:46.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.410+0000 7f3ea5054740 20 client.25801 trim_cache size 0 max 16384 2024-09-19T08:49:46.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.427+0000 7f3ea5054740 1 Processor -- start 2024-09-19T08:49:46.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.428+0000 7f3ea5054740 1 -- start start 2024-09-19T08:49:46.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.428+0000 7f3ea5054740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 0x560a6e7f34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:46.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.428+0000 7f3ea5054740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7eb480 0x560a6e80d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:46.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.428+0000 7f3ea5054740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a6e7f5d40 0x560a6e80dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:46.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.428+0000 7f3ea5054740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c1b2300 con 0x560a6e7eb480 2024-09-19T08:49:46.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.428+0000 7f3ea5054740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c1afbd0 con 0x560a6e7eab60 2024-09-19T08:49:46.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.428+0000 7f3ea5054740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c1ada20 con 0x560a6e7f5d40 2024-09-19T08:49:46.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.428+0000 7f3ea0a17640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7eb480 0x560a6e80d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:46.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.428+0000 7f3e93fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 0x560a6e7f34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:46.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.428+0000 7f3ea0a17640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7eb480 0x560a6e80d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44924/0 (socket says 172.21.15.7:44924) 2024-09-19T08:49:46.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.428+0000 7f3ea0a17640 1 -- 172.21.15.7:0/3316001850 learned_addr learned my addr 172.21.15.7:0/3316001850 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:46.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.428+0000 7f3e93fff640 1 --2- 172.21.15.7:0/3316001850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a6e7f5d40 0x560a6e80dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:46.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.428+0000 7f3e93fff640 1 -- 172.21.15.7:0/3316001850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a6e7f5d40 msgr2=0x560a6e80dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:46.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.428+0000 7f3e93fff640 1 --2- 172.21.15.7:0/3316001850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a6e7f5d40 0x560a6e80dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.428+0000 7f3e93fff640 1 -- 172.21.15.7:0/3316001850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7eb480 msgr2=0x560a6e80d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:46.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.428+0000 7f3e93fff640 1 --2- 172.21.15.7:0/3316001850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7eb480 0x560a6e80d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.428+0000 7f3e93fff640 1 -- 172.21.15.7:0/3316001850 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a6e7f51d0 con 0x560a6e7eab60 2024-09-19T08:49:46.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.428+0000 7f3ea0a17640 1 --2- 172.21.15.7:0/3316001850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7eb480 0x560a6e80d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:49:46.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.429+0000 7f3e93fff640 1 --2- 172.21.15.7:0/3316001850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 0x560a6e7f34a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x560a6e808610 tx=0x7f3e8c005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f06c8a1a0a0f0244 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:46.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.429+0000 7f3e827fc640 1 -- 172.21.15.7:0/3316001850 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c028040 con 0x560a6e7eab60 2024-09-19T08:49:46.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.429+0000 7f3e827fc640 1 -- 172.21.15.7:0/3316001850 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e8c005490 con 0x560a6e7eab60 2024-09-19T08:49:46.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.429+0000 7f3e827fc640 1 -- 172.21.15.7:0/3316001850 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c01fd10 con 0x560a6e7eab60 2024-09-19T08:49:46.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.429+0000 7f3ea5054740 1 -- 172.21.15.7:0/3316001850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 msgr2=0x560a6e7f34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:46.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.429+0000 7f3ea5054740 1 --2- 172.21.15.7:0/3316001850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 0x560a6e7f34a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x560a6e808610 tx=0x7f3e8c005850 comp rx=0 tx=0).stop 2024-09-19T08:49:46.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.429+0000 7f3ea5054740 1 -- 172.21.15.7:0/3316001850 shutdown_connections 2024-09-19T08:49:46.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.429+0000 7f3ea5054740 1 --2- 172.21.15.7:0/3316001850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a6e7f5d40 0x560a6e80dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.429+0000 7f3ea5054740 1 --2- 172.21.15.7:0/3316001850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7eb480 0x560a6e80d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.429+0000 7f3ea5054740 1 --2- 172.21.15.7:0/3316001850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 0x560a6e7f34a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.429+0000 7f3ea5054740 1 -- 172.21.15.7:0/3316001850 >> 172.21.15.7:0/3316001850 conn(0x560a6e7e70f0 msgr2=0x560a6e7f1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:46.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.430+0000 7f3ea5054740 1 -- 172.21.15.7:0/3316001850 shutdown_connections 2024-09-19T08:49:46.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.430+0000 7f3ea5054740 1 -- 172.21.15.7:0/3316001850 wait complete. 2024-09-19T08:49:46.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.430+0000 7f3ea5054740 1 -- start start 2024-09-19T08:49:46.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.430+0000 7f3ea5054740 1 Processor -- start 2024-09-19T08:49:46.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.430+0000 7f3ea5054740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 0x560a6e7f9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:46.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.430+0000 7f3ea5054740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7eb480 0x560a6e7fa030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:46.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.430+0000 7f3ea5054740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a6e7f5d40 0x560a6e7fa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:46.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.430+0000 7f3ea5054740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c1ae090 con 0x560a6e7eb480 2024-09-19T08:49:46.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.430+0000 7f3ea5054740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c1af500 con 0x560a6e7eab60 2024-09-19T08:49:46.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.430+0000 7f3ea5054740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c1ae760 con 0x560a6e7f5d40 2024-09-19T08:49:46.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.430+0000 7f3ea5054740 10 client.0 _ll_register_callbacks cb 0x7f3e98009870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:46.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.431+0000 7f3e93fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 0x560a6e7f9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:46.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.431+0000 7f3ea0a17640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7eb480 0x560a6e7fa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:46.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.431+0000 7f3e93fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 0x560a6e7f9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:40452/0 (socket says 172.21.15.7:40452) 2024-09-19T08:49:46.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.431+0000 7f3e93fff640 1 -- 172.21.15.7:0/3677615187 learned_addr learned my addr 172.21.15.7:0/3677615187 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:46.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.431+0000 7f3e93fff640 1 --2- 172.21.15.7:0/3677615187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a6e7f5d40 0x560a6e7fa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:46.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.431+0000 7f3e93fff640 1 -- 172.21.15.7:0/3677615187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a6e7f5d40 msgr2=0x560a6e7fa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:46.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.431+0000 7f3e93fff640 1 --2- 172.21.15.7:0/3677615187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a6e7f5d40 0x560a6e7fa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.431+0000 7f3e93fff640 1 -- 172.21.15.7:0/3677615187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7eb480 msgr2=0x560a6e7fa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:46.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.431+0000 7f3e93fff640 1 --2- 172.21.15.7:0/3677615187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7eb480 0x560a6e7fa030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.431+0000 7f3e93fff640 1 -- 172.21.15.7:0/3677615187 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a6e86f6c0 con 0x560a6e7eab60 2024-09-19T08:49:46.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.431+0000 7f3ea0a17640 1 --2- 172.21.15.7:0/3677615187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7eb480 0x560a6e7fa030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:49:46.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.431+0000 7f3e93fff640 1 --2- 172.21.15.7:0/3677615187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 0x560a6e7f9af0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c005640 tx=0x7f3e8c004cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22f0c882503522b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:46.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.431+0000 7f3e7bfff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-19T08:49:46.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.431+0000 7f3e7bfff640 1 -- 172.21.15.7:0/3677615187 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c01f440 con 0x560a6e7eab60 2024-09-19T08:49:46.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.431+0000 7f3e7bfff640 1 -- 172.21.15.7:0/3677615187 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f3e8c01f5e0 con 0x560a6e7eab60 2024-09-19T08:49:46.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.431+0000 7f3ea5054740 1 -- 172.21.15.7:0/3677615187 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e8c005490 con 0x560a6e7eab60 2024-09-19T08:49:46.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.432+0000 7f3e7bfff640 1 -- 172.21.15.7:0/3677615187 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3e8c01f990 con 0x560a6e7eab60 2024-09-19T08:49:46.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.432+0000 7f3ea5054740 10 client.26030 fetch_fsmap learned FSMap version 25 2024-09-19T08:49:46.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.432+0000 7f3ea5054740 1 -- 172.21.15.7:0/3677615187 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560a6e8709c0 con 0x560a6e7eab60 2024-09-19T08:49:46.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.432+0000 7f3e7bfff640 1 -- 172.21.15.7:0/3677615187 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e8c005490 con 0x560a6e7eab60 2024-09-19T08:49:46.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.432+0000 7f3e7bfff640 1 -- 172.21.15.7:0/3677615187 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3e8c042750 con 0x560a6e7eab60 2024-09-19T08:49:46.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.432+0000 7f3ea5054740 10 client.26030 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:49:46.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.432+0000 7f3ea5054740 10 client.26030 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:46.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.432+0000 7f3ea5054740 20 client.26030 populate_metadata read hostname 'smithi007' 2024-09-19T08:49:46.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.432+0000 7f3ea5054740 1 --2- 172.21.15.7:0/3677615187 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x560a6e870ef0 0x560a6e8732e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:46.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.432+0000 7f3ea5054740 4 client.26030 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:49:46.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.432+0000 7f3ea5054740 1 -- 172.21.15.7:0/3677615187 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560a6e7ee7f0 con 0x560a6e870ef0 2024-09-19T08:49:46.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.432+0000 7f3ea0a17640 1 --2- 172.21.15.7:0/3677615187 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x560a6e870ef0 0x560a6e8732e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:46.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.433+0000 7f3ea0a17640 1 --2- 172.21.15.7:0/3677615187 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x560a6e870ef0 0x560a6e8732e0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e432734547955d27 server_cookie=f1e5dd578cb98c0e in_seq=0 out_seq=0 2024-09-19T08:49:46.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.433+0000 7f3e7bfff640 10 client.26030 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:46.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.434+0000 7f3e7bfff640 1 -- 172.21.15.7:0/3677615187 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560a6e7ee7f0 con 0x560a6e870ef0 2024-09-19T08:49:46.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.434+0000 7f3e7bfff640 10 client.26030 handle_command_reply: tid=0 2024-09-19T08:49:46.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.434+0000 7f3ea5054740 1 client.26030 shutdown 2024-09-19T08:49:46.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.434+0000 7f3ea5054740 1 -- 172.21.15.7:0/3677615187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 msgr2=0x560a6e7f9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:46.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.434+0000 7f3ea5054740 1 --2- 172.21.15.7:0/3677615187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 0x560a6e7f9af0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c005640 tx=0x7f3e8c004cc0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.434+0000 7f3ea5054740 1 -- 172.21.15.7:0/3677615187 shutdown_connections 2024-09-19T08:49:46.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.434+0000 7f3ea5054740 1 --2- 172.21.15.7:0/3677615187 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x560a6e870ef0 0x560a6e8732e0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.434+0000 7f3ea5054740 1 --2- 172.21.15.7:0/3677615187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a6e7f5d40 0x560a6e7fa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.434+0000 7f3ea5054740 1 --2- 172.21.15.7:0/3677615187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560a6e7eb480 0x560a6e7fa030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.434+0000 7f3ea5054740 1 --2- 172.21.15.7:0/3677615187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6e7eab60 0x560a6e7f9af0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.434+0000 7f3ea5054740 1 -- 172.21.15.7:0/3677615187 >> 172.21.15.7:0/3677615187 conn(0x560a6e7e70f0 msgr2=0x560a6e7ec5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:46.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.434+0000 7f3e7bfff640 0 client.26030 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:46.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.434+0000 7f3ea5054740 1 -- 172.21.15.7:0/3677615187 shutdown_connections 2024-09-19T08:49:46.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.434+0000 7f3ea5054740 1 -- 172.21.15.7:0/3677615187 wait complete. 2024-09-19T08:49:46.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.434+0000 7f3ea5054740 20 client.26030 trim_cache size 0 max 16384 2024-09-19T08:49:46.440 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:49:46.441 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-19T08:49:46.441 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "d55a87d8-fda4-45bb-a36b-b74280cd9770", 2024-09-19T08:49:46.441 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-19T08:49:46.441 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:49:46.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.435+0000 7f3ea2c7b640 1 -- 172.21.15.7:0/2703407835 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3e840a33b0 msgr2=0x7f3e840a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:46.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.435+0000 7f3ea2c7b640 1 --2- 172.21.15.7:0/2703407835 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3e840a33b0 0x7f3e840a5870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3e940a5fd0 tx=0x7f3e9408ea50 comp rx=0 tx=0).stop 2024-09-19T08:49:46.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.435+0000 7f3ea2c7b640 1 -- 172.21.15.7:0/2703407835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e9c102ef0 msgr2=0x7f3e9c0fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:46.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.435+0000 7f3ea2c7b640 1 --2- 172.21.15.7:0/2703407835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e9c102ef0 0x7f3e9c0fd700 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f3e94004af0 tx=0x7f3e9402f3a0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.435+0000 7f3ea2c7b640 1 -- 172.21.15.7:0/2703407835 shutdown_connections 2024-09-19T08:49:46.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.435+0000 7f3ea2c7b640 1 --2- 172.21.15.7:0/2703407835 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3e840a33b0 0x7f3e840a5870 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.435+0000 7f3ea2c7b640 1 --2- 172.21.15.7:0/2703407835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e9c102ef0 0x7f3e9c0fd700 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.435+0000 7f3ea2c7b640 1 --2- 172.21.15.7:0/2703407835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e9c102570 0x7f3e9c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.435+0000 7f3ea2c7b640 1 --2- 172.21.15.7:0/2703407835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e9c100e20 0x7f3e9c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:46.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.435+0000 7f3ea2c7b640 1 -- 172.21.15.7:0/2703407835 >> 172.21.15.7:0/2703407835 conn(0x7f3e9c0fc7d0 msgr2=0x7f3e9c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:46.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.435+0000 7f3ea2c7b640 1 -- 172.21.15.7:0/2703407835 shutdown_connections 2024-09-19T08:49:46.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:46.435+0000 7f3ea2c7b640 1 -- 172.21.15.7:0/2703407835 wait complete. 2024-09-19T08:49:47.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:46 smithi044 ceph-mon[35072]: pgmap v160: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:47.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:46 smithi007 ceph-mon[31221]: pgmap v160: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:47.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:46 smithi175 ceph-mon[35688]: pgmap v160: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:49:47.306 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:49:47.561 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:47.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:47 smithi007 ceph-mon[31221]: scrub queued for path: / 2024-09-19T08:49:47.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:47 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:49:47.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:47 smithi007 ceph-mon[31221]: scrub summary: active paths [/] 2024-09-19T08:49:47.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:47 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:49:48.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.030+0000 7fa86fd9c640 1 -- 172.21.15.7:0/1275385393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa868106f10 msgr2=0x7fa86810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:48.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.030+0000 7fa86fd9c640 1 --2- 172.21.15.7:0/1275385393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa868106f10 0x7fa86810ea90 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa860009ca0 tx=0x7fa86002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.030+0000 7fa86fd9c640 1 -- 172.21.15.7:0/1275385393 shutdown_connections 2024-09-19T08:49:48.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.030+0000 7fa86fd9c640 1 --2- 172.21.15.7:0/1275385393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa868106f10 0x7fa86810ea90 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.030+0000 7fa86fd9c640 1 --2- 172.21.15.7:0/1275385393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa868102790 0x7fa8681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.030+0000 7fa86fd9c640 1 --2- 172.21.15.7:0/1275385393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa868101de0 0x7fa8681021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.030+0000 7fa86fd9c640 1 -- 172.21.15.7:0/1275385393 >> 172.21.15.7:0/1275385393 conn(0x7fa8680fd8c0 msgr2=0x7fa8680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:48.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.030+0000 7fa86fd9c640 1 -- 172.21.15.7:0/1275385393 shutdown_connections 2024-09-19T08:49:48.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.030+0000 7fa86fd9c640 1 -- 172.21.15.7:0/1275385393 wait complete. 2024-09-19T08:49:48.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.031+0000 7fa86fd9c640 1 Processor -- start 2024-09-19T08:49:48.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.031+0000 7fa86fd9c640 1 -- start start 2024-09-19T08:49:48.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.031+0000 7fa86fd9c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa868101de0 0x7fa868198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:48.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.031+0000 7fa86fd9c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa868102790 0x7fa868198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:48.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.031+0000 7fa86fd9c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa868106f10 0x7fa86819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:48.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.031+0000 7fa86fd9c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa868111f70 con 0x7fa868106f10 2024-09-19T08:49:48.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.031+0000 7fa86fd9c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa868111df0 con 0x7fa868102790 2024-09-19T08:49:48.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.031+0000 7fa86fd9c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa8681120f0 con 0x7fa868101de0 2024-09-19T08:49:48.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.031+0000 7fa86e339640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa868106f10 0x7fa86819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:48.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.031+0000 7fa86e339640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa868106f10 0x7fa86819cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44950/0 (socket says 172.21.15.7:44950) 2024-09-19T08:49:48.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.031+0000 7fa86e339640 1 -- 172.21.15.7:0/3585306872 learned_addr learned my addr 172.21.15.7:0/3585306872 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:48.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.032+0000 7fa86d337640 1 --2- 172.21.15.7:0/3585306872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa868102790 0x7fa868198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:48.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.032+0000 7fa86db38640 1 --2- 172.21.15.7:0/3585306872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa868101de0 0x7fa868198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:48.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.032+0000 7fa86e339640 1 -- 172.21.15.7:0/3585306872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa868101de0 msgr2=0x7fa868198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:48.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.032+0000 7fa86e339640 1 --2- 172.21.15.7:0/3585306872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa868101de0 0x7fa868198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.032+0000 7fa86e339640 1 -- 172.21.15.7:0/3585306872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa868102790 msgr2=0x7fa868198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:48.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.032+0000 7fa86e339640 1 --2- 172.21.15.7:0/3585306872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa868102790 0x7fa868198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.032+0000 7fa86e339640 1 -- 172.21.15.7:0/3585306872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa86819d2f0 con 0x7fa868106f10 2024-09-19T08:49:48.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.032+0000 7fa86db38640 1 --2- 172.21.15.7:0/3585306872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa868101de0 0x7fa868198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:48.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.032+0000 7fa86e339640 1 --2- 172.21.15.7:0/3585306872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa868106f10 0x7fa86819cc10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa860031a20 tx=0x7fa860031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:48.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.032+0000 7fa85effd640 1 -- 172.21.15.7:0/3585306872 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa860003b70 con 0x7fa868106f10 2024-09-19T08:49:48.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.032+0000 7fa85effd640 1 -- 172.21.15.7:0/3585306872 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa860003d10 con 0x7fa868106f10 2024-09-19T08:49:48.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.032+0000 7fa86fd9c640 1 -- 172.21.15.7:0/3585306872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa86819d580 con 0x7fa868106f10 2024-09-19T08:49:48.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.032+0000 7fa85effd640 1 -- 172.21.15.7:0/3585306872 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86002fc80 con 0x7fa868106f10 2024-09-19T08:49:48.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.032+0000 7fa86fd9c640 1 -- 172.21.15.7:0/3585306872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8681a4ec0 con 0x7fa868106f10 2024-09-19T08:49:48.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.035+0000 7fa85effd640 1 -- 172.21.15.7:0/3585306872 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa8600046a0 con 0x7fa868106f10 2024-09-19T08:49:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.035+0000 7fa872175740 1 Processor -- start 2024-09-19T08:49:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.035+0000 7fa872175740 1 -- start start 2024-09-19T08:49:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.035+0000 7fa872175740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cb35f3a0 0x55a5cb35f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.035+0000 7fa872175740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a5cb35fcc0 0x55a5cb36e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.035+0000 7fa872175740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb36ea90 0x55a5cb370e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.035+0000 7fa872175740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a5cb2c52e0 con 0x55a5cb36ea90 2024-09-19T08:49:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.035+0000 7fa872175740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a5cb26cce0 con 0x55a5cb35fcc0 2024-09-19T08:49:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.035+0000 7fa872175740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a5cb2c12a0 con 0x55a5cb35f3a0 2024-09-19T08:49:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.036+0000 7fa86d337640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb36ea90 0x55a5cb370e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.036+0000 7fa86d337640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb36ea90 0x55a5cb370e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44954/0 (socket says 172.21.15.7:44954) 2024-09-19T08:49:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.036+0000 7fa86d337640 1 -- 172.21.15.7:0/2616711437 learned_addr learned my addr 172.21.15.7:0/2616711437 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.036+0000 7fa86d337640 1 --2- 172.21.15.7:0/2616711437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cb35f3a0 0x55a5cb35f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.036+0000 7fa86db38640 1 --2- 172.21.15.7:0/2616711437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a5cb35fcc0 0x55a5cb36e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.036+0000 7fa85effd640 1 --2- 172.21.15.7:0/3585306872 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa8540a3430 0x7fa8540a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.036+0000 7fa86d337640 1 -- 172.21.15.7:0/2616711437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cb35f3a0 msgr2=0x55a5cb35f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.036+0000 7fa86d337640 1 --2- 172.21.15.7:0/2616711437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cb35f3a0 0x55a5cb35f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.036+0000 7fa86d337640 1 -- 172.21.15.7:0/2616711437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a5cb35fcc0 msgr2=0x55a5cb36e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.036+0000 7fa86d337640 1 --2- 172.21.15.7:0/2616711437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a5cb35fcc0 0x55a5cb36e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.036+0000 7fa86d337640 1 -- 172.21.15.7:0/2616711437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5cb251440 con 0x55a5cb36ea90 2024-09-19T08:49:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.036+0000 7fa86e339640 1 --2- 172.21.15.7:0/3585306872 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa8540a3430 0x7fa8540a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.036+0000 7fa85effd640 1 -- 172.21.15.7:0/3585306872 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fa8600f0f70 con 0x7fa868106f10 2024-09-19T08:49:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.036+0000 7fa86d337640 1 --2- 172.21.15.7:0/2616711437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb36ea90 0x55a5cb370e80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa858011770 tx=0x7fa85800a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e67f66f5d80d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.036+0000 7fa853fff640 1 -- 172.21.15.7:0/2616711437 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa858005020 con 0x55a5cb36ea90 2024-09-19T08:49:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.036+0000 7fa853fff640 1 -- 172.21.15.7:0/2616711437 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8580047a0 con 0x55a5cb36ea90 2024-09-19T08:49:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.037+0000 7fa853fff640 1 -- 172.21.15.7:0/2616711437 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85800fa50 con 0x55a5cb36ea90 2024-09-19T08:49:48.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.037+0000 7fa872175740 1 -- 172.21.15.7:0/2616711437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb36ea90 msgr2=0x55a5cb370e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:48.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.037+0000 7fa872175740 1 --2- 172.21.15.7:0/2616711437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb36ea90 0x55a5cb370e80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa858011770 tx=0x7fa85800a6e0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.037+0000 7fa86e339640 1 --2- 172.21.15.7:0/3585306872 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa8540a3430 0x7fa8540a58f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa8600bd370 tx=0x7fa8600dbf90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:48.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.037+0000 7fa872175740 1 -- 172.21.15.7:0/2616711437 shutdown_connections 2024-09-19T08:49:48.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.037+0000 7fa872175740 1 --2- 172.21.15.7:0/2616711437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb36ea90 0x55a5cb370e80 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.037+0000 7fa872175740 1 --2- 172.21.15.7:0/2616711437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a5cb35fcc0 0x55a5cb36e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.037+0000 7fa872175740 1 --2- 172.21.15.7:0/2616711437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cb35f3a0 0x55a5cb35f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.037+0000 7fa872175740 1 -- 172.21.15.7:0/2616711437 >> 172.21.15.7:0/2616711437 conn(0x55a5cb35ba30 msgr2=0x55a5cb35be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:48.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.037+0000 7fa872175740 1 -- 172.21.15.7:0/2616711437 shutdown_connections 2024-09-19T08:49:48.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.037+0000 7fa872175740 1 -- 172.21.15.7:0/2616711437 wait complete. 2024-09-19T08:49:48.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.038+0000 7fa872175740 1 -- start start 2024-09-19T08:49:48.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.038+0000 7fa872175740 1 Processor -- start 2024-09-19T08:49:48.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.038+0000 7fa872175740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cb35f3a0 0x55a5cb36e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:48.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.038+0000 7fa872175740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb35fcc0 0x55a5cb36b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:48.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.038+0000 7fa872175740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a5cb36ea90 0x55a5cb36bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:48.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.038+0000 7fa872175740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a5cb3716c0 con 0x55a5cb35fcc0 2024-09-19T08:49:48.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.038+0000 7fa872175740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a5cb280050 con 0x55a5cb36ea90 2024-09-19T08:49:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.038+0000 7fa872175740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a5cb371840 con 0x55a5cb35f3a0 2024-09-19T08:49:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.038+0000 7fa872175740 10 client.0 _ll_register_callbacks cb 0x55a5cb2c0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.039+0000 7fa86d337640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cb35f3a0 0x55a5cb36e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.039+0000 7fa86db38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb35fcc0 0x55a5cb36b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.039+0000 7fa86d337640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a5cb36ea90 0x55a5cb36bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.039+0000 7fa86d337640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cb35f3a0 0x55a5cb36e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.7:58356/0 (socket says 172.21.15.7:58356) 2024-09-19T08:49:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.039+0000 7fa86d337640 1 -- 172.21.15.7:0/1430109921 learned_addr learned my addr 172.21.15.7:0/1430109921 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.039+0000 7fa86db38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb35fcc0 0x55a5cb36b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44964/0 (socket says 172.21.15.7:44964) 2024-09-19T08:49:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.039+0000 7fa86d337640 1 -- 172.21.15.7:0/1430109921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a5cb36ea90 msgr2=0x55a5cb36bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.039+0000 7fa86d337640 1 --2- 172.21.15.7:0/1430109921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a5cb36ea90 0x55a5cb36bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.039+0000 7fa86d337640 1 -- 172.21.15.7:0/1430109921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb35fcc0 msgr2=0x55a5cb36b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.039+0000 7fa86d337640 1 --2- 172.21.15.7:0/1430109921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb35fcc0 0x55a5cb36b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.039+0000 7fa86d337640 1 -- 172.21.15.7:0/1430109921 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5cb0363c0 con 0x55a5cb35f3a0 2024-09-19T08:49:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.040+0000 7fa86d337640 1 --2- 172.21.15.7:0/1430109921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cb35f3a0 0x55a5cb36e520 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa85800a3f0 tx=0x7fa858011f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1e661a930956fb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.040+0000 7fa8517fa640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-19T08:49:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.040+0000 7fa8517fa640 1 -- 172.21.15.7:0/1430109921 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa858024070 con 0x55a5cb35f3a0 2024-09-19T08:49:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.040+0000 7fa872175740 1 -- 172.21.15.7:0/1430109921 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8580047a0 con 0x55a5cb35f3a0 2024-09-19T08:49:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.040+0000 7fa8517fa640 1 -- 172.21.15.7:0/1430109921 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fa8580054c0 con 0x55a5cb35f3a0 2024-09-19T08:49:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.040+0000 7fa8517fa640 1 -- 172.21.15.7:0/1430109921 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa858034050 con 0x55a5cb35f3a0 2024-09-19T08:49:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.040+0000 7fa872175740 10 client.25813 fetch_fsmap learned FSMap version 25 2024-09-19T08:49:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.040+0000 7fa872175740 1 -- 172.21.15.7:0/1430109921 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a5cb37d210 con 0x55a5cb35f3a0 2024-09-19T08:49:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.040+0000 7fa8517fa640 1 -- 172.21.15.7:0/1430109921 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8580047a0 con 0x55a5cb35f3a0 2024-09-19T08:49:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.041+0000 7fa8517fa640 1 -- 172.21.15.7:0/1430109921 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa85801e990 con 0x55a5cb35f3a0 2024-09-19T08:49:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.041+0000 7fa872175740 10 client.25813 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:49:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.041+0000 7fa872175740 10 client.25813 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.041+0000 7fa872175740 20 client.25813 populate_metadata read hostname 'smithi007' 2024-09-19T08:49:48.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.041+0000 7fa872175740 1 --2- 172.21.15.7:0/1430109921 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a5cb37e560 0x55a5cb380950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:48.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.041+0000 7fa872175740 4 client.25813 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:49:48.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.041+0000 7fa872175740 1 -- 172.21.15.7:0/1430109921 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5cb2d2850 con 0x55a5cb37e560 2024-09-19T08:49:48.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.041+0000 7fa86db38640 1 --2- 172.21.15.7:0/1430109921 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a5cb37e560 0x55a5cb380950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:48.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.041+0000 7fa86db38640 1 --2- 172.21.15.7:0/1430109921 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a5cb37e560 0x55a5cb380950 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=693ec5378b121cbe server_cookie=10d5a325303d6a9d in_seq=0 out_seq=0 2024-09-19T08:49:48.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.041+0000 7fa8517fa640 10 client.25813 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:48.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.042+0000 7fa8517fa640 1 -- 172.21.15.7:0/1430109921 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a5cb2d2850 con 0x55a5cb37e560 2024-09-19T08:49:48.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.042+0000 7fa8517fa640 10 client.25813 handle_command_reply: tid=0 2024-09-19T08:49:48.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.042+0000 7fa872175740 1 client.25813 shutdown 2024-09-19T08:49:48.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.042+0000 7fa872175740 1 -- 172.21.15.7:0/1430109921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cb35f3a0 msgr2=0x55a5cb36e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:48.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.042+0000 7fa872175740 1 --2- 172.21.15.7:0/1430109921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cb35f3a0 0x55a5cb36e520 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa85800a3f0 tx=0x7fa858011f00 comp rx=0 tx=0).stop 2024-09-19T08:49:48.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.042+0000 7fa872175740 1 -- 172.21.15.7:0/1430109921 shutdown_connections 2024-09-19T08:49:48.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.042+0000 7fa872175740 1 --2- 172.21.15.7:0/1430109921 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a5cb37e560 0x55a5cb380950 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.042+0000 7fa872175740 1 --2- 172.21.15.7:0/1430109921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a5cb36ea90 0x55a5cb36bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.042+0000 7fa872175740 1 --2- 172.21.15.7:0/1430109921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb35fcc0 0x55a5cb36b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.042+0000 7fa872175740 1 --2- 172.21.15.7:0/1430109921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cb35f3a0 0x55a5cb36e520 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.042+0000 7fa8517fa640 0 client.25813 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:48.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.042+0000 7fa872175740 1 -- 172.21.15.7:0/1430109921 >> 172.21.15.7:0/1430109921 conn(0x55a5cb35ba30 msgr2=0x55a5cb361790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:48.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.043+0000 7fa872175740 1 -- 172.21.15.7:0/1430109921 shutdown_connections 2024-09-19T08:49:48.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.043+0000 7fa872175740 1 -- 172.21.15.7:0/1430109921 wait complete. 2024-09-19T08:49:48.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.043+0000 7fa872175740 20 client.25813 trim_cache size 0 max 16384 2024-09-19T08:49:48.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.060+0000 7fa872175740 1 Processor -- start 2024-09-19T08:49:48.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.060+0000 7fa872175740 1 -- start start 2024-09-19T08:49:48.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.060+0000 7fa872175740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a5cb35f3a0 0x55a5cb36b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:48.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.060+0000 7fa872175740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb35fcc0 0x55a5cb366da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:48.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.060+0000 7fa872175740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cb36ea90 0x55a5cb35ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:48.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.060+0000 7fa872175740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa8681ade20 con 0x55a5cb35fcc0 2024-09-19T08:49:48.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.060+0000 7fa872175740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa8681ab6f0 con 0x55a5cb35f3a0 2024-09-19T08:49:48.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.060+0000 7fa872175740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa8681a9540 con 0x55a5cb36ea90 2024-09-19T08:49:48.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.061+0000 7fa86db38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb35fcc0 0x55a5cb366da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:48.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.061+0000 7fa86d337640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a5cb35f3a0 0x55a5cb36b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:48.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.061+0000 7fa86db38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb35fcc0 0x55a5cb366da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44980/0 (socket says 172.21.15.7:44980) 2024-09-19T08:49:48.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.061+0000 7fa86db38640 1 -- 172.21.15.7:0/2261394789 learned_addr learned my addr 172.21.15.7:0/2261394789 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:48.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.061+0000 7fa86d337640 1 --2- 172.21.15.7:0/2261394789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cb36ea90 0x55a5cb35ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:48.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.061+0000 7fa86db38640 1 -- 172.21.15.7:0/2261394789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cb36ea90 msgr2=0x55a5cb35ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:48.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.061+0000 7fa86db38640 1 --2- 172.21.15.7:0/2261394789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cb36ea90 0x55a5cb35ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.061+0000 7fa86db38640 1 -- 172.21.15.7:0/2261394789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a5cb35f3a0 msgr2=0x55a5cb36b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:48.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.061+0000 7fa86db38640 1 --2- 172.21.15.7:0/2261394789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a5cb35f3a0 0x55a5cb36b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.061+0000 7fa86db38640 1 -- 172.21.15.7:0/2261394789 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5cb3711f0 con 0x55a5cb35fcc0 2024-09-19T08:49:48.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.061+0000 7fa86d337640 1 --2- 172.21.15.7:0/2261394789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a5cb35f3a0 0x55a5cb36b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:49:48.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.061+0000 7fa86db38640 1 --2- 172.21.15.7:0/2261394789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb35fcc0 0x55a5cb366da0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa86400be40 tx=0x7fa864013b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb64d741c550d315 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:48.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.061+0000 7fa8537fe640 1 -- 172.21.15.7:0/2261394789 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa864004030 con 0x55a5cb35fcc0 2024-09-19T08:49:48.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.061+0000 7fa8537fe640 1 -- 172.21.15.7:0/2261394789 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8640041d0 con 0x55a5cb35fcc0 2024-09-19T08:49:48.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.061+0000 7fa8537fe640 1 -- 172.21.15.7:0/2261394789 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa864011730 con 0x55a5cb35fcc0 2024-09-19T08:49:48.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.062+0000 7fa872175740 1 -- 172.21.15.7:0/2261394789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb35fcc0 msgr2=0x55a5cb366da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:48.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.062+0000 7fa872175740 1 --2- 172.21.15.7:0/2261394789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb35fcc0 0x55a5cb366da0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa86400be40 tx=0x7fa864013b00 comp rx=0 tx=0).stop 2024-09-19T08:49:48.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.062+0000 7fa872175740 1 -- 172.21.15.7:0/2261394789 shutdown_connections 2024-09-19T08:49:48.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.062+0000 7fa872175740 1 --2- 172.21.15.7:0/2261394789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cb36ea90 0x55a5cb35ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.062+0000 7fa872175740 1 --2- 172.21.15.7:0/2261394789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb35fcc0 0x55a5cb366da0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.062+0000 7fa872175740 1 --2- 172.21.15.7:0/2261394789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a5cb35f3a0 0x55a5cb36b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.062+0000 7fa872175740 1 -- 172.21.15.7:0/2261394789 >> 172.21.15.7:0/2261394789 conn(0x55a5cb35ba30 msgr2=0x55a5cb35be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:48.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.062+0000 7fa872175740 1 -- 172.21.15.7:0/2261394789 shutdown_connections 2024-09-19T08:49:48.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.062+0000 7fa872175740 1 -- 172.21.15.7:0/2261394789 wait complete. 2024-09-19T08:49:48.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.062+0000 7fa872175740 1 -- start start 2024-09-19T08:49:48.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.062+0000 7fa872175740 1 Processor -- start 2024-09-19T08:49:48.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.063+0000 7fa872175740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cb35f3a0 0x55a5cb372230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:48.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.063+0000 7fa872175740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb35fcc0 0x55a5cb372770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:48.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.063+0000 7fa872175740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a5cb36ea90 0x55a5cb3e1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:48.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.063+0000 7fa872175740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa8681a9bb0 con 0x55a5cb35fcc0 2024-09-19T08:49:48.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.063+0000 7fa872175740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa8681ab020 con 0x55a5cb36ea90 2024-09-19T08:49:48.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.063+0000 7fa872175740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa8681aa280 con 0x55a5cb35f3a0 2024-09-19T08:49:48.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.063+0000 7fa872175740 10 client.0 _ll_register_callbacks cb 0x7fa86400b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:49:48.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.063+0000 7fa86db38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb35fcc0 0x55a5cb372770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:48.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.063+0000 7fa86db38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb35fcc0 0x55a5cb372770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44984/0 (socket says 172.21.15.7:44984) 2024-09-19T08:49:48.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.063+0000 7fa86db38640 1 -- 172.21.15.7:0/1280890159 learned_addr learned my addr 172.21.15.7:0/1280890159 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:49:48.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.063+0000 7fa86d337640 1 --2- 172.21.15.7:0/1280890159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cb35f3a0 0x55a5cb372230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:48.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.063+0000 7fa86d337640 1 --2- 172.21.15.7:0/1280890159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a5cb36ea90 0x55a5cb3e1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:48.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.063+0000 7fa86db38640 1 -- 172.21.15.7:0/1280890159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cb35f3a0 msgr2=0x55a5cb372230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:48.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.063+0000 7fa86db38640 1 --2- 172.21.15.7:0/1280890159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cb35f3a0 0x55a5cb372230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.063+0000 7fa86db38640 1 -- 172.21.15.7:0/1280890159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a5cb36ea90 msgr2=0x55a5cb3e1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:49:48.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.063+0000 7fa86db38640 1 --2- 172.21.15.7:0/1280890159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a5cb36ea90 0x55a5cb3e1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.063+0000 7fa86db38640 1 -- 172.21.15.7:0/1280890159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5cb3e16a0 con 0x55a5cb35fcc0 2024-09-19T08:49:48.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.063+0000 7fa86d337640 1 --2- 172.21.15.7:0/1280890159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a5cb36ea90 0x55a5cb3e1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:48.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.064+0000 7fa86db38640 1 --2- 172.21.15.7:0/1280890159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb35fcc0 0x55a5cb372770 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa864020000 tx=0x7fa864003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f9c04bdf998298 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:48.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.064+0000 7fa8517fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:49:48.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.064+0000 7fa8517fa640 1 -- 172.21.15.7:0/1280890159 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86402d020 con 0x55a5cb35fcc0 2024-09-19T08:49:48.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.064+0000 7fa8517fa640 1 -- 172.21.15.7:0/1280890159 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fa8640133d0 con 0x55a5cb35fcc0 2024-09-19T08:49:48.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.064+0000 7fa872175740 1 -- 172.21.15.7:0/1280890159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8640041d0 con 0x55a5cb35fcc0 2024-09-19T08:49:48.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.064+0000 7fa8517fa640 1 -- 172.21.15.7:0/1280890159 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa8640035f0 con 0x55a5cb35fcc0 2024-09-19T08:49:48.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.064+0000 7fa872175740 10 client.16386 fetch_fsmap learned FSMap version 25 2024-09-19T08:49:48.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.064+0000 7fa872175740 1 -- 172.21.15.7:0/1280890159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a5cb3e8a80 con 0x55a5cb35fcc0 2024-09-19T08:49:48.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.064+0000 7fa8517fa640 1 -- 172.21.15.7:0/1280890159 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8640041d0 con 0x55a5cb35fcc0 2024-09-19T08:49:48.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.064+0000 7fa8517fa640 1 -- 172.21.15.7:0/1280890159 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa864011c40 con 0x55a5cb35fcc0 2024-09-19T08:49:48.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.064+0000 7fa872175740 10 client.16386 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:49:48.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.064+0000 7fa872175740 10 client.16386 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:49:48.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.065+0000 7fa872175740 20 client.16386 populate_metadata read hostname 'smithi007' 2024-09-19T08:49:48.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.065+0000 7fa872175740 1 --2- 172.21.15.7:0/1280890159 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a5cb3e91f0 0x55a5cb3eb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:48.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.065+0000 7fa872175740 4 client.16386 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:49:48.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.065+0000 7fa872175740 1 -- 172.21.15.7:0/1280890159 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a5cb2ccd60 con 0x55a5cb3e91f0 2024-09-19T08:49:48.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.065+0000 7fa86d337640 1 --2- 172.21.15.7:0/1280890159 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a5cb3e91f0 0x55a5cb3eb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:48.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.065+0000 7fa86d337640 1 --2- 172.21.15.7:0/1280890159 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a5cb3e91f0 0x55a5cb3eb610 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=433f60f5def0f30a server_cookie=fd42301a13c34d14 in_seq=0 out_seq=0 2024-09-19T08:49:48.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.065+0000 7fa8517fa640 10 client.16386 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.065+0000 7fa8517fa640 1 -- 172.21.15.7:0/1280890159 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a5cb2ccd60 con 0x55a5cb3e91f0 2024-09-19T08:49:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.065+0000 7fa8517fa640 10 client.16386 handle_command_reply: tid=0 2024-09-19T08:49:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.065+0000 7fa872175740 1 client.16386 shutdown 2024-09-19T08:49:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.065+0000 7fa872175740 1 -- 172.21.15.7:0/1280890159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb35fcc0 msgr2=0x55a5cb372770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.065+0000 7fa872175740 1 --2- 172.21.15.7:0/1280890159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb35fcc0 0x55a5cb372770 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa864020000 tx=0x7fa864003d50 comp rx=0 tx=0).stop 2024-09-19T08:49:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.066+0000 7fa872175740 1 -- 172.21.15.7:0/1280890159 shutdown_connections 2024-09-19T08:49:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.066+0000 7fa872175740 1 --2- 172.21.15.7:0/1280890159 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55a5cb3e91f0 0x55a5cb3eb610 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.066+0000 7fa872175740 1 --2- 172.21.15.7:0/1280890159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a5cb36ea90 0x55a5cb3e1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.066+0000 7fa8517fa640 0 client.16386 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:49:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.066+0000 7fa872175740 1 --2- 172.21.15.7:0/1280890159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5cb35fcc0 0x55a5cb372770 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.066+0000 7fa872175740 1 --2- 172.21.15.7:0/1280890159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cb35f3a0 0x55a5cb372230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.066+0000 7fa872175740 1 -- 172.21.15.7:0/1280890159 >> 172.21.15.7:0/1280890159 conn(0x55a5cb35ba30 msgr2=0x55a5cb366da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.066+0000 7fa872175740 1 -- 172.21.15.7:0/1280890159 shutdown_connections 2024-09-19T08:49:48.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.066+0000 7fa872175740 1 -- 172.21.15.7:0/1280890159 wait complete. 2024-09-19T08:49:48.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.066+0000 7fa872175740 20 client.16386 trim_cache size 0 max 16384 2024-09-19T08:49:48.073 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:49:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:49:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-19T08:49:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: "d55a87d8-fda4-45bb-a36b-b74280cd9770": { 2024-09-19T08:49:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-19T08:49:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "d55a87d8-fda4-45bb-a36b-b74280cd9770", 2024-09-19T08:49:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-19T08:49:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:49:48.074 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:49:48.074 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:49:48.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.066+0000 7fa86fd9c640 1 -- 172.21.15.7:0/3585306872 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa8540a3430 msgr2=0x7fa8540a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:48.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.066+0000 7fa86fd9c640 1 --2- 172.21.15.7:0/3585306872 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa8540a3430 0x7fa8540a58f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa8600bd370 tx=0x7fa8600dbf90 comp rx=0 tx=0).stop 2024-09-19T08:49:48.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.066+0000 7fa86fd9c640 1 -- 172.21.15.7:0/3585306872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa868106f10 msgr2=0x7fa86819cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.066+0000 7fa86fd9c640 1 --2- 172.21.15.7:0/3585306872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa868106f10 0x7fa86819cc10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa860031a20 tx=0x7fa860031a50 comp rx=0 tx=0).stop 2024-09-19T08:49:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.066+0000 7fa86fd9c640 1 -- 172.21.15.7:0/3585306872 shutdown_connections 2024-09-19T08:49:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.066+0000 7fa86fd9c640 1 --2- 172.21.15.7:0/3585306872 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa8540a3430 0x7fa8540a58f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.066+0000 7fa86fd9c640 1 --2- 172.21.15.7:0/3585306872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa868106f10 0x7fa86819cc10 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.066+0000 7fa86fd9c640 1 --2- 172.21.15.7:0/3585306872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa868102790 0x7fa868198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.066+0000 7fa86fd9c640 1 --2- 172.21.15.7:0/3585306872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa868101de0 0x7fa868198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.066+0000 7fa86fd9c640 1 -- 172.21.15.7:0/3585306872 >> 172.21.15.7:0/3585306872 conn(0x7fa8680fd8c0 msgr2=0x7fa8680febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.066+0000 7fa86fd9c640 1 -- 172.21.15.7:0/3585306872 shutdown_connections 2024-09-19T08:49:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:49:48.066+0000 7fa86fd9c640 1 -- 172.21.15.7:0/3585306872 wait complete. 2024-09-19T08:49:48.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:47 smithi175 ceph-mon[35688]: scrub queued for path: / 2024-09-19T08:49:48.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:47 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:49:48.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:47 smithi175 ceph-mon[35688]: scrub summary: active paths [/] 2024-09-19T08:49:48.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:47 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:49:48.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:47 smithi044 ceph-mon[35072]: scrub queued for path: / 2024-09-19T08:49:48.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:47 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:49:48.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:47 smithi044 ceph-mon[35072]: scrub summary: active paths [/] 2024-09-19T08:49:48.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:47 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:49:48.942 INFO:tasks.cephfs.filesystem:scrub status for tag:d55a87d8-fda4-45bb-a36b-b74280cd9770 - {'path': '/', 'tag': 'd55a87d8-fda4-45bb-a36b-b74280cd9770', 'options': 'recursive,force'} 2024-09-19T08:49:49.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:48 smithi175 ceph-mon[35688]: pgmap v161: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:49:49.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:48 smithi007 ceph-mon[31221]: pgmap v161: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:49:49.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:48 smithi044 ceph-mon[35072]: pgmap v161: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:49:50.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:49 smithi175 ceph-mon[35688]: scrub summary: idle 2024-09-19T08:49:50.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:49 smithi007 ceph-mon[31221]: scrub summary: idle 2024-09-19T08:49:50.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:49 smithi044 ceph-mon[35072]: scrub summary: idle 2024-09-19T08:49:51.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:50 smithi175 ceph-mon[35688]: pgmap v162: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:49:51.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:50 smithi007 ceph-mon[31221]: pgmap v162: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:49:51.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:50 smithi044 ceph-mon[35072]: pgmap v162: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:49:53.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:52 smithi175 ceph-mon[35688]: pgmap v163: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:49:53.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:52 smithi007 ceph-mon[31221]: pgmap v163: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:49:53.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:52 smithi044 ceph-mon[35072]: pgmap v163: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:49:55.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:54 smithi175 ceph-mon[35688]: pgmap v164: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:49:55.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:54 smithi007 ceph-mon[31221]: pgmap v164: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:49:55.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:54 smithi044 ceph-mon[35072]: pgmap v164: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:49:57.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:56 smithi175 ceph-mon[35688]: pgmap v165: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:49:57.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:56 smithi007 ceph-mon[31221]: pgmap v165: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:49:57.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:56 smithi044 ceph-mon[35072]: pgmap v165: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:49:59.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:49:58 smithi175 ceph-mon[35688]: pgmap v166: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:49:59.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:49:58 smithi007 ceph-mon[31221]: pgmap v166: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:49:59.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:49:58 smithi044 ceph-mon[35072]: pgmap v166: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:50:01.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:00 smithi175 ceph-mon[35688]: pgmap v167: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:50:01.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:00 smithi175 ceph-mon[35688]: overall HEALTH_OK 2024-09-19T08:50:01.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:00 smithi007 ceph-mon[31221]: pgmap v167: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:50:01.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:00 smithi007 ceph-mon[31221]: overall HEALTH_OK 2024-09-19T08:50:01.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:00 smithi044 ceph-mon[35072]: pgmap v167: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:50:01.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:00 smithi044 ceph-mon[35072]: overall HEALTH_OK 2024-09-19T08:50:03.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:02 smithi175 ceph-mon[35688]: pgmap v168: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:50:03.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:02 smithi007 ceph-mon[31221]: pgmap v168: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:50:03.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:02 smithi044 ceph-mon[35072]: pgmap v168: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:50:05.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:04 smithi175 ceph-mon[35688]: pgmap v169: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:50:05.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:04 smithi007 ceph-mon[31221]: pgmap v169: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:50:05.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:04 smithi044 ceph-mon[35072]: pgmap v169: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:50:07.102 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:06 smithi044 ceph-mon[35072]: pgmap v170: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T08:50:07.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:06 smithi175 ceph-mon[35688]: pgmap v170: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T08:50:07.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:06 smithi007 ceph-mon[31221]: pgmap v170: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T08:50:09.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:08 smithi175 ceph-mon[35688]: pgmap v171: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:50:09.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:08 smithi007 ceph-mon[31221]: pgmap v171: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:50:09.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:08 smithi044 ceph-mon[35072]: pgmap v171: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:50:11.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:10 smithi007 ceph-mon[31221]: pgmap v172: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T08:50:11.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:10 smithi175 ceph-mon[35688]: pgmap v172: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T08:50:11.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:10 smithi044 ceph-mon[35072]: pgmap v172: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T08:50:13.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:12 smithi175 ceph-mon[35688]: pgmap v173: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T08:50:13.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:12 smithi007 ceph-mon[31221]: pgmap v173: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T08:50:13.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:12 smithi044 ceph-mon[35072]: pgmap v173: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T08:50:15.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:14 smithi175 ceph-mon[35688]: pgmap v174: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:50:15.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:14 smithi007 ceph-mon[31221]: pgmap v174: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:50:15.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:14 smithi044 ceph-mon[35072]: pgmap v174: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T08:50:17.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:16 smithi175 ceph-mon[35688]: pgmap v175: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T08:50:17.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:16 smithi007 ceph-mon[31221]: pgmap v175: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T08:50:17.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:16 smithi044 ceph-mon[35072]: pgmap v175: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T08:50:18.945 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:50:19.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:18 smithi175 ceph-mon[35688]: pgmap v176: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T08:50:19.218 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:19.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:18 smithi007 ceph-mon[31221]: pgmap v176: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T08:50:19.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:18 smithi044 ceph-mon[35072]: pgmap v176: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T08:50:19.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.716+0000 7f1aa9706640 1 -- 172.21.15.7:0/1067149071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa4103780 msgr2=0x7f1aa4107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.716+0000 7f1aa9706640 1 --2- 172.21.15.7:0/1067149071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa4103780 0x7f1aa4107bc0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009930 tx=0x7f1a9802a420 comp rx=0 tx=0).stop 2024-09-19T08:50:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.716+0000 7f1aa9706640 1 -- 172.21.15.7:0/1067149071 shutdown_connections 2024-09-19T08:50:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.716+0000 7f1aa9706640 1 --2- 172.21.15.7:0/1067149071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa4108300 0x7f1aa410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.716+0000 7f1aa9706640 1 --2- 172.21.15.7:0/1067149071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa4103780 0x7f1aa4107bc0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.716+0000 7f1aa9706640 1 --2- 172.21.15.7:0/1067149071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa4102dd0 0x7f1aa41031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.716+0000 7f1aa9706640 1 -- 172.21.15.7:0/1067149071 >> 172.21.15.7:0/1067149071 conn(0x7f1aa40fc7d0 msgr2=0x7f1aa40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.716+0000 7f1aa9706640 1 -- 172.21.15.7:0/1067149071 shutdown_connections 2024-09-19T08:50:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.716+0000 7f1aa9706640 1 -- 172.21.15.7:0/1067149071 wait complete. 2024-09-19T08:50:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.716+0000 7f1aa9706640 1 Processor -- start 2024-09-19T08:50:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.717+0000 7f1aa9706640 1 -- start start 2024-09-19T08:50:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.717+0000 7f1aa9706640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa4102dd0 0x7f1aa41985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.717+0000 7f1aa9706640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa4103780 0x7f1aa4198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.717+0000 7f1aa9706640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa4108300 0x7f1aa419cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.717+0000 7f1aa9706640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa4112070 con 0x7f1aa4103780 2024-09-19T08:50:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.717+0000 7f1aa9706640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa4111ef0 con 0x7f1aa4102dd0 2024-09-19T08:50:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.717+0000 7f1aa9706640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa41121f0 con 0x7f1aa4108300 2024-09-19T08:50:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.717+0000 7f1aa27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa4103780 0x7f1aa4198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.717+0000 7f1aa27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa4103780 0x7f1aa4198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47644/0 (socket says 172.21.15.7:47644) 2024-09-19T08:50:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.717+0000 7f1aa27fc640 1 -- 172.21.15.7:0/620634708 learned_addr learned my addr 172.21.15.7:0/620634708 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.717+0000 7f1aa2ffd640 1 --2- 172.21.15.7:0/620634708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa4102dd0 0x7f1aa41985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.717+0000 7f1aa37fe640 1 --2- 172.21.15.7:0/620634708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa4108300 0x7f1aa419cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.717+0000 7f1aa27fc640 1 -- 172.21.15.7:0/620634708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa4108300 msgr2=0x7f1aa419cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.717+0000 7f1aa27fc640 1 --2- 172.21.15.7:0/620634708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa4108300 0x7f1aa419cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.717+0000 7f1aa27fc640 1 -- 172.21.15.7:0/620634708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa4102dd0 msgr2=0x7f1aa41985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.717+0000 7f1aa27fc640 1 --2- 172.21.15.7:0/620634708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa4102dd0 0x7f1aa41985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.717+0000 7f1aa27fc640 1 -- 172.21.15.7:0/620634708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa419d5a0 con 0x7f1aa4103780 2024-09-19T08:50:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.717+0000 7f1aa2ffd640 1 --2- 172.21.15.7:0/620634708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa4102dd0 0x7f1aa41985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:50:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.718+0000 7f1aa27fc640 1 --2- 172.21.15.7:0/620634708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa4103780 0x7f1aa4198b30 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1a98005940 tx=0x7f1a980042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.718+0000 7f1a8bfff640 1 -- 172.21.15.7:0/620634708 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9803f030 con 0x7f1aa4103780 2024-09-19T08:50:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.718+0000 7f1a8bfff640 1 -- 172.21.15.7:0/620634708 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a98003ce0 con 0x7f1aa4103780 2024-09-19T08:50:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.718+0000 7f1a8bfff640 1 -- 172.21.15.7:0/620634708 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98035070 con 0x7f1aa4103780 2024-09-19T08:50:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.718+0000 7f1aa9706640 1 -- 172.21.15.7:0/620634708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa419d830 con 0x7f1aa4103780 2024-09-19T08:50:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.718+0000 7f1aa9706640 1 -- 172.21.15.7:0/620634708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa41a5170 con 0x7f1aa4103780 2024-09-19T08:50:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.721+0000 7f1a8bfff640 1 -- 172.21.15.7:0/620634708 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f1a98042030 con 0x7f1aa4103780 2024-09-19T08:50:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.721+0000 7f1aabadf740 1 Processor -- start 2024-09-19T08:50:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.721+0000 7f1aabadf740 1 -- start start 2024-09-19T08:50:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.721+0000 7f1aabadf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a4174a0 0x55f30a417880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.721+0000 7f1aabadf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f30a417dc0 0x55f30a422140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.721+0000 7f1aabadf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f30a422680 0x55f30a424a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.721+0000 7f1aabadf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f30a37d2e0 con 0x55f30a4174a0 2024-09-19T08:50:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.721+0000 7f1aabadf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f30a324ce0 con 0x55f30a417dc0 2024-09-19T08:50:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.721+0000 7f1aabadf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f30a3792a0 con 0x55f30a422680 2024-09-19T08:50:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.721+0000 7f1aa37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a4174a0 0x55f30a417880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.721+0000 7f1aa37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a4174a0 0x55f30a417880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47656/0 (socket says 172.21.15.7:47656) 2024-09-19T08:50:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.721+0000 7f1aa37fe640 1 -- 172.21.15.7:0/2069103704 learned_addr learned my addr 172.21.15.7:0/2069103704 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.722+0000 7f1aa2ffd640 1 --2- 172.21.15.7:0/2069103704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f30a417dc0 0x55f30a422140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.722+0000 7f1aa37fe640 1 -- 172.21.15.7:0/2069103704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f30a422680 msgr2=0x55f30a424a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.722+0000 7f1aa37fe640 1 --2- 172.21.15.7:0/2069103704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f30a422680 0x55f30a424a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.722+0000 7f1aa37fe640 1 -- 172.21.15.7:0/2069103704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f30a417dc0 msgr2=0x55f30a422140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.722+0000 7f1aa37fe640 1 --2- 172.21.15.7:0/2069103704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f30a417dc0 0x55f30a422140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.722+0000 7f1aa37fe640 1 -- 172.21.15.7:0/2069103704 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f30a309440 con 0x55f30a4174a0 2024-09-19T08:50:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.722+0000 7f1aa2ffd640 1 --2- 172.21.15.7:0/2069103704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f30a417dc0 0x55f30a422140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:50:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.722+0000 7f1a8bfff640 1 --2- 172.21.15.7:0/620634708 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1a8c0a33b0 0x7f1a8c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.722+0000 7f1aa37fe640 1 --2- 172.21.15.7:0/2069103704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a4174a0 0x55f30a417880 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00caa0 tx=0x7f1a9c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad9b60b8b19e263 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.722+0000 7f1aa2ffd640 1 --2- 172.21.15.7:0/620634708 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1a8c0a33b0 0x7f1a8c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.722+0000 7f1a8bfff640 1 -- 172.21.15.7:0/620634708 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f1a980f00f0 con 0x7f1aa4103780 2024-09-19T08:50:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.722+0000 7f1a897fa640 1 -- 172.21.15.7:0/2069103704 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c004020 con 0x55f30a4174a0 2024-09-19T08:50:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.722+0000 7f1a897fa640 1 -- 172.21.15.7:0/2069103704 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a9c0041c0 con 0x55f30a4174a0 2024-09-19T08:50:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.722+0000 7f1a897fa640 1 -- 172.21.15.7:0/2069103704 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c010690 con 0x55f30a4174a0 2024-09-19T08:50:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.723+0000 7f1aabadf740 1 -- 172.21.15.7:0/2069103704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a4174a0 msgr2=0x55f30a417880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.723+0000 7f1aa2ffd640 1 --2- 172.21.15.7:0/620634708 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1a8c0a33b0 0x7f1a8c0a5870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55f30a414890 tx=0x7f1a94009680 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.723+0000 7f1aabadf740 1 --2- 172.21.15.7:0/2069103704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a4174a0 0x55f30a417880 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00caa0 tx=0x7f1a9c00cf60 comp rx=0 tx=0).stop 2024-09-19T08:50:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.723+0000 7f1aabadf740 1 -- 172.21.15.7:0/2069103704 shutdown_connections 2024-09-19T08:50:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.723+0000 7f1aabadf740 1 --2- 172.21.15.7:0/2069103704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f30a422680 0x55f30a424a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.723+0000 7f1aabadf740 1 --2- 172.21.15.7:0/2069103704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f30a417dc0 0x55f30a422140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.723+0000 7f1aabadf740 1 --2- 172.21.15.7:0/2069103704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a4174a0 0x55f30a417880 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.723+0000 7f1aabadf740 1 -- 172.21.15.7:0/2069103704 >> 172.21.15.7:0/2069103704 conn(0x55f30a413a30 msgr2=0x55f30a413e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.723+0000 7f1aabadf740 1 -- 172.21.15.7:0/2069103704 shutdown_connections 2024-09-19T08:50:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.723+0000 7f1aabadf740 1 -- 172.21.15.7:0/2069103704 wait complete. 2024-09-19T08:50:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.723+0000 7f1aabadf740 1 -- start start 2024-09-19T08:50:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.723+0000 7f1aabadf740 1 Processor -- start 2024-09-19T08:50:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.724+0000 7f1aabadf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f30a4174a0 0x55f30a421ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.724+0000 7f1aabadf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f30a417dc0 0x55f30a41f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.724+0000 7f1aabadf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a422680 0x55f30a41f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.724+0000 7f1aabadf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f30a425250 con 0x55f30a422680 2024-09-19T08:50:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.724+0000 7f1aabadf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f30a338050 con 0x55f30a4174a0 2024-09-19T08:50:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.724+0000 7f1aabadf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f30a4253d0 con 0x55f30a417dc0 2024-09-19T08:50:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.724+0000 7f1aabadf740 10 client.0 _ll_register_callbacks cb 0x55f30a378160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.724+0000 7f1aa37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a422680 0x55f30a41f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.724+0000 7f1aa37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a422680 0x55f30a41f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47660/0 (socket says 172.21.15.7:47660) 2024-09-19T08:50:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.724+0000 7f1aa37fe640 1 -- 172.21.15.7:0/942588770 learned_addr learned my addr 172.21.15.7:0/942588770 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.724+0000 7f1aa2ffd640 1 --2- 172.21.15.7:0/942588770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f30a4174a0 0x55f30a421ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.724+0000 7f1aa27fc640 1 --2- 172.21.15.7:0/942588770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f30a417dc0 0x55f30a41f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.724+0000 7f1aa37fe640 1 -- 172.21.15.7:0/942588770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f30a417dc0 msgr2=0x55f30a41f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.724+0000 7f1aa37fe640 1 --2- 172.21.15.7:0/942588770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f30a417dc0 0x55f30a41f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.724+0000 7f1aa37fe640 1 -- 172.21.15.7:0/942588770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f30a4174a0 msgr2=0x55f30a421ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.724+0000 7f1aa37fe640 1 --2- 172.21.15.7:0/942588770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f30a4174a0 0x55f30a421ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.724+0000 7f1aa37fe640 1 -- 172.21.15.7:0/942588770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f30a0ee3c0 con 0x55f30a422680 2024-09-19T08:50:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.724+0000 7f1aa37fe640 1 --2- 172.21.15.7:0/942588770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a422680 0x55f30a41f800 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c004160 tx=0x7f1a9c00c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dedc6a35361761d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.724+0000 7f1a86ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:50:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.724+0000 7f1a86ff5640 1 -- 172.21.15.7:0/942588770 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c029060 con 0x55f30a422680 2024-09-19T08:50:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.724+0000 7f1a86ff5640 1 -- 172.21.15.7:0/942588770 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f1a9c003800 con 0x55f30a422680 2024-09-19T08:50:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.724+0000 7f1aabadf740 1 -- 172.21.15.7:0/942588770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a9c0041c0 con 0x55f30a422680 2024-09-19T08:50:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.725+0000 7f1a86ff5640 1 -- 172.21.15.7:0/942588770 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1a9c003a00 con 0x55f30a422680 2024-09-19T08:50:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.725+0000 7f1aabadf740 10 client.16398 fetch_fsmap learned FSMap version 25 2024-09-19T08:50:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.725+0000 7f1aabadf740 1 -- 172.21.15.7:0/942588770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f30a430bf0 con 0x55f30a422680 2024-09-19T08:50:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.725+0000 7f1a86ff5640 1 -- 172.21.15.7:0/942588770 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a9c0041c0 con 0x55f30a422680 2024-09-19T08:50:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.725+0000 7f1a86ff5640 1 -- 172.21.15.7:0/942588770 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1a9c004ac0 con 0x55f30a422680 2024-09-19T08:50:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.725+0000 7f1aabadf740 10 client.16398 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:50:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.725+0000 7f1aabadf740 10 client.16398 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:50:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.725+0000 7f1aabadf740 20 client.16398 populate_metadata read hostname 'smithi007' 2024-09-19T08:50:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.725+0000 7f1aabadf740 1 --2- 172.21.15.7:0/942588770 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f30a4320b0 0x55f30a4344a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.725+0000 7f1aabadf740 4 client.16398 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:50:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.725+0000 7f1aabadf740 1 -- 172.21.15.7:0/942588770 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f30a38a850 con 0x55f30a4320b0 2024-09-19T08:50:19.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.725+0000 7f1aa2ffd640 1 --2- 172.21.15.7:0/942588770 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f30a4320b0 0x55f30a4344a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:19.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.726+0000 7f1a86ff5640 10 client.16398 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:19.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.726+0000 7f1aa2ffd640 1 --2- 172.21.15.7:0/942588770 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f30a4320b0 0x55f30a4344a0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8976d54c8b822629 server_cookie=bad59d81515ce11 in_seq=0 out_seq=0 2024-09-19T08:50:19.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.726+0000 7f1a86ff5640 1 -- 172.21.15.7:0/942588770 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f30a38a850 con 0x55f30a4320b0 2024-09-19T08:50:19.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.726+0000 7f1a86ff5640 10 client.16398 handle_command_reply: tid=0 2024-09-19T08:50:19.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.726+0000 7f1aabadf740 1 client.16398 shutdown 2024-09-19T08:50:19.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.727+0000 7f1aabadf740 1 -- 172.21.15.7:0/942588770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a422680 msgr2=0x55f30a41f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:19.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.727+0000 7f1aabadf740 1 --2- 172.21.15.7:0/942588770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a422680 0x55f30a41f800 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c004160 tx=0x7f1a9c00c620 comp rx=0 tx=0).stop 2024-09-19T08:50:19.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.727+0000 7f1aabadf740 1 -- 172.21.15.7:0/942588770 shutdown_connections 2024-09-19T08:50:19.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.727+0000 7f1aabadf740 1 --2- 172.21.15.7:0/942588770 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f30a4320b0 0x55f30a4344a0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.727+0000 7f1aabadf740 1 --2- 172.21.15.7:0/942588770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a422680 0x55f30a41f800 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.727+0000 7f1aabadf740 1 --2- 172.21.15.7:0/942588770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f30a417dc0 0x55f30a41f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.727+0000 7f1aabadf740 1 --2- 172.21.15.7:0/942588770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f30a4174a0 0x55f30a421ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.727+0000 7f1a86ff5640 0 client.16398 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:19.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.727+0000 7f1aabadf740 1 -- 172.21.15.7:0/942588770 >> 172.21.15.7:0/942588770 conn(0x55f30a413a30 msgr2=0x55f30a419760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:19.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.727+0000 7f1aabadf740 1 -- 172.21.15.7:0/942588770 shutdown_connections 2024-09-19T08:50:19.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.727+0000 7f1aabadf740 1 -- 172.21.15.7:0/942588770 wait complete. 2024-09-19T08:50:19.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.727+0000 7f1aabadf740 20 client.16398 trim_cache size 0 max 16384 2024-09-19T08:50:19.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.744+0000 7f1aabadf740 1 Processor -- start 2024-09-19T08:50:19.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.744+0000 7f1aabadf740 1 -- start start 2024-09-19T08:50:19.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.744+0000 7f1aabadf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f30a413a30 0x55f30a42e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:19.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.744+0000 7f1aabadf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f30a4174a0 0x55f30a439aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:19.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.744+0000 7f1aabadf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a417dc0 0x55f30a439fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:19.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.744+0000 7f1aabadf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa41b01f0 con 0x55f30a417dc0 2024-09-19T08:50:19.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.744+0000 7f1aabadf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa41adac0 con 0x55f30a413a30 2024-09-19T08:50:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.744+0000 7f1aabadf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa41ab910 con 0x55f30a4174a0 2024-09-19T08:50:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.744+0000 7f1aa37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a417dc0 0x55f30a439fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.744+0000 7f1aa37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a417dc0 0x55f30a439fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47666/0 (socket says 172.21.15.7:47666) 2024-09-19T08:50:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.744+0000 7f1aa37fe640 1 -- 172.21.15.7:0/3692894780 learned_addr learned my addr 172.21.15.7:0/3692894780 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.744+0000 7f1aa2ffd640 1 --2- 172.21.15.7:0/3692894780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f30a413a30 0x55f30a42e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.744+0000 7f1aa27fc640 1 --2- 172.21.15.7:0/3692894780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f30a4174a0 0x55f30a439aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.744+0000 7f1aa37fe640 1 -- 172.21.15.7:0/3692894780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f30a4174a0 msgr2=0x55f30a439aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.744+0000 7f1aa37fe640 1 --2- 172.21.15.7:0/3692894780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f30a4174a0 0x55f30a439aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.744+0000 7f1aa37fe640 1 -- 172.21.15.7:0/3692894780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f30a413a30 msgr2=0x55f30a42e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.744+0000 7f1aa37fe640 1 --2- 172.21.15.7:0/3692894780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f30a413a30 0x55f30a42e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.744+0000 7f1aa37fe640 1 -- 172.21.15.7:0/3692894780 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f30a41fde0 con 0x55f30a417dc0 2024-09-19T08:50:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.745+0000 7f1aa37fe640 1 --2- 172.21.15.7:0/3692894780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a417dc0 0x55f30a439fe0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00c9a0 tx=0x7f1a9c00c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5075dd51943143 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.745+0000 7f1a88ff9640 1 -- 172.21.15.7:0/3692894780 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c01e070 con 0x55f30a417dc0 2024-09-19T08:50:19.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.745+0000 7f1a88ff9640 1 -- 172.21.15.7:0/3692894780 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a9c003e20 con 0x55f30a417dc0 2024-09-19T08:50:19.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.745+0000 7f1a88ff9640 1 -- 172.21.15.7:0/3692894780 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c005240 con 0x55f30a417dc0 2024-09-19T08:50:19.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.745+0000 7f1aabadf740 1 -- 172.21.15.7:0/3692894780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a417dc0 msgr2=0x55f30a439fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:19.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.745+0000 7f1aabadf740 1 --2- 172.21.15.7:0/3692894780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a417dc0 0x55f30a439fe0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00c9a0 tx=0x7f1a9c00c420 comp rx=0 tx=0).stop 2024-09-19T08:50:19.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.745+0000 7f1aabadf740 1 -- 172.21.15.7:0/3692894780 shutdown_connections 2024-09-19T08:50:19.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.745+0000 7f1aabadf740 1 --2- 172.21.15.7:0/3692894780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a417dc0 0x55f30a439fe0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.745+0000 7f1aabadf740 1 --2- 172.21.15.7:0/3692894780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f30a4174a0 0x55f30a439aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.745+0000 7f1aabadf740 1 --2- 172.21.15.7:0/3692894780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f30a413a30 0x55f30a42e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.745+0000 7f1aabadf740 1 -- 172.21.15.7:0/3692894780 >> 172.21.15.7:0/3692894780 conn(0x55f30a4144b0 msgr2=0x55f30a421320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:19.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.745+0000 7f1aabadf740 1 -- 172.21.15.7:0/3692894780 shutdown_connections 2024-09-19T08:50:19.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.745+0000 7f1aabadf740 1 -- 172.21.15.7:0/3692894780 wait complete. 2024-09-19T08:50:19.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.746+0000 7f1aabadf740 1 -- start start 2024-09-19T08:50:19.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.746+0000 7f1aabadf740 1 Processor -- start 2024-09-19T08:50:19.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.746+0000 7f1aabadf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f30a413a30 0x55f30a42af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:19.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.746+0000 7f1aabadf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a4174a0 0x55f30a4262b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:19.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.746+0000 7f1aabadf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f30a417dc0 0x55f30a426a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:19.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.746+0000 7f1aabadf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa41abf80 con 0x55f30a4174a0 2024-09-19T08:50:19.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.746+0000 7f1aabadf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa41ad3f0 con 0x55f30a417dc0 2024-09-19T08:50:19.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.746+0000 7f1aabadf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa41ac650 con 0x55f30a413a30 2024-09-19T08:50:19.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.746+0000 7f1aabadf740 10 client.0 _ll_register_callbacks cb 0x7f1a9c014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:19.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.746+0000 7f1aa27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a4174a0 0x55f30a4262b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:19.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.746+0000 7f1aa27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a4174a0 0x55f30a4262b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47676/0 (socket says 172.21.15.7:47676) 2024-09-19T08:50:19.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.746+0000 7f1aa27fc640 1 -- 172.21.15.7:0/3881448671 learned_addr learned my addr 172.21.15.7:0/3881448671 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:19.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.746+0000 7f1aa2ffd640 1 --2- 172.21.15.7:0/3881448671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f30a413a30 0x55f30a42af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:19.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.747+0000 7f1aa27fc640 1 -- 172.21.15.7:0/3881448671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f30a413a30 msgr2=0x55f30a42af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:19.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.747+0000 7f1aa27fc640 1 --2- 172.21.15.7:0/3881448671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f30a413a30 0x55f30a42af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.747+0000 7f1aa27fc640 1 -- 172.21.15.7:0/3881448671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f30a417dc0 msgr2=0x55f30a426a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:19.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.747+0000 7f1aa37fe640 1 --2- 172.21.15.7:0/3881448671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f30a417dc0 0x55f30a426a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:19.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.747+0000 7f1aa27fc640 1 --2- 172.21.15.7:0/3881448671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f30a417dc0 0x55f30a426a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.747+0000 7f1aa27fc640 1 -- 172.21.15.7:0/3881448671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f30a41fb70 con 0x55f30a4174a0 2024-09-19T08:50:19.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.747+0000 7f1aa37fe640 1 --2- 172.21.15.7:0/3881448671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f30a417dc0 0x55f30a426a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:50:19.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.747+0000 7f1aa27fc640 1 --2- 172.21.15.7:0/3881448671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a4174a0 0x55f30a4262b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1a980bc3f0 tx=0x7f1a980bc360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782a28324ec3399a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:19.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.747+0000 7f1a86ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:50:19.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.747+0000 7f1a86ff5640 1 -- 172.21.15.7:0/3881448671 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98049040 con 0x55f30a4174a0 2024-09-19T08:50:19.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.747+0000 7f1a86ff5640 1 -- 172.21.15.7:0/3881448671 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f1a980b8ad0 con 0x55f30a4174a0 2024-09-19T08:50:19.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.747+0000 7f1aabadf740 1 -- 172.21.15.7:0/3881448671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a9c003e20 con 0x55f30a4174a0 2024-09-19T08:50:19.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.747+0000 7f1a86ff5640 1 -- 172.21.15.7:0/3881448671 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1a980bc460 con 0x55f30a4174a0 2024-09-19T08:50:19.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.747+0000 7f1aabadf740 10 client.16404 fetch_fsmap learned FSMap version 25 2024-09-19T08:50:19.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.747+0000 7f1aabadf740 1 -- 172.21.15.7:0/3881448671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f30a414ae0 con 0x55f30a4174a0 2024-09-19T08:50:19.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.747+0000 7f1a86ff5640 1 -- 172.21.15.7:0/3881448671 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a9c003e20 con 0x55f30a4174a0 2024-09-19T08:50:19.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.747+0000 7f1a86ff5640 1 -- 172.21.15.7:0/3881448671 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1a980bc6c0 con 0x55f30a4174a0 2024-09-19T08:50:19.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.747+0000 7f1aabadf740 10 client.16404 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:50:19.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.747+0000 7f1aabadf740 10 client.16404 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:50:19.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.748+0000 7f1aabadf740 20 client.16404 populate_metadata read hostname 'smithi007' 2024-09-19T08:50:19.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.748+0000 7f1aabadf740 1 --2- 172.21.15.7:0/3881448671 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f30a422680 0x55f30a49f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:19.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.748+0000 7f1aabadf740 4 client.16404 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:50:19.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.748+0000 7f1aabadf740 1 -- 172.21.15.7:0/3881448671 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f30a384d60 con 0x55f30a422680 2024-09-19T08:50:19.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.748+0000 7f1aa2ffd640 1 --2- 172.21.15.7:0/3881448671 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f30a422680 0x55f30a49f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:19.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.748+0000 7f1aa2ffd640 1 --2- 172.21.15.7:0/3881448671 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f30a422680 0x55f30a49f060 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e6108816f682157 server_cookie=d0e4e37b82955af6 in_seq=0 out_seq=0 2024-09-19T08:50:19.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.748+0000 7f1a86ff5640 10 client.16404 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:19.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.748+0000 7f1a86ff5640 1 -- 172.21.15.7:0/3881448671 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f30a384d60 con 0x55f30a422680 2024-09-19T08:50:19.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.748+0000 7f1a86ff5640 10 client.16404 handle_command_reply: tid=0 2024-09-19T08:50:19.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.748+0000 7f1aabadf740 1 client.16404 shutdown 2024-09-19T08:50:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.749+0000 7f1aabadf740 1 -- 172.21.15.7:0/3881448671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a4174a0 msgr2=0x55f30a4262b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.749+0000 7f1aabadf740 1 --2- 172.21.15.7:0/3881448671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a4174a0 0x55f30a4262b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1a980bc3f0 tx=0x7f1a980bc360 comp rx=0 tx=0).stop 2024-09-19T08:50:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.749+0000 7f1aabadf740 1 -- 172.21.15.7:0/3881448671 shutdown_connections 2024-09-19T08:50:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.749+0000 7f1aabadf740 1 --2- 172.21.15.7:0/3881448671 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f30a422680 0x55f30a49f060 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.749+0000 7f1aabadf740 1 --2- 172.21.15.7:0/3881448671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f30a417dc0 0x55f30a426a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.749+0000 7f1aabadf740 1 --2- 172.21.15.7:0/3881448671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f30a4174a0 0x55f30a4262b0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.749+0000 7f1aabadf740 1 --2- 172.21.15.7:0/3881448671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f30a413a30 0x55f30a42af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.749+0000 7f1aabadf740 1 -- 172.21.15.7:0/3881448671 >> 172.21.15.7:0/3881448671 conn(0x55f30a4144b0 msgr2=0x55f30a418ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.749+0000 7f1a86ff5640 0 client.16404 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.749+0000 7f1aabadf740 1 -- 172.21.15.7:0/3881448671 shutdown_connections 2024-09-19T08:50:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.749+0000 7f1aabadf740 1 -- 172.21.15.7:0/3881448671 wait complete. 2024-09-19T08:50:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.749+0000 7f1aabadf740 20 client.16404 trim_cache size 0 max 16384 2024-09-19T08:50:19.766 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:50:19.766 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-19T08:50:19.766 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-09-19T08:50:19.766 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:50:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.749+0000 7f1aa9706640 1 -- 172.21.15.7:0/620634708 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1a8c0a33b0 msgr2=0x7f1a8c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.749+0000 7f1aa9706640 1 --2- 172.21.15.7:0/620634708 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1a8c0a33b0 0x7f1a8c0a5870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55f30a414890 tx=0x7f1a94009680 comp rx=0 tx=0).stop 2024-09-19T08:50:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.749+0000 7f1aa9706640 1 -- 172.21.15.7:0/620634708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa4103780 msgr2=0x7f1aa4198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.749+0000 7f1aa9706640 1 --2- 172.21.15.7:0/620634708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa4103780 0x7f1aa4198b30 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1a98005940 tx=0x7f1a980042f0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.749+0000 7f1aa9706640 1 -- 172.21.15.7:0/620634708 shutdown_connections 2024-09-19T08:50:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.749+0000 7f1aa9706640 1 --2- 172.21.15.7:0/620634708 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1a8c0a33b0 0x7f1a8c0a5870 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.749+0000 7f1aa9706640 1 --2- 172.21.15.7:0/620634708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa4108300 0x7f1aa419cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.749+0000 7f1aa9706640 1 --2- 172.21.15.7:0/620634708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa4103780 0x7f1aa4198b30 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.749+0000 7f1aa9706640 1 --2- 172.21.15.7:0/620634708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1aa4102dd0 0x7f1aa41985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.749+0000 7f1aa9706640 1 -- 172.21.15.7:0/620634708 >> 172.21.15.7:0/620634708 conn(0x7f1aa40fc7d0 msgr2=0x7f1aa4105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.750+0000 7f1aa9706640 1 -- 172.21.15.7:0/620634708 shutdown_connections 2024-09-19T08:50:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:19.750+0000 7f1aa9706640 1 -- 172.21.15.7:0/620634708 wait complete. 2024-09-19T08:50:20.556 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:50:20.556 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:50:20.815 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:21.114 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:20 smithi007 ceph-mon[31221]: pgmap v177: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:50:21.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:20 smithi175 ceph-mon[35688]: pgmap v177: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:50:21.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:20 smithi044 ceph-mon[35072]: pgmap v177: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:50:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.305+0000 7f4f2d5c9640 1 -- 172.21.15.7:0/1090159923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f28074510 msgr2=0x7f4f280748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.305+0000 7f4f2d5c9640 1 --2- 172.21.15.7:0/1090159923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f28074510 0x7f4f280748f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f4f18009ca0 tx=0x7f4f1802a950 comp rx=0 tx=0).stop 2024-09-19T08:50:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.305+0000 7f4f2d5c9640 1 -- 172.21.15.7:0/1090159923 shutdown_connections 2024-09-19T08:50:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.305+0000 7f4f2d5c9640 1 --2- 172.21.15.7:0/1090159923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f2810e450 0x7f4f28110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.305+0000 7f4f2d5c9640 1 --2- 172.21.15.7:0/1090159923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f28074e30 0x7f4f2810df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.305+0000 7f4f2d5c9640 1 --2- 172.21.15.7:0/1090159923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f28074510 0x7f4f280748f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.305+0000 7f4f2d5c9640 1 -- 172.21.15.7:0/1090159923 >> 172.21.15.7:0/1090159923 conn(0x7f4f280fd8f0 msgr2=0x7f4f280ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.305+0000 7f4f2d5c9640 1 -- 172.21.15.7:0/1090159923 shutdown_connections 2024-09-19T08:50:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.305+0000 7f4f2d5c9640 1 -- 172.21.15.7:0/1090159923 wait complete. 2024-09-19T08:50:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.305+0000 7f4f2d5c9640 1 Processor -- start 2024-09-19T08:50:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.306+0000 7f4f2d5c9640 1 -- start start 2024-09-19T08:50:21.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.306+0000 7f4f2d5c9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f28074510 0x7f4f2819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:21.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.306+0000 7f4f2d5c9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f28074e30 0x7f4f2819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:21.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.306+0000 7f4f2d5c9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f2810e450 0x7f4f2819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:21.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.306+0000 7f4f2d5c9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4f28114180 con 0x7f4f28074e30 2024-09-19T08:50:21.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.306+0000 7f4f2d5c9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4f28114000 con 0x7f4f28074510 2024-09-19T08:50:21.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.306+0000 7f4f2d5c9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4f28114300 con 0x7f4f2810e450 2024-09-19T08:50:21.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.306+0000 7f4f267fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f28074e30 0x7f4f2819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:21.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.306+0000 7f4f267fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f28074e30 0x7f4f2819abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47704/0 (socket says 172.21.15.7:47704) 2024-09-19T08:50:21.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.306+0000 7f4f267fc640 1 -- 172.21.15.7:0/2377097534 learned_addr learned my addr 172.21.15.7:0/2377097534 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:21.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.306+0000 7f4f277fe640 1 --2- 172.21.15.7:0/2377097534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f2810e450 0x7f4f2819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:21.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.306+0000 7f4f26ffd640 1 --2- 172.21.15.7:0/2377097534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f28074510 0x7f4f2819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:21.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.306+0000 7f4f267fc640 1 -- 172.21.15.7:0/2377097534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f2810e450 msgr2=0x7f4f2819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.306+0000 7f4f267fc640 1 --2- 172.21.15.7:0/2377097534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f2810e450 0x7f4f2819ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.306+0000 7f4f267fc640 1 -- 172.21.15.7:0/2377097534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f28074510 msgr2=0x7f4f2819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.306+0000 7f4f267fc640 1 --2- 172.21.15.7:0/2377097534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f28074510 0x7f4f2819a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.306+0000 7f4f267fc640 1 -- 172.21.15.7:0/2377097534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2819f650 con 0x7f4f28074e30 2024-09-19T08:50:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.307+0000 7f4f267fc640 1 --2- 172.21.15.7:0/2377097534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f28074e30 0x7f4f2819abe0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000c970 tx=0x7f4f1000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.307+0000 7f4f1ffff640 1 -- 172.21.15.7:0/2377097534 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10007bb0 con 0x7f4f28074e30 2024-09-19T08:50:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.307+0000 7f4f2d5c9640 1 -- 172.21.15.7:0/2377097534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f2819f940 con 0x7f4f28074e30 2024-09-19T08:50:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.307+0000 7f4f1ffff640 1 -- 172.21.15.7:0/2377097534 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f10007d50 con 0x7f4f28074e30 2024-09-19T08:50:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.307+0000 7f4f1ffff640 1 -- 172.21.15.7:0/2377097534 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1000f450 con 0x7f4f28074e30 2024-09-19T08:50:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.307+0000 7f4f2d5c9640 1 -- 172.21.15.7:0/2377097534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f281a7220 con 0x7f4f28074e30 2024-09-19T08:50:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.308+0000 7f4f2d5c9640 1 -- 172.21.15.7:0/2377097534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f280748f0 con 0x7f4f28074e30 2024-09-19T08:50:21.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.309+0000 7f4f1ffff640 1 -- 172.21.15.7:0/2377097534 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f4f10004fe0 con 0x7f4f28074e30 2024-09-19T08:50:21.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.310+0000 7f4f1ffff640 1 --2- 172.21.15.7:0/2377097534 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4f140a33b0 0x7f4f140a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:21.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.310+0000 7f4f26ffd640 1 --2- 172.21.15.7:0/2377097534 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4f140a33b0 0x7f4f140a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:21.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.310+0000 7f4f1ffff640 1 -- 172.21.15.7:0/2377097534 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f4f100cf820 con 0x7f4f28074e30 2024-09-19T08:50:21.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.311+0000 7f4f26ffd640 1 --2- 172.21.15.7:0/2377097534 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4f140a33b0 0x7f4f140a5870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4f18005fc0 tx=0x7f4f18009360 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:21.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.314+0000 7f4f1ffff640 1 -- 172.21.15.7:0/2377097534 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4f10014030 con 0x7f4f28074e30 2024-09-19T08:50:21.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.529+0000 7f4f2d5c9640 1 -- 172.21.15.7:0/2377097534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f2802d7c0 con 0x7f4f28074e30 2024-09-19T08:50:21.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.530+0000 7f4f1ffff640 1 -- 172.21.15.7:0/2377097534 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f4f1009c190 con 0x7f4f28074e30 2024-09-19T08:50:21.530 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:50:21.531 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:50:21.531 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:50:21.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.532+0000 7f4f2d5c9640 1 -- 172.21.15.7:0/2377097534 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4f140a33b0 msgr2=0x7f4f140a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:21.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.532+0000 7f4f2d5c9640 1 --2- 172.21.15.7:0/2377097534 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4f140a33b0 0x7f4f140a5870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4f18005fc0 tx=0x7f4f18009360 comp rx=0 tx=0).stop 2024-09-19T08:50:21.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.532+0000 7f4f2d5c9640 1 -- 172.21.15.7:0/2377097534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f28074e30 msgr2=0x7f4f2819abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:21.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.532+0000 7f4f2d5c9640 1 --2- 172.21.15.7:0/2377097534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f28074e30 0x7f4f2819abe0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000c970 tx=0x7f4f1000ce30 comp rx=0 tx=0).stop 2024-09-19T08:50:21.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.533+0000 7f4f2d5c9640 1 -- 172.21.15.7:0/2377097534 shutdown_connections 2024-09-19T08:50:21.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.533+0000 7f4f2d5c9640 1 --2- 172.21.15.7:0/2377097534 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4f140a33b0 0x7f4f140a5870 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:21.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.533+0000 7f4f2d5c9640 1 --2- 172.21.15.7:0/2377097534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f2810e450 0x7f4f2819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:21.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.533+0000 7f4f2d5c9640 1 --2- 172.21.15.7:0/2377097534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f28074e30 0x7f4f2819abe0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:21.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.533+0000 7f4f2d5c9640 1 --2- 172.21.15.7:0/2377097534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f28074510 0x7f4f2819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:21.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.533+0000 7f4f2d5c9640 1 -- 172.21.15.7:0/2377097534 >> 172.21.15.7:0/2377097534 conn(0x7f4f280fd8f0 msgr2=0x7f4f280ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:21.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.533+0000 7f4f2d5c9640 1 -- 172.21.15.7:0/2377097534 shutdown_connections 2024-09-19T08:50:21.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:21.533+0000 7f4f2d5c9640 1 -- 172.21.15.7:0/2377097534 wait complete. 2024-09-19T08:50:22.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:21 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/2377097534' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:50:22.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:21 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2377097534' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:50:22.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:21 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/2377097534' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:50:22.331 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:50:22.586 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:22.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:22 smithi007 ceph-mon[31221]: pgmap v178: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:50:23.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.071+0000 7ff5ff6a9640 1 -- 172.21.15.7:0/2128471978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5f8102d40 msgr2=0x7ff5f8103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:23.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.071+0000 7ff5ff6a9640 1 --2- 172.21.15.7:0/2128471978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5f8102d40 0x7ff5f8103120 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009ca0 tx=0x7ff5f402a950 comp rx=0 tx=0).stop 2024-09-19T08:50:23.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.072+0000 7ff5ff6a9640 1 -- 172.21.15.7:0/2128471978 shutdown_connections 2024-09-19T08:50:23.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.072+0000 7ff5ff6a9640 1 --2- 172.21.15.7:0/2128471978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5f810c170 0x7ff5f810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.072+0000 7ff5ff6a9640 1 --2- 172.21.15.7:0/2128471978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5f8103660 0x7ff5f810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.072+0000 7ff5ff6a9640 1 --2- 172.21.15.7:0/2128471978 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5f8102d40 0x7ff5f8103120 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.072+0000 7ff5ff6a9640 1 -- 172.21.15.7:0/2128471978 >> 172.21.15.7:0/2128471978 conn(0x7ff5f80fc7a0 msgr2=0x7ff5f80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:23.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.072+0000 7ff5ff6a9640 1 -- 172.21.15.7:0/2128471978 shutdown_connections 2024-09-19T08:50:23.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.072+0000 7ff5ff6a9640 1 -- 172.21.15.7:0/2128471978 wait complete. 2024-09-19T08:50:23.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.072+0000 7ff5ff6a9640 1 Processor -- start 2024-09-19T08:50:23.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.072+0000 7ff5ff6a9640 1 -- start start 2024-09-19T08:50:23.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.072+0000 7ff5ff6a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5f8102d40 0x7ff5f8198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:23.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.072+0000 7ff5ff6a9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5f8103660 0x7ff5f8198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.073+0000 7ff5ff6a9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5f810c170 0x7ff5f819cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.073+0000 7ff5ff6a9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f8111f70 con 0x7ff5f810c170 2024-09-19T08:50:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.073+0000 7ff5ff6a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f8111df0 con 0x7ff5f8102d40 2024-09-19T08:50:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.073+0000 7ff5ff6a9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f81120f0 con 0x7ff5f8103660 2024-09-19T08:50:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.073+0000 7ff5fdc46640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5f810c170 0x7ff5f819cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.073+0000 7ff5fdc46640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5f810c170 0x7ff5f819cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47710/0 (socket says 172.21.15.7:47710) 2024-09-19T08:50:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.073+0000 7ff5fdc46640 1 -- 172.21.15.7:0/303472010 learned_addr learned my addr 172.21.15.7:0/303472010 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.073+0000 7ff5fd445640 1 --2- 172.21.15.7:0/303472010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5f8102d40 0x7ff5f8198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.073+0000 7ff5fcc44640 1 --2- 172.21.15.7:0/303472010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5f8103660 0x7ff5f8198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.073+0000 7ff5fdc46640 1 -- 172.21.15.7:0/303472010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5f8103660 msgr2=0x7ff5f8198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.073+0000 7ff5fdc46640 1 --2- 172.21.15.7:0/303472010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5f8103660 0x7ff5f8198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.073+0000 7ff5fdc46640 1 -- 172.21.15.7:0/303472010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5f8102d40 msgr2=0x7ff5f8198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:23.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.073+0000 7ff5fdc46640 1 --2- 172.21.15.7:0/303472010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5f8102d40 0x7ff5f8198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.073+0000 7ff5fdc46640 1 -- 172.21.15.7:0/303472010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f819d1e0 con 0x7ff5f810c170 2024-09-19T08:50:23.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.073+0000 7ff5fdc46640 1 --2- 172.21.15.7:0/303472010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5f810c170 0x7ff5f819cb00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000c970 tx=0x7ff5f000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:23.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.073+0000 7ff5ea7fc640 1 -- 172.21.15.7:0/303472010 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0007bb0 con 0x7ff5f810c170 2024-09-19T08:50:23.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.073+0000 7ff5ea7fc640 1 -- 172.21.15.7:0/303472010 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5f0007d50 con 0x7ff5f810c170 2024-09-19T08:50:23.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.073+0000 7ff5ff6a9640 1 -- 172.21.15.7:0/303472010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f819d4d0 con 0x7ff5f810c170 2024-09-19T08:50:23.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.073+0000 7ff5ea7fc640 1 -- 172.21.15.7:0/303472010 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0018800 con 0x7ff5f810c170 2024-09-19T08:50:23.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.074+0000 7ff5ff6a9640 1 -- 172.21.15.7:0/303472010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f81a4db0 con 0x7ff5f810c170 2024-09-19T08:50:23.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.076+0000 7ff5ea7fc640 1 -- 172.21.15.7:0/303472010 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff5f000fa50 con 0x7ff5f810c170 2024-09-19T08:50:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.076+0000 7ff601a82740 1 Processor -- start 2024-09-19T08:50:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.076+0000 7ff601a82740 1 -- start start 2024-09-19T08:50:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.077+0000 7ff601a82740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef3682b40 0x556ef3681090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.077+0000 7ff601a82740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ef36815d0 0x556ef3681a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.077+0000 7ff601a82740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ef368c370 0x556ef368e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.077+0000 7ff601a82740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556ef35e72f0 con 0x556ef3682b40 2024-09-19T08:50:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.077+0000 7ff601a82740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556ef358ecf0 con 0x556ef36815d0 2024-09-19T08:50:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.077+0000 7ff601a82740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556ef35e32b0 con 0x556ef368c370 2024-09-19T08:50:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.077+0000 7ff5ea7fc640 1 --2- 172.21.15.7:0/303472010 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff5e40a3430 0x7ff5e40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.077+0000 7ff5fcc44640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef3682b40 0x556ef3681090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.077+0000 7ff5fcc44640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef3682b40 0x556ef3681090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47724/0 (socket says 172.21.15.7:47724) 2024-09-19T08:50:23.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.077+0000 7ff5fcc44640 1 -- 172.21.15.7:0/449109460 learned_addr learned my addr 172.21.15.7:0/449109460 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.077+0000 7ff5fd445640 1 --2- 172.21.15.7:0/449109460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ef36815d0 0x556ef3681a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.077+0000 7ff5fdc46640 1 --2- 172.21.15.7:0/303472010 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff5e40a3430 0x7ff5e40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.077+0000 7ff5fcc44640 1 --2- 172.21.15.7:0/449109460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ef368c370 0x556ef368e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.077+0000 7ff5ea7fc640 1 -- 172.21.15.7:0/303472010 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7ff5f00cfc80 con 0x7ff5f810c170 2024-09-19T08:50:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.077+0000 7ff5fcc44640 1 -- 172.21.15.7:0/449109460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ef368c370 msgr2=0x556ef368e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.077+0000 7ff5fcc44640 1 --2- 172.21.15.7:0/449109460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ef368c370 0x556ef368e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.077+0000 7ff5fcc44640 1 -- 172.21.15.7:0/449109460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ef36815d0 msgr2=0x556ef3681a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.077+0000 7ff5fcc44640 1 --2- 172.21.15.7:0/449109460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ef36815d0 0x556ef3681a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.077+0000 7ff5fcc44640 1 -- 172.21.15.7:0/449109460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ef35733a0 con 0x556ef3682b40 2024-09-19T08:50:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.077+0000 7ff5fcc44640 1 --2- 172.21.15.7:0/449109460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef3682b40 0x556ef3681090 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec00b610 tx=0x7ff5ec00b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7071b862b60d7f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.078+0000 7ff5fdc46640 1 --2- 172.21.15.7:0/303472010 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff5e40a3430 0x7ff5e40a58f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff5f00aefd0 tx=0x7ff5f00bc040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:23.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.078+0000 7ff5e37fe640 1 -- 172.21.15.7:0/449109460 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec0120d0 con 0x556ef3682b40 2024-09-19T08:50:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.078+0000 7ff5e37fe640 1 -- 172.21.15.7:0/449109460 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5ec004c80 con 0x556ef3682b40 2024-09-19T08:50:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.078+0000 7ff5e37fe640 1 -- 172.21.15.7:0/449109460 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec01c560 con 0x556ef3682b40 2024-09-19T08:50:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.078+0000 7ff601a82740 1 -- 172.21.15.7:0/449109460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef3682b40 msgr2=0x556ef3681090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.078+0000 7ff601a82740 1 --2- 172.21.15.7:0/449109460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef3682b40 0x556ef3681090 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec00b610 tx=0x7ff5ec00b5a0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.079+0000 7ff601a82740 1 -- 172.21.15.7:0/449109460 shutdown_connections 2024-09-19T08:50:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.079+0000 7ff601a82740 1 --2- 172.21.15.7:0/449109460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ef368c370 0x556ef368e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.079+0000 7ff601a82740 1 --2- 172.21.15.7:0/449109460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ef36815d0 0x556ef3681a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.079+0000 7ff601a82740 1 --2- 172.21.15.7:0/449109460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef3682b40 0x556ef3681090 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.079+0000 7ff601a82740 1 -- 172.21.15.7:0/449109460 >> 172.21.15.7:0/449109460 conn(0x556ef364a310 msgr2=0x556ef367dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.079+0000 7ff601a82740 1 -- 172.21.15.7:0/449109460 shutdown_connections 2024-09-19T08:50:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.079+0000 7ff601a82740 1 -- 172.21.15.7:0/449109460 wait complete. 2024-09-19T08:50:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.079+0000 7ff601a82740 1 -- start start 2024-09-19T08:50:23.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.079+0000 7ff601a82740 1 Processor -- start 2024-09-19T08:50:23.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.079+0000 7ff601a82740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef36815d0 0x556ef368bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.079+0000 7ff601a82740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ef3682b40 0x556ef3688f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.079+0000 7ff601a82740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ef368c370 0x556ef36894f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.079+0000 7ff601a82740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556ef368f010 con 0x556ef36815d0 2024-09-19T08:50:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.079+0000 7ff601a82740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556ef35a2060 con 0x556ef3682b40 2024-09-19T08:50:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.079+0000 7ff601a82740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556ef368f190 con 0x556ef368c370 2024-09-19T08:50:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.080+0000 7ff601a82740 10 client.0 _ll_register_callbacks cb 0x556ef32f58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.080+0000 7ff5fcc44640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef36815d0 0x556ef368bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.080+0000 7ff5fcc44640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef36815d0 0x556ef368bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47736/0 (socket says 172.21.15.7:47736) 2024-09-19T08:50:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.080+0000 7ff5fcc44640 1 -- 172.21.15.7:0/861716904 learned_addr learned my addr 172.21.15.7:0/861716904 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.080+0000 7ff5fd445640 1 --2- 172.21.15.7:0/861716904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ef3682b40 0x556ef3688f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:23.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.080+0000 7ff5fcc44640 1 --2- 172.21.15.7:0/861716904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ef368c370 0x556ef36894f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.080+0000 7ff5fcc44640 1 -- 172.21.15.7:0/861716904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ef368c370 msgr2=0x556ef36894f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.080+0000 7ff5fcc44640 1 --2- 172.21.15.7:0/861716904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ef368c370 0x556ef36894f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.080+0000 7ff5fcc44640 1 -- 172.21.15.7:0/861716904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ef3682b40 msgr2=0x556ef3688f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.080+0000 7ff5fcc44640 1 --2- 172.21.15.7:0/861716904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ef3682b40 0x556ef3688f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.080+0000 7ff5fcc44640 1 -- 172.21.15.7:0/861716904 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ef33583c0 con 0x556ef36815d0 2024-09-19T08:50:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.080+0000 7ff5fd445640 1 --2- 172.21.15.7:0/861716904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ef3682b40 0x556ef3688f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.080+0000 7ff5fcc44640 1 --2- 172.21.15.7:0/861716904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef36815d0 0x556ef368bce0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0052c0 tx=0x7ff5ec005350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deedeab12fe220f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.080+0000 7ff5e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:50:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.080+0000 7ff5e0ff9640 1 -- 172.21.15.7:0/861716904 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec030060 con 0x556ef36815d0 2024-09-19T08:50:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.080+0000 7ff5e0ff9640 1 -- 172.21.15.7:0/861716904 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7ff5ec0046c0 con 0x556ef36815d0 2024-09-19T08:50:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.080+0000 7ff601a82740 1 -- 172.21.15.7:0/861716904 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5ec004c80 con 0x556ef36815d0 2024-09-19T08:50:23.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.080+0000 7ff5e0ff9640 1 -- 172.21.15.7:0/861716904 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff5ec0057a0 con 0x556ef36815d0 2024-09-19T08:50:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.080+0000 7ff601a82740 10 client.16422 fetch_fsmap learned FSMap version 25 2024-09-19T08:50:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.080+0000 7ff601a82740 1 -- 172.21.15.7:0/861716904 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556ef369aa20 con 0x556ef36815d0 2024-09-19T08:50:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.081+0000 7ff5e0ff9640 1 -- 172.21.15.7:0/861716904 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5ec004c80 con 0x556ef36815d0 2024-09-19T08:50:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.081+0000 7ff5e0ff9640 1 -- 172.21.15.7:0/861716904 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff5ec026040 con 0x556ef36815d0 2024-09-19T08:50:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.081+0000 7ff601a82740 10 client.16422 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:50:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.081+0000 7ff601a82740 10 client.16422 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:50:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.081+0000 7ff601a82740 20 client.16422 populate_metadata read hostname 'smithi007' 2024-09-19T08:50:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.081+0000 7ff601a82740 1 --2- 172.21.15.7:0/861716904 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x556ef369be80 0x556ef369e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.081+0000 7ff601a82740 4 client.16422 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:50:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.081+0000 7ff601a82740 1 -- 172.21.15.7:0/861716904 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ef35f4860 con 0x556ef369be80 2024-09-19T08:50:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.081+0000 7ff5fd445640 1 --2- 172.21.15.7:0/861716904 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x556ef369be80 0x556ef369e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.082+0000 7ff5e0ff9640 10 client.16422 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:50:23.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.082+0000 7ff5fd445640 1 --2- 172.21.15.7:0/861716904 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x556ef369be80 0x556ef369e270 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2134f2f3b1a17a3f server_cookie=6a8780fba22db0b7 in_seq=0 out_seq=0 2024-09-19T08:50:23.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.082+0000 7ff5e0ff9640 1 -- 172.21.15.7:0/861716904 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556ef35f4860 con 0x556ef369be80 2024-09-19T08:50:23.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.082+0000 7ff5e0ff9640 10 client.16422 handle_command_reply: tid=0 2024-09-19T08:50:23.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.082+0000 7ff601a82740 1 client.16422 shutdown 2024-09-19T08:50:23.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.083+0000 7ff601a82740 1 -- 172.21.15.7:0/861716904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef36815d0 msgr2=0x556ef368bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:23.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.083+0000 7ff601a82740 1 --2- 172.21.15.7:0/861716904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef36815d0 0x556ef368bce0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0052c0 tx=0x7ff5ec005350 comp rx=0 tx=0).stop 2024-09-19T08:50:23.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.083+0000 7ff601a82740 1 -- 172.21.15.7:0/861716904 shutdown_connections 2024-09-19T08:50:23.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.083+0000 7ff601a82740 1 --2- 172.21.15.7:0/861716904 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x556ef369be80 0x556ef369e270 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.083+0000 7ff601a82740 1 --2- 172.21.15.7:0/861716904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ef368c370 0x556ef36894f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.083+0000 7ff601a82740 1 --2- 172.21.15.7:0/861716904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ef3682b40 0x556ef3688f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.083+0000 7ff601a82740 1 --2- 172.21.15.7:0/861716904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef36815d0 0x556ef368bce0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.083+0000 7ff5e0ff9640 0 client.16422 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:50:23.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.083+0000 7ff601a82740 1 -- 172.21.15.7:0/861716904 >> 172.21.15.7:0/861716904 conn(0x556ef364a310 msgr2=0x556ef3683930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:23.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.083+0000 7ff601a82740 1 -- 172.21.15.7:0/861716904 shutdown_connections 2024-09-19T08:50:23.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.083+0000 7ff601a82740 1 -- 172.21.15.7:0/861716904 wait complete. 2024-09-19T08:50:23.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.083+0000 7ff601a82740 20 client.16422 trim_cache size 0 max 16384 2024-09-19T08:50:23.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.096+0000 7ff601a82740 1 Processor -- start 2024-09-19T08:50:23.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.096+0000 7ff601a82740 1 -- start start 2024-09-19T08:50:23.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.096+0000 7ff601a82740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ef36815d0 0x556ef3684120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:23.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.096+0000 7ff601a82740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ef3682b40 0x556ef3684660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:23.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.096+0000 7ff601a82740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef368c370 0x556ef3686210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:23.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.096+0000 7ff601a82740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f81ade00 con 0x556ef368c370 2024-09-19T08:50:23.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.096+0000 7ff601a82740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f81ab6d0 con 0x556ef3682b40 2024-09-19T08:50:23.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.096+0000 7ff601a82740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f81a9540 con 0x556ef36815d0 2024-09-19T08:50:23.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.096+0000 7ff5fcc44640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef368c370 0x556ef3686210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:23.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.096+0000 7ff5fcc44640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef368c370 0x556ef3686210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47746/0 (socket says 172.21.15.7:47746) 2024-09-19T08:50:23.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.096+0000 7ff5fcc44640 1 -- 172.21.15.7:0/3394188750 learned_addr learned my addr 172.21.15.7:0/3394188750 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:23.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.097+0000 7ff5fd445640 1 --2- 172.21.15.7:0/3394188750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ef3682b40 0x556ef3684660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:23.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.097+0000 7ff5fcc44640 1 --2- 172.21.15.7:0/3394188750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ef36815d0 0x556ef3684120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.097+0000 7ff5fcc44640 1 -- 172.21.15.7:0/3394188750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ef36815d0 msgr2=0x556ef3684120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.097+0000 7ff5fcc44640 1 --2- 172.21.15.7:0/3394188750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ef36815d0 0x556ef3684120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.097+0000 7ff5fcc44640 1 -- 172.21.15.7:0/3394188750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ef3682b40 msgr2=0x556ef3684660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.097+0000 7ff5fcc44640 1 --2- 172.21.15.7:0/3394188750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ef3682b40 0x556ef3684660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.097+0000 7ff5fcc44640 1 -- 172.21.15.7:0/3394188750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ef3684ba0 con 0x556ef368c370 2024-09-19T08:50:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.097+0000 7ff5fcc44640 1 --2- 172.21.15.7:0/3394188750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef368c370 0x556ef3686210 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0123b0 tx=0x7ff5ec02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7932c12b01869bfe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.097+0000 7ff5e2ffd640 1 -- 172.21.15.7:0/3394188750 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec030030 con 0x556ef368c370 2024-09-19T08:50:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.097+0000 7ff5e2ffd640 1 -- 172.21.15.7:0/3394188750 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5ec012d90 con 0x556ef368c370 2024-09-19T08:50:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.097+0000 7ff5e2ffd640 1 -- 172.21.15.7:0/3394188750 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec01c7c0 con 0x556ef368c370 2024-09-19T08:50:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.098+0000 7ff601a82740 1 -- 172.21.15.7:0/3394188750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef368c370 msgr2=0x556ef3686210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.098+0000 7ff601a82740 1 --2- 172.21.15.7:0/3394188750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef368c370 0x556ef3686210 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0123b0 tx=0x7ff5ec02c040 comp rx=0 tx=0).stop 2024-09-19T08:50:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.098+0000 7ff601a82740 1 -- 172.21.15.7:0/3394188750 shutdown_connections 2024-09-19T08:50:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.098+0000 7ff601a82740 1 --2- 172.21.15.7:0/3394188750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef368c370 0x556ef3686210 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.098+0000 7ff601a82740 1 --2- 172.21.15.7:0/3394188750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ef3682b40 0x556ef3684660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.098+0000 7ff601a82740 1 --2- 172.21.15.7:0/3394188750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ef36815d0 0x556ef3684120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.098+0000 7ff601a82740 1 -- 172.21.15.7:0/3394188750 >> 172.21.15.7:0/3394188750 conn(0x556ef364a310 msgr2=0x556ef367cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:23.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.098+0000 7ff601a82740 1 -- 172.21.15.7:0/3394188750 shutdown_connections 2024-09-19T08:50:23.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.098+0000 7ff601a82740 1 -- 172.21.15.7:0/3394188750 wait complete. 2024-09-19T08:50:23.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.098+0000 7ff601a82740 1 -- start start 2024-09-19T08:50:23.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.098+0000 7ff601a82740 1 Processor -- start 2024-09-19T08:50:23.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff601a82740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef36815d0 0x556ef369f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:23.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff601a82740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ef3682b40 0x556ef369f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:23.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff601a82740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ef368c370 0x556ef369fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:23.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff601a82740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f81a9b90 con 0x556ef36815d0 2024-09-19T08:50:23.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff601a82740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f81ab000 con 0x556ef3682b40 2024-09-19T08:50:23.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff601a82740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f81aa260 con 0x556ef368c370 2024-09-19T08:50:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff601a82740 10 client.0 _ll_register_callbacks cb 0x7ff5ec012410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff5fcc44640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef36815d0 0x556ef369f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff5fd445640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ef3682b40 0x556ef369f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff5fcc44640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef36815d0 0x556ef369f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47750/0 (socket says 172.21.15.7:47750) 2024-09-19T08:50:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff5fcc44640 1 -- 172.21.15.7:0/4176473296 learned_addr learned my addr 172.21.15.7:0/4176473296 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff5fcc44640 1 --2- 172.21.15.7:0/4176473296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ef368c370 0x556ef369fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff5fcc44640 1 -- 172.21.15.7:0/4176473296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ef368c370 msgr2=0x556ef369fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff5fcc44640 1 --2- 172.21.15.7:0/4176473296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ef368c370 0x556ef369fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff5fcc44640 1 -- 172.21.15.7:0/4176473296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ef3682b40 msgr2=0x556ef369f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff5fcc44640 1 --2- 172.21.15.7:0/4176473296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ef3682b40 0x556ef369f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff5fcc44640 1 -- 172.21.15.7:0/4176473296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ef3705840 con 0x556ef36815d0 2024-09-19T08:50:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff5fd445640 1 --2- 172.21.15.7:0/4176473296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ef3682b40 0x556ef369f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:50:23.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff5fcc44640 1 --2- 172.21.15.7:0/4176473296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef36815d0 0x556ef369f0a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec01ce90 tx=0x7ff5ec00b580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3220bcb23e0699d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff5e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:50:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff5e0ff9640 1 -- 172.21.15.7:0/4176473296 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec030040 con 0x556ef36815d0 2024-09-19T08:50:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff5e0ff9640 1 -- 172.21.15.7:0/4176473296 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7ff5ec02ad40 con 0x556ef36815d0 2024-09-19T08:50:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.099+0000 7ff601a82740 1 -- 172.21.15.7:0/4176473296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5ec012d90 con 0x556ef36815d0 2024-09-19T08:50:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.100+0000 7ff5e0ff9640 1 -- 172.21.15.7:0/4176473296 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff5ec004020 con 0x556ef36815d0 2024-09-19T08:50:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.100+0000 7ff601a82740 10 client.16428 fetch_fsmap learned FSMap version 25 2024-09-19T08:50:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.100+0000 7ff601a82740 1 -- 172.21.15.7:0/4176473296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556ef3706b20 con 0x556ef36815d0 2024-09-19T08:50:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.100+0000 7ff5e0ff9640 1 -- 172.21.15.7:0/4176473296 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5ec012d90 con 0x556ef36815d0 2024-09-19T08:50:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.100+0000 7ff5e0ff9640 1 -- 172.21.15.7:0/4176473296 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff5ec03d060 con 0x556ef36815d0 2024-09-19T08:50:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.100+0000 7ff601a82740 10 client.16428 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:50:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.100+0000 7ff601a82740 10 client.16428 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:50:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.100+0000 7ff601a82740 20 client.16428 populate_metadata read hostname 'smithi007' 2024-09-19T08:50:23.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.100+0000 7ff601a82740 1 --2- 172.21.15.7:0/4176473296 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x556ef37071d0 0x556ef37095c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.100+0000 7ff601a82740 4 client.16428 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:50:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.100+0000 7ff601a82740 1 -- 172.21.15.7:0/4176473296 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556ef35eed70 con 0x556ef37071d0 2024-09-19T08:50:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.100+0000 7ff5fd445640 1 --2- 172.21.15.7:0/4176473296 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x556ef37071d0 0x556ef37095c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.101+0000 7ff5fd445640 1 --2- 172.21.15.7:0/4176473296 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x556ef37071d0 0x556ef37095c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9d5525a08ce0b078 server_cookie=1764701ba86715be in_seq=0 out_seq=0 2024-09-19T08:50:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.101+0000 7ff5e0ff9640 10 client.16428 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:50:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.101+0000 7ff5e0ff9640 1 -- 172.21.15.7:0/4176473296 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556ef35eed70 con 0x556ef37071d0 2024-09-19T08:50:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.101+0000 7ff5e0ff9640 10 client.16428 handle_command_reply: tid=0 2024-09-19T08:50:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.101+0000 7ff601a82740 1 client.16428 shutdown 2024-09-19T08:50:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.101+0000 7ff601a82740 1 -- 172.21.15.7:0/4176473296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef36815d0 msgr2=0x556ef369f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.101+0000 7ff601a82740 1 --2- 172.21.15.7:0/4176473296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef36815d0 0x556ef369f0a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec01ce90 tx=0x7ff5ec00b580 comp rx=0 tx=0).stop 2024-09-19T08:50:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.101+0000 7ff601a82740 1 -- 172.21.15.7:0/4176473296 shutdown_connections 2024-09-19T08:50:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.101+0000 7ff601a82740 1 --2- 172.21.15.7:0/4176473296 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x556ef37071d0 0x556ef37095c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.101+0000 7ff601a82740 1 --2- 172.21.15.7:0/4176473296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ef368c370 0x556ef369fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.101+0000 7ff601a82740 1 --2- 172.21.15.7:0/4176473296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ef3682b40 0x556ef369f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.101+0000 7ff601a82740 1 --2- 172.21.15.7:0/4176473296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ef36815d0 0x556ef369f0a0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.101+0000 7ff5e0ff9640 0 client.16428 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:50:23.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.101+0000 7ff601a82740 1 -- 172.21.15.7:0/4176473296 >> 172.21.15.7:0/4176473296 conn(0x556ef364a310 msgr2=0x556ef367cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:23.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.101+0000 7ff601a82740 1 -- 172.21.15.7:0/4176473296 shutdown_connections 2024-09-19T08:50:23.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.101+0000 7ff601a82740 1 -- 172.21.15.7:0/4176473296 wait complete. 2024-09-19T08:50:23.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.101+0000 7ff601a82740 20 client.16428 trim_cache size 0 max 16384 2024-09-19T08:50:23.107 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:50:23.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.102+0000 7ff5ff6a9640 1 -- 172.21.15.7:0/303472010 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff5e40a3430 msgr2=0x7ff5e40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:23.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.102+0000 7ff5ff6a9640 1 --2- 172.21.15.7:0/303472010 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff5e40a3430 0x7ff5e40a58f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff5f00aefd0 tx=0x7ff5f00bc040 comp rx=0 tx=0).stop 2024-09-19T08:50:23.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.102+0000 7ff5ff6a9640 1 -- 172.21.15.7:0/303472010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5f810c170 msgr2=0x7ff5f819cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:23.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.102+0000 7ff5ff6a9640 1 --2- 172.21.15.7:0/303472010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5f810c170 0x7ff5f819cb00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000c970 tx=0x7ff5f000ce30 comp rx=0 tx=0).stop 2024-09-19T08:50:23.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.102+0000 7ff5ff6a9640 1 -- 172.21.15.7:0/303472010 shutdown_connections 2024-09-19T08:50:23.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.102+0000 7ff5ff6a9640 1 --2- 172.21.15.7:0/303472010 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff5e40a3430 0x7ff5e40a58f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.102+0000 7ff5ff6a9640 1 --2- 172.21.15.7:0/303472010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5f810c170 0x7ff5f819cb00 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.102+0000 7ff5ff6a9640 1 --2- 172.21.15.7:0/303472010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5f8103660 0x7ff5f8198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.102+0000 7ff5ff6a9640 1 --2- 172.21.15.7:0/303472010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5f8102d40 0x7ff5f8198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.102+0000 7ff5ff6a9640 1 -- 172.21.15.7:0/303472010 >> 172.21.15.7:0/303472010 conn(0x7ff5f80fc7a0 msgr2=0x7ff5f810dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:23.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.102+0000 7ff5ff6a9640 1 -- 172.21.15.7:0/303472010 shutdown_connections 2024-09-19T08:50:23.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:23.102+0000 7ff5ff6a9640 1 -- 172.21.15.7:0/303472010 wait complete. 2024-09-19T08:50:23.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:22 smithi175 ceph-mon[35688]: pgmap v178: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:50:23.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:22 smithi044 ceph-mon[35072]: pgmap v178: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T08:50:23.791 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:50:24.049 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:24.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.546+0000 7f4dddb1b640 1 -- 172.21.15.7:0/1571955662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dd8102ef0 msgr2=0x7f4dd810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:24.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.546+0000 7f4dddb1b640 1 --2- 172.21.15.7:0/1571955662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dd8102ef0 0x7f4dd810da40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8009ca0 tx=0x7f4dc802a950 comp rx=0 tx=0).stop 2024-09-19T08:50:24.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.546+0000 7f4dddb1b640 1 -- 172.21.15.7:0/1571955662 shutdown_connections 2024-09-19T08:50:24.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.546+0000 7f4dddb1b640 1 --2- 172.21.15.7:0/1571955662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dd8102ef0 0x7f4dd810da40 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.546+0000 7f4dddb1b640 1 --2- 172.21.15.7:0/1571955662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dd8102570 0x7f4dd81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.546+0000 7f4dddb1b640 1 --2- 172.21.15.7:0/1571955662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dd8100e20 0x7f4dd8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.546+0000 7f4dddb1b640 1 -- 172.21.15.7:0/1571955662 >> 172.21.15.7:0/1571955662 conn(0x7f4dd80fc7d0 msgr2=0x7f4dd80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:24.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.546+0000 7f4dddb1b640 1 -- 172.21.15.7:0/1571955662 shutdown_connections 2024-09-19T08:50:24.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.546+0000 7f4dddb1b640 1 -- 172.21.15.7:0/1571955662 wait complete. 2024-09-19T08:50:24.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.546+0000 7f4dddb1b640 1 Processor -- start 2024-09-19T08:50:24.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.547+0000 7f4dddb1b640 1 -- start start 2024-09-19T08:50:24.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.547+0000 7f4dddb1b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dd8100e20 0x7f4dd80fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:24.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.547+0000 7f4dddb1b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dd8102570 0x7f4dd80fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:24.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.547+0000 7f4dddb1b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dd8102ef0 0x7f4dd80fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:24.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.547+0000 7f4dddb1b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd8110f80 con 0x7f4dd8102570 2024-09-19T08:50:24.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.547+0000 7f4dddb1b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd8110e00 con 0x7f4dd8102ef0 2024-09-19T08:50:24.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.547+0000 7f4dddb1b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd8111100 con 0x7f4dd8100e20 2024-09-19T08:50:24.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.547+0000 7f4dd6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dd8102570 0x7f4dd80fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:24.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.547+0000 7f4dd6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dd8102570 0x7f4dd80fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38422/0 (socket says 172.21.15.7:38422) 2024-09-19T08:50:24.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.547+0000 7f4dd6ffd640 1 -- 172.21.15.7:0/1945112367 learned_addr learned my addr 172.21.15.7:0/1945112367 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:24.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.547+0000 7f4dd77fe640 1 --2- 172.21.15.7:0/1945112367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dd8100e20 0x7f4dd80fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:24.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.547+0000 7f4dd7fff640 1 --2- 172.21.15.7:0/1945112367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dd8102ef0 0x7f4dd80fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:24.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.547+0000 7f4dd6ffd640 1 -- 172.21.15.7:0/1945112367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dd8100e20 msgr2=0x7f4dd80fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:24.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.547+0000 7f4dd6ffd640 1 --2- 172.21.15.7:0/1945112367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dd8100e20 0x7f4dd80fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.547+0000 7f4dd6ffd640 1 -- 172.21.15.7:0/1945112367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dd8102ef0 msgr2=0x7f4dd80fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:24.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.547+0000 7f4dd6ffd640 1 --2- 172.21.15.7:0/1945112367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dd8102ef0 0x7f4dd80fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.547+0000 7f4dd6ffd640 1 -- 172.21.15.7:0/1945112367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd81a68b0 con 0x7f4dd8102570 2024-09-19T08:50:24.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.547+0000 7f4dd77fe640 1 --2- 172.21.15.7:0/1945112367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dd8100e20 0x7f4dd80fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:24.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.548+0000 7f4dd6ffd640 1 --2- 172.21.15.7:0/1945112367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dd8102570 0x7f4dd80fd1c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000d770 tx=0x7f4dc000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:24.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.548+0000 7f4dd4ff9640 1 -- 172.21.15.7:0/1945112367 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0017070 con 0x7f4dd8102570 2024-09-19T08:50:24.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.548+0000 7f4dd4ff9640 1 -- 172.21.15.7:0/1945112367 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dc0005500 con 0x7f4dd8102570 2024-09-19T08:50:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.548+0000 7f4dddb1b640 1 -- 172.21.15.7:0/1945112367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd81a6ba0 con 0x7f4dd8102570 2024-09-19T08:50:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.548+0000 7f4dd4ff9640 1 -- 172.21.15.7:0/1945112367 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0004e00 con 0x7f4dd8102570 2024-09-19T08:50:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.548+0000 7f4dddb1b640 1 -- 172.21.15.7:0/1945112367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dd81a7090 con 0x7f4dd8102570 2024-09-19T08:50:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.550+0000 7f4dd4ff9640 1 -- 172.21.15.7:0/1945112367 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f4dc0004fa0 con 0x7f4dd8102570 2024-09-19T08:50:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.551+0000 7f4ddfef4740 1 Processor -- start 2024-09-19T08:50:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.551+0000 7f4ddfef4740 1 -- start start 2024-09-19T08:50:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.551+0000 7f4ddfef4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbc3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.551+0000 7f4ddfef4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8cfbc35d0 0x55c8cfbc3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.551+0000 7f4ddfef4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8cfbce370 0x55c8cfbd0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.551+0000 7f4ddfef4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c8cfb292f0 con 0x55c8cfbc4b40 2024-09-19T08:50:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.551+0000 7f4ddfef4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c8cfad0cf0 con 0x55c8cfbc35d0 2024-09-19T08:50:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.551+0000 7f4ddfef4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c8cfb252b0 con 0x55c8cfbce370 2024-09-19T08:50:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.551+0000 7f4dd7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbc3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.551+0000 7f4dd7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbc3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38426/0 (socket says 172.21.15.7:38426) 2024-09-19T08:50:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.551+0000 7f4dd7fff640 1 -- 172.21.15.7:0/130236254 learned_addr learned my addr 172.21.15.7:0/130236254 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.551+0000 7f4dd6ffd640 1 --2- 172.21.15.7:0/130236254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8cfbce370 0x55c8cfbd0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.551+0000 7f4dd77fe640 1 --2- 172.21.15.7:0/130236254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8cfbc35d0 0x55c8cfbc3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.551+0000 7f4dd4ff9640 1 --2- 172.21.15.7:0/1945112367 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4dc40a33b0 0x7f4dc40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.551+0000 7f4dd7fff640 1 -- 172.21.15.7:0/130236254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8cfbce370 msgr2=0x55c8cfbd0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.551+0000 7f4dd7fff640 1 --2- 172.21.15.7:0/130236254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8cfbce370 0x55c8cfbd0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.551+0000 7f4dd7fff640 1 -- 172.21.15.7:0/130236254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8cfbc35d0 msgr2=0x55c8cfbc3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.551+0000 7f4dd7fff640 1 --2- 172.21.15.7:0/130236254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8cfbc35d0 0x55c8cfbc3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.551+0000 7f4dd7fff640 1 -- 172.21.15.7:0/130236254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8cfab53a0 con 0x55c8cfbc4b40 2024-09-19T08:50:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.551+0000 7f4dd6ffd640 1 --2- 172.21.15.7:0/130236254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8cfbce370 0x55c8cfbd0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.551+0000 7f4dd7fff640 1 --2- 172.21.15.7:0/1945112367 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4dc40a33b0 0x7f4dc40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.552+0000 7f4dd4ff9640 1 -- 172.21.15.7:0/1945112367 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f4dc00cf7b0 con 0x7f4dd8102570 2024-09-19T08:50:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.552+0000 7f4dd7fff640 1 --2- 172.21.15.7:0/130236254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbc3090 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4dc802f9b0 tx=0x7f4dc802f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd7950d7d98b544 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.552+0000 7f4dcdffb640 1 -- 172.21.15.7:0/130236254 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8041040 con 0x55c8cfbc4b40 2024-09-19T08:50:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.552+0000 7f4dd7fff640 1 --2- 172.21.15.7:0/1945112367 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4dc40a33b0 0x7f4dc40a5870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4dc804c000 tx=0x7f4dc804d000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.552+0000 7f4dcdffb640 1 -- 172.21.15.7:0/130236254 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dc8004520 con 0x55c8cfbc4b40 2024-09-19T08:50:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.552+0000 7f4dcdffb640 1 -- 172.21.15.7:0/130236254 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8034040 con 0x55c8cfbc4b40 2024-09-19T08:50:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.553+0000 7f4ddfef4740 1 -- 172.21.15.7:0/130236254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 msgr2=0x55c8cfbc3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.553+0000 7f4ddfef4740 1 --2- 172.21.15.7:0/130236254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbc3090 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4dc802f9b0 tx=0x7f4dc802f9e0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.553+0000 7f4ddfef4740 1 -- 172.21.15.7:0/130236254 shutdown_connections 2024-09-19T08:50:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.553+0000 7f4ddfef4740 1 --2- 172.21.15.7:0/130236254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8cfbce370 0x55c8cfbd0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.553+0000 7f4ddfef4740 1 --2- 172.21.15.7:0/130236254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8cfbc35d0 0x55c8cfbc3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.553+0000 7f4ddfef4740 1 --2- 172.21.15.7:0/130236254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbc3090 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.553+0000 7f4ddfef4740 1 -- 172.21.15.7:0/130236254 >> 172.21.15.7:0/130236254 conn(0x55c8cfb8c310 msgr2=0x55c8cfbbfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:24.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.553+0000 7f4ddfef4740 1 -- 172.21.15.7:0/130236254 shutdown_connections 2024-09-19T08:50:24.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.553+0000 7f4ddfef4740 1 -- 172.21.15.7:0/130236254 wait complete. 2024-09-19T08:50:24.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.553+0000 7f4ddfef4740 1 -- start start 2024-09-19T08:50:24.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.553+0000 7f4ddfef4740 1 Processor -- start 2024-09-19T08:50:24.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.553+0000 7f4ddfef4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8cfbc35d0 0x55c8cfbcddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:24.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.553+0000 7f4ddfef4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbcb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:24.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.553+0000 7f4ddfef4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8cfbce370 0x55c8cfbcb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:24.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.554+0000 7f4ddfef4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c8cfbd1070 con 0x55c8cfbc4b40 2024-09-19T08:50:24.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.554+0000 7f4ddfef4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c8cfae4060 con 0x55c8cfbc35d0 2024-09-19T08:50:24.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.554+0000 7f4ddfef4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c8cfbd11f0 con 0x55c8cfbce370 2024-09-19T08:50:24.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.554+0000 7f4ddfef4740 10 client.0 _ll_register_callbacks cb 0x55c8cf8378c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:24.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.554+0000 7f4dd6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbcb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:24.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.554+0000 7f4dd6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbcb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38428/0 (socket says 172.21.15.7:38428) 2024-09-19T08:50:24.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.554+0000 7f4dd6ffd640 1 -- 172.21.15.7:0/4100703493 learned_addr learned my addr 172.21.15.7:0/4100703493 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.554+0000 7f4dd77fe640 1 --2- 172.21.15.7:0/4100703493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8cfbc35d0 0x55c8cfbcddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.554+0000 7f4dd7fff640 1 --2- 172.21.15.7:0/4100703493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8cfbce370 0x55c8cfbcb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.554+0000 7f4dd6ffd640 1 -- 172.21.15.7:0/4100703493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8cfbce370 msgr2=0x55c8cfbcb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.554+0000 7f4dd6ffd640 1 --2- 172.21.15.7:0/4100703493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8cfbce370 0x55c8cfbcb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.554+0000 7f4dd6ffd640 1 -- 172.21.15.7:0/4100703493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8cfbc35d0 msgr2=0x55c8cfbcddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.554+0000 7f4dd6ffd640 1 --2- 172.21.15.7:0/4100703493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8cfbc35d0 0x55c8cfbcddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.554+0000 7f4dd6ffd640 1 -- 172.21.15.7:0/4100703493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8cf89a3c0 con 0x55c8cfbc4b40 2024-09-19T08:50:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.554+0000 7f4dd7fff640 1 --2- 172.21.15.7:0/4100703493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8cfbce370 0x55c8cfbcb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:50:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.554+0000 7f4dd6ffd640 1 --2- 172.21.15.7:0/4100703493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbcb080 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0098450 tx=0x7f4dc009b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a6b1ad391e3f43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.554+0000 7f4db6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:50:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.554+0000 7f4db6ffd640 1 -- 172.21.15.7:0/4100703493 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0020070 con 0x55c8cfbc4b40 2024-09-19T08:50:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.554+0000 7f4db6ffd640 1 -- 172.21.15.7:0/4100703493 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f4dc0099d80 con 0x55c8cfbc4b40 2024-09-19T08:50:24.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.554+0000 7f4ddfef4740 1 -- 172.21.15.7:0/4100703493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4dc8004520 con 0x55c8cfbc4b40 2024-09-19T08:50:24.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.555+0000 7f4db6ffd640 1 -- 172.21.15.7:0/4100703493 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4dc009c180 con 0x55c8cfbc4b40 2024-09-19T08:50:24.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.555+0000 7f4ddfef4740 10 client.16440 fetch_fsmap learned FSMap version 25 2024-09-19T08:50:24.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.555+0000 7f4ddfef4740 1 -- 172.21.15.7:0/4100703493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c8cfbdcbe0 con 0x55c8cfbc4b40 2024-09-19T08:50:24.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.555+0000 7f4db6ffd640 1 -- 172.21.15.7:0/4100703493 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dc8004520 con 0x55c8cfbc4b40 2024-09-19T08:50:24.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.555+0000 7f4db6ffd640 1 -- 172.21.15.7:0/4100703493 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4dc00cd170 con 0x55c8cfbc4b40 2024-09-19T08:50:24.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.555+0000 7f4ddfef4740 10 client.16440 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:50:24.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.555+0000 7f4ddfef4740 10 client.16440 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:50:24.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.555+0000 7f4ddfef4740 20 client.16440 populate_metadata read hostname 'smithi007' 2024-09-19T08:50:24.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.555+0000 7f4ddfef4740 1 --2- 172.21.15.7:0/4100703493 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55c8cfbde0a0 0x55c8cfbe04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:24.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.555+0000 7f4ddfef4740 4 client.16440 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:50:24.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.555+0000 7f4ddfef4740 1 -- 172.21.15.7:0/4100703493 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8cfb36860 con 0x55c8cfbde0a0 2024-09-19T08:50:24.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.556+0000 7f4dd77fe640 1 --2- 172.21.15.7:0/4100703493 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55c8cfbde0a0 0x55c8cfbe04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:24.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.556+0000 7f4dd77fe640 1 --2- 172.21.15.7:0/4100703493 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55c8cfbde0a0 0x55c8cfbe04d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=aa704753b8f714a7 server_cookie=64656946ea31311a in_seq=0 out_seq=0 2024-09-19T08:50:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.556+0000 7f4db6ffd640 10 client.16440 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:50:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.557+0000 7f4db6ffd640 1 -- 172.21.15.7:0/4100703493 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c8cfb36860 con 0x55c8cfbde0a0 2024-09-19T08:50:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.557+0000 7f4db6ffd640 10 client.16440 handle_command_reply: tid=0 2024-09-19T08:50:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.557+0000 7f4ddfef4740 1 client.16440 shutdown 2024-09-19T08:50:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.557+0000 7f4ddfef4740 1 -- 172.21.15.7:0/4100703493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 msgr2=0x55c8cfbcb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.557+0000 7f4ddfef4740 1 --2- 172.21.15.7:0/4100703493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbcb080 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0098450 tx=0x7f4dc009b950 comp rx=0 tx=0).stop 2024-09-19T08:50:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.557+0000 7f4ddfef4740 1 -- 172.21.15.7:0/4100703493 shutdown_connections 2024-09-19T08:50:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.557+0000 7f4ddfef4740 1 --2- 172.21.15.7:0/4100703493 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55c8cfbde0a0 0x55c8cfbe04d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.557+0000 7f4ddfef4740 1 --2- 172.21.15.7:0/4100703493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8cfbce370 0x55c8cfbcb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.557+0000 7f4ddfef4740 1 --2- 172.21.15.7:0/4100703493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbcb080 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.557+0000 7f4ddfef4740 1 --2- 172.21.15.7:0/4100703493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8cfbc35d0 0x55c8cfbcddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.557+0000 7f4ddfef4740 1 -- 172.21.15.7:0/4100703493 >> 172.21.15.7:0/4100703493 conn(0x55c8cfb8c310 msgr2=0x55c8cfbc5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:24.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.557+0000 7f4db6ffd640 0 client.16440 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:50:24.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.557+0000 7f4ddfef4740 1 -- 172.21.15.7:0/4100703493 shutdown_connections 2024-09-19T08:50:24.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.557+0000 7f4ddfef4740 1 -- 172.21.15.7:0/4100703493 wait complete. 2024-09-19T08:50:24.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.557+0000 7f4ddfef4740 20 client.16440 trim_cache size 0 max 16384 2024-09-19T08:50:24.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.570+0000 7f4ddfef4740 1 Processor -- start 2024-09-19T08:50:24.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.570+0000 7f4ddfef4740 1 -- start start 2024-09-19T08:50:24.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.570+0000 7f4ddfef4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8cfbc35d0 0x55c8cfbca060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:24.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.570+0000 7f4ddfef4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbc6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:24.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.570+0000 7f4ddfef4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8cfbce370 0x55c8cfbc6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:24.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.570+0000 7f4ddfef4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd81b2250 con 0x55c8cfbc4b40 2024-09-19T08:50:24.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.570+0000 7f4ddfef4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd81afb20 con 0x55c8cfbc35d0 2024-09-19T08:50:24.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.570+0000 7f4ddfef4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd81ad970 con 0x55c8cfbce370 2024-09-19T08:50:24.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.570+0000 7f4dd6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbc6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:24.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.570+0000 7f4dd6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbc6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38442/0 (socket says 172.21.15.7:38442) 2024-09-19T08:50:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.571+0000 7f4dd6ffd640 1 -- 172.21.15.7:0/40449480 learned_addr learned my addr 172.21.15.7:0/40449480 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.571+0000 7f4dd77fe640 1 --2- 172.21.15.7:0/40449480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8cfbc35d0 0x55c8cfbca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.571+0000 7f4dd6ffd640 1 -- 172.21.15.7:0/40449480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8cfbce370 msgr2=0x55c8cfbc6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.571+0000 7f4dd6ffd640 1 --2- 172.21.15.7:0/40449480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8cfbce370 0x55c8cfbc6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.571+0000 7f4dd6ffd640 1 -- 172.21.15.7:0/40449480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8cfbc35d0 msgr2=0x55c8cfbca060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.571+0000 7f4dd6ffd640 1 --2- 172.21.15.7:0/40449480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8cfbc35d0 0x55c8cfbca060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.571+0000 7f4dd6ffd640 1 -- 172.21.15.7:0/40449480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8cfbc0960 con 0x55c8cfbc4b40 2024-09-19T08:50:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.571+0000 7f4dd77fe640 1 --2- 172.21.15.7:0/40449480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8cfbc35d0 0x55c8cfbca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.571+0000 7f4dd6ffd640 1 --2- 172.21.15.7:0/40449480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbc6120 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4dc009ba10 tx=0x7f4dc00cfb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb905babb6b1aa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.571+0000 7f4dcd7fa640 1 -- 172.21.15.7:0/40449480 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0020070 con 0x55c8cfbc4b40 2024-09-19T08:50:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.571+0000 7f4dcd7fa640 1 -- 172.21.15.7:0/40449480 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dc009ba80 con 0x55c8cfbc4b40 2024-09-19T08:50:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.571+0000 7f4dcd7fa640 1 -- 172.21.15.7:0/40449480 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0099d80 con 0x55c8cfbc4b40 2024-09-19T08:50:24.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.572+0000 7f4ddfef4740 1 -- 172.21.15.7:0/40449480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 msgr2=0x55c8cfbc6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:24.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.572+0000 7f4ddfef4740 1 --2- 172.21.15.7:0/40449480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbc6120 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4dc009ba10 tx=0x7f4dc00cfb40 comp rx=0 tx=0).stop 2024-09-19T08:50:24.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.572+0000 7f4ddfef4740 1 -- 172.21.15.7:0/40449480 shutdown_connections 2024-09-19T08:50:24.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.572+0000 7f4ddfef4740 1 --2- 172.21.15.7:0/40449480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8cfbce370 0x55c8cfbc6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.572+0000 7f4ddfef4740 1 --2- 172.21.15.7:0/40449480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbc6120 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.572+0000 7f4ddfef4740 1 --2- 172.21.15.7:0/40449480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8cfbc35d0 0x55c8cfbca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.572+0000 7f4ddfef4740 1 -- 172.21.15.7:0/40449480 >> 172.21.15.7:0/40449480 conn(0x55c8cfb8c310 msgr2=0x55c8cfbc9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.572+0000 7f4ddfef4740 1 -- 172.21.15.7:0/40449480 shutdown_connections 2024-09-19T08:50:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.572+0000 7f4ddfef4740 1 -- 172.21.15.7:0/40449480 wait complete. 2024-09-19T08:50:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.572+0000 7f4ddfef4740 1 -- start start 2024-09-19T08:50:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.572+0000 7f4ddfef4740 1 Processor -- start 2024-09-19T08:50:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.573+0000 7f4ddfef4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8cfbc35d0 0x55c8cfbd6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.573+0000 7f4ddfef4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbd6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.573+0000 7f4ddfef4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8cfbce370 0x55c8cfbd1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.573+0000 7f4ddfef4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd81adfe0 con 0x55c8cfbc4b40 2024-09-19T08:50:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.573+0000 7f4ddfef4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd81af450 con 0x55c8cfbc35d0 2024-09-19T08:50:24.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.573+0000 7f4ddfef4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd81ae6b0 con 0x55c8cfbce370 2024-09-19T08:50:24.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.573+0000 7f4ddfef4740 10 client.0 _ll_register_callbacks cb 0x7f4dc000d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:24.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.573+0000 7f4dd6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbd6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:24.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.573+0000 7f4dd6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbd6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38444/0 (socket says 172.21.15.7:38444) 2024-09-19T08:50:24.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.573+0000 7f4dd6ffd640 1 -- 172.21.15.7:0/1267004499 learned_addr learned my addr 172.21.15.7:0/1267004499 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:24.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.573+0000 7f4dd77fe640 1 --2- 172.21.15.7:0/1267004499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8cfbc35d0 0x55c8cfbd6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:24.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.573+0000 7f4dd7fff640 1 --2- 172.21.15.7:0/1267004499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8cfbce370 0x55c8cfbd1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:24.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.573+0000 7f4dd6ffd640 1 -- 172.21.15.7:0/1267004499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8cfbce370 msgr2=0x55c8cfbd1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:24.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.573+0000 7f4dd6ffd640 1 --2- 172.21.15.7:0/1267004499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8cfbce370 0x55c8cfbd1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.573+0000 7f4dd6ffd640 1 -- 172.21.15.7:0/1267004499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8cfbc35d0 msgr2=0x55c8cfbd6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:24.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.573+0000 7f4dd6ffd640 1 --2- 172.21.15.7:0/1267004499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8cfbc35d0 0x55c8cfbd6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.573+0000 7f4dd6ffd640 1 -- 172.21.15.7:0/1267004499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8cfbd2240 con 0x55c8cfbc4b40 2024-09-19T08:50:24.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.573+0000 7f4dd6ffd640 1 --2- 172.21.15.7:0/1267004499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbd6b90 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0098450 tx=0x7f4dc0098240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f224c95cd1ba96b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:24.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.573+0000 7f4db6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:50:24.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.573+0000 7f4db6ffd640 1 -- 172.21.15.7:0/1267004499 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0020040 con 0x55c8cfbc4b40 2024-09-19T08:50:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.574+0000 7f4db6ffd640 1 -- 172.21.15.7:0/1267004499 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f4dc00ba2b0 con 0x55c8cfbc4b40 2024-09-19T08:50:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.574+0000 7f4ddfef4740 1 -- 172.21.15.7:0/1267004499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4dc009ba80 con 0x55c8cfbc4b40 2024-09-19T08:50:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.574+0000 7f4db6ffd640 1 -- 172.21.15.7:0/1267004499 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4dc009fe30 con 0x55c8cfbc4b40 2024-09-19T08:50:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.574+0000 7f4ddfef4740 10 client.16446 fetch_fsmap learned FSMap version 25 2024-09-19T08:50:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.574+0000 7f4ddfef4740 1 -- 172.21.15.7:0/1267004499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c8cfc48880 con 0x55c8cfbc4b40 2024-09-19T08:50:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.574+0000 7f4db6ffd640 1 -- 172.21.15.7:0/1267004499 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dc009ba80 con 0x55c8cfbc4b40 2024-09-19T08:50:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.574+0000 7f4db6ffd640 1 -- 172.21.15.7:0/1267004499 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4dc0066020 con 0x55c8cfbc4b40 2024-09-19T08:50:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.574+0000 7f4ddfef4740 10 client.16446 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:50:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.574+0000 7f4ddfef4740 10 client.16446 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:50:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.574+0000 7f4ddfef4740 20 client.16446 populate_metadata read hostname 'smithi007' 2024-09-19T08:50:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.574+0000 7f4ddfef4740 1 --2- 172.21.15.7:0/1267004499 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55c8cfc48cb0 0x55c8cfc4b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.574+0000 7f4ddfef4740 4 client.16446 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:50:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.574+0000 7f4ddfef4740 1 -- 172.21.15.7:0/1267004499 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c8cfb30d70 con 0x55c8cfc48cb0 2024-09-19T08:50:24.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.575+0000 7f4dd77fe640 1 --2- 172.21.15.7:0/1267004499 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55c8cfc48cb0 0x55c8cfc4b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:24.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.575+0000 7f4dd77fe640 1 --2- 172.21.15.7:0/1267004499 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55c8cfc48cb0 0x55c8cfc4b0a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=67d6ef8900b60b5c server_cookie=abbe6a62157da3af in_seq=0 out_seq=0 2024-09-19T08:50:24.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.575+0000 7f4db6ffd640 10 client.16446 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:50:24.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.575+0000 7f4db6ffd640 1 -- 172.21.15.7:0/1267004499 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c8cfb30d70 con 0x55c8cfc48cb0 2024-09-19T08:50:24.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.575+0000 7f4db6ffd640 10 client.16446 handle_command_reply: tid=0 2024-09-19T08:50:24.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.575+0000 7f4ddfef4740 1 client.16446 shutdown 2024-09-19T08:50:24.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.575+0000 7f4ddfef4740 1 -- 172.21.15.7:0/1267004499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 msgr2=0x55c8cfbd6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:24.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.575+0000 7f4ddfef4740 1 --2- 172.21.15.7:0/1267004499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbd6b90 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0098450 tx=0x7f4dc0098240 comp rx=0 tx=0).stop 2024-09-19T08:50:24.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.575+0000 7f4ddfef4740 1 -- 172.21.15.7:0/1267004499 shutdown_connections 2024-09-19T08:50:24.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.575+0000 7f4ddfef4740 1 --2- 172.21.15.7:0/1267004499 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55c8cfc48cb0 0x55c8cfc4b0a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.575+0000 7f4ddfef4740 1 --2- 172.21.15.7:0/1267004499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c8cfbce370 0x55c8cfbd1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.575+0000 7f4ddfef4740 1 --2- 172.21.15.7:0/1267004499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c8cfbc4b40 0x55c8cfbd6b90 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.575+0000 7f4db6ffd640 0 client.16446 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:50:24.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.575+0000 7f4ddfef4740 1 --2- 172.21.15.7:0/1267004499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8cfbc35d0 0x55c8cfbd6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.575+0000 7f4ddfef4740 1 -- 172.21.15.7:0/1267004499 >> 172.21.15.7:0/1267004499 conn(0x55c8cfb8c310 msgr2=0x55c8cfbca170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:24.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.575+0000 7f4ddfef4740 1 -- 172.21.15.7:0/1267004499 shutdown_connections 2024-09-19T08:50:24.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.576+0000 7f4ddfef4740 1 -- 172.21.15.7:0/1267004499 wait complete. 2024-09-19T08:50:24.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.576+0000 7f4ddfef4740 20 client.16446 trim_cache size 0 max 16384 2024-09-19T08:50:24.581 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:50:24.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.576+0000 7f4dddb1b640 1 -- 172.21.15.7:0/1945112367 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4dc40a33b0 msgr2=0x7f4dc40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:24.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.576+0000 7f4dddb1b640 1 --2- 172.21.15.7:0/1945112367 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4dc40a33b0 0x7f4dc40a5870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4dc804c000 tx=0x7f4dc804d000 comp rx=0 tx=0).stop 2024-09-19T08:50:24.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.576+0000 7f4dddb1b640 1 -- 172.21.15.7:0/1945112367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dd8102570 msgr2=0x7f4dd80fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:24.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.576+0000 7f4dddb1b640 1 --2- 172.21.15.7:0/1945112367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dd8102570 0x7f4dd80fd1c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000d770 tx=0x7f4dc000dc30 comp rx=0 tx=0).stop 2024-09-19T08:50:24.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.576+0000 7f4dddb1b640 1 -- 172.21.15.7:0/1945112367 shutdown_connections 2024-09-19T08:50:24.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.576+0000 7f4dddb1b640 1 --2- 172.21.15.7:0/1945112367 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4dc40a33b0 0x7f4dc40a5870 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.576+0000 7f4dddb1b640 1 --2- 172.21.15.7:0/1945112367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dd8102ef0 0x7f4dd80fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.576+0000 7f4dddb1b640 1 --2- 172.21.15.7:0/1945112367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dd8102570 0x7f4dd80fd1c0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.576+0000 7f4dddb1b640 1 --2- 172.21.15.7:0/1945112367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dd8100e20 0x7f4dd80fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:24.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.576+0000 7f4dddb1b640 1 -- 172.21.15.7:0/1945112367 >> 172.21.15.7:0/1945112367 conn(0x7f4dd80fc7d0 msgr2=0x7f4dd806a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:24.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.576+0000 7f4dddb1b640 1 -- 172.21.15.7:0/1945112367 shutdown_connections 2024-09-19T08:50:24.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:24.576+0000 7f4dddb1b640 1 -- 172.21.15.7:0/1945112367 wait complete. 2024-09-19T08:50:25.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:24 smithi175 ceph-mon[35688]: pgmap v179: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T08:50:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:24 smithi007 ceph-mon[31221]: pgmap v179: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T08:50:25.263 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:50:25.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:24 smithi044 ceph-mon[35072]: pgmap v179: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T08:50:25.517 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:25.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.972+0000 7f11bf902640 1 -- 172.21.15.7:0/2543997188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11b810c170 msgr2=0x7f11b810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:25.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.972+0000 7f11bf902640 1 --2- 172.21.15.7:0/2543997188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11b810c170 0x7f11b810e610 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009ca0 tx=0x7f11b002a950 comp rx=0 tx=0).stop 2024-09-19T08:50:25.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.972+0000 7f11bf902640 1 -- 172.21.15.7:0/2543997188 shutdown_connections 2024-09-19T08:50:25.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.972+0000 7f11bf902640 1 --2- 172.21.15.7:0/2543997188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11b810c170 0x7f11b810e610 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.972+0000 7f11bf902640 1 --2- 172.21.15.7:0/2543997188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11b8103660 0x7f11b810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.972+0000 7f11bf902640 1 --2- 172.21.15.7:0/2543997188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11b8102d40 0x7f11b8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.972+0000 7f11bf902640 1 -- 172.21.15.7:0/2543997188 >> 172.21.15.7:0/2543997188 conn(0x7f11b80fc7a0 msgr2=0x7f11b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:25.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.972+0000 7f11bf902640 1 -- 172.21.15.7:0/2543997188 shutdown_connections 2024-09-19T08:50:25.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.972+0000 7f11bf902640 1 -- 172.21.15.7:0/2543997188 wait complete. 2024-09-19T08:50:25.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.973+0000 7f11bf902640 1 Processor -- start 2024-09-19T08:50:25.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.973+0000 7f11bf902640 1 -- start start 2024-09-19T08:50:25.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.973+0000 7f11bf902640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11b8102d40 0x7f11b8198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:25.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.973+0000 7f11bf902640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11b8103660 0x7f11b8198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:25.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.973+0000 7f11bf902640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11b810c170 0x7f11b819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:25.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.973+0000 7f11bf902640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f11b8111f70 con 0x7f11b810c170 2024-09-19T08:50:25.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.973+0000 7f11bf902640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f11b8111df0 con 0x7f11b8102d40 2024-09-19T08:50:25.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.973+0000 7f11bf902640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f11b81120f0 con 0x7f11b8103660 2024-09-19T08:50:25.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.974+0000 7f11bde9f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11b810c170 0x7f11b819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:25.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.974+0000 7f11bde9f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11b810c170 0x7f11b819cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38466/0 (socket says 172.21.15.7:38466) 2024-09-19T08:50:25.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.974+0000 7f11bde9f640 1 -- 172.21.15.7:0/1364044144 learned_addr learned my addr 172.21.15.7:0/1364044144 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:25.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.974+0000 7f11bce9d640 1 --2- 172.21.15.7:0/1364044144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11b8103660 0x7f11b8198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:25.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.974+0000 7f11bd69e640 1 --2- 172.21.15.7:0/1364044144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11b8102d40 0x7f11b8198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:25.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.974+0000 7f11bde9f640 1 -- 172.21.15.7:0/1364044144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11b8103660 msgr2=0x7f11b8198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:25.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.974+0000 7f11bde9f640 1 --2- 172.21.15.7:0/1364044144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11b8103660 0x7f11b8198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.974+0000 7f11bde9f640 1 -- 172.21.15.7:0/1364044144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11b8102d40 msgr2=0x7f11b8198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:25.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.974+0000 7f11bde9f640 1 --2- 172.21.15.7:0/1364044144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11b8102d40 0x7f11b8198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.974+0000 7f11bde9f640 1 -- 172.21.15.7:0/1364044144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b819d3c0 con 0x7f11b810c170 2024-09-19T08:50:25.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.974+0000 7f11bd69e640 1 --2- 172.21.15.7:0/1364044144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11b8102d40 0x7f11b8198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:25.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.974+0000 7f11bde9f640 1 --2- 172.21.15.7:0/1364044144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11b810c170 0x7f11b819cce0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f11b002ae70 tx=0x7f11b002f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:25.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.974+0000 7f11ae7fc640 1 -- 172.21.15.7:0/1364044144 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b0034040 con 0x7f11b810c170 2024-09-19T08:50:25.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.974+0000 7f11ae7fc640 1 -- 172.21.15.7:0/1364044144 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11b0030920 con 0x7f11b810c170 2024-09-19T08:50:25.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.974+0000 7f11ae7fc640 1 -- 172.21.15.7:0/1364044144 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b0045480 con 0x7f11b810c170 2024-09-19T08:50:25.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.974+0000 7f11bf902640 1 -- 172.21.15.7:0/1364044144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b819d650 con 0x7f11b810c170 2024-09-19T08:50:25.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.974+0000 7f11bf902640 1 -- 172.21.15.7:0/1364044144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11b81a4f90 con 0x7f11b810c170 2024-09-19T08:50:25.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.977+0000 7f11ae7fc640 1 -- 172.21.15.7:0/1364044144 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f11b0037020 con 0x7f11b810c170 2024-09-19T08:50:25.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.977+0000 7f11c1cdb740 1 Processor -- start 2024-09-19T08:50:25.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.977+0000 7f11c1cdb740 1 -- start start 2024-09-19T08:50:25.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.977+0000 7f11c1cdb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a44b40 0x55d8c4a43090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:25.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.977+0000 7f11c1cdb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8c4a435d0 0x55d8c4a43a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:25.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.977+0000 7f11c1cdb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8c4a52780 0x55d8c4a54b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.977+0000 7f11c1cdb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d8c49a92f0 con 0x55d8c4a44b40 2024-09-19T08:50:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.977+0000 7f11c1cdb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d8c4950cf0 con 0x55d8c4a435d0 2024-09-19T08:50:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.977+0000 7f11c1cdb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d8c49a52b0 con 0x55d8c4a52780 2024-09-19T08:50:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.978+0000 7f11ae7fc640 1 --2- 172.21.15.7:0/1364044144 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f11a40a3430 0x7f11a40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.978+0000 7f11bce9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a44b40 0x55d8c4a43090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.978+0000 7f11bce9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a44b40 0x55d8c4a43090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38478/0 (socket says 172.21.15.7:38478) 2024-09-19T08:50:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.978+0000 7f11bce9d640 1 -- 172.21.15.7:0/1429207292 learned_addr learned my addr 172.21.15.7:0/1429207292 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.978+0000 7f11bd69e640 1 --2- 172.21.15.7:0/1429207292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8c4a435d0 0x55d8c4a43a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.978+0000 7f11bde9f640 1 --2- 172.21.15.7:0/1364044144 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f11a40a3430 0x7f11a40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.978+0000 7f11bce9d640 1 --2- 172.21.15.7:0/1429207292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8c4a52780 0x55d8c4a54b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.978+0000 7f11bce9d640 1 -- 172.21.15.7:0/1429207292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8c4a52780 msgr2=0x55d8c4a54b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.978+0000 7f11bce9d640 1 --2- 172.21.15.7:0/1429207292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8c4a52780 0x55d8c4a54b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.978+0000 7f11bce9d640 1 -- 172.21.15.7:0/1429207292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8c4a435d0 msgr2=0x55d8c4a43a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.978+0000 7f11bce9d640 1 --2- 172.21.15.7:0/1429207292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8c4a435d0 0x55d8c4a43a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.978+0000 7f11ae7fc640 1 -- 172.21.15.7:0/1364044144 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f11b00f0b80 con 0x7f11b810c170 2024-09-19T08:50:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.978+0000 7f11bce9d640 1 -- 172.21.15.7:0/1429207292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8c49353a0 con 0x55d8c4a44b40 2024-09-19T08:50:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.978+0000 7f11bce9d640 1 --2- 172.21.15.7:0/1429207292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a44b40 0x55d8c4a43090 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f11a800bdd0 tx=0x7f11a800b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a7ae5d48b239055 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.978+0000 7f11bde9f640 1 --2- 172.21.15.7:0/1364044144 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f11a40a3430 0x7f11a40a58f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f11b00c5640 tx=0x7f11b00e7cd0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.978+0000 7f11a37fe640 1 -- 172.21.15.7:0/1429207292 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a80120d0 con 0x55d8c4a44b40 2024-09-19T08:50:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.979+0000 7f11a37fe640 1 -- 172.21.15.7:0/1429207292 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11a80047a0 con 0x55d8c4a44b40 2024-09-19T08:50:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.979+0000 7f11a37fe640 1 -- 172.21.15.7:0/1429207292 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8005240 con 0x55d8c4a44b40 2024-09-19T08:50:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.979+0000 7f11c1cdb740 1 -- 172.21.15.7:0/1429207292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a44b40 msgr2=0x55d8c4a43090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.979+0000 7f11c1cdb740 1 --2- 172.21.15.7:0/1429207292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a44b40 0x55d8c4a43090 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f11a800bdd0 tx=0x7f11a800b7d0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.979+0000 7f11c1cdb740 1 -- 172.21.15.7:0/1429207292 shutdown_connections 2024-09-19T08:50:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.979+0000 7f11c1cdb740 1 --2- 172.21.15.7:0/1429207292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8c4a52780 0x55d8c4a54b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.979+0000 7f11c1cdb740 1 --2- 172.21.15.7:0/1429207292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8c4a435d0 0x55d8c4a43a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.979+0000 7f11c1cdb740 1 --2- 172.21.15.7:0/1429207292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a44b40 0x55d8c4a43090 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.979+0000 7f11c1cdb740 1 -- 172.21.15.7:0/1429207292 >> 172.21.15.7:0/1429207292 conn(0x55d8c4a0c310 msgr2=0x55d8c4a3fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:25.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.979+0000 7f11c1cdb740 1 -- 172.21.15.7:0/1429207292 shutdown_connections 2024-09-19T08:50:25.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.979+0000 7f11c1cdb740 1 -- 172.21.15.7:0/1429207292 wait complete. 2024-09-19T08:50:25.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.980+0000 7f11c1cdb740 1 -- start start 2024-09-19T08:50:25.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.980+0000 7f11c1cdb740 1 Processor -- start 2024-09-19T08:50:25.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.980+0000 7f11c1cdb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8c4a435d0 0x55d8c4a520f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:25.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.980+0000 7f11c1cdb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8c4a44b40 0x55d8c4a4f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:25.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.980+0000 7f11c1cdb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a52780 0x55d8c4a4f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:25.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.980+0000 7f11c1cdb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d8c4a55420 con 0x55d8c4a52780 2024-09-19T08:50:25.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.980+0000 7f11c1cdb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d8c4964060 con 0x55d8c4a435d0 2024-09-19T08:50:25.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.980+0000 7f11c1cdb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d8c4a555a0 con 0x55d8c4a44b40 2024-09-19T08:50:25.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.980+0000 7f11c1cdb740 10 client.0 _ll_register_callbacks cb 0x55d8c46b78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:25.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.980+0000 7f11bce9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a52780 0x55d8c4a4f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:25.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.980+0000 7f11bce9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a52780 0x55d8c4a4f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38494/0 (socket says 172.21.15.7:38494) 2024-09-19T08:50:25.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.980+0000 7f11bce9d640 1 -- 172.21.15.7:0/189697914 learned_addr learned my addr 172.21.15.7:0/189697914 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:25.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.981+0000 7f11bd69e640 1 --2- 172.21.15.7:0/189697914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8c4a44b40 0x55d8c4a4f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:25.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.981+0000 7f11bce9d640 1 --2- 172.21.15.7:0/189697914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8c4a435d0 0x55d8c4a520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:25.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.981+0000 7f11bce9d640 1 -- 172.21.15.7:0/189697914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8c4a44b40 msgr2=0x55d8c4a4f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:25.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.981+0000 7f11bce9d640 1 --2- 172.21.15.7:0/189697914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8c4a44b40 0x55d8c4a4f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.981+0000 7f11bce9d640 1 -- 172.21.15.7:0/189697914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8c4a435d0 msgr2=0x55d8c4a520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:25.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.981+0000 7f11bce9d640 1 --2- 172.21.15.7:0/189697914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8c4a435d0 0x55d8c4a520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.981+0000 7f11bce9d640 1 -- 172.21.15.7:0/189697914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8c471a3c0 con 0x55d8c4a52780 2024-09-19T08:50:25.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.981+0000 7f11bce9d640 1 --2- 172.21.15.7:0/189697914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a52780 0x55d8c4a4f900 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f11a800b3c0 tx=0x7f11a800b580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d518ead7596c8d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:25.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.981+0000 7f11a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:50:25.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.981+0000 7f11a0ff9640 1 -- 172.21.15.7:0/189697914 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a801f020 con 0x55d8c4a52780 2024-09-19T08:50:25.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.981+0000 7f11c1cdb740 1 -- 172.21.15.7:0/189697914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11a80047a0 con 0x55d8c4a52780 2024-09-19T08:50:25.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.981+0000 7f11a0ff9640 1 -- 172.21.15.7:0/189697914 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f11a8005210 con 0x55d8c4a52780 2024-09-19T08:50:25.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.981+0000 7f11a0ff9640 1 -- 172.21.15.7:0/189697914 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f11a8030050 con 0x55d8c4a52780 2024-09-19T08:50:25.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.981+0000 7f11c1cdb740 10 client.16458 fetch_fsmap learned FSMap version 25 2024-09-19T08:50:25.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.981+0000 7f11c1cdb740 1 -- 172.21.15.7:0/189697914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d8c4a60e80 con 0x55d8c4a52780 2024-09-19T08:50:25.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.982+0000 7f11a0ff9640 1 -- 172.21.15.7:0/189697914 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11a80047a0 con 0x55d8c4a52780 2024-09-19T08:50:25.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.982+0000 7f11a0ff9640 1 -- 172.21.15.7:0/189697914 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f11a8010bc0 con 0x55d8c4a52780 2024-09-19T08:50:25.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.982+0000 7f11c1cdb740 10 client.16458 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:50:25.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.982+0000 7f11c1cdb740 10 client.16458 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:50:25.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.982+0000 7f11c1cdb740 20 client.16458 populate_metadata read hostname 'smithi007' 2024-09-19T08:50:25.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.982+0000 7f11c1cdb740 1 --2- 172.21.15.7:0/189697914 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d8c4a62290 0x55d8c4a64680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:25.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.982+0000 7f11c1cdb740 4 client.16458 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:50:25.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.982+0000 7f11c1cdb740 1 -- 172.21.15.7:0/189697914 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8c49b6860 con 0x55d8c4a62290 2024-09-19T08:50:25.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.982+0000 7f11bd69e640 1 --2- 172.21.15.7:0/189697914 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d8c4a62290 0x55d8c4a64680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:25.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.983+0000 7f11a0ff9640 10 client.16458 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:25.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.983+0000 7f11bd69e640 1 --2- 172.21.15.7:0/189697914 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d8c4a62290 0x55d8c4a64680 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f2d6dc9e2535ea server_cookie=499219de8779a7e1 in_seq=0 out_seq=0 2024-09-19T08:50:25.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.983+0000 7f11a0ff9640 1 -- 172.21.15.7:0/189697914 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d8c49b6860 con 0x55d8c4a62290 2024-09-19T08:50:25.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.983+0000 7f11a0ff9640 10 client.16458 handle_command_reply: tid=0 2024-09-19T08:50:25.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.983+0000 7f11c1cdb740 1 client.16458 shutdown 2024-09-19T08:50:25.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.983+0000 7f11c1cdb740 1 -- 172.21.15.7:0/189697914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a52780 msgr2=0x55d8c4a4f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:25.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.983+0000 7f11c1cdb740 1 --2- 172.21.15.7:0/189697914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a52780 0x55d8c4a4f900 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f11a800b3c0 tx=0x7f11a800b580 comp rx=0 tx=0).stop 2024-09-19T08:50:25.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.983+0000 7f11c1cdb740 1 -- 172.21.15.7:0/189697914 shutdown_connections 2024-09-19T08:50:25.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.983+0000 7f11c1cdb740 1 --2- 172.21.15.7:0/189697914 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d8c4a62290 0x55d8c4a64680 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.983+0000 7f11c1cdb740 1 --2- 172.21.15.7:0/189697914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a52780 0x55d8c4a4f900 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.983+0000 7f11c1cdb740 1 --2- 172.21.15.7:0/189697914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8c4a44b40 0x55d8c4a4f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.983+0000 7f11a0ff9640 0 client.16458 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:25.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.983+0000 7f11c1cdb740 1 --2- 172.21.15.7:0/189697914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8c4a435d0 0x55d8c4a520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.983+0000 7f11c1cdb740 1 -- 172.21.15.7:0/189697914 >> 172.21.15.7:0/189697914 conn(0x55d8c4a0c310 msgr2=0x55d8c4a45930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:25.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.984+0000 7f11c1cdb740 1 -- 172.21.15.7:0/189697914 shutdown_connections 2024-09-19T08:50:25.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.984+0000 7f11c1cdb740 1 -- 172.21.15.7:0/189697914 wait complete. 2024-09-19T08:50:25.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.984+0000 7f11c1cdb740 20 client.16458 trim_cache size 0 max 16384 2024-09-19T08:50:26.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.997+0000 7f11c1cdb740 1 Processor -- start 2024-09-19T08:50:26.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.997+0000 7f11c1cdb740 1 -- start start 2024-09-19T08:50:26.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.997+0000 7f11c1cdb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8c4a435d0 0x55d8c4a5e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:26.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.997+0000 7f11c1cdb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a44b40 0x55d8c4a69e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:26.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.997+0000 7f11c1cdb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8c4a52780 0x55d8c4a6a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:26.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.997+0000 7f11c1cdb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f11b81adf10 con 0x55d8c4a44b40 2024-09-19T08:50:26.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.997+0000 7f11c1cdb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f11b81ab7e0 con 0x55d8c4a52780 2024-09-19T08:50:26.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.997+0000 7f11c1cdb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f11b81a9630 con 0x55d8c4a435d0 2024-09-19T08:50:26.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.997+0000 7f11bd69e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a44b40 0x55d8c4a69e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.997+0000 7f11bd69e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a44b40 0x55d8c4a69e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38496/0 (socket says 172.21.15.7:38496) 2024-09-19T08:50:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.997+0000 7f11bd69e640 1 -- 172.21.15.7:0/201038567 learned_addr learned my addr 172.21.15.7:0/201038567 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.998+0000 7f11bce9d640 1 --2- 172.21.15.7:0/201038567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8c4a52780 0x55d8c4a6a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.998+0000 7f11bd69e640 1 -- 172.21.15.7:0/201038567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8c4a435d0 msgr2=0x55d8c4a5e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.998+0000 7f11bd69e640 1 --2- 172.21.15.7:0/201038567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8c4a435d0 0x55d8c4a5e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.998+0000 7f11bd69e640 1 -- 172.21.15.7:0/201038567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8c4a52780 msgr2=0x55d8c4a6a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.998+0000 7f11bd69e640 1 --2- 172.21.15.7:0/201038567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8c4a52780 0x55d8c4a6a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.998+0000 7f11bd69e640 1 -- 172.21.15.7:0/201038567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8c4a3e310 con 0x55d8c4a44b40 2024-09-19T08:50:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.998+0000 7f11bd69e640 1 --2- 172.21.15.7:0/201038567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a44b40 0x55d8c4a69e40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x55d8c4a4ec30 tx=0x7f11b40108c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a30634e74cf955c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.998+0000 7f11a2ffd640 1 -- 172.21.15.7:0/201038567 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b4004220 con 0x55d8c4a44b40 2024-09-19T08:50:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.998+0000 7f11a2ffd640 1 -- 172.21.15.7:0/201038567 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11b40043c0 con 0x55d8c4a44b40 2024-09-19T08:50:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.998+0000 7f11a2ffd640 1 -- 172.21.15.7:0/201038567 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b4004e50 con 0x55d8c4a44b40 2024-09-19T08:50:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.999+0000 7f11c1cdb740 1 -- 172.21.15.7:0/201038567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a44b40 msgr2=0x55d8c4a69e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.999+0000 7f11c1cdb740 1 --2- 172.21.15.7:0/201038567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a44b40 0x55d8c4a69e40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x55d8c4a4ec30 tx=0x7f11b40108c0 comp rx=0 tx=0).stop 2024-09-19T08:50:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.999+0000 7f11c1cdb740 1 -- 172.21.15.7:0/201038567 shutdown_connections 2024-09-19T08:50:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.999+0000 7f11c1cdb740 1 --2- 172.21.15.7:0/201038567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8c4a52780 0x55d8c4a6a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.999+0000 7f11c1cdb740 1 --2- 172.21.15.7:0/201038567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a44b40 0x55d8c4a69e40 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.999+0000 7f11c1cdb740 1 --2- 172.21.15.7:0/201038567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8c4a435d0 0x55d8c4a5e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.999+0000 7f11c1cdb740 1 -- 172.21.15.7:0/201038567 >> 172.21.15.7:0/201038567 conn(0x55d8c4a0c310 msgr2=0x55d8c4a4e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.999+0000 7f11c1cdb740 1 -- 172.21.15.7:0/201038567 shutdown_connections 2024-09-19T08:50:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.999+0000 7f11c1cdb740 1 -- 172.21.15.7:0/201038567 wait complete. 2024-09-19T08:50:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.999+0000 7f11c1cdb740 1 -- start start 2024-09-19T08:50:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:25.999+0000 7f11c1cdb740 1 Processor -- start 2024-09-19T08:50:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.000+0000 7f11c1cdb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8c4a435d0 0x55d8c4a4c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.000+0000 7f11c1cdb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a44b40 0x55d8c4a4c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.000+0000 7f11c1cdb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8c4a52780 0x55d8c4a4cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.000+0000 7f11c1cdb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f11b81a9ca0 con 0x55d8c4a44b40 2024-09-19T08:50:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.000+0000 7f11c1cdb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f11b81ab110 con 0x55d8c4a52780 2024-09-19T08:50:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.000+0000 7f11c1cdb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f11b81aa370 con 0x55d8c4a435d0 2024-09-19T08:50:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.000+0000 7f11c1cdb740 10 client.0 _ll_register_callbacks cb 0x7f11b400c390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.000+0000 7f11bd69e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a44b40 0x55d8c4a4c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.000+0000 7f11bd69e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a44b40 0x55d8c4a4c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38498/0 (socket says 172.21.15.7:38498) 2024-09-19T08:50:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.000+0000 7f11bd69e640 1 -- 172.21.15.7:0/3464295419 learned_addr learned my addr 172.21.15.7:0/3464295419 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.000+0000 7f11bce9d640 1 --2- 172.21.15.7:0/3464295419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8c4a435d0 0x55d8c4a4c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.000+0000 7f11bce9d640 1 --2- 172.21.15.7:0/3464295419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8c4a52780 0x55d8c4a4cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.000+0000 7f11bd69e640 1 -- 172.21.15.7:0/3464295419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8c4a435d0 msgr2=0x55d8c4a4c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.000+0000 7f11bd69e640 1 --2- 172.21.15.7:0/3464295419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8c4a435d0 0x55d8c4a4c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.000+0000 7f11bd69e640 1 -- 172.21.15.7:0/3464295419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8c4a52780 msgr2=0x55d8c4a4cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.000+0000 7f11bd69e640 1 --2- 172.21.15.7:0/3464295419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8c4a52780 0x55d8c4a4cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.000+0000 7f11bd69e640 1 -- 172.21.15.7:0/3464295419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8c4acbe10 con 0x55d8c4a44b40 2024-09-19T08:50:26.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.000+0000 7f11bce9d640 1 --2- 172.21.15.7:0/3464295419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8c4a52780 0x55d8c4a4cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:26.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.000+0000 7f11bd69e640 1 --2- 172.21.15.7:0/3464295419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a44b40 0x55d8c4a4c7f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f11b400c720 tx=0x7f11b4004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3186d6c550e1dbb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:26.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.000+0000 7f11a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:50:26.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.000+0000 7f11a0ff9640 1 -- 172.21.15.7:0/3464295419 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b4003ac0 con 0x55d8c4a44b40 2024-09-19T08:50:26.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.001+0000 7f11a0ff9640 1 -- 172.21.15.7:0/3464295419 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f11b4003c60 con 0x55d8c4a44b40 2024-09-19T08:50:26.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.001+0000 7f11c1cdb740 1 -- 172.21.15.7:0/3464295419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11b40043c0 con 0x55d8c4a44b40 2024-09-19T08:50:26.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.001+0000 7f11a0ff9640 1 -- 172.21.15.7:0/3464295419 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f11b4003e60 con 0x55d8c4a44b40 2024-09-19T08:50:26.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.001+0000 7f11c1cdb740 10 client.16464 fetch_fsmap learned FSMap version 25 2024-09-19T08:50:26.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.001+0000 7f11c1cdb740 1 -- 172.21.15.7:0/3464295419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d8c4acd020 con 0x55d8c4a44b40 2024-09-19T08:50:26.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.001+0000 7f11a0ff9640 1 -- 172.21.15.7:0/3464295419 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11b40043c0 con 0x55d8c4a44b40 2024-09-19T08:50:26.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.001+0000 7f11a0ff9640 1 -- 172.21.15.7:0/3464295419 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f11b402e900 con 0x55d8c4a44b40 2024-09-19T08:50:26.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.001+0000 7f11c1cdb740 10 client.16464 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:50:26.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.001+0000 7f11c1cdb740 10 client.16464 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:50:26.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.001+0000 7f11c1cdb740 20 client.16464 populate_metadata read hostname 'smithi007' 2024-09-19T08:50:26.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.001+0000 7f11c1cdb740 1 --2- 172.21.15.7:0/3464295419 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d8c4acd770 0x55d8c4acfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:26.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.001+0000 7f11c1cdb740 4 client.16464 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:50:26.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.001+0000 7f11c1cdb740 1 -- 172.21.15.7:0/3464295419 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d8c49b0d70 con 0x55d8c4acd770 2024-09-19T08:50:26.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.002+0000 7f11bce9d640 1 --2- 172.21.15.7:0/3464295419 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d8c4acd770 0x55d8c4acfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:26.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.002+0000 7f11bce9d640 1 --2- 172.21.15.7:0/3464295419 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d8c4acd770 0x55d8c4acfb90 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fa8b82e7d077841 server_cookie=6d4d6aec36196494 in_seq=0 out_seq=0 2024-09-19T08:50:26.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.002+0000 7f11a0ff9640 10 client.16464 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:26.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.002+0000 7f11a0ff9640 1 -- 172.21.15.7:0/3464295419 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d8c49b0d70 con 0x55d8c4acd770 2024-09-19T08:50:26.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.002+0000 7f11a0ff9640 10 client.16464 handle_command_reply: tid=0 2024-09-19T08:50:26.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.002+0000 7f11c1cdb740 1 client.16464 shutdown 2024-09-19T08:50:26.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.002+0000 7f11c1cdb740 1 -- 172.21.15.7:0/3464295419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a44b40 msgr2=0x55d8c4a4c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:26.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.002+0000 7f11c1cdb740 1 --2- 172.21.15.7:0/3464295419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a44b40 0x55d8c4a4c7f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f11b400c720 tx=0x7f11b4004250 comp rx=0 tx=0).stop 2024-09-19T08:50:26.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.002+0000 7f11c1cdb740 1 -- 172.21.15.7:0/3464295419 shutdown_connections 2024-09-19T08:50:26.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.002+0000 7f11c1cdb740 1 --2- 172.21.15.7:0/3464295419 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d8c4acd770 0x55d8c4acfb90 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:26.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.002+0000 7f11c1cdb740 1 --2- 172.21.15.7:0/3464295419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8c4a52780 0x55d8c4a4cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:26.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.002+0000 7f11c1cdb740 1 --2- 172.21.15.7:0/3464295419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d8c4a44b40 0x55d8c4a4c7f0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:26.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.002+0000 7f11c1cdb740 1 --2- 172.21.15.7:0/3464295419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8c4a435d0 0x55d8c4a4c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:26.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.002+0000 7f11c1cdb740 1 -- 172.21.15.7:0/3464295419 >> 172.21.15.7:0/3464295419 conn(0x55d8c4a0c310 msgr2=0x55d8c4a3e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:26.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.002+0000 7f11a0ff9640 0 client.16464 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:26.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.002+0000 7f11c1cdb740 1 -- 172.21.15.7:0/3464295419 shutdown_connections 2024-09-19T08:50:26.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.003+0000 7f11c1cdb740 1 -- 172.21.15.7:0/3464295419 wait complete. 2024-09-19T08:50:26.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.003+0000 7f11c1cdb740 20 client.16464 trim_cache size 0 max 16384 2024-09-19T08:50:26.009 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:50:26.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.003+0000 7f11bf902640 1 -- 172.21.15.7:0/1364044144 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f11a40a3430 msgr2=0x7f11a40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:26.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.003+0000 7f11bf902640 1 --2- 172.21.15.7:0/1364044144 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f11a40a3430 0x7f11a40a58f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f11b00c5640 tx=0x7f11b00e7cd0 comp rx=0 tx=0).stop 2024-09-19T08:50:26.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.003+0000 7f11bf902640 1 -- 172.21.15.7:0/1364044144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11b810c170 msgr2=0x7f11b819cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:26.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.003+0000 7f11bf902640 1 --2- 172.21.15.7:0/1364044144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11b810c170 0x7f11b819cce0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f11b002ae70 tx=0x7f11b002f5b0 comp rx=0 tx=0).stop 2024-09-19T08:50:26.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.003+0000 7f11bf902640 1 -- 172.21.15.7:0/1364044144 shutdown_connections 2024-09-19T08:50:26.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.003+0000 7f11bf902640 1 --2- 172.21.15.7:0/1364044144 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f11a40a3430 0x7f11a40a58f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:26.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.003+0000 7f11bf902640 1 --2- 172.21.15.7:0/1364044144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11b810c170 0x7f11b819cce0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:26.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.003+0000 7f11bf902640 1 --2- 172.21.15.7:0/1364044144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11b8103660 0x7f11b8198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:26.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.003+0000 7f11bf902640 1 --2- 172.21.15.7:0/1364044144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11b8102d40 0x7f11b8198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:26.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.003+0000 7f11bf902640 1 -- 172.21.15.7:0/1364044144 >> 172.21.15.7:0/1364044144 conn(0x7f11b80fc7a0 msgr2=0x7f11b80fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:26.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.003+0000 7f11bf902640 1 -- 172.21.15.7:0/1364044144 shutdown_connections 2024-09-19T08:50:26.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:26.003+0000 7f11bf902640 1 -- 172.21.15.7:0/1364044144 wait complete. 2024-09-19T08:50:27.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:26 smithi175 ceph-mon[35688]: pgmap v180: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:50:27.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:26 smithi007 ceph-mon[31221]: pgmap v180: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:50:27.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:26 smithi044 ceph-mon[35072]: pgmap v180: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:50:27.873 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:50:27.873 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:50:28.143 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:28.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.607+0000 7f66a5b79640 1 -- 172.21.15.7:0/737560637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66a0102ef0 msgr2=0x7f66a010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:28.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.607+0000 7f66a5b79640 1 --2- 172.21.15.7:0/737560637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66a0102ef0 0x7f66a010da40 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f6698009ca0 tx=0x7f669802a950 comp rx=0 tx=0).stop 2024-09-19T08:50:28.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.607+0000 7f66a5b79640 1 -- 172.21.15.7:0/737560637 shutdown_connections 2024-09-19T08:50:28.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.607+0000 7f66a5b79640 1 --2- 172.21.15.7:0/737560637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66a0102ef0 0x7f66a010da40 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.607+0000 7f66a5b79640 1 --2- 172.21.15.7:0/737560637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66a0102570 0x7f66a01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.607+0000 7f66a5b79640 1 --2- 172.21.15.7:0/737560637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66a0100e20 0x7f66a0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.607+0000 7f66a5b79640 1 -- 172.21.15.7:0/737560637 >> 172.21.15.7:0/737560637 conn(0x7f66a00fc7d0 msgr2=0x7f66a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:28.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.607+0000 7f66a5b79640 1 -- 172.21.15.7:0/737560637 shutdown_connections 2024-09-19T08:50:28.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.607+0000 7f66a5b79640 1 -- 172.21.15.7:0/737560637 wait complete. 2024-09-19T08:50:28.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.607+0000 7f66a5b79640 1 Processor -- start 2024-09-19T08:50:28.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.608+0000 7f66a5b79640 1 -- start start 2024-09-19T08:50:28.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.608+0000 7f66a5b79640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66a0100e20 0x7f66a0197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:28.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.608+0000 7f66a5b79640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66a0102570 0x7f66a0197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:28.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.608+0000 7f66a5b79640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66a0102ef0 0x7f66a0197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:28.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.608+0000 7f66a5b79640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f66a0110fa0 con 0x7f66a0102ef0 2024-09-19T08:50:28.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.608+0000 7f66a5b79640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f66a0110e20 con 0x7f66a0100e20 2024-09-19T08:50:28.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.608+0000 7f66a5b79640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f66a0111120 con 0x7f66a0102570 2024-09-19T08:50:28.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.608+0000 7f669ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66a0102ef0 0x7f66a0197bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:28.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.608+0000 7f669ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66a0102ef0 0x7f66a0197bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38522/0 (socket says 172.21.15.7:38522) 2024-09-19T08:50:28.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.608+0000 7f669ffff640 1 -- 172.21.15.7:0/3059475110 learned_addr learned my addr 172.21.15.7:0/3059475110 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:28.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.608+0000 7f669f7fe640 1 --2- 172.21.15.7:0/3059475110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66a0100e20 0x7f66a0197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:28.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.608+0000 7f669effd640 1 --2- 172.21.15.7:0/3059475110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66a0102570 0x7f66a0197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:28.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.608+0000 7f669ffff640 1 -- 172.21.15.7:0/3059475110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66a0102570 msgr2=0x7f66a0197680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:28.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.608+0000 7f669ffff640 1 --2- 172.21.15.7:0/3059475110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66a0102570 0x7f66a0197680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.608+0000 7f669ffff640 1 -- 172.21.15.7:0/3059475110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66a0100e20 msgr2=0x7f66a0197140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:28.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.608+0000 7f669ffff640 1 --2- 172.21.15.7:0/3059475110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66a0100e20 0x7f66a0197140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.608+0000 7f669ffff640 1 -- 172.21.15.7:0/3059475110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a01a69b0 con 0x7f66a0102ef0 2024-09-19T08:50:28.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.609+0000 7f669ffff640 1 --2- 172.21.15.7:0/3059475110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66a0102ef0 0x7f66a0197bc0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f6698006010 tx=0x7f669802f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:28.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.609+0000 7f669cff9640 1 -- 172.21.15.7:0/3059475110 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6698034040 con 0x7f66a0102ef0 2024-09-19T08:50:28.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.609+0000 7f66a5b79640 1 -- 172.21.15.7:0/3059475110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a01a6c40 con 0x7f66a0102ef0 2024-09-19T08:50:28.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.609+0000 7f669cff9640 1 -- 172.21.15.7:0/3059475110 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6698003e00 con 0x7f66a0102ef0 2024-09-19T08:50:28.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.609+0000 7f669cff9640 1 -- 172.21.15.7:0/3059475110 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6698045480 con 0x7f66a0102ef0 2024-09-19T08:50:28.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.609+0000 7f66a5b79640 1 -- 172.21.15.7:0/3059475110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a01a71f0 con 0x7f66a0102ef0 2024-09-19T08:50:28.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.611+0000 7f669cff9640 1 -- 172.21.15.7:0/3059475110 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f6698037020 con 0x7f66a0102ef0 2024-09-19T08:50:28.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.612+0000 7f66a7f52740 1 Processor -- start 2024-09-19T08:50:28.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.612+0000 7f66a7f52740 1 -- start start 2024-09-19T08:50:28.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.612+0000 7f66a7f52740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cfdf72b60 0x556cfdf72f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:28.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.612+0000 7f66a7f52740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf73480 0x556cfdf7d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:28.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.612+0000 7f66a7f52740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cfdf7dd40 0x556cfdf80130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:28.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.612+0000 7f66a7f52740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556cfded8280 con 0x556cfdf73480 2024-09-19T08:50:28.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.612+0000 7f66a7f52740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556cfde7fb10 con 0x556cfdf7dd40 2024-09-19T08:50:28.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.612+0000 7f66a7f52740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556cfded4240 con 0x556cfdf72b60 2024-09-19T08:50:28.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.612+0000 7f669cff9640 1 --2- 172.21.15.7:0/3059475110 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f66880a33b0 0x7f66880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:28.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.612+0000 7f669effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cfdf7dd40 0x556cfdf80130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:28.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.612+0000 7f669effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cfdf7dd40 0x556cfdf80130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:57086/0 (socket says 172.21.15.7:57086) 2024-09-19T08:50:28.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.612+0000 7f669effd640 1 -- 172.21.15.7:0/1182177454 learned_addr learned my addr 172.21.15.7:0/1182177454 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:28.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.612+0000 7f669cff9640 1 -- 172.21.15.7:0/3059475110 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f66980f0cc0 con 0x7f66a0102ef0 2024-09-19T08:50:28.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.612+0000 7f669f7fe640 1 --2- 172.21.15.7:0/1182177454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf73480 0x556cfdf7d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:28.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.612+0000 7f669ffff640 1 --2- 172.21.15.7:0/3059475110 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f66880a33b0 0x7f66880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:28.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.612+0000 7f669effd640 1 --2- 172.21.15.7:0/1182177454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cfdf72b60 0x556cfdf72f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:28.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.612+0000 7f669effd640 1 -- 172.21.15.7:0/1182177454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cfdf72b60 msgr2=0x556cfdf72f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:28.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.612+0000 7f669effd640 1 --2- 172.21.15.7:0/1182177454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cfdf72b60 0x556cfdf72f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.612+0000 7f669effd640 1 -- 172.21.15.7:0/1182177454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf73480 msgr2=0x556cfdf7d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:28.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.612+0000 7f669effd640 1 --2- 172.21.15.7:0/1182177454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf73480 0x556cfdf7d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.612+0000 7f669effd640 1 -- 172.21.15.7:0/1182177454 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cfde8c1f0 con 0x556cfdf7dd40 2024-09-19T08:50:28.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.613+0000 7f669ffff640 1 --2- 172.21.15.7:0/3059475110 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f66880a33b0 0x7f66880a5870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6698009430 tx=0x7f669808bd30 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:28.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.613+0000 7f669effd640 1 --2- 172.21.15.7:0/1182177454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cfdf7dd40 0x556cfdf80130 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6694011730 tx=0x7f669400a6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea1d913acde0acb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:28.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.613+0000 7f6685ffb640 1 -- 172.21.15.7:0/1182177454 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6694004020 con 0x556cfdf7dd40 2024-09-19T08:50:28.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.613+0000 7f6685ffb640 1 -- 172.21.15.7:0/1182177454 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6694005500 con 0x556cfdf7dd40 2024-09-19T08:50:28.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.613+0000 7f6685ffb640 1 -- 172.21.15.7:0/1182177454 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6694004bd0 con 0x556cfdf7dd40 2024-09-19T08:50:28.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.614+0000 7f66a7f52740 1 -- 172.21.15.7:0/1182177454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cfdf7dd40 msgr2=0x556cfdf80130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:28.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.614+0000 7f66a7f52740 1 --2- 172.21.15.7:0/1182177454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cfdf7dd40 0x556cfdf80130 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6694011730 tx=0x7f669400a6a0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.614+0000 7f66a7f52740 1 -- 172.21.15.7:0/1182177454 shutdown_connections 2024-09-19T08:50:28.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.614+0000 7f66a7f52740 1 --2- 172.21.15.7:0/1182177454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cfdf7dd40 0x556cfdf80130 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.614+0000 7f66a7f52740 1 --2- 172.21.15.7:0/1182177454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf73480 0x556cfdf7d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.614+0000 7f66a7f52740 1 --2- 172.21.15.7:0/1182177454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cfdf72b60 0x556cfdf72f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.614+0000 7f66a7f52740 1 -- 172.21.15.7:0/1182177454 >> 172.21.15.7:0/1182177454 conn(0x556cfdf6f0f0 msgr2=0x556cfdf6f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:28.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.614+0000 7f66a7f52740 1 -- 172.21.15.7:0/1182177454 shutdown_connections 2024-09-19T08:50:28.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.614+0000 7f66a7f52740 1 -- 172.21.15.7:0/1182177454 wait complete. 2024-09-19T08:50:28.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.614+0000 7f66a7f52740 1 -- start start 2024-09-19T08:50:28.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.614+0000 7f66a7f52740 1 Processor -- start 2024-09-19T08:50:28.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.615+0000 7f66a7f52740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cfdf72b60 0x556cfdf7ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:28.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.615+0000 7f66a7f52740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cfdf73480 0x556cfdf7b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:28.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.615+0000 7f66a7f52740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf7dd40 0x556cfdf7b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:28.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.615+0000 7f66a7f52740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556cfdf80910 con 0x556cfdf7dd40 2024-09-19T08:50:28.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.615+0000 7f66a7f52740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556cfde92f10 con 0x556cfdf72b60 2024-09-19T08:50:28.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.615+0000 7f66a7f52740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556cfdf80a90 con 0x556cfdf73480 2024-09-19T08:50:28.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.615+0000 7f66a7f52740 10 client.0 _ll_register_callbacks cb 0x556cfde5ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:28.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.615+0000 7f669effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf7dd40 0x556cfdf7b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:28.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.615+0000 7f669effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf7dd40 0x556cfdf7b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38544/0 (socket says 172.21.15.7:38544) 2024-09-19T08:50:28.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.615+0000 7f669effd640 1 -- 172.21.15.7:0/1572251844 learned_addr learned my addr 172.21.15.7:0/1572251844 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:28.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.615+0000 7f669effd640 1 --2- 172.21.15.7:0/1572251844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cfdf72b60 0x556cfdf7ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:28.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.615+0000 7f669f7fe640 1 --2- 172.21.15.7:0/1572251844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cfdf73480 0x556cfdf7b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:28.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.615+0000 7f669effd640 1 -- 172.21.15.7:0/1572251844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cfdf73480 msgr2=0x556cfdf7b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:28.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.615+0000 7f669effd640 1 --2- 172.21.15.7:0/1572251844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cfdf73480 0x556cfdf7b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.615+0000 7f669effd640 1 -- 172.21.15.7:0/1572251844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cfdf72b60 msgr2=0x556cfdf7ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:28.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.615+0000 7f669effd640 1 --2- 172.21.15.7:0/1572251844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cfdf72b60 0x556cfdf7ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.615+0000 7f669effd640 1 -- 172.21.15.7:0/1572251844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cfdc496a0 con 0x556cfdf7dd40 2024-09-19T08:50:28.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.615+0000 7f669effd640 1 --2- 172.21.15.7:0/1572251844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf7dd40 0x556cfdf7b690 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f66940058c0 tx=0x7f6694013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2306be5c938a674 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:28.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.615+0000 7f667effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:50:28.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.615+0000 7f667effd640 1 -- 172.21.15.7:0/1572251844 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6694004990 con 0x556cfdf7dd40 2024-09-19T08:50:28.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.615+0000 7f66a7f52740 1 -- 172.21.15.7:0/1572251844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6694005500 con 0x556cfdf7dd40 2024-09-19T08:50:28.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.615+0000 7f667effd640 1 -- 172.21.15.7:0/1572251844 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f6694004b30 con 0x556cfdf7dd40 2024-09-19T08:50:28.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.616+0000 7f667effd640 1 -- 172.21.15.7:0/1572251844 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6694033050 con 0x556cfdf7dd40 2024-09-19T08:50:28.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.616+0000 7f66a7f52740 10 client.16476 fetch_fsmap learned FSMap version 25 2024-09-19T08:50:28.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.616+0000 7f66a7f52740 1 -- 172.21.15.7:0/1572251844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556cfdf8c540 con 0x556cfdf7dd40 2024-09-19T08:50:28.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.616+0000 7f667effd640 1 -- 172.21.15.7:0/1572251844 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6694005500 con 0x556cfdf7dd40 2024-09-19T08:50:28.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.616+0000 7f667effd640 1 -- 172.21.15.7:0/1572251844 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f669402e570 con 0x556cfdf7dd40 2024-09-19T08:50:28.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.616+0000 7f66a7f52740 10 client.16476 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:50:28.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.616+0000 7f66a7f52740 10 client.16476 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:50:28.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.616+0000 7f66a7f52740 20 client.16476 populate_metadata read hostname 'smithi007' 2024-09-19T08:50:28.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.616+0000 7f66a7f52740 1 --2- 172.21.15.7:0/1572251844 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x556cfdf8d890 0x556cfdf8fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:28.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.616+0000 7f66a7f52740 4 client.16476 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:50:28.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.616+0000 7f66a7f52740 1 -- 172.21.15.7:0/1572251844 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556cfdee57f0 con 0x556cfdf8d890 2024-09-19T08:50:28.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.616+0000 7f669f7fe640 1 --2- 172.21.15.7:0/1572251844 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x556cfdf8d890 0x556cfdf8fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:28.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.617+0000 7f669f7fe640 1 --2- 172.21.15.7:0/1572251844 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x556cfdf8d890 0x556cfdf8fc80 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80af41a5e142f9e1 server_cookie=1d8c4aa554c0a44d in_seq=0 out_seq=0 2024-09-19T08:50:28.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.617+0000 7f667effd640 10 client.16476 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:28.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.617+0000 7f667effd640 1 -- 172.21.15.7:0/1572251844 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556cfdee57f0 con 0x556cfdf8d890 2024-09-19T08:50:28.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.617+0000 7f667effd640 10 client.16476 handle_command_reply: tid=0 2024-09-19T08:50:28.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.618+0000 7f66a7f52740 1 client.16476 shutdown 2024-09-19T08:50:28.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.618+0000 7f66a7f52740 1 -- 172.21.15.7:0/1572251844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf7dd40 msgr2=0x556cfdf7b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:28.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.618+0000 7f66a7f52740 1 --2- 172.21.15.7:0/1572251844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf7dd40 0x556cfdf7b690 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f66940058c0 tx=0x7f6694013040 comp rx=0 tx=0).stop 2024-09-19T08:50:28.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.618+0000 7f66a7f52740 1 -- 172.21.15.7:0/1572251844 shutdown_connections 2024-09-19T08:50:28.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.618+0000 7f66a7f52740 1 --2- 172.21.15.7:0/1572251844 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x556cfdf8d890 0x556cfdf8fc80 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.618+0000 7f66a7f52740 1 --2- 172.21.15.7:0/1572251844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf7dd40 0x556cfdf7b690 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.618+0000 7f66a7f52740 1 --2- 172.21.15.7:0/1572251844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cfdf73480 0x556cfdf7b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.618+0000 7f66a7f52740 1 --2- 172.21.15.7:0/1572251844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cfdf72b60 0x556cfdf7ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.618+0000 7f66a7f52740 1 -- 172.21.15.7:0/1572251844 >> 172.21.15.7:0/1572251844 conn(0x556cfdf6f0f0 msgr2=0x556cfdf74e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:28.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.618+0000 7f667effd640 0 client.16476 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:28.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.618+0000 7f66a7f52740 1 -- 172.21.15.7:0/1572251844 shutdown_connections 2024-09-19T08:50:28.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.618+0000 7f66a7f52740 1 -- 172.21.15.7:0/1572251844 wait complete. 2024-09-19T08:50:28.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.618+0000 7f66a7f52740 20 client.16476 trim_cache size 0 max 16384 2024-09-19T08:50:28.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.635+0000 7f66a7f52740 1 Processor -- start 2024-09-19T08:50:28.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.635+0000 7f66a7f52740 1 -- start start 2024-09-19T08:50:28.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.636+0000 7f66a7f52740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cfdf72b60 0x556cfdf74cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:28.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.636+0000 7f66a7f52740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf73480 0x556cfdf953c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:28.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.636+0000 7f66a7f52740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cfdf7dd40 0x556cfdf95900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:28.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.636+0000 7f66a7f52740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f66a01b22c0 con 0x556cfdf73480 2024-09-19T08:50:28.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.636+0000 7f66a7f52740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f66a01afb90 con 0x556cfdf7dd40 2024-09-19T08:50:28.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.636+0000 7f66a7f52740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f66a01ad9e0 con 0x556cfdf72b60 2024-09-19T08:50:28.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.636+0000 7f669f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf73480 0x556cfdf953c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:28.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.636+0000 7f669f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf73480 0x556cfdf953c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38550/0 (socket says 172.21.15.7:38550) 2024-09-19T08:50:28.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.636+0000 7f669f7fe640 1 -- 172.21.15.7:0/1816271102 learned_addr learned my addr 172.21.15.7:0/1816271102 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:28.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.636+0000 7f669effd640 1 --2- 172.21.15.7:0/1816271102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cfdf72b60 0x556cfdf74cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:28.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.636+0000 7f669effd640 1 --2- 172.21.15.7:0/1816271102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cfdf7dd40 0x556cfdf95900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:28.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.636+0000 7f669f7fe640 1 -- 172.21.15.7:0/1816271102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cfdf72b60 msgr2=0x556cfdf74cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:28.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.636+0000 7f669f7fe640 1 --2- 172.21.15.7:0/1816271102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cfdf72b60 0x556cfdf74cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.636+0000 7f669f7fe640 1 -- 172.21.15.7:0/1816271102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cfdf7dd40 msgr2=0x556cfdf95900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:28.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.636+0000 7f669f7fe640 1 --2- 172.21.15.7:0/1816271102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cfdf7dd40 0x556cfdf95900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.636+0000 7f669f7fe640 1 -- 172.21.15.7:0/1816271102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cfdf73d00 con 0x556cfdf73480 2024-09-19T08:50:28.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.636+0000 7f669effd640 1 --2- 172.21.15.7:0/1816271102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cfdf72b60 0x556cfdf74cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:28.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.636+0000 7f669f7fe640 1 --2- 172.21.15.7:0/1816271102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf73480 0x556cfdf953c0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f6690009b00 tx=0x7f6690008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f8708a796a220c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:28.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.636+0000 7f66857fa640 1 -- 172.21.15.7:0/1816271102 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6690021070 con 0x556cfdf73480 2024-09-19T08:50:28.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.636+0000 7f66857fa640 1 -- 172.21.15.7:0/1816271102 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6690016d70 con 0x556cfdf73480 2024-09-19T08:50:28.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.636+0000 7f66857fa640 1 -- 172.21.15.7:0/1816271102 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6690015740 con 0x556cfdf73480 2024-09-19T08:50:28.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.637+0000 7f66a7f52740 1 -- 172.21.15.7:0/1816271102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf73480 msgr2=0x556cfdf953c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:28.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.637+0000 7f66a7f52740 1 --2- 172.21.15.7:0/1816271102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf73480 0x556cfdf953c0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f6690009b00 tx=0x7f6690008040 comp rx=0 tx=0).stop 2024-09-19T08:50:28.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.637+0000 7f66a7f52740 1 -- 172.21.15.7:0/1816271102 shutdown_connections 2024-09-19T08:50:28.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.637+0000 7f66a7f52740 1 --2- 172.21.15.7:0/1816271102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cfdf7dd40 0x556cfdf95900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.637+0000 7f66a7f52740 1 --2- 172.21.15.7:0/1816271102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf73480 0x556cfdf953c0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.637+0000 7f66a7f52740 1 --2- 172.21.15.7:0/1816271102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cfdf72b60 0x556cfdf74cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.637+0000 7f66a7f52740 1 -- 172.21.15.7:0/1816271102 >> 172.21.15.7:0/1816271102 conn(0x556cfdf6f0f0 msgr2=0x556cfdf745b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:28.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.637+0000 7f66a7f52740 1 -- 172.21.15.7:0/1816271102 shutdown_connections 2024-09-19T08:50:28.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.637+0000 7f66a7f52740 1 -- 172.21.15.7:0/1816271102 wait complete. 2024-09-19T08:50:28.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.637+0000 7f66a7f52740 1 -- start start 2024-09-19T08:50:28.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.638+0000 7f66a7f52740 1 Processor -- start 2024-09-19T08:50:28.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.638+0000 7f66a7f52740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cfdf72b60 0x556cfdf81d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:28.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.638+0000 7f66a7f52740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf73480 0x556cfdf82260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:28.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.638+0000 7f66a7f52740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cfdf7dd40 0x556cfdf827a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:28.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.638+0000 7f66a7f52740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f66a01ae050 con 0x556cfdf73480 2024-09-19T08:50:28.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.638+0000 7f66a7f52740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f66a01af4c0 con 0x556cfdf72b60 2024-09-19T08:50:28.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.638+0000 7f66a7f52740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f66a01ae720 con 0x556cfdf7dd40 2024-09-19T08:50:28.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.638+0000 7f66a7f52740 10 client.0 _ll_register_callbacks cb 0x7f66900093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:28.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.638+0000 7f669f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf73480 0x556cfdf82260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:28.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.638+0000 7f669f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf73480 0x556cfdf82260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38554/0 (socket says 172.21.15.7:38554) 2024-09-19T08:50:28.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.638+0000 7f669f7fe640 1 -- 172.21.15.7:0/1903010300 learned_addr learned my addr 172.21.15.7:0/1903010300 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:28.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.638+0000 7f669effd640 1 --2- 172.21.15.7:0/1903010300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cfdf72b60 0x556cfdf81d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:28.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.638+0000 7f669effd640 1 --2- 172.21.15.7:0/1903010300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cfdf7dd40 0x556cfdf827a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:28.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.639+0000 7f669f7fe640 1 -- 172.21.15.7:0/1903010300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cfdf7dd40 msgr2=0x556cfdf827a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:28.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.639+0000 7f669f7fe640 1 --2- 172.21.15.7:0/1903010300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cfdf7dd40 0x556cfdf827a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.639+0000 7f669f7fe640 1 -- 172.21.15.7:0/1903010300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cfdf72b60 msgr2=0x556cfdf81d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:28.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.639+0000 7f669f7fe640 1 --2- 172.21.15.7:0/1903010300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cfdf72b60 0x556cfdf81d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.639+0000 7f669f7fe640 1 -- 172.21.15.7:0/1903010300 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cfdff7630 con 0x556cfdf73480 2024-09-19T08:50:28.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.639+0000 7f669f7fe640 1 --2- 172.21.15.7:0/1903010300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf73480 0x556cfdf82260 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6690000c00 tx=0x7f669001d500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b047ad62a27447fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.639+0000 7f667effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:50:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.639+0000 7f667effd640 1 -- 172.21.15.7:0/1903010300 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669002c070 con 0x556cfdf73480 2024-09-19T08:50:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.639+0000 7f667effd640 1 -- 172.21.15.7:0/1903010300 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f669001da80 con 0x556cfdf73480 2024-09-19T08:50:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.639+0000 7f66a7f52740 1 -- 172.21.15.7:0/1903010300 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6690016d70 con 0x556cfdf73480 2024-09-19T08:50:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.639+0000 7f667effd640 1 -- 172.21.15.7:0/1903010300 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6690038050 con 0x556cfdf73480 2024-09-19T08:50:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.639+0000 7f66a7f52740 10 client.16482 fetch_fsmap learned FSMap version 25 2024-09-19T08:50:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.639+0000 7f66a7f52740 1 -- 172.21.15.7:0/1903010300 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556cfdff8970 con 0x556cfdf73480 2024-09-19T08:50:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.640+0000 7f667effd640 1 -- 172.21.15.7:0/1903010300 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6690016d70 con 0x556cfdf73480 2024-09-19T08:50:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.640+0000 7f667effd640 1 -- 172.21.15.7:0/1903010300 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6690015470 con 0x556cfdf73480 2024-09-19T08:50:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.640+0000 7f66a7f52740 10 client.16482 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:50:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.640+0000 7f66a7f52740 10 client.16482 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:50:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.640+0000 7f66a7f52740 20 client.16482 populate_metadata read hostname 'smithi007' 2024-09-19T08:50:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.640+0000 7f66a7f52740 1 --2- 172.21.15.7:0/1903010300 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x556cfdff9040 0x556cfdffb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.640+0000 7f66a7f52740 4 client.16482 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:50:28.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.640+0000 7f66a7f52740 1 -- 172.21.15.7:0/1903010300 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556cfdedfd00 con 0x556cfdff9040 2024-09-19T08:50:28.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.640+0000 7f669effd640 1 --2- 172.21.15.7:0/1903010300 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x556cfdff9040 0x556cfdffb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:28.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.640+0000 7f669effd640 1 --2- 172.21.15.7:0/1903010300 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x556cfdff9040 0x556cfdffb460 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8aa54673a6d5d1a5 server_cookie=81106d27b69d13d9 in_seq=0 out_seq=0 2024-09-19T08:50:28.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.640+0000 7f667effd640 10 client.16482 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:28.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.641+0000 7f667effd640 1 -- 172.21.15.7:0/1903010300 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556cfdedfd00 con 0x556cfdff9040 2024-09-19T08:50:28.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.641+0000 7f667effd640 10 client.16482 handle_command_reply: tid=0 2024-09-19T08:50:28.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.641+0000 7f66a7f52740 1 client.16482 shutdown 2024-09-19T08:50:28.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.642+0000 7f66a7f52740 1 -- 172.21.15.7:0/1903010300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf73480 msgr2=0x556cfdf82260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:28.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.642+0000 7f66a7f52740 1 --2- 172.21.15.7:0/1903010300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf73480 0x556cfdf82260 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6690000c00 tx=0x7f669001d500 comp rx=0 tx=0).stop 2024-09-19T08:50:28.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.642+0000 7f66a7f52740 1 -- 172.21.15.7:0/1903010300 shutdown_connections 2024-09-19T08:50:28.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.642+0000 7f66a7f52740 1 --2- 172.21.15.7:0/1903010300 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x556cfdff9040 0x556cfdffb460 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.642+0000 7f66a7f52740 1 --2- 172.21.15.7:0/1903010300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cfdf7dd40 0x556cfdf827a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.642+0000 7f66a7f52740 1 --2- 172.21.15.7:0/1903010300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556cfdf73480 0x556cfdf82260 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.642+0000 7f66a7f52740 1 --2- 172.21.15.7:0/1903010300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cfdf72b60 0x556cfdf81d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.642+0000 7f66a7f52740 1 -- 172.21.15.7:0/1903010300 >> 172.21.15.7:0/1903010300 conn(0x556cfdf6f0f0 msgr2=0x556cfdf79bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:28.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.642+0000 7f667effd640 0 client.16482 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:28.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.642+0000 7f66a7f52740 1 -- 172.21.15.7:0/1903010300 shutdown_connections 2024-09-19T08:50:28.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.642+0000 7f66a7f52740 1 -- 172.21.15.7:0/1903010300 wait complete. 2024-09-19T08:50:28.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.642+0000 7f66a7f52740 20 client.16482 trim_cache size 0 max 16384 2024-09-19T08:50:28.657 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:50:28.657 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-19T08:50:28.657 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "08d7c9f6-0da4-4afe-9812-915ed7a0fc3c", 2024-09-19T08:50:28.657 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-19T08:50:28.658 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:50:28.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.642+0000 7f66a5b79640 1 -- 172.21.15.7:0/3059475110 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f66880a33b0 msgr2=0x7f66880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:28.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.642+0000 7f66a5b79640 1 --2- 172.21.15.7:0/3059475110 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f66880a33b0 0x7f66880a5870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6698009430 tx=0x7f669808bd30 comp rx=0 tx=0).stop 2024-09-19T08:50:28.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.642+0000 7f66a5b79640 1 -- 172.21.15.7:0/3059475110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66a0102ef0 msgr2=0x7f66a0197bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:28.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.642+0000 7f66a5b79640 1 --2- 172.21.15.7:0/3059475110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66a0102ef0 0x7f66a0197bc0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f6698006010 tx=0x7f669802f6f0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.642+0000 7f66a5b79640 1 -- 172.21.15.7:0/3059475110 shutdown_connections 2024-09-19T08:50:28.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.643+0000 7f66a5b79640 1 --2- 172.21.15.7:0/3059475110 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f66880a33b0 0x7f66880a5870 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.643+0000 7f66a5b79640 1 --2- 172.21.15.7:0/3059475110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66a0102ef0 0x7f66a0197bc0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.643+0000 7f66a5b79640 1 --2- 172.21.15.7:0/3059475110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66a0102570 0x7f66a0197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.643+0000 7f66a5b79640 1 --2- 172.21.15.7:0/3059475110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66a0100e20 0x7f66a0197140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:28.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.643+0000 7f66a5b79640 1 -- 172.21.15.7:0/3059475110 >> 172.21.15.7:0/3059475110 conn(0x7f66a00fc7d0 msgr2=0x7f66a0106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:28.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.643+0000 7f66a5b79640 1 -- 172.21.15.7:0/3059475110 shutdown_connections 2024-09-19T08:50:28.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:28.643+0000 7f66a5b79640 1 -- 172.21.15.7:0/3059475110 wait complete. 2024-09-19T08:50:29.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:28 smithi175 ceph-mon[35688]: pgmap v181: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:50:29.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:28 smithi007 ceph-mon[31221]: pgmap v181: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:50:29.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:28 smithi044 ceph-mon[35072]: pgmap v181: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:50:29.534 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:50:29.794 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:30.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:29 smithi007 ceph-mon[31221]: scrub queued for path: / 2024-09-19T08:50:30.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:29 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:50:30.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:29 smithi007 ceph-mon[31221]: scrub summary: active paths [/] 2024-09-19T08:50:30.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:29 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:50:30.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:29 smithi007 ceph-mon[31221]: scrub summary: idle 2024-09-19T08:50:30.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:29 smithi175 ceph-mon[35688]: scrub queued for path: / 2024-09-19T08:50:30.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:29 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:50:30.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:29 smithi175 ceph-mon[35688]: scrub summary: active paths [/] 2024-09-19T08:50:30.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:29 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:50:30.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:29 smithi175 ceph-mon[35688]: scrub summary: idle 2024-09-19T08:50:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.264+0000 7f38c8730640 1 -- 172.21.15.7:0/3065636928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38c010e4f0 msgr2=0x7f38c0110900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.264+0000 7f38c8730640 1 --2- 172.21.15.7:0/3065636928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38c010e4f0 0x7f38c0110900 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009ca0 tx=0x7f38b002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.264+0000 7f38c8730640 1 -- 172.21.15.7:0/3065636928 shutdown_connections 2024-09-19T08:50:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.264+0000 7f38c8730640 1 --2- 172.21.15.7:0/3065636928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38c010e4f0 0x7f38c0110900 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.264+0000 7f38c8730640 1 --2- 172.21.15.7:0/3065636928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38c0101380 0x7f38c010dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.264+0000 7f38c8730640 1 --2- 172.21.15.7:0/3065636928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38c01009d0 0x7f38c0100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.264+0000 7f38c8730640 1 -- 172.21.15.7:0/3065636928 >> 172.21.15.7:0/3065636928 conn(0x7f38c00fc7d0 msgr2=0x7f38c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.264+0000 7f38c8730640 1 -- 172.21.15.7:0/3065636928 shutdown_connections 2024-09-19T08:50:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.264+0000 7f38c8730640 1 -- 172.21.15.7:0/3065636928 wait complete. 2024-09-19T08:50:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.265+0000 7f38c8730640 1 Processor -- start 2024-09-19T08:50:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.265+0000 7f38c8730640 1 -- start start 2024-09-19T08:50:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.265+0000 7f38c8730640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38c01009d0 0x7f38c019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.265+0000 7f38c8730640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38c0101380 0x7f38c019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.265+0000 7f38c8730640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38c010e4f0 0x7f38c019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.265+0000 7f38c8730640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f38c0114250 con 0x7f38c010e4f0 2024-09-19T08:50:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.265+0000 7f38c8730640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f38c01140d0 con 0x7f38c0101380 2024-09-19T08:50:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.265+0000 7f38c8730640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f38c01143d0 con 0x7f38c01009d0 2024-09-19T08:50:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.265+0000 7f38c6ccd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38c010e4f0 0x7f38c019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.265+0000 7f38c6ccd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38c010e4f0 0x7f38c019efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38576/0 (socket says 172.21.15.7:38576) 2024-09-19T08:50:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.265+0000 7f38c5ccb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38c0101380 0x7f38c019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.265+0000 7f38c6ccd640 1 -- 172.21.15.7:0/2439449880 learned_addr learned my addr 172.21.15.7:0/2439449880 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:30.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.265+0000 7f38c64cc640 1 --2- 172.21.15.7:0/2439449880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38c01009d0 0x7f38c019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.265+0000 7f38c6ccd640 1 -- 172.21.15.7:0/2439449880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38c01009d0 msgr2=0x7f38c019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.265+0000 7f38c6ccd640 1 --2- 172.21.15.7:0/2439449880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38c01009d0 0x7f38c019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.265+0000 7f38c6ccd640 1 -- 172.21.15.7:0/2439449880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38c0101380 msgr2=0x7f38c019ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.265+0000 7f38c6ccd640 1 --2- 172.21.15.7:0/2439449880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38c0101380 0x7f38c019ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.265+0000 7f38c6ccd640 1 -- 172.21.15.7:0/2439449880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c019f6a0 con 0x7f38c010e4f0 2024-09-19T08:50:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.265+0000 7f38c64cc640 1 --2- 172.21.15.7:0/2439449880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38c01009d0 0x7f38c019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.265+0000 7f38c5ccb640 1 --2- 172.21.15.7:0/2439449880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38c0101380 0x7f38c019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:50:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.266+0000 7f38c6ccd640 1 --2- 172.21.15.7:0/2439449880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38c010e4f0 0x7f38c019efc0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f38b00319f0 tx=0x7f38b0031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.266+0000 7f38bf7fe640 1 -- 172.21.15.7:0/2439449880 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0003c30 con 0x7f38c010e4f0 2024-09-19T08:50:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.266+0000 7f38bf7fe640 1 -- 172.21.15.7:0/2439449880 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38b0003dd0 con 0x7f38c010e4f0 2024-09-19T08:50:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.266+0000 7f38bf7fe640 1 -- 172.21.15.7:0/2439449880 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b002fdd0 con 0x7f38c010e4f0 2024-09-19T08:50:30.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.266+0000 7f38c8730640 1 -- 172.21.15.7:0/2439449880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c019f930 con 0x7f38c010e4f0 2024-09-19T08:50:30.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.266+0000 7f38c8730640 1 -- 172.21.15.7:0/2439449880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c01a7270 con 0x7f38c010e4f0 2024-09-19T08:50:30.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.268+0000 7f38bf7fe640 1 -- 172.21.15.7:0/2439449880 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f38b0004050 con 0x7f38c010e4f0 2024-09-19T08:50:30.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.269+0000 7f38cab09740 1 Processor -- start 2024-09-19T08:50:30.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.269+0000 7f38cab09740 1 -- start start 2024-09-19T08:50:30.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.269+0000 7f38cab09740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cff5454a0 0x555cff545880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:30.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.269+0000 7f38cab09740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cff545dc0 0x555cff550140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:30.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.269+0000 7f38cab09740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff550680 0x555cff552a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:30.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.269+0000 7f38cab09740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555cff4ab2e0 con 0x555cff550680 2024-09-19T08:50:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.269+0000 7f38cab09740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555cff452ce0 con 0x555cff545dc0 2024-09-19T08:50:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.269+0000 7f38cab09740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555cff4a72a0 con 0x555cff5454a0 2024-09-19T08:50:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.269+0000 7f38c5ccb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff550680 0x555cff552a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.269+0000 7f38bf7fe640 1 --2- 172.21.15.7:0/2439449880 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f38a80a3430 0x7f38a80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.269+0000 7f38c5ccb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff550680 0x555cff552a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38582/0 (socket says 172.21.15.7:38582) 2024-09-19T08:50:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.269+0000 7f38c5ccb640 1 -- 172.21.15.7:0/615078937 learned_addr learned my addr 172.21.15.7:0/615078937 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.269+0000 7f38c5ccb640 1 --2- 172.21.15.7:0/615078937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cff5454a0 0x555cff545880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.269+0000 7f38c64cc640 1 --2- 172.21.15.7:0/615078937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cff545dc0 0x555cff550140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.269+0000 7f38c6ccd640 1 --2- 172.21.15.7:0/2439449880 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f38a80a3430 0x7f38a80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.270+0000 7f38c5ccb640 1 -- 172.21.15.7:0/615078937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cff5454a0 msgr2=0x555cff545880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.270+0000 7f38c5ccb640 1 --2- 172.21.15.7:0/615078937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cff5454a0 0x555cff545880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.270+0000 7f38bf7fe640 1 -- 172.21.15.7:0/2439449880 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f38b00f0e70 con 0x7f38c010e4f0 2024-09-19T08:50:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.270+0000 7f38c5ccb640 1 -- 172.21.15.7:0/615078937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cff545dc0 msgr2=0x555cff550140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.270+0000 7f38c5ccb640 1 --2- 172.21.15.7:0/615078937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cff545dc0 0x555cff550140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.270+0000 7f38c5ccb640 1 -- 172.21.15.7:0/615078937 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cff437440 con 0x555cff550680 2024-09-19T08:50:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.270+0000 7f38c5ccb640 1 --2- 172.21.15.7:0/615078937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff550680 0x555cff552a70 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f38b4012910 tx=0x7f38b400bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a6c78eae564370 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.270+0000 7f38c6ccd640 1 --2- 172.21.15.7:0/2439449880 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f38a80a3430 0x7f38a80a58f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f38b00eebb0 tx=0x7f38b0090110 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.270+0000 7f38bcff9640 1 -- 172.21.15.7:0/615078937 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b4004230 con 0x555cff550680 2024-09-19T08:50:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.270+0000 7f38bcff9640 1 -- 172.21.15.7:0/615078937 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38b40043d0 con 0x555cff550680 2024-09-19T08:50:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.270+0000 7f38bcff9640 1 -- 172.21.15.7:0/615078937 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b4003cc0 con 0x555cff550680 2024-09-19T08:50:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.271+0000 7f38cab09740 1 -- 172.21.15.7:0/615078937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff550680 msgr2=0x555cff552a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.271+0000 7f38cab09740 1 --2- 172.21.15.7:0/615078937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff550680 0x555cff552a70 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f38b4012910 tx=0x7f38b400bb10 comp rx=0 tx=0).stop 2024-09-19T08:50:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.271+0000 7f38cab09740 1 -- 172.21.15.7:0/615078937 shutdown_connections 2024-09-19T08:50:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.271+0000 7f38cab09740 1 --2- 172.21.15.7:0/615078937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff550680 0x555cff552a70 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.271+0000 7f38cab09740 1 --2- 172.21.15.7:0/615078937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cff545dc0 0x555cff550140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.271+0000 7f38cab09740 1 --2- 172.21.15.7:0/615078937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cff5454a0 0x555cff545880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.271+0000 7f38cab09740 1 -- 172.21.15.7:0/615078937 >> 172.21.15.7:0/615078937 conn(0x555cff541a30 msgr2=0x555cff541e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.271+0000 7f38cab09740 1 -- 172.21.15.7:0/615078937 shutdown_connections 2024-09-19T08:50:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.271+0000 7f38cab09740 1 -- 172.21.15.7:0/615078937 wait complete. 2024-09-19T08:50:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.271+0000 7f38cab09740 1 -- start start 2024-09-19T08:50:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.272+0000 7f38cab09740 1 Processor -- start 2024-09-19T08:50:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.272+0000 7f38cab09740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff5454a0 0x555cff5500a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.272+0000 7f38cab09740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cff545dc0 0x555cff54d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.272+0000 7f38cab09740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cff550680 0x555cff54d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.272+0000 7f38cab09740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555cff553250 con 0x555cff5454a0 2024-09-19T08:50:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.272+0000 7f38cab09740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555cff466050 con 0x555cff550680 2024-09-19T08:50:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.272+0000 7f38cab09740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x555cff5533d0 con 0x555cff545dc0 2024-09-19T08:50:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.272+0000 7f38cab09740 10 client.0 _ll_register_callbacks cb 0x555cff4a6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.272+0000 7f38c5ccb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff5454a0 0x555cff5500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.272+0000 7f38c5ccb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff5454a0 0x555cff5500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38592/0 (socket says 172.21.15.7:38592) 2024-09-19T08:50:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.272+0000 7f38c5ccb640 1 -- 172.21.15.7:0/1790210259 learned_addr learned my addr 172.21.15.7:0/1790210259 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.272+0000 7f38c64cc640 1 --2- 172.21.15.7:0/1790210259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cff545dc0 0x555cff54d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.272+0000 7f38c5ccb640 1 --2- 172.21.15.7:0/1790210259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cff550680 0x555cff54d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.272+0000 7f38c5ccb640 1 -- 172.21.15.7:0/1790210259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cff545dc0 msgr2=0x555cff54d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.272+0000 7f38c5ccb640 1 --2- 172.21.15.7:0/1790210259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cff545dc0 0x555cff54d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.272+0000 7f38c5ccb640 1 -- 172.21.15.7:0/1790210259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cff550680 msgr2=0x555cff54d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.272+0000 7f38c5ccb640 1 --2- 172.21.15.7:0/1790210259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cff550680 0x555cff54d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.272+0000 7f38c5ccb640 1 -- 172.21.15.7:0/1790210259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cff21c3c0 con 0x555cff5454a0 2024-09-19T08:50:30.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.272+0000 7f38c64cc640 1 --2- 172.21.15.7:0/1790210259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cff545dc0 0x555cff54d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.272+0000 7f38c5ccb640 1 --2- 172.21.15.7:0/1790210259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff5454a0 0x555cff5500a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f38b4010740 tx=0x7f38b4004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e2461bd34c02f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.272+0000 7f38a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:50:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.273+0000 7f38a5ffb640 1 -- 172.21.15.7:0/1790210259 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b4010db0 con 0x555cff5454a0 2024-09-19T08:50:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.273+0000 7f38a5ffb640 1 -- 172.21.15.7:0/1790210259 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f38b4005070 con 0x555cff5454a0 2024-09-19T08:50:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.273+0000 7f38cab09740 1 -- 172.21.15.7:0/1790210259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38b40043d0 con 0x555cff5454a0 2024-09-19T08:50:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.273+0000 7f38a5ffb640 1 -- 172.21.15.7:0/1790210259 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f38b4033050 con 0x555cff5454a0 2024-09-19T08:50:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.273+0000 7f38cab09740 10 client.16494 fetch_fsmap learned FSMap version 25 2024-09-19T08:50:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.273+0000 7f38cab09740 1 -- 172.21.15.7:0/1790210259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555cff55ece0 con 0x555cff5454a0 2024-09-19T08:50:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.273+0000 7f38a5ffb640 1 -- 172.21.15.7:0/1790210259 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38b40043d0 con 0x555cff5454a0 2024-09-19T08:50:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.273+0000 7f38a5ffb640 1 -- 172.21.15.7:0/1790210259 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f38b4003a40 con 0x555cff5454a0 2024-09-19T08:50:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.273+0000 7f38cab09740 10 client.16494 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:50:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.273+0000 7f38cab09740 10 client.16494 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:50:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.273+0000 7f38cab09740 20 client.16494 populate_metadata read hostname 'smithi007' 2024-09-19T08:50:30.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.273+0000 7f38cab09740 1 --2- 172.21.15.7:0/1790210259 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x555cff560030 0x555cff562420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:30.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.273+0000 7f38cab09740 4 client.16494 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:50:30.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.273+0000 7f38cab09740 1 -- 172.21.15.7:0/1790210259 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cff4b8850 con 0x555cff560030 2024-09-19T08:50:30.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.274+0000 7f38c64cc640 1 --2- 172.21.15.7:0/1790210259 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x555cff560030 0x555cff562420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:30.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.274+0000 7f38a5ffb640 10 client.16494 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:30.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.274+0000 7f38c64cc640 1 --2- 172.21.15.7:0/1790210259 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x555cff560030 0x555cff562420 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df8bf67f3d9bf526 server_cookie=9e5f0822e8a4b11c in_seq=0 out_seq=0 2024-09-19T08:50:30.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.275+0000 7f38a5ffb640 1 -- 172.21.15.7:0/1790210259 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555cff4b8850 con 0x555cff560030 2024-09-19T08:50:30.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.275+0000 7f38a5ffb640 10 client.16494 handle_command_reply: tid=0 2024-09-19T08:50:30.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.275+0000 7f38cab09740 1 client.16494 shutdown 2024-09-19T08:50:30.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.275+0000 7f38cab09740 1 -- 172.21.15.7:0/1790210259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff5454a0 msgr2=0x555cff5500a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.275+0000 7f38cab09740 1 --2- 172.21.15.7:0/1790210259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff5454a0 0x555cff5500a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f38b4010740 tx=0x7f38b4004580 comp rx=0 tx=0).stop 2024-09-19T08:50:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.275+0000 7f38cab09740 1 -- 172.21.15.7:0/1790210259 shutdown_connections 2024-09-19T08:50:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.275+0000 7f38cab09740 1 --2- 172.21.15.7:0/1790210259 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x555cff560030 0x555cff562420 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.275+0000 7f38cab09740 1 --2- 172.21.15.7:0/1790210259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cff550680 0x555cff54d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.275+0000 7f38cab09740 1 --2- 172.21.15.7:0/1790210259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cff545dc0 0x555cff54d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.275+0000 7f38cab09740 1 --2- 172.21.15.7:0/1790210259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff5454a0 0x555cff5500a0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.275+0000 7f38cab09740 1 -- 172.21.15.7:0/1790210259 >> 172.21.15.7:0/1790210259 conn(0x555cff541a30 msgr2=0x555cff547710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.275+0000 7f38a5ffb640 0 client.16494 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.275+0000 7f38cab09740 1 -- 172.21.15.7:0/1790210259 shutdown_connections 2024-09-19T08:50:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.275+0000 7f38cab09740 1 -- 172.21.15.7:0/1790210259 wait complete. 2024-09-19T08:50:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.275+0000 7f38cab09740 20 client.16494 trim_cache size 0 max 16384 2024-09-19T08:50:30.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.292+0000 7f38cab09740 1 Processor -- start 2024-09-19T08:50:30.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.292+0000 7f38cab09740 1 -- start start 2024-09-19T08:50:30.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.293+0000 7f38cab09740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff5454a0 0x555cff55c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:30.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.293+0000 7f38cab09740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cff545dc0 0x555cff540a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:30.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.293+0000 7f38cab09740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cff550680 0x555cff567c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:30.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.293+0000 7f38cab09740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f38c01b2330 con 0x555cff5454a0 2024-09-19T08:50:30.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.293+0000 7f38cab09740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f38c01afc00 con 0x555cff545dc0 2024-09-19T08:50:30.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.293+0000 7f38cab09740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f38c01ada50 con 0x555cff550680 2024-09-19T08:50:30.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.293+0000 7f38c5ccb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff5454a0 0x555cff55c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:30.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.293+0000 7f38c5ccb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff5454a0 0x555cff55c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38596/0 (socket says 172.21.15.7:38596) 2024-09-19T08:50:30.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.293+0000 7f38c5ccb640 1 -- 172.21.15.7:0/556867483 learned_addr learned my addr 172.21.15.7:0/556867483 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:30.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.293+0000 7f38c64cc640 1 --2- 172.21.15.7:0/556867483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cff545dc0 0x555cff540a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:30.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.293+0000 7f38c5ccb640 1 --2- 172.21.15.7:0/556867483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cff550680 0x555cff567c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:30.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.293+0000 7f38c5ccb640 1 -- 172.21.15.7:0/556867483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cff550680 msgr2=0x555cff567c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:30.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.293+0000 7f38c5ccb640 1 --2- 172.21.15.7:0/556867483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cff550680 0x555cff567c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.293+0000 7f38c5ccb640 1 -- 172.21.15.7:0/556867483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cff545dc0 msgr2=0x555cff540a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:30.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.293+0000 7f38c5ccb640 1 --2- 172.21.15.7:0/556867483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cff545dc0 0x555cff540a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.293+0000 7f38c5ccb640 1 -- 172.21.15.7:0/556867483 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cff54b8a0 con 0x555cff5454a0 2024-09-19T08:50:30.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.293+0000 7f38c5ccb640 1 --2- 172.21.15.7:0/556867483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff5454a0 0x555cff55c4b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f38b400b3d0 tx=0x7f38b400b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02050a3529e7026 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:30.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.293+0000 7f38a7fff640 1 -- 172.21.15.7:0/556867483 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b4004320 con 0x555cff5454a0 2024-09-19T08:50:30.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.293+0000 7f38a7fff640 1 -- 172.21.15.7:0/556867483 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38b4003c10 con 0x555cff5454a0 2024-09-19T08:50:30.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.293+0000 7f38a7fff640 1 -- 172.21.15.7:0/556867483 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b401e480 con 0x555cff5454a0 2024-09-19T08:50:30.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.294+0000 7f38cab09740 1 -- 172.21.15.7:0/556867483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff5454a0 msgr2=0x555cff55c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:30.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.294+0000 7f38cab09740 1 --2- 172.21.15.7:0/556867483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff5454a0 0x555cff55c4b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f38b400b3d0 tx=0x7f38b400b540 comp rx=0 tx=0).stop 2024-09-19T08:50:30.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.294+0000 7f38cab09740 1 -- 172.21.15.7:0/556867483 shutdown_connections 2024-09-19T08:50:30.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.294+0000 7f38cab09740 1 --2- 172.21.15.7:0/556867483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cff550680 0x555cff567c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.294+0000 7f38cab09740 1 --2- 172.21.15.7:0/556867483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cff545dc0 0x555cff540a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.294+0000 7f38cab09740 1 --2- 172.21.15.7:0/556867483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff5454a0 0x555cff55c4b0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.294+0000 7f38cab09740 1 -- 172.21.15.7:0/556867483 >> 172.21.15.7:0/556867483 conn(0x555cff541a30 msgr2=0x555cff540350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:30.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.294+0000 7f38cab09740 1 -- 172.21.15.7:0/556867483 shutdown_connections 2024-09-19T08:50:30.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.294+0000 7f38cab09740 1 -- 172.21.15.7:0/556867483 wait complete. 2024-09-19T08:50:30.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.294+0000 7f38cab09740 1 -- start start 2024-09-19T08:50:30.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.294+0000 7f38cab09740 1 Processor -- start 2024-09-19T08:50:30.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.295+0000 7f38cab09740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cff5454a0 0x555cff5c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:30.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.295+0000 7f38cab09740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cff545dc0 0x555cff5c3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:30.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.295+0000 7f38cab09740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff550680 0x555cff553c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:30.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.295+0000 7f38cab09740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f38c01ae0c0 con 0x555cff550680 2024-09-19T08:50:30.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.295+0000 7f38cab09740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f38c01af530 con 0x555cff545dc0 2024-09-19T08:50:30.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.295+0000 7f38cab09740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f38c01ae790 con 0x555cff5454a0 2024-09-19T08:50:30.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.295+0000 7f38cab09740 10 client.0 _ll_register_callbacks cb 0x7f38b800b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:30.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.295+0000 7f38c5ccb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff550680 0x555cff553c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:30.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.295+0000 7f38c64cc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cff545dc0 0x555cff5c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:30.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.295+0000 7f38c5ccb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff550680 0x555cff553c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38610/0 (socket says 172.21.15.7:38610) 2024-09-19T08:50:30.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.295+0000 7f38c5ccb640 1 -- 172.21.15.7:0/1844134233 learned_addr learned my addr 172.21.15.7:0/1844134233 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:30.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.295+0000 7f38c5ccb640 1 --2- 172.21.15.7:0/1844134233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cff5454a0 0x555cff5c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:30.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.295+0000 7f38c64cc640 1 -- 172.21.15.7:0/1844134233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cff5454a0 msgr2=0x555cff5c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:30.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.295+0000 7f38c64cc640 1 --2- 172.21.15.7:0/1844134233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cff5454a0 0x555cff5c2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.295+0000 7f38c64cc640 1 -- 172.21.15.7:0/1844134233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff550680 msgr2=0x555cff553c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:30.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.295+0000 7f38c64cc640 1 --2- 172.21.15.7:0/1844134233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff550680 0x555cff553c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.295+0000 7f38c64cc640 1 -- 172.21.15.7:0/1844134233 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cff5542f0 con 0x555cff545dc0 2024-09-19T08:50:30.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.295+0000 7f38c5ccb640 1 --2- 172.21.15.7:0/1844134233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff550680 0x555cff553c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:50:30.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.295+0000 7f38c64cc640 1 --2- 172.21.15.7:0/1844134233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cff545dc0 0x555cff5c3480 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x555cff562c20 tx=0x7f38b80138f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e84180d4a7f338a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:30.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.295+0000 7f38a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-19T08:50:30.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.296+0000 7f38a5ffb640 1 -- 172.21.15.7:0/1844134233 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b8004230 con 0x555cff545dc0 2024-09-19T08:50:30.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.296+0000 7f38cab09740 1 -- 172.21.15.7:0/1844134233 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38b4003c10 con 0x555cff545dc0 2024-09-19T08:50:30.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.296+0000 7f38a5ffb640 1 -- 172.21.15.7:0/1844134233 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f38b80043d0 con 0x555cff545dc0 2024-09-19T08:50:30.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.296+0000 7f38a5ffb640 1 -- 172.21.15.7:0/1844134233 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f38b802d050 con 0x555cff545dc0 2024-09-19T08:50:30.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.296+0000 7f38cab09740 10 client.26147 fetch_fsmap learned FSMap version 25 2024-09-19T08:50:30.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.296+0000 7f38cab09740 1 -- 172.21.15.7:0/1844134233 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555cff5ca810 con 0x555cff545dc0 2024-09-19T08:50:30.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.296+0000 7f38a5ffb640 1 -- 172.21.15.7:0/1844134233 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38b4003c10 con 0x555cff545dc0 2024-09-19T08:50:30.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.296+0000 7f38a5ffb640 1 -- 172.21.15.7:0/1844134233 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f38b8003920 con 0x555cff545dc0 2024-09-19T08:50:30.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.296+0000 7f38cab09740 10 client.26147 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:50:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.296+0000 7f38cab09740 10 client.26147 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:50:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.296+0000 7f38cab09740 20 client.26147 populate_metadata read hostname 'smithi007' 2024-09-19T08:50:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.296+0000 7f38cab09740 1 --2- 172.21.15.7:0/1844134233 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x555cff5caf20 0x555cff5cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.296+0000 7f38cab09740 4 client.26147 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:50:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.296+0000 7f38cab09740 1 -- 172.21.15.7:0/1844134233 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555cff4b2d60 con 0x555cff5caf20 2024-09-19T08:50:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.297+0000 7f38c5ccb640 1 --2- 172.21.15.7:0/1844134233 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x555cff5caf20 0x555cff5cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.297+0000 7f38c5ccb640 1 --2- 172.21.15.7:0/1844134233 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x555cff5caf20 0x555cff5cd310 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a7511e18dfff9a9 server_cookie=d337ce739cca3108 in_seq=0 out_seq=0 2024-09-19T08:50:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.297+0000 7f38a5ffb640 10 client.26147 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.297+0000 7f38a5ffb640 1 -- 172.21.15.7:0/1844134233 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555cff4b2d60 con 0x555cff5caf20 2024-09-19T08:50:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.297+0000 7f38a5ffb640 10 client.26147 handle_command_reply: tid=0 2024-09-19T08:50:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.297+0000 7f38cab09740 1 client.26147 shutdown 2024-09-19T08:50:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.297+0000 7f38cab09740 1 -- 172.21.15.7:0/1844134233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cff545dc0 msgr2=0x555cff5c3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.297+0000 7f38cab09740 1 --2- 172.21.15.7:0/1844134233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cff545dc0 0x555cff5c3480 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x555cff562c20 tx=0x7f38b80138f0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.297+0000 7f38cab09740 1 -- 172.21.15.7:0/1844134233 shutdown_connections 2024-09-19T08:50:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.297+0000 7f38cab09740 1 --2- 172.21.15.7:0/1844134233 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x555cff5caf20 0x555cff5cd310 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.297+0000 7f38cab09740 1 --2- 172.21.15.7:0/1844134233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cff550680 0x555cff553c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.297+0000 7f38cab09740 1 --2- 172.21.15.7:0/1844134233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cff545dc0 0x555cff5c3480 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.297+0000 7f38a5ffb640 0 client.26147 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.297+0000 7f38cab09740 1 --2- 172.21.15.7:0/1844134233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555cff5454a0 0x555cff5c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.297+0000 7f38cab09740 1 -- 172.21.15.7:0/1844134233 >> 172.21.15.7:0/1844134233 conn(0x555cff541a30 msgr2=0x555cff547710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.297+0000 7f38cab09740 1 -- 172.21.15.7:0/1844134233 shutdown_connections 2024-09-19T08:50:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.297+0000 7f38cab09740 1 -- 172.21.15.7:0/1844134233 wait complete. 2024-09-19T08:50:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.297+0000 7f38cab09740 20 client.26147 trim_cache size 0 max 16384 2024-09-19T08:50:30.304 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:50:30.304 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-19T08:50:30.304 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-09-19T08:50:30.304 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:50:30.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.298+0000 7f38c8730640 1 -- 172.21.15.7:0/2439449880 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f38a80a3430 msgr2=0x7f38a80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:30.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.298+0000 7f38c8730640 1 --2- 172.21.15.7:0/2439449880 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f38a80a3430 0x7f38a80a58f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f38b00eebb0 tx=0x7f38b0090110 comp rx=0 tx=0).stop 2024-09-19T08:50:30.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.298+0000 7f38c8730640 1 -- 172.21.15.7:0/2439449880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38c010e4f0 msgr2=0x7f38c019efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:30.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.298+0000 7f38c8730640 1 --2- 172.21.15.7:0/2439449880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38c010e4f0 0x7f38c019efc0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f38b00319f0 tx=0x7f38b0031a20 comp rx=0 tx=0).stop 2024-09-19T08:50:30.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.298+0000 7f38c8730640 1 -- 172.21.15.7:0/2439449880 shutdown_connections 2024-09-19T08:50:30.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.298+0000 7f38c8730640 1 --2- 172.21.15.7:0/2439449880 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f38a80a3430 0x7f38a80a58f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.298+0000 7f38c8730640 1 --2- 172.21.15.7:0/2439449880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38c010e4f0 0x7f38c019efc0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.298+0000 7f38c8730640 1 --2- 172.21.15.7:0/2439449880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38c0101380 0x7f38c019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.298+0000 7f38c8730640 1 --2- 172.21.15.7:0/2439449880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38c01009d0 0x7f38c019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:30.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.298+0000 7f38c8730640 1 -- 172.21.15.7:0/2439449880 >> 172.21.15.7:0/2439449880 conn(0x7f38c00fc7d0 msgr2=0x7f38c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:30.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.298+0000 7f38c8730640 1 -- 172.21.15.7:0/2439449880 shutdown_connections 2024-09-19T08:50:30.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:30.298+0000 7f38c8730640 1 -- 172.21.15.7:0/2439449880 wait complete. 2024-09-19T08:50:30.306 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:29 smithi044 ceph-mon[35072]: scrub queued for path: / 2024-09-19T08:50:30.306 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:29 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:50:30.306 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:29 smithi044 ceph-mon[35072]: scrub summary: active paths [/] 2024-09-19T08:50:30.306 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:29 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:50:30.306 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:29 smithi044 ceph-mon[35072]: scrub summary: idle 2024-09-19T08:50:31.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:30 smithi007 ceph-mon[31221]: pgmap v182: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:50:31.151 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:50:31.152 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:50:31.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:30 smithi175 ceph-mon[35688]: pgmap v182: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:50:31.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:30 smithi044 ceph-mon[35072]: pgmap v182: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:50:31.414 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:32.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.988+0000 7f90f8d74640 1 -- 172.21.15.7:0/3517721450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90f4074510 msgr2=0x7f90f40748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:32.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.988+0000 7f90f8d74640 1 --2- 172.21.15.7:0/3517721450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90f4074510 0x7f90f40748f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f90e4009900 tx=0x7f90e402a480 comp rx=0 tx=0).stop 2024-09-19T08:50:32.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.988+0000 7f90f8d74640 1 -- 172.21.15.7:0/3517721450 shutdown_connections 2024-09-19T08:50:32.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.988+0000 7f90f8d74640 1 --2- 172.21.15.7:0/3517721450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90f410e440 0x7f90f4110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:32.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.988+0000 7f90f8d74640 1 --2- 172.21.15.7:0/3517721450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90f4074e30 0x7f90f410df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:32.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.988+0000 7f90f8d74640 1 --2- 172.21.15.7:0/3517721450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90f4074510 0x7f90f40748f0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:32.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.988+0000 7f90f8d74640 1 -- 172.21.15.7:0/3517721450 >> 172.21.15.7:0/3517721450 conn(0x7f90f40fd8c0 msgr2=0x7f90f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:32.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.988+0000 7f90f8d74640 1 -- 172.21.15.7:0/3517721450 shutdown_connections 2024-09-19T08:50:32.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.988+0000 7f90f8d74640 1 -- 172.21.15.7:0/3517721450 wait complete. 2024-09-19T08:50:32.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.989+0000 7f90f8d74640 1 Processor -- start 2024-09-19T08:50:32.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.989+0000 7f90f8d74640 1 -- start start 2024-09-19T08:50:32.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.989+0000 7f90f8d74640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90f4074510 0x7f90f419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:32.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.989+0000 7f90f8d74640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90f4074e30 0x7f90f419abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:32.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.989+0000 7f90f8d74640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90f410e440 0x7f90f419ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:32.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.989+0000 7f90f8d74640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f90f41141c0 con 0x7f90f4074510 2024-09-19T08:50:32.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.989+0000 7f90f8d74640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f90f4114040 con 0x7f90f4074e30 2024-09-19T08:50:32.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.989+0000 7f90f8d74640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f90f4114340 con 0x7f90f410e440 2024-09-19T08:50:32.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.990+0000 7f90f259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90f4074510 0x7f90f419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:32.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.990+0000 7f90f259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90f4074510 0x7f90f419a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38640/0 (socket says 172.21.15.7:38640) 2024-09-19T08:50:32.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.990+0000 7f90f259c640 1 -- 172.21.15.7:0/1796360803 learned_addr learned my addr 172.21.15.7:0/1796360803 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:32.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.990+0000 7f90ebfff640 1 --2- 172.21.15.7:0/1796360803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90f4074e30 0x7f90f419abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:32.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.990+0000 7f90f2d9d640 1 --2- 172.21.15.7:0/1796360803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90f410e440 0x7f90f419ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:32.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.990+0000 7f90f259c640 1 -- 172.21.15.7:0/1796360803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90f410e440 msgr2=0x7f90f419ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.990+0000 7f90f259c640 1 --2- 172.21.15.7:0/1796360803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90f410e440 0x7f90f419ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.990+0000 7f90f259c640 1 -- 172.21.15.7:0/1796360803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90f4074e30 msgr2=0x7f90f419abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.990+0000 7f90f259c640 1 --2- 172.21.15.7:0/1796360803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90f4074e30 0x7f90f419abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.990+0000 7f90f259c640 1 -- 172.21.15.7:0/1796360803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90f419f630 con 0x7f90f4074510 2024-09-19T08:50:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.990+0000 7f90f259c640 1 --2- 172.21.15.7:0/1796360803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90f4074510 0x7f90f419a680 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f90e4005ab0 tx=0x7f90e40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.990+0000 7f90eb7fe640 1 -- 172.21.15.7:0/1796360803 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e403f030 con 0x7f90f4074510 2024-09-19T08:50:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.990+0000 7f90eb7fe640 1 -- 172.21.15.7:0/1796360803 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90e4003ce0 con 0x7f90f4074510 2024-09-19T08:50:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.990+0000 7f90f8d74640 1 -- 172.21.15.7:0/1796360803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90f419f8c0 con 0x7f90f4074510 2024-09-19T08:50:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.990+0000 7f90eb7fe640 1 -- 172.21.15.7:0/1796360803 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e4035070 con 0x7f90f4074510 2024-09-19T08:50:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.990+0000 7f90f8d74640 1 -- 172.21.15.7:0/1796360803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90f41a7200 con 0x7f90f4074510 2024-09-19T08:50:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.991+0000 7f90f8d74640 1 -- 172.21.15.7:0/1796360803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90f4075c50 con 0x7f90f4074510 2024-09-19T08:50:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.993+0000 7f90eb7fe640 1 -- 172.21.15.7:0/1796360803 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f90e4042030 con 0x7f90f4074510 2024-09-19T08:50:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.994+0000 7f90eb7fe640 1 --2- 172.21.15.7:0/1796360803 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f90e00a33b0 0x7f90e00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:32.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.994+0000 7f90ebfff640 1 --2- 172.21.15.7:0/1796360803 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f90e00a33b0 0x7f90e00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:32.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.994+0000 7f90eb7fe640 1 -- 172.21.15.7:0/1796360803 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f90e40f06b0 con 0x7f90f4074510 2024-09-19T08:50:32.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.994+0000 7f90ebfff640 1 --2- 172.21.15.7:0/1796360803 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f90e00a33b0 0x7f90e00a5870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f90f40ffe50 tx=0x7f90dc009110 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:32.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:31.998+0000 7f90eb7fe640 1 -- 172.21.15.7:0/1796360803 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f90e40bd080 con 0x7f90f4074510 2024-09-19T08:50:32.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:32.214+0000 7f90f8d74640 1 -- 172.21.15.7:0/1796360803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90f41095c0 con 0x7f90f4074510 2024-09-19T08:50:32.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:32.214+0000 7f90eb7fe640 1 -- 172.21.15.7:0/1796360803 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f90e40bc980 con 0x7f90f4074510 2024-09-19T08:50:32.214 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:50:32.214 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:50:32.215 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:50:32.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:32.217+0000 7f90f8d74640 1 -- 172.21.15.7:0/1796360803 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f90e00a33b0 msgr2=0x7f90e00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:32.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:32.217+0000 7f90f8d74640 1 --2- 172.21.15.7:0/1796360803 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f90e00a33b0 0x7f90e00a5870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f90f40ffe50 tx=0x7f90dc009110 comp rx=0 tx=0).stop 2024-09-19T08:50:32.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:32.217+0000 7f90f8d74640 1 -- 172.21.15.7:0/1796360803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90f4074510 msgr2=0x7f90f419a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:32.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:32.217+0000 7f90f8d74640 1 --2- 172.21.15.7:0/1796360803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90f4074510 0x7f90f419a680 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f90e4005ab0 tx=0x7f90e40042f0 comp rx=0 tx=0).stop 2024-09-19T08:50:32.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:32.217+0000 7f90f8d74640 1 -- 172.21.15.7:0/1796360803 shutdown_connections 2024-09-19T08:50:32.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:32.217+0000 7f90f8d74640 1 --2- 172.21.15.7:0/1796360803 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f90e00a33b0 0x7f90e00a5870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:32.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:32.217+0000 7f90f8d74640 1 --2- 172.21.15.7:0/1796360803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90f410e440 0x7f90f419ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:32.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:32.217+0000 7f90f8d74640 1 --2- 172.21.15.7:0/1796360803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90f4074e30 0x7f90f419abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:32.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:32.217+0000 7f90f8d74640 1 --2- 172.21.15.7:0/1796360803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90f4074510 0x7f90f419a680 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:32.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:32.217+0000 7f90f8d74640 1 -- 172.21.15.7:0/1796360803 >> 172.21.15.7:0/1796360803 conn(0x7f90f40fd8c0 msgr2=0x7f90f40fefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:32.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:32.217+0000 7f90f8d74640 1 -- 172.21.15.7:0/1796360803 shutdown_connections 2024-09-19T08:50:32.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:32.217+0000 7f90f8d74640 1 -- 172.21.15.7:0/1796360803 wait complete. 2024-09-19T08:50:32.942 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:50:33.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:32 smithi175 ceph-mon[35688]: pgmap v183: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:50:33.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:32 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1796360803' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:50:33.200 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:33.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:32 smithi007 ceph-mon[31221]: pgmap v183: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:50:33.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:32 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1796360803' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:50:33.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:32 smithi044 ceph-mon[35072]: pgmap v183: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:50:33.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:32 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1796360803' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:50:33.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.640+0000 7f8beb430640 1 -- 172.21.15.7:0/4005430827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8be410e480 msgr2=0x7f8be4110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:33.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.640+0000 7f8beb430640 1 --2- 172.21.15.7:0/4005430827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8be410e480 0x7f8be4110870 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc009ca0 tx=0x7f8bdc02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.640+0000 7f8beb430640 1 -- 172.21.15.7:0/4005430827 shutdown_connections 2024-09-19T08:50:33.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.640+0000 7f8beb430640 1 --2- 172.21.15.7:0/4005430827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8be410e480 0x7f8be4110870 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.640+0000 7f8beb430640 1 --2- 172.21.15.7:0/4005430827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8be4101280 0x7f8be410df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.640+0000 7f8beb430640 1 --2- 172.21.15.7:0/4005430827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8be41008d0 0x7f8be4100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.640+0000 7f8beb430640 1 -- 172.21.15.7:0/4005430827 >> 172.21.15.7:0/4005430827 conn(0x7f8be40fc7a0 msgr2=0x7f8be40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:33.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.640+0000 7f8beb430640 1 -- 172.21.15.7:0/4005430827 shutdown_connections 2024-09-19T08:50:33.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.640+0000 7f8beb430640 1 -- 172.21.15.7:0/4005430827 wait complete. 2024-09-19T08:50:33.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.640+0000 7f8beb430640 1 Processor -- start 2024-09-19T08:50:33.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.640+0000 7f8beb430640 1 -- start start 2024-09-19T08:50:33.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.641+0000 7f8beb430640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8be41008d0 0x7f8be419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:33.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.641+0000 7f8beb430640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8be4101280 0x7f8be419ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:33.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.641+0000 7f8beb430640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8be410e480 0x7f8be419efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:33.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.641+0000 7f8beb430640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8be4114160 con 0x7f8be41008d0 2024-09-19T08:50:33.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.641+0000 7f8beb430640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8be4113fe0 con 0x7f8be410e480 2024-09-19T08:50:33.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.641+0000 7f8beb430640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8be41142e0 con 0x7f8be4101280 2024-09-19T08:50:33.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.641+0000 7f8be91cc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8be41008d0 0x7f8be419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:33.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.641+0000 7f8be91cc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8be41008d0 0x7f8be419a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59428/0 (socket says 172.21.15.7:59428) 2024-09-19T08:50:33.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.641+0000 7f8be91cc640 1 -- 172.21.15.7:0/40067598 learned_addr learned my addr 172.21.15.7:0/40067598 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:33.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.641+0000 7f8be89cb640 1 --2- 172.21.15.7:0/40067598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8be4101280 0x7f8be419ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:33.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.641+0000 7f8be99cd640 1 --2- 172.21.15.7:0/40067598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8be410e480 0x7f8be419efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:33.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.641+0000 7f8be91cc640 1 -- 172.21.15.7:0/40067598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8be4101280 msgr2=0x7f8be419ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:33.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.641+0000 7f8be91cc640 1 --2- 172.21.15.7:0/40067598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8be4101280 0x7f8be419ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.641+0000 7f8be91cc640 1 -- 172.21.15.7:0/40067598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8be410e480 msgr2=0x7f8be419efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:33.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.641+0000 7f8be91cc640 1 --2- 172.21.15.7:0/40067598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8be410e480 0x7f8be419efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.641+0000 7f8be91cc640 1 -- 172.21.15.7:0/40067598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be419f690 con 0x7f8be41008d0 2024-09-19T08:50:33.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.642+0000 7f8be91cc640 1 --2- 172.21.15.7:0/40067598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8be41008d0 0x7f8be419a6e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f8be000d950 tx=0x7f8be000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:33.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.642+0000 7f8bda7fc640 1 -- 172.21.15.7:0/40067598 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be0017070 con 0x7f8be41008d0 2024-09-19T08:50:33.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.642+0000 7f8beb430640 1 -- 172.21.15.7:0/40067598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be419f980 con 0x7f8be41008d0 2024-09-19T08:50:33.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.642+0000 7f8bda7fc640 1 -- 172.21.15.7:0/40067598 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8be0009c30 con 0x7f8be41008d0 2024-09-19T08:50:33.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.642+0000 7f8bda7fc640 1 -- 172.21.15.7:0/40067598 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be000f6b0 con 0x7f8be41008d0 2024-09-19T08:50:33.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.642+0000 7f8beb430640 1 -- 172.21.15.7:0/40067598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be41a7260 con 0x7f8be41008d0 2024-09-19T08:50:33.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.644+0000 7f8bda7fc640 1 -- 172.21.15.7:0/40067598 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8be00109d0 con 0x7f8be41008d0 2024-09-19T08:50:33.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.644+0000 7f8bed809740 1 Processor -- start 2024-09-19T08:50:33.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.644+0000 7f8bed809740 1 -- start start 2024-09-19T08:50:33.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.645+0000 7f8bed809740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e636ad8b40 0x55e636ad7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:33.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.645+0000 7f8bed809740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e636ad75d0 0x55e636ad7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:33.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.645+0000 7f8bed809740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ae2370 0x55e636ae4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:33.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.645+0000 7f8bed809740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e636a3d2f0 con 0x55e636ae2370 2024-09-19T08:50:33.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.645+0000 7f8bed809740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e6369e4cf0 con 0x55e636ad75d0 2024-09-19T08:50:33.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.645+0000 7f8bed809740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e636a392b0 con 0x55e636ad8b40 2024-09-19T08:50:33.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.645+0000 7f8be89cb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ae2370 0x55e636ae4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:33.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.645+0000 7f8be89cb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ae2370 0x55e636ae4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59440/0 (socket says 172.21.15.7:59440) 2024-09-19T08:50:33.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.645+0000 7f8be89cb640 1 -- 172.21.15.7:0/3804311909 learned_addr learned my addr 172.21.15.7:0/3804311909 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:33.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.645+0000 7f8bda7fc640 1 --2- 172.21.15.7:0/40067598 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8bd00a33b0 0x7f8bd00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:33.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.645+0000 7f8be91cc640 1 --2- 172.21.15.7:0/3804311909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e636ad75d0 0x55e636ad7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:33.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.645+0000 7f8be99cd640 1 --2- 172.21.15.7:0/3804311909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e636ad8b40 0x55e636ad7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:33.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.645+0000 7f8be89cb640 1 -- 172.21.15.7:0/3804311909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e636ad8b40 msgr2=0x55e636ad7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:33.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.645+0000 7f8be89cb640 1 --2- 172.21.15.7:0/3804311909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e636ad8b40 0x55e636ad7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.645+0000 7f8be99cd640 1 --2- 172.21.15.7:0/40067598 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8bd00a33b0 0x7f8bd00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:33.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.645+0000 7f8be89cb640 1 -- 172.21.15.7:0/3804311909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e636ad75d0 msgr2=0x55e636ad7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:33.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.645+0000 7f8be89cb640 1 --2- 172.21.15.7:0/3804311909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e636ad75d0 0x55e636ad7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.645+0000 7f8be89cb640 1 -- 172.21.15.7:0/3804311909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6369c93a0 con 0x55e636ae2370 2024-09-19T08:50:33.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.645+0000 7f8be91cc640 1 --2- 172.21.15.7:0/3804311909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e636ad75d0 0x55e636ad7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:33.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.645+0000 7f8bda7fc640 1 -- 172.21.15.7:0/40067598 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f8be00cf8f0 con 0x7f8be41008d0 2024-09-19T08:50:33.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.645+0000 7f8be89cb640 1 --2- 172.21.15.7:0/3804311909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ae2370 0x55e636ae4760 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400bc30 tx=0x7f8bd40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db70dd1dafc9b641 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:33.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.646+0000 7f8bcf7fe640 1 -- 172.21.15.7:0/3804311909 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd401c480 con 0x55e636ae2370 2024-09-19T08:50:33.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.646+0000 7f8be99cd640 1 --2- 172.21.15.7:0/40067598 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8bd00a33b0 0x7f8bd00a5870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc006010 tx=0x7f8bdc004a80 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:33.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.646+0000 7f8bcf7fe640 1 -- 172.21.15.7:0/3804311909 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bd401cb00 con 0x55e636ae2370 2024-09-19T08:50:33.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.646+0000 7f8bcf7fe640 1 -- 172.21.15.7:0/3804311909 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4011b50 con 0x55e636ae2370 2024-09-19T08:50:33.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.646+0000 7f8bed809740 1 -- 172.21.15.7:0/3804311909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ae2370 msgr2=0x55e636ae4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:33.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.646+0000 7f8bed809740 1 --2- 172.21.15.7:0/3804311909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ae2370 0x55e636ae4760 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400bc30 tx=0x7f8bd40107a0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.647+0000 7f8bed809740 1 -- 172.21.15.7:0/3804311909 shutdown_connections 2024-09-19T08:50:33.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.647+0000 7f8bed809740 1 --2- 172.21.15.7:0/3804311909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ae2370 0x55e636ae4760 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.647+0000 7f8bed809740 1 --2- 172.21.15.7:0/3804311909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e636ad75d0 0x55e636ad7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.647+0000 7f8bed809740 1 --2- 172.21.15.7:0/3804311909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e636ad8b40 0x55e636ad7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.647+0000 7f8bed809740 1 -- 172.21.15.7:0/3804311909 >> 172.21.15.7:0/3804311909 conn(0x55e636aa0310 msgr2=0x55e636ad3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:33.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.647+0000 7f8bed809740 1 -- 172.21.15.7:0/3804311909 shutdown_connections 2024-09-19T08:50:33.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.647+0000 7f8bed809740 1 -- 172.21.15.7:0/3804311909 wait complete. 2024-09-19T08:50:33.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.647+0000 7f8bed809740 1 -- start start 2024-09-19T08:50:33.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.647+0000 7f8bed809740 1 Processor -- start 2024-09-19T08:50:33.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.647+0000 7f8bed809740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ad75d0 0x55e636ae1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:33.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.648+0000 7f8bed809740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e636ad8b40 0x55e636adeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:33.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.648+0000 7f8bed809740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e636ae2370 0x55e636adf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:33.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.648+0000 7f8bed809740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e636ae5070 con 0x55e636ad75d0 2024-09-19T08:50:33.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.648+0000 7f8bed809740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e6369f8060 con 0x55e636ae2370 2024-09-19T08:50:33.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.648+0000 7f8bed809740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e636ae51f0 con 0x55e636ad8b40 2024-09-19T08:50:33.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.648+0000 7f8bed809740 10 client.0 _ll_register_callbacks cb 0x55e63674b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:33.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.648+0000 7f8be91cc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ad75d0 0x55e636ae1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:33.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.648+0000 7f8be91cc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ad75d0 0x55e636ae1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59444/0 (socket says 172.21.15.7:59444) 2024-09-19T08:50:33.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.648+0000 7f8be91cc640 1 -- 172.21.15.7:0/3667742386 learned_addr learned my addr 172.21.15.7:0/3667742386 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:33.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.648+0000 7f8be99cd640 1 --2- 172.21.15.7:0/3667742386 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e636ae2370 0x55e636adf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:33.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.648+0000 7f8be89cb640 1 --2- 172.21.15.7:0/3667742386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e636ad8b40 0x55e636adeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:33.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.648+0000 7f8be91cc640 1 -- 172.21.15.7:0/3667742386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e636ad8b40 msgr2=0x55e636adeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:33.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.648+0000 7f8be91cc640 1 --2- 172.21.15.7:0/3667742386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e636ad8b40 0x55e636adeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.648+0000 7f8be91cc640 1 -- 172.21.15.7:0/3667742386 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e636ae2370 msgr2=0x55e636adf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:33.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.648+0000 7f8be91cc640 1 --2- 172.21.15.7:0/3667742386 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e636ae2370 0x55e636adf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.648+0000 7f8be91cc640 1 -- 172.21.15.7:0/3667742386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6367ae3c0 con 0x55e636ad75d0 2024-09-19T08:50:33.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.648+0000 7f8be89cb640 1 --2- 172.21.15.7:0/3667742386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e636ad8b40 0x55e636adeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:33.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.648+0000 7f8be91cc640 1 --2- 172.21.15.7:0/3667742386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ad75d0 0x55e636ae1d40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f8be00cd090 tx=0x7f8be0009de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6c6399384e1fc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:33.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.648+0000 7f8bccff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:50:33.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.648+0000 7f8bccff9640 1 -- 172.21.15.7:0/3667742386 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be0020040 con 0x55e636ad75d0 2024-09-19T08:50:33.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.649+0000 7f8bccff9640 1 -- 172.21.15.7:0/3667742386 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f8be0099f70 con 0x55e636ad75d0 2024-09-19T08:50:33.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.649+0000 7f8bed809740 1 -- 172.21.15.7:0/3667742386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bd401cb00 con 0x55e636ad75d0 2024-09-19T08:50:33.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.649+0000 7f8bccff9640 1 -- 172.21.15.7:0/3667742386 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8be00a4830 con 0x55e636ad75d0 2024-09-19T08:50:33.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.649+0000 7f8bed809740 10 client.16518 fetch_fsmap learned FSMap version 25 2024-09-19T08:50:33.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.649+0000 7f8bed809740 1 -- 172.21.15.7:0/3667742386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e636af0b30 con 0x55e636ad75d0 2024-09-19T08:50:33.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.649+0000 7f8bccff9640 1 -- 172.21.15.7:0/3667742386 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bd401cb00 con 0x55e636ad75d0 2024-09-19T08:50:33.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.649+0000 7f8bccff9640 1 -- 172.21.15.7:0/3667742386 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8be009b0c0 con 0x55e636ad75d0 2024-09-19T08:50:33.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.649+0000 7f8bed809740 10 client.16518 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:50:33.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.649+0000 7f8bed809740 10 client.16518 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:50:33.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.649+0000 7f8bed809740 20 client.16518 populate_metadata read hostname 'smithi007' 2024-09-19T08:50:33.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.649+0000 7f8bed809740 1 --2- 172.21.15.7:0/3667742386 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55e636af1f40 0x55e636af4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:33.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.649+0000 7f8bed809740 4 client.16518 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:50:33.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.649+0000 7f8bed809740 1 -- 172.21.15.7:0/3667742386 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e636a4a860 con 0x55e636af1f40 2024-09-19T08:50:33.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.650+0000 7f8be89cb640 1 --2- 172.21.15.7:0/3667742386 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55e636af1f40 0x55e636af4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:33.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.650+0000 7f8be89cb640 1 --2- 172.21.15.7:0/3667742386 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55e636af1f40 0x55e636af4390 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=711380332a3ee3f9 server_cookie=3582936b492f59c3 in_seq=0 out_seq=0 2024-09-19T08:50:33.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.650+0000 7f8bccff9640 10 client.16518 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:50:33.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.651+0000 7f8bccff9640 1 -- 172.21.15.7:0/3667742386 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e636a4a860 con 0x55e636af1f40 2024-09-19T08:50:33.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.651+0000 7f8bccff9640 10 client.16518 handle_command_reply: tid=0 2024-09-19T08:50:33.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.651+0000 7f8bed809740 1 client.16518 shutdown 2024-09-19T08:50:33.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.651+0000 7f8bed809740 1 -- 172.21.15.7:0/3667742386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ad75d0 msgr2=0x55e636ae1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:33.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.651+0000 7f8bed809740 1 --2- 172.21.15.7:0/3667742386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ad75d0 0x55e636ae1d40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f8be00cd090 tx=0x7f8be0009de0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.651+0000 7f8bed809740 1 -- 172.21.15.7:0/3667742386 shutdown_connections 2024-09-19T08:50:33.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.651+0000 7f8bed809740 1 --2- 172.21.15.7:0/3667742386 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55e636af1f40 0x55e636af4390 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.651+0000 7f8bed809740 1 --2- 172.21.15.7:0/3667742386 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e636ae2370 0x55e636adf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.651+0000 7f8bed809740 1 --2- 172.21.15.7:0/3667742386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e636ad8b40 0x55e636adeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.651+0000 7f8bed809740 1 --2- 172.21.15.7:0/3667742386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ad75d0 0x55e636ae1d40 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.651+0000 7f8bccff9640 0 client.16518 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:50:33.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.651+0000 7f8bed809740 1 -- 172.21.15.7:0/3667742386 >> 172.21.15.7:0/3667742386 conn(0x55e636aa0310 msgr2=0x55e636ad9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:33.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.651+0000 7f8bed809740 1 -- 172.21.15.7:0/3667742386 shutdown_connections 2024-09-19T08:50:33.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.651+0000 7f8bed809740 1 -- 172.21.15.7:0/3667742386 wait complete. 2024-09-19T08:50:33.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.651+0000 7f8bed809740 20 client.16518 trim_cache size 0 max 16384 2024-09-19T08:50:33.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.664+0000 7f8bed809740 1 Processor -- start 2024-09-19T08:50:33.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.664+0000 7f8bed809740 1 -- start start 2024-09-19T08:50:33.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.664+0000 7f8bed809740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e636ad75d0 0x55e636ade8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:33.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.664+0000 7f8bed809740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ad8b40 0x55e636ad2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:33.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.664+0000 7f8bed809740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e636ae2370 0x55e636ada120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:33.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.664+0000 7f8bed809740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8be41b23a0 con 0x55e636ad8b40 2024-09-19T08:50:33.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.664+0000 7f8bed809740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8be41afc70 con 0x55e636ae2370 2024-09-19T08:50:33.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.664+0000 7f8bed809740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8be41adac0 con 0x55e636ad75d0 2024-09-19T08:50:33.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.664+0000 7f8be89cb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ad8b40 0x55e636ad2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:33.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.665+0000 7f8be89cb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ad8b40 0x55e636ad2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59454/0 (socket says 172.21.15.7:59454) 2024-09-19T08:50:33.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.665+0000 7f8be89cb640 1 -- 172.21.15.7:0/552047933 learned_addr learned my addr 172.21.15.7:0/552047933 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:33.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.665+0000 7f8be91cc640 1 --2- 172.21.15.7:0/552047933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e636ad75d0 0x55e636ade8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:33.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.665+0000 7f8be99cd640 1 --2- 172.21.15.7:0/552047933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e636ae2370 0x55e636ada120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:33.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.665+0000 7f8be89cb640 1 -- 172.21.15.7:0/552047933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e636ad75d0 msgr2=0x55e636ade8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:33.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.665+0000 7f8be89cb640 1 --2- 172.21.15.7:0/552047933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e636ad75d0 0x55e636ade8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.665+0000 7f8be89cb640 1 -- 172.21.15.7:0/552047933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e636ae2370 msgr2=0x55e636ada120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:33.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.665+0000 7f8be89cb640 1 --2- 172.21.15.7:0/552047933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e636ae2370 0x55e636ada120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.665+0000 7f8be89cb640 1 -- 172.21.15.7:0/552047933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e636ae1960 con 0x55e636ad8b40 2024-09-19T08:50:33.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.665+0000 7f8be89cb640 1 --2- 172.21.15.7:0/552047933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ad8b40 0x55e636ad2bf0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x55e636ad8070 tx=0x7f8bd400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666d0b04682a2e1c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.665+0000 7f8bceffd640 1 -- 172.21.15.7:0/552047933 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd402c030 con 0x55e636ad8b40 2024-09-19T08:50:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.665+0000 7f8bceffd640 1 -- 172.21.15.7:0/552047933 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bd400bda0 con 0x55e636ad8b40 2024-09-19T08:50:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.665+0000 7f8bceffd640 1 -- 172.21.15.7:0/552047933 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4011690 con 0x55e636ad8b40 2024-09-19T08:50:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.666+0000 7f8bed809740 1 -- 172.21.15.7:0/552047933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ad8b40 msgr2=0x55e636ad2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.666+0000 7f8bed809740 1 --2- 172.21.15.7:0/552047933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ad8b40 0x55e636ad2bf0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x55e636ad8070 tx=0x7f8bd400b390 comp rx=0 tx=0).stop 2024-09-19T08:50:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.666+0000 7f8bed809740 1 -- 172.21.15.7:0/552047933 shutdown_connections 2024-09-19T08:50:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.666+0000 7f8bed809740 1 --2- 172.21.15.7:0/552047933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e636ae2370 0x55e636ada120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.666+0000 7f8bed809740 1 --2- 172.21.15.7:0/552047933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ad8b40 0x55e636ad2bf0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.666+0000 7f8bed809740 1 --2- 172.21.15.7:0/552047933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e636ad75d0 0x55e636ade8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.666+0000 7f8bed809740 1 -- 172.21.15.7:0/552047933 >> 172.21.15.7:0/552047933 conn(0x55e636aa0310 msgr2=0x55e636ad24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.666+0000 7f8bed809740 1 -- 172.21.15.7:0/552047933 shutdown_connections 2024-09-19T08:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.666+0000 7f8bed809740 1 -- 172.21.15.7:0/552047933 wait complete. 2024-09-19T08:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.666+0000 7f8bed809740 1 -- start start 2024-09-19T08:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.667+0000 7f8bed809740 1 Processor -- start 2024-09-19T08:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.667+0000 7f8bed809740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ad75d0 0x55e636aeaa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.667+0000 7f8bed809740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e636ad8b40 0x55e636adbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.667+0000 7f8bed809740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e636ae2370 0x55e636adc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.667+0000 7f8bed809740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8be41ae130 con 0x55e636ad75d0 2024-09-19T08:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.667+0000 7f8bed809740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8be41af5a0 con 0x55e636ae2370 2024-09-19T08:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.667+0000 7f8bed809740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8be41ae800 con 0x55e636ad8b40 2024-09-19T08:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.667+0000 7f8bed809740 10 client.0 _ll_register_callbacks cb 0x7f8be000df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.667+0000 7f8be91cc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ad75d0 0x55e636aeaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.667+0000 7f8be91cc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ad75d0 0x55e636aeaa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59458/0 (socket says 172.21.15.7:59458) 2024-09-19T08:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.667+0000 7f8be91cc640 1 -- 172.21.15.7:0/1606178589 learned_addr learned my addr 172.21.15.7:0/1606178589 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.667+0000 7f8be99cd640 1 --2- 172.21.15.7:0/1606178589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e636ae2370 0x55e636adc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.667+0000 7f8be89cb640 1 --2- 172.21.15.7:0/1606178589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e636ad8b40 0x55e636adbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.667+0000 7f8be91cc640 1 -- 172.21.15.7:0/1606178589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e636ad8b40 msgr2=0x55e636adbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.667+0000 7f8be91cc640 1 --2- 172.21.15.7:0/1606178589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e636ad8b40 0x55e636adbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.667+0000 7f8be91cc640 1 -- 172.21.15.7:0/1606178589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e636ae2370 msgr2=0x55e636adc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.667+0000 7f8be91cc640 1 --2- 172.21.15.7:0/1606178589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e636ae2370 0x55e636adc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.668+0000 7f8be91cc640 1 -- 172.21.15.7:0/1606178589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e636adc7a0 con 0x55e636ad75d0 2024-09-19T08:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.668+0000 7f8be89cb640 1 --2- 172.21.15.7:0/1606178589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e636ad8b40 0x55e636adbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.668+0000 7f8be91cc640 1 --2- 172.21.15.7:0/1606178589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ad75d0 0x55e636aeaa90 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f8be009be30 tx=0x7f8be009b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=262c66b9c1674893 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.668+0000 7f8bccff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.668+0000 7f8bccff9640 1 -- 172.21.15.7:0/1606178589 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be0020070 con 0x55e636ad75d0 2024-09-19T08:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.668+0000 7f8bccff9640 1 -- 172.21.15.7:0/1606178589 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f8be0099f70 con 0x55e636ad75d0 2024-09-19T08:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.668+0000 7f8bed809740 1 -- 172.21.15.7:0/1606178589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bd400bda0 con 0x55e636ad75d0 2024-09-19T08:50:33.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.668+0000 7f8bccff9640 1 -- 172.21.15.7:0/1606178589 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8be009ba40 con 0x55e636ad75d0 2024-09-19T08:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.668+0000 7f8bed809740 10 client.16524 fetch_fsmap learned FSMap version 25 2024-09-19T08:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.668+0000 7f8bed809740 1 -- 172.21.15.7:0/1606178589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e636b5cb40 con 0x55e636ad75d0 2024-09-19T08:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.668+0000 7f8bccff9640 1 -- 172.21.15.7:0/1606178589 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bd400bda0 con 0x55e636ad75d0 2024-09-19T08:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.668+0000 7f8bccff9640 1 -- 172.21.15.7:0/1606178589 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8be0086270 con 0x55e636ad75d0 2024-09-19T08:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.668+0000 7f8bed809740 10 client.16524 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.668+0000 7f8bed809740 10 client.16524 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.668+0000 7f8bed809740 20 client.16524 populate_metadata read hostname 'smithi007' 2024-09-19T08:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.668+0000 7f8bed809740 1 --2- 172.21.15.7:0/1606178589 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55e636b5d070 0x55e636b5f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.669+0000 7f8bed809740 4 client.16524 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.669+0000 7f8bed809740 1 -- 172.21.15.7:0/1606178589 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e636a44d70 con 0x55e636b5d070 2024-09-19T08:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.669+0000 7f8be89cb640 1 --2- 172.21.15.7:0/1606178589 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55e636b5d070 0x55e636b5f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.669+0000 7f8be89cb640 1 --2- 172.21.15.7:0/1606178589 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55e636b5d070 0x55e636b5f460 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=653ccf67e1b79a81 server_cookie=11ba147a5844eebf in_seq=0 out_seq=0 2024-09-19T08:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.669+0000 7f8bccff9640 10 client.16524 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:50:33.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.669+0000 7f8bccff9640 1 -- 172.21.15.7:0/1606178589 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e636a44d70 con 0x55e636b5d070 2024-09-19T08:50:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.669+0000 7f8bccff9640 10 client.16524 handle_command_reply: tid=0 2024-09-19T08:50:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.669+0000 7f8bed809740 1 client.16524 shutdown 2024-09-19T08:50:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.669+0000 7f8bed809740 1 -- 172.21.15.7:0/1606178589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ad75d0 msgr2=0x55e636aeaa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.669+0000 7f8bed809740 1 --2- 172.21.15.7:0/1606178589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ad75d0 0x55e636aeaa90 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f8be009be30 tx=0x7f8be009b7b0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.670+0000 7f8bed809740 1 -- 172.21.15.7:0/1606178589 shutdown_connections 2024-09-19T08:50:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.670+0000 7f8bed809740 1 --2- 172.21.15.7:0/1606178589 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55e636b5d070 0x55e636b5f460 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.670+0000 7f8bed809740 1 --2- 172.21.15.7:0/1606178589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e636ae2370 0x55e636adc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.670+0000 7f8bed809740 1 --2- 172.21.15.7:0/1606178589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e636ad8b40 0x55e636adbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.670+0000 7f8bed809740 1 --2- 172.21.15.7:0/1606178589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e636ad75d0 0x55e636aeaa90 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.670+0000 7f8bed809740 1 -- 172.21.15.7:0/1606178589 >> 172.21.15.7:0/1606178589 conn(0x55e636aa0310 msgr2=0x55e636aed300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.670+0000 7f8bccff9640 0 client.16524 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:50:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.670+0000 7f8bed809740 1 -- 172.21.15.7:0/1606178589 shutdown_connections 2024-09-19T08:50:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.670+0000 7f8bed809740 1 -- 172.21.15.7:0/1606178589 wait complete. 2024-09-19T08:50:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.670+0000 7f8bed809740 20 client.16524 trim_cache size 0 max 16384 2024-09-19T08:50:33.680 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:50:33.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.670+0000 7f8beb430640 1 -- 172.21.15.7:0/40067598 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8bd00a33b0 msgr2=0x7f8bd00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:33.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.670+0000 7f8beb430640 1 --2- 172.21.15.7:0/40067598 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8bd00a33b0 0x7f8bd00a5870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc006010 tx=0x7f8bdc004a80 comp rx=0 tx=0).stop 2024-09-19T08:50:33.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.670+0000 7f8beb430640 1 -- 172.21.15.7:0/40067598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8be41008d0 msgr2=0x7f8be419a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.670+0000 7f8beb430640 1 --2- 172.21.15.7:0/40067598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8be41008d0 0x7f8be419a6e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f8be000d950 tx=0x7f8be000de10 comp rx=0 tx=0).stop 2024-09-19T08:50:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.671+0000 7f8beb430640 1 -- 172.21.15.7:0/40067598 shutdown_connections 2024-09-19T08:50:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.671+0000 7f8beb430640 1 --2- 172.21.15.7:0/40067598 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8bd00a33b0 0x7f8bd00a5870 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.671+0000 7f8beb430640 1 --2- 172.21.15.7:0/40067598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8be410e480 0x7f8be419efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.671+0000 7f8beb430640 1 --2- 172.21.15.7:0/40067598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8be4101280 0x7f8be419ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.671+0000 7f8beb430640 1 --2- 172.21.15.7:0/40067598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8be41008d0 0x7f8be419a6e0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.671+0000 7f8beb430640 1 -- 172.21.15.7:0/40067598 >> 172.21.15.7:0/40067598 conn(0x7f8be40fc7a0 msgr2=0x7f8be40feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.671+0000 7f8beb430640 1 -- 172.21.15.7:0/40067598 shutdown_connections 2024-09-19T08:50:33.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:33.671+0000 7f8beb430640 1 -- 172.21.15.7:0/40067598 wait complete. 2024-09-19T08:50:34.490 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:50:34.746 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:35.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:34 smithi175 ceph-mon[35688]: pgmap v184: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:50:35.180 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:34 smithi007 ceph-mon[31221]: pgmap v184: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:50:35.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.264+0000 7f0c67eaf640 1 -- 172.21.15.7:0/3126439570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c60100a80 msgr2=0x7f0c60100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:35.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.264+0000 7f0c67eaf640 1 --2- 172.21.15.7:0/3126439570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c60100a80 0x7f0c60100ee0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f0c50009930 tx=0x7f0c5002a420 comp rx=0 tx=0).stop 2024-09-19T08:50:35.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.264+0000 7f0c67eaf640 1 -- 172.21.15.7:0/3126439570 shutdown_connections 2024-09-19T08:50:35.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.264+0000 7f0c67eaf640 1 --2- 172.21.15.7:0/3126439570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c60101420 0x7f0c6010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.264+0000 7f0c67eaf640 1 --2- 172.21.15.7:0/3126439570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c60100a80 0x7f0c60100ee0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.264+0000 7f0c67eaf640 1 --2- 172.21.15.7:0/3126439570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c60106a80 0x7f0c60106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.264+0000 7f0c67eaf640 1 -- 172.21.15.7:0/3126439570 >> 172.21.15.7:0/3126439570 conn(0x7f0c600fc7a0 msgr2=0x7f0c600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:35.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.264+0000 7f0c67eaf640 1 -- 172.21.15.7:0/3126439570 shutdown_connections 2024-09-19T08:50:35.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.264+0000 7f0c67eaf640 1 -- 172.21.15.7:0/3126439570 wait complete. 2024-09-19T08:50:35.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.265+0000 7f0c67eaf640 1 Processor -- start 2024-09-19T08:50:35.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.265+0000 7f0c67eaf640 1 -- start start 2024-09-19T08:50:35.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.265+0000 7f0c67eaf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c60100a80 0x7f0c601984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.265+0000 7f0c67eaf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c60101420 0x7f0c601989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.265+0000 7f0c67eaf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c60106a80 0x7f0c6019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.265+0000 7f0c67eaf640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0c60110e80 con 0x7f0c60101420 2024-09-19T08:50:35.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.265+0000 7f0c67eaf640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0c60110d00 con 0x7f0c60100a80 2024-09-19T08:50:35.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.265+0000 7f0c67eaf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0c60111000 con 0x7f0c60106a80 2024-09-19T08:50:35.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.265+0000 7f0c6544a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c60101420 0x7f0c601989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.265+0000 7f0c6544a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c60101420 0x7f0c601989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59468/0 (socket says 172.21.15.7:59468) 2024-09-19T08:50:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.265+0000 7f0c6544a640 1 -- 172.21.15.7:0/2843083430 learned_addr learned my addr 172.21.15.7:0/2843083430 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.265+0000 7f0c65c4b640 1 --2- 172.21.15.7:0/2843083430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c60100a80 0x7f0c601984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.266+0000 7f0c6644c640 1 --2- 172.21.15.7:0/2843083430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c60106a80 0x7f0c6019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.266+0000 7f0c6544a640 1 -- 172.21.15.7:0/2843083430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c60106a80 msgr2=0x7f0c6019cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.266+0000 7f0c6544a640 1 --2- 172.21.15.7:0/2843083430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c60106a80 0x7f0c6019cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.266+0000 7f0c6544a640 1 -- 172.21.15.7:0/2843083430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c60100a80 msgr2=0x7f0c601984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.266+0000 7f0c6544a640 1 --2- 172.21.15.7:0/2843083430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c60100a80 0x7f0c601984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.266+0000 7f0c6544a640 1 -- 172.21.15.7:0/2843083430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6019d450 con 0x7f0c60101420 2024-09-19T08:50:35.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.266+0000 7f0c6544a640 1 --2- 172.21.15.7:0/2843083430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c60101420 0x7f0c601989e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0c50009230 tx=0x7f0c50004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:35.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.266+0000 7f0c56ffd640 1 -- 172.21.15.7:0/2843083430 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5003f030 con 0x7f0c60101420 2024-09-19T08:50:35.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.266+0000 7f0c56ffd640 1 -- 172.21.15.7:0/2843083430 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c50003ad0 con 0x7f0c60101420 2024-09-19T08:50:35.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.266+0000 7f0c67eaf640 1 -- 172.21.15.7:0/2843083430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c6019d6e0 con 0x7f0c60101420 2024-09-19T08:50:35.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.266+0000 7f0c56ffd640 1 -- 172.21.15.7:0/2843083430 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50035070 con 0x7f0c60101420 2024-09-19T08:50:35.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.266+0000 7f0c67eaf640 1 -- 172.21.15.7:0/2843083430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c601a5020 con 0x7f0c60101420 2024-09-19T08:50:35.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.268+0000 7f0c56ffd640 1 -- 172.21.15.7:0/2843083430 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f0c50042030 con 0x7f0c60101420 2024-09-19T08:50:35.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.269+0000 7f0c6a288740 1 Processor -- start 2024-09-19T08:50:35.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.269+0000 7f0c6a288740 1 -- start start 2024-09-19T08:50:35.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.269+0000 7f0c6a288740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607e4699b40 0x5607e4698090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.269+0000 7f0c6a288740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e46985d0 0x5607e4698a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.269+0000 7f0c6a288740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e46a3370 0x5607e46a5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.269+0000 7f0c6a288740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5607e45fe2f0 con 0x5607e46a3370 2024-09-19T08:50:35.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.269+0000 7f0c6a288740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5607e45a5cf0 con 0x5607e46985d0 2024-09-19T08:50:35.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.269+0000 7f0c6a288740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5607e45fa2b0 con 0x5607e4699b40 2024-09-19T08:50:35.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.269+0000 7f0c56ffd640 1 --2- 172.21.15.7:0/2843083430 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0c4c0a33b0 0x7f0c4c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.269+0000 7f0c6544a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e46a3370 0x5607e46a5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.269+0000 7f0c6544a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e46a3370 0x5607e46a5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59474/0 (socket says 172.21.15.7:59474) 2024-09-19T08:50:35.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.270+0000 7f0c6544a640 1 -- 172.21.15.7:0/4262843976 learned_addr learned my addr 172.21.15.7:0/4262843976 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:35.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.270+0000 7f0c65c4b640 1 --2- 172.21.15.7:0/4262843976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e46985d0 0x5607e4698a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.270+0000 7f0c6644c640 1 --2- 172.21.15.7:0/4262843976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607e4699b40 0x5607e4698090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.270+0000 7f0c6644c640 1 --2- 172.21.15.7:0/2843083430 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0c4c0a33b0 0x7f0c4c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.270+0000 7f0c56ffd640 1 -- 172.21.15.7:0/2843083430 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f0c500f03b0 con 0x7f0c60101420 2024-09-19T08:50:35.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.270+0000 7f0c6544a640 1 -- 172.21.15.7:0/4262843976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607e4699b40 msgr2=0x5607e4698090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:35.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.270+0000 7f0c6544a640 1 --2- 172.21.15.7:0/4262843976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607e4699b40 0x5607e4698090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.270+0000 7f0c6544a640 1 -- 172.21.15.7:0/4262843976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e46985d0 msgr2=0x5607e4698a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:35.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.270+0000 7f0c6544a640 1 --2- 172.21.15.7:0/4262843976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e46985d0 0x5607e4698a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.270+0000 7f0c6544a640 1 -- 172.21.15.7:0/4262843976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607e458a3a0 con 0x5607e46a3370 2024-09-19T08:50:35.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.270+0000 7f0c65c4b640 1 --2- 172.21.15.7:0/4262843976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e46985d0 0x5607e4698a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:50:35.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.270+0000 7f0c6544a640 1 --2- 172.21.15.7:0/4262843976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e46a3370 0x5607e46a5760 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0c50000c00 tx=0x7f0c500b8a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459096ed19083576 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:35.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.270+0000 7f0c6644c640 1 --2- 172.21.15.7:0/2843083430 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0c4c0a33b0 0x7f0c4c0a5870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0c58005fd0 tx=0x7f0c580046c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:35.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.270+0000 7f0c4bfff640 1 -- 172.21.15.7:0/4262843976 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50049070 con 0x5607e46a3370 2024-09-19T08:50:35.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.270+0000 7f0c4bfff640 1 -- 172.21.15.7:0/4262843976 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c500bc680 con 0x5607e46a3370 2024-09-19T08:50:35.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.270+0000 7f0c4bfff640 1 -- 172.21.15.7:0/4262843976 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50003c80 con 0x5607e46a3370 2024-09-19T08:50:35.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.271+0000 7f0c6a288740 1 -- 172.21.15.7:0/4262843976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e46a3370 msgr2=0x5607e46a5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:35.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.271+0000 7f0c6a288740 1 --2- 172.21.15.7:0/4262843976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e46a3370 0x5607e46a5760 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0c50000c00 tx=0x7f0c500b8a50 comp rx=0 tx=0).stop 2024-09-19T08:50:35.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.271+0000 7f0c6a288740 1 -- 172.21.15.7:0/4262843976 shutdown_connections 2024-09-19T08:50:35.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.271+0000 7f0c6a288740 1 --2- 172.21.15.7:0/4262843976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e46a3370 0x5607e46a5760 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.271+0000 7f0c6a288740 1 --2- 172.21.15.7:0/4262843976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e46985d0 0x5607e4698a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.271+0000 7f0c6a288740 1 --2- 172.21.15.7:0/4262843976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607e4699b40 0x5607e4698090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.271+0000 7f0c6a288740 1 -- 172.21.15.7:0/4262843976 >> 172.21.15.7:0/4262843976 conn(0x5607e4661310 msgr2=0x5607e4694c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.271+0000 7f0c6a288740 1 -- 172.21.15.7:0/4262843976 shutdown_connections 2024-09-19T08:50:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.271+0000 7f0c6a288740 1 -- 172.21.15.7:0/4262843976 wait complete. 2024-09-19T08:50:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.272+0000 7f0c6a288740 1 -- start start 2024-09-19T08:50:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.272+0000 7f0c6a288740 1 Processor -- start 2024-09-19T08:50:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.272+0000 7f0c6a288740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607e46985d0 0x5607e46a2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.272+0000 7f0c6a288740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e4699b40 0x5607e46a0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.272+0000 7f0c6a288740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e46a3370 0x5607e46a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.272+0000 7f0c6a288740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5607e46a5e30 con 0x5607e4699b40 2024-09-19T08:50:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.272+0000 7f0c6a288740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5607e45b9060 con 0x5607e46a3370 2024-09-19T08:50:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.272+0000 7f0c6a288740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5607e46a5fb0 con 0x5607e46985d0 2024-09-19T08:50:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.272+0000 7f0c6a288740 10 client.0 _ll_register_callbacks cb 0x5607e430c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.272+0000 7f0c6544a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e4699b40 0x5607e46a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.272+0000 7f0c6544a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e4699b40 0x5607e46a0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59490/0 (socket says 172.21.15.7:59490) 2024-09-19T08:50:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.272+0000 7f0c6544a640 1 -- 172.21.15.7:0/752670454 learned_addr learned my addr 172.21.15.7:0/752670454 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.273+0000 7f0c6644c640 1 --2- 172.21.15.7:0/752670454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e46a3370 0x5607e46a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.273+0000 7f0c65c4b640 1 --2- 172.21.15.7:0/752670454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607e46985d0 0x5607e46a2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.273+0000 7f0c6544a640 1 -- 172.21.15.7:0/752670454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607e46985d0 msgr2=0x5607e46a2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.273+0000 7f0c6544a640 1 --2- 172.21.15.7:0/752670454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607e46985d0 0x5607e46a2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.273+0000 7f0c6544a640 1 -- 172.21.15.7:0/752670454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e46a3370 msgr2=0x5607e46a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.273+0000 7f0c6544a640 1 --2- 172.21.15.7:0/752670454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e46a3370 0x5607e46a07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.273+0000 7f0c6544a640 1 -- 172.21.15.7:0/752670454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607e436f3c0 con 0x5607e4699b40 2024-09-19T08:50:35.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.273+0000 7f0c65c4b640 1 --2- 172.21.15.7:0/752670454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607e46985d0 0x5607e46a2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:50:35.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.273+0000 7f0c6544a640 1 --2- 172.21.15.7:0/752670454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e4699b40 0x5607e46a0060 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f0c500bc610 tx=0x7f0c500bce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac36be55cb45001 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:35.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.273+0000 7f0c497fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:50:35.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.273+0000 7f0c497fa640 1 -- 172.21.15.7:0/752670454 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50049070 con 0x5607e4699b40 2024-09-19T08:50:35.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.273+0000 7f0c497fa640 1 -- 172.21.15.7:0/752670454 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f0c50003c80 con 0x5607e4699b40 2024-09-19T08:50:35.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.273+0000 7f0c6a288740 1 -- 172.21.15.7:0/752670454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c500bc680 con 0x5607e4699b40 2024-09-19T08:50:35.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.273+0000 7f0c497fa640 1 -- 172.21.15.7:0/752670454 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0c500c0a30 con 0x5607e4699b40 2024-09-19T08:50:35.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.273+0000 7f0c6a288740 10 client.16536 fetch_fsmap learned FSMap version 25 2024-09-19T08:50:35.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.273+0000 7f0c6a288740 1 -- 172.21.15.7:0/752670454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5607e46a5e30 con 0x5607e4699b40 2024-09-19T08:50:35.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.273+0000 7f0c497fa640 1 -- 172.21.15.7:0/752670454 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c500bc680 con 0x5607e4699b40 2024-09-19T08:50:35.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.274+0000 7f0c497fa640 1 -- 172.21.15.7:0/752670454 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0c500b8cf0 con 0x5607e4699b40 2024-09-19T08:50:35.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.274+0000 7f0c6a288740 10 client.16536 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:50:35.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.274+0000 7f0c6a288740 10 client.16536 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:50:35.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.274+0000 7f0c6a288740 20 client.16536 populate_metadata read hostname 'smithi007' 2024-09-19T08:50:35.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.274+0000 7f0c6a288740 1 --2- 172.21.15.7:0/752670454 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5607e46b2a50 0x5607e46b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.274+0000 7f0c6a288740 4 client.16536 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:50:35.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.274+0000 7f0c6a288740 1 -- 172.21.15.7:0/752670454 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607e460b860 con 0x5607e46b2a50 2024-09-19T08:50:35.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.274+0000 7f0c65c4b640 1 --2- 172.21.15.7:0/752670454 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5607e46b2a50 0x5607e46b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.274+0000 7f0c65c4b640 1 --2- 172.21.15.7:0/752670454 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5607e46b2a50 0x5607e46b4e80 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e4a689605073926c server_cookie=87c0bc21ddfddcf9 in_seq=0 out_seq=0 2024-09-19T08:50:35.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.274+0000 7f0c497fa640 10 client.16536 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:50:35.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.275+0000 7f0c497fa640 1 -- 172.21.15.7:0/752670454 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5607e460b860 con 0x5607e46b2a50 2024-09-19T08:50:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.275+0000 7f0c497fa640 10 client.16536 handle_command_reply: tid=0 2024-09-19T08:50:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.275+0000 7f0c6a288740 1 client.16536 shutdown 2024-09-19T08:50:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.275+0000 7f0c6a288740 1 -- 172.21.15.7:0/752670454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e4699b40 msgr2=0x5607e46a0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.275+0000 7f0c6a288740 1 --2- 172.21.15.7:0/752670454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e4699b40 0x5607e46a0060 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f0c500bc610 tx=0x7f0c500bce40 comp rx=0 tx=0).stop 2024-09-19T08:50:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.275+0000 7f0c6a288740 1 -- 172.21.15.7:0/752670454 shutdown_connections 2024-09-19T08:50:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.275+0000 7f0c6a288740 1 --2- 172.21.15.7:0/752670454 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5607e46b2a50 0x5607e46b4e80 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.275+0000 7f0c6a288740 1 --2- 172.21.15.7:0/752670454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e46a3370 0x5607e46a07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.276+0000 7f0c6a288740 1 --2- 172.21.15.7:0/752670454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e4699b40 0x5607e46a0060 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.276+0000 7f0c6a288740 1 --2- 172.21.15.7:0/752670454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607e46985d0 0x5607e46a2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.276+0000 7f0c6a288740 1 -- 172.21.15.7:0/752670454 >> 172.21.15.7:0/752670454 conn(0x5607e4661310 msgr2=0x5607e469a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:35.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.276+0000 7f0c497fa640 0 client.16536 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:50:35.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.276+0000 7f0c6a288740 1 -- 172.21.15.7:0/752670454 shutdown_connections 2024-09-19T08:50:35.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.276+0000 7f0c6a288740 1 -- 172.21.15.7:0/752670454 wait complete. 2024-09-19T08:50:35.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.276+0000 7f0c6a288740 20 client.16536 trim_cache size 0 max 16384 2024-09-19T08:50:35.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.289+0000 7f0c6a288740 1 Processor -- start 2024-09-19T08:50:35.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.289+0000 7f0c6a288740 1 -- start start 2024-09-19T08:50:35.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.289+0000 7f0c6a288740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607e46985d0 0x5607e4699300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.289+0000 7f0c6a288740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e4699b40 0x5607e469f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.289+0000 7f0c6a288740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e46a3370 0x5607e46a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.289+0000 7f0c6a288740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0c601b0130 con 0x5607e4699b40 2024-09-19T08:50:35.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.289+0000 7f0c6a288740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0c601ada00 con 0x5607e46a3370 2024-09-19T08:50:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.289+0000 7f0c6a288740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0c601ab850 con 0x5607e46985d0 2024-09-19T08:50:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.289+0000 7f0c6544a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e4699b40 0x5607e469f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.289+0000 7f0c6544a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e4699b40 0x5607e469f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59494/0 (socket says 172.21.15.7:59494) 2024-09-19T08:50:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.289+0000 7f0c6544a640 1 -- 172.21.15.7:0/2985305701 learned_addr learned my addr 172.21.15.7:0/2985305701 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.289+0000 7f0c65c4b640 1 --2- 172.21.15.7:0/2985305701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607e46985d0 0x5607e4699300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.289+0000 7f0c6544a640 1 -- 172.21.15.7:0/2985305701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607e46985d0 msgr2=0x5607e4699300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.289+0000 7f0c6644c640 1 --2- 172.21.15.7:0/2985305701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e46a3370 0x5607e46a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.289+0000 7f0c6544a640 1 --2- 172.21.15.7:0/2985305701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607e46985d0 0x5607e4699300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.289+0000 7f0c6544a640 1 -- 172.21.15.7:0/2985305701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e46a3370 msgr2=0x5607e46a1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.289+0000 7f0c6544a640 1 --2- 172.21.15.7:0/2985305701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e46a3370 0x5607e46a1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.289+0000 7f0c6544a640 1 -- 172.21.15.7:0/2985305701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607e46aef90 con 0x5607e4699b40 2024-09-19T08:50:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.289+0000 7f0c6644c640 1 --2- 172.21.15.7:0/2985305701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e46a3370 0x5607e46a1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:50:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.290+0000 7f0c6544a640 1 --2- 172.21.15.7:0/2985305701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e4699b40 0x5607e469f920 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f0c500b8ae0 tx=0x7f0c500bc580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99529eea99365819 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.290+0000 7f0c4b7fe640 1 -- 172.21.15.7:0/2985305701 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50049040 con 0x5607e4699b40 2024-09-19T08:50:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.290+0000 7f0c4b7fe640 1 -- 172.21.15.7:0/2985305701 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c500c52f0 con 0x5607e4699b40 2024-09-19T08:50:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.290+0000 7f0c4b7fe640 1 -- 172.21.15.7:0/2985305701 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c500b8cf0 con 0x5607e4699b40 2024-09-19T08:50:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.290+0000 7f0c6a288740 1 -- 172.21.15.7:0/2985305701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e4699b40 msgr2=0x5607e469f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.290+0000 7f0c6a288740 1 --2- 172.21.15.7:0/2985305701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e4699b40 0x5607e469f920 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f0c500b8ae0 tx=0x7f0c500bc580 comp rx=0 tx=0).stop 2024-09-19T08:50:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.290+0000 7f0c6a288740 1 -- 172.21.15.7:0/2985305701 shutdown_connections 2024-09-19T08:50:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.290+0000 7f0c6a288740 1 --2- 172.21.15.7:0/2985305701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e46a3370 0x5607e46a1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.290+0000 7f0c6a288740 1 --2- 172.21.15.7:0/2985305701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e4699b40 0x5607e469f920 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.290+0000 7f0c6a288740 1 --2- 172.21.15.7:0/2985305701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607e46985d0 0x5607e4699300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.290+0000 7f0c6a288740 1 -- 172.21.15.7:0/2985305701 >> 172.21.15.7:0/2985305701 conn(0x5607e4661310 msgr2=0x5607e46a18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.291+0000 7f0c6a288740 1 -- 172.21.15.7:0/2985305701 shutdown_connections 2024-09-19T08:50:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.291+0000 7f0c6a288740 1 -- 172.21.15.7:0/2985305701 wait complete. 2024-09-19T08:50:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.291+0000 7f0c6a288740 1 -- start start 2024-09-19T08:50:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.291+0000 7f0c6a288740 1 Processor -- start 2024-09-19T08:50:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.291+0000 7f0c6a288740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e46985d0 0x5607e46ab710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.291+0000 7f0c6a288740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607e4699b40 0x5607e46a6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.292+0000 7f0c6a288740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e46a3370 0x5607e46a6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.292+0000 7f0c6a288740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0c601abec0 con 0x5607e46a3370 2024-09-19T08:50:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.292+0000 7f0c6a288740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0c601ad330 con 0x5607e46985d0 2024-09-19T08:50:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.292+0000 7f0c6a288740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0c601ac590 con 0x5607e4699b40 2024-09-19T08:50:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.292+0000 7f0c6a288740 10 client.0 _ll_register_callbacks cb 0x7f0c5c009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.292+0000 7f0c6644c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e46a3370 0x5607e46a6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.292+0000 7f0c6644c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e46a3370 0x5607e46a6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59504/0 (socket says 172.21.15.7:59504) 2024-09-19T08:50:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.292+0000 7f0c65c4b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e46985d0 0x5607e46ab710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.292+0000 7f0c6644c640 1 -- 172.21.15.7:0/3743313071 learned_addr learned my addr 172.21.15.7:0/3743313071 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.292+0000 7f0c6544a640 1 --2- 172.21.15.7:0/3743313071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607e4699b40 0x5607e46a6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.292+0000 7f0c6644c640 1 -- 172.21.15.7:0/3743313071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607e4699b40 msgr2=0x5607e46a6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:35.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.292+0000 7f0c6644c640 1 --2- 172.21.15.7:0/3743313071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607e4699b40 0x5607e46a6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.292+0000 7f0c6644c640 1 -- 172.21.15.7:0/3743313071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e46985d0 msgr2=0x5607e46ab710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:35.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.292+0000 7f0c6644c640 1 --2- 172.21.15.7:0/3743313071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e46985d0 0x5607e46ab710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.292+0000 7f0c6644c640 1 -- 172.21.15.7:0/3743313071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607e46a7670 con 0x5607e46a3370 2024-09-19T08:50:35.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.292+0000 7f0c6644c640 1 --2- 172.21.15.7:0/3743313071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e46a3370 0x5607e46a6f80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0c58010d30 tx=0x7f0c5800e370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef04a049755fb90e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:35.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.292+0000 7f0c497fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:50:35.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.292+0000 7f0c497fa640 1 -- 172.21.15.7:0/3743313071 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c58013480 con 0x5607e46a3370 2024-09-19T08:50:35.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.292+0000 7f0c497fa640 1 -- 172.21.15.7:0/3743313071 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f0c58005020 con 0x5607e46a3370 2024-09-19T08:50:35.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.292+0000 7f0c6a288740 1 -- 172.21.15.7:0/3743313071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c500c52f0 con 0x5607e46a3370 2024-09-19T08:50:35.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.292+0000 7f0c497fa640 1 -- 172.21.15.7:0/3743313071 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0c58005220 con 0x5607e46a3370 2024-09-19T08:50:35.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.293+0000 7f0c6a288740 10 client.16542 fetch_fsmap learned FSMap version 25 2024-09-19T08:50:35.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.293+0000 7f0c6a288740 1 -- 172.21.15.7:0/3743313071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5607e471d550 con 0x5607e46a3370 2024-09-19T08:50:35.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.293+0000 7f0c497fa640 1 -- 172.21.15.7:0/3743313071 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c500c52f0 con 0x5607e46a3370 2024-09-19T08:50:35.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.293+0000 7f0c497fa640 1 -- 172.21.15.7:0/3743313071 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0c5801c040 con 0x5607e46a3370 2024-09-19T08:50:35.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.293+0000 7f0c6a288740 10 client.16542 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:50:35.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.293+0000 7f0c6a288740 10 client.16542 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:50:35.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.293+0000 7f0c6a288740 20 client.16542 populate_metadata read hostname 'smithi007' 2024-09-19T08:50:35.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.293+0000 7f0c6a288740 1 --2- 172.21.15.7:0/3743313071 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5607e471dd20 0x5607e4720140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:35.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.293+0000 7f0c6a288740 4 client.16542 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:50:35.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.293+0000 7f0c6a288740 1 -- 172.21.15.7:0/3743313071 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5607e4605d70 con 0x5607e471dd20 2024-09-19T08:50:35.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.293+0000 7f0c65c4b640 1 --2- 172.21.15.7:0/3743313071 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5607e471dd20 0x5607e4720140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:35.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.294+0000 7f0c65c4b640 1 --2- 172.21.15.7:0/3743313071 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5607e471dd20 0x5607e4720140 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b78d72f470b921a5 server_cookie=95ceb153127f2033 in_seq=0 out_seq=0 2024-09-19T08:50:35.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.294+0000 7f0c497fa640 10 client.16542 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:50:35.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.294+0000 7f0c497fa640 1 -- 172.21.15.7:0/3743313071 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5607e4605d70 con 0x5607e471dd20 2024-09-19T08:50:35.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.294+0000 7f0c497fa640 10 client.16542 handle_command_reply: tid=0 2024-09-19T08:50:35.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.294+0000 7f0c6a288740 1 client.16542 shutdown 2024-09-19T08:50:35.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.294+0000 7f0c6a288740 1 -- 172.21.15.7:0/3743313071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e46a3370 msgr2=0x5607e46a6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:35.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.294+0000 7f0c6a288740 1 --2- 172.21.15.7:0/3743313071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e46a3370 0x5607e46a6f80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0c58010d30 tx=0x7f0c5800e370 comp rx=0 tx=0).stop 2024-09-19T08:50:35.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.294+0000 7f0c6a288740 1 -- 172.21.15.7:0/3743313071 shutdown_connections 2024-09-19T08:50:35.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.294+0000 7f0c6a288740 1 --2- 172.21.15.7:0/3743313071 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5607e471dd20 0x5607e4720140 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.294+0000 7f0c6a288740 1 --2- 172.21.15.7:0/3743313071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5607e46a3370 0x5607e46a6f80 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.294+0000 7f0c6a288740 1 --2- 172.21.15.7:0/3743313071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5607e4699b40 0x5607e46a6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.294+0000 7f0c6a288740 1 --2- 172.21.15.7:0/3743313071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e46985d0 0x5607e46ab710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.294+0000 7f0c497fa640 0 client.16542 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:50:35.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.294+0000 7f0c6a288740 1 -- 172.21.15.7:0/3743313071 >> 172.21.15.7:0/3743313071 conn(0x5607e4661310 msgr2=0x5607e469e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:35.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.294+0000 7f0c6a288740 1 -- 172.21.15.7:0/3743313071 shutdown_connections 2024-09-19T08:50:35.322 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:50:35.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.294+0000 7f0c6a288740 1 -- 172.21.15.7:0/3743313071 wait complete. 2024-09-19T08:50:35.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.294+0000 7f0c6a288740 20 client.16542 trim_cache size 0 max 16384 2024-09-19T08:50:35.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.295+0000 7f0c67eaf640 1 -- 172.21.15.7:0/2843083430 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0c4c0a33b0 msgr2=0x7f0c4c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:35.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.295+0000 7f0c67eaf640 1 --2- 172.21.15.7:0/2843083430 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0c4c0a33b0 0x7f0c4c0a5870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0c58005fd0 tx=0x7f0c580046c0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.295+0000 7f0c67eaf640 1 -- 172.21.15.7:0/2843083430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c60101420 msgr2=0x7f0c601989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.295+0000 7f0c67eaf640 1 --2- 172.21.15.7:0/2843083430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c60101420 0x7f0c601989e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0c50009230 tx=0x7f0c50004270 comp rx=0 tx=0).stop 2024-09-19T08:50:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.295+0000 7f0c67eaf640 1 -- 172.21.15.7:0/2843083430 shutdown_connections 2024-09-19T08:50:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.295+0000 7f0c67eaf640 1 --2- 172.21.15.7:0/2843083430 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0c4c0a33b0 0x7f0c4c0a5870 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.295+0000 7f0c67eaf640 1 --2- 172.21.15.7:0/2843083430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c60106a80 0x7f0c6019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.295+0000 7f0c67eaf640 1 --2- 172.21.15.7:0/2843083430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c60101420 0x7f0c601989e0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.295+0000 7f0c67eaf640 1 --2- 172.21.15.7:0/2843083430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c60100a80 0x7f0c601984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.295+0000 7f0c67eaf640 1 -- 172.21.15.7:0/2843083430 >> 172.21.15.7:0/2843083430 conn(0x7f0c600fc7a0 msgr2=0x7f0c6006aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.295+0000 7f0c67eaf640 1 -- 172.21.15.7:0/2843083430 shutdown_connections 2024-09-19T08:50:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:35.295+0000 7f0c67eaf640 1 -- 172.21.15.7:0/2843083430 wait complete. 2024-09-19T08:50:35.324 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:34 smithi044 ceph-mon[35072]: pgmap v184: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:50:35.956 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:50:36.214 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:36.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.672+0000 7f884290a640 1 -- 172.21.15.7:0/2574772376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f883c102da0 msgr2=0x7f883c103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:36.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.672+0000 7f884290a640 1 --2- 172.21.15.7:0/2574772376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f883c102da0 0x7f883c103180 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f882c009900 tx=0x7f882c02a480 comp rx=0 tx=0).stop 2024-09-19T08:50:36.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.673+0000 7f884290a640 1 -- 172.21.15.7:0/2574772376 shutdown_connections 2024-09-19T08:50:36.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.673+0000 7f884290a640 1 --2- 172.21.15.7:0/2574772376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f883c10c180 0x7f883c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.673+0000 7f884290a640 1 --2- 172.21.15.7:0/2574772376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f883c1036c0 0x7f883c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.673+0000 7f884290a640 1 --2- 172.21.15.7:0/2574772376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f883c102da0 0x7f883c103180 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.673+0000 7f884290a640 1 -- 172.21.15.7:0/2574772376 >> 172.21.15.7:0/2574772376 conn(0x7f883c0fc7a0 msgr2=0x7f883c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:36.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.673+0000 7f884290a640 1 -- 172.21.15.7:0/2574772376 shutdown_connections 2024-09-19T08:50:36.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.673+0000 7f884290a640 1 -- 172.21.15.7:0/2574772376 wait complete. 2024-09-19T08:50:36.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.673+0000 7f884290a640 1 Processor -- start 2024-09-19T08:50:36.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.673+0000 7f884290a640 1 -- start start 2024-09-19T08:50:36.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.674+0000 7f884290a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f883c102da0 0x7f883c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:36.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.674+0000 7f884290a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f883c1036c0 0x7f883c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:36.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.674+0000 7f884290a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f883c10c180 0x7f883c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:36.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.674+0000 7f884290a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f883c111fb0 con 0x7f883c1036c0 2024-09-19T08:50:36.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.674+0000 7f884290a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f883c111e30 con 0x7f883c10c180 2024-09-19T08:50:36.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.674+0000 7f884290a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f883c112130 con 0x7f883c102da0 2024-09-19T08:50:36.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.674+0000 7f883b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f883c1036c0 0x7f883c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:36.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.674+0000 7f883b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f883c1036c0 0x7f883c198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59522/0 (socket says 172.21.15.7:59522) 2024-09-19T08:50:36.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.674+0000 7f883b7fe640 1 -- 172.21.15.7:0/933495452 learned_addr learned my addr 172.21.15.7:0/933495452 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:36.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.674+0000 7f883bfff640 1 --2- 172.21.15.7:0/933495452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f883c102da0 0x7f883c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:36.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.674+0000 7f8840ea7640 1 --2- 172.21.15.7:0/933495452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f883c10c180 0x7f883c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:36.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.674+0000 7f883b7fe640 1 -- 172.21.15.7:0/933495452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f883c102da0 msgr2=0x7f883c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:36.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.674+0000 7f883b7fe640 1 --2- 172.21.15.7:0/933495452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f883c102da0 0x7f883c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.674+0000 7f883b7fe640 1 -- 172.21.15.7:0/933495452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f883c10c180 msgr2=0x7f883c19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:36.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.674+0000 7f883b7fe640 1 --2- 172.21.15.7:0/933495452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f883c10c180 0x7f883c19cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.674+0000 7f883b7fe640 1 -- 172.21.15.7:0/933495452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f883c19d3c0 con 0x7f883c1036c0 2024-09-19T08:50:36.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.674+0000 7f883b7fe640 1 --2- 172.21.15.7:0/933495452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f883c1036c0 0x7f883c198950 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f883000c920 tx=0x7f883000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:36.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.675+0000 7f88397fa640 1 -- 172.21.15.7:0/933495452 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830007c70 con 0x7f883c1036c0 2024-09-19T08:50:36.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.675+0000 7f884290a640 1 -- 172.21.15.7:0/933495452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f883c19d6b0 con 0x7f883c1036c0 2024-09-19T08:50:36.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.675+0000 7f88397fa640 1 -- 172.21.15.7:0/933495452 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8830007e10 con 0x7f883c1036c0 2024-09-19T08:50:36.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.675+0000 7f88397fa640 1 -- 172.21.15.7:0/933495452 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830018890 con 0x7f883c1036c0 2024-09-19T08:50:36.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.675+0000 7f884290a640 1 -- 172.21.15.7:0/933495452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f883c1a4f90 con 0x7f883c1036c0 2024-09-19T08:50:36.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.677+0000 7f88397fa640 1 -- 172.21.15.7:0/933495452 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8830018a70 con 0x7f883c1036c0 2024-09-19T08:50:36.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.677+0000 7f8844ce3740 1 Processor -- start 2024-09-19T08:50:36.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.678+0000 7f8844ce3740 1 -- start start 2024-09-19T08:50:36.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.678+0000 7f8844ce3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3ebabb40 0x559f3ebaa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:36.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.678+0000 7f8844ce3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebaa5d0 0x559f3ebaaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:36.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.678+0000 7f8844ce3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3ebb5370 0x559f3ebb7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:36.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.678+0000 7f8844ce3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559f3eb102f0 con 0x559f3ebaa5d0 2024-09-19T08:50:36.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.678+0000 7f8844ce3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559f3eab7cf0 con 0x559f3ebabb40 2024-09-19T08:50:36.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.678+0000 7f8844ce3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559f3eb0c2b0 con 0x559f3ebb5370 2024-09-19T08:50:36.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.678+0000 7f883bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebaa5d0 0x559f3ebaaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:36.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.678+0000 7f883bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebaa5d0 0x559f3ebaaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59526/0 (socket says 172.21.15.7:59526) 2024-09-19T08:50:36.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.678+0000 7f883bfff640 1 -- 172.21.15.7:0/1043384158 learned_addr learned my addr 172.21.15.7:0/1043384158 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:36.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.678+0000 7f88397fa640 1 --2- 172.21.15.7:0/933495452 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f88240a33b0 0x7f88240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:36.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.678+0000 7f8840ea7640 1 --2- 172.21.15.7:0/1043384158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3ebabb40 0x559f3ebaa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:36.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.678+0000 7f883b7fe640 1 --2- 172.21.15.7:0/1043384158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3ebb5370 0x559f3ebb7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:36.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.678+0000 7f8840ea7640 1 --2- 172.21.15.7:0/933495452 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f88240a33b0 0x7f88240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:36.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.678+0000 7f883bfff640 1 -- 172.21.15.7:0/1043384158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3ebb5370 msgr2=0x559f3ebb7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:36.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.678+0000 7f883bfff640 1 --2- 172.21.15.7:0/1043384158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3ebb5370 0x559f3ebb7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.678+0000 7f883bfff640 1 -- 172.21.15.7:0/1043384158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3ebabb40 msgr2=0x559f3ebaa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.678+0000 7f883bfff640 1 --2- 172.21.15.7:0/1043384158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3ebabb40 0x559f3ebaa090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.678+0000 7f883bfff640 1 -- 172.21.15.7:0/1043384158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f3ea9c3a0 con 0x559f3ebaa5d0 2024-09-19T08:50:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.678+0000 7f883b7fe640 1 --2- 172.21.15.7:0/1043384158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3ebb5370 0x559f3ebb7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:50:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.678+0000 7f88397fa640 1 -- 172.21.15.7:0/933495452 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f88300cfe30 con 0x7f883c1036c0 2024-09-19T08:50:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.679+0000 7f883bfff640 1 --2- 172.21.15.7:0/1043384158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebaa5d0 0x559f3ebaaa10 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f882c031550 tx=0x7f882c0041a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0884e5427af8eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.679+0000 7f8840ea7640 1 --2- 172.21.15.7:0/933495452 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f88240a33b0 0x7f88240a5870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8834005fd0 tx=0x7f8834009600 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.679+0000 7f88227fc640 1 -- 172.21.15.7:0/1043384158 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c035040 con 0x559f3ebaa5d0 2024-09-19T08:50:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.679+0000 7f88227fc640 1 -- 172.21.15.7:0/1043384158 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f882c005520 con 0x559f3ebaa5d0 2024-09-19T08:50:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.679+0000 7f88227fc640 1 -- 172.21.15.7:0/1043384158 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c003810 con 0x559f3ebaa5d0 2024-09-19T08:50:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.679+0000 7f8844ce3740 1 -- 172.21.15.7:0/1043384158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebaa5d0 msgr2=0x559f3ebaaa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.679+0000 7f8844ce3740 1 --2- 172.21.15.7:0/1043384158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebaa5d0 0x559f3ebaaa10 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f882c031550 tx=0x7f882c0041a0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.679+0000 7f8844ce3740 1 -- 172.21.15.7:0/1043384158 shutdown_connections 2024-09-19T08:50:36.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.680+0000 7f8844ce3740 1 --2- 172.21.15.7:0/1043384158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3ebb5370 0x559f3ebb7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.680+0000 7f8844ce3740 1 --2- 172.21.15.7:0/1043384158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebaa5d0 0x559f3ebaaa10 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.680+0000 7f8844ce3740 1 --2- 172.21.15.7:0/1043384158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3ebabb40 0x559f3ebaa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.680+0000 7f8844ce3740 1 -- 172.21.15.7:0/1043384158 >> 172.21.15.7:0/1043384158 conn(0x559f3eb73310 msgr2=0x559f3eba6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:36.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.680+0000 7f8844ce3740 1 -- 172.21.15.7:0/1043384158 shutdown_connections 2024-09-19T08:50:36.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.680+0000 7f8844ce3740 1 -- 172.21.15.7:0/1043384158 wait complete. 2024-09-19T08:50:36.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.680+0000 7f8844ce3740 1 -- start start 2024-09-19T08:50:36.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.680+0000 7f8844ce3740 1 Processor -- start 2024-09-19T08:50:36.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.680+0000 7f8844ce3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebaa5d0 0x559f3ebb4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:36.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.680+0000 7f8844ce3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3ebabb40 0x559f3ebb1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:36.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.680+0000 7f8844ce3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3ebb5370 0x559f3ebb25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:36.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.680+0000 7f8844ce3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559f3ebb8010 con 0x559f3ebaa5d0 2024-09-19T08:50:36.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.680+0000 7f8844ce3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559f3eacb060 con 0x559f3ebb5370 2024-09-19T08:50:36.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.680+0000 7f8844ce3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559f3ebb8190 con 0x559f3ebabb40 2024-09-19T08:50:36.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.680+0000 7f8844ce3740 10 client.0 _ll_register_callbacks cb 0x559f3e81e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:36.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.680+0000 7f883bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebaa5d0 0x559f3ebb4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:36.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.681+0000 7f883bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebaa5d0 0x559f3ebb4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59538/0 (socket says 172.21.15.7:59538) 2024-09-19T08:50:36.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.681+0000 7f883bfff640 1 -- 172.21.15.7:0/1314190186 learned_addr learned my addr 172.21.15.7:0/1314190186 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:36.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.681+0000 7f883b7fe640 1 --2- 172.21.15.7:0/1314190186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3ebabb40 0x559f3ebb1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:36.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.681+0000 7f8840ea7640 1 --2- 172.21.15.7:0/1314190186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3ebb5370 0x559f3ebb25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:36.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.681+0000 7f883bfff640 1 -- 172.21.15.7:0/1314190186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3ebabb40 msgr2=0x559f3ebb1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:36.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.681+0000 7f883bfff640 1 --2- 172.21.15.7:0/1314190186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3ebabb40 0x559f3ebb1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.681+0000 7f883bfff640 1 -- 172.21.15.7:0/1314190186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3ebb5370 msgr2=0x559f3ebb25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:36.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.681+0000 7f883bfff640 1 --2- 172.21.15.7:0/1314190186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3ebb5370 0x559f3ebb25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.681+0000 7f883bfff640 1 -- 172.21.15.7:0/1314190186 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f3e8813c0 con 0x559f3ebaa5d0 2024-09-19T08:50:36.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.681+0000 7f8840ea7640 1 --2- 172.21.15.7:0/1314190186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3ebb5370 0x559f3ebb25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:50:36.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.681+0000 7f883bfff640 1 --2- 172.21.15.7:0/1314190186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebaa5d0 0x559f3ebb4d40 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f882c0096c0 tx=0x7f882c005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b99567b519544b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:36.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.681+0000 7f881b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:50:36.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.681+0000 7f881b7fe640 1 -- 172.21.15.7:0/1314190186 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c035070 con 0x559f3ebaa5d0 2024-09-19T08:50:36.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.681+0000 7f881b7fe640 1 -- 172.21.15.7:0/1314190186 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f882c0048d0 con 0x559f3ebaa5d0 2024-09-19T08:50:36.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.681+0000 7f8844ce3740 1 -- 172.21.15.7:0/1314190186 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f882c005520 con 0x559f3ebaa5d0 2024-09-19T08:50:36.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.681+0000 7f881b7fe640 1 -- 172.21.15.7:0/1314190186 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f882c049070 con 0x559f3ebaa5d0 2024-09-19T08:50:36.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.681+0000 7f8844ce3740 10 client.16554 fetch_fsmap learned FSMap version 25 2024-09-19T08:50:36.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.681+0000 7f8844ce3740 1 -- 172.21.15.7:0/1314190186 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559f3ebc39f0 con 0x559f3ebaa5d0 2024-09-19T08:50:36.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.682+0000 7f881b7fe640 1 -- 172.21.15.7:0/1314190186 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f882c005520 con 0x559f3ebaa5d0 2024-09-19T08:50:36.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.682+0000 7f881b7fe640 1 -- 172.21.15.7:0/1314190186 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f882c003680 con 0x559f3ebaa5d0 2024-09-19T08:50:36.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.682+0000 7f8844ce3740 10 client.16554 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:50:36.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.682+0000 7f8844ce3740 10 client.16554 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:50:36.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.682+0000 7f8844ce3740 20 client.16554 populate_metadata read hostname 'smithi007' 2024-09-19T08:50:36.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.682+0000 7f8844ce3740 1 --2- 172.21.15.7:0/1314190186 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559f3ebc4d40 0x559f3ebc7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:36.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.682+0000 7f8844ce3740 4 client.16554 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:50:36.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.682+0000 7f8844ce3740 1 -- 172.21.15.7:0/1314190186 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f3eb1d860 con 0x559f3ebc4d40 2024-09-19T08:50:36.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.682+0000 7f883b7fe640 1 --2- 172.21.15.7:0/1314190186 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559f3ebc4d40 0x559f3ebc7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:36.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.683+0000 7f883b7fe640 1 --2- 172.21.15.7:0/1314190186 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559f3ebc4d40 0x559f3ebc7130 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10921a3f0daa25dc server_cookie=de872c887ee02db4 in_seq=0 out_seq=0 2024-09-19T08:50:36.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.683+0000 7f881b7fe640 10 client.16554 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:36.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.683+0000 7f881b7fe640 1 -- 172.21.15.7:0/1314190186 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f3eb1d860 con 0x559f3ebc4d40 2024-09-19T08:50:36.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.683+0000 7f881b7fe640 10 client.16554 handle_command_reply: tid=0 2024-09-19T08:50:36.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.683+0000 7f8844ce3740 1 client.16554 shutdown 2024-09-19T08:50:36.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.683+0000 7f8844ce3740 1 -- 172.21.15.7:0/1314190186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebaa5d0 msgr2=0x559f3ebb4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:36.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.683+0000 7f8844ce3740 1 --2- 172.21.15.7:0/1314190186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebaa5d0 0x559f3ebb4d40 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f882c0096c0 tx=0x7f882c005250 comp rx=0 tx=0).stop 2024-09-19T08:50:36.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.684+0000 7f8844ce3740 1 -- 172.21.15.7:0/1314190186 shutdown_connections 2024-09-19T08:50:36.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.684+0000 7f8844ce3740 1 --2- 172.21.15.7:0/1314190186 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559f3ebc4d40 0x559f3ebc7130 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.684+0000 7f8844ce3740 1 --2- 172.21.15.7:0/1314190186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3ebb5370 0x559f3ebb25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.684+0000 7f8844ce3740 1 --2- 172.21.15.7:0/1314190186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3ebabb40 0x559f3ebb1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.684+0000 7f881b7fe640 0 client.16554 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:36.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.684+0000 7f8844ce3740 1 --2- 172.21.15.7:0/1314190186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebaa5d0 0x559f3ebb4d40 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.684+0000 7f8844ce3740 1 -- 172.21.15.7:0/1314190186 >> 172.21.15.7:0/1314190186 conn(0x559f3eb73310 msgr2=0x559f3ebac930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:36.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.684+0000 7f8844ce3740 1 -- 172.21.15.7:0/1314190186 shutdown_connections 2024-09-19T08:50:36.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.684+0000 7f8844ce3740 1 -- 172.21.15.7:0/1314190186 wait complete. 2024-09-19T08:50:36.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.684+0000 7f8844ce3740 20 client.16554 trim_cache size 0 max 16384 2024-09-19T08:50:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.697+0000 7f8844ce3740 1 Processor -- start 2024-09-19T08:50:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.697+0000 7f8844ce3740 1 -- start start 2024-09-19T08:50:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.697+0000 7f8844ce3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebaa5d0 0x559f3ebad120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.697+0000 7f8844ce3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3ebabb40 0x559f3ebad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.697+0000 7f8844ce3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3ebb5370 0x559f3ebaf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.697+0000 7f8844ce3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f883c1b0070 con 0x559f3ebaa5d0 2024-09-19T08:50:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.697+0000 7f8844ce3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f883c1ad940 con 0x559f3ebb5370 2024-09-19T08:50:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.697+0000 7f8844ce3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f883c1ab790 con 0x559f3ebabb40 2024-09-19T08:50:36.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.697+0000 7f883bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebaa5d0 0x559f3ebad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.697+0000 7f883bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebaa5d0 0x559f3ebad120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59550/0 (socket says 172.21.15.7:59550) 2024-09-19T08:50:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.697+0000 7f883bfff640 1 -- 172.21.15.7:0/1302281558 learned_addr learned my addr 172.21.15.7:0/1302281558 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.698+0000 7f8840ea7640 1 --2- 172.21.15.7:0/1302281558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3ebb5370 0x559f3ebaf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.698+0000 7f883b7fe640 1 --2- 172.21.15.7:0/1302281558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3ebabb40 0x559f3ebad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.698+0000 7f883bfff640 1 -- 172.21.15.7:0/1302281558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3ebabb40 msgr2=0x559f3ebad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.698+0000 7f883bfff640 1 --2- 172.21.15.7:0/1302281558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3ebabb40 0x559f3ebad660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.698+0000 7f883bfff640 1 -- 172.21.15.7:0/1302281558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3ebb5370 msgr2=0x559f3ebaf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.698+0000 7f883bfff640 1 --2- 172.21.15.7:0/1302281558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3ebb5370 0x559f3ebaf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.698+0000 7f883bfff640 1 -- 172.21.15.7:0/1302281558 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f3ebb2950 con 0x559f3ebaa5d0 2024-09-19T08:50:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.698+0000 7f883bfff640 1 --2- 172.21.15.7:0/1302281558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebaa5d0 0x559f3ebad120 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f882c000c00 tx=0x7f882c004e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ed9af3d6fd23e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.698+0000 7f8821ffb640 1 -- 172.21.15.7:0/1302281558 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c035070 con 0x559f3ebaa5d0 2024-09-19T08:50:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.698+0000 7f8821ffb640 1 -- 172.21.15.7:0/1302281558 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f882c05a070 con 0x559f3ebaa5d0 2024-09-19T08:50:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.698+0000 7f8821ffb640 1 -- 172.21.15.7:0/1302281558 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c0315b0 con 0x559f3ebaa5d0 2024-09-19T08:50:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.699+0000 7f8844ce3740 1 -- 172.21.15.7:0/1302281558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebaa5d0 msgr2=0x559f3ebad120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.699+0000 7f8844ce3740 1 --2- 172.21.15.7:0/1302281558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebaa5d0 0x559f3ebad120 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f882c000c00 tx=0x7f882c004e00 comp rx=0 tx=0).stop 2024-09-19T08:50:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.699+0000 7f8844ce3740 1 -- 172.21.15.7:0/1302281558 shutdown_connections 2024-09-19T08:50:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.699+0000 7f8844ce3740 1 --2- 172.21.15.7:0/1302281558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3ebb5370 0x559f3ebaf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.699+0000 7f8844ce3740 1 --2- 172.21.15.7:0/1302281558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3ebabb40 0x559f3ebad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.699+0000 7f8844ce3740 1 --2- 172.21.15.7:0/1302281558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebaa5d0 0x559f3ebad120 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.699+0000 7f8844ce3740 1 -- 172.21.15.7:0/1302281558 >> 172.21.15.7:0/1302281558 conn(0x559f3eb73310 msgr2=0x559f3eba5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.699+0000 7f8844ce3740 1 -- 172.21.15.7:0/1302281558 shutdown_connections 2024-09-19T08:50:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.699+0000 7f8844ce3740 1 -- 172.21.15.7:0/1302281558 wait complete. 2024-09-19T08:50:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.699+0000 7f8844ce3740 1 -- start start 2024-09-19T08:50:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.699+0000 7f8844ce3740 1 Processor -- start 2024-09-19T08:50:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.700+0000 7f8844ce3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3ebaa5d0 0x559f3ebc86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.700+0000 7f8844ce3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3ebabb40 0x559f3ebc8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.700+0000 7f8844ce3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebb5370 0x559f3ec2e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.700+0000 7f8844ce3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f883c1abe00 con 0x559f3ebb5370 2024-09-19T08:50:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.700+0000 7f8844ce3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f883c1ad270 con 0x559f3ebaa5d0 2024-09-19T08:50:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.700+0000 7f8844ce3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f883c1ac4d0 con 0x559f3ebabb40 2024-09-19T08:50:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.700+0000 7f8844ce3740 10 client.0 _ll_register_callbacks cb 0x7f882c0040d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.700+0000 7f8840ea7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebb5370 0x559f3ec2e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.700+0000 7f8840ea7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebb5370 0x559f3ec2e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59558/0 (socket says 172.21.15.7:59558) 2024-09-19T08:50:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.700+0000 7f8840ea7640 1 -- 172.21.15.7:0/3002978140 learned_addr learned my addr 172.21.15.7:0/3002978140 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:36.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.700+0000 7f883bfff640 1 --2- 172.21.15.7:0/3002978140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3ebaa5d0 0x559f3ebc86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:36.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.700+0000 7f883b7fe640 1 --2- 172.21.15.7:0/3002978140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3ebabb40 0x559f3ebc8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:36.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.700+0000 7f8840ea7640 1 -- 172.21.15.7:0/3002978140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3ebabb40 msgr2=0x559f3ebc8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:36.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.700+0000 7f8840ea7640 1 --2- 172.21.15.7:0/3002978140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3ebabb40 0x559f3ebc8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.700+0000 7f8840ea7640 1 -- 172.21.15.7:0/3002978140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3ebaa5d0 msgr2=0x559f3ebc86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:36.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.700+0000 7f8840ea7640 1 --2- 172.21.15.7:0/3002978140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3ebaa5d0 0x559f3ebc86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.700+0000 7f8840ea7640 1 -- 172.21.15.7:0/3002978140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f3ec2ecc0 con 0x559f3ebb5370 2024-09-19T08:50:36.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.700+0000 7f8840ea7640 1 --2- 172.21.15.7:0/3002978140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebb5370 0x559f3ec2e680 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8834010910 tx=0x7f8834004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33bc84e46cb8bc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:36.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.700+0000 7f881b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:50:36.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.701+0000 7f881b7fe640 1 -- 172.21.15.7:0/3002978140 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8834021b30 con 0x559f3ebb5370 2024-09-19T08:50:36.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.701+0000 7f881b7fe640 1 -- 172.21.15.7:0/3002978140 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f8834021cd0 con 0x559f3ebb5370 2024-09-19T08:50:36.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.701+0000 7f8844ce3740 1 -- 172.21.15.7:0/3002978140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f882c05a070 con 0x559f3ebb5370 2024-09-19T08:50:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.701+0000 7f881b7fe640 1 -- 172.21.15.7:0/3002978140 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f883402b430 con 0x559f3ebb5370 2024-09-19T08:50:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.701+0000 7f8844ce3740 10 client.16560 fetch_fsmap learned FSMap version 25 2024-09-19T08:50:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.701+0000 7f8844ce3740 1 -- 172.21.15.7:0/3002978140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559f3ec2ffe0 con 0x559f3ebb5370 2024-09-19T08:50:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.701+0000 7f881b7fe640 1 -- 172.21.15.7:0/3002978140 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f882c05a070 con 0x559f3ebb5370 2024-09-19T08:50:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.701+0000 7f881b7fe640 1 -- 172.21.15.7:0/3002978140 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f883400f040 con 0x559f3ebb5370 2024-09-19T08:50:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.701+0000 7f8844ce3740 10 client.16560 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:50:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.701+0000 7f8844ce3740 10 client.16560 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:50:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.701+0000 7f8844ce3740 20 client.16560 populate_metadata read hostname 'smithi007' 2024-09-19T08:50:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.701+0000 7f8844ce3740 1 --2- 172.21.15.7:0/3002978140 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559f3ec307b0 0x559f3ec32bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.701+0000 7f8844ce3740 4 client.16560 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:50:36.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.701+0000 7f8844ce3740 1 -- 172.21.15.7:0/3002978140 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559f3eb17d70 con 0x559f3ec307b0 2024-09-19T08:50:36.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.702+0000 7f883bfff640 1 --2- 172.21.15.7:0/3002978140 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559f3ec307b0 0x559f3ec32bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:36.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.702+0000 7f883bfff640 1 --2- 172.21.15.7:0/3002978140 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559f3ec307b0 0x559f3ec32bd0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1db45f4be2e7d017 server_cookie=43cf091b0b82bef5 in_seq=0 out_seq=0 2024-09-19T08:50:36.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.702+0000 7f881b7fe640 10 client.16560 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:36.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.702+0000 7f881b7fe640 1 -- 172.21.15.7:0/3002978140 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559f3eb17d70 con 0x559f3ec307b0 2024-09-19T08:50:36.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.702+0000 7f881b7fe640 10 client.16560 handle_command_reply: tid=0 2024-09-19T08:50:36.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.702+0000 7f8844ce3740 1 client.16560 shutdown 2024-09-19T08:50:36.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.702+0000 7f8844ce3740 1 -- 172.21.15.7:0/3002978140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebb5370 msgr2=0x559f3ec2e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:36.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.702+0000 7f8844ce3740 1 --2- 172.21.15.7:0/3002978140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebb5370 0x559f3ec2e680 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8834010910 tx=0x7f8834004a40 comp rx=0 tx=0).stop 2024-09-19T08:50:36.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.702+0000 7f8844ce3740 1 -- 172.21.15.7:0/3002978140 shutdown_connections 2024-09-19T08:50:36.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.702+0000 7f8844ce3740 1 --2- 172.21.15.7:0/3002978140 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559f3ec307b0 0x559f3ec32bd0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.702+0000 7f8844ce3740 1 --2- 172.21.15.7:0/3002978140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f3ebb5370 0x559f3ec2e680 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.702+0000 7f8844ce3740 1 --2- 172.21.15.7:0/3002978140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559f3ebabb40 0x559f3ebc8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.702+0000 7f8844ce3740 1 --2- 172.21.15.7:0/3002978140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3ebaa5d0 0x559f3ebc86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.702+0000 7f8844ce3740 1 -- 172.21.15.7:0/3002978140 >> 172.21.15.7:0/3002978140 conn(0x559f3eb73310 msgr2=0x559f3eba5310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:36.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.702+0000 7f881b7fe640 0 client.16560 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:36.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.702+0000 7f8844ce3740 1 -- 172.21.15.7:0/3002978140 shutdown_connections 2024-09-19T08:50:36.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.703+0000 7f8844ce3740 1 -- 172.21.15.7:0/3002978140 wait complete. 2024-09-19T08:50:36.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.703+0000 7f8844ce3740 20 client.16560 trim_cache size 0 max 16384 2024-09-19T08:50:36.712 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:50:36.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.703+0000 7f884290a640 1 -- 172.21.15.7:0/933495452 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f88240a33b0 msgr2=0x7f88240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:36.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.703+0000 7f884290a640 1 --2- 172.21.15.7:0/933495452 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f88240a33b0 0x7f88240a5870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8834005fd0 tx=0x7f8834009600 comp rx=0 tx=0).stop 2024-09-19T08:50:36.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.703+0000 7f884290a640 1 -- 172.21.15.7:0/933495452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f883c1036c0 msgr2=0x7f883c198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:36.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.703+0000 7f884290a640 1 --2- 172.21.15.7:0/933495452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f883c1036c0 0x7f883c198950 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f883000c920 tx=0x7f883000cde0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.703+0000 7f884290a640 1 -- 172.21.15.7:0/933495452 shutdown_connections 2024-09-19T08:50:36.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.703+0000 7f884290a640 1 --2- 172.21.15.7:0/933495452 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f88240a33b0 0x7f88240a5870 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.703+0000 7f884290a640 1 --2- 172.21.15.7:0/933495452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f883c10c180 0x7f883c19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.703+0000 7f884290a640 1 --2- 172.21.15.7:0/933495452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f883c1036c0 0x7f883c198950 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.703+0000 7f884290a640 1 --2- 172.21.15.7:0/933495452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f883c102da0 0x7f883c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.703+0000 7f884290a640 1 -- 172.21.15.7:0/933495452 >> 172.21.15.7:0/933495452 conn(0x7f883c0fc7a0 msgr2=0x7f883c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.703+0000 7f884290a640 1 -- 172.21.15.7:0/933495452 shutdown_connections 2024-09-19T08:50:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:36.703+0000 7f884290a640 1 -- 172.21.15.7:0/933495452 wait complete. 2024-09-19T08:50:37.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:36 smithi175 ceph-mon[35688]: pgmap v185: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:50:37.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:36 smithi007 ceph-mon[31221]: pgmap v185: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:50:37.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:36 smithi044 ceph-mon[35072]: pgmap v185: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:50:38.341 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:50:38.341 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:50:38.608 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:38.989 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:38 smithi007 ceph-mon[31221]: pgmap v186: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:50:39.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.075+0000 7fa522073640 1 -- 172.21.15.7:0/2106010012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51c1002f0 msgr2=0x7fa51c1006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:39.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.075+0000 7fa522073640 1 --2- 172.21.15.7:0/2106010012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51c1002f0 0x7fa51c1006d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009930 tx=0x7fa50c02a420 comp rx=0 tx=0).stop 2024-09-19T08:50:39.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.075+0000 7fa522073640 1 -- 172.21.15.7:0/2106010012 shutdown_connections 2024-09-19T08:50:39.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.075+0000 7fa522073640 1 --2- 172.21.15.7:0/2106010012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa51c106f50 0x7fa51c10eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.075+0000 7fa522073640 1 --2- 172.21.15.7:0/2106010012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa51c100ca0 0x7fa51c106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.075+0000 7fa522073640 1 --2- 172.21.15.7:0/2106010012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51c1002f0 0x7fa51c1006d0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.075+0000 7fa522073640 1 -- 172.21.15.7:0/2106010012 >> 172.21.15.7:0/2106010012 conn(0x7fa51c077210 msgr2=0x7fa51c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:39.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.075+0000 7fa522073640 1 -- 172.21.15.7:0/2106010012 shutdown_connections 2024-09-19T08:50:39.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.075+0000 7fa522073640 1 -- 172.21.15.7:0/2106010012 wait complete. 2024-09-19T08:50:39.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.076+0000 7fa522073640 1 Processor -- start 2024-09-19T08:50:39.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.076+0000 7fa522073640 1 -- start start 2024-09-19T08:50:39.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.076+0000 7fa522073640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa51c1002f0 0x7fa51c19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.076+0000 7fa522073640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa51c100ca0 0x7fa51c19ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.076+0000 7fa522073640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51c106f50 0x7fa51c19efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.076+0000 7fa522073640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c111fa0 con 0x7fa51c106f50 2024-09-19T08:50:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.076+0000 7fa522073640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c111e20 con 0x7fa51c1002f0 2024-09-19T08:50:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.076+0000 7fa522073640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c112120 con 0x7fa51c100ca0 2024-09-19T08:50:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.076+0000 7fa51bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51c106f50 0x7fa51c19efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.076+0000 7fa51bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51c106f50 0x7fa51c19efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59574/0 (socket says 172.21.15.7:59574) 2024-09-19T08:50:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.076+0000 7fa51bfff640 1 -- 172.21.15.7:0/2329485651 learned_addr learned my addr 172.21.15.7:0/2329485651 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.076+0000 7fa51b7fe640 1 --2- 172.21.15.7:0/2329485651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa51c1002f0 0x7fa51c19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.077+0000 7fa51affd640 1 --2- 172.21.15.7:0/2329485651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa51c100ca0 0x7fa51c19ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.077+0000 7fa51bfff640 1 -- 172.21.15.7:0/2329485651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa51c100ca0 msgr2=0x7fa51c19ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.077+0000 7fa51bfff640 1 --2- 172.21.15.7:0/2329485651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa51c100ca0 0x7fa51c19ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.077+0000 7fa51bfff640 1 -- 172.21.15.7:0/2329485651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa51c1002f0 msgr2=0x7fa51c19a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:39.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.077+0000 7fa51bfff640 1 --2- 172.21.15.7:0/2329485651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa51c1002f0 0x7fa51c19a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.077+0000 7fa51bfff640 1 -- 172.21.15.7:0/2329485651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51c19f6b0 con 0x7fa51c106f50 2024-09-19T08:50:39.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.077+0000 7fa51bfff640 1 --2- 172.21.15.7:0/2329485651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51c106f50 0x7fa51c19efd0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa51400cce0 tx=0x7fa51400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:39.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.077+0000 7fa518ff9640 1 -- 172.21.15.7:0/2329485651 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51400f450 con 0x7fa51c106f50 2024-09-19T08:50:39.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.077+0000 7fa518ff9640 1 -- 172.21.15.7:0/2329485651 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa51400fad0 con 0x7fa51c106f50 2024-09-19T08:50:39.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.077+0000 7fa522073640 1 -- 172.21.15.7:0/2329485651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa51c19f9a0 con 0x7fa51c106f50 2024-09-19T08:50:39.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.077+0000 7fa518ff9640 1 -- 172.21.15.7:0/2329485651 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa514018c10 con 0x7fa51c106f50 2024-09-19T08:50:39.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.077+0000 7fa522073640 1 -- 172.21.15.7:0/2329485651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa51c1a7280 con 0x7fa51c106f50 2024-09-19T08:50:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.079+0000 7fa518ff9640 1 -- 172.21.15.7:0/2329485651 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa51400f5f0 con 0x7fa51c106f50 2024-09-19T08:50:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.080+0000 7fa52444c740 1 Processor -- start 2024-09-19T08:50:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.080+0000 7fa52444c740 1 -- start start 2024-09-19T08:50:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.080+0000 7fa52444c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5eab60 0x55fe9a5eaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.080+0000 7fa52444c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe9a5eb480 0x55fe9a5f5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.080+0000 7fa52444c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe9a5f5d40 0x55fe9a5f8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.080+0000 7fa52444c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fe9a550280 con 0x55fe9a5eab60 2024-09-19T08:50:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.080+0000 7fa52444c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fe9a4f7b10 con 0x55fe9a5f5d40 2024-09-19T08:50:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.080+0000 7fa52444c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fe9a54c240 con 0x55fe9a5eb480 2024-09-19T08:50:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.080+0000 7fa51affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5eab60 0x55fe9a5eaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.080+0000 7fa51affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5eab60 0x55fe9a5eaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59576/0 (socket says 172.21.15.7:59576) 2024-09-19T08:50:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.080+0000 7fa51affd640 1 -- 172.21.15.7:0/2523349139 learned_addr learned my addr 172.21.15.7:0/2523349139 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.080+0000 7fa518ff9640 1 --2- 172.21.15.7:0/2329485651 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa5040a33b0 0x7fa5040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.080+0000 7fa51b7fe640 1 --2- 172.21.15.7:0/2523349139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe9a5eb480 0x55fe9a5f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.080+0000 7fa51affd640 1 --2- 172.21.15.7:0/2523349139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe9a5f5d40 0x55fe9a5f8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.080+0000 7fa51bfff640 1 --2- 172.21.15.7:0/2329485651 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa5040a33b0 0x7fa5040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.081+0000 7fa51affd640 1 -- 172.21.15.7:0/2523349139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe9a5eb480 msgr2=0x55fe9a5f5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.081+0000 7fa51affd640 1 --2- 172.21.15.7:0/2523349139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe9a5eb480 0x55fe9a5f5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.081+0000 7fa51affd640 1 -- 172.21.15.7:0/2523349139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe9a5f5d40 msgr2=0x55fe9a5f8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.081+0000 7fa51affd640 1 --2- 172.21.15.7:0/2523349139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe9a5f5d40 0x55fe9a5f8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.081+0000 7fa51affd640 1 -- 172.21.15.7:0/2523349139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe9a5041f0 con 0x55fe9a5eab60 2024-09-19T08:50:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.081+0000 7fa518ff9640 1 -- 172.21.15.7:0/2329485651 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fa5140d0360 con 0x7fa51c106f50 2024-09-19T08:50:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.081+0000 7fa51affd640 1 --2- 172.21.15.7:0/2523349139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5eab60 0x55fe9a5eaf40 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa51000bfa0 tx=0x7fa51000b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42e18288bb26ace server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.081+0000 7fa51bfff640 1 --2- 172.21.15.7:0/2329485651 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa5040a33b0 0x7fa5040a5870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa514098a90 tx=0x7fa51409f040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.081+0000 7fa501ffb640 1 -- 172.21.15.7:0/2523349139 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa510019020 con 0x55fe9a5eab60 2024-09-19T08:50:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.081+0000 7fa501ffb640 1 -- 172.21.15.7:0/2523349139 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa510010b40 con 0x55fe9a5eab60 2024-09-19T08:50:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.081+0000 7fa501ffb640 1 -- 172.21.15.7:0/2523349139 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51000fa90 con 0x55fe9a5eab60 2024-09-19T08:50:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.082+0000 7fa52444c740 1 -- 172.21.15.7:0/2523349139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5eab60 msgr2=0x55fe9a5eaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.082+0000 7fa52444c740 1 --2- 172.21.15.7:0/2523349139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5eab60 0x55fe9a5eaf40 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa51000bfa0 tx=0x7fa51000b650 comp rx=0 tx=0).stop 2024-09-19T08:50:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.082+0000 7fa52444c740 1 -- 172.21.15.7:0/2523349139 shutdown_connections 2024-09-19T08:50:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.082+0000 7fa52444c740 1 --2- 172.21.15.7:0/2523349139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe9a5f5d40 0x55fe9a5f8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.082+0000 7fa52444c740 1 --2- 172.21.15.7:0/2523349139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe9a5eb480 0x55fe9a5f5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.082+0000 7fa52444c740 1 --2- 172.21.15.7:0/2523349139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5eab60 0x55fe9a5eaf40 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.082+0000 7fa52444c740 1 -- 172.21.15.7:0/2523349139 >> 172.21.15.7:0/2523349139 conn(0x55fe9a5e70f0 msgr2=0x55fe9a5e74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.082+0000 7fa52444c740 1 -- 172.21.15.7:0/2523349139 shutdown_connections 2024-09-19T08:50:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.082+0000 7fa52444c740 1 -- 172.21.15.7:0/2523349139 wait complete. 2024-09-19T08:50:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.082+0000 7fa52444c740 1 -- start start 2024-09-19T08:50:39.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.082+0000 7fa52444c740 1 Processor -- start 2024-09-19T08:50:39.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.083+0000 7fa52444c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5eab60 0x55fe9a5f2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:39.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.083+0000 7fa52444c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe9a5eb480 0x55fe9a5f3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:39.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.083+0000 7fa52444c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe9a5f5d40 0x55fe9a5f3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:39.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.083+0000 7fa52444c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fe9a5f8910 con 0x55fe9a5eab60 2024-09-19T08:50:39.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.083+0000 7fa52444c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fe9a50af10 con 0x55fe9a5eb480 2024-09-19T08:50:39.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.083+0000 7fa52444c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fe9a5f8a90 con 0x55fe9a5f5d40 2024-09-19T08:50:39.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.083+0000 7fa52444c740 10 client.0 _ll_register_callbacks cb 0x55fe9a4d3a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:39.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.083+0000 7fa51affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5eab60 0x55fe9a5f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:39.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.083+0000 7fa51affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5eab60 0x55fe9a5f2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59580/0 (socket says 172.21.15.7:59580) 2024-09-19T08:50:39.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.083+0000 7fa51affd640 1 -- 172.21.15.7:0/1398060712 learned_addr learned my addr 172.21.15.7:0/1398060712 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:39.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.083+0000 7fa51b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe9a5eb480 0x55fe9a5f3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:39.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.083+0000 7fa51affd640 1 --2- 172.21.15.7:0/1398060712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe9a5f5d40 0x55fe9a5f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:39.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.083+0000 7fa51affd640 1 -- 172.21.15.7:0/1398060712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe9a5f5d40 msgr2=0x55fe9a5f3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:39.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.083+0000 7fa51affd640 1 --2- 172.21.15.7:0/1398060712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe9a5f5d40 0x55fe9a5f3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.083+0000 7fa51affd640 1 -- 172.21.15.7:0/1398060712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe9a5eb480 msgr2=0x55fe9a5f3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:39.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.083+0000 7fa51affd640 1 --2- 172.21.15.7:0/1398060712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe9a5eb480 0x55fe9a5f3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.083+0000 7fa51affd640 1 -- 172.21.15.7:0/1398060712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe9a2c16a0 con 0x55fe9a5eab60 2024-09-19T08:50:39.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.083+0000 7fa51b7fe640 1 --2- 172.21.15.7:0/1398060712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe9a5eb480 0x55fe9a5f3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:50:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.083+0000 7fa51affd640 1 --2- 172.21.15.7:0/1398060712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5eab60 0x55fe9a5f2c00 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa51000f770 tx=0x7fa51000f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9796a7d1696f1e18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.083+0000 7fa4faffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:50:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.084+0000 7fa4faffd640 1 -- 172.21.15.7:0/1398060712 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa510019030 con 0x55fe9a5eab60 2024-09-19T08:50:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.084+0000 7fa4faffd640 1 -- 172.21.15.7:0/1398060712 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fa510010870 con 0x55fe9a5eab60 2024-09-19T08:50:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.084+0000 7fa52444c740 1 -- 172.21.15.7:0/1398060712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa510010b40 con 0x55fe9a5eab60 2024-09-19T08:50:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.084+0000 7fa4faffd640 1 -- 172.21.15.7:0/1398060712 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa510004020 con 0x55fe9a5eab60 2024-09-19T08:50:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.084+0000 7fa52444c740 10 client.16572 fetch_fsmap learned FSMap version 25 2024-09-19T08:50:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.084+0000 7fa52444c740 1 -- 172.21.15.7:0/1398060712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fe9a6044f0 con 0x55fe9a5eab60 2024-09-19T08:50:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.084+0000 7fa4faffd640 1 -- 172.21.15.7:0/1398060712 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa510010b40 con 0x55fe9a5eab60 2024-09-19T08:50:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.084+0000 7fa4faffd640 1 -- 172.21.15.7:0/1398060712 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa51000f810 con 0x55fe9a5eab60 2024-09-19T08:50:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.084+0000 7fa52444c740 10 client.16572 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:50:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.084+0000 7fa52444c740 10 client.16572 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:50:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.084+0000 7fa52444c740 20 client.16572 populate_metadata read hostname 'smithi007' 2024-09-19T08:50:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.084+0000 7fa52444c740 1 --2- 172.21.15.7:0/1398060712 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fe9a605950 0x55fe9a607d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.084+0000 7fa52444c740 4 client.16572 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:50:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.084+0000 7fa52444c740 1 -- 172.21.15.7:0/1398060712 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe9a55d7f0 con 0x55fe9a605950 2024-09-19T08:50:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.085+0000 7fa51b7fe640 1 --2- 172.21.15.7:0/1398060712 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fe9a605950 0x55fe9a607d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.085+0000 7fa4faffd640 10 client.16572 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.085+0000 7fa51b7fe640 1 --2- 172.21.15.7:0/1398060712 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fe9a605950 0x55fe9a607d40 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d67ca1d746db7b4b server_cookie=9472a3c712f49056 in_seq=0 out_seq=0 2024-09-19T08:50:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.086+0000 7fa4faffd640 1 -- 172.21.15.7:0/1398060712 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fe9a55d7f0 con 0x55fe9a605950 2024-09-19T08:50:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.086+0000 7fa4faffd640 10 client.16572 handle_command_reply: tid=0 2024-09-19T08:50:39.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.086+0000 7fa52444c740 1 client.16572 shutdown 2024-09-19T08:50:39.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.086+0000 7fa52444c740 1 -- 172.21.15.7:0/1398060712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5eab60 msgr2=0x55fe9a5f2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:39.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.086+0000 7fa52444c740 1 --2- 172.21.15.7:0/1398060712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5eab60 0x55fe9a5f2c00 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa51000f770 tx=0x7fa51000f670 comp rx=0 tx=0).stop 2024-09-19T08:50:39.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.086+0000 7fa52444c740 1 -- 172.21.15.7:0/1398060712 shutdown_connections 2024-09-19T08:50:39.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.086+0000 7fa52444c740 1 --2- 172.21.15.7:0/1398060712 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fe9a605950 0x55fe9a607d40 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.086+0000 7fa52444c740 1 --2- 172.21.15.7:0/1398060712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe9a5f5d40 0x55fe9a5f3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.086+0000 7fa52444c740 1 --2- 172.21.15.7:0/1398060712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe9a5eb480 0x55fe9a5f3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.086+0000 7fa4faffd640 0 client.16572 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:39.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.086+0000 7fa52444c740 1 --2- 172.21.15.7:0/1398060712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5eab60 0x55fe9a5f2c00 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.086+0000 7fa52444c740 1 -- 172.21.15.7:0/1398060712 >> 172.21.15.7:0/1398060712 conn(0x55fe9a5e70f0 msgr2=0x55fe9a5ecdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:39.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.086+0000 7fa52444c740 1 -- 172.21.15.7:0/1398060712 shutdown_connections 2024-09-19T08:50:39.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.086+0000 7fa52444c740 1 -- 172.21.15.7:0/1398060712 wait complete. 2024-09-19T08:50:39.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.086+0000 7fa52444c740 20 client.16572 trim_cache size 0 max 16384 2024-09-19T08:50:39.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.104+0000 7fa52444c740 1 Processor -- start 2024-09-19T08:50:39.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.104+0000 7fa52444c740 1 -- start start 2024-09-19T08:50:39.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.104+0000 7fa52444c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe9a5eab60 0x55fe9a60d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:39.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.104+0000 7fa52444c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe9a5eb480 0x55fe9a60d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:39.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.104+0000 7fa52444c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5f5d40 0x55fe9a5ec5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:39.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.104+0000 7fa52444c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c1b23c0 con 0x55fe9a5f5d40 2024-09-19T08:50:39.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.104+0000 7fa52444c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c1afc90 con 0x55fe9a5eab60 2024-09-19T08:50:39.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.104+0000 7fa52444c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c1adae0 con 0x55fe9a5eb480 2024-09-19T08:50:39.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.104+0000 7fa51affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5f5d40 0x55fe9a5ec5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:39.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.104+0000 7fa51affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5f5d40 0x55fe9a5ec5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59584/0 (socket says 172.21.15.7:59584) 2024-09-19T08:50:39.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.104+0000 7fa51affd640 1 -- 172.21.15.7:0/4259259443 learned_addr learned my addr 172.21.15.7:0/4259259443 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:39.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.104+0000 7fa51affd640 1 --2- 172.21.15.7:0/4259259443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe9a5eab60 0x55fe9a60d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:39.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.104+0000 7fa51b7fe640 1 --2- 172.21.15.7:0/4259259443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe9a5eb480 0x55fe9a60d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:39.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.104+0000 7fa51affd640 1 -- 172.21.15.7:0/4259259443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe9a5eb480 msgr2=0x55fe9a60d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.104+0000 7fa51affd640 1 --2- 172.21.15.7:0/4259259443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe9a5eb480 0x55fe9a60d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.104+0000 7fa51affd640 1 -- 172.21.15.7:0/4259259443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe9a5eab60 msgr2=0x55fe9a60d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.104+0000 7fa51affd640 1 --2- 172.21.15.7:0/4259259443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe9a5eab60 0x55fe9a60d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.104+0000 7fa51affd640 1 -- 172.21.15.7:0/4259259443 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe9a5e6f20 con 0x55fe9a5f5d40 2024-09-19T08:50:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.105+0000 7fa51affd640 1 --2- 172.21.15.7:0/4259259443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5f5d40 0x55fe9a5ec5b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa51000f740 tx=0x7fa510005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1966407d2a8f387c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.105+0000 7fa5017fa640 1 -- 172.21.15.7:0/4259259443 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa510019030 con 0x55fe9a5f5d40 2024-09-19T08:50:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.105+0000 7fa5017fa640 1 -- 172.21.15.7:0/4259259443 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa51000fea0 con 0x55fe9a5f5d40 2024-09-19T08:50:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.105+0000 7fa5017fa640 1 -- 172.21.15.7:0/4259259443 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51000fa90 con 0x55fe9a5f5d40 2024-09-19T08:50:39.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.105+0000 7fa52444c740 1 -- 172.21.15.7:0/4259259443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5f5d40 msgr2=0x55fe9a5ec5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:39.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.105+0000 7fa52444c740 1 --2- 172.21.15.7:0/4259259443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5f5d40 0x55fe9a5ec5b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa51000f740 tx=0x7fa510005970 comp rx=0 tx=0).stop 2024-09-19T08:50:39.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.105+0000 7fa52444c740 1 -- 172.21.15.7:0/4259259443 shutdown_connections 2024-09-19T08:50:39.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.105+0000 7fa52444c740 1 --2- 172.21.15.7:0/4259259443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5f5d40 0x55fe9a5ec5b0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.105+0000 7fa52444c740 1 --2- 172.21.15.7:0/4259259443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe9a5eb480 0x55fe9a60d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.105+0000 7fa52444c740 1 --2- 172.21.15.7:0/4259259443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe9a5eab60 0x55fe9a60d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.105+0000 7fa52444c740 1 -- 172.21.15.7:0/4259259443 >> 172.21.15.7:0/4259259443 conn(0x55fe9a5e70f0 msgr2=0x55fe9a5f4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:39.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.106+0000 7fa52444c740 1 -- 172.21.15.7:0/4259259443 shutdown_connections 2024-09-19T08:50:39.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.106+0000 7fa52444c740 1 -- 172.21.15.7:0/4259259443 wait complete. 2024-09-19T08:50:39.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.106+0000 7fa52444c740 1 -- start start 2024-09-19T08:50:39.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.106+0000 7fa52444c740 1 Processor -- start 2024-09-19T08:50:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.106+0000 7fa52444c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe9a5eab60 0x55fe9a6685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.106+0000 7fa52444c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe9a5eb480 0x55fe9a668b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.106+0000 7fa52444c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5f5d40 0x55fe9a5fd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.106+0000 7fa52444c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c1ae150 con 0x55fe9a5f5d40 2024-09-19T08:50:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.106+0000 7fa52444c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c1af5c0 con 0x55fe9a5eb480 2024-09-19T08:50:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.106+0000 7fa52444c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c1ae820 con 0x55fe9a5eab60 2024-09-19T08:50:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.106+0000 7fa52444c740 10 client.0 _ll_register_callbacks cb 0x7fa510013400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.106+0000 7fa51affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5f5d40 0x55fe9a5fd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.107+0000 7fa51affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5f5d40 0x55fe9a5fd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59594/0 (socket says 172.21.15.7:59594) 2024-09-19T08:50:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.107+0000 7fa51affd640 1 -- 172.21.15.7:0/1584275325 learned_addr learned my addr 172.21.15.7:0/1584275325 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.107+0000 7fa51b7fe640 1 --2- 172.21.15.7:0/1584275325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe9a5eb480 0x55fe9a668b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.107+0000 7fa51affd640 1 --2- 172.21.15.7:0/1584275325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe9a5eab60 0x55fe9a6685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.107+0000 7fa51affd640 1 -- 172.21.15.7:0/1584275325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe9a5eab60 msgr2=0x55fe9a6685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.107+0000 7fa51affd640 1 --2- 172.21.15.7:0/1584275325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe9a5eab60 0x55fe9a6685d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.107+0000 7fa51affd640 1 -- 172.21.15.7:0/1584275325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe9a5eb480 msgr2=0x55fe9a668b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:39.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.107+0000 7fa51affd640 1 --2- 172.21.15.7:0/1584275325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe9a5eb480 0x55fe9a668b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.107+0000 7fa51affd640 1 -- 172.21.15.7:0/1584275325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe9a5ed9d0 con 0x55fe9a5f5d40 2024-09-19T08:50:39.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.107+0000 7fa51b7fe640 1 --2- 172.21.15.7:0/1584275325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe9a5eb480 0x55fe9a668b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:39.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.107+0000 7fa51affd640 1 --2- 172.21.15.7:0/1584275325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5f5d40 0x55fe9a5fd970 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fa51000fda0 tx=0x7fa510010a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb5168bace22c463 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:39.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.107+0000 7fa4faffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:50:39.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.107+0000 7fa4faffd640 1 -- 172.21.15.7:0/1584275325 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa510019070 con 0x55fe9a5f5d40 2024-09-19T08:50:39.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.107+0000 7fa4faffd640 1 -- 172.21.15.7:0/1584275325 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7fa5100043d0 con 0x55fe9a5f5d40 2024-09-19T08:50:39.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.107+0000 7fa52444c740 1 -- 172.21.15.7:0/1584275325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa51000fea0 con 0x55fe9a5f5d40 2024-09-19T08:50:39.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.107+0000 7fa4faffd640 1 -- 172.21.15.7:0/1584275325 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa510010b40 con 0x55fe9a5f5d40 2024-09-19T08:50:39.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.107+0000 7fa52444c740 10 client.16578 fetch_fsmap learned FSMap version 25 2024-09-19T08:50:39.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.107+0000 7fa52444c740 1 -- 172.21.15.7:0/1584275325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fe9a66fd00 con 0x55fe9a5f5d40 2024-09-19T08:50:39.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.108+0000 7fa4faffd640 1 -- 172.21.15.7:0/1584275325 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa51000fea0 con 0x55fe9a5f5d40 2024-09-19T08:50:39.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.108+0000 7fa4faffd640 1 -- 172.21.15.7:0/1584275325 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa510003a60 con 0x55fe9a5f5d40 2024-09-19T08:50:39.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.108+0000 7fa52444c740 10 client.16578 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:50:39.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.108+0000 7fa52444c740 10 client.16578 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:50:39.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.108+0000 7fa52444c740 20 client.16578 populate_metadata read hostname 'smithi007' 2024-09-19T08:50:39.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.108+0000 7fa52444c740 1 --2- 172.21.15.7:0/1584275325 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fe9a670210 0x55fe9a672630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:39.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.108+0000 7fa52444c740 4 client.16578 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:50:39.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.108+0000 7fa52444c740 1 -- 172.21.15.7:0/1584275325 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fe9a557d00 con 0x55fe9a670210 2024-09-19T08:50:39.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.108+0000 7fa51b7fe640 1 --2- 172.21.15.7:0/1584275325 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fe9a670210 0x55fe9a672630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:39.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.108+0000 7fa51b7fe640 1 --2- 172.21.15.7:0/1584275325 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fe9a670210 0x55fe9a672630 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93161b1cd4460fcd server_cookie=912563d696e7ffee in_seq=0 out_seq=0 2024-09-19T08:50:39.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.108+0000 7fa4faffd640 10 client.16578 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:39.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.109+0000 7fa4faffd640 1 -- 172.21.15.7:0/1584275325 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fe9a557d00 con 0x55fe9a670210 2024-09-19T08:50:39.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.109+0000 7fa4faffd640 10 client.16578 handle_command_reply: tid=0 2024-09-19T08:50:39.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.109+0000 7fa52444c740 1 client.16578 shutdown 2024-09-19T08:50:39.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.110+0000 7fa52444c740 1 -- 172.21.15.7:0/1584275325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5f5d40 msgr2=0x55fe9a5fd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:39.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.110+0000 7fa52444c740 1 --2- 172.21.15.7:0/1584275325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5f5d40 0x55fe9a5fd970 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fa51000fda0 tx=0x7fa510010a70 comp rx=0 tx=0).stop 2024-09-19T08:50:39.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.110+0000 7fa52444c740 1 -- 172.21.15.7:0/1584275325 shutdown_connections 2024-09-19T08:50:39.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.110+0000 7fa52444c740 1 --2- 172.21.15.7:0/1584275325 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55fe9a670210 0x55fe9a672630 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.110+0000 7fa52444c740 1 --2- 172.21.15.7:0/1584275325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe9a5f5d40 0x55fe9a5fd970 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.110+0000 7fa52444c740 1 --2- 172.21.15.7:0/1584275325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe9a5eb480 0x55fe9a668b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.110+0000 7fa52444c740 1 --2- 172.21.15.7:0/1584275325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe9a5eab60 0x55fe9a6685d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.110+0000 7fa52444c740 1 -- 172.21.15.7:0/1584275325 >> 172.21.15.7:0/1584275325 conn(0x55fe9a5e70f0 msgr2=0x55fe9a5f2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:39.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.110+0000 7fa4faffd640 0 client.16578 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:39.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.110+0000 7fa52444c740 1 -- 172.21.15.7:0/1584275325 shutdown_connections 2024-09-19T08:50:39.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.110+0000 7fa52444c740 1 -- 172.21.15.7:0/1584275325 wait complete. 2024-09-19T08:50:39.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.110+0000 7fa52444c740 20 client.16578 trim_cache size 0 max 16384 2024-09-19T08:50:39.115 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:50:39.115 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-19T08:50:39.115 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "a5201fb2-80fb-438f-8cb4-c6958af8d5e9", 2024-09-19T08:50:39.115 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-19T08:50:39.115 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:50:39.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.111+0000 7fa522073640 1 -- 172.21.15.7:0/2329485651 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa5040a33b0 msgr2=0x7fa5040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:39.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.111+0000 7fa522073640 1 --2- 172.21.15.7:0/2329485651 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa5040a33b0 0x7fa5040a5870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa514098a90 tx=0x7fa51409f040 comp rx=0 tx=0).stop 2024-09-19T08:50:39.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.111+0000 7fa522073640 1 -- 172.21.15.7:0/2329485651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51c106f50 msgr2=0x7fa51c19efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:39.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.111+0000 7fa522073640 1 --2- 172.21.15.7:0/2329485651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51c106f50 0x7fa51c19efd0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa51400cce0 tx=0x7fa51400a620 comp rx=0 tx=0).stop 2024-09-19T08:50:39.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.111+0000 7fa522073640 1 -- 172.21.15.7:0/2329485651 shutdown_connections 2024-09-19T08:50:39.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.111+0000 7fa522073640 1 --2- 172.21.15.7:0/2329485651 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa5040a33b0 0x7fa5040a5870 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.111+0000 7fa522073640 1 --2- 172.21.15.7:0/2329485651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51c106f50 0x7fa51c19efd0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.111+0000 7fa522073640 1 --2- 172.21.15.7:0/2329485651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa51c100ca0 0x7fa51c19ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.111+0000 7fa522073640 1 --2- 172.21.15.7:0/2329485651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa51c1002f0 0x7fa51c19a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.111+0000 7fa522073640 1 -- 172.21.15.7:0/2329485651 >> 172.21.15.7:0/2329485651 conn(0x7fa51c077210 msgr2=0x7fa51c1056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.111+0000 7fa522073640 1 -- 172.21.15.7:0/2329485651 shutdown_connections 2024-09-19T08:50:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:39.111+0000 7fa522073640 1 -- 172.21.15.7:0/2329485651 wait complete. 2024-09-19T08:50:39.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:38 smithi175 ceph-mon[35688]: pgmap v186: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:50:39.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:38 smithi044 ceph-mon[35072]: pgmap v186: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:50:39.765 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:50:40.025 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:40.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.480+0000 7f81bef31640 1 -- 172.21.15.7:0/1788655706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b8101420 msgr2=0x7f81b810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:40.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.480+0000 7f81bef31640 1 --2- 172.21.15.7:0/1788655706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b8101420 0x7f81b810d950 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f81b0009cd0 tx=0x7f81b002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.480+0000 7f81bef31640 1 -- 172.21.15.7:0/1788655706 shutdown_connections 2024-09-19T08:50:40.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.480+0000 7f81bef31640 1 --2- 172.21.15.7:0/1788655706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b8101420 0x7f81b810d950 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.480+0000 7f81bef31640 1 --2- 172.21.15.7:0/1788655706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81b8100a80 0x7f81b8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.480+0000 7f81bef31640 1 --2- 172.21.15.7:0/1788655706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81b8106a80 0x7f81b8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.480+0000 7f81bef31640 1 -- 172.21.15.7:0/1788655706 >> 172.21.15.7:0/1788655706 conn(0x7f81b80fc7a0 msgr2=0x7f81b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:40.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.480+0000 7f81bef31640 1 -- 172.21.15.7:0/1788655706 shutdown_connections 2024-09-19T08:50:40.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.480+0000 7f81bef31640 1 -- 172.21.15.7:0/1788655706 wait complete. 2024-09-19T08:50:40.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.480+0000 7f81bef31640 1 Processor -- start 2024-09-19T08:50:40.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.481+0000 7f81bef31640 1 -- start start 2024-09-19T08:50:40.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.481+0000 7f81bef31640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81b8100a80 0x7f81b8198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:40.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.481+0000 7f81bef31640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b8101420 0x7f81b8198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:40.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.481+0000 7f81bef31640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81b8106a80 0x7f81b819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:40.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.481+0000 7f81bef31640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f81b8110e80 con 0x7f81b8101420 2024-09-19T08:50:40.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.481+0000 7f81bef31640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f81b8110d00 con 0x7f81b8100a80 2024-09-19T08:50:40.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.481+0000 7f81bef31640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f81b8111000 con 0x7f81b8106a80 2024-09-19T08:50:40.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.481+0000 7f81b7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b8101420 0x7f81b8198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:40.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.481+0000 7f81b7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b8101420 0x7f81b8198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59614/0 (socket says 172.21.15.7:59614) 2024-09-19T08:50:40.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.481+0000 7f81b7fff640 1 -- 172.21.15.7:0/3257526499 learned_addr learned my addr 172.21.15.7:0/3257526499 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:40.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.481+0000 7f81bcccd640 1 --2- 172.21.15.7:0/3257526499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81b8100a80 0x7f81b8198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:40.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.481+0000 7f81bd4ce640 1 --2- 172.21.15.7:0/3257526499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81b8106a80 0x7f81b819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:40.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.481+0000 7f81b7fff640 1 -- 172.21.15.7:0/3257526499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81b8106a80 msgr2=0x7f81b819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:40.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.481+0000 7f81b7fff640 1 --2- 172.21.15.7:0/3257526499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81b8106a80 0x7f81b819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.481+0000 7f81b7fff640 1 -- 172.21.15.7:0/3257526499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81b8100a80 msgr2=0x7f81b8198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:40.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.481+0000 7f81b7fff640 1 --2- 172.21.15.7:0/3257526499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81b8100a80 0x7f81b8198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.481+0000 7f81b7fff640 1 -- 172.21.15.7:0/3257526499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b819d3c0 con 0x7f81b8101420 2024-09-19T08:50:40.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.481+0000 7f81b7fff640 1 --2- 172.21.15.7:0/3257526499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b8101420 0x7f81b8198950 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f81ac00d950 tx=0x7f81ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:40.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.482+0000 7f81b5ffb640 1 -- 172.21.15.7:0/3257526499 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac017070 con 0x7f81b8101420 2024-09-19T08:50:40.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.482+0000 7f81b5ffb640 1 -- 172.21.15.7:0/3257526499 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81ac009c30 con 0x7f81b8101420 2024-09-19T08:50:40.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.482+0000 7f81bef31640 1 -- 172.21.15.7:0/3257526499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b819d6b0 con 0x7f81b8101420 2024-09-19T08:50:40.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.482+0000 7f81b5ffb640 1 -- 172.21.15.7:0/3257526499 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac00f6b0 con 0x7f81b8101420 2024-09-19T08:50:40.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.482+0000 7f81bef31640 1 -- 172.21.15.7:0/3257526499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b81a4f90 con 0x7f81b8101420 2024-09-19T08:50:40.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.484+0000 7f81b5ffb640 1 -- 172.21.15.7:0/3257526499 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f81ac0109d0 con 0x7f81b8101420 2024-09-19T08:50:40.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.484+0000 7f81c130a740 1 Processor -- start 2024-09-19T08:50:40.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.484+0000 7f81c130a740 1 -- start start 2024-09-19T08:50:40.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.485+0000 7f81b5ffb640 1 --2- 172.21.15.7:0/3257526499 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f81a00a33b0 0x7f81a00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:40.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.485+0000 7f81c130a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b8e97b4a0 0x562b8e97b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:40.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.485+0000 7f81c130a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b8e97bdc0 0x562b8e986140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:40.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.485+0000 7f81c130a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e988a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:40.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.485+0000 7f81c130a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562b8e8e12e0 con 0x562b8e986680 2024-09-19T08:50:40.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.485+0000 7f81c130a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562b8e888ce0 con 0x562b8e97b4a0 2024-09-19T08:50:40.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.485+0000 7f81c130a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562b8e8dd2a0 con 0x562b8e97bdc0 2024-09-19T08:50:40.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.485+0000 7f81bd4ce640 1 --2- 172.21.15.7:0/3257526499 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f81a00a33b0 0x7f81a00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:40.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.485+0000 7f81b5ffb640 1 -- 172.21.15.7:0/3257526499 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f81ac0cf970 con 0x7f81b8101420 2024-09-19T08:50:40.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.485+0000 7f81bd4ce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e988a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:40.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.485+0000 7f81bd4ce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e988a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59624/0 (socket says 172.21.15.7:59624) 2024-09-19T08:50:40.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.485+0000 7f81bcccd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b8e97b4a0 0x562b8e97b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:40.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.485+0000 7f81bd4ce640 1 -- 172.21.15.7:0/1598966806 learned_addr learned my addr 172.21.15.7:0/1598966806 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:40.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.485+0000 7f81b7fff640 1 --2- 172.21.15.7:0/1598966806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b8e97bdc0 0x562b8e986140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:40.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.485+0000 7f81bcccd640 1 -- 172.21.15.7:0/1598966806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b8e97bdc0 msgr2=0x562b8e986140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:40.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.485+0000 7f81bcccd640 1 --2- 172.21.15.7:0/1598966806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b8e97bdc0 0x562b8e986140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.485+0000 7f81bcccd640 1 -- 172.21.15.7:0/1598966806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 msgr2=0x562b8e988a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:40.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.485+0000 7f81bcccd640 1 --2- 172.21.15.7:0/1598966806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e988a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.485+0000 7f81bcccd640 1 -- 172.21.15.7:0/1598966806 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b8e86d440 con 0x562b8e97b4a0 2024-09-19T08:50:40.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.485+0000 7f81bd4ce640 1 --2- 172.21.15.7:0/1598966806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e988a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:50:40.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.485+0000 7f81bd4ce640 1 --2- 172.21.15.7:0/3257526499 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f81a00a33b0 0x7f81a00a5870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81b0004ab0 tx=0x7f81b00098f0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:40.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.486+0000 7f81bcccd640 1 --2- 172.21.15.7:0/1598966806 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b8e97b4a0 0x562b8e97b880 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f81a800bb70 tx=0x7f81a80107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fbc498d06110d9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:40.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.486+0000 7f819effd640 1 -- 172.21.15.7:0/1598966806 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a8004030 con 0x562b8e97b4a0 2024-09-19T08:50:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.486+0000 7f819effd640 1 -- 172.21.15.7:0/1598966806 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81a80041d0 con 0x562b8e97b4a0 2024-09-19T08:50:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.486+0000 7f819effd640 1 -- 172.21.15.7:0/1598966806 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a8011640 con 0x562b8e97b4a0 2024-09-19T08:50:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.486+0000 7f81c130a740 1 -- 172.21.15.7:0/1598966806 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b8e97b4a0 msgr2=0x562b8e97b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.486+0000 7f81c130a740 1 --2- 172.21.15.7:0/1598966806 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b8e97b4a0 0x562b8e97b880 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f81a800bb70 tx=0x7f81a80107a0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.486+0000 7f81c130a740 1 -- 172.21.15.7:0/1598966806 shutdown_connections 2024-09-19T08:50:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.486+0000 7f81c130a740 1 --2- 172.21.15.7:0/1598966806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e988a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.486+0000 7f81c130a740 1 --2- 172.21.15.7:0/1598966806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b8e97bdc0 0x562b8e986140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.486+0000 7f81c130a740 1 --2- 172.21.15.7:0/1598966806 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b8e97b4a0 0x562b8e97b880 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.486+0000 7f81c130a740 1 -- 172.21.15.7:0/1598966806 >> 172.21.15.7:0/1598966806 conn(0x562b8e977a30 msgr2=0x562b8e977e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.487+0000 7f81c130a740 1 -- 172.21.15.7:0/1598966806 shutdown_connections 2024-09-19T08:50:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.487+0000 7f81c130a740 1 -- 172.21.15.7:0/1598966806 wait complete. 2024-09-19T08:50:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.487+0000 7f81c130a740 1 -- start start 2024-09-19T08:50:40.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.487+0000 7f81c130a740 1 Processor -- start 2024-09-19T08:50:40.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.487+0000 7f81c130a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b8e97b4a0 0x562b8e985f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:40.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.487+0000 7f81c130a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b8e97bdc0 0x562b8e9831f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:40.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.487+0000 7f81c130a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e983730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:40.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.487+0000 7f81c130a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562b8e989250 con 0x562b8e986680 2024-09-19T08:50:40.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.487+0000 7f81c130a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562b8e89c050 con 0x562b8e97bdc0 2024-09-19T08:50:40.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.487+0000 7f81c130a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562b8e9893d0 con 0x562b8e97b4a0 2024-09-19T08:50:40.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.487+0000 7f81c130a740 10 client.0 _ll_register_callbacks cb 0x562b8e8dc160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:40.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.487+0000 7f81bd4ce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e983730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:40.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.488+0000 7f81b7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b8e97bdc0 0x562b8e9831f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:40.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.488+0000 7f81bd4ce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e983730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59630/0 (socket says 172.21.15.7:59630) 2024-09-19T08:50:40.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.488+0000 7f81bd4ce640 1 -- 172.21.15.7:0/2920528860 learned_addr learned my addr 172.21.15.7:0/2920528860 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:40.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.488+0000 7f81bcccd640 1 --2- 172.21.15.7:0/2920528860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b8e97b4a0 0x562b8e985f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:40.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.488+0000 7f81bd4ce640 1 -- 172.21.15.7:0/2920528860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b8e97b4a0 msgr2=0x562b8e985f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:40.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.488+0000 7f81bd4ce640 1 --2- 172.21.15.7:0/2920528860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b8e97b4a0 0x562b8e985f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.488+0000 7f81bd4ce640 1 -- 172.21.15.7:0/2920528860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b8e97bdc0 msgr2=0x562b8e9831f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:40.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.488+0000 7f81bd4ce640 1 --2- 172.21.15.7:0/2920528860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b8e97bdc0 0x562b8e9831f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.488+0000 7f81bd4ce640 1 -- 172.21.15.7:0/2920528860 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b8e6523c0 con 0x562b8e986680 2024-09-19T08:50:40.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.488+0000 7f81b7fff640 1 --2- 172.21.15.7:0/2920528860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b8e97bdc0 0x562b8e9831f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:50:40.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.488+0000 7f81bd4ce640 1 --2- 172.21.15.7:0/2920528860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e983730 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f81b0009cd0 tx=0x7f81b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570137e345f4f21b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:40.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.488+0000 7f8197fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:50:40.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.488+0000 7f8197fff640 1 -- 172.21.15.7:0/2920528860 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b004f070 con 0x562b8e986680 2024-09-19T08:50:40.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.488+0000 7f81c130a740 1 -- 172.21.15.7:0/2920528860 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81a80041d0 con 0x562b8e986680 2024-09-19T08:50:40.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.488+0000 7f8197fff640 1 -- 172.21.15.7:0/2920528860 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f81b00305a0 con 0x562b8e986680 2024-09-19T08:50:40.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.488+0000 7f8197fff640 1 -- 172.21.15.7:0/2920528860 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f81b00307a0 con 0x562b8e986680 2024-09-19T08:50:40.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.488+0000 7f81c130a740 10 client.16590 fetch_fsmap learned FSMap version 25 2024-09-19T08:50:40.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.488+0000 7f81c130a740 1 -- 172.21.15.7:0/2920528860 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562b8e994bf0 con 0x562b8e986680 2024-09-19T08:50:40.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.489+0000 7f8197fff640 1 -- 172.21.15.7:0/2920528860 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81a80041d0 con 0x562b8e986680 2024-09-19T08:50:40.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.489+0000 7f8197fff640 1 -- 172.21.15.7:0/2920528860 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f81b0030070 con 0x562b8e986680 2024-09-19T08:50:40.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.489+0000 7f81c130a740 10 client.16590 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:50:40.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.489+0000 7f81c130a740 10 client.16590 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:50:40.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.489+0000 7f81c130a740 20 client.16590 populate_metadata read hostname 'smithi007' 2024-09-19T08:50:40.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.489+0000 7f81c130a740 1 --2- 172.21.15.7:0/2920528860 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562b8e996000 0x562b8e998410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:40.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.489+0000 7f81c130a740 4 client.16590 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:50:40.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.489+0000 7f81c130a740 1 -- 172.21.15.7:0/2920528860 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b8e8ee850 con 0x562b8e996000 2024-09-19T08:50:40.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.489+0000 7f81bcccd640 1 --2- 172.21.15.7:0/2920528860 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562b8e996000 0x562b8e998410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:40.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.490+0000 7f81bcccd640 1 --2- 172.21.15.7:0/2920528860 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562b8e996000 0x562b8e998410 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a034615d1d0f7b3 server_cookie=364a6e21c7dff6d1 in_seq=0 out_seq=0 2024-09-19T08:50:40.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.490+0000 7f8197fff640 10 client.16590 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:40.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.490+0000 7f8197fff640 1 -- 172.21.15.7:0/2920528860 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562b8e8ee850 con 0x562b8e996000 2024-09-19T08:50:40.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.490+0000 7f8197fff640 10 client.16590 handle_command_reply: tid=0 2024-09-19T08:50:40.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.490+0000 7f81c130a740 1 client.16590 shutdown 2024-09-19T08:50:40.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.491+0000 7f81c130a740 1 -- 172.21.15.7:0/2920528860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 msgr2=0x562b8e983730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:40.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.491+0000 7f81c130a740 1 --2- 172.21.15.7:0/2920528860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e983730 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f81b0009cd0 tx=0x7f81b0004a40 comp rx=0 tx=0).stop 2024-09-19T08:50:40.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.491+0000 7f81c130a740 1 -- 172.21.15.7:0/2920528860 shutdown_connections 2024-09-19T08:50:40.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.491+0000 7f81c130a740 1 --2- 172.21.15.7:0/2920528860 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562b8e996000 0x562b8e998410 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.491+0000 7f81c130a740 1 --2- 172.21.15.7:0/2920528860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e983730 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.491+0000 7f81c130a740 1 --2- 172.21.15.7:0/2920528860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b8e97bdc0 0x562b8e9831f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.491+0000 7f8197fff640 0 client.16590 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:40.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.491+0000 7f81c130a740 1 --2- 172.21.15.7:0/2920528860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b8e97b4a0 0x562b8e985f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.491+0000 7f81c130a740 1 -- 172.21.15.7:0/2920528860 >> 172.21.15.7:0/2920528860 conn(0x562b8e977a30 msgr2=0x562b8e97d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:40.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.491+0000 7f81c130a740 1 -- 172.21.15.7:0/2920528860 shutdown_connections 2024-09-19T08:50:40.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.491+0000 7f81c130a740 1 -- 172.21.15.7:0/2920528860 wait complete. 2024-09-19T08:50:40.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.491+0000 7f81c130a740 20 client.16590 trim_cache size 0 max 16384 2024-09-19T08:50:40.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.508+0000 7f81c130a740 1 Processor -- start 2024-09-19T08:50:40.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.508+0000 7f81c130a740 1 -- start start 2024-09-19T08:50:40.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.508+0000 7f81c130a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b8e97b4a0 0x562b8e985160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:40.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.508+0000 7f81c130a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b8e97bdc0 0x562b8e99dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:40.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.508+0000 7f81c130a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e99e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:40.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.508+0000 7f81c130a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f81b81b0240 con 0x562b8e986680 2024-09-19T08:50:40.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.508+0000 7f81c130a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f81b81adb10 con 0x562b8e97b4a0 2024-09-19T08:50:40.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.508+0000 7f81c130a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f81b81ab960 con 0x562b8e97bdc0 2024-09-19T08:50:40.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.508+0000 7f81bd4ce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e99e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:40.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.508+0000 7f81bd4ce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e99e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59636/0 (socket says 172.21.15.7:59636) 2024-09-19T08:50:40.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.508+0000 7f81bd4ce640 1 -- 172.21.15.7:0/2470696988 learned_addr learned my addr 172.21.15.7:0/2470696988 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:40.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.509+0000 7f81b7fff640 1 --2- 172.21.15.7:0/2470696988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b8e97bdc0 0x562b8e99dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:40.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.509+0000 7f81bcccd640 1 --2- 172.21.15.7:0/2470696988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b8e97b4a0 0x562b8e985160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:40.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.509+0000 7f81bd4ce640 1 -- 172.21.15.7:0/2470696988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b8e97bdc0 msgr2=0x562b8e99dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:40.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.509+0000 7f81bd4ce640 1 --2- 172.21.15.7:0/2470696988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b8e97bdc0 0x562b8e99dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.509+0000 7f81bd4ce640 1 -- 172.21.15.7:0/2470696988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b8e97b4a0 msgr2=0x562b8e985160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:40.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.509+0000 7f81bd4ce640 1 --2- 172.21.15.7:0/2470696988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b8e97b4a0 0x562b8e985160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.509+0000 7f81bd4ce640 1 -- 172.21.15.7:0/2470696988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b8e981740 con 0x562b8e986680 2024-09-19T08:50:40.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.509+0000 7f81bd4ce640 1 --2- 172.21.15.7:0/2470696988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e99e220 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f81b0049b20 tx=0x7f81b00319d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befb0745294b7bae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:40.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.509+0000 7f819e7fc640 1 -- 172.21.15.7:0/2470696988 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b004f070 con 0x562b8e986680 2024-09-19T08:50:40.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.509+0000 7f819e7fc640 1 -- 172.21.15.7:0/2470696988 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81b0003c80 con 0x562b8e986680 2024-09-19T08:50:40.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.509+0000 7f819e7fc640 1 -- 172.21.15.7:0/2470696988 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b0004b40 con 0x562b8e986680 2024-09-19T08:50:40.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.510+0000 7f81c130a740 1 -- 172.21.15.7:0/2470696988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 msgr2=0x562b8e99e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:40.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.510+0000 7f81c130a740 1 --2- 172.21.15.7:0/2470696988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e99e220 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f81b0049b20 tx=0x7f81b00319d0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.510+0000 7f81c130a740 1 -- 172.21.15.7:0/2470696988 shutdown_connections 2024-09-19T08:50:40.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.510+0000 7f81c130a740 1 --2- 172.21.15.7:0/2470696988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e99e220 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.510+0000 7f81c130a740 1 --2- 172.21.15.7:0/2470696988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b8e97bdc0 0x562b8e99dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.510+0000 7f81c130a740 1 --2- 172.21.15.7:0/2470696988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b8e97b4a0 0x562b8e985160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.510+0000 7f81c130a740 1 -- 172.21.15.7:0/2470696988 >> 172.21.15.7:0/2470696988 conn(0x562b8e977a30 msgr2=0x562b8e984a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:40.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.510+0000 7f81c130a740 1 -- 172.21.15.7:0/2470696988 shutdown_connections 2024-09-19T08:50:40.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.510+0000 7f81c130a740 1 -- 172.21.15.7:0/2470696988 wait complete. 2024-09-19T08:50:40.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.510+0000 7f81c130a740 1 -- start start 2024-09-19T08:50:40.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.510+0000 7f81c130a740 1 Processor -- start 2024-09-19T08:50:40.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.511+0000 7f81c130a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b8e97b4a0 0x562b8e98bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:40.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.511+0000 7f81c130a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b8e97bdc0 0x562b8e98c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:40.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.511+0000 7f81c130a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e9f8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:40.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.511+0000 7f81c130a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f81b81abfd0 con 0x562b8e986680 2024-09-19T08:50:40.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.511+0000 7f81c130a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f81b81ad440 con 0x562b8e97b4a0 2024-09-19T08:50:40.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.511+0000 7f81c130a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f81b81ac6a0 con 0x562b8e97bdc0 2024-09-19T08:50:40.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.511+0000 7f81c130a740 10 client.0 _ll_register_callbacks cb 0x7f81b0009c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:50:40.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.511+0000 7f81bd4ce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e9f8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:40.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.511+0000 7f81bd4ce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e9f8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59644/0 (socket says 172.21.15.7:59644) 2024-09-19T08:50:40.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.511+0000 7f81bd4ce640 1 -- 172.21.15.7:0/708580077 learned_addr learned my addr 172.21.15.7:0/708580077 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:50:40.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.511+0000 7f81b7fff640 1 --2- 172.21.15.7:0/708580077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b8e97bdc0 0x562b8e98c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:40.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.511+0000 7f81bcccd640 1 --2- 172.21.15.7:0/708580077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b8e97b4a0 0x562b8e98bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:40.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.511+0000 7f81bd4ce640 1 -- 172.21.15.7:0/708580077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b8e97bdc0 msgr2=0x562b8e98c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:40.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.511+0000 7f81bd4ce640 1 --2- 172.21.15.7:0/708580077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b8e97bdc0 0x562b8e98c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.511+0000 7f81bd4ce640 1 -- 172.21.15.7:0/708580077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b8e97b4a0 msgr2=0x562b8e98bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:50:40.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.511+0000 7f81bd4ce640 1 --2- 172.21.15.7:0/708580077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b8e97b4a0 0x562b8e98bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.511+0000 7f81bd4ce640 1 -- 172.21.15.7:0/708580077 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b8e9f9320 con 0x562b8e986680 2024-09-19T08:50:40.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.511+0000 7f81bd4ce640 1 --2- 172.21.15.7:0/708580077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e9f8c80 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f81b002ae00 tx=0x7f81b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8b556c02ff813 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:40.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.511+0000 7f8197fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:50:40.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.512+0000 7f8197fff640 1 -- 172.21.15.7:0/708580077 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b004f040 con 0x562b8e986680 2024-09-19T08:50:40.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.512+0000 7f8197fff640 1 -- 172.21.15.7:0/708580077 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8541+0+0 (secure 0 0 0) 0x7f81b0045050 con 0x562b8e986680 2024-09-19T08:50:40.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.512+0000 7f81c130a740 1 -- 172.21.15.7:0/708580077 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562b8e8e8d60 con 0x562b8e986680 2024-09-19T08:50:40.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.512+0000 7f8197fff640 1 -- 172.21.15.7:0/708580077 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f81b006d050 con 0x562b8e986680 2024-09-19T08:50:40.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.512+0000 7f81c130a740 10 client.16596 fetch_fsmap learned FSMap version 25 2024-09-19T08:50:40.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.512+0000 7f81c130a740 1 -- 172.21.15.7:0/708580077 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562b8ea006e0 con 0x562b8e986680 2024-09-19T08:50:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.512+0000 7f8197fff640 1 -- 172.21.15.7:0/708580077 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x562b8e8e8d60 con 0x562b8e986680 2024-09-19T08:50:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.512+0000 7f8197fff640 1 -- 172.21.15.7:0/708580077 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f81b0005040 con 0x562b8e986680 2024-09-19T08:50:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.512+0000 7f81c130a740 10 client.16596 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:50:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.512+0000 7f81c130a740 10 client.16596 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:50:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.512+0000 7f81c130a740 20 client.16596 populate_metadata read hostname 'smithi007' 2024-09-19T08:50:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.512+0000 7f81c130a740 1 --2- 172.21.15.7:0/708580077 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562b8ea00d70 0x562b8ea03190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.512+0000 7f81c130a740 4 client.16596 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:50:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.512+0000 7f81c130a740 1 -- 172.21.15.7:0/708580077 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562b8e865210 con 0x562b8ea00d70 2024-09-19T08:50:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.513+0000 7f81bcccd640 1 --2- 172.21.15.7:0/708580077 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562b8ea00d70 0x562b8ea03190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.513+0000 7f8197fff640 10 client.16596 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.513+0000 7f81bcccd640 1 --2- 172.21.15.7:0/708580077 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562b8ea00d70 0x562b8ea03190 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f80597688e1c0e40 server_cookie=b2199fe69840c23 in_seq=0 out_seq=0 2024-09-19T08:50:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.513+0000 7f8197fff640 1 -- 172.21.15.7:0/708580077 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562b8e865210 con 0x562b8ea00d70 2024-09-19T08:50:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.513+0000 7f8197fff640 10 client.16596 handle_command_reply: tid=0 2024-09-19T08:50:40.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.513+0000 7f81c130a740 1 client.16596 shutdown 2024-09-19T08:50:40.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.513+0000 7f81c130a740 1 -- 172.21.15.7:0/708580077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 msgr2=0x562b8e9f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:40.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.513+0000 7f81c130a740 1 --2- 172.21.15.7:0/708580077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e9f8c80 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f81b002ae00 tx=0x7f81b0004a40 comp rx=0 tx=0).stop 2024-09-19T08:50:40.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.513+0000 7f81c130a740 1 -- 172.21.15.7:0/708580077 shutdown_connections 2024-09-19T08:50:40.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.513+0000 7f81c130a740 1 --2- 172.21.15.7:0/708580077 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562b8ea00d70 0x562b8ea03190 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.513+0000 7f81c130a740 1 --2- 172.21.15.7:0/708580077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b8e986680 0x562b8e9f8c80 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.513+0000 7f81c130a740 1 --2- 172.21.15.7:0/708580077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b8e97bdc0 0x562b8e98c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.513+0000 7f81c130a740 1 --2- 172.21.15.7:0/708580077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b8e97b4a0 0x562b8e98bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.513+0000 7f81c130a740 1 -- 172.21.15.7:0/708580077 >> 172.21.15.7:0/708580077 conn(0x562b8e977a30 msgr2=0x562b8e985270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:40.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.513+0000 7f8197fff640 0 client.16596 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:50:40.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.513+0000 7f81c130a740 1 -- 172.21.15.7:0/708580077 shutdown_connections 2024-09-19T08:50:40.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.513+0000 7f81c130a740 1 -- 172.21.15.7:0/708580077 wait complete. 2024-09-19T08:50:40.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.514+0000 7f81c130a740 20 client.16596 trim_cache size 0 max 16384 2024-09-19T08:50:40.525 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:50:40.525 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:50:40.525 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-19T08:50:40.525 INFO:teuthology.orchestra.run.smithi007.stdout: "a5201fb2-80fb-438f-8cb4-c6958af8d5e9": { 2024-09-19T08:50:40.525 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-19T08:50:40.525 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "a5201fb2-80fb-438f-8cb4-c6958af8d5e9", 2024-09-19T08:50:40.525 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-19T08:50:40.525 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:50:40.526 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:50:40.526 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:50:40.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.514+0000 7f81bef31640 1 -- 172.21.15.7:0/3257526499 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f81a00a33b0 msgr2=0x7f81a00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:40.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.514+0000 7f81bef31640 1 --2- 172.21.15.7:0/3257526499 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f81a00a33b0 0x7f81a00a5870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81b0004ab0 tx=0x7f81b00098f0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.514+0000 7f81bef31640 1 -- 172.21.15.7:0/3257526499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b8101420 msgr2=0x7f81b8198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:40.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.514+0000 7f81bef31640 1 --2- 172.21.15.7:0/3257526499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b8101420 0x7f81b8198950 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f81ac00d950 tx=0x7f81ac00de10 comp rx=0 tx=0).stop 2024-09-19T08:50:40.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.514+0000 7f81bef31640 1 -- 172.21.15.7:0/3257526499 shutdown_connections 2024-09-19T08:50:40.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.514+0000 7f81bef31640 1 --2- 172.21.15.7:0/3257526499 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f81a00a33b0 0x7f81a00a5870 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.514+0000 7f81bef31640 1 --2- 172.21.15.7:0/3257526499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81b8106a80 0x7f81b819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.514+0000 7f81bef31640 1 --2- 172.21.15.7:0/3257526499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b8101420 0x7f81b8198950 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.514+0000 7f81bef31640 1 --2- 172.21.15.7:0/3257526499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81b8100a80 0x7f81b8198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:40.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.514+0000 7f81bef31640 1 -- 172.21.15.7:0/3257526499 >> 172.21.15.7:0/3257526499 conn(0x7f81b80fc7a0 msgr2=0x7f81b806a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:40.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.514+0000 7f81bef31640 1 -- 172.21.15.7:0/3257526499 shutdown_connections 2024-09-19T08:50:40.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:50:40.514+0000 7f81bef31640 1 -- 172.21.15.7:0/3257526499 wait complete. 2024-09-19T08:50:41.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:40 smithi175 ceph-mon[35688]: scrub queued for path: / 2024-09-19T08:50:41.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:40 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:50:41.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:40 smithi175 ceph-mon[35688]: scrub summary: active paths [/] 2024-09-19T08:50:41.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:40 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:50:41.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:40 smithi175 ceph-mon[35688]: pgmap v187: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:50:41.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:40 smithi007 ceph-mon[31221]: scrub queued for path: / 2024-09-19T08:50:41.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:40 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:50:41.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:40 smithi007 ceph-mon[31221]: scrub summary: active paths [/] 2024-09-19T08:50:41.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:40 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:50:41.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:40 smithi007 ceph-mon[31221]: pgmap v187: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:50:41.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:40 smithi044 ceph-mon[35072]: scrub queued for path: / 2024-09-19T08:50:41.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:40 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:50:41.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:40 smithi044 ceph-mon[35072]: scrub summary: active paths [/] 2024-09-19T08:50:41.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:40 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:50:41.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:40 smithi044 ceph-mon[35072]: pgmap v187: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:50:41.313 INFO:tasks.cephfs.filesystem:scrub status for tag:a5201fb2-80fb-438f-8cb4-c6958af8d5e9 - {'path': '/', 'tag': 'a5201fb2-80fb-438f-8cb4-c6958af8d5e9', 'options': 'recursive,force'} 2024-09-19T08:50:43.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:42 smithi175 ceph-mon[35688]: pgmap v188: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:50:43.285 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:42 smithi007 ceph-mon[31221]: pgmap v188: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:50:43.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:42 smithi044 ceph-mon[35072]: pgmap v188: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:50:45.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:44 smithi175 ceph-mon[35688]: pgmap v189: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T08:50:45.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:44 smithi175 ceph-mon[35688]: scrub summary: idle 2024-09-19T08:50:45.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:44 smithi007 ceph-mon[31221]: pgmap v189: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T08:50:45.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:44 smithi007 ceph-mon[31221]: scrub summary: idle 2024-09-19T08:50:45.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:44 smithi044 ceph-mon[35072]: pgmap v189: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T08:50:45.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:44 smithi044 ceph-mon[35072]: scrub summary: idle 2024-09-19T08:50:46.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:45 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:46.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:45 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:46.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:45 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:46.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:45 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:50:46.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:45 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:46.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:45 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:46.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:45 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:46.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:45 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:50:46.305 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:45 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:46.305 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:45 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:46.305 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:45 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:46.305 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:45 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:50:47.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:46 smithi175 ceph-mon[35688]: pgmap v190: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:50:47.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:46 smithi007 ceph-mon[31221]: pgmap v190: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:50:47.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:46 smithi044 ceph-mon[35072]: pgmap v190: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:50:49.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:48 smithi175 ceph-mon[35688]: pgmap v191: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:50:49.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:48 smithi007 ceph-mon[31221]: pgmap v191: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:50:49.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:48 smithi044 ceph-mon[35072]: pgmap v191: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:50:51.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:50 smithi175 ceph-mon[35688]: pgmap v192: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:50:51.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:50 smithi007 ceph-mon[31221]: pgmap v192: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:50:51.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:50 smithi044 ceph-mon[35072]: pgmap v192: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:50:53.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:52 smithi175 ceph-mon[35688]: pgmap v193: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:50:53.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:52 smithi007 ceph-mon[31221]: pgmap v193: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:50:53.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:52 smithi044 ceph-mon[35072]: pgmap v193: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:50:55.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:54 smithi175 ceph-mon[35688]: pgmap v194: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:50:55.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:54 smithi007 ceph-mon[31221]: pgmap v194: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:50:55.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:54 smithi044 ceph-mon[35072]: pgmap v194: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:50:57.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:56 smithi175 ceph-mon[35688]: pgmap v195: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:50:57.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:56 smithi007 ceph-mon[31221]: pgmap v195: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:50:57.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:56 smithi044 ceph-mon[35072]: pgmap v195: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:50:59.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:50:58 smithi175 ceph-mon[35688]: pgmap v196: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:50:59.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:50:58 smithi007 ceph-mon[31221]: pgmap v196: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:50:59.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:50:58 smithi044 ceph-mon[35072]: pgmap v196: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:51:01.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:00 smithi007 ceph-mon[31221]: pgmap v197: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:01.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:00 smithi044 ceph-mon[35072]: pgmap v197: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:01.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:00 smithi175 ceph-mon[35688]: pgmap v197: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:03.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:02 smithi007 ceph-mon[31221]: pgmap v198: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:03.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:02 smithi044 ceph-mon[35072]: pgmap v198: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:03.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:02 smithi175 ceph-mon[35688]: pgmap v198: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:04.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:04 smithi175 ceph-mon[35688]: pgmap v199: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:51:04.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:04 smithi007 ceph-mon[31221]: pgmap v199: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:51:04.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:04 smithi044 ceph-mon[35072]: pgmap v199: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:51:06.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:06 smithi175 ceph-mon[35688]: pgmap v200: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:51:06.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:06 smithi007 ceph-mon[31221]: pgmap v200: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:51:06.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:06 smithi044 ceph-mon[35072]: pgmap v200: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:51:08.603 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:08 smithi044 ceph-mon[35072]: pgmap v201: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:51:08.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:08 smithi175 ceph-mon[35688]: pgmap v201: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:51:08.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:08 smithi007 ceph-mon[31221]: pgmap v201: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:51:10.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:10 smithi175 ceph-mon[35688]: pgmap v202: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:51:10.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:10 smithi175 ceph-mon[35688]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T08:51:10.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:10 smithi007 ceph-mon[31221]: pgmap v202: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:51:10.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:10 smithi007 ceph-mon[31221]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T08:51:10.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:10 smithi044 ceph-mon[35072]: pgmap v202: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:51:10.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:10 smithi044 ceph-mon[35072]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T08:51:11.314 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:51:11.586 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:12.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.074+0000 7f7d9b678640 1 -- 172.21.15.7:0/4139230271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d941036e0 msgr2=0x7f7d94107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:12.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.074+0000 7f7d9b678640 1 --2- 172.21.15.7:0/4139230271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d941036e0 0x7f7d94107b90 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009930 tx=0x7f7d8402a420 comp rx=0 tx=0).stop 2024-09-19T08:51:12.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.074+0000 7f7d9b678640 1 -- 172.21.15.7:0/4139230271 shutdown_connections 2024-09-19T08:51:12.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.074+0000 7f7d9b678640 1 --2- 172.21.15.7:0/4139230271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d941082a0 0x7f7d9410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.074+0000 7f7d9b678640 1 --2- 172.21.15.7:0/4139230271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d941036e0 0x7f7d94107b90 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.074+0000 7f7d9b678640 1 --2- 172.21.15.7:0/4139230271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d94102d30 0x7f7d94103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.074+0000 7f7d9b678640 1 -- 172.21.15.7:0/4139230271 >> 172.21.15.7:0/4139230271 conn(0x7f7d940fc7d0 msgr2=0x7f7d940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:12.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.074+0000 7f7d9b678640 1 -- 172.21.15.7:0/4139230271 shutdown_connections 2024-09-19T08:51:12.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.074+0000 7f7d9b678640 1 -- 172.21.15.7:0/4139230271 wait complete. 2024-09-19T08:51:12.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.075+0000 7f7d9b678640 1 Processor -- start 2024-09-19T08:51:12.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.075+0000 7f7d9b678640 1 -- start start 2024-09-19T08:51:12.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.075+0000 7f7d9b678640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d94102d30 0x7f7d94100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:12.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.075+0000 7f7d9b678640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d941036e0 0x7f7d94100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:12.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.075+0000 7f7d9b678640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d941082a0 0x7f7d94101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:12.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.075+0000 7f7d9b678640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7d941120a0 con 0x7f7d941036e0 2024-09-19T08:51:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.075+0000 7f7d9b678640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7d94111f20 con 0x7f7d941082a0 2024-09-19T08:51:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.075+0000 7f7d9b678640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7d94112220 con 0x7f7d94102d30 2024-09-19T08:51:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.075+0000 7f7d98c13640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d941036e0 0x7f7d94100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.075+0000 7f7d98c13640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d941036e0 0x7f7d94100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44604/0 (socket says 172.21.15.7:44604) 2024-09-19T08:51:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.075+0000 7f7d98c13640 1 -- 172.21.15.7:0/3298467052 learned_addr learned my addr 172.21.15.7:0/3298467052 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.075+0000 7f7d99414640 1 --2- 172.21.15.7:0/3298467052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d94102d30 0x7f7d94100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.075+0000 7f7d99c15640 1 --2- 172.21.15.7:0/3298467052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d941082a0 0x7f7d94101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.076+0000 7f7d98c13640 1 -- 172.21.15.7:0/3298467052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d94102d30 msgr2=0x7f7d94100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.076+0000 7f7d98c13640 1 --2- 172.21.15.7:0/3298467052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d94102d30 0x7f7d94100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.076+0000 7f7d98c13640 1 -- 172.21.15.7:0/3298467052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d941082a0 msgr2=0x7f7d94101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.076+0000 7f7d98c13640 1 --2- 172.21.15.7:0/3298467052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d941082a0 0x7f7d94101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.076+0000 7f7d98c13640 1 -- 172.21.15.7:0/3298467052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d941a6aa0 con 0x7f7d941036e0 2024-09-19T08:51:12.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.076+0000 7f7d98c13640 1 --2- 172.21.15.7:0/3298467052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d941036e0 0x7f7d94100ed0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7d84005940 tx=0x7f7d840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:12.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.076+0000 7f7d8a7fc640 1 -- 172.21.15.7:0/3298467052 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8403f030 con 0x7f7d941036e0 2024-09-19T08:51:12.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.076+0000 7f7d8a7fc640 1 -- 172.21.15.7:0/3298467052 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d84003ce0 con 0x7f7d941036e0 2024-09-19T08:51:12.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.076+0000 7f7d9b678640 1 -- 172.21.15.7:0/3298467052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d941a6d30 con 0x7f7d941036e0 2024-09-19T08:51:12.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.076+0000 7f7d8a7fc640 1 -- 172.21.15.7:0/3298467052 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d84035070 con 0x7f7d941036e0 2024-09-19T08:51:12.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.076+0000 7f7d9b678640 1 -- 172.21.15.7:0/3298467052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d941a71c0 con 0x7f7d941036e0 2024-09-19T08:51:12.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.079+0000 7f7d8a7fc640 1 -- 172.21.15.7:0/3298467052 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f7d84042030 con 0x7f7d941036e0 2024-09-19T08:51:12.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.079+0000 7f7d9da51740 1 Processor -- start 2024-09-19T08:51:12.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.079+0000 7f7d9da51740 1 -- start start 2024-09-19T08:51:12.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.080+0000 7f7d9da51740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56178fe4c4a0 0x56178fe4c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:12.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.080+0000 7f7d9da51740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe4cdc0 0x56178fe57140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:12.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.080+0000 7f7d9da51740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56178fe57680 0x56178fe59a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:12.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.080+0000 7f7d9da51740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56178fdb22e0 con 0x56178fe4cdc0 2024-09-19T08:51:12.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.080+0000 7f7d9da51740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56178fd59ce0 con 0x56178fe4c4a0 2024-09-19T08:51:12.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.080+0000 7f7d9da51740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56178fdae2a0 con 0x56178fe57680 2024-09-19T08:51:12.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.080+0000 7f7d99414640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe4cdc0 0x56178fe57140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:12.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.080+0000 7f7d99414640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe4cdc0 0x56178fe57140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44620/0 (socket says 172.21.15.7:44620) 2024-09-19T08:51:12.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.080+0000 7f7d99c15640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56178fe4c4a0 0x56178fe4c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:12.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.080+0000 7f7d99414640 1 -- 172.21.15.7:0/4051138965 learned_addr learned my addr 172.21.15.7:0/4051138965 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:12.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.080+0000 7f7d8a7fc640 1 --2- 172.21.15.7:0/3298467052 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7d800a33b0 0x7f7d800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.080+0000 7f7d99414640 1 -- 172.21.15.7:0/4051138965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56178fe57680 msgr2=0x56178fe59a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.080+0000 7f7d99414640 1 --2- 172.21.15.7:0/4051138965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56178fe57680 0x56178fe59a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.080+0000 7f7d99414640 1 -- 172.21.15.7:0/4051138965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56178fe4c4a0 msgr2=0x56178fe4c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.080+0000 7f7d99414640 1 --2- 172.21.15.7:0/4051138965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56178fe4c4a0 0x56178fe4c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.080+0000 7f7d99414640 1 -- 172.21.15.7:0/4051138965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56178fd3e440 con 0x56178fe4cdc0 2024-09-19T08:51:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.080+0000 7f7d99c15640 1 --2- 172.21.15.7:0/4051138965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56178fe4c4a0 0x56178fe4c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.081+0000 7f7d8a7fc640 1 -- 172.21.15.7:0/3298467052 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8629+0+0 (secure 0 0 0) 0x7f7d840f0160 con 0x7f7d941036e0 2024-09-19T08:51:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.081+0000 7f7d99c15640 1 --2- 172.21.15.7:0/3298467052 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7d800a33b0 0x7f7d800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.081+0000 7f7d99414640 1 --2- 172.21.15.7:0/4051138965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe4cdc0 0x56178fe57140 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f7d900103f0 tx=0x7f7d900108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abcaade9df97c10c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.081+0000 7f7d7f7fe640 1 -- 172.21.15.7:0/4051138965 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90016070 con 0x56178fe4cdc0 2024-09-19T08:51:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.081+0000 7f7d7f7fe640 1 -- 172.21.15.7:0/4051138965 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d90004d20 con 0x56178fe4cdc0 2024-09-19T08:51:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.081+0000 7f7d7f7fe640 1 -- 172.21.15.7:0/4051138965 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90005450 con 0x56178fe4cdc0 2024-09-19T08:51:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.082+0000 7f7d99c15640 1 --2- 172.21.15.7:0/3298467052 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7d800a33b0 0x7f7d800a5870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c00b7a0 tx=0x7f7d8c0046c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.082+0000 7f7d9da51740 1 -- 172.21.15.7:0/4051138965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe4cdc0 msgr2=0x56178fe57140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.082+0000 7f7d9da51740 1 --2- 172.21.15.7:0/4051138965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe4cdc0 0x56178fe57140 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f7d900103f0 tx=0x7f7d900108b0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.082+0000 7f7d9da51740 1 -- 172.21.15.7:0/4051138965 shutdown_connections 2024-09-19T08:51:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.082+0000 7f7d9da51740 1 --2- 172.21.15.7:0/4051138965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56178fe57680 0x56178fe59a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.082+0000 7f7d9da51740 1 --2- 172.21.15.7:0/4051138965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe4cdc0 0x56178fe57140 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.082+0000 7f7d9da51740 1 --2- 172.21.15.7:0/4051138965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56178fe4c4a0 0x56178fe4c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.082+0000 7f7d9da51740 1 -- 172.21.15.7:0/4051138965 >> 172.21.15.7:0/4051138965 conn(0x56178fe48a30 msgr2=0x56178fe48e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.082+0000 7f7d9da51740 1 -- 172.21.15.7:0/4051138965 shutdown_connections 2024-09-19T08:51:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.082+0000 7f7d9da51740 1 -- 172.21.15.7:0/4051138965 wait complete. 2024-09-19T08:51:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.082+0000 7f7d9da51740 1 -- start start 2024-09-19T08:51:12.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.083+0000 7f7d9da51740 1 Processor -- start 2024-09-19T08:51:12.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.083+0000 7f7d9da51740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56178fe4c4a0 0x56178fe57060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:12.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.083+0000 7f7d9da51740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56178fe4cdc0 0x56178fe54310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:12.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.083+0000 7f7d9da51740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe57680 0x56178fe548e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:12.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.083+0000 7f7d9da51740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56178fe5a250 con 0x56178fe57680 2024-09-19T08:51:12.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.083+0000 7f7d9da51740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56178fd6d050 con 0x56178fe4c4a0 2024-09-19T08:51:12.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.083+0000 7f7d9da51740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56178fe5a3d0 con 0x56178fe4cdc0 2024-09-19T08:51:12.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.083+0000 7f7d9da51740 10 client.0 _ll_register_callbacks cb 0x56178fdad160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:12.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.083+0000 7f7d99c15640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe57680 0x56178fe548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:12.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.083+0000 7f7d99c15640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe57680 0x56178fe548e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44630/0 (socket says 172.21.15.7:44630) 2024-09-19T08:51:12.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.083+0000 7f7d99c15640 1 -- 172.21.15.7:0/3899815889 learned_addr learned my addr 172.21.15.7:0/3899815889 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:12.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.083+0000 7f7d99414640 1 --2- 172.21.15.7:0/3899815889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56178fe4c4a0 0x56178fe57060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:12.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.083+0000 7f7d98c13640 1 --2- 172.21.15.7:0/3899815889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56178fe4cdc0 0x56178fe54310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:12.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.083+0000 7f7d99c15640 1 -- 172.21.15.7:0/3899815889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56178fe4cdc0 msgr2=0x56178fe54310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:12.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.084+0000 7f7d99c15640 1 --2- 172.21.15.7:0/3899815889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56178fe4cdc0 0x56178fe54310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.084+0000 7f7d99c15640 1 -- 172.21.15.7:0/3899815889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56178fe4c4a0 msgr2=0x56178fe57060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:12.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.084+0000 7f7d99c15640 1 --2- 172.21.15.7:0/3899815889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56178fe4c4a0 0x56178fe57060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.084+0000 7f7d99c15640 1 -- 172.21.15.7:0/3899815889 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56178fb233c0 con 0x56178fe57680 2024-09-19T08:51:12.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.084+0000 7f7d99c15640 1 --2- 172.21.15.7:0/3899815889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe57680 0x56178fe548e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c00bf10 tx=0x7f7d8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8e91c22bcf774d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:12.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.084+0000 7f7d7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:51:12.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.084+0000 7f7d7cff9640 1 -- 172.21.15.7:0/3899815889 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c027640 con 0x56178fe57680 2024-09-19T08:51:12.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.084+0000 7f7d9da51740 1 -- 172.21.15.7:0/3899815889 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d90004d20 con 0x56178fe57680 2024-09-19T08:51:12.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.084+0000 7f7d7cff9640 1 -- 172.21.15.7:0/3899815889 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8629+0+0 (secure 0 0 0) 0x7f7d8c01b410 con 0x56178fe57680 2024-09-19T08:51:12.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.084+0000 7f7d7cff9640 1 -- 172.21.15.7:0/3899815889 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7d8c003f90 con 0x56178fe57680 2024-09-19T08:51:12.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.084+0000 7f7d9da51740 10 client.16608 fetch_fsmap learned FSMap version 25 2024-09-19T08:51:12.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.084+0000 7f7d9da51740 1 -- 172.21.15.7:0/3899815889 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56178fe65d70 con 0x56178fe57680 2024-09-19T08:51:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.084+0000 7f7d7cff9640 1 -- 172.21.15.7:0/3899815889 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d90004d20 con 0x56178fe57680 2024-09-19T08:51:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.085+0000 7f7d7cff9640 1 -- 172.21.15.7:0/3899815889 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7d8c025070 con 0x56178fe57680 2024-09-19T08:51:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.085+0000 7f7d9da51740 10 client.16608 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:51:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.085+0000 7f7d9da51740 10 client.16608 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:51:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.085+0000 7f7d9da51740 20 client.16608 populate_metadata read hostname 'smithi007' 2024-09-19T08:51:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.085+0000 7f7d9da51740 1 --2- 172.21.15.7:0/3899815889 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56178fe67180 0x56178fe69590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.085+0000 7f7d9da51740 4 client.16608 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:51:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.085+0000 7f7d9da51740 1 -- 172.21.15.7:0/3899815889 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56178fdbf850 con 0x56178fe67180 2024-09-19T08:51:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.085+0000 7f7d99414640 1 --2- 172.21.15.7:0/3899815889 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56178fe67180 0x56178fe69590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.086+0000 7f7d7cff9640 10 client.16608 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:51:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.086+0000 7f7d99414640 1 --2- 172.21.15.7:0/3899815889 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56178fe67180 0x56178fe69590 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2299dcf0bc8995cf server_cookie=a509b823ae3980 in_seq=0 out_seq=0 2024-09-19T08:51:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.086+0000 7f7d7cff9640 1 -- 172.21.15.7:0/3899815889 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56178fdbf850 con 0x56178fe67180 2024-09-19T08:51:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.086+0000 7f7d7cff9640 10 client.16608 handle_command_reply: tid=0 2024-09-19T08:51:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.086+0000 7f7d9da51740 1 client.16608 shutdown 2024-09-19T08:51:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.086+0000 7f7d9da51740 1 -- 172.21.15.7:0/3899815889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe57680 msgr2=0x56178fe548e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.086+0000 7f7d9da51740 1 --2- 172.21.15.7:0/3899815889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe57680 0x56178fe548e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c00bf10 tx=0x7f7d8c004730 comp rx=0 tx=0).stop 2024-09-19T08:51:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.086+0000 7f7d9da51740 1 -- 172.21.15.7:0/3899815889 shutdown_connections 2024-09-19T08:51:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.087+0000 7f7d9da51740 1 --2- 172.21.15.7:0/3899815889 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56178fe67180 0x56178fe69590 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.087+0000 7f7d9da51740 1 --2- 172.21.15.7:0/3899815889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe57680 0x56178fe548e0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.087+0000 7f7d9da51740 1 --2- 172.21.15.7:0/3899815889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56178fe4cdc0 0x56178fe54310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.087+0000 7f7d9da51740 1 --2- 172.21.15.7:0/3899815889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56178fe4c4a0 0x56178fe57060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.087+0000 7f7d9da51740 1 -- 172.21.15.7:0/3899815889 >> 172.21.15.7:0/3899815889 conn(0x56178fe48a30 msgr2=0x56178fe4e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.087+0000 7f7d7cff9640 0 client.16608 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:51:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.087+0000 7f7d9da51740 1 -- 172.21.15.7:0/3899815889 shutdown_connections 2024-09-19T08:51:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.087+0000 7f7d9da51740 1 -- 172.21.15.7:0/3899815889 wait complete. 2024-09-19T08:51:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.087+0000 7f7d9da51740 20 client.16608 trim_cache size 0 max 16384 2024-09-19T08:51:12.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.104+0000 7f7d9da51740 1 Processor -- start 2024-09-19T08:51:12.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.104+0000 7f7d9da51740 1 -- start start 2024-09-19T08:51:12.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.104+0000 7f7d9da51740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe4c4a0 0x56178fe634e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:12.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.104+0000 7f7d9da51740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56178fe4cdc0 0x56178fe56280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:12.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.104+0000 7f7d9da51740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56178fe57680 0x56178fe6ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:12.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.104+0000 7f7d9da51740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7d941b2520 con 0x56178fe4c4a0 2024-09-19T08:51:12.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.104+0000 7f7d9da51740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7d941afdf0 con 0x56178fe4cdc0 2024-09-19T08:51:12.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.104+0000 7f7d9da51740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7d941adc60 con 0x56178fe57680 2024-09-19T08:51:12.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.105+0000 7f7d99414640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe4c4a0 0x56178fe634e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:12.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.105+0000 7f7d99414640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe4c4a0 0x56178fe634e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44640/0 (socket says 172.21.15.7:44640) 2024-09-19T08:51:12.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.105+0000 7f7d99414640 1 -- 172.21.15.7:0/4241441494 learned_addr learned my addr 172.21.15.7:0/4241441494 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:12.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.105+0000 7f7d98c13640 1 --2- 172.21.15.7:0/4241441494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56178fe4cdc0 0x56178fe56280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:12.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.105+0000 7f7d99c15640 1 --2- 172.21.15.7:0/4241441494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56178fe57680 0x56178fe6ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:12.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.105+0000 7f7d99414640 1 -- 172.21.15.7:0/4241441494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56178fe57680 msgr2=0x56178fe6ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:12.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.105+0000 7f7d99414640 1 --2- 172.21.15.7:0/4241441494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56178fe57680 0x56178fe6ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.105+0000 7f7d99414640 1 -- 172.21.15.7:0/4241441494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56178fe4cdc0 msgr2=0x56178fe56280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:12.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.105+0000 7f7d99414640 1 --2- 172.21.15.7:0/4241441494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56178fe4cdc0 0x56178fe56280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.105+0000 7f7d99414640 1 -- 172.21.15.7:0/4241441494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56178fe573d0 con 0x56178fe4c4a0 2024-09-19T08:51:12.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.105+0000 7f7d99c15640 1 --2- 172.21.15.7:0/4241441494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56178fe57680 0x56178fe6ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:12.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.105+0000 7f7d99414640 1 --2- 172.21.15.7:0/4241441494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe4c4a0 0x56178fe634e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009e30 tx=0x7f7d90009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f27f87975b8fef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:12.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.105+0000 7f7d7effd640 1 -- 172.21.15.7:0/4241441494 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90016030 con 0x56178fe4c4a0 2024-09-19T08:51:12.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.105+0000 7f7d7effd640 1 -- 172.21.15.7:0/4241441494 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d900129f0 con 0x56178fe4c4a0 2024-09-19T08:51:12.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.105+0000 7f7d7effd640 1 -- 172.21.15.7:0/4241441494 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90005530 con 0x56178fe4c4a0 2024-09-19T08:51:12.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.106+0000 7f7d9da51740 1 -- 172.21.15.7:0/4241441494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe4c4a0 msgr2=0x56178fe634e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:12.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.106+0000 7f7d9da51740 1 --2- 172.21.15.7:0/4241441494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe4c4a0 0x56178fe634e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009e30 tx=0x7f7d90009680 comp rx=0 tx=0).stop 2024-09-19T08:51:12.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.106+0000 7f7d9da51740 1 -- 172.21.15.7:0/4241441494 shutdown_connections 2024-09-19T08:51:12.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.106+0000 7f7d9da51740 1 --2- 172.21.15.7:0/4241441494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56178fe57680 0x56178fe6ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.106+0000 7f7d9da51740 1 --2- 172.21.15.7:0/4241441494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56178fe4cdc0 0x56178fe56280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.106+0000 7f7d9da51740 1 --2- 172.21.15.7:0/4241441494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe4c4a0 0x56178fe634e0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.106+0000 7f7d9da51740 1 -- 172.21.15.7:0/4241441494 >> 172.21.15.7:0/4241441494 conn(0x56178fe48a30 msgr2=0x56178fe55b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.106+0000 7f7d9da51740 1 -- 172.21.15.7:0/4241441494 shutdown_connections 2024-09-19T08:51:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.106+0000 7f7d9da51740 1 -- 172.21.15.7:0/4241441494 wait complete. 2024-09-19T08:51:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.107+0000 7f7d9da51740 1 -- start start 2024-09-19T08:51:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.107+0000 7f7d9da51740 1 Processor -- start 2024-09-19T08:51:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.107+0000 7f7d9da51740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56178fe4c4a0 0x56178fe5fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.107+0000 7f7d9da51740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe4cdc0 0x56178fe51180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.107+0000 7f7d9da51740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56178fe57680 0x56178fe51910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.107+0000 7f7d9da51740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7d941ae2b0 con 0x56178fe4cdc0 2024-09-19T08:51:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.107+0000 7f7d9da51740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7d941af720 con 0x56178fe57680 2024-09-19T08:51:12.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.107+0000 7f7d9da51740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7d941ae980 con 0x56178fe4c4a0 2024-09-19T08:51:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.107+0000 7f7d9da51740 10 client.0 _ll_register_callbacks cb 0x7f7d8c004440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.107+0000 7f7d98c13640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe4cdc0 0x56178fe51180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.107+0000 7f7d98c13640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe4cdc0 0x56178fe51180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44648/0 (socket says 172.21.15.7:44648) 2024-09-19T08:51:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.107+0000 7f7d98c13640 1 -- 172.21.15.7:0/2451536873 learned_addr learned my addr 172.21.15.7:0/2451536873 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.108+0000 7f7d99c15640 1 --2- 172.21.15.7:0/2451536873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56178fe57680 0x56178fe51910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.108+0000 7f7d99414640 1 --2- 172.21.15.7:0/2451536873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56178fe4c4a0 0x56178fe5fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.108+0000 7f7d98c13640 1 -- 172.21.15.7:0/2451536873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56178fe4c4a0 msgr2=0x56178fe5fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.108+0000 7f7d98c13640 1 --2- 172.21.15.7:0/2451536873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56178fe4c4a0 0x56178fe5fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.108+0000 7f7d98c13640 1 -- 172.21.15.7:0/2451536873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56178fe57680 msgr2=0x56178fe51910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.108+0000 7f7d98c13640 1 --2- 172.21.15.7:0/2451536873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56178fe57680 0x56178fe51910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.108+0000 7f7d98c13640 1 -- 172.21.15.7:0/2451536873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56178fe4cbf0 con 0x56178fe4cdc0 2024-09-19T08:51:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.108+0000 7f7d99414640 1 --2- 172.21.15.7:0/2451536873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56178fe4c4a0 0x56178fe5fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:12.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.108+0000 7f7d98c13640 1 --2- 172.21.15.7:0/2451536873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe4cdc0 0x56178fe51180 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7d84004650 tx=0x7f7d84009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1feb9a44ca39ad2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.108+0000 7f7d7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:51:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.108+0000 7f7d7cff9640 1 -- 172.21.15.7:0/2451536873 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d84049040 con 0x56178fe4cdc0 2024-09-19T08:51:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.108+0000 7f7d7cff9640 1 -- 172.21.15.7:0/2451536873 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8629+0+0 (secure 0 0 0) 0x7f7d840b8af0 con 0x56178fe4cdc0 2024-09-19T08:51:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.108+0000 7f7d9da51740 1 -- 172.21.15.7:0/2451536873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d900129f0 con 0x56178fe4cdc0 2024-09-19T08:51:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.108+0000 7f7d7cff9640 1 -- 172.21.15.7:0/2451536873 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7d840bbde0 con 0x56178fe4cdc0 2024-09-19T08:51:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.108+0000 7f7d9da51740 10 client.16614 fetch_fsmap learned FSMap version 25 2024-09-19T08:51:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.108+0000 7f7d9da51740 1 -- 172.21.15.7:0/2451536873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56178fed1d30 con 0x56178fe4cdc0 2024-09-19T08:51:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.109+0000 7f7d7cff9640 1 -- 172.21.15.7:0/2451536873 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d900129f0 con 0x56178fe4cdc0 2024-09-19T08:51:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.109+0000 7f7d7cff9640 1 -- 172.21.15.7:0/2451536873 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7d840bc6e0 con 0x56178fe4cdc0 2024-09-19T08:51:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.109+0000 7f7d9da51740 10 client.16614 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:51:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.109+0000 7f7d9da51740 10 client.16614 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:51:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.109+0000 7f7d9da51740 20 client.16614 populate_metadata read hostname 'smithi007' 2024-09-19T08:51:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.109+0000 7f7d9da51740 1 --2- 172.21.15.7:0/2451536873 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56178fed2500 0x56178fed4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.109+0000 7f7d9da51740 4 client.16614 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:51:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.109+0000 7f7d9da51740 1 -- 172.21.15.7:0/2451536873 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56178fdb9d60 con 0x56178fed2500 2024-09-19T08:51:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.109+0000 7f7d99414640 1 --2- 172.21.15.7:0/2451536873 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56178fed2500 0x56178fed4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.110+0000 7f7d99414640 1 --2- 172.21.15.7:0/2451536873 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56178fed2500 0x56178fed4920 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd29e2d15d303868 server_cookie=d1cd677ac1574240 in_seq=0 out_seq=0 2024-09-19T08:51:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.110+0000 7f7d7cff9640 10 client.16614 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:51:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.110+0000 7f7d7cff9640 1 -- 172.21.15.7:0/2451536873 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56178fdb9d60 con 0x56178fed2500 2024-09-19T08:51:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.110+0000 7f7d7cff9640 10 client.16614 handle_command_reply: tid=0 2024-09-19T08:51:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.110+0000 7f7d9da51740 1 client.16614 shutdown 2024-09-19T08:51:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.110+0000 7f7d9da51740 1 -- 172.21.15.7:0/2451536873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe4cdc0 msgr2=0x56178fe51180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.110+0000 7f7d9da51740 1 --2- 172.21.15.7:0/2451536873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe4cdc0 0x56178fe51180 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7d84004650 tx=0x7f7d84009620 comp rx=0 tx=0).stop 2024-09-19T08:51:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.110+0000 7f7d9da51740 1 -- 172.21.15.7:0/2451536873 shutdown_connections 2024-09-19T08:51:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.110+0000 7f7d9da51740 1 --2- 172.21.15.7:0/2451536873 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56178fed2500 0x56178fed4920 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.110+0000 7f7d9da51740 1 --2- 172.21.15.7:0/2451536873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56178fe57680 0x56178fe51910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.110+0000 7f7d7cff9640 0 client.16614 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:51:12.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.110+0000 7f7d9da51740 1 --2- 172.21.15.7:0/2451536873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56178fe4cdc0 0x56178fe51180 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.110+0000 7f7d9da51740 1 --2- 172.21.15.7:0/2451536873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56178fe4c4a0 0x56178fe5fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.110+0000 7f7d9da51740 1 -- 172.21.15.7:0/2451536873 >> 172.21.15.7:0/2451536873 conn(0x56178fe48a30 msgr2=0x56178fe47b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:12.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.110+0000 7f7d9da51740 1 -- 172.21.15.7:0/2451536873 shutdown_connections 2024-09-19T08:51:12.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.110+0000 7f7d9da51740 1 -- 172.21.15.7:0/2451536873 wait complete. 2024-09-19T08:51:12.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.111+0000 7f7d9da51740 20 client.16614 trim_cache size 0 max 16384 2024-09-19T08:51:12.115 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:51:12.115 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-19T08:51:12.115 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-09-19T08:51:12.116 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:51:12.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.111+0000 7f7d9b678640 1 -- 172.21.15.7:0/3298467052 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7d800a33b0 msgr2=0x7f7d800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:12.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.111+0000 7f7d9b678640 1 --2- 172.21.15.7:0/3298467052 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7d800a33b0 0x7f7d800a5870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c00b7a0 tx=0x7f7d8c0046c0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.111+0000 7f7d9b678640 1 -- 172.21.15.7:0/3298467052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d941036e0 msgr2=0x7f7d94100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:12.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.111+0000 7f7d9b678640 1 --2- 172.21.15.7:0/3298467052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d941036e0 0x7f7d94100ed0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7d84005940 tx=0x7f7d840042f0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.111+0000 7f7d9b678640 1 -- 172.21.15.7:0/3298467052 shutdown_connections 2024-09-19T08:51:12.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.111+0000 7f7d9b678640 1 --2- 172.21.15.7:0/3298467052 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7d800a33b0 0x7f7d800a5870 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.111+0000 7f7d9b678640 1 --2- 172.21.15.7:0/3298467052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d941082a0 0x7f7d94101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.111+0000 7f7d9b678640 1 --2- 172.21.15.7:0/3298467052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d941036e0 0x7f7d94100ed0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.111+0000 7f7d9b678640 1 --2- 172.21.15.7:0/3298467052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d94102d30 0x7f7d94100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.111+0000 7f7d9b678640 1 -- 172.21.15.7:0/3298467052 >> 172.21.15.7:0/3298467052 conn(0x7f7d940fc7d0 msgr2=0x7f7d94105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:12.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.111+0000 7f7d9b678640 1 -- 172.21.15.7:0/3298467052 shutdown_connections 2024-09-19T08:51:12.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:12.111+0000 7f7d9b678640 1 -- 172.21.15.7:0/3298467052 wait complete. 2024-09-19T08:51:12.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:12 smithi007 ceph-mon[31221]: pgmap v204: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:51:12.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:12 smithi175 ceph-mon[35688]: pgmap v204: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:51:12.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:12 smithi044 ceph-mon[35072]: pgmap v204: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:51:12.902 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:51:12.903 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:51:13.168 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:13.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.653+0000 7f1ff6643640 1 -- 172.21.15.7:0/2501590285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ff0100a80 msgr2=0x7f1ff0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:13.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.653+0000 7f1ff6643640 1 --2- 172.21.15.7:0/2501590285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ff0100a80 0x7f1ff0100ee0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8009930 tx=0x7f1fd802a420 comp rx=0 tx=0).stop 2024-09-19T08:51:13.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.653+0000 7f1ff6643640 1 -- 172.21.15.7:0/2501590285 shutdown_connections 2024-09-19T08:51:13.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.653+0000 7f1ff6643640 1 --2- 172.21.15.7:0/2501590285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ff0101420 0x7f1ff010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:13.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.653+0000 7f1ff6643640 1 --2- 172.21.15.7:0/2501590285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ff0100a80 0x7f1ff0100ee0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:13.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.653+0000 7f1ff6643640 1 --2- 172.21.15.7:0/2501590285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ff0106a80 0x7f1ff0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:13.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.653+0000 7f1ff6643640 1 -- 172.21.15.7:0/2501590285 >> 172.21.15.7:0/2501590285 conn(0x7f1ff00fc7a0 msgr2=0x7f1ff00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:13.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.653+0000 7f1ff6643640 1 -- 172.21.15.7:0/2501590285 shutdown_connections 2024-09-19T08:51:13.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.653+0000 7f1ff6643640 1 -- 172.21.15.7:0/2501590285 wait complete. 2024-09-19T08:51:13.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.654+0000 7f1ff6643640 1 Processor -- start 2024-09-19T08:51:13.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.654+0000 7f1ff6643640 1 -- start start 2024-09-19T08:51:13.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.654+0000 7f1ff6643640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ff0100a80 0x7f1ff0198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:13.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.654+0000 7f1ff6643640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ff0101420 0x7f1ff01989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:13.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.654+0000 7f1ff6643640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ff0106a80 0x7f1ff019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:13.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.654+0000 7f1ff6643640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff0111f80 con 0x7f1ff0106a80 2024-09-19T08:51:13.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.654+0000 7f1ff6643640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff0111e00 con 0x7f1ff0101420 2024-09-19T08:51:13.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.654+0000 7f1ff6643640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff0112100 con 0x7f1ff0100a80 2024-09-19T08:51:13.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.654+0000 7f1ff4be0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ff0106a80 0x7f1ff019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:13.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.654+0000 7f1ff4be0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ff0106a80 0x7f1ff019cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59292/0 (socket says 172.21.15.7:59292) 2024-09-19T08:51:13.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.654+0000 7f1ff4be0640 1 -- 172.21.15.7:0/171729206 learned_addr learned my addr 172.21.15.7:0/171729206 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:13.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.654+0000 7f1feffff640 1 --2- 172.21.15.7:0/171729206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ff0100a80 0x7f1ff0198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:13.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.654+0000 7f1fe7fff640 1 --2- 172.21.15.7:0/171729206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ff0101420 0x7f1ff01989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:13.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.654+0000 7f1ff4be0640 1 -- 172.21.15.7:0/171729206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ff0100a80 msgr2=0x7f1ff0198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:13.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.654+0000 7f1ff4be0640 1 --2- 172.21.15.7:0/171729206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ff0100a80 0x7f1ff0198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:13.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.654+0000 7f1ff4be0640 1 -- 172.21.15.7:0/171729206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ff0101420 msgr2=0x7f1ff01989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:13.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.654+0000 7f1ff4be0640 1 --2- 172.21.15.7:0/171729206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ff0101420 0x7f1ff01989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:13.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.654+0000 7f1ff4be0640 1 -- 172.21.15.7:0/171729206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff019d430 con 0x7f1ff0106a80 2024-09-19T08:51:13.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.655+0000 7f1ff4be0640 1 --2- 172.21.15.7:0/171729206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ff0106a80 0x7f1ff019cd50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800eaa0 tx=0x7f1fe800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:13.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.655+0000 7f1fedffb640 1 -- 172.21.15.7:0/171729206 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe800cdb0 con 0x7f1ff0106a80 2024-09-19T08:51:13.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.655+0000 7f1ff6643640 1 -- 172.21.15.7:0/171729206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff019d720 con 0x7f1ff0106a80 2024-09-19T08:51:13.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.655+0000 7f1fedffb640 1 -- 172.21.15.7:0/171729206 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fe8005020 con 0x7f1ff0106a80 2024-09-19T08:51:13.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.655+0000 7f1fedffb640 1 -- 172.21.15.7:0/171729206 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80116b0 con 0x7f1ff0106a80 2024-09-19T08:51:13.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.655+0000 7f1ff6643640 1 -- 172.21.15.7:0/171729206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff01a5000 con 0x7f1ff0106a80 2024-09-19T08:51:13.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.656+0000 7f1ff6643640 1 -- 172.21.15.7:0/171729206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ff0100ee0 con 0x7f1ff0106a80 2024-09-19T08:51:13.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.658+0000 7f1fedffb640 1 -- 172.21.15.7:0/171729206 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f1fe8005560 con 0x7f1ff0106a80 2024-09-19T08:51:13.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.659+0000 7f1fedffb640 1 --2- 172.21.15.7:0/171729206 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1fdc0a33b0 0x7f1fdc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:13.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.659+0000 7f1feffff640 1 --2- 172.21.15.7:0/171729206 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1fdc0a33b0 0x7f1fdc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:13.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.659+0000 7f1fedffb640 1 -- 172.21.15.7:0/171729206 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8629+0+0 (secure 0 0 0) 0x7f1fe80d0480 con 0x7f1ff0106a80 2024-09-19T08:51:13.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.659+0000 7f1feffff640 1 --2- 172.21.15.7:0/171729206 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1fdc0a33b0 0x7f1fdc0a5870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0005fd0 tx=0x7f1fe0005850 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:13.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.662+0000 7f1fedffb640 1 -- 172.21.15.7:0/171729206 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1fe8016030 con 0x7f1ff0106a80 2024-09-19T08:51:13.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.874+0000 7f1ff6643640 1 -- 172.21.15.7:0/171729206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ff01997e0 con 0x7f1ff0106a80 2024-09-19T08:51:13.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.875+0000 7f1fedffb640 1 -- 172.21.15.7:0/171729206 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f1ff01997e0 con 0x7f1ff0106a80 2024-09-19T08:51:13.875 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:51:13.875 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:51:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:51:13.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.877+0000 7f1ff6643640 1 -- 172.21.15.7:0/171729206 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1fdc0a33b0 msgr2=0x7f1fdc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:13.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.877+0000 7f1ff6643640 1 --2- 172.21.15.7:0/171729206 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1fdc0a33b0 0x7f1fdc0a5870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0005fd0 tx=0x7f1fe0005850 comp rx=0 tx=0).stop 2024-09-19T08:51:13.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.877+0000 7f1ff6643640 1 -- 172.21.15.7:0/171729206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ff0106a80 msgr2=0x7f1ff019cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:13.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.877+0000 7f1ff6643640 1 --2- 172.21.15.7:0/171729206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ff0106a80 0x7f1ff019cd50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800eaa0 tx=0x7f1fe800ef60 comp rx=0 tx=0).stop 2024-09-19T08:51:13.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.877+0000 7f1ff6643640 1 -- 172.21.15.7:0/171729206 shutdown_connections 2024-09-19T08:51:13.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.877+0000 7f1ff6643640 1 --2- 172.21.15.7:0/171729206 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1fdc0a33b0 0x7f1fdc0a5870 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:13.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.877+0000 7f1ff6643640 1 --2- 172.21.15.7:0/171729206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ff0106a80 0x7f1ff019cd50 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:13.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.877+0000 7f1ff6643640 1 --2- 172.21.15.7:0/171729206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ff0101420 0x7f1ff01989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:13.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.877+0000 7f1ff6643640 1 --2- 172.21.15.7:0/171729206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ff0100a80 0x7f1ff0198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:13.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.877+0000 7f1ff6643640 1 -- 172.21.15.7:0/171729206 >> 172.21.15.7:0/171729206 conn(0x7f1ff00fc7a0 msgr2=0x7f1ff00fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:13.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.877+0000 7f1ff6643640 1 -- 172.21.15.7:0/171729206 shutdown_connections 2024-09-19T08:51:13.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:13.877+0000 7f1ff6643640 1 -- 172.21.15.7:0/171729206 wait complete. 2024-09-19T08:51:14.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:14 smithi007 ceph-mon[31221]: pgmap v205: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:51:14.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:14 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/171729206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:51:14.615 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:51:14.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:14 smithi175 ceph-mon[35688]: pgmap v205: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:51:14.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:14 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/171729206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:51:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:14 smithi044 ceph-mon[35072]: pgmap v205: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:51:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:14 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/171729206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:51:14.876 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.328+0000 7f4fafa38640 1 -- 172.21.15.7:0/1119566309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa8102790 msgr2=0x7f4fa81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.328+0000 7f4fafa38640 1 --2- 172.21.15.7:0/1119566309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa8102790 0x7f4fa81067e0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009900 tx=0x7f4f9802a410 comp rx=0 tx=0).stop 2024-09-19T08:51:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.328+0000 7f4fafa38640 1 -- 172.21.15.7:0/1119566309 shutdown_connections 2024-09-19T08:51:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.328+0000 7f4fafa38640 1 --2- 172.21.15.7:0/1119566309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4fa8106f10 0x7f4fa810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.328+0000 7f4fafa38640 1 --2- 172.21.15.7:0/1119566309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa8102790 0x7f4fa81067e0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.328+0000 7f4fafa38640 1 --2- 172.21.15.7:0/1119566309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa8101de0 0x7f4fa81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.329+0000 7f4fafa38640 1 -- 172.21.15.7:0/1119566309 >> 172.21.15.7:0/1119566309 conn(0x7f4fa80fd8c0 msgr2=0x7f4fa80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.329+0000 7f4fafa38640 1 -- 172.21.15.7:0/1119566309 shutdown_connections 2024-09-19T08:51:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.329+0000 7f4fafa38640 1 -- 172.21.15.7:0/1119566309 wait complete. 2024-09-19T08:51:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.329+0000 7f4fafa38640 1 Processor -- start 2024-09-19T08:51:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.329+0000 7f4fafa38640 1 -- start start 2024-09-19T08:51:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.329+0000 7f4fafa38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa8101de0 0x7f4fa8198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.329+0000 7f4fafa38640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa8102790 0x7f4fa8198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.330+0000 7f4fafa38640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4fa8106f10 0x7f4fa819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.330+0000 7f4fafa38640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa8111fc0 con 0x7f4fa8101de0 2024-09-19T08:51:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.330+0000 7f4fafa38640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa8111e40 con 0x7f4fa8106f10 2024-09-19T08:51:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.330+0000 7f4fafa38640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa8112140 con 0x7f4fa8102790 2024-09-19T08:51:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.330+0000 7f4fad7d4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa8101de0 0x7f4fa8198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.330+0000 7f4fad7d4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa8101de0 0x7f4fa8198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59312/0 (socket says 172.21.15.7:59312) 2024-09-19T08:51:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.330+0000 7f4fad7d4640 1 -- 172.21.15.7:0/256492196 learned_addr learned my addr 172.21.15.7:0/256492196 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.330+0000 7f4fadfd5640 1 --2- 172.21.15.7:0/256492196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4fa8106f10 0x7f4fa819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.330+0000 7f4facfd3640 1 --2- 172.21.15.7:0/256492196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa8102790 0x7f4fa8198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.330+0000 7f4fad7d4640 1 -- 172.21.15.7:0/256492196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa8102790 msgr2=0x7f4fa8198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.330+0000 7f4fad7d4640 1 --2- 172.21.15.7:0/256492196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa8102790 0x7f4fa8198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.330+0000 7f4fad7d4640 1 -- 172.21.15.7:0/256492196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4fa8106f10 msgr2=0x7f4fa819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.330+0000 7f4fad7d4640 1 --2- 172.21.15.7:0/256492196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4fa8106f10 0x7f4fa819cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.330+0000 7f4fad7d4640 1 -- 172.21.15.7:0/256492196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa819d3e0 con 0x7f4fa8101de0 2024-09-19T08:51:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.330+0000 7f4fad7d4640 1 --2- 172.21.15.7:0/256492196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa8101de0 0x7f4fa8198430 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400d770 tx=0x7f4fa400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.330+0000 7f4f9e7fc640 1 -- 172.21.15.7:0/256492196 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4017070 con 0x7f4fa8101de0 2024-09-19T08:51:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.330+0000 7f4f9e7fc640 1 -- 172.21.15.7:0/256492196 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fa4005500 con 0x7f4fa8101de0 2024-09-19T08:51:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.330+0000 7f4fafa38640 1 -- 172.21.15.7:0/256492196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fa819d6d0 con 0x7f4fa8101de0 2024-09-19T08:51:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.330+0000 7f4f9e7fc640 1 -- 172.21.15.7:0/256492196 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4004e00 con 0x7f4fa8101de0 2024-09-19T08:51:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.330+0000 7f4fafa38640 1 -- 172.21.15.7:0/256492196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fa81a4fb0 con 0x7f4fa8101de0 2024-09-19T08:51:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.333+0000 7f4f9e7fc640 1 -- 172.21.15.7:0/256492196 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f4fa4004fa0 con 0x7f4fa8101de0 2024-09-19T08:51:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.333+0000 7f4fb1e11740 1 Processor -- start 2024-09-19T08:51:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.333+0000 7f4fb1e11740 1 -- start start 2024-09-19T08:51:15.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.333+0000 7f4fb1e11740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b2b40 0x5570fb5b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.333+0000 7f4fb1e11740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570fb5b15d0 0x5570fb5b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.333+0000 7f4fb1e11740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5c0780 0x5570fb5c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.333+0000 7f4fb1e11740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5570fb5172f0 con 0x5570fb5b2b40 2024-09-19T08:51:15.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.333+0000 7f4fb1e11740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5570fb4becf0 con 0x5570fb5c0780 2024-09-19T08:51:15.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.333+0000 7f4fb1e11740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5570fb5132b0 con 0x5570fb5b15d0 2024-09-19T08:51:15.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.334+0000 7f4fadfd5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b2b40 0x5570fb5b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.334+0000 7f4fadfd5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b2b40 0x5570fb5b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59318/0 (socket says 172.21.15.7:59318) 2024-09-19T08:51:15.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.334+0000 7f4fadfd5640 1 -- 172.21.15.7:0/2690436447 learned_addr learned my addr 172.21.15.7:0/2690436447 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.334+0000 7f4f9e7fc640 1 --2- 172.21.15.7:0/256492196 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4f940a33b0 0x7f4f940a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.334+0000 7f4facfd3640 1 --2- 172.21.15.7:0/2690436447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5c0780 0x5570fb5c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.334+0000 7f4fad7d4640 1 --2- 172.21.15.7:0/2690436447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570fb5b15d0 0x5570fb5b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.334+0000 7f4fadfd5640 1 --2- 172.21.15.7:0/256492196 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4f940a33b0 0x7f4f940a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.334+0000 7f4f9e7fc640 1 -- 172.21.15.7:0/256492196 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8629+0+0 (secure 0 0 0) 0x7f4fa40cf8c0 con 0x7f4fa8101de0 2024-09-19T08:51:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.334+0000 7f4fadfd5640 1 -- 172.21.15.7:0/2690436447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570fb5b15d0 msgr2=0x5570fb5b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.334+0000 7f4fadfd5640 1 --2- 172.21.15.7:0/2690436447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570fb5b15d0 0x5570fb5b1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.334+0000 7f4fadfd5640 1 -- 172.21.15.7:0/2690436447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5c0780 msgr2=0x5570fb5c2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.334+0000 7f4fadfd5640 1 --2- 172.21.15.7:0/2690436447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5c0780 0x5570fb5c2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.334+0000 7f4fadfd5640 1 -- 172.21.15.7:0/2690436447 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570fb4a33a0 con 0x5570fb5b2b40 2024-09-19T08:51:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.334+0000 7f4facfd3640 1 --2- 172.21.15.7:0/2690436447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5c0780 0x5570fb5c2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.334+0000 7f4fadfd5640 1 --2- 172.21.15.7:0/2690436447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b2b40 0x5570fb5b1090 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00129f0 tx=0x7f4fa0012eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2963b0b6fa3f67a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:15.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.334+0000 7f4f937fe640 1 -- 172.21.15.7:0/2690436447 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0023070 con 0x5570fb5b2b40 2024-09-19T08:51:15.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.334+0000 7f4f937fe640 1 -- 172.21.15.7:0/2690436447 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fa0004710 con 0x5570fb5b2b40 2024-09-19T08:51:15.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.334+0000 7f4f937fe640 1 -- 172.21.15.7:0/2690436447 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa001fa90 con 0x5570fb5b2b40 2024-09-19T08:51:15.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.334+0000 7f4fadfd5640 1 --2- 172.21.15.7:0/256492196 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4f940a33b0 0x7f4f940a5870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0022000 tx=0x7f4fa0021000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:15.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.335+0000 7f4fb1e11740 1 -- 172.21.15.7:0/2690436447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b2b40 msgr2=0x5570fb5b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.335+0000 7f4fb1e11740 1 --2- 172.21.15.7:0/2690436447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b2b40 0x5570fb5b1090 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00129f0 tx=0x7f4fa0012eb0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.335+0000 7f4fb1e11740 1 -- 172.21.15.7:0/2690436447 shutdown_connections 2024-09-19T08:51:15.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.335+0000 7f4fb1e11740 1 --2- 172.21.15.7:0/2690436447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5c0780 0x5570fb5c2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.335+0000 7f4fb1e11740 1 --2- 172.21.15.7:0/2690436447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570fb5b15d0 0x5570fb5b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.335+0000 7f4fb1e11740 1 --2- 172.21.15.7:0/2690436447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b2b40 0x5570fb5b1090 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.335+0000 7f4fb1e11740 1 -- 172.21.15.7:0/2690436447 >> 172.21.15.7:0/2690436447 conn(0x5570fb57a310 msgr2=0x5570fb5adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:15.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.335+0000 7f4fb1e11740 1 -- 172.21.15.7:0/2690436447 shutdown_connections 2024-09-19T08:51:15.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.335+0000 7f4fb1e11740 1 -- 172.21.15.7:0/2690436447 wait complete. 2024-09-19T08:51:15.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.336+0000 7f4fb1e11740 1 -- start start 2024-09-19T08:51:15.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.336+0000 7f4fb1e11740 1 Processor -- start 2024-09-19T08:51:15.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.336+0000 7f4fb1e11740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b15d0 0x5570fb5c0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.336+0000 7f4fb1e11740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570fb5b2b40 0x5570fb5bd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.336+0000 7f4fb1e11740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5c0780 0x5570fb5bda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.336+0000 7f4fb1e11740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5570fb5c3480 con 0x5570fb5b15d0 2024-09-19T08:51:15.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.336+0000 7f4fb1e11740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5570fb4d2060 con 0x5570fb5c0780 2024-09-19T08:51:15.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.336+0000 7f4fb1e11740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5570fb5c3600 con 0x5570fb5b2b40 2024-09-19T08:51:15.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.336+0000 7f4fb1e11740 10 client.0 _ll_register_callbacks cb 0x5570fb2258c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:15.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.336+0000 7f4fad7d4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b15d0 0x5570fb5c0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.336+0000 7f4fad7d4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b15d0 0x5570fb5c0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59322/0 (socket says 172.21.15.7:59322) 2024-09-19T08:51:15.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.336+0000 7f4fad7d4640 1 -- 172.21.15.7:0/148255607 learned_addr learned my addr 172.21.15.7:0/148255607 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:15.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.336+0000 7f4fadfd5640 1 --2- 172.21.15.7:0/148255607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5c0780 0x5570fb5bda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.337+0000 7f4facfd3640 1 --2- 172.21.15.7:0/148255607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570fb5b2b40 0x5570fb5bd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.337+0000 7f4fad7d4640 1 -- 172.21.15.7:0/148255607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570fb5b2b40 msgr2=0x5570fb5bd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:15.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.337+0000 7f4fad7d4640 1 --2- 172.21.15.7:0/148255607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570fb5b2b40 0x5570fb5bd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.337+0000 7f4fad7d4640 1 -- 172.21.15.7:0/148255607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5c0780 msgr2=0x5570fb5bda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:15.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.337+0000 7f4fad7d4640 1 --2- 172.21.15.7:0/148255607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5c0780 0x5570fb5bda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.337+0000 7f4fad7d4640 1 -- 172.21.15.7:0/148255607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570fb2883c0 con 0x5570fb5b15d0 2024-09-19T08:51:15.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.337+0000 7f4facfd3640 1 --2- 172.21.15.7:0/148255607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570fb5b2b40 0x5570fb5bd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:15.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.337+0000 7f4fadfd5640 1 --2- 172.21.15.7:0/148255607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5c0780 0x5570fb5bda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:15.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.337+0000 7f4fad7d4640 1 --2- 172.21.15.7:0/148255607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b15d0 0x5570fb5c0170 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40cd000 tx=0x7f4fa40d1dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621b325646a03bbc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:15.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.337+0000 7f4f90ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:51:15.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.337+0000 7f4f90ff9640 1 -- 172.21.15.7:0/148255607 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa409ce60 con 0x5570fb5b15d0 2024-09-19T08:51:15.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.337+0000 7f4f90ff9640 1 -- 172.21.15.7:0/148255607 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8629+0+0 (secure 0 0 0) 0x7f4fa40cd220 con 0x5570fb5b15d0 2024-09-19T08:51:15.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.337+0000 7f4fb1e11740 1 -- 172.21.15.7:0/148255607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fa0004710 con 0x5570fb5b15d0 2024-09-19T08:51:15.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.337+0000 7f4f90ff9640 1 -- 172.21.15.7:0/148255607 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4fa4020040 con 0x5570fb5b15d0 2024-09-19T08:51:15.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.337+0000 7f4fb1e11740 10 client.16632 fetch_fsmap learned FSMap version 25 2024-09-19T08:51:15.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.337+0000 7f4fb1e11740 1 -- 172.21.15.7:0/148255607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5570fb5cef20 con 0x5570fb5b15d0 2024-09-19T08:51:15.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.337+0000 7f4f90ff9640 1 -- 172.21.15.7:0/148255607 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fa0004710 con 0x5570fb5b15d0 2024-09-19T08:51:15.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.337+0000 7f4f90ff9640 1 -- 172.21.15.7:0/148255607 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4fa40981a0 con 0x5570fb5b15d0 2024-09-19T08:51:15.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.338+0000 7f4fb1e11740 10 client.16632 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:51:15.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.338+0000 7f4fb1e11740 10 client.16632 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:51:15.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.338+0000 7f4fb1e11740 20 client.16632 populate_metadata read hostname 'smithi007' 2024-09-19T08:51:15.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.338+0000 7f4fb1e11740 1 --2- 172.21.15.7:0/148255607 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5570fb5d03e0 0x5570fb5d27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.338+0000 7f4fb1e11740 4 client.16632 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:51:15.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.338+0000 7f4fb1e11740 1 -- 172.21.15.7:0/148255607 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570fb524860 con 0x5570fb5d03e0 2024-09-19T08:51:15.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.338+0000 7f4facfd3640 1 --2- 172.21.15.7:0/148255607 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5570fb5d03e0 0x5570fb5d27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.338+0000 7f4facfd3640 1 --2- 172.21.15.7:0/148255607 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5570fb5d03e0 0x5570fb5d27d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c3675c24600a6754 server_cookie=ddcfff918deb0a38 in_seq=0 out_seq=0 2024-09-19T08:51:15.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.338+0000 7f4f90ff9640 10 client.16632 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:51:15.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.339+0000 7f4f90ff9640 1 -- 172.21.15.7:0/148255607 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5570fb524860 con 0x5570fb5d03e0 2024-09-19T08:51:15.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.339+0000 7f4f90ff9640 10 client.16632 handle_command_reply: tid=0 2024-09-19T08:51:15.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.339+0000 7f4fb1e11740 1 client.16632 shutdown 2024-09-19T08:51:15.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.339+0000 7f4fb1e11740 1 -- 172.21.15.7:0/148255607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b15d0 msgr2=0x5570fb5c0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.339+0000 7f4fb1e11740 1 --2- 172.21.15.7:0/148255607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b15d0 0x5570fb5c0170 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40cd000 tx=0x7f4fa40d1dd0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.339+0000 7f4fb1e11740 1 -- 172.21.15.7:0/148255607 shutdown_connections 2024-09-19T08:51:15.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.339+0000 7f4fb1e11740 1 --2- 172.21.15.7:0/148255607 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5570fb5d03e0 0x5570fb5d27d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.339+0000 7f4fb1e11740 1 --2- 172.21.15.7:0/148255607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5c0780 0x5570fb5bda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.339+0000 7f4fb1e11740 1 --2- 172.21.15.7:0/148255607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570fb5b2b40 0x5570fb5bd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.339+0000 7f4f90ff9640 0 client.16632 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:51:15.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.339+0000 7f4fb1e11740 1 --2- 172.21.15.7:0/148255607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b15d0 0x5570fb5c0170 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.339+0000 7f4fb1e11740 1 -- 172.21.15.7:0/148255607 >> 172.21.15.7:0/148255607 conn(0x5570fb57a310 msgr2=0x5570fb5b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:15.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.340+0000 7f4fb1e11740 1 -- 172.21.15.7:0/148255607 shutdown_connections 2024-09-19T08:51:15.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.340+0000 7f4fb1e11740 1 -- 172.21.15.7:0/148255607 wait complete. 2024-09-19T08:51:15.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.340+0000 7f4fb1e11740 20 client.16632 trim_cache size 0 max 16384 2024-09-19T08:51:15.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.354+0000 7f4fb1e11740 1 Processor -- start 2024-09-19T08:51:15.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.354+0000 7f4fb1e11740 1 -- start start 2024-09-19T08:51:15.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.355+0000 7f4fb1e11740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5b15d0 0x5570fb5bc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.355+0000 7f4fb1e11740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b2b40 0x5570fb5cc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.355+0000 7f4fb1e11740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570fb5c0780 0x5570fb5b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.355+0000 7f4fb1e11740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa81ae020 con 0x5570fb5b2b40 2024-09-19T08:51:15.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.355+0000 7f4fb1e11740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa81ab8f0 con 0x5570fb5b15d0 2024-09-19T08:51:15.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.355+0000 7f4fb1e11740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa81a9760 con 0x5570fb5c0780 2024-09-19T08:51:15.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.355+0000 7f4facfd3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b2b40 0x5570fb5cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.355+0000 7f4facfd3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b2b40 0x5570fb5cc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59332/0 (socket says 172.21.15.7:59332) 2024-09-19T08:51:15.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.355+0000 7f4facfd3640 1 -- 172.21.15.7:0/810351068 learned_addr learned my addr 172.21.15.7:0/810351068 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:15.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.355+0000 7f4fad7d4640 1 --2- 172.21.15.7:0/810351068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5b15d0 0x5570fb5bc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.355+0000 7f4fadfd5640 1 --2- 172.21.15.7:0/810351068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570fb5c0780 0x5570fb5b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.355+0000 7f4facfd3640 1 -- 172.21.15.7:0/810351068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570fb5c0780 msgr2=0x5570fb5b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:15.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.355+0000 7f4facfd3640 1 --2- 172.21.15.7:0/810351068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570fb5c0780 0x5570fb5b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.355+0000 7f4facfd3640 1 -- 172.21.15.7:0/810351068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5b15d0 msgr2=0x5570fb5bc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:15.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.355+0000 7f4facfd3640 1 --2- 172.21.15.7:0/810351068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5b15d0 0x5570fb5bc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.355+0000 7f4facfd3640 1 -- 172.21.15.7:0/810351068 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570fb5be510 con 0x5570fb5b2b40 2024-09-19T08:51:15.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.355+0000 7f4fadfd5640 1 --2- 172.21.15.7:0/810351068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570fb5c0780 0x5570fb5b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:15.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.355+0000 7f4facfd3640 1 --2- 172.21.15.7:0/810351068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b2b40 0x5570fb5cc720 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4f9802a9d0 tx=0x7f4f98005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf9fd030cbdb5f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:15.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.356+0000 7f4f92ffd640 1 -- 172.21.15.7:0/810351068 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f98049070 con 0x5570fb5b2b40 2024-09-19T08:51:15.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.356+0000 7f4f92ffd640 1 -- 172.21.15.7:0/810351068 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f98005520 con 0x5570fb5b2b40 2024-09-19T08:51:15.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.356+0000 7f4f92ffd640 1 -- 172.21.15.7:0/810351068 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f98035040 con 0x5570fb5b2b40 2024-09-19T08:51:15.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.356+0000 7f4fb1e11740 1 -- 172.21.15.7:0/810351068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b2b40 msgr2=0x5570fb5cc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.356+0000 7f4fb1e11740 1 --2- 172.21.15.7:0/810351068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b2b40 0x5570fb5cc720 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4f9802a9d0 tx=0x7f4f98005b50 comp rx=0 tx=0).stop 2024-09-19T08:51:15.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.356+0000 7f4fb1e11740 1 -- 172.21.15.7:0/810351068 shutdown_connections 2024-09-19T08:51:15.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.356+0000 7f4fb1e11740 1 --2- 172.21.15.7:0/810351068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570fb5c0780 0x5570fb5b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.356+0000 7f4fb1e11740 1 --2- 172.21.15.7:0/810351068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b2b40 0x5570fb5cc720 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.356+0000 7f4fb1e11740 1 --2- 172.21.15.7:0/810351068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5b15d0 0x5570fb5bc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.356+0000 7f4fb1e11740 1 -- 172.21.15.7:0/810351068 >> 172.21.15.7:0/810351068 conn(0x5570fb57a310 msgr2=0x5570fb5b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:15.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.357+0000 7f4fb1e11740 1 -- 172.21.15.7:0/810351068 shutdown_connections 2024-09-19T08:51:15.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.357+0000 7f4fb1e11740 1 -- 172.21.15.7:0/810351068 wait complete. 2024-09-19T08:51:15.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.357+0000 7f4fb1e11740 1 -- start start 2024-09-19T08:51:15.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.357+0000 7f4fb1e11740 1 Processor -- start 2024-09-19T08:51:15.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.357+0000 7f4fb1e11740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b15d0 0x5570fb5c8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.357+0000 7f4fb1e11740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5b2b40 0x5570fb5c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.357+0000 7f4fb1e11740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570fb5c0780 0x5570fb5c5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.357+0000 7f4fb1e11740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa81a9db0 con 0x5570fb5b15d0 2024-09-19T08:51:15.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.357+0000 7f4fb1e11740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa81ab220 con 0x5570fb5b2b40 2024-09-19T08:51:15.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.357+0000 7f4fb1e11740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa81aa480 con 0x5570fb5c0780 2024-09-19T08:51:15.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.358+0000 7f4fb1e11740 10 client.0 _ll_register_callbacks cb 0x7f4fa400de80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:15.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.358+0000 7f4fad7d4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b15d0 0x5570fb5c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.358+0000 7f4fad7d4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b15d0 0x5570fb5c8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59346/0 (socket says 172.21.15.7:59346) 2024-09-19T08:51:15.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.358+0000 7f4fad7d4640 1 -- 172.21.15.7:0/1203478432 learned_addr learned my addr 172.21.15.7:0/1203478432 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:15.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.358+0000 7f4facfd3640 1 --2- 172.21.15.7:0/1203478432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5b2b40 0x5570fb5c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.358+0000 7f4fadfd5640 1 --2- 172.21.15.7:0/1203478432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570fb5c0780 0x5570fb5c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.358+0000 7f4fad7d4640 1 -- 172.21.15.7:0/1203478432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570fb5c0780 msgr2=0x5570fb5c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:15.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.358+0000 7f4fad7d4640 1 --2- 172.21.15.7:0/1203478432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570fb5c0780 0x5570fb5c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.358+0000 7f4fad7d4640 1 -- 172.21.15.7:0/1203478432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5b2b40 msgr2=0x5570fb5c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:15.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.358+0000 7f4fad7d4640 1 --2- 172.21.15.7:0/1203478432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5b2b40 0x5570fb5c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.358+0000 7f4fad7d4640 1 -- 172.21.15.7:0/1203478432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570fb5c5da0 con 0x5570fb5b15d0 2024-09-19T08:51:15.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.358+0000 7f4facfd3640 1 --2- 172.21.15.7:0/1203478432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5b2b40 0x5570fb5c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:15.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.358+0000 7f4fad7d4640 1 --2- 172.21.15.7:0/1203478432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b15d0 0x5570fb5c8890 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4097f90 tx=0x7f4fa40a46a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7302965511aeb1c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:15.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.358+0000 7f4f90ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:51:15.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.358+0000 7f4f90ff9640 1 -- 172.21.15.7:0/1203478432 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4014070 con 0x5570fb5b15d0 2024-09-19T08:51:15.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.358+0000 7f4fb1e11740 1 -- 172.21.15.7:0/1203478432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f98005520 con 0x5570fb5b15d0 2024-09-19T08:51:15.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.358+0000 7f4f90ff9640 1 -- 172.21.15.7:0/1203478432 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8629+0+0 (secure 0 0 0) 0x7f4fa4097880 con 0x5570fb5b15d0 2024-09-19T08:51:15.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.359+0000 7f4f90ff9640 1 -- 172.21.15.7:0/1203478432 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4fa409ce60 con 0x5570fb5b15d0 2024-09-19T08:51:15.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.359+0000 7f4fb1e11740 10 client.16638 fetch_fsmap learned FSMap version 25 2024-09-19T08:51:15.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.359+0000 7f4fb1e11740 1 -- 172.21.15.7:0/1203478432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5570fb63b780 con 0x5570fb5b15d0 2024-09-19T08:51:15.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.359+0000 7f4f90ff9640 1 -- 172.21.15.7:0/1203478432 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f98005520 con 0x5570fb5b15d0 2024-09-19T08:51:15.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.359+0000 7f4f90ff9640 1 -- 172.21.15.7:0/1203478432 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4fa4097a80 con 0x5570fb5b15d0 2024-09-19T08:51:15.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.359+0000 7f4fb1e11740 10 client.16638 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:51:15.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.359+0000 7f4fb1e11740 10 client.16638 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:51:15.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.359+0000 7f4fb1e11740 20 client.16638 populate_metadata read hostname 'smithi007' 2024-09-19T08:51:15.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.359+0000 7f4fb1e11740 1 --2- 172.21.15.7:0/1203478432 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5570fb63bc60 0x5570fb63e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.359+0000 7f4fb1e11740 4 client.16638 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:51:15.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.359+0000 7f4fb1e11740 1 -- 172.21.15.7:0/1203478432 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5570fb51ed70 con 0x5570fb63bc60 2024-09-19T08:51:15.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.359+0000 7f4facfd3640 1 --2- 172.21.15.7:0/1203478432 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5570fb63bc60 0x5570fb63e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.360+0000 7f4facfd3640 1 --2- 172.21.15.7:0/1203478432 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5570fb63bc60 0x5570fb63e070 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=50b2af70c36ee30a server_cookie=8194659464e2693d in_seq=0 out_seq=0 2024-09-19T08:51:15.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.360+0000 7f4f90ff9640 10 client.16638 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:51:15.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.360+0000 7f4f90ff9640 1 -- 172.21.15.7:0/1203478432 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5570fb51ed70 con 0x5570fb63bc60 2024-09-19T08:51:15.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.360+0000 7f4f90ff9640 10 client.16638 handle_command_reply: tid=0 2024-09-19T08:51:15.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.360+0000 7f4fb1e11740 1 client.16638 shutdown 2024-09-19T08:51:15.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.360+0000 7f4fb1e11740 1 -- 172.21.15.7:0/1203478432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b15d0 msgr2=0x5570fb5c8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.360+0000 7f4fb1e11740 1 --2- 172.21.15.7:0/1203478432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b15d0 0x5570fb5c8890 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4097f90 tx=0x7f4fa40a46a0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.360+0000 7f4fb1e11740 1 -- 172.21.15.7:0/1203478432 shutdown_connections 2024-09-19T08:51:15.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.360+0000 7f4fb1e11740 1 --2- 172.21.15.7:0/1203478432 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5570fb63bc60 0x5570fb63e070 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.360+0000 7f4fb1e11740 1 --2- 172.21.15.7:0/1203478432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5570fb5c0780 0x5570fb5c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.360+0000 7f4fb1e11740 1 --2- 172.21.15.7:0/1203478432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570fb5b2b40 0x5570fb5c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.360+0000 7f4fb1e11740 1 --2- 172.21.15.7:0/1203478432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570fb5b15d0 0x5570fb5c8890 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.360+0000 7f4fb1e11740 1 -- 172.21.15.7:0/1203478432 >> 172.21.15.7:0/1203478432 conn(0x5570fb57a310 msgr2=0x5570fb5b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:15.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.360+0000 7f4f90ff9640 0 client.16638 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:51:15.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.360+0000 7f4fb1e11740 1 -- 172.21.15.7:0/1203478432 shutdown_connections 2024-09-19T08:51:15.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.360+0000 7f4fb1e11740 1 -- 172.21.15.7:0/1203478432 wait complete. 2024-09-19T08:51:15.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.360+0000 7f4fb1e11740 20 client.16638 trim_cache size 0 max 16384 2024-09-19T08:51:15.367 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:51:15.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.361+0000 7f4fafa38640 1 -- 172.21.15.7:0/256492196 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4f940a33b0 msgr2=0x7f4f940a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.361+0000 7f4fafa38640 1 --2- 172.21.15.7:0/256492196 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4f940a33b0 0x7f4f940a5870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0022000 tx=0x7f4fa0021000 comp rx=0 tx=0).stop 2024-09-19T08:51:15.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.361+0000 7f4fafa38640 1 -- 172.21.15.7:0/256492196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa8101de0 msgr2=0x7f4fa8198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.361+0000 7f4fafa38640 1 --2- 172.21.15.7:0/256492196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa8101de0 0x7f4fa8198430 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400d770 tx=0x7f4fa400dc30 comp rx=0 tx=0).stop 2024-09-19T08:51:15.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.361+0000 7f4fafa38640 1 -- 172.21.15.7:0/256492196 shutdown_connections 2024-09-19T08:51:15.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.361+0000 7f4fafa38640 1 --2- 172.21.15.7:0/256492196 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4f940a33b0 0x7f4f940a5870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.361+0000 7f4fafa38640 1 --2- 172.21.15.7:0/256492196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4fa8106f10 0x7f4fa819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.361+0000 7f4fafa38640 1 --2- 172.21.15.7:0/256492196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa8102790 0x7f4fa8198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.361+0000 7f4fafa38640 1 --2- 172.21.15.7:0/256492196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4fa8101de0 0x7f4fa8198430 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.361+0000 7f4fafa38640 1 -- 172.21.15.7:0/256492196 >> 172.21.15.7:0/256492196 conn(0x7f4fa80fd8c0 msgr2=0x7f4fa80fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:15.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.361+0000 7f4fafa38640 1 -- 172.21.15.7:0/256492196 shutdown_connections 2024-09-19T08:51:15.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:15.361+0000 7f4fafa38640 1 -- 172.21.15.7:0/256492196 wait complete. 2024-09-19T08:51:16.118 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:51:16.374 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:16.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:16 smithi007 ceph-mon[31221]: pgmap v206: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:51:16.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:16 smithi175 ceph-mon[35688]: pgmap v206: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:51:16.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:16 smithi044 ceph-mon[35072]: pgmap v206: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:51:16.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.811+0000 7f22824c5640 1 -- 172.21.15.7:0/1337497432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f227c100a80 msgr2=0x7f227c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:16.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.811+0000 7f22824c5640 1 --2- 172.21.15.7:0/1337497432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f227c100a80 0x7f227c100ee0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f2264009930 tx=0x7f226402a420 comp rx=0 tx=0).stop 2024-09-19T08:51:16.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.812+0000 7f22824c5640 1 -- 172.21.15.7:0/1337497432 shutdown_connections 2024-09-19T08:51:16.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.812+0000 7f22824c5640 1 --2- 172.21.15.7:0/1337497432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f227c101420 0x7f227c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.812+0000 7f22824c5640 1 --2- 172.21.15.7:0/1337497432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f227c100a80 0x7f227c100ee0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.812+0000 7f22824c5640 1 --2- 172.21.15.7:0/1337497432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c106a80 0x7f227c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.812+0000 7f22824c5640 1 -- 172.21.15.7:0/1337497432 >> 172.21.15.7:0/1337497432 conn(0x7f227c0fc7a0 msgr2=0x7f227c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:16.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.812+0000 7f22824c5640 1 -- 172.21.15.7:0/1337497432 shutdown_connections 2024-09-19T08:51:16.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.812+0000 7f22824c5640 1 -- 172.21.15.7:0/1337497432 wait complete. 2024-09-19T08:51:16.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.812+0000 7f22824c5640 1 Processor -- start 2024-09-19T08:51:16.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.812+0000 7f22824c5640 1 -- start start 2024-09-19T08:51:16.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.813+0000 7f22824c5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f227c100a80 0x7f227c0fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:16.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.813+0000 7f22824c5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f227c101420 0x7f227c0fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:16.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.813+0000 7f22824c5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c106a80 0x7f227c0fd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:16.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.813+0000 7f22824c5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f227c110e80 con 0x7f227c101420 2024-09-19T08:51:16.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.813+0000 7f22824c5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f227c110d00 con 0x7f227c106a80 2024-09-19T08:51:16.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.813+0000 7f22824c5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f227c111000 con 0x7f227c100a80 2024-09-19T08:51:16.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.813+0000 7f2273fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f227c101420 0x7f227c0fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:16.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.813+0000 7f2273fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f227c101420 0x7f227c0fd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59362/0 (socket says 172.21.15.7:59362) 2024-09-19T08:51:16.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.813+0000 7f2273fff640 1 -- 172.21.15.7:0/1494449415 learned_addr learned my addr 172.21.15.7:0/1494449415 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:16.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.813+0000 7f2280a62640 1 --2- 172.21.15.7:0/1494449415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c106a80 0x7f227c0fd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:16.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.813+0000 7f227bfff640 1 --2- 172.21.15.7:0/1494449415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f227c100a80 0x7f227c0fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:16.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.813+0000 7f2273fff640 1 -- 172.21.15.7:0/1494449415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f227c100a80 msgr2=0x7f227c0fccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:16.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.813+0000 7f2273fff640 1 --2- 172.21.15.7:0/1494449415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f227c100a80 0x7f227c0fccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.813+0000 7f2273fff640 1 -- 172.21.15.7:0/1494449415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c106a80 msgr2=0x7f227c0fd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:16.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.813+0000 7f2273fff640 1 --2- 172.21.15.7:0/1494449415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c106a80 0x7f227c0fd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.813+0000 7f2273fff640 1 -- 172.21.15.7:0/1494449415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227c1a68a0 con 0x7f227c101420 2024-09-19T08:51:16.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.813+0000 7f227bfff640 1 --2- 172.21.15.7:0/1494449415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f227c100a80 0x7f227c0fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:16.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.813+0000 7f2273fff640 1 --2- 172.21.15.7:0/1494449415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f227c101420 0x7f227c0fd230 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f2264009230 tx=0x7f2264004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:16.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.814+0000 7f2279ffb640 1 -- 172.21.15.7:0/1494449415 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226403f030 con 0x7f227c101420 2024-09-19T08:51:16.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.814+0000 7f22824c5640 1 -- 172.21.15.7:0/1494449415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f227c1a6b30 con 0x7f227c101420 2024-09-19T08:51:16.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.814+0000 7f2279ffb640 1 -- 172.21.15.7:0/1494449415 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2264003ad0 con 0x7f227c101420 2024-09-19T08:51:16.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.814+0000 7f2279ffb640 1 -- 172.21.15.7:0/1494449415 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2264035070 con 0x7f227c101420 2024-09-19T08:51:16.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.814+0000 7f22824c5640 1 -- 172.21.15.7:0/1494449415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f227c1a7060 con 0x7f227c101420 2024-09-19T08:51:16.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.816+0000 7f2279ffb640 1 -- 172.21.15.7:0/1494449415 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f2264042030 con 0x7f227c101420 2024-09-19T08:51:16.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.816+0000 7f228489e740 1 Processor -- start 2024-09-19T08:51:16.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.816+0000 7f228489e740 1 -- start start 2024-09-19T08:51:16.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.817+0000 7f228489e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bcab40 0x55f942bc9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:16.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.817+0000 7f228489e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bc95d0 0x55f942bc9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:16.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.817+0000 7f228489e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f942bd4370 0x55f942bd6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:16.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.817+0000 7f228489e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f942b2f2f0 con 0x55f942bcab40 2024-09-19T08:51:16.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.817+0000 7f228489e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f942ad6cf0 con 0x55f942bc95d0 2024-09-19T08:51:16.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.817+0000 7f228489e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f942b2b2b0 con 0x55f942bd4370 2024-09-19T08:51:16.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.817+0000 7f2280a62640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bcab40 0x55f942bc9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:16.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.817+0000 7f227bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bc95d0 0x55f942bc9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:16.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.817+0000 7f2280a62640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bcab40 0x55f942bc9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59378/0 (socket says 172.21.15.7:59378) 2024-09-19T08:51:16.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.817+0000 7f2280a62640 1 -- 172.21.15.7:0/3725541535 learned_addr learned my addr 172.21.15.7:0/3725541535 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:16.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.817+0000 7f2279ffb640 1 --2- 172.21.15.7:0/1494449415 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f22680a33b0 0x7f22680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:16.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.817+0000 7f2273fff640 1 --2- 172.21.15.7:0/3725541535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f942bd4370 0x55f942bd6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:16.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.817+0000 7f227bfff640 1 -- 172.21.15.7:0/3725541535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f942bd4370 msgr2=0x55f942bd6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:16.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.817+0000 7f227bfff640 1 --2- 172.21.15.7:0/3725541535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f942bd4370 0x55f942bd6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.817+0000 7f227bfff640 1 -- 172.21.15.7:0/3725541535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bcab40 msgr2=0x55f942bc9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:16.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.817+0000 7f227bfff640 1 --2- 172.21.15.7:0/3725541535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bcab40 0x55f942bc9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.817+0000 7f2279ffb640 1 -- 172.21.15.7:0/1494449415 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8629+0+0 (secure 0 0 0) 0x7f22640eff30 con 0x7f227c101420 2024-09-19T08:51:16.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.817+0000 7f227bfff640 1 -- 172.21.15.7:0/3725541535 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f942abb3a0 con 0x55f942bc95d0 2024-09-19T08:51:16.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.817+0000 7f2280a62640 1 --2- 172.21.15.7:0/3725541535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bcab40 0x55f942bc9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:16.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.817+0000 7f2273fff640 1 --2- 172.21.15.7:0/3725541535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f942bd4370 0x55f942bd6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:16.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.817+0000 7f2280a62640 1 --2- 172.21.15.7:0/1494449415 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f22680a33b0 0x7f22680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:16.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.818+0000 7f227bfff640 1 --2- 172.21.15.7:0/3725541535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bc95d0 0x55f942bc9a10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f226c008b30 tx=0x7f226c00e350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42d4c375b186eb9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:16.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.818+0000 7f2280a62640 1 --2- 172.21.15.7:0/1494449415 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f22680a33b0 0x7f22680a5870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2274009fd0 tx=0x7f2274004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:16.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.818+0000 7f22727fc640 1 -- 172.21.15.7:0/3725541535 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c014070 con 0x55f942bc95d0 2024-09-19T08:51:16.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.818+0000 7f22727fc640 1 -- 172.21.15.7:0/3725541535 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f226c005500 con 0x55f942bc95d0 2024-09-19T08:51:16.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.818+0000 7f22727fc640 1 -- 172.21.15.7:0/3725541535 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c010690 con 0x55f942bc95d0 2024-09-19T08:51:16.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.819+0000 7f228489e740 1 -- 172.21.15.7:0/3725541535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bc95d0 msgr2=0x55f942bc9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:16.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.819+0000 7f228489e740 1 --2- 172.21.15.7:0/3725541535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bc95d0 0x55f942bc9a10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f226c008b30 tx=0x7f226c00e350 comp rx=0 tx=0).stop 2024-09-19T08:51:16.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.819+0000 7f228489e740 1 -- 172.21.15.7:0/3725541535 shutdown_connections 2024-09-19T08:51:16.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.819+0000 7f228489e740 1 --2- 172.21.15.7:0/3725541535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f942bd4370 0x55f942bd6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.819+0000 7f228489e740 1 --2- 172.21.15.7:0/3725541535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bc95d0 0x55f942bc9a10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.819+0000 7f228489e740 1 --2- 172.21.15.7:0/3725541535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bcab40 0x55f942bc9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.819+0000 7f228489e740 1 -- 172.21.15.7:0/3725541535 >> 172.21.15.7:0/3725541535 conn(0x55f942b92310 msgr2=0x55f942bc5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:16.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.819+0000 7f228489e740 1 -- 172.21.15.7:0/3725541535 shutdown_connections 2024-09-19T08:51:16.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.819+0000 7f228489e740 1 -- 172.21.15.7:0/3725541535 wait complete. 2024-09-19T08:51:16.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.819+0000 7f228489e740 1 -- start start 2024-09-19T08:51:16.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.819+0000 7f228489e740 1 Processor -- start 2024-09-19T08:51:16.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.820+0000 7f228489e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bc95d0 0x55f942bd3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:16.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.820+0000 7f228489e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bcab40 0x55f942bd1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:16.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.820+0000 7f228489e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f942bd4370 0x55f942bd17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:16.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.820+0000 7f228489e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f942bd7070 con 0x55f942bc95d0 2024-09-19T08:51:16.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.820+0000 7f228489e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f942aea060 con 0x55f942bcab40 2024-09-19T08:51:16.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.820+0000 7f228489e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f942bd71f0 con 0x55f942bd4370 2024-09-19T08:51:16.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.820+0000 7f227bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bc95d0 0x55f942bd3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:16.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.820+0000 7f228489e740 10 client.0 _ll_register_callbacks cb 0x55f94283d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:16.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.820+0000 7f227bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bc95d0 0x55f942bd3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59388/0 (socket says 172.21.15.7:59388) 2024-09-19T08:51:16.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.820+0000 7f227bfff640 1 -- 172.21.15.7:0/2585794615 learned_addr learned my addr 172.21.15.7:0/2585794615 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:16.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.820+0000 7f2273fff640 1 --2- 172.21.15.7:0/2585794615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bcab40 0x55f942bd1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:16.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.820+0000 7f2280a62640 1 --2- 172.21.15.7:0/2585794615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f942bd4370 0x55f942bd17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:16.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.820+0000 7f227bfff640 1 -- 172.21.15.7:0/2585794615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f942bd4370 msgr2=0x55f942bd17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:16.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.820+0000 7f227bfff640 1 --2- 172.21.15.7:0/2585794615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f942bd4370 0x55f942bd17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.820+0000 7f227bfff640 1 -- 172.21.15.7:0/2585794615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bcab40 msgr2=0x55f942bd1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:16.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.820+0000 7f227bfff640 1 --2- 172.21.15.7:0/2585794615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bcab40 0x55f942bd1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.820+0000 7f227bfff640 1 -- 172.21.15.7:0/2585794615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9428a03c0 con 0x55f942bc95d0 2024-09-19T08:51:16.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.820+0000 7f2273fff640 1 --2- 172.21.15.7:0/2585794615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bcab40 0x55f942bd1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:16.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.820+0000 7f227bfff640 1 --2- 172.21.15.7:0/2585794615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bc95d0 0x55f942bd3da0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f226c000c00 tx=0x7f226c00efc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1b974f2a68ce82 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:16.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.820+0000 7f225b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:51:16.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.821+0000 7f225b7fe640 1 -- 172.21.15.7:0/2585794615 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c014070 con 0x55f942bc95d0 2024-09-19T08:51:16.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.821+0000 7f225b7fe640 1 -- 172.21.15.7:0/2585794615 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8629+0+0 (secure 0 0 0) 0x7f226c010640 con 0x55f942bc95d0 2024-09-19T08:51:16.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.821+0000 7f228489e740 1 -- 172.21.15.7:0/2585794615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f226c005500 con 0x55f942bc95d0 2024-09-19T08:51:16.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.821+0000 7f225b7fe640 1 -- 172.21.15.7:0/2585794615 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f226c008700 con 0x55f942bc95d0 2024-09-19T08:51:16.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.821+0000 7f228489e740 10 client.16650 fetch_fsmap learned FSMap version 25 2024-09-19T08:51:16.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.821+0000 7f228489e740 1 -- 172.21.15.7:0/2585794615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f942be2b50 con 0x55f942bc95d0 2024-09-19T08:51:16.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.821+0000 7f225b7fe640 1 -- 172.21.15.7:0/2585794615 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f226c005500 con 0x55f942bc95d0 2024-09-19T08:51:16.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.821+0000 7f225b7fe640 1 -- 172.21.15.7:0/2585794615 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f226c0237c0 con 0x55f942bc95d0 2024-09-19T08:51:16.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.821+0000 7f228489e740 10 client.16650 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:51:16.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.821+0000 7f228489e740 10 client.16650 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:51:16.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.821+0000 7f228489e740 20 client.16650 populate_metadata read hostname 'smithi007' 2024-09-19T08:51:16.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.821+0000 7f228489e740 1 --2- 172.21.15.7:0/2585794615 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f942be3f50 0x55f942be6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:16.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.821+0000 7f228489e740 4 client.16650 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:51:16.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.821+0000 7f228489e740 1 -- 172.21.15.7:0/2585794615 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f942b3c860 con 0x55f942be3f50 2024-09-19T08:51:16.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.822+0000 7f2273fff640 1 --2- 172.21.15.7:0/2585794615 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f942be3f50 0x55f942be6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:16.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.822+0000 7f2273fff640 1 --2- 172.21.15.7:0/2585794615 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f942be3f50 0x55f942be6340 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=64b271a16bbbeb12 server_cookie=4161ed1f02a6b1a0 in_seq=0 out_seq=0 2024-09-19T08:51:16.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.822+0000 7f225b7fe640 10 client.16650 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:51:16.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.823+0000 7f225b7fe640 1 -- 172.21.15.7:0/2585794615 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f942b3c860 con 0x55f942be3f50 2024-09-19T08:51:16.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.823+0000 7f225b7fe640 10 client.16650 handle_command_reply: tid=0 2024-09-19T08:51:16.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.823+0000 7f228489e740 1 client.16650 shutdown 2024-09-19T08:51:16.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.823+0000 7f228489e740 1 -- 172.21.15.7:0/2585794615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bc95d0 msgr2=0x55f942bd3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:16.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.823+0000 7f228489e740 1 --2- 172.21.15.7:0/2585794615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bc95d0 0x55f942bd3da0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f226c000c00 tx=0x7f226c00efc0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.823+0000 7f228489e740 1 -- 172.21.15.7:0/2585794615 shutdown_connections 2024-09-19T08:51:16.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.823+0000 7f228489e740 1 --2- 172.21.15.7:0/2585794615 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f942be3f50 0x55f942be6340 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.823+0000 7f228489e740 1 --2- 172.21.15.7:0/2585794615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f942bd4370 0x55f942bd17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.823+0000 7f228489e740 1 --2- 172.21.15.7:0/2585794615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bcab40 0x55f942bd1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.823+0000 7f228489e740 1 --2- 172.21.15.7:0/2585794615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bc95d0 0x55f942bd3da0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.823+0000 7f228489e740 1 -- 172.21.15.7:0/2585794615 >> 172.21.15.7:0/2585794615 conn(0x55f942b92310 msgr2=0x55f942bcb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:16.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.823+0000 7f225b7fe640 0 client.16650 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:51:16.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.823+0000 7f228489e740 1 -- 172.21.15.7:0/2585794615 shutdown_connections 2024-09-19T08:51:16.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.823+0000 7f228489e740 1 -- 172.21.15.7:0/2585794615 wait complete. 2024-09-19T08:51:16.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.823+0000 7f228489e740 20 client.16650 trim_cache size 0 max 16384 2024-09-19T08:51:16.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.836+0000 7f228489e740 1 Processor -- start 2024-09-19T08:51:16.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.836+0000 7f228489e740 1 -- start start 2024-09-19T08:51:16.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.836+0000 7f228489e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f942bc95d0 0x55f942bc5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:16.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.836+0000 7f228489e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bcab40 0x55f942bebb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:16.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.836+0000 7f228489e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bd4370 0x55f942bec060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:16.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.836+0000 7f228489e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f227c1b2430 con 0x55f942bd4370 2024-09-19T08:51:16.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.836+0000 7f228489e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f227c1afd00 con 0x55f942bcab40 2024-09-19T08:51:16.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.836+0000 7f228489e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f227c1adb70 con 0x55f942bc95d0 2024-09-19T08:51:16.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.836+0000 7f2280a62640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bd4370 0x55f942bec060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:16.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.836+0000 7f2280a62640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bd4370 0x55f942bec060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59400/0 (socket says 172.21.15.7:59400) 2024-09-19T08:51:16.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.836+0000 7f2280a62640 1 -- 172.21.15.7:0/1949957345 learned_addr learned my addr 172.21.15.7:0/1949957345 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:16.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.837+0000 7f2273fff640 1 --2- 172.21.15.7:0/1949957345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bcab40 0x55f942bebb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:16.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.837+0000 7f227bfff640 1 --2- 172.21.15.7:0/1949957345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f942bc95d0 0x55f942bc5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:16.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.837+0000 7f2280a62640 1 -- 172.21.15.7:0/1949957345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f942bc95d0 msgr2=0x55f942bc5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:16.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.837+0000 7f2280a62640 1 --2- 172.21.15.7:0/1949957345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f942bc95d0 0x55f942bc5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.837+0000 7f2280a62640 1 -- 172.21.15.7:0/1949957345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bcab40 msgr2=0x55f942bebb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:16.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.837+0000 7f2280a62640 1 --2- 172.21.15.7:0/1949957345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bcab40 0x55f942bebb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.837+0000 7f2280a62640 1 -- 172.21.15.7:0/1949957345 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f942bcc120 con 0x55f942bd4370 2024-09-19T08:51:16.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.837+0000 7f2273fff640 1 --2- 172.21.15.7:0/1949957345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bcab40 0x55f942bebb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:16.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.837+0000 7f2280a62640 1 --2- 172.21.15.7:0/1949957345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bd4370 0x55f942bec060 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f22740138a0 tx=0x7f2274017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41d88ea8d9c48d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:16.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.837+0000 7f2271ffb640 1 -- 172.21.15.7:0/1949957345 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227401fbd0 con 0x55f942bd4370 2024-09-19T08:51:16.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.837+0000 7f2271ffb640 1 -- 172.21.15.7:0/1949957345 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2274013e20 con 0x55f942bd4370 2024-09-19T08:51:16.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.837+0000 7f2271ffb640 1 -- 172.21.15.7:0/1949957345 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2274011640 con 0x55f942bd4370 2024-09-19T08:51:16.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.838+0000 7f228489e740 1 -- 172.21.15.7:0/1949957345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bd4370 msgr2=0x55f942bec060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:16.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.838+0000 7f228489e740 1 --2- 172.21.15.7:0/1949957345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bd4370 0x55f942bec060 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f22740138a0 tx=0x7f2274017000 comp rx=0 tx=0).stop 2024-09-19T08:51:16.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.838+0000 7f228489e740 1 -- 172.21.15.7:0/1949957345 shutdown_connections 2024-09-19T08:51:16.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.838+0000 7f228489e740 1 --2- 172.21.15.7:0/1949957345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bd4370 0x55f942bec060 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.838+0000 7f228489e740 1 --2- 172.21.15.7:0/1949957345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bcab40 0x55f942bebb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.838+0000 7f228489e740 1 --2- 172.21.15.7:0/1949957345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f942bc95d0 0x55f942bc5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.838+0000 7f228489e740 1 -- 172.21.15.7:0/1949957345 >> 172.21.15.7:0/1949957345 conn(0x55f942b92310 msgr2=0x55f942bc5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:16.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.838+0000 7f228489e740 1 -- 172.21.15.7:0/1949957345 shutdown_connections 2024-09-19T08:51:16.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.838+0000 7f228489e740 1 -- 172.21.15.7:0/1949957345 wait complete. 2024-09-19T08:51:16.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.838+0000 7f228489e740 1 -- start start 2024-09-19T08:51:16.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.838+0000 7f228489e740 1 Processor -- start 2024-09-19T08:51:16.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.839+0000 7f228489e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bc95d0 0x55f942bdc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:16.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.839+0000 7f228489e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bcab40 0x55f942bdc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:16.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.839+0000 7f228489e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f942bd4370 0x55f942bcd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:16.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.839+0000 7f228489e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f227c1ae1c0 con 0x55f942bc95d0 2024-09-19T08:51:16.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.839+0000 7f228489e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f227c1af630 con 0x55f942bcab40 2024-09-19T08:51:16.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.839+0000 7f228489e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f227c1ae890 con 0x55f942bd4370 2024-09-19T08:51:16.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.839+0000 7f228489e740 10 client.0 _ll_register_callbacks cb 0x7f2274009a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:16.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.839+0000 7f227bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bc95d0 0x55f942bdc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:16.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.839+0000 7f227bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bc95d0 0x55f942bdc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59408/0 (socket says 172.21.15.7:59408) 2024-09-19T08:51:16.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.839+0000 7f227bfff640 1 -- 172.21.15.7:0/2961902534 learned_addr learned my addr 172.21.15.7:0/2961902534 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:16.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.839+0000 7f2280a62640 1 --2- 172.21.15.7:0/2961902534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f942bd4370 0x55f942bcd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:16.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.839+0000 7f2273fff640 1 --2- 172.21.15.7:0/2961902534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bcab40 0x55f942bdc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:16.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.839+0000 7f227bfff640 1 -- 172.21.15.7:0/2961902534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f942bd4370 msgr2=0x55f942bcd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:16.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.839+0000 7f227bfff640 1 --2- 172.21.15.7:0/2961902534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f942bd4370 0x55f942bcd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.839+0000 7f227bfff640 1 -- 172.21.15.7:0/2961902534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bcab40 msgr2=0x55f942bdc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.839+0000 7f227bfff640 1 --2- 172.21.15.7:0/2961902534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bcab40 0x55f942bdc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.839+0000 7f227bfff640 1 -- 172.21.15.7:0/2961902534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f942bcdbe0 con 0x55f942bc95d0 2024-09-19T08:51:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.839+0000 7f2273fff640 1 --2- 172.21.15.7:0/2961902534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bcab40 0x55f942bdc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.839+0000 7f227bfff640 1 --2- 172.21.15.7:0/2961902534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bc95d0 0x55f942bdc480 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f226c001eb0 tx=0x7f226c018520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef98e68b802fceba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.839+0000 7f225b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:51:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.839+0000 7f225b7fe640 1 -- 172.21.15.7:0/2961902534 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c014070 con 0x55f942bc95d0 2024-09-19T08:51:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.840+0000 7f225b7fe640 1 -- 172.21.15.7:0/2961902534 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8629+0+0 (secure 0 0 0) 0x7f226c023e00 con 0x55f942bc95d0 2024-09-19T08:51:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.840+0000 7f228489e740 1 -- 172.21.15.7:0/2961902534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2274013e20 con 0x55f942bc95d0 2024-09-19T08:51:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.840+0000 7f225b7fe640 1 -- 172.21.15.7:0/2961902534 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f226c037050 con 0x55f942bc95d0 2024-09-19T08:51:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.840+0000 7f228489e740 10 client.16656 fetch_fsmap learned FSMap version 25 2024-09-19T08:51:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.840+0000 7f228489e740 1 -- 172.21.15.7:0/2961902534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f942c4e180 con 0x55f942bc95d0 2024-09-19T08:51:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.840+0000 7f225b7fe640 1 -- 172.21.15.7:0/2961902534 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2274013e20 con 0x55f942bc95d0 2024-09-19T08:51:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.840+0000 7f225b7fe640 1 -- 172.21.15.7:0/2961902534 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f226c010640 con 0x55f942bc95d0 2024-09-19T08:51:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.840+0000 7f228489e740 10 client.16656 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:51:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.840+0000 7f228489e740 10 client.16656 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:51:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.840+0000 7f228489e740 20 client.16656 populate_metadata read hostname 'smithi007' 2024-09-19T08:51:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.840+0000 7f228489e740 1 --2- 172.21.15.7:0/2961902534 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f942c4e7e0 0x55f942c50c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.840+0000 7f228489e740 4 client.16656 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:51:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.840+0000 7f228489e740 1 -- 172.21.15.7:0/2961902534 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f942b36d70 con 0x55f942c4e7e0 2024-09-19T08:51:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.840+0000 7f2273fff640 1 --2- 172.21.15.7:0/2961902534 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f942c4e7e0 0x55f942c50c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.841+0000 7f2273fff640 1 --2- 172.21.15.7:0/2961902534 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f942c4e7e0 0x55f942c50c00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=386cf9f8136e7e0 server_cookie=4b52711af5b6d6aa in_seq=0 out_seq=0 2024-09-19T08:51:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.841+0000 7f225b7fe640 10 client.16656 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:51:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.841+0000 7f225b7fe640 1 -- 172.21.15.7:0/2961902534 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f942b36d70 con 0x55f942c4e7e0 2024-09-19T08:51:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.841+0000 7f225b7fe640 10 client.16656 handle_command_reply: tid=0 2024-09-19T08:51:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.841+0000 7f228489e740 1 client.16656 shutdown 2024-09-19T08:51:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.841+0000 7f228489e740 1 -- 172.21.15.7:0/2961902534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bc95d0 msgr2=0x55f942bdc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:16.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.841+0000 7f228489e740 1 --2- 172.21.15.7:0/2961902534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bc95d0 0x55f942bdc480 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f226c001eb0 tx=0x7f226c018520 comp rx=0 tx=0).stop 2024-09-19T08:51:16.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.841+0000 7f228489e740 1 -- 172.21.15.7:0/2961902534 shutdown_connections 2024-09-19T08:51:16.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.841+0000 7f228489e740 1 --2- 172.21.15.7:0/2961902534 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f942c4e7e0 0x55f942c50c00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.841+0000 7f228489e740 1 --2- 172.21.15.7:0/2961902534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f942bd4370 0x55f942bcd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.841+0000 7f228489e740 1 --2- 172.21.15.7:0/2961902534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f942bcab40 0x55f942bdc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.841+0000 7f228489e740 1 --2- 172.21.15.7:0/2961902534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f942bc95d0 0x55f942bdc480 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.841+0000 7f228489e740 1 -- 172.21.15.7:0/2961902534 >> 172.21.15.7:0/2961902534 conn(0x55f942b92310 msgr2=0x55f942bcb110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:16.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.841+0000 7f225b7fe640 0 client.16656 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:51:16.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.841+0000 7f228489e740 1 -- 172.21.15.7:0/2961902534 shutdown_connections 2024-09-19T08:51:16.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.841+0000 7f228489e740 1 -- 172.21.15.7:0/2961902534 wait complete. 2024-09-19T08:51:16.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.842+0000 7f228489e740 20 client.16656 trim_cache size 0 max 16384 2024-09-19T08:51:16.847 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:51:16.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.842+0000 7f22824c5640 1 -- 172.21.15.7:0/1494449415 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f22680a33b0 msgr2=0x7f22680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:16.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.842+0000 7f22824c5640 1 --2- 172.21.15.7:0/1494449415 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f22680a33b0 0x7f22680a5870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2274009fd0 tx=0x7f2274004a40 comp rx=0 tx=0).stop 2024-09-19T08:51:16.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.842+0000 7f22824c5640 1 -- 172.21.15.7:0/1494449415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f227c101420 msgr2=0x7f227c0fd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:16.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.842+0000 7f22824c5640 1 --2- 172.21.15.7:0/1494449415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f227c101420 0x7f227c0fd230 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f2264009230 tx=0x7f2264004270 comp rx=0 tx=0).stop 2024-09-19T08:51:16.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.842+0000 7f22824c5640 1 -- 172.21.15.7:0/1494449415 shutdown_connections 2024-09-19T08:51:16.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.842+0000 7f22824c5640 1 --2- 172.21.15.7:0/1494449415 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f22680a33b0 0x7f22680a5870 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.842+0000 7f22824c5640 1 --2- 172.21.15.7:0/1494449415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f227c106a80 0x7f227c0fd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.842+0000 7f22824c5640 1 --2- 172.21.15.7:0/1494449415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f227c101420 0x7f227c0fd230 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.842+0000 7f22824c5640 1 --2- 172.21.15.7:0/1494449415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f227c100a80 0x7f227c0fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.842+0000 7f22824c5640 1 -- 172.21.15.7:0/1494449415 >> 172.21.15.7:0/1494449415 conn(0x7f227c0fc7a0 msgr2=0x7f227c06a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:16.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.842+0000 7f22824c5640 1 -- 172.21.15.7:0/1494449415 shutdown_connections 2024-09-19T08:51:16.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:16.842+0000 7f22824c5640 1 -- 172.21.15.7:0/1494449415 wait complete. 2024-09-19T08:51:17.815 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:51:18.072 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:18.462 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:18 smithi007 ceph-mon[31221]: pgmap v207: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:51:18.463 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:18 smithi007 ceph-mon[31221]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T08:51:18.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.548+0000 7f23a0f6c640 1 -- 172.21.15.7:0/3166532428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f239c101420 msgr2=0x7f239c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:18.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.548+0000 7f23a0f6c640 1 --2- 172.21.15.7:0/3166532428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f239c101420 0x7f239c10d950 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f2394009cd0 tx=0x7f239402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.548+0000 7f23a0f6c640 1 -- 172.21.15.7:0/3166532428 shutdown_connections 2024-09-19T08:51:18.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.548+0000 7f23a0f6c640 1 --2- 172.21.15.7:0/3166532428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f239c101420 0x7f239c10d950 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.548+0000 7f23a0f6c640 1 --2- 172.21.15.7:0/3166532428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f239c100a80 0x7f239c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.548+0000 7f23a0f6c640 1 --2- 172.21.15.7:0/3166532428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f239c106a80 0x7f239c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.548+0000 7f23a0f6c640 1 -- 172.21.15.7:0/3166532428 >> 172.21.15.7:0/3166532428 conn(0x7f239c0fc7a0 msgr2=0x7f239c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:18.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.548+0000 7f23a0f6c640 1 -- 172.21.15.7:0/3166532428 shutdown_connections 2024-09-19T08:51:18.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.548+0000 7f23a0f6c640 1 -- 172.21.15.7:0/3166532428 wait complete. 2024-09-19T08:51:18.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.549+0000 7f23a0f6c640 1 Processor -- start 2024-09-19T08:51:18.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.549+0000 7f23a0f6c640 1 -- start start 2024-09-19T08:51:18.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.549+0000 7f23a0f6c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f239c100a80 0x7f239c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:18.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.549+0000 7f23a0f6c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f239c101420 0x7f239c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:18.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.549+0000 7f23a0f6c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f239c106a80 0x7f239c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:18.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.550+0000 7f23a0f6c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f239c110ea0 con 0x7f239c101420 2024-09-19T08:51:18.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.550+0000 7f23a0f6c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f239c110d20 con 0x7f239c100a80 2024-09-19T08:51:18.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.550+0000 7f23a0f6c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f239c111020 con 0x7f239c106a80 2024-09-19T08:51:18.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.550+0000 7f2399d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f239c101420 0x7f239c1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:18.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.550+0000 7f2399d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f239c101420 0x7f239c1989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59432/0 (socket says 172.21.15.7:59432) 2024-09-19T08:51:18.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.550+0000 7f2399d9b640 1 -- 172.21.15.7:0/4270808570 learned_addr learned my addr 172.21.15.7:0/4270808570 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:18.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.550+0000 7f239a59c640 1 --2- 172.21.15.7:0/4270808570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f239c100a80 0x7f239c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:18.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.550+0000 7f239ad9d640 1 --2- 172.21.15.7:0/4270808570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f239c106a80 0x7f239c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:18.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.550+0000 7f2399d9b640 1 -- 172.21.15.7:0/4270808570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f239c106a80 msgr2=0x7f239c19cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:18.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.550+0000 7f2399d9b640 1 --2- 172.21.15.7:0/4270808570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f239c106a80 0x7f239c19cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.550+0000 7f2399d9b640 1 -- 172.21.15.7:0/4270808570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f239c100a80 msgr2=0x7f239c198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:18.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.550+0000 7f2399d9b640 1 --2- 172.21.15.7:0/4270808570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f239c100a80 0x7f239c198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.550+0000 7f2399d9b640 1 -- 172.21.15.7:0/4270808570 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239c19d430 con 0x7f239c101420 2024-09-19T08:51:18.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.550+0000 7f2399d9b640 1 --2- 172.21.15.7:0/4270808570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f239c101420 0x7f239c1989c0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f239000b4a0 tx=0x7f239000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:18.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.550+0000 7f238b7fe640 1 -- 172.21.15.7:0/4270808570 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2390015020 con 0x7f239c101420 2024-09-19T08:51:18.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.550+0000 7f238b7fe640 1 -- 172.21.15.7:0/4270808570 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2390011d10 con 0x7f239c101420 2024-09-19T08:51:18.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.550+0000 7f23a0f6c640 1 -- 172.21.15.7:0/4270808570 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f239c19d720 con 0x7f239c101420 2024-09-19T08:51:18.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.550+0000 7f238b7fe640 1 -- 172.21.15.7:0/4270808570 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239000f2e0 con 0x7f239c101420 2024-09-19T08:51:18.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.551+0000 7f23a0f6c640 1 -- 172.21.15.7:0/4270808570 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f239c1a5000 con 0x7f239c101420 2024-09-19T08:51:18.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.553+0000 7f238b7fe640 1 -- 172.21.15.7:0/4270808570 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f2390018020 con 0x7f239c101420 2024-09-19T08:51:18.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.553+0000 7f23a3345740 1 Processor -- start 2024-09-19T08:51:18.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.553+0000 7f23a3345740 1 -- start start 2024-09-19T08:51:18.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.554+0000 7f23a3345740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e390544b40 0x55e390543090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:18.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.554+0000 7f23a3345740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3905435d0 0x55e390543a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:18.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.554+0000 7f23a3345740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e39054e370 0x55e390550760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:18.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.554+0000 7f23a3345740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e3904a92f0 con 0x55e3905435d0 2024-09-19T08:51:18.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.554+0000 7f23a3345740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e390450cf0 con 0x55e39054e370 2024-09-19T08:51:18.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.554+0000 7f23a3345740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e3904a52b0 con 0x55e390544b40 2024-09-19T08:51:18.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.554+0000 7f239a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3905435d0 0x55e390543a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:18.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.554+0000 7f239a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3905435d0 0x55e390543a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59442/0 (socket says 172.21.15.7:59442) 2024-09-19T08:51:18.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.554+0000 7f239a59c640 1 -- 172.21.15.7:0/4059295589 learned_addr learned my addr 172.21.15.7:0/4059295589 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:18.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.554+0000 7f239ad9d640 1 --2- 172.21.15.7:0/4059295589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e390544b40 0x55e390543090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:18.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.554+0000 7f2399d9b640 1 --2- 172.21.15.7:0/4059295589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e39054e370 0x55e390550760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:18.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.554+0000 7f239a59c640 1 -- 172.21.15.7:0/4059295589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e390544b40 msgr2=0x55e390543090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:18.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.554+0000 7f239a59c640 1 --2- 172.21.15.7:0/4059295589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e390544b40 0x55e390543090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.554+0000 7f239a59c640 1 -- 172.21.15.7:0/4059295589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e39054e370 msgr2=0x55e390550760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:18.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.554+0000 7f239a59c640 1 --2- 172.21.15.7:0/4059295589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e39054e370 0x55e390550760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.554+0000 7f239a59c640 1 -- 172.21.15.7:0/4059295589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3904353a0 con 0x55e3905435d0 2024-09-19T08:51:18.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.554+0000 7f2399d9b640 1 --2- 172.21.15.7:0/4059295589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e39054e370 0x55e390550760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:18.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.554+0000 7f238b7fe640 1 --2- 172.21.15.7:0/4270808570 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f23840a3430 0x7f23840a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:18.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.554+0000 7f239ad9d640 1 --2- 172.21.15.7:0/4270808570 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f23840a3430 0x7f23840a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:18.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.554+0000 7f239a59c640 1 --2- 172.21.15.7:0/4059295589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3905435d0 0x55e390543a10 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f238c00ad00 tx=0x7f238c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f40978bb63ab03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:18.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.554+0000 7f238b7fe640 1 -- 172.21.15.7:0/4270808570 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f23900cf4f0 con 0x7f239c101420 2024-09-19T08:51:18.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.555+0000 7f2388ff9640 1 -- 172.21.15.7:0/4059295589 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c01d070 con 0x55e3905435d0 2024-09-19T08:51:18.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.555+0000 7f2388ff9640 1 -- 172.21.15.7:0/4059295589 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f238c018b20 con 0x55e3905435d0 2024-09-19T08:51:18.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.555+0000 7f2388ff9640 1 -- 172.21.15.7:0/4059295589 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c010c20 con 0x55e3905435d0 2024-09-19T08:51:18.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.555+0000 7f23a3345740 1 -- 172.21.15.7:0/4059295589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3905435d0 msgr2=0x55e390543a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:18.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.555+0000 7f239ad9d640 1 --2- 172.21.15.7:0/4270808570 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f23840a3430 0x7f23840a58f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2394009430 tx=0x7f2394005c50 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:18.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.555+0000 7f23a3345740 1 --2- 172.21.15.7:0/4059295589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3905435d0 0x55e390543a10 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f238c00ad00 tx=0x7f238c00f790 comp rx=0 tx=0).stop 2024-09-19T08:51:18.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.555+0000 7f23a3345740 1 -- 172.21.15.7:0/4059295589 shutdown_connections 2024-09-19T08:51:18.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.556+0000 7f23a3345740 1 --2- 172.21.15.7:0/4059295589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e39054e370 0x55e390550760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.556+0000 7f23a3345740 1 --2- 172.21.15.7:0/4059295589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3905435d0 0x55e390543a10 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.556+0000 7f23a3345740 1 --2- 172.21.15.7:0/4059295589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e390544b40 0x55e390543090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.556+0000 7f23a3345740 1 -- 172.21.15.7:0/4059295589 >> 172.21.15.7:0/4059295589 conn(0x55e39050c310 msgr2=0x55e39053fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:18.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.556+0000 7f23a3345740 1 -- 172.21.15.7:0/4059295589 shutdown_connections 2024-09-19T08:51:18.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.556+0000 7f23a3345740 1 -- 172.21.15.7:0/4059295589 wait complete. 2024-09-19T08:51:18.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.556+0000 7f23a3345740 1 -- start start 2024-09-19T08:51:18.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.556+0000 7f23a3345740 1 Processor -- start 2024-09-19T08:51:18.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.556+0000 7f23a3345740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3905435d0 0x55e39054ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:18.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.556+0000 7f23a3345740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e390544b40 0x55e39054b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:18.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.556+0000 7f23a3345740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e39054e370 0x55e39054b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:18.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.556+0000 7f23a3345740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e390551070 con 0x55e390544b40 2024-09-19T08:51:18.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.556+0000 7f23a3345740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e390464060 con 0x55e3905435d0 2024-09-19T08:51:18.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.556+0000 7f23a3345740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e3905511f0 con 0x55e39054e370 2024-09-19T08:51:18.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.556+0000 7f23a3345740 10 client.0 _ll_register_callbacks cb 0x55e3901b78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:18.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.556+0000 7f2399d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e390544b40 0x55e39054b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:18.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.556+0000 7f2399d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e390544b40 0x55e39054b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59452/0 (socket says 172.21.15.7:59452) 2024-09-19T08:51:18.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.556+0000 7f2399d9b640 1 -- 172.21.15.7:0/690495502 learned_addr learned my addr 172.21.15.7:0/690495502 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:18.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.557+0000 7f239a59c640 1 --2- 172.21.15.7:0/690495502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3905435d0 0x55e39054ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:18.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.557+0000 7f2399d9b640 1 -- 172.21.15.7:0/690495502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e39054e370 msgr2=0x55e39054b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:18.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.557+0000 7f239ad9d640 1 --2- 172.21.15.7:0/690495502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e39054e370 0x55e39054b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:18.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.557+0000 7f2399d9b640 1 --2- 172.21.15.7:0/690495502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e39054e370 0x55e39054b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.557+0000 7f2399d9b640 1 -- 172.21.15.7:0/690495502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3905435d0 msgr2=0x55e39054ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:18.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.557+0000 7f2399d9b640 1 --2- 172.21.15.7:0/690495502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3905435d0 0x55e39054ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.557+0000 7f2399d9b640 1 -- 172.21.15.7:0/690495502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e39021a3c0 con 0x55e390544b40 2024-09-19T08:51:18.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.557+0000 7f239a59c640 1 --2- 172.21.15.7:0/690495502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3905435d0 0x55e39054ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:18.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.557+0000 7f2399d9b640 1 --2- 172.21.15.7:0/690495502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e390544b40 0x55e39054b070 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f239009b5a0 tx=0x7f2390097c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854c03ed6dfdff6d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:18.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.557+0000 7f2381ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:51:18.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.557+0000 7f2381ffb640 1 -- 172.21.15.7:0/690495502 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23900092b0 con 0x55e390544b40 2024-09-19T08:51:18.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.557+0000 7f2381ffb640 1 -- 172.21.15.7:0/690495502 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f23900cce80 con 0x55e390544b40 2024-09-19T08:51:18.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.557+0000 7f23a3345740 1 -- 172.21.15.7:0/690495502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f238c018b20 con 0x55e390544b40 2024-09-19T08:51:18.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.557+0000 7f2381ffb640 1 -- 172.21.15.7:0/690495502 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f239009bfa0 con 0x55e390544b40 2024-09-19T08:51:18.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.557+0000 7f23a3345740 10 client.16668 fetch_fsmap learned FSMap version 25 2024-09-19T08:51:18.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.557+0000 7f23a3345740 1 -- 172.21.15.7:0/690495502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e39055cbe0 con 0x55e390544b40 2024-09-19T08:51:18.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.557+0000 7f2381ffb640 1 -- 172.21.15.7:0/690495502 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f238c018b20 con 0x55e390544b40 2024-09-19T08:51:18.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.558+0000 7f2381ffb640 1 -- 172.21.15.7:0/690495502 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2390097f10 con 0x55e390544b40 2024-09-19T08:51:18.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.558+0000 7f23a3345740 10 client.16668 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:51:18.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.558+0000 7f23a3345740 10 client.16668 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:51:18.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.558+0000 7f23a3345740 20 client.16668 populate_metadata read hostname 'smithi007' 2024-09-19T08:51:18.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.558+0000 7f23a3345740 1 --2- 172.21.15.7:0/690495502 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e39055e0e0 0x55e3905604d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:18.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.558+0000 7f23a3345740 4 client.16668 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:51:18.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.558+0000 7f23a3345740 1 -- 172.21.15.7:0/690495502 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3904b6860 con 0x55e39055e0e0 2024-09-19T08:51:18.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.558+0000 7f239a59c640 1 --2- 172.21.15.7:0/690495502 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e39055e0e0 0x55e3905604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:18.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.558+0000 7f2381ffb640 10 client.16668 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:51:18.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.558+0000 7f239a59c640 1 --2- 172.21.15.7:0/690495502 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e39055e0e0 0x55e3905604d0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ef3978b18f798d2 server_cookie=f3add81365d63c3a in_seq=0 out_seq=0 2024-09-19T08:51:18.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.559+0000 7f2381ffb640 1 -- 172.21.15.7:0/690495502 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e3904b6860 con 0x55e39055e0e0 2024-09-19T08:51:18.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.559+0000 7f2381ffb640 10 client.16668 handle_command_reply: tid=0 2024-09-19T08:51:18.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.559+0000 7f23a3345740 1 client.16668 shutdown 2024-09-19T08:51:18.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.559+0000 7f23a3345740 1 -- 172.21.15.7:0/690495502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e390544b40 msgr2=0x55e39054b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:18.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.559+0000 7f23a3345740 1 --2- 172.21.15.7:0/690495502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e390544b40 0x55e39054b070 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f239009b5a0 tx=0x7f2390097c00 comp rx=0 tx=0).stop 2024-09-19T08:51:18.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.559+0000 7f23a3345740 1 -- 172.21.15.7:0/690495502 shutdown_connections 2024-09-19T08:51:18.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.559+0000 7f23a3345740 1 --2- 172.21.15.7:0/690495502 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e39055e0e0 0x55e3905604d0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.559+0000 7f23a3345740 1 --2- 172.21.15.7:0/690495502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e39054e370 0x55e39054b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.559+0000 7f23a3345740 1 --2- 172.21.15.7:0/690495502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e390544b40 0x55e39054b070 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.559+0000 7f2381ffb640 0 client.16668 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:51:18.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.559+0000 7f23a3345740 1 --2- 172.21.15.7:0/690495502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e3905435d0 0x55e39054ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.560+0000 7f23a3345740 1 -- 172.21.15.7:0/690495502 >> 172.21.15.7:0/690495502 conn(0x55e39050c310 msgr2=0x55e390545960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:18.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.560+0000 7f23a3345740 1 -- 172.21.15.7:0/690495502 shutdown_connections 2024-09-19T08:51:18.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.560+0000 7f23a3345740 1 -- 172.21.15.7:0/690495502 wait complete. 2024-09-19T08:51:18.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.560+0000 7f23a3345740 20 client.16668 trim_cache size 0 max 16384 2024-09-19T08:51:18.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.573+0000 7f23a3345740 1 Processor -- start 2024-09-19T08:51:18.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.573+0000 7f23a3345740 1 -- start start 2024-09-19T08:51:18.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.573+0000 7f23a3345740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3905435d0 0x55e39054cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:18.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.573+0000 7f23a3345740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e390544b40 0x55e390546120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:18.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.573+0000 7f23a3345740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e39054e370 0x55e390546660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:18.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.573+0000 7f23a3345740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f239c1b0350 con 0x55e3905435d0 2024-09-19T08:51:18.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.573+0000 7f23a3345740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f239c1adc20 con 0x55e39054e370 2024-09-19T08:51:18.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.573+0000 7f23a3345740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f239c1aba90 con 0x55e390544b40 2024-09-19T08:51:18.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.573+0000 7f239a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3905435d0 0x55e39054cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:18.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.573+0000 7f239a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3905435d0 0x55e39054cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59460/0 (socket says 172.21.15.7:59460) 2024-09-19T08:51:18.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.573+0000 7f239a59c640 1 -- 172.21.15.7:0/1566158273 learned_addr learned my addr 172.21.15.7:0/1566158273 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:18.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.573+0000 7f239ad9d640 1 --2- 172.21.15.7:0/1566158273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e39054e370 0x55e390546660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:18.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.573+0000 7f239a59c640 1 -- 172.21.15.7:0/1566158273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e390544b40 msgr2=0x55e390546120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:18.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.573+0000 7f239a59c640 1 --2- 172.21.15.7:0/1566158273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e390544b40 0x55e390546120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.573+0000 7f239a59c640 1 -- 172.21.15.7:0/1566158273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e39054e370 msgr2=0x55e390546660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:18.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.573+0000 7f239a59c640 1 --2- 172.21.15.7:0/1566158273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e39054e370 0x55e390546660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.573+0000 7f239a59c640 1 -- 172.21.15.7:0/1566158273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e39054bb70 con 0x55e3905435d0 2024-09-19T08:51:18.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.573+0000 7f239ad9d640 1 --2- 172.21.15.7:0/1566158273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e39054e370 0x55e390546660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:18.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.573+0000 7f239a59c640 1 --2- 172.21.15.7:0/1566158273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3905435d0 0x55e39054cfe0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f238c01b040 tx=0x7f238c00a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9784463a7c5bc58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:18.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.574+0000 7f2383fff640 1 -- 172.21.15.7:0/1566158273 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c032070 con 0x55e3905435d0 2024-09-19T08:51:18.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.574+0000 7f2383fff640 1 -- 172.21.15.7:0/1566158273 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f238c010550 con 0x55e3905435d0 2024-09-19T08:51:18.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.574+0000 7f2383fff640 1 -- 172.21.15.7:0/1566158273 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c01d040 con 0x55e3905435d0 2024-09-19T08:51:18.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.574+0000 7f23a3345740 1 -- 172.21.15.7:0/1566158273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3905435d0 msgr2=0x55e39054cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:18.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.574+0000 7f23a3345740 1 --2- 172.21.15.7:0/1566158273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3905435d0 0x55e39054cfe0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f238c01b040 tx=0x7f238c00a2d0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.574+0000 7f23a3345740 1 -- 172.21.15.7:0/1566158273 shutdown_connections 2024-09-19T08:51:18.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.574+0000 7f23a3345740 1 --2- 172.21.15.7:0/1566158273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e39054e370 0x55e390546660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.574+0000 7f23a3345740 1 --2- 172.21.15.7:0/1566158273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e390544b40 0x55e390546120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.574+0000 7f23a3345740 1 --2- 172.21.15.7:0/1566158273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3905435d0 0x55e39054cfe0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.574+0000 7f23a3345740 1 -- 172.21.15.7:0/1566158273 >> 172.21.15.7:0/1566158273 conn(0x55e39050c310 msgr2=0x55e39054c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:18.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.574+0000 7f23a3345740 1 -- 172.21.15.7:0/1566158273 shutdown_connections 2024-09-19T08:51:18.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.574+0000 7f23a3345740 1 -- 172.21.15.7:0/1566158273 wait complete. 2024-09-19T08:51:18.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.574+0000 7f23a3345740 1 -- start start 2024-09-19T08:51:18.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.575+0000 7f23a3345740 1 Processor -- start 2024-09-19T08:51:18.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.575+0000 7f23a3345740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3905435d0 0x55e390556950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:18.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.575+0000 7f23a3345740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e390544b40 0x55e390553450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:18.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.575+0000 7f23a3345740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e39054e370 0x55e390553990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:18.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.575+0000 7f23a3345740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f239c1ac0e0 con 0x55e390544b40 2024-09-19T08:51:18.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.575+0000 7f23a3345740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f239c1ad550 con 0x55e39054e370 2024-09-19T08:51:18.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.575+0000 7f23a3345740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f239c1ac7b0 con 0x55e3905435d0 2024-09-19T08:51:18.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.575+0000 7f23a3345740 10 client.0 _ll_register_callbacks cb 0x7f239000bf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:18.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.575+0000 7f2399d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e390544b40 0x55e390553450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:18.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.575+0000 7f2399d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e390544b40 0x55e390553450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59472/0 (socket says 172.21.15.7:59472) 2024-09-19T08:51:18.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.575+0000 7f2399d9b640 1 -- 172.21.15.7:0/4224897417 learned_addr learned my addr 172.21.15.7:0/4224897417 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:18.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.575+0000 7f239ad9d640 1 --2- 172.21.15.7:0/4224897417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e39054e370 0x55e390553990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:18.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.575+0000 7f2399d9b640 1 -- 172.21.15.7:0/4224897417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3905435d0 msgr2=0x55e390556950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:18.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.575+0000 7f239a59c640 1 --2- 172.21.15.7:0/4224897417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3905435d0 0x55e390556950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:18.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.575+0000 7f2399d9b640 1 --2- 172.21.15.7:0/4224897417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3905435d0 0x55e390556950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.575+0000 7f2399d9b640 1 -- 172.21.15.7:0/4224897417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e39054e370 msgr2=0x55e390553990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:18.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.575+0000 7f2399d9b640 1 --2- 172.21.15.7:0/4224897417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e39054e370 0x55e390553990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.575+0000 7f2399d9b640 1 -- 172.21.15.7:0/4224897417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e390553f50 con 0x55e390544b40 2024-09-19T08:51:18.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.575+0000 7f239ad9d640 1 --2- 172.21.15.7:0/4224897417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e39054e370 0x55e390553990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:18.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.575+0000 7f2399d9b640 1 --2- 172.21.15.7:0/4224897417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e390544b40 0x55e390553450 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2390099b50 tx=0x7f2390010880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f941287864a6c5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:18.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.575+0000 7f2381ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:51:18.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.576+0000 7f2381ffb640 1 -- 172.21.15.7:0/4224897417 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23900092b0 con 0x55e390544b40 2024-09-19T08:51:18.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.576+0000 7f2381ffb640 1 -- 172.21.15.7:0/4224897417 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f2390084da0 con 0x55e390544b40 2024-09-19T08:51:18.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.576+0000 7f23a3345740 1 -- 172.21.15.7:0/4224897417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f238c010550 con 0x55e390544b40 2024-09-19T08:51:18.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.576+0000 7f2381ffb640 1 -- 172.21.15.7:0/4224897417 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f239009b3e0 con 0x55e390544b40 2024-09-19T08:51:18.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.576+0000 7f23a3345740 10 client.16674 fetch_fsmap learned FSMap version 25 2024-09-19T08:51:18.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.576+0000 7f23a3345740 1 -- 172.21.15.7:0/4224897417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e3905c9910 con 0x55e390544b40 2024-09-19T08:51:18.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.576+0000 7f2381ffb640 1 -- 172.21.15.7:0/4224897417 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f238c010550 con 0x55e390544b40 2024-09-19T08:51:18.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.576+0000 7f2381ffb640 1 -- 172.21.15.7:0/4224897417 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f239009acf0 con 0x55e390544b40 2024-09-19T08:51:18.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.576+0000 7f23a3345740 10 client.16674 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:51:18.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.576+0000 7f23a3345740 10 client.16674 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:51:18.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.576+0000 7f23a3345740 20 client.16674 populate_metadata read hostname 'smithi007' 2024-09-19T08:51:18.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.576+0000 7f23a3345740 1 --2- 172.21.15.7:0/4224897417 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e39055e0e0 0x55e3905cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:18.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.576+0000 7f23a3345740 4 client.16674 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:51:18.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.576+0000 7f23a3345740 1 -- 172.21.15.7:0/4224897417 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e3904b0d70 con 0x55e39055e0e0 2024-09-19T08:51:18.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.577+0000 7f239a59c640 1 --2- 172.21.15.7:0/4224897417 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e39055e0e0 0x55e3905cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:18.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.577+0000 7f239a59c640 1 --2- 172.21.15.7:0/4224897417 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e39055e0e0 0x55e3905cbf40 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b76433d749810c19 server_cookie=ad8c06d951fe0694 in_seq=0 out_seq=0 2024-09-19T08:51:18.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.577+0000 7f2381ffb640 10 client.16674 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:51:18.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.577+0000 7f2381ffb640 1 -- 172.21.15.7:0/4224897417 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e3904b0d70 con 0x55e39055e0e0 2024-09-19T08:51:18.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.577+0000 7f2381ffb640 10 client.16674 handle_command_reply: tid=0 2024-09-19T08:51:18.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.577+0000 7f23a3345740 1 client.16674 shutdown 2024-09-19T08:51:18.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.577+0000 7f23a3345740 1 -- 172.21.15.7:0/4224897417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e390544b40 msgr2=0x55e390553450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:18.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.577+0000 7f23a3345740 1 --2- 172.21.15.7:0/4224897417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e390544b40 0x55e390553450 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2390099b50 tx=0x7f2390010880 comp rx=0 tx=0).stop 2024-09-19T08:51:18.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.577+0000 7f23a3345740 1 -- 172.21.15.7:0/4224897417 shutdown_connections 2024-09-19T08:51:18.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.577+0000 7f23a3345740 1 --2- 172.21.15.7:0/4224897417 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e39055e0e0 0x55e3905cbf40 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.577+0000 7f23a3345740 1 --2- 172.21.15.7:0/4224897417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e39054e370 0x55e390553990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.577+0000 7f23a3345740 1 --2- 172.21.15.7:0/4224897417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e390544b40 0x55e390553450 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.577+0000 7f2381ffb640 0 client.16674 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:51:18.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.577+0000 7f23a3345740 1 --2- 172.21.15.7:0/4224897417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e3905435d0 0x55e390556950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.577+0000 7f23a3345740 1 -- 172.21.15.7:0/4224897417 >> 172.21.15.7:0/4224897417 conn(0x55e39050c310 msgr2=0x55e39054d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:18.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.577+0000 7f23a3345740 1 -- 172.21.15.7:0/4224897417 shutdown_connections 2024-09-19T08:51:18.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.578+0000 7f23a3345740 1 -- 172.21.15.7:0/4224897417 wait complete. 2024-09-19T08:51:18.596 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:51:18.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.578+0000 7f23a3345740 20 client.16674 trim_cache size 0 max 16384 2024-09-19T08:51:18.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.578+0000 7f23a0f6c640 1 -- 172.21.15.7:0/4270808570 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f23840a3430 msgr2=0x7f23840a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:18.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.578+0000 7f23a0f6c640 1 --2- 172.21.15.7:0/4270808570 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f23840a3430 0x7f23840a58f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2394009430 tx=0x7f2394005c50 comp rx=0 tx=0).stop 2024-09-19T08:51:18.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.578+0000 7f23a0f6c640 1 -- 172.21.15.7:0/4270808570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f239c101420 msgr2=0x7f239c1989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:18.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.578+0000 7f23a0f6c640 1 --2- 172.21.15.7:0/4270808570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f239c101420 0x7f239c1989c0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f239000b4a0 tx=0x7f239000b8a0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.578+0000 7f23a0f6c640 1 -- 172.21.15.7:0/4270808570 shutdown_connections 2024-09-19T08:51:18.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.578+0000 7f23a0f6c640 1 --2- 172.21.15.7:0/4270808570 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f23840a3430 0x7f23840a58f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.578+0000 7f23a0f6c640 1 --2- 172.21.15.7:0/4270808570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f239c106a80 0x7f239c19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.578+0000 7f23a0f6c640 1 --2- 172.21.15.7:0/4270808570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f239c101420 0x7f239c1989c0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.578+0000 7f23a0f6c640 1 --2- 172.21.15.7:0/4270808570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f239c100a80 0x7f239c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.578+0000 7f23a0f6c640 1 -- 172.21.15.7:0/4270808570 >> 172.21.15.7:0/4270808570 conn(0x7f239c0fc7a0 msgr2=0x7f239c06a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:18.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.578+0000 7f23a0f6c640 1 -- 172.21.15.7:0/4270808570 shutdown_connections 2024-09-19T08:51:18.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:18.578+0000 7f23a0f6c640 1 -- 172.21.15.7:0/4270808570 wait complete. 2024-09-19T08:51:18.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:18 smithi175 ceph-mon[35688]: pgmap v207: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:51:18.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:18 smithi175 ceph-mon[35688]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T08:51:18.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:18 smithi044 ceph-mon[35072]: pgmap v207: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:51:18.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:18 smithi044 ceph-mon[35072]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T08:51:20.348 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:51:20.349 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:51:20.618 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:20.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:20 smithi175 ceph-mon[35688]: pgmap v209: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2024-09-19T08:51:20.738 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:20 smithi007 ceph-mon[31221]: pgmap v209: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2024-09-19T08:51:20.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:20 smithi044 ceph-mon[35072]: pgmap v209: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2024-09-19T08:51:21.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.140+0000 7f4e0274a640 1 -- 172.21.15.7:0/1889941279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dfc102790 msgr2=0x7f4dfc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:21.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.140+0000 7f4e0274a640 1 --2- 172.21.15.7:0/1889941279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dfc102790 0x7f4dfc1067e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009900 tx=0x7f4de402a3f0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.140+0000 7f4e0274a640 1 -- 172.21.15.7:0/1889941279 shutdown_connections 2024-09-19T08:51:21.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.141+0000 7f4e0274a640 1 --2- 172.21.15.7:0/1889941279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dfc106f10 0x7f4dfc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.141+0000 7f4e0274a640 1 --2- 172.21.15.7:0/1889941279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dfc102790 0x7f4dfc1067e0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.141+0000 7f4e0274a640 1 --2- 172.21.15.7:0/1889941279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dfc101de0 0x7f4dfc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.141+0000 7f4e0274a640 1 -- 172.21.15.7:0/1889941279 >> 172.21.15.7:0/1889941279 conn(0x7f4dfc0fd8c0 msgr2=0x7f4dfc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:21.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.141+0000 7f4e0274a640 1 -- 172.21.15.7:0/1889941279 shutdown_connections 2024-09-19T08:51:21.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.141+0000 7f4e0274a640 1 -- 172.21.15.7:0/1889941279 wait complete. 2024-09-19T08:51:21.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.141+0000 7f4e0274a640 1 Processor -- start 2024-09-19T08:51:21.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.141+0000 7f4e0274a640 1 -- start start 2024-09-19T08:51:21.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.142+0000 7f4e0274a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dfc101de0 0x7f4dfc198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:21.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.142+0000 7f4e0274a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dfc102790 0x7f4dfc198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:21.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.142+0000 7f4e0274a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dfc106f10 0x7f4dfc19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:21.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.142+0000 7f4e0274a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4dfc111f30 con 0x7f4dfc101de0 2024-09-19T08:51:21.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.142+0000 7f4e0274a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4dfc111db0 con 0x7f4dfc102790 2024-09-19T08:51:21.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.142+0000 7f4e0274a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4dfc1120b0 con 0x7f4dfc106f10 2024-09-19T08:51:21.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.142+0000 7f4dfbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dfc101de0 0x7f4dfc198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:21.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.142+0000 7f4dfbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dfc101de0 0x7f4dfc198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59492/0 (socket says 172.21.15.7:59492) 2024-09-19T08:51:21.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.142+0000 7f4dfbfff640 1 -- 172.21.15.7:0/2141763179 learned_addr learned my addr 172.21.15.7:0/2141763179 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:21.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.142+0000 7f4e00ce7640 1 --2- 172.21.15.7:0/2141763179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dfc106f10 0x7f4dfc19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:21.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.142+0000 7f4df3fff640 1 --2- 172.21.15.7:0/2141763179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dfc102790 0x7f4dfc198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:21.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.142+0000 7f4dfbfff640 1 -- 172.21.15.7:0/2141763179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dfc106f10 msgr2=0x7f4dfc19cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:21.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.142+0000 7f4dfbfff640 1 --2- 172.21.15.7:0/2141763179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dfc106f10 0x7f4dfc19cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.142+0000 7f4dfbfff640 1 -- 172.21.15.7:0/2141763179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dfc102790 msgr2=0x7f4dfc198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:21.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.142+0000 7f4dfbfff640 1 --2- 172.21.15.7:0/2141763179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dfc102790 0x7f4dfc198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.142+0000 7f4dfbfff640 1 -- 172.21.15.7:0/2141763179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dfc19d2c0 con 0x7f4dfc101de0 2024-09-19T08:51:21.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.142+0000 7f4dfbfff640 1 --2- 172.21.15.7:0/2141763179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dfc101de0 0x7f4dfc198310 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00c920 tx=0x7f4dec00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:21.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.143+0000 7f4df9ffb640 1 -- 172.21.15.7:0/2141763179 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dec007c70 con 0x7f4dfc101de0 2024-09-19T08:51:21.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.143+0000 7f4df9ffb640 1 -- 172.21.15.7:0/2141763179 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dec007e10 con 0x7f4dfc101de0 2024-09-19T08:51:21.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.143+0000 7f4e0274a640 1 -- 172.21.15.7:0/2141763179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dfc19d5b0 con 0x7f4dfc101de0 2024-09-19T08:51:21.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.143+0000 7f4df9ffb640 1 -- 172.21.15.7:0/2141763179 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dec018890 con 0x7f4dfc101de0 2024-09-19T08:51:21.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.143+0000 7f4e0274a640 1 -- 172.21.15.7:0/2141763179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dfc1a4e90 con 0x7f4dfc101de0 2024-09-19T08:51:21.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.145+0000 7f4df9ffb640 1 -- 172.21.15.7:0/2141763179 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f4dec018a70 con 0x7f4dfc101de0 2024-09-19T08:51:21.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.145+0000 7f4e04b23740 1 Processor -- start 2024-09-19T08:51:21.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.145+0000 7f4e04b23740 1 -- start start 2024-09-19T08:51:21.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.146+0000 7f4e04b23740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dfec0da20 0x557dfec0de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:21.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.146+0000 7f4e04b23740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557dfec0e340 0x557dfec1cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:21.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.146+0000 7f4e04b23740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec1d150 0x557dfec1f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:21.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.146+0000 7f4e04b23740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557dfeb73280 con 0x557dfec1d150 2024-09-19T08:51:21.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.146+0000 7f4e04b23740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557dfeb1ab10 con 0x557dfec0e340 2024-09-19T08:51:21.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.146+0000 7f4e04b23740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557dfeb6f240 con 0x557dfec0da20 2024-09-19T08:51:21.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.146+0000 7f4df3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec1d150 0x557dfec1f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:21.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.146+0000 7f4df3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec1d150 0x557dfec1f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59502/0 (socket says 172.21.15.7:59502) 2024-09-19T08:51:21.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.146+0000 7f4df3fff640 1 -- 172.21.15.7:0/1695708530 learned_addr learned my addr 172.21.15.7:0/1695708530 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:21.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.146+0000 7f4dfbfff640 1 --2- 172.21.15.7:0/1695708530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557dfec0e340 0x557dfec1cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:21.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.146+0000 7f4e00ce7640 1 --2- 172.21.15.7:0/1695708530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dfec0da20 0x557dfec0de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:21.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.146+0000 7f4df9ffb640 1 --2- 172.21.15.7:0/2141763179 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4de80a3430 0x7f4de80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:21.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.146+0000 7f4df3fff640 1 -- 172.21.15.7:0/1695708530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dfec0da20 msgr2=0x557dfec0de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:21.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.146+0000 7f4df3fff640 1 --2- 172.21.15.7:0/1695708530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dfec0da20 0x557dfec0de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.146+0000 7f4df3fff640 1 -- 172.21.15.7:0/1695708530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557dfec0e340 msgr2=0x557dfec1cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:21.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.146+0000 7f4df3fff640 1 --2- 172.21.15.7:0/1695708530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557dfec0e340 0x557dfec1cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.146+0000 7f4df3fff640 1 -- 172.21.15.7:0/1695708530 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dfeb271f0 con 0x557dfec1d150 2024-09-19T08:51:21.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.146+0000 7f4e00ce7640 1 --2- 172.21.15.7:0/2141763179 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4de80a3430 0x7f4de80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:21.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.146+0000 7f4df9ffb640 1 -- 172.21.15.7:0/2141763179 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f4dec0cff30 con 0x7f4dfc101de0 2024-09-19T08:51:21.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.147+0000 7f4df3fff640 1 --2- 172.21.15.7:0/1695708530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec1d150 0x557dfec1f540 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f4de4005ab0 tx=0x7f4de4031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7b8dcdc94a3820 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:21.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.147+0000 7f4df27fc640 1 -- 172.21.15.7:0/1695708530 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de403f070 con 0x557dfec1d150 2024-09-19T08:51:21.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.147+0000 7f4e00ce7640 1 --2- 172.21.15.7:0/2141763179 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4de80a3430 0x7f4de80a58f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4df4007f30 tx=0x7f4df4004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:21.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.147+0000 7f4df27fc640 1 -- 172.21.15.7:0/1695708530 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4de4031a20 con 0x557dfec1d150 2024-09-19T08:51:21.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.147+0000 7f4df27fc640 1 -- 172.21.15.7:0/1695708530 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de4035070 con 0x557dfec1d150 2024-09-19T08:51:21.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.148+0000 7f4e04b23740 1 -- 172.21.15.7:0/1695708530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec1d150 msgr2=0x557dfec1f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:21.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.148+0000 7f4e04b23740 1 --2- 172.21.15.7:0/1695708530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec1d150 0x557dfec1f540 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f4de4005ab0 tx=0x7f4de4031630 comp rx=0 tx=0).stop 2024-09-19T08:51:21.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.148+0000 7f4e04b23740 1 -- 172.21.15.7:0/1695708530 shutdown_connections 2024-09-19T08:51:21.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.148+0000 7f4e04b23740 1 --2- 172.21.15.7:0/1695708530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec1d150 0x557dfec1f540 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.148+0000 7f4e04b23740 1 --2- 172.21.15.7:0/1695708530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557dfec0e340 0x557dfec1cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.148+0000 7f4e04b23740 1 --2- 172.21.15.7:0/1695708530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dfec0da20 0x557dfec0de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.148+0000 7f4e04b23740 1 -- 172.21.15.7:0/1695708530 >> 172.21.15.7:0/1695708530 conn(0x557dfec0a0f0 msgr2=0x557dfec0a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:21.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.148+0000 7f4e04b23740 1 -- 172.21.15.7:0/1695708530 shutdown_connections 2024-09-19T08:51:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.148+0000 7f4e04b23740 1 -- 172.21.15.7:0/1695708530 wait complete. 2024-09-19T08:51:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.148+0000 7f4e04b23740 1 -- start start 2024-09-19T08:51:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.148+0000 7f4e04b23740 1 Processor -- start 2024-09-19T08:51:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.149+0000 7f4e04b23740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dfec0da20 0x557dfec1a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.149+0000 7f4e04b23740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557dfec0e340 0x557dfec1a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.149+0000 7f4e04b23740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec1d150 0x557dfec1ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.149+0000 7f4e04b23740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557dfec1fcc0 con 0x557dfec1d150 2024-09-19T08:51:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.149+0000 7f4e04b23740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557dfeb2df10 con 0x557dfec0e340 2024-09-19T08:51:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.149+0000 7f4e04b23740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557dfec1fe40 con 0x557dfec0da20 2024-09-19T08:51:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.149+0000 7f4e04b23740 10 client.0 _ll_register_callbacks cb 0x557dfeaf6a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.149+0000 7f4e00ce7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec1d150 0x557dfec1ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.149+0000 7f4e00ce7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec1d150 0x557dfec1ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59510/0 (socket says 172.21.15.7:59510) 2024-09-19T08:51:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.149+0000 7f4dfbfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dfec0da20 0x557dfec1a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.149+0000 7f4e00ce7640 1 -- 172.21.15.7:0/1868909737 learned_addr learned my addr 172.21.15.7:0/1868909737 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.149+0000 7f4df3fff640 1 --2- 172.21.15.7:0/1868909737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557dfec0e340 0x557dfec1a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.149+0000 7f4e00ce7640 1 -- 172.21.15.7:0/1868909737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dfec0da20 msgr2=0x557dfec1a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.149+0000 7f4e00ce7640 1 --2- 172.21.15.7:0/1868909737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dfec0da20 0x557dfec1a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.149+0000 7f4e00ce7640 1 -- 172.21.15.7:0/1868909737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557dfec0e340 msgr2=0x557dfec1a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.149+0000 7f4e00ce7640 1 --2- 172.21.15.7:0/1868909737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557dfec0e340 0x557dfec1a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.149+0000 7f4e00ce7640 1 -- 172.21.15.7:0/1868909737 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dfe8e46a0 con 0x557dfec1d150 2024-09-19T08:51:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.149+0000 7f4e00ce7640 1 --2- 172.21.15.7:0/1868909737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec1d150 0x557dfec1ab00 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f4df40049d0 tx=0x7f4df4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56caca30dc49ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.149+0000 7f4ddb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:51:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.150+0000 7f4ddb7fe640 1 -- 172.21.15.7:0/1868909737 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df4010db0 con 0x557dfec1d150 2024-09-19T08:51:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.150+0000 7f4ddb7fe640 1 -- 172.21.15.7:0/1868909737 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f4df401f430 con 0x557dfec1d150 2024-09-19T08:51:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.150+0000 7f4e04b23740 1 -- 172.21.15.7:0/1868909737 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4de4031a20 con 0x557dfec1d150 2024-09-19T08:51:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.150+0000 7f4ddb7fe640 1 -- 172.21.15.7:0/1868909737 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4df402d050 con 0x557dfec1d150 2024-09-19T08:51:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.150+0000 7f4e04b23740 10 client.16686 fetch_fsmap learned FSMap version 25 2024-09-19T08:51:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.150+0000 7f4e04b23740 1 -- 172.21.15.7:0/1868909737 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557dfec2b9f0 con 0x557dfec1d150 2024-09-19T08:51:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.150+0000 7f4ddb7fe640 1 -- 172.21.15.7:0/1868909737 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4de4031a20 con 0x557dfec1d150 2024-09-19T08:51:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.150+0000 7f4ddb7fe640 1 -- 172.21.15.7:0/1868909737 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4df400e6b0 con 0x557dfec1d150 2024-09-19T08:51:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.150+0000 7f4e04b23740 10 client.16686 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:51:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.150+0000 7f4e04b23740 10 client.16686 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:51:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.150+0000 7f4e04b23740 20 client.16686 populate_metadata read hostname 'smithi007' 2024-09-19T08:51:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.150+0000 7f4e04b23740 1 --2- 172.21.15.7:0/1868909737 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x557dfec2ceb0 0x557dfec2f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.150+0000 7f4e04b23740 4 client.16686 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:51:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.150+0000 7f4e04b23740 1 -- 172.21.15.7:0/1868909737 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557dfeb807f0 con 0x557dfec2ceb0 2024-09-19T08:51:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.151+0000 7f4dfbfff640 1 --2- 172.21.15.7:0/1868909737 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x557dfec2ceb0 0x557dfec2f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.151+0000 7f4dfbfff640 1 --2- 172.21.15.7:0/1868909737 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x557dfec2ceb0 0x557dfec2f350 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a408fa2002c893 server_cookie=2bc7317395e31617 in_seq=0 out_seq=0 2024-09-19T08:51:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.151+0000 7f4ddb7fe640 10 client.16686 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:51:21.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.152+0000 7f4ddb7fe640 1 -- 172.21.15.7:0/1868909737 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557dfeb807f0 con 0x557dfec2ceb0 2024-09-19T08:51:21.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.152+0000 7f4ddb7fe640 10 client.16686 handle_command_reply: tid=0 2024-09-19T08:51:21.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.152+0000 7f4e04b23740 1 client.16686 shutdown 2024-09-19T08:51:21.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.152+0000 7f4e04b23740 1 -- 172.21.15.7:0/1868909737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec1d150 msgr2=0x557dfec1ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:21.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.152+0000 7f4e04b23740 1 --2- 172.21.15.7:0/1868909737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec1d150 0x557dfec1ab00 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f4df40049d0 tx=0x7f4df4004ab0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.152+0000 7f4e04b23740 1 -- 172.21.15.7:0/1868909737 shutdown_connections 2024-09-19T08:51:21.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.152+0000 7f4e04b23740 1 --2- 172.21.15.7:0/1868909737 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x557dfec2ceb0 0x557dfec2f350 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.152+0000 7f4e04b23740 1 --2- 172.21.15.7:0/1868909737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec1d150 0x557dfec1ab00 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.152+0000 7f4e04b23740 1 --2- 172.21.15.7:0/1868909737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557dfec0e340 0x557dfec1a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.152+0000 7f4e04b23740 1 --2- 172.21.15.7:0/1868909737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dfec0da20 0x557dfec1a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.152+0000 7f4e04b23740 1 -- 172.21.15.7:0/1868909737 >> 172.21.15.7:0/1868909737 conn(0x557dfec0a0f0 msgr2=0x557dfec0fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:21.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.152+0000 7f4ddb7fe640 0 client.16686 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:51:21.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.152+0000 7f4e04b23740 1 -- 172.21.15.7:0/1868909737 shutdown_connections 2024-09-19T08:51:21.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.152+0000 7f4e04b23740 1 -- 172.21.15.7:0/1868909737 wait complete. 2024-09-19T08:51:21.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.152+0000 7f4e04b23740 20 client.16686 trim_cache size 0 max 16384 2024-09-19T08:51:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.169+0000 7f4e04b23740 1 Processor -- start 2024-09-19T08:51:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.169+0000 7f4e04b23740 1 -- start start 2024-09-19T08:51:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.169+0000 7f4e04b23740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dfec0da20 0x557dfec1bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.169+0000 7f4e04b23740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec0e340 0x557dfec34c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.169+0000 7f4e04b23740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557dfec1d150 0x557dfec351b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.170+0000 7f4e04b23740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4dfc1adde0 con 0x557dfec0e340 2024-09-19T08:51:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.170+0000 7f4e04b23740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4dfc1ab6b0 con 0x557dfec1d150 2024-09-19T08:51:21.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.170+0000 7f4e04b23740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4dfc1a9520 con 0x557dfec0da20 2024-09-19T08:51:21.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.170+0000 7f4df3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec0e340 0x557dfec34c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:21.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.170+0000 7f4df3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec0e340 0x557dfec34c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59520/0 (socket says 172.21.15.7:59520) 2024-09-19T08:51:21.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.170+0000 7f4df3fff640 1 -- 172.21.15.7:0/73902443 learned_addr learned my addr 172.21.15.7:0/73902443 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:21.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.170+0000 7f4e00ce7640 1 --2- 172.21.15.7:0/73902443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557dfec1d150 0x557dfec351b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:21.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.170+0000 7f4dfbfff640 1 --2- 172.21.15.7:0/73902443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dfec0da20 0x557dfec1bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:21.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.170+0000 7f4df3fff640 1 -- 172.21.15.7:0/73902443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dfec0da20 msgr2=0x557dfec1bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:21.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.170+0000 7f4df3fff640 1 --2- 172.21.15.7:0/73902443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dfec0da20 0x557dfec1bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.170+0000 7f4df3fff640 1 -- 172.21.15.7:0/73902443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557dfec1d150 msgr2=0x557dfec351b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:21.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.170+0000 7f4df3fff640 1 --2- 172.21.15.7:0/73902443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557dfec1d150 0x557dfec351b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.170+0000 7f4df3fff640 1 -- 172.21.15.7:0/73902443 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dfec19030 con 0x557dfec0e340 2024-09-19T08:51:21.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.170+0000 7f4df3fff640 1 --2- 172.21.15.7:0/73902443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec0e340 0x557dfec34c70 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f4de40096c0 tx=0x7f4de40056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351a9422f37d74e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:21.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.170+0000 7f4df1ffb640 1 -- 172.21.15.7:0/73902443 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de4035040 con 0x557dfec0e340 2024-09-19T08:51:21.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.170+0000 7f4df1ffb640 1 -- 172.21.15.7:0/73902443 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4de4004230 con 0x557dfec0e340 2024-09-19T08:51:21.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.170+0000 7f4df1ffb640 1 -- 172.21.15.7:0/73902443 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de403f040 con 0x557dfec0e340 2024-09-19T08:51:21.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.171+0000 7f4e04b23740 1 -- 172.21.15.7:0/73902443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec0e340 msgr2=0x557dfec34c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:21.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.171+0000 7f4e04b23740 1 --2- 172.21.15.7:0/73902443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec0e340 0x557dfec34c70 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f4de40096c0 tx=0x7f4de40056e0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.171+0000 7f4e04b23740 1 -- 172.21.15.7:0/73902443 shutdown_connections 2024-09-19T08:51:21.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.171+0000 7f4e04b23740 1 --2- 172.21.15.7:0/73902443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557dfec1d150 0x557dfec351b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.171+0000 7f4e04b23740 1 --2- 172.21.15.7:0/73902443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec0e340 0x557dfec34c70 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.171+0000 7f4e04b23740 1 --2- 172.21.15.7:0/73902443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dfec0da20 0x557dfec1bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.171+0000 7f4e04b23740 1 -- 172.21.15.7:0/73902443 >> 172.21.15.7:0/73902443 conn(0x557dfec0a0f0 msgr2=0x557dfec1b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:21.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.171+0000 7f4e04b23740 1 -- 172.21.15.7:0/73902443 shutdown_connections 2024-09-19T08:51:21.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.171+0000 7f4e04b23740 1 -- 172.21.15.7:0/73902443 wait complete. 2024-09-19T08:51:21.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.171+0000 7f4e04b23740 1 -- start start 2024-09-19T08:51:21.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.172+0000 7f4e04b23740 1 Processor -- start 2024-09-19T08:51:21.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.172+0000 7f4e04b23740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dfec0da20 0x557dfec21510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:21.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.172+0000 7f4e04b23740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557dfec0e340 0x557dfec21a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:21.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.172+0000 7f4e04b23740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec1d150 0x557dfec96c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:21.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.172+0000 7f4e04b23740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4dfc1a9b70 con 0x557dfec1d150 2024-09-19T08:51:21.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.172+0000 7f4e04b23740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4dfc1aafe0 con 0x557dfec0e340 2024-09-19T08:51:21.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.172+0000 7f4e04b23740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4dfc1aa240 con 0x557dfec0da20 2024-09-19T08:51:21.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.172+0000 7f4e04b23740 10 client.0 _ll_register_callbacks cb 0x7f4df4003ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:21.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.172+0000 7f4e00ce7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec1d150 0x557dfec96c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:21.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.172+0000 7f4e00ce7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec1d150 0x557dfec96c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59524/0 (socket says 172.21.15.7:59524) 2024-09-19T08:51:21.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.172+0000 7f4e00ce7640 1 -- 172.21.15.7:0/1547011038 learned_addr learned my addr 172.21.15.7:0/1547011038 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:21.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.172+0000 7f4dfbfff640 1 --2- 172.21.15.7:0/1547011038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dfec0da20 0x557dfec21510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:21.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.172+0000 7f4df3fff640 1 --2- 172.21.15.7:0/1547011038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557dfec0e340 0x557dfec21a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:21.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.172+0000 7f4e00ce7640 1 -- 172.21.15.7:0/1547011038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dfec0da20 msgr2=0x557dfec21510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:21.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.172+0000 7f4e00ce7640 1 --2- 172.21.15.7:0/1547011038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dfec0da20 0x557dfec21510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.172+0000 7f4e00ce7640 1 -- 172.21.15.7:0/1547011038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557dfec0e340 msgr2=0x557dfec21a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:21.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.172+0000 7f4e00ce7640 1 --2- 172.21.15.7:0/1547011038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557dfec0e340 0x557dfec21a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.173+0000 7f4e00ce7640 1 -- 172.21.15.7:0/1547011038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dfec97180 con 0x557dfec1d150 2024-09-19T08:51:21.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.173+0000 7f4e00ce7640 1 --2- 172.21.15.7:0/1547011038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec1d150 0x557dfec96c40 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f4df4004410 tx=0x7f4df4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33dd9bb2e4bc533e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:21.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.173+0000 7f4ddb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:51:21.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.173+0000 7f4ddb7fe640 1 -- 172.21.15.7:0/1547011038 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df4010bb0 con 0x557dfec1d150 2024-09-19T08:51:21.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.173+0000 7f4ddb7fe640 1 -- 172.21.15.7:0/1547011038 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f4df4010d50 con 0x557dfec1d150 2024-09-19T08:51:21.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.173+0000 7f4e04b23740 1 -- 172.21.15.7:0/1547011038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4de4004230 con 0x557dfec1d150 2024-09-19T08:51:21.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.173+0000 7f4ddb7fe640 1 -- 172.21.15.7:0/1547011038 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4df400e3e0 con 0x557dfec1d150 2024-09-19T08:51:21.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.173+0000 7f4e04b23740 10 client.16692 fetch_fsmap learned FSMap version 25 2024-09-19T08:51:21.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.173+0000 7f4e04b23740 1 -- 172.21.15.7:0/1547011038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557dfec98460 con 0x557dfec1d150 2024-09-19T08:51:21.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.173+0000 7f4ddb7fe640 1 -- 172.21.15.7:0/1547011038 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4de4004230 con 0x557dfec1d150 2024-09-19T08:51:21.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.173+0000 7f4ddb7fe640 1 -- 172.21.15.7:0/1547011038 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4df4031b40 con 0x557dfec1d150 2024-09-19T08:51:21.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.173+0000 7f4e04b23740 10 client.16692 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:51:21.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.173+0000 7f4e04b23740 10 client.16692 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:51:21.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.173+0000 7f4e04b23740 20 client.16692 populate_metadata read hostname 'smithi007' 2024-09-19T08:51:21.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.174+0000 7f4e04b23740 1 --2- 172.21.15.7:0/1547011038 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x557dfec98bb0 0x557dfec9aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:21.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.174+0000 7f4e04b23740 4 client.16692 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:51:21.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.174+0000 7f4e04b23740 1 -- 172.21.15.7:0/1547011038 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557dfeb7ad00 con 0x557dfec98bb0 2024-09-19T08:51:21.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.174+0000 7f4dfbfff640 1 --2- 172.21.15.7:0/1547011038 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x557dfec98bb0 0x557dfec9aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:21.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.174+0000 7f4dfbfff640 1 --2- 172.21.15.7:0/1547011038 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x557dfec98bb0 0x557dfec9aff0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bcf3f70f7607e06 server_cookie=21d6163f55455137 in_seq=0 out_seq=0 2024-09-19T08:51:21.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.174+0000 7f4ddb7fe640 10 client.16692 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:51:21.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.175+0000 7f4ddb7fe640 1 -- 172.21.15.7:0/1547011038 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557dfeb7ad00 con 0x557dfec98bb0 2024-09-19T08:51:21.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.175+0000 7f4ddb7fe640 10 client.16692 handle_command_reply: tid=0 2024-09-19T08:51:21.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.175+0000 7f4e04b23740 1 client.16692 shutdown 2024-09-19T08:51:21.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.175+0000 7f4e04b23740 1 -- 172.21.15.7:0/1547011038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec1d150 msgr2=0x557dfec96c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:21.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.175+0000 7f4e04b23740 1 --2- 172.21.15.7:0/1547011038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec1d150 0x557dfec96c40 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f4df4004410 tx=0x7f4df4014000 comp rx=0 tx=0).stop 2024-09-19T08:51:21.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.175+0000 7f4e04b23740 1 -- 172.21.15.7:0/1547011038 shutdown_connections 2024-09-19T08:51:21.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.175+0000 7f4e04b23740 1 --2- 172.21.15.7:0/1547011038 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x557dfec98bb0 0x557dfec9aff0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.176+0000 7f4e04b23740 1 --2- 172.21.15.7:0/1547011038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557dfec1d150 0x557dfec96c40 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.176+0000 7f4ddb7fe640 0 client.16692 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:51:21.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.176+0000 7f4e04b23740 1 --2- 172.21.15.7:0/1547011038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557dfec0e340 0x557dfec21a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.176+0000 7f4e04b23740 1 --2- 172.21.15.7:0/1547011038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557dfec0da20 0x557dfec21510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.176+0000 7f4e04b23740 1 -- 172.21.15.7:0/1547011038 >> 172.21.15.7:0/1547011038 conn(0x557dfec0a0f0 msgr2=0x557dfec09270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:21.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.176+0000 7f4e04b23740 1 -- 172.21.15.7:0/1547011038 shutdown_connections 2024-09-19T08:51:21.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.176+0000 7f4e04b23740 1 -- 172.21.15.7:0/1547011038 wait complete. 2024-09-19T08:51:21.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.176+0000 7f4e04b23740 20 client.16692 trim_cache size 0 max 16384 2024-09-19T08:51:21.182 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:51:21.182 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-19T08:51:21.182 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "09d917bb-38c0-43b5-a683-882db1cbd2c4", 2024-09-19T08:51:21.182 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-19T08:51:21.182 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:51:21.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.176+0000 7f4e0274a640 1 -- 172.21.15.7:0/2141763179 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4de80a3430 msgr2=0x7f4de80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:21.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.176+0000 7f4e0274a640 1 --2- 172.21.15.7:0/2141763179 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4de80a3430 0x7f4de80a58f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4df4007f30 tx=0x7f4df4004a40 comp rx=0 tx=0).stop 2024-09-19T08:51:21.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.176+0000 7f4e0274a640 1 -- 172.21.15.7:0/2141763179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dfc101de0 msgr2=0x7f4dfc198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:21.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.176+0000 7f4e0274a640 1 --2- 172.21.15.7:0/2141763179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dfc101de0 0x7f4dfc198310 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00c920 tx=0x7f4dec00cde0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.176+0000 7f4e0274a640 1 -- 172.21.15.7:0/2141763179 shutdown_connections 2024-09-19T08:51:21.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.176+0000 7f4e0274a640 1 --2- 172.21.15.7:0/2141763179 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4de80a3430 0x7f4de80a58f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.176+0000 7f4e0274a640 1 --2- 172.21.15.7:0/2141763179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dfc106f10 0x7f4dfc19cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.176+0000 7f4e0274a640 1 --2- 172.21.15.7:0/2141763179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dfc102790 0x7f4dfc198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.176+0000 7f4e0274a640 1 --2- 172.21.15.7:0/2141763179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dfc101de0 0x7f4dfc198310 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.176+0000 7f4e0274a640 1 -- 172.21.15.7:0/2141763179 >> 172.21.15.7:0/2141763179 conn(0x7f4dfc0fd8c0 msgr2=0x7f4dfc0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:21.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.177+0000 7f4e0274a640 1 -- 172.21.15.7:0/2141763179 shutdown_connections 2024-09-19T08:51:21.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:21.177+0000 7f4e0274a640 1 -- 172.21.15.7:0/2141763179 wait complete. 2024-09-19T08:51:21.971 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:51:22.228 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:22.630 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:22 smithi007 ceph-mon[31221]: scrub queued for path: / 2024-09-19T08:51:22.630 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:22 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:51:22.630 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:22 smithi007 ceph-mon[31221]: scrub summary: active paths [/] 2024-09-19T08:51:22.630 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:22 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:51:22.630 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:22 smithi007 ceph-mon[31221]: pgmap v210: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:51:22.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:22 smithi175 ceph-mon[35688]: scrub queued for path: / 2024-09-19T08:51:22.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:22 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:51:22.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:22 smithi175 ceph-mon[35688]: scrub summary: active paths [/] 2024-09-19T08:51:22.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:22 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:51:22.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:22 smithi175 ceph-mon[35688]: pgmap v210: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:51:22.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.713+0000 7f6dbdbc7640 1 -- 172.21.15.7:0/3880011705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db8101de0 msgr2=0x7f6db81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:22.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.713+0000 7f6dbdbc7640 1 --2- 172.21.15.7:0/3880011705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db8101de0 0x7f6db81021c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6da8009900 tx=0x7f6da802a410 comp rx=0 tx=0).stop 2024-09-19T08:51:22.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.713+0000 7f6dbdbc7640 1 -- 172.21.15.7:0/3880011705 shutdown_connections 2024-09-19T08:51:22.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.713+0000 7f6dbdbc7640 1 --2- 172.21.15.7:0/3880011705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6db8106f10 0x7f6db810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.713+0000 7f6dbdbc7640 1 --2- 172.21.15.7:0/3880011705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6db8102790 0x7f6db81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.713+0000 7f6dbdbc7640 1 --2- 172.21.15.7:0/3880011705 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db8101de0 0x7f6db81021c0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.713+0000 7f6dbdbc7640 1 -- 172.21.15.7:0/3880011705 >> 172.21.15.7:0/3880011705 conn(0x7f6db80fd8c0 msgr2=0x7f6db80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.713+0000 7f6dbdbc7640 1 -- 172.21.15.7:0/3880011705 shutdown_connections 2024-09-19T08:51:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.713+0000 7f6dbdbc7640 1 -- 172.21.15.7:0/3880011705 wait complete. 2024-09-19T08:51:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.713+0000 7f6dbdbc7640 1 Processor -- start 2024-09-19T08:51:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.714+0000 7f6dbdbc7640 1 -- start start 2024-09-19T08:51:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.714+0000 7f6dbdbc7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6db8101de0 0x7f6db80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.714+0000 7f6dbdbc7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6db8102790 0x7f6db8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.714+0000 7f6dbdbc7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db8106f10 0x7f6db8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.714+0000 7f6dbdbc7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6db8111f70 con 0x7f6db8106f10 2024-09-19T08:51:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.714+0000 7f6dbdbc7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6db8111df0 con 0x7f6db8101de0 2024-09-19T08:51:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.714+0000 7f6dbdbc7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81120f0 con 0x7f6db8102790 2024-09-19T08:51:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.714+0000 7f6db7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db8106f10 0x7f6db8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.714+0000 7f6db7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db8106f10 0x7f6db8074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59542/0 (socket says 172.21.15.7:59542) 2024-09-19T08:51:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.714+0000 7f6db7fff640 1 -- 172.21.15.7:0/3879479974 learned_addr learned my addr 172.21.15.7:0/3879479974 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.714+0000 7f6db77fe640 1 --2- 172.21.15.7:0/3879479974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6db8101de0 0x7f6db80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.714+0000 7f6db6ffd640 1 --2- 172.21.15.7:0/3879479974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6db8102790 0x7f6db8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.715+0000 7f6db7fff640 1 -- 172.21.15.7:0/3879479974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6db8102790 msgr2=0x7f6db8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.715+0000 7f6db7fff640 1 --2- 172.21.15.7:0/3879479974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6db8102790 0x7f6db8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.715+0000 7f6db7fff640 1 -- 172.21.15.7:0/3879479974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6db8101de0 msgr2=0x7f6db80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.715+0000 7f6db7fff640 1 --2- 172.21.15.7:0/3879479974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6db8101de0 0x7f6db80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.715+0000 7f6db7fff640 1 -- 172.21.15.7:0/3879479974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db81a68f0 con 0x7f6db8106f10 2024-09-19T08:51:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.715+0000 7f6db77fe640 1 --2- 172.21.15.7:0/3879479974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6db8101de0 0x7f6db80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.715+0000 7f6db7fff640 1 --2- 172.21.15.7:0/3879479974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db8106f10 0x7f6db8074f70 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f6db000cad0 tx=0x7f6db000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.715+0000 7f6db4ff9640 1 -- 172.21.15.7:0/3879479974 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db000ae20 con 0x7f6db8106f10 2024-09-19T08:51:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.715+0000 7f6dbdbc7640 1 -- 172.21.15.7:0/3879479974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6db81a6be0 con 0x7f6db8106f10 2024-09-19T08:51:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.715+0000 7f6db4ff9640 1 -- 172.21.15.7:0/3879479974 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6db0005020 con 0x7f6db8106f10 2024-09-19T08:51:22.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.715+0000 7f6db4ff9640 1 -- 172.21.15.7:0/3879479974 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db000f6b0 con 0x7f6db8106f10 2024-09-19T08:51:22.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.715+0000 7f6dbdbc7640 1 -- 172.21.15.7:0/3879479974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6db81a7120 con 0x7f6db8106f10 2024-09-19T08:51:22.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.717+0000 7f6db4ff9640 1 -- 172.21.15.7:0/3879479974 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f6db00051d0 con 0x7f6db8106f10 2024-09-19T08:51:22.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.718+0000 7f6dbffa0740 1 Processor -- start 2024-09-19T08:51:22.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.718+0000 7f6dbffa0740 1 -- start start 2024-09-19T08:51:22.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.718+0000 7f6dbffa0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a78e544a0 0x562a78e54880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:22.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.718+0000 7f6dbffa0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a78e54dc0 0x562a78e5f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:22.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.718+0000 7f6dbffa0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e5f680 0x562a78e61a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:22.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.718+0000 7f6dbffa0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562a78dba2e0 con 0x562a78e5f680 2024-09-19T08:51:22.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.718+0000 7f6dbffa0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562a78d61ce0 con 0x562a78e54dc0 2024-09-19T08:51:22.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.718+0000 7f6dbffa0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562a78db62a0 con 0x562a78e544a0 2024-09-19T08:51:22.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.718+0000 7f6db4ff9640 1 --2- 172.21.15.7:0/3879479974 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6da00a33b0 0x7f6da00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:22.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.718+0000 7f6db77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a78e54dc0 0x562a78e5f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:22.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.718+0000 7f6db7fff640 1 --2- 172.21.15.7:0/3879479974 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6da00a33b0 0x7f6da00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:22.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.718+0000 7f6db77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a78e54dc0 0x562a78e5f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:52440/0 (socket says 172.21.15.7:52440) 2024-09-19T08:51:22.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.718+0000 7f6db77fe640 1 -- 172.21.15.7:0/2494880553 learned_addr learned my addr 172.21.15.7:0/2494880553 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:22.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.718+0000 7f6db6ffd640 1 --2- 172.21.15.7:0/2494880553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e5f680 0x562a78e61a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:22.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.718+0000 7f6db4ff9640 1 -- 172.21.15.7:0/3879479974 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f6db00d0040 con 0x7f6db8106f10 2024-09-19T08:51:22.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.718+0000 7f6db6ffd640 1 --2- 172.21.15.7:0/2494880553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a78e544a0 0x562a78e54880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:22.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.718+0000 7f6db77fe640 1 -- 172.21.15.7:0/2494880553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a78e544a0 msgr2=0x562a78e54880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:22.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.718+0000 7f6db77fe640 1 --2- 172.21.15.7:0/2494880553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a78e544a0 0x562a78e54880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.718+0000 7f6db77fe640 1 -- 172.21.15.7:0/2494880553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e5f680 msgr2=0x562a78e61a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:22.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.718+0000 7f6db77fe640 1 --2- 172.21.15.7:0/2494880553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e5f680 0x562a78e61a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.718+0000 7f6db77fe640 1 -- 172.21.15.7:0/2494880553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a78d46440 con 0x562a78e54dc0 2024-09-19T08:51:22.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.719+0000 7f6db7fff640 1 --2- 172.21.15.7:0/3879479974 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6da00a33b0 0x7f6da00a5870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6db0098740 tx=0x7f6db006e060 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:22.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.719+0000 7f6db77fe640 1 --2- 172.21.15.7:0/2494880553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a78e54dc0 0x562a78e5f140 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6da802a930 tx=0x7f6da80315b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5f2c1241104ac5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:22.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.719+0000 7f6d9dffb640 1 -- 172.21.15.7:0/2494880553 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da8035040 con 0x562a78e54dc0 2024-09-19T08:51:22.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.719+0000 7f6d9dffb640 1 -- 172.21.15.7:0/2494880553 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6da8005020 con 0x562a78e54dc0 2024-09-19T08:51:22.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.719+0000 7f6d9dffb640 1 -- 172.21.15.7:0/2494880553 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da8004a00 con 0x562a78e54dc0 2024-09-19T08:51:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.720+0000 7f6dbffa0740 1 -- 172.21.15.7:0/2494880553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a78e54dc0 msgr2=0x562a78e5f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.720+0000 7f6dbffa0740 1 --2- 172.21.15.7:0/2494880553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a78e54dc0 0x562a78e5f140 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6da802a930 tx=0x7f6da80315b0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.720+0000 7f6dbffa0740 1 -- 172.21.15.7:0/2494880553 shutdown_connections 2024-09-19T08:51:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.720+0000 7f6dbffa0740 1 --2- 172.21.15.7:0/2494880553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e5f680 0x562a78e61a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.720+0000 7f6dbffa0740 1 --2- 172.21.15.7:0/2494880553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a78e54dc0 0x562a78e5f140 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.720+0000 7f6dbffa0740 1 --2- 172.21.15.7:0/2494880553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a78e544a0 0x562a78e54880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.720+0000 7f6dbffa0740 1 -- 172.21.15.7:0/2494880553 >> 172.21.15.7:0/2494880553 conn(0x562a78e50a30 msgr2=0x562a78e50e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.720+0000 7f6dbffa0740 1 -- 172.21.15.7:0/2494880553 shutdown_connections 2024-09-19T08:51:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.720+0000 7f6dbffa0740 1 -- 172.21.15.7:0/2494880553 wait complete. 2024-09-19T08:51:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.720+0000 7f6dbffa0740 1 -- start start 2024-09-19T08:51:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.720+0000 7f6dbffa0740 1 Processor -- start 2024-09-19T08:51:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.720+0000 7f6dbffa0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a78e544a0 0x562a78e5ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.721+0000 7f6dbffa0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e54dc0 0x562a78e5c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:22.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.721+0000 7f6dbffa0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a78e5f680 0x562a78e5c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.721+0000 7f6dbffa0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562a78e62250 con 0x562a78e54dc0 2024-09-19T08:51:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.721+0000 7f6dbffa0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562a78d75050 con 0x562a78e544a0 2024-09-19T08:51:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.721+0000 7f6dbffa0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562a78e623d0 con 0x562a78e5f680 2024-09-19T08:51:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.721+0000 7f6dbffa0740 10 client.0 _ll_register_callbacks cb 0x562a78db5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.721+0000 7f6db77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e54dc0 0x562a78e5c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.721+0000 7f6db77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e54dc0 0x562a78e5c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59552/0 (socket says 172.21.15.7:59552) 2024-09-19T08:51:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.721+0000 7f6db77fe640 1 -- 172.21.15.7:0/1500128160 learned_addr learned my addr 172.21.15.7:0/1500128160 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.721+0000 7f6db6ffd640 1 --2- 172.21.15.7:0/1500128160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a78e544a0 0x562a78e5ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.721+0000 7f6db6ffd640 1 --2- 172.21.15.7:0/1500128160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a78e5f680 0x562a78e5c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.721+0000 7f6db77fe640 1 -- 172.21.15.7:0/1500128160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a78e5f680 msgr2=0x562a78e5c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.721+0000 7f6db77fe640 1 --2- 172.21.15.7:0/1500128160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a78e5f680 0x562a78e5c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.721+0000 7f6db77fe640 1 -- 172.21.15.7:0/1500128160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a78e544a0 msgr2=0x562a78e5ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.721+0000 7f6db77fe640 1 --2- 172.21.15.7:0/1500128160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a78e544a0 0x562a78e5ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.721+0000 7f6db77fe640 1 -- 172.21.15.7:0/1500128160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a78b2b3c0 con 0x562a78e54dc0 2024-09-19T08:51:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.721+0000 7f6db77fe640 1 --2- 172.21.15.7:0/1500128160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e54dc0 0x562a78e5c1c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6da8009900 tx=0x7f6da8031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0910670403b36eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.721+0000 7f6d96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:51:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.721+0000 7f6d96ffd640 1 -- 172.21.15.7:0/1500128160 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da8054060 con 0x562a78e54dc0 2024-09-19T08:51:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.721+0000 7f6d96ffd640 1 -- 172.21.15.7:0/1500128160 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f6da80053e0 con 0x562a78e54dc0 2024-09-19T08:51:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.721+0000 7f6dbffa0740 1 -- 172.21.15.7:0/1500128160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6da8005020 con 0x562a78e54dc0 2024-09-19T08:51:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.722+0000 7f6d96ffd640 1 -- 172.21.15.7:0/1500128160 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6da8035070 con 0x562a78e54dc0 2024-09-19T08:51:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.722+0000 7f6dbffa0740 10 client.16704 fetch_fsmap learned FSMap version 25 2024-09-19T08:51:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.722+0000 7f6dbffa0740 1 -- 172.21.15.7:0/1500128160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562a78e6db90 con 0x562a78e54dc0 2024-09-19T08:51:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.722+0000 7f6d96ffd640 1 -- 172.21.15.7:0/1500128160 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6da8005020 con 0x562a78e54dc0 2024-09-19T08:51:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.722+0000 7f6d96ffd640 1 -- 172.21.15.7:0/1500128160 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6da8046750 con 0x562a78e54dc0 2024-09-19T08:51:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.722+0000 7f6dbffa0740 10 client.16704 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:51:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.722+0000 7f6dbffa0740 10 client.16704 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:51:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.722+0000 7f6dbffa0740 20 client.16704 populate_metadata read hostname 'smithi007' 2024-09-19T08:51:22.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.722+0000 7f6dbffa0740 1 --2- 172.21.15.7:0/1500128160 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562a78e6eee0 0x562a78e712d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:22.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.722+0000 7f6dbffa0740 4 client.16704 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:51:22.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.722+0000 7f6dbffa0740 1 -- 172.21.15.7:0/1500128160 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a78dc7850 con 0x562a78e6eee0 2024-09-19T08:51:22.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.722+0000 7f6db6ffd640 1 --2- 172.21.15.7:0/1500128160 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562a78e6eee0 0x562a78e712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:22.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.723+0000 7f6db6ffd640 1 --2- 172.21.15.7:0/1500128160 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562a78e6eee0 0x562a78e712d0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34934c49929e62f9 server_cookie=8ce5ecc462a15a5f in_seq=0 out_seq=0 2024-09-19T08:51:22.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.723+0000 7f6d96ffd640 10 client.16704 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:51:22.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.723+0000 7f6d96ffd640 1 -- 172.21.15.7:0/1500128160 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562a78dc7850 con 0x562a78e6eee0 2024-09-19T08:51:22.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.723+0000 7f6d96ffd640 10 client.16704 handle_command_reply: tid=0 2024-09-19T08:51:22.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.724+0000 7f6dbffa0740 1 client.16704 shutdown 2024-09-19T08:51:22.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.724+0000 7f6dbffa0740 1 -- 172.21.15.7:0/1500128160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e54dc0 msgr2=0x562a78e5c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:22.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.724+0000 7f6dbffa0740 1 --2- 172.21.15.7:0/1500128160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e54dc0 0x562a78e5c1c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6da8009900 tx=0x7f6da8031a90 comp rx=0 tx=0).stop 2024-09-19T08:51:22.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.724+0000 7f6dbffa0740 1 -- 172.21.15.7:0/1500128160 shutdown_connections 2024-09-19T08:51:22.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.724+0000 7f6dbffa0740 1 --2- 172.21.15.7:0/1500128160 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562a78e6eee0 0x562a78e712d0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.724+0000 7f6dbffa0740 1 --2- 172.21.15.7:0/1500128160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a78e5f680 0x562a78e5c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.724+0000 7f6dbffa0740 1 --2- 172.21.15.7:0/1500128160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e54dc0 0x562a78e5c1c0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.724+0000 7f6dbffa0740 1 --2- 172.21.15.7:0/1500128160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a78e544a0 0x562a78e5ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.724+0000 7f6dbffa0740 1 -- 172.21.15.7:0/1500128160 >> 172.21.15.7:0/1500128160 conn(0x562a78e50a30 msgr2=0x562a78e56710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:22.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.724+0000 7f6d96ffd640 0 client.16704 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:51:22.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.724+0000 7f6dbffa0740 1 -- 172.21.15.7:0/1500128160 shutdown_connections 2024-09-19T08:51:22.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.724+0000 7f6dbffa0740 1 -- 172.21.15.7:0/1500128160 wait complete. 2024-09-19T08:51:22.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.724+0000 7f6dbffa0740 20 client.16704 trim_cache size 0 max 16384 2024-09-19T08:51:22.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.741+0000 7f6dbffa0740 1 Processor -- start 2024-09-19T08:51:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.741+0000 7f6dbffa0740 1 -- start start 2024-09-19T08:51:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.741+0000 7f6dbffa0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a78e544a0 0x562a78e59420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.742+0000 7f6dbffa0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a78e54dc0 0x562a78e59960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.742+0000 7f6dbffa0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e5f680 0x562a78e4f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.742+0000 7f6dbffa0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81b2470 con 0x562a78e5f680 2024-09-19T08:51:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.742+0000 7f6dbffa0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81afd40 con 0x562a78e544a0 2024-09-19T08:51:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.742+0000 7f6dbffa0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81adbb0 con 0x562a78e54dc0 2024-09-19T08:51:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.742+0000 7f6db6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e5f680 0x562a78e4f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.742+0000 7f6db6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e5f680 0x562a78e4f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59564/0 (socket says 172.21.15.7:59564) 2024-09-19T08:51:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.742+0000 7f6db6ffd640 1 -- 172.21.15.7:0/1077749252 learned_addr learned my addr 172.21.15.7:0/1077749252 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.742+0000 7f6db6ffd640 1 --2- 172.21.15.7:0/1077749252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a78e544a0 0x562a78e59420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.742+0000 7f6db77fe640 1 --2- 172.21.15.7:0/1077749252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a78e54dc0 0x562a78e59960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:22.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.742+0000 7f6db77fe640 1 -- 172.21.15.7:0/1077749252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a78e544a0 msgr2=0x562a78e59420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:22.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.742+0000 7f6db77fe640 1 --2- 172.21.15.7:0/1077749252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a78e544a0 0x562a78e59420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.742+0000 7f6db77fe640 1 -- 172.21.15.7:0/1077749252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e5f680 msgr2=0x562a78e4f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:22.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.742+0000 7f6db77fe640 1 --2- 172.21.15.7:0/1077749252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e5f680 0x562a78e4f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.742+0000 7f6db77fe640 1 -- 172.21.15.7:0/1077749252 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a78e5cf80 con 0x562a78e54dc0 2024-09-19T08:51:22.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.742+0000 7f6db6ffd640 1 --2- 172.21.15.7:0/1077749252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e5f680 0x562a78e4f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:22.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.743+0000 7f6db77fe640 1 --2- 172.21.15.7:0/1077749252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a78e54dc0 0x562a78e59960 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6da8031550 tx=0x7f6da80055f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7c7125eddf56ab2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:22.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.743+0000 7f6d9d7fa640 1 -- 172.21.15.7:0/1077749252 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da8054040 con 0x562a78e54dc0 2024-09-19T08:51:22.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.743+0000 7f6d9d7fa640 1 -- 172.21.15.7:0/1077749252 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6da8005850 con 0x562a78e54dc0 2024-09-19T08:51:22.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.743+0000 7f6d9d7fa640 1 -- 172.21.15.7:0/1077749252 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da80466b0 con 0x562a78e54dc0 2024-09-19T08:51:22.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.744+0000 7f6dbffa0740 1 -- 172.21.15.7:0/1077749252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a78e54dc0 msgr2=0x562a78e59960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:22.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.744+0000 7f6dbffa0740 1 --2- 172.21.15.7:0/1077749252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a78e54dc0 0x562a78e59960 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6da8031550 tx=0x7f6da80055f0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.744+0000 7f6dbffa0740 1 -- 172.21.15.7:0/1077749252 shutdown_connections 2024-09-19T08:51:22.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.744+0000 7f6dbffa0740 1 --2- 172.21.15.7:0/1077749252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e5f680 0x562a78e4f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.744+0000 7f6dbffa0740 1 --2- 172.21.15.7:0/1077749252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a78e54dc0 0x562a78e59960 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.744+0000 7f6dbffa0740 1 --2- 172.21.15.7:0/1077749252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a78e544a0 0x562a78e59420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.744+0000 7f6dbffa0740 1 -- 172.21.15.7:0/1077749252 >> 172.21.15.7:0/1077749252 conn(0x562a78e50a30 msgr2=0x562a78e5b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:22.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.744+0000 7f6dbffa0740 1 -- 172.21.15.7:0/1077749252 shutdown_connections 2024-09-19T08:51:22.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.744+0000 7f6dbffa0740 1 -- 172.21.15.7:0/1077749252 wait complete. 2024-09-19T08:51:22.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.744+0000 7f6dbffa0740 1 -- start start 2024-09-19T08:51:22.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.744+0000 7f6dbffa0740 1 Processor -- start 2024-09-19T08:51:22.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.745+0000 7f6dbffa0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e544a0 0x562a78ed0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:22.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.745+0000 7f6dbffa0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a78e54dc0 0x562a78ed12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:22.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.745+0000 7f6dbffa0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a78e5f680 0x562a78e73850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:22.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.745+0000 7f6dbffa0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81ae200 con 0x562a78e544a0 2024-09-19T08:51:22.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.745+0000 7f6dbffa0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81af670 con 0x562a78e5f680 2024-09-19T08:51:22.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.745+0000 7f6dbffa0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81ae8d0 con 0x562a78e54dc0 2024-09-19T08:51:22.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.745+0000 7f6dbffa0740 10 client.0 _ll_register_callbacks cb 0x7f6da8040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:22.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.745+0000 7f6db6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e544a0 0x562a78ed0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:22.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.745+0000 7f6db6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e544a0 0x562a78ed0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59582/0 (socket says 172.21.15.7:59582) 2024-09-19T08:51:22.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.745+0000 7f6db6ffd640 1 -- 172.21.15.7:0/2756079280 learned_addr learned my addr 172.21.15.7:0/2756079280 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:22.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.745+0000 7f6db77fe640 1 --2- 172.21.15.7:0/2756079280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a78e54dc0 0x562a78ed12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:22.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.745+0000 7f6db6ffd640 1 --2- 172.21.15.7:0/2756079280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a78e5f680 0x562a78e73850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:22.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.745+0000 7f6db6ffd640 1 -- 172.21.15.7:0/2756079280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a78e54dc0 msgr2=0x562a78ed12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:22.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.745+0000 7f6db6ffd640 1 --2- 172.21.15.7:0/2756079280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a78e54dc0 0x562a78ed12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.745+0000 7f6db6ffd640 1 -- 172.21.15.7:0/2756079280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a78e5f680 msgr2=0x562a78e73850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:22.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.745+0000 7f6db6ffd640 1 --2- 172.21.15.7:0/2756079280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a78e5f680 0x562a78e73850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.745+0000 7f6db6ffd640 1 -- 172.21.15.7:0/2756079280 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a78e74060 con 0x562a78e544a0 2024-09-19T08:51:22.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.746+0000 7f6db6ffd640 1 --2- 172.21.15.7:0/2756079280 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e544a0 0x562a78ed0d90 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0238a0 tx=0x7f6dac005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d2336cb714bd63 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:22.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.746+0000 7f6d96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:51:22.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.746+0000 7f6d96ffd640 1 -- 172.21.15.7:0/2756079280 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac011db0 con 0x562a78e544a0 2024-09-19T08:51:22.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.746+0000 7f6d96ffd640 1 -- 172.21.15.7:0/2756079280 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f6dac02d460 con 0x562a78e544a0 2024-09-19T08:51:22.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.746+0000 7f6dbffa0740 1 -- 172.21.15.7:0/2756079280 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6da8005850 con 0x562a78e544a0 2024-09-19T08:51:22.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.746+0000 7f6d96ffd640 1 -- 172.21.15.7:0/2756079280 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6dac02d660 con 0x562a78e544a0 2024-09-19T08:51:22.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.746+0000 7f6dbffa0740 10 client.16710 fetch_fsmap learned FSMap version 25 2024-09-19T08:51:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.746+0000 7f6dbffa0740 1 -- 172.21.15.7:0/2756079280 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562a78ed9700 con 0x562a78e544a0 2024-09-19T08:51:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.746+0000 7f6d96ffd640 1 -- 172.21.15.7:0/2756079280 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6da8005850 con 0x562a78e544a0 2024-09-19T08:51:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.747+0000 7f6d96ffd640 1 -- 172.21.15.7:0/2756079280 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6dac00f970 con 0x562a78e544a0 2024-09-19T08:51:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.747+0000 7f6dbffa0740 10 client.16710 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:51:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.747+0000 7f6dbffa0740 10 client.16710 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:51:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.747+0000 7f6dbffa0740 20 client.16710 populate_metadata read hostname 'smithi007' 2024-09-19T08:51:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.747+0000 7f6dbffa0740 1 --2- 172.21.15.7:0/2756079280 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562a78ed9e60 0x562a78edc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.747+0000 7f6dbffa0740 4 client.16710 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:51:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.747+0000 7f6dbffa0740 1 -- 172.21.15.7:0/2756079280 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562a78dc1d60 con 0x562a78ed9e60 2024-09-19T08:51:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.747+0000 7f6db77fe640 1 --2- 172.21.15.7:0/2756079280 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562a78ed9e60 0x562a78edc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.747+0000 7f6d96ffd640 10 client.16710 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:51:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.747+0000 7f6db77fe640 1 --2- 172.21.15.7:0/2756079280 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562a78ed9e60 0x562a78edc280 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a477ba14ceed4cc server_cookie=a65e155a3c21f1db in_seq=0 out_seq=0 2024-09-19T08:51:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.748+0000 7f6d96ffd640 1 -- 172.21.15.7:0/2756079280 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562a78dc1d60 con 0x562a78ed9e60 2024-09-19T08:51:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.748+0000 7f6d96ffd640 10 client.16710 handle_command_reply: tid=0 2024-09-19T08:51:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.748+0000 7f6dbffa0740 1 client.16710 shutdown 2024-09-19T08:51:22.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.748+0000 7f6dbffa0740 1 -- 172.21.15.7:0/2756079280 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e544a0 msgr2=0x562a78ed0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:22.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.748+0000 7f6dbffa0740 1 --2- 172.21.15.7:0/2756079280 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e544a0 0x562a78ed0d90 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0238a0 tx=0x7f6dac005f90 comp rx=0 tx=0).stop 2024-09-19T08:51:22.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.748+0000 7f6dbffa0740 1 -- 172.21.15.7:0/2756079280 shutdown_connections 2024-09-19T08:51:22.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.748+0000 7f6dbffa0740 1 --2- 172.21.15.7:0/2756079280 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x562a78ed9e60 0x562a78edc280 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.748+0000 7f6dbffa0740 1 --2- 172.21.15.7:0/2756079280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a78e5f680 0x562a78e73850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.748+0000 7f6dbffa0740 1 --2- 172.21.15.7:0/2756079280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562a78e54dc0 0x562a78ed12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.748+0000 7f6dbffa0740 1 --2- 172.21.15.7:0/2756079280 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562a78e544a0 0x562a78ed0d90 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.748+0000 7f6dbffa0740 1 -- 172.21.15.7:0/2756079280 >> 172.21.15.7:0/2756079280 conn(0x562a78e50a30 msgr2=0x562a78e5da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:22.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.748+0000 7f6d96ffd640 0 client.16710 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:51:22.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.748+0000 7f6dbffa0740 1 -- 172.21.15.7:0/2756079280 shutdown_connections 2024-09-19T08:51:22.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.748+0000 7f6dbffa0740 1 -- 172.21.15.7:0/2756079280 wait complete. 2024-09-19T08:51:22.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.748+0000 7f6dbffa0740 20 client.16710 trim_cache size 0 max 16384 2024-09-19T08:51:22.753 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:51:22.753 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:51:22.753 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-19T08:51:22.753 INFO:teuthology.orchestra.run.smithi007.stdout: "09d917bb-38c0-43b5-a683-882db1cbd2c4": { 2024-09-19T08:51:22.753 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-19T08:51:22.753 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "09d917bb-38c0-43b5-a683-882db1cbd2c4", 2024-09-19T08:51:22.753 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-19T08:51:22.753 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:51:22.753 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:51:22.753 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:51:22.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.749+0000 7f6dbdbc7640 1 -- 172.21.15.7:0/3879479974 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6da00a33b0 msgr2=0x7f6da00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:22.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.749+0000 7f6dbdbc7640 1 --2- 172.21.15.7:0/3879479974 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6da00a33b0 0x7f6da00a5870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6db0098740 tx=0x7f6db006e060 comp rx=0 tx=0).stop 2024-09-19T08:51:22.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.749+0000 7f6dbdbc7640 1 -- 172.21.15.7:0/3879479974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db8106f10 msgr2=0x7f6db8074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:22.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.749+0000 7f6dbdbc7640 1 --2- 172.21.15.7:0/3879479974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db8106f10 0x7f6db8074f70 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f6db000cad0 tx=0x7f6db000cf90 comp rx=0 tx=0).stop 2024-09-19T08:51:22.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.749+0000 7f6dbdbc7640 1 -- 172.21.15.7:0/3879479974 shutdown_connections 2024-09-19T08:51:22.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.749+0000 7f6dbdbc7640 1 --2- 172.21.15.7:0/3879479974 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6da00a33b0 0x7f6da00a5870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.749+0000 7f6dbdbc7640 1 --2- 172.21.15.7:0/3879479974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db8106f10 0x7f6db8074f70 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.749+0000 7f6dbdbc7640 1 --2- 172.21.15.7:0/3879479974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6db8102790 0x7f6db8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.749+0000 7f6dbdbc7640 1 --2- 172.21.15.7:0/3879479974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6db8101de0 0x7f6db80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.749+0000 7f6dbdbc7640 1 -- 172.21.15.7:0/3879479974 >> 172.21.15.7:0/3879479974 conn(0x7f6db80fd8c0 msgr2=0x7f6db80fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:22.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.749+0000 7f6dbdbc7640 1 -- 172.21.15.7:0/3879479974 shutdown_connections 2024-09-19T08:51:22.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:22.749+0000 7f6dbdbc7640 1 -- 172.21.15.7:0/3879479974 wait complete. 2024-09-19T08:51:22.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:22 smithi044 ceph-mon[35072]: scrub queued for path: / 2024-09-19T08:51:22.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:22 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:51:22.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:22 smithi044 ceph-mon[35072]: scrub summary: active paths [/] 2024-09-19T08:51:22.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:22 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:51:22.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:22 smithi044 ceph-mon[35072]: pgmap v210: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:51:23.583 INFO:tasks.cephfs.filesystem:scrub status for tag:09d917bb-38c0-43b5-a683-882db1cbd2c4 - {'path': '/', 'tag': '09d917bb-38c0-43b5-a683-882db1cbd2c4', 'options': 'recursive,force'} 2024-09-19T08:51:24.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:24 smithi175 ceph-mon[35688]: pgmap v211: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:51:24.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:24 smithi175 ceph-mon[35688]: scrub summary: idle 2024-09-19T08:51:24.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:24 smithi007 ceph-mon[31221]: pgmap v211: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:51:24.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:24 smithi007 ceph-mon[31221]: scrub summary: idle 2024-09-19T08:51:24.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:24 smithi044 ceph-mon[35072]: pgmap v211: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:51:24.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:24 smithi044 ceph-mon[35072]: scrub summary: idle 2024-09-19T08:51:26.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:26 smithi175 ceph-mon[35688]: pgmap v212: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:51:26.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:26 smithi007 ceph-mon[31221]: pgmap v212: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:51:26.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:26 smithi044 ceph-mon[35072]: pgmap v212: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:51:28.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:28 smithi175 ceph-mon[35688]: pgmap v213: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T08:51:28.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:28 smithi007 ceph-mon[31221]: pgmap v213: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T08:51:28.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:28 smithi044 ceph-mon[35072]: pgmap v213: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T08:51:30.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:30 smithi175 ceph-mon[35688]: pgmap v214: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:51:30.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:30 smithi007 ceph-mon[31221]: pgmap v214: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:51:30.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:30 smithi044 ceph-mon[35072]: pgmap v214: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:51:32.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:32 smithi175 ceph-mon[35688]: pgmap v215: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:51:32.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:32 smithi007 ceph-mon[31221]: pgmap v215: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:51:32.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:32 smithi044 ceph-mon[35072]: pgmap v215: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:51:34.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:34 smithi175 ceph-mon[35688]: pgmap v216: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:51:34.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:34 smithi007 ceph-mon[31221]: pgmap v216: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:51:34.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:34 smithi044 ceph-mon[35072]: pgmap v216: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:51:36.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:36 smithi175 ceph-mon[35688]: pgmap v217: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:36 smithi007 ceph-mon[31221]: pgmap v217: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:36.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:36 smithi044 ceph-mon[35072]: pgmap v217: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:38.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:38 smithi175 ceph-mon[35688]: pgmap v218: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:51:38.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:38 smithi007 ceph-mon[31221]: pgmap v218: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:51:38.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:38 smithi044 ceph-mon[35072]: pgmap v218: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:51:40.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:40 smithi175 ceph-mon[35688]: pgmap v219: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:40.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:40 smithi007 ceph-mon[31221]: pgmap v219: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:40.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:40 smithi044 ceph-mon[35072]: pgmap v219: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:42.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:42 smithi175 ceph-mon[35688]: pgmap v220: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:42.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:42 smithi007 ceph-mon[31221]: pgmap v220: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:42.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:42 smithi044 ceph-mon[35072]: pgmap v220: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:44.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:44 smithi175 ceph-mon[35688]: pgmap v221: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:51:44.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:44 smithi007 ceph-mon[31221]: pgmap v221: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:51:44.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:44 smithi044 ceph-mon[35072]: pgmap v221: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:51:46.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:46 smithi175 ceph-mon[35688]: pgmap v222: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:46.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:46 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:46.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:46 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:46.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:46 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:46.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:46 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:51:46.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:46 smithi007 ceph-mon[31221]: pgmap v222: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:46.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:46 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:46.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:46 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:46.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:46 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:46.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:46 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:51:46.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:46 smithi044 ceph-mon[35072]: pgmap v222: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:46 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:46 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:46 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:46 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:51:48.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:48 smithi175 ceph-mon[35688]: pgmap v223: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:51:48.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:48 smithi007 ceph-mon[31221]: pgmap v223: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:51:48.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:48 smithi044 ceph-mon[35072]: pgmap v223: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:51:50.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:50 smithi175 ceph-mon[35688]: pgmap v224: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:50.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:50 smithi007 ceph-mon[31221]: pgmap v224: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:50.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:50 smithi044 ceph-mon[35072]: pgmap v224: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:52.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:52 smithi175 ceph-mon[35688]: pgmap v225: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:52.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:52 smithi007 ceph-mon[31221]: pgmap v225: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:52.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:52 smithi044 ceph-mon[35072]: pgmap v225: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:53.584 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:51:53.854 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:54.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.322+0000 7ffa39ee2640 1 -- 172.21.15.7:0/2136899713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa34102d40 msgr2=0x7ffa34103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.322+0000 7ffa39ee2640 1 --2- 172.21.15.7:0/2136899713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa34102d40 0x7ffa34103120 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009900 tx=0x7ffa2402a480 comp rx=0 tx=0).stop 2024-09-19T08:51:54.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.322+0000 7ffa39ee2640 1 -- 172.21.15.7:0/2136899713 shutdown_connections 2024-09-19T08:51:54.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.322+0000 7ffa39ee2640 1 --2- 172.21.15.7:0/2136899713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa3410c170 0x7ffa3410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.322+0000 7ffa39ee2640 1 --2- 172.21.15.7:0/2136899713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa34103660 0x7ffa3410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.322+0000 7ffa39ee2640 1 --2- 172.21.15.7:0/2136899713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa34102d40 0x7ffa34103120 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.322+0000 7ffa39ee2640 1 -- 172.21.15.7:0/2136899713 >> 172.21.15.7:0/2136899713 conn(0x7ffa340fc7a0 msgr2=0x7ffa340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:54.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.322+0000 7ffa39ee2640 1 -- 172.21.15.7:0/2136899713 shutdown_connections 2024-09-19T08:51:54.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.322+0000 7ffa39ee2640 1 -- 172.21.15.7:0/2136899713 wait complete. 2024-09-19T08:51:54.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.322+0000 7ffa39ee2640 1 Processor -- start 2024-09-19T08:51:54.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.322+0000 7ffa39ee2640 1 -- start start 2024-09-19T08:51:54.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.323+0000 7ffa39ee2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa34102d40 0x7ffa341009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.323+0000 7ffa39ee2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa34103660 0x7ffa34100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.323+0000 7ffa39ee2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa3410c170 0x7ffa34101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.323+0000 7ffa39ee2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffa34111fb0 con 0x7ffa34103660 2024-09-19T08:51:54.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.323+0000 7ffa39ee2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffa34111e30 con 0x7ffa34102d40 2024-09-19T08:51:54.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.323+0000 7ffa39ee2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffa34112130 con 0x7ffa3410c170 2024-09-19T08:51:54.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.323+0000 7ffa2affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa34103660 0x7ffa34100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.323+0000 7ffa2affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa34103660 0x7ffa34100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55004/0 (socket says 172.21.15.7:55004) 2024-09-19T08:51:54.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.323+0000 7ffa2affd640 1 -- 172.21.15.7:0/846527098 learned_addr learned my addr 172.21.15.7:0/846527098 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:54.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.323+0000 7ffa337fe640 1 --2- 172.21.15.7:0/846527098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa34102d40 0x7ffa341009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.323+0000 7ffa33fff640 1 --2- 172.21.15.7:0/846527098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa3410c170 0x7ffa34101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.323+0000 7ffa2affd640 1 -- 172.21.15.7:0/846527098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa3410c170 msgr2=0x7ffa34101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.323+0000 7ffa2affd640 1 --2- 172.21.15.7:0/846527098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa3410c170 0x7ffa34101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.323+0000 7ffa2affd640 1 -- 172.21.15.7:0/846527098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa34102d40 msgr2=0x7ffa341009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.323+0000 7ffa2affd640 1 --2- 172.21.15.7:0/846527098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa34102d40 0x7ffa341009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.323+0000 7ffa2affd640 1 -- 172.21.15.7:0/846527098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa341a6950 con 0x7ffa34103660 2024-09-19T08:51:54.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.323+0000 7ffa33fff640 1 --2- 172.21.15.7:0/846527098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa3410c170 0x7ffa34101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:54.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.324+0000 7ffa2affd640 1 --2- 172.21.15.7:0/846527098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa34103660 0x7ffa34100ee0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c00d740 tx=0x7ffa1c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:54.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.324+0000 7ffa317fa640 1 -- 172.21.15.7:0/846527098 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c017070 con 0x7ffa34103660 2024-09-19T08:51:54.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.324+0000 7ffa317fa640 1 -- 172.21.15.7:0/846527098 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa1c00de50 con 0x7ffa34103660 2024-09-19T08:51:54.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.324+0000 7ffa39ee2640 1 -- 172.21.15.7:0/846527098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa341a6c40 con 0x7ffa34103660 2024-09-19T08:51:54.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.324+0000 7ffa317fa640 1 -- 172.21.15.7:0/846527098 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c00f620 con 0x7ffa34103660 2024-09-19T08:51:54.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.324+0000 7ffa39ee2640 1 -- 172.21.15.7:0/846527098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa341a7180 con 0x7ffa34103660 2024-09-19T08:51:54.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.326+0000 7ffa317fa640 1 -- 172.21.15.7:0/846527098 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ffa1c009c30 con 0x7ffa34103660 2024-09-19T08:51:54.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.326+0000 7ffa3c2bb740 1 Processor -- start 2024-09-19T08:51:54.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.326+0000 7ffa3c2bb740 1 -- start start 2024-09-19T08:51:54.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.327+0000 7ffa3c2bb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f477854a0 0x563f47785880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.327+0000 7ffa3c2bb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f47785dc0 0x563f47790140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.327+0000 7ffa3c2bb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f47790680 0x563f47792a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.327+0000 7ffa3c2bb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563f476eb2e0 con 0x563f47785dc0 2024-09-19T08:51:54.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.327+0000 7ffa3c2bb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563f47692ce0 con 0x563f47790680 2024-09-19T08:51:54.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.327+0000 7ffa3c2bb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563f476e72a0 con 0x563f477854a0 2024-09-19T08:51:54.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.327+0000 7ffa337fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f47785dc0 0x563f47790140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.327+0000 7ffa337fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f47785dc0 0x563f47790140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55016/0 (socket says 172.21.15.7:55016) 2024-09-19T08:51:54.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.327+0000 7ffa337fe640 1 -- 172.21.15.7:0/3163064102 learned_addr learned my addr 172.21.15.7:0/3163064102 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:54.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.327+0000 7ffa2affd640 1 --2- 172.21.15.7:0/3163064102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f47790680 0x563f47792a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.327+0000 7ffa317fa640 1 --2- 172.21.15.7:0/846527098 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffa200a33b0 0x7ffa200a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.327+0000 7ffa337fe640 1 -- 172.21.15.7:0/3163064102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f477854a0 msgr2=0x563f47785880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:51:54.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.327+0000 7ffa337fe640 1 --2- 172.21.15.7:0/3163064102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f477854a0 0x563f47785880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.327+0000 7ffa337fe640 1 -- 172.21.15.7:0/3163064102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f47790680 msgr2=0x563f47792a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:54.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.327+0000 7ffa337fe640 1 --2- 172.21.15.7:0/3163064102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f47790680 0x563f47792a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.327+0000 7ffa337fe640 1 -- 172.21.15.7:0/3163064102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f47677440 con 0x563f47785dc0 2024-09-19T08:51:54.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.327+0000 7ffa2affd640 1 --2- 172.21.15.7:0/3163064102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f47790680 0x563f47792a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:54.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.327+0000 7ffa33fff640 1 --2- 172.21.15.7:0/846527098 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffa200a33b0 0x7ffa200a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.327+0000 7ffa317fa640 1 -- 172.21.15.7:0/846527098 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7ffa1c0cf920 con 0x7ffa34103660 2024-09-19T08:51:54.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.327+0000 7ffa337fe640 1 --2- 172.21.15.7:0/3163064102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f47785dc0 0x563f47790140 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009900 tx=0x7ffa24031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abfa57cad14cff47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:54.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.328+0000 7ffa29ffb640 1 -- 172.21.15.7:0/3163064102 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24040070 con 0x563f47785dc0 2024-09-19T08:51:54.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.328+0000 7ffa29ffb640 1 -- 172.21.15.7:0/3163064102 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa24005020 con 0x563f47785dc0 2024-09-19T08:51:54.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.328+0000 7ffa33fff640 1 --2- 172.21.15.7:0/846527098 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffa200a33b0 0x7ffa200a5870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c009440 tx=0x7ffa2c0093d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:54.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.328+0000 7ffa29ffb640 1 -- 172.21.15.7:0/3163064102 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24035040 con 0x563f47785dc0 2024-09-19T08:51:54.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.328+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/3163064102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f47785dc0 msgr2=0x563f47790140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.328+0000 7ffa3c2bb740 1 --2- 172.21.15.7:0/3163064102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f47785dc0 0x563f47790140 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009900 tx=0x7ffa24031630 comp rx=0 tx=0).stop 2024-09-19T08:51:54.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.328+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/3163064102 shutdown_connections 2024-09-19T08:51:54.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.328+0000 7ffa3c2bb740 1 --2- 172.21.15.7:0/3163064102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f47790680 0x563f47792a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.328+0000 7ffa3c2bb740 1 --2- 172.21.15.7:0/3163064102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f47785dc0 0x563f47790140 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.328+0000 7ffa3c2bb740 1 --2- 172.21.15.7:0/3163064102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f477854a0 0x563f47785880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.328+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/3163064102 >> 172.21.15.7:0/3163064102 conn(0x563f47781a30 msgr2=0x563f47781e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:54.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.328+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/3163064102 shutdown_connections 2024-09-19T08:51:54.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.328+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/3163064102 wait complete. 2024-09-19T08:51:54.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.329+0000 7ffa3c2bb740 1 -- start start 2024-09-19T08:51:54.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.329+0000 7ffa3c2bb740 1 Processor -- start 2024-09-19T08:51:54.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.329+0000 7ffa3c2bb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f477854a0 0x563f4778ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.329+0000 7ffa3c2bb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f47785dc0 0x563f4778d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.329+0000 7ffa3c2bb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f47790680 0x563f4778d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.329+0000 7ffa3c2bb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563f47793250 con 0x563f47785dc0 2024-09-19T08:51:54.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.329+0000 7ffa3c2bb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563f476a6050 con 0x563f47790680 2024-09-19T08:51:54.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.329+0000 7ffa3c2bb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563f477933d0 con 0x563f477854a0 2024-09-19T08:51:54.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.329+0000 7ffa3c2bb740 10 client.0 _ll_register_callbacks cb 0x563f476e6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:54.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.329+0000 7ffa2affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f47785dc0 0x563f4778d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.329+0000 7ffa2affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f47785dc0 0x563f4778d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55030/0 (socket says 172.21.15.7:55030) 2024-09-19T08:51:54.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.329+0000 7ffa2affd640 1 -- 172.21.15.7:0/3333387970 learned_addr learned my addr 172.21.15.7:0/3333387970 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:54.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.330+0000 7ffa33fff640 1 --2- 172.21.15.7:0/3333387970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f47790680 0x563f4778d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.330+0000 7ffa337fe640 1 --2- 172.21.15.7:0/3333387970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f477854a0 0x563f4778ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.330+0000 7ffa2affd640 1 -- 172.21.15.7:0/3333387970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f477854a0 msgr2=0x563f4778ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:54.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.330+0000 7ffa2affd640 1 --2- 172.21.15.7:0/3333387970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f477854a0 0x563f4778ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.330+0000 7ffa2affd640 1 -- 172.21.15.7:0/3333387970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f47790680 msgr2=0x563f4778d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:54.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.330+0000 7ffa2affd640 1 --2- 172.21.15.7:0/3333387970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f47790680 0x563f4778d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.330+0000 7ffa2affd640 1 -- 172.21.15.7:0/3333387970 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f4745c3c0 con 0x563f47785dc0 2024-09-19T08:51:54.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.330+0000 7ffa2affd640 1 --2- 172.21.15.7:0/3333387970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f47785dc0 0x563f4778d250 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0cd090 tx=0x7ffa1c09b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0d71ae31101c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:54.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.330+0000 7ffa12ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:51:54.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.330+0000 7ffa12ffd640 1 -- 172.21.15.7:0/3333387970 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c020070 con 0x563f47785dc0 2024-09-19T08:51:54.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.330+0000 7ffa12ffd640 1 -- 172.21.15.7:0/3333387970 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7ffa1c0860b0 con 0x563f47785dc0 2024-09-19T08:51:54.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.330+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/3333387970 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa24005020 con 0x563f47785dc0 2024-09-19T08:51:54.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.330+0000 7ffa12ffd640 1 -- 172.21.15.7:0/3333387970 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ffa1c09ff70 con 0x563f47785dc0 2024-09-19T08:51:54.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.330+0000 7ffa3c2bb740 10 client.16722 fetch_fsmap learned FSMap version 25 2024-09-19T08:51:54.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.330+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/3333387970 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563f4779ec20 con 0x563f47785dc0 2024-09-19T08:51:54.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.331+0000 7ffa12ffd640 1 -- 172.21.15.7:0/3333387970 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa24005020 con 0x563f47785dc0 2024-09-19T08:51:54.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.331+0000 7ffa12ffd640 1 -- 172.21.15.7:0/3333387970 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ffa1c09b010 con 0x563f47785dc0 2024-09-19T08:51:54.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.331+0000 7ffa3c2bb740 10 client.16722 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:51:54.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.331+0000 7ffa3c2bb740 10 client.16722 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:51:54.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.331+0000 7ffa3c2bb740 20 client.16722 populate_metadata read hostname 'smithi007' 2024-09-19T08:51:54.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.331+0000 7ffa3c2bb740 1 --2- 172.21.15.7:0/3333387970 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563f477a00e0 0x563f477a24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.331+0000 7ffa3c2bb740 4 client.16722 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:51:54.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.331+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/3333387970 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f476f8850 con 0x563f477a00e0 2024-09-19T08:51:54.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.331+0000 7ffa337fe640 1 --2- 172.21.15.7:0/3333387970 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563f477a00e0 0x563f477a24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.331+0000 7ffa12ffd640 10 client.16722 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:51:54.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.331+0000 7ffa337fe640 1 --2- 172.21.15.7:0/3333387970 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563f477a00e0 0x563f477a24f0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=211f0c77f65b6650 server_cookie=28fe0505d7869 in_seq=0 out_seq=0 2024-09-19T08:51:54.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.332+0000 7ffa12ffd640 1 -- 172.21.15.7:0/3333387970 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563f476f8850 con 0x563f477a00e0 2024-09-19T08:51:54.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.332+0000 7ffa12ffd640 10 client.16722 handle_command_reply: tid=0 2024-09-19T08:51:54.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.332+0000 7ffa3c2bb740 1 client.16722 shutdown 2024-09-19T08:51:54.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.332+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/3333387970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f47785dc0 msgr2=0x563f4778d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.332+0000 7ffa3c2bb740 1 --2- 172.21.15.7:0/3333387970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f47785dc0 0x563f4778d250 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0cd090 tx=0x7ffa1c09b830 comp rx=0 tx=0).stop 2024-09-19T08:51:54.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.332+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/3333387970 shutdown_connections 2024-09-19T08:51:54.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.332+0000 7ffa3c2bb740 1 --2- 172.21.15.7:0/3333387970 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563f477a00e0 0x563f477a24f0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.332+0000 7ffa3c2bb740 1 --2- 172.21.15.7:0/3333387970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f47790680 0x563f4778d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.332+0000 7ffa3c2bb740 1 --2- 172.21.15.7:0/3333387970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f47785dc0 0x563f4778d250 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.332+0000 7ffa12ffd640 0 client.16722 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:51:54.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.332+0000 7ffa3c2bb740 1 --2- 172.21.15.7:0/3333387970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f477854a0 0x563f4778ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.332+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/3333387970 >> 172.21.15.7:0/3333387970 conn(0x563f47781a30 msgr2=0x563f47787710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:54.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.332+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/3333387970 shutdown_connections 2024-09-19T08:51:54.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.333+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/3333387970 wait complete. 2024-09-19T08:51:54.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.333+0000 7ffa3c2bb740 20 client.16722 trim_cache size 0 max 16384 2024-09-19T08:51:54.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.350+0000 7ffa3c2bb740 1 Processor -- start 2024-09-19T08:51:54.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.350+0000 7ffa3c2bb740 1 -- start start 2024-09-19T08:51:54.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.350+0000 7ffa3c2bb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f477854a0 0x563f4778bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.350+0000 7ffa3c2bb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f47785dc0 0x563f477a7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.350+0000 7ffa3c2bb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f47790680 0x563f477a8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.350+0000 7ffa3c2bb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffa341b23f0 con 0x563f477854a0 2024-09-19T08:51:54.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.350+0000 7ffa3c2bb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffa341afcc0 con 0x563f47785dc0 2024-09-19T08:51:54.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.350+0000 7ffa3c2bb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffa341adb30 con 0x563f47790680 2024-09-19T08:51:54.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.351+0000 7ffa337fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f477854a0 0x563f4778bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.351+0000 7ffa337fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f477854a0 0x563f4778bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55034/0 (socket says 172.21.15.7:55034) 2024-09-19T08:51:54.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.351+0000 7ffa337fe640 1 -- 172.21.15.7:0/1731047469 learned_addr learned my addr 172.21.15.7:0/1731047469 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:54.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.351+0000 7ffa2affd640 1 --2- 172.21.15.7:0/1731047469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f47785dc0 0x563f477a7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.351+0000 7ffa33fff640 1 --2- 172.21.15.7:0/1731047469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f47790680 0x563f477a8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.351+0000 7ffa337fe640 1 -- 172.21.15.7:0/1731047469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f47790680 msgr2=0x563f477a8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:54.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.351+0000 7ffa337fe640 1 --2- 172.21.15.7:0/1731047469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f47790680 0x563f477a8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.351+0000 7ffa337fe640 1 -- 172.21.15.7:0/1731047469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f47785dc0 msgr2=0x563f477a7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:54.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.351+0000 7ffa337fe640 1 --2- 172.21.15.7:0/1731047469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f47785dc0 0x563f477a7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.351+0000 7ffa337fe640 1 -- 172.21.15.7:0/1731047469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f477852d0 con 0x563f477854a0 2024-09-19T08:51:54.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.351+0000 7ffa2affd640 1 --2- 172.21.15.7:0/1731047469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f47785dc0 0x563f477a7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:54.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.351+0000 7ffa337fe640 1 --2- 172.21.15.7:0/1731047469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f477854a0 0x563f4778bb20 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ffa240096c0 tx=0x7ffa240055e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122ff0baca0b9b5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:54.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.351+0000 7ffa297fa640 1 -- 172.21.15.7:0/1731047469 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24053070 con 0x563f477854a0 2024-09-19T08:51:54.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.351+0000 7ffa297fa640 1 -- 172.21.15.7:0/1731047469 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa24004240 con 0x563f477854a0 2024-09-19T08:51:54.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.351+0000 7ffa297fa640 1 -- 172.21.15.7:0/1731047469 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24035040 con 0x563f477854a0 2024-09-19T08:51:54.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.352+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/1731047469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f477854a0 msgr2=0x563f4778bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.352+0000 7ffa3c2bb740 1 --2- 172.21.15.7:0/1731047469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f477854a0 0x563f4778bb20 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ffa240096c0 tx=0x7ffa240055e0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.352+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/1731047469 shutdown_connections 2024-09-19T08:51:54.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.352+0000 7ffa3c2bb740 1 --2- 172.21.15.7:0/1731047469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f47790680 0x563f477a8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.352+0000 7ffa3c2bb740 1 --2- 172.21.15.7:0/1731047469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f47785dc0 0x563f477a7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.352+0000 7ffa3c2bb740 1 --2- 172.21.15.7:0/1731047469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f477854a0 0x563f4778bb20 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.352+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/1731047469 >> 172.21.15.7:0/1731047469 conn(0x563f47781a30 msgr2=0x563f4778f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:54.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.352+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/1731047469 shutdown_connections 2024-09-19T08:51:54.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.352+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/1731047469 wait complete. 2024-09-19T08:51:54.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.353+0000 7ffa3c2bb740 1 -- start start 2024-09-19T08:51:54.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.353+0000 7ffa3c2bb740 1 Processor -- start 2024-09-19T08:51:54.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.353+0000 7ffa3c2bb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f477854a0 0x563f477967c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.353+0000 7ffa3c2bb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f47785dc0 0x563f47796d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.353+0000 7ffa3c2bb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f47790680 0x563f47809da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.353+0000 7ffa3c2bb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffa341ae180 con 0x563f477854a0 2024-09-19T08:51:54.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.353+0000 7ffa3c2bb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffa341af5f0 con 0x563f47785dc0 2024-09-19T08:51:54.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.353+0000 7ffa3c2bb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffa341ae850 con 0x563f47790680 2024-09-19T08:51:54.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.353+0000 7ffa3c2bb740 10 client.0 _ll_register_callbacks cb 0x7ffa1c010c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:54.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.353+0000 7ffa337fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f477854a0 0x563f477967c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.353+0000 7ffa337fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f477854a0 0x563f477967c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55040/0 (socket says 172.21.15.7:55040) 2024-09-19T08:51:54.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.353+0000 7ffa337fe640 1 -- 172.21.15.7:0/4230902026 learned_addr learned my addr 172.21.15.7:0/4230902026 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:54.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.353+0000 7ffa33fff640 1 --2- 172.21.15.7:0/4230902026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f47790680 0x563f47809da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.353+0000 7ffa2affd640 1 --2- 172.21.15.7:0/4230902026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f47785dc0 0x563f47796d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.354+0000 7ffa337fe640 1 -- 172.21.15.7:0/4230902026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f47790680 msgr2=0x563f47809da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:54.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.354+0000 7ffa337fe640 1 --2- 172.21.15.7:0/4230902026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f47790680 0x563f47809da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.354+0000 7ffa337fe640 1 -- 172.21.15.7:0/4230902026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f47785dc0 msgr2=0x563f47796d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:54.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.354+0000 7ffa337fe640 1 --2- 172.21.15.7:0/4230902026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f47785dc0 0x563f47796d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.354+0000 7ffa337fe640 1 -- 172.21.15.7:0/4230902026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f4780a2e0 con 0x563f477854a0 2024-09-19T08:51:54.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.354+0000 7ffa337fe640 1 --2- 172.21.15.7:0/4230902026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f477854a0 0x563f477967c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7ffa24031660 tx=0x7ffa2402ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d43372c7ae8376 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:54.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.354+0000 7ffa12ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:51:54.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.354+0000 7ffa12ffd640 1 -- 172.21.15.7:0/4230902026 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2405c060 con 0x563f477854a0 2024-09-19T08:51:54.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.354+0000 7ffa12ffd640 1 -- 172.21.15.7:0/4230902026 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7ffa240043f0 con 0x563f477854a0 2024-09-19T08:51:54.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.354+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/4230902026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa24004240 con 0x563f477854a0 2024-09-19T08:51:54.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.354+0000 7ffa12ffd640 1 -- 172.21.15.7:0/4230902026 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ffa24035070 con 0x563f477854a0 2024-09-19T08:51:54.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.354+0000 7ffa3c2bb740 10 client.16728 fetch_fsmap learned FSMap version 25 2024-09-19T08:51:54.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.354+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/4230902026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563f4780b470 con 0x563f477854a0 2024-09-19T08:51:54.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.354+0000 7ffa12ffd640 1 -- 172.21.15.7:0/4230902026 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa24004240 con 0x563f477854a0 2024-09-19T08:51:54.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.355+0000 7ffa12ffd640 1 -- 172.21.15.7:0/4230902026 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ffa24004910 con 0x563f477854a0 2024-09-19T08:51:54.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.355+0000 7ffa3c2bb740 10 client.16728 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:51:54.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.355+0000 7ffa3c2bb740 10 client.16728 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:51:54.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.355+0000 7ffa3c2bb740 20 client.16728 populate_metadata read hostname 'smithi007' 2024-09-19T08:51:54.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.355+0000 7ffa3c2bb740 1 --2- 172.21.15.7:0/4230902026 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563f4780b6a0 0x563f4780da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.355+0000 7ffa3c2bb740 4 client.16728 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:51:54.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.355+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/4230902026 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563f476f2d60 con 0x563f4780b6a0 2024-09-19T08:51:54.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.355+0000 7ffa2affd640 1 --2- 172.21.15.7:0/4230902026 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563f4780b6a0 0x563f4780da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.355+0000 7ffa2affd640 1 --2- 172.21.15.7:0/4230902026 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563f4780b6a0 0x563f4780da90 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aebc97f50448890 server_cookie=84543addda7aafce in_seq=0 out_seq=0 2024-09-19T08:51:54.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.355+0000 7ffa12ffd640 10 client.16728 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:51:54.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.356+0000 7ffa12ffd640 1 -- 172.21.15.7:0/4230902026 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563f476f2d60 con 0x563f4780b6a0 2024-09-19T08:51:54.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.356+0000 7ffa12ffd640 10 client.16728 handle_command_reply: tid=0 2024-09-19T08:51:54.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.356+0000 7ffa3c2bb740 1 client.16728 shutdown 2024-09-19T08:51:54.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.356+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/4230902026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f477854a0 msgr2=0x563f477967c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.356+0000 7ffa3c2bb740 1 --2- 172.21.15.7:0/4230902026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f477854a0 0x563f477967c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7ffa24031660 tx=0x7ffa2402ab80 comp rx=0 tx=0).stop 2024-09-19T08:51:54.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.356+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/4230902026 shutdown_connections 2024-09-19T08:51:54.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.356+0000 7ffa3c2bb740 1 --2- 172.21.15.7:0/4230902026 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563f4780b6a0 0x563f4780da90 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.356+0000 7ffa3c2bb740 1 --2- 172.21.15.7:0/4230902026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563f47790680 0x563f47809da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.356+0000 7ffa3c2bb740 1 --2- 172.21.15.7:0/4230902026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f47785dc0 0x563f47796d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.356+0000 7ffa3c2bb740 1 --2- 172.21.15.7:0/4230902026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f477854a0 0x563f477967c0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.356+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/4230902026 >> 172.21.15.7:0/4230902026 conn(0x563f47781a30 msgr2=0x563f4778eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:54.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.356+0000 7ffa12ffd640 0 client.16728 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:51:54.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.356+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/4230902026 shutdown_connections 2024-09-19T08:51:54.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.356+0000 7ffa3c2bb740 1 -- 172.21.15.7:0/4230902026 wait complete. 2024-09-19T08:51:54.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.356+0000 7ffa3c2bb740 20 client.16728 trim_cache size 0 max 16384 2024-09-19T08:51:54.362 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:51:54.362 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-19T08:51:54.362 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-09-19T08:51:54.362 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:51:54.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.357+0000 7ffa39ee2640 1 -- 172.21.15.7:0/846527098 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffa200a33b0 msgr2=0x7ffa200a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.357+0000 7ffa39ee2640 1 --2- 172.21.15.7:0/846527098 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffa200a33b0 0x7ffa200a5870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c009440 tx=0x7ffa2c0093d0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.357+0000 7ffa39ee2640 1 -- 172.21.15.7:0/846527098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa34103660 msgr2=0x7ffa34100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.357+0000 7ffa39ee2640 1 --2- 172.21.15.7:0/846527098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa34103660 0x7ffa34100ee0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c00d740 tx=0x7ffa1c00dc00 comp rx=0 tx=0).stop 2024-09-19T08:51:54.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.357+0000 7ffa39ee2640 1 -- 172.21.15.7:0/846527098 shutdown_connections 2024-09-19T08:51:54.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.357+0000 7ffa39ee2640 1 --2- 172.21.15.7:0/846527098 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffa200a33b0 0x7ffa200a5870 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.357+0000 7ffa39ee2640 1 --2- 172.21.15.7:0/846527098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa3410c170 0x7ffa34101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.357+0000 7ffa39ee2640 1 --2- 172.21.15.7:0/846527098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa34103660 0x7ffa34100ee0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.357+0000 7ffa39ee2640 1 --2- 172.21.15.7:0/846527098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa34102d40 0x7ffa341009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.357+0000 7ffa39ee2640 1 -- 172.21.15.7:0/846527098 >> 172.21.15.7:0/846527098 conn(0x7ffa340fc7a0 msgr2=0x7ffa340fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:54.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.357+0000 7ffa39ee2640 1 -- 172.21.15.7:0/846527098 shutdown_connections 2024-09-19T08:51:54.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:54.357+0000 7ffa39ee2640 1 -- 172.21.15.7:0/846527098 wait complete. 2024-09-19T08:51:54.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:54 smithi007 ceph-mon[31221]: pgmap v226: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:51:54.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:54 smithi175 ceph-mon[35688]: pgmap v226: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:51:54.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:54 smithi044 ceph-mon[35072]: pgmap v226: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:51:55.171 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:51:55.171 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:51:55.430 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:55.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.869+0000 7f1516102640 1 -- 172.21.15.7:0/2312441601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f151010c180 msgr2=0x7f151010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:55.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.869+0000 7f1516102640 1 --2- 172.21.15.7:0/2312441601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f151010c180 0x7f151010e610 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f1508009ca0 tx=0x7f150802a950 comp rx=0 tx=0).stop 2024-09-19T08:51:55.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.869+0000 7f1516102640 1 -- 172.21.15.7:0/2312441601 shutdown_connections 2024-09-19T08:51:55.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.869+0000 7f1516102640 1 --2- 172.21.15.7:0/2312441601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f151010c180 0x7f151010e610 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.869+0000 7f1516102640 1 --2- 172.21.15.7:0/2312441601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1510103700 0x7f151010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.869+0000 7f1516102640 1 --2- 172.21.15.7:0/2312441601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1510102de0 0x7f15101031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.869+0000 7f1516102640 1 -- 172.21.15.7:0/2312441601 >> 172.21.15.7:0/2312441601 conn(0x7f15100fc7a0 msgr2=0x7f15100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.869+0000 7f1516102640 1 -- 172.21.15.7:0/2312441601 shutdown_connections 2024-09-19T08:51:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.869+0000 7f1516102640 1 -- 172.21.15.7:0/2312441601 wait complete. 2024-09-19T08:51:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.869+0000 7f1516102640 1 Processor -- start 2024-09-19T08:51:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.870+0000 7f1516102640 1 -- start start 2024-09-19T08:51:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.870+0000 7f1516102640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1510102de0 0x7f15101983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.870+0000 7f1516102640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1510103700 0x7f1510198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.870+0000 7f1516102640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f151010c180 0x7f151019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.870+0000 7f1516102640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1510111f30 con 0x7f151010c180 2024-09-19T08:51:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.870+0000 7f1516102640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1510111db0 con 0x7f1510103700 2024-09-19T08:51:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.870+0000 7f1516102640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f15101120b0 con 0x7f1510102de0 2024-09-19T08:51:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.870+0000 7f150ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f151010c180 0x7f151019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.870+0000 7f150ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f151010c180 0x7f151019ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55058/0 (socket says 172.21.15.7:55058) 2024-09-19T08:51:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.870+0000 7f150ffff640 1 -- 172.21.15.7:0/1533276499 learned_addr learned my addr 172.21.15.7:0/1533276499 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.870+0000 7f150f7fe640 1 --2- 172.21.15.7:0/1533276499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1510102de0 0x7f15101983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.870+0000 7f150effd640 1 --2- 172.21.15.7:0/1533276499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1510103700 0x7f1510198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.870+0000 7f150ffff640 1 -- 172.21.15.7:0/1533276499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1510102de0 msgr2=0x7f15101983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.870+0000 7f150ffff640 1 --2- 172.21.15.7:0/1533276499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1510102de0 0x7f15101983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.870+0000 7f150ffff640 1 -- 172.21.15.7:0/1533276499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1510103700 msgr2=0x7f1510198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.870+0000 7f150ffff640 1 --2- 172.21.15.7:0/1533276499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1510103700 0x7f1510198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.871+0000 7f150ffff640 1 -- 172.21.15.7:0/1533276499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151019d3a0 con 0x7f151010c180 2024-09-19T08:51:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.871+0000 7f150ffff640 1 --2- 172.21.15.7:0/1533276499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f151010c180 0x7f151019ccc0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f150802ae70 tx=0x7f150802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.871+0000 7f150cff9640 1 -- 172.21.15.7:0/1533276499 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1508034040 con 0x7f151010c180 2024-09-19T08:51:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.871+0000 7f150cff9640 1 -- 172.21.15.7:0/1533276499 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1508030920 con 0x7f151010c180 2024-09-19T08:51:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.871+0000 7f1516102640 1 -- 172.21.15.7:0/1533276499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f151019d630 con 0x7f151010c180 2024-09-19T08:51:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.871+0000 7f150cff9640 1 -- 172.21.15.7:0/1533276499 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1508045480 con 0x7f151010c180 2024-09-19T08:51:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.871+0000 7f1516102640 1 -- 172.21.15.7:0/1533276499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15101a4f70 con 0x7f151010c180 2024-09-19T08:51:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.872+0000 7f1516102640 1 -- 172.21.15.7:0/1533276499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f151006afd0 con 0x7f151010c180 2024-09-19T08:51:55.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.873+0000 7f150cff9640 1 -- 172.21.15.7:0/1533276499 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f1508037020 con 0x7f151010c180 2024-09-19T08:51:55.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.874+0000 7f150cff9640 1 --2- 172.21.15.7:0/1533276499 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f14f80a33b0 0x7f14f80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:55.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.874+0000 7f150f7fe640 1 --2- 172.21.15.7:0/1533276499 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f14f80a33b0 0x7f14f80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:55.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.874+0000 7f150cff9640 1 -- 172.21.15.7:0/1533276499 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f15080f0c80 con 0x7f151010c180 2024-09-19T08:51:55.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.875+0000 7f150f7fe640 1 --2- 172.21.15.7:0/1533276499 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f14f80a33b0 0x7f14f80a5870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f150000bbe0 tx=0x7f150000b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:55.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:55.877+0000 7f150cff9640 1 -- 172.21.15.7:0/1533276499 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1508081210 con 0x7f151010c180 2024-09-19T08:51:56.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:56.093+0000 7f1516102640 1 -- 172.21.15.7:0/1533276499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15101031c0 con 0x7f151010c180 2024-09-19T08:51:56.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:56.094+0000 7f150cff9640 1 -- 172.21.15.7:0/1533276499 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f15101031c0 con 0x7f151010c180 2024-09-19T08:51:56.095 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:51:56.095 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:51:56.095 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:51:56.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:56.096+0000 7f1516102640 1 -- 172.21.15.7:0/1533276499 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f14f80a33b0 msgr2=0x7f14f80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:56.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:56.096+0000 7f1516102640 1 --2- 172.21.15.7:0/1533276499 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f14f80a33b0 0x7f14f80a5870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f150000bbe0 tx=0x7f150000b390 comp rx=0 tx=0).stop 2024-09-19T08:51:56.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:56.096+0000 7f1516102640 1 -- 172.21.15.7:0/1533276499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f151010c180 msgr2=0x7f151019ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:56.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:56.096+0000 7f1516102640 1 --2- 172.21.15.7:0/1533276499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f151010c180 0x7f151019ccc0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f150802ae70 tx=0x7f150802f5b0 comp rx=0 tx=0).stop 2024-09-19T08:51:56.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:56.096+0000 7f1516102640 1 -- 172.21.15.7:0/1533276499 shutdown_connections 2024-09-19T08:51:56.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:56.096+0000 7f1516102640 1 --2- 172.21.15.7:0/1533276499 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f14f80a33b0 0x7f14f80a5870 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:56.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:56.096+0000 7f1516102640 1 --2- 172.21.15.7:0/1533276499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f151010c180 0x7f151019ccc0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:56.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:56.096+0000 7f1516102640 1 --2- 172.21.15.7:0/1533276499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1510103700 0x7f1510198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:56.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:56.096+0000 7f1516102640 1 --2- 172.21.15.7:0/1533276499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1510102de0 0x7f15101983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:56.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:56.096+0000 7f1516102640 1 -- 172.21.15.7:0/1533276499 >> 172.21.15.7:0/1533276499 conn(0x7f15100fc7a0 msgr2=0x7f15100fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:56.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:56.097+0000 7f1516102640 1 -- 172.21.15.7:0/1533276499 shutdown_connections 2024-09-19T08:51:56.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:56.097+0000 7f1516102640 1 -- 172.21.15.7:0/1533276499 wait complete. 2024-09-19T08:51:56.658 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:56 smithi007 ceph-mon[31221]: pgmap v227: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:56.658 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:56 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1533276499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:51:56.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:56 smithi175 ceph-mon[35688]: pgmap v227: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:56.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:56 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1533276499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:51:56.687 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:51:56.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:56 smithi044 ceph-mon[35072]: pgmap v227: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:51:56.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:56 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1533276499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:51:56.943 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:57.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.419+0000 7f761016d640 1 -- 172.21.15.7:0/2548106982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7608106f10 msgr2=0x7f760810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:57.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.419+0000 7f761016d640 1 --2- 172.21.15.7:0/2548106982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7608106f10 0x7f760810ea90 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f75f8009ca0 tx=0x7f75f802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.419+0000 7f761016d640 1 -- 172.21.15.7:0/2548106982 shutdown_connections 2024-09-19T08:51:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.419+0000 7f761016d640 1 --2- 172.21.15.7:0/2548106982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7608106f10 0x7f760810ea90 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.419+0000 7f761016d640 1 --2- 172.21.15.7:0/2548106982 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7608102790 0x7f76081067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.419+0000 7f761016d640 1 --2- 172.21.15.7:0/2548106982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7608101de0 0x7f76081021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.419+0000 7f761016d640 1 -- 172.21.15.7:0/2548106982 >> 172.21.15.7:0/2548106982 conn(0x7f76080fd8c0 msgr2=0x7f76080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.420+0000 7f761016d640 1 -- 172.21.15.7:0/2548106982 shutdown_connections 2024-09-19T08:51:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.420+0000 7f761016d640 1 -- 172.21.15.7:0/2548106982 wait complete. 2024-09-19T08:51:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.420+0000 7f761016d640 1 Processor -- start 2024-09-19T08:51:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.420+0000 7f761016d640 1 -- start start 2024-09-19T08:51:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.420+0000 7f761016d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7608101de0 0x7f76081983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.420+0000 7f761016d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7608102790 0x7f7608198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.421+0000 7f761016d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7608106f10 0x7f760819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.421+0000 7f761016d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7608111f70 con 0x7f7608102790 2024-09-19T08:51:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.421+0000 7f761016d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7608111df0 con 0x7f7608106f10 2024-09-19T08:51:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.421+0000 7f761016d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f76081120f0 con 0x7f7608101de0 2024-09-19T08:51:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.421+0000 7f760d708640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7608102790 0x7f7608198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.421+0000 7f760d708640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7608102790 0x7f7608198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55074/0 (socket says 172.21.15.7:55074) 2024-09-19T08:51:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.421+0000 7f760d708640 1 -- 172.21.15.7:0/1691022903 learned_addr learned my addr 172.21.15.7:0/1691022903 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.421+0000 7f760df09640 1 --2- 172.21.15.7:0/1691022903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7608101de0 0x7f76081983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.421+0000 7f760e70a640 1 --2- 172.21.15.7:0/1691022903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7608106f10 0x7f760819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.421+0000 7f760d708640 1 -- 172.21.15.7:0/1691022903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7608101de0 msgr2=0x7f76081983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.421+0000 7f760d708640 1 --2- 172.21.15.7:0/1691022903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7608101de0 0x7f76081983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.421+0000 7f760d708640 1 -- 172.21.15.7:0/1691022903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7608106f10 msgr2=0x7f760819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.421+0000 7f760d708640 1 --2- 172.21.15.7:0/1691022903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7608106f10 0x7f760819ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.421+0000 7f760d708640 1 -- 172.21.15.7:0/1691022903 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f760819d3a0 con 0x7f7608102790 2024-09-19T08:51:57.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.421+0000 7f760d708640 1 --2- 172.21.15.7:0/1691022903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7608102790 0x7f7608198930 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00d950 tx=0x7f75fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:57.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.421+0000 7f7606ffd640 1 -- 172.21.15.7:0/1691022903 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc017070 con 0x7f7608102790 2024-09-19T08:51:57.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.421+0000 7f761016d640 1 -- 172.21.15.7:0/1691022903 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f760819d690 con 0x7f7608102790 2024-09-19T08:51:57.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.421+0000 7f7606ffd640 1 -- 172.21.15.7:0/1691022903 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75fc009c30 con 0x7f7608102790 2024-09-19T08:51:57.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.421+0000 7f7606ffd640 1 -- 172.21.15.7:0/1691022903 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc00f6b0 con 0x7f7608102790 2024-09-19T08:51:57.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.422+0000 7f761016d640 1 -- 172.21.15.7:0/1691022903 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76081a4f70 con 0x7f7608102790 2024-09-19T08:51:57.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.424+0000 7f7606ffd640 1 -- 172.21.15.7:0/1691022903 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f75fc0109d0 con 0x7f7608102790 2024-09-19T08:51:57.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.424+0000 7f7612546740 1 Processor -- start 2024-09-19T08:51:57.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.424+0000 7f7612546740 1 -- start start 2024-09-19T08:51:57.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.425+0000 7f7612546740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07cb40 0x55c4ae07b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.425+0000 7f7612546740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4ae07b5d0 0x55c4ae07ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.425+0000 7f7612546740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ae086370 0x55c4ae088760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.425+0000 7f7612546740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c4adfe12f0 con 0x55c4ae07cb40 2024-09-19T08:51:57.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.425+0000 7f7612546740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c4adf88cf0 con 0x55c4ae07b5d0 2024-09-19T08:51:57.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.425+0000 7f7612546740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c4adfdd2b0 con 0x55c4ae086370 2024-09-19T08:51:57.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.425+0000 7f760e70a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07cb40 0x55c4ae07b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.425+0000 7f7606ffd640 1 --2- 172.21.15.7:0/1691022903 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f75f00a33b0 0x7f75f00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.425+0000 7f760e70a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07cb40 0x55c4ae07b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55084/0 (socket says 172.21.15.7:55084) 2024-09-19T08:51:57.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.425+0000 7f760e70a640 1 -- 172.21.15.7:0/837293517 learned_addr learned my addr 172.21.15.7:0/837293517 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:57.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.425+0000 7f760df09640 1 --2- 172.21.15.7:0/837293517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4ae07b5d0 0x55c4ae07ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.425+0000 7f760d708640 1 --2- 172.21.15.7:0/837293517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ae086370 0x55c4ae088760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.425+0000 7f760e70a640 1 --2- 172.21.15.7:0/1691022903 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f75f00a33b0 0x7f75f00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.425+0000 7f7606ffd640 1 -- 172.21.15.7:0/1691022903 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f75fc0cf910 con 0x7f7608102790 2024-09-19T08:51:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.425+0000 7f760e70a640 1 -- 172.21.15.7:0/837293517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ae086370 msgr2=0x55c4ae088760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.425+0000 7f760e70a640 1 --2- 172.21.15.7:0/837293517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ae086370 0x55c4ae088760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.425+0000 7f760e70a640 1 -- 172.21.15.7:0/837293517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4ae07b5d0 msgr2=0x55c4ae07ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.425+0000 7f760e70a640 1 --2- 172.21.15.7:0/837293517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4ae07b5d0 0x55c4ae07ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.425+0000 7f760e70a640 1 -- 172.21.15.7:0/837293517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4adf6d3a0 con 0x55c4ae07cb40 2024-09-19T08:51:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.425+0000 7f760df09640 1 --2- 172.21.15.7:0/837293517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4ae07b5d0 0x55c4ae07ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.425+0000 7f760e70a640 1 --2- 172.21.15.7:0/837293517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07cb40 0x55c4ae07b090 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f75f8009430 tx=0x7f75f80039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba8ca709e662bf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.426+0000 7f75effff640 1 -- 172.21.15.7:0/837293517 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f80319a0 con 0x55c4ae07cb40 2024-09-19T08:51:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.426+0000 7f75effff640 1 -- 172.21.15.7:0/837293517 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75f804f070 con 0x55c4ae07cb40 2024-09-19T08:51:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.426+0000 7f75effff640 1 -- 172.21.15.7:0/837293517 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f802fbf0 con 0x55c4ae07cb40 2024-09-19T08:51:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.426+0000 7f760e70a640 1 --2- 172.21.15.7:0/1691022903 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f75f00a33b0 0x7f75f00a5870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f75f8004af0 tx=0x7f75f804c000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.426+0000 7f7612546740 1 -- 172.21.15.7:0/837293517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07cb40 msgr2=0x55c4ae07b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.426+0000 7f7612546740 1 --2- 172.21.15.7:0/837293517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07cb40 0x55c4ae07b090 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f75f8009430 tx=0x7f75f80039f0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.427+0000 7f7612546740 1 -- 172.21.15.7:0/837293517 shutdown_connections 2024-09-19T08:51:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.427+0000 7f7612546740 1 --2- 172.21.15.7:0/837293517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ae086370 0x55c4ae088760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.427+0000 7f7612546740 1 --2- 172.21.15.7:0/837293517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4ae07b5d0 0x55c4ae07ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.427+0000 7f7612546740 1 --2- 172.21.15.7:0/837293517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07cb40 0x55c4ae07b090 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.427+0000 7f7612546740 1 -- 172.21.15.7:0/837293517 >> 172.21.15.7:0/837293517 conn(0x55c4ae044310 msgr2=0x55c4ae077c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.427+0000 7f7612546740 1 -- 172.21.15.7:0/837293517 shutdown_connections 2024-09-19T08:51:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.427+0000 7f7612546740 1 -- 172.21.15.7:0/837293517 wait complete. 2024-09-19T08:51:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.427+0000 7f7612546740 1 -- start start 2024-09-19T08:51:57.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.427+0000 7f7612546740 1 Processor -- start 2024-09-19T08:51:57.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.427+0000 7f7612546740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07b5d0 0x55c4ae085d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.428+0000 7f7612546740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ae07cb40 0x55c4ae082ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.428+0000 7f7612546740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4ae086370 0x55c4ae0835e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.428+0000 7f7612546740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c4ae088ef0 con 0x55c4ae07b5d0 2024-09-19T08:51:57.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.428+0000 7f7612546740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c4adf9c060 con 0x55c4ae086370 2024-09-19T08:51:57.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.428+0000 7f7612546740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c4ae089070 con 0x55c4ae07cb40 2024-09-19T08:51:57.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.428+0000 7f7612546740 10 client.0 _ll_register_callbacks cb 0x55c4adcef8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:57.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.428+0000 7f760df09640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07b5d0 0x55c4ae085d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.428+0000 7f760df09640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07b5d0 0x55c4ae085d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55086/0 (socket says 172.21.15.7:55086) 2024-09-19T08:51:57.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.428+0000 7f760df09640 1 -- 172.21.15.7:0/2519829152 learned_addr learned my addr 172.21.15.7:0/2519829152 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:57.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.428+0000 7f760d708640 1 --2- 172.21.15.7:0/2519829152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ae07cb40 0x55c4ae082ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.428+0000 7f760e70a640 1 --2- 172.21.15.7:0/2519829152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4ae086370 0x55c4ae0835e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.428+0000 7f760df09640 1 -- 172.21.15.7:0/2519829152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ae07cb40 msgr2=0x55c4ae082ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:57.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.428+0000 7f760df09640 1 --2- 172.21.15.7:0/2519829152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ae07cb40 0x55c4ae082ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.428+0000 7f760df09640 1 -- 172.21.15.7:0/2519829152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4ae086370 msgr2=0x55c4ae0835e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:57.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.428+0000 7f760df09640 1 --2- 172.21.15.7:0/2519829152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4ae086370 0x55c4ae0835e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.428+0000 7f760df09640 1 -- 172.21.15.7:0/2519829152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4add523c0 con 0x55c4ae07b5d0 2024-09-19T08:51:57.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.428+0000 7f760df09640 1 --2- 172.21.15.7:0/2519829152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07b5d0 0x55c4ae085d40 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f760000b840 tx=0x7f760000bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc2f797cb10c541 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:57.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.428+0000 7f75ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:51:57.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.428+0000 7f75ed7fa640 1 -- 172.21.15.7:0/2519829152 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760001b440 con 0x55c4ae07b5d0 2024-09-19T08:51:57.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.428+0000 7f75ed7fa640 1 -- 172.21.15.7:0/2519829152 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f760001b5e0 con 0x55c4ae07b5d0 2024-09-19T08:51:57.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.428+0000 7f7612546740 1 -- 172.21.15.7:0/2519829152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75f804f070 con 0x55c4ae07b5d0 2024-09-19T08:51:57.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.429+0000 7f75ed7fa640 1 -- 172.21.15.7:0/2519829152 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f760001b7e0 con 0x55c4ae07b5d0 2024-09-19T08:51:57.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.429+0000 7f7612546740 10 client.16746 fetch_fsmap learned FSMap version 25 2024-09-19T08:51:57.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.429+0000 7f7612546740 1 -- 172.21.15.7:0/2519829152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c4ae098dd0 con 0x55c4ae07b5d0 2024-09-19T08:51:57.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.429+0000 7f75ed7fa640 1 -- 172.21.15.7:0/2519829152 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75f804f070 con 0x55c4ae07b5d0 2024-09-19T08:51:57.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.429+0000 7f75ed7fa640 1 -- 172.21.15.7:0/2519829152 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7600019020 con 0x55c4ae07b5d0 2024-09-19T08:51:57.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.429+0000 7f7612546740 10 client.16746 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:51:57.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.429+0000 7f7612546740 10 client.16746 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:51:57.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.429+0000 7f7612546740 20 client.16746 populate_metadata read hostname 'smithi007' 2024-09-19T08:51:57.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.429+0000 7f7612546740 1 --2- 172.21.15.7:0/2519829152 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c4ae09a290 0x55c4ae09c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.429+0000 7f7612546740 4 client.16746 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:51:57.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.429+0000 7f7612546740 1 -- 172.21.15.7:0/2519829152 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4adfee860 con 0x55c4ae09a290 2024-09-19T08:51:57.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.429+0000 7f760d708640 1 --2- 172.21.15.7:0/2519829152 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c4ae09a290 0x55c4ae09c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.430+0000 7f760d708640 1 --2- 172.21.15.7:0/2519829152 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c4ae09a290 0x55c4ae09c6c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c0b861518f1c2c3b server_cookie=5c41a4bf42490316 in_seq=0 out_seq=0 2024-09-19T08:51:57.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.430+0000 7f75ed7fa640 10 client.16746 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:51:57.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.430+0000 7f75ed7fa640 1 -- 172.21.15.7:0/2519829152 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c4adfee860 con 0x55c4ae09a290 2024-09-19T08:51:57.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.431+0000 7f75ed7fa640 10 client.16746 handle_command_reply: tid=0 2024-09-19T08:51:57.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.431+0000 7f7612546740 1 client.16746 shutdown 2024-09-19T08:51:57.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.431+0000 7f7612546740 1 -- 172.21.15.7:0/2519829152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07b5d0 msgr2=0x55c4ae085d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:57.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.431+0000 7f7612546740 1 --2- 172.21.15.7:0/2519829152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07b5d0 0x55c4ae085d40 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f760000b840 tx=0x7f760000bd00 comp rx=0 tx=0).stop 2024-09-19T08:51:57.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.431+0000 7f7612546740 1 -- 172.21.15.7:0/2519829152 shutdown_connections 2024-09-19T08:51:57.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.431+0000 7f7612546740 1 --2- 172.21.15.7:0/2519829152 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c4ae09a290 0x55c4ae09c6c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.431+0000 7f7612546740 1 --2- 172.21.15.7:0/2519829152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4ae086370 0x55c4ae0835e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.431+0000 7f7612546740 1 --2- 172.21.15.7:0/2519829152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ae07cb40 0x55c4ae082ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.431+0000 7f75ed7fa640 0 client.16746 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:51:57.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.431+0000 7f7612546740 1 --2- 172.21.15.7:0/2519829152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07b5d0 0x55c4ae085d40 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.431+0000 7f7612546740 1 -- 172.21.15.7:0/2519829152 >> 172.21.15.7:0/2519829152 conn(0x55c4ae044310 msgr2=0x55c4ae07d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:57.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.431+0000 7f7612546740 1 -- 172.21.15.7:0/2519829152 shutdown_connections 2024-09-19T08:51:57.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.431+0000 7f7612546740 1 -- 172.21.15.7:0/2519829152 wait complete. 2024-09-19T08:51:57.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.431+0000 7f7612546740 20 client.16746 trim_cache size 0 max 16384 2024-09-19T08:51:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.444+0000 7f7612546740 1 Processor -- start 2024-09-19T08:51:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.444+0000 7f7612546740 1 -- start start 2024-09-19T08:51:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.444+0000 7f7612546740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ae07b5d0 0x55c4ae096620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.444+0000 7f7612546740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07cb40 0x55c4ae076bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.444+0000 7f7612546740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4ae086370 0x55c4ae0a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.444+0000 7f7612546740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f76081ae0c0 con 0x55c4ae07cb40 2024-09-19T08:51:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.444+0000 7f7612546740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f76081ab990 con 0x55c4ae086370 2024-09-19T08:51:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.444+0000 7f7612546740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f76081a9800 con 0x55c4ae07b5d0 2024-09-19T08:51:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.444+0000 7f760d708640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07cb40 0x55c4ae076bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.444+0000 7f760d708640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07cb40 0x55c4ae076bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55100/0 (socket says 172.21.15.7:55100) 2024-09-19T08:51:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.444+0000 7f760d708640 1 -- 172.21.15.7:0/1636783512 learned_addr learned my addr 172.21.15.7:0/1636783512 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:57.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.445+0000 7f760df09640 1 --2- 172.21.15.7:0/1636783512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ae07b5d0 0x55c4ae096620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.445+0000 7f760e70a640 1 --2- 172.21.15.7:0/1636783512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4ae086370 0x55c4ae0a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.445+0000 7f760d708640 1 -- 172.21.15.7:0/1636783512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ae07b5d0 msgr2=0x55c4ae096620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.445+0000 7f760d708640 1 --2- 172.21.15.7:0/1636783512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ae07b5d0 0x55c4ae096620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.445+0000 7f760d708640 1 -- 172.21.15.7:0/1636783512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4ae086370 msgr2=0x55c4ae0a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.445+0000 7f760d708640 1 --2- 172.21.15.7:0/1636783512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4ae086370 0x55c4ae0a1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.445+0000 7f760d708640 1 -- 172.21.15.7:0/1636783512 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4ae09cd40 con 0x55c4ae07cb40 2024-09-19T08:51:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.445+0000 7f760df09640 1 --2- 172.21.15.7:0/1636783512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ae07b5d0 0x55c4ae096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.445+0000 7f760d708640 1 --2- 172.21.15.7:0/1636783512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07cb40 0x55c4ae076bf0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0cd020 tx=0x7f75fc0168b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb295be343fdce07 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.445+0000 7f75ef7fe640 1 -- 172.21.15.7:0/1636783512 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc020040 con 0x55c4ae07cb40 2024-09-19T08:51:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.445+0000 7f75ef7fe640 1 -- 172.21.15.7:0/1636783512 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75fc099f00 con 0x55c4ae07cb40 2024-09-19T08:51:57.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.445+0000 7f75ef7fe640 1 -- 172.21.15.7:0/1636783512 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc086310 con 0x55c4ae07cb40 2024-09-19T08:51:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.446+0000 7f7612546740 1 -- 172.21.15.7:0/1636783512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07cb40 msgr2=0x55c4ae076bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.446+0000 7f7612546740 1 --2- 172.21.15.7:0/1636783512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07cb40 0x55c4ae076bf0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0cd020 tx=0x7f75fc0168b0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.446+0000 7f7612546740 1 -- 172.21.15.7:0/1636783512 shutdown_connections 2024-09-19T08:51:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.446+0000 7f7612546740 1 --2- 172.21.15.7:0/1636783512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4ae086370 0x55c4ae0a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.446+0000 7f7612546740 1 --2- 172.21.15.7:0/1636783512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07cb40 0x55c4ae076bf0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.446+0000 7f7612546740 1 --2- 172.21.15.7:0/1636783512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ae07b5d0 0x55c4ae096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.446+0000 7f7612546740 1 -- 172.21.15.7:0/1636783512 >> 172.21.15.7:0/1636783512 conn(0x55c4ae044310 msgr2=0x55c4ae0764e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.446+0000 7f7612546740 1 -- 172.21.15.7:0/1636783512 shutdown_connections 2024-09-19T08:51:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.446+0000 7f7612546740 1 -- 172.21.15.7:0/1636783512 wait complete. 2024-09-19T08:51:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.446+0000 7f7612546740 1 -- start start 2024-09-19T08:51:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.446+0000 7f7612546740 1 Processor -- start 2024-09-19T08:51:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.446+0000 7f7612546740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4ae07b5d0 0x55c4ae0927a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.446+0000 7f7612546740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07cb40 0x55c4ae092ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.446+0000 7f7612546740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ae086370 0x55c4ae08ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.446+0000 7f7612546740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f76081a9e50 con 0x55c4ae07cb40 2024-09-19T08:51:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.446+0000 7f7612546740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f76081ab2c0 con 0x55c4ae07b5d0 2024-09-19T08:51:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.446+0000 7f7612546740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f76081aa520 con 0x55c4ae086370 2024-09-19T08:51:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.447+0000 7f7612546740 10 client.0 _ll_register_callbacks cb 0x7f7600005c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.447+0000 7f760d708640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07cb40 0x55c4ae092ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.447+0000 7f760d708640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07cb40 0x55c4ae092ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55110/0 (socket says 172.21.15.7:55110) 2024-09-19T08:51:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.447+0000 7f760d708640 1 -- 172.21.15.7:0/794147031 learned_addr learned my addr 172.21.15.7:0/794147031 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.447+0000 7f760df09640 1 --2- 172.21.15.7:0/794147031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4ae07b5d0 0x55c4ae0927a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.447+0000 7f760e70a640 1 --2- 172.21.15.7:0/794147031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ae086370 0x55c4ae08ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.447+0000 7f760d708640 1 -- 172.21.15.7:0/794147031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ae086370 msgr2=0x55c4ae08ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.447+0000 7f760d708640 1 --2- 172.21.15.7:0/794147031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ae086370 0x55c4ae08ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.447+0000 7f760d708640 1 -- 172.21.15.7:0/794147031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4ae07b5d0 msgr2=0x55c4ae0927a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.447+0000 7f760d708640 1 --2- 172.21.15.7:0/794147031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4ae07b5d0 0x55c4ae0927a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.447+0000 7f760d708640 1 -- 172.21.15.7:0/794147031 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4ae08f450 con 0x55c4ae07cb40 2024-09-19T08:51:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.447+0000 7f760df09640 1 --2- 172.21.15.7:0/794147031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4ae07b5d0 0x55c4ae0927a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.447+0000 7f760d708640 1 --2- 172.21.15.7:0/794147031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07cb40 0x55c4ae092ce0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0a4290 tx=0x7f75fc0a4940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b08b75a265a682c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.447+0000 7f75ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:51:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.447+0000 7f75ed7fa640 1 -- 172.21.15.7:0/794147031 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc0b9060 con 0x55c4ae07cb40 2024-09-19T08:51:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.447+0000 7f75ed7fa640 1 -- 172.21.15.7:0/794147031 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f75fc0860b0 con 0x55c4ae07cb40 2024-09-19T08:51:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.447+0000 7f7612546740 1 -- 172.21.15.7:0/794147031 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75fc099f00 con 0x55c4ae07cb40 2024-09-19T08:51:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.447+0000 7f75ed7fa640 1 -- 172.21.15.7:0/794147031 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f75fc0cd440 con 0x55c4ae07cb40 2024-09-19T08:51:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.447+0000 7f7612546740 10 client.16752 fetch_fsmap learned FSMap version 25 2024-09-19T08:51:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.447+0000 7f7612546740 1 -- 172.21.15.7:0/794147031 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c4ae105920 con 0x55c4ae07cb40 2024-09-19T08:51:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.448+0000 7f75ed7fa640 1 -- 172.21.15.7:0/794147031 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75fc099f00 con 0x55c4ae07cb40 2024-09-19T08:51:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.448+0000 7f75ed7fa640 1 -- 172.21.15.7:0/794147031 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f75fc09b050 con 0x55c4ae07cb40 2024-09-19T08:51:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.448+0000 7f7612546740 10 client.16752 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:51:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.448+0000 7f7612546740 10 client.16752 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:51:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.448+0000 7f7612546740 20 client.16752 populate_metadata read hostname 'smithi007' 2024-09-19T08:51:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.448+0000 7f7612546740 1 --2- 172.21.15.7:0/794147031 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c4ae1060d0 0x55c4ae1084f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.448+0000 7f7612546740 4 client.16752 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:51:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.448+0000 7f7612546740 1 -- 172.21.15.7:0/794147031 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c4adfe8d70 con 0x55c4ae1060d0 2024-09-19T08:51:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.448+0000 7f760df09640 1 --2- 172.21.15.7:0/794147031 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c4ae1060d0 0x55c4ae1084f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.449+0000 7f760df09640 1 --2- 172.21.15.7:0/794147031 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c4ae1060d0 0x55c4ae1084f0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4c7a99965809be0d server_cookie=6a5ec8023fc08bee in_seq=0 out_seq=0 2024-09-19T08:51:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.449+0000 7f75ed7fa640 10 client.16752 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:51:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.449+0000 7f75ed7fa640 1 -- 172.21.15.7:0/794147031 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c4adfe8d70 con 0x55c4ae1060d0 2024-09-19T08:51:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.449+0000 7f75ed7fa640 10 client.16752 handle_command_reply: tid=0 2024-09-19T08:51:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.449+0000 7f7612546740 1 client.16752 shutdown 2024-09-19T08:51:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.449+0000 7f7612546740 1 -- 172.21.15.7:0/794147031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07cb40 msgr2=0x55c4ae092ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:57.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.449+0000 7f7612546740 1 --2- 172.21.15.7:0/794147031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07cb40 0x55c4ae092ce0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0a4290 tx=0x7f75fc0a4940 comp rx=0 tx=0).stop 2024-09-19T08:51:57.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.449+0000 7f7612546740 1 -- 172.21.15.7:0/794147031 shutdown_connections 2024-09-19T08:51:57.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.449+0000 7f7612546740 1 --2- 172.21.15.7:0/794147031 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c4ae1060d0 0x55c4ae1084f0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.449+0000 7f7612546740 1 --2- 172.21.15.7:0/794147031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4ae086370 0x55c4ae08ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.449+0000 7f7612546740 1 --2- 172.21.15.7:0/794147031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4ae07cb40 0x55c4ae092ce0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.449+0000 7f75ed7fa640 0 client.16752 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:51:57.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.449+0000 7f7612546740 1 --2- 172.21.15.7:0/794147031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c4ae07b5d0 0x55c4ae0927a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.449+0000 7f7612546740 1 -- 172.21.15.7:0/794147031 >> 172.21.15.7:0/794147031 conn(0x55c4ae044310 msgr2=0x55c4ae0764e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:57.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.449+0000 7f7612546740 1 -- 172.21.15.7:0/794147031 shutdown_connections 2024-09-19T08:51:57.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.449+0000 7f7612546740 1 -- 172.21.15.7:0/794147031 wait complete. 2024-09-19T08:51:57.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.449+0000 7f7612546740 20 client.16752 trim_cache size 0 max 16384 2024-09-19T08:51:57.457 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:51:57.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.450+0000 7f761016d640 1 -- 172.21.15.7:0/1691022903 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f75f00a33b0 msgr2=0x7f75f00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:57.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.450+0000 7f761016d640 1 --2- 172.21.15.7:0/1691022903 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f75f00a33b0 0x7f75f00a5870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f75f8004af0 tx=0x7f75f804c000 comp rx=0 tx=0).stop 2024-09-19T08:51:57.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.450+0000 7f761016d640 1 -- 172.21.15.7:0/1691022903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7608102790 msgr2=0x7f7608198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:57.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.450+0000 7f761016d640 1 --2- 172.21.15.7:0/1691022903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7608102790 0x7f7608198930 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00d950 tx=0x7f75fc00de10 comp rx=0 tx=0).stop 2024-09-19T08:51:57.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.450+0000 7f761016d640 1 -- 172.21.15.7:0/1691022903 shutdown_connections 2024-09-19T08:51:57.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.450+0000 7f761016d640 1 --2- 172.21.15.7:0/1691022903 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f75f00a33b0 0x7f75f00a5870 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.450+0000 7f761016d640 1 --2- 172.21.15.7:0/1691022903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7608106f10 0x7f760819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.450+0000 7f761016d640 1 --2- 172.21.15.7:0/1691022903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7608102790 0x7f7608198930 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.450+0000 7f761016d640 1 --2- 172.21.15.7:0/1691022903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7608101de0 0x7f76081983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.450+0000 7f761016d640 1 -- 172.21.15.7:0/1691022903 >> 172.21.15.7:0/1691022903 conn(0x7f76080fd8c0 msgr2=0x7f76080feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:57.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.450+0000 7f761016d640 1 -- 172.21.15.7:0/1691022903 shutdown_connections 2024-09-19T08:51:57.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:57.450+0000 7f761016d640 1 -- 172.21.15.7:0/1691022903 wait complete. 2024-09-19T08:51:58.259 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:51:58.518 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:58.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:51:58 smithi007 ceph-mon[31221]: pgmap v228: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:51:58.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:51:58 smithi175 ceph-mon[35688]: pgmap v228: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:51:58.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:51:58 smithi044 ceph-mon[35072]: pgmap v228: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:51:59.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.068+0000 7f7977f47640 1 -- 172.21.15.7:0/1260457985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7970106a80 msgr2=0x7f7970106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:59.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.068+0000 7f7977f47640 1 --2- 172.21.15.7:0/1260457985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7970106a80 0x7f7970106e60 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f796c009930 tx=0x7f796c02a420 comp rx=0 tx=0).stop 2024-09-19T08:51:59.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.068+0000 7f7977f47640 1 -- 172.21.15.7:0/1260457985 shutdown_connections 2024-09-19T08:51:59.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.068+0000 7f7977f47640 1 --2- 172.21.15.7:0/1260457985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7970101420 0x7f797010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.068+0000 7f7977f47640 1 --2- 172.21.15.7:0/1260457985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7970100a80 0x7f7970100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.068+0000 7f7977f47640 1 --2- 172.21.15.7:0/1260457985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7970106a80 0x7f7970106e60 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.068+0000 7f7977f47640 1 -- 172.21.15.7:0/1260457985 >> 172.21.15.7:0/1260457985 conn(0x7f79700fc7a0 msgr2=0x7f79700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:59.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.068+0000 7f7977f47640 1 -- 172.21.15.7:0/1260457985 shutdown_connections 2024-09-19T08:51:59.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.068+0000 7f7977f47640 1 -- 172.21.15.7:0/1260457985 wait complete. 2024-09-19T08:51:59.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.069+0000 7f7977f47640 1 Processor -- start 2024-09-19T08:51:59.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.069+0000 7f7977f47640 1 -- start start 2024-09-19T08:51:59.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.069+0000 7f7977f47640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7970100a80 0x7f79701991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.069+0000 7f7977f47640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7970101420 0x7f7970199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.069+0000 7f7977f47640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7970106a80 0x7f79701a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.069+0000 7f7977f47640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7970110e80 con 0x7f7970100a80 2024-09-19T08:51:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.069+0000 7f7977f47640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7970110d00 con 0x7f7970101420 2024-09-19T08:51:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.069+0000 7f7977f47640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7970111000 con 0x7f7970106a80 2024-09-19T08:51:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.069+0000 7f7975ce3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7970100a80 0x7f79701991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.069+0000 7f7975ce3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7970100a80 0x7f79701991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55134/0 (socket says 172.21.15.7:55134) 2024-09-19T08:51:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.069+0000 7f7975ce3640 1 -- 172.21.15.7:0/1024403293 learned_addr learned my addr 172.21.15.7:0/1024403293 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.070+0000 7f79754e2640 1 --2- 172.21.15.7:0/1024403293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7970101420 0x7f7970199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.070+0000 7f79764e4640 1 --2- 172.21.15.7:0/1024403293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7970106a80 0x7f79701a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.070+0000 7f7975ce3640 1 -- 172.21.15.7:0/1024403293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7970106a80 msgr2=0x7f79701a4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.070+0000 7f7975ce3640 1 --2- 172.21.15.7:0/1024403293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7970106a80 0x7f79701a4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.070+0000 7f7975ce3640 1 -- 172.21.15.7:0/1024403293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7970101420 msgr2=0x7f7970199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.070+0000 7f7975ce3640 1 --2- 172.21.15.7:0/1024403293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7970101420 0x7f7970199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.070+0000 7f7975ce3640 1 -- 172.21.15.7:0/1024403293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79701a47b0 con 0x7f7970100a80 2024-09-19T08:51:59.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.070+0000 7f7975ce3640 1 --2- 172.21.15.7:0/1024403293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7970100a80 0x7f79701991f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f796c009230 tx=0x7f796c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:59.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.070+0000 7f7966ffd640 1 -- 172.21.15.7:0/1024403293 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c03f030 con 0x7f7970100a80 2024-09-19T08:51:59.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.070+0000 7f7977f47640 1 -- 172.21.15.7:0/1024403293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79701a4980 con 0x7f7970100a80 2024-09-19T08:51:59.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.070+0000 7f7966ffd640 1 -- 172.21.15.7:0/1024403293 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f796c003ad0 con 0x7f7970100a80 2024-09-19T08:51:59.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.070+0000 7f7966ffd640 1 -- 172.21.15.7:0/1024403293 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c035070 con 0x7f7970100a80 2024-09-19T08:51:59.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.070+0000 7f7977f47640 1 -- 172.21.15.7:0/1024403293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79701a4e60 con 0x7f7970100a80 2024-09-19T08:51:59.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.073+0000 7f7966ffd640 1 -- 172.21.15.7:0/1024403293 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f796c042030 con 0x7f7970100a80 2024-09-19T08:51:59.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.073+0000 7f797a320740 1 Processor -- start 2024-09-19T08:51:59.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.073+0000 7f797a320740 1 -- start start 2024-09-19T08:51:59.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.073+0000 7f797a320740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7cfb40 0x5558de7ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.073+0000 7f797a320740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.073+0000 7f797a320740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558de7d9370 0x5558de7db760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.073+0000 7f797a320740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5558de7342f0 con 0x5558de7ce5d0 2024-09-19T08:51:59.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.073+0000 7f797a320740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5558de6dbcf0 con 0x5558de7cfb40 2024-09-19T08:51:59.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.073+0000 7f797a320740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5558de7302b0 con 0x5558de7d9370 2024-09-19T08:51:59.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.073+0000 7f7975ce3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.073+0000 7f7975ce3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7cea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55138/0 (socket says 172.21.15.7:55138) 2024-09-19T08:51:59.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.073+0000 7f7975ce3640 1 -- 172.21.15.7:0/1746135581 learned_addr learned my addr 172.21.15.7:0/1746135581 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:59.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.073+0000 7f79764e4640 1 --2- 172.21.15.7:0/1746135581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7cfb40 0x5558de7ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.074+0000 7f7966ffd640 1 --2- 172.21.15.7:0/1024403293 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f795c0a33b0 0x7f795c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.074+0000 7f79754e2640 1 --2- 172.21.15.7:0/1746135581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558de7d9370 0x5558de7db760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.074+0000 7f79764e4640 1 --2- 172.21.15.7:0/1024403293 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f795c0a33b0 0x7f795c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.074+0000 7f79764e4640 1 -- 172.21.15.7:0/1746135581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558de7d9370 msgr2=0x5558de7db760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:59.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.074+0000 7f7966ffd640 1 -- 172.21.15.7:0/1024403293 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f796c0f0230 con 0x7f7970100a80 2024-09-19T08:51:59.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.074+0000 7f79764e4640 1 --2- 172.21.15.7:0/1746135581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558de7d9370 0x5558de7db760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.074+0000 7f79764e4640 1 -- 172.21.15.7:0/1746135581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 msgr2=0x5558de7cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:59.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.074+0000 7f79764e4640 1 --2- 172.21.15.7:0/1746135581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.074+0000 7f79764e4640 1 -- 172.21.15.7:0/1746135581 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558de6c03a0 con 0x5558de7cfb40 2024-09-19T08:51:59.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.074+0000 7f7975ce3640 1 --2- 172.21.15.7:0/1746135581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:59.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.074+0000 7f79764e4640 1 --2- 172.21.15.7:0/1746135581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7cfb40 0x5558de7ce090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f79680127d0 tx=0x7f7968012c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eac796cc7fdfff93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:59.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.074+0000 7f79764e4640 1 --2- 172.21.15.7:0/1024403293 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f795c0a33b0 0x7f795c0a5870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f796801a000 tx=0x7f796801c000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:59.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.074+0000 7f795bfff640 1 -- 172.21.15.7:0/1746135581 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7968004d20 con 0x5558de7cfb40 2024-09-19T08:51:59.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.074+0000 7f795bfff640 1 -- 172.21.15.7:0/1746135581 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7968020030 con 0x5558de7cfb40 2024-09-19T08:51:59.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.074+0000 7f795bfff640 1 -- 172.21.15.7:0/1746135581 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79680053b0 con 0x5558de7cfb40 2024-09-19T08:51:59.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.075+0000 7f797a320740 1 -- 172.21.15.7:0/1746135581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7cfb40 msgr2=0x5558de7ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:59.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.075+0000 7f797a320740 1 --2- 172.21.15.7:0/1746135581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7cfb40 0x5558de7ce090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f79680127d0 tx=0x7f7968012c90 comp rx=0 tx=0).stop 2024-09-19T08:51:59.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.075+0000 7f797a320740 1 -- 172.21.15.7:0/1746135581 shutdown_connections 2024-09-19T08:51:59.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.075+0000 7f797a320740 1 --2- 172.21.15.7:0/1746135581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558de7d9370 0x5558de7db760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.075+0000 7f797a320740 1 --2- 172.21.15.7:0/1746135581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.075+0000 7f797a320740 1 --2- 172.21.15.7:0/1746135581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7cfb40 0x5558de7ce090 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.075+0000 7f797a320740 1 -- 172.21.15.7:0/1746135581 >> 172.21.15.7:0/1746135581 conn(0x5558de797310 msgr2=0x5558de7cac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:59.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.075+0000 7f797a320740 1 -- 172.21.15.7:0/1746135581 shutdown_connections 2024-09-19T08:51:59.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.075+0000 7f797a320740 1 -- 172.21.15.7:0/1746135581 wait complete. 2024-09-19T08:51:59.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.076+0000 7f797a320740 1 -- start start 2024-09-19T08:51:59.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.076+0000 7f797a320740 1 Processor -- start 2024-09-19T08:51:59.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.076+0000 7f797a320740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7d8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.076+0000 7f797a320740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558de7cfb40 0x5558de7d6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.076+0000 7f797a320740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7d9370 0x5558de7d6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.076+0000 7f797a320740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5558de7e0420 con 0x5558de7ce5d0 2024-09-19T08:51:59.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.076+0000 7f797a320740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5558de6ef060 con 0x5558de7d9370 2024-09-19T08:51:59.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.076+0000 7f797a320740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5558de7e05a0 con 0x5558de7cfb40 2024-09-19T08:51:59.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.076+0000 7f797a320740 10 client.0 _ll_register_callbacks cb 0x5558de4428c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:59.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.076+0000 7f7975ce3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7d8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.077+0000 7f7975ce3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7d8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55140/0 (socket says 172.21.15.7:55140) 2024-09-19T08:51:59.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.077+0000 7f7975ce3640 1 -- 172.21.15.7:0/2074593761 learned_addr learned my addr 172.21.15.7:0/2074593761 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:59.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.077+0000 7f79754e2640 1 --2- 172.21.15.7:0/2074593761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558de7cfb40 0x5558de7d6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.077+0000 7f79764e4640 1 --2- 172.21.15.7:0/2074593761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7d9370 0x5558de7d6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.077+0000 7f7975ce3640 1 -- 172.21.15.7:0/2074593761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558de7cfb40 msgr2=0x5558de7d6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:59.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.077+0000 7f7975ce3640 1 --2- 172.21.15.7:0/2074593761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558de7cfb40 0x5558de7d6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.077+0000 7f7975ce3640 1 -- 172.21.15.7:0/2074593761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7d9370 msgr2=0x5558de7d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:59.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.077+0000 7f7975ce3640 1 --2- 172.21.15.7:0/2074593761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7d9370 0x5558de7d6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.077+0000 7f7975ce3640 1 -- 172.21.15.7:0/2074593761 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558de4a53c0 con 0x5558de7ce5d0 2024-09-19T08:51:59.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.077+0000 7f79764e4640 1 --2- 172.21.15.7:0/2074593761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7d9370 0x5558de7d6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:59.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.077+0000 7f7975ce3640 1 --2- 172.21.15.7:0/2074593761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7d8d90 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f796c0edf40 tx=0x7f796c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9b87d8917d033 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:59.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.077+0000 7f79597fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:51:59.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.077+0000 7f79597fa640 1 -- 172.21.15.7:0/2074593761 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c049040 con 0x5558de7ce5d0 2024-09-19T08:51:59.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.077+0000 7f797a320740 1 -- 172.21.15.7:0/2074593761 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7968020030 con 0x5558de7ce5d0 2024-09-19T08:51:59.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.077+0000 7f79597fa640 1 -- 172.21.15.7:0/2074593761 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f796c003c80 con 0x5558de7ce5d0 2024-09-19T08:51:59.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.077+0000 7f79597fa640 1 -- 172.21.15.7:0/2074593761 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f796c0bcbd0 con 0x5558de7ce5d0 2024-09-19T08:51:59.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.077+0000 7f797a320740 10 client.16764 fetch_fsmap learned FSMap version 25 2024-09-19T08:51:59.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.077+0000 7f797a320740 1 -- 172.21.15.7:0/2074593761 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5558de7ebef0 con 0x5558de7ce5d0 2024-09-19T08:51:59.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.077+0000 7f79597fa640 1 -- 172.21.15.7:0/2074593761 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7968020030 con 0x5558de7ce5d0 2024-09-19T08:51:59.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.078+0000 7f79597fa640 1 -- 172.21.15.7:0/2074593761 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f796c0b8b40 con 0x5558de7ce5d0 2024-09-19T08:51:59.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.078+0000 7f797a320740 10 client.16764 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:51:59.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.078+0000 7f797a320740 10 client.16764 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:51:59.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.078+0000 7f797a320740 20 client.16764 populate_metadata read hostname 'smithi007' 2024-09-19T08:51:59.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.078+0000 7f797a320740 1 --2- 172.21.15.7:0/2074593761 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5558de7ed3a0 0x5558de7ef7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.078+0000 7f797a320740 4 client.16764 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:51:59.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.078+0000 7f797a320740 1 -- 172.21.15.7:0/2074593761 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558de741860 con 0x5558de7ed3a0 2024-09-19T08:51:59.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.078+0000 7f79754e2640 1 --2- 172.21.15.7:0/2074593761 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5558de7ed3a0 0x5558de7ef7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.079+0000 7f79597fa640 10 client.16764 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:51:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.079+0000 7f79754e2640 1 --2- 172.21.15.7:0/2074593761 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5558de7ed3a0 0x5558de7ef7d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9eead92f9d08c66e server_cookie=f16739561a315e9d in_seq=0 out_seq=0 2024-09-19T08:51:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.079+0000 7f79597fa640 1 -- 172.21.15.7:0/2074593761 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5558de741860 con 0x5558de7ed3a0 2024-09-19T08:51:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.079+0000 7f79597fa640 10 client.16764 handle_command_reply: tid=0 2024-09-19T08:51:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.079+0000 7f797a320740 1 client.16764 shutdown 2024-09-19T08:51:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.079+0000 7f797a320740 1 -- 172.21.15.7:0/2074593761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 msgr2=0x5558de7d8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.079+0000 7f797a320740 1 --2- 172.21.15.7:0/2074593761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7d8d90 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f796c0edf40 tx=0x7f796c02a420 comp rx=0 tx=0).stop 2024-09-19T08:51:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.080+0000 7f797a320740 1 -- 172.21.15.7:0/2074593761 shutdown_connections 2024-09-19T08:51:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.080+0000 7f797a320740 1 --2- 172.21.15.7:0/2074593761 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5558de7ed3a0 0x5558de7ef7d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.080+0000 7f797a320740 1 --2- 172.21.15.7:0/2074593761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7d9370 0x5558de7d6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.080+0000 7f797a320740 1 --2- 172.21.15.7:0/2074593761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558de7cfb40 0x5558de7d6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.080+0000 7f79597fa640 0 client.16764 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:51:59.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.080+0000 7f797a320740 1 --2- 172.21.15.7:0/2074593761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7d8d90 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.080+0000 7f797a320740 1 -- 172.21.15.7:0/2074593761 >> 172.21.15.7:0/2074593761 conn(0x5558de797310 msgr2=0x5558de7d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:59.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.080+0000 7f797a320740 1 -- 172.21.15.7:0/2074593761 shutdown_connections 2024-09-19T08:51:59.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.080+0000 7f797a320740 1 -- 172.21.15.7:0/2074593761 wait complete. 2024-09-19T08:51:59.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.080+0000 7f797a320740 20 client.16764 trim_cache size 0 max 16384 2024-09-19T08:51:59.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.093+0000 7f797a320740 1 Processor -- start 2024-09-19T08:51:59.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.093+0000 7f797a320740 1 -- start start 2024-09-19T08:51:59.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.093+0000 7f797a320740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7d1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.093+0000 7f797a320740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558de7cfb40 0x5558de7d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.093+0000 7f797a320740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7d9370 0x5558de7f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.093+0000 7f797a320740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f79701adf70 con 0x5558de7ce5d0 2024-09-19T08:51:59.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.093+0000 7f797a320740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f79701ab840 con 0x5558de7d9370 2024-09-19T08:51:59.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.093+0000 7f797a320740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f79701a96b0 con 0x5558de7cfb40 2024-09-19T08:51:59.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.093+0000 7f7975ce3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.093+0000 7f7975ce3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7d1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55154/0 (socket says 172.21.15.7:55154) 2024-09-19T08:51:59.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.093+0000 7f7975ce3640 1 -- 172.21.15.7:0/1343758365 learned_addr learned my addr 172.21.15.7:0/1343758365 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:59.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.093+0000 7f79754e2640 1 --2- 172.21.15.7:0/1343758365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558de7cfb40 0x5558de7d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.093+0000 7f79764e4640 1 --2- 172.21.15.7:0/1343758365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7d9370 0x5558de7f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.093+0000 7f7975ce3640 1 -- 172.21.15.7:0/1343758365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558de7cfb40 msgr2=0x5558de7d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:59.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.093+0000 7f7975ce3640 1 --2- 172.21.15.7:0/1343758365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558de7cfb40 0x5558de7d1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.093+0000 7f7975ce3640 1 -- 172.21.15.7:0/1343758365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7d9370 msgr2=0x5558de7f50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:59.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.093+0000 7f7975ce3640 1 --2- 172.21.15.7:0/1343758365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7d9370 0x5558de7f50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.093+0000 7f7975ce3640 1 -- 172.21.15.7:0/1343758365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558de7efe50 con 0x5558de7ce5d0 2024-09-19T08:51:59.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.093+0000 7f79754e2640 1 --2- 172.21.15.7:0/1343758365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558de7cfb40 0x5558de7d1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:59.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.093+0000 7f79764e4640 1 --2- 172.21.15.7:0/1343758365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7d9370 0x5558de7f50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:59.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.093+0000 7f7975ce3640 1 --2- 172.21.15.7:0/1343758365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7d1120 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f796c0096c0 tx=0x7f796c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db88266c2108128a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:59.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.094+0000 7f795b7fe640 1 -- 172.21.15.7:0/1343758365 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c0da070 con 0x5558de7ce5d0 2024-09-19T08:51:59.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.094+0000 7f795b7fe640 1 -- 172.21.15.7:0/1343758365 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f796c0c5140 con 0x5558de7ce5d0 2024-09-19T08:51:59.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.094+0000 7f795b7fe640 1 -- 172.21.15.7:0/1343758365 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c049070 con 0x5558de7ce5d0 2024-09-19T08:51:59.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.094+0000 7f797a320740 1 -- 172.21.15.7:0/1343758365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 msgr2=0x5558de7d1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:59.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.094+0000 7f797a320740 1 --2- 172.21.15.7:0/1343758365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7d1120 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f796c0096c0 tx=0x7f796c009260 comp rx=0 tx=0).stop 2024-09-19T08:51:59.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.094+0000 7f797a320740 1 -- 172.21.15.7:0/1343758365 shutdown_connections 2024-09-19T08:51:59.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.094+0000 7f797a320740 1 --2- 172.21.15.7:0/1343758365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7d9370 0x5558de7f50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.094+0000 7f797a320740 1 --2- 172.21.15.7:0/1343758365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558de7cfb40 0x5558de7d1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.094+0000 7f797a320740 1 --2- 172.21.15.7:0/1343758365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7d1120 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.094+0000 7f797a320740 1 -- 172.21.15.7:0/1343758365 >> 172.21.15.7:0/1343758365 conn(0x5558de797310 msgr2=0x5558de7c9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:59.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.094+0000 7f797a320740 1 -- 172.21.15.7:0/1343758365 shutdown_connections 2024-09-19T08:51:59.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.094+0000 7f797a320740 1 -- 172.21.15.7:0/1343758365 wait complete. 2024-09-19T08:51:59.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.095+0000 7f797a320740 1 -- start start 2024-09-19T08:51:59.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.095+0000 7f797a320740 1 Processor -- start 2024-09-19T08:51:59.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.095+0000 7f797a320740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7e18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.095+0000 7f797a320740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7cfb40 0x5558de7e1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.095+0000 7f797a320740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558de7d9370 0x5558de8570b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.095+0000 7f797a320740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f79701a9d00 con 0x5558de7ce5d0 2024-09-19T08:51:59.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.095+0000 7f797a320740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f79701ab170 con 0x5558de7cfb40 2024-09-19T08:51:59.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.095+0000 7f797a320740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f79701aa3d0 con 0x5558de7d9370 2024-09-19T08:51:59.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.095+0000 7f797a320740 10 client.0 _ll_register_callbacks cb 0x7f796c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:59.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.095+0000 7f7975ce3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7e18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.095+0000 7f7975ce3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7e18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55162/0 (socket says 172.21.15.7:55162) 2024-09-19T08:51:59.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.095+0000 7f7975ce3640 1 -- 172.21.15.7:0/3594758612 learned_addr learned my addr 172.21.15.7:0/3594758612 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:51:59.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.095+0000 7f79754e2640 1 --2- 172.21.15.7:0/3594758612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7cfb40 0x5558de7e1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.096+0000 7f79764e4640 1 --2- 172.21.15.7:0/3594758612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558de7d9370 0x5558de8570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.096+0000 7f7975ce3640 1 -- 172.21.15.7:0/3594758612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558de7d9370 msgr2=0x5558de8570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:59.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.096+0000 7f7975ce3640 1 --2- 172.21.15.7:0/3594758612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558de7d9370 0x5558de8570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.096+0000 7f7975ce3640 1 -- 172.21.15.7:0/3594758612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7cfb40 msgr2=0x5558de7e1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:59.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.096+0000 7f7975ce3640 1 --2- 172.21.15.7:0/3594758612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7cfb40 0x5558de7e1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.096+0000 7f7975ce3640 1 -- 172.21.15.7:0/3594758612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558de7e2680 con 0x5558de7ce5d0 2024-09-19T08:51:59.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.096+0000 7f7975ce3640 1 --2- 172.21.15.7:0/3594758612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7e18b0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f796c046040 tx=0x7f796c03b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d539b09828b6fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:59.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.096+0000 7f79597fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:51:59.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.096+0000 7f79597fa640 1 -- 172.21.15.7:0/3594758612 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c0da070 con 0x5558de7ce5d0 2024-09-19T08:51:59.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.096+0000 7f79597fa640 1 -- 172.21.15.7:0/3594758612 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f796c0d5230 con 0x5558de7ce5d0 2024-09-19T08:51:59.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.096+0000 7f797a320740 1 -- 172.21.15.7:0/3594758612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f796c0c5140 con 0x5558de7ce5d0 2024-09-19T08:51:59.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.096+0000 7f79597fa640 1 -- 172.21.15.7:0/3594758612 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f796c049050 con 0x5558de7ce5d0 2024-09-19T08:51:59.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.096+0000 7f797a320740 10 client.16770 fetch_fsmap learned FSMap version 25 2024-09-19T08:51:59.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.096+0000 7f797a320740 1 -- 172.21.15.7:0/3594758612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5558de7e2680 con 0x5558de7ce5d0 2024-09-19T08:51:59.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.096+0000 7f79597fa640 1 -- 172.21.15.7:0/3594758612 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f796c0c5140 con 0x5558de7ce5d0 2024-09-19T08:51:59.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.096+0000 7f79597fa640 1 -- 172.21.15.7:0/3594758612 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f796c03bb90 con 0x5558de7ce5d0 2024-09-19T08:51:59.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.096+0000 7f797a320740 10 client.16770 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:51:59.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.097+0000 7f797a320740 10 client.16770 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:51:59.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.097+0000 7f797a320740 20 client.16770 populate_metadata read hostname 'smithi007' 2024-09-19T08:51:59.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.097+0000 7f797a320740 1 --2- 172.21.15.7:0/3594758612 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5558de858980 0x5558de85ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.097+0000 7f797a320740 4 client.16770 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:51:59.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.097+0000 7f797a320740 1 -- 172.21.15.7:0/3594758612 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5558de73bd70 con 0x5558de858980 2024-09-19T08:51:59.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.097+0000 7f79754e2640 1 --2- 172.21.15.7:0/3594758612 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5558de858980 0x5558de85ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.097+0000 7f79754e2640 1 --2- 172.21.15.7:0/3594758612 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5558de858980 0x5558de85ad70 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c0706d5ba878c4d5 server_cookie=c1d96b1f4aad2b4a in_seq=0 out_seq=0 2024-09-19T08:51:59.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.097+0000 7f79597fa640 10 client.16770 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:51:59.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.097+0000 7f79597fa640 1 -- 172.21.15.7:0/3594758612 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5558de73bd70 con 0x5558de858980 2024-09-19T08:51:59.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.097+0000 7f79597fa640 10 client.16770 handle_command_reply: tid=0 2024-09-19T08:51:59.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.097+0000 7f797a320740 1 client.16770 shutdown 2024-09-19T08:51:59.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.098+0000 7f797a320740 1 -- 172.21.15.7:0/3594758612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 msgr2=0x5558de7e18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:59.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.098+0000 7f797a320740 1 --2- 172.21.15.7:0/3594758612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7e18b0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f796c046040 tx=0x7f796c03b690 comp rx=0 tx=0).stop 2024-09-19T08:51:59.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.098+0000 7f797a320740 1 -- 172.21.15.7:0/3594758612 shutdown_connections 2024-09-19T08:51:59.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.098+0000 7f797a320740 1 --2- 172.21.15.7:0/3594758612 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5558de858980 0x5558de85ad70 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.098+0000 7f797a320740 1 --2- 172.21.15.7:0/3594758612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558de7d9370 0x5558de8570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.098+0000 7f79597fa640 0 client.16770 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:51:59.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.098+0000 7f797a320740 1 --2- 172.21.15.7:0/3594758612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5558de7cfb40 0x5558de7e1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.098+0000 7f797a320740 1 --2- 172.21.15.7:0/3594758612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558de7ce5d0 0x5558de7e18b0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.098+0000 7f797a320740 1 -- 172.21.15.7:0/3594758612 >> 172.21.15.7:0/3594758612 conn(0x5558de797310 msgr2=0x5558de7d78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:59.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.098+0000 7f797a320740 1 -- 172.21.15.7:0/3594758612 shutdown_connections 2024-09-19T08:51:59.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.098+0000 7f797a320740 1 -- 172.21.15.7:0/3594758612 wait complete. 2024-09-19T08:51:59.184 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:51:59.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.098+0000 7f797a320740 20 client.16770 trim_cache size 0 max 16384 2024-09-19T08:51:59.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.098+0000 7f7977f47640 1 -- 172.21.15.7:0/1024403293 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f795c0a33b0 msgr2=0x7f795c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:59.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.098+0000 7f7977f47640 1 --2- 172.21.15.7:0/1024403293 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f795c0a33b0 0x7f795c0a5870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f796801a000 tx=0x7f796801c000 comp rx=0 tx=0).stop 2024-09-19T08:51:59.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.098+0000 7f7977f47640 1 -- 172.21.15.7:0/1024403293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7970100a80 msgr2=0x7f79701991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:59.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.098+0000 7f7977f47640 1 --2- 172.21.15.7:0/1024403293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7970100a80 0x7f79701991f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f796c009230 tx=0x7f796c004270 comp rx=0 tx=0).stop 2024-09-19T08:51:59.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.098+0000 7f7977f47640 1 -- 172.21.15.7:0/1024403293 shutdown_connections 2024-09-19T08:51:59.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.098+0000 7f7977f47640 1 --2- 172.21.15.7:0/1024403293 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f795c0a33b0 0x7f795c0a5870 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.098+0000 7f7977f47640 1 --2- 172.21.15.7:0/1024403293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7970106a80 0x7f79701a4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.098+0000 7f7977f47640 1 --2- 172.21.15.7:0/1024403293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7970101420 0x7f7970199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.098+0000 7f7977f47640 1 --2- 172.21.15.7:0/1024403293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7970100a80 0x7f79701991f0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.098+0000 7f7977f47640 1 -- 172.21.15.7:0/1024403293 >> 172.21.15.7:0/1024403293 conn(0x7f79700fc7a0 msgr2=0x7f79700fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:59.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.099+0000 7f7977f47640 1 -- 172.21.15.7:0/1024403293 shutdown_connections 2024-09-19T08:51:59.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:51:59.099+0000 7f7977f47640 1 -- 172.21.15.7:0/1024403293 wait complete. 2024-09-19T08:51:59.804 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:52:00.060 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:00.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:00 smithi007 ceph-mon[31221]: pgmap v229: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:52:00.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.521+0000 7f7ce31e9640 1 -- 172.21.15.7:0/3830466432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc106a80 msgr2=0x7f7cdc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:00.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.521+0000 7f7ce31e9640 1 --2- 172.21.15.7:0/3830466432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc106a80 0x7f7cdc106e60 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc009930 tx=0x7f7ccc02a420 comp rx=0 tx=0).stop 2024-09-19T08:52:00.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.521+0000 7f7ce31e9640 1 -- 172.21.15.7:0/3830466432 shutdown_connections 2024-09-19T08:52:00.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.521+0000 7f7ce31e9640 1 --2- 172.21.15.7:0/3830466432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cdc101420 0x7f7cdc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.521+0000 7f7ce31e9640 1 --2- 172.21.15.7:0/3830466432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cdc100a80 0x7f7cdc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.521+0000 7f7ce31e9640 1 --2- 172.21.15.7:0/3830466432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc106a80 0x7f7cdc106e60 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.521+0000 7f7ce31e9640 1 -- 172.21.15.7:0/3830466432 >> 172.21.15.7:0/3830466432 conn(0x7f7cdc0fc7a0 msgr2=0x7f7cdc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:00.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.521+0000 7f7ce31e9640 1 -- 172.21.15.7:0/3830466432 shutdown_connections 2024-09-19T08:52:00.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.521+0000 7f7ce31e9640 1 -- 172.21.15.7:0/3830466432 wait complete. 2024-09-19T08:52:00.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.522+0000 7f7ce31e9640 1 Processor -- start 2024-09-19T08:52:00.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.522+0000 7f7ce31e9640 1 -- start start 2024-09-19T08:52:00.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.522+0000 7f7ce31e9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cdc100a80 0x7f7cdc198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.522+0000 7f7ce31e9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc101420 0x7f7cdc1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.522+0000 7f7ce31e9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cdc106a80 0x7f7cdc19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.522+0000 7f7ce31e9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc110e40 con 0x7f7cdc101420 2024-09-19T08:52:00.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.522+0000 7f7ce31e9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc110cc0 con 0x7f7cdc100a80 2024-09-19T08:52:00.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.522+0000 7f7ce31e9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc110fc0 con 0x7f7cdc106a80 2024-09-19T08:52:00.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.522+0000 7f7cdbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc101420 0x7f7cdc1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.522+0000 7f7cdbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc101420 0x7f7cdc1989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55180/0 (socket says 172.21.15.7:55180) 2024-09-19T08:52:00.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.522+0000 7f7cdbfff640 1 -- 172.21.15.7:0/1044102358 learned_addr learned my addr 172.21.15.7:0/1044102358 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:00.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.522+0000 7f7ce0f85640 1 --2- 172.21.15.7:0/1044102358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cdc100a80 0x7f7cdc198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.522+0000 7f7ce1786640 1 --2- 172.21.15.7:0/1044102358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cdc106a80 0x7f7cdc19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.522+0000 7f7cdbfff640 1 -- 172.21.15.7:0/1044102358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cdc106a80 msgr2=0x7f7cdc19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:00.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.522+0000 7f7cdbfff640 1 --2- 172.21.15.7:0/1044102358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cdc106a80 0x7f7cdc19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.522+0000 7f7cdbfff640 1 -- 172.21.15.7:0/1044102358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cdc100a80 msgr2=0x7f7cdc198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:00.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.522+0000 7f7cdbfff640 1 --2- 172.21.15.7:0/1044102358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cdc100a80 0x7f7cdc198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.523+0000 7f7cdbfff640 1 -- 172.21.15.7:0/1044102358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cdc19d440 con 0x7f7cdc101420 2024-09-19T08:52:00.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.523+0000 7f7cdbfff640 1 --2- 172.21.15.7:0/1044102358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc101420 0x7f7cdc1989d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f7cc400d950 tx=0x7f7cc400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:00.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.523+0000 7f7cd9ffb640 1 -- 172.21.15.7:0/1044102358 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4017030 con 0x7f7cdc101420 2024-09-19T08:52:00.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.523+0000 7f7cd9ffb640 1 -- 172.21.15.7:0/1044102358 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cc4004020 con 0x7f7cdc101420 2024-09-19T08:52:00.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.523+0000 7f7ce31e9640 1 -- 172.21.15.7:0/1044102358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cdc19d730 con 0x7f7cdc101420 2024-09-19T08:52:00.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.523+0000 7f7cd9ffb640 1 -- 172.21.15.7:0/1044102358 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc40047a0 con 0x7f7cdc101420 2024-09-19T08:52:00.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.523+0000 7f7ce31e9640 1 -- 172.21.15.7:0/1044102358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cdc1a5010 con 0x7f7cdc101420 2024-09-19T08:52:00.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.526+0000 7f7cd9ffb640 1 -- 172.21.15.7:0/1044102358 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f7cc40041d0 con 0x7f7cdc101420 2024-09-19T08:52:00.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.526+0000 7f7ce55c2740 1 Processor -- start 2024-09-19T08:52:00.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.526+0000 7f7ce55c2740 1 -- start start 2024-09-19T08:52:00.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.526+0000 7f7ce55c2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c93058b40 0x563c93057090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.526+0000 7f7ce55c2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c930575d0 0x563c93057a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.526+0000 7f7ce55c2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c93062370 0x563c93064760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.526+0000 7f7ce55c2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563c92fbd2f0 con 0x563c930575d0 2024-09-19T08:52:00.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.526+0000 7f7ce55c2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563c92f64cf0 con 0x563c93062370 2024-09-19T08:52:00.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.526+0000 7f7ce55c2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563c92fb92b0 con 0x563c93058b40 2024-09-19T08:52:00.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.527+0000 7f7ce0f85640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c930575d0 0x563c93057a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.527+0000 7f7ce0f85640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c930575d0 0x563c93057a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55186/0 (socket says 172.21.15.7:55186) 2024-09-19T08:52:00.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.527+0000 7f7ce0f85640 1 -- 172.21.15.7:0/1330050081 learned_addr learned my addr 172.21.15.7:0/1330050081 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:00.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.527+0000 7f7cd9ffb640 1 --2- 172.21.15.7:0/1044102358 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7cc80a3430 0x7f7cc80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.527+0000 7f7ce1786640 1 --2- 172.21.15.7:0/1330050081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c93058b40 0x563c93057090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.527+0000 7f7cdbfff640 1 --2- 172.21.15.7:0/1330050081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c93062370 0x563c93064760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.527+0000 7f7ce1786640 1 --2- 172.21.15.7:0/1044102358 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7cc80a3430 0x7f7cc80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.527+0000 7f7cd9ffb640 1 -- 172.21.15.7:0/1044102358 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f7cc40cf730 con 0x7f7cdc101420 2024-09-19T08:52:00.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.527+0000 7f7ce0f85640 1 -- 172.21.15.7:0/1330050081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c93058b40 msgr2=0x563c93057090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:00.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.527+0000 7f7ce0f85640 1 --2- 172.21.15.7:0/1330050081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c93058b40 0x563c93057090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.527+0000 7f7ce0f85640 1 -- 172.21.15.7:0/1330050081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c93062370 msgr2=0x563c93064760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:00.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.527+0000 7f7ce0f85640 1 --2- 172.21.15.7:0/1330050081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c93062370 0x563c93064760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.527+0000 7f7ce0f85640 1 -- 172.21.15.7:0/1330050081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c92f493a0 con 0x563c930575d0 2024-09-19T08:52:00.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.527+0000 7f7cdbfff640 1 --2- 172.21.15.7:0/1330050081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c93062370 0x563c93064760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:00.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.527+0000 7f7ce0f85640 1 --2- 172.21.15.7:0/1330050081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c930575d0 0x563c93057a10 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc009930 tx=0x7f7ccc031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e6eed3d8f9e67c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:00.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.527+0000 7f7ce1786640 1 --2- 172.21.15.7:0/1044102358 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7cc80a3430 0x7f7cc80a58f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4012ad0 tx=0x7f7cd4005c20 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:00.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.527+0000 7f7cd2ffd640 1 -- 172.21.15.7:0/1330050081 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc040070 con 0x563c930575d0 2024-09-19T08:52:00.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.527+0000 7f7cd2ffd640 1 -- 172.21.15.7:0/1330050081 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ccc005020 con 0x563c930575d0 2024-09-19T08:52:00.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.528+0000 7f7cd2ffd640 1 -- 172.21.15.7:0/1330050081 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc035040 con 0x563c930575d0 2024-09-19T08:52:00.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.528+0000 7f7ce55c2740 1 -- 172.21.15.7:0/1330050081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c930575d0 msgr2=0x563c93057a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:00.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.528+0000 7f7ce55c2740 1 --2- 172.21.15.7:0/1330050081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c930575d0 0x563c93057a10 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc009930 tx=0x7f7ccc031630 comp rx=0 tx=0).stop 2024-09-19T08:52:00.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.528+0000 7f7ce55c2740 1 -- 172.21.15.7:0/1330050081 shutdown_connections 2024-09-19T08:52:00.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.528+0000 7f7ce55c2740 1 --2- 172.21.15.7:0/1330050081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c93062370 0x563c93064760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.528+0000 7f7ce55c2740 1 --2- 172.21.15.7:0/1330050081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c930575d0 0x563c93057a10 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.528+0000 7f7ce55c2740 1 --2- 172.21.15.7:0/1330050081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c93058b40 0x563c93057090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.528+0000 7f7ce55c2740 1 -- 172.21.15.7:0/1330050081 >> 172.21.15.7:0/1330050081 conn(0x563c93020310 msgr2=0x563c93053c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:00.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.529+0000 7f7ce55c2740 1 -- 172.21.15.7:0/1330050081 shutdown_connections 2024-09-19T08:52:00.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.529+0000 7f7ce55c2740 1 -- 172.21.15.7:0/1330050081 wait complete. 2024-09-19T08:52:00.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.529+0000 7f7ce55c2740 1 -- start start 2024-09-19T08:52:00.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.529+0000 7f7ce55c2740 1 Processor -- start 2024-09-19T08:52:00.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.529+0000 7f7ce55c2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c930575d0 0x563c93061c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.529+0000 7f7ce55c2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c93058b40 0x563c9305eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.529+0000 7f7ce55c2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c93062370 0x563c9305f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.529+0000 7f7ce55c2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563c93065010 con 0x563c93058b40 2024-09-19T08:52:00.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.529+0000 7f7ce55c2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563c92f78060 con 0x563c930575d0 2024-09-19T08:52:00.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.529+0000 7f7ce55c2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563c93065190 con 0x563c93062370 2024-09-19T08:52:00.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.529+0000 7f7ce55c2740 10 client.0 _ll_register_callbacks cb 0x563c92ccb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:00.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.530+0000 7f7cdbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c93058b40 0x563c9305eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.530+0000 7f7ce1786640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c93062370 0x563c9305f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.530+0000 7f7cdbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c93058b40 0x563c9305eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55198/0 (socket says 172.21.15.7:55198) 2024-09-19T08:52:00.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.530+0000 7f7cdbfff640 1 -- 172.21.15.7:0/3126528129 learned_addr learned my addr 172.21.15.7:0/3126528129 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:00.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.530+0000 7f7ce0f85640 1 --2- 172.21.15.7:0/3126528129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c930575d0 0x563c93061c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.530+0000 7f7cdbfff640 1 -- 172.21.15.7:0/3126528129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c93062370 msgr2=0x563c9305f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:00.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.530+0000 7f7cdbfff640 1 --2- 172.21.15.7:0/3126528129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c93062370 0x563c9305f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.530+0000 7f7cdbfff640 1 -- 172.21.15.7:0/3126528129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c930575d0 msgr2=0x563c93061c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:00.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.530+0000 7f7cdbfff640 1 --2- 172.21.15.7:0/3126528129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c930575d0 0x563c93061c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.530+0000 7f7cdbfff640 1 -- 172.21.15.7:0/3126528129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c92d2e3c0 con 0x563c93058b40 2024-09-19T08:52:00.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.530+0000 7f7ce1786640 1 --2- 172.21.15.7:0/3126528129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c93062370 0x563c9305f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:00.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.530+0000 7f7cdbfff640 1 --2- 172.21.15.7:0/3126528129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c93058b40 0x563c9305eee0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4098340 tx=0x7f7cc401af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6c4a94357b0111 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:00.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.530+0000 7f7cbbfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:00.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.530+0000 7f7cbbfff640 1 -- 172.21.15.7:0/3126528129 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4020160 con 0x563c93058b40 2024-09-19T08:52:00.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.530+0000 7f7cbbfff640 1 -- 172.21.15.7:0/3126528129 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f7cc4018d30 con 0x563c93058b40 2024-09-19T08:52:00.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.531+0000 7f7ce55c2740 1 -- 172.21.15.7:0/3126528129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ccc005020 con 0x563c93058b40 2024-09-19T08:52:00.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.531+0000 7f7cbbfff640 1 -- 172.21.15.7:0/3126528129 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7cc409b970 con 0x563c93058b40 2024-09-19T08:52:00.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.531+0000 7f7ce55c2740 10 client.16782 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:00.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.531+0000 7f7ce55c2740 1 -- 172.21.15.7:0/3126528129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563c930709a0 con 0x563c93058b40 2024-09-19T08:52:00.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.531+0000 7f7cbbfff640 1 -- 172.21.15.7:0/3126528129 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ccc005020 con 0x563c93058b40 2024-09-19T08:52:00.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.531+0000 7f7cbbfff640 1 -- 172.21.15.7:0/3126528129 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7cc409adc0 con 0x563c93058b40 2024-09-19T08:52:00.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.531+0000 7f7ce55c2740 10 client.16782 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:00.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.531+0000 7f7ce55c2740 10 client.16782 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:00.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.531+0000 7f7ce55c2740 20 client.16782 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:00.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.531+0000 7f7ce55c2740 1 --2- 172.21.15.7:0/3126528129 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563c93071cf0 0x563c93074120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.531+0000 7f7ce55c2740 4 client.16782 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:00.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.531+0000 7f7ce55c2740 1 -- 172.21.15.7:0/3126528129 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c92fca860 con 0x563c93071cf0 2024-09-19T08:52:00.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.531+0000 7f7ce0f85640 1 --2- 172.21.15.7:0/3126528129 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563c93071cf0 0x563c93074120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.532+0000 7f7ce0f85640 1 --2- 172.21.15.7:0/3126528129 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563c93071cf0 0x563c93074120 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eecd6fc8a799b08b server_cookie=1dc923ff09908690 in_seq=0 out_seq=0 2024-09-19T08:52:00.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.532+0000 7f7cbbfff640 10 client.16782 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:00.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.533+0000 7f7cbbfff640 1 -- 172.21.15.7:0/3126528129 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c92fca860 con 0x563c93071cf0 2024-09-19T08:52:00.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.533+0000 7f7cbbfff640 10 client.16782 handle_command_reply: tid=0 2024-09-19T08:52:00.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.533+0000 7f7ce55c2740 1 client.16782 shutdown 2024-09-19T08:52:00.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.533+0000 7f7ce55c2740 1 -- 172.21.15.7:0/3126528129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c93058b40 msgr2=0x563c9305eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:00.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.533+0000 7f7ce55c2740 1 --2- 172.21.15.7:0/3126528129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c93058b40 0x563c9305eee0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4098340 tx=0x7f7cc401af90 comp rx=0 tx=0).stop 2024-09-19T08:52:00.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.533+0000 7f7ce55c2740 1 -- 172.21.15.7:0/3126528129 shutdown_connections 2024-09-19T08:52:00.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.533+0000 7f7ce55c2740 1 --2- 172.21.15.7:0/3126528129 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563c93071cf0 0x563c93074120 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.533+0000 7f7ce55c2740 1 --2- 172.21.15.7:0/3126528129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c93062370 0x563c9305f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.533+0000 7f7ce55c2740 1 --2- 172.21.15.7:0/3126528129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c93058b40 0x563c9305eee0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.533+0000 7f7cbbfff640 0 client.16782 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:00.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.533+0000 7f7ce55c2740 1 --2- 172.21.15.7:0/3126528129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c930575d0 0x563c93061c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.533+0000 7f7ce55c2740 1 -- 172.21.15.7:0/3126528129 >> 172.21.15.7:0/3126528129 conn(0x563c93020310 msgr2=0x563c93059960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:00.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.533+0000 7f7ce55c2740 1 -- 172.21.15.7:0/3126528129 shutdown_connections 2024-09-19T08:52:00.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.533+0000 7f7ce55c2740 1 -- 172.21.15.7:0/3126528129 wait complete. 2024-09-19T08:52:00.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.533+0000 7f7ce55c2740 20 client.16782 trim_cache size 0 max 16384 2024-09-19T08:52:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.546+0000 7f7ce55c2740 1 Processor -- start 2024-09-19T08:52:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.546+0000 7f7ce55c2740 1 -- start start 2024-09-19T08:52:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.547+0000 7f7ce55c2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c930575d0 0x563c93060e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.547+0000 7f7ce55c2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c93058b40 0x563c9305a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.547+0000 7f7ce55c2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c93062370 0x563c9305a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.547+0000 7f7ce55c2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1b02a0 con 0x563c930575d0 2024-09-19T08:52:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.547+0000 7f7ce55c2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1adb70 con 0x563c93058b40 2024-09-19T08:52:00.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.547+0000 7f7ce55c2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1ab9e0 con 0x563c93062370 2024-09-19T08:52:00.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.547+0000 7f7ce0f85640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c930575d0 0x563c93060e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.547+0000 7f7ce0f85640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c930575d0 0x563c93060e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55206/0 (socket says 172.21.15.7:55206) 2024-09-19T08:52:00.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.547+0000 7f7ce0f85640 1 -- 172.21.15.7:0/3490113778 learned_addr learned my addr 172.21.15.7:0/3490113778 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:00.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.547+0000 7f7ce1786640 1 --2- 172.21.15.7:0/3490113778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c93062370 0x563c9305a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.547+0000 7f7cdbfff640 1 --2- 172.21.15.7:0/3490113778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c93058b40 0x563c9305a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.547+0000 7f7ce0f85640 1 -- 172.21.15.7:0/3490113778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c93062370 msgr2=0x563c9305a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:00.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.547+0000 7f7ce0f85640 1 --2- 172.21.15.7:0/3490113778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c93062370 0x563c9305a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.547+0000 7f7ce0f85640 1 -- 172.21.15.7:0/3490113778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c93058b40 msgr2=0x563c9305a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:00.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.547+0000 7f7ce0f85640 1 --2- 172.21.15.7:0/3490113778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c93058b40 0x563c9305a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.547+0000 7f7ce0f85640 1 -- 172.21.15.7:0/3490113778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c930534f0 con 0x563c930575d0 2024-09-19T08:52:00.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.547+0000 7f7cdbfff640 1 --2- 172.21.15.7:0/3490113778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c93058b40 0x563c9305a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:00.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.547+0000 7f7ce0f85640 1 --2- 172.21.15.7:0/3490113778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c930575d0 0x563c93060e50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc009900 tx=0x7f7ccc0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab6d620286fa5ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:00.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.547+0000 7f7cd27fc640 1 -- 172.21.15.7:0/3490113778 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc040050 con 0x563c930575d0 2024-09-19T08:52:00.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.547+0000 7f7cd27fc640 1 -- 172.21.15.7:0/3490113778 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ccc04fb50 con 0x563c930575d0 2024-09-19T08:52:00.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.547+0000 7f7cd27fc640 1 -- 172.21.15.7:0/3490113778 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc035040 con 0x563c930575d0 2024-09-19T08:52:00.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.548+0000 7f7ce55c2740 1 -- 172.21.15.7:0/3490113778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c930575d0 msgr2=0x563c93060e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:00.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.548+0000 7f7ce55c2740 1 --2- 172.21.15.7:0/3490113778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c930575d0 0x563c93060e50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc009900 tx=0x7f7ccc0058d0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.548+0000 7f7ce55c2740 1 -- 172.21.15.7:0/3490113778 shutdown_connections 2024-09-19T08:52:00.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.548+0000 7f7ce55c2740 1 --2- 172.21.15.7:0/3490113778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c93062370 0x563c9305a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.548+0000 7f7ce55c2740 1 --2- 172.21.15.7:0/3490113778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c93058b40 0x563c9305a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.548+0000 7f7ce55c2740 1 --2- 172.21.15.7:0/3490113778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c930575d0 0x563c93060e50 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.548+0000 7f7ce55c2740 1 -- 172.21.15.7:0/3490113778 >> 172.21.15.7:0/3490113778 conn(0x563c93020310 msgr2=0x563c93060740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:00.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.548+0000 7f7ce55c2740 1 -- 172.21.15.7:0/3490113778 shutdown_connections 2024-09-19T08:52:00.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.548+0000 7f7ce55c2740 1 -- 172.21.15.7:0/3490113778 wait complete. 2024-09-19T08:52:00.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.548+0000 7f7ce55c2740 1 -- start start 2024-09-19T08:52:00.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.549+0000 7f7ce55c2740 1 Processor -- start 2024-09-19T08:52:00.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.549+0000 7f7ce55c2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c930575d0 0x563c9306acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.549+0000 7f7ce55c2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c93058b40 0x563c93066070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.549+0000 7f7ce55c2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c93062370 0x563c93066800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.549+0000 7f7ce55c2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1ac030 con 0x563c930575d0 2024-09-19T08:52:00.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.549+0000 7f7ce55c2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1ad4a0 con 0x563c93062370 2024-09-19T08:52:00.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.549+0000 7f7ce55c2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1ac700 con 0x563c93058b40 2024-09-19T08:52:00.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.549+0000 7f7ce55c2740 10 client.0 _ll_register_callbacks cb 0x7f7cc4097c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:00.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.549+0000 7f7ce0f85640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c930575d0 0x563c9306acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.549+0000 7f7ce0f85640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c930575d0 0x563c9306acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55222/0 (socket says 172.21.15.7:55222) 2024-09-19T08:52:00.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.549+0000 7f7ce0f85640 1 -- 172.21.15.7:0/1504512830 learned_addr learned my addr 172.21.15.7:0/1504512830 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:00.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.549+0000 7f7cdbfff640 1 --2- 172.21.15.7:0/1504512830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c93058b40 0x563c93066070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.549+0000 7f7ce1786640 1 --2- 172.21.15.7:0/1504512830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c93062370 0x563c93066800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.549+0000 7f7ce0f85640 1 -- 172.21.15.7:0/1504512830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c93058b40 msgr2=0x563c93066070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:00.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.549+0000 7f7ce0f85640 1 --2- 172.21.15.7:0/1504512830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c93058b40 0x563c93066070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.549+0000 7f7ce0f85640 1 -- 172.21.15.7:0/1504512830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c93062370 msgr2=0x563c93066800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:00.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.549+0000 7f7ce0f85640 1 --2- 172.21.15.7:0/1504512830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c93062370 0x563c93066800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.549+0000 7f7ce0f85640 1 -- 172.21.15.7:0/1504512830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c930db9c0 con 0x563c930575d0 2024-09-19T08:52:00.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.549+0000 7f7ce1786640 1 --2- 172.21.15.7:0/1504512830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c93062370 0x563c93066800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:00.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.549+0000 7f7cdbfff640 1 --2- 172.21.15.7:0/1504512830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c93058b40 0x563c93066070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:00.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.550+0000 7f7ce0f85640 1 --2- 172.21.15.7:0/1504512830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c930575d0 0x563c9306acf0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc031670 tx=0x7f7ccc02ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e73a8c9dcd0860e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:00.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.550+0000 7f7cbbfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:00.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.550+0000 7f7cbbfff640 1 -- 172.21.15.7:0/1504512830 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc05e060 con 0x563c930575d0 2024-09-19T08:52:00.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.550+0000 7f7cbbfff640 1 -- 172.21.15.7:0/1504512830 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f7ccc004050 con 0x563c930575d0 2024-09-19T08:52:00.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.550+0000 7f7ce55c2740 1 -- 172.21.15.7:0/1504512830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ccc04fb50 con 0x563c930575d0 2024-09-19T08:52:00.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.550+0000 7f7cbbfff640 1 -- 172.21.15.7:0/1504512830 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7ccc040020 con 0x563c930575d0 2024-09-19T08:52:00.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.550+0000 7f7ce55c2740 10 client.16788 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:00.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.550+0000 7f7ce55c2740 1 -- 172.21.15.7:0/1504512830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563c930dcb50 con 0x563c930575d0 2024-09-19T08:52:00.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.550+0000 7f7cbbfff640 1 -- 172.21.15.7:0/1504512830 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ccc04fb50 con 0x563c930575d0 2024-09-19T08:52:00.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.550+0000 7f7cbbfff640 1 -- 172.21.15.7:0/1504512830 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7ccc03cb20 con 0x563c930575d0 2024-09-19T08:52:00.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.550+0000 7f7ce55c2740 10 client.16788 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:00.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.550+0000 7f7ce55c2740 10 client.16788 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:00.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.550+0000 7f7ce55c2740 20 client.16788 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:00.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.551+0000 7f7ce55c2740 1 --2- 172.21.15.7:0/1504512830 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563c930dcdd0 0x563c930df1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.551+0000 7f7ce55c2740 4 client.16788 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:52:00.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.551+0000 7f7ce55c2740 1 -- 172.21.15.7:0/1504512830 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563c92fc4d70 con 0x563c930dcdd0 2024-09-19T08:52:00.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.551+0000 7f7cdbfff640 1 --2- 172.21.15.7:0/1504512830 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563c930dcdd0 0x563c930df1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.551+0000 7f7cbbfff640 10 client.16788 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.551+0000 7f7cdbfff640 1 --2- 172.21.15.7:0/1504512830 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563c930dcdd0 0x563c930df1c0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fd58a7dd99ae181 server_cookie=5cbeb4d0e5a89d25 in_seq=0 out_seq=0 2024-09-19T08:52:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.551+0000 7f7cbbfff640 1 -- 172.21.15.7:0/1504512830 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563c92fc4d70 con 0x563c930dcdd0 2024-09-19T08:52:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.551+0000 7f7cbbfff640 10 client.16788 handle_command_reply: tid=0 2024-09-19T08:52:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.551+0000 7f7ce55c2740 1 client.16788 shutdown 2024-09-19T08:52:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.552+0000 7f7ce55c2740 1 -- 172.21.15.7:0/1504512830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c930575d0 msgr2=0x563c9306acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.552+0000 7f7ce55c2740 1 --2- 172.21.15.7:0/1504512830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c930575d0 0x563c9306acf0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc031670 tx=0x7f7ccc02ab90 comp rx=0 tx=0).stop 2024-09-19T08:52:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.552+0000 7f7ce55c2740 1 -- 172.21.15.7:0/1504512830 shutdown_connections 2024-09-19T08:52:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.552+0000 7f7ce55c2740 1 --2- 172.21.15.7:0/1504512830 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x563c930dcdd0 0x563c930df1c0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.552+0000 7f7ce55c2740 1 --2- 172.21.15.7:0/1504512830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c93062370 0x563c93066800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.552+0000 7f7ce55c2740 1 --2- 172.21.15.7:0/1504512830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c93058b40 0x563c93066070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.552+0000 7f7cbbfff640 0 client.16788 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.552+0000 7f7ce55c2740 1 --2- 172.21.15.7:0/1504512830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c930575d0 0x563c9306acf0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.552+0000 7f7ce55c2740 1 -- 172.21.15.7:0/1504512830 >> 172.21.15.7:0/1504512830 conn(0x563c93020310 msgr2=0x563c93060f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:00.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.552+0000 7f7ce55c2740 1 -- 172.21.15.7:0/1504512830 shutdown_connections 2024-09-19T08:52:00.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.552+0000 7f7ce55c2740 1 -- 172.21.15.7:0/1504512830 wait complete. 2024-09-19T08:52:00.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.552+0000 7f7ce55c2740 20 client.16788 trim_cache size 0 max 16384 2024-09-19T08:52:00.559 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:52:00.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.552+0000 7f7ce31e9640 1 -- 172.21.15.7:0/1044102358 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7cc80a3430 msgr2=0x7f7cc80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:00.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.552+0000 7f7ce31e9640 1 --2- 172.21.15.7:0/1044102358 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7cc80a3430 0x7f7cc80a58f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4012ad0 tx=0x7f7cd4005c20 comp rx=0 tx=0).stop 2024-09-19T08:52:00.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.552+0000 7f7ce31e9640 1 -- 172.21.15.7:0/1044102358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc101420 msgr2=0x7f7cdc1989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:00.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.552+0000 7f7ce31e9640 1 --2- 172.21.15.7:0/1044102358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc101420 0x7f7cdc1989d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f7cc400d950 tx=0x7f7cc400de10 comp rx=0 tx=0).stop 2024-09-19T08:52:00.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.553+0000 7f7ce31e9640 1 -- 172.21.15.7:0/1044102358 shutdown_connections 2024-09-19T08:52:00.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.553+0000 7f7ce31e9640 1 --2- 172.21.15.7:0/1044102358 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7cc80a3430 0x7f7cc80a58f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.553+0000 7f7ce31e9640 1 --2- 172.21.15.7:0/1044102358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cdc106a80 0x7f7cdc19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.553+0000 7f7ce31e9640 1 --2- 172.21.15.7:0/1044102358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cdc101420 0x7f7cdc1989d0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.553+0000 7f7ce31e9640 1 --2- 172.21.15.7:0/1044102358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cdc100a80 0x7f7cdc198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.553+0000 7f7ce31e9640 1 -- 172.21.15.7:0/1044102358 >> 172.21.15.7:0/1044102358 conn(0x7f7cdc0fc7a0 msgr2=0x7f7cdc06aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:00.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.553+0000 7f7ce31e9640 1 -- 172.21.15.7:0/1044102358 shutdown_connections 2024-09-19T08:52:00.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:00.553+0000 7f7ce31e9640 1 -- 172.21.15.7:0/1044102358 wait complete. 2024-09-19T08:52:00.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:00 smithi175 ceph-mon[35688]: pgmap v229: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:52:00.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:00 smithi044 ceph-mon[35072]: pgmap v229: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:52:02.220 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:52:02.220 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:52:02.491 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:02.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:02 smithi007 ceph-mon[31221]: pgmap v230: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:52:02.680 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:02 smithi175 ceph-mon[35688]: pgmap v230: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:52:02.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:02 smithi044 ceph-mon[35072]: pgmap v230: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:52:03.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.980+0000 7fa0c8425640 1 -- 172.21.15.7:0/73253785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0c0101b60 msgr2=0x7fa0c010d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:03.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.980+0000 7fa0c8425640 1 --2- 172.21.15.7:0/73253785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0c0101b60 0x7fa0c010d970 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8009900 tx=0x7fa0b802a3f0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.980+0000 7fa0c8425640 1 -- 172.21.15.7:0/73253785 shutdown_connections 2024-09-19T08:52:03.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.980+0000 7fa0c8425640 1 --2- 172.21.15.7:0/73253785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0c0101b60 0x7fa0c010d970 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.980+0000 7fa0c8425640 1 --2- 172.21.15.7:0/73253785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c01011c0 0x7fa0c0101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.980+0000 7fa0c8425640 1 --2- 172.21.15.7:0/73253785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0c0105ad0 0x7fa0c0105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.980+0000 7fa0c8425640 1 -- 172.21.15.7:0/73253785 >> 172.21.15.7:0/73253785 conn(0x7fa0c0077210 msgr2=0x7fa0c00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:03.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.980+0000 7fa0c8425640 1 -- 172.21.15.7:0/73253785 shutdown_connections 2024-09-19T08:52:03.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.980+0000 7fa0c8425640 1 -- 172.21.15.7:0/73253785 wait complete. 2024-09-19T08:52:03.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.981+0000 7fa0c8425640 1 Processor -- start 2024-09-19T08:52:03.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.981+0000 7fa0c8425640 1 -- start start 2024-09-19T08:52:03.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.981+0000 7fa0c8425640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c01011c0 0x7fa0c0198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.981+0000 7fa0c8425640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0c0101b60 0x7fa0c01988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.981+0000 7fa0c8425640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0c0105ad0 0x7fa0c019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.981+0000 7fa0c8425640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c0110ef0 con 0x7fa0c0101b60 2024-09-19T08:52:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.981+0000 7fa0c8425640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c0110d70 con 0x7fa0c0105ad0 2024-09-19T08:52:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.981+0000 7fa0c8425640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c0111070 con 0x7fa0c01011c0 2024-09-19T08:52:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.981+0000 7fa0c59c0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0c0101b60 0x7fa0c01988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.981+0000 7fa0c59c0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0c0101b60 0x7fa0c01988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55248/0 (socket says 172.21.15.7:55248) 2024-09-19T08:52:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.981+0000 7fa0c59c0640 1 -- 172.21.15.7:0/2707713759 learned_addr learned my addr 172.21.15.7:0/2707713759 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.981+0000 7fa0c61c1640 1 --2- 172.21.15.7:0/2707713759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c01011c0 0x7fa0c0198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.981+0000 7fa0c69c2640 1 --2- 172.21.15.7:0/2707713759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0c0105ad0 0x7fa0c019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.981+0000 7fa0c59c0640 1 -- 172.21.15.7:0/2707713759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c01011c0 msgr2=0x7fa0c0198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.981+0000 7fa0c59c0640 1 --2- 172.21.15.7:0/2707713759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c01011c0 0x7fa0c0198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.981+0000 7fa0c59c0640 1 -- 172.21.15.7:0/2707713759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0c0105ad0 msgr2=0x7fa0c019cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.981+0000 7fa0c59c0640 1 --2- 172.21.15.7:0/2707713759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0c0105ad0 0x7fa0c019cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.981+0000 7fa0c59c0640 1 -- 172.21.15.7:0/2707713759 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c019d330 con 0x7fa0c0101b60 2024-09-19T08:52:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.982+0000 7fa0c59c0640 1 --2- 172.21.15.7:0/2707713759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0c0101b60 0x7fa0c01988c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400d950 tx=0x7fa0b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:03.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.982+0000 7fa0bf7fe640 1 -- 172.21.15.7:0/2707713759 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4017030 con 0x7fa0c0101b60 2024-09-19T08:52:03.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.982+0000 7fa0bf7fe640 1 -- 172.21.15.7:0/2707713759 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0b4004020 con 0x7fa0c0101b60 2024-09-19T08:52:03.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.982+0000 7fa0c8425640 1 -- 172.21.15.7:0/2707713759 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c019d620 con 0x7fa0c0101b60 2024-09-19T08:52:03.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.982+0000 7fa0bf7fe640 1 -- 172.21.15.7:0/2707713759 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40047a0 con 0x7fa0c0101b60 2024-09-19T08:52:03.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.982+0000 7fa0c8425640 1 -- 172.21.15.7:0/2707713759 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c01a4f00 con 0x7fa0c0101b60 2024-09-19T08:52:03.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.984+0000 7fa0bf7fe640 1 -- 172.21.15.7:0/2707713759 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa0b40041d0 con 0x7fa0c0101b60 2024-09-19T08:52:03.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.985+0000 7fa0ca7fe740 1 Processor -- start 2024-09-19T08:52:03.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.985+0000 7fa0ca7fe740 1 -- start start 2024-09-19T08:52:03.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.985+0000 7fa0ca7fe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d15fdcfb60 0x55d15fdcff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.985+0000 7fa0ca7fe740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d15fdd0480 0x55d15fdda800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.985+0000 7fa0ca7fe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fddad40 0x55d15fddd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.985+0000 7fa0ca7fe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d15fd35280 con 0x55d15fddad40 2024-09-19T08:52:03.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.985+0000 7fa0ca7fe740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d15fcdcb10 con 0x55d15fdd0480 2024-09-19T08:52:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.985+0000 7fa0ca7fe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d15fd31240 con 0x55d15fdcfb60 2024-09-19T08:52:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.985+0000 7fa0c59c0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fddad40 0x55d15fddd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.985+0000 7fa0c59c0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fddad40 0x55d15fddd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55258/0 (socket says 172.21.15.7:55258) 2024-09-19T08:52:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.985+0000 7fa0c59c0640 1 -- 172.21.15.7:0/3223346288 learned_addr learned my addr 172.21.15.7:0/3223346288 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.985+0000 7fa0c61c1640 1 --2- 172.21.15.7:0/3223346288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d15fdd0480 0x55d15fdda800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.985+0000 7fa0bf7fe640 1 --2- 172.21.15.7:0/2707713759 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa0a80a33b0 0x7fa0a80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.985+0000 7fa0c69c2640 1 --2- 172.21.15.7:0/3223346288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d15fdcfb60 0x55d15fdcff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.986+0000 7fa0c59c0640 1 -- 172.21.15.7:0/3223346288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d15fdcfb60 msgr2=0x55d15fdcff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.986+0000 7fa0c59c0640 1 --2- 172.21.15.7:0/3223346288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d15fdcfb60 0x55d15fdcff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.986+0000 7fa0c59c0640 1 -- 172.21.15.7:0/3223346288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d15fdd0480 msgr2=0x55d15fdda800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.986+0000 7fa0c59c0640 1 --2- 172.21.15.7:0/3223346288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d15fdd0480 0x55d15fdda800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.986+0000 7fa0c59c0640 1 -- 172.21.15.7:0/3223346288 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d15fce91f0 con 0x55d15fddad40 2024-09-19T08:52:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.986+0000 7fa0c69c2640 1 --2- 172.21.15.7:0/3223346288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d15fdcfb60 0x55d15fdcff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.986+0000 7fa0c69c2640 1 --2- 172.21.15.7:0/2707713759 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa0a80a33b0 0x7fa0a80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.986+0000 7fa0bf7fe640 1 -- 172.21.15.7:0/2707713759 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7fa0b40cf720 con 0x7fa0c0101b60 2024-09-19T08:52:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.986+0000 7fa0c59c0640 1 --2- 172.21.15.7:0/3223346288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fddad40 0x55d15fddd130 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40ccda0 tx=0x7fa0b4021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4661f88c7a830ce8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.986+0000 7fa0bcdea640 1 -- 172.21.15.7:0/3223346288 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b409b790 con 0x55d15fddad40 2024-09-19T08:52:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.986+0000 7fa0bcdea640 1 -- 172.21.15.7:0/3223346288 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0b4084cc0 con 0x55d15fddad40 2024-09-19T08:52:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.986+0000 7fa0bcdea640 1 -- 172.21.15.7:0/3223346288 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b409b320 con 0x55d15fddad40 2024-09-19T08:52:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.987+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/3223346288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fddad40 msgr2=0x55d15fddd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.987+0000 7fa0ca7fe740 1 --2- 172.21.15.7:0/3223346288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fddad40 0x55d15fddd130 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40ccda0 tx=0x7fa0b4021000 comp rx=0 tx=0).stop 2024-09-19T08:52:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.987+0000 7fa0c69c2640 1 --2- 172.21.15.7:0/2707713759 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa0a80a33b0 0x7fa0a80a5870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8006010 tx=0x7fa0b8009260 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.987+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/3223346288 shutdown_connections 2024-09-19T08:52:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.987+0000 7fa0ca7fe740 1 --2- 172.21.15.7:0/3223346288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fddad40 0x55d15fddd130 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.987+0000 7fa0ca7fe740 1 --2- 172.21.15.7:0/3223346288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d15fdd0480 0x55d15fdda800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.987+0000 7fa0ca7fe740 1 --2- 172.21.15.7:0/3223346288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d15fdcfb60 0x55d15fdcff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.987+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/3223346288 >> 172.21.15.7:0/3223346288 conn(0x55d15fdcc0f0 msgr2=0x55d15fdcc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.987+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/3223346288 shutdown_connections 2024-09-19T08:52:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.987+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/3223346288 wait complete. 2024-09-19T08:52:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.987+0000 7fa0ca7fe740 1 -- start start 2024-09-19T08:52:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.987+0000 7fa0ca7fe740 1 Processor -- start 2024-09-19T08:52:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.988+0000 7fa0ca7fe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fdcfb60 0x55d15fdd7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.988+0000 7fa0ca7fe740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d15fdd0480 0x55d15fdd80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.988+0000 7fa0ca7fe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d15fddad40 0x55d15fdd8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.988+0000 7fa0ca7fe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d15fddd910 con 0x55d15fdcfb60 2024-09-19T08:52:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.988+0000 7fa0ca7fe740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d15fceff10 con 0x55d15fdd0480 2024-09-19T08:52:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.988+0000 7fa0ca7fe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d15fddda90 con 0x55d15fddad40 2024-09-19T08:52:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.988+0000 7fa0ca7fe740 10 client.0 _ll_register_callbacks cb 0x55d15fcb8a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.988+0000 7fa0c61c1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fdcfb60 0x55d15fdd7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.988+0000 7fa0c61c1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fdcfb60 0x55d15fdd7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55264/0 (socket says 172.21.15.7:55264) 2024-09-19T08:52:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.988+0000 7fa0c61c1640 1 -- 172.21.15.7:0/2102802516 learned_addr learned my addr 172.21.15.7:0/2102802516 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.988+0000 7fa0c59c0640 1 --2- 172.21.15.7:0/2102802516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d15fdd0480 0x55d15fdd80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.988+0000 7fa0c69c2640 1 --2- 172.21.15.7:0/2102802516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d15fddad40 0x55d15fdd8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.988+0000 7fa0c61c1640 1 -- 172.21.15.7:0/2102802516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d15fddad40 msgr2=0x55d15fdd8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.988+0000 7fa0c61c1640 1 --2- 172.21.15.7:0/2102802516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d15fddad40 0x55d15fdd8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.988+0000 7fa0c61c1640 1 -- 172.21.15.7:0/2102802516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d15fdd0480 msgr2=0x55d15fdd80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.988+0000 7fa0c61c1640 1 --2- 172.21.15.7:0/2102802516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d15fdd0480 0x55d15fdd80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.988+0000 7fa0c61c1640 1 -- 172.21.15.7:0/2102802516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d15faa66a0 con 0x55d15fdcfb60 2024-09-19T08:52:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.988+0000 7fa0c61c1640 1 --2- 172.21.15.7:0/2102802516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fdcfb60 0x55d15fdd7ba0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0013d30 tx=0x7fa0b00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b4725daaaf3a50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:03.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.988+0000 7fa0a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:03.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.988+0000 7fa0a5ffb640 1 -- 172.21.15.7:0/2102802516 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0004d20 con 0x55d15fdcfb60 2024-09-19T08:52:03.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.988+0000 7fa0a5ffb640 1 -- 172.21.15.7:0/2102802516 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7fa0b0003970 con 0x55d15fdcfb60 2024-09-19T08:52:03.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.988+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/2102802516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0b4084cc0 con 0x55d15fdcfb60 2024-09-19T08:52:03.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.989+0000 7fa0a5ffb640 1 -- 172.21.15.7:0/2102802516 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa0b0003bb0 con 0x55d15fdcfb60 2024-09-19T08:52:03.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.989+0000 7fa0ca7fe740 10 client.16800 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:03.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.989+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/2102802516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d15fde9470 con 0x55d15fdcfb60 2024-09-19T08:52:03.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.989+0000 7fa0a5ffb640 1 -- 172.21.15.7:0/2102802516 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0b4084cc0 con 0x55d15fdcfb60 2024-09-19T08:52:03.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.989+0000 7fa0a5ffb640 1 -- 172.21.15.7:0/2102802516 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa0b001a030 con 0x55d15fdcfb60 2024-09-19T08:52:03.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.989+0000 7fa0ca7fe740 10 client.16800 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:03.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.989+0000 7fa0ca7fe740 10 client.16800 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:03.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.989+0000 7fa0ca7fe740 20 client.16800 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:03.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.989+0000 7fa0ca7fe740 1 --2- 172.21.15.7:0/2102802516 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d15fdea930 0x55d15fdecd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.989+0000 7fa0ca7fe740 4 client.16800 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:03.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.989+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/2102802516 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d15fd427f0 con 0x55d15fdea930 2024-09-19T08:52:03.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.989+0000 7fa0c59c0640 1 --2- 172.21.15.7:0/2102802516 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d15fdea930 0x55d15fdecd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.990+0000 7fa0c59c0640 1 --2- 172.21.15.7:0/2102802516 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d15fdea930 0x55d15fdecd80 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62f3bb94d372e42b server_cookie=e80e2856d2bfacab in_seq=0 out_seq=0 2024-09-19T08:52:03.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.990+0000 7fa0a5ffb640 10 client.16800 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:03.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.990+0000 7fa0a5ffb640 1 -- 172.21.15.7:0/2102802516 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d15fd427f0 con 0x55d15fdea930 2024-09-19T08:52:03.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.990+0000 7fa0a5ffb640 10 client.16800 handle_command_reply: tid=0 2024-09-19T08:52:03.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.990+0000 7fa0ca7fe740 1 client.16800 shutdown 2024-09-19T08:52:03.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.991+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/2102802516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fdcfb60 msgr2=0x55d15fdd7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:03.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.991+0000 7fa0ca7fe740 1 --2- 172.21.15.7:0/2102802516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fdcfb60 0x55d15fdd7ba0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0013d30 tx=0x7fa0b00117b0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.991+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/2102802516 shutdown_connections 2024-09-19T08:52:03.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.991+0000 7fa0ca7fe740 1 --2- 172.21.15.7:0/2102802516 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d15fdea930 0x55d15fdecd80 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.991+0000 7fa0ca7fe740 1 --2- 172.21.15.7:0/2102802516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d15fddad40 0x55d15fdd8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.991+0000 7fa0ca7fe740 1 --2- 172.21.15.7:0/2102802516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d15fdd0480 0x55d15fdd80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.991+0000 7fa0ca7fe740 1 --2- 172.21.15.7:0/2102802516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fdcfb60 0x55d15fdd7ba0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.991+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/2102802516 >> 172.21.15.7:0/2102802516 conn(0x55d15fdcc0f0 msgr2=0x55d15fdd1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:03.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.991+0000 7fa0a5ffb640 0 client.16800 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:03.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.991+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/2102802516 shutdown_connections 2024-09-19T08:52:03.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.991+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/2102802516 wait complete. 2024-09-19T08:52:03.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:02.991+0000 7fa0ca7fe740 20 client.16800 trim_cache size 0 max 16384 2024-09-19T08:52:03.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.008+0000 7fa0ca7fe740 1 Processor -- start 2024-09-19T08:52:03.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.008+0000 7fa0ca7fe740 1 -- start start 2024-09-19T08:52:03.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.008+0000 7fa0ca7fe740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d15fdcfb60 0x55d15fdf2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.008+0000 7fa0ca7fe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d15fdd0480 0x55d15fdf2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.008+0000 7fa0ca7fe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fddad40 0x55d15fdcaa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.008+0000 7fa0ca7fe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c01b02a0 con 0x55d15fddad40 2024-09-19T08:52:03.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.008+0000 7fa0ca7fe740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c01adb70 con 0x55d15fdcfb60 2024-09-19T08:52:03.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.008+0000 7fa0ca7fe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c01ab9e0 con 0x55d15fdd0480 2024-09-19T08:52:03.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.008+0000 7fa0c69c2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fddad40 0x55d15fdcaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.008+0000 7fa0c69c2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fddad40 0x55d15fdcaa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55268/0 (socket says 172.21.15.7:55268) 2024-09-19T08:52:03.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.008+0000 7fa0c69c2640 1 -- 172.21.15.7:0/2225291281 learned_addr learned my addr 172.21.15.7:0/2225291281 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:03.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.008+0000 7fa0c61c1640 1 --2- 172.21.15.7:0/2225291281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d15fdcfb60 0x55d15fdf2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.009+0000 7fa0c59c0640 1 --2- 172.21.15.7:0/2225291281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d15fdd0480 0x55d15fdf2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.009+0000 7fa0c69c2640 1 -- 172.21.15.7:0/2225291281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d15fdd0480 msgr2=0x55d15fdf2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.009+0000 7fa0c69c2640 1 --2- 172.21.15.7:0/2225291281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d15fdd0480 0x55d15fdf2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.009+0000 7fa0c69c2640 1 -- 172.21.15.7:0/2225291281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d15fdcfb60 msgr2=0x55d15fdf2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.009+0000 7fa0c69c2640 1 --2- 172.21.15.7:0/2225291281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d15fdcfb60 0x55d15fdf2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.009+0000 7fa0c69c2640 1 -- 172.21.15.7:0/2225291281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d15fdc7830 con 0x55d15fddad40 2024-09-19T08:52:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.009+0000 7fa0c69c2640 1 --2- 172.21.15.7:0/2225291281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fddad40 0x55d15fdcaa50 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8033000 tx=0x7fa0b803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99d759b9ab54c9f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.009+0000 7fa0a7fff640 1 -- 172.21.15.7:0/2225291281 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8035030 con 0x55d15fddad40 2024-09-19T08:52:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.009+0000 7fa0a7fff640 1 -- 172.21.15.7:0/2225291281 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0b8031a20 con 0x55d15fddad40 2024-09-19T08:52:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.009+0000 7fa0a7fff640 1 -- 172.21.15.7:0/2225291281 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b803c8f0 con 0x55d15fddad40 2024-09-19T08:52:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.010+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/2225291281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fddad40 msgr2=0x55d15fdcaa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.010+0000 7fa0ca7fe740 1 --2- 172.21.15.7:0/2225291281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fddad40 0x55d15fdcaa50 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8033000 tx=0x7fa0b803f000 comp rx=0 tx=0).stop 2024-09-19T08:52:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.010+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/2225291281 shutdown_connections 2024-09-19T08:52:03.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.010+0000 7fa0ca7fe740 1 --2- 172.21.15.7:0/2225291281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fddad40 0x55d15fdcaa50 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.010+0000 7fa0ca7fe740 1 --2- 172.21.15.7:0/2225291281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d15fdd0480 0x55d15fdf2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.010+0000 7fa0ca7fe740 1 --2- 172.21.15.7:0/2225291281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d15fdcfb60 0x55d15fdf2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.010+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/2225291281 >> 172.21.15.7:0/2225291281 conn(0x55d15fdcc0f0 msgr2=0x55d15fdd9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.010+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/2225291281 shutdown_connections 2024-09-19T08:52:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.010+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/2225291281 wait complete. 2024-09-19T08:52:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.010+0000 7fa0ca7fe740 1 -- start start 2024-09-19T08:52:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.010+0000 7fa0ca7fe740 1 Processor -- start 2024-09-19T08:52:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.010+0000 7fa0ca7fe740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d15fdcfb60 0x55d15fddea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.011+0000 7fa0ca7fe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d15fdd0480 0x55d15fddef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.011+0000 7fa0ca7fe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fddad40 0x55d15fddf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.011+0000 7fa0ca7fe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c01ac030 con 0x55d15fddad40 2024-09-19T08:52:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.011+0000 7fa0ca7fe740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c01ad4a0 con 0x55d15fdcfb60 2024-09-19T08:52:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.011+0000 7fa0ca7fe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c01ac700 con 0x55d15fdd0480 2024-09-19T08:52:03.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.011+0000 7fa0ca7fe740 10 client.0 _ll_register_callbacks cb 0x7fa0b0009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:03.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.011+0000 7fa0c61c1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d15fdcfb60 0x55d15fddea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.011+0000 7fa0c61c1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d15fdcfb60 0x55d15fddea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:52418/0 (socket says 172.21.15.7:52418) 2024-09-19T08:52:03.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.011+0000 7fa0c61c1640 1 -- 172.21.15.7:0/3965527375 learned_addr learned my addr 172.21.15.7:0/3965527375 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:03.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.011+0000 7fa0c69c2640 1 --2- 172.21.15.7:0/3965527375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fddad40 0x55d15fddf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.011+0000 7fa0c59c0640 1 --2- 172.21.15.7:0/3965527375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d15fdd0480 0x55d15fddef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.011+0000 7fa0c69c2640 1 -- 172.21.15.7:0/3965527375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d15fdd0480 msgr2=0x55d15fddef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:03.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.011+0000 7fa0c69c2640 1 --2- 172.21.15.7:0/3965527375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d15fdd0480 0x55d15fddef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.011+0000 7fa0c69c2640 1 -- 172.21.15.7:0/3965527375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d15fdcfb60 msgr2=0x55d15fddea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:03.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.011+0000 7fa0c69c2640 1 --2- 172.21.15.7:0/3965527375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d15fdcfb60 0x55d15fddea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.011+0000 7fa0c69c2640 1 -- 172.21.15.7:0/3965527375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d15fdd02b0 con 0x55d15fddad40 2024-09-19T08:52:03.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.011+0000 7fa0c61c1640 1 --2- 172.21.15.7:0/3965527375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d15fdcfb60 0x55d15fddea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:03.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.011+0000 7fa0c69c2640 1 --2- 172.21.15.7:0/3965527375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fddad40 0x55d15fddf480 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x55d15fdcbad0 tx=0x7fa0b8003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13301bbaaa18c8be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:03.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.011+0000 7fa0a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:03.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.011+0000 7fa0a5ffb640 1 -- 172.21.15.7:0/3965527375 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8031740 con 0x55d15fddad40 2024-09-19T08:52:03.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.011+0000 7fa0a5ffb640 1 -- 172.21.15.7:0/3965527375 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7fa0b803c630 con 0x55d15fddad40 2024-09-19T08:52:03.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.011+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/3965527375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0b8031a20 con 0x55d15fddad40 2024-09-19T08:52:03.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.012+0000 7fa0a5ffb640 1 -- 172.21.15.7:0/3965527375 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa0b803c830 con 0x55d15fddad40 2024-09-19T08:52:03.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.012+0000 7fa0ca7fe740 10 client.16806 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:03.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.012+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/3965527375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d15fe55740 con 0x55d15fddad40 2024-09-19T08:52:03.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.012+0000 7fa0a5ffb640 1 -- 172.21.15.7:0/3965527375 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0b8031a20 con 0x55d15fddad40 2024-09-19T08:52:03.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.012+0000 7fa0a5ffb640 1 -- 172.21.15.7:0/3965527375 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa0b805b9d0 con 0x55d15fddad40 2024-09-19T08:52:03.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.012+0000 7fa0ca7fe740 10 client.16806 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:03.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.012+0000 7fa0ca7fe740 10 client.16806 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:03.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.012+0000 7fa0ca7fe740 20 client.16806 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:03.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.012+0000 7fa0ca7fe740 1 --2- 172.21.15.7:0/3965527375 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d15fe55db0 0x55d15fe581a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.012+0000 7fa0ca7fe740 4 client.16806 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:52:03.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.012+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/3965527375 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d15fd3cd00 con 0x55d15fe55db0 2024-09-19T08:52:03.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.012+0000 7fa0c61c1640 1 --2- 172.21.15.7:0/3965527375 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d15fe55db0 0x55d15fe581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.013+0000 7fa0c61c1640 1 --2- 172.21.15.7:0/3965527375 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d15fe55db0 0x55d15fe581a0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ecc2a2a00996809 server_cookie=39a1dc0e7c9f7a in_seq=0 out_seq=0 2024-09-19T08:52:03.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.013+0000 7fa0a5ffb640 10 client.16806 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:03.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.014+0000 7fa0a5ffb640 1 -- 172.21.15.7:0/3965527375 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d15fd3cd00 con 0x55d15fe55db0 2024-09-19T08:52:03.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.014+0000 7fa0a5ffb640 10 client.16806 handle_command_reply: tid=0 2024-09-19T08:52:03.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.014+0000 7fa0ca7fe740 1 client.16806 shutdown 2024-09-19T08:52:03.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.014+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/3965527375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fddad40 msgr2=0x55d15fddf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:03.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.014+0000 7fa0ca7fe740 1 --2- 172.21.15.7:0/3965527375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fddad40 0x55d15fddf480 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x55d15fdcbad0 tx=0x7fa0b8003f20 comp rx=0 tx=0).stop 2024-09-19T08:52:03.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.014+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/3965527375 shutdown_connections 2024-09-19T08:52:03.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.014+0000 7fa0ca7fe740 1 --2- 172.21.15.7:0/3965527375 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d15fe55db0 0x55d15fe581a0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.014+0000 7fa0ca7fe740 1 --2- 172.21.15.7:0/3965527375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d15fddad40 0x55d15fddf480 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.014+0000 7fa0ca7fe740 1 --2- 172.21.15.7:0/3965527375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d15fdd0480 0x55d15fddef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.014+0000 7fa0a5ffb640 0 client.16806 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:03.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.014+0000 7fa0ca7fe740 1 --2- 172.21.15.7:0/3965527375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d15fdcfb60 0x55d15fddea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.014+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/3965527375 >> 172.21.15.7:0/3965527375 conn(0x55d15fdcc0f0 msgr2=0x55d15fdd6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:03.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.014+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/3965527375 shutdown_connections 2024-09-19T08:52:03.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.014+0000 7fa0ca7fe740 1 -- 172.21.15.7:0/3965527375 wait complete. 2024-09-19T08:52:03.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.014+0000 7fa0ca7fe740 20 client.16806 trim_cache size 0 max 16384 2024-09-19T08:52:03.024 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:52:03.024 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-19T08:52:03.024 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "514ce3a2-086f-46f3-aee7-3c7c53869bea", 2024-09-19T08:52:03.024 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-19T08:52:03.024 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:52:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.015+0000 7fa0c8425640 1 -- 172.21.15.7:0/2707713759 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa0a80a33b0 msgr2=0x7fa0a80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.015+0000 7fa0c8425640 1 --2- 172.21.15.7:0/2707713759 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa0a80a33b0 0x7fa0a80a5870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8006010 tx=0x7fa0b8009260 comp rx=0 tx=0).stop 2024-09-19T08:52:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.015+0000 7fa0c8425640 1 -- 172.21.15.7:0/2707713759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0c0101b60 msgr2=0x7fa0c01988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.015+0000 7fa0c8425640 1 --2- 172.21.15.7:0/2707713759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0c0101b60 0x7fa0c01988c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400d950 tx=0x7fa0b400de10 comp rx=0 tx=0).stop 2024-09-19T08:52:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.015+0000 7fa0c8425640 1 -- 172.21.15.7:0/2707713759 shutdown_connections 2024-09-19T08:52:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.015+0000 7fa0c8425640 1 --2- 172.21.15.7:0/2707713759 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa0a80a33b0 0x7fa0a80a5870 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.015+0000 7fa0c8425640 1 --2- 172.21.15.7:0/2707713759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0c0105ad0 0x7fa0c019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.015+0000 7fa0c8425640 1 --2- 172.21.15.7:0/2707713759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0c0101b60 0x7fa0c01988c0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.015+0000 7fa0c8425640 1 --2- 172.21.15.7:0/2707713759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c01011c0 0x7fa0c0198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.015+0000 7fa0c8425640 1 -- 172.21.15.7:0/2707713759 >> 172.21.15.7:0/2707713759 conn(0x7fa0c0077210 msgr2=0x7fa0c0100220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:03.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.015+0000 7fa0c8425640 1 -- 172.21.15.7:0/2707713759 shutdown_connections 2024-09-19T08:52:03.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:03.015+0000 7fa0c8425640 1 -- 172.21.15.7:0/2707713759 wait complete. 2024-09-19T08:52:03.737 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:52:03.993 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:04.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.430+0000 7fe7962a8640 1 -- 172.21.15.7:0/3128107642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe790100a60 msgr2=0x7fe790100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:04.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.430+0000 7fe7962a8640 1 --2- 172.21.15.7:0/3128107642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe790100a60 0x7fe790100ec0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe778009930 tx=0x7fe77802a420 comp rx=0 tx=0).stop 2024-09-19T08:52:04.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.430+0000 7fe7962a8640 1 -- 172.21.15.7:0/3128107642 shutdown_connections 2024-09-19T08:52:04.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.430+0000 7fe7962a8640 1 --2- 172.21.15.7:0/3128107642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe790101400 0x7fe79010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.430+0000 7fe7962a8640 1 --2- 172.21.15.7:0/3128107642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe790100a60 0x7fe790100ec0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.430+0000 7fe7962a8640 1 --2- 172.21.15.7:0/3128107642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe790106a60 0x7fe790106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.430+0000 7fe7962a8640 1 -- 172.21.15.7:0/3128107642 >> 172.21.15.7:0/3128107642 conn(0x7fe7900fc780 msgr2=0x7fe7900feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.430+0000 7fe7962a8640 1 -- 172.21.15.7:0/3128107642 shutdown_connections 2024-09-19T08:52:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.430+0000 7fe7962a8640 1 -- 172.21.15.7:0/3128107642 wait complete. 2024-09-19T08:52:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.431+0000 7fe7962a8640 1 Processor -- start 2024-09-19T08:52:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.431+0000 7fe7962a8640 1 -- start start 2024-09-19T08:52:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.431+0000 7fe7962a8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe790100a60 0x7fe7900fce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.431+0000 7fe7962a8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe790101400 0x7fe7900fd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.431+0000 7fe7962a8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe790106a60 0x7fe7900fd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.431+0000 7fe7962a8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe790110e60 con 0x7fe790100a60 2024-09-19T08:52:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.431+0000 7fe7962a8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe790110ce0 con 0x7fe790106a60 2024-09-19T08:52:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.431+0000 7fe7962a8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe790110fe0 con 0x7fe790101400 2024-09-19T08:52:04.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.431+0000 7fe78ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe790100a60 0x7fe7900fce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:04.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.432+0000 7fe78ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe790100a60 0x7fe7900fce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40514/0 (socket says 172.21.15.7:40514) 2024-09-19T08:52:04.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.432+0000 7fe78ffff640 1 -- 172.21.15.7:0/2492205719 learned_addr learned my addr 172.21.15.7:0/2492205719 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:04.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.432+0000 7fe787fff640 1 --2- 172.21.15.7:0/2492205719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe790101400 0x7fe7900fd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:04.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.432+0000 7fe794845640 1 --2- 172.21.15.7:0/2492205719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe790106a60 0x7fe7900fd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:04.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.432+0000 7fe78ffff640 1 -- 172.21.15.7:0/2492205719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe790101400 msgr2=0x7fe7900fd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:04.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.432+0000 7fe78ffff640 1 --2- 172.21.15.7:0/2492205719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe790101400 0x7fe7900fd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.432+0000 7fe78ffff640 1 -- 172.21.15.7:0/2492205719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe790106a60 msgr2=0x7fe7900fd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:04.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.432+0000 7fe78ffff640 1 --2- 172.21.15.7:0/2492205719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe790106a60 0x7fe7900fd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.432+0000 7fe78ffff640 1 -- 172.21.15.7:0/2492205719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7901a6960 con 0x7fe790100a60 2024-09-19T08:52:04.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.432+0000 7fe78ffff640 1 --2- 172.21.15.7:0/2492205719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe790100a60 0x7fe7900fce60 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe78000d770 tx=0x7fe78000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:04.725 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:04 smithi175 ceph-mon[35688]: scrub queued for path: / 2024-09-19T08:52:04.725 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:04 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:04.725 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:04 smithi175 ceph-mon[35688]: scrub summary: active paths [/] 2024-09-19T08:52:04.726 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:04 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:04.726 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:04 smithi175 ceph-mon[35688]: pgmap v231: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:52:04.726 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:04 smithi175 ceph-mon[35688]: scrub summary: idle 2024-09-19T08:52:04.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.432+0000 7fe78dffb640 1 -- 172.21.15.7:0/2492205719 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe780017070 con 0x7fe790100a60 2024-09-19T08:52:04.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.432+0000 7fe78dffb640 1 -- 172.21.15.7:0/2492205719 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe780005500 con 0x7fe790100a60 2024-09-19T08:52:04.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.432+0000 7fe7962a8640 1 -- 172.21.15.7:0/2492205719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7901a6c50 con 0x7fe790100a60 2024-09-19T08:52:04.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.432+0000 7fe78dffb640 1 -- 172.21.15.7:0/2492205719 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe780004e00 con 0x7fe790100a60 2024-09-19T08:52:04.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.432+0000 7fe7962a8640 1 -- 172.21.15.7:0/2492205719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7901a7110 con 0x7fe790100a60 2024-09-19T08:52:04.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.435+0000 7fe78dffb640 1 -- 172.21.15.7:0/2492205719 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fe780004fa0 con 0x7fe790100a60 2024-09-19T08:52:04.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.435+0000 7fe798681740 1 Processor -- start 2024-09-19T08:52:04.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.435+0000 7fe798681740 1 -- start start 2024-09-19T08:52:04.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.435+0000 7fe798681740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b1f4a0 0x558224b1f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:04.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.435+0000 7fe798681740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558224b1fdc0 0x558224b2a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:04.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.435+0000 7fe798681740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558224b2a680 0x558224b2ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:04.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.435+0000 7fe798681740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558224a852e0 con 0x558224b1f4a0 2024-09-19T08:52:04.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.435+0000 7fe798681740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558224a2cce0 con 0x558224b2a680 2024-09-19T08:52:04.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.435+0000 7fe798681740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558224a812a0 con 0x558224b1fdc0 2024-09-19T08:52:04.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.436+0000 7fe78dffb640 1 --2- 172.21.15.7:0/2492205719 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe77c0a33b0 0x7fe77c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:04.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.436+0000 7fe794845640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b1f4a0 0x558224b1f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:04.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.436+0000 7fe794845640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b1f4a0 0x558224b1f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40526/0 (socket says 172.21.15.7:40526) 2024-09-19T08:52:04.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.436+0000 7fe794845640 1 -- 172.21.15.7:0/2569147362 learned_addr learned my addr 172.21.15.7:0/2569147362 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:04.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.436+0000 7fe794845640 1 --2- 172.21.15.7:0/2492205719 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe77c0a33b0 0x7fe77c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:04.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.436+0000 7fe787fff640 1 --2- 172.21.15.7:0/2569147362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558224b2a680 0x558224b2ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:04.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.436+0000 7fe78dffb640 1 -- 172.21.15.7:0/2492205719 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7fe7800cf670 con 0x7fe790100a60 2024-09-19T08:52:04.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.436+0000 7fe78ffff640 1 --2- 172.21.15.7:0/2569147362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558224b1fdc0 0x558224b2a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:04.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.436+0000 7fe794845640 1 -- 172.21.15.7:0/2569147362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558224b1fdc0 msgr2=0x558224b2a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:04.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.436+0000 7fe794845640 1 --2- 172.21.15.7:0/2569147362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558224b1fdc0 0x558224b2a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.436+0000 7fe794845640 1 -- 172.21.15.7:0/2569147362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558224b2a680 msgr2=0x558224b2ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:04.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.436+0000 7fe794845640 1 --2- 172.21.15.7:0/2569147362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558224b2a680 0x558224b2ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.436+0000 7fe794845640 1 -- 172.21.15.7:0/2569147362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558224a11440 con 0x558224b1f4a0 2024-09-19T08:52:04.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.436+0000 7fe794845640 1 --2- 172.21.15.7:0/2569147362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b1f4a0 0x558224b1f880 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fe788012d80 tx=0x7fe788010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491daff853a21748 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:04.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.436+0000 7fe794845640 1 --2- 172.21.15.7:0/2492205719 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe77c0a33b0 0x7fe77c0a5870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe788010c40 tx=0x7fe78800c000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:04.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.437+0000 7fe7867fc640 1 -- 172.21.15.7:0/2569147362 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe788024070 con 0x558224b1f4a0 2024-09-19T08:52:04.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.437+0000 7fe7867fc640 1 -- 172.21.15.7:0/2569147362 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe788009da0 con 0x558224b1f4a0 2024-09-19T08:52:04.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.437+0000 7fe7867fc640 1 -- 172.21.15.7:0/2569147362 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe788005260 con 0x558224b1f4a0 2024-09-19T08:52:04.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.437+0000 7fe798681740 1 -- 172.21.15.7:0/2569147362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b1f4a0 msgr2=0x558224b1f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:04.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.437+0000 7fe798681740 1 --2- 172.21.15.7:0/2569147362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b1f4a0 0x558224b1f880 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fe788012d80 tx=0x7fe788010740 comp rx=0 tx=0).stop 2024-09-19T08:52:04.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.437+0000 7fe798681740 1 -- 172.21.15.7:0/2569147362 shutdown_connections 2024-09-19T08:52:04.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.437+0000 7fe798681740 1 --2- 172.21.15.7:0/2569147362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558224b2a680 0x558224b2ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.437+0000 7fe798681740 1 --2- 172.21.15.7:0/2569147362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558224b1fdc0 0x558224b2a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.437+0000 7fe798681740 1 --2- 172.21.15.7:0/2569147362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b1f4a0 0x558224b1f880 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.437+0000 7fe798681740 1 -- 172.21.15.7:0/2569147362 >> 172.21.15.7:0/2569147362 conn(0x558224b1ba30 msgr2=0x558224b1be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:04.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.437+0000 7fe798681740 1 -- 172.21.15.7:0/2569147362 shutdown_connections 2024-09-19T08:52:04.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.437+0000 7fe798681740 1 -- 172.21.15.7:0/2569147362 wait complete. 2024-09-19T08:52:04.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.438+0000 7fe798681740 1 -- start start 2024-09-19T08:52:04.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.438+0000 7fe798681740 1 Processor -- start 2024-09-19T08:52:04.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.438+0000 7fe798681740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558224b1f4a0 0x558224b29fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:04.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.438+0000 7fe798681740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558224b1fdc0 0x558224b27250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:04.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.438+0000 7fe798681740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b2a680 0x558224b27790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:04.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.438+0000 7fe798681740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558224b2d250 con 0x558224b2a680 2024-09-19T08:52:04.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.438+0000 7fe798681740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558224a40050 con 0x558224b1f4a0 2024-09-19T08:52:04.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.438+0000 7fe798681740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558224b2d3d0 con 0x558224b1fdc0 2024-09-19T08:52:04.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.438+0000 7fe798681740 10 client.0 _ll_register_callbacks cb 0x558224a80160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:04.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.438+0000 7fe794845640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b2a680 0x558224b27790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:04.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.438+0000 7fe794845640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b2a680 0x558224b27790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40534/0 (socket says 172.21.15.7:40534) 2024-09-19T08:52:04.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.439+0000 7fe794845640 1 -- 172.21.15.7:0/1973260720 learned_addr learned my addr 172.21.15.7:0/1973260720 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:04.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.439+0000 7fe78ffff640 1 --2- 172.21.15.7:0/1973260720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558224b1f4a0 0x558224b29fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:04.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.439+0000 7fe787fff640 1 --2- 172.21.15.7:0/1973260720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558224b1fdc0 0x558224b27250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:04.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.439+0000 7fe794845640 1 -- 172.21.15.7:0/1973260720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558224b1fdc0 msgr2=0x558224b27250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:04.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.439+0000 7fe794845640 1 --2- 172.21.15.7:0/1973260720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558224b1fdc0 0x558224b27250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.439+0000 7fe794845640 1 -- 172.21.15.7:0/1973260720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558224b1f4a0 msgr2=0x558224b29fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:04.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.439+0000 7fe794845640 1 --2- 172.21.15.7:0/1973260720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558224b1f4a0 0x558224b29fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.439+0000 7fe794845640 1 -- 172.21.15.7:0/1973260720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582247f63c0 con 0x558224b2a680 2024-09-19T08:52:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.439+0000 7fe794845640 1 --2- 172.21.15.7:0/1973260720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b2a680 0x558224b27790 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fe78800ce70 tx=0x7fe788005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eeac828b44c4f39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.439+0000 7fe76f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.439+0000 7fe76f7fe640 1 -- 172.21.15.7:0/1973260720 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe788024050 con 0x558224b2a680 2024-09-19T08:52:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.439+0000 7fe798681740 1 -- 172.21.15.7:0/1973260720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558224a92850 con 0x558224b2a680 2024-09-19T08:52:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.439+0000 7fe76f7fe640 1 -- 172.21.15.7:0/1973260720 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7fe788004c10 con 0x558224b2a680 2024-09-19T08:52:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.439+0000 7fe76f7fe640 1 -- 172.21.15.7:0/1973260720 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe78800cbc0 con 0x558224b2a680 2024-09-19T08:52:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.439+0000 7fe798681740 10 client.16818 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.439+0000 7fe798681740 1 -- 172.21.15.7:0/1973260720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558224b38bd0 con 0x558224b2a680 2024-09-19T08:52:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.440+0000 7fe76f7fe640 1 -- 172.21.15.7:0/1973260720 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x558224a92850 con 0x558224b2a680 2024-09-19T08:52:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.440+0000 7fe76f7fe640 1 -- 172.21.15.7:0/1973260720 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe78800f040 con 0x558224b2a680 2024-09-19T08:52:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.440+0000 7fe798681740 10 client.16818 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:04.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.440+0000 7fe798681740 10 client.16818 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.440+0000 7fe798681740 20 client.16818 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.440+0000 7fe798681740 1 --2- 172.21.15.7:0/1973260720 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558224b3a090 0x558224b3c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.440+0000 7fe798681740 4 client.16818 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.440+0000 7fe798681740 1 -- 172.21.15.7:0/1973260720 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558224a8cd60 con 0x558224b3a090 2024-09-19T08:52:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.440+0000 7fe78ffff640 1 --2- 172.21.15.7:0/1973260720 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558224b3a090 0x558224b3c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.440+0000 7fe78ffff640 1 --2- 172.21.15.7:0/1973260720 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558224b3a090 0x558224b3c480 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e91c96c303888f0 server_cookie=8e6565fc8c820e18 in_seq=0 out_seq=0 2024-09-19T08:52:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.440+0000 7fe76f7fe640 10 client.16818 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.441+0000 7fe76f7fe640 1 -- 172.21.15.7:0/1973260720 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558224a8cd60 con 0x558224b3a090 2024-09-19T08:52:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.441+0000 7fe76f7fe640 10 client.16818 handle_command_reply: tid=0 2024-09-19T08:52:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.441+0000 7fe798681740 1 client.16818 shutdown 2024-09-19T08:52:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.441+0000 7fe798681740 1 -- 172.21.15.7:0/1973260720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b2a680 msgr2=0x558224b27790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.441+0000 7fe798681740 1 --2- 172.21.15.7:0/1973260720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b2a680 0x558224b27790 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fe78800ce70 tx=0x7fe788005890 comp rx=0 tx=0).stop 2024-09-19T08:52:04.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.441+0000 7fe798681740 1 -- 172.21.15.7:0/1973260720 shutdown_connections 2024-09-19T08:52:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.441+0000 7fe798681740 1 --2- 172.21.15.7:0/1973260720 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558224b3a090 0x558224b3c480 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.441+0000 7fe798681740 1 --2- 172.21.15.7:0/1973260720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b2a680 0x558224b27790 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.441+0000 7fe798681740 1 --2- 172.21.15.7:0/1973260720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558224b1fdc0 0x558224b27250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.441+0000 7fe798681740 1 --2- 172.21.15.7:0/1973260720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558224b1f4a0 0x558224b29fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.441+0000 7fe76f7fe640 0 client.16818 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.441+0000 7fe798681740 1 -- 172.21.15.7:0/1973260720 >> 172.21.15.7:0/1973260720 conn(0x558224b1ba30 msgr2=0x558224b1ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.442+0000 7fe798681740 1 -- 172.21.15.7:0/1973260720 shutdown_connections 2024-09-19T08:52:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.442+0000 7fe798681740 1 -- 172.21.15.7:0/1973260720 wait complete. 2024-09-19T08:52:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.442+0000 7fe798681740 20 client.16818 trim_cache size 0 max 16384 2024-09-19T08:52:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.459+0000 7fe798681740 1 Processor -- start 2024-09-19T08:52:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.459+0000 7fe798681740 1 -- start start 2024-09-19T08:52:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.459+0000 7fe798681740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558224b1f4a0 0x558224b364b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.459+0000 7fe798681740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558224b1fdc0 0x558224b41a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:04.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.459+0000 7fe798681740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b2a680 0x558224b41f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:04.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.459+0000 7fe798681740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe7901b2350 con 0x558224b2a680 2024-09-19T08:52:04.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.459+0000 7fe798681740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe7901afc20 con 0x558224b1fdc0 2024-09-19T08:52:04.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.459+0000 7fe798681740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe7901ada90 con 0x558224b1f4a0 2024-09-19T08:52:04.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.459+0000 7fe794845640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b2a680 0x558224b41f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:04.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.459+0000 7fe794845640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b2a680 0x558224b41f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40548/0 (socket says 172.21.15.7:40548) 2024-09-19T08:52:04.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.459+0000 7fe794845640 1 -- 172.21.15.7:0/1142308276 learned_addr learned my addr 172.21.15.7:0/1142308276 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:04.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.460+0000 7fe787fff640 1 --2- 172.21.15.7:0/1142308276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558224b1fdc0 0x558224b41a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:04.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.460+0000 7fe794845640 1 -- 172.21.15.7:0/1142308276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558224b1f4a0 msgr2=0x558224b364b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:04.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.460+0000 7fe794845640 1 --2- 172.21.15.7:0/1142308276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558224b1f4a0 0x558224b364b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.460+0000 7fe794845640 1 -- 172.21.15.7:0/1142308276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558224b1fdc0 msgr2=0x558224b41a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:04.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.460+0000 7fe794845640 1 --2- 172.21.15.7:0/1142308276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558224b1fdc0 0x558224b41a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.460+0000 7fe794845640 1 -- 172.21.15.7:0/1142308276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558224b1c6c0 con 0x558224b2a680 2024-09-19T08:52:04.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.460+0000 7fe794845640 1 --2- 172.21.15.7:0/1142308276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b2a680 0x558224b41f60 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fe78800a010 tx=0x7fe78800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932c4bf335adf165 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.460+0000 7fe785ffb640 1 -- 172.21.15.7:0/1142308276 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe788024070 con 0x558224b2a680 2024-09-19T08:52:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.460+0000 7fe785ffb640 1 -- 172.21.15.7:0/1142308276 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7880125a0 con 0x558224b2a680 2024-09-19T08:52:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.460+0000 7fe785ffb640 1 -- 172.21.15.7:0/1142308276 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7880120c0 con 0x558224b2a680 2024-09-19T08:52:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.461+0000 7fe798681740 1 -- 172.21.15.7:0/1142308276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b2a680 msgr2=0x558224b41f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.461+0000 7fe798681740 1 --2- 172.21.15.7:0/1142308276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b2a680 0x558224b41f60 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fe78800a010 tx=0x7fe78800cd60 comp rx=0 tx=0).stop 2024-09-19T08:52:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.461+0000 7fe798681740 1 -- 172.21.15.7:0/1142308276 shutdown_connections 2024-09-19T08:52:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.461+0000 7fe798681740 1 --2- 172.21.15.7:0/1142308276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b2a680 0x558224b41f60 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.461+0000 7fe798681740 1 --2- 172.21.15.7:0/1142308276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558224b1fdc0 0x558224b41a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.461+0000 7fe798681740 1 --2- 172.21.15.7:0/1142308276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558224b1f4a0 0x558224b364b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.461+0000 7fe798681740 1 -- 172.21.15.7:0/1142308276 >> 172.21.15.7:0/1142308276 conn(0x558224b1ba30 msgr2=0x558224b292d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.461+0000 7fe798681740 1 -- 172.21.15.7:0/1142308276 shutdown_connections 2024-09-19T08:52:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.461+0000 7fe798681740 1 -- 172.21.15.7:0/1142308276 wait complete. 2024-09-19T08:52:04.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.461+0000 7fe798681740 1 -- start start 2024-09-19T08:52:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.461+0000 7fe798681740 1 Processor -- start 2024-09-19T08:52:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.462+0000 7fe798681740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b1f4a0 0x558224b2e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.462+0000 7fe798681740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558224b1fdc0 0x558224b2e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.462+0000 7fe798681740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558224b2a680 0x558224b2ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.462+0000 7fe798681740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe7901ae0e0 con 0x558224b1f4a0 2024-09-19T08:52:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.462+0000 7fe798681740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe7901af550 con 0x558224b2a680 2024-09-19T08:52:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.462+0000 7fe798681740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe7901ae7b0 con 0x558224b1fdc0 2024-09-19T08:52:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.462+0000 7fe798681740 10 client.0 _ll_register_callbacks cb 0x7fe780097ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.462+0000 7fe78ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b1f4a0 0x558224b2e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.462+0000 7fe78ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b1f4a0 0x558224b2e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40560/0 (socket says 172.21.15.7:40560) 2024-09-19T08:52:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.462+0000 7fe78ffff640 1 -- 172.21.15.7:0/1286242007 learned_addr learned my addr 172.21.15.7:0/1286242007 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.462+0000 7fe794845640 1 --2- 172.21.15.7:0/1286242007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558224b2a680 0x558224b2ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.462+0000 7fe787fff640 1 --2- 172.21.15.7:0/1286242007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558224b1fdc0 0x558224b2e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.462+0000 7fe78ffff640 1 -- 172.21.15.7:0/1286242007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558224b1fdc0 msgr2=0x558224b2e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.462+0000 7fe78ffff640 1 --2- 172.21.15.7:0/1286242007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558224b1fdc0 0x558224b2e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.462+0000 7fe78ffff640 1 -- 172.21.15.7:0/1286242007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558224b2a680 msgr2=0x558224b2ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.462+0000 7fe78ffff640 1 --2- 172.21.15.7:0/1286242007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558224b2a680 0x558224b2ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.462+0000 7fe78ffff640 1 -- 172.21.15.7:0/1286242007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558224ba39f0 con 0x558224b1f4a0 2024-09-19T08:52:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.462+0000 7fe78ffff640 1 --2- 172.21.15.7:0/1286242007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b1f4a0 0x558224b2e2e0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fe7800ccde0 tx=0x7fe780009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbe8ff270bf7848 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.462+0000 7fe76f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.463+0000 7fe76f7fe640 1 -- 172.21.15.7:0/1286242007 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe780020040 con 0x558224b1f4a0 2024-09-19T08:52:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.463+0000 7fe76f7fe640 1 -- 172.21.15.7:0/1286242007 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7fe780099cc0 con 0x558224b1f4a0 2024-09-19T08:52:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.463+0000 7fe798681740 1 -- 172.21.15.7:0/1286242007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7880125a0 con 0x558224b1f4a0 2024-09-19T08:52:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.463+0000 7fe76f7fe640 1 -- 172.21.15.7:0/1286242007 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe78009b9c0 con 0x558224b1f4a0 2024-09-19T08:52:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.463+0000 7fe798681740 10 client.16824 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.463+0000 7fe798681740 1 -- 172.21.15.7:0/1286242007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558224ba4c00 con 0x558224b1f4a0 2024-09-19T08:52:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.463+0000 7fe76f7fe640 1 -- 172.21.15.7:0/1286242007 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7880125a0 con 0x558224b1f4a0 2024-09-19T08:52:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.463+0000 7fe76f7fe640 1 -- 172.21.15.7:0/1286242007 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe780098030 con 0x558224b1f4a0 2024-09-19T08:52:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.463+0000 7fe798681740 10 client.16824 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.463+0000 7fe798681740 10 client.16824 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.463+0000 7fe798681740 20 client.16824 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.463+0000 7fe798681740 1 --2- 172.21.15.7:0/1286242007 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558224ba52d0 0x558224ba76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.463+0000 7fe798681740 4 client.16824 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:52:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.463+0000 7fe798681740 1 -- 172.21.15.7:0/1286242007 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558224b27b20 con 0x558224ba52d0 2024-09-19T08:52:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.463+0000 7fe787fff640 1 --2- 172.21.15.7:0/1286242007 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558224ba52d0 0x558224ba76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.464+0000 7fe787fff640 1 --2- 172.21.15.7:0/1286242007 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558224ba52d0 0x558224ba76c0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7629bcf403c33bfb server_cookie=aa13d7bd5124cf47 in_seq=0 out_seq=0 2024-09-19T08:52:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.464+0000 7fe76f7fe640 10 client.16824 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.464+0000 7fe76f7fe640 1 -- 172.21.15.7:0/1286242007 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558224b27b20 con 0x558224ba52d0 2024-09-19T08:52:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.464+0000 7fe76f7fe640 10 client.16824 handle_command_reply: tid=0 2024-09-19T08:52:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.464+0000 7fe798681740 1 client.16824 shutdown 2024-09-19T08:52:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.464+0000 7fe798681740 1 -- 172.21.15.7:0/1286242007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b1f4a0 msgr2=0x558224b2e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.464+0000 7fe798681740 1 --2- 172.21.15.7:0/1286242007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b1f4a0 0x558224b2e2e0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fe7800ccde0 tx=0x7fe780009c30 comp rx=0 tx=0).stop 2024-09-19T08:52:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.464+0000 7fe798681740 1 -- 172.21.15.7:0/1286242007 shutdown_connections 2024-09-19T08:52:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.464+0000 7fe798681740 1 --2- 172.21.15.7:0/1286242007 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558224ba52d0 0x558224ba76c0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.464+0000 7fe798681740 1 --2- 172.21.15.7:0/1286242007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558224b2a680 0x558224b2ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.464+0000 7fe798681740 1 --2- 172.21.15.7:0/1286242007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558224b1fdc0 0x558224b2e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.464+0000 7fe798681740 1 --2- 172.21.15.7:0/1286242007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558224b1f4a0 0x558224b2e2e0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.464+0000 7fe798681740 1 -- 172.21.15.7:0/1286242007 >> 172.21.15.7:0/1286242007 conn(0x558224b1ba30 msgr2=0x558224b259f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.464+0000 7fe76f7fe640 0 client.16824 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.464+0000 7fe798681740 1 -- 172.21.15.7:0/1286242007 shutdown_connections 2024-09-19T08:52:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.465+0000 7fe798681740 1 -- 172.21.15.7:0/1286242007 wait complete. 2024-09-19T08:52:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.465+0000 7fe798681740 20 client.16824 trim_cache size 0 max 16384 2024-09-19T08:52:04.749 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:52:04.749 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-19T08:52:04.749 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-09-19T08:52:04.749 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:52:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.465+0000 7fe7962a8640 1 -- 172.21.15.7:0/2492205719 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe77c0a33b0 msgr2=0x7fe77c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.465+0000 7fe7962a8640 1 --2- 172.21.15.7:0/2492205719 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe77c0a33b0 0x7fe77c0a5870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe788010c40 tx=0x7fe78800c000 comp rx=0 tx=0).stop 2024-09-19T08:52:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.465+0000 7fe7962a8640 1 -- 172.21.15.7:0/2492205719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe790100a60 msgr2=0x7fe7900fce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.465+0000 7fe7962a8640 1 --2- 172.21.15.7:0/2492205719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe790100a60 0x7fe7900fce60 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe78000d770 tx=0x7fe78000dc30 comp rx=0 tx=0).stop 2024-09-19T08:52:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.465+0000 7fe7962a8640 1 -- 172.21.15.7:0/2492205719 shutdown_connections 2024-09-19T08:52:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.465+0000 7fe7962a8640 1 --2- 172.21.15.7:0/2492205719 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe77c0a33b0 0x7fe77c0a5870 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.465+0000 7fe7962a8640 1 --2- 172.21.15.7:0/2492205719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe790106a60 0x7fe7900fd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.465+0000 7fe7962a8640 1 --2- 172.21.15.7:0/2492205719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe790101400 0x7fe7900fd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.465+0000 7fe7962a8640 1 --2- 172.21.15.7:0/2492205719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe790100a60 0x7fe7900fce60 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.465+0000 7fe7962a8640 1 -- 172.21.15.7:0/2492205719 >> 172.21.15.7:0/2492205719 conn(0x7fe7900fc780 msgr2=0x7fe79006aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.465+0000 7fe7962a8640 1 -- 172.21.15.7:0/2492205719 shutdown_connections 2024-09-19T08:52:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:04.465+0000 7fe7962a8640 1 -- 172.21.15.7:0/2492205719 wait complete. 2024-09-19T08:52:04.750 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:04 smithi007 ceph-mon[31221]: scrub queued for path: / 2024-09-19T08:52:04.751 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:04 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:04.751 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:04 smithi007 ceph-mon[31221]: scrub summary: active paths [/] 2024-09-19T08:52:04.751 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:04 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:04.751 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:04 smithi007 ceph-mon[31221]: pgmap v231: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:52:04.751 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:04 smithi007 ceph-mon[31221]: scrub summary: idle 2024-09-19T08:52:04.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:04 smithi044 ceph-mon[35072]: scrub queued for path: / 2024-09-19T08:52:04.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:04 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:04.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:04 smithi044 ceph-mon[35072]: scrub summary: active paths [/] 2024-09-19T08:52:04.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:04 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:04.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:04 smithi044 ceph-mon[35072]: pgmap v231: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:52:04.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:04 smithi044 ceph-mon[35072]: scrub summary: idle 2024-09-19T08:52:05.145 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:52:05.146 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:52:05.406 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:05.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.859+0000 7ffb82dfb640 1 -- 172.21.15.7:0/2724489406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb7c100e20 msgr2=0x7ffb7c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:05.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.859+0000 7ffb82dfb640 1 --2- 172.21.15.7:0/2724489406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb7c100e20 0x7ffb7c101200 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009900 tx=0x7ffb7402a480 comp rx=0 tx=0).stop 2024-09-19T08:52:05.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.859+0000 7ffb82dfb640 1 -- 172.21.15.7:0/2724489406 shutdown_connections 2024-09-19T08:52:05.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.859+0000 7ffb82dfb640 1 --2- 172.21.15.7:0/2724489406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb7c102ef0 0x7ffb7c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.859+0000 7ffb82dfb640 1 --2- 172.21.15.7:0/2724489406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb7c102570 0x7ffb7c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.859+0000 7ffb82dfb640 1 --2- 172.21.15.7:0/2724489406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb7c100e20 0x7ffb7c101200 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.859+0000 7ffb82dfb640 1 -- 172.21.15.7:0/2724489406 >> 172.21.15.7:0/2724489406 conn(0x7ffb7c0fc7d0 msgr2=0x7ffb7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.859+0000 7ffb82dfb640 1 -- 172.21.15.7:0/2724489406 shutdown_connections 2024-09-19T08:52:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.859+0000 7ffb82dfb640 1 -- 172.21.15.7:0/2724489406 wait complete. 2024-09-19T08:52:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.859+0000 7ffb82dfb640 1 Processor -- start 2024-09-19T08:52:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.860+0000 7ffb82dfb640 1 -- start start 2024-09-19T08:52:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.860+0000 7ffb82dfb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb7c100e20 0x7ffb7c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.860+0000 7ffb82dfb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb7c102570 0x7ffb7c1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.860+0000 7ffb82dfb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb7c102ef0 0x7ffb7c1a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.860+0000 7ffb82dfb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c110f80 con 0x7ffb7c102570 2024-09-19T08:52:05.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.860+0000 7ffb82dfb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c110e00 con 0x7ffb7c102ef0 2024-09-19T08:52:05.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.860+0000 7ffb82dfb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c111100 con 0x7ffb7c100e20 2024-09-19T08:52:05.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.860+0000 7ffb7bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb7c102570 0x7ffb7c1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:05.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.860+0000 7ffb7bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb7c102570 0x7ffb7c1997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40580/0 (socket says 172.21.15.7:40580) 2024-09-19T08:52:05.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.860+0000 7ffb7bfff640 1 -- 172.21.15.7:0/1844925083 learned_addr learned my addr 172.21.15.7:0/1844925083 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:05.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.860+0000 7ffb80b97640 1 --2- 172.21.15.7:0/1844925083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb7c100e20 0x7ffb7c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:05.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.860+0000 7ffb81398640 1 --2- 172.21.15.7:0/1844925083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb7c102ef0 0x7ffb7c1a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:05.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.860+0000 7ffb7bfff640 1 -- 172.21.15.7:0/1844925083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb7c100e20 msgr2=0x7ffb7c1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:05.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.860+0000 7ffb7bfff640 1 --2- 172.21.15.7:0/1844925083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb7c100e20 0x7ffb7c1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:05.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.860+0000 7ffb7bfff640 1 -- 172.21.15.7:0/1844925083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb7c102ef0 msgr2=0x7ffb7c1a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:05.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.860+0000 7ffb7bfff640 1 --2- 172.21.15.7:0/1844925083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb7c102ef0 0x7ffb7c1a4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:05.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.860+0000 7ffb7bfff640 1 -- 172.21.15.7:0/1844925083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb7c1a4870 con 0x7ffb7c102570 2024-09-19T08:52:05.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.861+0000 7ffb7bfff640 1 --2- 172.21.15.7:0/1844925083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb7c102570 0x7ffb7c1997f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400c920 tx=0x7ffb6400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:05.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.861+0000 7ffb79ffb640 1 -- 172.21.15.7:0/1844925083 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb64007c70 con 0x7ffb7c102570 2024-09-19T08:52:05.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.861+0000 7ffb79ffb640 1 -- 172.21.15.7:0/1844925083 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb64007e10 con 0x7ffb7c102570 2024-09-19T08:52:05.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.861+0000 7ffb79ffb640 1 -- 172.21.15.7:0/1844925083 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb64018890 con 0x7ffb7c102570 2024-09-19T08:52:05.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.861+0000 7ffb82dfb640 1 -- 172.21.15.7:0/1844925083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb7c1a4a40 con 0x7ffb7c102570 2024-09-19T08:52:05.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.861+0000 7ffb82dfb640 1 -- 172.21.15.7:0/1844925083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb7c1a4f00 con 0x7ffb7c102570 2024-09-19T08:52:05.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.862+0000 7ffb82dfb640 1 -- 172.21.15.7:0/1844925083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb7c101200 con 0x7ffb7c102570 2024-09-19T08:52:05.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.863+0000 7ffb79ffb640 1 -- 172.21.15.7:0/1844925083 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ffb64018a70 con 0x7ffb7c102570 2024-09-19T08:52:05.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.864+0000 7ffb79ffb640 1 --2- 172.21.15.7:0/1844925083 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffb680a33b0 0x7ffb680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:05.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.864+0000 7ffb80b97640 1 --2- 172.21.15.7:0/1844925083 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffb680a33b0 0x7ffb680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:05.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.864+0000 7ffb79ffb640 1 -- 172.21.15.7:0/1844925083 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7ffb640cfe00 con 0x7ffb7c102570 2024-09-19T08:52:05.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.864+0000 7ffb80b97640 1 --2- 172.21.15.7:0/1844925083 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffb680a33b0 0x7ffb680a5870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009230 tx=0x7ffb740058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:05.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:05.868+0000 7ffb79ffb640 1 -- 172.21.15.7:0/1844925083 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffb64014030 con 0x7ffb7c102570 2024-09-19T08:52:06.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:06.080+0000 7ffb82dfb640 1 -- 172.21.15.7:0/1844925083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb7c1a51f0 con 0x7ffb7c102570 2024-09-19T08:52:06.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:06.081+0000 7ffb79ffb640 1 -- 172.21.15.7:0/1844925083 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7ffb6409c7a0 con 0x7ffb7c102570 2024-09-19T08:52:06.082 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:52:06.082 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:52:06.082 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:52:06.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:06.083+0000 7ffb82dfb640 1 -- 172.21.15.7:0/1844925083 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffb680a33b0 msgr2=0x7ffb680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:06.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:06.083+0000 7ffb82dfb640 1 --2- 172.21.15.7:0/1844925083 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffb680a33b0 0x7ffb680a5870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009230 tx=0x7ffb740058d0 comp rx=0 tx=0).stop 2024-09-19T08:52:06.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:06.083+0000 7ffb82dfb640 1 -- 172.21.15.7:0/1844925083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb7c102570 msgr2=0x7ffb7c1997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:06.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:06.083+0000 7ffb82dfb640 1 --2- 172.21.15.7:0/1844925083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb7c102570 0x7ffb7c1997f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400c920 tx=0x7ffb6400cde0 comp rx=0 tx=0).stop 2024-09-19T08:52:06.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:06.083+0000 7ffb82dfb640 1 -- 172.21.15.7:0/1844925083 shutdown_connections 2024-09-19T08:52:06.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:06.083+0000 7ffb82dfb640 1 --2- 172.21.15.7:0/1844925083 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ffb680a33b0 0x7ffb680a5870 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:06.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:06.083+0000 7ffb82dfb640 1 --2- 172.21.15.7:0/1844925083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb7c102ef0 0x7ffb7c1a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:06.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:06.083+0000 7ffb82dfb640 1 --2- 172.21.15.7:0/1844925083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb7c102570 0x7ffb7c1997f0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:06.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:06.083+0000 7ffb82dfb640 1 --2- 172.21.15.7:0/1844925083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb7c100e20 0x7ffb7c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:06.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:06.083+0000 7ffb82dfb640 1 -- 172.21.15.7:0/1844925083 >> 172.21.15.7:0/1844925083 conn(0x7ffb7c0fc7d0 msgr2=0x7ffb7c106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:06.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:06.084+0000 7ffb82dfb640 1 -- 172.21.15.7:0/1844925083 shutdown_connections 2024-09-19T08:52:06.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:06.084+0000 7ffb82dfb640 1 -- 172.21.15.7:0/1844925083 wait complete. 2024-09-19T08:52:06.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:06 smithi175 ceph-mon[35688]: pgmap v232: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:52:06.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:06 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1844925083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:06.699 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:06 smithi007 ceph-mon[31221]: pgmap v232: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:52:06.699 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:06 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1844925083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:06.731 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:52:06.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:06 smithi044 ceph-mon[35072]: pgmap v232: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:52:06.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:06 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1844925083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:07.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.503+0000 7f633a7cb640 1 -- 172.21.15.7:0/635814632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6334101280 msgr2=0x7f633410df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:07.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.503+0000 7f633a7cb640 1 --2- 172.21.15.7:0/635814632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6334101280 0x7f633410df40 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f631c009900 tx=0x7f631c02a410 comp rx=0 tx=0).stop 2024-09-19T08:52:07.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.503+0000 7f633a7cb640 1 -- 172.21.15.7:0/635814632 shutdown_connections 2024-09-19T08:52:07.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.503+0000 7f633a7cb640 1 --2- 172.21.15.7:0/635814632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f633410e480 0x7f6334110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.503+0000 7f633a7cb640 1 --2- 172.21.15.7:0/635814632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6334101280 0x7f633410df40 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.503+0000 7f633a7cb640 1 --2- 172.21.15.7:0/635814632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63341008d0 0x7f6334100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.503+0000 7f633a7cb640 1 -- 172.21.15.7:0/635814632 >> 172.21.15.7:0/635814632 conn(0x7f63340fc7a0 msgr2=0x7f63340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:07.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.503+0000 7f633a7cb640 1 -- 172.21.15.7:0/635814632 shutdown_connections 2024-09-19T08:52:07.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.503+0000 7f633a7cb640 1 -- 172.21.15.7:0/635814632 wait complete. 2024-09-19T08:52:07.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.504+0000 7f633a7cb640 1 Processor -- start 2024-09-19T08:52:07.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.504+0000 7f633a7cb640 1 -- start start 2024-09-19T08:52:07.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.504+0000 7f633a7cb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63341008d0 0x7f633419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.504+0000 7f633a7cb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6334101280 0x7f633419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.504+0000 7f633a7cb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f633410e480 0x7f633419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.504+0000 7f633a7cb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6334114190 con 0x7f6334101280 2024-09-19T08:52:07.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.504+0000 7f633a7cb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6334114010 con 0x7f633410e480 2024-09-19T08:52:07.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.504+0000 7f633a7cb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6334114310 con 0x7f63341008d0 2024-09-19T08:52:07.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.504+0000 7f632bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6334101280 0x7f633419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.504+0000 7f632bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6334101280 0x7f633419abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40594/0 (socket says 172.21.15.7:40594) 2024-09-19T08:52:07.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.504+0000 7f632bfff640 1 -- 172.21.15.7:0/98370427 learned_addr learned my addr 172.21.15.7:0/98370427 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:07.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.504+0000 7f6333fff640 1 --2- 172.21.15.7:0/98370427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63341008d0 0x7f633419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.504+0000 7f6338d68640 1 --2- 172.21.15.7:0/98370427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f633410e480 0x7f633419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.504+0000 7f632bfff640 1 -- 172.21.15.7:0/98370427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63341008d0 msgr2=0x7f633419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:07.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.504+0000 7f632bfff640 1 --2- 172.21.15.7:0/98370427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63341008d0 0x7f633419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.504+0000 7f632bfff640 1 -- 172.21.15.7:0/98370427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f633410e480 msgr2=0x7f633419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:07.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.504+0000 7f632bfff640 1 --2- 172.21.15.7:0/98370427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f633410e480 0x7f633419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.504+0000 7f632bfff640 1 -- 172.21.15.7:0/98370427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633419f640 con 0x7f6334101280 2024-09-19T08:52:07.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.504+0000 7f6338d68640 1 --2- 172.21.15.7:0/98370427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f633410e480 0x7f633419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:07.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.505+0000 7f632bfff640 1 --2- 172.21.15.7:0/98370427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6334101280 0x7f633419abd0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f631c006010 tx=0x7f631c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:07.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.505+0000 7f6331ffb640 1 -- 172.21.15.7:0/98370427 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c03f030 con 0x7f6334101280 2024-09-19T08:52:07.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.505+0000 7f6331ffb640 1 -- 172.21.15.7:0/98370427 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f631c003ce0 con 0x7f6334101280 2024-09-19T08:52:07.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.505+0000 7f633a7cb640 1 -- 172.21.15.7:0/98370427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f633419f8d0 con 0x7f6334101280 2024-09-19T08:52:07.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.505+0000 7f6331ffb640 1 -- 172.21.15.7:0/98370427 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c035070 con 0x7f6334101280 2024-09-19T08:52:07.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.505+0000 7f633a7cb640 1 -- 172.21.15.7:0/98370427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63341a7210 con 0x7f6334101280 2024-09-19T08:52:07.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.507+0000 7f6331ffb640 1 -- 172.21.15.7:0/98370427 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f631c042030 con 0x7f6334101280 2024-09-19T08:52:07.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.507+0000 7f633cba4740 1 Processor -- start 2024-09-19T08:52:07.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.507+0000 7f633cba4740 1 -- start start 2024-09-19T08:52:07.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.508+0000 7f633cba4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5809b1b40 0x55e5809b0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.508+0000 7f633cba4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b05d0 0x55e5809b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.508+0000 7f633cba4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5809bb370 0x55e5809bd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.508+0000 7f633cba4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e5809162f0 con 0x55e5809b05d0 2024-09-19T08:52:07.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.508+0000 7f633cba4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e5808bdcf0 con 0x55e5809b1b40 2024-09-19T08:52:07.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.508+0000 7f633cba4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e5809122b0 con 0x55e5809bb370 2024-09-19T08:52:07.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.508+0000 7f6333fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b05d0 0x55e5809b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.508+0000 7f6333fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b05d0 0x55e5809b0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40604/0 (socket says 172.21.15.7:40604) 2024-09-19T08:52:07.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.508+0000 7f6333fff640 1 -- 172.21.15.7:0/3672629651 learned_addr learned my addr 172.21.15.7:0/3672629651 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:07.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.508+0000 7f6338d68640 1 --2- 172.21.15.7:0/3672629651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5809b1b40 0x55e5809b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.508+0000 7f632bfff640 1 --2- 172.21.15.7:0/3672629651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5809bb370 0x55e5809bd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.508+0000 7f6331ffb640 1 --2- 172.21.15.7:0/98370427 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f63200a3430 0x7f63200a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.508+0000 7f6333fff640 1 -- 172.21.15.7:0/3672629651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5809bb370 msgr2=0x55e5809bd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:07.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.508+0000 7f6333fff640 1 --2- 172.21.15.7:0/3672629651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5809bb370 0x55e5809bd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.508+0000 7f6333fff640 1 -- 172.21.15.7:0/3672629651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5809b1b40 msgr2=0x55e5809b0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:07.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.508+0000 7f6333fff640 1 --2- 172.21.15.7:0/3672629651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5809b1b40 0x55e5809b0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.508+0000 7f6333fff640 1 -- 172.21.15.7:0/3672629651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5808a23a0 con 0x55e5809b05d0 2024-09-19T08:52:07.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.508+0000 7f6338d68640 1 --2- 172.21.15.7:0/98370427 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f63200a3430 0x7f63200a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.508+0000 7f6333fff640 1 --2- 172.21.15.7:0/3672629651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b05d0 0x55e5809b0a10 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f632400dcb0 tx=0x7f632400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b3eac44325c6c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:07.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.508+0000 7f6331ffb640 1 -- 172.21.15.7:0/98370427 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f631c0f0370 con 0x7f6334101280 2024-09-19T08:52:07.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.508+0000 7f632a7fc640 1 -- 172.21.15.7:0/3672629651 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6324011440 con 0x55e5809b05d0 2024-09-19T08:52:07.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.509+0000 7f632a7fc640 1 -- 172.21.15.7:0/3672629651 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6324011ac0 con 0x55e5809b05d0 2024-09-19T08:52:07.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.509+0000 7f632a7fc640 1 -- 172.21.15.7:0/3672629651 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632401baf0 con 0x55e5809b05d0 2024-09-19T08:52:07.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.509+0000 7f633cba4740 1 -- 172.21.15.7:0/3672629651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b05d0 msgr2=0x55e5809b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:07.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.509+0000 7f6338d68640 1 --2- 172.21.15.7:0/98370427 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f63200a3430 0x7f63200a58f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f633406a0f0 tx=0x7f632c004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:07.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.509+0000 7f633cba4740 1 --2- 172.21.15.7:0/3672629651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b05d0 0x55e5809b0a10 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f632400dcb0 tx=0x7f632400f730 comp rx=0 tx=0).stop 2024-09-19T08:52:07.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.509+0000 7f633cba4740 1 -- 172.21.15.7:0/3672629651 shutdown_connections 2024-09-19T08:52:07.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.509+0000 7f633cba4740 1 --2- 172.21.15.7:0/3672629651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5809bb370 0x55e5809bd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.509+0000 7f633cba4740 1 --2- 172.21.15.7:0/3672629651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b05d0 0x55e5809b0a10 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.509+0000 7f633cba4740 1 --2- 172.21.15.7:0/3672629651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5809b1b40 0x55e5809b0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.509+0000 7f633cba4740 1 -- 172.21.15.7:0/3672629651 >> 172.21.15.7:0/3672629651 conn(0x55e580979310 msgr2=0x55e5809acc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:07.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.509+0000 7f633cba4740 1 -- 172.21.15.7:0/3672629651 shutdown_connections 2024-09-19T08:52:07.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.509+0000 7f633cba4740 1 -- 172.21.15.7:0/3672629651 wait complete. 2024-09-19T08:52:07.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.510+0000 7f633cba4740 1 -- start start 2024-09-19T08:52:07.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.510+0000 7f633cba4740 1 Processor -- start 2024-09-19T08:52:07.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.510+0000 7f633cba4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5809b05d0 0x55e5809bad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.510+0000 7f633cba4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b1b40 0x55e5809b8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.510+0000 7f633cba4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5809bb370 0x55e5809b8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.510+0000 7f633cba4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e5809be070 con 0x55e5809b1b40 2024-09-19T08:52:07.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.510+0000 7f633cba4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e5808d1060 con 0x55e5809b05d0 2024-09-19T08:52:07.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.510+0000 7f633cba4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e5809be1f0 con 0x55e5809bb370 2024-09-19T08:52:07.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.510+0000 7f633cba4740 10 client.0 _ll_register_callbacks cb 0x55e5806248c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:07.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.510+0000 7f632bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b1b40 0x55e5809b8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.510+0000 7f632bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b1b40 0x55e5809b8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40610/0 (socket says 172.21.15.7:40610) 2024-09-19T08:52:07.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.510+0000 7f632bfff640 1 -- 172.21.15.7:0/2439014683 learned_addr learned my addr 172.21.15.7:0/2439014683 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:07.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.510+0000 7f6333fff640 1 --2- 172.21.15.7:0/2439014683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5809b05d0 0x55e5809bad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.511+0000 7f6338d68640 1 --2- 172.21.15.7:0/2439014683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5809bb370 0x55e5809b8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.511+0000 7f632bfff640 1 -- 172.21.15.7:0/2439014683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5809bb370 msgr2=0x55e5809b8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:07.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.511+0000 7f632bfff640 1 --2- 172.21.15.7:0/2439014683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5809bb370 0x55e5809b8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.511+0000 7f632bfff640 1 -- 172.21.15.7:0/2439014683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5809b05d0 msgr2=0x55e5809bad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:07.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.511+0000 7f632bfff640 1 --2- 172.21.15.7:0/2439014683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5809b05d0 0x55e5809bad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.511+0000 7f632bfff640 1 -- 172.21.15.7:0/2439014683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5806873c0 con 0x55e5809b1b40 2024-09-19T08:52:07.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.511+0000 7f6338d68640 1 --2- 172.21.15.7:0/2439014683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5809bb370 0x55e5809b8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:07.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.511+0000 7f632bfff640 1 --2- 172.21.15.7:0/2439014683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b1b40 0x55e5809b8030 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f631c0ee080 tx=0x7f631c003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c34549eee9fafc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:07.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.511+0000 7f63137fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:07.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.511+0000 7f63137fe640 1 -- 172.21.15.7:0/2439014683 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c049070 con 0x55e5809b1b40 2024-09-19T08:52:07.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.511+0000 7f63137fe640 1 -- 172.21.15.7:0/2439014683 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f631c0edd00 con 0x55e5809b1b40 2024-09-19T08:52:07.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.511+0000 7f633cba4740 1 -- 172.21.15.7:0/2439014683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6324011ac0 con 0x55e5809b1b40 2024-09-19T08:52:07.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.511+0000 7f63137fe640 1 -- 172.21.15.7:0/2439014683 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f631c0b8970 con 0x55e5809b1b40 2024-09-19T08:52:07.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.511+0000 7f633cba4740 10 client.16842 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:07.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.511+0000 7f633cba4740 1 -- 172.21.15.7:0/2439014683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e5809c9b40 con 0x55e5809b1b40 2024-09-19T08:52:07.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.511+0000 7f63137fe640 1 -- 172.21.15.7:0/2439014683 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6324011ac0 con 0x55e5809b1b40 2024-09-19T08:52:07.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.512+0000 7f63137fe640 1 -- 172.21.15.7:0/2439014683 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f631c0b8d40 con 0x55e5809b1b40 2024-09-19T08:52:07.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.512+0000 7f633cba4740 10 client.16842 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:07.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.512+0000 7f633cba4740 10 client.16842 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:52:07.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.512+0000 7f633cba4740 20 client.16842 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:07.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.512+0000 7f633cba4740 1 --2- 172.21.15.7:0/2439014683 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55e5809caf30 0x55e5809cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.512+0000 7f633cba4740 4 client.16842 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:07.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.512+0000 7f633cba4740 1 -- 172.21.15.7:0/2439014683 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e580923860 con 0x55e5809caf30 2024-09-19T08:52:07.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.512+0000 7f6333fff640 1 --2- 172.21.15.7:0/2439014683 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55e5809caf30 0x55e5809cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.512+0000 7f6333fff640 1 --2- 172.21.15.7:0/2439014683 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55e5809caf30 0x55e5809cd320 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cb271395385448f1 server_cookie=9451caf53a82af26 in_seq=0 out_seq=0 2024-09-19T08:52:07.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.512+0000 7f63137fe640 10 client.16842 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:52:07.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.513+0000 7f63137fe640 1 -- 172.21.15.7:0/2439014683 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e580923860 con 0x55e5809caf30 2024-09-19T08:52:07.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.513+0000 7f63137fe640 10 client.16842 handle_command_reply: tid=0 2024-09-19T08:52:07.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.513+0000 7f633cba4740 1 client.16842 shutdown 2024-09-19T08:52:07.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.513+0000 7f633cba4740 1 -- 172.21.15.7:0/2439014683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b1b40 msgr2=0x55e5809b8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:07.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.513+0000 7f633cba4740 1 --2- 172.21.15.7:0/2439014683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b1b40 0x55e5809b8030 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f631c0ee080 tx=0x7f631c003e90 comp rx=0 tx=0).stop 2024-09-19T08:52:07.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.513+0000 7f633cba4740 1 -- 172.21.15.7:0/2439014683 shutdown_connections 2024-09-19T08:52:07.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.513+0000 7f633cba4740 1 --2- 172.21.15.7:0/2439014683 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55e5809caf30 0x55e5809cd320 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.513+0000 7f633cba4740 1 --2- 172.21.15.7:0/2439014683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5809bb370 0x55e5809b8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.514+0000 7f63137fe640 0 client.16842 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:52:07.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.514+0000 7f633cba4740 1 --2- 172.21.15.7:0/2439014683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b1b40 0x55e5809b8030 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.514+0000 7f633cba4740 1 --2- 172.21.15.7:0/2439014683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5809b05d0 0x55e5809bad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.514+0000 7f633cba4740 1 -- 172.21.15.7:0/2439014683 >> 172.21.15.7:0/2439014683 conn(0x55e580979310 msgr2=0x55e5809b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:07.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.514+0000 7f633cba4740 1 -- 172.21.15.7:0/2439014683 shutdown_connections 2024-09-19T08:52:07.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.514+0000 7f633cba4740 1 -- 172.21.15.7:0/2439014683 wait complete. 2024-09-19T08:52:07.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.514+0000 7f633cba4740 20 client.16842 trim_cache size 0 max 16384 2024-09-19T08:52:07.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.527+0000 7f633cba4740 1 Processor -- start 2024-09-19T08:52:07.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.527+0000 7f633cba4740 1 -- start start 2024-09-19T08:52:07.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.527+0000 7f633cba4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5809b05d0 0x55e5809ace10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.527+0000 7f633cba4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b1b40 0x55e5809c7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.527+0000 7f633cba4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5809bb370 0x55e5809d2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.527+0000 7f633cba4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f63341b2420 con 0x55e5809b1b40 2024-09-19T08:52:07.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.527+0000 7f633cba4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f63341afcf0 con 0x55e5809bb370 2024-09-19T08:52:07.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.527+0000 7f633cba4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f63341adb60 con 0x55e5809b05d0 2024-09-19T08:52:07.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.527+0000 7f632bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b1b40 0x55e5809c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.527+0000 7f632bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b1b40 0x55e5809c7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40624/0 (socket says 172.21.15.7:40624) 2024-09-19T08:52:07.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.527+0000 7f632bfff640 1 -- 172.21.15.7:0/3931137634 learned_addr learned my addr 172.21.15.7:0/3931137634 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:07.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.527+0000 7f6338d68640 1 --2- 172.21.15.7:0/3931137634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5809bb370 0x55e5809d2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.528+0000 7f6333fff640 1 --2- 172.21.15.7:0/3931137634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5809b05d0 0x55e5809ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.528+0000 7f632bfff640 1 -- 172.21.15.7:0/3931137634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5809b05d0 msgr2=0x55e5809ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:07.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.528+0000 7f632bfff640 1 --2- 172.21.15.7:0/3931137634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5809b05d0 0x55e5809ace10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.528+0000 7f632bfff640 1 -- 172.21.15.7:0/3931137634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5809bb370 msgr2=0x55e5809d2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:07.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.528+0000 7f632bfff640 1 --2- 172.21.15.7:0/3931137634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5809bb370 0x55e5809d2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.528+0000 7f632bfff640 1 -- 172.21.15.7:0/3931137634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5809bdad0 con 0x55e5809b1b40 2024-09-19T08:52:07.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.528+0000 7f632bfff640 1 --2- 172.21.15.7:0/3931137634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b1b40 0x55e5809c7310 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f631c0ba980 tx=0x7f631c005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d715d36857d562 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:07.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.528+0000 7f6329ffb640 1 -- 172.21.15.7:0/3931137634 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c049030 con 0x55e5809b1b40 2024-09-19T08:52:07.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.528+0000 7f6329ffb640 1 -- 172.21.15.7:0/3931137634 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f631c0bcdd0 con 0x55e5809b1b40 2024-09-19T08:52:07.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.528+0000 7f6329ffb640 1 -- 172.21.15.7:0/3931137634 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c0044e0 con 0x55e5809b1b40 2024-09-19T08:52:07.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.529+0000 7f633cba4740 1 -- 172.21.15.7:0/3931137634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b1b40 msgr2=0x55e5809c7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:07.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.529+0000 7f633cba4740 1 --2- 172.21.15.7:0/3931137634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b1b40 0x55e5809c7310 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f631c0ba980 tx=0x7f631c005c90 comp rx=0 tx=0).stop 2024-09-19T08:52:07.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.529+0000 7f633cba4740 1 -- 172.21.15.7:0/3931137634 shutdown_connections 2024-09-19T08:52:07.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.529+0000 7f633cba4740 1 --2- 172.21.15.7:0/3931137634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5809bb370 0x55e5809d2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.529+0000 7f633cba4740 1 --2- 172.21.15.7:0/3931137634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b1b40 0x55e5809c7310 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.529+0000 7f633cba4740 1 --2- 172.21.15.7:0/3931137634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5809b05d0 0x55e5809ace10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.529+0000 7f633cba4740 1 -- 172.21.15.7:0/3931137634 >> 172.21.15.7:0/3931137634 conn(0x55e580979310 msgr2=0x55e5809ac700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:07.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.529+0000 7f633cba4740 1 -- 172.21.15.7:0/3931137634 shutdown_connections 2024-09-19T08:52:07.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.529+0000 7f633cba4740 1 -- 172.21.15.7:0/3931137634 wait complete. 2024-09-19T08:52:07.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.529+0000 7f633cba4740 1 -- start start 2024-09-19T08:52:07.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.529+0000 7f633cba4740 1 Processor -- start 2024-09-19T08:52:07.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.530+0000 7f633cba4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b05d0 0x55e5809c3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.530+0000 7f633cba4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5809b1b40 0x55e5809c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.530+0000 7f633cba4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5809bb370 0x55e5809c0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.530+0000 7f633cba4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f63341ae1b0 con 0x55e5809b05d0 2024-09-19T08:52:07.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.530+0000 7f633cba4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f63341af620 con 0x55e5809bb370 2024-09-19T08:52:07.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.530+0000 7f633cba4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f63341ae880 con 0x55e5809b1b40 2024-09-19T08:52:07.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.530+0000 7f633cba4740 10 client.0 _ll_register_callbacks cb 0x7f631c005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:07.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.530+0000 7f6333fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b05d0 0x55e5809c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.530+0000 7f6333fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b05d0 0x55e5809c3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40634/0 (socket says 172.21.15.7:40634) 2024-09-19T08:52:07.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.530+0000 7f6333fff640 1 -- 172.21.15.7:0/520449874 learned_addr learned my addr 172.21.15.7:0/520449874 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:07.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.530+0000 7f632bfff640 1 --2- 172.21.15.7:0/520449874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5809b1b40 0x55e5809c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.530+0000 7f6338d68640 1 --2- 172.21.15.7:0/520449874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5809bb370 0x55e5809c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.530+0000 7f6333fff640 1 -- 172.21.15.7:0/520449874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5809b1b40 msgr2=0x55e5809c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:07.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.530+0000 7f6333fff640 1 --2- 172.21.15.7:0/520449874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5809b1b40 0x55e5809c39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.530+0000 7f6333fff640 1 -- 172.21.15.7:0/520449874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5809bb370 msgr2=0x55e5809c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:07.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.530+0000 7f6333fff640 1 --2- 172.21.15.7:0/520449874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5809bb370 0x55e5809c0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.530+0000 7f6333fff640 1 -- 172.21.15.7:0/520449874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5809c0990 con 0x55e5809b05d0 2024-09-19T08:52:07.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.530+0000 7f6338d68640 1 --2- 172.21.15.7:0/520449874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5809bb370 0x55e5809c0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:07.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.530+0000 7f6333fff640 1 --2- 172.21.15.7:0/520449874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b05d0 0x55e5809c3480 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f632400dbd0 tx=0x7f632400dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf21a1b7f57cb86e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:07.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.530+0000 7f63137fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:07.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.531+0000 7f63137fe640 1 -- 172.21.15.7:0/520449874 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6324004240 con 0x55e5809b05d0 2024-09-19T08:52:07.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.531+0000 7f63137fe640 1 -- 172.21.15.7:0/520449874 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f63240043e0 con 0x55e5809b05d0 2024-09-19T08:52:07.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.531+0000 7f633cba4740 1 -- 172.21.15.7:0/520449874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f631c0bcdd0 con 0x55e5809b05d0 2024-09-19T08:52:07.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.531+0000 7f63137fe640 1 -- 172.21.15.7:0/520449874 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6324035050 con 0x55e5809b05d0 2024-09-19T08:52:07.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.531+0000 7f633cba4740 10 client.16848 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:07.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.531+0000 7f633cba4740 1 -- 172.21.15.7:0/520449874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e580a36270 con 0x55e5809b05d0 2024-09-19T08:52:07.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.531+0000 7f63137fe640 1 -- 172.21.15.7:0/520449874 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f631c0bcdd0 con 0x55e5809b05d0 2024-09-19T08:52:07.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.531+0000 7f63137fe640 1 -- 172.21.15.7:0/520449874 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f632401ba60 con 0x55e5809b05d0 2024-09-19T08:52:07.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.531+0000 7f633cba4740 10 client.16848 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:07.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.531+0000 7f633cba4740 10 client.16848 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:52:07.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.531+0000 7f633cba4740 20 client.16848 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:07.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.531+0000 7f633cba4740 1 --2- 172.21.15.7:0/520449874 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55e5809caf30 0x55e580a386c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:07.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.531+0000 7f633cba4740 4 client.16848 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:52:07.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.531+0000 7f633cba4740 1 -- 172.21.15.7:0/520449874 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e58091dd70 con 0x55e5809caf30 2024-09-19T08:52:07.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.532+0000 7f632bfff640 1 --2- 172.21.15.7:0/520449874 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55e5809caf30 0x55e580a386c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:07.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.532+0000 7f632bfff640 1 --2- 172.21.15.7:0/520449874 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55e5809caf30 0x55e580a386c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=187e3a932c76c3ea server_cookie=964f213570e05fb0 in_seq=0 out_seq=0 2024-09-19T08:52:07.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.532+0000 7f63137fe640 10 client.16848 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:52:07.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.532+0000 7f63137fe640 1 -- 172.21.15.7:0/520449874 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e58091dd70 con 0x55e5809caf30 2024-09-19T08:52:07.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.532+0000 7f63137fe640 10 client.16848 handle_command_reply: tid=0 2024-09-19T08:52:07.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.532+0000 7f633cba4740 1 client.16848 shutdown 2024-09-19T08:52:07.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.532+0000 7f633cba4740 1 -- 172.21.15.7:0/520449874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b05d0 msgr2=0x55e5809c3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:07.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.532+0000 7f633cba4740 1 --2- 172.21.15.7:0/520449874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b05d0 0x55e5809c3480 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f632400dbd0 tx=0x7f632400dda0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.532+0000 7f633cba4740 1 -- 172.21.15.7:0/520449874 shutdown_connections 2024-09-19T08:52:07.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.532+0000 7f633cba4740 1 --2- 172.21.15.7:0/520449874 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55e5809caf30 0x55e580a386c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.532+0000 7f633cba4740 1 --2- 172.21.15.7:0/520449874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5809bb370 0x55e5809c0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.533+0000 7f633cba4740 1 --2- 172.21.15.7:0/520449874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5809b1b40 0x55e5809c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.533+0000 7f63137fe640 0 client.16848 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:52:07.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.533+0000 7f633cba4740 1 --2- 172.21.15.7:0/520449874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5809b05d0 0x55e5809c3480 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.533+0000 7f633cba4740 1 -- 172.21.15.7:0/520449874 >> 172.21.15.7:0/520449874 conn(0x55e580979310 msgr2=0x55e5809b9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:07.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.533+0000 7f633cba4740 1 -- 172.21.15.7:0/520449874 shutdown_connections 2024-09-19T08:52:07.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.533+0000 7f633cba4740 1 -- 172.21.15.7:0/520449874 wait complete. 2024-09-19T08:52:07.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.533+0000 7f633cba4740 20 client.16848 trim_cache size 0 max 16384 2024-09-19T08:52:07.539 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:52:07.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.533+0000 7f633a7cb640 1 -- 172.21.15.7:0/98370427 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f63200a3430 msgr2=0x7f63200a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:07.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.533+0000 7f633a7cb640 1 --2- 172.21.15.7:0/98370427 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f63200a3430 0x7f63200a58f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f633406a0f0 tx=0x7f632c004a40 comp rx=0 tx=0).stop 2024-09-19T08:52:07.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.533+0000 7f633a7cb640 1 -- 172.21.15.7:0/98370427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6334101280 msgr2=0x7f633419abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:07.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.533+0000 7f633a7cb640 1 --2- 172.21.15.7:0/98370427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6334101280 0x7f633419abd0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f631c006010 tx=0x7f631c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.533+0000 7f633a7cb640 1 -- 172.21.15.7:0/98370427 shutdown_connections 2024-09-19T08:52:07.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.533+0000 7f633a7cb640 1 --2- 172.21.15.7:0/98370427 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f63200a3430 0x7f63200a58f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.533+0000 7f633a7cb640 1 --2- 172.21.15.7:0/98370427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f633410e480 0x7f633419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.533+0000 7f633a7cb640 1 --2- 172.21.15.7:0/98370427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6334101280 0x7f633419abd0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.533+0000 7f633a7cb640 1 --2- 172.21.15.7:0/98370427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63341008d0 0x7f633419a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:07.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.533+0000 7f633a7cb640 1 -- 172.21.15.7:0/98370427 >> 172.21.15.7:0/98370427 conn(0x7f63340fc7a0 msgr2=0x7f63340feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:07.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.533+0000 7f633a7cb640 1 -- 172.21.15.7:0/98370427 shutdown_connections 2024-09-19T08:52:07.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:07.533+0000 7f633a7cb640 1 -- 172.21.15.7:0/98370427 wait complete. 2024-09-19T08:52:08.248 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:52:08.508 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:08.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:08 smithi007 ceph-mon[31221]: pgmap v233: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:52:08.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:08 smithi175 ceph-mon[35688]: pgmap v233: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:52:08.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:08 smithi044 ceph-mon[35072]: pgmap v233: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:52:08.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.953+0000 7f66549a1640 1 -- 172.21.15.7:0/3868681270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6650102380 msgr2=0x7f665010e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:08.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.953+0000 7f66549a1640 1 --2- 172.21.15.7:0/3868681270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6650102380 0x7f665010e9c0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f6648009cd0 tx=0x7f664802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.954+0000 7f66549a1640 1 -- 172.21.15.7:0/3868681270 shutdown_connections 2024-09-19T08:52:08.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.954+0000 7f66549a1640 1 --2- 172.21.15.7:0/3868681270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6650102380 0x7f665010e9c0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.954+0000 7f66549a1640 1 --2- 172.21.15.7:0/3868681270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66501019e0 0x7f6650101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.954+0000 7f66549a1640 1 --2- 172.21.15.7:0/3868681270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6650107af0 0x7f6650107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.954+0000 7f66549a1640 1 -- 172.21.15.7:0/3868681270 >> 172.21.15.7:0/3868681270 conn(0x7f66500fd700 msgr2=0x7f66500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:08.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.954+0000 7f66549a1640 1 -- 172.21.15.7:0/3868681270 shutdown_connections 2024-09-19T08:52:08.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.954+0000 7f66549a1640 1 -- 172.21.15.7:0/3868681270 wait complete. 2024-09-19T08:52:08.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.954+0000 7f66549a1640 1 Processor -- start 2024-09-19T08:52:08.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.954+0000 7f66549a1640 1 -- start start 2024-09-19T08:52:08.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.955+0000 7f66549a1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66501019e0 0x7f66500744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:08.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.955+0000 7f66549a1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6650102380 0x7f6650074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:08.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.955+0000 7f66549a1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6650107af0 0x7f6650074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:08.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.955+0000 7f66549a1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6650111ef0 con 0x7f6650107af0 2024-09-19T08:52:08.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.955+0000 7f66549a1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6650111d70 con 0x7f66501019e0 2024-09-19T08:52:08.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.955+0000 7f66549a1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6650112070 con 0x7f6650102380 2024-09-19T08:52:08.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.955+0000 7f664ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6650107af0 0x7f6650074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:08.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.955+0000 7f664ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6650107af0 0x7f6650074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40660/0 (socket says 172.21.15.7:40660) 2024-09-19T08:52:08.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.955+0000 7f664ffff640 1 -- 172.21.15.7:0/2735912360 learned_addr learned my addr 172.21.15.7:0/2735912360 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:08.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.955+0000 7f664f7fe640 1 --2- 172.21.15.7:0/2735912360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66501019e0 0x7f66500744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:08.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.955+0000 7f664effd640 1 --2- 172.21.15.7:0/2735912360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6650102380 0x7f6650074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:08.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.955+0000 7f664ffff640 1 -- 172.21.15.7:0/2735912360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6650102380 msgr2=0x7f6650074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:08.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.955+0000 7f664ffff640 1 --2- 172.21.15.7:0/2735912360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6650102380 0x7f6650074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.955+0000 7f664ffff640 1 -- 172.21.15.7:0/2735912360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66501019e0 msgr2=0x7f66500744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:08.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.955+0000 7f664ffff640 1 --2- 172.21.15.7:0/2735912360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66501019e0 0x7f66500744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.955+0000 7f664ffff640 1 -- 172.21.15.7:0/2735912360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66501a6810 con 0x7f6650107af0 2024-09-19T08:52:08.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.955+0000 7f664ffff640 1 --2- 172.21.15.7:0/2735912360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6650107af0 0x7f6650074f70 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f6648005cc0 tx=0x7f6648032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:08.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.956+0000 7f664cff9640 1 -- 172.21.15.7:0/2735912360 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6648004040 con 0x7f6650107af0 2024-09-19T08:52:08.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.956+0000 7f664cff9640 1 -- 172.21.15.7:0/2735912360 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66480046c0 con 0x7f6650107af0 2024-09-19T08:52:08.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.956+0000 7f66549a1640 1 -- 172.21.15.7:0/2735912360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66501a6aa0 con 0x7f6650107af0 2024-09-19T08:52:08.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.956+0000 7f664cff9640 1 -- 172.21.15.7:0/2735912360 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6648030e00 con 0x7f6650107af0 2024-09-19T08:52:08.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.956+0000 7f66549a1640 1 -- 172.21.15.7:0/2735912360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66501a6fe0 con 0x7f6650107af0 2024-09-19T08:52:08.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.958+0000 7f664cff9640 1 -- 172.21.15.7:0/2735912360 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f66480305a0 con 0x7f6650107af0 2024-09-19T08:52:08.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.958+0000 7f6657fdc740 1 Processor -- start 2024-09-19T08:52:08.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.958+0000 7f6657fdc740 1 -- start start 2024-09-19T08:52:08.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f664cff9640 1 --2- 172.21.15.7:0/2735912360 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f66380a33b0 0x7f66380a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:08.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f6657fdc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e985bb9d20 0x55e985bb8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:08.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f664cff9640 1 -- 172.21.15.7:0/2735912360 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f664802e030 con 0x7f6650107af0 2024-09-19T08:52:08.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f664effd640 1 --2- 172.21.15.7:0/2735912360 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f66380a33b0 0x7f66380a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:08.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f6657fdc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bb87b0 0x55e985bb8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:08.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f6657fdc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bc3550 0x55e985bc5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:08.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f6657fdc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e985b1e2f0 con 0x55e985bb87b0 2024-09-19T08:52:08.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f6657fdc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e985ac5cf0 con 0x55e985bc3550 2024-09-19T08:52:08.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f6657fdc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e985b1a2b0 con 0x55e985bb9d20 2024-09-19T08:52:08.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f664effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bb87b0 0x55e985bb8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:08.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f664f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e985bb9d20 0x55e985bb8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:08.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f664effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bb87b0 0x55e985bb8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40666/0 (socket says 172.21.15.7:40666) 2024-09-19T08:52:08.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f664f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e985bb9d20 0x55e985bb8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.7:53016/0 (socket says 172.21.15.7:53016) 2024-09-19T08:52:08.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f664effd640 1 -- 172.21.15.7:0/3302606398 learned_addr learned my addr 172.21.15.7:0/3302606398 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:08.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f664ffff640 1 --2- 172.21.15.7:0/3302606398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bc3550 0x55e985bc5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:08.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f664effd640 1 --2- 172.21.15.7:0/2735912360 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f66380a33b0 0x7f66380a5870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6644013570 tx=0x7f6644013970 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:08.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f664effd640 1 -- 172.21.15.7:0/3302606398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e985bb9d20 msgr2=0x55e985bb8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:08.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f664effd640 1 --2- 172.21.15.7:0/3302606398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e985bb9d20 0x55e985bb8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f664effd640 1 -- 172.21.15.7:0/3302606398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bc3550 msgr2=0x55e985bc5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:08.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f664effd640 1 --2- 172.21.15.7:0/3302606398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bc3550 0x55e985bc5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f664effd640 1 -- 172.21.15.7:0/3302606398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e985aaa3a0 con 0x55e985bb87b0 2024-09-19T08:52:08.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f664ffff640 1 --2- 172.21.15.7:0/3302606398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bc3550 0x55e985bc5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:08.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.959+0000 7f664f7fe640 1 --2- 172.21.15.7:0/3302606398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e985bb9d20 0x55e985bb8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:08.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.960+0000 7f664effd640 1 --2- 172.21.15.7:0/3302606398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bb87b0 0x55e985bb8bf0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f6644009b70 tx=0x7f6644020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8faab20fe215ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:08.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.960+0000 7f6635ffb640 1 -- 172.21.15.7:0/3302606398 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664400fe30 con 0x55e985bb87b0 2024-09-19T08:52:08.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.960+0000 7f6635ffb640 1 -- 172.21.15.7:0/3302606398 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6644024070 con 0x55e985bb87b0 2024-09-19T08:52:08.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.960+0000 7f6635ffb640 1 -- 172.21.15.7:0/3302606398 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6644005220 con 0x55e985bb87b0 2024-09-19T08:52:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.960+0000 7f6657fdc740 1 -- 172.21.15.7:0/3302606398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bb87b0 msgr2=0x55e985bb8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.960+0000 7f6657fdc740 1 --2- 172.21.15.7:0/3302606398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bb87b0 0x55e985bb8bf0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f6644009b70 tx=0x7f6644020000 comp rx=0 tx=0).stop 2024-09-19T08:52:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.961+0000 7f6657fdc740 1 -- 172.21.15.7:0/3302606398 shutdown_connections 2024-09-19T08:52:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.961+0000 7f6657fdc740 1 --2- 172.21.15.7:0/3302606398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bc3550 0x55e985bc5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.961+0000 7f6657fdc740 1 --2- 172.21.15.7:0/3302606398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bb87b0 0x55e985bb8bf0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.961+0000 7f6657fdc740 1 --2- 172.21.15.7:0/3302606398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e985bb9d20 0x55e985bb8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.961+0000 7f6657fdc740 1 -- 172.21.15.7:0/3302606398 >> 172.21.15.7:0/3302606398 conn(0x55e985b81310 msgr2=0x55e985bb4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.961+0000 7f6657fdc740 1 -- 172.21.15.7:0/3302606398 shutdown_connections 2024-09-19T08:52:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.961+0000 7f6657fdc740 1 -- 172.21.15.7:0/3302606398 wait complete. 2024-09-19T08:52:08.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.961+0000 7f6657fdc740 1 -- start start 2024-09-19T08:52:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.961+0000 7f6657fdc740 1 Processor -- start 2024-09-19T08:52:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.961+0000 7f6657fdc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bb87b0 0x55e985bc2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.961+0000 7f6657fdc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bb9d20 0x55e985bc01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.961+0000 7f6657fdc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e985bc3550 0x55e985bc07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.961+0000 7f6657fdc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e985bc61f0 con 0x55e985bb9d20 2024-09-19T08:52:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.961+0000 7f6657fdc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e985ad9060 con 0x55e985bb87b0 2024-09-19T08:52:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.961+0000 7f6657fdc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e985bc6370 con 0x55e985bc3550 2024-09-19T08:52:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.962+0000 7f6657fdc740 10 client.0 _ll_register_callbacks cb 0x55e98582c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.962+0000 7f664effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bb9d20 0x55e985bc01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.962+0000 7f664effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bb9d20 0x55e985bc01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40678/0 (socket says 172.21.15.7:40678) 2024-09-19T08:52:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.962+0000 7f664effd640 1 -- 172.21.15.7:0/1955361616 learned_addr learned my addr 172.21.15.7:0/1955361616 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.962+0000 7f664f7fe640 1 --2- 172.21.15.7:0/1955361616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bb87b0 0x55e985bc2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:08.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.962+0000 7f664ffff640 1 --2- 172.21.15.7:0/1955361616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e985bc3550 0x55e985bc07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.962+0000 7f664effd640 1 -- 172.21.15.7:0/1955361616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e985bc3550 msgr2=0x55e985bc07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.962+0000 7f664effd640 1 --2- 172.21.15.7:0/1955361616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e985bc3550 0x55e985bc07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.962+0000 7f664effd640 1 -- 172.21.15.7:0/1955361616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bb87b0 msgr2=0x55e985bc2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.962+0000 7f664effd640 1 --2- 172.21.15.7:0/1955361616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bb87b0 0x55e985bc2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.962+0000 7f664effd640 1 -- 172.21.15.7:0/1955361616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e98588f3c0 con 0x55e985bb9d20 2024-09-19T08:52:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.962+0000 7f664effd640 1 --2- 172.21.15.7:0/1955361616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bb9d20 0x55e985bc01c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f6644009dc0 tx=0x7f6644020b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25282026460de9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.962+0000 7f662effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.962+0000 7f662effd640 1 -- 172.21.15.7:0/1955361616 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664402d070 con 0x55e985bb9d20 2024-09-19T08:52:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.962+0000 7f662effd640 1 -- 172.21.15.7:0/1955361616 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f6644005450 con 0x55e985bb9d20 2024-09-19T08:52:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.962+0000 7f6657fdc740 1 -- 172.21.15.7:0/1955361616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6644024070 con 0x55e985bb9d20 2024-09-19T08:52:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.963+0000 7f662effd640 1 -- 172.21.15.7:0/1955361616 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6644039050 con 0x55e985bb9d20 2024-09-19T08:52:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.963+0000 7f6657fdc740 10 client.16860 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:08.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.963+0000 7f6657fdc740 1 -- 172.21.15.7:0/1955361616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e985bd1c50 con 0x55e985bb9d20 2024-09-19T08:52:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.963+0000 7f662effd640 1 -- 172.21.15.7:0/1955361616 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6644024070 con 0x55e985bb9d20 2024-09-19T08:52:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.963+0000 7f662effd640 1 -- 172.21.15.7:0/1955361616 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f664401f070 con 0x55e985bb9d20 2024-09-19T08:52:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.963+0000 7f6657fdc740 10 client.16860 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.963+0000 7f6657fdc740 10 client.16860 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:52:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.963+0000 7f6657fdc740 20 client.16860 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.963+0000 7f6657fdc740 1 --2- 172.21.15.7:0/1955361616 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55e985bd3000 0x55e985bd53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.963+0000 7f6657fdc740 4 client.16860 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.963+0000 7f6657fdc740 1 -- 172.21.15.7:0/1955361616 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e985b2b860 con 0x55e985bd3000 2024-09-19T08:52:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.963+0000 7f664f7fe640 1 --2- 172.21.15.7:0/1955361616 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55e985bd3000 0x55e985bd53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.964+0000 7f664f7fe640 1 --2- 172.21.15.7:0/1955361616 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55e985bd3000 0x55e985bd53f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7879d5ca2ba02fdc server_cookie=ce7d3c754626fec3 in_seq=0 out_seq=0 2024-09-19T08:52:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.964+0000 7f662effd640 10 client.16860 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:52:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.964+0000 7f662effd640 1 -- 172.21.15.7:0/1955361616 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e985b2b860 con 0x55e985bd3000 2024-09-19T08:52:08.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.964+0000 7f662effd640 10 client.16860 handle_command_reply: tid=0 2024-09-19T08:52:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.964+0000 7f6657fdc740 1 client.16860 shutdown 2024-09-19T08:52:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.965+0000 7f6657fdc740 1 -- 172.21.15.7:0/1955361616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bb9d20 msgr2=0x55e985bc01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.965+0000 7f6657fdc740 1 --2- 172.21.15.7:0/1955361616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bb9d20 0x55e985bc01c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f6644009dc0 tx=0x7f6644020b40 comp rx=0 tx=0).stop 2024-09-19T08:52:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.965+0000 7f6657fdc740 1 -- 172.21.15.7:0/1955361616 shutdown_connections 2024-09-19T08:52:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.965+0000 7f6657fdc740 1 --2- 172.21.15.7:0/1955361616 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55e985bd3000 0x55e985bd53f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.965+0000 7f6657fdc740 1 --2- 172.21.15.7:0/1955361616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e985bc3550 0x55e985bc07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.965+0000 7f6657fdc740 1 --2- 172.21.15.7:0/1955361616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bb9d20 0x55e985bc01c0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.965+0000 7f6657fdc740 1 --2- 172.21.15.7:0/1955361616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bb87b0 0x55e985bc2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.965+0000 7f662effd640 0 client.16860 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:52:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.965+0000 7f6657fdc740 1 -- 172.21.15.7:0/1955361616 >> 172.21.15.7:0/1955361616 conn(0x55e985b81310 msgr2=0x55e985bbab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.965+0000 7f6657fdc740 1 -- 172.21.15.7:0/1955361616 shutdown_connections 2024-09-19T08:52:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.965+0000 7f6657fdc740 1 -- 172.21.15.7:0/1955361616 wait complete. 2024-09-19T08:52:08.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.965+0000 7f6657fdc740 20 client.16860 trim_cache size 0 max 16384 2024-09-19T08:52:08.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.978+0000 7f6657fdc740 1 Processor -- start 2024-09-19T08:52:08.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.978+0000 7f6657fdc740 1 -- start start 2024-09-19T08:52:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.978+0000 7f6657fdc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bb87b0 0x55e985bcf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.978+0000 7f6657fdc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bb9d20 0x55e985bbf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.978+0000 7f6657fdc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e985bc3550 0x55e985bdaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.978+0000 7f6657fdc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f66501b2160 con 0x55e985bb9d20 2024-09-19T08:52:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.978+0000 7f6657fdc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f66501afa30 con 0x55e985bb87b0 2024-09-19T08:52:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.978+0000 7f6657fdc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f66501ad8a0 con 0x55e985bc3550 2024-09-19T08:52:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.978+0000 7f664effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bb9d20 0x55e985bbf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.978+0000 7f664f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bb87b0 0x55e985bcf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.978+0000 7f664effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bb9d20 0x55e985bbf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40688/0 (socket says 172.21.15.7:40688) 2024-09-19T08:52:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.978+0000 7f664effd640 1 -- 172.21.15.7:0/760789461 learned_addr learned my addr 172.21.15.7:0/760789461 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.979+0000 7f664effd640 1 -- 172.21.15.7:0/760789461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e985bc3550 msgr2=0x55e985bdaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.979+0000 7f664effd640 1 --2- 172.21.15.7:0/760789461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e985bc3550 0x55e985bdaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.979+0000 7f664effd640 1 -- 172.21.15.7:0/760789461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bb87b0 msgr2=0x55e985bcf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:08.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.979+0000 7f664effd640 1 --2- 172.21.15.7:0/760789461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bb87b0 0x55e985bcf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.979+0000 7f664effd640 1 -- 172.21.15.7:0/760789461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e985bb5b40 con 0x55e985bb9d20 2024-09-19T08:52:08.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.979+0000 7f664f7fe640 1 --2- 172.21.15.7:0/760789461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bb87b0 0x55e985bcf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:08.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.979+0000 7f664effd640 1 --2- 172.21.15.7:0/760789461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bb9d20 0x55e985bbf1a0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f66440092e0 tx=0x7f66440097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321ed367c3180ac6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:08.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.979+0000 7f66357fa640 1 -- 172.21.15.7:0/760789461 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664402d070 con 0x55e985bb9d20 2024-09-19T08:52:08.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.979+0000 7f66357fa640 1 -- 172.21.15.7:0/760789461 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6644024040 con 0x55e985bb9d20 2024-09-19T08:52:08.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.979+0000 7f66357fa640 1 -- 172.21.15.7:0/760789461 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6644004450 con 0x55e985bb9d20 2024-09-19T08:52:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.980+0000 7f6657fdc740 1 -- 172.21.15.7:0/760789461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bb9d20 msgr2=0x55e985bbf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.980+0000 7f6657fdc740 1 --2- 172.21.15.7:0/760789461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bb9d20 0x55e985bbf1a0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f66440092e0 tx=0x7f66440097a0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.980+0000 7f6657fdc740 1 -- 172.21.15.7:0/760789461 shutdown_connections 2024-09-19T08:52:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.980+0000 7f6657fdc740 1 --2- 172.21.15.7:0/760789461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e985bc3550 0x55e985bdaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.980+0000 7f6657fdc740 1 --2- 172.21.15.7:0/760789461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bb9d20 0x55e985bbf1a0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.980+0000 7f6657fdc740 1 --2- 172.21.15.7:0/760789461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bb87b0 0x55e985bcf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.980+0000 7f6657fdc740 1 -- 172.21.15.7:0/760789461 >> 172.21.15.7:0/760789461 conn(0x55e985b81310 msgr2=0x55e985bbea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.980+0000 7f6657fdc740 1 -- 172.21.15.7:0/760789461 shutdown_connections 2024-09-19T08:52:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.980+0000 7f6657fdc740 1 -- 172.21.15.7:0/760789461 wait complete. 2024-09-19T08:52:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.980+0000 7f6657fdc740 1 -- start start 2024-09-19T08:52:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.980+0000 7f6657fdc740 1 Processor -- start 2024-09-19T08:52:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f6657fdc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bb87b0 0x55e985bcba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:08.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f6657fdc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e985bb9d20 0x55e985bc6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:08.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f6657fdc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bc3550 0x55e985bc72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:08.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f6657fdc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f66501adef0 con 0x55e985bc3550 2024-09-19T08:52:08.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f6657fdc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f66501af360 con 0x55e985bb87b0 2024-09-19T08:52:08.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f6657fdc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f66501ae5c0 con 0x55e985bb9d20 2024-09-19T08:52:08.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f6657fdc740 10 client.0 _ll_register_callbacks cb 0x7f6640004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:08.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f664ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bc3550 0x55e985bc72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:08.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f664f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bb87b0 0x55e985bcba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:08.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f664ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bc3550 0x55e985bc72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40698/0 (socket says 172.21.15.7:40698) 2024-09-19T08:52:08.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f664f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bb87b0 0x55e985bcba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:58504/0 (socket says 172.21.15.7:58504) 2024-09-19T08:52:08.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f664ffff640 1 -- 172.21.15.7:0/994905917 learned_addr learned my addr 172.21.15.7:0/994905917 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:08.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f664effd640 1 --2- 172.21.15.7:0/994905917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e985bb9d20 0x55e985bc6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:08.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f664ffff640 1 -- 172.21.15.7:0/994905917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e985bb9d20 msgr2=0x55e985bc6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:08.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f664ffff640 1 --2- 172.21.15.7:0/994905917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e985bb9d20 0x55e985bc6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f664ffff640 1 -- 172.21.15.7:0/994905917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bb87b0 msgr2=0x55e985bcba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:08.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f664ffff640 1 --2- 172.21.15.7:0/994905917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bb87b0 0x55e985bcba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f664ffff640 1 -- 172.21.15.7:0/994905917 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e985bc7830 con 0x55e985bc3550 2024-09-19T08:52:08.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f664ffff640 1 --2- 172.21.15.7:0/994905917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bc3550 0x55e985bc72f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f66480eee60 tx=0x7f6648004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9eee27cdd31677 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:08.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f662effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:08.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f662effd640 1 -- 172.21.15.7:0/994905917 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66480d5030 con 0x55e985bc3550 2024-09-19T08:52:08.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f662effd640 1 -- 172.21.15.7:0/994905917 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8585+0+0 (secure 0 0 0) 0x7f66480d6270 con 0x55e985bc3550 2024-09-19T08:52:08.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.981+0000 7f6657fdc740 1 -- 172.21.15.7:0/994905917 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6644024040 con 0x55e985bc3550 2024-09-19T08:52:08.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.982+0000 7f662effd640 1 -- 172.21.15.7:0/994905917 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f66480b9040 con 0x55e985bc3550 2024-09-19T08:52:08.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.982+0000 7f6657fdc740 10 client.16866 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:08.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.982+0000 7f6657fdc740 1 -- 172.21.15.7:0/994905917 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e985c3d830 con 0x55e985bc3550 2024-09-19T08:52:08.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.982+0000 7f662effd640 1 -- 172.21.15.7:0/994905917 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6644024040 con 0x55e985bc3550 2024-09-19T08:52:08.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.982+0000 7f662effd640 1 -- 172.21.15.7:0/994905917 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f664804e070 con 0x55e985bc3550 2024-09-19T08:52:08.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.982+0000 7f6657fdc740 10 client.16866 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:08.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.982+0000 7f6657fdc740 10 client.16866 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:52:08.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.982+0000 7f6657fdc740 20 client.16866 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:08.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.982+0000 7f6657fdc740 1 --2- 172.21.15.7:0/994905917 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55e985c3df00 0x55e985c40320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:08.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.982+0000 7f6657fdc740 4 client.16866 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:52:08.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.982+0000 7f6657fdc740 1 -- 172.21.15.7:0/994905917 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e985b25d70 con 0x55e985c3df00 2024-09-19T08:52:08.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.982+0000 7f664f7fe640 1 --2- 172.21.15.7:0/994905917 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55e985c3df00 0x55e985c40320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:08.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.983+0000 7f664f7fe640 1 --2- 172.21.15.7:0/994905917 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55e985c3df00 0x55e985c40320 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=79157148f92f2d7 server_cookie=74624d12f1dcc01e in_seq=0 out_seq=0 2024-09-19T08:52:08.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.983+0000 7f662effd640 10 client.16866 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:52:08.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.983+0000 7f662effd640 1 -- 172.21.15.7:0/994905917 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e985b25d70 con 0x55e985c3df00 2024-09-19T08:52:08.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.983+0000 7f662effd640 10 client.16866 handle_command_reply: tid=0 2024-09-19T08:52:08.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.983+0000 7f6657fdc740 1 client.16866 shutdown 2024-09-19T08:52:08.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.983+0000 7f6657fdc740 1 -- 172.21.15.7:0/994905917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bc3550 msgr2=0x55e985bc72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:08.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.983+0000 7f6657fdc740 1 --2- 172.21.15.7:0/994905917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bc3550 0x55e985bc72f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f66480eee60 tx=0x7f6648004920 comp rx=0 tx=0).stop 2024-09-19T08:52:08.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.983+0000 7f6657fdc740 1 -- 172.21.15.7:0/994905917 shutdown_connections 2024-09-19T08:52:08.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.983+0000 7f6657fdc740 1 --2- 172.21.15.7:0/994905917 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55e985c3df00 0x55e985c40320 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.983+0000 7f6657fdc740 1 --2- 172.21.15.7:0/994905917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e985bc3550 0x55e985bc72f0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.983+0000 7f6657fdc740 1 --2- 172.21.15.7:0/994905917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e985bb9d20 0x55e985bc6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.983+0000 7f6657fdc740 1 --2- 172.21.15.7:0/994905917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e985bb87b0 0x55e985bcba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.983+0000 7f662effd640 0 client.16866 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:52:08.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.983+0000 7f6657fdc740 1 -- 172.21.15.7:0/994905917 >> 172.21.15.7:0/994905917 conn(0x55e985b81310 msgr2=0x55e985bc1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:08.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.983+0000 7f6657fdc740 1 -- 172.21.15.7:0/994905917 shutdown_connections 2024-09-19T08:52:08.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.983+0000 7f6657fdc740 1 -- 172.21.15.7:0/994905917 wait complete. 2024-09-19T08:52:08.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.983+0000 7f6657fdc740 20 client.16866 trim_cache size 0 max 16384 2024-09-19T08:52:08.990 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:52:08.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.984+0000 7f66549a1640 1 -- 172.21.15.7:0/2735912360 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f66380a33b0 msgr2=0x7f66380a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:08.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.984+0000 7f66549a1640 1 --2- 172.21.15.7:0/2735912360 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f66380a33b0 0x7f66380a5870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6644013570 tx=0x7f6644013970 comp rx=0 tx=0).stop 2024-09-19T08:52:08.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.984+0000 7f66549a1640 1 -- 172.21.15.7:0/2735912360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6650107af0 msgr2=0x7f6650074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:08.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.984+0000 7f66549a1640 1 --2- 172.21.15.7:0/2735912360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6650107af0 0x7f6650074f70 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f6648005cc0 tx=0x7f6648032f40 comp rx=0 tx=0).stop 2024-09-19T08:52:08.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.984+0000 7f66549a1640 1 -- 172.21.15.7:0/2735912360 shutdown_connections 2024-09-19T08:52:08.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.984+0000 7f66549a1640 1 --2- 172.21.15.7:0/2735912360 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f66380a33b0 0x7f66380a5870 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.984+0000 7f66549a1640 1 --2- 172.21.15.7:0/2735912360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6650107af0 0x7f6650074f70 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.984+0000 7f66549a1640 1 --2- 172.21.15.7:0/2735912360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6650102380 0x7f6650074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.984+0000 7f66549a1640 1 --2- 172.21.15.7:0/2735912360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66501019e0 0x7f66500744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.984+0000 7f66549a1640 1 -- 172.21.15.7:0/2735912360 >> 172.21.15.7:0/2735912360 conn(0x7f66500fd700 msgr2=0x7f66500fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:08.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.984+0000 7f66549a1640 1 -- 172.21.15.7:0/2735912360 shutdown_connections 2024-09-19T08:52:08.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:08.984+0000 7f66549a1640 1 -- 172.21.15.7:0/2735912360 wait complete. 2024-09-19T08:52:09.685 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:52:09.947 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:10.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.385+0000 7f32915ed640 1 -- 172.21.15.7:0/3903948849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f328c101420 msgr2=0x7f328c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.385+0000 7f32915ed640 1 --2- 172.21.15.7:0/3903948849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f328c101420 0x7f328c10d950 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f3284009cd0 tx=0x7f328402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.385+0000 7f32915ed640 1 -- 172.21.15.7:0/3903948849 shutdown_connections 2024-09-19T08:52:10.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.385+0000 7f32915ed640 1 --2- 172.21.15.7:0/3903948849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f328c101420 0x7f328c10d950 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.385+0000 7f32915ed640 1 --2- 172.21.15.7:0/3903948849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f328c100a80 0x7f328c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.385+0000 7f32915ed640 1 --2- 172.21.15.7:0/3903948849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f328c106a80 0x7f328c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.385+0000 7f32915ed640 1 -- 172.21.15.7:0/3903948849 >> 172.21.15.7:0/3903948849 conn(0x7f328c0fc7a0 msgr2=0x7f328c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:10.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.385+0000 7f32915ed640 1 -- 172.21.15.7:0/3903948849 shutdown_connections 2024-09-19T08:52:10.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.385+0000 7f32915ed640 1 -- 172.21.15.7:0/3903948849 wait complete. 2024-09-19T08:52:10.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.386+0000 7f32915ed640 1 Processor -- start 2024-09-19T08:52:10.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.386+0000 7f32915ed640 1 -- start start 2024-09-19T08:52:10.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.386+0000 7f32915ed640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f328c100a80 0x7f328c1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.386+0000 7f32915ed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f328c101420 0x7f328c198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.386+0000 7f32915ed640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f328c106a80 0x7f328c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.386+0000 7f32915ed640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f328c112020 con 0x7f328c101420 2024-09-19T08:52:10.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.386+0000 7f32915ed640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f328c111ea0 con 0x7f328c100a80 2024-09-19T08:52:10.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.386+0000 7f32915ed640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f328c1121a0 con 0x7f328c106a80 2024-09-19T08:52:10.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.386+0000 7f328a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f328c101420 0x7f328c198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.387+0000 7f328a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f328c101420 0x7f328c198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40708/0 (socket says 172.21.15.7:40708) 2024-09-19T08:52:10.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.387+0000 7f328a7fc640 1 -- 172.21.15.7:0/3944350960 learned_addr learned my addr 172.21.15.7:0/3944350960 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:10.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.387+0000 7f328affd640 1 --2- 172.21.15.7:0/3944350960 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f328c100a80 0x7f328c1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.387+0000 7f328b7fe640 1 --2- 172.21.15.7:0/3944350960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f328c106a80 0x7f328c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.387+0000 7f328a7fc640 1 -- 172.21.15.7:0/3944350960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f328c106a80 msgr2=0x7f328c19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.387+0000 7f328a7fc640 1 --2- 172.21.15.7:0/3944350960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f328c106a80 0x7f328c19ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.387+0000 7f328a7fc640 1 -- 172.21.15.7:0/3944350960 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f328c100a80 msgr2=0x7f328c1985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.387+0000 7f328a7fc640 1 --2- 172.21.15.7:0/3944350960 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f328c100a80 0x7f328c1985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.387+0000 7f328a7fc640 1 -- 172.21.15.7:0/3944350960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328c19d550 con 0x7f328c101420 2024-09-19T08:52:10.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.387+0000 7f328a7fc640 1 --2- 172.21.15.7:0/3944350960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f328c101420 0x7f328c198ae0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f328000b4a0 tx=0x7f328000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:10.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.387+0000 7f3273fff640 1 -- 172.21.15.7:0/3944350960 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3280015020 con 0x7f328c101420 2024-09-19T08:52:10.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.387+0000 7f32915ed640 1 -- 172.21.15.7:0/3944350960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f328c19d840 con 0x7f328c101420 2024-09-19T08:52:10.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.387+0000 7f3273fff640 1 -- 172.21.15.7:0/3944350960 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3280011d10 con 0x7f328c101420 2024-09-19T08:52:10.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.387+0000 7f3273fff640 1 -- 172.21.15.7:0/3944350960 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328000f2e0 con 0x7f328c101420 2024-09-19T08:52:10.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.387+0000 7f32915ed640 1 -- 172.21.15.7:0/3944350960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f328c1a5120 con 0x7f328c101420 2024-09-19T08:52:10.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.390+0000 7f3273fff640 1 -- 172.21.15.7:0/3944350960 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f3280018020 con 0x7f328c101420 2024-09-19T08:52:10.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.390+0000 7f32939c6740 1 Processor -- start 2024-09-19T08:52:10.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.390+0000 7f32939c6740 1 -- start start 2024-09-19T08:52:10.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.390+0000 7f32939c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bda70db40 0x559bda70c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.390+0000 7f32939c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda70c5d0 0x559bda70ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.390+0000 7f32939c6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559bda717370 0x559bda719760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.390+0000 7f3273fff640 1 --2- 172.21.15.7:0/3944350960 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f32740a33b0 0x7f32740a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.390+0000 7f32939c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559bda6722f0 con 0x559bda70c5d0 2024-09-19T08:52:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.390+0000 7f32939c6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559bda619cf0 con 0x559bda717370 2024-09-19T08:52:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.390+0000 7f32939c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559bda66e2b0 con 0x559bda70db40 2024-09-19T08:52:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.390+0000 7f328affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda70c5d0 0x559bda70ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.390+0000 7f328b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bda70db40 0x559bda70c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.390+0000 7f328affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda70c5d0 0x559bda70ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40724/0 (socket says 172.21.15.7:40724) 2024-09-19T08:52:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.390+0000 7f328affd640 1 -- 172.21.15.7:0/1250948894 learned_addr learned my addr 172.21.15.7:0/1250948894 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.390+0000 7f3273fff640 1 -- 172.21.15.7:0/3944350960 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8629+0+0 (secure 0 0 0) 0x7f32800cf590 con 0x7f328c101420 2024-09-19T08:52:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.391+0000 7f328a7fc640 1 --2- 172.21.15.7:0/1250948894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559bda717370 0x559bda719760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.391+0000 7f328b7fe640 1 --2- 172.21.15.7:0/3944350960 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f32740a33b0 0x7f32740a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.391+0000 7f328affd640 1 -- 172.21.15.7:0/1250948894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bda70db40 msgr2=0x559bda70c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.391+0000 7f328affd640 1 --2- 172.21.15.7:0/1250948894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bda70db40 0x559bda70c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.391+0000 7f328affd640 1 -- 172.21.15.7:0/1250948894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559bda717370 msgr2=0x559bda719760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:10.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.391+0000 7f328affd640 1 --2- 172.21.15.7:0/1250948894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559bda717370 0x559bda719760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.391+0000 7f328affd640 1 -- 172.21.15.7:0/1250948894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bda5fe3a0 con 0x559bda70c5d0 2024-09-19T08:52:10.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.391+0000 7f328a7fc640 1 --2- 172.21.15.7:0/1250948894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559bda717370 0x559bda719760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:10.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.391+0000 7f328b7fe640 1 --2- 172.21.15.7:0/3944350960 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f32740a33b0 0x7f32740a5870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3284009430 tx=0x7f3284005ef0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:10.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.391+0000 7f328affd640 1 --2- 172.21.15.7:0/1250948894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda70c5d0 0x559bda70ca10 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f327c009a70 tx=0x7f327c009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb933c773096377 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:10.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.391+0000 7f32717fa640 1 -- 172.21.15.7:0/1250948894 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c017070 con 0x559bda70c5d0 2024-09-19T08:52:10.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.391+0000 7f32717fa640 1 -- 172.21.15.7:0/1250948894 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f327c013470 con 0x559bda70c5d0 2024-09-19T08:52:10.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.391+0000 7f32717fa640 1 -- 172.21.15.7:0/1250948894 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c012630 con 0x559bda70c5d0 2024-09-19T08:52:10.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.392+0000 7f32939c6740 1 -- 172.21.15.7:0/1250948894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda70c5d0 msgr2=0x559bda70ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.392+0000 7f32939c6740 1 --2- 172.21.15.7:0/1250948894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda70c5d0 0x559bda70ca10 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f327c009a70 tx=0x7f327c009f30 comp rx=0 tx=0).stop 2024-09-19T08:52:10.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.392+0000 7f32939c6740 1 -- 172.21.15.7:0/1250948894 shutdown_connections 2024-09-19T08:52:10.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.392+0000 7f32939c6740 1 --2- 172.21.15.7:0/1250948894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559bda717370 0x559bda719760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.392+0000 7f32939c6740 1 --2- 172.21.15.7:0/1250948894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda70c5d0 0x559bda70ca10 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.392+0000 7f32939c6740 1 --2- 172.21.15.7:0/1250948894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bda70db40 0x559bda70c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.392+0000 7f32939c6740 1 -- 172.21.15.7:0/1250948894 >> 172.21.15.7:0/1250948894 conn(0x559bda6d5310 msgr2=0x559bda708c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:10.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.392+0000 7f32939c6740 1 -- 172.21.15.7:0/1250948894 shutdown_connections 2024-09-19T08:52:10.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.392+0000 7f32939c6740 1 -- 172.21.15.7:0/1250948894 wait complete. 2024-09-19T08:52:10.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.393+0000 7f32939c6740 1 -- start start 2024-09-19T08:52:10.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.393+0000 7f32939c6740 1 Processor -- start 2024-09-19T08:52:10.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.393+0000 7f32939c6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559bda70c5d0 0x559bda716d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.393+0000 7f32939c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bda70db40 0x559bda713ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.393+0000 7f32939c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda717370 0x559bda7145e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.393+0000 7f32939c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559bda71a070 con 0x559bda717370 2024-09-19T08:52:10.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.393+0000 7f32939c6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559bda62d060 con 0x559bda70c5d0 2024-09-19T08:52:10.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.393+0000 7f32939c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559bda71a1f0 con 0x559bda70db40 2024-09-19T08:52:10.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.393+0000 7f32939c6740 10 client.0 _ll_register_callbacks cb 0x559bda3808c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:10.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.393+0000 7f328b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda717370 0x559bda7145e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.393+0000 7f328b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda717370 0x559bda7145e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40730/0 (socket says 172.21.15.7:40730) 2024-09-19T08:52:10.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.393+0000 7f328b7fe640 1 -- 172.21.15.7:0/3889421913 learned_addr learned my addr 172.21.15.7:0/3889421913 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:10.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.393+0000 7f328affd640 1 --2- 172.21.15.7:0/3889421913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559bda70c5d0 0x559bda716d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.393+0000 7f328a7fc640 1 --2- 172.21.15.7:0/3889421913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bda70db40 0x559bda713ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.393+0000 7f328b7fe640 1 -- 172.21.15.7:0/3889421913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bda70db40 msgr2=0x559bda713ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:10.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.393+0000 7f328b7fe640 1 --2- 172.21.15.7:0/3889421913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bda70db40 0x559bda713ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.393+0000 7f328b7fe640 1 -- 172.21.15.7:0/3889421913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559bda70c5d0 msgr2=0x559bda716d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:10.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.394+0000 7f328b7fe640 1 --2- 172.21.15.7:0/3889421913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559bda70c5d0 0x559bda716d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.394+0000 7f328b7fe640 1 -- 172.21.15.7:0/3889421913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bda3e33c0 con 0x559bda717370 2024-09-19T08:52:10.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.394+0000 7f328a7fc640 1 --2- 172.21.15.7:0/3889421913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bda70db40 0x559bda713ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:10.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.394+0000 7f328b7fe640 1 --2- 172.21.15.7:0/3889421913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda717370 0x559bda7145e0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f3284004d70 tx=0x7f32840093a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a680757bdd538b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:10.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.394+0000 7f326eff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:10.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.394+0000 7f326eff5640 1 -- 172.21.15.7:0/3889421913 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3284050030 con 0x559bda717370 2024-09-19T08:52:10.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.394+0000 7f326eff5640 1 -- 172.21.15.7:0/3889421913 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8629+0+0 (secure 0 0 0) 0x7f3284004040 con 0x559bda717370 2024-09-19T08:52:10.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.394+0000 7f32939c6740 1 -- 172.21.15.7:0/3889421913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f327c013470 con 0x559bda717370 2024-09-19T08:52:10.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.394+0000 7f326eff5640 1 -- 172.21.15.7:0/3889421913 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3284031cf0 con 0x559bda717370 2024-09-19T08:52:10.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.394+0000 7f32939c6740 10 client.16878 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:10.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.394+0000 7f32939c6740 1 -- 172.21.15.7:0/3889421913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559bda725b30 con 0x559bda717370 2024-09-19T08:52:10.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.394+0000 7f326eff5640 1 -- 172.21.15.7:0/3889421913 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f327c013470 con 0x559bda717370 2024-09-19T08:52:10.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.395+0000 7f326eff5640 1 -- 172.21.15.7:0/3889421913 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3284030070 con 0x559bda717370 2024-09-19T08:52:10.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.395+0000 7f32939c6740 10 client.16878 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:10.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.395+0000 7f32939c6740 10 client.16878 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:10.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.395+0000 7f32939c6740 20 client.16878 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:10.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.395+0000 7f32939c6740 1 --2- 172.21.15.7:0/3889421913 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559bda726f40 0x559bda7293e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.395+0000 7f32939c6740 4 client.16878 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:10.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.395+0000 7f32939c6740 1 -- 172.21.15.7:0/3889421913 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bda67f860 con 0x559bda726f40 2024-09-19T08:52:10.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.395+0000 7f328affd640 1 --2- 172.21.15.7:0/3889421913 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559bda726f40 0x559bda7293e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.395+0000 7f328affd640 1 --2- 172.21.15.7:0/3889421913 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559bda726f40 0x559bda7293e0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f84fab8a8bd34660 server_cookie=9b417e6f64a40587 in_seq=0 out_seq=0 2024-09-19T08:52:10.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.395+0000 7f326eff5640 10 client.16878 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:10.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.396+0000 7f326eff5640 1 -- 172.21.15.7:0/3889421913 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559bda67f860 con 0x559bda726f40 2024-09-19T08:52:10.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.396+0000 7f326eff5640 10 client.16878 handle_command_reply: tid=0 2024-09-19T08:52:10.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.396+0000 7f32939c6740 1 client.16878 shutdown 2024-09-19T08:52:10.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.396+0000 7f32939c6740 1 -- 172.21.15.7:0/3889421913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda717370 msgr2=0x559bda7145e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.396+0000 7f32939c6740 1 --2- 172.21.15.7:0/3889421913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda717370 0x559bda7145e0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f3284004d70 tx=0x7f32840093a0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.396+0000 7f32939c6740 1 -- 172.21.15.7:0/3889421913 shutdown_connections 2024-09-19T08:52:10.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.396+0000 7f32939c6740 1 --2- 172.21.15.7:0/3889421913 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559bda726f40 0x559bda7293e0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.396+0000 7f32939c6740 1 --2- 172.21.15.7:0/3889421913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda717370 0x559bda7145e0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.396+0000 7f32939c6740 1 --2- 172.21.15.7:0/3889421913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bda70db40 0x559bda713ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.396+0000 7f32939c6740 1 --2- 172.21.15.7:0/3889421913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559bda70c5d0 0x559bda716d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.396+0000 7f32939c6740 1 -- 172.21.15.7:0/3889421913 >> 172.21.15.7:0/3889421913 conn(0x559bda6d5310 msgr2=0x559bda70e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:10.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.396+0000 7f326eff5640 0 client.16878 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:10.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.396+0000 7f32939c6740 1 -- 172.21.15.7:0/3889421913 shutdown_connections 2024-09-19T08:52:10.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.396+0000 7f32939c6740 1 -- 172.21.15.7:0/3889421913 wait complete. 2024-09-19T08:52:10.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.396+0000 7f32939c6740 20 client.16878 trim_cache size 0 max 16384 2024-09-19T08:52:10.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.409+0000 7f32939c6740 1 Processor -- start 2024-09-19T08:52:10.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.409+0000 7f32939c6740 1 -- start start 2024-09-19T08:52:10.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.410+0000 7f32939c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bda70c5d0 0x559bda708e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.410+0000 7f32939c6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559bda70db40 0x559bda723310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.410+0000 7f32939c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda717370 0x559bda70f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.410+0000 7f32939c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f328c1b0270 con 0x559bda717370 2024-09-19T08:52:10.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.410+0000 7f32939c6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f328c1adb40 con 0x559bda70db40 2024-09-19T08:52:10.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.410+0000 7f32939c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f328c1ab9b0 con 0x559bda70c5d0 2024-09-19T08:52:10.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.410+0000 7f328b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda717370 0x559bda70f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.410+0000 7f328b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda717370 0x559bda70f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40732/0 (socket says 172.21.15.7:40732) 2024-09-19T08:52:10.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.410+0000 7f328b7fe640 1 -- 172.21.15.7:0/3082820672 learned_addr learned my addr 172.21.15.7:0/3082820672 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:10.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.410+0000 7f328affd640 1 --2- 172.21.15.7:0/3082820672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bda70c5d0 0x559bda708e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.410+0000 7f328a7fc640 1 --2- 172.21.15.7:0/3082820672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559bda70db40 0x559bda723310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.410+0000 7f328b7fe640 1 -- 172.21.15.7:0/3082820672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bda70c5d0 msgr2=0x559bda708e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:10.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.410+0000 7f328b7fe640 1 --2- 172.21.15.7:0/3082820672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bda70c5d0 0x559bda708e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.410+0000 7f328b7fe640 1 -- 172.21.15.7:0/3082820672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559bda70db40 msgr2=0x559bda723310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:10.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.410+0000 7f328b7fe640 1 --2- 172.21.15.7:0/3082820672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559bda70db40 0x559bda723310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.410+0000 7f328b7fe640 1 -- 172.21.15.7:0/3082820672 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bda712560 con 0x559bda717370 2024-09-19T08:52:10.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.410+0000 7f328a7fc640 1 --2- 172.21.15.7:0/3082820672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559bda70db40 0x559bda723310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:10.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.410+0000 7f328affd640 1 --2- 172.21.15.7:0/3082820672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bda70c5d0 0x559bda708e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:10.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.410+0000 7f328b7fe640 1 --2- 172.21.15.7:0/3082820672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda717370 0x559bda70f120 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f3284031eb0 tx=0x7f32840095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c9aa87c89042ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:10.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.410+0000 7f3270ff9640 1 -- 172.21.15.7:0/3082820672 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3284061070 con 0x559bda717370 2024-09-19T08:52:10.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.410+0000 7f3270ff9640 1 -- 172.21.15.7:0/3082820672 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3284036040 con 0x559bda717370 2024-09-19T08:52:10.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.410+0000 7f3270ff9640 1 -- 172.21.15.7:0/3082820672 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3284050070 con 0x559bda717370 2024-09-19T08:52:10.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.411+0000 7f32939c6740 1 -- 172.21.15.7:0/3082820672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda717370 msgr2=0x559bda70f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.411+0000 7f32939c6740 1 --2- 172.21.15.7:0/3082820672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda717370 0x559bda70f120 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f3284031eb0 tx=0x7f32840095c0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.411+0000 7f32939c6740 1 -- 172.21.15.7:0/3082820672 shutdown_connections 2024-09-19T08:52:10.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.411+0000 7f32939c6740 1 --2- 172.21.15.7:0/3082820672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda717370 0x559bda70f120 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.411+0000 7f32939c6740 1 --2- 172.21.15.7:0/3082820672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559bda70db40 0x559bda723310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.411+0000 7f32939c6740 1 --2- 172.21.15.7:0/3082820672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bda70c5d0 0x559bda708e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.411+0000 7f32939c6740 1 -- 172.21.15.7:0/3082820672 >> 172.21.15.7:0/3082820672 conn(0x559bda6d5310 msgr2=0x559bda708700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:10.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.411+0000 7f32939c6740 1 -- 172.21.15.7:0/3082820672 shutdown_connections 2024-09-19T08:52:10.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.411+0000 7f32939c6740 1 -- 172.21.15.7:0/3082820672 wait complete. 2024-09-19T08:52:10.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.411+0000 7f32939c6740 1 -- start start 2024-09-19T08:52:10.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.411+0000 7f32939c6740 1 Processor -- start 2024-09-19T08:52:10.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.412+0000 7f32939c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bda70c5d0 0x559bda71fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.412+0000 7f32939c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda70db40 0x559bda710c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.412+0000 7f32939c6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559bda717370 0x559bda711140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.412+0000 7f32939c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f328c1ac000 con 0x559bda70db40 2024-09-19T08:52:10.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.412+0000 7f32939c6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f328c1ad470 con 0x559bda717370 2024-09-19T08:52:10.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.412+0000 7f32939c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f328c1ac6d0 con 0x559bda70c5d0 2024-09-19T08:52:10.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.412+0000 7f32939c6740 10 client.0 _ll_register_callbacks cb 0x7f3284009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:10.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.412+0000 7f328a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda70db40 0x559bda710c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.412+0000 7f328a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda70db40 0x559bda710c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40734/0 (socket says 172.21.15.7:40734) 2024-09-19T08:52:10.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.412+0000 7f328a7fc640 1 -- 172.21.15.7:0/3917891305 learned_addr learned my addr 172.21.15.7:0/3917891305 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:10.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.412+0000 7f328b7fe640 1 --2- 172.21.15.7:0/3917891305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559bda717370 0x559bda711140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.412+0000 7f328affd640 1 --2- 172.21.15.7:0/3917891305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bda70c5d0 0x559bda71fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.412+0000 7f328a7fc640 1 -- 172.21.15.7:0/3917891305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bda70c5d0 msgr2=0x559bda71fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:10.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.412+0000 7f328a7fc640 1 --2- 172.21.15.7:0/3917891305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bda70c5d0 0x559bda71fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.412+0000 7f328a7fc640 1 -- 172.21.15.7:0/3917891305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559bda717370 msgr2=0x559bda711140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:10.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.412+0000 7f328a7fc640 1 --2- 172.21.15.7:0/3917891305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559bda717370 0x559bda711140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.412+0000 7f328a7fc640 1 -- 172.21.15.7:0/3917891305 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bda7117e0 con 0x559bda70db40 2024-09-19T08:52:10.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.412+0000 7f328a7fc640 1 --2- 172.21.15.7:0/3917891305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda70db40 0x559bda710c00 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f32800ccde0 tx=0x7f32800ae2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ace939a757eb02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:10.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.412+0000 7f326eff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:10.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.412+0000 7f326eff5640 1 -- 172.21.15.7:0/3917891305 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32800a4580 con 0x559bda70db40 2024-09-19T08:52:10.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.412+0000 7f326eff5640 1 -- 172.21.15.7:0/3917891305 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8629+0+0 (secure 0 0 0) 0x7f3280010510 con 0x559bda70db40 2024-09-19T08:52:10.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.412+0000 7f32939c6740 1 -- 172.21.15.7:0/3917891305 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3284036040 con 0x559bda70db40 2024-09-19T08:52:10.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.413+0000 7f326eff5640 1 -- 172.21.15.7:0/3917891305 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f32800ccef0 con 0x559bda70db40 2024-09-19T08:52:10.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.413+0000 7f32939c6740 10 client.16884 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:10.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.413+0000 7f32939c6740 1 -- 172.21.15.7:0/3917891305 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559bda791b30 con 0x559bda70db40 2024-09-19T08:52:10.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.413+0000 7f326eff5640 1 -- 172.21.15.7:0/3917891305 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3284036040 con 0x559bda70db40 2024-09-19T08:52:10.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.413+0000 7f326eff5640 1 -- 172.21.15.7:0/3917891305 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f32800b1bc0 con 0x559bda70db40 2024-09-19T08:52:10.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.413+0000 7f32939c6740 10 client.16884 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:10.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.413+0000 7f32939c6740 10 client.16884 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:10.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.413+0000 7f32939c6740 20 client.16884 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:10.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.413+0000 7f32939c6740 1 --2- 172.21.15.7:0/3917891305 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559bda792230 0x559bda794650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.413+0000 7f32939c6740 4 client.16884 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:52:10.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.413+0000 7f32939c6740 1 -- 172.21.15.7:0/3917891305 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559bda679d70 con 0x559bda792230 2024-09-19T08:52:10.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.413+0000 7f328affd640 1 --2- 172.21.15.7:0/3917891305 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559bda792230 0x559bda794650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.414+0000 7f328affd640 1 --2- 172.21.15.7:0/3917891305 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559bda792230 0x559bda794650 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a25d3eefa62b7377 server_cookie=3b60843a0d90a6f8 in_seq=0 out_seq=0 2024-09-19T08:52:10.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.414+0000 7f326eff5640 10 client.16884 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:10.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.414+0000 7f326eff5640 1 -- 172.21.15.7:0/3917891305 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559bda679d70 con 0x559bda792230 2024-09-19T08:52:10.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.414+0000 7f326eff5640 10 client.16884 handle_command_reply: tid=0 2024-09-19T08:52:10.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.414+0000 7f32939c6740 1 client.16884 shutdown 2024-09-19T08:52:10.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.414+0000 7f32939c6740 1 -- 172.21.15.7:0/3917891305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda70db40 msgr2=0x559bda710c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.414+0000 7f32939c6740 1 --2- 172.21.15.7:0/3917891305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda70db40 0x559bda710c00 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f32800ccde0 tx=0x7f32800ae2e0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.414+0000 7f32939c6740 1 -- 172.21.15.7:0/3917891305 shutdown_connections 2024-09-19T08:52:10.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.414+0000 7f32939c6740 1 --2- 172.21.15.7:0/3917891305 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559bda792230 0x559bda794650 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.414+0000 7f32939c6740 1 --2- 172.21.15.7:0/3917891305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559bda717370 0x559bda711140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.414+0000 7f32939c6740 1 --2- 172.21.15.7:0/3917891305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559bda70db40 0x559bda710c00 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.414+0000 7f32939c6740 1 --2- 172.21.15.7:0/3917891305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559bda70c5d0 0x559bda71fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.414+0000 7f32939c6740 1 -- 172.21.15.7:0/3917891305 >> 172.21.15.7:0/3917891305 conn(0x559bda6d5310 msgr2=0x559bda7074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:10.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.414+0000 7f326eff5640 0 client.16884 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:10.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.414+0000 7f32939c6740 1 -- 172.21.15.7:0/3917891305 shutdown_connections 2024-09-19T08:52:10.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.414+0000 7f32939c6740 1 -- 172.21.15.7:0/3917891305 wait complete. 2024-09-19T08:52:10.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.414+0000 7f32939c6740 20 client.16884 trim_cache size 0 max 16384 2024-09-19T08:52:10.421 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:52:10.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.415+0000 7f32915ed640 1 -- 172.21.15.7:0/3944350960 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f32740a33b0 msgr2=0x7f32740a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.415+0000 7f32915ed640 1 --2- 172.21.15.7:0/3944350960 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f32740a33b0 0x7f32740a5870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3284009430 tx=0x7f3284005ef0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.415+0000 7f32915ed640 1 -- 172.21.15.7:0/3944350960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f328c101420 msgr2=0x7f328c198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.415+0000 7f32915ed640 1 --2- 172.21.15.7:0/3944350960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f328c101420 0x7f328c198ae0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f328000b4a0 tx=0x7f328000b8a0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.415+0000 7f32915ed640 1 -- 172.21.15.7:0/3944350960 shutdown_connections 2024-09-19T08:52:10.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.415+0000 7f32915ed640 1 --2- 172.21.15.7:0/3944350960 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f32740a33b0 0x7f32740a5870 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.415+0000 7f32915ed640 1 --2- 172.21.15.7:0/3944350960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f328c106a80 0x7f328c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.415+0000 7f32915ed640 1 --2- 172.21.15.7:0/3944350960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f328c101420 0x7f328c198ae0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.415+0000 7f32915ed640 1 --2- 172.21.15.7:0/3944350960 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f328c100a80 0x7f328c1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.415+0000 7f32915ed640 1 -- 172.21.15.7:0/3944350960 >> 172.21.15.7:0/3944350960 conn(0x7f328c0fc7a0 msgr2=0x7f328c0fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:10.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.415+0000 7f32915ed640 1 -- 172.21.15.7:0/3944350960 shutdown_connections 2024-09-19T08:52:10.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:10.415+0000 7f32915ed640 1 -- 172.21.15.7:0/3944350960 wait complete. 2024-09-19T08:52:10.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:10 smithi007 ceph-mon[31221]: pgmap v234: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:52:10.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:10 smithi007 ceph-mon[31221]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T08:52:10.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:10 smithi044 ceph-mon[35072]: pgmap v234: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:52:10.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:10 smithi044 ceph-mon[35072]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T08:52:10.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:10 smithi175 ceph-mon[35688]: pgmap v234: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:52:10.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:10 smithi175 ceph-mon[35688]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T08:52:12.181 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:52:12.182 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:52:12.454 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:12.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:12 smithi007 ceph-mon[31221]: pgmap v236: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:52:12.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:12 smithi044 ceph-mon[35072]: pgmap v236: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:52:12.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.899+0000 7f827b2ec640 1 -- 172.21.15.7:0/3411939425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8274101440 msgr2=0x7f827410df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:12.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.899+0000 7f827b2ec640 1 --2- 172.21.15.7:0/3411939425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8274101440 0x7f827410df30 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f8268009ca0 tx=0x7f826802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.899+0000 7f827b2ec640 1 -- 172.21.15.7:0/3411939425 shutdown_connections 2024-09-19T08:52:12.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.899+0000 7f827b2ec640 1 --2- 172.21.15.7:0/3411939425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f827410e500 0x7f8274110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.899+0000 7f827b2ec640 1 --2- 172.21.15.7:0/3411939425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8274101440 0x7f827410df30 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.899+0000 7f827b2ec640 1 --2- 172.21.15.7:0/3411939425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8274100b20 0x7f8274100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.899+0000 7f827b2ec640 1 -- 172.21.15.7:0/3411939425 >> 172.21.15.7:0/3411939425 conn(0x7f82740fc7d0 msgr2=0x7f82740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:12.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.899+0000 7f827b2ec640 1 -- 172.21.15.7:0/3411939425 shutdown_connections 2024-09-19T08:52:12.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.899+0000 7f827b2ec640 1 -- 172.21.15.7:0/3411939425 wait complete. 2024-09-19T08:52:12.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.900+0000 7f827b2ec640 1 Processor -- start 2024-09-19T08:52:12.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.900+0000 7f827b2ec640 1 -- start start 2024-09-19T08:52:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.900+0000 7f827b2ec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8274100b20 0x7f82741a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.900+0000 7f827b2ec640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8274101440 0x7f82741a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.900+0000 7f827b2ec640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f827410e500 0x7f827419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.900+0000 7f827b2ec640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8274114250 con 0x7f8274100b20 2024-09-19T08:52:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.900+0000 7f827b2ec640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f82741140d0 con 0x7f827410e500 2024-09-19T08:52:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.900+0000 7f827b2ec640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f82741143d0 con 0x7f8274101440 2024-09-19T08:52:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.900+0000 7f8279088640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8274100b20 0x7f82741a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.900+0000 7f8279088640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8274100b20 0x7f82741a03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40746/0 (socket says 172.21.15.7:40746) 2024-09-19T08:52:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.900+0000 7f8279088640 1 -- 172.21.15.7:0/2679681975 learned_addr learned my addr 172.21.15.7:0/2679681975 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:12.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.900+0000 7f8279889640 1 --2- 172.21.15.7:0/2679681975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f827410e500 0x7f827419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:12.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.900+0000 7f8278887640 1 --2- 172.21.15.7:0/2679681975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8274101440 0x7f82741a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:12.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.901+0000 7f8279088640 1 -- 172.21.15.7:0/2679681975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8274101440 msgr2=0x7f82741a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:12.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.901+0000 7f8279088640 1 --2- 172.21.15.7:0/2679681975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8274101440 0x7f82741a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.901+0000 7f8279088640 1 -- 172.21.15.7:0/2679681975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f827410e500 msgr2=0x7f827419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:12.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.901+0000 7f8279088640 1 --2- 172.21.15.7:0/2679681975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f827410e500 0x7f827419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.901+0000 7f8279088640 1 -- 172.21.15.7:0/2679681975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827419acd0 con 0x7f8274100b20 2024-09-19T08:52:12.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.901+0000 7f8279889640 1 --2- 172.21.15.7:0/2679681975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f827410e500 0x7f827419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:12.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.901+0000 7f8279088640 1 --2- 172.21.15.7:0/2679681975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8274100b20 0x7f82741a03e0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f826400c890 tx=0x7f826400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:12.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.901+0000 7f82727fc640 1 -- 172.21.15.7:0/2679681975 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8264004220 con 0x7f8274100b20 2024-09-19T08:52:12.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.901+0000 7f82727fc640 1 -- 172.21.15.7:0/2679681975 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82640043c0 con 0x7f8274100b20 2024-09-19T08:52:12.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.901+0000 7f82727fc640 1 -- 172.21.15.7:0/2679681975 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82640049e0 con 0x7f8274100b20 2024-09-19T08:52:12.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.901+0000 7f827b2ec640 1 -- 172.21.15.7:0/2679681975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f827419afc0 con 0x7f8274100b20 2024-09-19T08:52:12.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.901+0000 7f827b2ec640 1 -- 172.21.15.7:0/2679681975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82741a72b0 con 0x7f8274100b20 2024-09-19T08:52:12.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.904+0000 7f82727fc640 1 -- 172.21.15.7:0/2679681975 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f82640079b0 con 0x7f8274100b20 2024-09-19T08:52:12.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.904+0000 7f827d6c5740 1 Processor -- start 2024-09-19T08:52:12.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.904+0000 7f827d6c5740 1 -- start start 2024-09-19T08:52:12.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.905+0000 7f827d6c5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0ba7b60 0x55d7a0ba7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:12.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.905+0000 7f827d6c5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0ba8480 0x55d7a0bb2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:12.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.905+0000 7f827d6c5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7a0bb2d40 0x55d7a0bb5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:12.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.905+0000 7f827d6c5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d7a0b0d280 con 0x55d7a0ba8480 2024-09-19T08:52:12.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.905+0000 7f827d6c5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d7a0ab4b10 con 0x55d7a0ba7b60 2024-09-19T08:52:12.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.905+0000 7f827d6c5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d7a0b09240 con 0x55d7a0bb2d40 2024-09-19T08:52:12.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.905+0000 7f8279088640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0ba8480 0x55d7a0bb2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:12.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.905+0000 7f8279088640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0ba8480 0x55d7a0bb2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40758/0 (socket says 172.21.15.7:40758) 2024-09-19T08:52:12.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.905+0000 7f8279088640 1 -- 172.21.15.7:0/1856694397 learned_addr learned my addr 172.21.15.7:0/1856694397 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:12.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.905+0000 7f8279889640 1 --2- 172.21.15.7:0/1856694397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0ba7b60 0x55d7a0ba7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:12.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.905+0000 7f82727fc640 1 --2- 172.21.15.7:0/2679681975 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f825c0a3430 0x7f825c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:12.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.905+0000 7f8278887640 1 --2- 172.21.15.7:0/1856694397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7a0bb2d40 0x55d7a0bb5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:12.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.905+0000 7f8279088640 1 -- 172.21.15.7:0/1856694397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7a0bb2d40 msgr2=0x55d7a0bb5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:12.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.905+0000 7f8279088640 1 --2- 172.21.15.7:0/1856694397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7a0bb2d40 0x55d7a0bb5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.905+0000 7f8279889640 1 --2- 172.21.15.7:0/2679681975 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f825c0a3430 0x7f825c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:12.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.905+0000 7f8279088640 1 -- 172.21.15.7:0/1856694397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0ba7b60 msgr2=0x55d7a0ba7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:12.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.905+0000 7f8279088640 1 --2- 172.21.15.7:0/1856694397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0ba7b60 0x55d7a0ba7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.905+0000 7f82727fc640 1 -- 172.21.15.7:0/2679681975 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8629+0+0 (secure 0 0 0) 0x7f82640cfec0 con 0x7f8274100b20 2024-09-19T08:52:12.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.905+0000 7f8279088640 1 -- 172.21.15.7:0/1856694397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7a0ac11f0 con 0x55d7a0ba8480 2024-09-19T08:52:12.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.906+0000 7f8279088640 1 --2- 172.21.15.7:0/1856694397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0ba8480 0x55d7a0bb2800 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f82640cd480 tx=0x7f8264005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175f0d5be5504a38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:12.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.906+0000 7f8279889640 1 --2- 172.21.15.7:0/2679681975 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f825c0a3430 0x7f825c0a58f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8274069760 tx=0x7f826c004730 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:12.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.906+0000 7f825b7fe640 1 -- 172.21.15.7:0/1856694397 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826401d070 con 0x55d7a0ba8480 2024-09-19T08:52:12.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.906+0000 7f825b7fe640 1 -- 172.21.15.7:0/1856694397 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f826409c7d0 con 0x55d7a0ba8480 2024-09-19T08:52:12.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.906+0000 7f825b7fe640 1 -- 172.21.15.7:0/1856694397 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826409c0d0 con 0x55d7a0ba8480 2024-09-19T08:52:12.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.907+0000 7f827d6c5740 1 -- 172.21.15.7:0/1856694397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0ba8480 msgr2=0x55d7a0bb2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:12.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.907+0000 7f827d6c5740 1 --2- 172.21.15.7:0/1856694397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0ba8480 0x55d7a0bb2800 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f82640cd480 tx=0x7f8264005300 comp rx=0 tx=0).stop 2024-09-19T08:52:12.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.907+0000 7f827d6c5740 1 -- 172.21.15.7:0/1856694397 shutdown_connections 2024-09-19T08:52:12.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.907+0000 7f827d6c5740 1 --2- 172.21.15.7:0/1856694397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7a0bb2d40 0x55d7a0bb5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.907+0000 7f827d6c5740 1 --2- 172.21.15.7:0/1856694397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0ba8480 0x55d7a0bb2800 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.907+0000 7f827d6c5740 1 --2- 172.21.15.7:0/1856694397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0ba7b60 0x55d7a0ba7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.907+0000 7f827d6c5740 1 -- 172.21.15.7:0/1856694397 >> 172.21.15.7:0/1856694397 conn(0x55d7a0ba40f0 msgr2=0x55d7a0ba44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:12.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.907+0000 7f827d6c5740 1 -- 172.21.15.7:0/1856694397 shutdown_connections 2024-09-19T08:52:12.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.907+0000 7f827d6c5740 1 -- 172.21.15.7:0/1856694397 wait complete. 2024-09-19T08:52:12.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.907+0000 7f827d6c5740 1 -- start start 2024-09-19T08:52:12.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.907+0000 7f827d6c5740 1 Processor -- start 2024-09-19T08:52:12.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.908+0000 7f827d6c5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0ba7b60 0x55d7a0bafbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:12.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.908+0000 7f827d6c5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7a0ba8480 0x55d7a0bb0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:12.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.908+0000 7f827d6c5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0bb2d40 0x55d7a0bb0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:12.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.908+0000 7f827d6c5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d7a0bb5910 con 0x55d7a0bb2d40 2024-09-19T08:52:12.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.908+0000 7f827d6c5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d7a0ac7f10 con 0x55d7a0ba7b60 2024-09-19T08:52:12.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.908+0000 7f827d6c5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d7a0bb5a90 con 0x55d7a0ba8480 2024-09-19T08:52:12.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.908+0000 7f827d6c5740 10 client.0 _ll_register_callbacks cb 0x55d7a0a90a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:12.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.908+0000 7f8279088640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0ba7b60 0x55d7a0bafbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:12.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.908+0000 7f8279889640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0bb2d40 0x55d7a0bb0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:12.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.908+0000 7f8279088640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0ba7b60 0x55d7a0bafbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:58610/0 (socket says 172.21.15.7:58610) 2024-09-19T08:52:12.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.908+0000 7f8279088640 1 -- 172.21.15.7:0/1184739444 learned_addr learned my addr 172.21.15.7:0/1184739444 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:12.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.908+0000 7f8278887640 1 --2- 172.21.15.7:0/1184739444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7a0ba8480 0x55d7a0bb0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:12.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.908+0000 7f8279088640 1 -- 172.21.15.7:0/1184739444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7a0ba8480 msgr2=0x55d7a0bb0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:12.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.908+0000 7f8279088640 1 --2- 172.21.15.7:0/1184739444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7a0ba8480 0x55d7a0bb0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.908+0000 7f8279088640 1 -- 172.21.15.7:0/1184739444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0bb2d40 msgr2=0x55d7a0bb0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:12.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.908+0000 7f8279088640 1 --2- 172.21.15.7:0/1184739444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0bb2d40 0x55d7a0bb0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.908+0000 7f8279088640 1 -- 172.21.15.7:0/1184739444 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7a087e6a0 con 0x55d7a0ba7b60 2024-09-19T08:52:12.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.908+0000 7f8279889640 1 --2- 172.21.15.7:0/1184739444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0bb2d40 0x55d7a0bb0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:12.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.909+0000 7f8279088640 1 --2- 172.21.15.7:0/1184739444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0ba7b60 0x55d7a0bafbc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f826409a380 tx=0x7f82640d36a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a866c7cbc5f59d40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:12.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.909+0000 7f8258ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-19T08:52:12.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.909+0000 7f8258ff9640 1 -- 172.21.15.7:0/1184739444 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826401d040 con 0x55d7a0ba7b60 2024-09-19T08:52:12.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.909+0000 7f827d6c5740 1 -- 172.21.15.7:0/1184739444 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f826409c7d0 con 0x55d7a0ba7b60 2024-09-19T08:52:12.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.909+0000 7f8258ff9640 1 -- 172.21.15.7:0/1184739444 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8629+0+0 (secure 0 0 0) 0x7f82640a0170 con 0x55d7a0ba7b60 2024-09-19T08:52:12.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.909+0000 7f8258ff9640 1 -- 172.21.15.7:0/1184739444 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f826409bc10 con 0x55d7a0ba7b60 2024-09-19T08:52:12.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.909+0000 7f827d6c5740 10 client.26492 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:12.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.909+0000 7f827d6c5740 1 -- 172.21.15.7:0/1184739444 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d7a0bc14c0 con 0x55d7a0ba7b60 2024-09-19T08:52:12.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.909+0000 7f8258ff9640 1 -- 172.21.15.7:0/1184739444 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f826409c7d0 con 0x55d7a0ba7b60 2024-09-19T08:52:12.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.909+0000 7f8258ff9640 1 -- 172.21.15.7:0/1184739444 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f82640cd7c0 con 0x55d7a0ba7b60 2024-09-19T08:52:12.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.909+0000 7f827d6c5740 10 client.26492 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:12.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.909+0000 7f827d6c5740 10 client.26492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:12.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.910+0000 7f827d6c5740 20 client.26492 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:12.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.910+0000 7f827d6c5740 1 --2- 172.21.15.7:0/1184739444 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d7a0bc2810 0x55d7a0bc4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:12.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.910+0000 7f827d6c5740 4 client.26492 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:12.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.910+0000 7f827d6c5740 1 -- 172.21.15.7:0/1184739444 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7a0b1a7f0 con 0x55d7a0bc2810 2024-09-19T08:52:12.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.910+0000 7f8278887640 1 --2- 172.21.15.7:0/1184739444 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d7a0bc2810 0x55d7a0bc4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:12.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.910+0000 7f8278887640 1 --2- 172.21.15.7:0/1184739444 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d7a0bc2810 0x55d7a0bc4c00 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74ccc68a0ccbc1f1 server_cookie=b2515af32d1606 in_seq=0 out_seq=0 2024-09-19T08:52:12.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.910+0000 7f8258ff9640 10 client.26492 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:12.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.911+0000 7f8258ff9640 1 -- 172.21.15.7:0/1184739444 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d7a0b1a7f0 con 0x55d7a0bc2810 2024-09-19T08:52:12.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.911+0000 7f8258ff9640 10 client.26492 handle_command_reply: tid=0 2024-09-19T08:52:12.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.911+0000 7f827d6c5740 1 client.26492 shutdown 2024-09-19T08:52:12.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.911+0000 7f827d6c5740 1 -- 172.21.15.7:0/1184739444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0ba7b60 msgr2=0x55d7a0bafbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:12.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.911+0000 7f827d6c5740 1 --2- 172.21.15.7:0/1184739444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0ba7b60 0x55d7a0bafbc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f826409a380 tx=0x7f82640d36a0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.911+0000 7f827d6c5740 1 -- 172.21.15.7:0/1184739444 shutdown_connections 2024-09-19T08:52:12.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.911+0000 7f827d6c5740 1 --2- 172.21.15.7:0/1184739444 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d7a0bc2810 0x55d7a0bc4c00 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.911+0000 7f827d6c5740 1 --2- 172.21.15.7:0/1184739444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0bb2d40 0x55d7a0bb0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.911+0000 7f827d6c5740 1 --2- 172.21.15.7:0/1184739444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7a0ba8480 0x55d7a0bb0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.911+0000 7f827d6c5740 1 --2- 172.21.15.7:0/1184739444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0ba7b60 0x55d7a0bafbc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.911+0000 7f8258ff9640 0 client.26492 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:12.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.911+0000 7f827d6c5740 1 -- 172.21.15.7:0/1184739444 >> 172.21.15.7:0/1184739444 conn(0x55d7a0ba40f0 msgr2=0x55d7a0ba9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:12.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.911+0000 7f827d6c5740 1 -- 172.21.15.7:0/1184739444 shutdown_connections 2024-09-19T08:52:12.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.911+0000 7f827d6c5740 1 -- 172.21.15.7:0/1184739444 wait complete. 2024-09-19T08:52:12.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.911+0000 7f827d6c5740 20 client.26492 trim_cache size 0 max 16384 2024-09-19T08:52:12.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:12 smithi175 ceph-mon[35688]: pgmap v236: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:52:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.929+0000 7f827d6c5740 1 Processor -- start 2024-09-19T08:52:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.929+0000 7f827d6c5740 1 -- start start 2024-09-19T08:52:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.929+0000 7f827d6c5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0ba7b60 0x55d7a0bbe3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.930+0000 7f827d6c5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7a0ba8480 0x55d7a0bc7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.930+0000 7f827d6c5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0bb2d40 0x55d7a0bc8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.930+0000 7f827d6c5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f82741b2560 con 0x55d7a0ba7b60 2024-09-19T08:52:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.930+0000 7f827d6c5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f82741afe30 con 0x55d7a0bb2d40 2024-09-19T08:52:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.930+0000 7f827d6c5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f82741adca0 con 0x55d7a0ba8480 2024-09-19T08:52:12.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.930+0000 7f8279088640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0ba7b60 0x55d7a0bbe3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:12.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.930+0000 7f8279088640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0ba7b60 0x55d7a0bbe3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40788/0 (socket says 172.21.15.7:40788) 2024-09-19T08:52:12.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.930+0000 7f8279088640 1 -- 172.21.15.7:0/1659295662 learned_addr learned my addr 172.21.15.7:0/1659295662 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:12.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.930+0000 7f8279889640 1 --2- 172.21.15.7:0/1659295662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0bb2d40 0x55d7a0bc8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:12.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.930+0000 7f8278887640 1 --2- 172.21.15.7:0/1659295662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7a0ba8480 0x55d7a0bc7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:12.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.930+0000 7f8279088640 1 -- 172.21.15.7:0/1659295662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7a0ba8480 msgr2=0x55d7a0bc7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:12.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.930+0000 7f8279088640 1 --2- 172.21.15.7:0/1659295662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7a0ba8480 0x55d7a0bc7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.930+0000 7f8279088640 1 -- 172.21.15.7:0/1659295662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0bb2d40 msgr2=0x55d7a0bc8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:12.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.930+0000 7f8279088640 1 --2- 172.21.15.7:0/1659295662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0bb2d40 0x55d7a0bc8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.930+0000 7f8279088640 1 -- 172.21.15.7:0/1659295662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7a0b9f830 con 0x55d7a0ba7b60 2024-09-19T08:52:12.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.930+0000 7f8278887640 1 --2- 172.21.15.7:0/1659295662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7a0ba8480 0x55d7a0bc7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:12.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.930+0000 7f8279088640 1 --2- 172.21.15.7:0/1659295662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0ba7b60 0x55d7a0bbe3f0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f8264007590 tx=0x7f82640bc300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f06ea32a200c22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:12.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.930+0000 7f825affd640 1 -- 172.21.15.7:0/1659295662 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826401d070 con 0x55d7a0ba7b60 2024-09-19T08:52:12.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.931+0000 7f825affd640 1 -- 172.21.15.7:0/1659295662 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f826409c5b0 con 0x55d7a0ba7b60 2024-09-19T08:52:12.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.931+0000 7f825affd640 1 -- 172.21.15.7:0/1659295662 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82640d3a60 con 0x55d7a0ba7b60 2024-09-19T08:52:12.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.931+0000 7f827d6c5740 1 -- 172.21.15.7:0/1659295662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0ba7b60 msgr2=0x55d7a0bbe3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:12.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.931+0000 7f827d6c5740 1 --2- 172.21.15.7:0/1659295662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0ba7b60 0x55d7a0bbe3f0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f8264007590 tx=0x7f82640bc300 comp rx=0 tx=0).stop 2024-09-19T08:52:12.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.931+0000 7f827d6c5740 1 -- 172.21.15.7:0/1659295662 shutdown_connections 2024-09-19T08:52:12.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.931+0000 7f827d6c5740 1 --2- 172.21.15.7:0/1659295662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0bb2d40 0x55d7a0bc8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.931+0000 7f827d6c5740 1 --2- 172.21.15.7:0/1659295662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7a0ba8480 0x55d7a0bc7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.931+0000 7f827d6c5740 1 --2- 172.21.15.7:0/1659295662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0ba7b60 0x55d7a0bbe3f0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.931+0000 7f827d6c5740 1 -- 172.21.15.7:0/1659295662 >> 172.21.15.7:0/1659295662 conn(0x55d7a0ba40f0 msgr2=0x55d7a0bbdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.931+0000 7f827d6c5740 1 -- 172.21.15.7:0/1659295662 shutdown_connections 2024-09-19T08:52:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.931+0000 7f827d6c5740 1 -- 172.21.15.7:0/1659295662 wait complete. 2024-09-19T08:52:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.932+0000 7f827d6c5740 1 -- start start 2024-09-19T08:52:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.932+0000 7f827d6c5740 1 Processor -- start 2024-09-19T08:52:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.932+0000 7f827d6c5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7a0ba7b60 0x55d7a0bc82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.932+0000 7f827d6c5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0ba8480 0x55d7a0bc5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.932+0000 7f827d6c5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0bb2d40 0x55d7a0bc5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.932+0000 7f827d6c5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f82741ae2f0 con 0x55d7a0bb2d40 2024-09-19T08:52:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.932+0000 7f827d6c5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f82741af760 con 0x55d7a0ba8480 2024-09-19T08:52:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.932+0000 7f827d6c5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f82741ae9c0 con 0x55d7a0ba7b60 2024-09-19T08:52:12.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.932+0000 7f827d6c5740 10 client.0 _ll_register_callbacks cb 0x7f826c0095a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.932+0000 7f8279889640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0bb2d40 0x55d7a0bc5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.932+0000 7f8278887640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0ba8480 0x55d7a0bc5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.933+0000 7f8279889640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0bb2d40 0x55d7a0bc5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40790/0 (socket says 172.21.15.7:40790) 2024-09-19T08:52:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.933+0000 7f8279889640 1 -- 172.21.15.7:0/3750102880 learned_addr learned my addr 172.21.15.7:0/3750102880 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.933+0000 7f8279088640 1 --2- 172.21.15.7:0/3750102880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7a0ba7b60 0x55d7a0bc82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.933+0000 7f8278887640 1 -- 172.21.15.7:0/3750102880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7a0ba7b60 msgr2=0x55d7a0bc82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.933+0000 7f8278887640 1 --2- 172.21.15.7:0/3750102880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7a0ba7b60 0x55d7a0bc82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.933+0000 7f8278887640 1 -- 172.21.15.7:0/3750102880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0bb2d40 msgr2=0x55d7a0bc5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.933+0000 7f8278887640 1 --2- 172.21.15.7:0/3750102880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0bb2d40 0x55d7a0bc5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.933+0000 7f8278887640 1 -- 172.21.15.7:0/3750102880 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7a0ba82b0 con 0x55d7a0ba8480 2024-09-19T08:52:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.933+0000 7f8278887640 1 --2- 172.21.15.7:0/3750102880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0ba8480 0x55d7a0bc5620 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f826802ade0 tx=0x7f8268031ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3feccf6da89a04ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:12.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.933+0000 7f8258ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-19T08:52:12.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.933+0000 7f8258ff9640 1 -- 172.21.15.7:0/3750102880 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268003d80 con 0x55d7a0ba8480 2024-09-19T08:52:12.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.933+0000 7f827d6c5740 1 -- 172.21.15.7:0/3750102880 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f826409c5b0 con 0x55d7a0ba8480 2024-09-19T08:52:12.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.933+0000 7f8258ff9640 1 -- 172.21.15.7:0/3750102880 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8629+0+0 (secure 0 0 0) 0x7f8268031450 con 0x55d7a0ba8480 2024-09-19T08:52:12.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.933+0000 7f8258ff9640 1 -- 172.21.15.7:0/3750102880 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8268057050 con 0x55d7a0ba8480 2024-09-19T08:52:12.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.934+0000 7f827d6c5740 10 client.26498 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:12.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.934+0000 7f827d6c5740 1 -- 172.21.15.7:0/3750102880 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d7a0c2cf80 con 0x55d7a0ba8480 2024-09-19T08:52:12.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.934+0000 7f8258ff9640 1 -- 172.21.15.7:0/3750102880 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f826409c5b0 con 0x55d7a0ba8480 2024-09-19T08:52:12.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.934+0000 7f8258ff9640 1 -- 172.21.15.7:0/3750102880 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8268047440 con 0x55d7a0ba8480 2024-09-19T08:52:12.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.934+0000 7f827d6c5740 10 client.26498 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:12.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.934+0000 7f827d6c5740 10 client.26498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:12.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.934+0000 7f827d6c5740 20 client.26498 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:12.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.934+0000 7f827d6c5740 1 --2- 172.21.15.7:0/3750102880 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d7a0c2d6b0 0x55d7a0c2fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:12.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.934+0000 7f827d6c5740 4 client.26498 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:52:12.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.934+0000 7f827d6c5740 1 -- 172.21.15.7:0/3750102880 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d7a0b14d00 con 0x55d7a0c2d6b0 2024-09-19T08:52:12.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.934+0000 7f8279088640 1 --2- 172.21.15.7:0/3750102880 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d7a0c2d6b0 0x55d7a0c2fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:12.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.935+0000 7f8279088640 1 --2- 172.21.15.7:0/3750102880 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d7a0c2d6b0 0x55d7a0c2fad0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a70755ea09184c29 server_cookie=2e63d706ffe56fe8 in_seq=0 out_seq=0 2024-09-19T08:52:12.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.935+0000 7f8258ff9640 10 client.26498 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:12.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.936+0000 7f8258ff9640 1 -- 172.21.15.7:0/3750102880 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d7a0b14d00 con 0x55d7a0c2d6b0 2024-09-19T08:52:12.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.936+0000 7f8258ff9640 10 client.26498 handle_command_reply: tid=0 2024-09-19T08:52:12.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.936+0000 7f827d6c5740 1 client.26498 shutdown 2024-09-19T08:52:12.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.936+0000 7f827d6c5740 1 -- 172.21.15.7:0/3750102880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0ba8480 msgr2=0x55d7a0bc5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:12.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.936+0000 7f827d6c5740 1 --2- 172.21.15.7:0/3750102880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0ba8480 0x55d7a0bc5620 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f826802ade0 tx=0x7f8268031ca0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.936+0000 7f827d6c5740 1 -- 172.21.15.7:0/3750102880 shutdown_connections 2024-09-19T08:52:12.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.936+0000 7f827d6c5740 1 --2- 172.21.15.7:0/3750102880 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55d7a0c2d6b0 0x55d7a0c2fad0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.936+0000 7f827d6c5740 1 --2- 172.21.15.7:0/3750102880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d7a0bb2d40 0x55d7a0bc5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.936+0000 7f827d6c5740 1 --2- 172.21.15.7:0/3750102880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7a0ba8480 0x55d7a0bc5620 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.936+0000 7f827d6c5740 1 --2- 172.21.15.7:0/3750102880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7a0ba7b60 0x55d7a0bc82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.936+0000 7f827d6c5740 1 -- 172.21.15.7:0/3750102880 >> 172.21.15.7:0/3750102880 conn(0x55d7a0ba40f0 msgr2=0x55d7a0bbe500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:12.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.936+0000 7f8258ff9640 0 client.26498 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:12.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.936+0000 7f827d6c5740 1 -- 172.21.15.7:0/3750102880 shutdown_connections 2024-09-19T08:52:12.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.936+0000 7f827d6c5740 1 -- 172.21.15.7:0/3750102880 wait complete. 2024-09-19T08:52:12.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.936+0000 7f827d6c5740 20 client.26498 trim_cache size 0 max 16384 2024-09-19T08:52:12.940 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:52:12.940 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-19T08:52:12.940 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "f2e127e1-e2bf-4e87-a3df-44beee9bc105", 2024-09-19T08:52:12.941 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-19T08:52:12.941 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:52:12.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.937+0000 7f827b2ec640 1 -- 172.21.15.7:0/2679681975 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f825c0a3430 msgr2=0x7f825c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:12.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.937+0000 7f827b2ec640 1 --2- 172.21.15.7:0/2679681975 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f825c0a3430 0x7f825c0a58f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8274069760 tx=0x7f826c004730 comp rx=0 tx=0).stop 2024-09-19T08:52:12.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.937+0000 7f827b2ec640 1 -- 172.21.15.7:0/2679681975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8274100b20 msgr2=0x7f82741a03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:12.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.937+0000 7f827b2ec640 1 --2- 172.21.15.7:0/2679681975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8274100b20 0x7f82741a03e0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f826400c890 tx=0x7f826400cd50 comp rx=0 tx=0).stop 2024-09-19T08:52:12.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.937+0000 7f827b2ec640 1 -- 172.21.15.7:0/2679681975 shutdown_connections 2024-09-19T08:52:12.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.937+0000 7f827b2ec640 1 --2- 172.21.15.7:0/2679681975 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f825c0a3430 0x7f825c0a58f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.937+0000 7f827b2ec640 1 --2- 172.21.15.7:0/2679681975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f827410e500 0x7f827419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.937+0000 7f827b2ec640 1 --2- 172.21.15.7:0/2679681975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8274101440 0x7f82741a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.937+0000 7f827b2ec640 1 --2- 172.21.15.7:0/2679681975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8274100b20 0x7f82741a03e0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.937+0000 7f827b2ec640 1 -- 172.21.15.7:0/2679681975 >> 172.21.15.7:0/2679681975 conn(0x7f82740fc7d0 msgr2=0x7f82740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:12.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.937+0000 7f827b2ec640 1 -- 172.21.15.7:0/2679681975 shutdown_connections 2024-09-19T08:52:12.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:12.937+0000 7f827b2ec640 1 -- 172.21.15.7:0/2679681975 wait complete. 2024-09-19T08:52:13.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:13 smithi007 ceph-mon[31221]: scrub queued for path: / 2024-09-19T08:52:13.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:13 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:13.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:13 smithi007 ceph-mon[31221]: scrub summary: active paths [/] 2024-09-19T08:52:13.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:13 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:13.668 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:52:13.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:13 smithi044 ceph-mon[35072]: scrub queued for path: / 2024-09-19T08:52:13.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:13 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:13.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:13 smithi044 ceph-mon[35072]: scrub summary: active paths [/] 2024-09-19T08:52:13.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:13 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:13.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:13 smithi175 ceph-mon[35688]: scrub queued for path: / 2024-09-19T08:52:13.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:13 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:13.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:13 smithi175 ceph-mon[35688]: scrub summary: active paths [/] 2024-09-19T08:52:13.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:13 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:13.929 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:14.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.371+0000 7fe6cef0b640 1 -- 172.21.15.7:0/1554137816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6c8102570 msgr2=0x7fe6c81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.371+0000 7fe6cef0b640 1 --2- 172.21.15.7:0/1554137816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6c8102570 0x7fe6c81029b0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009900 tx=0x7fe6b402a480 comp rx=0 tx=0).stop 2024-09-19T08:52:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.371+0000 7fe6cef0b640 1 -- 172.21.15.7:0/1554137816 shutdown_connections 2024-09-19T08:52:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.371+0000 7fe6cef0b640 1 --2- 172.21.15.7:0/1554137816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c8102ef0 0x7fe6c810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.371+0000 7fe6cef0b640 1 --2- 172.21.15.7:0/1554137816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6c8102570 0x7fe6c81029b0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.371+0000 7fe6cef0b640 1 --2- 172.21.15.7:0/1554137816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6c8100e20 0x7fe6c8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.371+0000 7fe6cef0b640 1 -- 172.21.15.7:0/1554137816 >> 172.21.15.7:0/1554137816 conn(0x7fe6c80fc7d0 msgr2=0x7fe6c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.371+0000 7fe6cef0b640 1 -- 172.21.15.7:0/1554137816 shutdown_connections 2024-09-19T08:52:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.371+0000 7fe6cef0b640 1 -- 172.21.15.7:0/1554137816 wait complete. 2024-09-19T08:52:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.371+0000 7fe6cef0b640 1 Processor -- start 2024-09-19T08:52:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.372+0000 7fe6cef0b640 1 -- start start 2024-09-19T08:52:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.372+0000 7fe6cef0b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6c8100e20 0x7fe6c810e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.372+0000 7fe6cef0b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6c8102570 0x7fe6c810ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.372+0000 7fe6cef0b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c8102ef0 0x7fe6c810ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.372+0000 7fe6cef0b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c81120a0 con 0x7fe6c8100e20 2024-09-19T08:52:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.372+0000 7fe6cef0b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c8111f20 con 0x7fe6c8102570 2024-09-19T08:52:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.372+0000 7fe6cef0b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c8112220 con 0x7fe6c8102ef0 2024-09-19T08:52:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.372+0000 7fe6ccca7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6c8100e20 0x7fe6c810e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.372+0000 7fe6ccca7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6c8100e20 0x7fe6c810e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34504/0 (socket says 172.21.15.7:34504) 2024-09-19T08:52:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.372+0000 7fe6ccca7640 1 -- 172.21.15.7:0/1418484532 learned_addr learned my addr 172.21.15.7:0/1418484532 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.372+0000 7fe6c7fff640 1 --2- 172.21.15.7:0/1418484532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6c8102570 0x7fe6c810ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.372+0000 7fe6cd4a8640 1 --2- 172.21.15.7:0/1418484532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c8102ef0 0x7fe6c810ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.372+0000 7fe6ccca7640 1 -- 172.21.15.7:0/1418484532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c8102ef0 msgr2=0x7fe6c810ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.372+0000 7fe6ccca7640 1 --2- 172.21.15.7:0/1418484532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c8102ef0 0x7fe6c810ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.372+0000 7fe6ccca7640 1 -- 172.21.15.7:0/1418484532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6c8102570 msgr2=0x7fe6c810ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.372+0000 7fe6ccca7640 1 --2- 172.21.15.7:0/1418484532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6c8102570 0x7fe6c810ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.372+0000 7fe6ccca7640 1 -- 172.21.15.7:0/1418484532 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c81a6a20 con 0x7fe6c8100e20 2024-09-19T08:52:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.372+0000 7fe6cd4a8640 1 --2- 172.21.15.7:0/1418484532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c8102ef0 0x7fe6c810ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.372+0000 7fe6ccca7640 1 --2- 172.21.15.7:0/1418484532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6c8100e20 0x7fe6c810e4d0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00d950 tx=0x7fe6bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.372+0000 7fe6c5ffb640 1 -- 172.21.15.7:0/1418484532 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc017070 con 0x7fe6c8100e20 2024-09-19T08:52:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.373+0000 7fe6c5ffb640 1 -- 172.21.15.7:0/1418484532 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6bc009c30 con 0x7fe6c8100e20 2024-09-19T08:52:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.373+0000 7fe6cef0b640 1 -- 172.21.15.7:0/1418484532 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6c81a6d10 con 0x7fe6c8100e20 2024-09-19T08:52:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.373+0000 7fe6c5ffb640 1 -- 172.21.15.7:0/1418484532 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc00f6b0 con 0x7fe6c8100e20 2024-09-19T08:52:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.373+0000 7fe6cef0b640 1 -- 172.21.15.7:0/1418484532 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c81a7240 con 0x7fe6c8100e20 2024-09-19T08:52:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.376+0000 7fe6c5ffb640 1 -- 172.21.15.7:0/1418484532 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fe6bc0109d0 con 0x7fe6c8100e20 2024-09-19T08:52:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.376+0000 7fe6d12e4740 1 Processor -- start 2024-09-19T08:52:14.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.376+0000 7fe6d12e4740 1 -- start start 2024-09-19T08:52:14.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.376+0000 7fe6d12e4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55909edeb4a0 0x55909edeb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.376+0000 7fe6d12e4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55909edebdc0 0x55909edf6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.376+0000 7fe6d12e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edf6680 0x55909edf8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.376+0000 7fe6d12e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55909ed512e0 con 0x55909edf6680 2024-09-19T08:52:14.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.376+0000 7fe6d12e4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55909ecf8ce0 con 0x55909edeb4a0 2024-09-19T08:52:14.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.376+0000 7fe6d12e4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55909ed4d2a0 con 0x55909edebdc0 2024-09-19T08:52:14.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.376+0000 7fe6c7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edf6680 0x55909edf8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.376+0000 7fe6cd4a8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55909edeb4a0 0x55909edeb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.376+0000 7fe6c5ffb640 1 --2- 172.21.15.7:0/1418484532 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe6b80a3430 0x7fe6b80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.376+0000 7fe6c7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edf6680 0x55909edf8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34508/0 (socket says 172.21.15.7:34508) 2024-09-19T08:52:14.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.376+0000 7fe6cd4a8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55909edeb4a0 0x55909edeb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:37760/0 (socket says 172.21.15.7:37760) 2024-09-19T08:52:14.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.376+0000 7fe6c7fff640 1 -- 172.21.15.7:0/3043572773 learned_addr learned my addr 172.21.15.7:0/3043572773 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.377+0000 7fe6cd4a8640 1 --2- 172.21.15.7:0/1418484532 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe6b80a3430 0x7fe6b80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.377+0000 7fe6c5ffb640 1 -- 172.21.15.7:0/1418484532 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8629+0+0 (secure 0 0 0) 0x7fe6bc0cfd40 con 0x7fe6c8100e20 2024-09-19T08:52:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.377+0000 7fe6ccca7640 1 --2- 172.21.15.7:0/3043572773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55909edebdc0 0x55909edf6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.377+0000 7fe6c7fff640 1 -- 172.21.15.7:0/3043572773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55909edebdc0 msgr2=0x55909edf6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.377+0000 7fe6c7fff640 1 --2- 172.21.15.7:0/3043572773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55909edebdc0 0x55909edf6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.377+0000 7fe6c7fff640 1 -- 172.21.15.7:0/3043572773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55909edeb4a0 msgr2=0x55909edeb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.377+0000 7fe6c7fff640 1 --2- 172.21.15.7:0/3043572773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55909edeb4a0 0x55909edeb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.377+0000 7fe6c7fff640 1 -- 172.21.15.7:0/3043572773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55909ecdd440 con 0x55909edf6680 2024-09-19T08:52:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.377+0000 7fe6c7fff640 1 --2- 172.21.15.7:0/3043572773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edf6680 0x55909edf8a70 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe6b40314e0 tx=0x7fe6b4004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16de7f58f77bb3d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.377+0000 7fe6cd4a8640 1 --2- 172.21.15.7:0/1418484532 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe6b80a3430 0x7fe6b80a58f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0013c20 tx=0x7fe6c0004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.377+0000 7fe6b2ffd640 1 -- 172.21.15.7:0/3043572773 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4035030 con 0x55909edf6680 2024-09-19T08:52:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.377+0000 7fe6b2ffd640 1 -- 172.21.15.7:0/3043572773 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6b4005520 con 0x55909edf6680 2024-09-19T08:52:14.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.377+0000 7fe6b2ffd640 1 -- 172.21.15.7:0/3043572773 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4003850 con 0x55909edf6680 2024-09-19T08:52:14.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.378+0000 7fe6d12e4740 1 -- 172.21.15.7:0/3043572773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edf6680 msgr2=0x55909edf8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:14.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.378+0000 7fe6d12e4740 1 --2- 172.21.15.7:0/3043572773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edf6680 0x55909edf8a70 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe6b40314e0 tx=0x7fe6b4004170 comp rx=0 tx=0).stop 2024-09-19T08:52:14.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.378+0000 7fe6d12e4740 1 -- 172.21.15.7:0/3043572773 shutdown_connections 2024-09-19T08:52:14.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.378+0000 7fe6d12e4740 1 --2- 172.21.15.7:0/3043572773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edf6680 0x55909edf8a70 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.378+0000 7fe6d12e4740 1 --2- 172.21.15.7:0/3043572773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55909edebdc0 0x55909edf6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.378+0000 7fe6d12e4740 1 --2- 172.21.15.7:0/3043572773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55909edeb4a0 0x55909edeb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.378+0000 7fe6d12e4740 1 -- 172.21.15.7:0/3043572773 >> 172.21.15.7:0/3043572773 conn(0x55909ede7a30 msgr2=0x55909ede7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:14.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.378+0000 7fe6d12e4740 1 -- 172.21.15.7:0/3043572773 shutdown_connections 2024-09-19T08:52:14.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.378+0000 7fe6d12e4740 1 -- 172.21.15.7:0/3043572773 wait complete. 2024-09-19T08:52:14.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.378+0000 7fe6d12e4740 1 -- start start 2024-09-19T08:52:14.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.378+0000 7fe6d12e4740 1 Processor -- start 2024-09-19T08:52:14.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.379+0000 7fe6d12e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edeb4a0 0x55909edf5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.379+0000 7fe6d12e4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55909edebdc0 0x55909edf31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.379+0000 7fe6d12e4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55909edf6680 0x55909edf3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.379+0000 7fe6d12e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55909edf9250 con 0x55909edeb4a0 2024-09-19T08:52:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.379+0000 7fe6d12e4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55909ed0c050 con 0x55909edf6680 2024-09-19T08:52:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.379+0000 7fe6d12e4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55909edf93d0 con 0x55909edebdc0 2024-09-19T08:52:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.379+0000 7fe6d12e4740 10 client.0 _ll_register_callbacks cb 0x55909ed4c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.379+0000 7fe6ccca7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edeb4a0 0x55909edf5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.379+0000 7fe6ccca7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edeb4a0 0x55909edf5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34516/0 (socket says 172.21.15.7:34516) 2024-09-19T08:52:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.379+0000 7fe6ccca7640 1 -- 172.21.15.7:0/500500685 learned_addr learned my addr 172.21.15.7:0/500500685 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.379+0000 7fe6c7fff640 1 --2- 172.21.15.7:0/500500685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55909edebdc0 0x55909edf31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.379+0000 7fe6cd4a8640 1 --2- 172.21.15.7:0/500500685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55909edf6680 0x55909edf3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.379+0000 7fe6ccca7640 1 -- 172.21.15.7:0/500500685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55909edebdc0 msgr2=0x55909edf31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:14.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.379+0000 7fe6ccca7640 1 --2- 172.21.15.7:0/500500685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55909edebdc0 0x55909edf31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.379+0000 7fe6ccca7640 1 -- 172.21.15.7:0/500500685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55909edf6680 msgr2=0x55909edf3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.379+0000 7fe6ccca7640 1 --2- 172.21.15.7:0/500500685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55909edf6680 0x55909edf3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.379+0000 7fe6ccca7640 1 -- 172.21.15.7:0/500500685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55909eac23c0 con 0x55909edeb4a0 2024-09-19T08:52:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.379+0000 7fe6cd4a8640 1 --2- 172.21.15.7:0/500500685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55909edf6680 0x55909edf3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.379+0000 7fe6ccca7640 1 --2- 172.21.15.7:0/500500685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edeb4a0 0x55909edf5f40 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc010fd0 tx=0x7fe6bc0bc170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72792ca098dec58f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.379+0000 7fe6a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.380+0000 7fe6a7fff640 1 -- 172.21.15.7:0/500500685 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc09bfb0 con 0x55909edeb4a0 2024-09-19T08:52:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.380+0000 7fe6a7fff640 1 -- 172.21.15.7:0/500500685 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8629+0+0 (secure 0 0 0) 0x7fe6bc0a4790 con 0x55909edeb4a0 2024-09-19T08:52:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.380+0000 7fe6d12e4740 1 -- 172.21.15.7:0/500500685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6b4005520 con 0x55909edeb4a0 2024-09-19T08:52:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.380+0000 7fe6a7fff640 1 -- 172.21.15.7:0/500500685 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe6bc0a0360 con 0x55909edeb4a0 2024-09-19T08:52:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.380+0000 7fe6d12e4740 10 client.16914 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.380+0000 7fe6d12e4740 1 -- 172.21.15.7:0/500500685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55909ee04bf0 con 0x55909edeb4a0 2024-09-19T08:52:14.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.380+0000 7fe6a7fff640 1 -- 172.21.15.7:0/500500685 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6b4005520 con 0x55909edeb4a0 2024-09-19T08:52:14.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.380+0000 7fe6a7fff640 1 -- 172.21.15.7:0/500500685 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe6bc09b400 con 0x55909edeb4a0 2024-09-19T08:52:14.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.380+0000 7fe6d12e4740 10 client.16914 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:14.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.380+0000 7fe6d12e4740 10 client.16914 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:14.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.380+0000 7fe6d12e4740 20 client.16914 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:14.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.380+0000 7fe6d12e4740 1 --2- 172.21.15.7:0/500500685 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55909ee060b0 0x55909ee084c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.380+0000 7fe6d12e4740 4 client.16914 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:14.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.380+0000 7fe6d12e4740 1 -- 172.21.15.7:0/500500685 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55909ed5e850 con 0x55909ee060b0 2024-09-19T08:52:14.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.381+0000 7fe6c7fff640 1 --2- 172.21.15.7:0/500500685 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55909ee060b0 0x55909ee084c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.381+0000 7fe6c7fff640 1 --2- 172.21.15.7:0/500500685 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55909ee060b0 0x55909ee084c0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1609a4714e1a03f server_cookie=40e0186e6d48a2f0 in_seq=0 out_seq=0 2024-09-19T08:52:14.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.381+0000 7fe6a7fff640 10 client.16914 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:14.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.382+0000 7fe6a7fff640 1 -- 172.21.15.7:0/500500685 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55909ed5e850 con 0x55909ee060b0 2024-09-19T08:52:14.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.382+0000 7fe6a7fff640 10 client.16914 handle_command_reply: tid=0 2024-09-19T08:52:14.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.382+0000 7fe6d12e4740 1 client.16914 shutdown 2024-09-19T08:52:14.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.382+0000 7fe6d12e4740 1 -- 172.21.15.7:0/500500685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edeb4a0 msgr2=0x55909edf5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:14.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.382+0000 7fe6d12e4740 1 --2- 172.21.15.7:0/500500685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edeb4a0 0x55909edf5f40 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc010fd0 tx=0x7fe6bc0bc170 comp rx=0 tx=0).stop 2024-09-19T08:52:14.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.382+0000 7fe6d12e4740 1 -- 172.21.15.7:0/500500685 shutdown_connections 2024-09-19T08:52:14.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.382+0000 7fe6d12e4740 1 --2- 172.21.15.7:0/500500685 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55909ee060b0 0x55909ee084c0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.382+0000 7fe6d12e4740 1 --2- 172.21.15.7:0/500500685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55909edf6680 0x55909edf3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.382+0000 7fe6d12e4740 1 --2- 172.21.15.7:0/500500685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55909edebdc0 0x55909edf31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.382+0000 7fe6d12e4740 1 --2- 172.21.15.7:0/500500685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edeb4a0 0x55909edf5f40 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.382+0000 7fe6a7fff640 0 client.16914 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:14.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.382+0000 7fe6d12e4740 1 -- 172.21.15.7:0/500500685 >> 172.21.15.7:0/500500685 conn(0x55909ede7a30 msgr2=0x55909eded710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:14.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.382+0000 7fe6d12e4740 1 -- 172.21.15.7:0/500500685 shutdown_connections 2024-09-19T08:52:14.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.382+0000 7fe6d12e4740 1 -- 172.21.15.7:0/500500685 wait complete. 2024-09-19T08:52:14.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.382+0000 7fe6d12e4740 20 client.16914 trim_cache size 0 max 16384 2024-09-19T08:52:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.399+0000 7fe6d12e4740 1 Processor -- start 2024-09-19T08:52:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.399+0000 7fe6d12e4740 1 -- start start 2024-09-19T08:52:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.400+0000 7fe6d12e4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55909edeb4a0 0x55909ee024e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.400+0000 7fe6d12e4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55909edebdc0 0x55909ee0dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.400+0000 7fe6d12e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edf6680 0x55909ee0e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.400+0000 7fe6d12e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c81b23a0 con 0x55909edf6680 2024-09-19T08:52:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.400+0000 7fe6d12e4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c81afc70 con 0x55909edebdc0 2024-09-19T08:52:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.400+0000 7fe6d12e4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c81adae0 con 0x55909edeb4a0 2024-09-19T08:52:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.400+0000 7fe6cd4a8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edf6680 0x55909ee0e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.400+0000 7fe6cd4a8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edf6680 0x55909ee0e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34532/0 (socket says 172.21.15.7:34532) 2024-09-19T08:52:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.400+0000 7fe6cd4a8640 1 -- 172.21.15.7:0/3731426976 learned_addr learned my addr 172.21.15.7:0/3731426976 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.400+0000 7fe6ccca7640 1 --2- 172.21.15.7:0/3731426976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55909edeb4a0 0x55909ee024e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.400+0000 7fe6c7fff640 1 --2- 172.21.15.7:0/3731426976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55909edebdc0 0x55909ee0dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.400+0000 7fe6cd4a8640 1 -- 172.21.15.7:0/3731426976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55909edeb4a0 msgr2=0x55909ee024e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.400+0000 7fe6cd4a8640 1 --2- 172.21.15.7:0/3731426976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55909edeb4a0 0x55909ee024e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.400+0000 7fe6cd4a8640 1 -- 172.21.15.7:0/3731426976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55909edebdc0 msgr2=0x55909ee0dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.400+0000 7fe6cd4a8640 1 --2- 172.21.15.7:0/3731426976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55909edebdc0 0x55909ee0dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.400+0000 7fe6cd4a8640 1 -- 172.21.15.7:0/3731426976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55909ede74d0 con 0x55909edf6680 2024-09-19T08:52:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.400+0000 7fe6cd4a8640 1 --2- 172.21.15.7:0/3731426976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edf6680 0x55909ee0e280 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0011000 tx=0x7fe6c00078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5d4844ccf39b5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.400+0000 7fe6b27fc640 1 -- 172.21.15.7:0/3731426976 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0012db0 con 0x55909edf6680 2024-09-19T08:52:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.401+0000 7fe6b27fc640 1 -- 172.21.15.7:0/3731426976 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6c0025070 con 0x55909edf6680 2024-09-19T08:52:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.401+0000 7fe6b27fc640 1 -- 172.21.15.7:0/3731426976 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c000d6a0 con 0x55909edf6680 2024-09-19T08:52:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.401+0000 7fe6d12e4740 1 -- 172.21.15.7:0/3731426976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edf6680 msgr2=0x55909ee0e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.401+0000 7fe6d12e4740 1 --2- 172.21.15.7:0/3731426976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edf6680 0x55909ee0e280 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0011000 tx=0x7fe6c00078a0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.401+0000 7fe6d12e4740 1 -- 172.21.15.7:0/3731426976 shutdown_connections 2024-09-19T08:52:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.401+0000 7fe6d12e4740 1 --2- 172.21.15.7:0/3731426976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edf6680 0x55909ee0e280 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.401+0000 7fe6d12e4740 1 --2- 172.21.15.7:0/3731426976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55909edebdc0 0x55909ee0dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.401+0000 7fe6d12e4740 1 --2- 172.21.15.7:0/3731426976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55909edeb4a0 0x55909ee024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.401+0000 7fe6d12e4740 1 -- 172.21.15.7:0/3731426976 >> 172.21.15.7:0/3731426976 conn(0x55909ede7a30 msgr2=0x55909edf1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.401+0000 7fe6d12e4740 1 -- 172.21.15.7:0/3731426976 shutdown_connections 2024-09-19T08:52:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.401+0000 7fe6d12e4740 1 -- 172.21.15.7:0/3731426976 wait complete. 2024-09-19T08:52:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.402+0000 7fe6d12e4740 1 -- start start 2024-09-19T08:52:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.402+0000 7fe6d12e4740 1 Processor -- start 2024-09-19T08:52:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.402+0000 7fe6d12e4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55909edeb4a0 0x55909edfedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.402+0000 7fe6d12e4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55909edebdc0 0x55909edfa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.402+0000 7fe6d12e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edf6680 0x55909edfa630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.402+0000 7fe6d12e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c81ae130 con 0x55909edf6680 2024-09-19T08:52:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.402+0000 7fe6d12e4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c81af5a0 con 0x55909edeb4a0 2024-09-19T08:52:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.402+0000 7fe6d12e4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c81ae800 con 0x55909edebdc0 2024-09-19T08:52:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.402+0000 7fe6d12e4740 10 client.0 _ll_register_callbacks cb 0x7fe6bc09b930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.402+0000 7fe6cd4a8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edf6680 0x55909edfa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.402+0000 7fe6cd4a8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edf6680 0x55909edfa630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34544/0 (socket says 172.21.15.7:34544) 2024-09-19T08:52:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.402+0000 7fe6cd4a8640 1 -- 172.21.15.7:0/292186572 learned_addr learned my addr 172.21.15.7:0/292186572 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.402+0000 7fe6ccca7640 1 --2- 172.21.15.7:0/292186572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55909edeb4a0 0x55909edfedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.402+0000 7fe6c7fff640 1 --2- 172.21.15.7:0/292186572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55909edebdc0 0x55909edfa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.403+0000 7fe6cd4a8640 1 -- 172.21.15.7:0/292186572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55909edebdc0 msgr2=0x55909edfa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.403+0000 7fe6cd4a8640 1 --2- 172.21.15.7:0/292186572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55909edebdc0 0x55909edfa0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.403+0000 7fe6cd4a8640 1 -- 172.21.15.7:0/292186572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55909edeb4a0 msgr2=0x55909edfedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.403+0000 7fe6cd4a8640 1 --2- 172.21.15.7:0/292186572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55909edeb4a0 0x55909edfedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.403+0000 7fe6cd4a8640 1 -- 172.21.15.7:0/292186572 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55909edfae80 con 0x55909edf6680 2024-09-19T08:52:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.403+0000 7fe6cd4a8640 1 --2- 172.21.15.7:0/292186572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edf6680 0x55909edfa630 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0013a10 tx=0x7fe6c0007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af870a52d760021 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.403+0000 7fe6a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.403+0000 7fe6a7fff640 1 -- 172.21.15.7:0/292186572 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c002e070 con 0x55909edf6680 2024-09-19T08:52:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.403+0000 7fe6a7fff640 1 -- 172.21.15.7:0/292186572 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8629+0+0 (secure 0 0 0) 0x7fe6c0020860 con 0x55909edf6680 2024-09-19T08:52:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.403+0000 7fe6d12e4740 1 -- 172.21.15.7:0/292186572 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6c0025070 con 0x55909edf6680 2024-09-19T08:52:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.403+0000 7fe6a7fff640 1 -- 172.21.15.7:0/292186572 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe6c0020a60 con 0x55909edf6680 2024-09-19T08:52:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.403+0000 7fe6d12e4740 10 client.16920 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.403+0000 7fe6d12e4740 1 -- 172.21.15.7:0/292186572 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55909ee70d50 con 0x55909edf6680 2024-09-19T08:52:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.403+0000 7fe6a7fff640 1 -- 172.21.15.7:0/292186572 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6c0025070 con 0x55909edf6680 2024-09-19T08:52:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.404+0000 7fe6a7fff640 1 -- 172.21.15.7:0/292186572 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe6c002a400 con 0x55909edf6680 2024-09-19T08:52:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.404+0000 7fe6d12e4740 10 client.16920 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.404+0000 7fe6d12e4740 10 client.16920 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.404+0000 7fe6d12e4740 20 client.16920 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.404+0000 7fe6d12e4740 1 --2- 172.21.15.7:0/292186572 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55909ee71440 0x55909ee73860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.404+0000 7fe6d12e4740 4 client.16920 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:52:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.404+0000 7fe6d12e4740 1 -- 172.21.15.7:0/292186572 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55909ed58d60 con 0x55909ee71440 2024-09-19T08:52:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.404+0000 7fe6ccca7640 1 --2- 172.21.15.7:0/292186572 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55909ee71440 0x55909ee73860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.404+0000 7fe6ccca7640 1 --2- 172.21.15.7:0/292186572 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55909ee71440 0x55909ee73860 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5790507028e23270 server_cookie=7775213ef7e09bfd in_seq=0 out_seq=0 2024-09-19T08:52:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.404+0000 7fe6a7fff640 10 client.16920 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.404+0000 7fe6a7fff640 1 -- 172.21.15.7:0/292186572 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55909ed58d60 con 0x55909ee71440 2024-09-19T08:52:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.404+0000 7fe6a7fff640 10 client.16920 handle_command_reply: tid=0 2024-09-19T08:52:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.404+0000 7fe6d12e4740 1 client.16920 shutdown 2024-09-19T08:52:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.405+0000 7fe6d12e4740 1 -- 172.21.15.7:0/292186572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edf6680 msgr2=0x55909edfa630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.405+0000 7fe6d12e4740 1 --2- 172.21.15.7:0/292186572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edf6680 0x55909edfa630 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0013a10 tx=0x7fe6c0007d50 comp rx=0 tx=0).stop 2024-09-19T08:52:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.405+0000 7fe6d12e4740 1 -- 172.21.15.7:0/292186572 shutdown_connections 2024-09-19T08:52:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.405+0000 7fe6d12e4740 1 --2- 172.21.15.7:0/292186572 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55909ee71440 0x55909ee73860 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.405+0000 7fe6d12e4740 1 --2- 172.21.15.7:0/292186572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909edf6680 0x55909edfa630 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.405+0000 7fe6d12e4740 1 --2- 172.21.15.7:0/292186572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55909edebdc0 0x55909edfa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.405+0000 7fe6a7fff640 0 client.16920 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.405+0000 7fe6d12e4740 1 --2- 172.21.15.7:0/292186572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55909edeb4a0 0x55909edfedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.405+0000 7fe6d12e4740 1 -- 172.21.15.7:0/292186572 >> 172.21.15.7:0/292186572 conn(0x55909ede7a30 msgr2=0x55909ede6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.405+0000 7fe6d12e4740 1 -- 172.21.15.7:0/292186572 shutdown_connections 2024-09-19T08:52:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.405+0000 7fe6d12e4740 1 -- 172.21.15.7:0/292186572 wait complete. 2024-09-19T08:52:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.405+0000 7fe6d12e4740 20 client.16920 trim_cache size 0 max 16384 2024-09-19T08:52:14.416 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:52:14.417 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-19T08:52:14.417 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-09-19T08:52:14.417 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:52:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.405+0000 7fe6cef0b640 1 -- 172.21.15.7:0/1418484532 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe6b80a3430 msgr2=0x7fe6b80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.405+0000 7fe6cef0b640 1 --2- 172.21.15.7:0/1418484532 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe6b80a3430 0x7fe6b80a58f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0013c20 tx=0x7fe6c0004a40 comp rx=0 tx=0).stop 2024-09-19T08:52:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.405+0000 7fe6cef0b640 1 -- 172.21.15.7:0/1418484532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6c8100e20 msgr2=0x7fe6c810e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.405+0000 7fe6cef0b640 1 --2- 172.21.15.7:0/1418484532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6c8100e20 0x7fe6c810e4d0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00d950 tx=0x7fe6bc00de10 comp rx=0 tx=0).stop 2024-09-19T08:52:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.406+0000 7fe6cef0b640 1 -- 172.21.15.7:0/1418484532 shutdown_connections 2024-09-19T08:52:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.406+0000 7fe6cef0b640 1 --2- 172.21.15.7:0/1418484532 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe6b80a3430 0x7fe6b80a58f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.406+0000 7fe6cef0b640 1 --2- 172.21.15.7:0/1418484532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c8102ef0 0x7fe6c810ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.406+0000 7fe6cef0b640 1 --2- 172.21.15.7:0/1418484532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6c8102570 0x7fe6c810ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.406+0000 7fe6cef0b640 1 --2- 172.21.15.7:0/1418484532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6c8100e20 0x7fe6c810e4d0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.406+0000 7fe6cef0b640 1 -- 172.21.15.7:0/1418484532 >> 172.21.15.7:0/1418484532 conn(0x7fe6c80fc7d0 msgr2=0x7fe6c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.406+0000 7fe6cef0b640 1 -- 172.21.15.7:0/1418484532 shutdown_connections 2024-09-19T08:52:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:14.406+0000 7fe6cef0b640 1 -- 172.21.15.7:0/1418484532 wait complete. 2024-09-19T08:52:14.715 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:14 smithi007 ceph-mon[31221]: pgmap v237: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:52:14.715 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:14 smithi007 ceph-mon[31221]: scrub summary: idle 2024-09-19T08:52:14.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:14 smithi044 ceph-mon[35072]: pgmap v237: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:52:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:14 smithi044 ceph-mon[35072]: scrub summary: idle 2024-09-19T08:52:14.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:14 smithi175 ceph-mon[35688]: pgmap v237: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:52:14.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:14 smithi175 ceph-mon[35688]: scrub summary: idle 2024-09-19T08:52:15.111 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:52:15.111 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:52:15.366 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:15.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.800+0000 7f0cf4015640 1 -- 172.21.15.7:0/2218225898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cec106a60 msgr2=0x7f0cec106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:15.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.800+0000 7f0cf4015640 1 --2- 172.21.15.7:0/2218225898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cec106a60 0x7f0cec106e40 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009930 tx=0x7f0ce802a420 comp rx=0 tx=0).stop 2024-09-19T08:52:15.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.800+0000 7f0cf4015640 1 -- 172.21.15.7:0/2218225898 shutdown_connections 2024-09-19T08:52:15.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.800+0000 7f0cf4015640 1 --2- 172.21.15.7:0/2218225898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cec101400 0x7f0cec10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:15.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.800+0000 7f0cf4015640 1 --2- 172.21.15.7:0/2218225898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cec100a60 0x7f0cec100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:15.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.800+0000 7f0cf4015640 1 --2- 172.21.15.7:0/2218225898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cec106a60 0x7f0cec106e40 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:15.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.800+0000 7f0cf4015640 1 -- 172.21.15.7:0/2218225898 >> 172.21.15.7:0/2218225898 conn(0x7f0cec0fc780 msgr2=0x7f0cec0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:15.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.800+0000 7f0cf4015640 1 -- 172.21.15.7:0/2218225898 shutdown_connections 2024-09-19T08:52:15.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.800+0000 7f0cf4015640 1 -- 172.21.15.7:0/2218225898 wait complete. 2024-09-19T08:52:15.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.801+0000 7f0cf4015640 1 Processor -- start 2024-09-19T08:52:15.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.801+0000 7f0cf4015640 1 -- start start 2024-09-19T08:52:15.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.801+0000 7f0cf4015640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cec100a60 0x7f0cec1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:15.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.801+0000 7f0cf4015640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cec101400 0x7f0cec1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:15.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.801+0000 7f0cf4015640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cec106a60 0x7f0cec19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:15.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.801+0000 7f0cf4015640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0cec110e60 con 0x7f0cec101400 2024-09-19T08:52:15.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.801+0000 7f0cf4015640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0cec110ce0 con 0x7f0cec106a60 2024-09-19T08:52:15.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.801+0000 7f0cf4015640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0cec110fe0 con 0x7f0cec100a60 2024-09-19T08:52:15.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.801+0000 7f0cf15b0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cec101400 0x7f0cec1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:15.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.801+0000 7f0cf15b0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cec101400 0x7f0cec1989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34556/0 (socket says 172.21.15.7:34556) 2024-09-19T08:52:15.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.801+0000 7f0cf15b0640 1 -- 172.21.15.7:0/1677576436 learned_addr learned my addr 172.21.15.7:0/1677576436 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:15.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.801+0000 7f0cf25b2640 1 --2- 172.21.15.7:0/1677576436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cec106a60 0x7f0cec19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:15.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.801+0000 7f0cf1db1640 1 --2- 172.21.15.7:0/1677576436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cec100a60 0x7f0cec1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:15.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.801+0000 7f0cf15b0640 1 -- 172.21.15.7:0/1677576436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cec100a60 msgr2=0x7f0cec1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:15.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.801+0000 7f0cf15b0640 1 --2- 172.21.15.7:0/1677576436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cec100a60 0x7f0cec1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:15.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.801+0000 7f0cf15b0640 1 -- 172.21.15.7:0/1677576436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cec106a60 msgr2=0x7f0cec19cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:15.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.801+0000 7f0cf15b0640 1 --2- 172.21.15.7:0/1677576436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cec106a60 0x7f0cec19cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:15.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.801+0000 7f0cf15b0640 1 -- 172.21.15.7:0/1677576436 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cec19d450 con 0x7f0cec101400 2024-09-19T08:52:15.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.802+0000 7f0cf15b0640 1 --2- 172.21.15.7:0/1677576436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cec101400 0x7f0cec1989e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00d950 tx=0x7f0cdc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:15.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.802+0000 7f0ce2ffd640 1 -- 172.21.15.7:0/1677576436 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc017070 con 0x7f0cec101400 2024-09-19T08:52:15.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.802+0000 7f0ce2ffd640 1 -- 172.21.15.7:0/1677576436 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cdc009c30 con 0x7f0cec101400 2024-09-19T08:52:15.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.802+0000 7f0cf4015640 1 -- 172.21.15.7:0/1677576436 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cec19d740 con 0x7f0cec101400 2024-09-19T08:52:15.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.802+0000 7f0ce2ffd640 1 -- 172.21.15.7:0/1677576436 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00f6b0 con 0x7f0cec101400 2024-09-19T08:52:15.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.802+0000 7f0cf4015640 1 -- 172.21.15.7:0/1677576436 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cec1a5020 con 0x7f0cec101400 2024-09-19T08:52:15.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.803+0000 7f0cf4015640 1 -- 172.21.15.7:0/1677576436 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cec100ec0 con 0x7f0cec101400 2024-09-19T08:52:15.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.804+0000 7f0ce2ffd640 1 -- 172.21.15.7:0/1677576436 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f0cdc0109d0 con 0x7f0cec101400 2024-09-19T08:52:15.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.805+0000 7f0ce2ffd640 1 --2- 172.21.15.7:0/1677576436 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0cd80a33b0 0x7f0cd80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:15.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.805+0000 7f0cf1db1640 1 --2- 172.21.15.7:0/1677576436 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0cd80a33b0 0x7f0cd80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:15.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.805+0000 7f0ce2ffd640 1 -- 172.21.15.7:0/1677576436 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8629+0+0 (secure 0 0 0) 0x7f0cdc0cf990 con 0x7f0cec101400 2024-09-19T08:52:15.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.805+0000 7f0cf1db1640 1 --2- 172.21.15.7:0/1677576436 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0cd80a33b0 0x7f0cd80a5870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009900 tx=0x7f0ce80058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:15.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:15.809+0000 7f0ce2ffd640 1 -- 172.21.15.7:0/1677576436 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0cdc009de0 con 0x7f0cec101400 2024-09-19T08:52:16.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:16.020+0000 7f0cf4015640 1 -- 172.21.15.7:0/1677576436 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0cec1a52e0 con 0x7f0cec101400 2024-09-19T08:52:16.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:16.021+0000 7f0ce2ffd640 1 -- 172.21.15.7:0/1677576436 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f0cdc09bc50 con 0x7f0cec101400 2024-09-19T08:52:16.021 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:52:16.021 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:52:16.021 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:52:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:16.023+0000 7f0cf4015640 1 -- 172.21.15.7:0/1677576436 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0cd80a33b0 msgr2=0x7f0cd80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:16.023+0000 7f0cf4015640 1 --2- 172.21.15.7:0/1677576436 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0cd80a33b0 0x7f0cd80a5870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009900 tx=0x7f0ce80058d0 comp rx=0 tx=0).stop 2024-09-19T08:52:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:16.023+0000 7f0cf4015640 1 -- 172.21.15.7:0/1677576436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cec101400 msgr2=0x7f0cec1989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:16.023+0000 7f0cf4015640 1 --2- 172.21.15.7:0/1677576436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cec101400 0x7f0cec1989e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00d950 tx=0x7f0cdc00de10 comp rx=0 tx=0).stop 2024-09-19T08:52:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:16.023+0000 7f0cf4015640 1 -- 172.21.15.7:0/1677576436 shutdown_connections 2024-09-19T08:52:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:16.023+0000 7f0cf4015640 1 --2- 172.21.15.7:0/1677576436 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f0cd80a33b0 0x7f0cd80a5870 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:16.023+0000 7f0cf4015640 1 --2- 172.21.15.7:0/1677576436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cec106a60 0x7f0cec19cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:16.023+0000 7f0cf4015640 1 --2- 172.21.15.7:0/1677576436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cec101400 0x7f0cec1989e0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:16.023+0000 7f0cf4015640 1 --2- 172.21.15.7:0/1677576436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cec100a60 0x7f0cec1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:16.023+0000 7f0cf4015640 1 -- 172.21.15.7:0/1677576436 >> 172.21.15.7:0/1677576436 conn(0x7f0cec0fc780 msgr2=0x7f0cec06a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:16.023+0000 7f0cf4015640 1 -- 172.21.15.7:0/1677576436 shutdown_connections 2024-09-19T08:52:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:16.023+0000 7f0cf4015640 1 -- 172.21.15.7:0/1677576436 wait complete. 2024-09-19T08:52:16.649 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:16 smithi007 ceph-mon[31221]: pgmap v238: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:52:16.649 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:16 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1677576436' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:16.682 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:52:16.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:16 smithi044 ceph-mon[35072]: pgmap v238: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:52:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:16 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1677576436' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:16.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:16 smithi175 ceph-mon[35688]: pgmap v238: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:52:16.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:16 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1677576436' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:16.942 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:17.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.420+0000 7f5e377b3640 1 -- 172.21.15.7:0/2116637357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e30101de0 msgr2=0x7f5e301021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:17.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.420+0000 7f5e377b3640 1 --2- 172.21.15.7:0/2116637357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e30101de0 0x7f5e301021c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009900 tx=0x7f5e2c02a3f0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.420+0000 7f5e377b3640 1 -- 172.21.15.7:0/2116637357 shutdown_connections 2024-09-19T08:52:17.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.420+0000 7f5e377b3640 1 --2- 172.21.15.7:0/2116637357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e30106f10 0x7f5e3010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.420+0000 7f5e377b3640 1 --2- 172.21.15.7:0/2116637357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e30102790 0x7f5e301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.420+0000 7f5e377b3640 1 --2- 172.21.15.7:0/2116637357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e30101de0 0x7f5e301021c0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.420+0000 7f5e377b3640 1 -- 172.21.15.7:0/2116637357 >> 172.21.15.7:0/2116637357 conn(0x7f5e300fd8c0 msgr2=0x7f5e300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:17.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.420+0000 7f5e377b3640 1 -- 172.21.15.7:0/2116637357 shutdown_connections 2024-09-19T08:52:17.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.420+0000 7f5e377b3640 1 -- 172.21.15.7:0/2116637357 wait complete. 2024-09-19T08:52:17.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.421+0000 7f5e377b3640 1 Processor -- start 2024-09-19T08:52:17.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.421+0000 7f5e377b3640 1 -- start start 2024-09-19T08:52:17.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.421+0000 7f5e377b3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e30101de0 0x7f5e30198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:17.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.421+0000 7f5e377b3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e30102790 0x7f5e30198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:17.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.421+0000 7f5e377b3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e30106f10 0x7f5e3019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:17.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.421+0000 7f5e377b3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5e30111f30 con 0x7f5e30106f10 2024-09-19T08:52:17.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.421+0000 7f5e377b3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5e30111db0 con 0x7f5e30101de0 2024-09-19T08:52:17.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.421+0000 7f5e377b3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5e301120b0 con 0x7f5e30102790 2024-09-19T08:52:17.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.421+0000 7f5e35d50640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e30106f10 0x7f5e3019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:17.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.421+0000 7f5e35d50640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e30106f10 0x7f5e3019cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34564/0 (socket says 172.21.15.7:34564) 2024-09-19T08:52:17.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.421+0000 7f5e35d50640 1 -- 172.21.15.7:0/1229212419 learned_addr learned my addr 172.21.15.7:0/1229212419 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:17.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.421+0000 7f5e3554f640 1 --2- 172.21.15.7:0/1229212419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e30101de0 0x7f5e30198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:17.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.421+0000 7f5e34d4e640 1 --2- 172.21.15.7:0/1229212419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e30102790 0x7f5e30198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:17.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.422+0000 7f5e35d50640 1 -- 172.21.15.7:0/1229212419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e30102790 msgr2=0x7f5e30198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:17.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.422+0000 7f5e35d50640 1 --2- 172.21.15.7:0/1229212419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e30102790 0x7f5e30198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.422+0000 7f5e35d50640 1 -- 172.21.15.7:0/1229212419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e30101de0 msgr2=0x7f5e30198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:17.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.422+0000 7f5e35d50640 1 --2- 172.21.15.7:0/1229212419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e30101de0 0x7f5e30198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.422+0000 7f5e35d50640 1 -- 172.21.15.7:0/1229212419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3019d2c0 con 0x7f5e30106f10 2024-09-19T08:52:17.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.422+0000 7f5e35d50640 1 --2- 172.21.15.7:0/1229212419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e30106f10 0x7f5e3019cbe0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800cce0 tx=0x7f5e2800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:17.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.422+0000 7f5e267fc640 1 -- 172.21.15.7:0/1229212419 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2800f450 con 0x7f5e30106f10 2024-09-19T08:52:17.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.422+0000 7f5e267fc640 1 -- 172.21.15.7:0/1229212419 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e2800fad0 con 0x7f5e30106f10 2024-09-19T08:52:17.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.422+0000 7f5e377b3640 1 -- 172.21.15.7:0/1229212419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e3019d5b0 con 0x7f5e30106f10 2024-09-19T08:52:17.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.422+0000 7f5e267fc640 1 -- 172.21.15.7:0/1229212419 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e28018c10 con 0x7f5e30106f10 2024-09-19T08:52:17.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.422+0000 7f5e377b3640 1 -- 172.21.15.7:0/1229212419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e301a4e90 con 0x7f5e30106f10 2024-09-19T08:52:17.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.424+0000 7f5e267fc640 1 -- 172.21.15.7:0/1229212419 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f5e2800f5f0 con 0x7f5e30106f10 2024-09-19T08:52:17.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.425+0000 7f5e39b8c740 1 Processor -- start 2024-09-19T08:52:17.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.425+0000 7f5e39b8c740 1 -- start start 2024-09-19T08:52:17.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.425+0000 7f5e39b8c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cbc0711b40 0x55cbc0710090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:17.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.425+0000 7f5e39b8c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc07105d0 0x55cbc0710a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:17.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.425+0000 7f5e39b8c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbc071b370 0x55cbc071d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:17.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.425+0000 7f5e39b8c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cbc06762f0 con 0x55cbc07105d0 2024-09-19T08:52:17.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.425+0000 7f5e39b8c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cbc061dcf0 con 0x55cbc0711b40 2024-09-19T08:52:17.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.425+0000 7f5e39b8c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cbc06722b0 con 0x55cbc071b370 2024-09-19T08:52:17.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.425+0000 7f5e3554f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc07105d0 0x55cbc0710a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:17.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.425+0000 7f5e3554f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc07105d0 0x55cbc0710a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34572/0 (socket says 172.21.15.7:34572) 2024-09-19T08:52:17.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.425+0000 7f5e3554f640 1 -- 172.21.15.7:0/2434448098 learned_addr learned my addr 172.21.15.7:0/2434448098 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:17.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.425+0000 7f5e34d4e640 1 --2- 172.21.15.7:0/2434448098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cbc0711b40 0x55cbc0710090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:17.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.426+0000 7f5e267fc640 1 --2- 172.21.15.7:0/1229212419 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5e1c0a33b0 0x7f5e1c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:17.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.426+0000 7f5e35d50640 1 --2- 172.21.15.7:0/1229212419 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5e1c0a33b0 0x7f5e1c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:17.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.426+0000 7f5e3554f640 1 -- 172.21.15.7:0/2434448098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbc071b370 msgr2=0x55cbc071d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.426+0000 7f5e34d4e640 1 --2- 172.21.15.7:0/2434448098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbc071b370 0x55cbc071d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.426+0000 7f5e3554f640 1 --2- 172.21.15.7:0/2434448098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbc071b370 0x55cbc071d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.426+0000 7f5e3554f640 1 -- 172.21.15.7:0/2434448098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cbc0711b40 msgr2=0x55cbc0710090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.426+0000 7f5e3554f640 1 --2- 172.21.15.7:0/2434448098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cbc0711b40 0x55cbc0710090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.426+0000 7f5e3554f640 1 -- 172.21.15.7:0/2434448098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbc06023a0 con 0x55cbc07105d0 2024-09-19T08:52:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.426+0000 7f5e34d4e640 1 --2- 172.21.15.7:0/2434448098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbc071b370 0x55cbc071d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.426+0000 7f5e267fc640 1 -- 172.21.15.7:0/1229212419 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8629+0+0 (secure 0 0 0) 0x7f5e280d0470 con 0x7f5e30106f10 2024-09-19T08:52:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.426+0000 7f5e3554f640 1 --2- 172.21.15.7:0/2434448098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc07105d0 0x55cbc0710a10 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009900 tx=0x7f5e2c0316e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ff9e56b5eab0ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.426+0000 7f5e35d50640 1 --2- 172.21.15.7:0/1229212419 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5e1c0a33b0 0x7f5e1c0a5870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5e2809c380 tx=0x7f5e2806e400 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.426+0000 7f5e1b7fe640 1 -- 172.21.15.7:0/2434448098 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c040070 con 0x55cbc07105d0 2024-09-19T08:52:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.426+0000 7f5e1b7fe640 1 -- 172.21.15.7:0/2434448098 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e2c005020 con 0x55cbc07105d0 2024-09-19T08:52:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.426+0000 7f5e1b7fe640 1 -- 172.21.15.7:0/2434448098 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c035040 con 0x55cbc07105d0 2024-09-19T08:52:17.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.427+0000 7f5e39b8c740 1 -- 172.21.15.7:0/2434448098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc07105d0 msgr2=0x55cbc0710a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:17.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.427+0000 7f5e39b8c740 1 --2- 172.21.15.7:0/2434448098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc07105d0 0x55cbc0710a10 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009900 tx=0x7f5e2c0316e0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.427+0000 7f5e39b8c740 1 -- 172.21.15.7:0/2434448098 shutdown_connections 2024-09-19T08:52:17.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.427+0000 7f5e39b8c740 1 --2- 172.21.15.7:0/2434448098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbc071b370 0x55cbc071d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.427+0000 7f5e39b8c740 1 --2- 172.21.15.7:0/2434448098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc07105d0 0x55cbc0710a10 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.427+0000 7f5e39b8c740 1 --2- 172.21.15.7:0/2434448098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cbc0711b40 0x55cbc0710090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.427+0000 7f5e39b8c740 1 -- 172.21.15.7:0/2434448098 >> 172.21.15.7:0/2434448098 conn(0x55cbc06d9310 msgr2=0x55cbc070cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:17.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.427+0000 7f5e39b8c740 1 -- 172.21.15.7:0/2434448098 shutdown_connections 2024-09-19T08:52:17.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.427+0000 7f5e39b8c740 1 -- 172.21.15.7:0/2434448098 wait complete. 2024-09-19T08:52:17.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.428+0000 7f5e39b8c740 1 -- start start 2024-09-19T08:52:17.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.428+0000 7f5e39b8c740 1 Processor -- start 2024-09-19T08:52:17.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.428+0000 7f5e39b8c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbc07105d0 0x55cbc071ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:17.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.428+0000 7f5e39b8c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc0711b40 0x55cbc0717f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:17.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.428+0000 7f5e39b8c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cbc071b370 0x55cbc07184f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:17.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.428+0000 7f5e39b8c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cbc071e010 con 0x55cbc0711b40 2024-09-19T08:52:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.428+0000 7f5e39b8c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cbc0631060 con 0x55cbc071b370 2024-09-19T08:52:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.428+0000 7f5e39b8c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cbc071e190 con 0x55cbc07105d0 2024-09-19T08:52:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.428+0000 7f5e39b8c740 10 client.0 _ll_register_callbacks cb 0x55cbc03848c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.428+0000 7f5e3554f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc0711b40 0x55cbc0717f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.428+0000 7f5e3554f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc0711b40 0x55cbc0717f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34584/0 (socket says 172.21.15.7:34584) 2024-09-19T08:52:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.428+0000 7f5e3554f640 1 -- 172.21.15.7:0/2410112297 learned_addr learned my addr 172.21.15.7:0/2410112297 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.429+0000 7f5e34d4e640 1 --2- 172.21.15.7:0/2410112297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbc07105d0 0x55cbc071ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.429+0000 7f5e34d4e640 1 --2- 172.21.15.7:0/2410112297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cbc071b370 0x55cbc07184f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.429+0000 7f5e3554f640 1 -- 172.21.15.7:0/2410112297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbc07105d0 msgr2=0x55cbc071ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.429+0000 7f5e3554f640 1 --2- 172.21.15.7:0/2410112297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbc07105d0 0x55cbc071ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.429+0000 7f5e3554f640 1 -- 172.21.15.7:0/2410112297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cbc071b370 msgr2=0x55cbc07184f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.429+0000 7f5e3554f640 1 --2- 172.21.15.7:0/2410112297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cbc071b370 0x55cbc07184f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.429+0000 7f5e3554f640 1 -- 172.21.15.7:0/2410112297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbc03e73c0 con 0x55cbc0711b40 2024-09-19T08:52:17.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.429+0000 7f5e34d4e640 1 --2- 172.21.15.7:0/2410112297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cbc071b370 0x55cbc07184f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:17.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.429+0000 7f5e3554f640 1 --2- 172.21.15.7:0/2410112297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc0711b40 0x55cbc0717f90 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c005940 tx=0x7f5e2c0095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c790f7d2dee1ed3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:17.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.429+0000 7f5e18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:17.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.429+0000 7f5e18ff9640 1 -- 172.21.15.7:0/2410112297 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c04c020 con 0x55cbc0711b40 2024-09-19T08:52:17.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.429+0000 7f5e18ff9640 1 -- 172.21.15.7:0/2410112297 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8629+0+0 (secure 0 0 0) 0x7f5e2c004af0 con 0x55cbc0711b40 2024-09-19T08:52:17.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.429+0000 7f5e39b8c740 1 -- 172.21.15.7:0/2410112297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e2c005020 con 0x55cbc0711b40 2024-09-19T08:52:17.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.429+0000 7f5e18ff9640 1 -- 172.21.15.7:0/2410112297 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5e2c057050 con 0x55cbc0711b40 2024-09-19T08:52:17.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.429+0000 7f5e39b8c740 10 client.16938 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:17.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.429+0000 7f5e39b8c740 1 -- 172.21.15.7:0/2410112297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cbc0729990 con 0x55cbc0711b40 2024-09-19T08:52:17.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.429+0000 7f5e18ff9640 1 -- 172.21.15.7:0/2410112297 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e2c005020 con 0x55cbc0711b40 2024-09-19T08:52:17.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.430+0000 7f5e18ff9640 1 -- 172.21.15.7:0/2410112297 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5e2c044400 con 0x55cbc0711b40 2024-09-19T08:52:17.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.430+0000 7f5e39b8c740 10 client.16938 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:17.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.430+0000 7f5e39b8c740 10 client.16938 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:52:17.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.430+0000 7f5e39b8c740 20 client.16938 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:17.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.430+0000 7f5e39b8c740 1 --2- 172.21.15.7:0/2410112297 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55cbc072ace0 0x55cbc072d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:17.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.430+0000 7f5e39b8c740 4 client.16938 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:17.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.430+0000 7f5e39b8c740 1 -- 172.21.15.7:0/2410112297 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbc0683860 con 0x55cbc072ace0 2024-09-19T08:52:17.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.430+0000 7f5e34d4e640 1 --2- 172.21.15.7:0/2410112297 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55cbc072ace0 0x55cbc072d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:17.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.430+0000 7f5e18ff9640 10 client.16938 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:52:17.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.430+0000 7f5e34d4e640 1 --2- 172.21.15.7:0/2410112297 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55cbc072ace0 0x55cbc072d0d0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7cf82d5d1ef5bdf6 server_cookie=64b77e5402b12fd6 in_seq=0 out_seq=0 2024-09-19T08:52:17.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.431+0000 7f5e18ff9640 1 -- 172.21.15.7:0/2410112297 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cbc0683860 con 0x55cbc072ace0 2024-09-19T08:52:17.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.431+0000 7f5e18ff9640 10 client.16938 handle_command_reply: tid=0 2024-09-19T08:52:17.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.431+0000 7f5e39b8c740 1 client.16938 shutdown 2024-09-19T08:52:17.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.432+0000 7f5e39b8c740 1 -- 172.21.15.7:0/2410112297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc0711b40 msgr2=0x55cbc0717f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:17.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.432+0000 7f5e39b8c740 1 --2- 172.21.15.7:0/2410112297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc0711b40 0x55cbc0717f90 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c005940 tx=0x7f5e2c0095f0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.432+0000 7f5e39b8c740 1 -- 172.21.15.7:0/2410112297 shutdown_connections 2024-09-19T08:52:17.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.432+0000 7f5e39b8c740 1 --2- 172.21.15.7:0/2410112297 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55cbc072ace0 0x55cbc072d0d0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.432+0000 7f5e39b8c740 1 --2- 172.21.15.7:0/2410112297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cbc071b370 0x55cbc07184f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.432+0000 7f5e39b8c740 1 --2- 172.21.15.7:0/2410112297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc0711b40 0x55cbc0717f90 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.432+0000 7f5e18ff9640 0 client.16938 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:52:17.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.432+0000 7f5e39b8c740 1 --2- 172.21.15.7:0/2410112297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbc07105d0 0x55cbc071ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.432+0000 7f5e39b8c740 1 -- 172.21.15.7:0/2410112297 >> 172.21.15.7:0/2410112297 conn(0x55cbc06d9310 msgr2=0x55cbc0712930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:17.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.432+0000 7f5e39b8c740 1 -- 172.21.15.7:0/2410112297 shutdown_connections 2024-09-19T08:52:17.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.432+0000 7f5e39b8c740 1 -- 172.21.15.7:0/2410112297 wait complete. 2024-09-19T08:52:17.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.432+0000 7f5e39b8c740 20 client.16938 trim_cache size 0 max 16384 2024-09-19T08:52:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.445+0000 7f5e39b8c740 1 Processor -- start 2024-09-19T08:52:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.445+0000 7f5e39b8c740 1 -- start start 2024-09-19T08:52:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.445+0000 7f5e39b8c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbc07105d0 0x55cbc07272b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.445+0000 7f5e39b8c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc0711b40 0x55cbc070cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.445+0000 7f5e39b8c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cbc071b370 0x55cbc0716e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.445+0000 7f5e39b8c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5e301b0160 con 0x55cbc0711b40 2024-09-19T08:52:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.445+0000 7f5e39b8c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5e301ada30 con 0x55cbc071b370 2024-09-19T08:52:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.445+0000 7f5e39b8c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5e301ab8a0 con 0x55cbc07105d0 2024-09-19T08:52:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.446+0000 7f5e3554f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc0711b40 0x55cbc070cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.446+0000 7f5e34d4e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbc07105d0 0x55cbc07272b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.446+0000 7f5e3554f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc0711b40 0x55cbc070cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34594/0 (socket says 172.21.15.7:34594) 2024-09-19T08:52:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.446+0000 7f5e3554f640 1 -- 172.21.15.7:0/3031515401 learned_addr learned my addr 172.21.15.7:0/3031515401 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.446+0000 7f5e34d4e640 1 --2- 172.21.15.7:0/3031515401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cbc071b370 0x55cbc0716e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.446+0000 7f5e34d4e640 1 -- 172.21.15.7:0/3031515401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cbc071b370 msgr2=0x55cbc0716e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.446+0000 7f5e34d4e640 1 --2- 172.21.15.7:0/3031515401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cbc071b370 0x55cbc0716e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.446+0000 7f5e34d4e640 1 -- 172.21.15.7:0/3031515401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc0711b40 msgr2=0x55cbc070cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.446+0000 7f5e34d4e640 1 --2- 172.21.15.7:0/3031515401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc0711b40 0x55cbc070cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.446+0000 7f5e34d4e640 1 -- 172.21.15.7:0/3031515401 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbc070b310 con 0x55cbc07105d0 2024-09-19T08:52:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.446+0000 7f5e3554f640 1 --2- 172.21.15.7:0/3031515401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc0711b40 0x55cbc070cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.446+0000 7f5e34d4e640 1 --2- 172.21.15.7:0/3031515401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbc07105d0 0x55cbc07272b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55cbc072d640 tx=0x7f5e2000c5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac4cabe28a2154e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:17.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.448+0000 7f5e1affd640 1 -- 172.21.15.7:0/3031515401 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e20012c50 con 0x55cbc07105d0 2024-09-19T08:52:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.448+0000 7f5e1affd640 1 -- 172.21.15.7:0/3031515401 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e20012df0 con 0x55cbc07105d0 2024-09-19T08:52:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.448+0000 7f5e1affd640 1 -- 172.21.15.7:0/3031515401 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e20010820 con 0x55cbc07105d0 2024-09-19T08:52:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.449+0000 7f5e39b8c740 1 -- 172.21.15.7:0/3031515401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbc07105d0 msgr2=0x55cbc07272b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.449+0000 7f5e39b8c740 1 --2- 172.21.15.7:0/3031515401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbc07105d0 0x55cbc07272b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55cbc072d640 tx=0x7f5e2000c5a0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.449+0000 7f5e39b8c740 1 -- 172.21.15.7:0/3031515401 shutdown_connections 2024-09-19T08:52:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.449+0000 7f5e39b8c740 1 --2- 172.21.15.7:0/3031515401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cbc071b370 0x55cbc0716e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.449+0000 7f5e39b8c740 1 --2- 172.21.15.7:0/3031515401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc0711b40 0x55cbc070cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.449+0000 7f5e39b8c740 1 --2- 172.21.15.7:0/3031515401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbc07105d0 0x55cbc07272b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.449+0000 7f5e39b8c740 1 -- 172.21.15.7:0/3031515401 >> 172.21.15.7:0/3031515401 conn(0x55cbc06d9310 msgr2=0x55cbc0716730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.449+0000 7f5e39b8c740 1 -- 172.21.15.7:0/3031515401 shutdown_connections 2024-09-19T08:52:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.449+0000 7f5e39b8c740 1 -- 172.21.15.7:0/3031515401 wait complete. 2024-09-19T08:52:17.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.449+0000 7f5e39b8c740 1 -- start start 2024-09-19T08:52:17.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.449+0000 7f5e39b8c740 1 Processor -- start 2024-09-19T08:52:17.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.450+0000 7f5e39b8c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc07105d0 0x55cbc0723600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:17.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.450+0000 7f5e39b8c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbc0711b40 0x55cbc0723b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:17.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.450+0000 7f5e39b8c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cbc071b370 0x55cbc07147a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:17.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.450+0000 7f5e39b8c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5e301abef0 con 0x55cbc07105d0 2024-09-19T08:52:17.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.450+0000 7f5e39b8c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5e301ad360 con 0x55cbc071b370 2024-09-19T08:52:17.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.450+0000 7f5e39b8c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5e301ac5c0 con 0x55cbc0711b40 2024-09-19T08:52:17.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.450+0000 7f5e39b8c740 10 client.0 _ll_register_callbacks cb 0x7f5e2000c400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:17.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.450+0000 7f5e34d4e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc07105d0 0x55cbc0723600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:17.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.450+0000 7f5e34d4e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc07105d0 0x55cbc0723600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34598/0 (socket says 172.21.15.7:34598) 2024-09-19T08:52:17.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.450+0000 7f5e34d4e640 1 -- 172.21.15.7:0/4247143956 learned_addr learned my addr 172.21.15.7:0/4247143956 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:17.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.450+0000 7f5e3554f640 1 --2- 172.21.15.7:0/4247143956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbc0711b40 0x55cbc0723b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:17.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.450+0000 7f5e34d4e640 1 --2- 172.21.15.7:0/4247143956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cbc071b370 0x55cbc07147a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:17.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.450+0000 7f5e34d4e640 1 -- 172.21.15.7:0/4247143956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbc0711b40 msgr2=0x55cbc0723b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:17.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.450+0000 7f5e34d4e640 1 --2- 172.21.15.7:0/4247143956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbc0711b40 0x55cbc0723b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.450+0000 7f5e34d4e640 1 -- 172.21.15.7:0/4247143956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cbc071b370 msgr2=0x55cbc07147a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:17.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.450+0000 7f5e34d4e640 1 --2- 172.21.15.7:0/4247143956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cbc071b370 0x55cbc07147a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.450+0000 7f5e34d4e640 1 -- 172.21.15.7:0/4247143956 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbc0714fd0 con 0x55cbc07105d0 2024-09-19T08:52:17.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.450+0000 7f5e34d4e640 1 --2- 172.21.15.7:0/4247143956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc07105d0 0x55cbc0723600 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000c540 tx=0x7f5e2000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96994c63fa69e8a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:17.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.450+0000 7f5e18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:17.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.451+0000 7f5e18ff9640 1 -- 172.21.15.7:0/4247143956 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2001d8f0 con 0x55cbc07105d0 2024-09-19T08:52:17.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.451+0000 7f5e18ff9640 1 -- 172.21.15.7:0/4247143956 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8629+0+0 (secure 0 0 0) 0x7f5e2001da90 con 0x55cbc07105d0 2024-09-19T08:52:17.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.451+0000 7f5e39b8c740 1 -- 172.21.15.7:0/4247143956 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e20012df0 con 0x55cbc07105d0 2024-09-19T08:52:17.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.451+0000 7f5e18ff9640 1 -- 172.21.15.7:0/4247143956 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5e2001dc90 con 0x55cbc07105d0 2024-09-19T08:52:17.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.451+0000 7f5e39b8c740 10 client.16944 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:17.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.451+0000 7f5e39b8c740 1 -- 172.21.15.7:0/4247143956 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cbc0795130 con 0x55cbc07105d0 2024-09-19T08:52:17.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.451+0000 7f5e18ff9640 1 -- 172.21.15.7:0/4247143956 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e20012df0 con 0x55cbc07105d0 2024-09-19T08:52:17.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.451+0000 7f5e18ff9640 1 -- 172.21.15.7:0/4247143956 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5e20035030 con 0x55cbc07105d0 2024-09-19T08:52:17.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.451+0000 7f5e39b8c740 10 client.16944 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:17.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.451+0000 7f5e39b8c740 10 client.16944 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:52:17.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.451+0000 7f5e39b8c740 20 client.16944 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:17.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.451+0000 7f5e39b8c740 1 --2- 172.21.15.7:0/4247143956 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55cbc0795690 0x55cbc0797a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:17.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.451+0000 7f5e39b8c740 4 client.16944 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:52:17.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.451+0000 7f5e39b8c740 1 -- 172.21.15.7:0/4247143956 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cbc067dd70 con 0x55cbc0795690 2024-09-19T08:52:17.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.452+0000 7f5e3554f640 1 --2- 172.21.15.7:0/4247143956 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55cbc0795690 0x55cbc0797a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:17.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.452+0000 7f5e3554f640 1 --2- 172.21.15.7:0/4247143956 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55cbc0795690 0x55cbc0797a80 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a5455bc344040615 server_cookie=c6540d72573094e0 in_seq=0 out_seq=0 2024-09-19T08:52:17.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.452+0000 7f5e18ff9640 10 client.16944 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:52:17.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.452+0000 7f5e18ff9640 1 -- 172.21.15.7:0/4247143956 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cbc067dd70 con 0x55cbc0795690 2024-09-19T08:52:17.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.452+0000 7f5e18ff9640 10 client.16944 handle_command_reply: tid=0 2024-09-19T08:52:17.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.452+0000 7f5e39b8c740 1 client.16944 shutdown 2024-09-19T08:52:17.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.452+0000 7f5e39b8c740 1 -- 172.21.15.7:0/4247143956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc07105d0 msgr2=0x55cbc0723600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:17.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.452+0000 7f5e39b8c740 1 --2- 172.21.15.7:0/4247143956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc07105d0 0x55cbc0723600 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000c540 tx=0x7f5e2000cc20 comp rx=0 tx=0).stop 2024-09-19T08:52:17.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.452+0000 7f5e39b8c740 1 -- 172.21.15.7:0/4247143956 shutdown_connections 2024-09-19T08:52:17.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.452+0000 7f5e39b8c740 1 --2- 172.21.15.7:0/4247143956 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55cbc0795690 0x55cbc0797a80 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.452+0000 7f5e39b8c740 1 --2- 172.21.15.7:0/4247143956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cbc071b370 0x55cbc07147a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.452+0000 7f5e18ff9640 0 client.16944 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:52:17.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.452+0000 7f5e39b8c740 1 --2- 172.21.15.7:0/4247143956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cbc0711b40 0x55cbc0723b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.452+0000 7f5e39b8c740 1 --2- 172.21.15.7:0/4247143956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cbc07105d0 0x55cbc0723600 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.452+0000 7f5e39b8c740 1 -- 172.21.15.7:0/4247143956 >> 172.21.15.7:0/4247143956 conn(0x55cbc06d9310 msgr2=0x55cbc0712930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:17.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.453+0000 7f5e39b8c740 1 -- 172.21.15.7:0/4247143956 shutdown_connections 2024-09-19T08:52:17.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.453+0000 7f5e39b8c740 1 -- 172.21.15.7:0/4247143956 wait complete. 2024-09-19T08:52:17.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.453+0000 7f5e39b8c740 20 client.16944 trim_cache size 0 max 16384 2024-09-19T08:52:17.460 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:52:17.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.453+0000 7f5e377b3640 1 -- 172.21.15.7:0/1229212419 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5e1c0a33b0 msgr2=0x7f5e1c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.453+0000 7f5e377b3640 1 --2- 172.21.15.7:0/1229212419 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5e1c0a33b0 0x7f5e1c0a5870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5e2809c380 tx=0x7f5e2806e400 comp rx=0 tx=0).stop 2024-09-19T08:52:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.453+0000 7f5e377b3640 1 -- 172.21.15.7:0/1229212419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e30106f10 msgr2=0x7f5e3019cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.453+0000 7f5e377b3640 1 --2- 172.21.15.7:0/1229212419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e30106f10 0x7f5e3019cbe0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800cce0 tx=0x7f5e2800a620 comp rx=0 tx=0).stop 2024-09-19T08:52:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.453+0000 7f5e377b3640 1 -- 172.21.15.7:0/1229212419 shutdown_connections 2024-09-19T08:52:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.453+0000 7f5e377b3640 1 --2- 172.21.15.7:0/1229212419 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5e1c0a33b0 0x7f5e1c0a5870 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.453+0000 7f5e377b3640 1 --2- 172.21.15.7:0/1229212419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e30106f10 0x7f5e3019cbe0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.453+0000 7f5e377b3640 1 --2- 172.21.15.7:0/1229212419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e30102790 0x7f5e30198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.453+0000 7f5e377b3640 1 --2- 172.21.15.7:0/1229212419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e30101de0 0x7f5e30198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.453+0000 7f5e377b3640 1 -- 172.21.15.7:0/1229212419 >> 172.21.15.7:0/1229212419 conn(0x7f5e300fd8c0 msgr2=0x7f5e300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.453+0000 7f5e377b3640 1 -- 172.21.15.7:0/1229212419 shutdown_connections 2024-09-19T08:52:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:17.453+0000 7f5e377b3640 1 -- 172.21.15.7:0/1229212419 wait complete. 2024-09-19T08:52:18.145 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:52:18.404 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:18.697 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:18 smithi007 ceph-mon[31221]: pgmap v239: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:52:18.697 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:18 smithi007 ceph-mon[31221]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T08:52:18.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:18 smithi044 ceph-mon[35072]: pgmap v239: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:52:18.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:18 smithi044 ceph-mon[35072]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T08:52:18.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.887+0000 7f1b4d33f640 1 -- 172.21.15.7:0/2358875508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b481036e0 msgr2=0x7f1b48107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:18.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.887+0000 7f1b4d33f640 1 --2- 172.21.15.7:0/2358875508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b481036e0 0x7f1b48107b90 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c009930 tx=0x7f1b3c02a420 comp rx=0 tx=0).stop 2024-09-19T08:52:18.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.887+0000 7f1b4d33f640 1 -- 172.21.15.7:0/2358875508 shutdown_connections 2024-09-19T08:52:18.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.887+0000 7f1b4d33f640 1 --2- 172.21.15.7:0/2358875508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b481082a0 0x7f1b4810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.887+0000 7f1b4d33f640 1 --2- 172.21.15.7:0/2358875508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b481036e0 0x7f1b48107b90 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.887+0000 7f1b4d33f640 1 --2- 172.21.15.7:0/2358875508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b48102d30 0x7f1b48103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.887+0000 7f1b4d33f640 1 -- 172.21.15.7:0/2358875508 >> 172.21.15.7:0/2358875508 conn(0x7f1b480fc7d0 msgr2=0x7f1b480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:18.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.887+0000 7f1b4d33f640 1 -- 172.21.15.7:0/2358875508 shutdown_connections 2024-09-19T08:52:18.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.887+0000 7f1b4d33f640 1 -- 172.21.15.7:0/2358875508 wait complete. 2024-09-19T08:52:18.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.888+0000 7f1b4d33f640 1 Processor -- start 2024-09-19T08:52:18.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.888+0000 7f1b4d33f640 1 -- start start 2024-09-19T08:52:18.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.888+0000 7f1b4d33f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b48102d30 0x7f1b481985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:18.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.888+0000 7f1b4d33f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b481036e0 0x7f1b48198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.888+0000 7f1b4d33f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b481082a0 0x7f1b4819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.888+0000 7f1b4d33f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1b481120a0 con 0x7f1b48102d30 2024-09-19T08:52:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.888+0000 7f1b4d33f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1b48111f20 con 0x7f1b481036e0 2024-09-19T08:52:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.888+0000 7f1b4d33f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1b48112220 con 0x7f1b481082a0 2024-09-19T08:52:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.888+0000 7f1b46ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b48102d30 0x7f1b481985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.888+0000 7f1b46ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b48102d30 0x7f1b481985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34626/0 (socket says 172.21.15.7:34626) 2024-09-19T08:52:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.888+0000 7f1b46ffd640 1 -- 172.21.15.7:0/1288026014 learned_addr learned my addr 172.21.15.7:0/1288026014 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.888+0000 7f1b467fc640 1 --2- 172.21.15.7:0/1288026014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b481036e0 0x7f1b48198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.889+0000 7f1b477fe640 1 --2- 172.21.15.7:0/1288026014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b481082a0 0x7f1b4819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.889+0000 7f1b46ffd640 1 -- 172.21.15.7:0/1288026014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b481082a0 msgr2=0x7f1b4819ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.889+0000 7f1b46ffd640 1 --2- 172.21.15.7:0/1288026014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b481082a0 0x7f1b4819ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.889+0000 7f1b46ffd640 1 -- 172.21.15.7:0/1288026014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b481036e0 msgr2=0x7f1b48198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.889+0000 7f1b46ffd640 1 --2- 172.21.15.7:0/1288026014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b481036e0 0x7f1b48198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.889+0000 7f1b46ffd640 1 -- 172.21.15.7:0/1288026014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4819d590 con 0x7f1b48102d30 2024-09-19T08:52:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.889+0000 7f1b467fc640 1 --2- 172.21.15.7:0/1288026014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b481036e0 0x7f1b48198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.889+0000 7f1b46ffd640 1 --2- 172.21.15.7:0/1288026014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b48102d30 0x7f1b481985e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800d770 tx=0x7f1b3800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.889+0000 7f1b2ffff640 1 -- 172.21.15.7:0/1288026014 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b38017070 con 0x7f1b48102d30 2024-09-19T08:52:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.889+0000 7f1b2ffff640 1 -- 172.21.15.7:0/1288026014 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b38005500 con 0x7f1b48102d30 2024-09-19T08:52:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.889+0000 7f1b4d33f640 1 -- 172.21.15.7:0/1288026014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b4819d880 con 0x7f1b48102d30 2024-09-19T08:52:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.889+0000 7f1b2ffff640 1 -- 172.21.15.7:0/1288026014 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b38004e00 con 0x7f1b48102d30 2024-09-19T08:52:18.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.889+0000 7f1b4d33f640 1 -- 172.21.15.7:0/1288026014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b481a5160 con 0x7f1b48102d30 2024-09-19T08:52:18.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.891+0000 7f1b2ffff640 1 -- 172.21.15.7:0/1288026014 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f1b38004fa0 con 0x7f1b48102d30 2024-09-19T08:52:18.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.892+0000 7f1b4f718740 1 Processor -- start 2024-09-19T08:52:18.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.892+0000 7f1b4f718740 1 -- start start 2024-09-19T08:52:18.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.892+0000 7f1b4f718740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd6f5b40 0x5634bd6f4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:18.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.892+0000 7f1b4f718740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634bd6f45d0 0x5634bd6f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:18.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.892+0000 7f1b4f718740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd703780 0x5634bd705b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:18.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.892+0000 7f1b4f718740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5634bd65a2f0 con 0x5634bd6f5b40 2024-09-19T08:52:18.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.892+0000 7f1b4f718740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5634bd601cf0 con 0x5634bd703780 2024-09-19T08:52:18.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.892+0000 7f1b4f718740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5634bd6562b0 con 0x5634bd6f45d0 2024-09-19T08:52:18.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.892+0000 7f1b477fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd6f5b40 0x5634bd6f4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:18.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.892+0000 7f1b477fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd6f5b40 0x5634bd6f4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34636/0 (socket says 172.21.15.7:34636) 2024-09-19T08:52:18.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.892+0000 7f1b477fe640 1 -- 172.21.15.7:0/4125534363 learned_addr learned my addr 172.21.15.7:0/4125534363 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:18.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.892+0000 7f1b46ffd640 1 --2- 172.21.15.7:0/4125534363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634bd6f45d0 0x5634bd6f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:18.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.892+0000 7f1b467fc640 1 --2- 172.21.15.7:0/4125534363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd703780 0x5634bd705b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:18.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.892+0000 7f1b2ffff640 1 --2- 172.21.15.7:0/1288026014 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1b300a33b0 0x7f1b300a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:18.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.892+0000 7f1b477fe640 1 -- 172.21.15.7:0/4125534363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634bd6f45d0 msgr2=0x5634bd6f4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:18.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.892+0000 7f1b477fe640 1 --2- 172.21.15.7:0/4125534363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634bd6f45d0 0x5634bd6f4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.892+0000 7f1b477fe640 1 -- 172.21.15.7:0/4125534363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd703780 msgr2=0x5634bd705b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:18.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.892+0000 7f1b477fe640 1 --2- 172.21.15.7:0/4125534363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd703780 0x5634bd705b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.892+0000 7f1b477fe640 1 -- 172.21.15.7:0/4125534363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634bd5e63a0 con 0x5634bd6f5b40 2024-09-19T08:52:18.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.892+0000 7f1b467fc640 1 --2- 172.21.15.7:0/4125534363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd703780 0x5634bd705b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:18.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.893+0000 7f1b477fe640 1 --2- 172.21.15.7:0/1288026014 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1b300a33b0 0x7f1b300a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:18.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.893+0000 7f1b2ffff640 1 -- 172.21.15.7:0/1288026014 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7f1b380cf840 con 0x7f1b48102d30 2024-09-19T08:52:18.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.893+0000 7f1b477fe640 1 --2- 172.21.15.7:0/4125534363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd6f5b40 0x5634bd6f4090 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009fd0 tx=0x7f1b4000f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b8c4cd3c21de31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:18.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.893+0000 7f1b2d7fa640 1 -- 172.21.15.7:0/4125534363 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4001c910 con 0x5634bd6f5b40 2024-09-19T08:52:18.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.893+0000 7f1b2d7fa640 1 -- 172.21.15.7:0/4125534363 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b4001b440 con 0x5634bd6f5b40 2024-09-19T08:52:18.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.893+0000 7f1b2d7fa640 1 -- 172.21.15.7:0/4125534363 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4001a5f0 con 0x5634bd6f5b40 2024-09-19T08:52:18.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.894+0000 7f1b4f718740 1 -- 172.21.15.7:0/4125534363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd6f5b40 msgr2=0x5634bd6f4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:18.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.894+0000 7f1b4f718740 1 --2- 172.21.15.7:0/4125534363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd6f5b40 0x5634bd6f4090 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009fd0 tx=0x7f1b4000f870 comp rx=0 tx=0).stop 2024-09-19T08:52:18.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.894+0000 7f1b477fe640 1 --2- 172.21.15.7:0/1288026014 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1b300a33b0 0x7f1b300a5870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1b40020000 tx=0x7f1b4001d000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.894+0000 7f1b4f718740 1 -- 172.21.15.7:0/4125534363 shutdown_connections 2024-09-19T08:52:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.894+0000 7f1b4f718740 1 --2- 172.21.15.7:0/4125534363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd703780 0x5634bd705b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.894+0000 7f1b4f718740 1 --2- 172.21.15.7:0/4125534363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634bd6f45d0 0x5634bd6f4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.894+0000 7f1b4f718740 1 --2- 172.21.15.7:0/4125534363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd6f5b40 0x5634bd6f4090 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.894+0000 7f1b4f718740 1 -- 172.21.15.7:0/4125534363 >> 172.21.15.7:0/4125534363 conn(0x5634bd6bd310 msgr2=0x5634bd6f0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.894+0000 7f1b4f718740 1 -- 172.21.15.7:0/4125534363 shutdown_connections 2024-09-19T08:52:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.894+0000 7f1b4f718740 1 -- 172.21.15.7:0/4125534363 wait complete. 2024-09-19T08:52:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.894+0000 7f1b4f718740 1 -- start start 2024-09-19T08:52:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.894+0000 7f1b4f718740 1 Processor -- start 2024-09-19T08:52:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.895+0000 7f1b4f718740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd6f45d0 0x5634bd703160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.895+0000 7f1b4f718740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634bd6f5b40 0x5634bd700410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.895+0000 7f1b4f718740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd703780 0x5634bd7009e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.895+0000 7f1b4f718740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5634bd706480 con 0x5634bd703780 2024-09-19T08:52:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.895+0000 7f1b4f718740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5634bd615060 con 0x5634bd6f45d0 2024-09-19T08:52:18.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.895+0000 7f1b4f718740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5634bd706600 con 0x5634bd6f5b40 2024-09-19T08:52:18.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.895+0000 7f1b4f718740 10 client.0 _ll_register_callbacks cb 0x5634bd3688c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:18.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.895+0000 7f1b477fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd703780 0x5634bd7009e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:18.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.895+0000 7f1b477fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd703780 0x5634bd7009e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34644/0 (socket says 172.21.15.7:34644) 2024-09-19T08:52:18.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.895+0000 7f1b477fe640 1 -- 172.21.15.7:0/3843524198 learned_addr learned my addr 172.21.15.7:0/3843524198 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:18.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.895+0000 7f1b46ffd640 1 --2- 172.21.15.7:0/3843524198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd6f45d0 0x5634bd703160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:18.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.895+0000 7f1b467fc640 1 --2- 172.21.15.7:0/3843524198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634bd6f5b40 0x5634bd700410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:18.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.895+0000 7f1b477fe640 1 -- 172.21.15.7:0/3843524198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634bd6f5b40 msgr2=0x5634bd700410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:18.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.895+0000 7f1b477fe640 1 --2- 172.21.15.7:0/3843524198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634bd6f5b40 0x5634bd700410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.895+0000 7f1b477fe640 1 -- 172.21.15.7:0/3843524198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd6f45d0 msgr2=0x5634bd703160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:18.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.895+0000 7f1b477fe640 1 --2- 172.21.15.7:0/3843524198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd6f45d0 0x5634bd703160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.895+0000 7f1b477fe640 1 -- 172.21.15.7:0/3843524198 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634bd3cb3c0 con 0x5634bd703780 2024-09-19T08:52:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.895+0000 7f1b46ffd640 1 --2- 172.21.15.7:0/3843524198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd6f45d0 0x5634bd703160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.895+0000 7f1b477fe640 1 --2- 172.21.15.7:0/3843524198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd703780 0x5634bd7009e0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f1b4001b880 tx=0x7f1b4001b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97953d5faf8e44c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.895+0000 7f1b2aff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.896+0000 7f1b2aff5640 1 -- 172.21.15.7:0/3843524198 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b40035060 con 0x5634bd703780 2024-09-19T08:52:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.896+0000 7f1b4f718740 1 -- 172.21.15.7:0/3843524198 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b4001b440 con 0x5634bd703780 2024-09-19T08:52:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.896+0000 7f1b2aff5640 1 -- 172.21.15.7:0/3843524198 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7f1b4001bad0 con 0x5634bd703780 2024-09-19T08:52:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.896+0000 7f1b2aff5640 1 -- 172.21.15.7:0/3843524198 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1b4002c040 con 0x5634bd703780 2024-09-19T08:52:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.896+0000 7f1b4f718740 10 client.16956 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.896+0000 7f1b4f718740 1 -- 172.21.15.7:0/3843524198 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5634bd711f00 con 0x5634bd703780 2024-09-19T08:52:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.896+0000 7f1b2aff5640 1 -- 172.21.15.7:0/3843524198 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b4001b440 con 0x5634bd703780 2024-09-19T08:52:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.896+0000 7f1b2aff5640 1 -- 172.21.15.7:0/3843524198 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1b40026480 con 0x5634bd703780 2024-09-19T08:52:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.896+0000 7f1b4f718740 10 client.16956 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.896+0000 7f1b4f718740 10 client.16956 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:52:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.896+0000 7f1b4f718740 20 client.16956 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.896+0000 7f1b4f718740 1 --2- 172.21.15.7:0/3843524198 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5634bd713310 0x5634bd715700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.896+0000 7f1b4f718740 4 client.16956 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.896+0000 7f1b4f718740 1 -- 172.21.15.7:0/3843524198 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634bd667860 con 0x5634bd713310 2024-09-19T08:52:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.897+0000 7f1b46ffd640 1 --2- 172.21.15.7:0/3843524198 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5634bd713310 0x5634bd715700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.897+0000 7f1b46ffd640 1 --2- 172.21.15.7:0/3843524198 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5634bd713310 0x5634bd715700 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5604ec61e263d929 server_cookie=f56d04b63af08e23 in_seq=0 out_seq=0 2024-09-19T08:52:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.897+0000 7f1b2aff5640 10 client.16956 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:52:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.898+0000 7f1b2aff5640 1 -- 172.21.15.7:0/3843524198 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5634bd667860 con 0x5634bd713310 2024-09-19T08:52:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.898+0000 7f1b2aff5640 10 client.16956 handle_command_reply: tid=0 2024-09-19T08:52:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.898+0000 7f1b4f718740 1 client.16956 shutdown 2024-09-19T08:52:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.898+0000 7f1b4f718740 1 -- 172.21.15.7:0/3843524198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd703780 msgr2=0x5634bd7009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.898+0000 7f1b4f718740 1 --2- 172.21.15.7:0/3843524198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd703780 0x5634bd7009e0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f1b4001b880 tx=0x7f1b4001b8b0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.898+0000 7f1b4f718740 1 -- 172.21.15.7:0/3843524198 shutdown_connections 2024-09-19T08:52:18.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.898+0000 7f1b4f718740 1 --2- 172.21.15.7:0/3843524198 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5634bd713310 0x5634bd715700 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.898+0000 7f1b4f718740 1 --2- 172.21.15.7:0/3843524198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd703780 0x5634bd7009e0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.898+0000 7f1b4f718740 1 --2- 172.21.15.7:0/3843524198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634bd6f5b40 0x5634bd700410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.898+0000 7f1b2aff5640 0 client.16956 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:52:18.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.898+0000 7f1b4f718740 1 --2- 172.21.15.7:0/3843524198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd6f45d0 0x5634bd703160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.898+0000 7f1b4f718740 1 -- 172.21.15.7:0/3843524198 >> 172.21.15.7:0/3843524198 conn(0x5634bd6bd310 msgr2=0x5634bd6f6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.898+0000 7f1b4f718740 1 -- 172.21.15.7:0/3843524198 shutdown_connections 2024-09-19T08:52:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.898+0000 7f1b4f718740 1 -- 172.21.15.7:0/3843524198 wait complete. 2024-09-19T08:52:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.898+0000 7f1b4f718740 20 client.16956 trim_cache size 0 max 16384 2024-09-19T08:52:18.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.911+0000 7f1b4f718740 1 Processor -- start 2024-09-19T08:52:18.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.911+0000 7f1b4f718740 1 -- start start 2024-09-19T08:52:18.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.911+0000 7f1b4f718740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd6bd310 0x5634bd70f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:18.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.911+0000 7f1b4f718740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634bd6f45d0 0x5634bd6f3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:18.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.911+0000 7f1b4f718740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd6f5b40 0x5634bd702380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:18.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.912+0000 7f1b4f718740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1b481ae000 con 0x5634bd6bd310 2024-09-19T08:52:18.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.912+0000 7f1b4f718740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1b481ab8d0 con 0x5634bd6f5b40 2024-09-19T08:52:18.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.912+0000 7f1b4f718740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1b481a9720 con 0x5634bd6f45d0 2024-09-19T08:52:18.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.912+0000 7f1b46ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd6bd310 0x5634bd70f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:18.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.912+0000 7f1b46ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd6bd310 0x5634bd70f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34646/0 (socket says 172.21.15.7:34646) 2024-09-19T08:52:18.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.912+0000 7f1b46ffd640 1 -- 172.21.15.7:0/3088389578 learned_addr learned my addr 172.21.15.7:0/3088389578 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:18.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.912+0000 7f1b467fc640 1 --2- 172.21.15.7:0/3088389578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634bd6f45d0 0x5634bd6f3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:18.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.912+0000 7f1b477fe640 1 --2- 172.21.15.7:0/3088389578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd6f5b40 0x5634bd702380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:18.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.912+0000 7f1b46ffd640 1 -- 172.21.15.7:0/3088389578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634bd6f45d0 msgr2=0x5634bd6f3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:18.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.912+0000 7f1b46ffd640 1 --2- 172.21.15.7:0/3088389578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634bd6f45d0 0x5634bd6f3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.912+0000 7f1b46ffd640 1 -- 172.21.15.7:0/3088389578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd6f5b40 msgr2=0x5634bd702380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:18.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.912+0000 7f1b46ffd640 1 --2- 172.21.15.7:0/3088389578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd6f5b40 0x5634bd702380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.912+0000 7f1b46ffd640 1 -- 172.21.15.7:0/3088389578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634bd6fe960 con 0x5634bd6bd310 2024-09-19T08:52:18.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.912+0000 7f1b467fc640 1 --2- 172.21.15.7:0/3088389578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634bd6f45d0 0x5634bd6f3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:18.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.912+0000 7f1b477fe640 1 --2- 172.21.15.7:0/3088389578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd6f5b40 0x5634bd702380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:18.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.912+0000 7f1b46ffd640 1 --2- 172.21.15.7:0/3088389578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd6bd310 0x5634bd70f720 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f1b3809b5b0 tx=0x7f1b380d1d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b49910be8c5f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:18.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.912+0000 7f1b2cff9640 1 -- 172.21.15.7:0/3088389578 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b38020040 con 0x5634bd6bd310 2024-09-19T08:52:18.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.912+0000 7f1b2cff9640 1 -- 172.21.15.7:0/3088389578 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b380046c0 con 0x5634bd6bd310 2024-09-19T08:52:18.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.912+0000 7f1b2cff9640 1 -- 172.21.15.7:0/3088389578 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b38005320 con 0x5634bd6bd310 2024-09-19T08:52:18.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.913+0000 7f1b4f718740 1 -- 172.21.15.7:0/3088389578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd6bd310 msgr2=0x5634bd70f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:18.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.913+0000 7f1b4f718740 1 --2- 172.21.15.7:0/3088389578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd6bd310 0x5634bd70f720 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f1b3809b5b0 tx=0x7f1b380d1d50 comp rx=0 tx=0).stop 2024-09-19T08:52:18.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.913+0000 7f1b4f718740 1 -- 172.21.15.7:0/3088389578 shutdown_connections 2024-09-19T08:52:18.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.913+0000 7f1b4f718740 1 --2- 172.21.15.7:0/3088389578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd6f5b40 0x5634bd702380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.913+0000 7f1b4f718740 1 --2- 172.21.15.7:0/3088389578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634bd6f45d0 0x5634bd6f3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.913+0000 7f1b4f718740 1 --2- 172.21.15.7:0/3088389578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd6bd310 0x5634bd70f720 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.913+0000 7f1b4f718740 1 -- 172.21.15.7:0/3088389578 >> 172.21.15.7:0/3088389578 conn(0x5634bd6fbe00 msgr2=0x5634bd701c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.913+0000 7f1b4f718740 1 -- 172.21.15.7:0/3088389578 shutdown_connections 2024-09-19T08:52:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.913+0000 7f1b4f718740 1 -- 172.21.15.7:0/3088389578 wait complete. 2024-09-19T08:52:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.913+0000 7f1b4f718740 1 -- start start 2024-09-19T08:52:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.913+0000 7f1b4f718740 1 Processor -- start 2024-09-19T08:52:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.914+0000 7f1b4f718740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634bd6bd310 0x5634bd70bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.914+0000 7f1b4f718740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd6f45d0 0x5634bd707230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.914+0000 7f1b4f718740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd6f5b40 0x5634bd707770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.914+0000 7f1b4f718740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1b481a9d90 con 0x5634bd6f45d0 2024-09-19T08:52:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.914+0000 7f1b4f718740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1b481ab200 con 0x5634bd6f5b40 2024-09-19T08:52:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.914+0000 7f1b4f718740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1b481aa460 con 0x5634bd6bd310 2024-09-19T08:52:18.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.914+0000 7f1b4f718740 10 client.0 _ll_register_callbacks cb 0x7f1b40029040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.914+0000 7f1b467fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd6f45d0 0x5634bd707230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.914+0000 7f1b467fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd6f45d0 0x5634bd707230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34654/0 (socket says 172.21.15.7:34654) 2024-09-19T08:52:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.914+0000 7f1b467fc640 1 -- 172.21.15.7:0/1797044726 learned_addr learned my addr 172.21.15.7:0/1797044726 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.914+0000 7f1b477fe640 1 --2- 172.21.15.7:0/1797044726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd6f5b40 0x5634bd707770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.914+0000 7f1b46ffd640 1 --2- 172.21.15.7:0/1797044726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634bd6bd310 0x5634bd70bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.914+0000 7f1b467fc640 1 -- 172.21.15.7:0/1797044726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634bd6bd310 msgr2=0x5634bd70bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.914+0000 7f1b467fc640 1 --2- 172.21.15.7:0/1797044726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634bd6bd310 0x5634bd70bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.914+0000 7f1b467fc640 1 -- 172.21.15.7:0/1797044726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd6f5b40 msgr2=0x5634bd707770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.914+0000 7f1b467fc640 1 --2- 172.21.15.7:0/1797044726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd6f5b40 0x5634bd707770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.914+0000 7f1b467fc640 1 -- 172.21.15.7:0/1797044726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634bd707fa0 con 0x5634bd6f45d0 2024-09-19T08:52:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.914+0000 7f1b467fc640 1 --2- 172.21.15.7:0/1797044726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd6f45d0 0x5634bd707230 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c006010 tx=0x7f1b3c031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ad5ec7679ed899 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.914+0000 7f1b2aff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.915+0000 7f1b2aff5640 1 -- 172.21.15.7:0/1797044726 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c035040 con 0x5634bd6f45d0 2024-09-19T08:52:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.915+0000 7f1b4f718740 1 -- 172.21.15.7:0/1797044726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5634bd661d70 con 0x5634bd6f45d0 2024-09-19T08:52:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.915+0000 7f1b2aff5640 1 -- 172.21.15.7:0/1797044726 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7f1b3c004350 con 0x5634bd6f45d0 2024-09-19T08:52:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.915+0000 7f1b2aff5640 1 -- 172.21.15.7:0/1797044726 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1b3c005030 con 0x5634bd6f45d0 2024-09-19T08:52:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.915+0000 7f1b4f718740 10 client.16962 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.915+0000 7f1b4f718740 1 -- 172.21.15.7:0/1797044726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5634bd77dd00 con 0x5634bd6f45d0 2024-09-19T08:52:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.915+0000 7f1b2aff5640 1 -- 172.21.15.7:0/1797044726 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5634bd661d70 con 0x5634bd6f45d0 2024-09-19T08:52:18.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.915+0000 7f1b2aff5640 1 -- 172.21.15.7:0/1797044726 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1b3c0035f0 con 0x5634bd6f45d0 2024-09-19T08:52:18.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.915+0000 7f1b4f718740 10 client.16962 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:18.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.915+0000 7f1b4f718740 10 client.16962 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:52:18.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.915+0000 7f1b4f718740 20 client.16962 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:18.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.915+0000 7f1b4f718740 1 --2- 172.21.15.7:0/1797044726 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5634bd703780 0x5634bd780460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:18.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.915+0000 7f1b4f718740 4 client.16962 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:52:18.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.915+0000 7f1b4f718740 1 -- 172.21.15.7:0/1797044726 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5634bd5de170 con 0x5634bd703780 2024-09-19T08:52:18.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.915+0000 7f1b46ffd640 1 --2- 172.21.15.7:0/1797044726 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5634bd703780 0x5634bd780460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:18.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.916+0000 7f1b46ffd640 1 --2- 172.21.15.7:0/1797044726 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5634bd703780 0x5634bd780460 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f3bb8b8f6ca49220 server_cookie=646d442e717b3033 in_seq=0 out_seq=0 2024-09-19T08:52:18.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.916+0000 7f1b2aff5640 10 client.16962 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:52:18.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.916+0000 7f1b2aff5640 1 -- 172.21.15.7:0/1797044726 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5634bd5de170 con 0x5634bd703780 2024-09-19T08:52:18.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.916+0000 7f1b2aff5640 10 client.16962 handle_command_reply: tid=0 2024-09-19T08:52:18.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.916+0000 7f1b4f718740 1 client.16962 shutdown 2024-09-19T08:52:18.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.916+0000 7f1b4f718740 1 -- 172.21.15.7:0/1797044726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd6f45d0 msgr2=0x5634bd707230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:18.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.916+0000 7f1b4f718740 1 --2- 172.21.15.7:0/1797044726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd6f45d0 0x5634bd707230 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c006010 tx=0x7f1b3c031b60 comp rx=0 tx=0).stop 2024-09-19T08:52:18.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.916+0000 7f1b4f718740 1 -- 172.21.15.7:0/1797044726 shutdown_connections 2024-09-19T08:52:18.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.916+0000 7f1b4f718740 1 --2- 172.21.15.7:0/1797044726 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5634bd703780 0x5634bd780460 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.916+0000 7f1b4f718740 1 --2- 172.21.15.7:0/1797044726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5634bd6f5b40 0x5634bd707770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.916+0000 7f1b4f718740 1 --2- 172.21.15.7:0/1797044726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5634bd6f45d0 0x5634bd707230 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.916+0000 7f1b4f718740 1 --2- 172.21.15.7:0/1797044726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634bd6bd310 0x5634bd70bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.916+0000 7f1b2aff5640 0 client.16962 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:52:18.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.916+0000 7f1b4f718740 1 -- 172.21.15.7:0/1797044726 >> 172.21.15.7:0/1797044726 conn(0x5634bd6fbe00 msgr2=0x5634bd6f6930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:18.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.916+0000 7f1b4f718740 1 -- 172.21.15.7:0/1797044726 shutdown_connections 2024-09-19T08:52:18.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.916+0000 7f1b4f718740 1 -- 172.21.15.7:0/1797044726 wait complete. 2024-09-19T08:52:18.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.916+0000 7f1b4f718740 20 client.16962 trim_cache size 0 max 16384 2024-09-19T08:52:18.926 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:52:18.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.917+0000 7f1b4d33f640 1 -- 172.21.15.7:0/1288026014 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1b300a33b0 msgr2=0x7f1b300a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:18.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.917+0000 7f1b4d33f640 1 --2- 172.21.15.7:0/1288026014 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1b300a33b0 0x7f1b300a5870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1b40020000 tx=0x7f1b4001d000 comp rx=0 tx=0).stop 2024-09-19T08:52:18.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.917+0000 7f1b4d33f640 1 -- 172.21.15.7:0/1288026014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b48102d30 msgr2=0x7f1b481985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:18.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.917+0000 7f1b4d33f640 1 --2- 172.21.15.7:0/1288026014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b48102d30 0x7f1b481985e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800d770 tx=0x7f1b3800dc30 comp rx=0 tx=0).stop 2024-09-19T08:52:18.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.917+0000 7f1b4d33f640 1 -- 172.21.15.7:0/1288026014 shutdown_connections 2024-09-19T08:52:18.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.917+0000 7f1b4d33f640 1 --2- 172.21.15.7:0/1288026014 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1b300a33b0 0x7f1b300a5870 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.917+0000 7f1b4d33f640 1 --2- 172.21.15.7:0/1288026014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b481082a0 0x7f1b4819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.917+0000 7f1b4d33f640 1 --2- 172.21.15.7:0/1288026014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b481036e0 0x7f1b48198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.917+0000 7f1b4d33f640 1 --2- 172.21.15.7:0/1288026014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b48102d30 0x7f1b481985e0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.917+0000 7f1b4d33f640 1 -- 172.21.15.7:0/1288026014 >> 172.21.15.7:0/1288026014 conn(0x7f1b480fc7d0 msgr2=0x7f1b48105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:18.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.917+0000 7f1b4d33f640 1 -- 172.21.15.7:0/1288026014 shutdown_connections 2024-09-19T08:52:18.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:18.917+0000 7f1b4d33f640 1 -- 172.21.15.7:0/1288026014 wait complete. 2024-09-19T08:52:18.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:18 smithi175 ceph-mon[35688]: pgmap v239: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:52:18.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:18 smithi175 ceph-mon[35688]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T08:52:19.706 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:52:19.965 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:20.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.421+0000 7fe91aac7640 1 -- 172.21.15.7:0/1489568556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe914106f10 msgr2=0x7fe91410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:20.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.421+0000 7fe91aac7640 1 --2- 172.21.15.7:0/1489568556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe914106f10 0x7fe91410ea90 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fe90c009ca0 tx=0x7fe90c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.421+0000 7fe91aac7640 1 -- 172.21.15.7:0/1489568556 shutdown_connections 2024-09-19T08:52:20.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.421+0000 7fe91aac7640 1 --2- 172.21.15.7:0/1489568556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe914106f10 0x7fe91410ea90 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.422+0000 7fe91aac7640 1 --2- 172.21.15.7:0/1489568556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe914102790 0x7fe9141067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.422+0000 7fe91aac7640 1 --2- 172.21.15.7:0/1489568556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe914101de0 0x7fe9141021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.422+0000 7fe91aac7640 1 -- 172.21.15.7:0/1489568556 >> 172.21.15.7:0/1489568556 conn(0x7fe9140fd8c0 msgr2=0x7fe9140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:20.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.422+0000 7fe91aac7640 1 -- 172.21.15.7:0/1489568556 shutdown_connections 2024-09-19T08:52:20.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.422+0000 7fe91aac7640 1 -- 172.21.15.7:0/1489568556 wait complete. 2024-09-19T08:52:20.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.422+0000 7fe91aac7640 1 Processor -- start 2024-09-19T08:52:20.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.422+0000 7fe91aac7640 1 -- start start 2024-09-19T08:52:20.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.422+0000 7fe91aac7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe914101de0 0x7fe9141983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.422+0000 7fe91aac7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe914102790 0x7fe914198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.422+0000 7fe91aac7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe914106f10 0x7fe91419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.422+0000 7fe91aac7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe914111f70 con 0x7fe914102790 2024-09-19T08:52:20.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.422+0000 7fe91aac7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe914111df0 con 0x7fe914106f10 2024-09-19T08:52:20.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.422+0000 7fe91aac7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe9141120f0 con 0x7fe914101de0 2024-09-19T08:52:20.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.423+0000 7fe913fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe914102790 0x7fe914198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.423+0000 7fe913fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe914102790 0x7fe914198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34672/0 (socket says 172.21.15.7:34672) 2024-09-19T08:52:20.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.423+0000 7fe913fff640 1 -- 172.21.15.7:0/2527072331 learned_addr learned my addr 172.21.15.7:0/2527072331 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:20.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.423+0000 7fe919064640 1 --2- 172.21.15.7:0/2527072331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe914106f10 0x7fe91419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.423+0000 7fe918863640 1 --2- 172.21.15.7:0/2527072331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe914101de0 0x7fe9141983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.423+0000 7fe913fff640 1 -- 172.21.15.7:0/2527072331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe914101de0 msgr2=0x7fe9141983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:20.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.423+0000 7fe913fff640 1 --2- 172.21.15.7:0/2527072331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe914101de0 0x7fe9141983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.423+0000 7fe913fff640 1 -- 172.21.15.7:0/2527072331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe914106f10 msgr2=0x7fe91419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:20.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.423+0000 7fe913fff640 1 --2- 172.21.15.7:0/2527072331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe914106f10 0x7fe91419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.423+0000 7fe913fff640 1 -- 172.21.15.7:0/2527072331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91419d3a0 con 0x7fe914102790 2024-09-19T08:52:20.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.423+0000 7fe918863640 1 --2- 172.21.15.7:0/2527072331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe914101de0 0x7fe9141983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:20.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.423+0000 7fe913fff640 1 --2- 172.21.15.7:0/2527072331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe914102790 0x7fe914198930 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fe90000c970 tx=0x7fe90000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:20.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.423+0000 7fe911ffb640 1 -- 172.21.15.7:0/2527072331 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe900007bb0 con 0x7fe914102790 2024-09-19T08:52:20.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.423+0000 7fe91aac7640 1 -- 172.21.15.7:0/2527072331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe91419d690 con 0x7fe914102790 2024-09-19T08:52:20.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.423+0000 7fe911ffb640 1 -- 172.21.15.7:0/2527072331 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe900007d50 con 0x7fe914102790 2024-09-19T08:52:20.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.423+0000 7fe911ffb640 1 -- 172.21.15.7:0/2527072331 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90000f450 con 0x7fe914102790 2024-09-19T08:52:20.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.424+0000 7fe91aac7640 1 -- 172.21.15.7:0/2527072331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9141a4f70 con 0x7fe914102790 2024-09-19T08:52:20.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.426+0000 7fe911ffb640 1 -- 172.21.15.7:0/2527072331 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fe900005020 con 0x7fe914102790 2024-09-19T08:52:20.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.426+0000 7fe91cea0740 1 Processor -- start 2024-09-19T08:52:20.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.426+0000 7fe91cea0740 1 -- start start 2024-09-19T08:52:20.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.426+0000 7fe91cea0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7fd5ecb40 0x55f7fd5eb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.426+0000 7fe91cea0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd5eba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.426+0000 7fe91cea0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5fa780 0x55f7fd5fcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.426+0000 7fe91cea0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f7fd5512f0 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.426+0000 7fe91cea0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f7fd4f8cf0 con 0x55f7fd5fa780 2024-09-19T08:52:20.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.426+0000 7fe91cea0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f7fd54d2b0 con 0x55f7fd5ecb40 2024-09-19T08:52:20.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.426+0000 7fe911ffb640 1 --2- 172.21.15.7:0/2527072331 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe9040a33b0 0x7fe9040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.426+0000 7fe918863640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd5eba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.426+0000 7fe918863640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd5eba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34676/0 (socket says 172.21.15.7:34676) 2024-09-19T08:52:20.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.426+0000 7fe918863640 1 -- 172.21.15.7:0/2705933816 learned_addr learned my addr 172.21.15.7:0/2705933816 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.427+0000 7fe919064640 1 --2- 172.21.15.7:0/2527072331 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe9040a33b0 0x7fe9040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.427+0000 7fe911ffb640 1 -- 172.21.15.7:0/2527072331 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7fe9000cfad0 con 0x7fe914102790 2024-09-19T08:52:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.427+0000 7fe913fff640 1 --2- 172.21.15.7:0/2705933816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5fa780 0x55f7fd5fcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.427+0000 7fe919064640 1 --2- 172.21.15.7:0/2705933816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7fd5ecb40 0x55f7fd5eb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.427+0000 7fe918863640 1 -- 172.21.15.7:0/2705933816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7fd5ecb40 msgr2=0x55f7fd5eb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.427+0000 7fe918863640 1 --2- 172.21.15.7:0/2705933816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7fd5ecb40 0x55f7fd5eb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.427+0000 7fe918863640 1 -- 172.21.15.7:0/2705933816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5fa780 msgr2=0x55f7fd5fcb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.427+0000 7fe918863640 1 --2- 172.21.15.7:0/2705933816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5fa780 0x55f7fd5fcb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.427+0000 7fe918863640 1 -- 172.21.15.7:0/2705933816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7fd4dd3a0 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.427+0000 7fe913fff640 1 --2- 172.21.15.7:0/2705933816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5fa780 0x55f7fd5fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:20.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.427+0000 7fe919064640 1 --2- 172.21.15.7:0/2705933816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7fd5ecb40 0x55f7fd5eb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:20.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.427+0000 7fe918863640 1 --2- 172.21.15.7:0/2705933816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd5eba10 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fe90800bcc0 tx=0x7fe90800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=462b4c6a709fe4dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:20.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.427+0000 7fe919064640 1 --2- 172.21.15.7:0/2527072331 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe9040a33b0 0x7fe9040a5870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe90c004af0 tx=0x7fe90c03e040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:20.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.427+0000 7fe8feffd640 1 -- 172.21.15.7:0/2705933816 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe908005020 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.427+0000 7fe8feffd640 1 -- 172.21.15.7:0/2705933816 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9080047a0 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.427+0000 7fe8feffd640 1 -- 172.21.15.7:0/2705933816 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe908011710 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.428+0000 7fe91cea0740 1 -- 172.21.15.7:0/2705933816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 msgr2=0x55f7fd5eba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:20.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.428+0000 7fe91cea0740 1 --2- 172.21.15.7:0/2705933816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd5eba10 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fe90800bcc0 tx=0x7fe90800f730 comp rx=0 tx=0).stop 2024-09-19T08:52:20.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.428+0000 7fe91cea0740 1 -- 172.21.15.7:0/2705933816 shutdown_connections 2024-09-19T08:52:20.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.428+0000 7fe91cea0740 1 --2- 172.21.15.7:0/2705933816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5fa780 0x55f7fd5fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.428+0000 7fe91cea0740 1 --2- 172.21.15.7:0/2705933816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd5eba10 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.428+0000 7fe91cea0740 1 --2- 172.21.15.7:0/2705933816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7fd5ecb40 0x55f7fd5eb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.428+0000 7fe91cea0740 1 -- 172.21.15.7:0/2705933816 >> 172.21.15.7:0/2705933816 conn(0x55f7fd5b4310 msgr2=0x55f7fd5e7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:20.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.428+0000 7fe91cea0740 1 -- 172.21.15.7:0/2705933816 shutdown_connections 2024-09-19T08:52:20.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.428+0000 7fe91cea0740 1 -- 172.21.15.7:0/2705933816 wait complete. 2024-09-19T08:52:20.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.429+0000 7fe91cea0740 1 -- start start 2024-09-19T08:52:20.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.429+0000 7fe91cea0740 1 Processor -- start 2024-09-19T08:52:20.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.429+0000 7fe91cea0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd5fa040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.429+0000 7fe91cea0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7fd5ecb40 0x55f7fd5f72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.429+0000 7fe91cea0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5fa780 0x55f7fd5f7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.429+0000 7fe91cea0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f7fd5fd480 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.429+0000 7fe91cea0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f7fd50c060 con 0x55f7fd5fa780 2024-09-19T08:52:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.429+0000 7fe91cea0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f7fd5fd600 con 0x55f7fd5ecb40 2024-09-19T08:52:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.429+0000 7fe91cea0740 10 client.0 _ll_register_callbacks cb 0x55f7fd25f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.429+0000 7fe918863640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd5fa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.429+0000 7fe918863640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd5fa040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34686/0 (socket says 172.21.15.7:34686) 2024-09-19T08:52:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.429+0000 7fe918863640 1 -- 172.21.15.7:0/3838477991 learned_addr learned my addr 172.21.15.7:0/3838477991 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.429+0000 7fe913fff640 1 --2- 172.21.15.7:0/3838477991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7fd5ecb40 0x55f7fd5f72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.429+0000 7fe919064640 1 --2- 172.21.15.7:0/3838477991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5fa780 0x55f7fd5f7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.430+0000 7fe918863640 1 -- 172.21.15.7:0/3838477991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7fd5ecb40 msgr2=0x55f7fd5f72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.430+0000 7fe918863640 1 --2- 172.21.15.7:0/3838477991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7fd5ecb40 0x55f7fd5f72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.430+0000 7fe918863640 1 -- 172.21.15.7:0/3838477991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5fa780 msgr2=0x55f7fd5f7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:20.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.430+0000 7fe918863640 1 --2- 172.21.15.7:0/3838477991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5fa780 0x55f7fd5f7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.430+0000 7fe918863640 1 -- 172.21.15.7:0/3838477991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7fd2c23c0 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.430+0000 7fe919064640 1 --2- 172.21.15.7:0/3838477991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5fa780 0x55f7fd5f7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.430+0000 7fe913fff640 1 --2- 172.21.15.7:0/3838477991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7fd5ecb40 0x55f7fd5f72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.430+0000 7fe918863640 1 --2- 172.21.15.7:0/3838477991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd5fa040 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fe908006010 tx=0x7fe908004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d0546b676f2a85 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.430+0000 7fe8f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.430+0000 7fe8f3fff640 1 -- 172.21.15.7:0/3838477991 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90800be20 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.430+0000 7fe8f3fff640 1 -- 172.21.15.7:0/3838477991 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7fe908005210 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.430+0000 7fe91cea0740 1 -- 172.21.15.7:0/3838477991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9080047a0 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.430+0000 7fe8f3fff640 1 -- 172.21.15.7:0/3838477991 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe908005410 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.430+0000 7fe91cea0740 10 client.16974 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.430+0000 7fe91cea0740 1 -- 172.21.15.7:0/3838477991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f7fd608d80 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.430+0000 7fe8f3fff640 1 -- 172.21.15.7:0/3838477991 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9080047a0 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.430+0000 7fe8f3fff640 1 -- 172.21.15.7:0/3838477991 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe90802c030 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.431+0000 7fe91cea0740 10 client.16974 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.431+0000 7fe91cea0740 10 client.16974 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.431+0000 7fe91cea0740 20 client.16974 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.431+0000 7fe91cea0740 1 --2- 172.21.15.7:0/3838477991 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f7fd60a180 0x55f7fd60c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.431+0000 7fe91cea0740 4 client.16974 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.431+0000 7fe91cea0740 1 -- 172.21.15.7:0/3838477991 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7fd55e860 con 0x55f7fd60a180 2024-09-19T08:52:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.431+0000 7fe913fff640 1 --2- 172.21.15.7:0/3838477991 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f7fd60a180 0x55f7fd60c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.431+0000 7fe913fff640 1 --2- 172.21.15.7:0/3838477991 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f7fd60a180 0x55f7fd60c570 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4152bf91b9f41e29 server_cookie=e76ed5809d4e382c in_seq=0 out_seq=0 2024-09-19T08:52:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.431+0000 7fe8f3fff640 10 client.16974 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.432+0000 7fe8f3fff640 1 -- 172.21.15.7:0/3838477991 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f7fd55e860 con 0x55f7fd60a180 2024-09-19T08:52:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.432+0000 7fe8f3fff640 10 client.16974 handle_command_reply: tid=0 2024-09-19T08:52:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.432+0000 7fe91cea0740 1 client.16974 shutdown 2024-09-19T08:52:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.432+0000 7fe91cea0740 1 -- 172.21.15.7:0/3838477991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 msgr2=0x55f7fd5fa040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.432+0000 7fe91cea0740 1 --2- 172.21.15.7:0/3838477991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd5fa040 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fe908006010 tx=0x7fe908004b80 comp rx=0 tx=0).stop 2024-09-19T08:52:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.432+0000 7fe91cea0740 1 -- 172.21.15.7:0/3838477991 shutdown_connections 2024-09-19T08:52:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.432+0000 7fe91cea0740 1 --2- 172.21.15.7:0/3838477991 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f7fd60a180 0x55f7fd60c570 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.432+0000 7fe91cea0740 1 --2- 172.21.15.7:0/3838477991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5fa780 0x55f7fd5f7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.432+0000 7fe91cea0740 1 --2- 172.21.15.7:0/3838477991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7fd5ecb40 0x55f7fd5f72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.432+0000 7fe8f3fff640 0 client.16974 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:20.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.432+0000 7fe91cea0740 1 --2- 172.21.15.7:0/3838477991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd5fa040 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.432+0000 7fe91cea0740 1 -- 172.21.15.7:0/3838477991 >> 172.21.15.7:0/3838477991 conn(0x55f7fd5b4310 msgr2=0x55f7fd5ed960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:20.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.432+0000 7fe91cea0740 1 -- 172.21.15.7:0/3838477991 shutdown_connections 2024-09-19T08:52:20.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.432+0000 7fe91cea0740 1 -- 172.21.15.7:0/3838477991 wait complete. 2024-09-19T08:52:20.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.432+0000 7fe91cea0740 20 client.16974 trim_cache size 0 max 16384 2024-09-19T08:52:20.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.445+0000 7fe91cea0740 1 Processor -- start 2024-09-19T08:52:20.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.445+0000 7fe91cea0740 1 -- start start 2024-09-19T08:52:20.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.446+0000 7fe91cea0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd606720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.446+0000 7fe91cea0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5ecb40 0x55f7fd5f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.446+0000 7fe91cea0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7fd5fa780 0x55f7fd5fbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.446+0000 7fe91cea0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe9141ae040 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.446+0000 7fe91cea0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe9141ab910 con 0x55f7fd5ecb40 2024-09-19T08:52:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.446+0000 7fe91cea0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe9141a9780 con 0x55f7fd5fa780 2024-09-19T08:52:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.446+0000 7fe918863640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd606720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.446+0000 7fe918863640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd606720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34702/0 (socket says 172.21.15.7:34702) 2024-09-19T08:52:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.446+0000 7fe918863640 1 -- 172.21.15.7:0/226940853 learned_addr learned my addr 172.21.15.7:0/226940853 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.446+0000 7fe913fff640 1 --2- 172.21.15.7:0/226940853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5ecb40 0x55f7fd5f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.446+0000 7fe919064640 1 --2- 172.21.15.7:0/226940853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7fd5fa780 0x55f7fd5fbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.446+0000 7fe918863640 1 -- 172.21.15.7:0/226940853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7fd5fa780 msgr2=0x55f7fd5fbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.446+0000 7fe918863640 1 --2- 172.21.15.7:0/226940853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7fd5fa780 0x55f7fd5fbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.446+0000 7fe918863640 1 -- 172.21.15.7:0/226940853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5ecb40 msgr2=0x55f7fd5f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.446+0000 7fe918863640 1 --2- 172.21.15.7:0/226940853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5ecb40 0x55f7fd5f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.446+0000 7fe918863640 1 -- 172.21.15.7:0/226940853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7fd5f2ef0 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.446+0000 7fe918863640 1 --2- 172.21.15.7:0/226940853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd606720 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fe90800fc30 tx=0x7fe908003e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544a3c70da64a8b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:20.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.446+0000 7fe8fe7fc640 1 -- 172.21.15.7:0/226940853 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90801f020 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.447+0000 7fe8fe7fc640 1 -- 172.21.15.7:0/226940853 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe908011440 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.447+0000 7fe8fe7fc640 1 -- 172.21.15.7:0/226940853 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe908004170 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.447+0000 7fe91cea0740 1 -- 172.21.15.7:0/226940853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 msgr2=0x55f7fd606720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.447+0000 7fe91cea0740 1 --2- 172.21.15.7:0/226940853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd606720 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fe90800fc30 tx=0x7fe908003e10 comp rx=0 tx=0).stop 2024-09-19T08:52:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.447+0000 7fe91cea0740 1 -- 172.21.15.7:0/226940853 shutdown_connections 2024-09-19T08:52:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.447+0000 7fe91cea0740 1 --2- 172.21.15.7:0/226940853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7fd5fa780 0x55f7fd5fbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.447+0000 7fe91cea0740 1 --2- 172.21.15.7:0/226940853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5ecb40 0x55f7fd5f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.447+0000 7fe91cea0740 1 --2- 172.21.15.7:0/226940853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd606720 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.447+0000 7fe91cea0740 1 -- 172.21.15.7:0/226940853 >> 172.21.15.7:0/226940853 conn(0x55f7fd5b4310 msgr2=0x55f7fd5f5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.447+0000 7fe91cea0740 1 -- 172.21.15.7:0/226940853 shutdown_connections 2024-09-19T08:52:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.447+0000 7fe91cea0740 1 -- 172.21.15.7:0/226940853 wait complete. 2024-09-19T08:52:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.447+0000 7fe91cea0740 1 -- start start 2024-09-19T08:52:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.448+0000 7fe91cea0740 1 Processor -- start 2024-09-19T08:52:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.448+0000 7fe91cea0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd610d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.448+0000 7fe91cea0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5ecb40 0x55f7fd6112a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.448+0000 7fe91cea0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7fd5fa780 0x55f7fd6117e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.448+0000 7fe91cea0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe9141a9dd0 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.448+0000 7fe91cea0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe9141ab240 con 0x55f7fd5ecb40 2024-09-19T08:52:20.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.448+0000 7fe91cea0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe9141aa4a0 con 0x55f7fd5fa780 2024-09-19T08:52:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.448+0000 7fe91cea0740 10 client.0 _ll_register_callbacks cb 0x7fe908015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.448+0000 7fe918863640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd610d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.448+0000 7fe918863640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd610d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34706/0 (socket says 172.21.15.7:34706) 2024-09-19T08:52:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.448+0000 7fe918863640 1 -- 172.21.15.7:0/1657441123 learned_addr learned my addr 172.21.15.7:0/1657441123 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.448+0000 7fe913fff640 1 --2- 172.21.15.7:0/1657441123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5ecb40 0x55f7fd6112a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.448+0000 7fe919064640 1 --2- 172.21.15.7:0/1657441123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7fd5fa780 0x55f7fd6117e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.449+0000 7fe918863640 1 -- 172.21.15.7:0/1657441123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7fd5fa780 msgr2=0x55f7fd6117e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.449+0000 7fe918863640 1 --2- 172.21.15.7:0/1657441123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7fd5fa780 0x55f7fd6117e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.449+0000 7fe918863640 1 -- 172.21.15.7:0/1657441123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5ecb40 msgr2=0x55f7fd6112a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.449+0000 7fe918863640 1 --2- 172.21.15.7:0/1657441123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5ecb40 0x55f7fd6112a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.449+0000 7fe918863640 1 -- 172.21.15.7:0/1657441123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7fd601a40 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.449+0000 7fe913fff640 1 --2- 172.21.15.7:0/1657441123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5ecb40 0x55f7fd6112a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.449+0000 7fe918863640 1 --2- 172.21.15.7:0/1657441123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd610d60 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fe90800b500 tx=0x7fe9080055b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29fe89756423b3e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.449+0000 7fe8f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:20.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.451+0000 7fe8f3fff640 1 -- 172.21.15.7:0/1657441123 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90801f030 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.451+0000 7fe8f3fff640 1 -- 172.21.15.7:0/1657441123 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7fe908005210 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.451+0000 7fe91cea0740 1 -- 172.21.15.7:0/1657441123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe908011440 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.451+0000 7fe8f3fff640 1 -- 172.21.15.7:0/1657441123 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe908046050 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.451+0000 7fe91cea0740 10 client.16980 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:20.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.451+0000 7fe91cea0740 1 -- 172.21.15.7:0/1657441123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f7fd602d20 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.451+0000 7fe8f3fff640 1 -- 172.21.15.7:0/1657441123 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe908011440 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.452+0000 7fe8f3fff640 1 -- 172.21.15.7:0/1657441123 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe908011870 con 0x55f7fd5eb5d0 2024-09-19T08:52:20.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.452+0000 7fe91cea0740 10 client.16980 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:20.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.452+0000 7fe91cea0740 10 client.16980 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:20.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.452+0000 7fe91cea0740 20 client.16980 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:20.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.452+0000 7fe91cea0740 1 --2- 172.21.15.7:0/1657441123 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f7fd60a180 0x55f7fd676d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.452+0000 7fe91cea0740 4 client.16980 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:52:20.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.452+0000 7fe91cea0740 1 -- 172.21.15.7:0/1657441123 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f7fd558d70 con 0x55f7fd60a180 2024-09-19T08:52:20.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.452+0000 7fe913fff640 1 --2- 172.21.15.7:0/1657441123 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f7fd60a180 0x55f7fd676d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.452+0000 7fe913fff640 1 --2- 172.21.15.7:0/1657441123 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f7fd60a180 0x55f7fd676d50 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d8bdfa93de3da76 server_cookie=f2ddfdadccff298e in_seq=0 out_seq=0 2024-09-19T08:52:20.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.452+0000 7fe8f3fff640 10 client.16980 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:20.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.452+0000 7fe8f3fff640 1 -- 172.21.15.7:0/1657441123 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f7fd558d70 con 0x55f7fd60a180 2024-09-19T08:52:20.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.452+0000 7fe8f3fff640 10 client.16980 handle_command_reply: tid=0 2024-09-19T08:52:20.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.452+0000 7fe91cea0740 1 client.16980 shutdown 2024-09-19T08:52:20.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.453+0000 7fe91cea0740 1 -- 172.21.15.7:0/1657441123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 msgr2=0x55f7fd610d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:20.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.453+0000 7fe91cea0740 1 --2- 172.21.15.7:0/1657441123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd610d60 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fe90800b500 tx=0x7fe9080055b0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.453+0000 7fe91cea0740 1 -- 172.21.15.7:0/1657441123 shutdown_connections 2024-09-19T08:52:20.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.453+0000 7fe91cea0740 1 --2- 172.21.15.7:0/1657441123 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f7fd60a180 0x55f7fd676d50 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.453+0000 7fe8f3fff640 0 client.16980 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:20.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.453+0000 7fe91cea0740 1 --2- 172.21.15.7:0/1657441123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7fd5fa780 0x55f7fd6117e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.453+0000 7fe91cea0740 1 --2- 172.21.15.7:0/1657441123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7fd5ecb40 0x55f7fd6112a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.453+0000 7fe91cea0740 1 --2- 172.21.15.7:0/1657441123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f7fd5eb5d0 0x55f7fd610d60 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.453+0000 7fe91cea0740 1 -- 172.21.15.7:0/1657441123 >> 172.21.15.7:0/1657441123 conn(0x55f7fd5b4310 msgr2=0x55f7fd5f63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:20.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.453+0000 7fe91cea0740 1 -- 172.21.15.7:0/1657441123 shutdown_connections 2024-09-19T08:52:20.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.453+0000 7fe91cea0740 1 -- 172.21.15.7:0/1657441123 wait complete. 2024-09-19T08:52:20.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.453+0000 7fe91cea0740 20 client.16980 trim_cache size 0 max 16384 2024-09-19T08:52:20.458 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:52:20.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.453+0000 7fe91aac7640 1 -- 172.21.15.7:0/2527072331 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe9040a33b0 msgr2=0x7fe9040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.453+0000 7fe91aac7640 1 --2- 172.21.15.7:0/2527072331 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe9040a33b0 0x7fe9040a5870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe90c004af0 tx=0x7fe90c03e040 comp rx=0 tx=0).stop 2024-09-19T08:52:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.453+0000 7fe91aac7640 1 -- 172.21.15.7:0/2527072331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe914102790 msgr2=0x7fe914198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.453+0000 7fe91aac7640 1 --2- 172.21.15.7:0/2527072331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe914102790 0x7fe914198930 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fe90000c970 tx=0x7fe90000ce30 comp rx=0 tx=0).stop 2024-09-19T08:52:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.454+0000 7fe91aac7640 1 -- 172.21.15.7:0/2527072331 shutdown_connections 2024-09-19T08:52:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.454+0000 7fe91aac7640 1 --2- 172.21.15.7:0/2527072331 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe9040a33b0 0x7fe9040a5870 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.454+0000 7fe91aac7640 1 --2- 172.21.15.7:0/2527072331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe914106f10 0x7fe91419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.454+0000 7fe91aac7640 1 --2- 172.21.15.7:0/2527072331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe914102790 0x7fe914198930 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.454+0000 7fe91aac7640 1 --2- 172.21.15.7:0/2527072331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe914101de0 0x7fe9141983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.454+0000 7fe91aac7640 1 -- 172.21.15.7:0/2527072331 >> 172.21.15.7:0/2527072331 conn(0x7fe9140fd8c0 msgr2=0x7fe9140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.454+0000 7fe91aac7640 1 -- 172.21.15.7:0/2527072331 shutdown_connections 2024-09-19T08:52:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:20.454+0000 7fe91aac7640 1 -- 172.21.15.7:0/2527072331 wait complete. 2024-09-19T08:52:20.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:20 smithi007 ceph-mon[31221]: pgmap v241: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 207 B/s wr, 6 op/s 2024-09-19T08:52:20.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:20 smithi044 ceph-mon[35072]: pgmap v241: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 207 B/s wr, 6 op/s 2024-09-19T08:52:20.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:20 smithi175 ceph-mon[35688]: pgmap v241: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 207 B/s wr, 6 op/s 2024-09-19T08:52:22.306 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:52:22.306 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:52:22.576 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:22.693 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:22 smithi007 ceph-mon[31221]: pgmap v242: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:52:22.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:22 smithi044 ceph-mon[35072]: pgmap v242: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:52:22.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:22 smithi175 ceph-mon[35688]: pgmap v242: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:52:22.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.990+0000 7f8b2a73a640 1 -- 172.21.15.7:0/880497549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b24100e20 msgr2=0x7f8b24101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:22.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.990+0000 7f8b2a73a640 1 --2- 172.21.15.7:0/880497549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b24100e20 0x7f8b24101200 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009900 tx=0x7f8b1402a480 comp rx=0 tx=0).stop 2024-09-19T08:52:22.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.990+0000 7f8b2a73a640 1 -- 172.21.15.7:0/880497549 shutdown_connections 2024-09-19T08:52:22.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.990+0000 7f8b2a73a640 1 --2- 172.21.15.7:0/880497549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b24102ef0 0x7f8b2410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:22.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.990+0000 7f8b2a73a640 1 --2- 172.21.15.7:0/880497549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b24102570 0x7f8b241029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:22.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.990+0000 7f8b2a73a640 1 --2- 172.21.15.7:0/880497549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b24100e20 0x7f8b24101200 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.990+0000 7f8b2a73a640 1 -- 172.21.15.7:0/880497549 >> 172.21.15.7:0/880497549 conn(0x7f8b240fc7d0 msgr2=0x7f8b240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.990+0000 7f8b2a73a640 1 -- 172.21.15.7:0/880497549 shutdown_connections 2024-09-19T08:52:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.990+0000 7f8b2a73a640 1 -- 172.21.15.7:0/880497549 wait complete. 2024-09-19T08:52:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.990+0000 7f8b2a73a640 1 Processor -- start 2024-09-19T08:52:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.990+0000 7f8b2a73a640 1 -- start start 2024-09-19T08:52:22.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.991+0000 7f8b2a73a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b24100e20 0x7f8b24199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:22.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.991+0000 7f8b2a73a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b24102570 0x7f8b24199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:22.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.991+0000 7f8b2a73a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b24102ef0 0x7f8b241a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:22.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.991+0000 7f8b2a73a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8b24110fa0 con 0x7f8b24100e20 2024-09-19T08:52:22.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.991+0000 7f8b2a73a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8b24110e20 con 0x7f8b24102ef0 2024-09-19T08:52:22.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.991+0000 7f8b2a73a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8b24111120 con 0x7f8b24102570 2024-09-19T08:52:22.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.991+0000 7f8b23fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b24100e20 0x7f8b24199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:22.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.991+0000 7f8b23fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b24100e20 0x7f8b24199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34712/0 (socket says 172.21.15.7:34712) 2024-09-19T08:52:22.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.991+0000 7f8b23fff640 1 -- 172.21.15.7:0/3539114984 learned_addr learned my addr 172.21.15.7:0/3539114984 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:22.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.991+0000 7f8b28cd7640 1 --2- 172.21.15.7:0/3539114984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b24102ef0 0x7f8b241a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:22.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.991+0000 7f8b237fe640 1 --2- 172.21.15.7:0/3539114984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b24102570 0x7f8b24199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:22.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.991+0000 7f8b23fff640 1 -- 172.21.15.7:0/3539114984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b24102570 msgr2=0x7f8b24199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:22.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.991+0000 7f8b23fff640 1 --2- 172.21.15.7:0/3539114984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b24102570 0x7f8b24199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:22.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.991+0000 7f8b23fff640 1 -- 172.21.15.7:0/3539114984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b24102ef0 msgr2=0x7f8b241a44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:22.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.991+0000 7f8b23fff640 1 --2- 172.21.15.7:0/3539114984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b24102ef0 0x7f8b241a44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:22.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.991+0000 7f8b23fff640 1 -- 172.21.15.7:0/3539114984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b241a49f0 con 0x7f8b24100e20 2024-09-19T08:52:22.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.992+0000 7f8b23fff640 1 --2- 172.21.15.7:0/3539114984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b24100e20 0x7f8b24199430 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f8b14006010 tx=0x7f8b14003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:22.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.992+0000 7f8b217fa640 1 -- 172.21.15.7:0/3539114984 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1403f070 con 0x7f8b24100e20 2024-09-19T08:52:22.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.992+0000 7f8b217fa640 1 -- 172.21.15.7:0/3539114984 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b14031c30 con 0x7f8b24100e20 2024-09-19T08:52:22.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.992+0000 7f8b2a73a640 1 -- 172.21.15.7:0/3539114984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b241a4bc0 con 0x7f8b24100e20 2024-09-19T08:52:22.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.992+0000 7f8b217fa640 1 -- 172.21.15.7:0/3539114984 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14035030 con 0x7f8b24100e20 2024-09-19T08:52:22.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.992+0000 7f8b2a73a640 1 -- 172.21.15.7:0/3539114984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b241a5070 con 0x7f8b24100e20 2024-09-19T08:52:22.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.994+0000 7f8b217fa640 1 -- 172.21.15.7:0/3539114984 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8b14042070 con 0x7f8b24100e20 2024-09-19T08:52:22.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.994+0000 7f8b2cb13740 1 Processor -- start 2024-09-19T08:52:22.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.995+0000 7f8b2cb13740 1 -- start start 2024-09-19T08:52:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.995+0000 7f8b2cb13740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b564613b60 0x55b564613f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.995+0000 7f8b2cb13740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b564614480 0x55b56461e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.995+0000 7f8b2cb13740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b56461ed40 0x55b564621130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.995+0000 7f8b2cb13740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b564579280 con 0x55b564613b60 2024-09-19T08:52:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.995+0000 7f8b2cb13740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b564520b10 con 0x55b56461ed40 2024-09-19T08:52:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.995+0000 7f8b2cb13740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b564575240 con 0x55b564614480 2024-09-19T08:52:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.995+0000 7f8b28cd7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b564613b60 0x55b564613f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.995+0000 7f8b28cd7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b564613b60 0x55b564613f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34728/0 (socket says 172.21.15.7:34728) 2024-09-19T08:52:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.995+0000 7f8b28cd7640 1 -- 172.21.15.7:0/1998857809 learned_addr learned my addr 172.21.15.7:0/1998857809 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.995+0000 7f8b23fff640 1 --2- 172.21.15.7:0/1998857809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b564614480 0x55b56461e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.995+0000 7f8b217fa640 1 --2- 172.21.15.7:0/3539114984 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8b0c0a3430 0x7f8b0c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.995+0000 7f8b237fe640 1 --2- 172.21.15.7:0/1998857809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b56461ed40 0x55b564621130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.995+0000 7f8b28cd7640 1 -- 172.21.15.7:0/1998857809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b564614480 msgr2=0x55b56461e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.995+0000 7f8b28cd7640 1 --2- 172.21.15.7:0/1998857809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b564614480 0x55b56461e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.995+0000 7f8b28cd7640 1 -- 172.21.15.7:0/1998857809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b56461ed40 msgr2=0x55b564621130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.995+0000 7f8b28cd7640 1 --2- 172.21.15.7:0/1998857809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b56461ed40 0x55b564621130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.995+0000 7f8b28cd7640 1 -- 172.21.15.7:0/1998857809 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b56452d1f0 con 0x55b564613b60 2024-09-19T08:52:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.995+0000 7f8b23fff640 1 --2- 172.21.15.7:0/1998857809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b564614480 0x55b56461e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.995+0000 7f8b28cd7640 1 --2- 172.21.15.7:0/3539114984 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8b0c0a3430 0x7f8b0c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.996+0000 7f8b217fa640 1 -- 172.21.15.7:0/3539114984 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7f8b140f03f0 con 0x7f8b24100e20 2024-09-19T08:52:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.996+0000 7f8b28cd7640 1 --2- 172.21.15.7:0/1998857809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b564613b60 0x55b564613f40 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c010510 tx=0x7f8b1c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f460cd7030f35a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.996+0000 7f8b0a7fc640 1 -- 172.21.15.7:0/1998857809 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c01d400 con 0x55b564613b60 2024-09-19T08:52:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.996+0000 7f8b0a7fc640 1 -- 172.21.15.7:0/1998857809 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b1c01da80 con 0x55b564613b60 2024-09-19T08:52:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.996+0000 7f8b0a7fc640 1 -- 172.21.15.7:0/1998857809 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c01c8d0 con 0x55b564613b60 2024-09-19T08:52:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.997+0000 7f8b2cb13740 1 -- 172.21.15.7:0/1998857809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b564613b60 msgr2=0x55b564613f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.997+0000 7f8b28cd7640 1 --2- 172.21.15.7:0/3539114984 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8b0c0a3430 0x7f8b0c0a58f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c021000 tx=0x7f8b1c01e000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.997+0000 7f8b2cb13740 1 --2- 172.21.15.7:0/1998857809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b564613b60 0x55b564613f40 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c010510 tx=0x7f8b1c009f90 comp rx=0 tx=0).stop 2024-09-19T08:52:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.997+0000 7f8b2cb13740 1 -- 172.21.15.7:0/1998857809 shutdown_connections 2024-09-19T08:52:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.997+0000 7f8b2cb13740 1 --2- 172.21.15.7:0/1998857809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b56461ed40 0x55b564621130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.997+0000 7f8b2cb13740 1 --2- 172.21.15.7:0/1998857809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b564614480 0x55b56461e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.997+0000 7f8b2cb13740 1 --2- 172.21.15.7:0/1998857809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b564613b60 0x55b564613f40 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.997+0000 7f8b2cb13740 1 -- 172.21.15.7:0/1998857809 >> 172.21.15.7:0/1998857809 conn(0x55b5646100f0 msgr2=0x55b5646104d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.997+0000 7f8b2cb13740 1 -- 172.21.15.7:0/1998857809 shutdown_connections 2024-09-19T08:52:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.997+0000 7f8b2cb13740 1 -- 172.21.15.7:0/1998857809 wait complete. 2024-09-19T08:52:23.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.997+0000 7f8b2cb13740 1 -- start start 2024-09-19T08:52:23.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.997+0000 7f8b2cb13740 1 Processor -- start 2024-09-19T08:52:23.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.998+0000 7f8b2cb13740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b564613b60 0x55b56461bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:23.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.998+0000 7f8b2cb13740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b564614480 0x55b56461c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:23.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.998+0000 7f8b2cb13740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b56461ed40 0x55b56461c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:23.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.998+0000 7f8b2cb13740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b564621910 con 0x55b56461ed40 2024-09-19T08:52:23.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.998+0000 7f8b2cb13740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b564533f10 con 0x55b564613b60 2024-09-19T08:52:23.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.998+0000 7f8b2cb13740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b564621a90 con 0x55b564614480 2024-09-19T08:52:23.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.998+0000 7f8b2cb13740 10 client.0 _ll_register_callbacks cb 0x55b5644fca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:23.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.998+0000 7f8b28cd7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b56461ed40 0x55b56461c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:23.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.998+0000 7f8b28cd7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b56461ed40 0x55b56461c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34734/0 (socket says 172.21.15.7:34734) 2024-09-19T08:52:23.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.998+0000 7f8b28cd7640 1 -- 172.21.15.7:0/2224573739 learned_addr learned my addr 172.21.15.7:0/2224573739 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:23.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.998+0000 7f8b237fe640 1 --2- 172.21.15.7:0/2224573739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b564614480 0x55b56461c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:23.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.998+0000 7f8b23fff640 1 --2- 172.21.15.7:0/2224573739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b564613b60 0x55b56461bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:23.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.998+0000 7f8b28cd7640 1 -- 172.21.15.7:0/2224573739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b564614480 msgr2=0x55b56461c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:23.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.998+0000 7f8b28cd7640 1 --2- 172.21.15.7:0/2224573739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b564614480 0x55b56461c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.998+0000 7f8b28cd7640 1 -- 172.21.15.7:0/2224573739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b564613b60 msgr2=0x55b56461bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:23.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.998+0000 7f8b28cd7640 1 --2- 172.21.15.7:0/2224573739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b564613b60 0x55b56461bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.998+0000 7f8b28cd7640 1 -- 172.21.15.7:0/2224573739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5642ea6a0 con 0x55b56461ed40 2024-09-19T08:52:23.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.998+0000 7f8b28cd7640 1 --2- 172.21.15.7:0/2224573739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b56461ed40 0x55b56461c630 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c0136a0 tx=0x7f8b1c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d864018e39b7cd25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:23.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.998+0000 7f8b037fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:23.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.999+0000 7f8b037fe640 1 -- 172.21.15.7:0/2224573739 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c01cd80 con 0x55b56461ed40 2024-09-19T08:52:23.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.999+0000 7f8b037fe640 1 -- 172.21.15.7:0/2224573739 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7f8b1c01d400 con 0x55b56461ed40 2024-09-19T08:52:23.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.999+0000 7f8b2cb13740 1 -- 172.21.15.7:0/2224573739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b1c01da80 con 0x55b56461ed40 2024-09-19T08:52:23.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.999+0000 7f8b037fe640 1 -- 172.21.15.7:0/2224573739 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8b1c01d600 con 0x55b56461ed40 2024-09-19T08:52:23.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.999+0000 7f8b2cb13740 10 client.16992 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:23.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.999+0000 7f8b2cb13740 1 -- 172.21.15.7:0/2224573739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b56462d4a0 con 0x55b56461ed40 2024-09-19T08:52:23.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.999+0000 7f8b037fe640 1 -- 172.21.15.7:0/2224573739 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b1c01da80 con 0x55b56461ed40 2024-09-19T08:52:23.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.999+0000 7f8b037fe640 1 -- 172.21.15.7:0/2224573739 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8b1c00f040 con 0x55b56461ed40 2024-09-19T08:52:23.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.999+0000 7f8b2cb13740 10 client.16992 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:23.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.999+0000 7f8b2cb13740 10 client.16992 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:23.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.999+0000 7f8b2cb13740 20 client.16992 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:23.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.999+0000 7f8b2cb13740 1 --2- 172.21.15.7:0/2224573739 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b56462e900 0x55b564630cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:23.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.999+0000 7f8b2cb13740 4 client.16992 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:23.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:22.999+0000 7f8b2cb13740 1 -- 172.21.15.7:0/2224573739 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5645867f0 con 0x55b56462e900 2024-09-19T08:52:23.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.000+0000 7f8b23fff640 1 --2- 172.21.15.7:0/2224573739 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b56462e900 0x55b564630cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:23.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.000+0000 7f8b037fe640 10 client.16992 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:23.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.000+0000 7f8b23fff640 1 --2- 172.21.15.7:0/2224573739 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b56462e900 0x55b564630cf0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a60cb2f07f62212 server_cookie=a77426c1576aafbe in_seq=0 out_seq=0 2024-09-19T08:52:23.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.001+0000 7f8b037fe640 1 -- 172.21.15.7:0/2224573739 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b5645867f0 con 0x55b56462e900 2024-09-19T08:52:23.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.001+0000 7f8b037fe640 10 client.16992 handle_command_reply: tid=0 2024-09-19T08:52:23.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.001+0000 7f8b2cb13740 1 client.16992 shutdown 2024-09-19T08:52:23.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.001+0000 7f8b2cb13740 1 -- 172.21.15.7:0/2224573739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b56461ed40 msgr2=0x55b56461c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:23.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.001+0000 7f8b2cb13740 1 --2- 172.21.15.7:0/2224573739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b56461ed40 0x55b56461c630 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c0136a0 tx=0x7f8b1c01c900 comp rx=0 tx=0).stop 2024-09-19T08:52:23.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.001+0000 7f8b2cb13740 1 -- 172.21.15.7:0/2224573739 shutdown_connections 2024-09-19T08:52:23.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.001+0000 7f8b2cb13740 1 --2- 172.21.15.7:0/2224573739 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b56462e900 0x55b564630cf0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.001+0000 7f8b2cb13740 1 --2- 172.21.15.7:0/2224573739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b56461ed40 0x55b56461c630 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.001+0000 7f8b2cb13740 1 --2- 172.21.15.7:0/2224573739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b564614480 0x55b56461c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.001+0000 7f8b2cb13740 1 --2- 172.21.15.7:0/2224573739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b564613b60 0x55b56461bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.001+0000 7f8b2cb13740 1 -- 172.21.15.7:0/2224573739 >> 172.21.15.7:0/2224573739 conn(0x55b5646100f0 msgr2=0x55b56460f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:23.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.002+0000 7f8b037fe640 0 client.16992 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:23.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.002+0000 7f8b2cb13740 1 -- 172.21.15.7:0/2224573739 shutdown_connections 2024-09-19T08:52:23.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.002+0000 7f8b2cb13740 1 -- 172.21.15.7:0/2224573739 wait complete. 2024-09-19T08:52:23.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.002+0000 7f8b2cb13740 20 client.16992 trim_cache size 0 max 16384 2024-09-19T08:52:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.019+0000 7f8b2cb13740 1 Processor -- start 2024-09-19T08:52:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.019+0000 7f8b2cb13740 1 -- start start 2024-09-19T08:52:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.019+0000 7f8b2cb13740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b564613b60 0x55b56461aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.019+0000 7f8b2cb13740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b564614480 0x55b564636550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.019+0000 7f8b2cb13740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b56461ed40 0x55b564636a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.019+0000 7f8b2cb13740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8b241adfe0 con 0x55b56461ed40 2024-09-19T08:52:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.019+0000 7f8b2cb13740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8b241ab8b0 con 0x55b564614480 2024-09-19T08:52:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.019+0000 7f8b2cb13740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8b241a9720 con 0x55b564613b60 2024-09-19T08:52:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.019+0000 7f8b28cd7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b56461ed40 0x55b564636a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.019+0000 7f8b28cd7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b56461ed40 0x55b564636a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34748/0 (socket says 172.21.15.7:34748) 2024-09-19T08:52:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.019+0000 7f8b28cd7640 1 -- 172.21.15.7:0/483678265 learned_addr learned my addr 172.21.15.7:0/483678265 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.020+0000 7f8b237fe640 1 --2- 172.21.15.7:0/483678265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b564614480 0x55b564636550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.020+0000 7f8b28cd7640 1 -- 172.21.15.7:0/483678265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b564613b60 msgr2=0x55b56461aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.020+0000 7f8b28cd7640 1 --2- 172.21.15.7:0/483678265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b564613b60 0x55b56461aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.020+0000 7f8b28cd7640 1 -- 172.21.15.7:0/483678265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b564614480 msgr2=0x55b564636550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.020+0000 7f8b28cd7640 1 --2- 172.21.15.7:0/483678265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b564614480 0x55b564636550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.020+0000 7f8b28cd7640 1 -- 172.21.15.7:0/483678265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b564631320 con 0x55b56461ed40 2024-09-19T08:52:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.020+0000 7f8b237fe640 1 --2- 172.21.15.7:0/483678265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b564614480 0x55b564636550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.020+0000 7f8b28cd7640 1 --2- 172.21.15.7:0/483678265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b56461ed40 0x55b564636a90 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c010f80 tx=0x7f8b1c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524f4d1e5f644158 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.020+0000 7f8b09ffb640 1 -- 172.21.15.7:0/483678265 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c0134c0 con 0x55b56461ed40 2024-09-19T08:52:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.020+0000 7f8b09ffb640 1 -- 172.21.15.7:0/483678265 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b1c02b050 con 0x55b56461ed40 2024-09-19T08:52:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.020+0000 7f8b09ffb640 1 -- 172.21.15.7:0/483678265 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c005340 con 0x55b56461ed40 2024-09-19T08:52:23.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.021+0000 7f8b2cb13740 1 -- 172.21.15.7:0/483678265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b56461ed40 msgr2=0x55b564636a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:23.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.021+0000 7f8b2cb13740 1 --2- 172.21.15.7:0/483678265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b56461ed40 0x55b564636a90 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c010f80 tx=0x7f8b1c01c9f0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.021+0000 7f8b2cb13740 1 -- 172.21.15.7:0/483678265 shutdown_connections 2024-09-19T08:52:23.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.021+0000 7f8b2cb13740 1 --2- 172.21.15.7:0/483678265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b56461ed40 0x55b564636a90 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.021+0000 7f8b2cb13740 1 --2- 172.21.15.7:0/483678265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b564614480 0x55b564636550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.021+0000 7f8b2cb13740 1 --2- 172.21.15.7:0/483678265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b564613b60 0x55b56461aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.021+0000 7f8b2cb13740 1 -- 172.21.15.7:0/483678265 >> 172.21.15.7:0/483678265 conn(0x55b5646100f0 msgr2=0x55b56461a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:23.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.021+0000 7f8b2cb13740 1 -- 172.21.15.7:0/483678265 shutdown_connections 2024-09-19T08:52:23.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.021+0000 7f8b2cb13740 1 -- 172.21.15.7:0/483678265 wait complete. 2024-09-19T08:52:23.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.021+0000 7f8b2cb13740 1 -- start start 2024-09-19T08:52:23.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.022+0000 7f8b2cb13740 1 Processor -- start 2024-09-19T08:52:23.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.022+0000 7f8b2cb13740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b564613b60 0x55b564622a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:23.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.022+0000 7f8b2cb13740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b564614480 0x55b564622f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:23.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.022+0000 7f8b2cb13740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b56461ed40 0x55b564623480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:23.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.022+0000 7f8b2cb13740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8b241a9d70 con 0x55b564614480 2024-09-19T08:52:23.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.022+0000 7f8b2cb13740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8b241ab1e0 con 0x55b56461ed40 2024-09-19T08:52:23.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.022+0000 7f8b2cb13740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8b241aa440 con 0x55b564613b60 2024-09-19T08:52:23.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.022+0000 7f8b2cb13740 10 client.0 _ll_register_callbacks cb 0x7f8b1c020020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:23.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.022+0000 7f8b237fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b564614480 0x55b564622f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:23.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.022+0000 7f8b237fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b564614480 0x55b564622f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34760/0 (socket says 172.21.15.7:34760) 2024-09-19T08:52:23.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.022+0000 7f8b237fe640 1 -- 172.21.15.7:0/3764214605 learned_addr learned my addr 172.21.15.7:0/3764214605 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:23.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.022+0000 7f8b23fff640 1 --2- 172.21.15.7:0/3764214605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b564613b60 0x55b564622a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:23.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.022+0000 7f8b28cd7640 1 --2- 172.21.15.7:0/3764214605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b56461ed40 0x55b564623480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:23.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.022+0000 7f8b237fe640 1 -- 172.21.15.7:0/3764214605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b564613b60 msgr2=0x55b564622a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:23.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.022+0000 7f8b237fe640 1 --2- 172.21.15.7:0/3764214605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b564613b60 0x55b564622a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.022+0000 7f8b237fe640 1 -- 172.21.15.7:0/3764214605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b56461ed40 msgr2=0x55b564623480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:23.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.022+0000 7f8b237fe640 1 --2- 172.21.15.7:0/3764214605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b56461ed40 0x55b564623480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.022+0000 7f8b237fe640 1 -- 172.21.15.7:0/3764214605 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b564698520 con 0x55b564614480 2024-09-19T08:52:23.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.023+0000 7f8b237fe640 1 --2- 172.21.15.7:0/3764214605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b564614480 0x55b564622f40 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x55b564611470 tx=0x7f8b18009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55a6216ec558afc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:23.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.023+0000 7f8b037fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:23.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.023+0000 7f8b037fe640 1 -- 172.21.15.7:0/3764214605 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b18018700 con 0x55b564614480 2024-09-19T08:52:23.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.023+0000 7f8b037fe640 1 -- 172.21.15.7:0/3764214605 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7f8b180188a0 con 0x55b564614480 2024-09-19T08:52:23.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.023+0000 7f8b2cb13740 1 -- 172.21.15.7:0/3764214605 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b1c02b050 con 0x55b564614480 2024-09-19T08:52:23.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.023+0000 7f8b037fe640 1 -- 172.21.15.7:0/3764214605 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8b1802b050 con 0x55b564614480 2024-09-19T08:52:23.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.023+0000 7f8b2cb13740 10 client.16998 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:23.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.023+0000 7f8b2cb13740 1 -- 172.21.15.7:0/3764214605 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b5646997b0 con 0x55b564614480 2024-09-19T08:52:23.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.023+0000 7f8b037fe640 1 -- 172.21.15.7:0/3764214605 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b1c02b050 con 0x55b564614480 2024-09-19T08:52:23.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.023+0000 7f8b037fe640 1 -- 172.21.15.7:0/3764214605 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8b1801c3d0 con 0x55b564614480 2024-09-19T08:52:23.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.023+0000 7f8b2cb13740 10 client.16998 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:23.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.023+0000 7f8b2cb13740 10 client.16998 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:23.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.023+0000 7f8b2cb13740 20 client.16998 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:23.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.023+0000 7f8b2cb13740 1 --2- 172.21.15.7:0/3764214605 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b564699fe0 0x55b56469c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:23.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.023+0000 7f8b2cb13740 4 client.16998 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:52:23.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.023+0000 7f8b2cb13740 1 -- 172.21.15.7:0/3764214605 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b564580d00 con 0x55b564699fe0 2024-09-19T08:52:23.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.024+0000 7f8b23fff640 1 --2- 172.21.15.7:0/3764214605 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b564699fe0 0x55b56469c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:23.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.024+0000 7f8b23fff640 1 --2- 172.21.15.7:0/3764214605 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b564699fe0 0x55b56469c400 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=702355f27f33aade server_cookie=10dba040427da717 in_seq=0 out_seq=0 2024-09-19T08:52:23.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.024+0000 7f8b037fe640 10 client.16998 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:23.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.025+0000 7f8b037fe640 1 -- 172.21.15.7:0/3764214605 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b564580d00 con 0x55b564699fe0 2024-09-19T08:52:23.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.025+0000 7f8b037fe640 10 client.16998 handle_command_reply: tid=0 2024-09-19T08:52:23.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.025+0000 7f8b2cb13740 1 client.16998 shutdown 2024-09-19T08:52:23.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.026+0000 7f8b2cb13740 1 -- 172.21.15.7:0/3764214605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b564614480 msgr2=0x55b564622f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:23.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.026+0000 7f8b2cb13740 1 --2- 172.21.15.7:0/3764214605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b564614480 0x55b564622f40 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x55b564611470 tx=0x7f8b18009b20 comp rx=0 tx=0).stop 2024-09-19T08:52:23.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.026+0000 7f8b2cb13740 1 -- 172.21.15.7:0/3764214605 shutdown_connections 2024-09-19T08:52:23.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.026+0000 7f8b2cb13740 1 --2- 172.21.15.7:0/3764214605 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b564699fe0 0x55b56469c400 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.026+0000 7f8b2cb13740 1 --2- 172.21.15.7:0/3764214605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b56461ed40 0x55b564623480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.026+0000 7f8b2cb13740 1 --2- 172.21.15.7:0/3764214605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b564614480 0x55b564622f40 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.026+0000 7f8b2cb13740 1 --2- 172.21.15.7:0/3764214605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b564613b60 0x55b564622a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.026+0000 7f8b2cb13740 1 -- 172.21.15.7:0/3764214605 >> 172.21.15.7:0/3764214605 conn(0x55b5646100f0 msgr2=0x55b564615dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:23.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.026+0000 7f8b037fe640 0 client.16998 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:23.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.026+0000 7f8b2cb13740 1 -- 172.21.15.7:0/3764214605 shutdown_connections 2024-09-19T08:52:23.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.026+0000 7f8b2cb13740 1 -- 172.21.15.7:0/3764214605 wait complete. 2024-09-19T08:52:23.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.026+0000 7f8b2cb13740 20 client.16998 trim_cache size 0 max 16384 2024-09-19T08:52:23.031 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:52:23.031 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-19T08:52:23.031 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "eb8129c2-8e3f-44f0-ac90-5b57740b3ea2", 2024-09-19T08:52:23.031 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-19T08:52:23.031 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:52:23.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.027+0000 7f8b2a73a640 1 -- 172.21.15.7:0/3539114984 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8b0c0a3430 msgr2=0x7f8b0c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:23.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.027+0000 7f8b2a73a640 1 --2- 172.21.15.7:0/3539114984 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8b0c0a3430 0x7f8b0c0a58f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c021000 tx=0x7f8b1c01e000 comp rx=0 tx=0).stop 2024-09-19T08:52:23.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.027+0000 7f8b2a73a640 1 -- 172.21.15.7:0/3539114984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b24100e20 msgr2=0x7f8b24199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:23.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.027+0000 7f8b2a73a640 1 --2- 172.21.15.7:0/3539114984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b24100e20 0x7f8b24199430 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f8b14006010 tx=0x7f8b14003c10 comp rx=0 tx=0).stop 2024-09-19T08:52:23.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.027+0000 7f8b2a73a640 1 -- 172.21.15.7:0/3539114984 shutdown_connections 2024-09-19T08:52:23.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.027+0000 7f8b2a73a640 1 --2- 172.21.15.7:0/3539114984 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8b0c0a3430 0x7f8b0c0a58f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.027+0000 7f8b2a73a640 1 --2- 172.21.15.7:0/3539114984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b24102ef0 0x7f8b241a44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.027+0000 7f8b2a73a640 1 --2- 172.21.15.7:0/3539114984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b24102570 0x7f8b24199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.027+0000 7f8b2a73a640 1 --2- 172.21.15.7:0/3539114984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b24100e20 0x7f8b24199430 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.027+0000 7f8b2a73a640 1 -- 172.21.15.7:0/3539114984 >> 172.21.15.7:0/3539114984 conn(0x7f8b240fc7d0 msgr2=0x7f8b240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:23.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.027+0000 7f8b2a73a640 1 -- 172.21.15.7:0/3539114984 shutdown_connections 2024-09-19T08:52:23.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:23.027+0000 7f8b2a73a640 1 -- 172.21.15.7:0/3539114984 wait complete. 2024-09-19T08:52:23.722 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:52:23.979 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:24.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.457+0000 7fe56d0bb640 1 -- 172.21.15.7:0/809630459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5681082a0 msgr2=0x7fe56810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:24.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.457+0000 7fe56d0bb640 1 --2- 172.21.15.7:0/809630459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5681082a0 0x7fe56810ec40 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fe560009cd0 tx=0x7fe56002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.457+0000 7fe56d0bb640 1 -- 172.21.15.7:0/809630459 shutdown_connections 2024-09-19T08:52:24.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.457+0000 7fe56d0bb640 1 --2- 172.21.15.7:0/809630459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5681082a0 0x7fe56810ec40 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.457+0000 7fe56d0bb640 1 --2- 172.21.15.7:0/809630459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5681036e0 0x7fe568107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.457+0000 7fe56d0bb640 1 --2- 172.21.15.7:0/809630459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe568102d30 0x7fe568103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.457+0000 7fe56d0bb640 1 -- 172.21.15.7:0/809630459 >> 172.21.15.7:0/809630459 conn(0x7fe5680fc7d0 msgr2=0x7fe5680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:24.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.458+0000 7fe56d0bb640 1 -- 172.21.15.7:0/809630459 shutdown_connections 2024-09-19T08:52:24.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.458+0000 7fe56d0bb640 1 -- 172.21.15.7:0/809630459 wait complete. 2024-09-19T08:52:24.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.458+0000 7fe56d0bb640 1 Processor -- start 2024-09-19T08:52:24.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.459+0000 7fe56d0bb640 1 -- start start 2024-09-19T08:52:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.459+0000 7fe56d0bb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe568102d30 0x7fe568100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.459+0000 7fe56d0bb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5681036e0 0x7fe568100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.459+0000 7fe56d0bb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5681082a0 0x7fe568101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.459+0000 7fe56d0bb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe5681120f0 con 0x7fe5681036e0 2024-09-19T08:52:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.459+0000 7fe56d0bb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe568111f70 con 0x7fe5681082a0 2024-09-19T08:52:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.459+0000 7fe56d0bb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe568112270 con 0x7fe568102d30 2024-09-19T08:52:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.459+0000 7fe56659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5681036e0 0x7fe568100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.459+0000 7fe56659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5681036e0 0x7fe568100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43828/0 (socket says 172.21.15.7:43828) 2024-09-19T08:52:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.459+0000 7fe56659c640 1 -- 172.21.15.7:0/2262548036 learned_addr learned my addr 172.21.15.7:0/2262548036 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.459+0000 7fe566d9d640 1 --2- 172.21.15.7:0/2262548036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe568102d30 0x7fe568100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.459+0000 7fe56759e640 1 --2- 172.21.15.7:0/2262548036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5681082a0 0x7fe568101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.459+0000 7fe56659c640 1 -- 172.21.15.7:0/2262548036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe568102d30 msgr2=0x7fe568100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.459+0000 7fe56659c640 1 --2- 172.21.15.7:0/2262548036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe568102d30 0x7fe568100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.459+0000 7fe56659c640 1 -- 172.21.15.7:0/2262548036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5681082a0 msgr2=0x7fe568101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.459+0000 7fe56659c640 1 --2- 172.21.15.7:0/2262548036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5681082a0 0x7fe568101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.459+0000 7fe56659c640 1 -- 172.21.15.7:0/2262548036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5681a6a50 con 0x7fe5681036e0 2024-09-19T08:52:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.459+0000 7fe56659c640 1 --2- 172.21.15.7:0/2262548036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5681036e0 0x7fe568100ed0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00e9f0 tx=0x7fe55c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.460+0000 7fe54ffff640 1 -- 172.21.15.7:0/2262548036 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c00ccc0 con 0x7fe5681036e0 2024-09-19T08:52:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.460+0000 7fe54ffff640 1 -- 172.21.15.7:0/2262548036 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe55c010910 con 0x7fe5681036e0 2024-09-19T08:52:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.460+0000 7fe54ffff640 1 -- 172.21.15.7:0/2262548036 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c018920 con 0x7fe5681036e0 2024-09-19T08:52:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.460+0000 7fe56d0bb640 1 -- 172.21.15.7:0/2262548036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5681a6d40 con 0x7fe5681036e0 2024-09-19T08:52:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.460+0000 7fe56d0bb640 1 -- 172.21.15.7:0/2262548036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5681a7270 con 0x7fe5681036e0 2024-09-19T08:52:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.462+0000 7fe54ffff640 1 -- 172.21.15.7:0/2262548036 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fe55c010ac0 con 0x7fe5681036e0 2024-09-19T08:52:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.462+0000 7fe56f494740 1 Processor -- start 2024-09-19T08:52:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.462+0000 7fe56f494740 1 -- start start 2024-09-19T08:52:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.463+0000 7fe56f494740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709c84a0 0x55cf709c8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.463+0000 7fe56f494740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf709c8dc0 0x55cf709d3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.463+0000 7fe56f494740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709d3680 0x55cf709d5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.463+0000 7fe56f494740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cf7092e2e0 con 0x55cf709d3680 2024-09-19T08:52:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.463+0000 7fe56f494740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cf708d5ce0 con 0x55cf709c84a0 2024-09-19T08:52:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.463+0000 7fe56f494740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cf7092a2a0 con 0x55cf709c8dc0 2024-09-19T08:52:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.463+0000 7fe56659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709d3680 0x55cf709d5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.463+0000 7fe56659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709d3680 0x55cf709d5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43834/0 (socket says 172.21.15.7:43834) 2024-09-19T08:52:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.463+0000 7fe56659c640 1 -- 172.21.15.7:0/3987550976 learned_addr learned my addr 172.21.15.7:0/3987550976 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.463+0000 7fe56759e640 1 --2- 172.21.15.7:0/3987550976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709c84a0 0x55cf709c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.463+0000 7fe566d9d640 1 --2- 172.21.15.7:0/3987550976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf709c8dc0 0x55cf709d3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.463+0000 7fe54ffff640 1 --2- 172.21.15.7:0/2262548036 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe5500a3430 0x7fe5500a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.463+0000 7fe56659c640 1 -- 172.21.15.7:0/3987550976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf709c8dc0 msgr2=0x55cf709d3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.463+0000 7fe56659c640 1 --2- 172.21.15.7:0/3987550976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf709c8dc0 0x55cf709d3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.463+0000 7fe56659c640 1 -- 172.21.15.7:0/3987550976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709c84a0 msgr2=0x55cf709c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.463+0000 7fe56659c640 1 --2- 172.21.15.7:0/3987550976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709c84a0 0x55cf709c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.463+0000 7fe56659c640 1 -- 172.21.15.7:0/3987550976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf708ba440 con 0x55cf709d3680 2024-09-19T08:52:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.463+0000 7fe56759e640 1 --2- 172.21.15.7:0/3987550976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709c84a0 0x55cf709c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.463+0000 7fe56759e640 1 --2- 172.21.15.7:0/2262548036 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe5500a3430 0x7fe5500a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.463+0000 7fe56659c640 1 --2- 172.21.15.7:0/3987550976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709d3680 0x55cf709d5a70 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fe55c0cd550 tx=0x7fe55c0ab9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2478b49c4f83784 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.464+0000 7fe54ffff640 1 -- 172.21.15.7:0/2262548036 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7fe55c0cff60 con 0x7fe5681036e0 2024-09-19T08:52:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.464+0000 7fe54d7fa640 1 -- 172.21.15.7:0/3987550976 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c026030 con 0x55cf709d3680 2024-09-19T08:52:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.464+0000 7fe54d7fa640 1 -- 172.21.15.7:0/3987550976 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe55c0a6100 con 0x55cf709d3680 2024-09-19T08:52:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.464+0000 7fe54d7fa640 1 -- 172.21.15.7:0/3987550976 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c09c250 con 0x55cf709d3680 2024-09-19T08:52:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.464+0000 7fe56f494740 1 -- 172.21.15.7:0/3987550976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709d3680 msgr2=0x55cf709d5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.464+0000 7fe56759e640 1 --2- 172.21.15.7:0/2262548036 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe5500a3430 0x7fe5500a58f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe560005e30 tx=0x7fe56003f040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.464+0000 7fe56f494740 1 --2- 172.21.15.7:0/3987550976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709d3680 0x55cf709d5a70 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fe55c0cd550 tx=0x7fe55c0ab9e0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.464+0000 7fe56f494740 1 -- 172.21.15.7:0/3987550976 shutdown_connections 2024-09-19T08:52:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.464+0000 7fe56f494740 1 --2- 172.21.15.7:0/3987550976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709d3680 0x55cf709d5a70 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.464+0000 7fe56f494740 1 --2- 172.21.15.7:0/3987550976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf709c8dc0 0x55cf709d3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.464+0000 7fe56f494740 1 --2- 172.21.15.7:0/3987550976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709c84a0 0x55cf709c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.464+0000 7fe56f494740 1 -- 172.21.15.7:0/3987550976 >> 172.21.15.7:0/3987550976 conn(0x55cf709c4a30 msgr2=0x55cf709c4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.465+0000 7fe56f494740 1 -- 172.21.15.7:0/3987550976 shutdown_connections 2024-09-19T08:52:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.465+0000 7fe56f494740 1 -- 172.21.15.7:0/3987550976 wait complete. 2024-09-19T08:52:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.465+0000 7fe56f494740 1 -- start start 2024-09-19T08:52:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.465+0000 7fe56f494740 1 Processor -- start 2024-09-19T08:52:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.465+0000 7fe56f494740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709c84a0 0x55cf709d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.465+0000 7fe56f494740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709c8dc0 0x55cf709d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.465+0000 7fe56f494740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf709d3680 0x55cf709d0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.465+0000 7fe56f494740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cf709d6250 con 0x55cf709c8dc0 2024-09-19T08:52:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.465+0000 7fe56f494740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cf708e9050 con 0x55cf709c84a0 2024-09-19T08:52:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.465+0000 7fe56f494740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cf709d63d0 con 0x55cf709d3680 2024-09-19T08:52:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.465+0000 7fe56f494740 10 client.0 _ll_register_callbacks cb 0x55cf70929160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.465+0000 7fe56659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709c8dc0 0x55cf709d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.465+0000 7fe56659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709c8dc0 0x55cf709d0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43836/0 (socket says 172.21.15.7:43836) 2024-09-19T08:52:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.465+0000 7fe56659c640 1 -- 172.21.15.7:0/1987318691 learned_addr learned my addr 172.21.15.7:0/1987318691 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.465+0000 7fe566d9d640 1 --2- 172.21.15.7:0/1987318691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709c84a0 0x55cf709d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.466+0000 7fe56659c640 1 -- 172.21.15.7:0/1987318691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf709d3680 msgr2=0x55cf709d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.466+0000 7fe56659c640 1 --2- 172.21.15.7:0/1987318691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf709d3680 0x55cf709d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.466+0000 7fe56659c640 1 -- 172.21.15.7:0/1987318691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709c84a0 msgr2=0x55cf709d2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.466+0000 7fe56659c640 1 --2- 172.21.15.7:0/1987318691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709c84a0 0x55cf709d2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.466+0000 7fe56659c640 1 -- 172.21.15.7:0/1987318691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf7069f3c0 con 0x55cf709c8dc0 2024-09-19T08:52:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.466+0000 7fe566d9d640 1 --2- 172.21.15.7:0/1987318691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709c84a0 0x55cf709d2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.466+0000 7fe56659c640 1 --2- 172.21.15.7:0/1987318691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709c8dc0 0x55cf709d0210 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fe55c09c1e0 tx=0x7fe55c009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf13964cc195aa72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.466+0000 7fe54aff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.466+0000 7fe54aff5640 1 -- 172.21.15.7:0/1987318691 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c09c020 con 0x55cf709c8dc0 2024-09-19T08:52:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.466+0000 7fe54aff5640 1 -- 172.21.15.7:0/1987318691 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7fe55c0a0200 con 0x55cf709c8dc0 2024-09-19T08:52:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.466+0000 7fe56f494740 1 -- 172.21.15.7:0/1987318691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cf7093b850 con 0x55cf709c8dc0 2024-09-19T08:52:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.466+0000 7fe54aff5640 1 -- 172.21.15.7:0/1987318691 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe55c09bd90 con 0x55cf709c8dc0 2024-09-19T08:52:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.466+0000 7fe56f494740 10 client.17010 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.466+0000 7fe56f494740 1 -- 172.21.15.7:0/1987318691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cf709e1bc0 con 0x55cf709c8dc0 2024-09-19T08:52:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.466+0000 7fe54aff5640 1 -- 172.21.15.7:0/1987318691 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55cf7093b850 con 0x55cf709c8dc0 2024-09-19T08:52:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.466+0000 7fe54aff5640 1 -- 172.21.15.7:0/1987318691 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe55c097fa0 con 0x55cf709c8dc0 2024-09-19T08:52:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.466+0000 7fe56f494740 10 client.17010 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.466+0000 7fe56f494740 10 client.17010 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.466+0000 7fe56f494740 20 client.17010 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.466+0000 7fe56f494740 1 --2- 172.21.15.7:0/1987318691 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55cf709e2f10 0x55cf709e5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.466+0000 7fe56f494740 4 client.17010 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.466+0000 7fe56f494740 1 -- 172.21.15.7:0/1987318691 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf70935d60 con 0x55cf709e2f10 2024-09-19T08:52:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.467+0000 7fe566d9d640 1 --2- 172.21.15.7:0/1987318691 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55cf709e2f10 0x55cf709e5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.467+0000 7fe566d9d640 1 --2- 172.21.15.7:0/1987318691 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55cf709e2f10 0x55cf709e5300 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc58abacd17efbfd server_cookie=d50a6c05ea4db6c0 in_seq=0 out_seq=0 2024-09-19T08:52:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.467+0000 7fe54aff5640 10 client.17010 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.468+0000 7fe54aff5640 1 -- 172.21.15.7:0/1987318691 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cf70935d60 con 0x55cf709e2f10 2024-09-19T08:52:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.468+0000 7fe54aff5640 10 client.17010 handle_command_reply: tid=0 2024-09-19T08:52:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.468+0000 7fe56f494740 1 client.17010 shutdown 2024-09-19T08:52:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.468+0000 7fe56f494740 1 -- 172.21.15.7:0/1987318691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709c8dc0 msgr2=0x55cf709d0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.468+0000 7fe56f494740 1 --2- 172.21.15.7:0/1987318691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709c8dc0 0x55cf709d0210 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fe55c09c1e0 tx=0x7fe55c009710 comp rx=0 tx=0).stop 2024-09-19T08:52:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.468+0000 7fe56f494740 1 -- 172.21.15.7:0/1987318691 shutdown_connections 2024-09-19T08:52:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.468+0000 7fe56f494740 1 --2- 172.21.15.7:0/1987318691 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55cf709e2f10 0x55cf709e5300 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.468+0000 7fe56f494740 1 --2- 172.21.15.7:0/1987318691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf709d3680 0x55cf709d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.468+0000 7fe56f494740 1 --2- 172.21.15.7:0/1987318691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709c8dc0 0x55cf709d0210 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.468+0000 7fe54aff5640 0 client.17010 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.468+0000 7fe56f494740 1 --2- 172.21.15.7:0/1987318691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709c84a0 0x55cf709d2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.468+0000 7fe56f494740 1 -- 172.21.15.7:0/1987318691 >> 172.21.15.7:0/1987318691 conn(0x55cf709c4a30 msgr2=0x55cf709ca710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.468+0000 7fe56f494740 1 -- 172.21.15.7:0/1987318691 shutdown_connections 2024-09-19T08:52:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.468+0000 7fe56f494740 1 -- 172.21.15.7:0/1987318691 wait complete. 2024-09-19T08:52:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.468+0000 7fe56f494740 20 client.17010 trim_cache size 0 max 16384 2024-09-19T08:52:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.485+0000 7fe56f494740 1 Processor -- start 2024-09-19T08:52:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.485+0000 7fe56f494740 1 -- start start 2024-09-19T08:52:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.485+0000 7fe56f494740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709c84a0 0x55cf709e8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.485+0000 7fe56f494740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf709c8dc0 0x55cf709e8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.486+0000 7fe56f494740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709d3680 0x55cf709cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.486+0000 7fe56f494740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe5681b2480 con 0x55cf709c84a0 2024-09-19T08:52:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.486+0000 7fe56f494740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe5681afd50 con 0x55cf709d3680 2024-09-19T08:52:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.486+0000 7fe56f494740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe5681adbc0 con 0x55cf709c8dc0 2024-09-19T08:52:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.486+0000 7fe566d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709c84a0 0x55cf709e8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.486+0000 7fe566d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709c84a0 0x55cf709e8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43838/0 (socket says 172.21.15.7:43838) 2024-09-19T08:52:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.486+0000 7fe566d9d640 1 -- 172.21.15.7:0/2756584630 learned_addr learned my addr 172.21.15.7:0/2756584630 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.486+0000 7fe566d9d640 1 -- 172.21.15.7:0/2756584630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf709c8dc0 msgr2=0x55cf709e8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.486+0000 7fe566d9d640 1 --2- 172.21.15.7:0/2756584630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf709c8dc0 0x55cf709e8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.486+0000 7fe56759e640 1 --2- 172.21.15.7:0/2756584630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709d3680 0x55cf709cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.486+0000 7fe566d9d640 1 -- 172.21.15.7:0/2756584630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709d3680 msgr2=0x55cf709cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.486+0000 7fe566d9d640 1 --2- 172.21.15.7:0/2756584630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709d3680 0x55cf709cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.486+0000 7fe566d9d640 1 -- 172.21.15.7:0/2756584630 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf709d32d0 con 0x55cf709c84a0 2024-09-19T08:52:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.486+0000 7fe56759e640 1 --2- 172.21.15.7:0/2756584630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709d3680 0x55cf709cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.486+0000 7fe566d9d640 1 --2- 172.21.15.7:0/2756584630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709c84a0 0x55cf709e8320 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x55cf709d6430 tx=0x7fe5580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ff3f47032d6f04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.486+0000 7fe54cff9640 1 -- 172.21.15.7:0/2756584630 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe558010430 con 0x55cf709c84a0 2024-09-19T08:52:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.486+0000 7fe54cff9640 1 -- 172.21.15.7:0/2756584630 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe558010ab0 con 0x55cf709c84a0 2024-09-19T08:52:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.486+0000 7fe54cff9640 1 -- 172.21.15.7:0/2756584630 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55801ea80 con 0x55cf709c84a0 2024-09-19T08:52:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.487+0000 7fe56f494740 1 -- 172.21.15.7:0/2756584630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709c84a0 msgr2=0x55cf709e8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.487+0000 7fe56f494740 1 --2- 172.21.15.7:0/2756584630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709c84a0 0x55cf709e8320 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x55cf709d6430 tx=0x7fe5580046c0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.487+0000 7fe56f494740 1 -- 172.21.15.7:0/2756584630 shutdown_connections 2024-09-19T08:52:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.487+0000 7fe56f494740 1 --2- 172.21.15.7:0/2756584630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709d3680 0x55cf709cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.487+0000 7fe56f494740 1 --2- 172.21.15.7:0/2756584630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf709c8dc0 0x55cf709e8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.487+0000 7fe56f494740 1 --2- 172.21.15.7:0/2756584630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709c84a0 0x55cf709e8320 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.487+0000 7fe56f494740 1 -- 172.21.15.7:0/2756584630 >> 172.21.15.7:0/2756584630 conn(0x55cf709c4a30 msgr2=0x55cf709cb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.487+0000 7fe56f494740 1 -- 172.21.15.7:0/2756584630 shutdown_connections 2024-09-19T08:52:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.487+0000 7fe56f494740 1 -- 172.21.15.7:0/2756584630 wait complete. 2024-09-19T08:52:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.487+0000 7fe56f494740 1 -- start start 2024-09-19T08:52:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.487+0000 7fe56f494740 1 Processor -- start 2024-09-19T08:52:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.488+0000 7fe56f494740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf709c84a0 0x55cf709e67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.488+0000 7fe56f494740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709c8dc0 0x55cf709e6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.488+0000 7fe56f494740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709d3680 0x55cf70a4c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.488+0000 7fe56f494740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe5681ae210 con 0x55cf709c8dc0 2024-09-19T08:52:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.488+0000 7fe56f494740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe5681af680 con 0x55cf709d3680 2024-09-19T08:52:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.488+0000 7fe56f494740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe5681ae8e0 con 0x55cf709c84a0 2024-09-19T08:52:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.488+0000 7fe56f494740 10 client.0 _ll_register_callbacks cb 0x7fe558009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:24.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.488+0000 7fe56659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709c8dc0 0x55cf709e6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:24.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.488+0000 7fe56659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709c8dc0 0x55cf709e6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43848/0 (socket says 172.21.15.7:43848) 2024-09-19T08:52:24.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.488+0000 7fe56659c640 1 -- 172.21.15.7:0/2667626719 learned_addr learned my addr 172.21.15.7:0/2667626719 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:24.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.488+0000 7fe56759e640 1 --2- 172.21.15.7:0/2667626719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709d3680 0x55cf70a4c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:24.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.488+0000 7fe566d9d640 1 --2- 172.21.15.7:0/2667626719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf709c84a0 0x55cf709e67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:24.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.488+0000 7fe56659c640 1 -- 172.21.15.7:0/2667626719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf709c84a0 msgr2=0x55cf709e67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:24.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.488+0000 7fe56659c640 1 --2- 172.21.15.7:0/2667626719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf709c84a0 0x55cf709e67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.488+0000 7fe56659c640 1 -- 172.21.15.7:0/2667626719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709d3680 msgr2=0x55cf70a4c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:24.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.488+0000 7fe56659c640 1 --2- 172.21.15.7:0/2667626719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709d3680 0x55cf70a4c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.488+0000 7fe56659c640 1 -- 172.21.15.7:0/2667626719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf70a4cd90 con 0x55cf709c8dc0 2024-09-19T08:52:24.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.488+0000 7fe566d9d640 1 --2- 172.21.15.7:0/2667626719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf709c84a0 0x55cf709e67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:24.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.488+0000 7fe56659c640 1 --2- 172.21.15.7:0/2667626719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709c8dc0 0x55cf709e6d10 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fe55c000c00 tx=0x7fe55c0cdaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cba87a061530713 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:24.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.488+0000 7fe54aff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.488+0000 7fe54aff5640 1 -- 172.21.15.7:0/2667626719 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c09c020 con 0x55cf709c8dc0 2024-09-19T08:52:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.489+0000 7fe54aff5640 1 -- 172.21.15.7:0/2667626719 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7fe55c0d32c0 con 0x55cf709c8dc0 2024-09-19T08:52:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.489+0000 7fe56f494740 1 -- 172.21.15.7:0/2667626719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe558010ab0 con 0x55cf709c8dc0 2024-09-19T08:52:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.489+0000 7fe54aff5640 1 -- 172.21.15.7:0/2667626719 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe55c09bbb0 con 0x55cf709c8dc0 2024-09-19T08:52:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.489+0000 7fe56f494740 10 client.17016 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.489+0000 7fe56f494740 1 -- 172.21.15.7:0/2667626719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cf70a4dfe0 con 0x55cf709c8dc0 2024-09-19T08:52:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.489+0000 7fe54aff5640 1 -- 172.21.15.7:0/2667626719 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe558010ab0 con 0x55cf709c8dc0 2024-09-19T08:52:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.489+0000 7fe54aff5640 1 -- 172.21.15.7:0/2667626719 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe55c0a00d0 con 0x55cf709c8dc0 2024-09-19T08:52:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.489+0000 7fe56f494740 10 client.17016 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.489+0000 7fe56f494740 10 client.17016 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.489+0000 7fe56f494740 20 client.17016 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.489+0000 7fe56f494740 1 --2- 172.21.15.7:0/2667626719 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55cf70a4e5d0 0x55cf70a509f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.489+0000 7fe56f494740 4 client.17016 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:52:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.489+0000 7fe56f494740 1 -- 172.21.15.7:0/2667626719 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cf708b2210 con 0x55cf70a4e5d0 2024-09-19T08:52:24.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.489+0000 7fe566d9d640 1 --2- 172.21.15.7:0/2667626719 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55cf70a4e5d0 0x55cf70a509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:24.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.490+0000 7fe54aff5640 10 client.17016 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:24.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.490+0000 7fe566d9d640 1 --2- 172.21.15.7:0/2667626719 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55cf70a4e5d0 0x55cf70a509f0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7356bc2eb994c32 server_cookie=13437ef19b789bb8 in_seq=0 out_seq=0 2024-09-19T08:52:24.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.490+0000 7fe54aff5640 1 -- 172.21.15.7:0/2667626719 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55cf708b2210 con 0x55cf70a4e5d0 2024-09-19T08:52:24.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.490+0000 7fe54aff5640 10 client.17016 handle_command_reply: tid=0 2024-09-19T08:52:24.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.490+0000 7fe56f494740 1 client.17016 shutdown 2024-09-19T08:52:24.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.490+0000 7fe56f494740 1 -- 172.21.15.7:0/2667626719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709c8dc0 msgr2=0x55cf709e6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:24.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.490+0000 7fe56f494740 1 --2- 172.21.15.7:0/2667626719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709c8dc0 0x55cf709e6d10 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fe55c000c00 tx=0x7fe55c0cdaf0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.490+0000 7fe56f494740 1 -- 172.21.15.7:0/2667626719 shutdown_connections 2024-09-19T08:52:24.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.490+0000 7fe56f494740 1 --2- 172.21.15.7:0/2667626719 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55cf70a4e5d0 0x55cf70a509f0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.490+0000 7fe56f494740 1 --2- 172.21.15.7:0/2667626719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf709d3680 0x55cf70a4c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.490+0000 7fe54aff5640 0 client.17016 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:24.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.490+0000 7fe56f494740 1 --2- 172.21.15.7:0/2667626719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf709c8dc0 0x55cf709e6d10 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.490+0000 7fe56f494740 1 --2- 172.21.15.7:0/2667626719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf709c84a0 0x55cf709e67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.490+0000 7fe56f494740 1 -- 172.21.15.7:0/2667626719 >> 172.21.15.7:0/2667626719 conn(0x55cf709c4a30 msgr2=0x55cf709d1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:24.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.490+0000 7fe56f494740 1 -- 172.21.15.7:0/2667626719 shutdown_connections 2024-09-19T08:52:24.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.490+0000 7fe56f494740 1 -- 172.21.15.7:0/2667626719 wait complete. 2024-09-19T08:52:24.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.490+0000 7fe56f494740 20 client.17016 trim_cache size 0 max 16384 2024-09-19T08:52:24.499 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:52:24.499 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-19T08:52:24.499 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-09-19T08:52:24.499 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:52:24.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.491+0000 7fe56d0bb640 1 -- 172.21.15.7:0/2262548036 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe5500a3430 msgr2=0x7fe5500a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:24.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.491+0000 7fe56d0bb640 1 --2- 172.21.15.7:0/2262548036 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe5500a3430 0x7fe5500a58f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe560005e30 tx=0x7fe56003f040 comp rx=0 tx=0).stop 2024-09-19T08:52:24.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.491+0000 7fe56d0bb640 1 -- 172.21.15.7:0/2262548036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5681036e0 msgr2=0x7fe568100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:24.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.491+0000 7fe56d0bb640 1 --2- 172.21.15.7:0/2262548036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5681036e0 0x7fe568100ed0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00e9f0 tx=0x7fe55c00eeb0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.491+0000 7fe56d0bb640 1 -- 172.21.15.7:0/2262548036 shutdown_connections 2024-09-19T08:52:24.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.491+0000 7fe56d0bb640 1 --2- 172.21.15.7:0/2262548036 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe5500a3430 0x7fe5500a58f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.491+0000 7fe56d0bb640 1 --2- 172.21.15.7:0/2262548036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5681082a0 0x7fe568101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.491+0000 7fe56d0bb640 1 --2- 172.21.15.7:0/2262548036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5681036e0 0x7fe568100ed0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.491+0000 7fe56d0bb640 1 --2- 172.21.15.7:0/2262548036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe568102d30 0x7fe568100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.491+0000 7fe56d0bb640 1 -- 172.21.15.7:0/2262548036 >> 172.21.15.7:0/2262548036 conn(0x7fe5680fc7d0 msgr2=0x7fe568106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.491+0000 7fe56d0bb640 1 -- 172.21.15.7:0/2262548036 shutdown_connections 2024-09-19T08:52:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:24.491+0000 7fe56d0bb640 1 -- 172.21.15.7:0/2262548036 wait complete. 2024-09-19T08:52:24.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:24 smithi007 ceph-mon[31221]: scrub queued for path: / 2024-09-19T08:52:24.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:24 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:24.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:24 smithi007 ceph-mon[31221]: scrub summary: active paths [/] 2024-09-19T08:52:24.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:24 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:24.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:24 smithi007 ceph-mon[31221]: pgmap v243: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:52:24.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:24 smithi007 ceph-mon[31221]: scrub summary: idle 2024-09-19T08:52:24.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:24 smithi044 ceph-mon[35072]: scrub queued for path: / 2024-09-19T08:52:24.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:24 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:24.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:24 smithi044 ceph-mon[35072]: scrub summary: active paths [/] 2024-09-19T08:52:24.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:24 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:24.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:24 smithi044 ceph-mon[35072]: pgmap v243: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:52:24.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:24 smithi044 ceph-mon[35072]: scrub summary: idle 2024-09-19T08:52:24.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:24 smithi175 ceph-mon[35688]: scrub queued for path: / 2024-09-19T08:52:24.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:24 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:24.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:24 smithi175 ceph-mon[35688]: scrub summary: active paths [/] 2024-09-19T08:52:24.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:24 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:24.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:24 smithi175 ceph-mon[35688]: pgmap v243: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:52:24.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:24 smithi175 ceph-mon[35688]: scrub summary: idle 2024-09-19T08:52:25.393 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:52:25.394 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:52:25.663 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:26.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.139+0000 7f51da12f640 1 -- 172.21.15.7:0/537055976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51d4102ef0 msgr2=0x7f51d410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:26.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.139+0000 7f51da12f640 1 --2- 172.21.15.7:0/537055976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51d4102ef0 0x7f51d410da40 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f51cc009ca0 tx=0x7f51cc02a950 comp rx=0 tx=0).stop 2024-09-19T08:52:26.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.139+0000 7f51da12f640 1 -- 172.21.15.7:0/537055976 shutdown_connections 2024-09-19T08:52:26.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.139+0000 7f51da12f640 1 --2- 172.21.15.7:0/537055976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51d4102ef0 0x7f51d410da40 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:26.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.139+0000 7f51da12f640 1 --2- 172.21.15.7:0/537055976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51d4102570 0x7f51d41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:26.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.139+0000 7f51da12f640 1 --2- 172.21.15.7:0/537055976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51d4100e20 0x7f51d4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:26.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.139+0000 7f51da12f640 1 -- 172.21.15.7:0/537055976 >> 172.21.15.7:0/537055976 conn(0x7f51d40fc7d0 msgr2=0x7f51d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:26.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.139+0000 7f51da12f640 1 -- 172.21.15.7:0/537055976 shutdown_connections 2024-09-19T08:52:26.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.139+0000 7f51da12f640 1 -- 172.21.15.7:0/537055976 wait complete. 2024-09-19T08:52:26.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.140+0000 7f51da12f640 1 Processor -- start 2024-09-19T08:52:26.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.140+0000 7f51da12f640 1 -- start start 2024-09-19T08:52:26.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.140+0000 7f51da12f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51d4100e20 0x7f51d41993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:26.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.140+0000 7f51da12f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51d4102570 0x7f51d41998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:26.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.140+0000 7f51da12f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51d4102ef0 0x7f51d4199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:26.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.140+0000 7f51da12f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f51d4110f80 con 0x7f51d4100e20 2024-09-19T08:52:26.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.141+0000 7f51da12f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f51d4110e00 con 0x7f51d4102ef0 2024-09-19T08:52:26.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.141+0000 7f51da12f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f51d4111100 con 0x7f51d4102570 2024-09-19T08:52:26.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.141+0000 7f51d37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51d4100e20 0x7f51d41993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:26.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.141+0000 7f51d37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51d4100e20 0x7f51d41993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43872/0 (socket says 172.21.15.7:43872) 2024-09-19T08:52:26.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.141+0000 7f51d37fe640 1 -- 172.21.15.7:0/582048372 learned_addr learned my addr 172.21.15.7:0/582048372 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:26.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.141+0000 7f51d3fff640 1 --2- 172.21.15.7:0/582048372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51d4102ef0 0x7f51d4199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:26.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.141+0000 7f51caffd640 1 --2- 172.21.15.7:0/582048372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51d4102570 0x7f51d41998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:26.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.141+0000 7f51d37fe640 1 -- 172.21.15.7:0/582048372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51d4102570 msgr2=0x7f51d41998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:26.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.141+0000 7f51d37fe640 1 --2- 172.21.15.7:0/582048372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51d4102570 0x7f51d41998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:26.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.141+0000 7f51d37fe640 1 -- 172.21.15.7:0/582048372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51d4102ef0 msgr2=0x7f51d4199e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:26.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.141+0000 7f51d37fe640 1 --2- 172.21.15.7:0/582048372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51d4102ef0 0x7f51d4199e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:26.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.141+0000 7f51d37fe640 1 -- 172.21.15.7:0/582048372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d41a47b0 con 0x7f51d4100e20 2024-09-19T08:52:26.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.141+0000 7f51caffd640 1 --2- 172.21.15.7:0/582048372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51d4102570 0x7f51d41998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:26.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.141+0000 7f51d37fe640 1 --2- 172.21.15.7:0/582048372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51d4100e20 0x7f51d41993b0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f51c400d950 tx=0x7f51c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:26.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.141+0000 7f51d17fa640 1 -- 172.21.15.7:0/582048372 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c4017030 con 0x7f51d4100e20 2024-09-19T08:52:26.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.141+0000 7f51da12f640 1 -- 172.21.15.7:0/582048372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51d41a4aa0 con 0x7f51d4100e20 2024-09-19T08:52:26.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.141+0000 7f51da12f640 1 -- 172.21.15.7:0/582048372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51d41a5030 con 0x7f51d4100e20 2024-09-19T08:52:26.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.141+0000 7f51d17fa640 1 -- 172.21.15.7:0/582048372 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51c4004020 con 0x7f51d4100e20 2024-09-19T08:52:26.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.142+0000 7f51d17fa640 1 -- 172.21.15.7:0/582048372 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c40047a0 con 0x7f51d4100e20 2024-09-19T08:52:26.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.142+0000 7f51da12f640 1 -- 172.21.15.7:0/582048372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51d4101200 con 0x7f51d4100e20 2024-09-19T08:52:26.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.144+0000 7f51d17fa640 1 -- 172.21.15.7:0/582048372 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f51c40041d0 con 0x7f51d4100e20 2024-09-19T08:52:26.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.145+0000 7f51d17fa640 1 --2- 172.21.15.7:0/582048372 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f51c00a3430 0x7f51c00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:26.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.145+0000 7f51d17fa640 1 -- 172.21.15.7:0/582048372 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7f51c40cf6d0 con 0x7f51d4100e20 2024-09-19T08:52:26.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.145+0000 7f51caffd640 1 --2- 172.21.15.7:0/582048372 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f51c00a3430 0x7f51c00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:26.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.145+0000 7f51caffd640 1 --2- 172.21.15.7:0/582048372 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f51c00a3430 0x7f51c00a58f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f51bc005e00 tx=0x7f51bc005c70 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:26.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.149+0000 7f51d17fa640 1 -- 172.21.15.7:0/582048372 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f51c409c070 con 0x7f51d4100e20 2024-09-19T08:52:26.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.363+0000 7f51da12f640 1 -- 172.21.15.7:0/582048372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51d4109090 con 0x7f51d4100e20 2024-09-19T08:52:26.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.364+0000 7f51d17fa640 1 -- 172.21.15.7:0/582048372 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f51c409b970 con 0x7f51d4100e20 2024-09-19T08:52:26.364 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:52:26.364 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:52:26.364 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:52:26.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.366+0000 7f51da12f640 1 -- 172.21.15.7:0/582048372 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f51c00a3430 msgr2=0x7f51c00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:26.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.366+0000 7f51da12f640 1 --2- 172.21.15.7:0/582048372 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f51c00a3430 0x7f51c00a58f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f51bc005e00 tx=0x7f51bc005c70 comp rx=0 tx=0).stop 2024-09-19T08:52:26.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.366+0000 7f51da12f640 1 -- 172.21.15.7:0/582048372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51d4100e20 msgr2=0x7f51d41993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:26.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.366+0000 7f51da12f640 1 --2- 172.21.15.7:0/582048372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51d4100e20 0x7f51d41993b0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f51c400d950 tx=0x7f51c400de10 comp rx=0 tx=0).stop 2024-09-19T08:52:26.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.366+0000 7f51da12f640 1 -- 172.21.15.7:0/582048372 shutdown_connections 2024-09-19T08:52:26.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.366+0000 7f51da12f640 1 --2- 172.21.15.7:0/582048372 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f51c00a3430 0x7f51c00a58f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:26.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.366+0000 7f51da12f640 1 --2- 172.21.15.7:0/582048372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51d4102ef0 0x7f51d4199e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:26.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.366+0000 7f51da12f640 1 --2- 172.21.15.7:0/582048372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51d4102570 0x7f51d41998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:26.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.366+0000 7f51da12f640 1 --2- 172.21.15.7:0/582048372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51d4100e20 0x7f51d41993b0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:26.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.366+0000 7f51da12f640 1 -- 172.21.15.7:0/582048372 >> 172.21.15.7:0/582048372 conn(0x7f51d40fc7d0 msgr2=0x7f51d41068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:26.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.366+0000 7f51da12f640 1 -- 172.21.15.7:0/582048372 shutdown_connections 2024-09-19T08:52:26.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:26.366+0000 7f51da12f640 1 -- 172.21.15.7:0/582048372 wait complete. 2024-09-19T08:52:26.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:26 smithi007 ceph-mon[31221]: pgmap v244: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:52:26.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:26 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/582048372' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:26.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:26 smithi044 ceph-mon[35072]: pgmap v244: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:52:26.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:26 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/582048372' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:26.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:26 smithi175 ceph-mon[35688]: pgmap v244: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:52:26.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:26 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/582048372' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:27.095 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:52:27.569 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:28.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.015+0000 7fe2bb359640 1 -- 172.21.15.7:0/2765955870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b4102dd0 msgr2=0x7fe2b41031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:28.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.015+0000 7fe2bb359640 1 --2- 172.21.15.7:0/2765955870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b4102dd0 0x7fe2b41031b0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0009930 tx=0x7fe2b002a420 comp rx=0 tx=0).stop 2024-09-19T08:52:28.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.015+0000 7fe2bb359640 1 -- 172.21.15.7:0/2765955870 shutdown_connections 2024-09-19T08:52:28.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.015+0000 7fe2bb359640 1 --2- 172.21.15.7:0/2765955870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2b4108300 0x7fe2b410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.015+0000 7fe2bb359640 1 --2- 172.21.15.7:0/2765955870 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2b4103780 0x7fe2b4107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.015+0000 7fe2bb359640 1 --2- 172.21.15.7:0/2765955870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b4102dd0 0x7fe2b41031b0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.015+0000 7fe2bb359640 1 -- 172.21.15.7:0/2765955870 >> 172.21.15.7:0/2765955870 conn(0x7fe2b40fc7d0 msgr2=0x7fe2b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:28.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.015+0000 7fe2bb359640 1 -- 172.21.15.7:0/2765955870 shutdown_connections 2024-09-19T08:52:28.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.015+0000 7fe2bb359640 1 -- 172.21.15.7:0/2765955870 wait complete. 2024-09-19T08:52:28.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.016+0000 7fe2bb359640 1 Processor -- start 2024-09-19T08:52:28.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.016+0000 7fe2bb359640 1 -- start start 2024-09-19T08:52:28.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.016+0000 7fe2bb359640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2b4102dd0 0x7fe2b4198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:28.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.016+0000 7fe2bb359640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2b4103780 0x7fe2b4198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:28.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.016+0000 7fe2bb359640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b4108300 0x7fe2b419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:28.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.016+0000 7fe2bb359640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b41120b0 con 0x7fe2b4108300 2024-09-19T08:52:28.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.016+0000 7fe2bb359640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b4111f30 con 0x7fe2b4102dd0 2024-09-19T08:52:28.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.016+0000 7fe2bb359640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b4112230 con 0x7fe2b4103780 2024-09-19T08:52:28.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.016+0000 7fe2b98f6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b4108300 0x7fe2b419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:28.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.016+0000 7fe2b98f6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b4108300 0x7fe2b419cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43884/0 (socket says 172.21.15.7:43884) 2024-09-19T08:52:28.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.016+0000 7fe2b98f6640 1 -- 172.21.15.7:0/1003453921 learned_addr learned my addr 172.21.15.7:0/1003453921 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:28.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.016+0000 7fe2b90f5640 1 --2- 172.21.15.7:0/1003453921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2b4102dd0 0x7fe2b4198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:28.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.016+0000 7fe2b88f4640 1 --2- 172.21.15.7:0/1003453921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2b4103780 0x7fe2b4198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:28.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.016+0000 7fe2b98f6640 1 -- 172.21.15.7:0/1003453921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2b4103780 msgr2=0x7fe2b4198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:28.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.016+0000 7fe2b98f6640 1 --2- 172.21.15.7:0/1003453921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2b4103780 0x7fe2b4198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.016+0000 7fe2b98f6640 1 -- 172.21.15.7:0/1003453921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2b4102dd0 msgr2=0x7fe2b4198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:28.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.016+0000 7fe2b98f6640 1 --2- 172.21.15.7:0/1003453921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2b4102dd0 0x7fe2b4198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.016+0000 7fe2b98f6640 1 -- 172.21.15.7:0/1003453921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b419d620 con 0x7fe2b4108300 2024-09-19T08:52:28.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.017+0000 7fe2b98f6640 1 --2- 172.21.15.7:0/1003453921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b4108300 0x7fe2b419cf40 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00eb10 tx=0x7fe2ac00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.017+0000 7fe2aa7fc640 1 -- 172.21.15.7:0/1003453921 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac004b20 con 0x7fe2b4108300 2024-09-19T08:52:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.017+0000 7fe2aa7fc640 1 -- 172.21.15.7:0/1003453921 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2ac004cc0 con 0x7fe2b4108300 2024-09-19T08:52:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.017+0000 7fe2bb359640 1 -- 172.21.15.7:0/1003453921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b419d910 con 0x7fe2b4108300 2024-09-19T08:52:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.017+0000 7fe2aa7fc640 1 -- 172.21.15.7:0/1003453921 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac010760 con 0x7fe2b4108300 2024-09-19T08:52:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.017+0000 7fe2bb359640 1 -- 172.21.15.7:0/1003453921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b41a51f0 con 0x7fe2b4108300 2024-09-19T08:52:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.019+0000 7fe2aa7fc640 1 -- 172.21.15.7:0/1003453921 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fe2ac005020 con 0x7fe2b4108300 2024-09-19T08:52:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.020+0000 7fe2aa7fc640 1 --2- 172.21.15.7:0/1003453921 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe2a00a3430 0x7fe2a00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.020+0000 7fe2bd732740 1 Processor -- start 2024-09-19T08:52:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.020+0000 7fe2bd732740 1 -- start start 2024-09-19T08:52:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.020+0000 7fe2b90f5640 1 --2- 172.21.15.7:0/1003453921 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe2a00a3430 0x7fe2a00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.020+0000 7fe2aa7fc640 1 -- 172.21.15.7:0/1003453921 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7fe2ac0d03c0 con 0x7fe2b4108300 2024-09-19T08:52:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.020+0000 7fe2bd732740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e626f5b40 0x556e626f4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.020+0000 7fe2bd732740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e626f45d0 0x556e626f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.020+0000 7fe2bd732740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626ff370 0x556e62701760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:28.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.020+0000 7fe2bd732740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556e6265a2f0 con 0x556e626ff370 2024-09-19T08:52:28.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.020+0000 7fe2bd732740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556e62601cf0 con 0x556e626f5b40 2024-09-19T08:52:28.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.020+0000 7fe2bd732740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556e626562b0 con 0x556e626f45d0 2024-09-19T08:52:28.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.021+0000 7fe2b98f6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626ff370 0x556e62701760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:28.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.021+0000 7fe2b98f6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626ff370 0x556e62701760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43890/0 (socket says 172.21.15.7:43890) 2024-09-19T08:52:28.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.021+0000 7fe2b98f6640 1 -- 172.21.15.7:0/3408491937 learned_addr learned my addr 172.21.15.7:0/3408491937 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:28.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.021+0000 7fe2b90f5640 1 --2- 172.21.15.7:0/3408491937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e626f5b40 0x556e626f4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:28.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.021+0000 7fe2b88f4640 1 --2- 172.21.15.7:0/3408491937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e626f45d0 0x556e626f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:28.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.021+0000 7fe2b98f6640 1 -- 172.21.15.7:0/3408491937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e626f45d0 msgr2=0x556e626f4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:28.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.021+0000 7fe2b98f6640 1 --2- 172.21.15.7:0/3408491937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e626f45d0 0x556e626f4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.021+0000 7fe2b98f6640 1 -- 172.21.15.7:0/3408491937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e626f5b40 msgr2=0x556e626f4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:28.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.021+0000 7fe2b98f6640 1 --2- 172.21.15.7:0/3408491937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e626f5b40 0x556e626f4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.021+0000 7fe2b90f5640 1 --2- 172.21.15.7:0/1003453921 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe2a00a3430 0x7fe2a00a58f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0009900 tx=0x7fe2b0000bc0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:28.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.021+0000 7fe2b98f6640 1 -- 172.21.15.7:0/3408491937 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e625e63a0 con 0x556e626ff370 2024-09-19T08:52:28.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.021+0000 7fe2b88f4640 1 --2- 172.21.15.7:0/3408491937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e626f45d0 0x556e626f4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:28.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.021+0000 7fe2b98f6640 1 --2- 172.21.15.7:0/3408491937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626ff370 0x556e62701760 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0a4da0 tx=0x7fe2ac0989c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52148e74bed8679d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:28.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.021+0000 7fe29f7fe640 1 -- 172.21.15.7:0/3408491937 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac09cd60 con 0x556e626ff370 2024-09-19T08:52:28.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.021+0000 7fe29f7fe640 1 -- 172.21.15.7:0/3408491937 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2ac09c660 con 0x556e626ff370 2024-09-19T08:52:28.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.021+0000 7fe29f7fe640 1 -- 172.21.15.7:0/3408491937 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac0cdee0 con 0x556e626ff370 2024-09-19T08:52:28.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.022+0000 7fe2bd732740 1 -- 172.21.15.7:0/3408491937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626ff370 msgr2=0x556e62701760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:28.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.022+0000 7fe2bd732740 1 --2- 172.21.15.7:0/3408491937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626ff370 0x556e62701760 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0a4da0 tx=0x7fe2ac0989c0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.022+0000 7fe2bd732740 1 -- 172.21.15.7:0/3408491937 shutdown_connections 2024-09-19T08:52:28.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.022+0000 7fe2bd732740 1 --2- 172.21.15.7:0/3408491937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626ff370 0x556e62701760 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.022+0000 7fe2bd732740 1 --2- 172.21.15.7:0/3408491937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e626f45d0 0x556e626f4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.022+0000 7fe2bd732740 1 --2- 172.21.15.7:0/3408491937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e626f5b40 0x556e626f4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.022+0000 7fe2bd732740 1 -- 172.21.15.7:0/3408491937 >> 172.21.15.7:0/3408491937 conn(0x556e626bd310 msgr2=0x556e626f0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:28.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.022+0000 7fe2bd732740 1 -- 172.21.15.7:0/3408491937 shutdown_connections 2024-09-19T08:52:28.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.022+0000 7fe2bd732740 1 -- 172.21.15.7:0/3408491937 wait complete. 2024-09-19T08:52:28.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.022+0000 7fe2bd732740 1 -- start start 2024-09-19T08:52:28.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.023+0000 7fe2bd732740 1 Processor -- start 2024-09-19T08:52:28.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.023+0000 7fe2bd732740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626f45d0 0x556e626fece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:28.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.023+0000 7fe2bd732740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e626f5b40 0x556e626fbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:28.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.023+0000 7fe2bd732740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e626ff370 0x556e626fc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:28.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.023+0000 7fe2bd732740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556e62702070 con 0x556e626f45d0 2024-09-19T08:52:28.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.023+0000 7fe2bd732740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556e62615060 con 0x556e626ff370 2024-09-19T08:52:28.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.023+0000 7fe2bd732740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556e627021f0 con 0x556e626f5b40 2024-09-19T08:52:28.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.023+0000 7fe2bd732740 10 client.0 _ll_register_callbacks cb 0x556e623688c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:28.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.023+0000 7fe2b90f5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626f45d0 0x556e626fece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:28.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.023+0000 7fe2b90f5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626f45d0 0x556e626fece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43902/0 (socket says 172.21.15.7:43902) 2024-09-19T08:52:28.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.023+0000 7fe2b90f5640 1 -- 172.21.15.7:0/2124380869 learned_addr learned my addr 172.21.15.7:0/2124380869 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:28.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.023+0000 7fe2b98f6640 1 --2- 172.21.15.7:0/2124380869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e626ff370 0x556e626fc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:28.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.023+0000 7fe2b88f4640 1 --2- 172.21.15.7:0/2124380869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e626f5b40 0x556e626fbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:28.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.023+0000 7fe2b90f5640 1 -- 172.21.15.7:0/2124380869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e626f5b40 msgr2=0x556e626fbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:28.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.023+0000 7fe2b90f5640 1 --2- 172.21.15.7:0/2124380869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e626f5b40 0x556e626fbf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.023+0000 7fe2b90f5640 1 -- 172.21.15.7:0/2124380869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e626ff370 msgr2=0x556e626fc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:28.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.023+0000 7fe2b90f5640 1 --2- 172.21.15.7:0/2124380869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e626ff370 0x556e626fc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.023+0000 7fe2b90f5640 1 -- 172.21.15.7:0/2124380869 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e623cb3c0 con 0x556e626f45d0 2024-09-19T08:52:28.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.024+0000 7fe2b98f6640 1 --2- 172.21.15.7:0/2124380869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e626ff370 0x556e626fc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:28.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.024+0000 7fe2b90f5640 1 --2- 172.21.15.7:0/2124380869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626f45d0 0x556e626fece0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0033000 tx=0x7fe2b002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10beab24e8b1ba86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:28.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.024+0000 7fe29cff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:28.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.024+0000 7fe29cff9640 1 -- 172.21.15.7:0/2124380869 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0035040 con 0x556e626f45d0 2024-09-19T08:52:28.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.024+0000 7fe29cff9640 1 -- 172.21.15.7:0/2124380869 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7fe2b0003b40 con 0x556e626f45d0 2024-09-19T08:52:28.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.024+0000 7fe2bd732740 1 -- 172.21.15.7:0/2124380869 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2ac09c660 con 0x556e626f45d0 2024-09-19T08:52:28.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.024+0000 7fe29cff9640 1 -- 172.21.15.7:0/2124380869 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe2b0003d40 con 0x556e626f45d0 2024-09-19T08:52:28.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.024+0000 7fe2bd732740 10 client.17034 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:28.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.024+0000 7fe2bd732740 1 -- 172.21.15.7:0/2124380869 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556e6270d9f0 con 0x556e626f45d0 2024-09-19T08:52:28.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.024+0000 7fe29cff9640 1 -- 172.21.15.7:0/2124380869 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2ac09c660 con 0x556e626f45d0 2024-09-19T08:52:28.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.025+0000 7fe29cff9640 1 -- 172.21.15.7:0/2124380869 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe2b003d6b0 con 0x556e626f45d0 2024-09-19T08:52:28.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.025+0000 7fe2bd732740 10 client.17034 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:28.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.025+0000 7fe2bd732740 10 client.17034 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:52:28.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.025+0000 7fe2bd732740 20 client.17034 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:28.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.025+0000 7fe2bd732740 1 --2- 172.21.15.7:0/2124380869 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x556e6270ef00 0x556e62711360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:28.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.025+0000 7fe2bd732740 4 client.17034 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:28.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.025+0000 7fe2bd732740 1 -- 172.21.15.7:0/2124380869 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e62667860 con 0x556e6270ef00 2024-09-19T08:52:28.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.025+0000 7fe2b88f4640 1 --2- 172.21.15.7:0/2124380869 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x556e6270ef00 0x556e62711360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:28.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.025+0000 7fe2b88f4640 1 --2- 172.21.15.7:0/2124380869 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x556e6270ef00 0x556e62711360 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d9ea3324d5e227b6 server_cookie=2c37fff4702acad5 in_seq=0 out_seq=0 2024-09-19T08:52:28.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.025+0000 7fe29cff9640 10 client.17034 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:52:28.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.026+0000 7fe29cff9640 1 -- 172.21.15.7:0/2124380869 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556e62667860 con 0x556e6270ef00 2024-09-19T08:52:28.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.026+0000 7fe29cff9640 10 client.17034 handle_command_reply: tid=0 2024-09-19T08:52:28.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.026+0000 7fe2bd732740 1 client.17034 shutdown 2024-09-19T08:52:28.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.026+0000 7fe2bd732740 1 -- 172.21.15.7:0/2124380869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626f45d0 msgr2=0x556e626fece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:28.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.026+0000 7fe2bd732740 1 --2- 172.21.15.7:0/2124380869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626f45d0 0x556e626fece0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0033000 tx=0x7fe2b002a420 comp rx=0 tx=0).stop 2024-09-19T08:52:28.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.026+0000 7fe2bd732740 1 -- 172.21.15.7:0/2124380869 shutdown_connections 2024-09-19T08:52:28.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.026+0000 7fe2bd732740 1 --2- 172.21.15.7:0/2124380869 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x556e6270ef00 0x556e62711360 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.026+0000 7fe2bd732740 1 --2- 172.21.15.7:0/2124380869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e626ff370 0x556e626fc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.026+0000 7fe2bd732740 1 --2- 172.21.15.7:0/2124380869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e626f5b40 0x556e626fbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.026+0000 7fe2bd732740 1 --2- 172.21.15.7:0/2124380869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626f45d0 0x556e626fece0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.026+0000 7fe29cff9640 0 client.17034 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:52:28.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.026+0000 7fe2bd732740 1 -- 172.21.15.7:0/2124380869 >> 172.21.15.7:0/2124380869 conn(0x556e626bd310 msgr2=0x556e626f6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:28.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.026+0000 7fe2bd732740 1 -- 172.21.15.7:0/2124380869 shutdown_connections 2024-09-19T08:52:28.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.026+0000 7fe2bd732740 1 -- 172.21.15.7:0/2124380869 wait complete. 2024-09-19T08:52:28.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.026+0000 7fe2bd732740 20 client.17034 trim_cache size 0 max 16384 2024-09-19T08:52:28.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.039+0000 7fe2bd732740 1 Processor -- start 2024-09-19T08:52:28.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.039+0000 7fe2bd732740 1 -- start start 2024-09-19T08:52:28.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.040+0000 7fe2bd732740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e626f45d0 0x556e626f7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:28.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.040+0000 7fe2bd732740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626f5b40 0x556e626f76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:28.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.040+0000 7fe2bd732740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e626ff370 0x556e62716c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:28.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.040+0000 7fe2bd732740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b41b03a0 con 0x556e626f5b40 2024-09-19T08:52:28.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.040+0000 7fe2bd732740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b41adc70 con 0x556e626ff370 2024-09-19T08:52:28.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.040+0000 7fe2bd732740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b41abae0 con 0x556e626f45d0 2024-09-19T08:52:28.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.040+0000 7fe2b88f4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626f5b40 0x556e626f76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:28.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.040+0000 7fe2b88f4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626f5b40 0x556e626f76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43908/0 (socket says 172.21.15.7:43908) 2024-09-19T08:52:28.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.040+0000 7fe2b98f6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e626ff370 0x556e62716c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:28.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.040+0000 7fe2b88f4640 1 -- 172.21.15.7:0/3166462571 learned_addr learned my addr 172.21.15.7:0/3166462571 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:28.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.040+0000 7fe2b90f5640 1 --2- 172.21.15.7:0/3166462571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e626f45d0 0x556e626f7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:28.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.040+0000 7fe2b98f6640 1 -- 172.21.15.7:0/3166462571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e626f45d0 msgr2=0x556e626f7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:28.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.040+0000 7fe2b98f6640 1 --2- 172.21.15.7:0/3166462571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e626f45d0 0x556e626f7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.040+0000 7fe2b98f6640 1 -- 172.21.15.7:0/3166462571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626f5b40 msgr2=0x556e626f76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:28.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.040+0000 7fe2b98f6640 1 --2- 172.21.15.7:0/3166462571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626f5b40 0x556e626f76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.040+0000 7fe2b98f6640 1 -- 172.21.15.7:0/3166462571 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e626f5300 con 0x556e626ff370 2024-09-19T08:52:28.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.040+0000 7fe2b88f4640 1 --2- 172.21.15.7:0/3166462571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626f5b40 0x556e626f76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:28.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.040+0000 7fe2b98f6640 1 --2- 172.21.15.7:0/3166462571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e626ff370 0x556e62716c30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x556e626f5070 tx=0x7fe2ac004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e45cff4f998b37dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:28.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.041+0000 7fe29effd640 1 -- 172.21.15.7:0/3166462571 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac0a0a10 con 0x556e626ff370 2024-09-19T08:52:28.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.041+0000 7fe29effd640 1 -- 172.21.15.7:0/3166462571 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2ac0a52d0 con 0x556e626ff370 2024-09-19T08:52:28.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.041+0000 7fe29effd640 1 -- 172.21.15.7:0/3166462571 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac0b0b80 con 0x556e626ff370 2024-09-19T08:52:28.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.041+0000 7fe2bd732740 1 -- 172.21.15.7:0/3166462571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e626ff370 msgr2=0x556e62716c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:28.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.041+0000 7fe2bd732740 1 --2- 172.21.15.7:0/3166462571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e626ff370 0x556e62716c30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x556e626f5070 tx=0x7fe2ac004ab0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.041+0000 7fe2bd732740 1 -- 172.21.15.7:0/3166462571 shutdown_connections 2024-09-19T08:52:28.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.041+0000 7fe2bd732740 1 --2- 172.21.15.7:0/3166462571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e626ff370 0x556e62716c30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.041+0000 7fe2bd732740 1 --2- 172.21.15.7:0/3166462571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626f5b40 0x556e626f76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.041+0000 7fe2bd732740 1 --2- 172.21.15.7:0/3166462571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e626f45d0 0x556e626f7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.041+0000 7fe2bd732740 1 -- 172.21.15.7:0/3166462571 >> 172.21.15.7:0/3166462571 conn(0x556e626bd310 msgr2=0x556e626efd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:28.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.042+0000 7fe2bd732740 1 -- 172.21.15.7:0/3166462571 shutdown_connections 2024-09-19T08:52:28.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.042+0000 7fe2bd732740 1 -- 172.21.15.7:0/3166462571 wait complete. 2024-09-19T08:52:28.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.042+0000 7fe2bd732740 1 -- start start 2024-09-19T08:52:28.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.042+0000 7fe2bd732740 1 Processor -- start 2024-09-19T08:52:28.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.042+0000 7fe2bd732740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e626f45d0 0x556e626f8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:28.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.042+0000 7fe2bd732740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626f5b40 0x556e626f9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:28.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.042+0000 7fe2bd732740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e626ff370 0x556e626f9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:28.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.042+0000 7fe2bd732740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b41ac130 con 0x556e626f5b40 2024-09-19T08:52:28.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.042+0000 7fe2bd732740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b41ad5a0 con 0x556e626f45d0 2024-09-19T08:52:28.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.043+0000 7fe2bd732740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b41ac800 con 0x556e626ff370 2024-09-19T08:52:28.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.043+0000 7fe2bd732740 10 client.0 _ll_register_callbacks cb 0x7fe2b0031830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:28.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.043+0000 7fe2b88f4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626f5b40 0x556e626f9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:28.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.043+0000 7fe2b88f4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626f5b40 0x556e626f9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43922/0 (socket says 172.21.15.7:43922) 2024-09-19T08:52:28.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.043+0000 7fe2b88f4640 1 -- 172.21.15.7:0/191734052 learned_addr learned my addr 172.21.15.7:0/191734052 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:28.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.043+0000 7fe2b90f5640 1 --2- 172.21.15.7:0/191734052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e626f45d0 0x556e626f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:28.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.043+0000 7fe2b98f6640 1 --2- 172.21.15.7:0/191734052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e626ff370 0x556e626f9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:28.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.043+0000 7fe2b88f4640 1 -- 172.21.15.7:0/191734052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e626ff370 msgr2=0x556e626f9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:28.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.043+0000 7fe2b88f4640 1 --2- 172.21.15.7:0/191734052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e626ff370 0x556e626f9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.043+0000 7fe2b88f4640 1 -- 172.21.15.7:0/191734052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e626f45d0 msgr2=0x556e626f8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:28.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.043+0000 7fe2b88f4640 1 --2- 172.21.15.7:0/191734052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e626f45d0 0x556e626f8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.043+0000 7fe2b88f4640 1 -- 172.21.15.7:0/191734052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e6277d010 con 0x556e626f5b40 2024-09-19T08:52:28.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.043+0000 7fe2b88f4640 1 --2- 172.21.15.7:0/191734052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626f5b40 0x556e626f9420 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fe2b406a2d0 tx=0x7fe2a400f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749d708cc61c6f9f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:28.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.043+0000 7fe29cff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:28.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.043+0000 7fe29cff9640 1 -- 172.21.15.7:0/191734052 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4004460 con 0x556e626f5b40 2024-09-19T08:52:28.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.043+0000 7fe29cff9640 1 -- 172.21.15.7:0/191734052 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7fe2a40035f0 con 0x556e626f5b40 2024-09-19T08:52:28.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.043+0000 7fe2bd732740 1 -- 172.21.15.7:0/191734052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2ac0a52d0 con 0x556e626f5b40 2024-09-19T08:52:28.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.044+0000 7fe29cff9640 1 -- 172.21.15.7:0/191734052 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe2a40037f0 con 0x556e626f5b40 2024-09-19T08:52:28.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.044+0000 7fe2bd732740 10 client.17040 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:28.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.044+0000 7fe2bd732740 1 -- 172.21.15.7:0/191734052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556e6277e2e0 con 0x556e626f5b40 2024-09-19T08:52:28.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.045+0000 7fe29cff9640 1 -- 172.21.15.7:0/191734052 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2ac0a52d0 con 0x556e626f5b40 2024-09-19T08:52:28.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.045+0000 7fe29cff9640 1 -- 172.21.15.7:0/191734052 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe2a4025400 con 0x556e626f5b40 2024-09-19T08:52:28.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.045+0000 7fe2bd732740 10 client.17040 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:28.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.045+0000 7fe2bd732740 10 client.17040 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:52:28.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.045+0000 7fe2bd732740 20 client.17040 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:28.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.045+0000 7fe2bd732740 1 --2- 172.21.15.7:0/191734052 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x556e6277ea90 0x556e62780eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:28.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.045+0000 7fe2bd732740 4 client.17040 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:52:28.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.045+0000 7fe2bd732740 1 -- 172.21.15.7:0/191734052 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556e62661d70 con 0x556e6277ea90 2024-09-19T08:52:28.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.045+0000 7fe2b90f5640 1 --2- 172.21.15.7:0/191734052 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x556e6277ea90 0x556e62780eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:28.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.046+0000 7fe29cff9640 10 client.17040 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:52:28.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.046+0000 7fe2b90f5640 1 --2- 172.21.15.7:0/191734052 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x556e6277ea90 0x556e62780eb0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7c4b1871db392eb1 server_cookie=8558dcd384b263f6 in_seq=0 out_seq=0 2024-09-19T08:52:28.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.046+0000 7fe29cff9640 1 -- 172.21.15.7:0/191734052 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556e62661d70 con 0x556e6277ea90 2024-09-19T08:52:28.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.046+0000 7fe29cff9640 10 client.17040 handle_command_reply: tid=0 2024-09-19T08:52:28.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.046+0000 7fe2bd732740 1 client.17040 shutdown 2024-09-19T08:52:28.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.046+0000 7fe2bd732740 1 -- 172.21.15.7:0/191734052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626f5b40 msgr2=0x556e626f9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:28.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.046+0000 7fe2bd732740 1 --2- 172.21.15.7:0/191734052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626f5b40 0x556e626f9420 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fe2b406a2d0 tx=0x7fe2a400f7f0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.046+0000 7fe2bd732740 1 -- 172.21.15.7:0/191734052 shutdown_connections 2024-09-19T08:52:28.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.046+0000 7fe2bd732740 1 --2- 172.21.15.7:0/191734052 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x556e6277ea90 0x556e62780eb0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.046+0000 7fe29cff9640 0 client.17040 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:52:28.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.046+0000 7fe2bd732740 1 --2- 172.21.15.7:0/191734052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556e626ff370 0x556e626f9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.046+0000 7fe2bd732740 1 --2- 172.21.15.7:0/191734052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556e626f5b40 0x556e626f9420 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.046+0000 7fe2bd732740 1 --2- 172.21.15.7:0/191734052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556e626f45d0 0x556e626f8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.046+0000 7fe2bd732740 1 -- 172.21.15.7:0/191734052 >> 172.21.15.7:0/191734052 conn(0x556e626bd310 msgr2=0x556e626fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:28.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.046+0000 7fe2bd732740 1 -- 172.21.15.7:0/191734052 shutdown_connections 2024-09-19T08:52:28.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.046+0000 7fe2bd732740 1 -- 172.21.15.7:0/191734052 wait complete. 2024-09-19T08:52:28.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.047+0000 7fe2bd732740 20 client.17040 trim_cache size 0 max 16384 2024-09-19T08:52:28.061 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:52:28.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.047+0000 7fe2bb359640 1 -- 172.21.15.7:0/1003453921 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe2a00a3430 msgr2=0x7fe2a00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:28.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.047+0000 7fe2bb359640 1 --2- 172.21.15.7:0/1003453921 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe2a00a3430 0x7fe2a00a58f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0009900 tx=0x7fe2b0000bc0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.047+0000 7fe2bb359640 1 -- 172.21.15.7:0/1003453921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b4108300 msgr2=0x7fe2b419cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:28.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.047+0000 7fe2bb359640 1 --2- 172.21.15.7:0/1003453921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b4108300 0x7fe2b419cf40 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00eb10 tx=0x7fe2ac00c2d0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.047+0000 7fe2bb359640 1 -- 172.21.15.7:0/1003453921 shutdown_connections 2024-09-19T08:52:28.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.047+0000 7fe2bb359640 1 --2- 172.21.15.7:0/1003453921 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe2a00a3430 0x7fe2a00a58f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.047+0000 7fe2bb359640 1 --2- 172.21.15.7:0/1003453921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b4108300 0x7fe2b419cf40 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.047+0000 7fe2bb359640 1 --2- 172.21.15.7:0/1003453921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2b4103780 0x7fe2b4198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.047+0000 7fe2bb359640 1 --2- 172.21.15.7:0/1003453921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2b4102dd0 0x7fe2b4198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:28.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.047+0000 7fe2bb359640 1 -- 172.21.15.7:0/1003453921 >> 172.21.15.7:0/1003453921 conn(0x7fe2b40fc7d0 msgr2=0x7fe2b4105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:28.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.048+0000 7fe2bb359640 1 -- 172.21.15.7:0/1003453921 shutdown_connections 2024-09-19T08:52:28.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:28.048+0000 7fe2bb359640 1 -- 172.21.15.7:0/1003453921 wait complete. 2024-09-19T08:52:28.716 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:28 smithi007 ceph-mon[31221]: pgmap v245: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T08:52:28.750 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:52:28.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:28 smithi044 ceph-mon[35072]: pgmap v245: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T08:52:28.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:28 smithi175 ceph-mon[35688]: pgmap v245: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T08:52:29.011 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:29.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.435+0000 7f5eb30ee640 1 -- 172.21.15.7:0/4288767249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5eac103660 msgr2=0x7f5eac10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:29.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.435+0000 7f5eb30ee640 1 --2- 172.21.15.7:0/4288767249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5eac103660 0x7f5eac10bb50 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009900 tx=0x7f5ea002a480 comp rx=0 tx=0).stop 2024-09-19T08:52:29.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.435+0000 7f5eb30ee640 1 -- 172.21.15.7:0/4288767249 shutdown_connections 2024-09-19T08:52:29.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.435+0000 7f5eb30ee640 1 --2- 172.21.15.7:0/4288767249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5eac10c170 0x7f5eac10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.435+0000 7f5eb30ee640 1 --2- 172.21.15.7:0/4288767249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5eac103660 0x7f5eac10bb50 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.435+0000 7f5eb30ee640 1 --2- 172.21.15.7:0/4288767249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5eac102d40 0x7f5eac103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.435+0000 7f5eb30ee640 1 -- 172.21.15.7:0/4288767249 >> 172.21.15.7:0/4288767249 conn(0x7f5eac0fc7a0 msgr2=0x7f5eac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:29.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.436+0000 7f5eb30ee640 1 -- 172.21.15.7:0/4288767249 shutdown_connections 2024-09-19T08:52:29.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.436+0000 7f5eb30ee640 1 -- 172.21.15.7:0/4288767249 wait complete. 2024-09-19T08:52:29.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.436+0000 7f5eb30ee640 1 Processor -- start 2024-09-19T08:52:29.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.436+0000 7f5eb30ee640 1 -- start start 2024-09-19T08:52:29.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.436+0000 7f5eb30ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5eac102d40 0x7f5eac1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:29.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.437+0000 7f5eb30ee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5eac103660 0x7f5eac100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:29.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.437+0000 7f5eb30ee640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5eac10c170 0x7f5eac101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:29.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.437+0000 7f5eb30ee640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5eac111f70 con 0x7f5eac103660 2024-09-19T08:52:29.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.437+0000 7f5eb30ee640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5eac111df0 con 0x7f5eac102d40 2024-09-19T08:52:29.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.437+0000 7f5eb30ee640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5eac1120f0 con 0x7f5eac10c170 2024-09-19T08:52:29.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.437+0000 7f5eabfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5eac103660 0x7f5eac100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:29.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.437+0000 7f5eabfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5eac103660 0x7f5eac100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43942/0 (socket says 172.21.15.7:43942) 2024-09-19T08:52:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.437+0000 7f5eabfff640 1 -- 172.21.15.7:0/4102694805 learned_addr learned my addr 172.21.15.7:0/4102694805 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.437+0000 7f5eb0e8a640 1 --2- 172.21.15.7:0/4102694805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5eac102d40 0x7f5eac1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.437+0000 7f5eb168b640 1 --2- 172.21.15.7:0/4102694805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5eac10c170 0x7f5eac101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.437+0000 7f5eabfff640 1 -- 172.21.15.7:0/4102694805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5eac10c170 msgr2=0x7f5eac101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.437+0000 7f5eabfff640 1 --2- 172.21.15.7:0/4102694805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5eac10c170 0x7f5eac101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.437+0000 7f5eabfff640 1 -- 172.21.15.7:0/4102694805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5eac102d40 msgr2=0x7f5eac1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.437+0000 7f5eabfff640 1 --2- 172.21.15.7:0/4102694805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5eac102d40 0x7f5eac1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.437+0000 7f5eabfff640 1 -- 172.21.15.7:0/4102694805 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eac1a6910 con 0x7f5eac103660 2024-09-19T08:52:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.437+0000 7f5eabfff640 1 --2- 172.21.15.7:0/4102694805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5eac103660 0x7f5eac100ee0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0006010 tx=0x7f5ea00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.438+0000 7f5ea9ffb640 1 -- 172.21.15.7:0/4102694805 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea003f030 con 0x7f5eac103660 2024-09-19T08:52:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.438+0000 7f5ea9ffb640 1 -- 172.21.15.7:0/4102694805 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ea0003ce0 con 0x7f5eac103660 2024-09-19T08:52:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.438+0000 7f5eb30ee640 1 -- 172.21.15.7:0/4102694805 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eac1a6ba0 con 0x7f5eac103660 2024-09-19T08:52:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.438+0000 7f5ea9ffb640 1 -- 172.21.15.7:0/4102694805 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0035070 con 0x7f5eac103660 2024-09-19T08:52:29.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.438+0000 7f5eb30ee640 1 -- 172.21.15.7:0/4102694805 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eac1a7080 con 0x7f5eac103660 2024-09-19T08:52:29.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.440+0000 7f5ea9ffb640 1 -- 172.21.15.7:0/4102694805 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f5ea0042030 con 0x7f5eac103660 2024-09-19T08:52:29.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.440+0000 7f5eb54c7740 1 Processor -- start 2024-09-19T08:52:29.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.441+0000 7f5eb54c7740 1 -- start start 2024-09-19T08:52:29.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.441+0000 7f5eb54c7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557716542b40 0x557716541090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:29.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.441+0000 7f5eb54c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577165415d0 0x557716541a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:29.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.441+0000 7f5eb54c7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55771654c370 0x55771654e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:29.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.441+0000 7f5eb54c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5577164a72f0 con 0x5577165415d0 2024-09-19T08:52:29.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.441+0000 7f5eb54c7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55771644ecf0 con 0x557716542b40 2024-09-19T08:52:29.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.441+0000 7f5eb54c7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5577164a32b0 con 0x55771654c370 2024-09-19T08:52:29.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.441+0000 7f5eb0e8a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577165415d0 0x557716541a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:29.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.441+0000 7f5eb0e8a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577165415d0 0x557716541a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43954/0 (socket says 172.21.15.7:43954) 2024-09-19T08:52:29.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.441+0000 7f5eb0e8a640 1 -- 172.21.15.7:0/773129454 learned_addr learned my addr 172.21.15.7:0/773129454 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:29.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.441+0000 7f5eb168b640 1 --2- 172.21.15.7:0/773129454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557716542b40 0x557716541090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:29.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.441+0000 7f5eabfff640 1 --2- 172.21.15.7:0/773129454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55771654c370 0x55771654e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:29.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.441+0000 7f5eb0e8a640 1 -- 172.21.15.7:0/773129454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55771654c370 msgr2=0x55771654e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:29.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.441+0000 7f5eb0e8a640 1 --2- 172.21.15.7:0/773129454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55771654c370 0x55771654e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.441+0000 7f5eb0e8a640 1 -- 172.21.15.7:0/773129454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557716542b40 msgr2=0x557716541090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:29.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.441+0000 7f5eb0e8a640 1 --2- 172.21.15.7:0/773129454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557716542b40 0x557716541090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.441+0000 7f5eb0e8a640 1 -- 172.21.15.7:0/773129454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577164333a0 con 0x5577165415d0 2024-09-19T08:52:29.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.441+0000 7f5eb168b640 1 --2- 172.21.15.7:0/773129454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557716542b40 0x557716541090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:29.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.441+0000 7f5ea9ffb640 1 --2- 172.21.15.7:0/4102694805 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5e940a33b0 0x7f5e940a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:29.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.442+0000 7f5eb168b640 1 --2- 172.21.15.7:0/4102694805 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5e940a33b0 0x7f5e940a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:29.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.442+0000 7f5eb0e8a640 1 --2- 172.21.15.7:0/773129454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577165415d0 0x557716541a10 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00b760 tx=0x7f5e9c00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba3e23c9a2663b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:29.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.442+0000 7f5ea9ffb640 1 -- 172.21.15.7:0/4102694805 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7f5ea00f0270 con 0x7f5eac103660 2024-09-19T08:52:29.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.442+0000 7f5e92ffd640 1 -- 172.21.15.7:0/773129454 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c003dd0 con 0x5577165415d0 2024-09-19T08:52:29.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.442+0000 7f5e92ffd640 1 -- 172.21.15.7:0/773129454 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e9c015070 con 0x5577165415d0 2024-09-19T08:52:29.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.442+0000 7f5e92ffd640 1 -- 172.21.15.7:0/773129454 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c004e10 con 0x5577165415d0 2024-09-19T08:52:29.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.443+0000 7f5eb54c7740 1 -- 172.21.15.7:0/773129454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577165415d0 msgr2=0x557716541a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:29.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.443+0000 7f5eb168b640 1 --2- 172.21.15.7:0/4102694805 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5e940a33b0 0x7f5e940a5870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4005fd0 tx=0x7f5ea4009600 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:29.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.443+0000 7f5eb54c7740 1 --2- 172.21.15.7:0/773129454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577165415d0 0x557716541a10 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00b760 tx=0x7f5e9c00bc20 comp rx=0 tx=0).stop 2024-09-19T08:52:29.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.443+0000 7f5eb54c7740 1 -- 172.21.15.7:0/773129454 shutdown_connections 2024-09-19T08:52:29.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.443+0000 7f5eb54c7740 1 --2- 172.21.15.7:0/773129454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55771654c370 0x55771654e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.443+0000 7f5eb54c7740 1 --2- 172.21.15.7:0/773129454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577165415d0 0x557716541a10 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.443+0000 7f5eb54c7740 1 --2- 172.21.15.7:0/773129454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557716542b40 0x557716541090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.443+0000 7f5eb54c7740 1 -- 172.21.15.7:0/773129454 >> 172.21.15.7:0/773129454 conn(0x55771650a310 msgr2=0x55771653dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:29.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.443+0000 7f5eb54c7740 1 -- 172.21.15.7:0/773129454 shutdown_connections 2024-09-19T08:52:29.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.443+0000 7f5eb54c7740 1 -- 172.21.15.7:0/773129454 wait complete. 2024-09-19T08:52:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.443+0000 7f5eb54c7740 1 -- start start 2024-09-19T08:52:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.443+0000 7f5eb54c7740 1 Processor -- start 2024-09-19T08:52:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.444+0000 7f5eb54c7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5577165415d0 0x55771654bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.444+0000 7f5eb54c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557716542b40 0x557716548fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.444+0000 7f5eb54c7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55771654c370 0x557716549520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.444+0000 7f5eb54c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55771654f070 con 0x557716542b40 2024-09-19T08:52:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.444+0000 7f5eb54c7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557716462060 con 0x55771654c370 2024-09-19T08:52:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.444+0000 7f5eb54c7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55771654f1f0 con 0x5577165415d0 2024-09-19T08:52:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.444+0000 7f5eb54c7740 10 client.0 _ll_register_callbacks cb 0x5577161b58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.444+0000 7f5eabfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557716542b40 0x557716548fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.444+0000 7f5eabfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557716542b40 0x557716548fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43962/0 (socket says 172.21.15.7:43962) 2024-09-19T08:52:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.444+0000 7f5eabfff640 1 -- 172.21.15.7:0/3504879935 learned_addr learned my addr 172.21.15.7:0/3504879935 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.444+0000 7f5eb0e8a640 1 --2- 172.21.15.7:0/3504879935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5577165415d0 0x55771654bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.444+0000 7f5eb168b640 1 --2- 172.21.15.7:0/3504879935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55771654c370 0x557716549520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.444+0000 7f5eabfff640 1 -- 172.21.15.7:0/3504879935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5577165415d0 msgr2=0x55771654bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.444+0000 7f5eabfff640 1 --2- 172.21.15.7:0/3504879935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5577165415d0 0x55771654bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.444+0000 7f5eabfff640 1 -- 172.21.15.7:0/3504879935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55771654c370 msgr2=0x557716549520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.444+0000 7f5eabfff640 1 --2- 172.21.15.7:0/3504879935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55771654c370 0x557716549520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.444+0000 7f5eabfff640 1 -- 172.21.15.7:0/3504879935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577162183c0 con 0x557716542b40 2024-09-19T08:52:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.444+0000 7f5eb168b640 1 --2- 172.21.15.7:0/3504879935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55771654c370 0x557716549520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.444+0000 7f5eabfff640 1 --2- 172.21.15.7:0/3504879935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557716542b40 0x557716548fa0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f5ea00b8a80 tx=0x7f5ea00092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a940fd1d2e720bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.444+0000 7f5e8bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.445+0000 7f5e8bfff640 1 -- 172.21.15.7:0/3504879935 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0049070 con 0x557716542b40 2024-09-19T08:52:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.445+0000 7f5e8bfff640 1 -- 172.21.15.7:0/3504879935 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7f5ea00c4d50 con 0x557716542b40 2024-09-19T08:52:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.445+0000 7f5eb54c7740 1 -- 172.21.15.7:0/3504879935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e9c015070 con 0x557716542b40 2024-09-19T08:52:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.445+0000 7f5e8bfff640 1 -- 172.21.15.7:0/3504879935 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5ea00b88c0 con 0x557716542b40 2024-09-19T08:52:29.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.445+0000 7f5eb54c7740 10 client.17052 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:29.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.445+0000 7f5eb54c7740 1 -- 172.21.15.7:0/3504879935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55771655aad0 con 0x557716542b40 2024-09-19T08:52:29.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.445+0000 7f5e8bfff640 1 -- 172.21.15.7:0/3504879935 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e9c015070 con 0x557716542b40 2024-09-19T08:52:29.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.445+0000 7f5e8bfff640 1 -- 172.21.15.7:0/3504879935 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5ea003bbb0 con 0x557716542b40 2024-09-19T08:52:29.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.445+0000 7f5eb54c7740 10 client.17052 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:29.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.445+0000 7f5eb54c7740 10 client.17052 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:52:29.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.445+0000 7f5eb54c7740 20 client.17052 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:29.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.445+0000 7f5eb54c7740 1 --2- 172.21.15.7:0/3504879935 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55771655bec0 0x55771655e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:29.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.445+0000 7f5eb54c7740 4 client.17052 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.445+0000 7f5eb54c7740 1 -- 172.21.15.7:0/3504879935 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577164b4860 con 0x55771655bec0 2024-09-19T08:52:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.446+0000 7f5eb0e8a640 1 --2- 172.21.15.7:0/3504879935 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55771655bec0 0x55771655e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.446+0000 7f5eb0e8a640 1 --2- 172.21.15.7:0/3504879935 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55771655bec0 0x55771655e2b0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=81424d18caa022b6 server_cookie=f558c87b5a44f400 in_seq=0 out_seq=0 2024-09-19T08:52:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.446+0000 7f5e8bfff640 10 client.17052 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:52:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.447+0000 7f5e8bfff640 1 -- 172.21.15.7:0/3504879935 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5577164b4860 con 0x55771655bec0 2024-09-19T08:52:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.447+0000 7f5e8bfff640 10 client.17052 handle_command_reply: tid=0 2024-09-19T08:52:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.447+0000 7f5eb54c7740 1 client.17052 shutdown 2024-09-19T08:52:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.447+0000 7f5eb54c7740 1 -- 172.21.15.7:0/3504879935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557716542b40 msgr2=0x557716548fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.447+0000 7f5eb54c7740 1 --2- 172.21.15.7:0/3504879935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557716542b40 0x557716548fa0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f5ea00b8a80 tx=0x7f5ea00092c0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.447+0000 7f5eb54c7740 1 -- 172.21.15.7:0/3504879935 shutdown_connections 2024-09-19T08:52:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.447+0000 7f5eb54c7740 1 --2- 172.21.15.7:0/3504879935 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55771655bec0 0x55771655e2b0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.447+0000 7f5eb54c7740 1 --2- 172.21.15.7:0/3504879935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55771654c370 0x557716549520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.447+0000 7f5eb54c7740 1 --2- 172.21.15.7:0/3504879935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557716542b40 0x557716548fa0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.447+0000 7f5eb54c7740 1 --2- 172.21.15.7:0/3504879935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5577165415d0 0x55771654bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.447+0000 7f5e8bfff640 0 client.17052 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:52:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.447+0000 7f5eb54c7740 1 -- 172.21.15.7:0/3504879935 >> 172.21.15.7:0/3504879935 conn(0x55771650a310 msgr2=0x557716543930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.447+0000 7f5eb54c7740 1 -- 172.21.15.7:0/3504879935 shutdown_connections 2024-09-19T08:52:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.447+0000 7f5eb54c7740 1 -- 172.21.15.7:0/3504879935 wait complete. 2024-09-19T08:52:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.447+0000 7f5eb54c7740 20 client.17052 trim_cache size 0 max 16384 2024-09-19T08:52:29.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.460+0000 7f5eb54c7740 1 Processor -- start 2024-09-19T08:52:29.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.461+0000 7f5eb54c7740 1 -- start start 2024-09-19T08:52:29.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.461+0000 7f5eb54c7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5577165415d0 0x55771653de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:29.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.461+0000 7f5eb54c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557716542b40 0x557716558340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:29.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.461+0000 7f5eb54c7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55771654c370 0x557716542300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:29.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.461+0000 7f5eb54c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5eac1b2410 con 0x557716542b40 2024-09-19T08:52:29.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.461+0000 7f5eb54c7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5eac1afce0 con 0x55771654c370 2024-09-19T08:52:29.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.461+0000 7f5eb54c7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5eac1adb50 con 0x5577165415d0 2024-09-19T08:52:29.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.461+0000 7f5eabfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557716542b40 0x557716558340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:29.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.461+0000 7f5eabfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557716542b40 0x557716558340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43966/0 (socket says 172.21.15.7:43966) 2024-09-19T08:52:29.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.461+0000 7f5eabfff640 1 -- 172.21.15.7:0/2114259699 learned_addr learned my addr 172.21.15.7:0/2114259699 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:29.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.461+0000 7f5eb0e8a640 1 --2- 172.21.15.7:0/2114259699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5577165415d0 0x55771653de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:29.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.461+0000 7f5eabfff640 1 -- 172.21.15.7:0/2114259699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5577165415d0 msgr2=0x55771653de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:29.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.461+0000 7f5eabfff640 1 --2- 172.21.15.7:0/2114259699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5577165415d0 0x55771653de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.461+0000 7f5eabfff640 1 -- 172.21.15.7:0/2114259699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55771654c370 msgr2=0x557716542300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:29.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.461+0000 7f5eabfff640 1 --2- 172.21.15.7:0/2114259699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55771654c370 0x557716542300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.461+0000 7f5eabfff640 1 -- 172.21.15.7:0/2114259699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557716547550 con 0x557716542b40 2024-09-19T08:52:29.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.461+0000 7f5eabfff640 1 --2- 172.21.15.7:0/2114259699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557716542b40 0x557716558340 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f5ea003d040 tx=0x7f5ea0031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27d8fa738d0af23 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:29.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.462+0000 7f5e927fc640 1 -- 172.21.15.7:0/2114259699 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0049070 con 0x557716542b40 2024-09-19T08:52:29.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.462+0000 7f5e927fc640 1 -- 172.21.15.7:0/2114259699 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ea00c51e0 con 0x557716542b40 2024-09-19T08:52:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.462+0000 7f5e927fc640 1 -- 172.21.15.7:0/2114259699 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00bbf80 con 0x557716542b40 2024-09-19T08:52:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.463+0000 7f5eb54c7740 1 -- 172.21.15.7:0/2114259699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557716542b40 msgr2=0x557716558340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.463+0000 7f5eb54c7740 1 --2- 172.21.15.7:0/2114259699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557716542b40 0x557716558340 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f5ea003d040 tx=0x7f5ea0031a60 comp rx=0 tx=0).stop 2024-09-19T08:52:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.463+0000 7f5eb54c7740 1 -- 172.21.15.7:0/2114259699 shutdown_connections 2024-09-19T08:52:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.463+0000 7f5eb54c7740 1 --2- 172.21.15.7:0/2114259699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55771654c370 0x557716542300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.463+0000 7f5eb54c7740 1 --2- 172.21.15.7:0/2114259699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557716542b40 0x557716558340 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.463+0000 7f5eb54c7740 1 --2- 172.21.15.7:0/2114259699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5577165415d0 0x55771653de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.463+0000 7f5eb54c7740 1 -- 172.21.15.7:0/2114259699 >> 172.21.15.7:0/2114259699 conn(0x55771650a310 msgr2=0x55771653d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.463+0000 7f5eb54c7740 1 -- 172.21.15.7:0/2114259699 shutdown_connections 2024-09-19T08:52:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.463+0000 7f5eb54c7740 1 -- 172.21.15.7:0/2114259699 wait complete. 2024-09-19T08:52:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.463+0000 7f5eb54c7740 1 -- start start 2024-09-19T08:52:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.463+0000 7f5eb54c7740 1 Processor -- start 2024-09-19T08:52:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.463+0000 7f5eb54c7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5577165415d0 0x557716545f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:29.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.463+0000 7f5eb54c7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557716542b40 0x5577165464a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:29.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.463+0000 7f5eb54c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55771654c370 0x5577165469e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:29.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.464+0000 7f5eb54c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5eac1ae1a0 con 0x55771654c370 2024-09-19T08:52:29.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.464+0000 7f5eb54c7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5eac1af610 con 0x557716542b40 2024-09-19T08:52:29.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.464+0000 7f5eb54c7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5eac1ae870 con 0x5577165415d0 2024-09-19T08:52:29.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.464+0000 7f5eb54c7740 10 client.0 _ll_register_callbacks cb 0x7f5ea0005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:29.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.464+0000 7f5eb168b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55771654c370 0x5577165469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:29.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.464+0000 7f5eb168b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55771654c370 0x5577165469e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43982/0 (socket says 172.21.15.7:43982) 2024-09-19T08:52:29.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.464+0000 7f5eb168b640 1 -- 172.21.15.7:0/3340750825 learned_addr learned my addr 172.21.15.7:0/3340750825 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:29.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.464+0000 7f5eabfff640 1 --2- 172.21.15.7:0/3340750825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557716542b40 0x5577165464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:29.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.464+0000 7f5eb0e8a640 1 --2- 172.21.15.7:0/3340750825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5577165415d0 0x557716545f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:29.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.464+0000 7f5eb168b640 1 -- 172.21.15.7:0/3340750825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5577165415d0 msgr2=0x557716545f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:29.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.464+0000 7f5eb168b640 1 --2- 172.21.15.7:0/3340750825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5577165415d0 0x557716545f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.464+0000 7f5eb168b640 1 -- 172.21.15.7:0/3340750825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557716542b40 msgr2=0x5577165464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:29.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.464+0000 7f5eb168b640 1 --2- 172.21.15.7:0/3340750825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557716542b40 0x5577165464a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.464+0000 7f5eb168b640 1 -- 172.21.15.7:0/3340750825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577165c5b90 con 0x55771654c370 2024-09-19T08:52:29.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.464+0000 7f5eabfff640 1 --2- 172.21.15.7:0/3340750825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557716542b40 0x5577165464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:29.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.464+0000 7f5eb168b640 1 --2- 172.21.15.7:0/3340750825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55771654c370 0x5577165469e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4011ed0 tx=0x7f5ea4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e555e78240502ef4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:29.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.464+0000 7f5e8bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:29.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.464+0000 7f5e8bfff640 1 -- 172.21.15.7:0/3340750825 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea402d060 con 0x55771654c370 2024-09-19T08:52:29.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.464+0000 7f5e8bfff640 1 -- 172.21.15.7:0/3340750825 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7f5ea4020db0 con 0x55771654c370 2024-09-19T08:52:29.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.464+0000 7f5eb54c7740 1 -- 172.21.15.7:0/3340750825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ea00c51e0 con 0x55771654c370 2024-09-19T08:52:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.465+0000 7f5e8bfff640 1 -- 172.21.15.7:0/3340750825 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5ea4009ab0 con 0x55771654c370 2024-09-19T08:52:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.465+0000 7f5eb54c7740 10 client.17058 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.465+0000 7f5eb54c7740 1 -- 172.21.15.7:0/3340750825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5577165c6e30 con 0x55771654c370 2024-09-19T08:52:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.465+0000 7f5e8bfff640 1 -- 172.21.15.7:0/3340750825 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ea00c51e0 con 0x55771654c370 2024-09-19T08:52:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.465+0000 7f5e8bfff640 1 -- 172.21.15.7:0/3340750825 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5ea4027030 con 0x55771654c370 2024-09-19T08:52:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.465+0000 7f5eb54c7740 10 client.17058 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.465+0000 7f5eb54c7740 10 client.17058 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:52:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.465+0000 7f5eb54c7740 20 client.17058 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.465+0000 7f5eb54c7740 1 --2- 172.21.15.7:0/3340750825 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5577165c7560 0x5577165c9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.465+0000 7f5eb54c7740 4 client.17058 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:52:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.465+0000 7f5eb54c7740 1 -- 172.21.15.7:0/3340750825 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5577164aed70 con 0x5577165c7560 2024-09-19T08:52:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.465+0000 7f5eb0e8a640 1 --2- 172.21.15.7:0/3340750825 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5577165c7560 0x5577165c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.466+0000 7f5eb0e8a640 1 --2- 172.21.15.7:0/3340750825 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5577165c7560 0x5577165c9980 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4b209b9fe7112fe9 server_cookie=8c9247f47d1d45e9 in_seq=0 out_seq=0 2024-09-19T08:52:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.466+0000 7f5e8bfff640 10 client.17058 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:52:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.466+0000 7f5e8bfff640 1 -- 172.21.15.7:0/3340750825 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5577164aed70 con 0x5577165c7560 2024-09-19T08:52:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.466+0000 7f5e8bfff640 10 client.17058 handle_command_reply: tid=0 2024-09-19T08:52:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.466+0000 7f5eb54c7740 1 client.17058 shutdown 2024-09-19T08:52:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.466+0000 7f5eb54c7740 1 -- 172.21.15.7:0/3340750825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55771654c370 msgr2=0x5577165469e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.466+0000 7f5eb54c7740 1 --2- 172.21.15.7:0/3340750825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55771654c370 0x5577165469e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4011ed0 tx=0x7f5ea4004ab0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.466+0000 7f5eb54c7740 1 -- 172.21.15.7:0/3340750825 shutdown_connections 2024-09-19T08:52:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.466+0000 7f5eb54c7740 1 --2- 172.21.15.7:0/3340750825 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5577165c7560 0x5577165c9980 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.466+0000 7f5eb54c7740 1 --2- 172.21.15.7:0/3340750825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55771654c370 0x5577165469e0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.466+0000 7f5e8bfff640 0 client.17058 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:52:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.466+0000 7f5eb54c7740 1 --2- 172.21.15.7:0/3340750825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557716542b40 0x5577165464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.466+0000 7f5eb54c7740 1 --2- 172.21.15.7:0/3340750825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5577165415d0 0x557716545f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.466+0000 7f5eb54c7740 1 -- 172.21.15.7:0/3340750825 >> 172.21.15.7:0/3340750825 conn(0x55771650a310 msgr2=0x55771654a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:29.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.466+0000 7f5eb54c7740 1 -- 172.21.15.7:0/3340750825 shutdown_connections 2024-09-19T08:52:29.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.466+0000 7f5eb54c7740 1 -- 172.21.15.7:0/3340750825 wait complete. 2024-09-19T08:52:29.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.466+0000 7f5eb54c7740 20 client.17058 trim_cache size 0 max 16384 2024-09-19T08:52:29.472 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:52:29.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.467+0000 7f5eb30ee640 1 -- 172.21.15.7:0/4102694805 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5e940a33b0 msgr2=0x7f5e940a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:29.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.467+0000 7f5eb30ee640 1 --2- 172.21.15.7:0/4102694805 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5e940a33b0 0x7f5e940a5870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4005fd0 tx=0x7f5ea4009600 comp rx=0 tx=0).stop 2024-09-19T08:52:29.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.467+0000 7f5eb30ee640 1 -- 172.21.15.7:0/4102694805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5eac103660 msgr2=0x7f5eac100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:29.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.467+0000 7f5eb30ee640 1 --2- 172.21.15.7:0/4102694805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5eac103660 0x7f5eac100ee0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0006010 tx=0x7f5ea00042f0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.467+0000 7f5eb30ee640 1 -- 172.21.15.7:0/4102694805 shutdown_connections 2024-09-19T08:52:29.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.467+0000 7f5eb30ee640 1 --2- 172.21.15.7:0/4102694805 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5e940a33b0 0x7f5e940a5870 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.467+0000 7f5eb30ee640 1 --2- 172.21.15.7:0/4102694805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5eac10c170 0x7f5eac101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.467+0000 7f5eb30ee640 1 --2- 172.21.15.7:0/4102694805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5eac103660 0x7f5eac100ee0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.467+0000 7f5eb30ee640 1 --2- 172.21.15.7:0/4102694805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5eac102d40 0x7f5eac1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.467+0000 7f5eb30ee640 1 -- 172.21.15.7:0/4102694805 >> 172.21.15.7:0/4102694805 conn(0x7f5eac0fc7a0 msgr2=0x7f5eac0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:29.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.467+0000 7f5eb30ee640 1 -- 172.21.15.7:0/4102694805 shutdown_connections 2024-09-19T08:52:29.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:29.467+0000 7f5eb30ee640 1 -- 172.21.15.7:0/4102694805 wait complete. 2024-09-19T08:52:30.179 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:52:30.434 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:30.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:30 smithi007 ceph-mon[31221]: pgmap v246: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:52:30.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:30 smithi044 ceph-mon[35072]: pgmap v246: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:52:30.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.894+0000 7f8f90752640 1 -- 172.21.15.7:0/2747887646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f88100a80 msgr2=0x7f8f88100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:30.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.894+0000 7f8f90752640 1 --2- 172.21.15.7:0/2747887646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f88100a80 0x7f8f88100ee0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009930 tx=0x7f8f7802a420 comp rx=0 tx=0).stop 2024-09-19T08:52:30.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.894+0000 7f8f90752640 1 -- 172.21.15.7:0/2747887646 shutdown_connections 2024-09-19T08:52:30.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.894+0000 7f8f90752640 1 --2- 172.21.15.7:0/2747887646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f88101420 0x7f8f8810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.894+0000 7f8f90752640 1 --2- 172.21.15.7:0/2747887646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f88100a80 0x7f8f88100ee0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.894+0000 7f8f90752640 1 --2- 172.21.15.7:0/2747887646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f88106a80 0x7f8f88106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.894+0000 7f8f90752640 1 -- 172.21.15.7:0/2747887646 >> 172.21.15.7:0/2747887646 conn(0x7f8f880fc7a0 msgr2=0x7f8f880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:30.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.894+0000 7f8f90752640 1 -- 172.21.15.7:0/2747887646 shutdown_connections 2024-09-19T08:52:30.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.894+0000 7f8f90752640 1 -- 172.21.15.7:0/2747887646 wait complete. 2024-09-19T08:52:30.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.895+0000 7f8f90752640 1 Processor -- start 2024-09-19T08:52:30.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.895+0000 7f8f90752640 1 -- start start 2024-09-19T08:52:30.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.895+0000 7f8f90752640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f88100a80 0x7f8f88199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.895+0000 7f8f90752640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f88101420 0x7f8f881997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.895+0000 7f8f90752640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f88106a80 0x7f8f881a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.895+0000 7f8f90752640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8f88110e40 con 0x7f8f88100a80 2024-09-19T08:52:30.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.895+0000 7f8f90752640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8f88110cc0 con 0x7f8f88101420 2024-09-19T08:52:30.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.895+0000 7f8f90752640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8f88110fc0 con 0x7f8f88106a80 2024-09-19T08:52:30.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.895+0000 7f8f8e4ee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f88100a80 0x7f8f88199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.895+0000 7f8f8e4ee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f88100a80 0x7f8f88199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44006/0 (socket says 172.21.15.7:44006) 2024-09-19T08:52:30.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.895+0000 7f8f8e4ee640 1 -- 172.21.15.7:0/3048798620 learned_addr learned my addr 172.21.15.7:0/3048798620 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:30.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.895+0000 7f8f8dced640 1 --2- 172.21.15.7:0/3048798620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f88101420 0x7f8f881997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.895+0000 7f8f8ecef640 1 --2- 172.21.15.7:0/3048798620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f88106a80 0x7f8f881a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.895+0000 7f8f8e4ee640 1 -- 172.21.15.7:0/3048798620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f88106a80 msgr2=0x7f8f881a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:30.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.895+0000 7f8f8e4ee640 1 --2- 172.21.15.7:0/3048798620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f88106a80 0x7f8f881a42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.895+0000 7f8f8e4ee640 1 -- 172.21.15.7:0/3048798620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f88101420 msgr2=0x7f8f881997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:30.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.895+0000 7f8f8e4ee640 1 --2- 172.21.15.7:0/3048798620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f88101420 0x7f8f881997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.895+0000 7f8f8e4ee640 1 -- 172.21.15.7:0/3048798620 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f881a4830 con 0x7f8f88100a80 2024-09-19T08:52:30.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.895+0000 7f8f8dced640 1 --2- 172.21.15.7:0/3048798620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f88101420 0x7f8f881997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:30.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.896+0000 7f8f8e4ee640 1 --2- 172.21.15.7:0/3048798620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f88100a80 0x7f8f88199270 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400c920 tx=0x7f8f8400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:30.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.896+0000 7f8f7f7fe640 1 -- 172.21.15.7:0/3048798620 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f84007c70 con 0x7f8f88100a80 2024-09-19T08:52:30.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.896+0000 7f8f7f7fe640 1 -- 172.21.15.7:0/3048798620 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f84007e10 con 0x7f8f88100a80 2024-09-19T08:52:30.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.896+0000 7f8f90752640 1 -- 172.21.15.7:0/3048798620 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f881a4a00 con 0x7f8f88100a80 2024-09-19T08:52:30.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.896+0000 7f8f7f7fe640 1 -- 172.21.15.7:0/3048798620 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f84018890 con 0x7f8f88100a80 2024-09-19T08:52:30.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.896+0000 7f8f90752640 1 -- 172.21.15.7:0/3048798620 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f881a4f10 con 0x7f8f88100a80 2024-09-19T08:52:30.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.898+0000 7f8f7f7fe640 1 -- 172.21.15.7:0/3048798620 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8f84018a70 con 0x7f8f88100a80 2024-09-19T08:52:30.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.898+0000 7f8f92b2b740 1 Processor -- start 2024-09-19T08:52:30.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.898+0000 7f8f92b2b740 1 -- start start 2024-09-19T08:52:30.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.899+0000 7f8f92b2b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5555669dff50 0x5555669de4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.899+0000 7f8f92b2b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555669de9e0 0x5555669dee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.899+0000 7f8f92b2b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669e9780 0x5555669ebb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.899+0000 7f8f92b2b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5555669402f0 con 0x5555669e9780 2024-09-19T08:52:30.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.899+0000 7f8f92b2b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5555668e7cf0 con 0x5555669dff50 2024-09-19T08:52:30.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.899+0000 7f8f92b2b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55556693c2b0 con 0x5555669de9e0 2024-09-19T08:52:30.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.899+0000 7f8f8dced640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669e9780 0x5555669ebb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.899+0000 7f8f8ecef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5555669dff50 0x5555669de4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.899+0000 7f8f8dced640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669e9780 0x5555669ebb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44010/0 (socket says 172.21.15.7:44010) 2024-09-19T08:52:30.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.899+0000 7f8f8ecef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5555669dff50 0x5555669de4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:49674/0 (socket says 172.21.15.7:49674) 2024-09-19T08:52:30.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.899+0000 7f8f8dced640 1 -- 172.21.15.7:0/3333660266 learned_addr learned my addr 172.21.15.7:0/3333660266 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:30.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.899+0000 7f8f8e4ee640 1 --2- 172.21.15.7:0/3333660266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555669de9e0 0x5555669dee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.899+0000 7f8f7f7fe640 1 --2- 172.21.15.7:0/3048798620 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8f740a33b0 0x7f8f740a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.899+0000 7f8f8dced640 1 -- 172.21.15.7:0/3333660266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555669de9e0 msgr2=0x5555669dee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:30.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.899+0000 7f8f8dced640 1 --2- 172.21.15.7:0/3333660266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555669de9e0 0x5555669dee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.899+0000 7f8f8dced640 1 -- 172.21.15.7:0/3333660266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5555669dff50 msgr2=0x5555669de4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:30.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.899+0000 7f8f8dced640 1 --2- 172.21.15.7:0/3333660266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5555669dff50 0x5555669de4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.899+0000 7f8f8dced640 1 -- 172.21.15.7:0/3333660266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555668cc3a0 con 0x5555669e9780 2024-09-19T08:52:30.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.899+0000 7f8f8ecef640 1 --2- 172.21.15.7:0/3048798620 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8f740a33b0 0x7f8f740a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.899+0000 7f8f7f7fe640 1 -- 172.21.15.7:0/3048798620 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7f8f840cfee0 con 0x7f8f88100a80 2024-09-19T08:52:30.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.900+0000 7f8f8dced640 1 --2- 172.21.15.7:0/3333660266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669e9780 0x5555669ebb70 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f8f78006010 tx=0x7f8f78009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f64cd2f28230016 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:30.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.900+0000 7f8f7cff9640 1 -- 172.21.15.7:0/3333660266 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7803f070 con 0x5555669e9780 2024-09-19T08:52:30.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.900+0000 7f8f8ecef640 1 --2- 172.21.15.7:0/3048798620 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8f740a33b0 0x7f8f740a5870 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8f80005fd0 tx=0x7f8f80004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:30.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.900+0000 7f8f7cff9640 1 -- 172.21.15.7:0/3333660266 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f780317b0 con 0x5555669e9780 2024-09-19T08:52:30.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.900+0000 7f8f7cff9640 1 -- 172.21.15.7:0/3333660266 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f78035070 con 0x5555669e9780 2024-09-19T08:52:30.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.901+0000 7f8f92b2b740 1 -- 172.21.15.7:0/3333660266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669e9780 msgr2=0x5555669ebb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:30.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.901+0000 7f8f92b2b740 1 --2- 172.21.15.7:0/3333660266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669e9780 0x5555669ebb70 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f8f78006010 tx=0x7f8f78009680 comp rx=0 tx=0).stop 2024-09-19T08:52:30.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.901+0000 7f8f92b2b740 1 -- 172.21.15.7:0/3333660266 shutdown_connections 2024-09-19T08:52:30.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.901+0000 7f8f92b2b740 1 --2- 172.21.15.7:0/3333660266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669e9780 0x5555669ebb70 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.901+0000 7f8f92b2b740 1 --2- 172.21.15.7:0/3333660266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555669de9e0 0x5555669dee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.901+0000 7f8f92b2b740 1 --2- 172.21.15.7:0/3333660266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5555669dff50 0x5555669de4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.901+0000 7f8f92b2b740 1 -- 172.21.15.7:0/3333660266 >> 172.21.15.7:0/3333660266 conn(0x5555669a3310 msgr2=0x5555669db070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:30.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.901+0000 7f8f92b2b740 1 -- 172.21.15.7:0/3333660266 shutdown_connections 2024-09-19T08:52:30.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.901+0000 7f8f92b2b740 1 -- 172.21.15.7:0/3333660266 wait complete. 2024-09-19T08:52:30.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.901+0000 7f8f92b2b740 1 -- start start 2024-09-19T08:52:30.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.901+0000 7f8f92b2b740 1 Processor -- start 2024-09-19T08:52:30.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.902+0000 7f8f92b2b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555669de9e0 0x5555669e90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.902+0000 7f8f92b2b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669dff50 0x5555669e6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.902+0000 7f8f92b2b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5555669e9780 0x5555669e6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.902+0000 7f8f92b2b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5555669ec420 con 0x5555669dff50 2024-09-19T08:52:30.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.902+0000 7f8f92b2b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5555668fb060 con 0x5555669e9780 2024-09-19T08:52:30.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.902+0000 7f8f92b2b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5555669ec5a0 con 0x5555669de9e0 2024-09-19T08:52:30.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.902+0000 7f8f92b2b740 10 client.0 _ll_register_callbacks cb 0x55556664e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:30.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.902+0000 7f8f8ecef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5555669e9780 0x5555669e6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.902+0000 7f8f8e4ee640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555669de9e0 0x5555669e90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.902+0000 7f8f8e4ee640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555669de9e0 0x5555669e90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.7:53578/0 (socket says 172.21.15.7:53578) 2024-09-19T08:52:30.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.902+0000 7f8f8e4ee640 1 -- 172.21.15.7:0/3964422832 learned_addr learned my addr 172.21.15.7:0/3964422832 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:30.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.902+0000 7f8f8dced640 1 --2- 172.21.15.7:0/3964422832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669dff50 0x5555669e6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.902+0000 7f8f8ecef640 1 -- 172.21.15.7:0/3964422832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555669de9e0 msgr2=0x5555669e90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:30.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.902+0000 7f8f8ecef640 1 --2- 172.21.15.7:0/3964422832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555669de9e0 0x5555669e90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.902+0000 7f8f8ecef640 1 -- 172.21.15.7:0/3964422832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669dff50 msgr2=0x5555669e6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:30.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.902+0000 7f8f8ecef640 1 --2- 172.21.15.7:0/3964422832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669dff50 0x5555669e6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.902+0000 7f8f8ecef640 1 -- 172.21.15.7:0/3964422832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555666b13c0 con 0x5555669e9780 2024-09-19T08:52:30.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.903+0000 7f8f8ecef640 1 --2- 172.21.15.7:0/3964422832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5555669e9780 0x5555669e6890 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8f80013880 tx=0x7f8f80004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1005b31b8c869bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:30.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.903+0000 7f8f71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-19T08:52:30.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.903+0000 7f8f71ffb640 1 -- 172.21.15.7:0/3964422832 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f80022070 con 0x5555669e9780 2024-09-19T08:52:30.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.903+0000 7f8f92b2b740 1 -- 172.21.15.7:0/3964422832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f780317b0 con 0x5555669e9780 2024-09-19T08:52:30.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.903+0000 7f8f71ffb640 1 -- 172.21.15.7:0/3964422832 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7f8f80011dc0 con 0x5555669e9780 2024-09-19T08:52:30.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.903+0000 7f8f71ffb640 1 -- 172.21.15.7:0/3964422832 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8f8002e050 con 0x5555669e9780 2024-09-19T08:52:30.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.903+0000 7f8f92b2b740 10 client.26642 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:30.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.903+0000 7f8f92b2b740 1 -- 172.21.15.7:0/3964422832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5555669f7ec0 con 0x5555669e9780 2024-09-19T08:52:30.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.903+0000 7f8f71ffb640 1 -- 172.21.15.7:0/3964422832 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f780317b0 con 0x5555669e9780 2024-09-19T08:52:30.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.903+0000 7f8f71ffb640 1 -- 172.21.15.7:0/3964422832 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8f80010460 con 0x5555669e9780 2024-09-19T08:52:30.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.904+0000 7f8f92b2b740 10 client.26642 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:30.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.904+0000 7f8f92b2b740 10 client.26642 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:30.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.904+0000 7f8f92b2b740 20 client.26642 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:30.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.904+0000 7f8f92b2b740 1 --2- 172.21.15.7:0/3964422832 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5555669f92d0 0x5555669fb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.904+0000 7f8f92b2b740 4 client.26642 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:30.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.904+0000 7f8f92b2b740 1 -- 172.21.15.7:0/3964422832 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55556694d860 con 0x5555669f92d0 2024-09-19T08:52:30.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.904+0000 7f8f8e4ee640 1 --2- 172.21.15.7:0/3964422832 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5555669f92d0 0x5555669fb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.904+0000 7f8f71ffb640 10 client.26642 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:30.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.904+0000 7f8f8e4ee640 1 --2- 172.21.15.7:0/3964422832 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5555669f92d0 0x5555669fb700 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8e77ec868cf10e8 server_cookie=fb0d76d2f5b625a5 in_seq=0 out_seq=0 2024-09-19T08:52:30.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.905+0000 7f8f71ffb640 1 -- 172.21.15.7:0/3964422832 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55556694d860 con 0x5555669f92d0 2024-09-19T08:52:30.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.905+0000 7f8f71ffb640 10 client.26642 handle_command_reply: tid=0 2024-09-19T08:52:30.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.905+0000 7f8f92b2b740 1 client.26642 shutdown 2024-09-19T08:52:30.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.905+0000 7f8f92b2b740 1 -- 172.21.15.7:0/3964422832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5555669e9780 msgr2=0x5555669e6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:30.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.905+0000 7f8f92b2b740 1 --2- 172.21.15.7:0/3964422832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5555669e9780 0x5555669e6890 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8f80013880 tx=0x7f8f80004ab0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.905+0000 7f8f92b2b740 1 -- 172.21.15.7:0/3964422832 shutdown_connections 2024-09-19T08:52:30.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.905+0000 7f8f92b2b740 1 --2- 172.21.15.7:0/3964422832 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5555669f92d0 0x5555669fb700 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.905+0000 7f8f92b2b740 1 --2- 172.21.15.7:0/3964422832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5555669e9780 0x5555669e6890 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.905+0000 7f8f71ffb640 0 client.26642 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:30.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.905+0000 7f8f92b2b740 1 --2- 172.21.15.7:0/3964422832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669dff50 0x5555669e6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.905+0000 7f8f92b2b740 1 --2- 172.21.15.7:0/3964422832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555669de9e0 0x5555669e90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.905+0000 7f8f92b2b740 1 -- 172.21.15.7:0/3964422832 >> 172.21.15.7:0/3964422832 conn(0x5555669a3310 msgr2=0x5555669e0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:30.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.905+0000 7f8f92b2b740 1 -- 172.21.15.7:0/3964422832 shutdown_connections 2024-09-19T08:52:30.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.905+0000 7f8f92b2b740 1 -- 172.21.15.7:0/3964422832 wait complete. 2024-09-19T08:52:30.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.906+0000 7f8f92b2b740 20 client.26642 trim_cache size 0 max 16384 2024-09-19T08:52:30.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.919+0000 7f8f92b2b740 1 Processor -- start 2024-09-19T08:52:30.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.919+0000 7f8f92b2b740 1 -- start start 2024-09-19T08:52:30.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.919+0000 7f8f92b2b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5555669a3310 0x5555669d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.919+0000 7f8f92b2b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669de9e0 0x5555669e82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.919+0000 7f8f92b2b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555669dff50 0x5555669e1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.919+0000 7f8f92b2b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8f881adfc0 con 0x5555669de9e0 2024-09-19T08:52:30.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.919+0000 7f8f92b2b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8f881ab890 con 0x5555669a3310 2024-09-19T08:52:30.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.919+0000 7f8f92b2b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8f881a9700 con 0x5555669dff50 2024-09-19T08:52:30.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.919+0000 7f8f8dced640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669de9e0 0x5555669e82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.919+0000 7f8f8dced640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669de9e0 0x5555669e82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44034/0 (socket says 172.21.15.7:44034) 2024-09-19T08:52:30.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.919+0000 7f8f8dced640 1 -- 172.21.15.7:0/2198787288 learned_addr learned my addr 172.21.15.7:0/2198787288 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:30.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.919+0000 7f8f8e4ee640 1 --2- 172.21.15.7:0/2198787288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5555669a3310 0x5555669d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.919+0000 7f8f8ecef640 1 --2- 172.21.15.7:0/2198787288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555669dff50 0x5555669e1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.919+0000 7f8f8dced640 1 -- 172.21.15.7:0/2198787288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555669dff50 msgr2=0x5555669e1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:30.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.919+0000 7f8f8dced640 1 --2- 172.21.15.7:0/2198787288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555669dff50 0x5555669e1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.919+0000 7f8f8dced640 1 -- 172.21.15.7:0/2198787288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5555669a3310 msgr2=0x5555669d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:30.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.919+0000 7f8f8dced640 1 --2- 172.21.15.7:0/2198787288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5555669a3310 0x5555669d1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.919+0000 7f8f8dced640 1 -- 172.21.15.7:0/2198787288 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555669dbd70 con 0x5555669de9e0 2024-09-19T08:52:30.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.920+0000 7f8f8dced640 1 --2- 172.21.15.7:0/2198787288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669de9e0 0x5555669e82c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f8f78004620 tx=0x7f8f78009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737ae8c146a40b22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:30.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.920+0000 7f8f73fff640 1 -- 172.21.15.7:0/2198787288 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7804b070 con 0x5555669de9e0 2024-09-19T08:52:30.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.920+0000 7f8f73fff640 1 -- 172.21.15.7:0/2198787288 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f78005520 con 0x5555669de9e0 2024-09-19T08:52:30.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.920+0000 7f8f73fff640 1 -- 172.21.15.7:0/2198787288 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f78035040 con 0x5555669de9e0 2024-09-19T08:52:30.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.920+0000 7f8f92b2b740 1 -- 172.21.15.7:0/2198787288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669de9e0 msgr2=0x5555669e82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:30.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.920+0000 7f8f92b2b740 1 --2- 172.21.15.7:0/2198787288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669de9e0 0x5555669e82c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f8f78004620 tx=0x7f8f78009260 comp rx=0 tx=0).stop 2024-09-19T08:52:30.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.920+0000 7f8f92b2b740 1 -- 172.21.15.7:0/2198787288 shutdown_connections 2024-09-19T08:52:30.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.920+0000 7f8f92b2b740 1 --2- 172.21.15.7:0/2198787288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555669dff50 0x5555669e1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.920+0000 7f8f92b2b740 1 --2- 172.21.15.7:0/2198787288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669de9e0 0x5555669e82c0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.920+0000 7f8f92b2b740 1 --2- 172.21.15.7:0/2198787288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5555669a3310 0x5555669d1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.920+0000 7f8f92b2b740 1 -- 172.21.15.7:0/2198787288 >> 172.21.15.7:0/2198787288 conn(0x5555669e69f0 msgr2=0x5555669e7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:30.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.921+0000 7f8f92b2b740 1 -- 172.21.15.7:0/2198787288 shutdown_connections 2024-09-19T08:52:30.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.921+0000 7f8f92b2b740 1 -- 172.21.15.7:0/2198787288 wait complete. 2024-09-19T08:52:30.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.921+0000 7f8f92b2b740 1 -- start start 2024-09-19T08:52:30.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.921+0000 7f8f92b2b740 1 Processor -- start 2024-09-19T08:52:30.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.921+0000 7f8f92b2b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669a3310 0x5555669ed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.921+0000 7f8f92b2b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555669de9e0 0x5555669edc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.921+0000 7f8f92b2b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5555669dff50 0x5555669ee150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.921+0000 7f8f92b2b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8f881a9d50 con 0x5555669a3310 2024-09-19T08:52:30.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.921+0000 7f8f92b2b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8f881ab1c0 con 0x5555669dff50 2024-09-19T08:52:30.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.921+0000 7f8f92b2b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8f881aa420 con 0x5555669de9e0 2024-09-19T08:52:30.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.921+0000 7f8f92b2b740 10 client.0 _ll_register_callbacks cb 0x7f8f80009c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:30.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.921+0000 7f8f8e4ee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669a3310 0x5555669ed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.921+0000 7f8f8e4ee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669a3310 0x5555669ed6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44042/0 (socket says 172.21.15.7:44042) 2024-09-19T08:52:30.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.921+0000 7f8f8e4ee640 1 -- 172.21.15.7:0/4076667130 learned_addr learned my addr 172.21.15.7:0/4076667130 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:30.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.921+0000 7f8f8ecef640 1 --2- 172.21.15.7:0/4076667130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5555669dff50 0x5555669ee150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.922+0000 7f8f8e4ee640 1 -- 172.21.15.7:0/4076667130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555669de9e0 msgr2=0x5555669edc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:30.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.922+0000 7f8f8e4ee640 1 --2- 172.21.15.7:0/4076667130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555669de9e0 0x5555669edc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.922+0000 7f8f8e4ee640 1 -- 172.21.15.7:0/4076667130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5555669dff50 msgr2=0x5555669ee150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:30.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.922+0000 7f8f8e4ee640 1 --2- 172.21.15.7:0/4076667130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5555669dff50 0x5555669ee150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.922+0000 7f8f8e4ee640 1 -- 172.21.15.7:0/4076667130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555566a63100 con 0x5555669a3310 2024-09-19T08:52:30.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.922+0000 7f8f8e4ee640 1 --2- 172.21.15.7:0/4076667130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669a3310 0x5555669ed6d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f8f840985e0 tx=0x7f8f840bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7c6e7ac6834fb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:30.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.922+0000 7f8f71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:30.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.922+0000 7f8f71ffb640 1 -- 172.21.15.7:0/4076667130 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f840ba020 con 0x5555669a3310 2024-09-19T08:52:30.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.922+0000 7f8f71ffb640 1 -- 172.21.15.7:0/4076667130 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7f8f840cd870 con 0x5555669a3310 2024-09-19T08:52:30.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.922+0000 7f8f92b2b740 1 -- 172.21.15.7:0/4076667130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f78005520 con 0x5555669a3310 2024-09-19T08:52:30.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.922+0000 7f8f71ffb640 1 -- 172.21.15.7:0/4076667130 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8f840a0530 con 0x5555669a3310 2024-09-19T08:52:30.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.922+0000 7f8f92b2b740 10 client.17076 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:30.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.922+0000 7f8f92b2b740 1 -- 172.21.15.7:0/4076667130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555566a643e0 con 0x5555669a3310 2024-09-19T08:52:30.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.922+0000 7f8f71ffb640 1 -- 172.21.15.7:0/4076667130 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f78005520 con 0x5555669a3310 2024-09-19T08:52:30.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.922+0000 7f8f71ffb640 1 -- 172.21.15.7:0/4076667130 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8f840bc0b0 con 0x5555669a3310 2024-09-19T08:52:30.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.922+0000 7f8f92b2b740 10 client.17076 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:30.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.923+0000 7f8f92b2b740 10 client.17076 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:30.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.923+0000 7f8f92b2b740 20 client.17076 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:30.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.923+0000 7f8f92b2b740 1 --2- 172.21.15.7:0/4076667130 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5555669e9780 0x555566a66b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.923+0000 7f8f92b2b740 4 client.17076 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:52:30.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.923+0000 7f8f92b2b740 1 -- 172.21.15.7:0/4076667130 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555566947d70 con 0x5555669e9780 2024-09-19T08:52:30.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.923+0000 7f8f8dced640 1 --2- 172.21.15.7:0/4076667130 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5555669e9780 0x555566a66b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.923+0000 7f8f8dced640 1 --2- 172.21.15.7:0/4076667130 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5555669e9780 0x555566a66b60 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2f0e259fd794759 server_cookie=fcb90ce43f1a7ceb in_seq=0 out_seq=0 2024-09-19T08:52:30.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.923+0000 7f8f71ffb640 10 client.17076 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:30.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.923+0000 7f8f71ffb640 1 -- 172.21.15.7:0/4076667130 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555566947d70 con 0x5555669e9780 2024-09-19T08:52:30.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.923+0000 7f8f71ffb640 10 client.17076 handle_command_reply: tid=0 2024-09-19T08:52:30.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.923+0000 7f8f92b2b740 1 client.17076 shutdown 2024-09-19T08:52:30.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.923+0000 7f8f92b2b740 1 -- 172.21.15.7:0/4076667130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669a3310 msgr2=0x5555669ed6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:30.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.923+0000 7f8f92b2b740 1 --2- 172.21.15.7:0/4076667130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669a3310 0x5555669ed6d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f8f840985e0 tx=0x7f8f840bc040 comp rx=0 tx=0).stop 2024-09-19T08:52:30.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.924+0000 7f8f92b2b740 1 -- 172.21.15.7:0/4076667130 shutdown_connections 2024-09-19T08:52:30.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.924+0000 7f8f92b2b740 1 --2- 172.21.15.7:0/4076667130 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5555669e9780 0x555566a66b60 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.924+0000 7f8f92b2b740 1 --2- 172.21.15.7:0/4076667130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5555669dff50 0x5555669ee150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.924+0000 7f8f92b2b740 1 --2- 172.21.15.7:0/4076667130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555669de9e0 0x5555669edc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.924+0000 7f8f92b2b740 1 --2- 172.21.15.7:0/4076667130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5555669a3310 0x5555669ed6d0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.924+0000 7f8f92b2b740 1 -- 172.21.15.7:0/4076667130 >> 172.21.15.7:0/4076667130 conn(0x5555669e69f0 msgr2=0x5555669d5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:30.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.924+0000 7f8f71ffb640 0 client.17076 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:30.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.924+0000 7f8f92b2b740 1 -- 172.21.15.7:0/4076667130 shutdown_connections 2024-09-19T08:52:30.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.924+0000 7f8f92b2b740 1 -- 172.21.15.7:0/4076667130 wait complete. 2024-09-19T08:52:30.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.924+0000 7f8f92b2b740 20 client.17076 trim_cache size 0 max 16384 2024-09-19T08:52:30.935 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:52:30.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.924+0000 7f8f90752640 1 -- 172.21.15.7:0/3048798620 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8f740a33b0 msgr2=0x7f8f740a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:30.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.924+0000 7f8f90752640 1 --2- 172.21.15.7:0/3048798620 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8f740a33b0 0x7f8f740a5870 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8f80005fd0 tx=0x7f8f80004a40 comp rx=0 tx=0).stop 2024-09-19T08:52:30.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.924+0000 7f8f90752640 1 -- 172.21.15.7:0/3048798620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f88100a80 msgr2=0x7f8f88199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:30.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.924+0000 7f8f90752640 1 --2- 172.21.15.7:0/3048798620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f88100a80 0x7f8f88199270 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400c920 tx=0x7f8f8400cde0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.924+0000 7f8f90752640 1 -- 172.21.15.7:0/3048798620 shutdown_connections 2024-09-19T08:52:30.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.924+0000 7f8f90752640 1 --2- 172.21.15.7:0/3048798620 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8f740a33b0 0x7f8f740a5870 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.924+0000 7f8f90752640 1 --2- 172.21.15.7:0/3048798620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f88106a80 0x7f8f881a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.924+0000 7f8f90752640 1 --2- 172.21.15.7:0/3048798620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f88101420 0x7f8f881997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.924+0000 7f8f90752640 1 --2- 172.21.15.7:0/3048798620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f88100a80 0x7f8f88199270 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.924+0000 7f8f90752640 1 -- 172.21.15.7:0/3048798620 >> 172.21.15.7:0/3048798620 conn(0x7f8f880fc7a0 msgr2=0x7f8f880fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:30.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.924+0000 7f8f90752640 1 -- 172.21.15.7:0/3048798620 shutdown_connections 2024-09-19T08:52:30.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:30.925+0000 7f8f90752640 1 -- 172.21.15.7:0/3048798620 wait complete. 2024-09-19T08:52:30.937 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:30 smithi175 ceph-mon[35688]: pgmap v246: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:52:32.721 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:52:32.722 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:52:32.752 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:32 smithi007 ceph-mon[31221]: pgmap v247: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:32.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:32 smithi044 ceph-mon[35072]: pgmap v247: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:32.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:32 smithi175 ceph-mon[35688]: pgmap v247: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:32.990 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:33.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.473+0000 7ffa077aa640 1 -- 172.21.15.7:0/392376924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa00103670 msgr2=0x7ffa0010bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:33.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.473+0000 7ffa077aa640 1 --2- 172.21.15.7:0/392376924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa00103670 0x7ffa0010bb60 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009900 tx=0x7ff9f002a480 comp rx=0 tx=0).stop 2024-09-19T08:52:33.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.474+0000 7ffa077aa640 1 -- 172.21.15.7:0/392376924 shutdown_connections 2024-09-19T08:52:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.474+0000 7ffa077aa640 1 --2- 172.21.15.7:0/392376924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa0010c180 0x7ffa0010e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.474+0000 7ffa077aa640 1 --2- 172.21.15.7:0/392376924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa00103670 0x7ffa0010bb60 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.474+0000 7ffa077aa640 1 --2- 172.21.15.7:0/392376924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa00102d50 0x7ffa00103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.474+0000 7ffa077aa640 1 -- 172.21.15.7:0/392376924 >> 172.21.15.7:0/392376924 conn(0x7ffa000fc7d0 msgr2=0x7ffa000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.474+0000 7ffa077aa640 1 -- 172.21.15.7:0/392376924 shutdown_connections 2024-09-19T08:52:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.474+0000 7ffa077aa640 1 -- 172.21.15.7:0/392376924 wait complete. 2024-09-19T08:52:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.474+0000 7ffa077aa640 1 Processor -- start 2024-09-19T08:52:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.474+0000 7ffa077aa640 1 -- start start 2024-09-19T08:52:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.474+0000 7ffa077aa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa00102d50 0x7ffa00198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.474+0000 7ffa077aa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa00103670 0x7ffa00198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.475+0000 7ffa077aa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa0010c180 0x7ffa0019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.475+0000 7ffa077aa640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffa00111f80 con 0x7ffa0010c180 2024-09-19T08:52:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.475+0000 7ffa077aa640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffa00111e00 con 0x7ffa00103670 2024-09-19T08:52:33.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.475+0000 7ffa077aa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffa00112100 con 0x7ffa00102d50 2024-09-19T08:52:33.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.475+0000 7ffa05d47640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa0010c180 0x7ffa0019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:33.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.475+0000 7ffa05d47640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa0010c180 0x7ffa0019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50942/0 (socket says 172.21.15.7:50942) 2024-09-19T08:52:33.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.475+0000 7ffa05d47640 1 -- 172.21.15.7:0/204722514 learned_addr learned my addr 172.21.15.7:0/204722514 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:33.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.475+0000 7ffa04d45640 1 --2- 172.21.15.7:0/204722514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa00103670 0x7ffa00198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:33.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.475+0000 7ffa05546640 1 --2- 172.21.15.7:0/204722514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa00102d50 0x7ffa00198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:33.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.475+0000 7ffa05d47640 1 -- 172.21.15.7:0/204722514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa00102d50 msgr2=0x7ffa00198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:33.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.475+0000 7ffa05d47640 1 --2- 172.21.15.7:0/204722514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa00102d50 0x7ffa00198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.475+0000 7ffa05d47640 1 -- 172.21.15.7:0/204722514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa00103670 msgr2=0x7ffa00198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:33.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.475+0000 7ffa05d47640 1 --2- 172.21.15.7:0/204722514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa00103670 0x7ffa00198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.475+0000 7ffa05d47640 1 -- 172.21.15.7:0/204722514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa0019d3f0 con 0x7ffa0010c180 2024-09-19T08:52:33.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.475+0000 7ffa04d45640 1 --2- 172.21.15.7:0/204722514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa00103670 0x7ffa00198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:33.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.475+0000 7ffa05d47640 1 --2- 172.21.15.7:0/204722514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa0010c180 0x7ffa0019cd10 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800eaa0 tx=0x7ff9f800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:33.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.475+0000 7ff9f67fc640 1 -- 172.21.15.7:0/204722514 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f800cdb0 con 0x7ffa0010c180 2024-09-19T08:52:33.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.475+0000 7ffa077aa640 1 -- 172.21.15.7:0/204722514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa0019d6e0 con 0x7ffa0010c180 2024-09-19T08:52:33.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.475+0000 7ff9f67fc640 1 -- 172.21.15.7:0/204722514 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9f8005020 con 0x7ffa0010c180 2024-09-19T08:52:33.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.475+0000 7ff9f67fc640 1 -- 172.21.15.7:0/204722514 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f80116b0 con 0x7ffa0010c180 2024-09-19T08:52:33.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.475+0000 7ffa077aa640 1 -- 172.21.15.7:0/204722514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa001a4fc0 con 0x7ffa0010c180 2024-09-19T08:52:33.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.478+0000 7ff9f67fc640 1 -- 172.21.15.7:0/204722514 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff9f8005560 con 0x7ffa0010c180 2024-09-19T08:52:33.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.479+0000 7ffa09b83740 1 Processor -- start 2024-09-19T08:52:33.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.479+0000 7ffa09b83740 1 -- start start 2024-09-19T08:52:33.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.479+0000 7ffa09b83740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1b5b60 0x55c48d1b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:33.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.479+0000 7ffa09b83740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48d1b6480 0x55c48d1c0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:33.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.479+0000 7ffa09b83740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c48d1c0d40 0x55c48d1c3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:33.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.479+0000 7ffa09b83740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c48d11b280 con 0x55c48d1b5b60 2024-09-19T08:52:33.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.479+0000 7ffa09b83740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c48d0c2b10 con 0x55c48d1c0d40 2024-09-19T08:52:33.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.479+0000 7ffa09b83740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c48d117240 con 0x55c48d1b6480 2024-09-19T08:52:33.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.479+0000 7ffa04d45640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1b5b60 0x55c48d1b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:33.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.479+0000 7ffa04d45640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1b5b60 0x55c48d1b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50950/0 (socket says 172.21.15.7:50950) 2024-09-19T08:52:33.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.479+0000 7ffa04d45640 1 -- 172.21.15.7:0/700303842 learned_addr learned my addr 172.21.15.7:0/700303842 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:33.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.479+0000 7ff9f67fc640 1 --2- 172.21.15.7:0/204722514 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff9ec0a33b0 0x7ff9ec0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:33.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.479+0000 7ffa05d47640 1 --2- 172.21.15.7:0/204722514 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff9ec0a33b0 0x7ff9ec0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:33.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.479+0000 7ffa05546640 1 --2- 172.21.15.7:0/700303842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48d1b6480 0x55c48d1c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:33.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.479+0000 7ff9f67fc640 1 -- 172.21.15.7:0/204722514 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7ff9f80cff50 con 0x7ffa0010c180 2024-09-19T08:52:33.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.479+0000 7ffa04d45640 1 -- 172.21.15.7:0/700303842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48d1b6480 msgr2=0x55c48d1c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:33.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.479+0000 7ffa04d45640 1 --2- 172.21.15.7:0/700303842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48d1b6480 0x55c48d1c0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.479+0000 7ffa04d45640 1 -- 172.21.15.7:0/700303842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c48d1c0d40 msgr2=0x55c48d1c3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:33.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.479+0000 7ffa04d45640 1 --2- 172.21.15.7:0/700303842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c48d1c0d40 0x55c48d1c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.479+0000 7ffa04d45640 1 -- 172.21.15.7:0/700303842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c48d0cf1f0 con 0x55c48d1b5b60 2024-09-19T08:52:33.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.480+0000 7ffa04d45640 1 --2- 172.21.15.7:0/700303842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1b5b60 0x55c48d1b5f40 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0005940 tx=0x7ff9f0005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729011d0d6c4d72c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:33.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.480+0000 7ffa05d47640 1 --2- 172.21.15.7:0/204722514 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff9ec0a33b0 0x7ff9ec0a5870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800efd0 tx=0x7ff9f80514e0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:33.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.480+0000 7ff9eb7fe640 1 -- 172.21.15.7:0/700303842 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0035050 con 0x55c48d1b5b60 2024-09-19T08:52:33.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.480+0000 7ff9eb7fe640 1 -- 172.21.15.7:0/700303842 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9f00317b0 con 0x55c48d1b5b60 2024-09-19T08:52:33.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.480+0000 7ff9eb7fe640 1 -- 172.21.15.7:0/700303842 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00046c0 con 0x55c48d1b5b60 2024-09-19T08:52:33.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.481+0000 7ffa09b83740 1 -- 172.21.15.7:0/700303842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1b5b60 msgr2=0x55c48d1b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:33.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.481+0000 7ffa09b83740 1 --2- 172.21.15.7:0/700303842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1b5b60 0x55c48d1b5f40 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0005940 tx=0x7ff9f0005d90 comp rx=0 tx=0).stop 2024-09-19T08:52:33.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.481+0000 7ffa09b83740 1 -- 172.21.15.7:0/700303842 shutdown_connections 2024-09-19T08:52:33.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.481+0000 7ffa09b83740 1 --2- 172.21.15.7:0/700303842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c48d1c0d40 0x55c48d1c3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.481+0000 7ffa09b83740 1 --2- 172.21.15.7:0/700303842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48d1b6480 0x55c48d1c0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.481+0000 7ffa09b83740 1 --2- 172.21.15.7:0/700303842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1b5b60 0x55c48d1b5f40 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.481+0000 7ffa09b83740 1 -- 172.21.15.7:0/700303842 >> 172.21.15.7:0/700303842 conn(0x55c48d1b20f0 msgr2=0x55c48d1b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:33.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.481+0000 7ffa09b83740 1 -- 172.21.15.7:0/700303842 shutdown_connections 2024-09-19T08:52:33.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.481+0000 7ffa09b83740 1 -- 172.21.15.7:0/700303842 wait complete. 2024-09-19T08:52:33.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.481+0000 7ffa09b83740 1 -- start start 2024-09-19T08:52:33.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.481+0000 7ffa09b83740 1 Processor -- start 2024-09-19T08:52:33.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.482+0000 7ffa09b83740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c48d1b5b60 0x55c48d1bdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:33.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.482+0000 7ffa09b83740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1b6480 0x55c48d1be1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:33.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.482+0000 7ffa09b83740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48d1c0d40 0x55c48d1be710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:33.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.482+0000 7ffa09b83740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c48d1c3910 con 0x55c48d1b6480 2024-09-19T08:52:33.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.482+0000 7ffa09b83740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c48d0d5f10 con 0x55c48d1b5b60 2024-09-19T08:52:33.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.482+0000 7ffa09b83740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c48d1c3a90 con 0x55c48d1c0d40 2024-09-19T08:52:33.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.482+0000 7ffa09b83740 10 client.0 _ll_register_callbacks cb 0x55c48d09ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:33.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.482+0000 7ffa05546640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1b6480 0x55c48d1be1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:33.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.482+0000 7ffa05546640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1b6480 0x55c48d1be1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50958/0 (socket says 172.21.15.7:50958) 2024-09-19T08:52:33.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.482+0000 7ffa05546640 1 -- 172.21.15.7:0/4084543268 learned_addr learned my addr 172.21.15.7:0/4084543268 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:33.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.482+0000 7ffa04d45640 1 --2- 172.21.15.7:0/4084543268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c48d1b5b60 0x55c48d1bdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:33.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.482+0000 7ffa04d45640 1 --2- 172.21.15.7:0/4084543268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48d1c0d40 0x55c48d1be710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:33.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.482+0000 7ffa05546640 1 -- 172.21.15.7:0/4084543268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48d1c0d40 msgr2=0x55c48d1be710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:33.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.482+0000 7ffa05546640 1 --2- 172.21.15.7:0/4084543268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48d1c0d40 0x55c48d1be710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.482+0000 7ffa05546640 1 -- 172.21.15.7:0/4084543268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c48d1b5b60 msgr2=0x55c48d1bdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:33.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.482+0000 7ffa05546640 1 --2- 172.21.15.7:0/4084543268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c48d1b5b60 0x55c48d1bdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.482+0000 7ffa05546640 1 -- 172.21.15.7:0/4084543268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c48ce8c6a0 con 0x55c48d1b6480 2024-09-19T08:52:33.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.482+0000 7ffa05546640 1 --2- 172.21.15.7:0/4084543268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1b6480 0x55c48d1be1d0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc00b970 tx=0x7ff9fc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876e6270224a1ad6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:33.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.482+0000 7ff9e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:33.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.482+0000 7ff9e8ff9640 1 -- 172.21.15.7:0/4084543268 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc01b470 con 0x55c48d1b6480 2024-09-19T08:52:33.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.482+0000 7ff9e8ff9640 1 -- 172.21.15.7:0/4084543268 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7ff9fc01b610 con 0x55c48d1b6480 2024-09-19T08:52:33.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.483+0000 7ffa09b83740 1 -- 172.21.15.7:0/4084543268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9f00317b0 con 0x55c48d1b6480 2024-09-19T08:52:33.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.483+0000 7ff9e8ff9640 1 -- 172.21.15.7:0/4084543268 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff9fc01b810 con 0x55c48d1b6480 2024-09-19T08:52:33.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.483+0000 7ffa09b83740 10 client.17088 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:33.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.483+0000 7ffa09b83740 1 -- 172.21.15.7:0/4084543268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c48d1cf5f0 con 0x55c48d1b6480 2024-09-19T08:52:33.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.483+0000 7ff9e8ff9640 1 -- 172.21.15.7:0/4084543268 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9f00317b0 con 0x55c48d1b6480 2024-09-19T08:52:33.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.483+0000 7ff9e8ff9640 1 -- 172.21.15.7:0/4084543268 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff9fc012c10 con 0x55c48d1b6480 2024-09-19T08:52:33.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.483+0000 7ffa09b83740 10 client.17088 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:33.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.483+0000 7ffa09b83740 10 client.17088 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:33.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.483+0000 7ffa09b83740 20 client.17088 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:33.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.483+0000 7ffa09b83740 1 --2- 172.21.15.7:0/4084543268 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c48d1d0ab0 0x55c48d1d2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:33.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.483+0000 7ffa09b83740 4 client.17088 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:33.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.483+0000 7ffa09b83740 1 -- 172.21.15.7:0/4084543268 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c48d1287f0 con 0x55c48d1d0ab0 2024-09-19T08:52:33.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.483+0000 7ffa04d45640 1 --2- 172.21.15.7:0/4084543268 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c48d1d0ab0 0x55c48d1d2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:33.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.484+0000 7ff9e8ff9640 10 client.17088 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:33.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.484+0000 7ffa04d45640 1 --2- 172.21.15.7:0/4084543268 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c48d1d0ab0 0x55c48d1d2ee0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfbc89b7e6fbc90d server_cookie=87c499dc59926466 in_seq=0 out_seq=0 2024-09-19T08:52:33.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.484+0000 7ff9e8ff9640 1 -- 172.21.15.7:0/4084543268 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c48d1287f0 con 0x55c48d1d0ab0 2024-09-19T08:52:33.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.484+0000 7ff9e8ff9640 10 client.17088 handle_command_reply: tid=0 2024-09-19T08:52:33.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.484+0000 7ffa09b83740 1 client.17088 shutdown 2024-09-19T08:52:33.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.485+0000 7ffa09b83740 1 -- 172.21.15.7:0/4084543268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1b6480 msgr2=0x55c48d1be1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:33.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.485+0000 7ffa09b83740 1 --2- 172.21.15.7:0/4084543268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1b6480 0x55c48d1be1d0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc00b970 tx=0x7ff9fc00be30 comp rx=0 tx=0).stop 2024-09-19T08:52:33.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.485+0000 7ffa09b83740 1 -- 172.21.15.7:0/4084543268 shutdown_connections 2024-09-19T08:52:33.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.485+0000 7ffa09b83740 1 --2- 172.21.15.7:0/4084543268 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c48d1d0ab0 0x55c48d1d2ee0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.485+0000 7ffa09b83740 1 --2- 172.21.15.7:0/4084543268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48d1c0d40 0x55c48d1be710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.485+0000 7ffa09b83740 1 --2- 172.21.15.7:0/4084543268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1b6480 0x55c48d1be1d0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.485+0000 7ffa09b83740 1 --2- 172.21.15.7:0/4084543268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c48d1b5b60 0x55c48d1bdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.485+0000 7ff9e8ff9640 0 client.17088 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:33.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.485+0000 7ffa09b83740 1 -- 172.21.15.7:0/4084543268 >> 172.21.15.7:0/4084543268 conn(0x55c48d1b20f0 msgr2=0x55c48d1b7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:33.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.485+0000 7ffa09b83740 1 -- 172.21.15.7:0/4084543268 shutdown_connections 2024-09-19T08:52:33.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.485+0000 7ffa09b83740 1 -- 172.21.15.7:0/4084543268 wait complete. 2024-09-19T08:52:33.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.485+0000 7ffa09b83740 20 client.17088 trim_cache size 0 max 16384 2024-09-19T08:52:33.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.503+0000 7ffa09b83740 1 Processor -- start 2024-09-19T08:52:33.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.503+0000 7ffa09b83740 1 -- start start 2024-09-19T08:52:33.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.503+0000 7ffa09b83740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48d1b5b60 0x55c48d1b85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:33.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.504+0000 7ffa09b83740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1b6480 0x55c48d1d87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:33.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.504+0000 7ffa09b83740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c48d1c0d40 0x55c48d1d8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:33.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.504+0000 7ffa09b83740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffa001b0140 con 0x55c48d1b6480 2024-09-19T08:52:33.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.504+0000 7ffa09b83740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffa001ada10 con 0x55c48d1c0d40 2024-09-19T08:52:33.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.504+0000 7ffa09b83740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffa001ab880 con 0x55c48d1b5b60 2024-09-19T08:52:33.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.504+0000 7ffa05546640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1b6480 0x55c48d1d87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:33.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.504+0000 7ffa05546640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1b6480 0x55c48d1d87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50970/0 (socket says 172.21.15.7:50970) 2024-09-19T08:52:33.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.504+0000 7ffa05546640 1 -- 172.21.15.7:0/672997976 learned_addr learned my addr 172.21.15.7:0/672997976 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:33.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.504+0000 7ffa04d45640 1 --2- 172.21.15.7:0/672997976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48d1b5b60 0x55c48d1b85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:33.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.504+0000 7ffa04d45640 1 --2- 172.21.15.7:0/672997976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c48d1c0d40 0x55c48d1d8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:33.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.504+0000 7ffa05546640 1 -- 172.21.15.7:0/672997976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48d1b5b60 msgr2=0x55c48d1b85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:33.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.504+0000 7ffa05546640 1 --2- 172.21.15.7:0/672997976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48d1b5b60 0x55c48d1b85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.504+0000 7ffa05546640 1 -- 172.21.15.7:0/672997976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c48d1c0d40 msgr2=0x55c48d1d8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:33.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.504+0000 7ffa05546640 1 --2- 172.21.15.7:0/672997976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c48d1c0d40 0x55c48d1d8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.504+0000 7ffa05546640 1 -- 172.21.15.7:0/672997976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c48d1bc1e0 con 0x55c48d1b6480 2024-09-19T08:52:33.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.504+0000 7ffa05546640 1 --2- 172.21.15.7:0/672997976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1b6480 0x55c48d1d87f0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc015040 tx=0x7ff9fc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3dbe46383ae7ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:33.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.504+0000 7ff9eaffd640 1 -- 172.21.15.7:0/672997976 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc030070 con 0x55c48d1b6480 2024-09-19T08:52:33.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.504+0000 7ff9eaffd640 1 -- 172.21.15.7:0/672997976 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9fc016070 con 0x55c48d1b6480 2024-09-19T08:52:33.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.504+0000 7ff9eaffd640 1 -- 172.21.15.7:0/672997976 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc01bc10 con 0x55c48d1b6480 2024-09-19T08:52:33.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.505+0000 7ffa09b83740 1 -- 172.21.15.7:0/672997976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1b6480 msgr2=0x55c48d1d87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:33.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.505+0000 7ffa09b83740 1 --2- 172.21.15.7:0/672997976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1b6480 0x55c48d1d87f0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc015040 tx=0x7ff9fc000bc0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.505+0000 7ffa09b83740 1 -- 172.21.15.7:0/672997976 shutdown_connections 2024-09-19T08:52:33.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.505+0000 7ffa09b83740 1 --2- 172.21.15.7:0/672997976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c48d1c0d40 0x55c48d1d8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.505+0000 7ffa09b83740 1 --2- 172.21.15.7:0/672997976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1b6480 0x55c48d1d87f0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.505+0000 7ffa09b83740 1 --2- 172.21.15.7:0/672997976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48d1b5b60 0x55c48d1b85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.505+0000 7ffa09b83740 1 -- 172.21.15.7:0/672997976 >> 172.21.15.7:0/672997976 conn(0x55c48d1b20f0 msgr2=0x55c48d1bfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:33.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.505+0000 7ffa09b83740 1 -- 172.21.15.7:0/672997976 shutdown_connections 2024-09-19T08:52:33.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.505+0000 7ffa09b83740 1 -- 172.21.15.7:0/672997976 wait complete. 2024-09-19T08:52:33.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.506+0000 7ffa09b83740 1 -- start start 2024-09-19T08:52:33.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.506+0000 7ffa09b83740 1 Processor -- start 2024-09-19T08:52:33.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.506+0000 7ffa09b83740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c48d1b5b60 0x55c48d1c9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:33.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.506+0000 7ffa09b83740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48d1b6480 0x55c48d1c9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:33.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.506+0000 7ffa09b83740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1c0d40 0x55c48d1c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:33.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.506+0000 7ffa09b83740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffa001abed0 con 0x55c48d1c0d40 2024-09-19T08:52:33.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.506+0000 7ffa09b83740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffa001ad340 con 0x55c48d1b5b60 2024-09-19T08:52:33.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.506+0000 7ffa09b83740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffa001ac5a0 con 0x55c48d1b6480 2024-09-19T08:52:33.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.506+0000 7ffa09b83740 10 client.0 _ll_register_callbacks cb 0x7ff9fc0040a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:33.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.506+0000 7ffa04d45640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c48d1b5b60 0x55c48d1c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:33.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.506+0000 7ffa05546640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48d1b6480 0x55c48d1c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:33.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.506+0000 7ffa04d45640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1c0d40 0x55c48d1c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:33.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.506+0000 7ffa05546640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48d1b6480 0x55c48d1c9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.7:37592/0 (socket says 172.21.15.7:37592) 2024-09-19T08:52:33.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.506+0000 7ffa04d45640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1c0d40 0x55c48d1c55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50986/0 (socket says 172.21.15.7:50986) 2024-09-19T08:52:33.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.506+0000 7ffa05546640 1 -- 172.21.15.7:0/4205746459 learned_addr learned my addr 172.21.15.7:0/4205746459 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:33.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.507+0000 7ffa04d45640 1 -- 172.21.15.7:0/4205746459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48d1b6480 msgr2=0x55c48d1c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:33.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.507+0000 7ffa04d45640 1 --2- 172.21.15.7:0/4205746459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48d1b6480 0x55c48d1c9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.507+0000 7ffa04d45640 1 -- 172.21.15.7:0/4205746459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c48d1b5b60 msgr2=0x55c48d1c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:33.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.507+0000 7ffa04d45640 1 --2- 172.21.15.7:0/4205746459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c48d1b5b60 0x55c48d1c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.507+0000 7ffa04d45640 1 -- 172.21.15.7:0/4205746459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c48d1c5e10 con 0x55c48d1c0d40 2024-09-19T08:52:33.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.507+0000 7ffa04d45640 1 --2- 172.21.15.7:0/4205746459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1c0d40 0x55c48d1c55e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0006010 tx=0x7ff9fc004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9208222fdfdad336 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:33.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.507+0000 7ff9e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:33.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.507+0000 7ff9e8ff9640 1 -- 172.21.15.7:0/4205746459 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0035040 con 0x55c48d1c0d40 2024-09-19T08:52:33.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.507+0000 7ff9e8ff9640 1 -- 172.21.15.7:0/4205746459 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7ff9f0054e80 con 0x55c48d1c0d40 2024-09-19T08:52:33.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.507+0000 7ffa09b83740 1 -- 172.21.15.7:0/4205746459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9fc016070 con 0x55c48d1c0d40 2024-09-19T08:52:33.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.507+0000 7ff9e8ff9640 1 -- 172.21.15.7:0/4205746459 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff9f00046c0 con 0x55c48d1c0d40 2024-09-19T08:52:33.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.507+0000 7ffa09b83740 10 client.17094 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:33.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.507+0000 7ffa09b83740 1 -- 172.21.15.7:0/4205746459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c48d23c450 con 0x55c48d1c0d40 2024-09-19T08:52:33.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.507+0000 7ff9e8ff9640 1 -- 172.21.15.7:0/4205746459 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9fc016070 con 0x55c48d1c0d40 2024-09-19T08:52:33.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.508+0000 7ff9e8ff9640 1 -- 172.21.15.7:0/4205746459 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff9f00546d0 con 0x55c48d1c0d40 2024-09-19T08:52:33.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.508+0000 7ffa09b83740 10 client.17094 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:33.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.508+0000 7ffa09b83740 10 client.17094 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:33.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.508+0000 7ffa09b83740 20 client.17094 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:33.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.508+0000 7ffa09b83740 1 --2- 172.21.15.7:0/4205746459 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c48d23c6d0 0x55c48d23eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:33.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.508+0000 7ffa09b83740 4 client.17094 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:52:33.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.508+0000 7ffa09b83740 1 -- 172.21.15.7:0/4205746459 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c48d122d00 con 0x55c48d23c6d0 2024-09-19T08:52:33.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.508+0000 7ffa05546640 1 --2- 172.21.15.7:0/4205746459 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c48d23c6d0 0x55c48d23eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:33.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.508+0000 7ff9e8ff9640 10 client.17094 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:33.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.508+0000 7ffa05546640 1 --2- 172.21.15.7:0/4205746459 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c48d23c6d0 0x55c48d23eac0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f7e8756d9d5061b server_cookie=22635e4549f73584 in_seq=0 out_seq=0 2024-09-19T08:52:33.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.509+0000 7ff9e8ff9640 1 -- 172.21.15.7:0/4205746459 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c48d122d00 con 0x55c48d23c6d0 2024-09-19T08:52:33.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.509+0000 7ff9e8ff9640 10 client.17094 handle_command_reply: tid=0 2024-09-19T08:52:33.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.509+0000 7ffa09b83740 1 client.17094 shutdown 2024-09-19T08:52:33.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.509+0000 7ffa09b83740 1 -- 172.21.15.7:0/4205746459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1c0d40 msgr2=0x55c48d1c55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:33.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.509+0000 7ffa09b83740 1 --2- 172.21.15.7:0/4205746459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1c0d40 0x55c48d1c55e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0006010 tx=0x7ff9fc004410 comp rx=0 tx=0).stop 2024-09-19T08:52:33.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.510+0000 7ffa09b83740 1 -- 172.21.15.7:0/4205746459 shutdown_connections 2024-09-19T08:52:33.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.510+0000 7ffa09b83740 1 --2- 172.21.15.7:0/4205746459 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c48d23c6d0 0x55c48d23eac0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.510+0000 7ffa09b83740 1 --2- 172.21.15.7:0/4205746459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c48d1c0d40 0x55c48d1c55e0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.510+0000 7ffa09b83740 1 --2- 172.21.15.7:0/4205746459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48d1b6480 0x55c48d1c9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.510+0000 7ffa09b83740 1 --2- 172.21.15.7:0/4205746459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c48d1b5b60 0x55c48d1c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.510+0000 7ffa09b83740 1 -- 172.21.15.7:0/4205746459 >> 172.21.15.7:0/4205746459 conn(0x55c48d1b20f0 msgr2=0x55c48d1bdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:33.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.510+0000 7ff9e8ff9640 0 client.17094 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:33.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.510+0000 7ffa09b83740 1 -- 172.21.15.7:0/4205746459 shutdown_connections 2024-09-19T08:52:33.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.510+0000 7ffa09b83740 1 -- 172.21.15.7:0/4205746459 wait complete. 2024-09-19T08:52:33.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.510+0000 7ffa09b83740 20 client.17094 trim_cache size 0 max 16384 2024-09-19T08:52:33.514 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:52:33.514 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-19T08:52:33.514 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "1a24a87c-19fc-4347-b8cb-08cf4eeda656", 2024-09-19T08:52:33.514 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-19T08:52:33.514 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:52:33.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.510+0000 7ffa077aa640 1 -- 172.21.15.7:0/204722514 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff9ec0a33b0 msgr2=0x7ff9ec0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:33.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.510+0000 7ffa077aa640 1 --2- 172.21.15.7:0/204722514 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff9ec0a33b0 0x7ff9ec0a5870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800efd0 tx=0x7ff9f80514e0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.510+0000 7ffa077aa640 1 -- 172.21.15.7:0/204722514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa0010c180 msgr2=0x7ffa0019cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:33.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.510+0000 7ffa077aa640 1 --2- 172.21.15.7:0/204722514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa0010c180 0x7ffa0019cd10 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800eaa0 tx=0x7ff9f800ef60 comp rx=0 tx=0).stop 2024-09-19T08:52:33.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.510+0000 7ffa077aa640 1 -- 172.21.15.7:0/204722514 shutdown_connections 2024-09-19T08:52:33.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.510+0000 7ffa077aa640 1 --2- 172.21.15.7:0/204722514 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff9ec0a33b0 0x7ff9ec0a5870 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.511+0000 7ffa077aa640 1 --2- 172.21.15.7:0/204722514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa0010c180 0x7ffa0019cd10 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.511+0000 7ffa077aa640 1 --2- 172.21.15.7:0/204722514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa00103670 0x7ffa00198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.511+0000 7ffa077aa640 1 --2- 172.21.15.7:0/204722514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa00102d50 0x7ffa00198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.511+0000 7ffa077aa640 1 -- 172.21.15.7:0/204722514 >> 172.21.15.7:0/204722514 conn(0x7ffa000fc7d0 msgr2=0x7ffa000fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:33.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.511+0000 7ffa077aa640 1 -- 172.21.15.7:0/204722514 shutdown_connections 2024-09-19T08:52:33.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:33.511+0000 7ffa077aa640 1 -- 172.21.15.7:0/204722514 wait complete. 2024-09-19T08:52:34.401 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:52:34.703 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:34.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:34 smithi007 ceph-mon[31221]: pgmap v248: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:52:34.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:34 smithi007 ceph-mon[31221]: scrub queued for path: / 2024-09-19T08:52:34.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:34 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:34.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:34 smithi007 ceph-mon[31221]: scrub summary: active paths [/] 2024-09-19T08:52:34.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:34 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:34.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:34 smithi007 ceph-mon[31221]: scrub summary: idle 2024-09-19T08:52:34.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:34 smithi044 ceph-mon[35072]: pgmap v248: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:52:34.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:34 smithi044 ceph-mon[35072]: scrub queued for path: / 2024-09-19T08:52:34.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:34 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:34.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:34 smithi044 ceph-mon[35072]: scrub summary: active paths [/] 2024-09-19T08:52:34.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:34 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:34.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:34 smithi044 ceph-mon[35072]: scrub summary: idle 2024-09-19T08:52:34.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:34 smithi175 ceph-mon[35688]: pgmap v248: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:52:34.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:34 smithi175 ceph-mon[35688]: scrub queued for path: / 2024-09-19T08:52:34.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:34 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:34.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:34 smithi175 ceph-mon[35688]: scrub summary: active paths [/] 2024-09-19T08:52:34.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:34 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:34.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:34 smithi175 ceph-mon[35688]: scrub summary: idle 2024-09-19T08:52:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.322+0000 7f5c9be8e640 1 -- 172.21.15.7:0/1692647243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c9410c170 msgr2=0x7f5c9410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.322+0000 7f5c9be8e640 1 --2- 172.21.15.7:0/1692647243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c9410c170 0x7f5c9410e610 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c009ca0 tx=0x7f5c8c02a950 comp rx=0 tx=0).stop 2024-09-19T08:52:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.323+0000 7f5c9be8e640 1 -- 172.21.15.7:0/1692647243 shutdown_connections 2024-09-19T08:52:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.323+0000 7f5c9be8e640 1 --2- 172.21.15.7:0/1692647243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c9410c170 0x7f5c9410e610 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.323+0000 7f5c9be8e640 1 --2- 172.21.15.7:0/1692647243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c94103660 0x7f5c9410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.323+0000 7f5c9be8e640 1 --2- 172.21.15.7:0/1692647243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c94102d40 0x7f5c94103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.323+0000 7f5c9be8e640 1 -- 172.21.15.7:0/1692647243 >> 172.21.15.7:0/1692647243 conn(0x7f5c940fc7a0 msgr2=0x7f5c940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.323+0000 7f5c9be8e640 1 -- 172.21.15.7:0/1692647243 shutdown_connections 2024-09-19T08:52:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.323+0000 7f5c9be8e640 1 -- 172.21.15.7:0/1692647243 wait complete. 2024-09-19T08:52:35.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.323+0000 7f5c9be8e640 1 Processor -- start 2024-09-19T08:52:35.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.323+0000 7f5c9be8e640 1 -- start start 2024-09-19T08:52:35.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.324+0000 7f5c9be8e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c94102d40 0x7f5c941009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:35.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.324+0000 7f5c9be8e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c94103660 0x7f5c94100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:35.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.324+0000 7f5c9be8e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c9410c170 0x7f5c94101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:35.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.324+0000 7f5c9be8e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5c94111f70 con 0x7f5c9410c170 2024-09-19T08:52:35.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.324+0000 7f5c9be8e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5c94111df0 con 0x7f5c94102d40 2024-09-19T08:52:35.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.324+0000 7f5c9be8e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5c941120f0 con 0x7f5c94103660 2024-09-19T08:52:35.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.324+0000 7f5c9a42b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c9410c170 0x7f5c94101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:35.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.324+0000 7f5c9a42b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c9410c170 0x7f5c94101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50992/0 (socket says 172.21.15.7:50992) 2024-09-19T08:52:35.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.324+0000 7f5c9a42b640 1 -- 172.21.15.7:0/1832869739 learned_addr learned my addr 172.21.15.7:0/1832869739 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:35.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.324+0000 7f5c99c2a640 1 --2- 172.21.15.7:0/1832869739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c94102d40 0x7f5c941009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:35.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.324+0000 7f5c99429640 1 --2- 172.21.15.7:0/1832869739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c94103660 0x7f5c94100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:35.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.324+0000 7f5c9a42b640 1 -- 172.21.15.7:0/1832869739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c94103660 msgr2=0x7f5c94100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:35.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.324+0000 7f5c9a42b640 1 --2- 172.21.15.7:0/1832869739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c94103660 0x7f5c94100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.324+0000 7f5c9a42b640 1 -- 172.21.15.7:0/1832869739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c94102d40 msgr2=0x7f5c941009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:35.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.324+0000 7f5c9a42b640 1 --2- 172.21.15.7:0/1832869739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c94102d40 0x7f5c941009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.324+0000 7f5c9a42b640 1 -- 172.21.15.7:0/1832869739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c941a6890 con 0x7f5c9410c170 2024-09-19T08:52:35.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.324+0000 7f5c99429640 1 --2- 172.21.15.7:0/1832869739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c94103660 0x7f5c94100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:35.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.324+0000 7f5c9a42b640 1 --2- 172.21.15.7:0/1832869739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c9410c170 0x7f5c94101420 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c02ae70 tx=0x7f5c8c02f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:35.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.324+0000 7f5c8affd640 1 -- 172.21.15.7:0/1832869739 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c034040 con 0x7f5c9410c170 2024-09-19T08:52:35.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.325+0000 7f5c9be8e640 1 -- 172.21.15.7:0/1832869739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c941a6b20 con 0x7f5c9410c170 2024-09-19T08:52:35.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.325+0000 7f5c8affd640 1 -- 172.21.15.7:0/1832869739 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c8c030920 con 0x7f5c9410c170 2024-09-19T08:52:35.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.325+0000 7f5c8affd640 1 -- 172.21.15.7:0/1832869739 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c045480 con 0x7f5c9410c170 2024-09-19T08:52:35.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.325+0000 7f5c9be8e640 1 -- 172.21.15.7:0/1832869739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c941a7000 con 0x7f5c9410c170 2024-09-19T08:52:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.327+0000 7f5c8affd640 1 -- 172.21.15.7:0/1832869739 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f5c8c037020 con 0x7f5c9410c170 2024-09-19T08:52:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.327+0000 7f5c9e267740 1 Processor -- start 2024-09-19T08:52:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.328+0000 7f5c9e267740 1 -- start start 2024-09-19T08:52:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.328+0000 7f5c9e267740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce389fe4a0 0x55ce389fe880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.328+0000 7f5c9e267740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce389fedc0 0x55ce38a09140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.328+0000 7f5c8affd640 1 --2- 172.21.15.7:0/1832869739 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5c800a33b0 0x7f5c800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.328+0000 7f5c9e267740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce38a09680 0x55ce38a0ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.328+0000 7f5c9e267740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ce389642e0 con 0x55ce389fe4a0 2024-09-19T08:52:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.328+0000 7f5c9e267740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ce3890bce0 con 0x55ce38a09680 2024-09-19T08:52:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.328+0000 7f5c9e267740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ce389602a0 con 0x55ce389fedc0 2024-09-19T08:52:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.328+0000 7f5c99429640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce389fe4a0 0x55ce389fe880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.328+0000 7f5c99429640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce389fe4a0 0x55ce389fe880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50994/0 (socket says 172.21.15.7:50994) 2024-09-19T08:52:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.328+0000 7f5c99429640 1 -- 172.21.15.7:0/2309133570 learned_addr learned my addr 172.21.15.7:0/2309133570 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.328+0000 7f5c99c2a640 1 --2- 172.21.15.7:0/2309133570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce389fedc0 0x55ce38a09140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.328+0000 7f5c8affd640 1 -- 172.21.15.7:0/1832869739 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7f5c8c0f0bd0 con 0x7f5c9410c170 2024-09-19T08:52:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.328+0000 7f5c99429640 1 --2- 172.21.15.7:0/1832869739 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5c800a33b0 0x7f5c800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.328+0000 7f5c9a42b640 1 --2- 172.21.15.7:0/2309133570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce38a09680 0x55ce38a0ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.329+0000 7f5c99c2a640 1 -- 172.21.15.7:0/2309133570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce38a09680 msgr2=0x55ce38a0ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.329+0000 7f5c99c2a640 1 --2- 172.21.15.7:0/2309133570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce38a09680 0x55ce38a0ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.329+0000 7f5c99c2a640 1 -- 172.21.15.7:0/2309133570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce389fe4a0 msgr2=0x55ce389fe880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.329+0000 7f5c99c2a640 1 --2- 172.21.15.7:0/2309133570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce389fe4a0 0x55ce389fe880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.329+0000 7f5c99c2a640 1 -- 172.21.15.7:0/2309133570 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce388f0440 con 0x55ce389fedc0 2024-09-19T08:52:35.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.329+0000 7f5c99429640 1 --2- 172.21.15.7:0/2309133570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce389fe4a0 0x55ce389fe880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:35.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.329+0000 7f5c99c2a640 1 --2- 172.21.15.7:0/2309133570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce389fedc0 0x55ce38a09140 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000bbf0 tx=0x7f5c900107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c63cda45f14c4611 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:35.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.329+0000 7f5c99429640 1 --2- 172.21.15.7:0/1832869739 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5c800a33b0 0x7f5c800a5870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5c84005e00 tx=0x7f5c84005c70 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:35.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.329+0000 7f5c7ffff640 1 -- 172.21.15.7:0/2309133570 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90004030 con 0x55ce389fedc0 2024-09-19T08:52:35.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.329+0000 7f5c7ffff640 1 -- 172.21.15.7:0/2309133570 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c900041d0 con 0x55ce389fedc0 2024-09-19T08:52:35.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.329+0000 7f5c7ffff640 1 -- 172.21.15.7:0/2309133570 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90011680 con 0x55ce389fedc0 2024-09-19T08:52:35.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.330+0000 7f5c9e267740 1 -- 172.21.15.7:0/2309133570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce389fedc0 msgr2=0x55ce38a09140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:35.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.330+0000 7f5c9e267740 1 --2- 172.21.15.7:0/2309133570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce389fedc0 0x55ce38a09140 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000bbf0 tx=0x7f5c900107a0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.330+0000 7f5c9e267740 1 -- 172.21.15.7:0/2309133570 shutdown_connections 2024-09-19T08:52:35.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.330+0000 7f5c9e267740 1 --2- 172.21.15.7:0/2309133570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce38a09680 0x55ce38a0ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.330+0000 7f5c9e267740 1 --2- 172.21.15.7:0/2309133570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce389fedc0 0x55ce38a09140 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.330+0000 7f5c9e267740 1 --2- 172.21.15.7:0/2309133570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce389fe4a0 0x55ce389fe880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.330+0000 7f5c9e267740 1 -- 172.21.15.7:0/2309133570 >> 172.21.15.7:0/2309133570 conn(0x55ce389faa30 msgr2=0x55ce389fae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:35.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.330+0000 7f5c9e267740 1 -- 172.21.15.7:0/2309133570 shutdown_connections 2024-09-19T08:52:35.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.330+0000 7f5c9e267740 1 -- 172.21.15.7:0/2309133570 wait complete. 2024-09-19T08:52:35.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.330+0000 7f5c9e267740 1 -- start start 2024-09-19T08:52:35.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.330+0000 7f5c9e267740 1 Processor -- start 2024-09-19T08:52:35.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.331+0000 7f5c9e267740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce389fe4a0 0x55ce38a08f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:35.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.331+0000 7f5c9e267740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce389fedc0 0x55ce38a061e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:35.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.331+0000 7f5c9e267740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce38a09680 0x55ce38a06720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:35.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.331+0000 7f5c9e267740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ce38a0c250 con 0x55ce389fe4a0 2024-09-19T08:52:35.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.331+0000 7f5c9e267740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ce3891f050 con 0x55ce38a09680 2024-09-19T08:52:35.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.331+0000 7f5c9e267740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ce38a0c3d0 con 0x55ce389fedc0 2024-09-19T08:52:35.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.331+0000 7f5c9e267740 10 client.0 _ll_register_callbacks cb 0x55ce3895f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:35.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.331+0000 7f5c99c2a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce389fe4a0 0x55ce38a08f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:35.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.331+0000 7f5c99c2a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce389fe4a0 0x55ce38a08f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51010/0 (socket says 172.21.15.7:51010) 2024-09-19T08:52:35.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.331+0000 7f5c99c2a640 1 -- 172.21.15.7:0/3521887515 learned_addr learned my addr 172.21.15.7:0/3521887515 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:35.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.331+0000 7f5c99429640 1 --2- 172.21.15.7:0/3521887515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce389fedc0 0x55ce38a061e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:35.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.331+0000 7f5c9a42b640 1 --2- 172.21.15.7:0/3521887515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce38a09680 0x55ce38a06720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:35.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.331+0000 7f5c99c2a640 1 -- 172.21.15.7:0/3521887515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce389fedc0 msgr2=0x55ce38a061e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:35.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.331+0000 7f5c99c2a640 1 --2- 172.21.15.7:0/3521887515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce389fedc0 0x55ce38a061e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.331+0000 7f5c99c2a640 1 -- 172.21.15.7:0/3521887515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce38a09680 msgr2=0x55ce38a06720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.331+0000 7f5c99c2a640 1 --2- 172.21.15.7:0/3521887515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce38a09680 0x55ce38a06720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.331+0000 7f5c99c2a640 1 -- 172.21.15.7:0/3521887515 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce386d53c0 con 0x55ce389fe4a0 2024-09-19T08:52:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.332+0000 7f5c99c2a640 1 --2- 172.21.15.7:0/3521887515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce389fe4a0 0x55ce38a08f30 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f5c90000c00 tx=0x7f5c9000b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e985606ec0f261e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.332+0000 7f5c7d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.332+0000 7f5c7d7fa640 1 -- 172.21.15.7:0/3521887515 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9002a060 con 0x55ce389fe4a0 2024-09-19T08:52:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.332+0000 7f5c7d7fa640 1 -- 172.21.15.7:0/3521887515 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7f5c900035f0 con 0x55ce389fe4a0 2024-09-19T08:52:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.332+0000 7f5c9e267740 1 -- 172.21.15.7:0/3521887515 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c900041d0 con 0x55ce389fe4a0 2024-09-19T08:52:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.332+0000 7f5c7d7fa640 1 -- 172.21.15.7:0/3521887515 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5c9000be60 con 0x55ce389fe4a0 2024-09-19T08:52:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.332+0000 7f5c9e267740 10 client.17106 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.332+0000 7f5c9e267740 1 -- 172.21.15.7:0/3521887515 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ce38a17b70 con 0x55ce389fe4a0 2024-09-19T08:52:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.332+0000 7f5c7d7fa640 1 -- 172.21.15.7:0/3521887515 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c900041d0 con 0x55ce389fe4a0 2024-09-19T08:52:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.332+0000 7f5c7d7fa640 1 -- 172.21.15.7:0/3521887515 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5c90004860 con 0x55ce389fe4a0 2024-09-19T08:52:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.332+0000 7f5c9e267740 10 client.17106 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:35.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.332+0000 7f5c9e267740 10 client.17106 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:35.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.333+0000 7f5c9e267740 20 client.17106 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:35.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.333+0000 7f5c9e267740 1 --2- 172.21.15.7:0/3521887515 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ce38a18f80 0x55ce38a1b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:35.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.333+0000 7f5c9e267740 4 client.17106 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:35.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.333+0000 7f5c9e267740 1 -- 172.21.15.7:0/3521887515 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce38971850 con 0x55ce38a18f80 2024-09-19T08:52:35.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.333+0000 7f5c99429640 1 --2- 172.21.15.7:0/3521887515 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ce38a18f80 0x55ce38a1b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:35.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.333+0000 7f5c99429640 1 --2- 172.21.15.7:0/3521887515 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ce38a18f80 0x55ce38a1b370 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8b2d83a085b8d1f server_cookie=6797d088219991d1 in_seq=0 out_seq=0 2024-09-19T08:52:35.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.333+0000 7f5c7d7fa640 10 client.17106 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:35.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.334+0000 7f5c7d7fa640 1 -- 172.21.15.7:0/3521887515 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ce38971850 con 0x55ce38a18f80 2024-09-19T08:52:35.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.334+0000 7f5c7d7fa640 10 client.17106 handle_command_reply: tid=0 2024-09-19T08:52:35.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.334+0000 7f5c9e267740 1 client.17106 shutdown 2024-09-19T08:52:35.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.334+0000 7f5c9e267740 1 -- 172.21.15.7:0/3521887515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce389fe4a0 msgr2=0x55ce38a08f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:35.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.334+0000 7f5c9e267740 1 --2- 172.21.15.7:0/3521887515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce389fe4a0 0x55ce38a08f30 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f5c90000c00 tx=0x7f5c9000b820 comp rx=0 tx=0).stop 2024-09-19T08:52:35.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.334+0000 7f5c9e267740 1 -- 172.21.15.7:0/3521887515 shutdown_connections 2024-09-19T08:52:35.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.334+0000 7f5c9e267740 1 --2- 172.21.15.7:0/3521887515 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ce38a18f80 0x55ce38a1b370 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.334+0000 7f5c9e267740 1 --2- 172.21.15.7:0/3521887515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce38a09680 0x55ce38a06720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.334+0000 7f5c9e267740 1 --2- 172.21.15.7:0/3521887515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce389fedc0 0x55ce38a061e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.334+0000 7f5c7d7fa640 0 client.17106 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:35.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.334+0000 7f5c9e267740 1 --2- 172.21.15.7:0/3521887515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce389fe4a0 0x55ce38a08f30 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.334+0000 7f5c9e267740 1 -- 172.21.15.7:0/3521887515 >> 172.21.15.7:0/3521887515 conn(0x55ce389faa30 msgr2=0x55ce38a00760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:35.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.334+0000 7f5c9e267740 1 -- 172.21.15.7:0/3521887515 shutdown_connections 2024-09-19T08:52:35.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.334+0000 7f5c9e267740 1 -- 172.21.15.7:0/3521887515 wait complete. 2024-09-19T08:52:35.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.334+0000 7f5c9e267740 20 client.17106 trim_cache size 0 max 16384 2024-09-19T08:52:35.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.351+0000 7f5c9e267740 1 Processor -- start 2024-09-19T08:52:35.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.352+0000 7f5c9e267740 1 -- start start 2024-09-19T08:52:35.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.352+0000 7f5c9e267740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce389fe4a0 0x55ce38a154b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:35.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.352+0000 7f5c9e267740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce389fedc0 0x55ce38a017f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:35.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.352+0000 7f5c9e267740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce38a09680 0x55ce38a20970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:35.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.352+0000 7f5c9e267740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5c941b23d0 con 0x55ce38a09680 2024-09-19T08:52:35.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.352+0000 7f5c9e267740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5c941afca0 con 0x55ce389fe4a0 2024-09-19T08:52:35.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.352+0000 7f5c9e267740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5c941adb10 con 0x55ce389fedc0 2024-09-19T08:52:35.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.352+0000 7f5c9a42b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce38a09680 0x55ce38a20970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:35.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.352+0000 7f5c9a42b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce38a09680 0x55ce38a20970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51012/0 (socket says 172.21.15.7:51012) 2024-09-19T08:52:35.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.352+0000 7f5c9a42b640 1 -- 172.21.15.7:0/369710973 learned_addr learned my addr 172.21.15.7:0/369710973 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:35.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.352+0000 7f5c99c2a640 1 --2- 172.21.15.7:0/369710973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce389fe4a0 0x55ce38a154b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:35.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.352+0000 7f5c99429640 1 --2- 172.21.15.7:0/369710973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce389fedc0 0x55ce38a017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:35.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.352+0000 7f5c9a42b640 1 -- 172.21.15.7:0/369710973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce389fedc0 msgr2=0x55ce38a017f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:35.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.352+0000 7f5c9a42b640 1 --2- 172.21.15.7:0/369710973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce389fedc0 0x55ce38a017f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.352+0000 7f5c9a42b640 1 -- 172.21.15.7:0/369710973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce389fe4a0 msgr2=0x55ce38a154b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:35.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.352+0000 7f5c9a42b640 1 --2- 172.21.15.7:0/369710973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce389fe4a0 0x55ce38a154b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.352+0000 7f5c9a42b640 1 -- 172.21.15.7:0/369710973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce389fa860 con 0x55ce38a09680 2024-09-19T08:52:35.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.352+0000 7f5c9a42b640 1 --2- 172.21.15.7:0/369710973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce38a09680 0x55ce38a20970 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0b9380 tx=0x7f5c8c02a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19311ae168f3852d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:35.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.352+0000 7f5c7f7fe640 1 -- 172.21.15.7:0/369710973 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c02c040 con 0x55ce38a09680 2024-09-19T08:52:35.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.353+0000 7f5c7f7fe640 1 -- 172.21.15.7:0/369710973 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c8c0098d0 con 0x55ce38a09680 2024-09-19T08:52:35.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.353+0000 7f5c7f7fe640 1 -- 172.21.15.7:0/369710973 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c004040 con 0x55ce38a09680 2024-09-19T08:52:35.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.353+0000 7f5c9e267740 1 -- 172.21.15.7:0/369710973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce38a09680 msgr2=0x55ce38a20970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:35.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.353+0000 7f5c9e267740 1 --2- 172.21.15.7:0/369710973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce38a09680 0x55ce38a20970 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0b9380 tx=0x7f5c8c02a950 comp rx=0 tx=0).stop 2024-09-19T08:52:35.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.353+0000 7f5c9e267740 1 -- 172.21.15.7:0/369710973 shutdown_connections 2024-09-19T08:52:35.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.353+0000 7f5c9e267740 1 --2- 172.21.15.7:0/369710973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce38a09680 0x55ce38a20970 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.353+0000 7f5c9e267740 1 --2- 172.21.15.7:0/369710973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce389fedc0 0x55ce38a017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.353+0000 7f5c9e267740 1 --2- 172.21.15.7:0/369710973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce389fe4a0 0x55ce38a154b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.353+0000 7f5c9e267740 1 -- 172.21.15.7:0/369710973 >> 172.21.15.7:0/369710973 conn(0x55ce389faa30 msgr2=0x55ce38a010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:35.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.353+0000 7f5c9e267740 1 -- 172.21.15.7:0/369710973 shutdown_connections 2024-09-19T08:52:35.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.353+0000 7f5c9e267740 1 -- 172.21.15.7:0/369710973 wait complete. 2024-09-19T08:52:35.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.353+0000 7f5c9e267740 1 -- start start 2024-09-19T08:52:35.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.354+0000 7f5c9e267740 1 Processor -- start 2024-09-19T08:52:35.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.354+0000 7f5c9e267740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce389fe4a0 0x55ce38a11cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:35.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.354+0000 7f5c9e267740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce389fedc0 0x55ce38a0d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:35.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.354+0000 7f5c9e267740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce38a09680 0x55ce38a0d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:35.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.354+0000 7f5c9e267740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5c941ae160 con 0x55ce389fe4a0 2024-09-19T08:52:35.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.354+0000 7f5c9e267740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5c941af5d0 con 0x55ce389fedc0 2024-09-19T08:52:35.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.354+0000 7f5c9e267740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5c941ae830 con 0x55ce38a09680 2024-09-19T08:52:35.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.354+0000 7f5c9e267740 10 client.0 _ll_register_callbacks cb 0x7f5c9406b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:35.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.354+0000 7f5c99c2a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce389fe4a0 0x55ce38a11cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:35.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.354+0000 7f5c99c2a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce389fe4a0 0x55ce38a11cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51014/0 (socket says 172.21.15.7:51014) 2024-09-19T08:52:35.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.354+0000 7f5c99c2a640 1 -- 172.21.15.7:0/728152226 learned_addr learned my addr 172.21.15.7:0/728152226 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:35.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.354+0000 7f5c99429640 1 --2- 172.21.15.7:0/728152226 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce389fedc0 0x55ce38a0d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:35.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.354+0000 7f5c9a42b640 1 --2- 172.21.15.7:0/728152226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce38a09680 0x55ce38a0d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:35.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.354+0000 7f5c99c2a640 1 -- 172.21.15.7:0/728152226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce38a09680 msgr2=0x55ce38a0d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:35.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.355+0000 7f5c99c2a640 1 --2- 172.21.15.7:0/728152226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce38a09680 0x55ce38a0d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.355+0000 7f5c99c2a640 1 -- 172.21.15.7:0/728152226 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce389fedc0 msgr2=0x55ce38a0d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:35.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.355+0000 7f5c99c2a640 1 --2- 172.21.15.7:0/728152226 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce389fedc0 0x55ce38a0d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.355+0000 7f5c99c2a640 1 -- 172.21.15.7:0/728152226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce38a0dd90 con 0x55ce389fe4a0 2024-09-19T08:52:35.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.355+0000 7f5c9a42b640 1 --2- 172.21.15.7:0/728152226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce38a09680 0x55ce38a0d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:35.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.355+0000 7f5c99c2a640 1 --2- 172.21.15.7:0/728152226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce389fe4a0 0x55ce38a11cf0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f5c9002f040 tx=0x7f5c9000b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c165f65114aef7e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:35.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.355+0000 7f5c7d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:35.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.355+0000 7f5c7d7fa640 1 -- 172.21.15.7:0/728152226 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c900041d0 con 0x55ce389fe4a0 2024-09-19T08:52:35.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.355+0000 7f5c9e267740 1 -- 172.21.15.7:0/728152226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ce3896bd60 con 0x55ce389fe4a0 2024-09-19T08:52:35.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.355+0000 7f5c7d7fa640 1 -- 172.21.15.7:0/728152226 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7f5c900118f0 con 0x55ce389fe4a0 2024-09-19T08:52:35.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.355+0000 7f5c7d7fa640 1 -- 172.21.15.7:0/728152226 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5c90011440 con 0x55ce389fe4a0 2024-09-19T08:52:35.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.355+0000 7f5c9e267740 10 client.17112 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:35.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.355+0000 7f5c9e267740 1 -- 172.21.15.7:0/728152226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ce38a838e0 con 0x55ce389fe4a0 2024-09-19T08:52:35.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.355+0000 7f5c7d7fa640 1 -- 172.21.15.7:0/728152226 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55ce3896bd60 con 0x55ce389fe4a0 2024-09-19T08:52:35.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.355+0000 7f5c7d7fa640 1 -- 172.21.15.7:0/728152226 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5c9003c030 con 0x55ce389fe4a0 2024-09-19T08:52:35.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.356+0000 7f5c9e267740 10 client.17112 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:35.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.356+0000 7f5c9e267740 10 client.17112 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:35.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.356+0000 7f5c9e267740 20 client.17112 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:35.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.356+0000 7f5c9e267740 1 --2- 172.21.15.7:0/728152226 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ce38a83ff0 0x55ce38a863e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:35.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.356+0000 7f5c9e267740 4 client.17112 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:52:35.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.356+0000 7f5c9e267740 1 -- 172.21.15.7:0/728152226 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ce388e8210 con 0x55ce38a83ff0 2024-09-19T08:52:35.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.356+0000 7f5c99429640 1 --2- 172.21.15.7:0/728152226 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ce38a83ff0 0x55ce38a863e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:35.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.356+0000 7f5c99429640 1 --2- 172.21.15.7:0/728152226 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ce38a83ff0 0x55ce38a863e0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1592c24c55d9a765 server_cookie=8cde4b3c78c41107 in_seq=0 out_seq=0 2024-09-19T08:52:35.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.356+0000 7f5c7d7fa640 10 client.17112 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:35.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.356+0000 7f5c7d7fa640 1 -- 172.21.15.7:0/728152226 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ce388e8210 con 0x55ce38a83ff0 2024-09-19T08:52:35.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.356+0000 7f5c7d7fa640 10 client.17112 handle_command_reply: tid=0 2024-09-19T08:52:35.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.356+0000 7f5c9e267740 1 client.17112 shutdown 2024-09-19T08:52:35.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.356+0000 7f5c9e267740 1 -- 172.21.15.7:0/728152226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce389fe4a0 msgr2=0x55ce38a11cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:35.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.356+0000 7f5c9e267740 1 --2- 172.21.15.7:0/728152226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce389fe4a0 0x55ce38a11cf0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f5c9002f040 tx=0x7f5c9000b7b0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.357+0000 7f5c9e267740 1 -- 172.21.15.7:0/728152226 shutdown_connections 2024-09-19T08:52:35.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.357+0000 7f5c9e267740 1 --2- 172.21.15.7:0/728152226 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55ce38a83ff0 0x55ce38a863e0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.357+0000 7f5c9e267740 1 --2- 172.21.15.7:0/728152226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce38a09680 0x55ce38a0d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.357+0000 7f5c9e267740 1 --2- 172.21.15.7:0/728152226 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce389fedc0 0x55ce38a0d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.357+0000 7f5c7d7fa640 0 client.17112 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:35.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.357+0000 7f5c9e267740 1 --2- 172.21.15.7:0/728152226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce389fe4a0 0x55ce38a11cf0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.357+0000 7f5c9e267740 1 -- 172.21.15.7:0/728152226 >> 172.21.15.7:0/728152226 conn(0x55ce389faa30 msgr2=0x55ce389f9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:35.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.357+0000 7f5c9e267740 1 -- 172.21.15.7:0/728152226 shutdown_connections 2024-09-19T08:52:35.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.357+0000 7f5c9e267740 1 -- 172.21.15.7:0/728152226 wait complete. 2024-09-19T08:52:35.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.357+0000 7f5c9e267740 20 client.17112 trim_cache size 0 max 16384 2024-09-19T08:52:35.362 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:52:35.362 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-19T08:52:35.362 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-09-19T08:52:35.362 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:52:35.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.357+0000 7f5c9be8e640 1 -- 172.21.15.7:0/1832869739 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5c800a33b0 msgr2=0x7f5c800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:35.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.357+0000 7f5c9be8e640 1 --2- 172.21.15.7:0/1832869739 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5c800a33b0 0x7f5c800a5870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5c84005e00 tx=0x7f5c84005c70 comp rx=0 tx=0).stop 2024-09-19T08:52:35.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.357+0000 7f5c9be8e640 1 -- 172.21.15.7:0/1832869739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c9410c170 msgr2=0x7f5c94101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:35.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.357+0000 7f5c9be8e640 1 --2- 172.21.15.7:0/1832869739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c9410c170 0x7f5c94101420 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c02ae70 tx=0x7f5c8c02f5b0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.357+0000 7f5c9be8e640 1 -- 172.21.15.7:0/1832869739 shutdown_connections 2024-09-19T08:52:35.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.357+0000 7f5c9be8e640 1 --2- 172.21.15.7:0/1832869739 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5c800a33b0 0x7f5c800a5870 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.357+0000 7f5c9be8e640 1 --2- 172.21.15.7:0/1832869739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c9410c170 0x7f5c94101420 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.357+0000 7f5c9be8e640 1 --2- 172.21.15.7:0/1832869739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c94103660 0x7f5c94100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.357+0000 7f5c9be8e640 1 --2- 172.21.15.7:0/1832869739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c94102d40 0x7f5c941009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:35.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.357+0000 7f5c9be8e640 1 -- 172.21.15.7:0/1832869739 >> 172.21.15.7:0/1832869739 conn(0x7f5c940fc7a0 msgr2=0x7f5c940fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:35.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.358+0000 7f5c9be8e640 1 -- 172.21.15.7:0/1832869739 shutdown_connections 2024-09-19T08:52:35.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:35.358+0000 7f5c9be8e640 1 -- 172.21.15.7:0/1832869739 wait complete. 2024-09-19T08:52:36.105 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:52:36.105 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:52:36.363 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:36.720 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:36 smithi007 ceph-mon[31221]: pgmap v249: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:36.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:36 smithi044 ceph-mon[35072]: pgmap v249: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.806+0000 7ff6dda6c640 1 -- 172.21.15.7:0/3393441950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d8102ef0 msgr2=0x7ff6d810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.806+0000 7ff6dda6c640 1 --2- 172.21.15.7:0/3393441950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d8102ef0 0x7ff6d810da40 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009ca0 tx=0x7ff6d002a950 comp rx=0 tx=0).stop 2024-09-19T08:52:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.806+0000 7ff6dda6c640 1 -- 172.21.15.7:0/3393441950 shutdown_connections 2024-09-19T08:52:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.806+0000 7ff6dda6c640 1 --2- 172.21.15.7:0/3393441950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d8102ef0 0x7ff6d810da40 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.806+0000 7ff6dda6c640 1 --2- 172.21.15.7:0/3393441950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6d8102570 0x7ff6d81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.806+0000 7ff6dda6c640 1 --2- 172.21.15.7:0/3393441950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6d8100e20 0x7ff6d8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.806+0000 7ff6dda6c640 1 -- 172.21.15.7:0/3393441950 >> 172.21.15.7:0/3393441950 conn(0x7ff6d80fc7d0 msgr2=0x7ff6d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.806+0000 7ff6dda6c640 1 -- 172.21.15.7:0/3393441950 shutdown_connections 2024-09-19T08:52:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.806+0000 7ff6dda6c640 1 -- 172.21.15.7:0/3393441950 wait complete. 2024-09-19T08:52:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.807+0000 7ff6dda6c640 1 Processor -- start 2024-09-19T08:52:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.807+0000 7ff6dda6c640 1 -- start start 2024-09-19T08:52:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.807+0000 7ff6dda6c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6d8100e20 0x7ff6d81983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.807+0000 7ff6dda6c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6d8102570 0x7ff6d81988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.807+0000 7ff6dda6c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d8102ef0 0x7ff6d819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.807+0000 7ff6dda6c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d8110f80 con 0x7ff6d8102ef0 2024-09-19T08:52:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.807+0000 7ff6dda6c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d8110e00 con 0x7ff6d8100e20 2024-09-19T08:52:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.807+0000 7ff6dda6c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d8111100 con 0x7ff6d8102570 2024-09-19T08:52:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.807+0000 7ff6d7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d8102ef0 0x7ff6d819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.807+0000 7ff6d7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d8102ef0 0x7ff6d819cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51024/0 (socket says 172.21.15.7:51024) 2024-09-19T08:52:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.807+0000 7ff6d7fff640 1 -- 172.21.15.7:0/2208807016 learned_addr learned my addr 172.21.15.7:0/2208807016 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.807+0000 7ff6d77fe640 1 --2- 172.21.15.7:0/2208807016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6d8100e20 0x7ff6d81983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.807+0000 7ff6d6ffd640 1 --2- 172.21.15.7:0/2208807016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6d8102570 0x7ff6d81988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.808+0000 7ff6d7fff640 1 -- 172.21.15.7:0/2208807016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6d8102570 msgr2=0x7ff6d81988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.808+0000 7ff6d7fff640 1 --2- 172.21.15.7:0/2208807016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6d8102570 0x7ff6d81988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.808+0000 7ff6d7fff640 1 -- 172.21.15.7:0/2208807016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6d8100e20 msgr2=0x7ff6d81983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.808+0000 7ff6d7fff640 1 --2- 172.21.15.7:0/2208807016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6d8100e20 0x7ff6d81983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.808+0000 7ff6d7fff640 1 -- 172.21.15.7:0/2208807016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d819d360 con 0x7ff6d8102ef0 2024-09-19T08:52:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.808+0000 7ff6d77fe640 1 --2- 172.21.15.7:0/2208807016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6d8100e20 0x7ff6d81983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.808+0000 7ff6d7fff640 1 --2- 172.21.15.7:0/2208807016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d8102ef0 0x7ff6d819cc80 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ff6d002ae70 tx=0x7ff6d002f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.808+0000 7ff6d4ff9640 1 -- 172.21.15.7:0/2208807016 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0034040 con 0x7ff6d8102ef0 2024-09-19T08:52:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.808+0000 7ff6d4ff9640 1 -- 172.21.15.7:0/2208807016 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6d0030920 con 0x7ff6d8102ef0 2024-09-19T08:52:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.808+0000 7ff6dda6c640 1 -- 172.21.15.7:0/2208807016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6d819d5f0 con 0x7ff6d8102ef0 2024-09-19T08:52:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.808+0000 7ff6d4ff9640 1 -- 172.21.15.7:0/2208807016 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0045480 con 0x7ff6d8102ef0 2024-09-19T08:52:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.808+0000 7ff6dda6c640 1 -- 172.21.15.7:0/2208807016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6d81a4f30 con 0x7ff6d8102ef0 2024-09-19T08:52:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.809+0000 7ff6dda6c640 1 -- 172.21.15.7:0/2208807016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6d8101200 con 0x7ff6d8102ef0 2024-09-19T08:52:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.810+0000 7ff6d4ff9640 1 -- 172.21.15.7:0/2208807016 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff6d0037020 con 0x7ff6d8102ef0 2024-09-19T08:52:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.811+0000 7ff6d4ff9640 1 --2- 172.21.15.7:0/2208807016 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff6c00a3430 0x7ff6c00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:36.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.811+0000 7ff6d4ff9640 1 -- 172.21.15.7:0/2208807016 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7ff6d00f0d20 con 0x7ff6d8102ef0 2024-09-19T08:52:36.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.811+0000 7ff6d77fe640 1 --2- 172.21.15.7:0/2208807016 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff6c00a3430 0x7ff6c00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:36.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.812+0000 7ff6d77fe640 1 --2- 172.21.15.7:0/2208807016 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff6c00a3430 0x7ff6c00a58f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8005d00 tx=0x7ff6c8005c70 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:36.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:36.814+0000 7ff6d4ff9640 1 -- 172.21.15.7:0/2208807016 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff6d0081210 con 0x7ff6d8102ef0 2024-09-19T08:52:36.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:36 smithi175 ceph-mon[35688]: pgmap v249: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:37.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:37.028+0000 7ff6dda6c640 1 -- 172.21.15.7:0/2208807016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6d8199710 con 0x7ff6d8102ef0 2024-09-19T08:52:37.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:37.028+0000 7ff6d4ff9640 1 -- 172.21.15.7:0/2208807016 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7ff6d8199710 con 0x7ff6d8102ef0 2024-09-19T08:52:37.029 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:52:37.029 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:52:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:52:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:37.031+0000 7ff6dda6c640 1 -- 172.21.15.7:0/2208807016 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff6c00a3430 msgr2=0x7ff6c00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:37.031+0000 7ff6dda6c640 1 --2- 172.21.15.7:0/2208807016 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff6c00a3430 0x7ff6c00a58f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8005d00 tx=0x7ff6c8005c70 comp rx=0 tx=0).stop 2024-09-19T08:52:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:37.031+0000 7ff6dda6c640 1 -- 172.21.15.7:0/2208807016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d8102ef0 msgr2=0x7ff6d819cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:37.031+0000 7ff6dda6c640 1 --2- 172.21.15.7:0/2208807016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d8102ef0 0x7ff6d819cc80 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ff6d002ae70 tx=0x7ff6d002f5d0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:37.031+0000 7ff6dda6c640 1 -- 172.21.15.7:0/2208807016 shutdown_connections 2024-09-19T08:52:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:37.031+0000 7ff6dda6c640 1 --2- 172.21.15.7:0/2208807016 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff6c00a3430 0x7ff6c00a58f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:37.031+0000 7ff6dda6c640 1 --2- 172.21.15.7:0/2208807016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d8102ef0 0x7ff6d819cc80 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:37.031+0000 7ff6dda6c640 1 --2- 172.21.15.7:0/2208807016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6d8102570 0x7ff6d81988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:37.031+0000 7ff6dda6c640 1 --2- 172.21.15.7:0/2208807016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6d8100e20 0x7ff6d81983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:37.031+0000 7ff6dda6c640 1 -- 172.21.15.7:0/2208807016 >> 172.21.15.7:0/2208807016 conn(0x7ff6d80fc7d0 msgr2=0x7ff6d806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:37.031+0000 7ff6dda6c640 1 -- 172.21.15.7:0/2208807016 shutdown_connections 2024-09-19T08:52:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:37.031+0000 7ff6dda6c640 1 -- 172.21.15.7:0/2208807016 wait complete. 2024-09-19T08:52:37.767 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:37 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2208807016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:37.797 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:52:37.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:37 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/2208807016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:37.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:37 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/2208807016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:38.054 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:38.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.515+0000 7f891538d640 1 -- 172.21.15.7:0/1282435442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8910102ef0 msgr2=0x7f891010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:38.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.515+0000 7f891538d640 1 --2- 172.21.15.7:0/1282435442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8910102ef0 0x7f891010da40 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f8908009ca0 tx=0x7f890802a950 comp rx=0 tx=0).stop 2024-09-19T08:52:38.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.515+0000 7f891538d640 1 -- 172.21.15.7:0/1282435442 shutdown_connections 2024-09-19T08:52:38.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.515+0000 7f891538d640 1 --2- 172.21.15.7:0/1282435442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8910102ef0 0x7f891010da40 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.515+0000 7f891538d640 1 --2- 172.21.15.7:0/1282435442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8910102570 0x7f89101029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.515+0000 7f891538d640 1 --2- 172.21.15.7:0/1282435442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8910100e20 0x7f8910101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.515+0000 7f891538d640 1 -- 172.21.15.7:0/1282435442 >> 172.21.15.7:0/1282435442 conn(0x7f89100fc7d0 msgr2=0x7f89100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:38.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.515+0000 7f891538d640 1 -- 172.21.15.7:0/1282435442 shutdown_connections 2024-09-19T08:52:38.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.515+0000 7f891538d640 1 -- 172.21.15.7:0/1282435442 wait complete. 2024-09-19T08:52:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.516+0000 7f891538d640 1 Processor -- start 2024-09-19T08:52:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.516+0000 7f891538d640 1 -- start start 2024-09-19T08:52:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.516+0000 7f891538d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8910100e20 0x7f8910197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.516+0000 7f891538d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8910102570 0x7f8910197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.516+0000 7f891538d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8910102ef0 0x7f891019bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.516+0000 7f891538d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8910110f80 con 0x7f8910100e20 2024-09-19T08:52:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.516+0000 7f891538d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8910110e00 con 0x7f8910102ef0 2024-09-19T08:52:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.516+0000 7f891538d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8910111100 con 0x7f8910102570 2024-09-19T08:52:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.517+0000 7f890effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8910100e20 0x7f8910197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.517+0000 7f890effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8910100e20 0x7f8910197400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51030/0 (socket says 172.21.15.7:51030) 2024-09-19T08:52:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.517+0000 7f890effd640 1 -- 172.21.15.7:0/1746135959 learned_addr learned my addr 172.21.15.7:0/1746135959 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.517+0000 7f890f7fe640 1 --2- 172.21.15.7:0/1746135959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8910102ef0 0x7f891019bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:38.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.517+0000 7f890e7fc640 1 --2- 172.21.15.7:0/1746135959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8910102570 0x7f8910197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:38.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.517+0000 7f890effd640 1 -- 172.21.15.7:0/1746135959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8910102570 msgr2=0x7f8910197940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:38.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.517+0000 7f890effd640 1 --2- 172.21.15.7:0/1746135959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8910102570 0x7f8910197940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.517+0000 7f890effd640 1 -- 172.21.15.7:0/1746135959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8910102ef0 msgr2=0x7f891019bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:38.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.517+0000 7f890effd640 1 --2- 172.21.15.7:0/1746135959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8910102ef0 0x7f891019bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.517+0000 7f890effd640 1 -- 172.21.15.7:0/1746135959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f891019c3b0 con 0x7f8910100e20 2024-09-19T08:52:38.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.517+0000 7f890effd640 1 --2- 172.21.15.7:0/1746135959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8910100e20 0x7f8910197400 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f890000e9f0 tx=0x7f890000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:38.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.517+0000 7f88f7fff640 1 -- 172.21.15.7:0/1746135959 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890000cd80 con 0x7f8910100e20 2024-09-19T08:52:38.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.517+0000 7f891538d640 1 -- 172.21.15.7:0/1746135959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f891019c6a0 con 0x7f8910100e20 2024-09-19T08:52:38.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.517+0000 7f88f7fff640 1 -- 172.21.15.7:0/1746135959 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8900010910 con 0x7f8910100e20 2024-09-19T08:52:38.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.517+0000 7f88f7fff640 1 -- 172.21.15.7:0/1746135959 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900018990 con 0x7f8910100e20 2024-09-19T08:52:38.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.517+0000 7f891538d640 1 -- 172.21.15.7:0/1746135959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89101a3f80 con 0x7f8910100e20 2024-09-19T08:52:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.520+0000 7f88f7fff640 1 -- 172.21.15.7:0/1746135959 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8900010ac0 con 0x7f8910100e20 2024-09-19T08:52:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.520+0000 7f8917766740 1 Processor -- start 2024-09-19T08:52:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.520+0000 7f8917766740 1 -- start start 2024-09-19T08:52:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.520+0000 7f8917766740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55992ea4ec30 0x55992ea4d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.520+0000 7f8917766740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55992ea4d7e0 0x55992ea4dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.520+0000 7f8917766740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea5a970 0x55992ea5cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.520+0000 7f8917766740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55992e9b12f0 con 0x55992ea5a970 2024-09-19T08:52:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.520+0000 7f8917766740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55992e958cf0 con 0x55992ea4d7e0 2024-09-19T08:52:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.520+0000 7f8917766740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55992e9ad2b0 con 0x55992ea4ec30 2024-09-19T08:52:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.521+0000 7f890e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea5a970 0x55992ea5cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.521+0000 7f890e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea5a970 0x55992ea5cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51040/0 (socket says 172.21.15.7:51040) 2024-09-19T08:52:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.521+0000 7f890e7fc640 1 -- 172.21.15.7:0/2004204919 learned_addr learned my addr 172.21.15.7:0/2004204919 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.521+0000 7f890effd640 1 --2- 172.21.15.7:0/2004204919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55992ea4d7e0 0x55992ea4dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.521+0000 7f890f7fe640 1 --2- 172.21.15.7:0/2004204919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55992ea4ec30 0x55992ea4d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.521+0000 7f88f7fff640 1 --2- 172.21.15.7:0/1746135959 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f88f80a33b0 0x7f88f80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.521+0000 7f890e7fc640 1 -- 172.21.15.7:0/2004204919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55992ea4ec30 msgr2=0x55992ea4d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.521+0000 7f890e7fc640 1 --2- 172.21.15.7:0/2004204919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55992ea4ec30 0x55992ea4d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.521+0000 7f890e7fc640 1 -- 172.21.15.7:0/2004204919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55992ea4d7e0 msgr2=0x55992ea4dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.521+0000 7f890e7fc640 1 --2- 172.21.15.7:0/2004204919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55992ea4d7e0 0x55992ea4dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.521+0000 7f890e7fc640 1 -- 172.21.15.7:0/2004204919 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55992e93d3a0 con 0x55992ea5a970 2024-09-19T08:52:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.521+0000 7f890f7fe640 1 --2- 172.21.15.7:0/1746135959 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f88f80a33b0 0x7f88f80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.521+0000 7f88f7fff640 1 -- 172.21.15.7:0/1746135959 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7f89000d0100 con 0x7f8910100e20 2024-09-19T08:52:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.521+0000 7f890e7fc640 1 --2- 172.21.15.7:0/2004204919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea5a970 0x55992ea5cd60 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f890400cbb0 tx=0x7f890400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792a099e09146633 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:38.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.521+0000 7f88f57fa640 1 -- 172.21.15.7:0/2004204919 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8904010630 con 0x55992ea5a970 2024-09-19T08:52:38.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.522+0000 7f88f57fa640 1 -- 172.21.15.7:0/2004204919 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8904010cb0 con 0x55992ea5a970 2024-09-19T08:52:38.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.522+0000 7f88f57fa640 1 -- 172.21.15.7:0/2004204919 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890400fbb0 con 0x55992ea5a970 2024-09-19T08:52:38.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.522+0000 7f8917766740 1 -- 172.21.15.7:0/2004204919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea5a970 msgr2=0x55992ea5cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:38.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.522+0000 7f890f7fe640 1 --2- 172.21.15.7:0/1746135959 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f88f80a33b0 0x7f88f80a5870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8908005e30 tx=0x7f890803c040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:38.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.522+0000 7f8917766740 1 --2- 172.21.15.7:0/2004204919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea5a970 0x55992ea5cd60 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f890400cbb0 tx=0x7f890400e720 comp rx=0 tx=0).stop 2024-09-19T08:52:38.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.522+0000 7f8917766740 1 -- 172.21.15.7:0/2004204919 shutdown_connections 2024-09-19T08:52:38.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.522+0000 7f8917766740 1 --2- 172.21.15.7:0/2004204919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea5a970 0x55992ea5cd60 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.522+0000 7f8917766740 1 --2- 172.21.15.7:0/2004204919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55992ea4d7e0 0x55992ea4dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.522+0000 7f8917766740 1 --2- 172.21.15.7:0/2004204919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55992ea4ec30 0x55992ea4d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.522+0000 7f8917766740 1 -- 172.21.15.7:0/2004204919 >> 172.21.15.7:0/2004204919 conn(0x55992ea14310 msgr2=0x55992ea49e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:38.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.522+0000 7f8917766740 1 -- 172.21.15.7:0/2004204919 shutdown_connections 2024-09-19T08:52:38.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.522+0000 7f8917766740 1 -- 172.21.15.7:0/2004204919 wait complete. 2024-09-19T08:52:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.523+0000 7f8917766740 1 -- start start 2024-09-19T08:52:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.523+0000 7f8917766740 1 Processor -- start 2024-09-19T08:52:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.523+0000 7f8917766740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55992ea4d7e0 0x55992ea5a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.523+0000 7f8917766740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea4ec30 0x55992ea57580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.523+0000 7f8917766740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55992ea5a970 0x55992ea57ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.523+0000 7f8917766740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55992ea5d540 con 0x55992ea4ec30 2024-09-19T08:52:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.523+0000 7f8917766740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55992e96c060 con 0x55992ea5a970 2024-09-19T08:52:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.523+0000 7f8917766740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55992ea5d6c0 con 0x55992ea4d7e0 2024-09-19T08:52:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.523+0000 7f8917766740 10 client.0 _ll_register_callbacks cb 0x55992e6bf8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.523+0000 7f890e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea4ec30 0x55992ea57580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.523+0000 7f890e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea4ec30 0x55992ea57580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51052/0 (socket says 172.21.15.7:51052) 2024-09-19T08:52:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.523+0000 7f890e7fc640 1 -- 172.21.15.7:0/2168555298 learned_addr learned my addr 172.21.15.7:0/2168555298 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.523+0000 7f890f7fe640 1 --2- 172.21.15.7:0/2168555298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55992ea5a970 0x55992ea57ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.524+0000 7f890effd640 1 --2- 172.21.15.7:0/2168555298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55992ea4d7e0 0x55992ea5a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.524+0000 7f890e7fc640 1 -- 172.21.15.7:0/2168555298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55992ea4d7e0 msgr2=0x55992ea5a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.524+0000 7f890e7fc640 1 --2- 172.21.15.7:0/2168555298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55992ea4d7e0 0x55992ea5a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.524+0000 7f890e7fc640 1 -- 172.21.15.7:0/2168555298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55992ea5a970 msgr2=0x55992ea57ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.524+0000 7f890e7fc640 1 --2- 172.21.15.7:0/2168555298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55992ea5a970 0x55992ea57ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.524+0000 7f890e7fc640 1 -- 172.21.15.7:0/2168555298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55992e7223c0 con 0x55992ea4ec30 2024-09-19T08:52:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.524+0000 7f890f7fe640 1 --2- 172.21.15.7:0/2168555298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55992ea5a970 0x55992ea57ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.524+0000 7f890e7fc640 1 --2- 172.21.15.7:0/2168555298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea4ec30 0x55992ea57580 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f890400cb00 tx=0x7f890400feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515dbe267d6804b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.524+0000 7f88f2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.524+0000 7f88f2ff5640 1 -- 172.21.15.7:0/2168555298 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8904010e60 con 0x55992ea4ec30 2024-09-19T08:52:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.524+0000 7f88f2ff5640 1 -- 172.21.15.7:0/2168555298 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7f8904004020 con 0x55992ea4ec30 2024-09-19T08:52:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.524+0000 7f8917766740 1 -- 172.21.15.7:0/2168555298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8904010cb0 con 0x55992ea4ec30 2024-09-19T08:52:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.524+0000 7f88f2ff5640 1 -- 172.21.15.7:0/2168555298 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8904004220 con 0x55992ea4ec30 2024-09-19T08:52:38.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.524+0000 7f8917766740 10 client.17130 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:38.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.524+0000 7f8917766740 1 -- 172.21.15.7:0/2168555298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55992ea68f50 con 0x55992ea4ec30 2024-09-19T08:52:38.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.524+0000 7f88f2ff5640 1 -- 172.21.15.7:0/2168555298 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8904010cb0 con 0x55992ea4ec30 2024-09-19T08:52:38.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.525+0000 7f88f2ff5640 1 -- 172.21.15.7:0/2168555298 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f89040035f0 con 0x55992ea4ec30 2024-09-19T08:52:38.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.525+0000 7f8917766740 10 client.17130 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:38.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.525+0000 7f8917766740 10 client.17130 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:52:38.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.525+0000 7f8917766740 20 client.17130 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:38.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.525+0000 7f8917766740 1 --2- 172.21.15.7:0/2168555298 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55992ea6a3b0 0x55992ea6c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:38.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.525+0000 7f8917766740 4 client.17130 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:38.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.525+0000 7f8917766740 1 -- 172.21.15.7:0/2168555298 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55992e9be860 con 0x55992ea6a3b0 2024-09-19T08:52:38.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.525+0000 7f890effd640 1 --2- 172.21.15.7:0/2168555298 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55992ea6a3b0 0x55992ea6c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:38.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.525+0000 7f88f2ff5640 10 client.17130 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:52:38.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.525+0000 7f890effd640 1 --2- 172.21.15.7:0/2168555298 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55992ea6a3b0 0x55992ea6c7a0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8eff994ba156508c server_cookie=1f26a4fd4799cb62 in_seq=0 out_seq=0 2024-09-19T08:52:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.526+0000 7f88f2ff5640 1 -- 172.21.15.7:0/2168555298 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55992e9be860 con 0x55992ea6a3b0 2024-09-19T08:52:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.526+0000 7f88f2ff5640 10 client.17130 handle_command_reply: tid=0 2024-09-19T08:52:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.526+0000 7f8917766740 1 client.17130 shutdown 2024-09-19T08:52:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.526+0000 7f8917766740 1 -- 172.21.15.7:0/2168555298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea4ec30 msgr2=0x55992ea57580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.526+0000 7f8917766740 1 --2- 172.21.15.7:0/2168555298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea4ec30 0x55992ea57580 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f890400cb00 tx=0x7f890400feb0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.526+0000 7f8917766740 1 -- 172.21.15.7:0/2168555298 shutdown_connections 2024-09-19T08:52:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.526+0000 7f8917766740 1 --2- 172.21.15.7:0/2168555298 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55992ea6a3b0 0x55992ea6c7a0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.526+0000 7f88f2ff5640 0 client.17130 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:52:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.526+0000 7f8917766740 1 --2- 172.21.15.7:0/2168555298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55992ea5a970 0x55992ea57ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.526+0000 7f8917766740 1 --2- 172.21.15.7:0/2168555298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea4ec30 0x55992ea57580 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.526+0000 7f8917766740 1 --2- 172.21.15.7:0/2168555298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55992ea4d7e0 0x55992ea5a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.526+0000 7f8917766740 1 -- 172.21.15.7:0/2168555298 >> 172.21.15.7:0/2168555298 conn(0x55992ea14310 msgr2=0x55992ea4fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.526+0000 7f8917766740 1 -- 172.21.15.7:0/2168555298 shutdown_connections 2024-09-19T08:52:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.526+0000 7f8917766740 1 -- 172.21.15.7:0/2168555298 wait complete. 2024-09-19T08:52:38.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.526+0000 7f8917766740 20 client.17130 trim_cache size 0 max 16384 2024-09-19T08:52:38.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.539+0000 7f8917766740 1 Processor -- start 2024-09-19T08:52:38.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.539+0000 7f8917766740 1 -- start start 2024-09-19T08:52:38.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.539+0000 7f8917766740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea4d7e0 0x55992ea667a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:38.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.539+0000 7f8917766740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55992ea4ec30 0x55992ea56560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:38.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.539+0000 7f8917766740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55992ea5a970 0x55992ea474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:38.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.539+0000 7f8917766740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f89101adfb0 con 0x55992ea4d7e0 2024-09-19T08:52:38.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.539+0000 7f8917766740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f89101ab880 con 0x55992ea5a970 2024-09-19T08:52:38.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.539+0000 7f8917766740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f89101a96f0 con 0x55992ea4ec30 2024-09-19T08:52:38.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.540+0000 7f890effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea4d7e0 0x55992ea667a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:38.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.540+0000 7f890effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea4d7e0 0x55992ea667a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51062/0 (socket says 172.21.15.7:51062) 2024-09-19T08:52:38.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.540+0000 7f890effd640 1 -- 172.21.15.7:0/3118216900 learned_addr learned my addr 172.21.15.7:0/3118216900 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:38.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.540+0000 7f890f7fe640 1 --2- 172.21.15.7:0/3118216900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55992ea5a970 0x55992ea474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:38.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.540+0000 7f890e7fc640 1 --2- 172.21.15.7:0/3118216900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55992ea4ec30 0x55992ea56560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:38.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.540+0000 7f890effd640 1 -- 172.21.15.7:0/3118216900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55992ea4ec30 msgr2=0x55992ea56560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:38.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.540+0000 7f890effd640 1 --2- 172.21.15.7:0/3118216900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55992ea4ec30 0x55992ea56560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.540+0000 7f890effd640 1 -- 172.21.15.7:0/3118216900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55992ea5a970 msgr2=0x55992ea474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:38.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.540+0000 7f890effd640 1 --2- 172.21.15.7:0/3118216900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55992ea5a970 0x55992ea474f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.540+0000 7f890effd640 1 -- 172.21.15.7:0/3118216900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55992ea5a640 con 0x55992ea4d7e0 2024-09-19T08:52:38.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.540+0000 7f890e7fc640 1 --2- 172.21.15.7:0/3118216900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55992ea4ec30 0x55992ea56560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:38.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.540+0000 7f890effd640 1 --2- 172.21.15.7:0/3118216900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea4d7e0 0x55992ea667a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f890009c0a0 tx=0x7f89000d2610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cbc7ed263641821 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:38.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.540+0000 7f88f4ff9640 1 -- 172.21.15.7:0/3118216900 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890009bd00 con 0x55992ea4d7e0 2024-09-19T08:52:38.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.540+0000 7f88f4ff9640 1 -- 172.21.15.7:0/3118216900 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f890009caa0 con 0x55992ea4d7e0 2024-09-19T08:52:38.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.540+0000 7f88f4ff9640 1 -- 172.21.15.7:0/3118216900 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890009a770 con 0x55992ea4d7e0 2024-09-19T08:52:38.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.541+0000 7f8917766740 1 -- 172.21.15.7:0/3118216900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea4d7e0 msgr2=0x55992ea667a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:38.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.541+0000 7f8917766740 1 --2- 172.21.15.7:0/3118216900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea4d7e0 0x55992ea667a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f890009c0a0 tx=0x7f89000d2610 comp rx=0 tx=0).stop 2024-09-19T08:52:38.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.541+0000 7f8917766740 1 -- 172.21.15.7:0/3118216900 shutdown_connections 2024-09-19T08:52:38.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.541+0000 7f8917766740 1 --2- 172.21.15.7:0/3118216900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55992ea5a970 0x55992ea474f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.541+0000 7f8917766740 1 --2- 172.21.15.7:0/3118216900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55992ea4ec30 0x55992ea56560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.541+0000 7f8917766740 1 --2- 172.21.15.7:0/3118216900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea4d7e0 0x55992ea667a0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.541+0000 7f8917766740 1 -- 172.21.15.7:0/3118216900 >> 172.21.15.7:0/3118216900 conn(0x55992ea14310 msgr2=0x55992ea55e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:38.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.541+0000 7f8917766740 1 -- 172.21.15.7:0/3118216900 shutdown_connections 2024-09-19T08:52:38.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.541+0000 7f8917766740 1 -- 172.21.15.7:0/3118216900 wait complete. 2024-09-19T08:52:38.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.541+0000 7f8917766740 1 -- start start 2024-09-19T08:52:38.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.541+0000 7f8917766740 1 Processor -- start 2024-09-19T08:52:38.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.542+0000 7f8917766740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea4d7e0 0x55992ea63140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:38.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.542+0000 7f8917766740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55992ea4ec30 0x55992ea717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:38.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.542+0000 7f8917766740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55992ea5a970 0x55992ea71dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:38.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.542+0000 7f8917766740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f89101a9d40 con 0x55992ea4d7e0 2024-09-19T08:52:38.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.542+0000 7f8917766740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f89101ab1b0 con 0x55992ea5a970 2024-09-19T08:52:38.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.542+0000 7f8917766740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f89101aa410 con 0x55992ea4ec30 2024-09-19T08:52:38.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.542+0000 7f8917766740 10 client.0 _ll_register_callbacks cb 0x7f8904014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:38.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.542+0000 7f890effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea4d7e0 0x55992ea63140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.542+0000 7f890effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea4d7e0 0x55992ea63140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51072/0 (socket says 172.21.15.7:51072) 2024-09-19T08:52:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.542+0000 7f890effd640 1 -- 172.21.15.7:0/1905434459 learned_addr learned my addr 172.21.15.7:0/1905434459 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.542+0000 7f890f7fe640 1 --2- 172.21.15.7:0/1905434459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55992ea5a970 0x55992ea71dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.542+0000 7f890e7fc640 1 --2- 172.21.15.7:0/1905434459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55992ea4ec30 0x55992ea717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.542+0000 7f890effd640 1 -- 172.21.15.7:0/1905434459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55992ea4ec30 msgr2=0x55992ea717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.542+0000 7f890effd640 1 --2- 172.21.15.7:0/1905434459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55992ea4ec30 0x55992ea717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.542+0000 7f890effd640 1 -- 172.21.15.7:0/1905434459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55992ea5a970 msgr2=0x55992ea71dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.542+0000 7f890effd640 1 --2- 172.21.15.7:0/1905434459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55992ea5a970 0x55992ea71dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.542+0000 7f890effd640 1 -- 172.21.15.7:0/1905434459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55992ea72600 con 0x55992ea4d7e0 2024-09-19T08:52:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.542+0000 7f890effd640 1 --2- 172.21.15.7:0/1905434459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea4d7e0 0x55992ea63140 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f890000c6a0 tx=0x7f89000d3a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd58b44d9fee2d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.542+0000 7f88f2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.542+0000 7f88f2ff5640 1 -- 172.21.15.7:0/1905434459 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890009c3a0 con 0x55992ea4d7e0 2024-09-19T08:52:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.542+0000 7f88f2ff5640 1 -- 172.21.15.7:0/1905434459 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7f8900098a10 con 0x55992ea4d7e0 2024-09-19T08:52:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.542+0000 7f8917766740 1 -- 172.21.15.7:0/1905434459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f890009caa0 con 0x55992ea4d7e0 2024-09-19T08:52:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.543+0000 7f88f2ff5640 1 -- 172.21.15.7:0/1905434459 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f89000a0750 con 0x55992ea4d7e0 2024-09-19T08:52:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.543+0000 7f8917766740 10 client.17136 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.543+0000 7f8917766740 1 -- 172.21.15.7:0/1905434459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55992ead4e20 con 0x55992ea4d7e0 2024-09-19T08:52:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.543+0000 7f88f2ff5640 1 -- 172.21.15.7:0/1905434459 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f890009caa0 con 0x55992ea4d7e0 2024-09-19T08:52:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.543+0000 7f88f2ff5640 1 -- 172.21.15.7:0/1905434459 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f890009b7f0 con 0x55992ea4d7e0 2024-09-19T08:52:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.543+0000 7f8917766740 10 client.17136 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.543+0000 7f8917766740 10 client.17136 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:52:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.543+0000 7f8917766740 20 client.17136 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.543+0000 7f8917766740 1 --2- 172.21.15.7:0/1905434459 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55992ea6a3b0 0x55992ead74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.543+0000 7f8917766740 4 client.17136 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:52:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.543+0000 7f8917766740 1 -- 172.21.15.7:0/1905434459 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55992e9b8d70 con 0x55992ea6a3b0 2024-09-19T08:52:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.543+0000 7f890e7fc640 1 --2- 172.21.15.7:0/1905434459 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55992ea6a3b0 0x55992ead74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:38.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.544+0000 7f890e7fc640 1 --2- 172.21.15.7:0/1905434459 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55992ea6a3b0 0x55992ead74f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d9eee9adc0a70655 server_cookie=a7b832583d044eaa in_seq=0 out_seq=0 2024-09-19T08:52:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.544+0000 7f88f2ff5640 10 client.17136 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:52:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.544+0000 7f88f2ff5640 1 -- 172.21.15.7:0/1905434459 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55992e9b8d70 con 0x55992ea6a3b0 2024-09-19T08:52:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.544+0000 7f88f2ff5640 10 client.17136 handle_command_reply: tid=0 2024-09-19T08:52:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.544+0000 7f8917766740 1 client.17136 shutdown 2024-09-19T08:52:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.544+0000 7f8917766740 1 -- 172.21.15.7:0/1905434459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea4d7e0 msgr2=0x55992ea63140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.544+0000 7f8917766740 1 --2- 172.21.15.7:0/1905434459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea4d7e0 0x55992ea63140 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f890000c6a0 tx=0x7f89000d3a80 comp rx=0 tx=0).stop 2024-09-19T08:52:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.544+0000 7f8917766740 1 -- 172.21.15.7:0/1905434459 shutdown_connections 2024-09-19T08:52:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.544+0000 7f8917766740 1 --2- 172.21.15.7:0/1905434459 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55992ea6a3b0 0x55992ead74f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.544+0000 7f8917766740 1 --2- 172.21.15.7:0/1905434459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55992ea5a970 0x55992ea71dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.544+0000 7f8917766740 1 --2- 172.21.15.7:0/1905434459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55992ea4ec30 0x55992ea717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.544+0000 7f8917766740 1 --2- 172.21.15.7:0/1905434459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55992ea4d7e0 0x55992ea63140 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.544+0000 7f8917766740 1 -- 172.21.15.7:0/1905434459 >> 172.21.15.7:0/1905434459 conn(0x55992ea14310 msgr2=0x55992ea56670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.544+0000 7f88f2ff5640 0 client.17136 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:52:38.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.544+0000 7f8917766740 1 -- 172.21.15.7:0/1905434459 shutdown_connections 2024-09-19T08:52:38.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.544+0000 7f8917766740 1 -- 172.21.15.7:0/1905434459 wait complete. 2024-09-19T08:52:38.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.545+0000 7f8917766740 20 client.17136 trim_cache size 0 max 16384 2024-09-19T08:52:38.551 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:52:38.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.545+0000 7f891538d640 1 -- 172.21.15.7:0/1746135959 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f88f80a33b0 msgr2=0x7f88f80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:38.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.545+0000 7f891538d640 1 --2- 172.21.15.7:0/1746135959 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f88f80a33b0 0x7f88f80a5870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8908005e30 tx=0x7f890803c040 comp rx=0 tx=0).stop 2024-09-19T08:52:38.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.545+0000 7f891538d640 1 -- 172.21.15.7:0/1746135959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8910100e20 msgr2=0x7f8910197400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:38.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.545+0000 7f891538d640 1 --2- 172.21.15.7:0/1746135959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8910100e20 0x7f8910197400 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f890000e9f0 tx=0x7f890000eeb0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.545+0000 7f891538d640 1 -- 172.21.15.7:0/1746135959 shutdown_connections 2024-09-19T08:52:38.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.545+0000 7f891538d640 1 --2- 172.21.15.7:0/1746135959 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f88f80a33b0 0x7f88f80a5870 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.545+0000 7f891538d640 1 --2- 172.21.15.7:0/1746135959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8910102ef0 0x7f891019bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.545+0000 7f891538d640 1 --2- 172.21.15.7:0/1746135959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8910102570 0x7f8910197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.545+0000 7f891538d640 1 --2- 172.21.15.7:0/1746135959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8910100e20 0x7f8910197400 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:38.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.545+0000 7f891538d640 1 -- 172.21.15.7:0/1746135959 >> 172.21.15.7:0/1746135959 conn(0x7f89100fc7d0 msgr2=0x7f8910106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:38.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.545+0000 7f891538d640 1 -- 172.21.15.7:0/1746135959 shutdown_connections 2024-09-19T08:52:38.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:38.545+0000 7f891538d640 1 -- 172.21.15.7:0/1746135959 wait complete. 2024-09-19T08:52:38.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:38 smithi007 ceph-mon[31221]: pgmap v250: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T08:52:38.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:38 smithi044 ceph-mon[35072]: pgmap v250: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T08:52:38.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:38 smithi175 ceph-mon[35688]: pgmap v250: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T08:52:39.416 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:52:39.676 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:40.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.130+0000 7f60108bd640 1 -- 172.21.15.7:0/292017071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f600c101380 msgr2=0x7f600c10dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.130+0000 7f60108bd640 1 --2- 172.21.15.7:0/292017071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f600c101380 0x7f600c10dfb0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f6000009900 tx=0x7f600002a410 comp rx=0 tx=0).stop 2024-09-19T08:52:40.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.131+0000 7f60108bd640 1 -- 172.21.15.7:0/292017071 shutdown_connections 2024-09-19T08:52:40.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.131+0000 7f60108bd640 1 --2- 172.21.15.7:0/292017071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f600c10e4f0 0x7f600c110900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.131+0000 7f60108bd640 1 --2- 172.21.15.7:0/292017071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f600c101380 0x7f600c10dfb0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.131+0000 7f60108bd640 1 --2- 172.21.15.7:0/292017071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f600c1009d0 0x7f600c100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.131+0000 7f60108bd640 1 -- 172.21.15.7:0/292017071 >> 172.21.15.7:0/292017071 conn(0x7f600c0fc7d0 msgr2=0x7f600c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:40.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.131+0000 7f60108bd640 1 -- 172.21.15.7:0/292017071 shutdown_connections 2024-09-19T08:52:40.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.131+0000 7f60108bd640 1 -- 172.21.15.7:0/292017071 wait complete. 2024-09-19T08:52:40.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.131+0000 7f60108bd640 1 Processor -- start 2024-09-19T08:52:40.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.131+0000 7f60108bd640 1 -- start start 2024-09-19T08:52:40.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.132+0000 7f60108bd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f600c1009d0 0x7f600c19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.132+0000 7f60108bd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f600c101380 0x7f600c19ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.132+0000 7f60108bd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f600c10e4f0 0x7f600c19efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.132+0000 7f60108bd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f600c114260 con 0x7f600c10e4f0 2024-09-19T08:52:40.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.132+0000 7f60108bd640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f600c1140e0 con 0x7f600c1009d0 2024-09-19T08:52:40.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.132+0000 7f60108bd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f600c1143e0 con 0x7f600c101380 2024-09-19T08:52:40.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.132+0000 7f600ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f600c10e4f0 0x7f600c19efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.132+0000 7f600ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f600c10e4f0 0x7f600c19efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51084/0 (socket says 172.21.15.7:51084) 2024-09-19T08:52:40.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.132+0000 7f600ad9d640 1 -- 172.21.15.7:0/3238822502 learned_addr learned my addr 172.21.15.7:0/3238822502 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:40.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.132+0000 7f600a59c640 1 --2- 172.21.15.7:0/3238822502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f600c1009d0 0x7f600c19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.132+0000 7f600ad9d640 1 -- 172.21.15.7:0/3238822502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f600c101380 msgr2=0x7f600c19ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.132+0000 7f600ad9d640 1 --2- 172.21.15.7:0/3238822502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f600c101380 0x7f600c19ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.132+0000 7f600ad9d640 1 -- 172.21.15.7:0/3238822502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f600c1009d0 msgr2=0x7f600c19a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.132+0000 7f600ad9d640 1 --2- 172.21.15.7:0/3238822502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f600c1009d0 0x7f600c19a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.132+0000 7f600ad9d640 1 -- 172.21.15.7:0/3238822502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600c19f6c0 con 0x7f600c10e4f0 2024-09-19T08:52:40.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.132+0000 7f600a59c640 1 --2- 172.21.15.7:0/3238822502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f600c1009d0 0x7f600c19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:40.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.132+0000 7f600ad9d640 1 --2- 172.21.15.7:0/3238822502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f600c10e4f0 0x7f600c19efe0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f600400c970 tx=0x7f600400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:40.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.133+0000 7f5ffb7fe640 1 -- 172.21.15.7:0/3238822502 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6004007bb0 con 0x7f600c10e4f0 2024-09-19T08:52:40.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.133+0000 7f5ffb7fe640 1 -- 172.21.15.7:0/3238822502 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6004007d50 con 0x7f600c10e4f0 2024-09-19T08:52:40.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.133+0000 7f60108bd640 1 -- 172.21.15.7:0/3238822502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f600c19f9b0 con 0x7f600c10e4f0 2024-09-19T08:52:40.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.133+0000 7f5ffb7fe640 1 -- 172.21.15.7:0/3238822502 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6004018800 con 0x7f600c10e4f0 2024-09-19T08:52:40.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.133+0000 7f60108bd640 1 -- 172.21.15.7:0/3238822502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f600c1a7290 con 0x7f600c10e4f0 2024-09-19T08:52:40.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.135+0000 7f5ffb7fe640 1 -- 172.21.15.7:0/3238822502 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f600400f450 con 0x7f600c10e4f0 2024-09-19T08:52:40.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.135+0000 7f6012c96740 1 Processor -- start 2024-09-19T08:52:40.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.136+0000 7f6012c96740 1 -- start start 2024-09-19T08:52:40.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.136+0000 7f6012c96740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce82dc1b40 0x55ce82dc0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.136+0000 7f6012c96740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc05d0 0x55ce82dc0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.136+0000 7f6012c96740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dcb370 0x55ce82dcd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.136+0000 7f6012c96740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ce82d262f0 con 0x55ce82dcb370 2024-09-19T08:52:40.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.136+0000 7f6012c96740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ce82ccdcf0 con 0x55ce82dc05d0 2024-09-19T08:52:40.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.136+0000 7f6012c96740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ce82d222b0 con 0x55ce82dc1b40 2024-09-19T08:52:40.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.136+0000 7f5ffb7fe640 1 --2- 172.21.15.7:0/3238822502 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5ff40a33b0 0x7f5ff40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.136+0000 7f6009d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dcb370 0x55ce82dcd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.136+0000 7f6009d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dcb370 0x55ce82dcd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51098/0 (socket says 172.21.15.7:51098) 2024-09-19T08:52:40.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.136+0000 7f6009d9b640 1 -- 172.21.15.7:0/873055064 learned_addr learned my addr 172.21.15.7:0/873055064 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:40.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.136+0000 7f600ad9d640 1 --2- 172.21.15.7:0/3238822502 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5ff40a33b0 0x7f5ff40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.136+0000 7f600a59c640 1 --2- 172.21.15.7:0/873055064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc05d0 0x55ce82dc0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.136+0000 7f5ffb7fe640 1 -- 172.21.15.7:0/3238822502 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7f60040cfe00 con 0x7f600c10e4f0 2024-09-19T08:52:40.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.136+0000 7f6009d9b640 1 --2- 172.21.15.7:0/873055064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce82dc1b40 0x55ce82dc0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.136+0000 7f6009d9b640 1 -- 172.21.15.7:0/873055064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce82dc1b40 msgr2=0x55ce82dc0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:40.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.136+0000 7f6009d9b640 1 --2- 172.21.15.7:0/873055064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce82dc1b40 0x55ce82dc0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.136+0000 7f6009d9b640 1 -- 172.21.15.7:0/873055064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc05d0 msgr2=0x55ce82dc0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:40.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.136+0000 7f6009d9b640 1 --2- 172.21.15.7:0/873055064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc05d0 0x55ce82dc0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.136+0000 7f6009d9b640 1 -- 172.21.15.7:0/873055064 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce82cb23a0 con 0x55ce82dcb370 2024-09-19T08:52:40.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.136+0000 7f600a59c640 1 --2- 172.21.15.7:0/873055064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc05d0 0x55ce82dc0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:40.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.137+0000 7f6009d9b640 1 --2- 172.21.15.7:0/873055064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dcb370 0x55ce82dcd760 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f6000031550 tx=0x7f6000005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e408e8b07b8d79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:40.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.137+0000 7f600ad9d640 1 --2- 172.21.15.7:0/3238822502 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5ff40a33b0 0x7f5ff40a5870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f600409bd40 tx=0x7f60040914d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:40.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.137+0000 7f5ff8ff9640 1 -- 172.21.15.7:0/873055064 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000035070 con 0x55ce82dcb370 2024-09-19T08:52:40.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.137+0000 7f5ff8ff9640 1 -- 172.21.15.7:0/873055064 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6000044070 con 0x55ce82dcb370 2024-09-19T08:52:40.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.137+0000 7f5ff8ff9640 1 -- 172.21.15.7:0/873055064 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600003d6e0 con 0x55ce82dcb370 2024-09-19T08:52:40.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.137+0000 7f6012c96740 1 -- 172.21.15.7:0/873055064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dcb370 msgr2=0x55ce82dcd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.137+0000 7f6012c96740 1 --2- 172.21.15.7:0/873055064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dcb370 0x55ce82dcd760 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f6000031550 tx=0x7f6000005a20 comp rx=0 tx=0).stop 2024-09-19T08:52:40.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.138+0000 7f6012c96740 1 -- 172.21.15.7:0/873055064 shutdown_connections 2024-09-19T08:52:40.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.138+0000 7f6012c96740 1 --2- 172.21.15.7:0/873055064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dcb370 0x55ce82dcd760 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.138+0000 7f6012c96740 1 --2- 172.21.15.7:0/873055064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc05d0 0x55ce82dc0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.138+0000 7f6012c96740 1 --2- 172.21.15.7:0/873055064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce82dc1b40 0x55ce82dc0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.138+0000 7f6012c96740 1 -- 172.21.15.7:0/873055064 >> 172.21.15.7:0/873055064 conn(0x55ce82d89310 msgr2=0x55ce82dbcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:40.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.138+0000 7f6012c96740 1 -- 172.21.15.7:0/873055064 shutdown_connections 2024-09-19T08:52:40.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.138+0000 7f6012c96740 1 -- 172.21.15.7:0/873055064 wait complete. 2024-09-19T08:52:40.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.138+0000 7f6012c96740 1 -- start start 2024-09-19T08:52:40.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.138+0000 7f6012c96740 1 Processor -- start 2024-09-19T08:52:40.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.138+0000 7f6012c96740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce82dc05d0 0x55ce82dcadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.138+0000 7f6012c96740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc1b40 0x55ce82dc8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.138+0000 7f6012c96740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dcb370 0x55ce82dc8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.138+0000 7f6012c96740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ce82dce010 con 0x55ce82dcb370 2024-09-19T08:52:40.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.138+0000 7f6012c96740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ce82ce1060 con 0x55ce82dc1b40 2024-09-19T08:52:40.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.138+0000 7f6012c96740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ce82dce190 con 0x55ce82dc05d0 2024-09-19T08:52:40.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.138+0000 7f6012c96740 10 client.0 _ll_register_callbacks cb 0x55ce82a348c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:40.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.138+0000 7f6009d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dcb370 0x55ce82dc8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.139+0000 7f6009d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dcb370 0x55ce82dc8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51114/0 (socket says 172.21.15.7:51114) 2024-09-19T08:52:40.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.139+0000 7f6009d9b640 1 -- 172.21.15.7:0/2544275366 learned_addr learned my addr 172.21.15.7:0/2544275366 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:40.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.139+0000 7f6009d9b640 1 --2- 172.21.15.7:0/2544275366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce82dc05d0 0x55ce82dcadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.139+0000 7f600a59c640 1 --2- 172.21.15.7:0/2544275366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc1b40 0x55ce82dc8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.139+0000 7f6009d9b640 1 -- 172.21.15.7:0/2544275366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce82dc05d0 msgr2=0x55ce82dcadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:40.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.139+0000 7f6009d9b640 1 --2- 172.21.15.7:0/2544275366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce82dc05d0 0x55ce82dcadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.139+0000 7f6009d9b640 1 -- 172.21.15.7:0/2544275366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc1b40 msgr2=0x55ce82dc8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:40.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.139+0000 7f6009d9b640 1 --2- 172.21.15.7:0/2544275366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc1b40 0x55ce82dc8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.139+0000 7f6009d9b640 1 -- 172.21.15.7:0/2544275366 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce82a973c0 con 0x55ce82dcb370 2024-09-19T08:52:40.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.139+0000 7f6009d9b640 1 --2- 172.21.15.7:0/2544275366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dcb370 0x55ce82dc8800 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f60000057c0 tx=0x7f6000003dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca300ba087d9ddc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:40.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.139+0000 7f5ff1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:40.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.139+0000 7f5ff1ffb640 1 -- 172.21.15.7:0/2544275366 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600004d070 con 0x55ce82dcb370 2024-09-19T08:52:40.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.139+0000 7f5ff1ffb640 1 -- 172.21.15.7:0/2544275366 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7f60000037f0 con 0x55ce82dcb370 2024-09-19T08:52:40.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.139+0000 7f6012c96740 1 -- 172.21.15.7:0/2544275366 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6000044070 con 0x55ce82dcb370 2024-09-19T08:52:40.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.139+0000 7f5ff1ffb640 1 -- 172.21.15.7:0/2544275366 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f600005c050 con 0x55ce82dcb370 2024-09-19T08:52:40.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.139+0000 7f6012c96740 10 client.17148 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:40.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.139+0000 7f6012c96740 1 -- 172.21.15.7:0/2544275366 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ce82dd9b20 con 0x55ce82dcb370 2024-09-19T08:52:40.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.140+0000 7f5ff1ffb640 1 -- 172.21.15.7:0/2544275366 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6000044070 con 0x55ce82dcb370 2024-09-19T08:52:40.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.140+0000 7f5ff1ffb640 1 -- 172.21.15.7:0/2544275366 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f600003a040 con 0x55ce82dcb370 2024-09-19T08:52:40.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.140+0000 7f6012c96740 10 client.17148 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:40.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.140+0000 7f6012c96740 10 client.17148 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:52:40.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.140+0000 7f6012c96740 20 client.17148 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:40.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.140+0000 7f6012c96740 1 --2- 172.21.15.7:0/2544275366 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55ce82ddae70 0x55ce82ddd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.140+0000 7f6012c96740 4 client.17148 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:40.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.140+0000 7f6012c96740 1 -- 172.21.15.7:0/2544275366 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce82d33860 con 0x55ce82ddae70 2024-09-19T08:52:40.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.140+0000 7f600a59c640 1 --2- 172.21.15.7:0/2544275366 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55ce82ddae70 0x55ce82ddd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.141+0000 7f600a59c640 1 --2- 172.21.15.7:0/2544275366 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55ce82ddae70 0x55ce82ddd260 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d1750cd5f16a9f33 server_cookie=7dcd3f3264ace562 in_seq=0 out_seq=0 2024-09-19T08:52:40.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.141+0000 7f5ff1ffb640 10 client.17148 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:52:40.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.141+0000 7f5ff1ffb640 1 -- 172.21.15.7:0/2544275366 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ce82d33860 con 0x55ce82ddae70 2024-09-19T08:52:40.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.141+0000 7f5ff1ffb640 10 client.17148 handle_command_reply: tid=0 2024-09-19T08:52:40.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.141+0000 7f6012c96740 1 client.17148 shutdown 2024-09-19T08:52:40.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.142+0000 7f6012c96740 1 -- 172.21.15.7:0/2544275366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dcb370 msgr2=0x55ce82dc8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.142+0000 7f6012c96740 1 --2- 172.21.15.7:0/2544275366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dcb370 0x55ce82dc8800 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f60000057c0 tx=0x7f6000003dc0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.142+0000 7f6012c96740 1 -- 172.21.15.7:0/2544275366 shutdown_connections 2024-09-19T08:52:40.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.142+0000 7f6012c96740 1 --2- 172.21.15.7:0/2544275366 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55ce82ddae70 0x55ce82ddd260 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.142+0000 7f6012c96740 1 --2- 172.21.15.7:0/2544275366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dcb370 0x55ce82dc8800 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.142+0000 7f5ff1ffb640 0 client.17148 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:52:40.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.142+0000 7f6012c96740 1 --2- 172.21.15.7:0/2544275366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc1b40 0x55ce82dc8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.142+0000 7f6012c96740 1 --2- 172.21.15.7:0/2544275366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce82dc05d0 0x55ce82dcadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.142+0000 7f6012c96740 1 -- 172.21.15.7:0/2544275366 >> 172.21.15.7:0/2544275366 conn(0x55ce82d89310 msgr2=0x55ce82dc2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:40.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.142+0000 7f6012c96740 1 -- 172.21.15.7:0/2544275366 shutdown_connections 2024-09-19T08:52:40.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.142+0000 7f6012c96740 1 -- 172.21.15.7:0/2544275366 wait complete. 2024-09-19T08:52:40.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.142+0000 7f6012c96740 20 client.17148 trim_cache size 0 max 16384 2024-09-19T08:52:40.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.155+0000 7f6012c96740 1 Processor -- start 2024-09-19T08:52:40.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.155+0000 7f6012c96740 1 -- start start 2024-09-19T08:52:40.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.155+0000 7f6012c96740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc05d0 0x55ce82dc09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.155+0000 7f6012c96740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dc1b40 0x55ce82dbc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.155+0000 7f6012c96740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce82dcb370 0x55ce82dbcc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.155+0000 7f6012c96740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f600c1b2330 con 0x55ce82dc1b40 2024-09-19T08:52:40.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.155+0000 7f6012c96740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f600c1afc00 con 0x55ce82dc05d0 2024-09-19T08:52:40.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.155+0000 7f6012c96740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f600c1ada70 con 0x55ce82dcb370 2024-09-19T08:52:40.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.155+0000 7f600a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dc1b40 0x55ce82dbc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.155+0000 7f600a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dc1b40 0x55ce82dbc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51120/0 (socket says 172.21.15.7:51120) 2024-09-19T08:52:40.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.155+0000 7f600a59c640 1 -- 172.21.15.7:0/885837279 learned_addr learned my addr 172.21.15.7:0/885837279 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:40.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.155+0000 7f600a59c640 1 -- 172.21.15.7:0/885837279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce82dcb370 msgr2=0x55ce82dbcc40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:52:40.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.155+0000 7f6009d9b640 1 --2- 172.21.15.7:0/885837279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc05d0 0x55ce82dc09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.155+0000 7f600a59c640 1 --2- 172.21.15.7:0/885837279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce82dcb370 0x55ce82dbcc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.155+0000 7f600a59c640 1 -- 172.21.15.7:0/885837279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc05d0 msgr2=0x55ce82dc09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:40.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.156+0000 7f600a59c640 1 --2- 172.21.15.7:0/885837279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc05d0 0x55ce82dc09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.156+0000 7f600a59c640 1 -- 172.21.15.7:0/885837279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce82dbc510 con 0x55ce82dc1b40 2024-09-19T08:52:40.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.156+0000 7f6009d9b640 1 --2- 172.21.15.7:0/885837279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc05d0 0x55ce82dc09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:40.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.156+0000 7f600a59c640 1 --2- 172.21.15.7:0/885837279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dc1b40 0x55ce82dbc700 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc0117d0 tx=0x7f5ffc00f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4faee4ae8794be46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.156+0000 7f5ff3fff640 1 -- 172.21.15.7:0/885837279 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc003970 con 0x55ce82dc1b40 2024-09-19T08:52:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.156+0000 7f5ff3fff640 1 -- 172.21.15.7:0/885837279 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ffc004020 con 0x55ce82dc1b40 2024-09-19T08:52:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.156+0000 7f5ff3fff640 1 -- 172.21.15.7:0/885837279 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc01e690 con 0x55ce82dc1b40 2024-09-19T08:52:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.156+0000 7f6012c96740 1 -- 172.21.15.7:0/885837279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dc1b40 msgr2=0x55ce82dbc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.156+0000 7f6012c96740 1 --2- 172.21.15.7:0/885837279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dc1b40 0x55ce82dbc700 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc0117d0 tx=0x7f5ffc00f7f0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.157+0000 7f6012c96740 1 -- 172.21.15.7:0/885837279 shutdown_connections 2024-09-19T08:52:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.157+0000 7f6012c96740 1 --2- 172.21.15.7:0/885837279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce82dcb370 0x55ce82dbcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.157+0000 7f6012c96740 1 --2- 172.21.15.7:0/885837279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dc1b40 0x55ce82dbc700 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.157+0000 7f6012c96740 1 --2- 172.21.15.7:0/885837279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc05d0 0x55ce82dc09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.157+0000 7f6012c96740 1 -- 172.21.15.7:0/885837279 >> 172.21.15.7:0/885837279 conn(0x55ce82d89310 msgr2=0x55ce82db7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:40.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.157+0000 7f6012c96740 1 -- 172.21.15.7:0/885837279 shutdown_connections 2024-09-19T08:52:40.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.157+0000 7f6012c96740 1 -- 172.21.15.7:0/885837279 wait complete. 2024-09-19T08:52:40.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.157+0000 7f6012c96740 1 -- start start 2024-09-19T08:52:40.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.157+0000 7f6012c96740 1 Processor -- start 2024-09-19T08:52:40.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.157+0000 7f6012c96740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc05d0 0x55ce82de0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.157+0000 7f6012c96740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dc1b40 0x55ce82dddc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.157+0000 7f6012c96740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce82dcb370 0x55ce82dde1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.157+0000 7f6012c96740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f600c1ae0c0 con 0x55ce82dc1b40 2024-09-19T08:52:40.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.157+0000 7f6012c96740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f600c1af530 con 0x55ce82dc05d0 2024-09-19T08:52:40.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.157+0000 7f6012c96740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f600c1ae790 con 0x55ce82dcb370 2024-09-19T08:52:40.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.157+0000 7f6012c96740 10 client.0 _ll_register_callbacks cb 0x7f6000031880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:40.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.157+0000 7f600a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dc1b40 0x55ce82dddc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.157+0000 7f600a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dc1b40 0x55ce82dddc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51136/0 (socket says 172.21.15.7:51136) 2024-09-19T08:52:40.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.157+0000 7f600a59c640 1 -- 172.21.15.7:0/595039180 learned_addr learned my addr 172.21.15.7:0/595039180 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:40.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.157+0000 7f6009d9b640 1 --2- 172.21.15.7:0/595039180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc05d0 0x55ce82de0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.158+0000 7f6009d9b640 1 --2- 172.21.15.7:0/595039180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce82dcb370 0x55ce82dde1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.158+0000 7f600a59c640 1 -- 172.21.15.7:0/595039180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce82dcb370 msgr2=0x55ce82dde1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:40.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.158+0000 7f600a59c640 1 --2- 172.21.15.7:0/595039180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce82dcb370 0x55ce82dde1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.158+0000 7f600a59c640 1 -- 172.21.15.7:0/595039180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc05d0 msgr2=0x55ce82de0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:40.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.158+0000 7f600a59c640 1 --2- 172.21.15.7:0/595039180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc05d0 0x55ce82de0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.158+0000 7f600a59c640 1 -- 172.21.15.7:0/595039180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce82dde9f0 con 0x55ce82dc1b40 2024-09-19T08:52:40.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.158+0000 7f6009d9b640 1 --2- 172.21.15.7:0/595039180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc05d0 0x55ce82de0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:40.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.158+0000 7f600a59c640 1 --2- 172.21.15.7:0/595039180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dc1b40 0x55ce82dddc80 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc011f20 tx=0x7f5ffc011f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af67d4c8d601393 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:40.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.158+0000 7f5ff1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:40.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.158+0000 7f5ff1ffb640 1 -- 172.21.15.7:0/595039180 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc035060 con 0x55ce82dc1b40 2024-09-19T08:52:40.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.158+0000 7f5ff1ffb640 1 -- 172.21.15.7:0/595039180 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7f5ffc003b80 con 0x55ce82dc1b40 2024-09-19T08:52:40.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.158+0000 7f6012c96740 1 -- 172.21.15.7:0/595039180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ffc004020 con 0x55ce82dc1b40 2024-09-19T08:52:40.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.158+0000 7f5ff1ffb640 1 -- 172.21.15.7:0/595039180 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5ffc003d80 con 0x55ce82dc1b40 2024-09-19T08:52:40.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.158+0000 7f6012c96740 10 client.17154 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:40.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.158+0000 7f6012c96740 1 -- 172.21.15.7:0/595039180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ce82e45690 con 0x55ce82dc1b40 2024-09-19T08:52:40.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.159+0000 7f5ff1ffb640 1 -- 172.21.15.7:0/595039180 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ffc004020 con 0x55ce82dc1b40 2024-09-19T08:52:40.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.159+0000 7f5ff1ffb640 1 -- 172.21.15.7:0/595039180 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5ffc01e9d0 con 0x55ce82dc1b40 2024-09-19T08:52:40.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.159+0000 7f6012c96740 10 client.17154 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:40.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.159+0000 7f6012c96740 10 client.17154 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:52:40.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.159+0000 7f6012c96740 20 client.17154 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:40.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.159+0000 7f6012c96740 1 --2- 172.21.15.7:0/595039180 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55ce82e45db0 0x55ce82e481d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.159+0000 7f6012c96740 4 client.17154 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:52:40.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.159+0000 7f6012c96740 1 -- 172.21.15.7:0/595039180 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ce82d2dd70 con 0x55ce82e45db0 2024-09-19T08:52:40.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.159+0000 7f6009d9b640 1 --2- 172.21.15.7:0/595039180 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55ce82e45db0 0x55ce82e481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.159+0000 7f6009d9b640 1 --2- 172.21.15.7:0/595039180 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55ce82e45db0 0x55ce82e481d0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6d27587f2faa49eb server_cookie=b763a4a1800f047c in_seq=0 out_seq=0 2024-09-19T08:52:40.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.159+0000 7f5ff1ffb640 10 client.17154 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:52:40.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.160+0000 7f5ff1ffb640 1 -- 172.21.15.7:0/595039180 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ce82d2dd70 con 0x55ce82e45db0 2024-09-19T08:52:40.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.160+0000 7f5ff1ffb640 10 client.17154 handle_command_reply: tid=0 2024-09-19T08:52:40.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.160+0000 7f6012c96740 1 client.17154 shutdown 2024-09-19T08:52:40.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.160+0000 7f6012c96740 1 -- 172.21.15.7:0/595039180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dc1b40 msgr2=0x55ce82dddc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.160+0000 7f6012c96740 1 --2- 172.21.15.7:0/595039180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dc1b40 0x55ce82dddc80 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc011f20 tx=0x7f5ffc011f50 comp rx=0 tx=0).stop 2024-09-19T08:52:40.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.160+0000 7f6012c96740 1 -- 172.21.15.7:0/595039180 shutdown_connections 2024-09-19T08:52:40.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.160+0000 7f6012c96740 1 --2- 172.21.15.7:0/595039180 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55ce82e45db0 0x55ce82e481d0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.160+0000 7f6012c96740 1 --2- 172.21.15.7:0/595039180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ce82dcb370 0x55ce82dde1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.160+0000 7f6012c96740 1 --2- 172.21.15.7:0/595039180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ce82dc1b40 0x55ce82dddc80 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.160+0000 7f5ff1ffb640 0 client.17154 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:52:40.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.160+0000 7f6012c96740 1 --2- 172.21.15.7:0/595039180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce82dc05d0 0x55ce82de0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.160+0000 7f6012c96740 1 -- 172.21.15.7:0/595039180 >> 172.21.15.7:0/595039180 conn(0x55ce82d89310 msgr2=0x55ce82dbc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:40.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.160+0000 7f6012c96740 1 -- 172.21.15.7:0/595039180 shutdown_connections 2024-09-19T08:52:40.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.160+0000 7f6012c96740 1 -- 172.21.15.7:0/595039180 wait complete. 2024-09-19T08:52:40.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.160+0000 7f6012c96740 20 client.17154 trim_cache size 0 max 16384 2024-09-19T08:52:40.175 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:52:40.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.161+0000 7f60108bd640 1 -- 172.21.15.7:0/3238822502 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5ff40a33b0 msgr2=0x7f5ff40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.161+0000 7f60108bd640 1 --2- 172.21.15.7:0/3238822502 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5ff40a33b0 0x7f5ff40a5870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f600409bd40 tx=0x7f60040914d0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.161+0000 7f60108bd640 1 -- 172.21.15.7:0/3238822502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f600c10e4f0 msgr2=0x7f600c19efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.161+0000 7f60108bd640 1 --2- 172.21.15.7:0/3238822502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f600c10e4f0 0x7f600c19efe0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f600400c970 tx=0x7f600400ce30 comp rx=0 tx=0).stop 2024-09-19T08:52:40.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.161+0000 7f60108bd640 1 -- 172.21.15.7:0/3238822502 shutdown_connections 2024-09-19T08:52:40.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.161+0000 7f60108bd640 1 --2- 172.21.15.7:0/3238822502 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5ff40a33b0 0x7f5ff40a5870 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.161+0000 7f60108bd640 1 --2- 172.21.15.7:0/3238822502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f600c10e4f0 0x7f600c19efe0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.161+0000 7f60108bd640 1 --2- 172.21.15.7:0/3238822502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f600c101380 0x7f600c19ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.161+0000 7f60108bd640 1 --2- 172.21.15.7:0/3238822502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f600c1009d0 0x7f600c19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.161+0000 7f60108bd640 1 -- 172.21.15.7:0/3238822502 >> 172.21.15.7:0/3238822502 conn(0x7f600c0fc7d0 msgr2=0x7f600c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:40.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.161+0000 7f60108bd640 1 -- 172.21.15.7:0/3238822502 shutdown_connections 2024-09-19T08:52:40.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:40.161+0000 7f60108bd640 1 -- 172.21.15.7:0/3238822502 wait complete. 2024-09-19T08:52:40.730 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:40 smithi175 ceph-mon[35688]: pgmap v251: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:40.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:40 smithi007 ceph-mon[31221]: pgmap v251: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:40.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:40 smithi044 ceph-mon[35072]: pgmap v251: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:41.137 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:52:41.399 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:41.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.889+0000 7fdf9d292640 1 -- 172.21.15.7:0/2384555677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf9810c170 msgr2=0x7fdf9810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:41.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.889+0000 7fdf9d292640 1 --2- 172.21.15.7:0/2384555677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf9810c170 0x7fdf9810e610 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fdf90009ca0 tx=0x7fdf9002a950 comp rx=0 tx=0).stop 2024-09-19T08:52:41.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.889+0000 7fdf9d292640 1 -- 172.21.15.7:0/2384555677 shutdown_connections 2024-09-19T08:52:41.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.889+0000 7fdf9d292640 1 --2- 172.21.15.7:0/2384555677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf9810c170 0x7fdf9810e610 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.889+0000 7fdf9d292640 1 --2- 172.21.15.7:0/2384555677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf98103660 0x7fdf9810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.889+0000 7fdf9d292640 1 --2- 172.21.15.7:0/2384555677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf98102d40 0x7fdf98103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.889+0000 7fdf9d292640 1 -- 172.21.15.7:0/2384555677 >> 172.21.15.7:0/2384555677 conn(0x7fdf980fc7a0 msgr2=0x7fdf980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:41.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.889+0000 7fdf9d292640 1 -- 172.21.15.7:0/2384555677 shutdown_connections 2024-09-19T08:52:41.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.889+0000 7fdf9d292640 1 -- 172.21.15.7:0/2384555677 wait complete. 2024-09-19T08:52:41.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.890+0000 7fdf9d292640 1 Processor -- start 2024-09-19T08:52:41.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.890+0000 7fdf9d292640 1 -- start start 2024-09-19T08:52:41.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.890+0000 7fdf9d292640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf98102d40 0x7fdf981983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.890+0000 7fdf9d292640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf98103660 0x7fdf98198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.890+0000 7fdf9d292640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf9810c170 0x7fdf9819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.890+0000 7fdf9d292640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdf98111f70 con 0x7fdf98102d40 2024-09-19T08:52:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.890+0000 7fdf9d292640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdf98111df0 con 0x7fdf98103660 2024-09-19T08:52:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.890+0000 7fdf9d292640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdf981120f0 con 0x7fdf9810c170 2024-09-19T08:52:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.890+0000 7fdf96ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf98102d40 0x7fdf981983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.891+0000 7fdf96ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf98102d40 0x7fdf981983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51150/0 (socket says 172.21.15.7:51150) 2024-09-19T08:52:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.891+0000 7fdf96ffd640 1 -- 172.21.15.7:0/119244101 learned_addr learned my addr 172.21.15.7:0/119244101 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.891+0000 7fdf967fc640 1 --2- 172.21.15.7:0/119244101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf98103660 0x7fdf98198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.891+0000 7fdf977fe640 1 --2- 172.21.15.7:0/119244101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf9810c170 0x7fdf9819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.891+0000 7fdf96ffd640 1 -- 172.21.15.7:0/119244101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf9810c170 msgr2=0x7fdf9819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.891+0000 7fdf96ffd640 1 --2- 172.21.15.7:0/119244101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf9810c170 0x7fdf9819ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.891+0000 7fdf96ffd640 1 -- 172.21.15.7:0/119244101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf98103660 msgr2=0x7fdf98198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.891+0000 7fdf96ffd640 1 --2- 172.21.15.7:0/119244101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf98103660 0x7fdf98198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.891+0000 7fdf96ffd640 1 -- 172.21.15.7:0/119244101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9819d3a0 con 0x7fdf98102d40 2024-09-19T08:52:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.891+0000 7fdf977fe640 1 --2- 172.21.15.7:0/119244101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf9810c170 0x7fdf9819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.891+0000 7fdf96ffd640 1 --2- 172.21.15.7:0/119244101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf98102d40 0x7fdf981983f0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fdf8800e9f0 tx=0x7fdf8800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.891+0000 7fdf7ffff640 1 -- 172.21.15.7:0/119244101 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8800cd80 con 0x7fdf98102d40 2024-09-19T08:52:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.891+0000 7fdf7ffff640 1 -- 172.21.15.7:0/119244101 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf88010910 con 0x7fdf98102d40 2024-09-19T08:52:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.891+0000 7fdf9d292640 1 -- 172.21.15.7:0/119244101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf9819d690 con 0x7fdf98102d40 2024-09-19T08:52:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.891+0000 7fdf7ffff640 1 -- 172.21.15.7:0/119244101 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf88018990 con 0x7fdf98102d40 2024-09-19T08:52:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.891+0000 7fdf9d292640 1 -- 172.21.15.7:0/119244101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf981008d0 con 0x7fdf98102d40 2024-09-19T08:52:41.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.894+0000 7fdf7ffff640 1 -- 172.21.15.7:0/119244101 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fdf88010ac0 con 0x7fdf98102d40 2024-09-19T08:52:41.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.894+0000 7fdf9f66b740 1 Processor -- start 2024-09-19T08:52:41.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.894+0000 7fdf9f66b740 1 -- start start 2024-09-19T08:52:41.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.894+0000 7fdf9f66b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ead1dbb40 0x564ead1da090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.894+0000 7fdf9f66b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1da5d0 0x564ead1daa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.894+0000 7fdf9f66b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ead1e5370 0x564ead1e7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.894+0000 7fdf9f66b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564ead1402f0 con 0x564ead1da5d0 2024-09-19T08:52:41.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.894+0000 7fdf9f66b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564ead0e7cf0 con 0x564ead1e5370 2024-09-19T08:52:41.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.894+0000 7fdf9f66b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564ead13c2b0 con 0x564ead1dbb40 2024-09-19T08:52:41.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.894+0000 7fdf96ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1da5d0 0x564ead1daa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.894+0000 7fdf96ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1da5d0 0x564ead1daa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51152/0 (socket says 172.21.15.7:51152) 2024-09-19T08:52:41.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.894+0000 7fdf96ffd640 1 -- 172.21.15.7:0/2032405402 learned_addr learned my addr 172.21.15.7:0/2032405402 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:41.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.894+0000 7fdf967fc640 1 --2- 172.21.15.7:0/2032405402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ead1e5370 0x564ead1e7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.894+0000 7fdf977fe640 1 --2- 172.21.15.7:0/2032405402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ead1dbb40 0x564ead1da090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.895+0000 7fdf7ffff640 1 --2- 172.21.15.7:0/119244101 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdf800a33b0 0x7fdf800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.895+0000 7fdf96ffd640 1 -- 172.21.15.7:0/2032405402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ead1dbb40 msgr2=0x564ead1da090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:41.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.895+0000 7fdf96ffd640 1 --2- 172.21.15.7:0/2032405402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ead1dbb40 0x564ead1da090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.895+0000 7fdf96ffd640 1 -- 172.21.15.7:0/2032405402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ead1e5370 msgr2=0x564ead1e7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:41.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.895+0000 7fdf96ffd640 1 --2- 172.21.15.7:0/2032405402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ead1e5370 0x564ead1e7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.895+0000 7fdf96ffd640 1 -- 172.21.15.7:0/2032405402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ead0cc3a0 con 0x564ead1da5d0 2024-09-19T08:52:41.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.895+0000 7fdf977fe640 1 --2- 172.21.15.7:0/2032405402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ead1dbb40 0x564ead1da090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:41.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.895+0000 7fdf977fe640 1 --2- 172.21.15.7:0/119244101 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdf800a33b0 0x7fdf800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.895+0000 7fdf7ffff640 1 -- 172.21.15.7:0/119244101 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7fdf880d0140 con 0x7fdf98102d40 2024-09-19T08:52:41.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.895+0000 7fdf96ffd640 1 --2- 172.21.15.7:0/2032405402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1da5d0 0x564ead1daa10 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fdf880cd7c0 tx=0x7fdf88025360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a810dee33717c78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:41.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.895+0000 7fdf7d7fa640 1 -- 172.21.15.7:0/2032405402 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8809c1b0 con 0x564ead1da5d0 2024-09-19T08:52:41.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.895+0000 7fdf7d7fa640 1 -- 172.21.15.7:0/2032405402 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf8809cae0 con 0x564ead1da5d0 2024-09-19T08:52:41.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.895+0000 7fdf7d7fa640 1 -- 172.21.15.7:0/2032405402 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8806b200 con 0x564ead1da5d0 2024-09-19T08:52:41.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.896+0000 7fdf9f66b740 1 -- 172.21.15.7:0/2032405402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1da5d0 msgr2=0x564ead1daa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:41.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.896+0000 7fdf9f66b740 1 --2- 172.21.15.7:0/2032405402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1da5d0 0x564ead1daa10 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fdf880cd7c0 tx=0x7fdf88025360 comp rx=0 tx=0).stop 2024-09-19T08:52:41.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.896+0000 7fdf977fe640 1 --2- 172.21.15.7:0/119244101 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdf800a33b0 0x7fdf800a5870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdf90004af0 tx=0x7fdf9003d040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.896+0000 7fdf9f66b740 1 -- 172.21.15.7:0/2032405402 shutdown_connections 2024-09-19T08:52:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.896+0000 7fdf9f66b740 1 --2- 172.21.15.7:0/2032405402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ead1e5370 0x564ead1e7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.896+0000 7fdf9f66b740 1 --2- 172.21.15.7:0/2032405402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1da5d0 0x564ead1daa10 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.896+0000 7fdf9f66b740 1 --2- 172.21.15.7:0/2032405402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ead1dbb40 0x564ead1da090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.896+0000 7fdf9f66b740 1 -- 172.21.15.7:0/2032405402 >> 172.21.15.7:0/2032405402 conn(0x564ead1a3310 msgr2=0x564ead1d6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.896+0000 7fdf9f66b740 1 -- 172.21.15.7:0/2032405402 shutdown_connections 2024-09-19T08:52:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.896+0000 7fdf9f66b740 1 -- 172.21.15.7:0/2032405402 wait complete. 2024-09-19T08:52:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.896+0000 7fdf9f66b740 1 -- start start 2024-09-19T08:52:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.897+0000 7fdf9f66b740 1 Processor -- start 2024-09-19T08:52:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.897+0000 7fdf9f66b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ead1da5d0 0x564ead1e4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.897+0000 7fdf9f66b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ead1dbb40 0x564ead1e2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.897+0000 7fdf9f66b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1e5370 0x564ead1e2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.897+0000 7fdf9f66b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564ead1e8010 con 0x564ead1e5370 2024-09-19T08:52:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.897+0000 7fdf9f66b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564ead0fb060 con 0x564ead1da5d0 2024-09-19T08:52:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.897+0000 7fdf9f66b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564ead1e8190 con 0x564ead1dbb40 2024-09-19T08:52:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.897+0000 7fdf9f66b740 10 client.0 _ll_register_callbacks cb 0x564eace4e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.897+0000 7fdf977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1e5370 0x564ead1e2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.897+0000 7fdf977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1e5370 0x564ead1e2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51154/0 (socket says 172.21.15.7:51154) 2024-09-19T08:52:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.897+0000 7fdf977fe640 1 -- 172.21.15.7:0/210293175 learned_addr learned my addr 172.21.15.7:0/210293175 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.897+0000 7fdf967fc640 1 --2- 172.21.15.7:0/210293175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ead1dbb40 0x564ead1e2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.897+0000 7fdf96ffd640 1 --2- 172.21.15.7:0/210293175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ead1da5d0 0x564ead1e4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.897+0000 7fdf977fe640 1 -- 172.21.15.7:0/210293175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ead1dbb40 msgr2=0x564ead1e2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.897+0000 7fdf977fe640 1 --2- 172.21.15.7:0/210293175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ead1dbb40 0x564ead1e2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.897+0000 7fdf977fe640 1 -- 172.21.15.7:0/210293175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ead1da5d0 msgr2=0x564ead1e4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:41.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.897+0000 7fdf977fe640 1 --2- 172.21.15.7:0/210293175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ead1da5d0 0x564ead1e4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.897+0000 7fdf977fe640 1 -- 172.21.15.7:0/210293175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eaceb13c0 con 0x564ead1e5370 2024-09-19T08:52:41.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.898+0000 7fdf977fe640 1 --2- 172.21.15.7:0/210293175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1e5370 0x564ead1e2640 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fdf9002f650 tx=0x7fdf90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e43fbdf69b5d40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:41.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.898+0000 7fdf7aff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:41.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.898+0000 7fdf7aff5640 1 -- 172.21.15.7:0/210293175 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf90034040 con 0x564ead1e5370 2024-09-19T08:52:41.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.898+0000 7fdf7aff5640 1 -- 172.21.15.7:0/210293175 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7fdf90004040 con 0x564ead1e5370 2024-09-19T08:52:41.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.898+0000 7fdf9f66b740 1 -- 172.21.15.7:0/210293175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf8809cae0 con 0x564ead1e5370 2024-09-19T08:52:41.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.898+0000 7fdf7aff5640 1 -- 172.21.15.7:0/210293175 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdf90003e40 con 0x564ead1e5370 2024-09-19T08:52:41.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.898+0000 7fdf9f66b740 10 client.17166 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:41.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.898+0000 7fdf9f66b740 1 -- 172.21.15.7:0/210293175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564ead1f3ae0 con 0x564ead1e5370 2024-09-19T08:52:41.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.898+0000 7fdf7aff5640 1 -- 172.21.15.7:0/210293175 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf8809cae0 con 0x564ead1e5370 2024-09-19T08:52:41.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.898+0000 7fdf7aff5640 1 -- 172.21.15.7:0/210293175 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdf90056020 con 0x564ead1e5370 2024-09-19T08:52:41.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.898+0000 7fdf9f66b740 10 client.17166 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:41.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.898+0000 7fdf9f66b740 10 client.17166 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:41.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.898+0000 7fdf9f66b740 20 client.17166 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:41.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.898+0000 7fdf9f66b740 1 --2- 172.21.15.7:0/210293175 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564ead1f4f40 0x564ead1f7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.898+0000 7fdf9f66b740 4 client.17166 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:41.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.898+0000 7fdf9f66b740 1 -- 172.21.15.7:0/210293175 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ead14d860 con 0x564ead1f4f40 2024-09-19T08:52:41.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.899+0000 7fdf96ffd640 1 --2- 172.21.15.7:0/210293175 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564ead1f4f40 0x564ead1f7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.899+0000 7fdf96ffd640 1 --2- 172.21.15.7:0/210293175 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564ead1f4f40 0x564ead1f7380 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3e68467966695da server_cookie=3b6f6e5433abe231 in_seq=0 out_seq=0 2024-09-19T08:52:41.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.899+0000 7fdf7aff5640 10 client.17166 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:41.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.900+0000 7fdf7aff5640 1 -- 172.21.15.7:0/210293175 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564ead14d860 con 0x564ead1f4f40 2024-09-19T08:52:41.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.900+0000 7fdf7aff5640 10 client.17166 handle_command_reply: tid=0 2024-09-19T08:52:41.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.900+0000 7fdf9f66b740 1 client.17166 shutdown 2024-09-19T08:52:41.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.900+0000 7fdf9f66b740 1 -- 172.21.15.7:0/210293175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1e5370 msgr2=0x564ead1e2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:41.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.900+0000 7fdf9f66b740 1 --2- 172.21.15.7:0/210293175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1e5370 0x564ead1e2640 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fdf9002f650 tx=0x7fdf90004a40 comp rx=0 tx=0).stop 2024-09-19T08:52:41.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.900+0000 7fdf9f66b740 1 -- 172.21.15.7:0/210293175 shutdown_connections 2024-09-19T08:52:41.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.900+0000 7fdf9f66b740 1 --2- 172.21.15.7:0/210293175 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564ead1f4f40 0x564ead1f7380 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.900+0000 7fdf7aff5640 0 client.17166 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:41.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.900+0000 7fdf9f66b740 1 --2- 172.21.15.7:0/210293175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1e5370 0x564ead1e2640 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.900+0000 7fdf9f66b740 1 --2- 172.21.15.7:0/210293175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ead1dbb40 0x564ead1e2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.900+0000 7fdf9f66b740 1 --2- 172.21.15.7:0/210293175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ead1da5d0 0x564ead1e4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.900+0000 7fdf9f66b740 1 -- 172.21.15.7:0/210293175 >> 172.21.15.7:0/210293175 conn(0x564ead1a3310 msgr2=0x564ead1dc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:41.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.900+0000 7fdf9f66b740 1 -- 172.21.15.7:0/210293175 shutdown_connections 2024-09-19T08:52:41.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.900+0000 7fdf9f66b740 1 -- 172.21.15.7:0/210293175 wait complete. 2024-09-19T08:52:41.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.900+0000 7fdf9f66b740 20 client.17166 trim_cache size 0 max 16384 2024-09-19T08:52:41.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.913+0000 7fdf9f66b740 1 Processor -- start 2024-09-19T08:52:41.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.913+0000 7fdf9f66b740 1 -- start start 2024-09-19T08:52:41.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.914+0000 7fdf9f66b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1da5d0 0x564ead1d6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.914+0000 7fdf9f66b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ead1dbb40 0x564ead1f12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.914+0000 7fdf9f66b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ead1e5370 0x564ead1fcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.914+0000 7fdf9f66b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdf981b2470 con 0x564ead1da5d0 2024-09-19T08:52:41.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.914+0000 7fdf9f66b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdf981afd40 con 0x564ead1dbb40 2024-09-19T08:52:41.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.914+0000 7fdf9f66b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdf981adbb0 con 0x564ead1e5370 2024-09-19T08:52:41.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.914+0000 7fdf96ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1da5d0 0x564ead1d6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.914+0000 7fdf96ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1da5d0 0x564ead1d6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51158/0 (socket says 172.21.15.7:51158) 2024-09-19T08:52:41.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.914+0000 7fdf96ffd640 1 -- 172.21.15.7:0/1444863498 learned_addr learned my addr 172.21.15.7:0/1444863498 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:41.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.914+0000 7fdf977fe640 1 --2- 172.21.15.7:0/1444863498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ead1e5370 0x564ead1fcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.914+0000 7fdf967fc640 1 --2- 172.21.15.7:0/1444863498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ead1dbb40 0x564ead1f12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.914+0000 7fdf96ffd640 1 -- 172.21.15.7:0/1444863498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ead1e5370 msgr2=0x564ead1fcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:41.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.914+0000 7fdf96ffd640 1 --2- 172.21.15.7:0/1444863498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ead1e5370 0x564ead1fcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.914+0000 7fdf96ffd640 1 -- 172.21.15.7:0/1444863498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ead1dbb40 msgr2=0x564ead1f12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:41.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.914+0000 7fdf96ffd640 1 --2- 172.21.15.7:0/1444863498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ead1dbb40 0x564ead1f12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.914+0000 7fdf96ffd640 1 -- 172.21.15.7:0/1444863498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ead1f7a00 con 0x564ead1da5d0 2024-09-19T08:52:41.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.914+0000 7fdf96ffd640 1 --2- 172.21.15.7:0/1444863498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1da5d0 0x564ead1d6e10 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fdf880cd900 tx=0x7fdf8800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666b1ed16bbdce5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:41.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.914+0000 7fdf7cff9640 1 -- 172.21.15.7:0/1444863498 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8809bd40 con 0x564ead1da5d0 2024-09-19T08:52:41.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.914+0000 7fdf7cff9640 1 -- 172.21.15.7:0/1444863498 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf880a0790 con 0x564ead1da5d0 2024-09-19T08:52:41.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.914+0000 7fdf7cff9640 1 -- 172.21.15.7:0/1444863498 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8809bf20 con 0x564ead1da5d0 2024-09-19T08:52:41.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.915+0000 7fdf9f66b740 1 -- 172.21.15.7:0/1444863498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1da5d0 msgr2=0x564ead1d6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:41.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.915+0000 7fdf9f66b740 1 --2- 172.21.15.7:0/1444863498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1da5d0 0x564ead1d6e10 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fdf880cd900 tx=0x7fdf8800c7d0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.915+0000 7fdf9f66b740 1 -- 172.21.15.7:0/1444863498 shutdown_connections 2024-09-19T08:52:41.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.915+0000 7fdf9f66b740 1 --2- 172.21.15.7:0/1444863498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ead1e5370 0x564ead1fcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.915+0000 7fdf9f66b740 1 --2- 172.21.15.7:0/1444863498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ead1dbb40 0x564ead1f12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.915+0000 7fdf9f66b740 1 --2- 172.21.15.7:0/1444863498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1da5d0 0x564ead1d6e10 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.915+0000 7fdf9f66b740 1 -- 172.21.15.7:0/1444863498 >> 172.21.15.7:0/1444863498 conn(0x564ead1a3310 msgr2=0x564ead1d6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:41.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.915+0000 7fdf9f66b740 1 -- 172.21.15.7:0/1444863498 shutdown_connections 2024-09-19T08:52:41.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.915+0000 7fdf9f66b740 1 -- 172.21.15.7:0/1444863498 wait complete. 2024-09-19T08:52:41.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.915+0000 7fdf9f66b740 1 -- start start 2024-09-19T08:52:41.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.916+0000 7fdf9f66b740 1 Processor -- start 2024-09-19T08:52:41.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.916+0000 7fdf9f66b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1da5d0 0x564ead1e95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.916+0000 7fdf9f66b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ead1dbb40 0x564ead1e9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.916+0000 7fdf9f66b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ead1e5370 0x564ead25ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.916+0000 7fdf9f66b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdf981ae200 con 0x564ead1da5d0 2024-09-19T08:52:41.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.916+0000 7fdf9f66b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdf981af670 con 0x564ead1e5370 2024-09-19T08:52:41.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.916+0000 7fdf9f66b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdf981ae8d0 con 0x564ead1dbb40 2024-09-19T08:52:41.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.916+0000 7fdf9f66b740 10 client.0 _ll_register_callbacks cb 0x7fdf88005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:41.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.916+0000 7fdf96ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1da5d0 0x564ead1e95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.916+0000 7fdf96ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1da5d0 0x564ead1e95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51164/0 (socket says 172.21.15.7:51164) 2024-09-19T08:52:41.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.916+0000 7fdf96ffd640 1 -- 172.21.15.7:0/3055701950 learned_addr learned my addr 172.21.15.7:0/3055701950 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:41.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.916+0000 7fdf967fc640 1 --2- 172.21.15.7:0/3055701950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ead1dbb40 0x564ead1e9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.916+0000 7fdf977fe640 1 --2- 172.21.15.7:0/3055701950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ead1e5370 0x564ead25ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.916+0000 7fdf96ffd640 1 -- 172.21.15.7:0/3055701950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ead1dbb40 msgr2=0x564ead1e9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:41.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.916+0000 7fdf96ffd640 1 --2- 172.21.15.7:0/3055701950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ead1dbb40 0x564ead1e9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.916+0000 7fdf96ffd640 1 -- 172.21.15.7:0/3055701950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ead1e5370 msgr2=0x564ead25ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:41.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.916+0000 7fdf96ffd640 1 --2- 172.21.15.7:0/3055701950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ead1e5370 0x564ead25ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.916+0000 7fdf96ffd640 1 -- 172.21.15.7:0/3055701950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ead25f160 con 0x564ead1da5d0 2024-09-19T08:52:41.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.916+0000 7fdf977fe640 1 --2- 172.21.15.7:0/3055701950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ead1e5370 0x564ead25ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:41.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.916+0000 7fdf96ffd640 1 --2- 172.21.15.7:0/3055701950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1da5d0 0x564ead1e95b0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fdf8809a690 tx=0x7fdf880d3d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b558870eb8c03d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:41.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.916+0000 7fdf7aff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:41.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.917+0000 7fdf7aff5640 1 -- 172.21.15.7:0/3055701950 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8809bd40 con 0x564ead1da5d0 2024-09-19T08:52:41.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.917+0000 7fdf7aff5640 1 -- 172.21.15.7:0/3055701950 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7fdf880d3920 con 0x564ead1da5d0 2024-09-19T08:52:41.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.917+0000 7fdf9f66b740 1 -- 172.21.15.7:0/3055701950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf880a0790 con 0x564ead1da5d0 2024-09-19T08:52:41.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.917+0000 7fdf7aff5640 1 -- 172.21.15.7:0/3055701950 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdf880a5050 con 0x564ead1da5d0 2024-09-19T08:52:41.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.917+0000 7fdf9f66b740 10 client.17172 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:41.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.917+0000 7fdf9f66b740 1 -- 172.21.15.7:0/3055701950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564ead260340 con 0x564ead1da5d0 2024-09-19T08:52:41.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.917+0000 7fdf7aff5640 1 -- 172.21.15.7:0/3055701950 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf880a0790 con 0x564ead1da5d0 2024-09-19T08:52:41.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.917+0000 7fdf7aff5640 1 -- 172.21.15.7:0/3055701950 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdf88098a50 con 0x564ead1da5d0 2024-09-19T08:52:41.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.917+0000 7fdf9f66b740 10 client.17172 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:41.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.917+0000 7fdf9f66b740 10 client.17172 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:41.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.917+0000 7fdf9f66b740 20 client.17172 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:41.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.917+0000 7fdf9f66b740 1 --2- 172.21.15.7:0/3055701950 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564ead260560 0x564ead262950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:41.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.917+0000 7fdf9f66b740 4 client.17172 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:52:41.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.917+0000 7fdf9f66b740 1 -- 172.21.15.7:0/3055701950 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564ead147d70 con 0x564ead260560 2024-09-19T08:52:41.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.917+0000 7fdf967fc640 1 --2- 172.21.15.7:0/3055701950 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564ead260560 0x564ead262950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:41.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.918+0000 7fdf967fc640 1 --2- 172.21.15.7:0/3055701950 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564ead260560 0x564ead262950 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=929acd6e97e14f5d server_cookie=5b9d54c97ddf0351 in_seq=0 out_seq=0 2024-09-19T08:52:41.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.918+0000 7fdf7aff5640 10 client.17172 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:41.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.918+0000 7fdf7aff5640 1 -- 172.21.15.7:0/3055701950 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564ead147d70 con 0x564ead260560 2024-09-19T08:52:41.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.918+0000 7fdf7aff5640 10 client.17172 handle_command_reply: tid=0 2024-09-19T08:52:41.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.918+0000 7fdf9f66b740 1 client.17172 shutdown 2024-09-19T08:52:41.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.918+0000 7fdf9f66b740 1 -- 172.21.15.7:0/3055701950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1da5d0 msgr2=0x564ead1e95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:41.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.918+0000 7fdf9f66b740 1 --2- 172.21.15.7:0/3055701950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1da5d0 0x564ead1e95b0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fdf8809a690 tx=0x7fdf880d3d20 comp rx=0 tx=0).stop 2024-09-19T08:52:41.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.918+0000 7fdf9f66b740 1 -- 172.21.15.7:0/3055701950 shutdown_connections 2024-09-19T08:52:41.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.918+0000 7fdf9f66b740 1 --2- 172.21.15.7:0/3055701950 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564ead260560 0x564ead262950 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.918+0000 7fdf9f66b740 1 --2- 172.21.15.7:0/3055701950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ead1e5370 0x564ead25ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.918+0000 7fdf9f66b740 1 --2- 172.21.15.7:0/3055701950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ead1dbb40 0x564ead1e9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.918+0000 7fdf7aff5640 0 client.17172 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:41.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.918+0000 7fdf9f66b740 1 --2- 172.21.15.7:0/3055701950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564ead1da5d0 0x564ead1e95b0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.918+0000 7fdf9f66b740 1 -- 172.21.15.7:0/3055701950 >> 172.21.15.7:0/3055701950 conn(0x564ead1a3310 msgr2=0x564ead1e40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:41.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.918+0000 7fdf9f66b740 1 -- 172.21.15.7:0/3055701950 shutdown_connections 2024-09-19T08:52:41.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.918+0000 7fdf9f66b740 1 -- 172.21.15.7:0/3055701950 wait complete. 2024-09-19T08:52:41.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.919+0000 7fdf9f66b740 20 client.17172 trim_cache size 0 max 16384 2024-09-19T08:52:41.925 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:52:41.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.919+0000 7fdf9d292640 1 -- 172.21.15.7:0/119244101 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdf800a33b0 msgr2=0x7fdf800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:41.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.919+0000 7fdf9d292640 1 --2- 172.21.15.7:0/119244101 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdf800a33b0 0x7fdf800a5870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdf90004af0 tx=0x7fdf9003d040 comp rx=0 tx=0).stop 2024-09-19T08:52:41.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.919+0000 7fdf9d292640 1 -- 172.21.15.7:0/119244101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf98102d40 msgr2=0x7fdf981983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:41.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.919+0000 7fdf9d292640 1 --2- 172.21.15.7:0/119244101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf98102d40 0x7fdf981983f0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fdf8800e9f0 tx=0x7fdf8800eeb0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.919+0000 7fdf9d292640 1 -- 172.21.15.7:0/119244101 shutdown_connections 2024-09-19T08:52:41.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.919+0000 7fdf9d292640 1 --2- 172.21.15.7:0/119244101 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdf800a33b0 0x7fdf800a5870 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.919+0000 7fdf9d292640 1 --2- 172.21.15.7:0/119244101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf9810c170 0x7fdf9819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.919+0000 7fdf9d292640 1 --2- 172.21.15.7:0/119244101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf98103660 0x7fdf98198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.919+0000 7fdf9d292640 1 --2- 172.21.15.7:0/119244101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf98102d40 0x7fdf981983f0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:41.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.919+0000 7fdf9d292640 1 -- 172.21.15.7:0/119244101 >> 172.21.15.7:0/119244101 conn(0x7fdf980fc7a0 msgr2=0x7fdf980fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:41.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.919+0000 7fdf9d292640 1 -- 172.21.15.7:0/119244101 shutdown_connections 2024-09-19T08:52:41.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:41.919+0000 7fdf9d292640 1 -- 172.21.15.7:0/119244101 wait complete. 2024-09-19T08:52:42.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:42 smithi007 ceph-mon[31221]: pgmap v252: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:42.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:42 smithi044 ceph-mon[35072]: pgmap v252: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:42.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:42 smithi175 ceph-mon[35688]: pgmap v252: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:43.556 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:52:43.557 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:52:43.833 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:44.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.321+0000 7fc49e8ac640 1 -- 172.21.15.7:0/1371621519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc498106f20 msgr2=0x7fc49810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.321+0000 7fc49e8ac640 1 --2- 172.21.15.7:0/1371621519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc498106f20 0x7fc49810eaa0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fc490009ca0 tx=0x7fc49002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.321+0000 7fc49e8ac640 1 -- 172.21.15.7:0/1371621519 shutdown_connections 2024-09-19T08:52:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.321+0000 7fc49e8ac640 1 --2- 172.21.15.7:0/1371621519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc498106f20 0x7fc49810eaa0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.321+0000 7fc49e8ac640 1 --2- 172.21.15.7:0/1371621519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4981027a0 0x7fc4981067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.321+0000 7fc49e8ac640 1 --2- 172.21.15.7:0/1371621519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc498101df0 0x7fc4981021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.321+0000 7fc49e8ac640 1 -- 172.21.15.7:0/1371621519 >> 172.21.15.7:0/1371621519 conn(0x7fc4980fd8f0 msgr2=0x7fc4980ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.321+0000 7fc49e8ac640 1 -- 172.21.15.7:0/1371621519 shutdown_connections 2024-09-19T08:52:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.321+0000 7fc49e8ac640 1 -- 172.21.15.7:0/1371621519 wait complete. 2024-09-19T08:52:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.321+0000 7fc49e8ac640 1 Processor -- start 2024-09-19T08:52:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.321+0000 7fc49e8ac640 1 -- start start 2024-09-19T08:52:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.322+0000 7fc49e8ac640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc498101df0 0x7fc4980744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.322+0000 7fc49e8ac640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4981027a0 0x7fc498074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.322+0000 7fc49e8ac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc498106f20 0x7fc498074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.322+0000 7fc49e8ac640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc498111f80 con 0x7fc4981027a0 2024-09-19T08:52:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.322+0000 7fc49e8ac640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc498111e00 con 0x7fc498106f20 2024-09-19T08:52:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.322+0000 7fc49e8ac640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc498112100 con 0x7fc498101df0 2024-09-19T08:52:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.322+0000 7fc48ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4981027a0 0x7fc498074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.322+0000 7fc48ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4981027a0 0x7fc498074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39610/0 (socket says 172.21.15.7:39610) 2024-09-19T08:52:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.322+0000 7fc48ffff640 1 -- 172.21.15.7:0/462055548 learned_addr learned my addr 172.21.15.7:0/462055548 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.322+0000 7fc497fff640 1 --2- 172.21.15.7:0/462055548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc498101df0 0x7fc4980744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.322+0000 7fc49ce49640 1 --2- 172.21.15.7:0/462055548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc498106f20 0x7fc498074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.322+0000 7fc48ffff640 1 -- 172.21.15.7:0/462055548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc498101df0 msgr2=0x7fc4980744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.322+0000 7fc48ffff640 1 --2- 172.21.15.7:0/462055548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc498101df0 0x7fc4980744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.322+0000 7fc48ffff640 1 -- 172.21.15.7:0/462055548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc498106f20 msgr2=0x7fc498074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.322+0000 7fc48ffff640 1 --2- 172.21.15.7:0/462055548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc498106f20 0x7fc498074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.322+0000 7fc48ffff640 1 -- 172.21.15.7:0/462055548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4981a6840 con 0x7fc4981027a0 2024-09-19T08:52:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.322+0000 7fc48ffff640 1 --2- 172.21.15.7:0/462055548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4981027a0 0x7fc498074a30 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fc48000c920 tx=0x7fc48000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.322+0000 7fc495ffb640 1 -- 172.21.15.7:0/462055548 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc480007c70 con 0x7fc4981027a0 2024-09-19T08:52:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.322+0000 7fc495ffb640 1 -- 172.21.15.7:0/462055548 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc480007e10 con 0x7fc4981027a0 2024-09-19T08:52:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.322+0000 7fc49e8ac640 1 -- 172.21.15.7:0/462055548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4981a6b30 con 0x7fc4981027a0 2024-09-19T08:52:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.323+0000 7fc495ffb640 1 -- 172.21.15.7:0/462055548 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc480018890 con 0x7fc4981027a0 2024-09-19T08:52:44.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.323+0000 7fc49e8ac640 1 -- 172.21.15.7:0/462055548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4981a70c0 con 0x7fc4981027a0 2024-09-19T08:52:44.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.325+0000 7fc495ffb640 1 -- 172.21.15.7:0/462055548 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fc480018a70 con 0x7fc4981027a0 2024-09-19T08:52:44.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.325+0000 7fc4a0c85740 1 Processor -- start 2024-09-19T08:52:44.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.325+0000 7fc4a0c85740 1 -- start start 2024-09-19T08:52:44.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.325+0000 7fc4a0c85740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff5ffb60 0x5560ff5fff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:44.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.325+0000 7fc4a0c85740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff600480 0x5560ff60a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:44.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.325+0000 7fc4a0c85740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560ff60ad40 0x5560ff60d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:44.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.325+0000 7fc4a0c85740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5560ff565280 con 0x5560ff5ffb60 2024-09-19T08:52:44.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.325+0000 7fc4a0c85740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5560ff50cb10 con 0x5560ff600480 2024-09-19T08:52:44.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.325+0000 7fc4a0c85740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5560ff561240 con 0x5560ff60ad40 2024-09-19T08:52:44.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.326+0000 7fc49ce49640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff5ffb60 0x5560ff5fff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:44.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.326+0000 7fc49ce49640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff5ffb60 0x5560ff5fff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39620/0 (socket says 172.21.15.7:39620) 2024-09-19T08:52:44.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.326+0000 7fc49ce49640 1 -- 172.21.15.7:0/3651253631 learned_addr learned my addr 172.21.15.7:0/3651253631 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:44.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.326+0000 7fc497fff640 1 --2- 172.21.15.7:0/3651253631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff600480 0x5560ff60a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:44.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.326+0000 7fc48ffff640 1 --2- 172.21.15.7:0/3651253631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560ff60ad40 0x5560ff60d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:44.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.326+0000 7fc495ffb640 1 --2- 172.21.15.7:0/462055548 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc4840a34b0 0x7fc4840a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:44.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.326+0000 7fc497fff640 1 -- 172.21.15.7:0/3651253631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560ff60ad40 msgr2=0x5560ff60d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:44.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.326+0000 7fc497fff640 1 --2- 172.21.15.7:0/3651253631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560ff60ad40 0x5560ff60d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.326+0000 7fc497fff640 1 -- 172.21.15.7:0/3651253631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff5ffb60 msgr2=0x5560ff5fff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:44.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.326+0000 7fc497fff640 1 --2- 172.21.15.7:0/3651253631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff5ffb60 0x5560ff5fff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.326+0000 7fc497fff640 1 -- 172.21.15.7:0/3651253631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560ff5191f0 con 0x5560ff600480 2024-09-19T08:52:44.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.326+0000 7fc49ce49640 1 --2- 172.21.15.7:0/3651253631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff5ffb60 0x5560ff5fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:44.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.326+0000 7fc48ffff640 1 --2- 172.21.15.7:0/3651253631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560ff60ad40 0x5560ff60d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:44.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.326+0000 7fc49ce49640 1 --2- 172.21.15.7:0/462055548 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc4840a34b0 0x7fc4840a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:44.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.326+0000 7fc495ffb640 1 -- 172.21.15.7:0/462055548 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7fc4800cfdf0 con 0x7fc4981027a0 2024-09-19T08:52:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.326+0000 7fc497fff640 1 --2- 172.21.15.7:0/3651253631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff600480 0x5560ff60a800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc488009c20 tx=0x7fc488011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d46adbc5155cc052 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.327+0000 7fc48e7fc640 1 -- 172.21.15.7:0/3651253631 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc488009dd0 con 0x5560ff600480 2024-09-19T08:52:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.327+0000 7fc49ce49640 1 --2- 172.21.15.7:0/462055548 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc4840a34b0 0x7fc4840a5970 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc490009430 tx=0x7fc4900095c0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.327+0000 7fc48e7fc640 1 -- 172.21.15.7:0/3651253631 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc488005020 con 0x5560ff600480 2024-09-19T08:52:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.327+0000 7fc48e7fc640 1 -- 172.21.15.7:0/3651253631 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc488004b70 con 0x5560ff600480 2024-09-19T08:52:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.327+0000 7fc4a0c85740 1 -- 172.21.15.7:0/3651253631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff600480 msgr2=0x5560ff60a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.327+0000 7fc4a0c85740 1 --2- 172.21.15.7:0/3651253631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff600480 0x5560ff60a800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc488009c20 tx=0x7fc488011810 comp rx=0 tx=0).stop 2024-09-19T08:52:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.327+0000 7fc4a0c85740 1 -- 172.21.15.7:0/3651253631 shutdown_connections 2024-09-19T08:52:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.327+0000 7fc4a0c85740 1 --2- 172.21.15.7:0/3651253631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560ff60ad40 0x5560ff60d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.327+0000 7fc4a0c85740 1 --2- 172.21.15.7:0/3651253631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff600480 0x5560ff60a800 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.327+0000 7fc4a0c85740 1 --2- 172.21.15.7:0/3651253631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff5ffb60 0x5560ff5fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.327+0000 7fc4a0c85740 1 -- 172.21.15.7:0/3651253631 >> 172.21.15.7:0/3651253631 conn(0x5560ff5fc0f0 msgr2=0x5560ff5fc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.328+0000 7fc4a0c85740 1 -- 172.21.15.7:0/3651253631 shutdown_connections 2024-09-19T08:52:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.328+0000 7fc4a0c85740 1 -- 172.21.15.7:0/3651253631 wait complete. 2024-09-19T08:52:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.328+0000 7fc4a0c85740 1 -- start start 2024-09-19T08:52:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.328+0000 7fc4a0c85740 1 Processor -- start 2024-09-19T08:52:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.328+0000 7fc4a0c85740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff5ffb60 0x5560ff60a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.328+0000 7fc4a0c85740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff600480 0x5560ff607b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.328+0000 7fc4a0c85740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560ff60ad40 0x5560ff6082b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.328+0000 7fc4a0c85740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5560ff60d910 con 0x5560ff5ffb60 2024-09-19T08:52:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.328+0000 7fc4a0c85740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5560ff51ff10 con 0x5560ff600480 2024-09-19T08:52:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.328+0000 7fc4a0c85740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5560ff60da90 con 0x5560ff60ad40 2024-09-19T08:52:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.328+0000 7fc4a0c85740 10 client.0 _ll_register_callbacks cb 0x5560ff4e8a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.329+0000 7fc497fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff5ffb60 0x5560ff60a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.329+0000 7fc48ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff600480 0x5560ff607b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.329+0000 7fc497fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff5ffb60 0x5560ff60a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39622/0 (socket says 172.21.15.7:39622) 2024-09-19T08:52:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.329+0000 7fc497fff640 1 -- 172.21.15.7:0/2898353996 learned_addr learned my addr 172.21.15.7:0/2898353996 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.329+0000 7fc49ce49640 1 --2- 172.21.15.7:0/2898353996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560ff60ad40 0x5560ff6082b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.329+0000 7fc497fff640 1 -- 172.21.15.7:0/2898353996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560ff60ad40 msgr2=0x5560ff6082b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.329+0000 7fc497fff640 1 --2- 172.21.15.7:0/2898353996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560ff60ad40 0x5560ff6082b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.329+0000 7fc497fff640 1 -- 172.21.15.7:0/2898353996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff600480 msgr2=0x5560ff607b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.329+0000 7fc497fff640 1 --2- 172.21.15.7:0/2898353996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff600480 0x5560ff607b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.329+0000 7fc497fff640 1 -- 172.21.15.7:0/2898353996 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560ff2d66a0 con 0x5560ff5ffb60 2024-09-19T08:52:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.329+0000 7fc48ffff640 1 --2- 172.21.15.7:0/2898353996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff600480 0x5560ff607b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.329+0000 7fc497fff640 1 --2- 172.21.15.7:0/2898353996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff5ffb60 0x5560ff60a7d0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fc48801b040 tx=0x7fc488009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe479f1a2758c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.329+0000 7fc4777fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.329+0000 7fc4777fe640 1 -- 172.21.15.7:0/2898353996 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc488029020 con 0x5560ff5ffb60 2024-09-19T08:52:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.329+0000 7fc4777fe640 1 -- 172.21.15.7:0/2898353996 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7fc488004b00 con 0x5560ff5ffb60 2024-09-19T08:52:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.329+0000 7fc4a0c85740 1 -- 172.21.15.7:0/2898353996 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc488005020 con 0x5560ff5ffb60 2024-09-19T08:52:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.330+0000 7fc4777fe640 1 -- 172.21.15.7:0/2898353996 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc488034050 con 0x5560ff5ffb60 2024-09-19T08:52:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.330+0000 7fc4a0c85740 10 client.17184 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.330+0000 7fc4a0c85740 1 -- 172.21.15.7:0/2898353996 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5560ff619450 con 0x5560ff5ffb60 2024-09-19T08:52:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.330+0000 7fc4777fe640 1 -- 172.21.15.7:0/2898353996 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc488005020 con 0x5560ff5ffb60 2024-09-19T08:52:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.330+0000 7fc4777fe640 1 -- 172.21.15.7:0/2898353996 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc488023420 con 0x5560ff5ffb60 2024-09-19T08:52:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.330+0000 7fc4a0c85740 10 client.17184 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.330+0000 7fc4a0c85740 10 client.17184 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.330+0000 7fc4a0c85740 20 client.17184 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.330+0000 7fc4a0c85740 1 --2- 172.21.15.7:0/2898353996 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5560ff61a8b0 0x5560ff61cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.330+0000 7fc4a0c85740 4 client.17184 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.330+0000 7fc4a0c85740 1 -- 172.21.15.7:0/2898353996 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560ff5727f0 con 0x5560ff61a8b0 2024-09-19T08:52:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.330+0000 7fc48ffff640 1 --2- 172.21.15.7:0/2898353996 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5560ff61a8b0 0x5560ff61cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.331+0000 7fc48ffff640 1 --2- 172.21.15.7:0/2898353996 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5560ff61a8b0 0x5560ff61cca0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb0e943b0814ddb6 server_cookie=100790be01416304 in_seq=0 out_seq=0 2024-09-19T08:52:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.331+0000 7fc4777fe640 10 client.17184 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.331+0000 7fc4777fe640 1 -- 172.21.15.7:0/2898353996 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5560ff5727f0 con 0x5560ff61a8b0 2024-09-19T08:52:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.331+0000 7fc4777fe640 10 client.17184 handle_command_reply: tid=0 2024-09-19T08:52:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.331+0000 7fc4a0c85740 1 client.17184 shutdown 2024-09-19T08:52:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.332+0000 7fc4a0c85740 1 -- 172.21.15.7:0/2898353996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff5ffb60 msgr2=0x5560ff60a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.332+0000 7fc4a0c85740 1 --2- 172.21.15.7:0/2898353996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff5ffb60 0x5560ff60a7d0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fc48801b040 tx=0x7fc488009930 comp rx=0 tx=0).stop 2024-09-19T08:52:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.332+0000 7fc4a0c85740 1 -- 172.21.15.7:0/2898353996 shutdown_connections 2024-09-19T08:52:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.332+0000 7fc4a0c85740 1 --2- 172.21.15.7:0/2898353996 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5560ff61a8b0 0x5560ff61cca0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.332+0000 7fc4a0c85740 1 --2- 172.21.15.7:0/2898353996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560ff60ad40 0x5560ff6082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.332+0000 7fc4a0c85740 1 --2- 172.21.15.7:0/2898353996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff600480 0x5560ff607b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.332+0000 7fc4a0c85740 1 --2- 172.21.15.7:0/2898353996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff5ffb60 0x5560ff60a7d0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.332+0000 7fc4a0c85740 1 -- 172.21.15.7:0/2898353996 >> 172.21.15.7:0/2898353996 conn(0x5560ff5fc0f0 msgr2=0x5560ff601e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.332+0000 7fc4777fe640 0 client.17184 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.332+0000 7fc4a0c85740 1 -- 172.21.15.7:0/2898353996 shutdown_connections 2024-09-19T08:52:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.332+0000 7fc4a0c85740 1 -- 172.21.15.7:0/2898353996 wait complete. 2024-09-19T08:52:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.332+0000 7fc4a0c85740 20 client.17184 trim_cache size 0 max 16384 2024-09-19T08:52:44.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.350+0000 7fc4a0c85740 1 Processor -- start 2024-09-19T08:52:44.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.350+0000 7fc4a0c85740 1 -- start start 2024-09-19T08:52:44.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.350+0000 7fc4a0c85740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff5ffb60 0x5560ff609980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:44.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.350+0000 7fc4a0c85740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560ff600480 0x5560ff6224a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:44.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.350+0000 7fc4a0c85740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff60ad40 0x5560ff6229e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:44.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.350+0000 7fc4a0c85740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc4981b23a0 con 0x5560ff5ffb60 2024-09-19T08:52:44.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.350+0000 7fc4a0c85740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc4981afc70 con 0x5560ff60ad40 2024-09-19T08:52:44.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.350+0000 7fc4a0c85740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc4981adae0 con 0x5560ff600480 2024-09-19T08:52:44.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.351+0000 7fc497fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff5ffb60 0x5560ff609980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:44.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.351+0000 7fc497fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff5ffb60 0x5560ff609980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39628/0 (socket says 172.21.15.7:39628) 2024-09-19T08:52:44.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.351+0000 7fc497fff640 1 -- 172.21.15.7:0/1885601205 learned_addr learned my addr 172.21.15.7:0/1885601205 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:44.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.351+0000 7fc49ce49640 1 --2- 172.21.15.7:0/1885601205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff60ad40 0x5560ff6229e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:44.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.351+0000 7fc48ffff640 1 --2- 172.21.15.7:0/1885601205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560ff600480 0x5560ff6224a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:44.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.351+0000 7fc497fff640 1 -- 172.21.15.7:0/1885601205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560ff600480 msgr2=0x5560ff6224a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:44.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.351+0000 7fc497fff640 1 --2- 172.21.15.7:0/1885601205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560ff600480 0x5560ff6224a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.351+0000 7fc497fff640 1 -- 172.21.15.7:0/1885601205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff60ad40 msgr2=0x5560ff6229e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:44.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.351+0000 7fc497fff640 1 --2- 172.21.15.7:0/1885601205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff60ad40 0x5560ff6229e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.351+0000 7fc497fff640 1 -- 172.21.15.7:0/1885601205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560ff608620 con 0x5560ff5ffb60 2024-09-19T08:52:44.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.351+0000 7fc48ffff640 1 --2- 172.21.15.7:0/1885601205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560ff600480 0x5560ff6224a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:44.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.351+0000 7fc49ce49640 1 --2- 172.21.15.7:0/1885601205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff60ad40 0x5560ff6229e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:44.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.351+0000 7fc497fff640 1 --2- 172.21.15.7:0/1885601205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff5ffb60 0x5560ff609980 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fc4880056e0 tx=0x7fc488004810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2b970488e455b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:44.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.351+0000 7fc48dffb640 1 -- 172.21.15.7:0/1885601205 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc488029050 con 0x5560ff5ffb60 2024-09-19T08:52:44.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.351+0000 7fc48dffb640 1 -- 172.21.15.7:0/1885601205 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc488016070 con 0x5560ff5ffb60 2024-09-19T08:52:44.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.351+0000 7fc48dffb640 1 -- 172.21.15.7:0/1885601205 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4880256d0 con 0x5560ff5ffb60 2024-09-19T08:52:44.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.352+0000 7fc4a0c85740 1 -- 172.21.15.7:0/1885601205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff5ffb60 msgr2=0x5560ff609980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:44.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.352+0000 7fc4a0c85740 1 --2- 172.21.15.7:0/1885601205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff5ffb60 0x5560ff609980 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fc4880056e0 tx=0x7fc488004810 comp rx=0 tx=0).stop 2024-09-19T08:52:44.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.352+0000 7fc4a0c85740 1 -- 172.21.15.7:0/1885601205 shutdown_connections 2024-09-19T08:52:44.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.352+0000 7fc4a0c85740 1 --2- 172.21.15.7:0/1885601205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff60ad40 0x5560ff6229e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.352+0000 7fc4a0c85740 1 --2- 172.21.15.7:0/1885601205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560ff600480 0x5560ff6224a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.352+0000 7fc4a0c85740 1 --2- 172.21.15.7:0/1885601205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff5ffb60 0x5560ff609980 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.352+0000 7fc4a0c85740 1 -- 172.21.15.7:0/1885601205 >> 172.21.15.7:0/1885601205 conn(0x5560ff5fc0f0 msgr2=0x5560ff609270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:44.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.352+0000 7fc4a0c85740 1 -- 172.21.15.7:0/1885601205 shutdown_connections 2024-09-19T08:52:44.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.352+0000 7fc4a0c85740 1 -- 172.21.15.7:0/1885601205 wait complete. 2024-09-19T08:52:44.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.353+0000 7fc4a0c85740 1 -- start start 2024-09-19T08:52:44.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.353+0000 7fc4a0c85740 1 Processor -- start 2024-09-19T08:52:44.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.353+0000 7fc4a0c85740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff5ffb60 0x5560ff6131e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:44.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.353+0000 7fc4a0c85740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff600480 0x5560ff6045d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:44.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.353+0000 7fc4a0c85740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560ff60ad40 0x5560ff604b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:44.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.353+0000 7fc4a0c85740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc4981ae130 con 0x5560ff600480 2024-09-19T08:52:44.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.353+0000 7fc4a0c85740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc4981af5a0 con 0x5560ff5ffb60 2024-09-19T08:52:44.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.353+0000 7fc4a0c85740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc4981ae800 con 0x5560ff60ad40 2024-09-19T08:52:44.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.353+0000 7fc4a0c85740 10 client.0 _ll_register_callbacks cb 0x7fc488005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:44.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.353+0000 7fc48ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff600480 0x5560ff6045d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:44.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.353+0000 7fc48ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff600480 0x5560ff6045d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39642/0 (socket says 172.21.15.7:39642) 2024-09-19T08:52:44.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.353+0000 7fc48ffff640 1 -- 172.21.15.7:0/3988733562 learned_addr learned my addr 172.21.15.7:0/3988733562 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:44.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.354+0000 7fc49ce49640 1 --2- 172.21.15.7:0/3988733562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560ff60ad40 0x5560ff604b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:44.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.354+0000 7fc497fff640 1 --2- 172.21.15.7:0/3988733562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff5ffb60 0x5560ff6131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:44.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.354+0000 7fc48ffff640 1 -- 172.21.15.7:0/3988733562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560ff60ad40 msgr2=0x5560ff604b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:44.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.354+0000 7fc48ffff640 1 --2- 172.21.15.7:0/3988733562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560ff60ad40 0x5560ff604b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.354+0000 7fc48ffff640 1 -- 172.21.15.7:0/3988733562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff5ffb60 msgr2=0x5560ff6131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:44.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.354+0000 7fc48ffff640 1 --2- 172.21.15.7:0/3988733562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff5ffb60 0x5560ff6131e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.354+0000 7fc48ffff640 1 -- 172.21.15.7:0/3988733562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560ff605100 con 0x5560ff600480 2024-09-19T08:52:44.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.354+0000 7fc48ffff640 1 --2- 172.21.15.7:0/3988733562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff600480 0x5560ff6045d0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fc480098a00 tx=0x7fc480000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ecee3c5a65e459e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:44.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.354+0000 7fc4777fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:44.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.354+0000 7fc4777fe640 1 -- 172.21.15.7:0/3988733562 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4800b5030 con 0x5560ff600480 2024-09-19T08:52:44.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.354+0000 7fc4777fe640 1 -- 172.21.15.7:0/3988733562 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7fc480018d60 con 0x5560ff600480 2024-09-19T08:52:44.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.354+0000 7fc4a0c85740 1 -- 172.21.15.7:0/3988733562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc488016070 con 0x5560ff600480 2024-09-19T08:52:44.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.354+0000 7fc4777fe640 1 -- 172.21.15.7:0/3988733562 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc48007f050 con 0x5560ff600480 2024-09-19T08:52:44.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.354+0000 7fc4a0c85740 10 client.17190 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:44.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.354+0000 7fc4a0c85740 1 -- 172.21.15.7:0/3988733562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5560ff685470 con 0x5560ff600480 2024-09-19T08:52:44.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.355+0000 7fc4777fe640 1 -- 172.21.15.7:0/3988733562 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc488016070 con 0x5560ff600480 2024-09-19T08:52:44.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.355+0000 7fc4777fe640 1 -- 172.21.15.7:0/3988733562 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc4800a4810 con 0x5560ff600480 2024-09-19T08:52:44.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.355+0000 7fc4a0c85740 10 client.17190 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:44.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.355+0000 7fc4a0c85740 10 client.17190 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:44.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.355+0000 7fc4a0c85740 20 client.17190 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:44.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.355+0000 7fc4a0c85740 1 --2- 172.21.15.7:0/3988733562 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5560ff6859e0 0x5560ff687e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:44.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.355+0000 7fc4a0c85740 4 client.17190 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:52:44.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.355+0000 7fc4a0c85740 1 -- 172.21.15.7:0/3988733562 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5560ff56cd00 con 0x5560ff6859e0 2024-09-19T08:52:44.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.355+0000 7fc497fff640 1 --2- 172.21.15.7:0/3988733562 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5560ff6859e0 0x5560ff687e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:44.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.356+0000 7fc497fff640 1 --2- 172.21.15.7:0/3988733562 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5560ff6859e0 0x5560ff687e00 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d96180be3b142209 server_cookie=23506d01dd07ee74 in_seq=0 out_seq=0 2024-09-19T08:52:44.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.356+0000 7fc4777fe640 10 client.17190 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:44.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.357+0000 7fc4777fe640 1 -- 172.21.15.7:0/3988733562 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5560ff56cd00 con 0x5560ff6859e0 2024-09-19T08:52:44.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.357+0000 7fc4777fe640 10 client.17190 handle_command_reply: tid=0 2024-09-19T08:52:44.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.357+0000 7fc4a0c85740 1 client.17190 shutdown 2024-09-19T08:52:44.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.357+0000 7fc4a0c85740 1 -- 172.21.15.7:0/3988733562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff600480 msgr2=0x5560ff6045d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:44.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.357+0000 7fc4a0c85740 1 --2- 172.21.15.7:0/3988733562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff600480 0x5560ff6045d0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fc480098a00 tx=0x7fc480000bc0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.357+0000 7fc4a0c85740 1 -- 172.21.15.7:0/3988733562 shutdown_connections 2024-09-19T08:52:44.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.357+0000 7fc4a0c85740 1 --2- 172.21.15.7:0/3988733562 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5560ff6859e0 0x5560ff687e00 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.357+0000 7fc4a0c85740 1 --2- 172.21.15.7:0/3988733562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560ff60ad40 0x5560ff604b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.357+0000 7fc4a0c85740 1 --2- 172.21.15.7:0/3988733562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560ff600480 0x5560ff6045d0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.357+0000 7fc4777fe640 0 client.17190 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:44.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.357+0000 7fc4a0c85740 1 --2- 172.21.15.7:0/3988733562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ff5ffb60 0x5560ff6131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.357+0000 7fc4a0c85740 1 -- 172.21.15.7:0/3988733562 >> 172.21.15.7:0/3988733562 conn(0x5560ff5fc0f0 msgr2=0x5560ff5fb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:44.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.358+0000 7fc4a0c85740 1 -- 172.21.15.7:0/3988733562 shutdown_connections 2024-09-19T08:52:44.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.358+0000 7fc4a0c85740 1 -- 172.21.15.7:0/3988733562 wait complete. 2024-09-19T08:52:44.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.358+0000 7fc4a0c85740 20 client.17190 trim_cache size 0 max 16384 2024-09-19T08:52:44.363 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:52:44.363 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-19T08:52:44.363 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "226f7d3b-4294-41e9-904b-137e6ee6fec4", 2024-09-19T08:52:44.363 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-19T08:52:44.363 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:52:44.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.358+0000 7fc49e8ac640 1 -- 172.21.15.7:0/462055548 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc4840a34b0 msgr2=0x7fc4840a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:44.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.358+0000 7fc49e8ac640 1 --2- 172.21.15.7:0/462055548 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc4840a34b0 0x7fc4840a5970 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc490009430 tx=0x7fc4900095c0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.358+0000 7fc49e8ac640 1 -- 172.21.15.7:0/462055548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4981027a0 msgr2=0x7fc498074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:44.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.358+0000 7fc49e8ac640 1 --2- 172.21.15.7:0/462055548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4981027a0 0x7fc498074a30 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fc48000c920 tx=0x7fc48000cde0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.359+0000 7fc49e8ac640 1 -- 172.21.15.7:0/462055548 shutdown_connections 2024-09-19T08:52:44.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.359+0000 7fc49e8ac640 1 --2- 172.21.15.7:0/462055548 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fc4840a34b0 0x7fc4840a5970 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.359+0000 7fc49e8ac640 1 --2- 172.21.15.7:0/462055548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc498106f20 0x7fc498074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.359+0000 7fc49e8ac640 1 --2- 172.21.15.7:0/462055548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4981027a0 0x7fc498074a30 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.359+0000 7fc49e8ac640 1 --2- 172.21.15.7:0/462055548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc498101df0 0x7fc4980744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.359+0000 7fc49e8ac640 1 -- 172.21.15.7:0/462055548 >> 172.21.15.7:0/462055548 conn(0x7fc4980fd8f0 msgr2=0x7fc4980ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:44.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.359+0000 7fc49e8ac640 1 -- 172.21.15.7:0/462055548 shutdown_connections 2024-09-19T08:52:44.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:44.359+0000 7fc49e8ac640 1 -- 172.21.15.7:0/462055548 wait complete. 2024-09-19T08:52:44.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:44 smithi007 ceph-mon[31221]: pgmap v253: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:52:44.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:44 smithi044 ceph-mon[35072]: pgmap v253: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:52:44.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:44 smithi175 ceph-mon[35688]: pgmap v253: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:52:45.165 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:52:45.422 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:45.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:45 smithi007 ceph-mon[31221]: scrub queued for path: / 2024-09-19T08:52:45.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:45 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:45.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:45 smithi007 ceph-mon[31221]: scrub summary: active paths [/] 2024-09-19T08:52:45.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:45 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:45.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:45 smithi044 ceph-mon[35072]: scrub queued for path: / 2024-09-19T08:52:45.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:45 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:45.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:45 smithi044 ceph-mon[35072]: scrub summary: active paths [/] 2024-09-19T08:52:45.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:45 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:45.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.887+0000 7fda0e275640 1 -- 172.21.15.7:0/2354851463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda08101400 msgr2=0x7fda0810d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:45.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.887+0000 7fda0e275640 1 --2- 172.21.15.7:0/2354851463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda08101400 0x7fda0810d930 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fda00009cd0 tx=0x7fda0002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.887+0000 7fda0e275640 1 -- 172.21.15.7:0/2354851463 shutdown_connections 2024-09-19T08:52:45.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.887+0000 7fda0e275640 1 --2- 172.21.15.7:0/2354851463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda08101400 0x7fda0810d930 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.887+0000 7fda0e275640 1 --2- 172.21.15.7:0/2354851463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda08100a60 0x7fda08100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.887+0000 7fda0e275640 1 --2- 172.21.15.7:0/2354851463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda08106a60 0x7fda08106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.887+0000 7fda0e275640 1 -- 172.21.15.7:0/2354851463 >> 172.21.15.7:0/2354851463 conn(0x7fda080fc780 msgr2=0x7fda080feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.887+0000 7fda0e275640 1 -- 172.21.15.7:0/2354851463 shutdown_connections 2024-09-19T08:52:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.887+0000 7fda0e275640 1 -- 172.21.15.7:0/2354851463 wait complete. 2024-09-19T08:52:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.888+0000 7fda0e275640 1 Processor -- start 2024-09-19T08:52:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.888+0000 7fda0e275640 1 -- start start 2024-09-19T08:52:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.888+0000 7fda0e275640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda08100a60 0x7fda081970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.888+0000 7fda0e275640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda08101400 0x7fda08197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.888+0000 7fda0e275640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda08106a60 0x7fda08197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.888+0000 7fda0e275640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fda08110e60 con 0x7fda08101400 2024-09-19T08:52:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.888+0000 7fda0e275640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fda08110ce0 con 0x7fda08106a60 2024-09-19T08:52:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.888+0000 7fda0e275640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fda08110fe0 con 0x7fda08100a60 2024-09-19T08:52:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.888+0000 7fda077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda08101400 0x7fda08197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.888+0000 7fda077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda08101400 0x7fda08197620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39666/0 (socket says 172.21.15.7:39666) 2024-09-19T08:52:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.888+0000 7fda077fe640 1 -- 172.21.15.7:0/4102444803 learned_addr learned my addr 172.21.15.7:0/4102444803 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.888+0000 7fda0c812640 1 --2- 172.21.15.7:0/4102444803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda08106a60 0x7fda08197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.888+0000 7fda07fff640 1 --2- 172.21.15.7:0/4102444803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda08100a60 0x7fda081970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.889+0000 7fda077fe640 1 -- 172.21.15.7:0/4102444803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda08100a60 msgr2=0x7fda081970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.889+0000 7fda077fe640 1 --2- 172.21.15.7:0/4102444803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda08100a60 0x7fda081970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.889+0000 7fda077fe640 1 -- 172.21.15.7:0/4102444803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda08106a60 msgr2=0x7fda08197b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.889+0000 7fda077fe640 1 --2- 172.21.15.7:0/4102444803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda08106a60 0x7fda08197b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.889+0000 7fda077fe640 1 -- 172.21.15.7:0/4102444803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda081a6950 con 0x7fda08101400 2024-09-19T08:52:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.889+0000 7fda07fff640 1 --2- 172.21.15.7:0/4102444803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda08100a60 0x7fda081970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.889+0000 7fda077fe640 1 --2- 172.21.15.7:0/4102444803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda08101400 0x7fda08197620 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00d950 tx=0x7fd9fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.889+0000 7fda057fa640 1 -- 172.21.15.7:0/4102444803 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc017030 con 0x7fda08101400 2024-09-19T08:52:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.889+0000 7fda057fa640 1 -- 172.21.15.7:0/4102444803 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9fc004020 con 0x7fda08101400 2024-09-19T08:52:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.889+0000 7fda0e275640 1 -- 172.21.15.7:0/4102444803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda081a6c40 con 0x7fda08101400 2024-09-19T08:52:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.889+0000 7fda057fa640 1 -- 172.21.15.7:0/4102444803 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc0047a0 con 0x7fda08101400 2024-09-19T08:52:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.889+0000 7fda0e275640 1 -- 172.21.15.7:0/4102444803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda081a7180 con 0x7fda08101400 2024-09-19T08:52:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.892+0000 7fda1064e740 1 Processor -- start 2024-09-19T08:52:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.892+0000 7fda1064e740 1 -- start start 2024-09-19T08:52:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.892+0000 7fda057fa640 1 -- 172.21.15.7:0/4102444803 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fd9fc0041d0 con 0x7fda08101400 2024-09-19T08:52:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.892+0000 7fda1064e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e58955a4a0 0x55e58955a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.892+0000 7fda1064e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e58955adc0 0x55e589565140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.892+0000 7fda1064e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e589567a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.892+0000 7fda1064e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e5894c02e0 con 0x55e589565680 2024-09-19T08:52:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.892+0000 7fda1064e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e589467ce0 con 0x55e58955adc0 2024-09-19T08:52:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.892+0000 7fda1064e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e5894bc2a0 con 0x55e58955a4a0 2024-09-19T08:52:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.893+0000 7fda077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e589567a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:45.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.893+0000 7fda077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e589567a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39668/0 (socket says 172.21.15.7:39668) 2024-09-19T08:52:45.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.893+0000 7fda077fe640 1 -- 172.21.15.7:0/1932282151 learned_addr learned my addr 172.21.15.7:0/1932282151 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:45.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.893+0000 7fda07fff640 1 --2- 172.21.15.7:0/1932282151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e58955adc0 0x55e589565140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:45.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.893+0000 7fda0c812640 1 --2- 172.21.15.7:0/1932282151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e58955a4a0 0x55e58955a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:45.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.893+0000 7fda077fe640 1 -- 172.21.15.7:0/1932282151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e58955a4a0 msgr2=0x55e58955a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:45.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.893+0000 7fda077fe640 1 --2- 172.21.15.7:0/1932282151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e58955a4a0 0x55e58955a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.893+0000 7fda077fe640 1 -- 172.21.15.7:0/1932282151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e58955adc0 msgr2=0x55e589565140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:45.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.893+0000 7fda077fe640 1 --2- 172.21.15.7:0/1932282151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e58955adc0 0x55e589565140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.893+0000 7fda077fe640 1 -- 172.21.15.7:0/1932282151 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e58944c440 con 0x55e589565680 2024-09-19T08:52:45.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.893+0000 7fda0c812640 1 --2- 172.21.15.7:0/1932282151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e58955a4a0 0x55e58955a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:45.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.893+0000 7fda057fa640 1 --2- 172.21.15.7:0/4102444803 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd9f00a33b0 0x7fd9f00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:45.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.893+0000 7fda077fe640 1 --2- 172.21.15.7:0/1932282151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e589567a70 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0ccda0 tx=0x7fd9fc0d5f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2fae07efd699cac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.893+0000 7fda0c812640 1 --2- 172.21.15.7:0/4102444803 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd9f00a33b0 0x7fd9f00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.893+0000 7fda057fa640 1 -- 172.21.15.7:0/4102444803 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7fd9fc0cf720 con 0x7fda08101400 2024-09-19T08:52:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.893+0000 7fd9ee7fc640 1 -- 172.21.15.7:0/1932282151 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc097c60 con 0x55e589565680 2024-09-19T08:52:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.893+0000 7fd9ee7fc640 1 -- 172.21.15.7:0/1932282151 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9fc09c0c0 con 0x55e589565680 2024-09-19T08:52:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.893+0000 7fd9ee7fc640 1 -- 172.21.15.7:0/1932282151 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc09b320 con 0x55e589565680 2024-09-19T08:52:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.894+0000 7fda1064e740 1 -- 172.21.15.7:0/1932282151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 msgr2=0x55e589567a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.894+0000 7fda1064e740 1 --2- 172.21.15.7:0/1932282151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e589567a70 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0ccda0 tx=0x7fd9fc0d5f10 comp rx=0 tx=0).stop 2024-09-19T08:52:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.894+0000 7fda0c812640 1 --2- 172.21.15.7:0/4102444803 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd9f00a33b0 0x7fd9f00a5870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fda00004ab0 tx=0x7fda00004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.894+0000 7fda1064e740 1 -- 172.21.15.7:0/1932282151 shutdown_connections 2024-09-19T08:52:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.894+0000 7fda1064e740 1 --2- 172.21.15.7:0/1932282151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e589567a70 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.894+0000 7fda1064e740 1 --2- 172.21.15.7:0/1932282151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e58955adc0 0x55e589565140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.894+0000 7fda1064e740 1 --2- 172.21.15.7:0/1932282151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e58955a4a0 0x55e58955a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.894+0000 7fda1064e740 1 -- 172.21.15.7:0/1932282151 >> 172.21.15.7:0/1932282151 conn(0x55e589556a30 msgr2=0x55e589556e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.894+0000 7fda1064e740 1 -- 172.21.15.7:0/1932282151 shutdown_connections 2024-09-19T08:52:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.894+0000 7fda1064e740 1 -- 172.21.15.7:0/1932282151 wait complete. 2024-09-19T08:52:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.895+0000 7fda1064e740 1 -- start start 2024-09-19T08:52:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.895+0000 7fda1064e740 1 Processor -- start 2024-09-19T08:52:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.895+0000 7fda1064e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e58955a4a0 0x55e589564fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.895+0000 7fda1064e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e58955adc0 0x55e589562250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.895+0000 7fda1064e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e589562790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.895+0000 7fda1064e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e589568250 con 0x55e589565680 2024-09-19T08:52:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.895+0000 7fda1064e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e58947b050 con 0x55e58955adc0 2024-09-19T08:52:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.895+0000 7fda1064e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e5895683d0 con 0x55e58955a4a0 2024-09-19T08:52:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.895+0000 7fda1064e740 10 client.0 _ll_register_callbacks cb 0x55e5894bb160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.895+0000 7fda0c812640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e589562790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.895+0000 7fda0c812640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e589562790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39672/0 (socket says 172.21.15.7:39672) 2024-09-19T08:52:45.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.895+0000 7fda0c812640 1 -- 172.21.15.7:0/1068599577 learned_addr learned my addr 172.21.15.7:0/1068599577 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:45.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.896+0000 7fda07fff640 1 --2- 172.21.15.7:0/1068599577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e58955a4a0 0x55e589564fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:45.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.896+0000 7fda077fe640 1 --2- 172.21.15.7:0/1068599577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e58955adc0 0x55e589562250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:45.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.896+0000 7fda0c812640 1 -- 172.21.15.7:0/1068599577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e58955a4a0 msgr2=0x55e589564fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:45.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.896+0000 7fda0c812640 1 --2- 172.21.15.7:0/1068599577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e58955a4a0 0x55e589564fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.896+0000 7fda0c812640 1 -- 172.21.15.7:0/1068599577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e58955adc0 msgr2=0x55e589562250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:45.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.896+0000 7fda0c812640 1 --2- 172.21.15.7:0/1068599577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e58955adc0 0x55e589562250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.896+0000 7fda0c812640 1 -- 172.21.15.7:0/1068599577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5892313c0 con 0x55e589565680 2024-09-19T08:52:45.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.896+0000 7fda077fe640 1 --2- 172.21.15.7:0/1068599577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e58955adc0 0x55e589562250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:45.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.896+0000 7fda0c812640 1 --2- 172.21.15.7:0/1068599577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e589562790 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fda00035000 tx=0x7fda0002a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16625637ca8beccd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:45.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.896+0000 7fd9e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:45.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.896+0000 7fd9e77fe640 1 -- 172.21.15.7:0/1068599577 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00055060 con 0x55e589565680 2024-09-19T08:52:45.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.896+0000 7fd9e77fe640 1 -- 172.21.15.7:0/1068599577 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7fda000045c0 con 0x55e589565680 2024-09-19T08:52:45.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.896+0000 7fda1064e740 1 -- 172.21.15.7:0/1068599577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9fc09c0c0 con 0x55e589565680 2024-09-19T08:52:45.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.896+0000 7fd9e77fe640 1 -- 172.21.15.7:0/1068599577 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fda00004800 con 0x55e589565680 2024-09-19T08:52:45.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.896+0000 7fda1064e740 10 client.17202 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:45.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.896+0000 7fda1064e740 1 -- 172.21.15.7:0/1068599577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e589573c00 con 0x55e589565680 2024-09-19T08:52:45.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.896+0000 7fd9e77fe640 1 -- 172.21.15.7:0/1068599577 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9fc09c0c0 con 0x55e589565680 2024-09-19T08:52:45.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.897+0000 7fd9e77fe640 1 -- 172.21.15.7:0/1068599577 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fda0004f030 con 0x55e589565680 2024-09-19T08:52:45.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.897+0000 7fda1064e740 10 client.17202 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:45.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.897+0000 7fda1064e740 10 client.17202 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:45.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.897+0000 7fda1064e740 20 client.17202 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:45.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.897+0000 7fda1064e740 1 --2- 172.21.15.7:0/1068599577 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e5895750c0 0x55e5895774f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:45.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.897+0000 7fda1064e740 4 client.17202 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:45.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.897+0000 7fda1064e740 1 -- 172.21.15.7:0/1068599577 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5894cd850 con 0x55e5895750c0 2024-09-19T08:52:45.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.897+0000 7fda07fff640 1 --2- 172.21.15.7:0/1068599577 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e5895750c0 0x55e5895774f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:45.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.897+0000 7fda07fff640 1 --2- 172.21.15.7:0/1068599577 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e5895750c0 0x55e5895774f0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16f608b509937c86 server_cookie=2fe2938ac8ff7b99 in_seq=0 out_seq=0 2024-09-19T08:52:45.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.897+0000 7fd9e77fe640 10 client.17202 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:45.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.898+0000 7fd9e77fe640 1 -- 172.21.15.7:0/1068599577 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e5894cd850 con 0x55e5895750c0 2024-09-19T08:52:45.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.898+0000 7fd9e77fe640 10 client.17202 handle_command_reply: tid=0 2024-09-19T08:52:45.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.898+0000 7fda1064e740 1 client.17202 shutdown 2024-09-19T08:52:45.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.898+0000 7fda1064e740 1 -- 172.21.15.7:0/1068599577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 msgr2=0x55e589562790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:45.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.898+0000 7fda1064e740 1 --2- 172.21.15.7:0/1068599577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e589562790 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fda00035000 tx=0x7fda0002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.898+0000 7fda1064e740 1 -- 172.21.15.7:0/1068599577 shutdown_connections 2024-09-19T08:52:45.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.898+0000 7fda1064e740 1 --2- 172.21.15.7:0/1068599577 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e5895750c0 0x55e5895774f0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.898+0000 7fda1064e740 1 --2- 172.21.15.7:0/1068599577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e589562790 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.898+0000 7fda1064e740 1 --2- 172.21.15.7:0/1068599577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e58955adc0 0x55e589562250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.898+0000 7fda1064e740 1 --2- 172.21.15.7:0/1068599577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e58955a4a0 0x55e589564fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.898+0000 7fd9e77fe640 0 client.17202 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:45.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.898+0000 7fda1064e740 1 -- 172.21.15.7:0/1068599577 >> 172.21.15.7:0/1068599577 conn(0x55e589556a30 msgr2=0x55e58955c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:45.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.898+0000 7fda1064e740 1 -- 172.21.15.7:0/1068599577 shutdown_connections 2024-09-19T08:52:45.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.898+0000 7fda1064e740 1 -- 172.21.15.7:0/1068599577 wait complete. 2024-09-19T08:52:45.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.899+0000 7fda1064e740 20 client.17202 trim_cache size 0 max 16384 2024-09-19T08:52:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.915+0000 7fda1064e740 1 Processor -- start 2024-09-19T08:52:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.915+0000 7fda1064e740 1 -- start start 2024-09-19T08:52:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.916+0000 7fda1064e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e58955a4a0 0x55e5895714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.916+0000 7fda1064e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e58955adc0 0x55e589560b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.916+0000 7fda1064e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e58957cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.916+0000 7fda1064e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fda081b2490 con 0x55e589565680 2024-09-19T08:52:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.916+0000 7fda1064e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fda081afd60 con 0x55e58955a4a0 2024-09-19T08:52:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.916+0000 7fda1064e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fda081adbd0 con 0x55e58955adc0 2024-09-19T08:52:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.916+0000 7fda0c812640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e58957cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.916+0000 7fda0c812640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e58957cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39678/0 (socket says 172.21.15.7:39678) 2024-09-19T08:52:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.916+0000 7fda0c812640 1 -- 172.21.15.7:0/2502571303 learned_addr learned my addr 172.21.15.7:0/2502571303 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.916+0000 7fda07fff640 1 --2- 172.21.15.7:0/2502571303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e58955a4a0 0x55e5895714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.916+0000 7fda0c812640 1 -- 172.21.15.7:0/2502571303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e58955adc0 msgr2=0x55e589560b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.916+0000 7fda077fe640 1 --2- 172.21.15.7:0/2502571303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e58955adc0 0x55e589560b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.916+0000 7fda0c812640 1 --2- 172.21.15.7:0/2502571303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e58955adc0 0x55e589560b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.916+0000 7fda0c812640 1 -- 172.21.15.7:0/2502571303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e58955a4a0 msgr2=0x55e5895714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.916+0000 7fda0c812640 1 --2- 172.21.15.7:0/2502571303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e58955a4a0 0x55e5895714e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.916+0000 7fda0c812640 1 -- 172.21.15.7:0/2502571303 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e589561200 con 0x55e589565680 2024-09-19T08:52:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.916+0000 7fda07fff640 1 --2- 172.21.15.7:0/2502571303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e58955a4a0 0x55e5895714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.916+0000 7fda0c812640 1 --2- 172.21.15.7:0/2502571303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e58957cdc0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fda00005e30 tx=0x7fda00031e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5562823c17571ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.917+0000 7fd9edffb640 1 -- 172.21.15.7:0/2502571303 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00055070 con 0x55e589565680 2024-09-19T08:52:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.917+0000 7fd9edffb640 1 -- 172.21.15.7:0/2502571303 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda00036040 con 0x55e589565680 2024-09-19T08:52:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.917+0000 7fd9edffb640 1 -- 172.21.15.7:0/2502571303 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00030ce0 con 0x55e589565680 2024-09-19T08:52:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.917+0000 7fda1064e740 1 -- 172.21.15.7:0/2502571303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 msgr2=0x55e58957cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.917+0000 7fda1064e740 1 --2- 172.21.15.7:0/2502571303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e58957cdc0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fda00005e30 tx=0x7fda00031e70 comp rx=0 tx=0).stop 2024-09-19T08:52:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.917+0000 7fda1064e740 1 -- 172.21.15.7:0/2502571303 shutdown_connections 2024-09-19T08:52:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.917+0000 7fda1064e740 1 --2- 172.21.15.7:0/2502571303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e58957cdc0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.917+0000 7fda1064e740 1 --2- 172.21.15.7:0/2502571303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e58955adc0 0x55e589560b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.917+0000 7fda1064e740 1 --2- 172.21.15.7:0/2502571303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e58955a4a0 0x55e5895714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.917+0000 7fda1064e740 1 -- 172.21.15.7:0/2502571303 >> 172.21.15.7:0/2502571303 conn(0x55e589556a30 msgr2=0x55e58955d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.917+0000 7fda1064e740 1 -- 172.21.15.7:0/2502571303 shutdown_connections 2024-09-19T08:52:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.917+0000 7fda1064e740 1 -- 172.21.15.7:0/2502571303 wait complete. 2024-09-19T08:52:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.918+0000 7fda1064e740 1 -- start start 2024-09-19T08:52:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.918+0000 7fda1064e740 1 Processor -- start 2024-09-19T08:52:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.918+0000 7fda1064e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e58955a4a0 0x55e5895696e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.918+0000 7fda1064e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e58955adc0 0x55e589569c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.918+0000 7fda1064e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e5895ded90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.918+0000 7fda1064e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fda081ae220 con 0x55e589565680 2024-09-19T08:52:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.918+0000 7fda1064e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fda081af690 con 0x55e58955a4a0 2024-09-19T08:52:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.918+0000 7fda1064e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fda081ae8f0 con 0x55e58955adc0 2024-09-19T08:52:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.918+0000 7fda1064e740 10 client.0 _ll_register_callbacks cb 0x7fda00031d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.918+0000 7fda0c812640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e5895ded90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.918+0000 7fda0c812640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e5895ded90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39690/0 (socket says 172.21.15.7:39690) 2024-09-19T08:52:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.918+0000 7fda0c812640 1 -- 172.21.15.7:0/3119312682 learned_addr learned my addr 172.21.15.7:0/3119312682 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:52:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.918+0000 7fda07fff640 1 --2- 172.21.15.7:0/3119312682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e58955a4a0 0x55e5895696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:45.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.918+0000 7fda077fe640 1 --2- 172.21.15.7:0/3119312682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e58955adc0 0x55e589569c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:45.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.919+0000 7fda0c812640 1 -- 172.21.15.7:0/3119312682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e58955adc0 msgr2=0x55e589569c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:45.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.919+0000 7fda0c812640 1 --2- 172.21.15.7:0/3119312682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e58955adc0 0x55e589569c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.919+0000 7fda0c812640 1 -- 172.21.15.7:0/3119312682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e58955a4a0 msgr2=0x55e5895696e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:45.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.919+0000 7fda0c812640 1 --2- 172.21.15.7:0/3119312682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e58955a4a0 0x55e5895696e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.919+0000 7fda0c812640 1 -- 172.21.15.7:0/3119312682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e58956a4b0 con 0x55e589565680 2024-09-19T08:52:45.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.919+0000 7fda077fe640 1 --2- 172.21.15.7:0/3119312682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e58955adc0 0x55e589569c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:45.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.919+0000 7fda0c812640 1 --2- 172.21.15.7:0/3119312682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e5895ded90 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fda0002ade0 tx=0x7fda00005cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52e8f7812e39de8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:45.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.919+0000 7fd9e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:52:45.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.919+0000 7fd9e77fe640 1 -- 172.21.15.7:0/3119312682 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00065070 con 0x55e589565680 2024-09-19T08:52:45.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.919+0000 7fd9e77fe640 1 -- 172.21.15.7:0/3119312682 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8585+0+0 (secure 0 0 0) 0x7fda000309b0 con 0x55e589565680 2024-09-19T08:52:45.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.919+0000 7fda1064e740 1 -- 172.21.15.7:0/3119312682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda00036040 con 0x55e589565680 2024-09-19T08:52:45.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.919+0000 7fd9e77fe640 1 -- 172.21.15.7:0/3119312682 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fda00055070 con 0x55e589565680 2024-09-19T08:52:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.919+0000 7fda1064e740 10 client.17208 fetch_fsmap learned FSMap version 25 2024-09-19T08:52:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.919+0000 7fda1064e740 1 -- 172.21.15.7:0/3119312682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e5895e03b0 con 0x55e589565680 2024-09-19T08:52:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.919+0000 7fd9e77fe640 1 -- 172.21.15.7:0/3119312682 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda00036040 con 0x55e589565680 2024-09-19T08:52:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.919+0000 7fd9e77fe640 1 -- 172.21.15.7:0/3119312682 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fda0004f040 con 0x55e589565680 2024-09-19T08:52:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.920+0000 7fda1064e740 10 client.17208 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:52:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.920+0000 7fda1064e740 10 client.17208 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.920+0000 7fda1064e740 20 client.17208 populate_metadata read hostname 'smithi007' 2024-09-19T08:52:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.920+0000 7fda1064e740 1 --2- 172.21.15.7:0/3119312682 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e5895e0880 0x55e5895e2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.920+0000 7fda1064e740 4 client.17208 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:52:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.920+0000 7fda1064e740 1 -- 172.21.15.7:0/3119312682 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e5894c7d60 con 0x55e5895e0880 2024-09-19T08:52:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.920+0000 7fda07fff640 1 --2- 172.21.15.7:0/3119312682 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e5895e0880 0x55e5895e2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.920+0000 7fda07fff640 1 --2- 172.21.15.7:0/3119312682 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e5895e0880 0x55e5895e2c70 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15ce965704a693e server_cookie=2f73c6ec764339d6 in_seq=0 out_seq=0 2024-09-19T08:52:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.920+0000 7fd9e77fe640 10 client.17208 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:45.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.920+0000 7fd9e77fe640 1 -- 172.21.15.7:0/3119312682 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e5894c7d60 con 0x55e5895e0880 2024-09-19T08:52:45.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.920+0000 7fd9e77fe640 10 client.17208 handle_command_reply: tid=0 2024-09-19T08:52:45.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.920+0000 7fda1064e740 1 client.17208 shutdown 2024-09-19T08:52:45.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.921+0000 7fda1064e740 1 -- 172.21.15.7:0/3119312682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 msgr2=0x55e5895ded90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:45.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.921+0000 7fda1064e740 1 --2- 172.21.15.7:0/3119312682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e5895ded90 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fda0002ade0 tx=0x7fda00005cf0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.921+0000 7fda1064e740 1 -- 172.21.15.7:0/3119312682 shutdown_connections 2024-09-19T08:52:45.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.921+0000 7fda1064e740 1 --2- 172.21.15.7:0/3119312682 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55e5895e0880 0x55e5895e2c70 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.921+0000 7fda1064e740 1 --2- 172.21.15.7:0/3119312682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e589565680 0x55e5895ded90 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.921+0000 7fda1064e740 1 --2- 172.21.15.7:0/3119312682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e58955adc0 0x55e589569c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.921+0000 7fda1064e740 1 --2- 172.21.15.7:0/3119312682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e58955a4a0 0x55e5895696e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.921+0000 7fd9e77fe640 0 client.17208 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:52:45.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.921+0000 7fda1064e740 1 -- 172.21.15.7:0/3119312682 >> 172.21.15.7:0/3119312682 conn(0x55e589556a30 msgr2=0x55e5895642d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:45.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.921+0000 7fda1064e740 1 -- 172.21.15.7:0/3119312682 shutdown_connections 2024-09-19T08:52:45.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.921+0000 7fda1064e740 1 -- 172.21.15.7:0/3119312682 wait complete. 2024-09-19T08:52:45.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.921+0000 7fda1064e740 20 client.17208 trim_cache size 0 max 16384 2024-09-19T08:52:45.927 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:52:45.927 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:52:45.927 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-19T08:52:45.927 INFO:teuthology.orchestra.run.smithi007.stdout: "226f7d3b-4294-41e9-904b-137e6ee6fec4": { 2024-09-19T08:52:45.927 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-19T08:52:45.927 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "226f7d3b-4294-41e9-904b-137e6ee6fec4", 2024-09-19T08:52:45.927 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-19T08:52:45.927 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:52:45.927 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:52:45.928 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:52:45.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.921+0000 7fda0e275640 1 -- 172.21.15.7:0/4102444803 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd9f00a33b0 msgr2=0x7fd9f00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:45.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.921+0000 7fda0e275640 1 --2- 172.21.15.7:0/4102444803 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd9f00a33b0 0x7fd9f00a5870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fda00004ab0 tx=0x7fda00004a40 comp rx=0 tx=0).stop 2024-09-19T08:52:45.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.921+0000 7fda0e275640 1 -- 172.21.15.7:0/4102444803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda08101400 msgr2=0x7fda08197620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:45.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.921+0000 7fda0e275640 1 --2- 172.21.15.7:0/4102444803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda08101400 0x7fda08197620 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00d950 tx=0x7fd9fc00de10 comp rx=0 tx=0).stop 2024-09-19T08:52:45.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.921+0000 7fda0e275640 1 -- 172.21.15.7:0/4102444803 shutdown_connections 2024-09-19T08:52:45.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.921+0000 7fda0e275640 1 --2- 172.21.15.7:0/4102444803 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd9f00a33b0 0x7fd9f00a5870 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.921+0000 7fda0e275640 1 --2- 172.21.15.7:0/4102444803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda08106a60 0x7fda08197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.921+0000 7fda0e275640 1 --2- 172.21.15.7:0/4102444803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda08101400 0x7fda08197620 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.922+0000 7fda0e275640 1 --2- 172.21.15.7:0/4102444803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda08100a60 0x7fda081970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:45.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.922+0000 7fda0e275640 1 -- 172.21.15.7:0/4102444803 >> 172.21.15.7:0/4102444803 conn(0x7fda080fc780 msgr2=0x7fda080fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:45.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.922+0000 7fda0e275640 1 -- 172.21.15.7:0/4102444803 shutdown_connections 2024-09-19T08:52:45.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:52:45.922+0000 7fda0e275640 1 -- 172.21.15.7:0/4102444803 wait complete. 2024-09-19T08:52:45.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:45 smithi175 ceph-mon[35688]: scrub queued for path: / 2024-09-19T08:52:45.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:45 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:45.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:45 smithi175 ceph-mon[35688]: scrub summary: active paths [/] 2024-09-19T08:52:45.930 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:45 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:46.728 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:46 smithi007 ceph-mon[31221]: pgmap v254: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:46.728 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:46 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:46.728 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:46 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:46.728 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:46 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:46.728 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:46 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:52:46.756 INFO:tasks.cephfs.filesystem:scrub status for tag:226f7d3b-4294-41e9-904b-137e6ee6fec4 - {'path': '/', 'tag': '226f7d3b-4294-41e9-904b-137e6ee6fec4', 'options': 'recursive,force'} 2024-09-19T08:52:46.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:46 smithi044 ceph-mon[35072]: pgmap v254: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:46 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:46 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:46 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:46.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:46 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:52:46.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:46 smithi175 ceph-mon[35688]: pgmap v254: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:46.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:46 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:46.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:46 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:46.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:46 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:46.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:46 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:52:48.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:48 smithi007 ceph-mon[31221]: pgmap v255: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T08:52:48.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:48 smithi044 ceph-mon[35072]: pgmap v255: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T08:52:48.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:48 smithi175 ceph-mon[35688]: pgmap v255: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T08:52:49.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:49 smithi007 ceph-mon[31221]: scrub summary: idle 2024-09-19T08:52:49.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:49 smithi044 ceph-mon[35072]: scrub summary: idle 2024-09-19T08:52:49.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:49 smithi175 ceph-mon[35688]: scrub summary: idle 2024-09-19T08:52:50.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:50 smithi007 ceph-mon[31221]: pgmap v256: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:50.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:50 smithi044 ceph-mon[35072]: pgmap v256: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:50.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:50 smithi175 ceph-mon[35688]: pgmap v256: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:52.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:52 smithi007 ceph-mon[31221]: pgmap v257: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:52.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:52 smithi044 ceph-mon[35072]: pgmap v257: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:52.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:52 smithi175 ceph-mon[35688]: pgmap v257: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:54.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:54 smithi007 ceph-mon[31221]: pgmap v258: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:52:54.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:54 smithi044 ceph-mon[35072]: pgmap v258: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:52:54.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:54 smithi175 ceph-mon[35688]: pgmap v258: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:52:56.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:56 smithi007 ceph-mon[31221]: pgmap v259: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:56.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:56 smithi044 ceph-mon[35072]: pgmap v259: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:56.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:56 smithi175 ceph-mon[35688]: pgmap v259: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:52:58.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:52:58 smithi007 ceph-mon[31221]: pgmap v260: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:52:58.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:52:58 smithi044 ceph-mon[35072]: pgmap v260: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:52:58.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:52:58 smithi175 ceph-mon[35688]: pgmap v260: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:53:00.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:00 smithi007 ceph-mon[31221]: pgmap v261: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:00.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:00 smithi044 ceph-mon[35072]: pgmap v261: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:00.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:00 smithi175 ceph-mon[35688]: pgmap v261: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:02.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:02 smithi007 ceph-mon[31221]: pgmap v262: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:02.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:02 smithi044 ceph-mon[35072]: pgmap v262: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:02.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:02 smithi175 ceph-mon[35688]: pgmap v262: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:04.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:04 smithi007 ceph-mon[31221]: pgmap v263: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:53:04.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:04 smithi044 ceph-mon[35072]: pgmap v263: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:53:04.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:04 smithi175 ceph-mon[35688]: pgmap v263: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:53:06.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:06 smithi007 ceph-mon[31221]: pgmap v264: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:53:06.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:06 smithi044 ceph-mon[35072]: pgmap v264: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:53:06.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:06 smithi175 ceph-mon[35688]: pgmap v264: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:53:08.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:08 smithi007 ceph-mon[31221]: pgmap v265: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:53:08.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:08 smithi044 ceph-mon[35072]: pgmap v265: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:53:08.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:08 smithi175 ceph-mon[35688]: pgmap v265: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:53:10.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:10 smithi044 ceph-mon[35072]: pgmap v266: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:53:10.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:10 smithi044 ceph-mon[35072]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T08:53:10.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:10 smithi175 ceph-mon[35688]: pgmap v266: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:53:10.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:10 smithi175 ceph-mon[35688]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T08:53:11.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:10 smithi007 ceph-mon[31221]: pgmap v266: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:53:11.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:10 smithi007 ceph-mon[31221]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T08:53:12.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:12 smithi044 ceph-mon[35072]: pgmap v268: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:53:12.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:12 smithi007 ceph-mon[31221]: pgmap v268: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:53:12.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:12 smithi175 ceph-mon[35688]: pgmap v268: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:53:14.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:14 smithi044 ceph-mon[35072]: pgmap v269: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:53:14.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:14 smithi175 ceph-mon[35688]: pgmap v269: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:53:15.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:14 smithi007 ceph-mon[31221]: pgmap v269: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:53:16.757 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:53:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:16 smithi044 ceph-mon[35072]: pgmap v270: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:53:16.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:16 smithi175 ceph-mon[35688]: pgmap v270: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:53:17.029 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:17.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:16 smithi007 ceph-mon[31221]: pgmap v270: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:53:17.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.507+0000 7fd23d83a640 1 -- 172.21.15.7:0/2834904256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd238101420 msgr2=0x7fd23810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:17.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.507+0000 7fd23d83a640 1 --2- 172.21.15.7:0/2834904256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd238101420 0x7fd23810d950 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fd230009cd0 tx=0x7fd23002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.507+0000 7fd23d83a640 1 -- 172.21.15.7:0/2834904256 shutdown_connections 2024-09-19T08:53:17.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.507+0000 7fd23d83a640 1 --2- 172.21.15.7:0/2834904256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd238101420 0x7fd23810d950 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.507+0000 7fd23d83a640 1 --2- 172.21.15.7:0/2834904256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd238100a80 0x7fd238100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.507+0000 7fd23d83a640 1 --2- 172.21.15.7:0/2834904256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd238106a80 0x7fd238106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.507+0000 7fd23d83a640 1 -- 172.21.15.7:0/2834904256 >> 172.21.15.7:0/2834904256 conn(0x7fd2380fc7a0 msgr2=0x7fd2380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:17.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.507+0000 7fd23d83a640 1 -- 172.21.15.7:0/2834904256 shutdown_connections 2024-09-19T08:53:17.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.507+0000 7fd23d83a640 1 -- 172.21.15.7:0/2834904256 wait complete. 2024-09-19T08:53:17.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.508+0000 7fd23d83a640 1 Processor -- start 2024-09-19T08:53:17.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.508+0000 7fd23d83a640 1 -- start start 2024-09-19T08:53:17.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.508+0000 7fd23d83a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd238100a80 0x7fd238198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.508+0000 7fd23d83a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd238101420 0x7fd238198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.508+0000 7fd23d83a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd238106a80 0x7fd23819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.508+0000 7fd23d83a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd238110e80 con 0x7fd238100a80 2024-09-19T08:53:17.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.508+0000 7fd23d83a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd238110d00 con 0x7fd238101420 2024-09-19T08:53:17.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.508+0000 7fd23d83a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd238111000 con 0x7fd238106a80 2024-09-19T08:53:17.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.508+0000 7fd236ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd238100a80 0x7fd238198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.508+0000 7fd236ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd238100a80 0x7fd238198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35128/0 (socket says 172.21.15.7:35128) 2024-09-19T08:53:17.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.508+0000 7fd236ffd640 1 -- 172.21.15.7:0/3130416354 learned_addr learned my addr 172.21.15.7:0/3130416354 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:17.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.509+0000 7fd22e7fc640 1 --2- 172.21.15.7:0/3130416354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd238101420 0x7fd238198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.509+0000 7fd2377fe640 1 --2- 172.21.15.7:0/3130416354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd238106a80 0x7fd23819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.509+0000 7fd236ffd640 1 -- 172.21.15.7:0/3130416354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd238106a80 msgr2=0x7fd23819ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:17.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.509+0000 7fd236ffd640 1 --2- 172.21.15.7:0/3130416354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd238106a80 0x7fd23819ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.509+0000 7fd236ffd640 1 -- 172.21.15.7:0/3130416354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd238101420 msgr2=0x7fd238198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:17.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.509+0000 7fd236ffd640 1 --2- 172.21.15.7:0/3130416354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd238101420 0x7fd238198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.509+0000 7fd236ffd640 1 -- 172.21.15.7:0/3130416354 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23819d3d0 con 0x7fd238100a80 2024-09-19T08:53:17.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.509+0000 7fd22e7fc640 1 --2- 172.21.15.7:0/3130416354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd238101420 0x7fd238198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:17.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.509+0000 7fd236ffd640 1 --2- 172.21.15.7:0/3130416354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd238100a80 0x7fd238198420 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fd22800c920 tx=0x7fd22800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:17.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.509+0000 7fd23c838640 1 -- 172.21.15.7:0/3130416354 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd228007c70 con 0x7fd238100a80 2024-09-19T08:53:17.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.509+0000 7fd23c838640 1 -- 172.21.15.7:0/3130416354 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd228007e10 con 0x7fd238100a80 2024-09-19T08:53:17.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.509+0000 7fd23d83a640 1 -- 172.21.15.7:0/3130416354 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd23819d6c0 con 0x7fd238100a80 2024-09-19T08:53:17.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.509+0000 7fd23c838640 1 -- 172.21.15.7:0/3130416354 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd228018890 con 0x7fd238100a80 2024-09-19T08:53:17.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.509+0000 7fd23d83a640 1 -- 172.21.15.7:0/3130416354 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2381a4fa0 con 0x7fd238100a80 2024-09-19T08:53:17.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.512+0000 7fd23c838640 1 -- 172.21.15.7:0/3130416354 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fd228018a70 con 0x7fd238100a80 2024-09-19T08:53:17.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.512+0000 7fd23fc13740 1 Processor -- start 2024-09-19T08:53:17.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.512+0000 7fd23fc13740 1 -- start start 2024-09-19T08:53:17.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.512+0000 7fd23fc13740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f09053a0 0x5633f0905780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.512+0000 7fd23fc13740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633f0905cc0 0x5633f0914550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.512+0000 7fd23fc13740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f0914a90 0x5633f0916e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.512+0000 7fd23fc13740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5633f086b2e0 con 0x5633f0914a90 2024-09-19T08:53:17.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.512+0000 7fd23fc13740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5633f0812ce0 con 0x5633f09053a0 2024-09-19T08:53:17.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.512+0000 7fd23fc13740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5633f08672a0 con 0x5633f0905cc0 2024-09-19T08:53:17.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.512+0000 7fd22e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f0914a90 0x5633f0916e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.512+0000 7fd22e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f0914a90 0x5633f0916e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35142/0 (socket says 172.21.15.7:35142) 2024-09-19T08:53:17.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.512+0000 7fd22e7fc640 1 -- 172.21.15.7:0/675038770 learned_addr learned my addr 172.21.15.7:0/675038770 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:17.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.512+0000 7fd2377fe640 1 --2- 172.21.15.7:0/675038770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f09053a0 0x5633f0905780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.512+0000 7fd236ffd640 1 --2- 172.21.15.7:0/675038770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633f0905cc0 0x5633f0914550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.513+0000 7fd23c838640 1 --2- 172.21.15.7:0/3130416354 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd2240a3430 0x7fd2240a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.513+0000 7fd22e7fc640 1 -- 172.21.15.7:0/675038770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633f0905cc0 msgr2=0x5633f0914550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:17.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.513+0000 7fd22e7fc640 1 --2- 172.21.15.7:0/675038770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633f0905cc0 0x5633f0914550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.513+0000 7fd22e7fc640 1 -- 172.21.15.7:0/675038770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f09053a0 msgr2=0x5633f0905780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:17.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.513+0000 7fd22e7fc640 1 --2- 172.21.15.7:0/675038770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f09053a0 0x5633f0905780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.513+0000 7fd22e7fc640 1 -- 172.21.15.7:0/675038770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633f07f7440 con 0x5633f0914a90 2024-09-19T08:53:17.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.513+0000 7fd2377fe640 1 --2- 172.21.15.7:0/675038770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f09053a0 0x5633f0905780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:17.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.513+0000 7fd2377fe640 1 --2- 172.21.15.7:0/3130416354 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd2240a3430 0x7fd2240a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.513+0000 7fd23c838640 1 -- 172.21.15.7:0/3130416354 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8629+0+0 (secure 0 0 0) 0x7fd2280cfe80 con 0x7fd238100a80 2024-09-19T08:53:17.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.513+0000 7fd22e7fc640 1 --2- 172.21.15.7:0/675038770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f0914a90 0x5633f0916e80 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fd220009c20 tx=0x7fd22000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583a730c69c60836 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:17.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.513+0000 7fd22dffb640 1 -- 172.21.15.7:0/675038770 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd220016070 con 0x5633f0914a90 2024-09-19T08:53:17.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.513+0000 7fd22dffb640 1 -- 172.21.15.7:0/675038770 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd220011950 con 0x5633f0914a90 2024-09-19T08:53:17.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.513+0000 7fd22dffb640 1 -- 172.21.15.7:0/675038770 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd220010810 con 0x5633f0914a90 2024-09-19T08:53:17.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.514+0000 7fd23fc13740 1 -- 172.21.15.7:0/675038770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f0914a90 msgr2=0x5633f0916e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:17.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.514+0000 7fd23fc13740 1 --2- 172.21.15.7:0/675038770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f0914a90 0x5633f0916e80 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fd220009c20 tx=0x7fd22000e6c0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.514+0000 7fd2377fe640 1 --2- 172.21.15.7:0/3130416354 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd2240a3430 0x7fd2240a58f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd230009430 tx=0x7fd23002a8e0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:17.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.514+0000 7fd23fc13740 1 -- 172.21.15.7:0/675038770 shutdown_connections 2024-09-19T08:53:17.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.514+0000 7fd23fc13740 1 --2- 172.21.15.7:0/675038770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f0914a90 0x5633f0916e80 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.514+0000 7fd23fc13740 1 --2- 172.21.15.7:0/675038770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633f0905cc0 0x5633f0914550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.514+0000 7fd23fc13740 1 --2- 172.21.15.7:0/675038770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f09053a0 0x5633f0905780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.514+0000 7fd23fc13740 1 -- 172.21.15.7:0/675038770 >> 172.21.15.7:0/675038770 conn(0x5633f0901a30 msgr2=0x5633f0901e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:17.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.514+0000 7fd23fc13740 1 -- 172.21.15.7:0/675038770 shutdown_connections 2024-09-19T08:53:17.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.514+0000 7fd23fc13740 1 -- 172.21.15.7:0/675038770 wait complete. 2024-09-19T08:53:17.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.514+0000 7fd23fc13740 1 -- start start 2024-09-19T08:53:17.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.515+0000 7fd23fc13740 1 Processor -- start 2024-09-19T08:53:17.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.515+0000 7fd23fc13740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f09053a0 0x5633f0914360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.515+0000 7fd23fc13740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f0905cc0 0x5633f0911610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.515+0000 7fd23fc13740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633f0914a90 0x5633f0911b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.515+0000 7fd23fc13740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5633f09176c0 con 0x5633f0905cc0 2024-09-19T08:53:17.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.515+0000 7fd23fc13740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5633f0826050 con 0x5633f09053a0 2024-09-19T08:53:17.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.515+0000 7fd23fc13740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5633f0917840 con 0x5633f0914a90 2024-09-19T08:53:17.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.515+0000 7fd23fc13740 10 client.0 _ll_register_callbacks cb 0x5633f0866160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:17.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.515+0000 7fd22e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f0905cc0 0x5633f0911610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.515+0000 7fd22e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f0905cc0 0x5633f0911610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35144/0 (socket says 172.21.15.7:35144) 2024-09-19T08:53:17.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.515+0000 7fd22e7fc640 1 -- 172.21.15.7:0/3841372123 learned_addr learned my addr 172.21.15.7:0/3841372123 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:17.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.515+0000 7fd236ffd640 1 --2- 172.21.15.7:0/3841372123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f09053a0 0x5633f0914360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.516+0000 7fd22e7fc640 1 -- 172.21.15.7:0/3841372123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633f0914a90 msgr2=0x5633f0911b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:17.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.516+0000 7fd22e7fc640 1 --2- 172.21.15.7:0/3841372123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633f0914a90 0x5633f0911b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.516+0000 7fd22e7fc640 1 -- 172.21.15.7:0/3841372123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f09053a0 msgr2=0x5633f0914360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:17.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.516+0000 7fd22e7fc640 1 --2- 172.21.15.7:0/3841372123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f09053a0 0x5633f0914360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.516+0000 7fd22e7fc640 1 -- 172.21.15.7:0/3841372123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633f05dc3c0 con 0x5633f0905cc0 2024-09-19T08:53:17.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.516+0000 7fd22e7fc640 1 --2- 172.21.15.7:0/3841372123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f0905cc0 0x5633f0911610 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fd220010410 tx=0x7fd2200118c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4cbf05b1f1669f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:17.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.516+0000 7fd216ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:53:17.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.516+0000 7fd216ffd640 1 -- 172.21.15.7:0/3841372123 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd220016050 con 0x5633f0905cc0 2024-09-19T08:53:17.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.516+0000 7fd216ffd640 1 -- 172.21.15.7:0/3841372123 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8629+0+0 (secure 0 0 0) 0x7fd220005040 con 0x5633f0905cc0 2024-09-19T08:53:17.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.516+0000 7fd23fc13740 1 -- 172.21.15.7:0/3841372123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd220011950 con 0x5633f0905cc0 2024-09-19T08:53:17.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.516+0000 7fd216ffd640 1 -- 172.21.15.7:0/3841372123 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd220030050 con 0x5633f0905cc0 2024-09-19T08:53:17.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.516+0000 7fd23fc13740 10 client.17220 fetch_fsmap learned FSMap version 25 2024-09-19T08:53:17.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.516+0000 7fd23fc13740 1 -- 172.21.15.7:0/3841372123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5633f0923050 con 0x5633f0905cc0 2024-09-19T08:53:17.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.516+0000 7fd216ffd640 1 -- 172.21.15.7:0/3841372123 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd220011950 con 0x5633f0905cc0 2024-09-19T08:53:17.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.516+0000 7fd216ffd640 1 -- 172.21.15.7:0/3841372123 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd22002b030 con 0x5633f0905cc0 2024-09-19T08:53:17.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.517+0000 7fd23fc13740 10 client.17220 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:53:17.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.517+0000 7fd23fc13740 10 client.17220 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:17.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.517+0000 7fd23fc13740 20 client.17220 populate_metadata read hostname 'smithi007' 2024-09-19T08:53:17.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.517+0000 7fd23fc13740 1 --2- 172.21.15.7:0/3841372123 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5633f09244b0 0x5633f09268a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.517+0000 7fd23fc13740 4 client.17220 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:53:17.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.517+0000 7fd23fc13740 1 -- 172.21.15.7:0/3841372123 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633f0878850 con 0x5633f09244b0 2024-09-19T08:53:17.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.517+0000 7fd236ffd640 1 --2- 172.21.15.7:0/3841372123 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5633f09244b0 0x5633f09268a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.517+0000 7fd236ffd640 1 --2- 172.21.15.7:0/3841372123 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5633f09244b0 0x5633f09268a0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44c12065b3689af6 server_cookie=6a6c9e1ad84f3a37 in_seq=0 out_seq=0 2024-09-19T08:53:17.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.517+0000 7fd216ffd640 10 client.17220 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:53:17.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.518+0000 7fd216ffd640 1 -- 172.21.15.7:0/3841372123 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5633f0878850 con 0x5633f09244b0 2024-09-19T08:53:17.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.518+0000 7fd216ffd640 10 client.17220 handle_command_reply: tid=0 2024-09-19T08:53:17.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.518+0000 7fd23fc13740 1 client.17220 shutdown 2024-09-19T08:53:17.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.518+0000 7fd23fc13740 1 -- 172.21.15.7:0/3841372123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f0905cc0 msgr2=0x5633f0911610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:17.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.518+0000 7fd23fc13740 1 --2- 172.21.15.7:0/3841372123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f0905cc0 0x5633f0911610 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fd220010410 tx=0x7fd2200118c0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.518+0000 7fd23fc13740 1 -- 172.21.15.7:0/3841372123 shutdown_connections 2024-09-19T08:53:17.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.518+0000 7fd23fc13740 1 --2- 172.21.15.7:0/3841372123 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5633f09244b0 0x5633f09268a0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.518+0000 7fd23fc13740 1 --2- 172.21.15.7:0/3841372123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633f0914a90 0x5633f0911b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.518+0000 7fd23fc13740 1 --2- 172.21.15.7:0/3841372123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f0905cc0 0x5633f0911610 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.518+0000 7fd23fc13740 1 --2- 172.21.15.7:0/3841372123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f09053a0 0x5633f0914360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.518+0000 7fd23fc13740 1 -- 172.21.15.7:0/3841372123 >> 172.21.15.7:0/3841372123 conn(0x5633f0901a30 msgr2=0x5633f0907790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:17.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.518+0000 7fd216ffd640 0 client.17220 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:53:17.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.518+0000 7fd23fc13740 1 -- 172.21.15.7:0/3841372123 shutdown_connections 2024-09-19T08:53:17.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.518+0000 7fd23fc13740 1 -- 172.21.15.7:0/3841372123 wait complete. 2024-09-19T08:53:17.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.518+0000 7fd23fc13740 20 client.17220 trim_cache size 0 max 16384 2024-09-19T08:53:17.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.536+0000 7fd23fc13740 1 Processor -- start 2024-09-19T08:53:17.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.536+0000 7fd23fc13740 1 -- start start 2024-09-19T08:53:17.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.536+0000 7fd23fc13740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f0901a30 0x5633f0920960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.536+0000 7fd23fc13740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633f09053a0 0x5633f090cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.536+0000 7fd23fc13740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f0905cc0 0x5633f0900a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.536+0000 7fd23fc13740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd2381ae020 con 0x5633f0901a30 2024-09-19T08:53:17.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.536+0000 7fd23fc13740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd2381ab8f0 con 0x5633f0905cc0 2024-09-19T08:53:17.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.536+0000 7fd23fc13740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd2381a9760 con 0x5633f09053a0 2024-09-19T08:53:17.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.536+0000 7fd236ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f0901a30 0x5633f0920960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.536+0000 7fd236ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f0901a30 0x5633f0920960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35160/0 (socket says 172.21.15.7:35160) 2024-09-19T08:53:17.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.536+0000 7fd236ffd640 1 -- 172.21.15.7:0/2966097013 learned_addr learned my addr 172.21.15.7:0/2966097013 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:17.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.536+0000 7fd2377fe640 1 --2- 172.21.15.7:0/2966097013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f0905cc0 0x5633f0900a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.536+0000 7fd22e7fc640 1 --2- 172.21.15.7:0/2966097013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633f09053a0 0x5633f090cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.536+0000 7fd236ffd640 1 -- 172.21.15.7:0/2966097013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633f09053a0 msgr2=0x5633f090cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:17.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.536+0000 7fd236ffd640 1 --2- 172.21.15.7:0/2966097013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633f09053a0 0x5633f090cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.536+0000 7fd236ffd640 1 -- 172.21.15.7:0/2966097013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f0905cc0 msgr2=0x5633f0900a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:17.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.536+0000 7fd236ffd640 1 --2- 172.21.15.7:0/2966097013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f0905cc0 0x5633f0900a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.536+0000 7fd236ffd640 1 -- 172.21.15.7:0/2966097013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633f0901860 con 0x5633f0901a30 2024-09-19T08:53:17.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.536+0000 7fd2377fe640 1 --2- 172.21.15.7:0/2966097013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f0905cc0 0x5633f0900a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:17.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.537+0000 7fd236ffd640 1 --2- 172.21.15.7:0/2966097013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f0901a30 0x5633f0920960 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fd228098ac0 tx=0x7fd2280d2390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff461822a8b0e30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:17.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.537+0000 7fd22d7fa640 1 -- 172.21.15.7:0/2966097013 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22809c0f0 con 0x5633f0901a30 2024-09-19T08:53:17.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.537+0000 7fd22d7fa640 1 -- 172.21.15.7:0/2966097013 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2280a04a0 con 0x5633f0901a30 2024-09-19T08:53:17.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.537+0000 7fd22d7fa640 1 -- 172.21.15.7:0/2966097013 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2280bc0b0 con 0x5633f0901a30 2024-09-19T08:53:17.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.537+0000 7fd23fc13740 1 -- 172.21.15.7:0/2966097013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f0901a30 msgr2=0x5633f0920960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:17.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.537+0000 7fd23fc13740 1 --2- 172.21.15.7:0/2966097013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f0901a30 0x5633f0920960 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fd228098ac0 tx=0x7fd2280d2390 comp rx=0 tx=0).stop 2024-09-19T08:53:17.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.537+0000 7fd23fc13740 1 -- 172.21.15.7:0/2966097013 shutdown_connections 2024-09-19T08:53:17.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.537+0000 7fd23fc13740 1 --2- 172.21.15.7:0/2966097013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f0905cc0 0x5633f0900a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.537+0000 7fd23fc13740 1 --2- 172.21.15.7:0/2966097013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633f09053a0 0x5633f090cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.537+0000 7fd23fc13740 1 --2- 172.21.15.7:0/2966097013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f0901a30 0x5633f0920960 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.537+0000 7fd23fc13740 1 -- 172.21.15.7:0/2966097013 >> 172.21.15.7:0/2966097013 conn(0x5633f0926ba0 msgr2=0x5633f0900350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:17.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.537+0000 7fd23fc13740 1 -- 172.21.15.7:0/2966097013 shutdown_connections 2024-09-19T08:53:17.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.538+0000 7fd23fc13740 1 -- 172.21.15.7:0/2966097013 wait complete. 2024-09-19T08:53:17.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.538+0000 7fd23fc13740 1 -- start start 2024-09-19T08:53:17.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.538+0000 7fd23fc13740 1 Processor -- start 2024-09-19T08:53:17.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.538+0000 7fd23fc13740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f0901a30 0x5633f091d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.538+0000 7fd23fc13740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f09053a0 0x5633f0918490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.538+0000 7fd23fc13740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633f0905cc0 0x5633f09189d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.538+0000 7fd23fc13740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd2381a9db0 con 0x5633f09053a0 2024-09-19T08:53:17.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.538+0000 7fd23fc13740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd2381ab220 con 0x5633f0901a30 2024-09-19T08:53:17.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.538+0000 7fd23fc13740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd2381aa480 con 0x5633f0905cc0 2024-09-19T08:53:17.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.538+0000 7fd23fc13740 10 client.0 _ll_register_callbacks cb 0x7fd230009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:17.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.539+0000 7fd22e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f09053a0 0x5633f0918490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.539+0000 7fd22e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f09053a0 0x5633f0918490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35176/0 (socket says 172.21.15.7:35176) 2024-09-19T08:53:17.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.539+0000 7fd22e7fc640 1 -- 172.21.15.7:0/1963219391 learned_addr learned my addr 172.21.15.7:0/1963219391 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:17.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.539+0000 7fd2377fe640 1 --2- 172.21.15.7:0/1963219391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633f0905cc0 0x5633f09189d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.539+0000 7fd236ffd640 1 --2- 172.21.15.7:0/1963219391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f0901a30 0x5633f091d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.539+0000 7fd22e7fc640 1 -- 172.21.15.7:0/1963219391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633f0905cc0 msgr2=0x5633f09189d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:17.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.539+0000 7fd22e7fc640 1 --2- 172.21.15.7:0/1963219391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633f0905cc0 0x5633f09189d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.539+0000 7fd22e7fc640 1 -- 172.21.15.7:0/1963219391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f0901a30 msgr2=0x5633f091d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:17.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.539+0000 7fd22e7fc640 1 --2- 172.21.15.7:0/1963219391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f0901a30 0x5633f091d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.539+0000 7fd22e7fc640 1 -- 172.21.15.7:0/1963219391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633f09191b0 con 0x5633f09053a0 2024-09-19T08:53:17.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.539+0000 7fd236ffd640 1 --2- 172.21.15.7:0/1963219391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f0901a30 0x5633f091d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:17.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.539+0000 7fd22e7fc640 1 --2- 172.21.15.7:0/1963219391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f09053a0 0x5633f0918490 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fd220004d10 tx=0x7fd220009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4395f54d4608191 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:17.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.539+0000 7fd216ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:53:17.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.539+0000 7fd216ffd640 1 -- 172.21.15.7:0/1963219391 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd220038020 con 0x5633f09053a0 2024-09-19T08:53:17.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.539+0000 7fd216ffd640 1 -- 172.21.15.7:0/1963219391 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8629+0+0 (secure 0 0 0) 0x7fd220004820 con 0x5633f09053a0 2024-09-19T08:53:17.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.539+0000 7fd23fc13740 1 -- 172.21.15.7:0/1963219391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2280a04a0 con 0x5633f09053a0 2024-09-19T08:53:17.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.539+0000 7fd216ffd640 1 -- 172.21.15.7:0/1963219391 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd220040050 con 0x5633f09053a0 2024-09-19T08:53:17.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.539+0000 7fd23fc13740 10 client.17226 fetch_fsmap learned FSMap version 25 2024-09-19T08:53:17.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.539+0000 7fd23fc13740 1 -- 172.21.15.7:0/1963219391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5633f098ee80 con 0x5633f09053a0 2024-09-19T08:53:17.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.540+0000 7fd216ffd640 1 -- 172.21.15.7:0/1963219391 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2280a04a0 con 0x5633f09053a0 2024-09-19T08:53:17.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.540+0000 7fd216ffd640 1 -- 172.21.15.7:0/1963219391 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd22002b040 con 0x5633f09053a0 2024-09-19T08:53:17.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.540+0000 7fd23fc13740 10 client.17226 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:53:17.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.540+0000 7fd23fc13740 10 client.17226 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:17.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.540+0000 7fd23fc13740 20 client.17226 populate_metadata read hostname 'smithi007' 2024-09-19T08:53:17.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.540+0000 7fd23fc13740 1 --2- 172.21.15.7:0/1963219391 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5633f0914a90 0x5633f0991600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.540+0000 7fd23fc13740 4 client.17226 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:53:17.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.540+0000 7fd23fc13740 1 -- 172.21.15.7:0/1963219391 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5633f0911ee0 con 0x5633f0914a90 2024-09-19T08:53:17.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.540+0000 7fd236ffd640 1 --2- 172.21.15.7:0/1963219391 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5633f0914a90 0x5633f0991600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.541+0000 7fd216ffd640 10 client.17226 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:53:17.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.541+0000 7fd236ffd640 1 --2- 172.21.15.7:0/1963219391 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5633f0914a90 0x5633f0991600 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9715d5b7d8e908a server_cookie=97ce869410930a0a in_seq=0 out_seq=0 2024-09-19T08:53:17.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.541+0000 7fd216ffd640 1 -- 172.21.15.7:0/1963219391 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5633f0911ee0 con 0x5633f0914a90 2024-09-19T08:53:17.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.541+0000 7fd216ffd640 10 client.17226 handle_command_reply: tid=0 2024-09-19T08:53:17.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.541+0000 7fd23fc13740 1 client.17226 shutdown 2024-09-19T08:53:17.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.541+0000 7fd23fc13740 1 -- 172.21.15.7:0/1963219391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f09053a0 msgr2=0x5633f0918490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:17.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.541+0000 7fd23fc13740 1 --2- 172.21.15.7:0/1963219391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f09053a0 0x5633f0918490 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fd220004d10 tx=0x7fd220009f20 comp rx=0 tx=0).stop 2024-09-19T08:53:17.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.541+0000 7fd23fc13740 1 -- 172.21.15.7:0/1963219391 shutdown_connections 2024-09-19T08:53:17.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.541+0000 7fd23fc13740 1 --2- 172.21.15.7:0/1963219391 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5633f0914a90 0x5633f0991600 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.541+0000 7fd23fc13740 1 --2- 172.21.15.7:0/1963219391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633f0905cc0 0x5633f09189d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.541+0000 7fd23fc13740 1 --2- 172.21.15.7:0/1963219391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633f09053a0 0x5633f0918490 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.541+0000 7fd23fc13740 1 --2- 172.21.15.7:0/1963219391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633f0901a30 0x5633f091d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.541+0000 7fd23fc13740 1 -- 172.21.15.7:0/1963219391 >> 172.21.15.7:0/1963219391 conn(0x5633f0926ba0 msgr2=0x5633f090cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:17.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.541+0000 7fd216ffd640 0 client.17226 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:53:17.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.541+0000 7fd23fc13740 1 -- 172.21.15.7:0/1963219391 shutdown_connections 2024-09-19T08:53:17.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.541+0000 7fd23fc13740 1 -- 172.21.15.7:0/1963219391 wait complete. 2024-09-19T08:53:17.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.541+0000 7fd23fc13740 20 client.17226 trim_cache size 0 max 16384 2024-09-19T08:53:17.548 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:53:17.548 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-19T08:53:17.549 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-09-19T08:53:17.549 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:53:17.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.542+0000 7fd23d83a640 1 -- 172.21.15.7:0/3130416354 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd2240a3430 msgr2=0x7fd2240a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:17.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.542+0000 7fd23d83a640 1 --2- 172.21.15.7:0/3130416354 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd2240a3430 0x7fd2240a58f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd230009430 tx=0x7fd23002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.542+0000 7fd23d83a640 1 -- 172.21.15.7:0/3130416354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd238100a80 msgr2=0x7fd238198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:17.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.542+0000 7fd23d83a640 1 --2- 172.21.15.7:0/3130416354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd238100a80 0x7fd238198420 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fd22800c920 tx=0x7fd22800cde0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.542+0000 7fd23d83a640 1 -- 172.21.15.7:0/3130416354 shutdown_connections 2024-09-19T08:53:17.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.542+0000 7fd23d83a640 1 --2- 172.21.15.7:0/3130416354 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd2240a3430 0x7fd2240a58f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.542+0000 7fd23d83a640 1 --2- 172.21.15.7:0/3130416354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd238106a80 0x7fd23819ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.542+0000 7fd23d83a640 1 --2- 172.21.15.7:0/3130416354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd238101420 0x7fd238198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.542+0000 7fd23d83a640 1 --2- 172.21.15.7:0/3130416354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd238100a80 0x7fd238198420 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.542+0000 7fd23d83a640 1 -- 172.21.15.7:0/3130416354 >> 172.21.15.7:0/3130416354 conn(0x7fd2380fc7a0 msgr2=0x7fd23806a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:17.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.542+0000 7fd23d83a640 1 -- 172.21.15.7:0/3130416354 shutdown_connections 2024-09-19T08:53:17.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:17.542+0000 7fd23d83a640 1 -- 172.21.15.7:0/3130416354 wait complete. 2024-09-19T08:53:18.510 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:53:18.511 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:53:18.776 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:18.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:18 smithi007 ceph-mon[31221]: pgmap v271: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:53:18.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:18 smithi007 ceph-mon[31221]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T08:53:18.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:18 smithi044 ceph-mon[35072]: pgmap v271: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:53:18.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:18 smithi044 ceph-mon[35072]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T08:53:18.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:18 smithi175 ceph-mon[35688]: pgmap v271: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:53:18.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:18 smithi175 ceph-mon[35688]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T08:53:19.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.220+0000 7f6b3df60640 1 -- 172.21.15.7:0/3674239904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b38101de0 msgr2=0x7f6b381021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:19.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.220+0000 7f6b3df60640 1 --2- 172.21.15.7:0/3674239904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b38101de0 0x7f6b381021c0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f6b28009900 tx=0x7f6b2802a410 comp rx=0 tx=0).stop 2024-09-19T08:53:19.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.221+0000 7f6b3df60640 1 -- 172.21.15.7:0/3674239904 shutdown_connections 2024-09-19T08:53:19.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.221+0000 7f6b3df60640 1 --2- 172.21.15.7:0/3674239904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b38106f10 0x7f6b3810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:19.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.221+0000 7f6b3df60640 1 --2- 172.21.15.7:0/3674239904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b38102790 0x7f6b381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:19.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.221+0000 7f6b3df60640 1 --2- 172.21.15.7:0/3674239904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b38101de0 0x7f6b381021c0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:19.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.221+0000 7f6b3df60640 1 -- 172.21.15.7:0/3674239904 >> 172.21.15.7:0/3674239904 conn(0x7f6b380fd8c0 msgr2=0x7f6b380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:19.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.221+0000 7f6b3df60640 1 -- 172.21.15.7:0/3674239904 shutdown_connections 2024-09-19T08:53:19.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.221+0000 7f6b3df60640 1 -- 172.21.15.7:0/3674239904 wait complete. 2024-09-19T08:53:19.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.221+0000 7f6b3df60640 1 Processor -- start 2024-09-19T08:53:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.221+0000 7f6b3df60640 1 -- start start 2024-09-19T08:53:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b3df60640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b38101de0 0x7f6b381a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b3df60640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b38102790 0x7f6b381a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b3df60640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b38106f10 0x7f6b3819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b3df60640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6b38112010 con 0x7f6b38101de0 2024-09-19T08:53:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b3df60640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6b38111e90 con 0x7f6b38102790 2024-09-19T08:53:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b3df60640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6b38112190 con 0x7f6b38106f10 2024-09-19T08:53:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b377fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b38101de0 0x7f6b381a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b377fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b38101de0 0x7f6b381a0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35196/0 (socket says 172.21.15.7:35196) 2024-09-19T08:53:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b377fe640 1 -- 172.21.15.7:0/4236034577 learned_addr learned my addr 172.21.15.7:0/4236034577 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b2effd640 1 --2- 172.21.15.7:0/4236034577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b38102790 0x7f6b381a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b37fff640 1 --2- 172.21.15.7:0/4236034577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b38106f10 0x7f6b3819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b377fe640 1 -- 172.21.15.7:0/4236034577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b38106f10 msgr2=0x7f6b3819a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b377fe640 1 --2- 172.21.15.7:0/4236034577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b38106f10 0x7f6b3819a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b377fe640 1 -- 172.21.15.7:0/4236034577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b38102790 msgr2=0x7f6b381a0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b377fe640 1 --2- 172.21.15.7:0/4236034577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b38102790 0x7f6b381a0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b377fe640 1 -- 172.21.15.7:0/4236034577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b3819ad10 con 0x7f6b38101de0 2024-09-19T08:53:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b2effd640 1 --2- 172.21.15.7:0/4236034577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b38102790 0x7f6b381a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b37fff640 1 --2- 172.21.15.7:0/4236034577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b38106f10 0x7f6b3819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b377fe640 1 --2- 172.21.15.7:0/4236034577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b38101de0 0x7f6b381a0420 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f6b28005ab0 tx=0x7f6b280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b357fa640 1 -- 172.21.15.7:0/4236034577 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2803f030 con 0x7f6b38101de0 2024-09-19T08:53:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b3df60640 1 -- 172.21.15.7:0/4236034577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b3819afa0 con 0x7f6b38101de0 2024-09-19T08:53:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b357fa640 1 -- 172.21.15.7:0/4236034577 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b28003ce0 con 0x7f6b38101de0 2024-09-19T08:53:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.222+0000 7f6b357fa640 1 -- 172.21.15.7:0/4236034577 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b28035070 con 0x7f6b38101de0 2024-09-19T08:53:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.223+0000 7f6b3df60640 1 -- 172.21.15.7:0/4236034577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b381a72f0 con 0x7f6b38101de0 2024-09-19T08:53:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.223+0000 7f6b3df60640 1 -- 172.21.15.7:0/4236034577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b38102240 con 0x7f6b38101de0 2024-09-19T08:53:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.225+0000 7f6b357fa640 1 -- 172.21.15.7:0/4236034577 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f6b28042030 con 0x7f6b38101de0 2024-09-19T08:53:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.226+0000 7f6b357fa640 1 --2- 172.21.15.7:0/4236034577 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6b240a33b0 0x7f6b240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.226+0000 7f6b2effd640 1 --2- 172.21.15.7:0/4236034577 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6b240a33b0 0x7f6b240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.226+0000 7f6b357fa640 1 -- 172.21.15.7:0/4236034577 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7f6b280f09e0 con 0x7f6b38101de0 2024-09-19T08:53:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.227+0000 7f6b2effd640 1 --2- 172.21.15.7:0/4236034577 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6b240a33b0 0x7f6b240a5870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6b20006fd0 tx=0x7f6b20008040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.229+0000 7f6b357fa640 1 -- 172.21.15.7:0/4236034577 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6b280bd320 con 0x7f6b38101de0 2024-09-19T08:53:19.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.444+0000 7f6b3df60640 1 -- 172.21.15.7:0/4236034577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b381a74c0 con 0x7f6b38101de0 2024-09-19T08:53:19.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.445+0000 7f6b357fa640 1 -- 172.21.15.7:0/4236034577 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f6b280bcc20 con 0x7f6b38101de0 2024-09-19T08:53:19.446 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:53:19.446 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:53:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:53:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.447+0000 7f6b3df60640 1 -- 172.21.15.7:0/4236034577 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6b240a33b0 msgr2=0x7f6b240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.447+0000 7f6b3df60640 1 --2- 172.21.15.7:0/4236034577 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6b240a33b0 0x7f6b240a5870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6b20006fd0 tx=0x7f6b20008040 comp rx=0 tx=0).stop 2024-09-19T08:53:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.447+0000 7f6b3df60640 1 -- 172.21.15.7:0/4236034577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b38101de0 msgr2=0x7f6b381a0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.447+0000 7f6b3df60640 1 --2- 172.21.15.7:0/4236034577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b38101de0 0x7f6b381a0420 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f6b28005ab0 tx=0x7f6b280042f0 comp rx=0 tx=0).stop 2024-09-19T08:53:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.447+0000 7f6b3df60640 1 -- 172.21.15.7:0/4236034577 shutdown_connections 2024-09-19T08:53:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.447+0000 7f6b3df60640 1 --2- 172.21.15.7:0/4236034577 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6b240a33b0 0x7f6b240a5870 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.447+0000 7f6b3df60640 1 --2- 172.21.15.7:0/4236034577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b38106f10 0x7f6b3819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.447+0000 7f6b3df60640 1 --2- 172.21.15.7:0/4236034577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b38102790 0x7f6b381a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:19.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.447+0000 7f6b3df60640 1 --2- 172.21.15.7:0/4236034577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b38101de0 0x7f6b381a0420 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:19.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.447+0000 7f6b3df60640 1 -- 172.21.15.7:0/4236034577 >> 172.21.15.7:0/4236034577 conn(0x7f6b380fd8c0 msgr2=0x7f6b380fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:19.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.448+0000 7f6b3df60640 1 -- 172.21.15.7:0/4236034577 shutdown_connections 2024-09-19T08:53:19.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:19.448+0000 7f6b3df60640 1 -- 172.21.15.7:0/4236034577 wait complete. 2024-09-19T08:53:19.750 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:19 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/4236034577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:19.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:19 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/4236034577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:20.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:19 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/4236034577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:20.188 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:53:20.444 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:20.821 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:20 smithi007 ceph-mon[31221]: pgmap v273: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 209 B/s wr, 6 op/s 2024-09-19T08:53:20.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.904+0000 7f014cfa3640 1 -- 172.21.15.7:0/743406198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01481082a0 msgr2=0x7f014810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:20.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.904+0000 7f014cfa3640 1 --2- 172.21.15.7:0/743406198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01481082a0 0x7f014810ec40 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f0138009cd0 tx=0x7f013802a8f0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.904+0000 7f014cfa3640 1 -- 172.21.15.7:0/743406198 shutdown_connections 2024-09-19T08:53:20.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.904+0000 7f014cfa3640 1 --2- 172.21.15.7:0/743406198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01481082a0 0x7f014810ec40 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.904+0000 7f014cfa3640 1 --2- 172.21.15.7:0/743406198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01481036e0 0x7f0148107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.904+0000 7f014cfa3640 1 --2- 172.21.15.7:0/743406198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0148102d30 0x7f0148103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.904+0000 7f014cfa3640 1 -- 172.21.15.7:0/743406198 >> 172.21.15.7:0/743406198 conn(0x7f01480fc7d0 msgr2=0x7f01480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:20.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.904+0000 7f014cfa3640 1 -- 172.21.15.7:0/743406198 shutdown_connections 2024-09-19T08:53:20.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.904+0000 7f014cfa3640 1 -- 172.21.15.7:0/743406198 wait complete. 2024-09-19T08:53:20.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.905+0000 7f014cfa3640 1 Processor -- start 2024-09-19T08:53:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.905+0000 7f014cfa3640 1 -- start start 2024-09-19T08:53:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.905+0000 7f014cfa3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0148102d30 0x7f0148198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.905+0000 7f014cfa3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01481036e0 0x7f0148198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.905+0000 7f014cfa3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01481082a0 0x7f014819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.905+0000 7f014cfa3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f01481120a0 con 0x7f01481082a0 2024-09-19T08:53:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.905+0000 7f014cfa3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0148111f20 con 0x7f0148102d30 2024-09-19T08:53:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.905+0000 7f014cfa3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0148112220 con 0x7f01481036e0 2024-09-19T08:53:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.905+0000 7f0146d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01481082a0 0x7f014819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.905+0000 7f014659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0148102d30 0x7f0148198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.905+0000 7f0146d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01481082a0 0x7f014819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35208/0 (socket says 172.21.15.7:35208) 2024-09-19T08:53:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.905+0000 7f0146d9d640 1 -- 172.21.15.7:0/3974513010 learned_addr learned my addr 172.21.15.7:0/3974513010 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.905+0000 7f0145d9b640 1 --2- 172.21.15.7:0/3974513010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01481036e0 0x7f0148198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.905+0000 7f0146d9d640 1 -- 172.21.15.7:0/3974513010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01481036e0 msgr2=0x7f0148198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.905+0000 7f0146d9d640 1 --2- 172.21.15.7:0/3974513010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01481036e0 0x7f0148198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.905+0000 7f0146d9d640 1 -- 172.21.15.7:0/3974513010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0148102d30 msgr2=0x7f0148198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.905+0000 7f0146d9d640 1 --2- 172.21.15.7:0/3974513010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0148102d30 0x7f0148198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.905+0000 7f0146d9d640 1 -- 172.21.15.7:0/3974513010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f014819d3f0 con 0x7f01481082a0 2024-09-19T08:53:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.906+0000 7f0146d9d640 1 --2- 172.21.15.7:0/3974513010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01481082a0 0x7f014819cd10 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f0138009ca0 tx=0x7f01380039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.906+0000 7f013f7fe640 1 -- 172.21.15.7:0/3974513010 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0138004040 con 0x7f01481082a0 2024-09-19T08:53:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.906+0000 7f013f7fe640 1 -- 172.21.15.7:0/3974513010 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0138040070 con 0x7f01481082a0 2024-09-19T08:53:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.906+0000 7f014cfa3640 1 -- 172.21.15.7:0/3974513010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f014819d680 con 0x7f01481082a0 2024-09-19T08:53:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.906+0000 7f013f7fe640 1 -- 172.21.15.7:0/3974513010 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0138045cd0 con 0x7f01481082a0 2024-09-19T08:53:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.906+0000 7f014cfa3640 1 -- 172.21.15.7:0/3974513010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01481a4fc0 con 0x7f01481082a0 2024-09-19T08:53:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.909+0000 7f013f7fe640 1 -- 172.21.15.7:0/3974513010 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f01380041e0 con 0x7f01481082a0 2024-09-19T08:53:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.909+0000 7f014f37c740 1 Processor -- start 2024-09-19T08:53:20.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.909+0000 7f014f37c740 1 -- start start 2024-09-19T08:53:20.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.910+0000 7f014f37c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614df4c6b40 0x5614df4c5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:20.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.910+0000 7f014f37c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614df4c55d0 0x5614df4c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:20.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.910+0000 7f014f37c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4d4780 0x5614df4d6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:20.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.910+0000 7f014f37c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5614df42b2f0 con 0x5614df4d4780 2024-09-19T08:53:20.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.910+0000 7f014f37c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5614df3d2cf0 con 0x5614df4c6b40 2024-09-19T08:53:20.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.910+0000 7f014f37c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5614df4272b0 con 0x5614df4c55d0 2024-09-19T08:53:20.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.910+0000 7f0145d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4d4780 0x5614df4d6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:20.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.910+0000 7f0145d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4d4780 0x5614df4d6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35214/0 (socket says 172.21.15.7:35214) 2024-09-19T08:53:20.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.910+0000 7f0145d9b640 1 -- 172.21.15.7:0/3397681234 learned_addr learned my addr 172.21.15.7:0/3397681234 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:20.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.910+0000 7f013f7fe640 1 --2- 172.21.15.7:0/3974513010 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f01340a33b0 0x7f01340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:20.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.910+0000 7f014659c640 1 --2- 172.21.15.7:0/3397681234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614df4c55d0 0x5614df4c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:20.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.910+0000 7f0145d9b640 1 --2- 172.21.15.7:0/3397681234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614df4c6b40 0x5614df4c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:20.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.910+0000 7f0146d9d640 1 --2- 172.21.15.7:0/3974513010 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f01340a33b0 0x7f01340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:20.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.910+0000 7f0145d9b640 1 -- 172.21.15.7:0/3397681234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614df4c55d0 msgr2=0x5614df4c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:20.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.910+0000 7f0145d9b640 1 --2- 172.21.15.7:0/3397681234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614df4c55d0 0x5614df4c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.910+0000 7f0145d9b640 1 -- 172.21.15.7:0/3397681234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614df4c6b40 msgr2=0x5614df4c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:20.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.910+0000 7f013f7fe640 1 -- 172.21.15.7:0/3974513010 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7f01380f1120 con 0x7f01481082a0 2024-09-19T08:53:20.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.910+0000 7f0145d9b640 1 --2- 172.21.15.7:0/3397681234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614df4c6b40 0x5614df4c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.910+0000 7f0145d9b640 1 -- 172.21.15.7:0/3397681234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614df3b73a0 con 0x5614df4d4780 2024-09-19T08:53:20.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.910+0000 7f0145d9b640 1 --2- 172.21.15.7:0/3397681234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4d4780 0x5614df4d6b70 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f013000a5c0 tx=0x7f013000a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b5def455ab022e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:20.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.911+0000 7f013cff9640 1 -- 172.21.15.7:0/3397681234 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013000f890 con 0x5614df4d4780 2024-09-19T08:53:20.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.911+0000 7f0146d9d640 1 --2- 172.21.15.7:0/3974513010 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f01340a33b0 0x7f01340a5870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f01380bd170 tx=0x7f0138088310 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.911+0000 7f013cff9640 1 -- 172.21.15.7:0/3397681234 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f013001d440 con 0x5614df4d4780 2024-09-19T08:53:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.911+0000 7f013cff9640 1 -- 172.21.15.7:0/3397681234 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013001b5a0 con 0x5614df4d4780 2024-09-19T08:53:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.911+0000 7f014f37c740 1 -- 172.21.15.7:0/3397681234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4d4780 msgr2=0x5614df4d6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.911+0000 7f014f37c740 1 --2- 172.21.15.7:0/3397681234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4d4780 0x5614df4d6b70 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f013000a5c0 tx=0x7f013000a730 comp rx=0 tx=0).stop 2024-09-19T08:53:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.911+0000 7f014f37c740 1 -- 172.21.15.7:0/3397681234 shutdown_connections 2024-09-19T08:53:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.911+0000 7f014f37c740 1 --2- 172.21.15.7:0/3397681234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4d4780 0x5614df4d6b70 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.911+0000 7f014f37c740 1 --2- 172.21.15.7:0/3397681234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614df4c55d0 0x5614df4c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.911+0000 7f014f37c740 1 --2- 172.21.15.7:0/3397681234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614df4c6b40 0x5614df4c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.911+0000 7f014f37c740 1 -- 172.21.15.7:0/3397681234 >> 172.21.15.7:0/3397681234 conn(0x5614df48e310 msgr2=0x5614df4c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.912+0000 7f014f37c740 1 -- 172.21.15.7:0/3397681234 shutdown_connections 2024-09-19T08:53:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.912+0000 7f014f37c740 1 -- 172.21.15.7:0/3397681234 wait complete. 2024-09-19T08:53:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.912+0000 7f014f37c740 1 -- start start 2024-09-19T08:53:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.912+0000 7f014f37c740 1 Processor -- start 2024-09-19T08:53:20.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.912+0000 7f014f37c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614df4c55d0 0x5614df4d41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:20.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.912+0000 7f014f37c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614df4c6b40 0x5614df4d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:20.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.912+0000 7f014f37c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4d4780 0x5614df4d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:20.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.912+0000 7f014f37c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5614df4d7480 con 0x5614df4d4780 2024-09-19T08:53:20.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.912+0000 7f014f37c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5614df3e6060 con 0x5614df4c6b40 2024-09-19T08:53:20.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.912+0000 7f014f37c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5614df4d7600 con 0x5614df4c55d0 2024-09-19T08:53:20.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.912+0000 7f014f37c740 10 client.0 _ll_register_callbacks cb 0x5614df1398c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:20.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.912+0000 7f0145d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4d4780 0x5614df4d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:20.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.912+0000 7f0145d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4d4780 0x5614df4d1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35226/0 (socket says 172.21.15.7:35226) 2024-09-19T08:53:20.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.912+0000 7f0145d9b640 1 -- 172.21.15.7:0/3098610455 learned_addr learned my addr 172.21.15.7:0/3098610455 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:20.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.913+0000 7f0145d9b640 1 --2- 172.21.15.7:0/3098610455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614df4c55d0 0x5614df4d41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:20.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.913+0000 7f014659c640 1 --2- 172.21.15.7:0/3098610455 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614df4c6b40 0x5614df4d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:20.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.913+0000 7f0145d9b640 1 -- 172.21.15.7:0/3098610455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614df4c55d0 msgr2=0x5614df4d41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:20.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.913+0000 7f0145d9b640 1 --2- 172.21.15.7:0/3098610455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614df4c55d0 0x5614df4d41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.913+0000 7f0145d9b640 1 -- 172.21.15.7:0/3098610455 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614df4c6b40 msgr2=0x5614df4d14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:20.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.913+0000 7f0145d9b640 1 --2- 172.21.15.7:0/3098610455 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614df4c6b40 0x5614df4d14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.913+0000 7f0145d9b640 1 -- 172.21.15.7:0/3098610455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614df19c3c0 con 0x5614df4d4780 2024-09-19T08:53:20.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.913+0000 7f0145d9b640 1 --2- 172.21.15.7:0/3098610455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4d4780 0x5614df4d1be0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f013001dda0 tx=0x7f013001dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a53dbe305d60f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:20.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.913+0000 7f012dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:53:20.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.913+0000 7f012dffb640 1 -- 172.21.15.7:0/3098610455 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013000fcd0 con 0x5614df4d4780 2024-09-19T08:53:20.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.913+0000 7f014f37c740 1 -- 172.21.15.7:0/3098610455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f013001d440 con 0x5614df4d4780 2024-09-19T08:53:20.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.913+0000 7f012dffb640 1 -- 172.21.15.7:0/3098610455 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7f0130005030 con 0x5614df4d4780 2024-09-19T08:53:20.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.913+0000 7f012dffb640 1 -- 172.21.15.7:0/3098610455 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0130033050 con 0x5614df4d4780 2024-09-19T08:53:20.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.913+0000 7f014f37c740 10 client.17244 fetch_fsmap learned FSMap version 25 2024-09-19T08:53:20.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.913+0000 7f014f37c740 1 -- 172.21.15.7:0/3098610455 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5614df4e2fb0 con 0x5614df4d4780 2024-09-19T08:53:20.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.914+0000 7f012dffb640 1 -- 172.21.15.7:0/3098610455 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f013001d440 con 0x5614df4d4780 2024-09-19T08:53:20.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.914+0000 7f012dffb640 1 -- 172.21.15.7:0/3098610455 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f013001b020 con 0x5614df4d4780 2024-09-19T08:53:20.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.914+0000 7f014f37c740 10 client.17244 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:53:20.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.914+0000 7f014f37c740 10 client.17244 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:53:20.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.914+0000 7f014f37c740 20 client.17244 populate_metadata read hostname 'smithi007' 2024-09-19T08:53:20.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.914+0000 7f014f37c740 1 --2- 172.21.15.7:0/3098610455 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5614df4e4360 0x5614df4e6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:20.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.914+0000 7f014f37c740 4 client.17244 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:53:20.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.914+0000 7f014f37c740 1 -- 172.21.15.7:0/3098610455 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614df438860 con 0x5614df4e4360 2024-09-19T08:53:20.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.914+0000 7f014659c640 1 --2- 172.21.15.7:0/3098610455 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5614df4e4360 0x5614df4e6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:20.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.915+0000 7f014659c640 1 --2- 172.21.15.7:0/3098610455 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5614df4e4360 0x5614df4e6750 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aef1de6bd6be4fdc server_cookie=6b7751929f3d4253 in_seq=0 out_seq=0 2024-09-19T08:53:20.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.915+0000 7f012dffb640 10 client.17244 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:53:20.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.915+0000 7f012dffb640 1 -- 172.21.15.7:0/3098610455 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5614df438860 con 0x5614df4e4360 2024-09-19T08:53:20.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.915+0000 7f012dffb640 10 client.17244 handle_command_reply: tid=0 2024-09-19T08:53:20.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.915+0000 7f014f37c740 1 client.17244 shutdown 2024-09-19T08:53:20.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.915+0000 7f014f37c740 1 -- 172.21.15.7:0/3098610455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4d4780 msgr2=0x5614df4d1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:20.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.915+0000 7f014f37c740 1 --2- 172.21.15.7:0/3098610455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4d4780 0x5614df4d1be0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f013001dda0 tx=0x7f013001dea0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.915+0000 7f014f37c740 1 -- 172.21.15.7:0/3098610455 shutdown_connections 2024-09-19T08:53:20.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.915+0000 7f014f37c740 1 --2- 172.21.15.7:0/3098610455 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5614df4e4360 0x5614df4e6750 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.916+0000 7f014f37c740 1 --2- 172.21.15.7:0/3098610455 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4d4780 0x5614df4d1be0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.916+0000 7f012dffb640 0 client.17244 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:53:20.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.916+0000 7f014f37c740 1 --2- 172.21.15.7:0/3098610455 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614df4c6b40 0x5614df4d14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.916+0000 7f014f37c740 1 --2- 172.21.15.7:0/3098610455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614df4c55d0 0x5614df4d41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.916+0000 7f014f37c740 1 -- 172.21.15.7:0/3098610455 >> 172.21.15.7:0/3098610455 conn(0x5614df48e310 msgr2=0x5614df4c7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:20.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.916+0000 7f014f37c740 1 -- 172.21.15.7:0/3098610455 shutdown_connections 2024-09-19T08:53:20.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.916+0000 7f014f37c740 1 -- 172.21.15.7:0/3098610455 wait complete. 2024-09-19T08:53:20.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.916+0000 7f014f37c740 20 client.17244 trim_cache size 0 max 16384 2024-09-19T08:53:20.931 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:20 smithi175 ceph-mon[35688]: pgmap v273: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 209 B/s wr, 6 op/s 2024-09-19T08:53:20.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.929+0000 7f014f37c740 1 Processor -- start 2024-09-19T08:53:20.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.929+0000 7f014f37c740 1 -- start start 2024-09-19T08:53:20.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.929+0000 7f014f37c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614df4c55d0 0x5614df4d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:20.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.929+0000 7f014f37c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614df4c6b40 0x5614df4e0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:20.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.929+0000 7f014f37c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4d4780 0x5614df4d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:20.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.929+0000 7f014f37c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f01481aded0 con 0x5614df4d4780 2024-09-19T08:53:20.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.929+0000 7f014f37c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f01481ab7a0 con 0x5614df4c55d0 2024-09-19T08:53:20.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.929+0000 7f014f37c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f01481a9610 con 0x5614df4c6b40 2024-09-19T08:53:20.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.929+0000 7f0145d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4d4780 0x5614df4d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:20.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.929+0000 7f0145d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4d4780 0x5614df4d04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35240/0 (socket says 172.21.15.7:35240) 2024-09-19T08:53:20.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.929+0000 7f0145d9b640 1 -- 172.21.15.7:0/4070587397 learned_addr learned my addr 172.21.15.7:0/4070587397 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:20.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.929+0000 7f014659c640 1 --2- 172.21.15.7:0/4070587397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614df4c6b40 0x5614df4e0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:20.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.929+0000 7f0145d9b640 1 --2- 172.21.15.7:0/4070587397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614df4c55d0 0x5614df4d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:20.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.929+0000 7f0145d9b640 1 -- 172.21.15.7:0/4070587397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614df4c6b40 msgr2=0x5614df4e0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:20.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.929+0000 7f0145d9b640 1 --2- 172.21.15.7:0/4070587397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614df4c6b40 0x5614df4e0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.929+0000 7f0145d9b640 1 -- 172.21.15.7:0/4070587397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614df4c55d0 msgr2=0x5614df4d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:20.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.929+0000 7f0145d9b640 1 --2- 172.21.15.7:0/4070587397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614df4c55d0 0x5614df4d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.929+0000 7f0145d9b640 1 -- 172.21.15.7:0/4070587397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614df4e0c60 con 0x5614df4d4780 2024-09-19T08:53:20.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.930+0000 7f0145d9b640 1 --2- 172.21.15.7:0/4070587397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4d4780 0x5614df4d04a0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f0130011460 tx=0x7f013000ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9526a908e5aedc23 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:20.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.930+0000 7f012ffff640 1 -- 172.21.15.7:0/4070587397 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013003e070 con 0x5614df4d4780 2024-09-19T08:53:20.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.930+0000 7f012ffff640 1 -- 172.21.15.7:0/4070587397 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f013001dbd0 con 0x5614df4d4780 2024-09-19T08:53:20.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.930+0000 7f012ffff640 1 -- 172.21.15.7:0/4070587397 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013000fd30 con 0x5614df4d4780 2024-09-19T08:53:20.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.930+0000 7f014f37c740 1 -- 172.21.15.7:0/4070587397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4d4780 msgr2=0x5614df4d04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:20.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.930+0000 7f014f37c740 1 --2- 172.21.15.7:0/4070587397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4d4780 0x5614df4d04a0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f0130011460 tx=0x7f013000ad50 comp rx=0 tx=0).stop 2024-09-19T08:53:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.931+0000 7f014f37c740 1 -- 172.21.15.7:0/4070587397 shutdown_connections 2024-09-19T08:53:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.931+0000 7f014f37c740 1 --2- 172.21.15.7:0/4070587397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4d4780 0x5614df4d04a0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.931+0000 7f014f37c740 1 --2- 172.21.15.7:0/4070587397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614df4c6b40 0x5614df4e0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.931+0000 7f014f37c740 1 --2- 172.21.15.7:0/4070587397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614df4c55d0 0x5614df4d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.931+0000 7f014f37c740 1 -- 172.21.15.7:0/4070587397 >> 172.21.15.7:0/4070587397 conn(0x5614df48e310 msgr2=0x5614df4cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.931+0000 7f014f37c740 1 -- 172.21.15.7:0/4070587397 shutdown_connections 2024-09-19T08:53:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.931+0000 7f014f37c740 1 -- 172.21.15.7:0/4070587397 wait complete. 2024-09-19T08:53:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.931+0000 7f014f37c740 1 -- start start 2024-09-19T08:53:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.931+0000 7f014f37c740 1 Processor -- start 2024-09-19T08:53:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.931+0000 7f014f37c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614df4c55d0 0x5614df4dca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.931+0000 7f014f37c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4c6b40 0x5614df4dcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.931+0000 7f014f37c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614df4d4780 0x5614df4cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.931+0000 7f014f37c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f01481a9c60 con 0x5614df4c6b40 2024-09-19T08:53:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.931+0000 7f014f37c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f01481ab0d0 con 0x5614df4d4780 2024-09-19T08:53:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.931+0000 7f014f37c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f01481aa330 con 0x5614df4c55d0 2024-09-19T08:53:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.931+0000 7f014f37c740 10 client.0 _ll_register_callbacks cb 0x7f014000a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.931+0000 7f014659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4c6b40 0x5614df4dcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.931+0000 7f014659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4c6b40 0x5614df4dcfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35246/0 (socket says 172.21.15.7:35246) 2024-09-19T08:53:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.931+0000 7f014659c640 1 -- 172.21.15.7:0/3362879443 learned_addr learned my addr 172.21.15.7:0/3362879443 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.932+0000 7f0145d9b640 1 --2- 172.21.15.7:0/3362879443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614df4d4780 0x5614df4cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.932+0000 7f014659c640 1 -- 172.21.15.7:0/3362879443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614df4c55d0 msgr2=0x5614df4dca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.932+0000 7f014659c640 1 --2- 172.21.15.7:0/3362879443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614df4c55d0 0x5614df4dca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.932+0000 7f014659c640 1 -- 172.21.15.7:0/3362879443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614df4d4780 msgr2=0x5614df4cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.932+0000 7f014659c640 1 --2- 172.21.15.7:0/3362879443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614df4d4780 0x5614df4cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.932+0000 7f014659c640 1 -- 172.21.15.7:0/3362879443 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614df4ce460 con 0x5614df4c6b40 2024-09-19T08:53:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.932+0000 7f0145d9b640 1 --2- 172.21.15.7:0/3362879443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614df4d4780 0x5614df4cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.932+0000 7f014659c640 1 --2- 172.21.15.7:0/3362879443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4c6b40 0x5614df4dcfb0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f0140000c00 tx=0x7f0140010a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14f6e7e0683c133 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.932+0000 7f012dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:53:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.932+0000 7f012dffb640 1 -- 172.21.15.7:0/3362879443 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014002b060 con 0x5614df4c6b40 2024-09-19T08:53:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.932+0000 7f012dffb640 1 -- 172.21.15.7:0/3362879443 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7f014001e9f0 con 0x5614df4c6b40 2024-09-19T08:53:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.932+0000 7f014f37c740 1 -- 172.21.15.7:0/3362879443 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f013001dbd0 con 0x5614df4c6b40 2024-09-19T08:53:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.932+0000 7f012dffb640 1 -- 172.21.15.7:0/3362879443 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f014001ebf0 con 0x5614df4c6b40 2024-09-19T08:53:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.932+0000 7f014f37c740 10 client.17250 fetch_fsmap learned FSMap version 25 2024-09-19T08:53:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.932+0000 7f014f37c740 1 -- 172.21.15.7:0/3362879443 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5614df54e840 con 0x5614df4c6b40 2024-09-19T08:53:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.933+0000 7f012dffb640 1 -- 172.21.15.7:0/3362879443 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f013001dbd0 con 0x5614df4c6b40 2024-09-19T08:53:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.933+0000 7f012dffb640 1 -- 172.21.15.7:0/3362879443 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f014001d420 con 0x5614df4c6b40 2024-09-19T08:53:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.933+0000 7f014f37c740 10 client.17250 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:53:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.933+0000 7f014f37c740 10 client.17250 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:53:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.933+0000 7f014f37c740 20 client.17250 populate_metadata read hostname 'smithi007' 2024-09-19T08:53:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.933+0000 7f014f37c740 1 --2- 172.21.15.7:0/3362879443 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5614df54eef0 0x5614df551330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.933+0000 7f014f37c740 4 client.17250 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:53:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.933+0000 7f014f37c740 1 -- 172.21.15.7:0/3362879443 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5614df432d70 con 0x5614df54eef0 2024-09-19T08:53:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.933+0000 7f0145d9b640 1 --2- 172.21.15.7:0/3362879443 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5614df54eef0 0x5614df551330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.933+0000 7f012dffb640 10 client.17250 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:53:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.933+0000 7f0145d9b640 1 --2- 172.21.15.7:0/3362879443 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5614df54eef0 0x5614df551330 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5ffc370e4f15bebf server_cookie=5aaf6321f6707eb in_seq=0 out_seq=0 2024-09-19T08:53:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.934+0000 7f012dffb640 1 -- 172.21.15.7:0/3362879443 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5614df432d70 con 0x5614df54eef0 2024-09-19T08:53:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.934+0000 7f012dffb640 10 client.17250 handle_command_reply: tid=0 2024-09-19T08:53:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.934+0000 7f014f37c740 1 client.17250 shutdown 2024-09-19T08:53:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.934+0000 7f014f37c740 1 -- 172.21.15.7:0/3362879443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4c6b40 msgr2=0x5614df4dcfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.934+0000 7f014f37c740 1 --2- 172.21.15.7:0/3362879443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4c6b40 0x5614df4dcfb0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f0140000c00 tx=0x7f0140010a30 comp rx=0 tx=0).stop 2024-09-19T08:53:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.934+0000 7f014f37c740 1 -- 172.21.15.7:0/3362879443 shutdown_connections 2024-09-19T08:53:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.934+0000 7f014f37c740 1 --2- 172.21.15.7:0/3362879443 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x5614df54eef0 0x5614df551330 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.934+0000 7f012dffb640 0 client.17250 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:53:20.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.934+0000 7f014f37c740 1 --2- 172.21.15.7:0/3362879443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5614df4d4780 0x5614df4cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.934+0000 7f014f37c740 1 --2- 172.21.15.7:0/3362879443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5614df4c6b40 0x5614df4dcfb0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.934+0000 7f014f37c740 1 --2- 172.21.15.7:0/3362879443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5614df4c55d0 0x5614df4dca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.934+0000 7f014f37c740 1 -- 172.21.15.7:0/3362879443 >> 172.21.15.7:0/3362879443 conn(0x5614df48e310 msgr2=0x5614df4c7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:20.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.934+0000 7f014f37c740 1 -- 172.21.15.7:0/3362879443 shutdown_connections 2024-09-19T08:53:20.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.934+0000 7f014f37c740 1 -- 172.21.15.7:0/3362879443 wait complete. 2024-09-19T08:53:20.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.934+0000 7f014f37c740 20 client.17250 trim_cache size 0 max 16384 2024-09-19T08:53:20.942 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:53:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.934+0000 7f014cfa3640 1 -- 172.21.15.7:0/3974513010 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f01340a33b0 msgr2=0x7f01340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.935+0000 7f014cfa3640 1 --2- 172.21.15.7:0/3974513010 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f01340a33b0 0x7f01340a5870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f01380bd170 tx=0x7f0138088310 comp rx=0 tx=0).stop 2024-09-19T08:53:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.935+0000 7f014cfa3640 1 -- 172.21.15.7:0/3974513010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01481082a0 msgr2=0x7f014819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.935+0000 7f014cfa3640 1 --2- 172.21.15.7:0/3974513010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01481082a0 0x7f014819cd10 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f0138009ca0 tx=0x7f01380039f0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.935+0000 7f014cfa3640 1 -- 172.21.15.7:0/3974513010 shutdown_connections 2024-09-19T08:53:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.935+0000 7f014cfa3640 1 --2- 172.21.15.7:0/3974513010 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f01340a33b0 0x7f01340a5870 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.935+0000 7f014cfa3640 1 --2- 172.21.15.7:0/3974513010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01481082a0 0x7f014819cd10 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.935+0000 7f014cfa3640 1 --2- 172.21.15.7:0/3974513010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01481036e0 0x7f0148198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.935+0000 7f014cfa3640 1 --2- 172.21.15.7:0/3974513010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0148102d30 0x7f0148198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:20.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.935+0000 7f014cfa3640 1 -- 172.21.15.7:0/3974513010 >> 172.21.15.7:0/3974513010 conn(0x7f01480fc7d0 msgr2=0x7f01480fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:20.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.935+0000 7f014cfa3640 1 -- 172.21.15.7:0/3974513010 shutdown_connections 2024-09-19T08:53:20.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:20.935+0000 7f014cfa3640 1 -- 172.21.15.7:0/3974513010 wait complete. 2024-09-19T08:53:21.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:20 smithi044 ceph-mon[35072]: pgmap v273: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 209 B/s wr, 6 op/s 2024-09-19T08:53:21.755 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:53:22.011 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:22.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.480+0000 7fd934cc5640 1 -- 172.21.15.7:0/4068085276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd930100a80 msgr2=0x7fd930100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:22.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.480+0000 7fd934cc5640 1 --2- 172.21.15.7:0/4068085276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd930100a80 0x7fd930100ee0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd924009930 tx=0x7fd92402a420 comp rx=0 tx=0).stop 2024-09-19T08:53:22.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.480+0000 7fd934cc5640 1 -- 172.21.15.7:0/4068085276 shutdown_connections 2024-09-19T08:53:22.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.480+0000 7fd934cc5640 1 --2- 172.21.15.7:0/4068085276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd930101420 0x7fd93010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.480+0000 7fd934cc5640 1 --2- 172.21.15.7:0/4068085276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd930100a80 0x7fd930100ee0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.480+0000 7fd934cc5640 1 --2- 172.21.15.7:0/4068085276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd930106a80 0x7fd930106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.480+0000 7fd934cc5640 1 -- 172.21.15.7:0/4068085276 >> 172.21.15.7:0/4068085276 conn(0x7fd9300fc7a0 msgr2=0x7fd9300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:22.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.480+0000 7fd934cc5640 1 -- 172.21.15.7:0/4068085276 shutdown_connections 2024-09-19T08:53:22.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.480+0000 7fd934cc5640 1 -- 172.21.15.7:0/4068085276 wait complete. 2024-09-19T08:53:22.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.481+0000 7fd934cc5640 1 Processor -- start 2024-09-19T08:53:22.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.481+0000 7fd934cc5640 1 -- start start 2024-09-19T08:53:22.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.481+0000 7fd934cc5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd930100a80 0x7fd9301984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.481+0000 7fd934cc5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd930101420 0x7fd930198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.481+0000 7fd934cc5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd930106a80 0x7fd93019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.481+0000 7fd934cc5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd930110ea0 con 0x7fd930101420 2024-09-19T08:53:22.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.481+0000 7fd934cc5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd930110d20 con 0x7fd930106a80 2024-09-19T08:53:22.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.481+0000 7fd934cc5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd930111020 con 0x7fd930100a80 2024-09-19T08:53:22.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.481+0000 7fd92dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd930101420 0x7fd930198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.482+0000 7fd92dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd930101420 0x7fd930198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35274/0 (socket says 172.21.15.7:35274) 2024-09-19T08:53:22.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.482+0000 7fd92dd9b640 1 -- 172.21.15.7:0/761864577 learned_addr learned my addr 172.21.15.7:0/761864577 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:22.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.482+0000 7fd92ed9d640 1 --2- 172.21.15.7:0/761864577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd930106a80 0x7fd93019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.482+0000 7fd92e59c640 1 --2- 172.21.15.7:0/761864577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd930100a80 0x7fd9301984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.482+0000 7fd92dd9b640 1 -- 172.21.15.7:0/761864577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd930100a80 msgr2=0x7fd9301984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:22.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.482+0000 7fd92dd9b640 1 --2- 172.21.15.7:0/761864577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd930100a80 0x7fd9301984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.482+0000 7fd92dd9b640 1 -- 172.21.15.7:0/761864577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd930106a80 msgr2=0x7fd93019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:22.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.482+0000 7fd92dd9b640 1 --2- 172.21.15.7:0/761864577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd930106a80 0x7fd93019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.482+0000 7fd92dd9b640 1 -- 172.21.15.7:0/761864577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd93019d480 con 0x7fd930101420 2024-09-19T08:53:22.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.482+0000 7fd92dd9b640 1 --2- 172.21.15.7:0/761864577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd930101420 0x7fd930198a10 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd924009a50 tx=0x7fd924004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:22.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.482+0000 7fd91f7fe640 1 -- 172.21.15.7:0/761864577 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92403f030 con 0x7fd930101420 2024-09-19T08:53:22.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.482+0000 7fd91f7fe640 1 -- 172.21.15.7:0/761864577 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd924003ce0 con 0x7fd930101420 2024-09-19T08:53:22.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.482+0000 7fd934cc5640 1 -- 172.21.15.7:0/761864577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd93019d710 con 0x7fd930101420 2024-09-19T08:53:22.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.482+0000 7fd91f7fe640 1 -- 172.21.15.7:0/761864577 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd924035070 con 0x7fd930101420 2024-09-19T08:53:22.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.482+0000 7fd934cc5640 1 -- 172.21.15.7:0/761864577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9301a5050 con 0x7fd930101420 2024-09-19T08:53:22.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.485+0000 7fd91f7fe640 1 -- 172.21.15.7:0/761864577 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fd924042030 con 0x7fd930101420 2024-09-19T08:53:22.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.485+0000 7fd93709e740 1 Processor -- start 2024-09-19T08:53:22.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.485+0000 7fd93709e740 1 -- start start 2024-09-19T08:53:22.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.485+0000 7fd93709e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478acb40 0x5619478ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.485+0000 7fd93709e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619478ab5d0 0x5619478aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.485+0000 7fd93709e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619478ba780 0x5619478bcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.486+0000 7fd93709e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5619478112f0 con 0x5619478acb40 2024-09-19T08:53:22.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.486+0000 7fd93709e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5619477b8cf0 con 0x5619478ba780 2024-09-19T08:53:22.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.486+0000 7fd93709e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56194780d2b0 con 0x5619478ab5d0 2024-09-19T08:53:22.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.486+0000 7fd91f7fe640 1 --2- 172.21.15.7:0/761864577 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd9180a33b0 0x7fd9180a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.486+0000 7fd92ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478acb40 0x5619478ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.486+0000 7fd92ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478acb40 0x5619478ab090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35284/0 (socket says 172.21.15.7:35284) 2024-09-19T08:53:22.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.486+0000 7fd92ed9d640 1 -- 172.21.15.7:0/2413799586 learned_addr learned my addr 172.21.15.7:0/2413799586 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:22.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.486+0000 7fd92ed9d640 1 --2- 172.21.15.7:0/761864577 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd9180a33b0 0x7fd9180a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.486+0000 7fd91f7fe640 1 -- 172.21.15.7:0/761864577 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7fd9240f0300 con 0x7fd930101420 2024-09-19T08:53:22.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.486+0000 7fd92e59c640 1 --2- 172.21.15.7:0/2413799586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619478ab5d0 0x5619478aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.486+0000 7fd92dd9b640 1 --2- 172.21.15.7:0/2413799586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619478ba780 0x5619478bcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.486+0000 7fd92ed9d640 1 -- 172.21.15.7:0/2413799586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619478ab5d0 msgr2=0x5619478aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:22.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.486+0000 7fd92ed9d640 1 --2- 172.21.15.7:0/2413799586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619478ab5d0 0x5619478aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.486+0000 7fd92ed9d640 1 -- 172.21.15.7:0/2413799586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619478ba780 msgr2=0x5619478bcb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:22.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.486+0000 7fd92ed9d640 1 --2- 172.21.15.7:0/2413799586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619478ba780 0x5619478bcb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.486+0000 7fd92ed9d640 1 -- 172.21.15.7:0/2413799586 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56194779d3a0 con 0x5619478acb40 2024-09-19T08:53:22.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.486+0000 7fd92ed9d640 1 --2- 172.21.15.7:0/2413799586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478acb40 0x5619478ab090 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fd928008340 tx=0x7fd928008800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f728b921c885b97d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:22.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.486+0000 7fd92ed9d640 1 --2- 172.21.15.7:0/761864577 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd9180a33b0 0x7fd9180a5870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd928009900 tx=0x7fd92801b000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:22.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.487+0000 7fd91cff9640 1 -- 172.21.15.7:0/2413799586 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928027070 con 0x5619478acb40 2024-09-19T08:53:22.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.487+0000 7fd91cff9640 1 -- 172.21.15.7:0/2413799586 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd928019d30 con 0x5619478acb40 2024-09-19T08:53:22.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.487+0000 7fd91cff9640 1 -- 172.21.15.7:0/2413799586 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928014040 con 0x5619478acb40 2024-09-19T08:53:22.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.487+0000 7fd93709e740 1 -- 172.21.15.7:0/2413799586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478acb40 msgr2=0x5619478ab090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:22.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.487+0000 7fd93709e740 1 --2- 172.21.15.7:0/2413799586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478acb40 0x5619478ab090 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fd928008340 tx=0x7fd928008800 comp rx=0 tx=0).stop 2024-09-19T08:53:22.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.487+0000 7fd93709e740 1 -- 172.21.15.7:0/2413799586 shutdown_connections 2024-09-19T08:53:22.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.487+0000 7fd93709e740 1 --2- 172.21.15.7:0/2413799586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619478ba780 0x5619478bcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.487+0000 7fd93709e740 1 --2- 172.21.15.7:0/2413799586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619478ab5d0 0x5619478aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.487+0000 7fd93709e740 1 --2- 172.21.15.7:0/2413799586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478acb40 0x5619478ab090 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.487+0000 7fd93709e740 1 -- 172.21.15.7:0/2413799586 >> 172.21.15.7:0/2413799586 conn(0x561947874310 msgr2=0x5619478a7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:22.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.487+0000 7fd93709e740 1 -- 172.21.15.7:0/2413799586 shutdown_connections 2024-09-19T08:53:22.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.488+0000 7fd93709e740 1 -- 172.21.15.7:0/2413799586 wait complete. 2024-09-19T08:53:22.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.488+0000 7fd93709e740 1 -- start start 2024-09-19T08:53:22.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.488+0000 7fd93709e740 1 Processor -- start 2024-09-19T08:53:22.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.488+0000 7fd93709e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619478ab5d0 0x5619478ba1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.488+0000 7fd93709e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619478acb40 0x5619478b7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.488+0000 7fd93709e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478ba780 0x5619478b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.488+0000 7fd93709e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5619478bd420 con 0x5619478ba780 2024-09-19T08:53:22.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.488+0000 7fd93709e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5619477cc060 con 0x5619478ab5d0 2024-09-19T08:53:22.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.488+0000 7fd93709e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5619478bd5a0 con 0x5619478acb40 2024-09-19T08:53:22.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.488+0000 7fd93709e740 10 client.0 _ll_register_callbacks cb 0x56194751f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:22.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.488+0000 7fd92ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478ba780 0x5619478b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.488+0000 7fd92ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478ba780 0x5619478b7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35298/0 (socket says 172.21.15.7:35298) 2024-09-19T08:53:22.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.488+0000 7fd92ed9d640 1 -- 172.21.15.7:0/3349404442 learned_addr learned my addr 172.21.15.7:0/3349404442 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:22.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.488+0000 7fd92e59c640 1 --2- 172.21.15.7:0/3349404442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619478ab5d0 0x5619478ba1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.488+0000 7fd92dd9b640 1 --2- 172.21.15.7:0/3349404442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619478acb40 0x5619478b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.489+0000 7fd92ed9d640 1 -- 172.21.15.7:0/3349404442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619478acb40 msgr2=0x5619478b7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:22.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.489+0000 7fd92ed9d640 1 --2- 172.21.15.7:0/3349404442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619478acb40 0x5619478b7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.489+0000 7fd92ed9d640 1 -- 172.21.15.7:0/3349404442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619478ab5d0 msgr2=0x5619478ba1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:22.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.489+0000 7fd92ed9d640 1 --2- 172.21.15.7:0/3349404442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619478ab5d0 0x5619478ba1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.489+0000 7fd92ed9d640 1 -- 172.21.15.7:0/3349404442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619475823c0 con 0x5619478ba780 2024-09-19T08:53:22.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.489+0000 7fd92e59c640 1 --2- 172.21.15.7:0/3349404442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619478ab5d0 0x5619478ba1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:22.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.489+0000 7fd92dd9b640 1 --2- 172.21.15.7:0/3349404442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619478acb40 0x5619478b7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:22.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.489+0000 7fd92ed9d640 1 --2- 172.21.15.7:0/3349404442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478ba780 0x5619478b7a60 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fd9280096d0 tx=0x7fd928004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64876eb65cced1f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:22.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.489+0000 7fd915ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:53:22.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.489+0000 7fd915ffb640 1 -- 172.21.15.7:0/3349404442 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928030070 con 0x5619478ba780 2024-09-19T08:53:22.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.489+0000 7fd915ffb640 1 -- 172.21.15.7:0/3349404442 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7fd928022cd0 con 0x5619478ba780 2024-09-19T08:53:22.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.489+0000 7fd93709e740 1 -- 172.21.15.7:0/3349404442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd928019d30 con 0x5619478ba780 2024-09-19T08:53:22.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.489+0000 7fd915ffb640 1 -- 172.21.15.7:0/3349404442 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd92803c050 con 0x5619478ba780 2024-09-19T08:53:22.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.489+0000 7fd93709e740 10 client.17262 fetch_fsmap learned FSMap version 25 2024-09-19T08:53:22.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.489+0000 7fd93709e740 1 -- 172.21.15.7:0/3349404442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5619478c8ef0 con 0x5619478ba780 2024-09-19T08:53:22.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.489+0000 7fd915ffb640 1 -- 172.21.15.7:0/3349404442 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd928019d30 con 0x5619478ba780 2024-09-19T08:53:22.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.490+0000 7fd915ffb640 1 -- 172.21.15.7:0/3349404442 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd92802c480 con 0x5619478ba780 2024-09-19T08:53:22.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.490+0000 7fd93709e740 10 client.17262 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:53:22.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.490+0000 7fd93709e740 10 client.17262 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:53:22.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.490+0000 7fd93709e740 20 client.17262 populate_metadata read hostname 'smithi007' 2024-09-19T08:53:22.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.490+0000 7fd93709e740 1 --2- 172.21.15.7:0/3349404442 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5619478ca300 0x5619478cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.490+0000 7fd93709e740 4 client.17262 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:53:22.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.490+0000 7fd93709e740 1 -- 172.21.15.7:0/3349404442 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56194781e860 con 0x5619478ca300 2024-09-19T08:53:22.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.490+0000 7fd92e59c640 1 --2- 172.21.15.7:0/3349404442 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5619478ca300 0x5619478cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.490+0000 7fd92e59c640 1 --2- 172.21.15.7:0/3349404442 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5619478ca300 0x5619478cc6f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=33f77014a3e19c07 server_cookie=32f625dfb08908ad in_seq=0 out_seq=0 2024-09-19T08:53:22.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.490+0000 7fd915ffb640 10 client.17262 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:53:22.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.491+0000 7fd915ffb640 1 -- 172.21.15.7:0/3349404442 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56194781e860 con 0x5619478ca300 2024-09-19T08:53:22.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.491+0000 7fd915ffb640 10 client.17262 handle_command_reply: tid=0 2024-09-19T08:53:22.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.491+0000 7fd93709e740 1 client.17262 shutdown 2024-09-19T08:53:22.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.491+0000 7fd93709e740 1 -- 172.21.15.7:0/3349404442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478ba780 msgr2=0x5619478b7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:22.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.491+0000 7fd93709e740 1 --2- 172.21.15.7:0/3349404442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478ba780 0x5619478b7a60 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fd9280096d0 tx=0x7fd928004a40 comp rx=0 tx=0).stop 2024-09-19T08:53:22.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.491+0000 7fd93709e740 1 -- 172.21.15.7:0/3349404442 shutdown_connections 2024-09-19T08:53:22.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.491+0000 7fd93709e740 1 --2- 172.21.15.7:0/3349404442 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5619478ca300 0x5619478cc6f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.491+0000 7fd915ffb640 0 client.17262 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:53:22.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.491+0000 7fd93709e740 1 --2- 172.21.15.7:0/3349404442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478ba780 0x5619478b7a60 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.491+0000 7fd93709e740 1 --2- 172.21.15.7:0/3349404442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619478acb40 0x5619478b7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.491+0000 7fd93709e740 1 --2- 172.21.15.7:0/3349404442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619478ab5d0 0x5619478ba1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.491+0000 7fd93709e740 1 -- 172.21.15.7:0/3349404442 >> 172.21.15.7:0/3349404442 conn(0x561947874310 msgr2=0x5619478ad960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:22.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.491+0000 7fd93709e740 1 -- 172.21.15.7:0/3349404442 shutdown_connections 2024-09-19T08:53:22.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.491+0000 7fd93709e740 1 -- 172.21.15.7:0/3349404442 wait complete. 2024-09-19T08:53:22.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.491+0000 7fd93709e740 20 client.17262 trim_cache size 0 max 16384 2024-09-19T08:53:22.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.504+0000 7fd93709e740 1 Processor -- start 2024-09-19T08:53:22.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.504+0000 7fd93709e740 1 -- start start 2024-09-19T08:53:22.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.505+0000 7fd93709e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478ab5d0 0x5619478c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.505+0000 7fd93709e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619478acb40 0x5619478d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.505+0000 7fd93709e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619478ba780 0x5619478d2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.505+0000 7fd93709e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9301ae000 con 0x5619478ab5d0 2024-09-19T08:53:22.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.505+0000 7fd93709e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd9301ab8d0 con 0x5619478ba780 2024-09-19T08:53:22.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.505+0000 7fd93709e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd9301a9740 con 0x5619478acb40 2024-09-19T08:53:22.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.505+0000 7fd92e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478ab5d0 0x5619478c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.505+0000 7fd92e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478ab5d0 0x5619478c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35312/0 (socket says 172.21.15.7:35312) 2024-09-19T08:53:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.505+0000 7fd92e59c640 1 -- 172.21.15.7:0/2885755779 learned_addr learned my addr 172.21.15.7:0/2885755779 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.505+0000 7fd92ed9d640 1 --2- 172.21.15.7:0/2885755779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619478ba780 0x5619478d2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.505+0000 7fd92dd9b640 1 --2- 172.21.15.7:0/2885755779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619478acb40 0x5619478d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.505+0000 7fd92e59c640 1 -- 172.21.15.7:0/2885755779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619478acb40 msgr2=0x5619478d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.505+0000 7fd92e59c640 1 --2- 172.21.15.7:0/2885755779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619478acb40 0x5619478d1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.505+0000 7fd92e59c640 1 -- 172.21.15.7:0/2885755779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619478ba780 msgr2=0x5619478d2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.505+0000 7fd92e59c640 1 --2- 172.21.15.7:0/2885755779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619478ba780 0x5619478d2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.505+0000 7fd92e59c640 1 -- 172.21.15.7:0/2885755779 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619478a2a30 con 0x5619478ab5d0 2024-09-19T08:53:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.505+0000 7fd92e59c640 1 --2- 172.21.15.7:0/2885755779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478ab5d0 0x5619478c66c0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fd92000ef60 tx=0x7fd92000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a3c8bbc710912b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.505+0000 7fd917fff640 1 -- 172.21.15.7:0/2885755779 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd920004020 con 0x5619478ab5d0 2024-09-19T08:53:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.505+0000 7fd917fff640 1 -- 172.21.15.7:0/2885755779 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9200041c0 con 0x5619478ab5d0 2024-09-19T08:53:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.505+0000 7fd917fff640 1 -- 172.21.15.7:0/2885755779 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92001a770 con 0x5619478ab5d0 2024-09-19T08:53:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.506+0000 7fd93709e740 1 -- 172.21.15.7:0/2885755779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478ab5d0 msgr2=0x5619478c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.506+0000 7fd93709e740 1 --2- 172.21.15.7:0/2885755779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478ab5d0 0x5619478c66c0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fd92000ef60 tx=0x7fd92000ef90 comp rx=0 tx=0).stop 2024-09-19T08:53:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.506+0000 7fd93709e740 1 -- 172.21.15.7:0/2885755779 shutdown_connections 2024-09-19T08:53:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.506+0000 7fd93709e740 1 --2- 172.21.15.7:0/2885755779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619478ba780 0x5619478d2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.506+0000 7fd93709e740 1 --2- 172.21.15.7:0/2885755779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619478acb40 0x5619478d1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.506+0000 7fd93709e740 1 --2- 172.21.15.7:0/2885755779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478ab5d0 0x5619478c66c0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.506+0000 7fd93709e740 1 -- 172.21.15.7:0/2885755779 >> 172.21.15.7:0/2885755779 conn(0x561947874310 msgr2=0x5619478a6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.506+0000 7fd93709e740 1 -- 172.21.15.7:0/2885755779 shutdown_connections 2024-09-19T08:53:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.506+0000 7fd93709e740 1 -- 172.21.15.7:0/2885755779 wait complete. 2024-09-19T08:53:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.506+0000 7fd93709e740 1 -- start start 2024-09-19T08:53:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.507+0000 7fd93709e740 1 Processor -- start 2024-09-19T08:53:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.507+0000 7fd93709e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619478ab5d0 0x5619478c2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.507+0000 7fd93709e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619478acb40 0x5619478be2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.507+0000 7fd93709e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478ba780 0x5619478be830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.507+0000 7fd93709e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9301a9d90 con 0x5619478ba780 2024-09-19T08:53:22.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.507+0000 7fd93709e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd9301ab200 con 0x5619478acb40 2024-09-19T08:53:22.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.507+0000 7fd93709e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd9301aa460 con 0x5619478ab5d0 2024-09-19T08:53:22.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.507+0000 7fd93709e740 10 client.0 _ll_register_callbacks cb 0x7fd928025070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:22.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.507+0000 7fd92ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478ba780 0x5619478be830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.507+0000 7fd92ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478ba780 0x5619478be830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35318/0 (socket says 172.21.15.7:35318) 2024-09-19T08:53:22.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.507+0000 7fd92ed9d640 1 -- 172.21.15.7:0/263349196 learned_addr learned my addr 172.21.15.7:0/263349196 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:22.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.507+0000 7fd92e59c640 1 --2- 172.21.15.7:0/263349196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619478ab5d0 0x5619478c2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.507+0000 7fd92dd9b640 1 --2- 172.21.15.7:0/263349196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619478acb40 0x5619478be2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.507+0000 7fd92ed9d640 1 -- 172.21.15.7:0/263349196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619478ab5d0 msgr2=0x5619478c2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:22.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.507+0000 7fd92ed9d640 1 --2- 172.21.15.7:0/263349196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619478ab5d0 0x5619478c2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.507+0000 7fd92ed9d640 1 -- 172.21.15.7:0/263349196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619478acb40 msgr2=0x5619478be2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:22.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.507+0000 7fd92ed9d640 1 --2- 172.21.15.7:0/263349196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619478acb40 0x5619478be2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.507+0000 7fd92ed9d640 1 -- 172.21.15.7:0/263349196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619478bf030 con 0x5619478ba780 2024-09-19T08:53:22.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.507+0000 7fd92dd9b640 1 --2- 172.21.15.7:0/263349196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619478acb40 0x5619478be2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:22.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.508+0000 7fd92ed9d640 1 --2- 172.21.15.7:0/263349196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478ba780 0x5619478be830 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fd92802c8d0 tx=0x7fd928019f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50fe10736c14db5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:22.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.508+0000 7fd915ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:53:22.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.508+0000 7fd915ffb640 1 -- 172.21.15.7:0/263349196 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928030040 con 0x5619478ba780 2024-09-19T08:53:22.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.508+0000 7fd915ffb640 1 -- 172.21.15.7:0/263349196 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7fd92800b040 con 0x5619478ba780 2024-09-19T08:53:22.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.508+0000 7fd93709e740 1 -- 172.21.15.7:0/263349196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9200041c0 con 0x5619478ba780 2024-09-19T08:53:22.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.508+0000 7fd915ffb640 1 -- 172.21.15.7:0/263349196 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd928027040 con 0x5619478ba780 2024-09-19T08:53:22.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.508+0000 7fd93709e740 10 client.17268 fetch_fsmap learned FSMap version 25 2024-09-19T08:53:22.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.508+0000 7fd93709e740 1 -- 172.21.15.7:0/263349196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561947934d20 con 0x5619478ba780 2024-09-19T08:53:22.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.508+0000 7fd915ffb640 1 -- 172.21.15.7:0/263349196 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9200041c0 con 0x5619478ba780 2024-09-19T08:53:22.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.508+0000 7fd915ffb640 1 -- 172.21.15.7:0/263349196 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd928022930 con 0x5619478ba780 2024-09-19T08:53:22.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.508+0000 7fd93709e740 10 client.17268 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:53:22.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.508+0000 7fd93709e740 10 client.17268 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:53:22.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.508+0000 7fd93709e740 20 client.17268 populate_metadata read hostname 'smithi007' 2024-09-19T08:53:22.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.508+0000 7fd93709e740 1 --2- 172.21.15.7:0/263349196 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5619478ca300 0x561947937410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:22.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.508+0000 7fd93709e740 4 client.17268 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:53:22.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.508+0000 7fd93709e740 1 -- 172.21.15.7:0/263349196 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561947818d70 con 0x5619478ca300 2024-09-19T08:53:22.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.509+0000 7fd92e59c640 1 --2- 172.21.15.7:0/263349196 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5619478ca300 0x561947937410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:22.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.509+0000 7fd915ffb640 10 client.17268 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:53:22.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.509+0000 7fd92e59c640 1 --2- 172.21.15.7:0/263349196 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5619478ca300 0x561947937410 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6fd5471e770ce546 server_cookie=9331c6e6052d9303 in_seq=0 out_seq=0 2024-09-19T08:53:22.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.509+0000 7fd915ffb640 1 -- 172.21.15.7:0/263349196 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561947818d70 con 0x5619478ca300 2024-09-19T08:53:22.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.509+0000 7fd915ffb640 10 client.17268 handle_command_reply: tid=0 2024-09-19T08:53:22.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.509+0000 7fd93709e740 1 client.17268 shutdown 2024-09-19T08:53:22.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.509+0000 7fd93709e740 1 -- 172.21.15.7:0/263349196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478ba780 msgr2=0x5619478be830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:22.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.509+0000 7fd93709e740 1 --2- 172.21.15.7:0/263349196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478ba780 0x5619478be830 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fd92802c8d0 tx=0x7fd928019f60 comp rx=0 tx=0).stop 2024-09-19T08:53:22.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.509+0000 7fd93709e740 1 -- 172.21.15.7:0/263349196 shutdown_connections 2024-09-19T08:53:22.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.509+0000 7fd93709e740 1 --2- 172.21.15.7:0/263349196 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5619478ca300 0x561947937410 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.509+0000 7fd93709e740 1 --2- 172.21.15.7:0/263349196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619478ba780 0x5619478be830 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.509+0000 7fd93709e740 1 --2- 172.21.15.7:0/263349196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619478acb40 0x5619478be2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.509+0000 7fd93709e740 1 --2- 172.21.15.7:0/263349196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619478ab5d0 0x5619478c2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.509+0000 7fd93709e740 1 -- 172.21.15.7:0/263349196 >> 172.21.15.7:0/263349196 conn(0x561947874310 msgr2=0x5619478b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:22.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.509+0000 7fd915ffb640 0 client.17268 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:53:22.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.509+0000 7fd93709e740 1 -- 172.21.15.7:0/263349196 shutdown_connections 2024-09-19T08:53:22.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.510+0000 7fd93709e740 1 -- 172.21.15.7:0/263349196 wait complete. 2024-09-19T08:53:22.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.510+0000 7fd93709e740 20 client.17268 trim_cache size 0 max 16384 2024-09-19T08:53:22.531 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:53:22.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.510+0000 7fd934cc5640 1 -- 172.21.15.7:0/761864577 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd9180a33b0 msgr2=0x7fd9180a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:22.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.510+0000 7fd934cc5640 1 --2- 172.21.15.7:0/761864577 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd9180a33b0 0x7fd9180a5870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd928009900 tx=0x7fd92801b000 comp rx=0 tx=0).stop 2024-09-19T08:53:22.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.510+0000 7fd934cc5640 1 -- 172.21.15.7:0/761864577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd930101420 msgr2=0x7fd930198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:22.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.510+0000 7fd934cc5640 1 --2- 172.21.15.7:0/761864577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd930101420 0x7fd930198a10 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd924009a50 tx=0x7fd924004270 comp rx=0 tx=0).stop 2024-09-19T08:53:22.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.510+0000 7fd934cc5640 1 -- 172.21.15.7:0/761864577 shutdown_connections 2024-09-19T08:53:22.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.510+0000 7fd934cc5640 1 --2- 172.21.15.7:0/761864577 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd9180a33b0 0x7fd9180a5870 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.510+0000 7fd934cc5640 1 --2- 172.21.15.7:0/761864577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd930106a80 0x7fd93019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.510+0000 7fd934cc5640 1 --2- 172.21.15.7:0/761864577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd930101420 0x7fd930198a10 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.510+0000 7fd934cc5640 1 --2- 172.21.15.7:0/761864577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd930100a80 0x7fd9301984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:22.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.510+0000 7fd934cc5640 1 -- 172.21.15.7:0/761864577 >> 172.21.15.7:0/761864577 conn(0x7fd9300fc7a0 msgr2=0x7fd93006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:22.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.510+0000 7fd934cc5640 1 -- 172.21.15.7:0/761864577 shutdown_connections 2024-09-19T08:53:22.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:22.510+0000 7fd934cc5640 1 -- 172.21.15.7:0/761864577 wait complete. 2024-09-19T08:53:22.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:22 smithi007 ceph-mon[31221]: pgmap v274: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:53:22.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:22 smithi175 ceph-mon[35688]: pgmap v274: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:53:23.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:22 smithi044 ceph-mon[35072]: pgmap v274: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:53:23.381 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:53:23.635 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:24.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.098+0000 7fec0dce1640 1 -- 172.21.15.7:0/2453125586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec08103740 msgr2=0x7fec08107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:24.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.098+0000 7fec0dce1640 1 --2- 172.21.15.7:0/2453125586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec08103740 0x7fec08107b80 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7febf0009930 tx=0x7febf002a420 comp rx=0 tx=0).stop 2024-09-19T08:53:24.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.098+0000 7fec0dce1640 1 -- 172.21.15.7:0/2453125586 shutdown_connections 2024-09-19T08:53:24.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.098+0000 7fec0dce1640 1 --2- 172.21.15.7:0/2453125586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec08108290 0x7fec0810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.098+0000 7fec0dce1640 1 --2- 172.21.15.7:0/2453125586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec08103740 0x7fec08107b80 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.098+0000 7fec0dce1640 1 --2- 172.21.15.7:0/2453125586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec08102d90 0x7fec08103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.098+0000 7fec0dce1640 1 -- 172.21.15.7:0/2453125586 >> 172.21.15.7:0/2453125586 conn(0x7fec080fc7d0 msgr2=0x7fec080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:24.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.099+0000 7fec0dce1640 1 -- 172.21.15.7:0/2453125586 shutdown_connections 2024-09-19T08:53:24.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.099+0000 7fec0dce1640 1 -- 172.21.15.7:0/2453125586 wait complete. 2024-09-19T08:53:24.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.099+0000 7fec0dce1640 1 Processor -- start 2024-09-19T08:53:24.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.099+0000 7fec0dce1640 1 -- start start 2024-09-19T08:53:24.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.099+0000 7fec0dce1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec08102d90 0x7fec081009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:24.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.099+0000 7fec0dce1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec08103740 0x7fec08100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:24.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.099+0000 7fec0dce1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec08108290 0x7fec08101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:24.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.099+0000 7fec0dce1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fec08112090 con 0x7fec08103740 2024-09-19T08:53:24.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.099+0000 7fec0dce1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fec08111f10 con 0x7fec08108290 2024-09-19T08:53:24.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.099+0000 7fec0dce1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fec08112210 con 0x7fec08102d90 2024-09-19T08:53:24.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.099+0000 7febfffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec08103740 0x7fec08100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:24.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.100+0000 7febfffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec08103740 0x7fec08100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41022/0 (socket says 172.21.15.7:41022) 2024-09-19T08:53:24.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.100+0000 7febfffff640 1 -- 172.21.15.7:0/3192922037 learned_addr learned my addr 172.21.15.7:0/3192922037 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:24.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.100+0000 7fec077fe640 1 --2- 172.21.15.7:0/3192922037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec08102d90 0x7fec081009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:24.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.100+0000 7fec07fff640 1 --2- 172.21.15.7:0/3192922037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec08108290 0x7fec08101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:24.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.100+0000 7febfffff640 1 -- 172.21.15.7:0/3192922037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec08102d90 msgr2=0x7fec081009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:24.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.100+0000 7febfffff640 1 --2- 172.21.15.7:0/3192922037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec08102d90 0x7fec081009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.100+0000 7febfffff640 1 -- 172.21.15.7:0/3192922037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec08108290 msgr2=0x7fec08101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:24.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.100+0000 7febfffff640 1 --2- 172.21.15.7:0/3192922037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec08108290 0x7fec08101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.100+0000 7febfffff640 1 -- 172.21.15.7:0/3192922037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec081a6ad0 con 0x7fec08103740 2024-09-19T08:53:24.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.100+0000 7fec077fe640 1 --2- 172.21.15.7:0/3192922037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec08102d90 0x7fec081009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:24.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.100+0000 7febfffff640 1 --2- 172.21.15.7:0/3192922037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec08103740 0x7fec08100f30 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7febf0005940 tx=0x7febf00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:24.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.100+0000 7fec057fa640 1 -- 172.21.15.7:0/3192922037 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf003f030 con 0x7fec08103740 2024-09-19T08:53:24.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.100+0000 7fec057fa640 1 -- 172.21.15.7:0/3192922037 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febf0003ce0 con 0x7fec08103740 2024-09-19T08:53:24.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.100+0000 7fec0dce1640 1 -- 172.21.15.7:0/3192922037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec081a6d60 con 0x7fec08103740 2024-09-19T08:53:24.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.100+0000 7fec057fa640 1 -- 172.21.15.7:0/3192922037 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0035070 con 0x7fec08103740 2024-09-19T08:53:24.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.100+0000 7fec0dce1640 1 -- 172.21.15.7:0/3192922037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec081a71e0 con 0x7fec08103740 2024-09-19T08:53:24.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.103+0000 7fec057fa640 1 -- 172.21.15.7:0/3192922037 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7febf0042030 con 0x7fec08103740 2024-09-19T08:53:24.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.103+0000 7fec100ba740 1 Processor -- start 2024-09-19T08:53:24.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.103+0000 7fec100ba740 1 -- start start 2024-09-19T08:53:24.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.103+0000 7fec100ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0eeb40 0x56143c0ed090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:24.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.103+0000 7fec100ba740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56143c0ed5d0 0x56143c0eda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:24.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.103+0000 7fec100ba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56143c0f8370 0x56143c0fa760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:24.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.103+0000 7fec100ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56143c0532f0 con 0x56143c0eeb40 2024-09-19T08:53:24.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.103+0000 7fec100ba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56143bffacf0 con 0x56143c0f8370 2024-09-19T08:53:24.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.103+0000 7fec100ba740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56143c04f2b0 con 0x56143c0ed5d0 2024-09-19T08:53:24.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.103+0000 7fec07fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0eeb40 0x56143c0ed090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:24.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.103+0000 7fec07fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0eeb40 0x56143c0ed090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41030/0 (socket says 172.21.15.7:41030) 2024-09-19T08:53:24.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.103+0000 7fec07fff640 1 -- 172.21.15.7:0/3989972426 learned_addr learned my addr 172.21.15.7:0/3989972426 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:24.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.103+0000 7fec077fe640 1 --2- 172.21.15.7:0/3989972426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56143c0ed5d0 0x56143c0eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:24.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.103+0000 7febfffff640 1 --2- 172.21.15.7:0/3989972426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56143c0f8370 0x56143c0fa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:24.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.104+0000 7fec057fa640 1 --2- 172.21.15.7:0/3192922037 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7febf40a33b0 0x7febf40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:24.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.104+0000 7fec07fff640 1 -- 172.21.15.7:0/3989972426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56143c0ed5d0 msgr2=0x56143c0eda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:24.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.104+0000 7fec07fff640 1 --2- 172.21.15.7:0/3989972426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56143c0ed5d0 0x56143c0eda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.104+0000 7fec07fff640 1 -- 172.21.15.7:0/3989972426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56143c0f8370 msgr2=0x56143c0fa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:24.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.104+0000 7fec07fff640 1 --2- 172.21.15.7:0/3989972426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56143c0f8370 0x56143c0fa760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.104+0000 7fec07fff640 1 -- 172.21.15.7:0/3989972426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56143bfdf3a0 con 0x56143c0eeb40 2024-09-19T08:53:24.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.104+0000 7fec057fa640 1 -- 172.21.15.7:0/3192922037 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7febf00f0330 con 0x7fec08103740 2024-09-19T08:53:24.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.104+0000 7fec07fff640 1 --2- 172.21.15.7:0/3989972426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0eeb40 0x56143c0ed090 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fec00008d40 tx=0x7fec0000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d62f87a43c2f31e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:24.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.104+0000 7fec07fff640 1 --2- 172.21.15.7:0/3192922037 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7febf40a33b0 0x7febf40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:24.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.104+0000 7febfdffb640 1 -- 172.21.15.7:0/3989972426 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec00014070 con 0x56143c0eeb40 2024-09-19T08:53:24.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.104+0000 7febfdffb640 1 -- 172.21.15.7:0/3989972426 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec00010430 con 0x56143c0eeb40 2024-09-19T08:53:24.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.104+0000 7febfdffb640 1 -- 172.21.15.7:0/3989972426 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec00018680 con 0x56143c0eeb40 2024-09-19T08:53:24.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.105+0000 7fec100ba740 1 -- 172.21.15.7:0/3989972426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0eeb40 msgr2=0x56143c0ed090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:24.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.105+0000 7fec07fff640 1 --2- 172.21.15.7:0/3192922037 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7febf40a33b0 0x7febf40a5870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fec00008fd0 tx=0x7fec00018d80 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:24.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.105+0000 7fec100ba740 1 --2- 172.21.15.7:0/3989972426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0eeb40 0x56143c0ed090 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fec00008d40 tx=0x7fec0000e720 comp rx=0 tx=0).stop 2024-09-19T08:53:24.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.105+0000 7fec100ba740 1 -- 172.21.15.7:0/3989972426 shutdown_connections 2024-09-19T08:53:24.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.105+0000 7fec100ba740 1 --2- 172.21.15.7:0/3989972426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56143c0f8370 0x56143c0fa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.105+0000 7fec100ba740 1 --2- 172.21.15.7:0/3989972426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56143c0ed5d0 0x56143c0eda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.105+0000 7fec100ba740 1 --2- 172.21.15.7:0/3989972426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0eeb40 0x56143c0ed090 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.105+0000 7fec100ba740 1 -- 172.21.15.7:0/3989972426 >> 172.21.15.7:0/3989972426 conn(0x56143c0b6310 msgr2=0x56143c0e9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:24.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.105+0000 7fec100ba740 1 -- 172.21.15.7:0/3989972426 shutdown_connections 2024-09-19T08:53:24.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.105+0000 7fec100ba740 1 -- 172.21.15.7:0/3989972426 wait complete. 2024-09-19T08:53:24.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.106+0000 7fec100ba740 1 -- start start 2024-09-19T08:53:24.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.106+0000 7fec100ba740 1 Processor -- start 2024-09-19T08:53:24.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.106+0000 7fec100ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0ed5d0 0x56143c0f7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:24.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.106+0000 7fec100ba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56143c0eeb40 0x56143c0f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:24.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.106+0000 7fec100ba740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56143c0f8370 0x56143c0f5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:24.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.106+0000 7fec100ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56143c0fb070 con 0x56143c0ed5d0 2024-09-19T08:53:24.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.106+0000 7fec100ba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56143c00e060 con 0x56143c0eeb40 2024-09-19T08:53:24.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.106+0000 7fec100ba740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56143c0fb1f0 con 0x56143c0f8370 2024-09-19T08:53:24.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.106+0000 7fec100ba740 10 client.0 _ll_register_callbacks cb 0x56143bd618c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:24.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.106+0000 7fec077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0ed5d0 0x56143c0f7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:24.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.106+0000 7fec077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0ed5d0 0x56143c0f7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41046/0 (socket says 172.21.15.7:41046) 2024-09-19T08:53:24.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.106+0000 7fec077fe640 1 -- 172.21.15.7:0/971061611 learned_addr learned my addr 172.21.15.7:0/971061611 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:24.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.106+0000 7fec07fff640 1 --2- 172.21.15.7:0/971061611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56143c0f8370 0x56143c0f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:24.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.106+0000 7febfffff640 1 --2- 172.21.15.7:0/971061611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56143c0eeb40 0x56143c0f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:24.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.107+0000 7fec077fe640 1 -- 172.21.15.7:0/971061611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56143c0f8370 msgr2=0x56143c0f5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:24.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.107+0000 7fec077fe640 1 --2- 172.21.15.7:0/971061611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56143c0f8370 0x56143c0f5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.107+0000 7fec077fe640 1 -- 172.21.15.7:0/971061611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56143c0eeb40 msgr2=0x56143c0f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:24.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.107+0000 7fec077fe640 1 --2- 172.21.15.7:0/971061611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56143c0eeb40 0x56143c0f4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.107+0000 7fec077fe640 1 -- 172.21.15.7:0/971061611 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56143bdc43c0 con 0x56143c0ed5d0 2024-09-19T08:53:24.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.107+0000 7fec077fe640 1 --2- 172.21.15.7:0/971061611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0ed5d0 0x56143c0f7d00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7febf800bf80 tx=0x7febf8011870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f180630581cc39f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:24.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.107+0000 7febe6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:53:24.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.107+0000 7febe6ffd640 1 -- 172.21.15.7:0/971061611 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf8005220 con 0x56143c0ed5d0 2024-09-19T08:53:24.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.107+0000 7febe6ffd640 1 -- 172.21.15.7:0/971061611 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7febf80053c0 con 0x56143c0ed5d0 2024-09-19T08:53:24.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.107+0000 7fec100ba740 1 -- 172.21.15.7:0/971061611 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec00010430 con 0x56143c0ed5d0 2024-09-19T08:53:24.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.107+0000 7febe6ffd640 1 -- 172.21.15.7:0/971061611 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7febf80055c0 con 0x56143c0ed5d0 2024-09-19T08:53:24.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.107+0000 7fec100ba740 10 client.17280 fetch_fsmap learned FSMap version 25 2024-09-19T08:53:24.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.107+0000 7fec100ba740 1 -- 172.21.15.7:0/971061611 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56143c106ad0 con 0x56143c0ed5d0 2024-09-19T08:53:24.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.108+0000 7febe6ffd640 1 -- 172.21.15.7:0/971061611 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec00010430 con 0x56143c0ed5d0 2024-09-19T08:53:24.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.108+0000 7febe6ffd640 1 -- 172.21.15.7:0/971061611 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7febf8012aa0 con 0x56143c0ed5d0 2024-09-19T08:53:24.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.108+0000 7fec100ba740 10 client.17280 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:53:24.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.108+0000 7fec100ba740 10 client.17280 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:24.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.108+0000 7fec100ba740 20 client.17280 populate_metadata read hostname 'smithi007' 2024-09-19T08:53:24.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.108+0000 7fec100ba740 1 --2- 172.21.15.7:0/971061611 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56143c107f90 0x56143c10a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:24.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.108+0000 7fec100ba740 4 client.17280 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:53:24.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.108+0000 7fec100ba740 1 -- 172.21.15.7:0/971061611 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56143c060860 con 0x56143c107f90 2024-09-19T08:53:24.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.108+0000 7febfffff640 1 --2- 172.21.15.7:0/971061611 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56143c107f90 0x56143c10a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:24.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.109+0000 7febfffff640 1 --2- 172.21.15.7:0/971061611 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56143c107f90 0x56143c10a3c0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9f5b1a2faee8e0e server_cookie=297f1ba009e18a1d in_seq=0 out_seq=0 2024-09-19T08:53:24.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.109+0000 7febe6ffd640 10 client.17280 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:53:24.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.109+0000 7febe6ffd640 1 -- 172.21.15.7:0/971061611 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56143c060860 con 0x56143c107f90 2024-09-19T08:53:24.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.109+0000 7febe6ffd640 10 client.17280 handle_command_reply: tid=0 2024-09-19T08:53:24.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.109+0000 7fec100ba740 1 client.17280 shutdown 2024-09-19T08:53:24.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.109+0000 7fec100ba740 1 -- 172.21.15.7:0/971061611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0ed5d0 msgr2=0x56143c0f7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:24.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.109+0000 7fec100ba740 1 --2- 172.21.15.7:0/971061611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0ed5d0 0x56143c0f7d00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7febf800bf80 tx=0x7febf8011870 comp rx=0 tx=0).stop 2024-09-19T08:53:24.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.109+0000 7fec100ba740 1 -- 172.21.15.7:0/971061611 shutdown_connections 2024-09-19T08:53:24.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.109+0000 7fec100ba740 1 --2- 172.21.15.7:0/971061611 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56143c107f90 0x56143c10a3c0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.110+0000 7fec100ba740 1 --2- 172.21.15.7:0/971061611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56143c0f8370 0x56143c0f5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.110+0000 7fec100ba740 1 --2- 172.21.15.7:0/971061611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56143c0eeb40 0x56143c0f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.110+0000 7fec100ba740 1 --2- 172.21.15.7:0/971061611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0ed5d0 0x56143c0f7d00 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.110+0000 7fec100ba740 1 -- 172.21.15.7:0/971061611 >> 172.21.15.7:0/971061611 conn(0x56143c0b6310 msgr2=0x56143c0ef930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:24.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.110+0000 7febe6ffd640 0 client.17280 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:53:24.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.110+0000 7fec100ba740 1 -- 172.21.15.7:0/971061611 shutdown_connections 2024-09-19T08:53:24.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.110+0000 7fec100ba740 1 -- 172.21.15.7:0/971061611 wait complete. 2024-09-19T08:53:24.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.110+0000 7fec100ba740 20 client.17280 trim_cache size 0 max 16384 2024-09-19T08:53:24.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.123+0000 7fec100ba740 1 Processor -- start 2024-09-19T08:53:24.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.123+0000 7fec100ba740 1 -- start start 2024-09-19T08:53:24.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.123+0000 7fec100ba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56143c0ed5d0 0x56143c0e9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:24.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.123+0000 7fec100ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0eeb40 0x56143c104340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:24.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.123+0000 7fec100ba740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56143c0f8370 0x56143c0f0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:24.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.123+0000 7fec100ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fec081b24b0 con 0x56143c0eeb40 2024-09-19T08:53:24.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.123+0000 7fec100ba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fec081afd80 con 0x56143c0ed5d0 2024-09-19T08:53:24.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.123+0000 7fec100ba740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fec081adbf0 con 0x56143c0f8370 2024-09-19T08:53:24.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.123+0000 7febfffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0eeb40 0x56143c104340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:24.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.123+0000 7febfffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0eeb40 0x56143c104340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41060/0 (socket says 172.21.15.7:41060) 2024-09-19T08:53:24.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.123+0000 7febfffff640 1 -- 172.21.15.7:0/2398316600 learned_addr learned my addr 172.21.15.7:0/2398316600 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:24.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.124+0000 7fec077fe640 1 --2- 172.21.15.7:0/2398316600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56143c0ed5d0 0x56143c0e9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:24.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.124+0000 7fec07fff640 1 --2- 172.21.15.7:0/2398316600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56143c0f8370 0x56143c0f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:24.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.124+0000 7febfffff640 1 -- 172.21.15.7:0/2398316600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56143c0f8370 msgr2=0x56143c0f0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:24.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.124+0000 7febfffff640 1 --2- 172.21.15.7:0/2398316600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56143c0f8370 0x56143c0f0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.124+0000 7febfffff640 1 -- 172.21.15.7:0/2398316600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56143c0ed5d0 msgr2=0x56143c0e9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:24.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.124+0000 7febfffff640 1 --2- 172.21.15.7:0/2398316600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56143c0ed5d0 0x56143c0e9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.124+0000 7febfffff640 1 -- 172.21.15.7:0/2398316600 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56143c0ed2d0 con 0x56143c0eeb40 2024-09-19T08:53:24.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.124+0000 7fec07fff640 1 --2- 172.21.15.7:0/2398316600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56143c0f8370 0x56143c0f0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:24.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.124+0000 7febfffff640 1 --2- 172.21.15.7:0/2398316600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0eeb40 0x56143c104340 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7febf00096c0 tx=0x7febf002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57dcb4af564369f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:24.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.124+0000 7febfd7fa640 1 -- 172.21.15.7:0/2398316600 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0049070 con 0x56143c0eeb40 2024-09-19T08:53:24.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.124+0000 7febfd7fa640 1 -- 172.21.15.7:0/2398316600 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febf00bccd0 con 0x56143c0eeb40 2024-09-19T08:53:24.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.124+0000 7febfd7fa640 1 -- 172.21.15.7:0/2398316600 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf00ba8d0 con 0x56143c0eeb40 2024-09-19T08:53:24.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.125+0000 7fec100ba740 1 -- 172.21.15.7:0/2398316600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0eeb40 msgr2=0x56143c104340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:24.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.125+0000 7fec100ba740 1 --2- 172.21.15.7:0/2398316600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0eeb40 0x56143c104340 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7febf00096c0 tx=0x7febf002a420 comp rx=0 tx=0).stop 2024-09-19T08:53:24.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.125+0000 7fec100ba740 1 -- 172.21.15.7:0/2398316600 shutdown_connections 2024-09-19T08:53:24.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.125+0000 7fec100ba740 1 --2- 172.21.15.7:0/2398316600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56143c0f8370 0x56143c0f0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.125+0000 7fec100ba740 1 --2- 172.21.15.7:0/2398316600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0eeb40 0x56143c104340 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.125+0000 7fec100ba740 1 --2- 172.21.15.7:0/2398316600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56143c0ed5d0 0x56143c0e9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.125+0000 7fec100ba740 1 -- 172.21.15.7:0/2398316600 >> 172.21.15.7:0/2398316600 conn(0x56143c0b6310 msgr2=0x56143c0e9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:24.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.125+0000 7fec100ba740 1 -- 172.21.15.7:0/2398316600 shutdown_connections 2024-09-19T08:53:24.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.125+0000 7fec100ba740 1 -- 172.21.15.7:0/2398316600 wait complete. 2024-09-19T08:53:24.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.125+0000 7fec100ba740 1 -- start start 2024-09-19T08:53:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.126+0000 7fec100ba740 1 Processor -- start 2024-09-19T08:53:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.126+0000 7fec100ba740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56143c0ed5d0 0x56143c100690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.126+0000 7fec100ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0eeb40 0x56143c100bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.126+0000 7fec100ba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56143c0f8370 0x56143c0f1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.126+0000 7fec100ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fec081ae240 con 0x56143c0eeb40 2024-09-19T08:53:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.126+0000 7fec100ba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fec081af6b0 con 0x56143c0f8370 2024-09-19T08:53:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.126+0000 7fec100ba740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fec081ae910 con 0x56143c0ed5d0 2024-09-19T08:53:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.126+0000 7fec100ba740 10 client.0 _ll_register_callbacks cb 0x7febf800b4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.126+0000 7febfffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0eeb40 0x56143c100bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.126+0000 7febfffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0eeb40 0x56143c100bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41066/0 (socket says 172.21.15.7:41066) 2024-09-19T08:53:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.126+0000 7febfffff640 1 -- 172.21.15.7:0/4154557929 learned_addr learned my addr 172.21.15.7:0/4154557929 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.126+0000 7fec07fff640 1 --2- 172.21.15.7:0/4154557929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56143c0f8370 0x56143c0f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.126+0000 7fec077fe640 1 --2- 172.21.15.7:0/4154557929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56143c0ed5d0 0x56143c100690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:24.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.126+0000 7febfffff640 1 -- 172.21.15.7:0/4154557929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56143c0ed5d0 msgr2=0x56143c100690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:24.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.126+0000 7febfffff640 1 --2- 172.21.15.7:0/4154557929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56143c0ed5d0 0x56143c100690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.126+0000 7febfffff640 1 -- 172.21.15.7:0/4154557929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56143c0f8370 msgr2=0x56143c0f1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:24.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.126+0000 7febfffff640 1 --2- 172.21.15.7:0/4154557929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56143c0f8370 0x56143c0f1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.126+0000 7febfffff640 1 -- 172.21.15.7:0/4154557929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56143c0f1f60 con 0x56143c0eeb40 2024-09-19T08:53:24.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.126+0000 7febfffff640 1 --2- 172.21.15.7:0/4154557929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0eeb40 0x56143c100bd0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7febf00bc2d0 tx=0x7febf0009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb24db5c74ff0f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:24.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.126+0000 7febe6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:53:24.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.127+0000 7febe6ffd640 1 -- 172.21.15.7:0/4154557929 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0049040 con 0x56143c0eeb40 2024-09-19T08:53:24.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.127+0000 7febe6ffd640 1 -- 172.21.15.7:0/4154557929 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7febf00ba8d0 con 0x56143c0eeb40 2024-09-19T08:53:24.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.127+0000 7fec100ba740 1 -- 172.21.15.7:0/4154557929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febf00bccd0 con 0x56143c0eeb40 2024-09-19T08:53:24.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.127+0000 7febe6ffd640 1 -- 172.21.15.7:0/4154557929 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7febf00c5240 con 0x56143c0eeb40 2024-09-19T08:53:24.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.127+0000 7fec100ba740 10 client.17286 fetch_fsmap learned FSMap version 25 2024-09-19T08:53:24.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.127+0000 7fec100ba740 1 -- 172.21.15.7:0/4154557929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56143c172660 con 0x56143c0eeb40 2024-09-19T08:53:24.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.127+0000 7febe6ffd640 1 -- 172.21.15.7:0/4154557929 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febf00bccd0 con 0x56143c0eeb40 2024-09-19T08:53:24.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.127+0000 7febe6ffd640 1 -- 172.21.15.7:0/4154557929 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7febf0031bd0 con 0x56143c0eeb40 2024-09-19T08:53:24.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.127+0000 7fec100ba740 10 client.17286 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:53:24.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.127+0000 7fec100ba740 10 client.17286 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:24.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.127+0000 7fec100ba740 20 client.17286 populate_metadata read hostname 'smithi007' 2024-09-19T08:53:24.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.127+0000 7fec100ba740 1 --2- 172.21.15.7:0/4154557929 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56143c172d20 0x56143c175110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:24.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.127+0000 7fec100ba740 4 client.17286 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:53:24.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.127+0000 7fec100ba740 1 -- 172.21.15.7:0/4154557929 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56143c05ad70 con 0x56143c172d20 2024-09-19T08:53:24.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.128+0000 7fec077fe640 1 --2- 172.21.15.7:0/4154557929 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56143c172d20 0x56143c175110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:24.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.128+0000 7fec077fe640 1 --2- 172.21.15.7:0/4154557929 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56143c172d20 0x56143c175110 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=604706522cc574b4 server_cookie=12c077f3e904dd6b in_seq=0 out_seq=0 2024-09-19T08:53:24.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.128+0000 7febe6ffd640 10 client.17286 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:53:24.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.128+0000 7febe6ffd640 1 -- 172.21.15.7:0/4154557929 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56143c05ad70 con 0x56143c172d20 2024-09-19T08:53:24.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.128+0000 7febe6ffd640 10 client.17286 handle_command_reply: tid=0 2024-09-19T08:53:24.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.128+0000 7fec100ba740 1 client.17286 shutdown 2024-09-19T08:53:24.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.128+0000 7fec100ba740 1 -- 172.21.15.7:0/4154557929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0eeb40 msgr2=0x56143c100bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:24.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.128+0000 7fec100ba740 1 --2- 172.21.15.7:0/4154557929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0eeb40 0x56143c100bd0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7febf00bc2d0 tx=0x7febf0009650 comp rx=0 tx=0).stop 2024-09-19T08:53:24.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.128+0000 7fec100ba740 1 -- 172.21.15.7:0/4154557929 shutdown_connections 2024-09-19T08:53:24.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.128+0000 7fec100ba740 1 --2- 172.21.15.7:0/4154557929 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56143c172d20 0x56143c175110 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.128+0000 7fec100ba740 1 --2- 172.21.15.7:0/4154557929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56143c0f8370 0x56143c0f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.128+0000 7fec100ba740 1 --2- 172.21.15.7:0/4154557929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56143c0eeb40 0x56143c100bd0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.128+0000 7febe6ffd640 0 client.17286 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:53:24.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.128+0000 7fec100ba740 1 --2- 172.21.15.7:0/4154557929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56143c0ed5d0 0x56143c100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.128+0000 7fec100ba740 1 -- 172.21.15.7:0/4154557929 >> 172.21.15.7:0/4154557929 conn(0x56143c0b6310 msgr2=0x56143c0e84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:24.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.129+0000 7fec100ba740 1 -- 172.21.15.7:0/4154557929 shutdown_connections 2024-09-19T08:53:24.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.129+0000 7fec100ba740 1 -- 172.21.15.7:0/4154557929 wait complete. 2024-09-19T08:53:24.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.129+0000 7fec100ba740 20 client.17286 trim_cache size 0 max 16384 2024-09-19T08:53:24.134 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:53:24.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.129+0000 7fec0dce1640 1 -- 172.21.15.7:0/3192922037 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7febf40a33b0 msgr2=0x7febf40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:24.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.129+0000 7fec0dce1640 1 --2- 172.21.15.7:0/3192922037 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7febf40a33b0 0x7febf40a5870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fec00008fd0 tx=0x7fec00018d80 comp rx=0 tx=0).stop 2024-09-19T08:53:24.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.129+0000 7fec0dce1640 1 -- 172.21.15.7:0/3192922037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec08103740 msgr2=0x7fec08100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:24.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.129+0000 7fec0dce1640 1 --2- 172.21.15.7:0/3192922037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec08103740 0x7fec08100f30 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7febf0005940 tx=0x7febf00042f0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.129+0000 7fec0dce1640 1 -- 172.21.15.7:0/3192922037 shutdown_connections 2024-09-19T08:53:24.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.129+0000 7fec0dce1640 1 --2- 172.21.15.7:0/3192922037 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7febf40a33b0 0x7febf40a5870 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.129+0000 7fec0dce1640 1 --2- 172.21.15.7:0/3192922037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec08108290 0x7fec08101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.129+0000 7fec0dce1640 1 --2- 172.21.15.7:0/3192922037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec08103740 0x7fec08100f30 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.129+0000 7fec0dce1640 1 --2- 172.21.15.7:0/3192922037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec08102d90 0x7fec081009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:24.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.129+0000 7fec0dce1640 1 -- 172.21.15.7:0/3192922037 >> 172.21.15.7:0/3192922037 conn(0x7fec080fc7d0 msgr2=0x7fec08105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:24.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.129+0000 7fec0dce1640 1 -- 172.21.15.7:0/3192922037 shutdown_connections 2024-09-19T08:53:24.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:24.129+0000 7fec0dce1640 1 -- 172.21.15.7:0/3192922037 wait complete. 2024-09-19T08:53:24.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:24 smithi007 ceph-mon[31221]: pgmap v275: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:53:24.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:24 smithi175 ceph-mon[35688]: pgmap v275: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:53:24.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:24 smithi044 ceph-mon[35072]: pgmap v275: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:53:25.815 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:53:25.816 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:53:26.085 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:26.470 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:26 smithi007 ceph-mon[31221]: pgmap v276: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:53:26.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.556+0000 7f00e86eb640 1 -- 172.21.15.7:0/1891896603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00e0102790 msgr2=0x7f00e01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:26.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.556+0000 7f00e86eb640 1 --2- 172.21.15.7:0/1891896603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00e0102790 0x7f00e01067e0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f00d0009900 tx=0x7f00d002a410 comp rx=0 tx=0).stop 2024-09-19T08:53:26.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.556+0000 7f00e86eb640 1 -- 172.21.15.7:0/1891896603 shutdown_connections 2024-09-19T08:53:26.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.556+0000 7f00e86eb640 1 --2- 172.21.15.7:0/1891896603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e0106f10 0x7f00e010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.556+0000 7f00e86eb640 1 --2- 172.21.15.7:0/1891896603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00e0102790 0x7f00e01067e0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.556+0000 7f00e86eb640 1 --2- 172.21.15.7:0/1891896603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00e0101de0 0x7f00e01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.556+0000 7f00e86eb640 1 -- 172.21.15.7:0/1891896603 >> 172.21.15.7:0/1891896603 conn(0x7f00e00fd8c0 msgr2=0x7f00e00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:26.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.556+0000 7f00e86eb640 1 -- 172.21.15.7:0/1891896603 shutdown_connections 2024-09-19T08:53:26.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.556+0000 7f00e86eb640 1 -- 172.21.15.7:0/1891896603 wait complete. 2024-09-19T08:53:26.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.556+0000 7f00e86eb640 1 Processor -- start 2024-09-19T08:53:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.557+0000 7f00e86eb640 1 -- start start 2024-09-19T08:53:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.557+0000 7f00e86eb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e0101de0 0x7f00e0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.557+0000 7f00e86eb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00e0102790 0x7f00e0198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.557+0000 7f00e86eb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00e0106f10 0x7f00e019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.557+0000 7f00e86eb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f00e0111f70 con 0x7f00e0106f10 2024-09-19T08:53:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.557+0000 7f00e86eb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f00e0111df0 con 0x7f00e0101de0 2024-09-19T08:53:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.557+0000 7f00e86eb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f00e01120f0 con 0x7f00e0102790 2024-09-19T08:53:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.557+0000 7f00e6c88640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00e0106f10 0x7f00e019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.557+0000 7f00e6c88640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00e0106f10 0x7f00e019cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41088/0 (socket says 172.21.15.7:41088) 2024-09-19T08:53:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.557+0000 7f00e6c88640 1 -- 172.21.15.7:0/973183835 learned_addr learned my addr 172.21.15.7:0/973183835 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.557+0000 7f00e5c86640 1 --2- 172.21.15.7:0/973183835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00e0102790 0x7f00e0198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.557+0000 7f00e6487640 1 --2- 172.21.15.7:0/973183835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e0101de0 0x7f00e0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.557+0000 7f00e6c88640 1 -- 172.21.15.7:0/973183835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00e0102790 msgr2=0x7f00e0198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.557+0000 7f00e6c88640 1 --2- 172.21.15.7:0/973183835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00e0102790 0x7f00e0198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.557+0000 7f00e6c88640 1 -- 172.21.15.7:0/973183835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e0101de0 msgr2=0x7f00e0198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.557+0000 7f00e6c88640 1 --2- 172.21.15.7:0/973183835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e0101de0 0x7f00e0198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.557+0000 7f00e6c88640 1 -- 172.21.15.7:0/973183835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e019d3e0 con 0x7f00e0106f10 2024-09-19T08:53:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.558+0000 7f00e6c88640 1 --2- 172.21.15.7:0/973183835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00e0106f10 0x7f00e019cd00 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f00d800eb10 tx=0x7f00d800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.558+0000 7f00d77fe640 1 -- 172.21.15.7:0/973183835 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d8004b20 con 0x7f00e0106f10 2024-09-19T08:53:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.558+0000 7f00e86eb640 1 -- 172.21.15.7:0/973183835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e019d6d0 con 0x7f00e0106f10 2024-09-19T08:53:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.558+0000 7f00d77fe640 1 -- 172.21.15.7:0/973183835 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00d8004cc0 con 0x7f00e0106f10 2024-09-19T08:53:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.558+0000 7f00d77fe640 1 -- 172.21.15.7:0/973183835 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d8010760 con 0x7f00e0106f10 2024-09-19T08:53:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.558+0000 7f00e86eb640 1 -- 172.21.15.7:0/973183835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e01a4fb0 con 0x7f00e0106f10 2024-09-19T08:53:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.560+0000 7f00d77fe640 1 -- 172.21.15.7:0/973183835 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f00d8005020 con 0x7f00e0106f10 2024-09-19T08:53:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.561+0000 7f00eaac4740 1 Processor -- start 2024-09-19T08:53:26.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.561+0000 7f00eaac4740 1 -- start start 2024-09-19T08:53:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.561+0000 7f00eaac4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2be598b60 0x55b2be598f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.561+0000 7f00eaac4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be599480 0x55b2be5a3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.561+0000 7f00eaac4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2be5a3d40 0x55b2be5a6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.561+0000 7f00eaac4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b2be4fe280 con 0x55b2be599480 2024-09-19T08:53:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.561+0000 7f00eaac4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b2be4a5b10 con 0x55b2be5a3d40 2024-09-19T08:53:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.561+0000 7f00eaac4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b2be4fa240 con 0x55b2be598b60 2024-09-19T08:53:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.561+0000 7f00e6487640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be599480 0x55b2be5a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.561+0000 7f00e6487640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be599480 0x55b2be5a3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41092/0 (socket says 172.21.15.7:41092) 2024-09-19T08:53:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.561+0000 7f00e6487640 1 -- 172.21.15.7:0/1947323444 learned_addr learned my addr 172.21.15.7:0/1947323444 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.561+0000 7f00d77fe640 1 --2- 172.21.15.7:0/973183835 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f00cc0a33b0 0x7f00cc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.562+0000 7f00e5c86640 1 --2- 172.21.15.7:0/1947323444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2be598b60 0x55b2be598f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.562+0000 7f00e6487640 1 -- 172.21.15.7:0/1947323444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2be598b60 msgr2=0x55b2be598f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:26.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.562+0000 7f00e5c86640 1 --2- 172.21.15.7:0/1947323444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2be5a3d40 0x55b2be5a6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.562+0000 7f00e6487640 1 --2- 172.21.15.7:0/1947323444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2be598b60 0x55b2be598f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.562+0000 7f00e6487640 1 -- 172.21.15.7:0/1947323444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2be5a3d40 msgr2=0x55b2be5a6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.562+0000 7f00e6487640 1 --2- 172.21.15.7:0/1947323444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2be5a3d40 0x55b2be5a6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.562+0000 7f00e6487640 1 -- 172.21.15.7:0/1947323444 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2be4b21f0 con 0x55b2be599480 2024-09-19T08:53:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.562+0000 7f00e6c88640 1 --2- 172.21.15.7:0/973183835 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f00cc0a33b0 0x7f00cc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.562+0000 7f00e5c86640 1 --2- 172.21.15.7:0/1947323444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2be5a3d40 0x55b2be5a6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.562+0000 7f00e6487640 1 --2- 172.21.15.7:0/1947323444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be599480 0x55b2be5a3800 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00bcf0 tx=0x7f00dc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f9623c795dace1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.562+0000 7f00d77fe640 1 -- 172.21.15.7:0/973183835 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7f00d80d0360 con 0x7f00e0106f10 2024-09-19T08:53:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.562+0000 7f00d4ff9640 1 -- 172.21.15.7:0/1947323444 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc015070 con 0x55b2be599480 2024-09-19T08:53:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.562+0000 7f00e6c88640 1 --2- 172.21.15.7:0/973183835 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f00cc0a33b0 0x7f00cc0a5870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f00d807cad0 tx=0x7f00d8067380 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.562+0000 7f00d4ff9640 1 -- 172.21.15.7:0/1947323444 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00dc011920 con 0x55b2be599480 2024-09-19T08:53:26.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.562+0000 7f00d4ff9640 1 -- 172.21.15.7:0/1947323444 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc010930 con 0x55b2be599480 2024-09-19T08:53:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.563+0000 7f00eaac4740 1 -- 172.21.15.7:0/1947323444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be599480 msgr2=0x55b2be5a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.563+0000 7f00eaac4740 1 --2- 172.21.15.7:0/1947323444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be599480 0x55b2be5a3800 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00bcf0 tx=0x7f00dc00f730 comp rx=0 tx=0).stop 2024-09-19T08:53:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.563+0000 7f00eaac4740 1 -- 172.21.15.7:0/1947323444 shutdown_connections 2024-09-19T08:53:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.563+0000 7f00eaac4740 1 --2- 172.21.15.7:0/1947323444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2be5a3d40 0x55b2be5a6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.563+0000 7f00eaac4740 1 --2- 172.21.15.7:0/1947323444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be599480 0x55b2be5a3800 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.563+0000 7f00eaac4740 1 --2- 172.21.15.7:0/1947323444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2be598b60 0x55b2be598f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.563+0000 7f00eaac4740 1 -- 172.21.15.7:0/1947323444 >> 172.21.15.7:0/1947323444 conn(0x55b2be5950f0 msgr2=0x55b2be5954d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.563+0000 7f00eaac4740 1 -- 172.21.15.7:0/1947323444 shutdown_connections 2024-09-19T08:53:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.563+0000 7f00eaac4740 1 -- 172.21.15.7:0/1947323444 wait complete. 2024-09-19T08:53:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.563+0000 7f00eaac4740 1 -- start start 2024-09-19T08:53:26.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.564+0000 7f00eaac4740 1 Processor -- start 2024-09-19T08:53:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.564+0000 7f00eaac4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2be598b60 0x55b2be5a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.564+0000 7f00eaac4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2be599480 0x55b2be5a1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.564+0000 7f00eaac4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be5a3d40 0x55b2be5a1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.564+0000 7f00eaac4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b2be5a6910 con 0x55b2be5a3d40 2024-09-19T08:53:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.564+0000 7f00eaac4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b2be4b8f10 con 0x55b2be599480 2024-09-19T08:53:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.564+0000 7f00eaac4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b2be5a6a90 con 0x55b2be598b60 2024-09-19T08:53:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.564+0000 7f00eaac4740 10 client.0 _ll_register_callbacks cb 0x55b2be481a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.564+0000 7f00e5c86640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be5a3d40 0x55b2be5a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.564+0000 7f00e5c86640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be5a3d40 0x55b2be5a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41106/0 (socket says 172.21.15.7:41106) 2024-09-19T08:53:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.564+0000 7f00e5c86640 1 -- 172.21.15.7:0/3743251335 learned_addr learned my addr 172.21.15.7:0/3743251335 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.564+0000 7f00e5c86640 1 --2- 172.21.15.7:0/3743251335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2be598b60 0x55b2be5a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.564+0000 7f00e6487640 1 --2- 172.21.15.7:0/3743251335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2be599480 0x55b2be5a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.564+0000 7f00e5c86640 1 -- 172.21.15.7:0/3743251335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2be598b60 msgr2=0x55b2be5a0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.564+0000 7f00e5c86640 1 --2- 172.21.15.7:0/3743251335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2be598b60 0x55b2be5a0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.564+0000 7f00e5c86640 1 -- 172.21.15.7:0/3743251335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2be599480 msgr2=0x55b2be5a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.564+0000 7f00e5c86640 1 --2- 172.21.15.7:0/3743251335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2be599480 0x55b2be5a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.564+0000 7f00e5c86640 1 -- 172.21.15.7:0/3743251335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2be26f6a0 con 0x55b2be5a3d40 2024-09-19T08:53:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.564+0000 7f00e5c86640 1 --2- 172.21.15.7:0/3743251335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be5a3d40 0x55b2be5a1680 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f00d002a930 tx=0x7f00d0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6039f4a8f8f49d27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.564+0000 7f00c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:53:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.565+0000 7f00c9ffb640 1 -- 172.21.15.7:0/3743251335 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d0035030 con 0x55b2be5a3d40 2024-09-19T08:53:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.565+0000 7f00c9ffb640 1 -- 172.21.15.7:0/3743251335 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7f00d0004030 con 0x55b2be5a3d40 2024-09-19T08:53:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.565+0000 7f00eaac4740 1 -- 172.21.15.7:0/3743251335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00dc011920 con 0x55b2be5a3d40 2024-09-19T08:53:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.565+0000 7f00c9ffb640 1 -- 172.21.15.7:0/3743251335 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f00d0051050 con 0x55b2be5a3d40 2024-09-19T08:53:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.565+0000 7f00eaac4740 10 client.17298 fetch_fsmap learned FSMap version 25 2024-09-19T08:53:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.565+0000 7f00eaac4740 1 -- 172.21.15.7:0/3743251335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b2be5b2460 con 0x55b2be5a3d40 2024-09-19T08:53:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.565+0000 7f00c9ffb640 1 -- 172.21.15.7:0/3743251335 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00dc011920 con 0x55b2be5a3d40 2024-09-19T08:53:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.565+0000 7f00c9ffb640 1 -- 172.21.15.7:0/3743251335 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f00d0049020 con 0x55b2be5a3d40 2024-09-19T08:53:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.565+0000 7f00eaac4740 10 client.17298 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:53:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.565+0000 7f00eaac4740 10 client.17298 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.565+0000 7f00eaac4740 20 client.17298 populate_metadata read hostname 'smithi007' 2024-09-19T08:53:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.565+0000 7f00eaac4740 1 --2- 172.21.15.7:0/3743251335 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b2be5b3920 0x55b2be5b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.565+0000 7f00eaac4740 4 client.17298 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:53:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.565+0000 7f00eaac4740 1 -- 172.21.15.7:0/3743251335 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2be50b7f0 con 0x55b2be5b3920 2024-09-19T08:53:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.566+0000 7f00e6487640 1 --2- 172.21.15.7:0/3743251335 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b2be5b3920 0x55b2be5b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.566+0000 7f00e6487640 1 --2- 172.21.15.7:0/3743251335 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b2be5b3920 0x55b2be5b5d10 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=340da5e587d71d88 server_cookie=73b0b6b25e93e603 in_seq=0 out_seq=0 2024-09-19T08:53:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.566+0000 7f00c9ffb640 10 client.17298 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:53:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.567+0000 7f00c9ffb640 1 -- 172.21.15.7:0/3743251335 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b2be50b7f0 con 0x55b2be5b3920 2024-09-19T08:53:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.567+0000 7f00c9ffb640 10 client.17298 handle_command_reply: tid=0 2024-09-19T08:53:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.567+0000 7f00eaac4740 1 client.17298 shutdown 2024-09-19T08:53:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.567+0000 7f00eaac4740 1 -- 172.21.15.7:0/3743251335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be5a3d40 msgr2=0x55b2be5a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.567+0000 7f00eaac4740 1 --2- 172.21.15.7:0/3743251335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be5a3d40 0x55b2be5a1680 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f00d002a930 tx=0x7f00d0009260 comp rx=0 tx=0).stop 2024-09-19T08:53:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.567+0000 7f00eaac4740 1 -- 172.21.15.7:0/3743251335 shutdown_connections 2024-09-19T08:53:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.567+0000 7f00eaac4740 1 --2- 172.21.15.7:0/3743251335 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b2be5b3920 0x55b2be5b5d10 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.567+0000 7f00eaac4740 1 --2- 172.21.15.7:0/3743251335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be5a3d40 0x55b2be5a1680 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.567+0000 7f00eaac4740 1 --2- 172.21.15.7:0/3743251335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2be599480 0x55b2be5a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.567+0000 7f00c9ffb640 0 client.17298 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:53:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.567+0000 7f00eaac4740 1 --2- 172.21.15.7:0/3743251335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2be598b60 0x55b2be5a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.567+0000 7f00eaac4740 1 -- 172.21.15.7:0/3743251335 >> 172.21.15.7:0/3743251335 conn(0x55b2be5950f0 msgr2=0x55b2be594270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.567+0000 7f00eaac4740 1 -- 172.21.15.7:0/3743251335 shutdown_connections 2024-09-19T08:53:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.567+0000 7f00eaac4740 1 -- 172.21.15.7:0/3743251335 wait complete. 2024-09-19T08:53:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.567+0000 7f00eaac4740 20 client.17298 trim_cache size 0 max 16384 2024-09-19T08:53:26.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.585+0000 7f00eaac4740 1 Processor -- start 2024-09-19T08:53:26.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.585+0000 7f00eaac4740 1 -- start start 2024-09-19T08:53:26.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.585+0000 7f00eaac4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be598b60 0x55b2be59b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.585+0000 7f00eaac4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2be599480 0x55b2be5ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.585+0000 7f00eaac4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2be5a3d40 0x55b2be5ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.585+0000 7f00eaac4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f00e01b0250 con 0x55b2be598b60 2024-09-19T08:53:26.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.585+0000 7f00eaac4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f00e01adb20 con 0x55b2be599480 2024-09-19T08:53:26.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.585+0000 7f00eaac4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f00e01ab990 con 0x55b2be5a3d40 2024-09-19T08:53:26.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.585+0000 7f00e5c86640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be598b60 0x55b2be59b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.585+0000 7f00e5c86640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be598b60 0x55b2be59b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41110/0 (socket says 172.21.15.7:41110) 2024-09-19T08:53:26.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.585+0000 7f00e5c86640 1 -- 172.21.15.7:0/3759011227 learned_addr learned my addr 172.21.15.7:0/3759011227 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:26.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.585+0000 7f00e5c86640 1 -- 172.21.15.7:0/3759011227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2be5a3d40 msgr2=0x55b2be5ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:26.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.585+0000 7f00e5c86640 1 --2- 172.21.15.7:0/3759011227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2be5a3d40 0x55b2be5ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.585+0000 7f00e6487640 1 --2- 172.21.15.7:0/3759011227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2be599480 0x55b2be5ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.585+0000 7f00e5c86640 1 -- 172.21.15.7:0/3759011227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2be599480 msgr2=0x55b2be5ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:26.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.585+0000 7f00e5c86640 1 --2- 172.21.15.7:0/3759011227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2be599480 0x55b2be5ac0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.585+0000 7f00e5c86640 1 -- 172.21.15.7:0/3759011227 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2be5b6080 con 0x55b2be598b60 2024-09-19T08:53:26.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.585+0000 7f00e6487640 1 --2- 172.21.15.7:0/3759011227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2be599480 0x55b2be5ac0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:26.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.585+0000 7f00e5c86640 1 --2- 172.21.15.7:0/3759011227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be598b60 0x55b2be59b5c0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f00d00096c0 tx=0x7f00d0005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9364e43b3bf6ce6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:26.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.586+0000 7f00cbfff640 1 -- 172.21.15.7:0/3759011227 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d0035040 con 0x55b2be598b60 2024-09-19T08:53:26.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.586+0000 7f00cbfff640 1 -- 172.21.15.7:0/3759011227 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00d00044a0 con 0x55b2be598b60 2024-09-19T08:53:26.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.586+0000 7f00cbfff640 1 -- 172.21.15.7:0/3759011227 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d0005040 con 0x55b2be598b60 2024-09-19T08:53:26.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.586+0000 7f00eaac4740 1 -- 172.21.15.7:0/3759011227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be598b60 msgr2=0x55b2be59b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:26.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.586+0000 7f00eaac4740 1 --2- 172.21.15.7:0/3759011227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be598b60 0x55b2be59b5c0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f00d00096c0 tx=0x7f00d0005e30 comp rx=0 tx=0).stop 2024-09-19T08:53:26.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.586+0000 7f00eaac4740 1 -- 172.21.15.7:0/3759011227 shutdown_connections 2024-09-19T08:53:26.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.586+0000 7f00eaac4740 1 --2- 172.21.15.7:0/3759011227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2be5a3d40 0x55b2be5ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.586+0000 7f00eaac4740 1 --2- 172.21.15.7:0/3759011227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2be599480 0x55b2be5ac0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.586+0000 7f00eaac4740 1 --2- 172.21.15.7:0/3759011227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be598b60 0x55b2be59b5c0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.586+0000 7f00eaac4740 1 -- 172.21.15.7:0/3759011227 >> 172.21.15.7:0/3759011227 conn(0x55b2be5950f0 msgr2=0x55b2be5a2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:26.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.586+0000 7f00eaac4740 1 -- 172.21.15.7:0/3759011227 shutdown_connections 2024-09-19T08:53:26.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.586+0000 7f00eaac4740 1 -- 172.21.15.7:0/3759011227 wait complete. 2024-09-19T08:53:26.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.587+0000 7f00eaac4740 1 -- start start 2024-09-19T08:53:26.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.587+0000 7f00eaac4740 1 Processor -- start 2024-09-19T08:53:26.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.587+0000 7f00eaac4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2be598b60 0x55b2be59e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.587+0000 7f00eaac4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2be599480 0x55b2be59e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.587+0000 7f00eaac4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be5a3d40 0x55b2be59ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.587+0000 7f00eaac4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f00e01abfe0 con 0x55b2be5a3d40 2024-09-19T08:53:26.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.587+0000 7f00eaac4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f00e01ad450 con 0x55b2be599480 2024-09-19T08:53:26.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.587+0000 7f00eaac4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f00e01ac6b0 con 0x55b2be598b60 2024-09-19T08:53:26.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.587+0000 7f00eaac4740 10 client.0 _ll_register_callbacks cb 0x7f00d0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:26.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.587+0000 7f00e5c86640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be5a3d40 0x55b2be59ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.587+0000 7f00e5c86640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be5a3d40 0x55b2be59ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41122/0 (socket says 172.21.15.7:41122) 2024-09-19T08:53:26.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.587+0000 7f00e5c86640 1 -- 172.21.15.7:0/909762 learned_addr learned my addr 172.21.15.7:0/909762 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:26.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.587+0000 7f00e6487640 1 --2- 172.21.15.7:0/909762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2be599480 0x55b2be59e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.587+0000 7f00e5c86640 1 --2- 172.21.15.7:0/909762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2be598b60 0x55b2be59e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.587+0000 7f00e5c86640 1 -- 172.21.15.7:0/909762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2be598b60 msgr2=0x55b2be59e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:26.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.587+0000 7f00e5c86640 1 --2- 172.21.15.7:0/909762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2be598b60 0x55b2be59e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.587+0000 7f00e5c86640 1 -- 172.21.15.7:0/909762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2be599480 msgr2=0x55b2be59e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:26.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.587+0000 7f00e5c86640 1 --2- 172.21.15.7:0/909762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2be599480 0x55b2be59e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.587+0000 7f00e5c86640 1 -- 172.21.15.7:0/909762 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2be59d6a0 con 0x55b2be5a3d40 2024-09-19T08:53:26.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.588+0000 7f00e5c86640 1 --2- 172.21.15.7:0/909762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be5a3d40 0x55b2be59ce70 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f00d00316c0 tx=0x7f00d0003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeefedc7580b9965 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:26.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.588+0000 7f00c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:53:26.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.588+0000 7f00c9ffb640 1 -- 172.21.15.7:0/909762 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d0003f70 con 0x55b2be5a3d40 2024-09-19T08:53:26.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.588+0000 7f00c9ffb640 1 -- 172.21.15.7:0/909762 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7f00d0004110 con 0x55b2be5a3d40 2024-09-19T08:53:26.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.588+0000 7f00eaac4740 1 -- 172.21.15.7:0/909762 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00d00044a0 con 0x55b2be5a3d40 2024-09-19T08:53:26.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.588+0000 7f00c9ffb640 1 -- 172.21.15.7:0/909762 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f00d00046c0 con 0x55b2be5a3d40 2024-09-19T08:53:26.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.588+0000 7f00eaac4740 10 client.17304 fetch_fsmap learned FSMap version 25 2024-09-19T08:53:26.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.588+0000 7f00eaac4740 1 -- 172.21.15.7:0/909762 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b2be623060 con 0x55b2be5a3d40 2024-09-19T08:53:26.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.588+0000 7f00c9ffb640 1 -- 172.21.15.7:0/909762 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00d00044a0 con 0x55b2be5a3d40 2024-09-19T08:53:26.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.588+0000 7f00c9ffb640 1 -- 172.21.15.7:0/909762 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f00d0049070 con 0x55b2be5a3d40 2024-09-19T08:53:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.588+0000 7f00eaac4740 10 client.17304 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:53:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.588+0000 7f00eaac4740 10 client.17304 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.588+0000 7f00eaac4740 20 client.17304 populate_metadata read hostname 'smithi007' 2024-09-19T08:53:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.588+0000 7f00eaac4740 1 --2- 172.21.15.7:0/909762 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b2be6236c0 0x55b2be625ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.588+0000 7f00eaac4740 4 client.17304 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:53:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.588+0000 7f00eaac4740 1 -- 172.21.15.7:0/909762 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b2be505d00 con 0x55b2be6236c0 2024-09-19T08:53:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.589+0000 7f00e6487640 1 --2- 172.21.15.7:0/909762 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b2be6236c0 0x55b2be625ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.589+0000 7f00e6487640 1 --2- 172.21.15.7:0/909762 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b2be6236c0 0x55b2be625ab0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75ffc893ff963d1 server_cookie=5e5a075157c63970 in_seq=0 out_seq=0 2024-09-19T08:53:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.589+0000 7f00c9ffb640 10 client.17304 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:53:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.590+0000 7f00c9ffb640 1 -- 172.21.15.7:0/909762 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b2be505d00 con 0x55b2be6236c0 2024-09-19T08:53:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.590+0000 7f00c9ffb640 10 client.17304 handle_command_reply: tid=0 2024-09-19T08:53:26.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.590+0000 7f00eaac4740 1 client.17304 shutdown 2024-09-19T08:53:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.590+0000 7f00eaac4740 1 -- 172.21.15.7:0/909762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be5a3d40 msgr2=0x55b2be59ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.590+0000 7f00eaac4740 1 --2- 172.21.15.7:0/909762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be5a3d40 0x55b2be59ce70 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f00d00316c0 tx=0x7f00d0003a80 comp rx=0 tx=0).stop 2024-09-19T08:53:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.590+0000 7f00eaac4740 1 -- 172.21.15.7:0/909762 shutdown_connections 2024-09-19T08:53:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.590+0000 7f00eaac4740 1 --2- 172.21.15.7:0/909762 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b2be6236c0 0x55b2be625ab0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.590+0000 7f00eaac4740 1 --2- 172.21.15.7:0/909762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b2be5a3d40 0x55b2be59ce70 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.590+0000 7f00c9ffb640 0 client.17304 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:53:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.590+0000 7f00eaac4740 1 --2- 172.21.15.7:0/909762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2be599480 0x55b2be59e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.590+0000 7f00eaac4740 1 --2- 172.21.15.7:0/909762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b2be598b60 0x55b2be59e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.590+0000 7f00eaac4740 1 -- 172.21.15.7:0/909762 >> 172.21.15.7:0/909762 conn(0x55b2be5950f0 msgr2=0x55b2be5a0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.591+0000 7f00eaac4740 1 -- 172.21.15.7:0/909762 shutdown_connections 2024-09-19T08:53:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.591+0000 7f00eaac4740 1 -- 172.21.15.7:0/909762 wait complete. 2024-09-19T08:53:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.591+0000 7f00eaac4740 20 client.17304 trim_cache size 0 max 16384 2024-09-19T08:53:26.599 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:53:26.599 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-19T08:53:26.599 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "678b01fe-53c2-49b0-a107-8daca6a627a9", 2024-09-19T08:53:26.599 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-19T08:53:26.599 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:53:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.591+0000 7f00e86eb640 1 -- 172.21.15.7:0/973183835 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f00cc0a33b0 msgr2=0x7f00cc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.591+0000 7f00e86eb640 1 --2- 172.21.15.7:0/973183835 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f00cc0a33b0 0x7f00cc0a5870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f00d807cad0 tx=0x7f00d8067380 comp rx=0 tx=0).stop 2024-09-19T08:53:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.591+0000 7f00e86eb640 1 -- 172.21.15.7:0/973183835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00e0106f10 msgr2=0x7f00e019cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.591+0000 7f00e86eb640 1 --2- 172.21.15.7:0/973183835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00e0106f10 0x7f00e019cd00 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f00d800eb10 tx=0x7f00d800c2d0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.591+0000 7f00e86eb640 1 -- 172.21.15.7:0/973183835 shutdown_connections 2024-09-19T08:53:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.591+0000 7f00e86eb640 1 --2- 172.21.15.7:0/973183835 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f00cc0a33b0 0x7f00cc0a5870 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.591+0000 7f00e86eb640 1 --2- 172.21.15.7:0/973183835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00e0106f10 0x7f00e019cd00 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.591+0000 7f00e86eb640 1 --2- 172.21.15.7:0/973183835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00e0102790 0x7f00e0198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.591+0000 7f00e86eb640 1 --2- 172.21.15.7:0/973183835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e0101de0 0x7f00e0198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.591+0000 7f00e86eb640 1 -- 172.21.15.7:0/973183835 >> 172.21.15.7:0/973183835 conn(0x7f00e00fd8c0 msgr2=0x7f00e00fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:26.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.591+0000 7f00e86eb640 1 -- 172.21.15.7:0/973183835 shutdown_connections 2024-09-19T08:53:26.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:26.591+0000 7f00e86eb640 1 -- 172.21.15.7:0/973183835 wait complete. 2024-09-19T08:53:26.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:26 smithi175 ceph-mon[35688]: pgmap v276: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:53:26.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:26 smithi044 ceph-mon[35072]: pgmap v276: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:53:27.221 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:53:27.480 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:27 smithi007 ceph-mon[31221]: scrub queued for path: / 2024-09-19T08:53:27.480 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:27 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:53:27.480 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:27 smithi007 ceph-mon[31221]: scrub summary: active paths [/] 2024-09-19T08:53:27.480 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:27 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:53:27.481 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:27.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:27 smithi175 ceph-mon[35688]: scrub queued for path: / 2024-09-19T08:53:27.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:27 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:53:27.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:27 smithi175 ceph-mon[35688]: scrub summary: active paths [/] 2024-09-19T08:53:27.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:27 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:53:27.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:27 smithi044 ceph-mon[35072]: scrub queued for path: / 2024-09-19T08:53:27.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:27 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:53:27.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:27 smithi044 ceph-mon[35072]: scrub summary: active paths [/] 2024-09-19T08:53:27.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:27 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:53:27.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.944+0000 7ff1cc0c6640 1 -- 172.21.15.7:0/2393952304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1c4102790 msgr2=0x7ff1c41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:27.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.944+0000 7ff1cc0c6640 1 --2- 172.21.15.7:0/2393952304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1c4102790 0x7ff1c41067e0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009900 tx=0x7ff1b402a410 comp rx=0 tx=0).stop 2024-09-19T08:53:27.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.944+0000 7ff1cc0c6640 1 -- 172.21.15.7:0/2393952304 shutdown_connections 2024-09-19T08:53:27.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.944+0000 7ff1cc0c6640 1 --2- 172.21.15.7:0/2393952304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1c4106f10 0x7ff1c410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.944+0000 7ff1cc0c6640 1 --2- 172.21.15.7:0/2393952304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1c4102790 0x7ff1c41067e0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.944+0000 7ff1cc0c6640 1 --2- 172.21.15.7:0/2393952304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1c4101de0 0x7ff1c41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.944+0000 7ff1cc0c6640 1 -- 172.21.15.7:0/2393952304 >> 172.21.15.7:0/2393952304 conn(0x7ff1c40fd8c0 msgr2=0x7ff1c40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:27.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.944+0000 7ff1cc0c6640 1 -- 172.21.15.7:0/2393952304 shutdown_connections 2024-09-19T08:53:27.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.944+0000 7ff1cc0c6640 1 -- 172.21.15.7:0/2393952304 wait complete. 2024-09-19T08:53:27.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.945+0000 7ff1cc0c6640 1 Processor -- start 2024-09-19T08:53:27.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.945+0000 7ff1cc0c6640 1 -- start start 2024-09-19T08:53:27.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.945+0000 7ff1cc0c6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1c4101de0 0x7ff1c40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:27.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.945+0000 7ff1cc0c6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1c4102790 0x7ff1c4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:27.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.945+0000 7ff1cc0c6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1c4106f10 0x7ff1c4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:27.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.945+0000 7ff1cc0c6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c4111f70 con 0x7ff1c4102790 2024-09-19T08:53:27.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.945+0000 7ff1cc0c6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c4111df0 con 0x7ff1c4101de0 2024-09-19T08:53:27.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.945+0000 7ff1cc0c6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c41120f0 con 0x7ff1c4106f10 2024-09-19T08:53:27.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.945+0000 7ff1c9661640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1c4102790 0x7ff1c4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:27.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.945+0000 7ff1c9661640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1c4102790 0x7ff1c4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41132/0 (socket says 172.21.15.7:41132) 2024-09-19T08:53:27.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.945+0000 7ff1c9661640 1 -- 172.21.15.7:0/3161636000 learned_addr learned my addr 172.21.15.7:0/3161636000 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:27.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.945+0000 7ff1c9e62640 1 --2- 172.21.15.7:0/3161636000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1c4101de0 0x7ff1c40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:27.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.946+0000 7ff1ca663640 1 --2- 172.21.15.7:0/3161636000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1c4106f10 0x7ff1c4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:27.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.946+0000 7ff1c9661640 1 -- 172.21.15.7:0/3161636000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1c4106f10 msgr2=0x7ff1c4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:27.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.946+0000 7ff1c9661640 1 --2- 172.21.15.7:0/3161636000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1c4106f10 0x7ff1c4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.946+0000 7ff1c9661640 1 -- 172.21.15.7:0/3161636000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1c4101de0 msgr2=0x7ff1c40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:27.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.946+0000 7ff1c9661640 1 --2- 172.21.15.7:0/3161636000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1c4101de0 0x7ff1c40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.946+0000 7ff1c9661640 1 -- 172.21.15.7:0/3161636000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c41aadc0 con 0x7ff1c4102790 2024-09-19T08:53:27.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.946+0000 7ff1c9661640 1 --2- 172.21.15.7:0/3161636000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1c4102790 0x7ff1c4074a30 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4006010 tx=0x7ff1b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:27.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.946+0000 7ff1baffd640 1 -- 172.21.15.7:0/3161636000 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b403f030 con 0x7ff1c4102790 2024-09-19T08:53:27.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.946+0000 7ff1baffd640 1 -- 172.21.15.7:0/3161636000 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1b4003ce0 con 0x7ff1c4102790 2024-09-19T08:53:27.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.946+0000 7ff1cc0c6640 1 -- 172.21.15.7:0/3161636000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c41aaf90 con 0x7ff1c4102790 2024-09-19T08:53:27.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.946+0000 7ff1baffd640 1 -- 172.21.15.7:0/3161636000 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4035070 con 0x7ff1c4102790 2024-09-19T08:53:27.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.946+0000 7ff1cc0c6640 1 -- 172.21.15.7:0/3161636000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c41ab3e0 con 0x7ff1c4102790 2024-09-19T08:53:27.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.949+0000 7ff1baffd640 1 -- 172.21.15.7:0/3161636000 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff1b4042030 con 0x7ff1c4102790 2024-09-19T08:53:27.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.949+0000 7ff1ce49f740 1 Processor -- start 2024-09-19T08:53:27.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.949+0000 7ff1ce49f740 1 -- start start 2024-09-19T08:53:27.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.949+0000 7ff1ce49f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565def724a0 0x5565def72880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:27.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.949+0000 7ff1ce49f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565def72dc0 0x5565def7d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:27.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.949+0000 7ff1ce49f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def7d680 0x5565def7fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:27.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.949+0000 7ff1ce49f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5565deed82e0 con 0x5565def7d680 2024-09-19T08:53:27.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.949+0000 7ff1ce49f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5565dee7fce0 con 0x5565def724a0 2024-09-19T08:53:27.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.949+0000 7ff1ce49f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5565deed42a0 con 0x5565def72dc0 2024-09-19T08:53:27.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.949+0000 7ff1c9661640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def7d680 0x5565def7fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:27.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.949+0000 7ff1c9661640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def7d680 0x5565def7fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41148/0 (socket says 172.21.15.7:41148) 2024-09-19T08:53:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.949+0000 7ff1c9661640 1 -- 172.21.15.7:0/3415540861 learned_addr learned my addr 172.21.15.7:0/3415540861 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.949+0000 7ff1c9e62640 1 --2- 172.21.15.7:0/3415540861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565def72dc0 0x5565def7d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.949+0000 7ff1ca663640 1 --2- 172.21.15.7:0/3415540861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565def724a0 0x5565def72880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.950+0000 7ff1baffd640 1 --2- 172.21.15.7:0/3161636000 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff1b00a33b0 0x7ff1b00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.950+0000 7ff1c9661640 1 -- 172.21.15.7:0/3415540861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565def72dc0 msgr2=0x5565def7d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.950+0000 7ff1c9661640 1 --2- 172.21.15.7:0/3415540861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565def72dc0 0x5565def7d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.950+0000 7ff1c9661640 1 -- 172.21.15.7:0/3415540861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565def724a0 msgr2=0x5565def72880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.950+0000 7ff1c9661640 1 --2- 172.21.15.7:0/3415540861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565def724a0 0x5565def72880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.950+0000 7ff1c9661640 1 -- 172.21.15.7:0/3415540861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565dee64440 con 0x5565def7d680 2024-09-19T08:53:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.950+0000 7ff1ca663640 1 --2- 172.21.15.7:0/3161636000 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff1b00a33b0 0x7ff1b00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:27.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.950+0000 7ff1baffd640 1 -- 172.21.15.7:0/3161636000 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7ff1b40eff80 con 0x7ff1c4102790 2024-09-19T08:53:27.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.950+0000 7ff1c9661640 1 --2- 172.21.15.7:0/3415540861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def7d680 0x5565def7fa70 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40ed600 tx=0x7ff1b40e6ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e0aa37e80c99d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:27.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.950+0000 7ff1affff640 1 -- 172.21.15.7:0/3415540861 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4049070 con 0x5565def7d680 2024-09-19T08:53:27.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.950+0000 7ff1affff640 1 -- 172.21.15.7:0/3415540861 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1b403b580 con 0x5565def7d680 2024-09-19T08:53:27.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.950+0000 7ff1affff640 1 -- 172.21.15.7:0/3415540861 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b40dae60 con 0x5565def7d680 2024-09-19T08:53:27.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.951+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3415540861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def7d680 msgr2=0x5565def7fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:27.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.951+0000 7ff1ca663640 1 --2- 172.21.15.7:0/3161636000 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff1b00a33b0 0x7ff1b00a5870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc005fd0 tx=0x7ff1bc004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:27.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.951+0000 7ff1ce49f740 1 --2- 172.21.15.7:0/3415540861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def7d680 0x5565def7fa70 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40ed600 tx=0x7ff1b40e6ff0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.951+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3415540861 shutdown_connections 2024-09-19T08:53:27.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.951+0000 7ff1ce49f740 1 --2- 172.21.15.7:0/3415540861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def7d680 0x5565def7fa70 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.951+0000 7ff1ce49f740 1 --2- 172.21.15.7:0/3415540861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565def72dc0 0x5565def7d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.951+0000 7ff1ce49f740 1 --2- 172.21.15.7:0/3415540861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565def724a0 0x5565def72880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.951+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3415540861 >> 172.21.15.7:0/3415540861 conn(0x5565def6ea30 msgr2=0x5565def6ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:27.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.951+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3415540861 shutdown_connections 2024-09-19T08:53:27.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.951+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3415540861 wait complete. 2024-09-19T08:53:27.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.951+0000 7ff1ce49f740 1 -- start start 2024-09-19T08:53:27.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.952+0000 7ff1ce49f740 1 Processor -- start 2024-09-19T08:53:27.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.952+0000 7ff1ce49f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def724a0 0x5565def7cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:27.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.952+0000 7ff1ce49f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565def72dc0 0x5565def7a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:27.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.952+0000 7ff1ce49f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565def7d680 0x5565def7a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:27.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.952+0000 7ff1ce49f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5565def80010 con 0x5565def724a0 2024-09-19T08:53:27.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.952+0000 7ff1ce49f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5565dee93050 con 0x5565def7d680 2024-09-19T08:53:27.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.952+0000 7ff1ce49f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5565def80190 con 0x5565def72dc0 2024-09-19T08:53:27.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.952+0000 7ff1ce49f740 10 client.0 _ll_register_callbacks cb 0x5565deed3160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:27.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.952+0000 7ff1c9e62640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def724a0 0x5565def7cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:27.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.952+0000 7ff1c9e62640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def724a0 0x5565def7cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41158/0 (socket says 172.21.15.7:41158) 2024-09-19T08:53:27.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.952+0000 7ff1c9e62640 1 -- 172.21.15.7:0/3407516357 learned_addr learned my addr 172.21.15.7:0/3407516357 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:27.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.952+0000 7ff1ca663640 1 --2- 172.21.15.7:0/3407516357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565def7d680 0x5565def7a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:27.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.952+0000 7ff1c9661640 1 --2- 172.21.15.7:0/3407516357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565def72dc0 0x5565def7a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:27.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.953+0000 7ff1c9e62640 1 -- 172.21.15.7:0/3407516357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565def72dc0 msgr2=0x5565def7a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:27.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.953+0000 7ff1c9e62640 1 --2- 172.21.15.7:0/3407516357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565def72dc0 0x5565def7a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.953+0000 7ff1c9e62640 1 -- 172.21.15.7:0/3407516357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565def7d680 msgr2=0x5565def7a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:27.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.953+0000 7ff1c9e62640 1 --2- 172.21.15.7:0/3407516357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565def7d680 0x5565def7a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.953+0000 7ff1c9e62640 1 -- 172.21.15.7:0/3407516357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565dec493c0 con 0x5565def724a0 2024-09-19T08:53:27.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.953+0000 7ff1c9e62640 1 --2- 172.21.15.7:0/3407516357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def724a0 0x5565def7cf30 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000bf60 tx=0x7ff1c000bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aaf9a09d2976afb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:27.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.953+0000 7ff1ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:53:27.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.953+0000 7ff1ad7fa640 1 -- 172.21.15.7:0/3407516357 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0004230 con 0x5565def724a0 2024-09-19T08:53:27.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.953+0000 7ff1ad7fa640 1 -- 172.21.15.7:0/3407516357 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7ff1c00043d0 con 0x5565def724a0 2024-09-19T08:53:27.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.953+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3407516357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5565deee5850 con 0x5565def724a0 2024-09-19T08:53:27.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.953+0000 7ff1ad7fa640 1 -- 172.21.15.7:0/3407516357 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff1c00106a0 con 0x5565def724a0 2024-09-19T08:53:27.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.953+0000 7ff1ce49f740 10 client.17316 fetch_fsmap learned FSMap version 25 2024-09-19T08:53:27.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.953+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3407516357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5565def8b900 con 0x5565def724a0 2024-09-19T08:53:27.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.953+0000 7ff1ad7fa640 1 -- 172.21.15.7:0/3407516357 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5565deee5850 con 0x5565def724a0 2024-09-19T08:53:27.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.954+0000 7ff1ad7fa640 1 -- 172.21.15.7:0/3407516357 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff1c0021030 con 0x5565def724a0 2024-09-19T08:53:27.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.954+0000 7ff1ce49f740 10 client.17316 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:53:27.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.954+0000 7ff1ce49f740 10 client.17316 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:27.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.954+0000 7ff1ce49f740 20 client.17316 populate_metadata read hostname 'smithi007' 2024-09-19T08:53:27.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.954+0000 7ff1ce49f740 1 --2- 172.21.15.7:0/3407516357 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5565def8cdc0 0x5565def8f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:27.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.954+0000 7ff1ce49f740 4 client.17316 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:53:27.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.954+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3407516357 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565deedfd60 con 0x5565def8cdc0 2024-09-19T08:53:27.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.954+0000 7ff1c9661640 1 --2- 172.21.15.7:0/3407516357 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5565def8cdc0 0x5565def8f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:27.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.954+0000 7ff1c9661640 1 --2- 172.21.15.7:0/3407516357 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5565def8cdc0 0x5565def8f1b0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4643b781767b9e9b server_cookie=8b37b961c1fad507 in_seq=0 out_seq=0 2024-09-19T08:53:27.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.954+0000 7ff1ad7fa640 10 client.17316 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:53:27.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.955+0000 7ff1ad7fa640 1 -- 172.21.15.7:0/3407516357 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5565deedfd60 con 0x5565def8cdc0 2024-09-19T08:53:27.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.955+0000 7ff1ad7fa640 10 client.17316 handle_command_reply: tid=0 2024-09-19T08:53:27.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.955+0000 7ff1ce49f740 1 client.17316 shutdown 2024-09-19T08:53:27.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.955+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3407516357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def724a0 msgr2=0x5565def7cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:27.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.955+0000 7ff1ce49f740 1 --2- 172.21.15.7:0/3407516357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def724a0 0x5565def7cf30 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000bf60 tx=0x7ff1c000bf90 comp rx=0 tx=0).stop 2024-09-19T08:53:27.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.955+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3407516357 shutdown_connections 2024-09-19T08:53:27.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.955+0000 7ff1ce49f740 1 --2- 172.21.15.7:0/3407516357 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5565def8cdc0 0x5565def8f1b0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.955+0000 7ff1ce49f740 1 --2- 172.21.15.7:0/3407516357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565def7d680 0x5565def7a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.955+0000 7ff1ce49f740 1 --2- 172.21.15.7:0/3407516357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565def72dc0 0x5565def7a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.955+0000 7ff1ad7fa640 0 client.17316 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:53:27.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.955+0000 7ff1ce49f740 1 --2- 172.21.15.7:0/3407516357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def724a0 0x5565def7cf30 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.955+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3407516357 >> 172.21.15.7:0/3407516357 conn(0x5565def6ea30 msgr2=0x5565def74760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:27.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.955+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3407516357 shutdown_connections 2024-09-19T08:53:27.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.955+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3407516357 wait complete. 2024-09-19T08:53:27.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.956+0000 7ff1ce49f740 20 client.17316 trim_cache size 0 max 16384 2024-09-19T08:53:27.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.973+0000 7ff1ce49f740 1 Processor -- start 2024-09-19T08:53:27.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.973+0000 7ff1ce49f740 1 -- start start 2024-09-19T08:53:27.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.973+0000 7ff1ce49f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565def724a0 0x5565def89180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:27.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.973+0000 7ff1ce49f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565def72dc0 0x5565def7c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:27.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.973+0000 7ff1ce49f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def7d680 0x5565def7c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:27.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.973+0000 7ff1ce49f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c41b6860 con 0x5565def7d680 2024-09-19T08:53:27.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.973+0000 7ff1ce49f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c41b4130 con 0x5565def72dc0 2024-09-19T08:53:27.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.973+0000 7ff1ce49f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c41b1fa0 con 0x5565def724a0 2024-09-19T08:53:27.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.973+0000 7ff1ca663640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def7d680 0x5565def7c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:27.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.973+0000 7ff1ca663640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def7d680 0x5565def7c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41168/0 (socket says 172.21.15.7:41168) 2024-09-19T08:53:27.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.973+0000 7ff1ca663640 1 -- 172.21.15.7:0/3182036123 learned_addr learned my addr 172.21.15.7:0/3182036123 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:27.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.973+0000 7ff1c9661640 1 --2- 172.21.15.7:0/3182036123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565def72dc0 0x5565def7c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:27.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.973+0000 7ff1c9e62640 1 --2- 172.21.15.7:0/3182036123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565def724a0 0x5565def89180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:27.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.973+0000 7ff1ca663640 1 -- 172.21.15.7:0/3182036123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565def724a0 msgr2=0x5565def89180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:27.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.973+0000 7ff1ca663640 1 --2- 172.21.15.7:0/3182036123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565def724a0 0x5565def89180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.973+0000 7ff1ca663640 1 -- 172.21.15.7:0/3182036123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565def72dc0 msgr2=0x5565def7c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:27.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.973+0000 7ff1ca663640 1 --2- 172.21.15.7:0/3182036123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565def72dc0 0x5565def7c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.973+0000 7ff1ca663640 1 -- 172.21.15.7:0/3182036123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565def6e860 con 0x5565def7d680 2024-09-19T08:53:27.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.973+0000 7ff1c9e62640 1 --2- 172.21.15.7:0/3182036123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565def724a0 0x5565def89180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:27.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.973+0000 7ff1c9661640 1 --2- 172.21.15.7:0/3182036123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565def72dc0 0x5565def7c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:27.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.974+0000 7ff1ca663640 1 --2- 172.21.15.7:0/3182036123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def7d680 0x5565def7c690 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc012920 tx=0x7ff1bc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9be8dea13ee24b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:27.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.974+0000 7ff1af7fe640 1 -- 172.21.15.7:0/3182036123 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc020bb0 con 0x5565def7d680 2024-09-19T08:53:27.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.974+0000 7ff1af7fe640 1 -- 172.21.15.7:0/3182036123 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1bc017070 con 0x5565def7d680 2024-09-19T08:53:27.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.974+0000 7ff1af7fe640 1 -- 172.21.15.7:0/3182036123 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc011640 con 0x5565def7d680 2024-09-19T08:53:27.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.974+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3182036123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def7d680 msgr2=0x5565def7c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:27.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.974+0000 7ff1ce49f740 1 --2- 172.21.15.7:0/3182036123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def7d680 0x5565def7c690 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc012920 tx=0x7ff1bc015000 comp rx=0 tx=0).stop 2024-09-19T08:53:27.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.974+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3182036123 shutdown_connections 2024-09-19T08:53:27.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.974+0000 7ff1ce49f740 1 --2- 172.21.15.7:0/3182036123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def7d680 0x5565def7c690 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.974+0000 7ff1ce49f740 1 --2- 172.21.15.7:0/3182036123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565def72dc0 0x5565def7c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.974+0000 7ff1ce49f740 1 --2- 172.21.15.7:0/3182036123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565def724a0 0x5565def89180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.974+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3182036123 >> 172.21.15.7:0/3182036123 conn(0x5565def6ea30 msgr2=0x5565def7ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:27.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.975+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3182036123 shutdown_connections 2024-09-19T08:53:27.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.975+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3182036123 wait complete. 2024-09-19T08:53:27.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.975+0000 7ff1ce49f740 1 -- start start 2024-09-19T08:53:27.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.975+0000 7ff1ce49f740 1 Processor -- start 2024-09-19T08:53:27.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.975+0000 7ff1ce49f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565def724a0 0x5565def832a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:27.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.975+0000 7ff1ce49f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565def72dc0 0x5565def837e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:27.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.975+0000 7ff1ce49f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def7d680 0x5565def83d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:27.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.975+0000 7ff1ce49f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c41b25f0 con 0x5565def7d680 2024-09-19T08:53:27.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.975+0000 7ff1ce49f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c41b3a60 con 0x5565def72dc0 2024-09-19T08:53:27.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.975+0000 7ff1ce49f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c41b2cc0 con 0x5565def724a0 2024-09-19T08:53:27.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.975+0000 7ff1ce49f740 10 client.0 _ll_register_callbacks cb 0x7ff1c000b790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:27.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.976+0000 7ff1ca663640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def7d680 0x5565def83d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:27.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.976+0000 7ff1c9661640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565def72dc0 0x5565def837e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:27.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.976+0000 7ff1ca663640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def7d680 0x5565def83d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41176/0 (socket says 172.21.15.7:41176) 2024-09-19T08:53:27.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.976+0000 7ff1ca663640 1 -- 172.21.15.7:0/3530443451 learned_addr learned my addr 172.21.15.7:0/3530443451 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:27.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.976+0000 7ff1c9e62640 1 --2- 172.21.15.7:0/3530443451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565def724a0 0x5565def832a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:27.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.976+0000 7ff1ca663640 1 -- 172.21.15.7:0/3530443451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565def724a0 msgr2=0x5565def832a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:27.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.976+0000 7ff1ca663640 1 --2- 172.21.15.7:0/3530443451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565def724a0 0x5565def832a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.976+0000 7ff1ca663640 1 -- 172.21.15.7:0/3530443451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565def72dc0 msgr2=0x5565def837e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:27.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.976+0000 7ff1ca663640 1 --2- 172.21.15.7:0/3530443451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565def72dc0 0x5565def837e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.976+0000 7ff1ca663640 1 -- 172.21.15.7:0/3530443451 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565deff6c90 con 0x5565def7d680 2024-09-19T08:53:27.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.976+0000 7ff1c9661640 1 --2- 172.21.15.7:0/3530443451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565def72dc0 0x5565def837e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:27.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.976+0000 7ff1ca663640 1 --2- 172.21.15.7:0/3530443451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def7d680 0x5565def83d20 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0128f0 tx=0x7ff1bc012f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443620dc6a776028 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:27.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.976+0000 7ff1ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:53:27.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.976+0000 7ff1ad7fa640 1 -- 172.21.15.7:0/3530443451 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc038060 con 0x5565def7d680 2024-09-19T08:53:27.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.976+0000 7ff1ad7fa640 1 -- 172.21.15.7:0/3530443451 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7ff1bc020bc0 con 0x5565def7d680 2024-09-19T08:53:27.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.976+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3530443451 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1bc017070 con 0x5565def7d680 2024-09-19T08:53:27.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.976+0000 7ff1ad7fa640 1 -- 172.21.15.7:0/3530443451 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff1bc029440 con 0x5565def7d680 2024-09-19T08:53:27.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.977+0000 7ff1ce49f740 10 client.17322 fetch_fsmap learned FSMap version 25 2024-09-19T08:53:27.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.977+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3530443451 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5565deff7ed0 con 0x5565def7d680 2024-09-19T08:53:27.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.977+0000 7ff1ad7fa640 1 -- 172.21.15.7:0/3530443451 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1bc017070 con 0x5565def7d680 2024-09-19T08:53:27.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.977+0000 7ff1ad7fa640 1 -- 172.21.15.7:0/3530443451 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff1bc027020 con 0x5565def7d680 2024-09-19T08:53:27.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.977+0000 7ff1ce49f740 10 client.17322 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:53:27.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.977+0000 7ff1ce49f740 10 client.17322 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:27.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.977+0000 7ff1ce49f740 20 client.17322 populate_metadata read hostname 'smithi007' 2024-09-19T08:53:27.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.977+0000 7ff1ce49f740 1 --2- 172.21.15.7:0/3530443451 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5565deff8510 0x5565deffa930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:27.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.977+0000 7ff1ce49f740 4 client.17322 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:53:27.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.977+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3530443451 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5565dee5c210 con 0x5565deff8510 2024-09-19T08:53:27.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.977+0000 7ff1c9e62640 1 --2- 172.21.15.7:0/3530443451 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5565deff8510 0x5565deffa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:27.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.978+0000 7ff1ad7fa640 10 client.17322 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:53:27.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.978+0000 7ff1c9e62640 1 --2- 172.21.15.7:0/3530443451 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5565deff8510 0x5565deffa930 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5fd3ad590520043 server_cookie=3309353476e53ea in_seq=0 out_seq=0 2024-09-19T08:53:27.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.978+0000 7ff1ad7fa640 1 -- 172.21.15.7:0/3530443451 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5565dee5c210 con 0x5565deff8510 2024-09-19T08:53:27.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.978+0000 7ff1ad7fa640 10 client.17322 handle_command_reply: tid=0 2024-09-19T08:53:27.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.978+0000 7ff1ce49f740 1 client.17322 shutdown 2024-09-19T08:53:27.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.978+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3530443451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def7d680 msgr2=0x5565def83d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:27.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.978+0000 7ff1ce49f740 1 --2- 172.21.15.7:0/3530443451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def7d680 0x5565def83d20 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0128f0 tx=0x7ff1bc012f60 comp rx=0 tx=0).stop 2024-09-19T08:53:27.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.978+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3530443451 shutdown_connections 2024-09-19T08:53:27.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.978+0000 7ff1ce49f740 1 --2- 172.21.15.7:0/3530443451 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5565deff8510 0x5565deffa930 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.978+0000 7ff1ce49f740 1 --2- 172.21.15.7:0/3530443451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5565def7d680 0x5565def83d20 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.978+0000 7ff1ce49f740 1 --2- 172.21.15.7:0/3530443451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565def72dc0 0x5565def837e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.978+0000 7ff1ce49f740 1 --2- 172.21.15.7:0/3530443451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565def724a0 0x5565def832a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.978+0000 7ff1ad7fa640 0 client.17322 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:53:27.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.978+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3530443451 >> 172.21.15.7:0/3530443451 conn(0x5565def6ea30 msgr2=0x5565def7c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:27.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.978+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3530443451 shutdown_connections 2024-09-19T08:53:27.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.978+0000 7ff1ce49f740 1 -- 172.21.15.7:0/3530443451 wait complete. 2024-09-19T08:53:27.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.978+0000 7ff1ce49f740 20 client.17322 trim_cache size 0 max 16384 2024-09-19T08:53:27.985 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:53:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:53:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-19T08:53:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: "678b01fe-53c2-49b0-a107-8daca6a627a9": { 2024-09-19T08:53:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-19T08:53:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "678b01fe-53c2-49b0-a107-8daca6a627a9", 2024-09-19T08:53:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-19T08:53:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:53:27.986 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:53:27.986 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:53:27.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.979+0000 7ff1cc0c6640 1 -- 172.21.15.7:0/3161636000 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff1b00a33b0 msgr2=0x7ff1b00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:27.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.979+0000 7ff1cc0c6640 1 --2- 172.21.15.7:0/3161636000 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff1b00a33b0 0x7ff1b00a5870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc005fd0 tx=0x7ff1bc004a40 comp rx=0 tx=0).stop 2024-09-19T08:53:27.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.979+0000 7ff1cc0c6640 1 -- 172.21.15.7:0/3161636000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1c4102790 msgr2=0x7ff1c4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:27.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.979+0000 7ff1cc0c6640 1 --2- 172.21.15.7:0/3161636000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1c4102790 0x7ff1c4074a30 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4006010 tx=0x7ff1b40042f0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.979+0000 7ff1cc0c6640 1 -- 172.21.15.7:0/3161636000 shutdown_connections 2024-09-19T08:53:27.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.979+0000 7ff1cc0c6640 1 --2- 172.21.15.7:0/3161636000 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff1b00a33b0 0x7ff1b00a5870 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.979+0000 7ff1cc0c6640 1 --2- 172.21.15.7:0/3161636000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1c4106f10 0x7ff1c4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.979+0000 7ff1cc0c6640 1 --2- 172.21.15.7:0/3161636000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1c4102790 0x7ff1c4074a30 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.979+0000 7ff1cc0c6640 1 --2- 172.21.15.7:0/3161636000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1c4101de0 0x7ff1c40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:27.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.979+0000 7ff1cc0c6640 1 -- 172.21.15.7:0/3161636000 >> 172.21.15.7:0/3161636000 conn(0x7ff1c40fd8c0 msgr2=0x7ff1c40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:27.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.979+0000 7ff1cc0c6640 1 -- 172.21.15.7:0/3161636000 shutdown_connections 2024-09-19T08:53:27.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:27.979+0000 7ff1cc0c6640 1 -- 172.21.15.7:0/3161636000 wait complete. 2024-09-19T08:53:28.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:28 smithi175 ceph-mon[35688]: pgmap v277: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T08:53:28.723 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:28 smithi007 ceph-mon[31221]: pgmap v277: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T08:53:28.754 INFO:tasks.cephfs.filesystem:scrub status for tag:678b01fe-53c2-49b0-a107-8daca6a627a9 - {'path': '/', 'tag': '678b01fe-53c2-49b0-a107-8daca6a627a9', 'options': 'recursive,force'} 2024-09-19T08:53:28.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:28 smithi044 ceph-mon[35072]: pgmap v277: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T08:53:29.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:29 smithi175 ceph-mon[35688]: scrub summary: idle 2024-09-19T08:53:29.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:29 smithi007 ceph-mon[31221]: scrub summary: idle 2024-09-19T08:53:29.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:29 smithi044 ceph-mon[35072]: scrub summary: idle 2024-09-19T08:53:30.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:30 smithi175 ceph-mon[35688]: pgmap v278: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:53:30.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:30 smithi007 ceph-mon[31221]: pgmap v278: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:53:30.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:30 smithi044 ceph-mon[35072]: pgmap v278: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:53:32.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:32 smithi175 ceph-mon[35688]: pgmap v279: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:53:32.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:32 smithi007 ceph-mon[31221]: pgmap v279: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:53:32.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:32 smithi044 ceph-mon[35072]: pgmap v279: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:53:34.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:34 smithi175 ceph-mon[35688]: pgmap v280: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:53:34.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:34 smithi007 ceph-mon[31221]: pgmap v280: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:53:34.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:34 smithi044 ceph-mon[35072]: pgmap v280: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:53:36.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:36 smithi175 ceph-mon[35688]: pgmap v281: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:53:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:36 smithi007 ceph-mon[31221]: pgmap v281: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:53:36.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:36 smithi044 ceph-mon[35072]: pgmap v281: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:53:38.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:38 smithi175 ceph-mon[35688]: pgmap v282: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:53:38.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:38 smithi007 ceph-mon[31221]: pgmap v282: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:53:38.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:38 smithi044 ceph-mon[35072]: pgmap v282: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:53:40.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:40 smithi175 ceph-mon[35688]: pgmap v283: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:40.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:40 smithi007 ceph-mon[31221]: pgmap v283: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:40.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:40 smithi044 ceph-mon[35072]: pgmap v283: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:42.688 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:42 smithi175 ceph-mon[35688]: pgmap v284: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:42.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:42 smithi007 ceph-mon[31221]: pgmap v284: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:42.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:42 smithi044 ceph-mon[35072]: pgmap v284: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:44.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:44 smithi175 ceph-mon[35688]: pgmap v285: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:53:44.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:44 smithi007 ceph-mon[31221]: pgmap v285: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:53:44.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:44 smithi044 ceph-mon[35072]: pgmap v285: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:53:46.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:46 smithi175 ceph-mon[35688]: pgmap v286: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:46.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:46 smithi007 ceph-mon[31221]: pgmap v286: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:46.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:46 smithi044 ceph-mon[35072]: pgmap v286: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:47.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:47 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:47.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:47 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:47.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:47 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:47.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:47 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:53:47.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:47 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:47.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:47 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:47.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:47 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:47.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:47 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:53:47.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:47 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:47.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:47 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:47.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:47 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:47.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:47 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:53:49.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:49 smithi007 ceph-mon[31221]: pgmap v287: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:53:49.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:49 smithi044 ceph-mon[35072]: pgmap v287: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:53:49.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:49 smithi175 ceph-mon[35688]: pgmap v287: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:53:51.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:51 smithi007 ceph-mon[31221]: pgmap v288: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:51.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:51 smithi044 ceph-mon[35072]: pgmap v288: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:51.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:51 smithi175 ceph-mon[35688]: pgmap v288: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:53.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:53 smithi007 ceph-mon[31221]: pgmap v289: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:53.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:53 smithi044 ceph-mon[35072]: pgmap v289: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:53.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:53 smithi175 ceph-mon[35688]: pgmap v289: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:55.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:55 smithi007 ceph-mon[31221]: pgmap v290: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:53:55.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:55 smithi044 ceph-mon[35072]: pgmap v290: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:53:55.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:55 smithi175 ceph-mon[35688]: pgmap v290: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:53:57.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:57 smithi007 ceph-mon[31221]: pgmap v291: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:57.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:57 smithi044 ceph-mon[35072]: pgmap v291: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:57.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:57 smithi175 ceph-mon[35688]: pgmap v291: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:53:58.755 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:53:59.026 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:59.138 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:53:59 smithi007 ceph-mon[31221]: pgmap v292: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:53:59.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:53:59 smithi044 ceph-mon[35072]: pgmap v292: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:53:59.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:53:59 smithi175 ceph-mon[35688]: pgmap v292: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T08:53:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.460+0000 7fa2a70ee640 1 -- 172.21.15.7:0/2399859599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2a0102790 msgr2=0x7fa2a01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.460+0000 7fa2a70ee640 1 --2- 172.21.15.7:0/2399859599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2a0102790 0x7fa2a01067e0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fa290009ca0 tx=0x7fa29002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.460+0000 7fa2a70ee640 1 -- 172.21.15.7:0/2399859599 shutdown_connections 2024-09-19T08:53:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.460+0000 7fa2a70ee640 1 --2- 172.21.15.7:0/2399859599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a0106f10 0x7fa2a010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.460+0000 7fa2a70ee640 1 --2- 172.21.15.7:0/2399859599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2a0102790 0x7fa2a01067e0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.460+0000 7fa2a70ee640 1 --2- 172.21.15.7:0/2399859599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2a0101de0 0x7fa2a01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.460+0000 7fa2a70ee640 1 -- 172.21.15.7:0/2399859599 >> 172.21.15.7:0/2399859599 conn(0x7fa2a00fd8c0 msgr2=0x7fa2a00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.460+0000 7fa2a70ee640 1 -- 172.21.15.7:0/2399859599 shutdown_connections 2024-09-19T08:53:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.460+0000 7fa2a70ee640 1 -- 172.21.15.7:0/2399859599 wait complete. 2024-09-19T08:53:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.461+0000 7fa2a70ee640 1 Processor -- start 2024-09-19T08:53:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.461+0000 7fa2a70ee640 1 -- start start 2024-09-19T08:53:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.461+0000 7fa2a70ee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2a0101de0 0x7fa2a0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.461+0000 7fa2a70ee640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a0102790 0x7fa2a01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.461+0000 7fa2a70ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2a0106f10 0x7fa2a019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.461+0000 7fa2a70ee640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a0111f70 con 0x7fa2a0101de0 2024-09-19T08:53:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.461+0000 7fa2a70ee640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a0111df0 con 0x7fa2a0106f10 2024-09-19T08:53:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.461+0000 7fa2a70ee640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a01120f0 con 0x7fa2a0102790 2024-09-19T08:53:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.461+0000 7fa2a4e8a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2a0101de0 0x7fa2a0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.461+0000 7fa2a4e8a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2a0101de0 0x7fa2a0198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39414/0 (socket says 172.21.15.7:39414) 2024-09-19T08:53:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.461+0000 7fa2a4e8a640 1 -- 172.21.15.7:0/3227274836 learned_addr learned my addr 172.21.15.7:0/3227274836 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:59.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.461+0000 7fa2a568b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2a0106f10 0x7fa2a019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.461+0000 7fa29ffff640 1 --2- 172.21.15.7:0/3227274836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a0102790 0x7fa2a01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.462+0000 7fa2a4e8a640 1 -- 172.21.15.7:0/3227274836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a0102790 msgr2=0x7fa2a01989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.462+0000 7fa2a4e8a640 1 --2- 172.21.15.7:0/3227274836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a0102790 0x7fa2a01989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.462+0000 7fa2a4e8a640 1 -- 172.21.15.7:0/3227274836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2a0106f10 msgr2=0x7fa2a019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.462+0000 7fa2a4e8a640 1 --2- 172.21.15.7:0/3227274836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2a0106f10 0x7fa2a019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.462+0000 7fa2a4e8a640 1 -- 172.21.15.7:0/3227274836 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a019d440 con 0x7fa2a0101de0 2024-09-19T08:53:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.462+0000 7fa2a568b640 1 --2- 172.21.15.7:0/3227274836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2a0106f10 0x7fa2a019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.462+0000 7fa2a4e8a640 1 --2- 172.21.15.7:0/3227274836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2a0101de0 0x7fa2a0198490 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fa28800d950 tx=0x7fa28800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.462+0000 7fa29dffb640 1 -- 172.21.15.7:0/3227274836 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288017030 con 0x7fa2a0101de0 2024-09-19T08:53:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.462+0000 7fa29dffb640 1 -- 172.21.15.7:0/3227274836 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa288004020 con 0x7fa2a0101de0 2024-09-19T08:53:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.462+0000 7fa2a70ee640 1 -- 172.21.15.7:0/3227274836 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a019d730 con 0x7fa2a0101de0 2024-09-19T08:53:59.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.462+0000 7fa29dffb640 1 -- 172.21.15.7:0/3227274836 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2880047a0 con 0x7fa2a0101de0 2024-09-19T08:53:59.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.462+0000 7fa2a70ee640 1 -- 172.21.15.7:0/3227274836 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a01a5010 con 0x7fa2a0101de0 2024-09-19T08:53:59.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.464+0000 7fa29dffb640 1 -- 172.21.15.7:0/3227274836 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa2880041d0 con 0x7fa2a0101de0 2024-09-19T08:53:59.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.465+0000 7fa2a94c7740 1 Processor -- start 2024-09-19T08:53:59.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.465+0000 7fa2a94c7740 1 -- start start 2024-09-19T08:53:59.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.465+0000 7fa29dffb640 1 --2- 172.21.15.7:0/3227274836 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa28c0a33b0 0x7fa28c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:59.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.465+0000 7fa2a94c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d9483a0 0x558c3d948780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:59.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.465+0000 7fa2a94c7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c3d948cc0 0x558c3d957550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:59.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.465+0000 7fa2a94c7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c3d957a90 0x558c3d959e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:59.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.465+0000 7fa2a94c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558c3d8ae2e0 con 0x558c3d9483a0 2024-09-19T08:53:59.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.465+0000 7fa2a94c7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558c3d855ce0 con 0x558c3d957a90 2024-09-19T08:53:59.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.465+0000 7fa2a568b640 1 --2- 172.21.15.7:0/3227274836 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa28c0a33b0 0x7fa28c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:59.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.465+0000 7fa2a94c7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558c3d8aa2a0 con 0x558c3d948cc0 2024-09-19T08:53:59.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.465+0000 7fa29dffb640 1 -- 172.21.15.7:0/3227274836 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7fa2880cf7b0 con 0x7fa2a0101de0 2024-09-19T08:53:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.465+0000 7fa2a4e8a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d9483a0 0x558c3d948780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.465+0000 7fa2a4e8a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d9483a0 0x558c3d948780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39426/0 (socket says 172.21.15.7:39426) 2024-09-19T08:53:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.465+0000 7fa2a4e8a640 1 -- 172.21.15.7:0/2185177078 learned_addr learned my addr 172.21.15.7:0/2185177078 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.466+0000 7fa2a568b640 1 --2- 172.21.15.7:0/2185177078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c3d957a90 0x558c3d959e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.466+0000 7fa29ffff640 1 --2- 172.21.15.7:0/2185177078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c3d948cc0 0x558c3d957550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.466+0000 7fa2a4e8a640 1 -- 172.21.15.7:0/2185177078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c3d948cc0 msgr2=0x558c3d957550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.466+0000 7fa2a4e8a640 1 --2- 172.21.15.7:0/2185177078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c3d948cc0 0x558c3d957550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.466+0000 7fa2a4e8a640 1 -- 172.21.15.7:0/2185177078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c3d957a90 msgr2=0x558c3d959e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.466+0000 7fa2a4e8a640 1 --2- 172.21.15.7:0/2185177078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c3d957a90 0x558c3d959e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.466+0000 7fa2a4e8a640 1 -- 172.21.15.7:0/2185177078 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c3d83a440 con 0x558c3d9483a0 2024-09-19T08:53:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.466+0000 7fa2a568b640 1 --2- 172.21.15.7:0/3227274836 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa28c0a33b0 0x7fa28c0a5870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa29800bf10 tx=0x7fa2980107a0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:59.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.466+0000 7fa2a4e8a640 1 --2- 172.21.15.7:0/2185177078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d9483a0 0x558c3d948780 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fa2880983c0 tx=0x7fa28809b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77158b15f26838c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:59.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.466+0000 7fa296ffd640 1 -- 172.21.15.7:0/2185177078 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2880a4660 con 0x558c3d9483a0 2024-09-19T08:53:59.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.466+0000 7fa296ffd640 1 -- 172.21.15.7:0/2185177078 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2880860c0 con 0x558c3d9483a0 2024-09-19T08:53:59.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.466+0000 7fa296ffd640 1 -- 172.21.15.7:0/2185177078 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28809ae40 con 0x558c3d9483a0 2024-09-19T08:53:59.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.467+0000 7fa2a94c7740 1 -- 172.21.15.7:0/2185177078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d9483a0 msgr2=0x558c3d948780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:59.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.467+0000 7fa2a94c7740 1 --2- 172.21.15.7:0/2185177078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d9483a0 0x558c3d948780 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fa2880983c0 tx=0x7fa28809b410 comp rx=0 tx=0).stop 2024-09-19T08:53:59.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.467+0000 7fa2a94c7740 1 -- 172.21.15.7:0/2185177078 shutdown_connections 2024-09-19T08:53:59.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.467+0000 7fa2a94c7740 1 --2- 172.21.15.7:0/2185177078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c3d957a90 0x558c3d959e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.467+0000 7fa2a94c7740 1 --2- 172.21.15.7:0/2185177078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c3d948cc0 0x558c3d957550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.467+0000 7fa2a94c7740 1 --2- 172.21.15.7:0/2185177078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d9483a0 0x558c3d948780 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.467+0000 7fa2a94c7740 1 -- 172.21.15.7:0/2185177078 >> 172.21.15.7:0/2185177078 conn(0x558c3d944a30 msgr2=0x558c3d944e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:59.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.467+0000 7fa2a94c7740 1 -- 172.21.15.7:0/2185177078 shutdown_connections 2024-09-19T08:53:59.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.467+0000 7fa2a94c7740 1 -- 172.21.15.7:0/2185177078 wait complete. 2024-09-19T08:53:59.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.467+0000 7fa2a94c7740 1 -- start start 2024-09-19T08:53:59.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.467+0000 7fa2a94c7740 1 Processor -- start 2024-09-19T08:53:59.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.468+0000 7fa2a94c7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c3d9483a0 0x558c3d9574b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:59.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.468+0000 7fa2a94c7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c3d948cc0 0x558c3d954760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:59.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.468+0000 7fa2a94c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d957a90 0x558c3d954d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:59.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.468+0000 7fa2a94c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558c3d95a600 con 0x558c3d957a90 2024-09-19T08:53:59.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.468+0000 7fa2a94c7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558c3d869050 con 0x558c3d9483a0 2024-09-19T08:53:59.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.468+0000 7fa2a94c7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558c3d95a780 con 0x558c3d948cc0 2024-09-19T08:53:59.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.468+0000 7fa2a94c7740 10 client.0 _ll_register_callbacks cb 0x558c3d8a9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:59.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.468+0000 7fa2a568b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d957a90 0x558c3d954d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:59.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.468+0000 7fa2a568b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d957a90 0x558c3d954d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39438/0 (socket says 172.21.15.7:39438) 2024-09-19T08:53:59.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.468+0000 7fa2a568b640 1 -- 172.21.15.7:0/1688252865 learned_addr learned my addr 172.21.15.7:0/1688252865 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:59.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.468+0000 7fa29ffff640 1 --2- 172.21.15.7:0/1688252865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c3d948cc0 0x558c3d954760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:59.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.468+0000 7fa2a4e8a640 1 --2- 172.21.15.7:0/1688252865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c3d9483a0 0x558c3d9574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:59.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.468+0000 7fa2a568b640 1 -- 172.21.15.7:0/1688252865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c3d948cc0 msgr2=0x558c3d954760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:59.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.468+0000 7fa2a568b640 1 --2- 172.21.15.7:0/1688252865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c3d948cc0 0x558c3d954760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.468+0000 7fa2a568b640 1 -- 172.21.15.7:0/1688252865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c3d9483a0 msgr2=0x558c3d9574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:59.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.468+0000 7fa2a568b640 1 --2- 172.21.15.7:0/1688252865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c3d9483a0 0x558c3d9574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.468+0000 7fa2a568b640 1 -- 172.21.15.7:0/1688252865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c3d61f3c0 con 0x558c3d957a90 2024-09-19T08:53:59.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.468+0000 7fa2a568b640 1 --2- 172.21.15.7:0/1688252865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d957a90 0x558c3d954d70 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fa2980119a0 tx=0x7fa298004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c6ec22c05738ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:59.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.468+0000 7fa27ffff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:53:59.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.469+0000 7fa27ffff640 1 -- 172.21.15.7:0/1688252865 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa298019040 con 0x558c3d957a90 2024-09-19T08:53:59.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.469+0000 7fa27ffff640 1 -- 172.21.15.7:0/1688252865 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7fa298004440 con 0x558c3d957a90 2024-09-19T08:53:59.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.469+0000 7fa2a94c7740 1 -- 172.21.15.7:0/1688252865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2880860c0 con 0x558c3d957a90 2024-09-19T08:53:59.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.469+0000 7fa27ffff640 1 -- 172.21.15.7:0/1688252865 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa29802f050 con 0x558c3d957a90 2024-09-19T08:53:59.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.469+0000 7fa2a94c7740 10 client.17334 fetch_fsmap learned FSMap version 25 2024-09-19T08:53:59.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.469+0000 7fa2a94c7740 1 -- 172.21.15.7:0/1688252865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558c3d966130 con 0x558c3d957a90 2024-09-19T08:53:59.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.469+0000 7fa27ffff640 1 -- 172.21.15.7:0/1688252865 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2880860c0 con 0x558c3d957a90 2024-09-19T08:53:59.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.469+0000 7fa27ffff640 1 -- 172.21.15.7:0/1688252865 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa298003ce0 con 0x558c3d957a90 2024-09-19T08:53:59.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.469+0000 7fa2a94c7740 10 client.17334 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:53:59.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.469+0000 7fa2a94c7740 10 client.17334 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:59.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.469+0000 7fa2a94c7740 20 client.17334 populate_metadata read hostname 'smithi007' 2024-09-19T08:53:59.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.469+0000 7fa2a94c7740 1 --2- 172.21.15.7:0/1688252865 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558c3d9675f0 0x558c3d9699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:59.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.469+0000 7fa2a94c7740 4 client.17334 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:53:59.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.469+0000 7fa2a94c7740 1 -- 172.21.15.7:0/1688252865 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c3d8bb850 con 0x558c3d9675f0 2024-09-19T08:53:59.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.470+0000 7fa2a4e8a640 1 --2- 172.21.15.7:0/1688252865 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558c3d9675f0 0x558c3d9699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:59.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.470+0000 7fa2a4e8a640 1 --2- 172.21.15.7:0/1688252865 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558c3d9675f0 0x558c3d9699e0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a335e7ae4325b6e6 server_cookie=ba427e01ddb63ed3 in_seq=0 out_seq=0 2024-09-19T08:53:59.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.470+0000 7fa27ffff640 10 client.17334 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:53:59.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.471+0000 7fa27ffff640 1 -- 172.21.15.7:0/1688252865 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c3d8bb850 con 0x558c3d9675f0 2024-09-19T08:53:59.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.471+0000 7fa27ffff640 10 client.17334 handle_command_reply: tid=0 2024-09-19T08:53:59.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.471+0000 7fa2a94c7740 1 client.17334 shutdown 2024-09-19T08:53:59.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.471+0000 7fa2a94c7740 1 -- 172.21.15.7:0/1688252865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d957a90 msgr2=0x558c3d954d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:59.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.471+0000 7fa2a94c7740 1 --2- 172.21.15.7:0/1688252865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d957a90 0x558c3d954d70 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fa2980119a0 tx=0x7fa298004730 comp rx=0 tx=0).stop 2024-09-19T08:53:59.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.471+0000 7fa2a94c7740 1 -- 172.21.15.7:0/1688252865 shutdown_connections 2024-09-19T08:53:59.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.471+0000 7fa2a94c7740 1 --2- 172.21.15.7:0/1688252865 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558c3d9675f0 0x558c3d9699e0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.471+0000 7fa2a94c7740 1 --2- 172.21.15.7:0/1688252865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d957a90 0x558c3d954d70 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.471+0000 7fa2a94c7740 1 --2- 172.21.15.7:0/1688252865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c3d948cc0 0x558c3d954760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.471+0000 7fa2a94c7740 1 --2- 172.21.15.7:0/1688252865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c3d9483a0 0x558c3d9574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.471+0000 7fa27ffff640 0 client.17334 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:53:59.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.471+0000 7fa2a94c7740 1 -- 172.21.15.7:0/1688252865 >> 172.21.15.7:0/1688252865 conn(0x558c3d944a30 msgr2=0x558c3d94a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:59.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.471+0000 7fa2a94c7740 1 -- 172.21.15.7:0/1688252865 shutdown_connections 2024-09-19T08:53:59.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.471+0000 7fa2a94c7740 1 -- 172.21.15.7:0/1688252865 wait complete. 2024-09-19T08:53:59.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.471+0000 7fa2a94c7740 20 client.17334 trim_cache size 0 max 16384 2024-09-19T08:53:59.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.488+0000 7fa2a94c7740 1 Processor -- start 2024-09-19T08:53:59.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.488+0000 7fa2a94c7740 1 -- start start 2024-09-19T08:53:59.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.489+0000 7fa2a94c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d9483a0 0x558c3d954cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:59.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.489+0000 7fa2a94c7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c3d948cc0 0x558c3d9638a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:59.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.489+0000 7fa2a94c7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c3d957a90 0x558c3d96f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:59.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.489+0000 7fa2a94c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a01ae0a0 con 0x558c3d9483a0 2024-09-19T08:53:59.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.489+0000 7fa2a94c7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a01ab970 con 0x558c3d948cc0 2024-09-19T08:53:59.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.489+0000 7fa2a94c7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a01a97e0 con 0x558c3d957a90 2024-09-19T08:53:59.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.489+0000 7fa2a4e8a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d9483a0 0x558c3d954cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:59.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.489+0000 7fa2a4e8a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d9483a0 0x558c3d954cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39442/0 (socket says 172.21.15.7:39442) 2024-09-19T08:53:59.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.489+0000 7fa2a4e8a640 1 -- 172.21.15.7:0/964133655 learned_addr learned my addr 172.21.15.7:0/964133655 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:59.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.489+0000 7fa29ffff640 1 --2- 172.21.15.7:0/964133655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c3d948cc0 0x558c3d9638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:59.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.489+0000 7fa2a568b640 1 --2- 172.21.15.7:0/964133655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c3d957a90 0x558c3d96f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:59.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.489+0000 7fa2a4e8a640 1 -- 172.21.15.7:0/964133655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c3d957a90 msgr2=0x558c3d96f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:59.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.489+0000 7fa2a4e8a640 1 --2- 172.21.15.7:0/964133655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c3d957a90 0x558c3d96f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.489+0000 7fa2a4e8a640 1 -- 172.21.15.7:0/964133655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c3d948cc0 msgr2=0x558c3d9638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:59.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.489+0000 7fa2a4e8a640 1 --2- 172.21.15.7:0/964133655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c3d948cc0 0x558c3d9638a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.489+0000 7fa2a4e8a640 1 -- 172.21.15.7:0/964133655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c3d96a010 con 0x558c3d9483a0 2024-09-19T08:53:59.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.489+0000 7fa2a568b640 1 --2- 172.21.15.7:0/964133655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c3d957a90 0x558c3d96f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:59.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.489+0000 7fa2a4e8a640 1 --2- 172.21.15.7:0/964133655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d9483a0 0x558c3d954cb0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fa288099ca0 tx=0x7fa28809bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3531f375f0331ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:59.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.490+0000 7fa2967fc640 1 -- 172.21.15.7:0/964133655 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288098060 con 0x558c3d9483a0 2024-09-19T08:53:59.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.490+0000 7fa2967fc640 1 -- 172.21.15.7:0/964133655 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2880cd0e0 con 0x558c3d9483a0 2024-09-19T08:53:59.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.490+0000 7fa2967fc640 1 -- 172.21.15.7:0/964133655 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28809b170 con 0x558c3d9483a0 2024-09-19T08:53:59.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.490+0000 7fa2a94c7740 1 -- 172.21.15.7:0/964133655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d9483a0 msgr2=0x558c3d954cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:59.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.490+0000 7fa2a94c7740 1 --2- 172.21.15.7:0/964133655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d9483a0 0x558c3d954cb0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fa288099ca0 tx=0x7fa28809bb30 comp rx=0 tx=0).stop 2024-09-19T08:53:59.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.490+0000 7fa2a94c7740 1 -- 172.21.15.7:0/964133655 shutdown_connections 2024-09-19T08:53:59.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.490+0000 7fa2a94c7740 1 --2- 172.21.15.7:0/964133655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c3d957a90 0x558c3d96f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.490+0000 7fa2a94c7740 1 --2- 172.21.15.7:0/964133655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c3d948cc0 0x558c3d9638a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.490+0000 7fa2a94c7740 1 --2- 172.21.15.7:0/964133655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d9483a0 0x558c3d954cb0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.490+0000 7fa2a94c7740 1 -- 172.21.15.7:0/964133655 >> 172.21.15.7:0/964133655 conn(0x558c3d944a30 msgr2=0x558c3d9567e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:59.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.490+0000 7fa2a94c7740 1 -- 172.21.15.7:0/964133655 shutdown_connections 2024-09-19T08:53:59.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.491+0000 7fa2a94c7740 1 -- 172.21.15.7:0/964133655 wait complete. 2024-09-19T08:53:59.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.491+0000 7fa2a94c7740 1 -- start start 2024-09-19T08:53:59.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.491+0000 7fa2a94c7740 1 Processor -- start 2024-09-19T08:53:59.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.491+0000 7fa2a94c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d9483a0 0x558c3d95ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:59.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.491+0000 7fa2a94c7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c3d948cc0 0x558c3d95bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:59.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.491+0000 7fa2a94c7740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c3d957a90 0x558c3d95c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:59.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.492+0000 7fa2a94c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a01a9e30 con 0x558c3d9483a0 2024-09-19T08:53:59.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.492+0000 7fa2a94c7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a01ab2a0 con 0x558c3d948cc0 2024-09-19T08:53:59.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.492+0000 7fa2a94c7740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a01aa500 con 0x558c3d957a90 2024-09-19T08:53:59.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.492+0000 7fa2a4e8a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d9483a0 0x558c3d95ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:59.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.492+0000 7fa2a4e8a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d9483a0 0x558c3d95ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39452/0 (socket says 172.21.15.7:39452) 2024-09-19T08:53:59.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.492+0000 7fa2a4e8a640 1 -- 172.21.15.7:0/959657826 learned_addr learned my addr 172.21.15.7:0/959657826 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:53:59.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.492+0000 7fa2a94c7740 10 client.0 _ll_register_callbacks cb 0x7fa298011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:59.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.492+0000 7fa29ffff640 1 --2- 172.21.15.7:0/959657826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c3d948cc0 0x558c3d95bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:59.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.492+0000 7fa2a568b640 1 --2- 172.21.15.7:0/959657826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c3d957a90 0x558c3d95c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:59.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.492+0000 7fa2a4e8a640 1 -- 172.21.15.7:0/959657826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c3d957a90 msgr2=0x558c3d95c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:59.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.492+0000 7fa2a4e8a640 1 --2- 172.21.15.7:0/959657826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c3d957a90 0x558c3d95c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.492+0000 7fa2a4e8a640 1 -- 172.21.15.7:0/959657826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c3d948cc0 msgr2=0x558c3d95bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:59.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.492+0000 7fa2a4e8a640 1 --2- 172.21.15.7:0/959657826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c3d948cc0 0x558c3d95bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.492+0000 7fa2a4e8a640 1 -- 172.21.15.7:0/959657826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c3d9456c0 con 0x558c3d9483a0 2024-09-19T08:53:59.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.492+0000 7fa2a568b640 1 --2- 172.21.15.7:0/959657826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c3d957a90 0x558c3d95c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:59.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.492+0000 7fa2a4e8a640 1 --2- 172.21.15.7:0/959657826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d9483a0 0x558c3d95ba00 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fa28809b980 tx=0x7fa2880ccf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8631dab44d55a939 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:59.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.492+0000 7fa27ffff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:53:59.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.492+0000 7fa27ffff640 1 -- 172.21.15.7:0/959657826 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2880cd290 con 0x558c3d9483a0 2024-09-19T08:53:59.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.492+0000 7fa27ffff640 1 -- 172.21.15.7:0/959657826 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7fa288099cf0 con 0x558c3d9483a0 2024-09-19T08:53:59.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.492+0000 7fa2a94c7740 1 -- 172.21.15.7:0/959657826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2880cd0e0 con 0x558c3d9483a0 2024-09-19T08:53:59.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.493+0000 7fa27ffff640 1 -- 172.21.15.7:0/959657826 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa28809ae40 con 0x558c3d9483a0 2024-09-19T08:53:59.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.493+0000 7fa2a94c7740 10 client.17340 fetch_fsmap learned FSMap version 25 2024-09-19T08:53:59.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.493+0000 7fa2a94c7740 1 -- 172.21.15.7:0/959657826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558c3d9d2460 con 0x558c3d9483a0 2024-09-19T08:53:59.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.493+0000 7fa27ffff640 1 -- 172.21.15.7:0/959657826 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2880cd0e0 con 0x558c3d9483a0 2024-09-19T08:53:59.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.493+0000 7fa27ffff640 1 -- 172.21.15.7:0/959657826 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa28809aae0 con 0x558c3d9483a0 2024-09-19T08:53:59.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.493+0000 7fa2a94c7740 10 client.17340 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:53:59.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.493+0000 7fa2a94c7740 10 client.17340 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:59.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.493+0000 7fa2a94c7740 20 client.17340 populate_metadata read hostname 'smithi007' 2024-09-19T08:53:59.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.493+0000 7fa2a94c7740 1 --2- 172.21.15.7:0/959657826 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558c3d9d2690 0x558c3d9d4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:59.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.493+0000 7fa2a94c7740 4 client.17340 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:53:59.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.493+0000 7fa2a94c7740 1 -- 172.21.15.7:0/959657826 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558c3d8b5d60 con 0x558c3d9d2690 2024-09-19T08:53:59.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.493+0000 7fa29ffff640 1 --2- 172.21.15.7:0/959657826 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558c3d9d2690 0x558c3d9d4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:59.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.494+0000 7fa29ffff640 1 --2- 172.21.15.7:0/959657826 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558c3d9d2690 0x558c3d9d4a80 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fe2871bc29f1683 server_cookie=ece2dd6610e2f69b in_seq=0 out_seq=0 2024-09-19T08:53:59.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.494+0000 7fa27ffff640 10 client.17340 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:53:59.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.494+0000 7fa27ffff640 1 -- 172.21.15.7:0/959657826 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558c3d8b5d60 con 0x558c3d9d2690 2024-09-19T08:53:59.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.494+0000 7fa27ffff640 10 client.17340 handle_command_reply: tid=0 2024-09-19T08:53:59.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.494+0000 7fa2a94c7740 1 client.17340 shutdown 2024-09-19T08:53:59.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.494+0000 7fa2a94c7740 1 -- 172.21.15.7:0/959657826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d9483a0 msgr2=0x558c3d95ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:59.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.494+0000 7fa2a94c7740 1 --2- 172.21.15.7:0/959657826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d9483a0 0x558c3d95ba00 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fa28809b980 tx=0x7fa2880ccf40 comp rx=0 tx=0).stop 2024-09-19T08:53:59.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.494+0000 7fa2a94c7740 1 -- 172.21.15.7:0/959657826 shutdown_connections 2024-09-19T08:53:59.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.494+0000 7fa2a94c7740 1 --2- 172.21.15.7:0/959657826 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558c3d9d2690 0x558c3d9d4a80 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.494+0000 7fa2a94c7740 1 --2- 172.21.15.7:0/959657826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c3d957a90 0x558c3d95c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.494+0000 7fa2a94c7740 1 --2- 172.21.15.7:0/959657826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c3d948cc0 0x558c3d95bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.494+0000 7fa2a94c7740 1 --2- 172.21.15.7:0/959657826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558c3d9483a0 0x558c3d95ba00 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.494+0000 7fa2a94c7740 1 -- 172.21.15.7:0/959657826 >> 172.21.15.7:0/959657826 conn(0x558c3d944a30 msgr2=0x558c3d949ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:59.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.494+0000 7fa27ffff640 0 client.17340 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:53:59.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.494+0000 7fa2a94c7740 1 -- 172.21.15.7:0/959657826 shutdown_connections 2024-09-19T08:53:59.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.494+0000 7fa2a94c7740 1 -- 172.21.15.7:0/959657826 wait complete. 2024-09-19T08:53:59.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.494+0000 7fa2a94c7740 20 client.17340 trim_cache size 0 max 16384 2024-09-19T08:53:59.505 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:53:59.505 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-19T08:53:59.505 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-09-19T08:53:59.505 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:53:59.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.495+0000 7fa2a70ee640 1 -- 172.21.15.7:0/3227274836 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa28c0a33b0 msgr2=0x7fa28c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:59.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.495+0000 7fa2a70ee640 1 --2- 172.21.15.7:0/3227274836 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa28c0a33b0 0x7fa28c0a5870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa29800bf10 tx=0x7fa2980107a0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.495+0000 7fa2a70ee640 1 -- 172.21.15.7:0/3227274836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2a0101de0 msgr2=0x7fa2a0198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:59.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.495+0000 7fa2a70ee640 1 --2- 172.21.15.7:0/3227274836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2a0101de0 0x7fa2a0198490 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fa28800d950 tx=0x7fa28800de10 comp rx=0 tx=0).stop 2024-09-19T08:53:59.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.495+0000 7fa2a70ee640 1 -- 172.21.15.7:0/3227274836 shutdown_connections 2024-09-19T08:53:59.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.495+0000 7fa2a70ee640 1 --2- 172.21.15.7:0/3227274836 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fa28c0a33b0 0x7fa28c0a5870 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.495+0000 7fa2a70ee640 1 --2- 172.21.15.7:0/3227274836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2a0106f10 0x7fa2a019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.495+0000 7fa2a70ee640 1 --2- 172.21.15.7:0/3227274836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2a0102790 0x7fa2a01989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.495+0000 7fa2a70ee640 1 --2- 172.21.15.7:0/3227274836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2a0101de0 0x7fa2a0198490 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.495+0000 7fa2a70ee640 1 -- 172.21.15.7:0/3227274836 >> 172.21.15.7:0/3227274836 conn(0x7fa2a00fd8c0 msgr2=0x7fa2a00fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:59.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.495+0000 7fa2a70ee640 1 -- 172.21.15.7:0/3227274836 shutdown_connections 2024-09-19T08:53:59.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:53:59.495+0000 7fa2a70ee640 1 -- 172.21.15.7:0/3227274836 wait complete. 2024-09-19T08:54:00.199 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:54:00.200 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:54:00.459 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:00.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.902+0000 7faef10b9640 1 -- 172.21.15.7:0/2720339506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeec102ef0 msgr2=0x7faeec10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:00.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.902+0000 7faef10b9640 1 --2- 172.21.15.7:0/2720339506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeec102ef0 0x7faeec10da40 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7faee4009ca0 tx=0x7faee402a950 comp rx=0 tx=0).stop 2024-09-19T08:54:00.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.902+0000 7faef10b9640 1 -- 172.21.15.7:0/2720339506 shutdown_connections 2024-09-19T08:54:00.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.902+0000 7faef10b9640 1 --2- 172.21.15.7:0/2720339506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeec102ef0 0x7faeec10da40 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:00.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.902+0000 7faef10b9640 1 --2- 172.21.15.7:0/2720339506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeec102570 0x7faeec1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:00.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.902+0000 7faef10b9640 1 --2- 172.21.15.7:0/2720339506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faeec100e20 0x7faeec101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:00.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.902+0000 7faef10b9640 1 -- 172.21.15.7:0/2720339506 >> 172.21.15.7:0/2720339506 conn(0x7faeec0fc7d0 msgr2=0x7faeec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:00.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.902+0000 7faef10b9640 1 -- 172.21.15.7:0/2720339506 shutdown_connections 2024-09-19T08:54:00.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.902+0000 7faef10b9640 1 -- 172.21.15.7:0/2720339506 wait complete. 2024-09-19T08:54:00.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.903+0000 7faef10b9640 1 Processor -- start 2024-09-19T08:54:00.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.903+0000 7faef10b9640 1 -- start start 2024-09-19T08:54:00.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.903+0000 7faef10b9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeec100e20 0x7faeec1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:00.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.903+0000 7faef10b9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeec102570 0x7faeec1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:00.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.903+0000 7faef10b9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faeec102ef0 0x7faeec1a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:00.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.903+0000 7faef10b9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faeec110f80 con 0x7faeec100e20 2024-09-19T08:54:00.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.903+0000 7faef10b9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faeec110e00 con 0x7faeec102ef0 2024-09-19T08:54:00.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.903+0000 7faef10b9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faeec111100 con 0x7faeec102570 2024-09-19T08:54:00.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.903+0000 7faeead9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeec100e20 0x7faeec1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:00.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.903+0000 7faeead9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeec100e20 0x7faeec1992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39476/0 (socket says 172.21.15.7:39476) 2024-09-19T08:54:00.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.903+0000 7faeead9d640 1 -- 172.21.15.7:0/1860075071 learned_addr learned my addr 172.21.15.7:0/1860075071 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:00.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.903+0000 7faeea59c640 1 --2- 172.21.15.7:0/1860075071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeec102570 0x7faeec1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:00.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.904+0000 7faeeb59e640 1 --2- 172.21.15.7:0/1860075071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faeec102ef0 0x7faeec1a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:00.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.904+0000 7faeead9d640 1 -- 172.21.15.7:0/1860075071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeec102570 msgr2=0x7faeec1997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:00.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.904+0000 7faeead9d640 1 --2- 172.21.15.7:0/1860075071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeec102570 0x7faeec1997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:00.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.904+0000 7faeead9d640 1 -- 172.21.15.7:0/1860075071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faeec102ef0 msgr2=0x7faeec1a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:00.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.904+0000 7faeead9d640 1 --2- 172.21.15.7:0/1860075071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faeec102ef0 0x7faeec1a4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:00.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.904+0000 7faeead9d640 1 -- 172.21.15.7:0/1860075071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeec1a4870 con 0x7faeec100e20 2024-09-19T08:54:00.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.904+0000 7faeead9d640 1 --2- 172.21.15.7:0/1860075071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeec100e20 0x7faeec1992b0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7faedc00d950 tx=0x7faedc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:00.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.904+0000 7faed3fff640 1 -- 172.21.15.7:0/1860075071 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc017070 con 0x7faeec100e20 2024-09-19T08:54:00.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.904+0000 7faed3fff640 1 -- 172.21.15.7:0/1860075071 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faedc009c30 con 0x7faeec100e20 2024-09-19T08:54:00.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.904+0000 7faef10b9640 1 -- 172.21.15.7:0/1860075071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeec1a4a40 con 0x7faeec100e20 2024-09-19T08:54:00.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.904+0000 7faed3fff640 1 -- 172.21.15.7:0/1860075071 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc00f6b0 con 0x7faeec100e20 2024-09-19T08:54:00.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.904+0000 7faef10b9640 1 -- 172.21.15.7:0/1860075071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeec1a4f80 con 0x7faeec100e20 2024-09-19T08:54:00.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.905+0000 7faef10b9640 1 -- 172.21.15.7:0/1860075071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeec101200 con 0x7faeec100e20 2024-09-19T08:54:00.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.907+0000 7faed3fff640 1 -- 172.21.15.7:0/1860075071 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7faedc0109d0 con 0x7faeec100e20 2024-09-19T08:54:00.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.907+0000 7faed3fff640 1 --2- 172.21.15.7:0/1860075071 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7faed40a33b0 0x7faed40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:00.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.907+0000 7faed3fff640 1 -- 172.21.15.7:0/1860075071 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7faedc0cf8c0 con 0x7faeec100e20 2024-09-19T08:54:00.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.907+0000 7faeea59c640 1 --2- 172.21.15.7:0/1860075071 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7faed40a33b0 0x7faed40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:00.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.908+0000 7faeea59c640 1 --2- 172.21.15.7:0/1860075071 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7faed40a33b0 0x7faed40a5870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faeec06ab00 tx=0x7faee000b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:00.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:00.910+0000 7faed3fff640 1 -- 172.21.15.7:0/1860075071 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faedc009de0 con 0x7faeec100e20 2024-09-19T08:54:01.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:01.141+0000 7faef10b9640 1 -- 172.21.15.7:0/1860075071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faeec1a51b0 con 0x7faeec100e20 2024-09-19T08:54:01.141 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:01 smithi007 ceph-mon[31221]: pgmap v293: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:54:01.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:01.142+0000 7faed3fff640 1 -- 172.21.15.7:0/1860075071 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7faedc09bc10 con 0x7faeec100e20 2024-09-19T08:54:01.142 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:54:01.142 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:54:01.142 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:54:01.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:01.144+0000 7faef10b9640 1 -- 172.21.15.7:0/1860075071 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7faed40a33b0 msgr2=0x7faed40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:01.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:01.144+0000 7faef10b9640 1 --2- 172.21.15.7:0/1860075071 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7faed40a33b0 0x7faed40a5870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faeec06ab00 tx=0x7faee000b390 comp rx=0 tx=0).stop 2024-09-19T08:54:01.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:01.144+0000 7faef10b9640 1 -- 172.21.15.7:0/1860075071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeec100e20 msgr2=0x7faeec1992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:01.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:01.144+0000 7faef10b9640 1 --2- 172.21.15.7:0/1860075071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeec100e20 0x7faeec1992b0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7faedc00d950 tx=0x7faedc00de10 comp rx=0 tx=0).stop 2024-09-19T08:54:01.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:01.144+0000 7faef10b9640 1 -- 172.21.15.7:0/1860075071 shutdown_connections 2024-09-19T08:54:01.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:01.144+0000 7faef10b9640 1 --2- 172.21.15.7:0/1860075071 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7faed40a33b0 0x7faed40a5870 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:01.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:01.144+0000 7faef10b9640 1 --2- 172.21.15.7:0/1860075071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faeec102ef0 0x7faeec1a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:01.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:01.144+0000 7faef10b9640 1 --2- 172.21.15.7:0/1860075071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeec102570 0x7faeec1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:01.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:01.144+0000 7faef10b9640 1 --2- 172.21.15.7:0/1860075071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeec100e20 0x7faeec1992b0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:01.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:01.144+0000 7faef10b9640 1 -- 172.21.15.7:0/1860075071 >> 172.21.15.7:0/1860075071 conn(0x7faeec0fc7d0 msgr2=0x7faeec106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:01.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:01.144+0000 7faef10b9640 1 -- 172.21.15.7:0/1860075071 shutdown_connections 2024-09-19T08:54:01.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:01.144+0000 7faef10b9640 1 -- 172.21.15.7:0/1860075071 wait complete. 2024-09-19T08:54:01.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:01 smithi044 ceph-mon[35072]: pgmap v293: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:54:01.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:01 smithi175 ceph-mon[35688]: pgmap v293: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:54:01.872 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:54:02.140 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:02.260 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:02 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1860075071' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:02.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:02 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1860075071' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:02.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:02 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1860075071' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:02.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.642+0000 7f143737c640 1 -- 172.21.15.7:0/3103313138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1430102790 msgr2=0x7f14301067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:02.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.642+0000 7f143737c640 1 --2- 172.21.15.7:0/3103313138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1430102790 0x7f14301067e0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f1420009900 tx=0x7f142002a410 comp rx=0 tx=0).stop 2024-09-19T08:54:02.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.642+0000 7f143737c640 1 -- 172.21.15.7:0/3103313138 shutdown_connections 2024-09-19T08:54:02.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.642+0000 7f143737c640 1 --2- 172.21.15.7:0/3103313138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1430106f10 0x7f143010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.642+0000 7f143737c640 1 --2- 172.21.15.7:0/3103313138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1430102790 0x7f14301067e0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.642+0000 7f143737c640 1 --2- 172.21.15.7:0/3103313138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1430101de0 0x7f14301021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.642+0000 7f143737c640 1 -- 172.21.15.7:0/3103313138 >> 172.21.15.7:0/3103313138 conn(0x7f14300fd8c0 msgr2=0x7f14300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:02.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.642+0000 7f143737c640 1 -- 172.21.15.7:0/3103313138 shutdown_connections 2024-09-19T08:54:02.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.642+0000 7f143737c640 1 -- 172.21.15.7:0/3103313138 wait complete. 2024-09-19T08:54:02.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.643+0000 7f143737c640 1 Processor -- start 2024-09-19T08:54:02.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.643+0000 7f143737c640 1 -- start start 2024-09-19T08:54:02.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.643+0000 7f143737c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1430101de0 0x7f1430198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.643+0000 7f143737c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1430102790 0x7f14301989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.643+0000 7f143737c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1430106f10 0x7f143019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.643+0000 7f143737c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1430111f90 con 0x7f1430102790 2024-09-19T08:54:02.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.643+0000 7f143737c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1430111e10 con 0x7f1430101de0 2024-09-19T08:54:02.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.643+0000 7f143737c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1430112110 con 0x7f1430106f10 2024-09-19T08:54:02.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.643+0000 7f1434917640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1430102790 0x7f14301989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.643+0000 7f1434917640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1430102790 0x7f14301989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39498/0 (socket says 172.21.15.7:39498) 2024-09-19T08:54:02.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.643+0000 7f1434917640 1 -- 172.21.15.7:0/2622791279 learned_addr learned my addr 172.21.15.7:0/2622791279 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:02.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.644+0000 7f1435118640 1 --2- 172.21.15.7:0/2622791279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1430101de0 0x7f1430198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.644+0000 7f1435919640 1 --2- 172.21.15.7:0/2622791279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1430106f10 0x7f143019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.644+0000 7f1434917640 1 -- 172.21.15.7:0/2622791279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1430106f10 msgr2=0x7f143019cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:02.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.644+0000 7f1434917640 1 --2- 172.21.15.7:0/2622791279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1430106f10 0x7f143019cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.644+0000 7f1434917640 1 -- 172.21.15.7:0/2622791279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1430101de0 msgr2=0x7f1430198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:02.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.644+0000 7f1434917640 1 --2- 172.21.15.7:0/2622791279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1430101de0 0x7f1430198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.644+0000 7f1434917640 1 -- 172.21.15.7:0/2622791279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143019d420 con 0x7f1430102790 2024-09-19T08:54:02.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.644+0000 7f1435118640 1 --2- 172.21.15.7:0/2622791279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1430101de0 0x7f1430198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:02.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.644+0000 7f1435919640 1 --2- 172.21.15.7:0/2622791279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1430106f10 0x7f143019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:02.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.644+0000 7f1434917640 1 --2- 172.21.15.7:0/2622791279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1430102790 0x7f14301989b0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f1420006010 tx=0x7f14200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:02.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.644+0000 7f14267fc640 1 -- 172.21.15.7:0/2622791279 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142003f030 con 0x7f1430102790 2024-09-19T08:54:02.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.644+0000 7f14267fc640 1 -- 172.21.15.7:0/2622791279 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1420003ce0 con 0x7f1430102790 2024-09-19T08:54:02.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.644+0000 7f143737c640 1 -- 172.21.15.7:0/2622791279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f143019d6b0 con 0x7f1430102790 2024-09-19T08:54:02.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.644+0000 7f14267fc640 1 -- 172.21.15.7:0/2622791279 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1420035070 con 0x7f1430102790 2024-09-19T08:54:02.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.644+0000 7f143737c640 1 -- 172.21.15.7:0/2622791279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14301a4ff0 con 0x7f1430102790 2024-09-19T08:54:02.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.646+0000 7f14267fc640 1 -- 172.21.15.7:0/2622791279 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f1420042030 con 0x7f1430102790 2024-09-19T08:54:02.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.647+0000 7f1439755740 1 Processor -- start 2024-09-19T08:54:02.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.647+0000 7f1439755740 1 -- start start 2024-09-19T08:54:02.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.647+0000 7f1439755740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967ecb40 0x5633967eb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.647+0000 7f1439755740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967eb5d0 0x5633967eba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.647+0000 7f1439755740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967fa780 0x5633967fcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.647+0000 7f1439755740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5633967512f0 con 0x5633967fa780 2024-09-19T08:54:02.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.647+0000 7f1439755740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5633966f8cf0 con 0x5633967eb5d0 2024-09-19T08:54:02.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.647+0000 7f1439755740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56339674d2b0 con 0x5633967ecb40 2024-09-19T08:54:02.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.647+0000 7f14267fc640 1 --2- 172.21.15.7:0/2622791279 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f141c0a3430 0x7f141c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.648+0000 7f1434917640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967fa780 0x5633967fcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.648+0000 7f1435919640 1 --2- 172.21.15.7:0/2622791279 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f141c0a3430 0x7f141c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.648+0000 7f1434917640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967fa780 0x5633967fcb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39502/0 (socket says 172.21.15.7:39502) 2024-09-19T08:54:02.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.648+0000 7f1434917640 1 -- 172.21.15.7:0/640917055 learned_addr learned my addr 172.21.15.7:0/640917055 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:02.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.648+0000 7f1435118640 1 --2- 172.21.15.7:0/640917055 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967eb5d0 0x5633967eba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.648+0000 7f14267fc640 1 -- 172.21.15.7:0/2622791279 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7f14200f0400 con 0x7f1430102790 2024-09-19T08:54:02.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.648+0000 7f1435919640 1 --2- 172.21.15.7:0/640917055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967ecb40 0x5633967eb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.648+0000 7f1434917640 1 -- 172.21.15.7:0/640917055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967ecb40 msgr2=0x5633967eb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:02.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.648+0000 7f1434917640 1 --2- 172.21.15.7:0/640917055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967ecb40 0x5633967eb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.648+0000 7f1434917640 1 -- 172.21.15.7:0/640917055 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967eb5d0 msgr2=0x5633967eba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:02.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.648+0000 7f1434917640 1 --2- 172.21.15.7:0/640917055 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967eb5d0 0x5633967eba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.648+0000 7f1434917640 1 -- 172.21.15.7:0/640917055 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633966dd3a0 con 0x5633967fa780 2024-09-19T08:54:02.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.648+0000 7f1435919640 1 --2- 172.21.15.7:0/640917055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967ecb40 0x5633967eb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:02.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.648+0000 7f1435118640 1 --2- 172.21.15.7:0/640917055 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967eb5d0 0x5633967eba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:02.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.648+0000 7f1434917640 1 --2- 172.21.15.7:0/640917055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967fa780 0x5633967fcb70 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f14200b8b60 tx=0x7f142008c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135a363441d0de2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:02.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.648+0000 7f1435919640 1 --2- 172.21.15.7:0/2622791279 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f141c0a3430 0x7f141c0a58f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1428009440 tx=0x7f1428009600 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:02.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.648+0000 7f141b7fe640 1 -- 172.21.15.7:0/640917055 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1420049070 con 0x5633967fa780 2024-09-19T08:54:02.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.648+0000 7f141b7fe640 1 -- 172.21.15.7:0/640917055 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f142003b580 con 0x5633967fa780 2024-09-19T08:54:02.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.648+0000 7f141b7fe640 1 -- 172.21.15.7:0/640917055 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14200bc700 con 0x5633967fa780 2024-09-19T08:54:02.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.649+0000 7f1439755740 1 -- 172.21.15.7:0/640917055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967fa780 msgr2=0x5633967fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:02.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.649+0000 7f1439755740 1 --2- 172.21.15.7:0/640917055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967fa780 0x5633967fcb70 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f14200b8b60 tx=0x7f142008c3e0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.649+0000 7f1439755740 1 -- 172.21.15.7:0/640917055 shutdown_connections 2024-09-19T08:54:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.649+0000 7f1439755740 1 --2- 172.21.15.7:0/640917055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967fa780 0x5633967fcb70 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.649+0000 7f1439755740 1 --2- 172.21.15.7:0/640917055 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967eb5d0 0x5633967eba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.649+0000 7f1439755740 1 --2- 172.21.15.7:0/640917055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967ecb40 0x5633967eb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.649+0000 7f1439755740 1 -- 172.21.15.7:0/640917055 >> 172.21.15.7:0/640917055 conn(0x5633967b4310 msgr2=0x5633967e7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.649+0000 7f1439755740 1 -- 172.21.15.7:0/640917055 shutdown_connections 2024-09-19T08:54:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.649+0000 7f1439755740 1 -- 172.21.15.7:0/640917055 wait complete. 2024-09-19T08:54:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.650+0000 7f1439755740 1 -- start start 2024-09-19T08:54:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.650+0000 7f1439755740 1 Processor -- start 2024-09-19T08:54:02.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.650+0000 7f1439755740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967eb5d0 0x5633967fa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.650+0000 7f1439755740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967ecb40 0x5633967f7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.650+0000 7f1439755740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967fa780 0x5633967f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.650+0000 7f1439755740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5633967fd240 con 0x5633967fa780 2024-09-19T08:54:02.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.650+0000 7f1439755740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56339670c060 con 0x5633967ecb40 2024-09-19T08:54:02.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.650+0000 7f1439755740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5633967fd3c0 con 0x5633967eb5d0 2024-09-19T08:54:02.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.650+0000 7f1439755740 10 client.0 _ll_register_callbacks cb 0x56339645f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:02.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.650+0000 7f1435919640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967fa780 0x5633967f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.650+0000 7f1435919640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967fa780 0x5633967f7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39518/0 (socket says 172.21.15.7:39518) 2024-09-19T08:54:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.650+0000 7f1434917640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967ecb40 0x5633967f7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.650+0000 7f1435919640 1 -- 172.21.15.7:0/140746566 learned_addr learned my addr 172.21.15.7:0/140746566 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.651+0000 7f1435118640 1 --2- 172.21.15.7:0/140746566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967eb5d0 0x5633967fa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.651+0000 7f1435919640 1 -- 172.21.15.7:0/140746566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967eb5d0 msgr2=0x5633967fa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.651+0000 7f1435919640 1 --2- 172.21.15.7:0/140746566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967eb5d0 0x5633967fa180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.651+0000 7f1435919640 1 -- 172.21.15.7:0/140746566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967ecb40 msgr2=0x5633967f7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.651+0000 7f1435919640 1 --2- 172.21.15.7:0/140746566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967ecb40 0x5633967f7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.651+0000 7f1435919640 1 -- 172.21.15.7:0/140746566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633964c23c0 con 0x5633967fa780 2024-09-19T08:54:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.651+0000 7f1435118640 1 --2- 172.21.15.7:0/140746566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967eb5d0 0x5633967fa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.651+0000 7f1434917640 1 --2- 172.21.15.7:0/140746566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967ecb40 0x5633967f7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.651+0000 7f1435919640 1 --2- 172.21.15.7:0/140746566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967fa780 0x5633967f7a20 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f1428009c60 tx=0x7f1428004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c591aaf0a8095e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.651+0000 7f1418ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.651+0000 7f1418ff9640 1 -- 172.21.15.7:0/140746566 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1428028060 con 0x5633967fa780 2024-09-19T08:54:02.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.651+0000 7f1418ff9640 1 -- 172.21.15.7:0/140746566 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7f142801a8b0 con 0x5633967fa780 2024-09-19T08:54:02.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.651+0000 7f1439755740 1 -- 172.21.15.7:0/140746566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56339675e860 con 0x5633967fa780 2024-09-19T08:54:02.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.651+0000 7f1418ff9640 1 -- 172.21.15.7:0/140746566 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1428013040 con 0x5633967fa780 2024-09-19T08:54:02.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.651+0000 7f1439755740 10 client.17358 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:02.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.651+0000 7f1439755740 1 -- 172.21.15.7:0/140746566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563396808c30 con 0x5633967fa780 2024-09-19T08:54:02.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.652+0000 7f1418ff9640 1 -- 172.21.15.7:0/140746566 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56339675e860 con 0x5633967fa780 2024-09-19T08:54:02.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.652+0000 7f1418ff9640 1 -- 172.21.15.7:0/140746566 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1428023b20 con 0x5633967fa780 2024-09-19T08:54:02.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.652+0000 7f1439755740 10 client.17358 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:02.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.652+0000 7f1439755740 10 client.17358 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:54:02.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.652+0000 7f1439755740 20 client.17358 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:02.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.652+0000 7f1439755740 1 --2- 172.21.15.7:0/140746566 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x56339680a0f0 0x56339680c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.652+0000 7f1439755740 4 client.17358 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:02.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.652+0000 7f1439755740 1 -- 172.21.15.7:0/140746566 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563396758d70 con 0x56339680a0f0 2024-09-19T08:54:02.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.652+0000 7f1435118640 1 --2- 172.21.15.7:0/140746566 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x56339680a0f0 0x56339680c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.652+0000 7f1435118640 1 --2- 172.21.15.7:0/140746566 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x56339680a0f0 0x56339680c520 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=176e9394db7c41c2 server_cookie=1db67986f6ef9627 in_seq=0 out_seq=0 2024-09-19T08:54:02.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.652+0000 7f1418ff9640 10 client.17358 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:54:02.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.653+0000 7f1418ff9640 1 -- 172.21.15.7:0/140746566 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563396758d70 con 0x56339680a0f0 2024-09-19T08:54:02.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.653+0000 7f1418ff9640 10 client.17358 handle_command_reply: tid=0 2024-09-19T08:54:02.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.653+0000 7f1439755740 1 client.17358 shutdown 2024-09-19T08:54:02.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.653+0000 7f1439755740 1 -- 172.21.15.7:0/140746566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967fa780 msgr2=0x5633967f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:02.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.653+0000 7f1439755740 1 --2- 172.21.15.7:0/140746566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967fa780 0x5633967f7a20 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f1428009c60 tx=0x7f1428004a40 comp rx=0 tx=0).stop 2024-09-19T08:54:02.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.653+0000 7f1439755740 1 -- 172.21.15.7:0/140746566 shutdown_connections 2024-09-19T08:54:02.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.653+0000 7f1439755740 1 --2- 172.21.15.7:0/140746566 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x56339680a0f0 0x56339680c520 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.653+0000 7f1439755740 1 --2- 172.21.15.7:0/140746566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967fa780 0x5633967f7a20 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.653+0000 7f1439755740 1 --2- 172.21.15.7:0/140746566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967ecb40 0x5633967f7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.653+0000 7f1439755740 1 --2- 172.21.15.7:0/140746566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967eb5d0 0x5633967fa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.653+0000 7f1439755740 1 -- 172.21.15.7:0/140746566 >> 172.21.15.7:0/140746566 conn(0x5633967b4310 msgr2=0x5633967ed990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:02.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.653+0000 7f1418ff9640 0 client.17358 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:54:02.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.654+0000 7f1439755740 1 -- 172.21.15.7:0/140746566 shutdown_connections 2024-09-19T08:54:02.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.654+0000 7f1439755740 1 -- 172.21.15.7:0/140746566 wait complete. 2024-09-19T08:54:02.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.654+0000 7f1439755740 20 client.17358 trim_cache size 0 max 16384 2024-09-19T08:54:02.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.667+0000 7f1439755740 1 Processor -- start 2024-09-19T08:54:02.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.667+0000 7f1439755740 1 -- start start 2024-09-19T08:54:02.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.667+0000 7f1439755740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967eb5d0 0x563396806410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.667+0000 7f1439755740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967ecb40 0x5633967f73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.667+0000 7f1439755740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967fa780 0x5633967f7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.667+0000 7f1439755740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f14301ae040 con 0x5633967ecb40 2024-09-19T08:54:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.667+0000 7f1439755740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f14301ab910 con 0x5633967fa780 2024-09-19T08:54:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.667+0000 7f1439755740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f14301a9780 con 0x5633967eb5d0 2024-09-19T08:54:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.667+0000 7f1434917640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967ecb40 0x5633967f73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.667+0000 7f1434917640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967ecb40 0x5633967f73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39520/0 (socket says 172.21.15.7:39520) 2024-09-19T08:54:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.667+0000 7f1434917640 1 -- 172.21.15.7:0/1657427877 learned_addr learned my addr 172.21.15.7:0/1657427877 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.667+0000 7f1435919640 1 --2- 172.21.15.7:0/1657427877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967fa780 0x5633967f7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.667+0000 7f1435118640 1 --2- 172.21.15.7:0/1657427877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967eb5d0 0x563396806410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.667+0000 7f1434917640 1 -- 172.21.15.7:0/1657427877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967eb5d0 msgr2=0x563396806410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.667+0000 7f1434917640 1 --2- 172.21.15.7:0/1657427877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967eb5d0 0x563396806410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.667+0000 7f1434917640 1 -- 172.21.15.7:0/1657427877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967fa780 msgr2=0x5633967f7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.667+0000 7f1434917640 1 --2- 172.21.15.7:0/1657427877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967fa780 0x5633967f7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.667+0000 7f1434917640 1 -- 172.21.15.7:0/1657427877 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633967f9da0 con 0x5633967ecb40 2024-09-19T08:54:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.667+0000 7f1435118640 1 --2- 172.21.15.7:0/1657427877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967eb5d0 0x563396806410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.667+0000 7f1434917640 1 --2- 172.21.15.7:0/1657427877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967ecb40 0x5633967f73f0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f14200bc690 tx=0x7f14200f02f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b99ac483dd0500 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.668+0000 7f141affd640 1 -- 172.21.15.7:0/1657427877 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1420049040 con 0x5633967ecb40 2024-09-19T08:54:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.668+0000 7f141affd640 1 -- 172.21.15.7:0/1657427877 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14200bce00 con 0x5633967ecb40 2024-09-19T08:54:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.668+0000 7f141affd640 1 -- 172.21.15.7:0/1657427877 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14200bc700 con 0x5633967ecb40 2024-09-19T08:54:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.668+0000 7f1439755740 1 -- 172.21.15.7:0/1657427877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967ecb40 msgr2=0x5633967f73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.668+0000 7f1439755740 1 --2- 172.21.15.7:0/1657427877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967ecb40 0x5633967f73f0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f14200bc690 tx=0x7f14200f02f0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.668+0000 7f1439755740 1 -- 172.21.15.7:0/1657427877 shutdown_connections 2024-09-19T08:54:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.668+0000 7f1439755740 1 --2- 172.21.15.7:0/1657427877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967fa780 0x5633967f7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.668+0000 7f1439755740 1 --2- 172.21.15.7:0/1657427877 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967ecb40 0x5633967f73f0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.668+0000 7f1439755740 1 --2- 172.21.15.7:0/1657427877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967eb5d0 0x563396806410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.668+0000 7f1439755740 1 -- 172.21.15.7:0/1657427877 >> 172.21.15.7:0/1657427877 conn(0x5633967b4310 msgr2=0x5633967f2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.668+0000 7f1439755740 1 -- 172.21.15.7:0/1657427877 shutdown_connections 2024-09-19T08:54:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.668+0000 7f1439755740 1 -- 172.21.15.7:0/1657427877 wait complete. 2024-09-19T08:54:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.669+0000 7f1439755740 1 -- start start 2024-09-19T08:54:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.669+0000 7f1439755740 1 Processor -- start 2024-09-19T08:54:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.669+0000 7f1439755740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967eb5d0 0x5633967fd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.669+0000 7f1439755740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967ecb40 0x5633967fda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.669+0000 7f1439755740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967fa780 0x5633967fdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.669+0000 7f1439755740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f14301a9dd0 con 0x5633967eb5d0 2024-09-19T08:54:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.669+0000 7f1439755740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f14301ab240 con 0x5633967fa780 2024-09-19T08:54:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.669+0000 7f1439755740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f14301aa4a0 con 0x5633967ecb40 2024-09-19T08:54:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.669+0000 7f1439755740 10 client.0 _ll_register_callbacks cb 0x7f142800af10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.669+0000 7f1435118640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967eb5d0 0x5633967fd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.669+0000 7f1435118640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967eb5d0 0x5633967fd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39536/0 (socket says 172.21.15.7:39536) 2024-09-19T08:54:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.669+0000 7f1435118640 1 -- 172.21.15.7:0/3230683543 learned_addr learned my addr 172.21.15.7:0/3230683543 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.669+0000 7f1435919640 1 --2- 172.21.15.7:0/3230683543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967fa780 0x5633967fdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.669+0000 7f1434917640 1 --2- 172.21.15.7:0/3230683543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967ecb40 0x5633967fda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.670+0000 7f1435118640 1 -- 172.21.15.7:0/3230683543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967ecb40 msgr2=0x5633967fda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.670+0000 7f1435118640 1 --2- 172.21.15.7:0/3230683543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967ecb40 0x5633967fda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.670+0000 7f1435118640 1 -- 172.21.15.7:0/3230683543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967fa780 msgr2=0x5633967fdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.670+0000 7f1435118640 1 --2- 172.21.15.7:0/3230683543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967fa780 0x5633967fdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.670+0000 7f1435118640 1 -- 172.21.15.7:0/3230683543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563396872f10 con 0x5633967eb5d0 2024-09-19T08:54:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.670+0000 7f1435919640 1 --2- 172.21.15.7:0/3230683543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967fa780 0x5633967fdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.670+0000 7f1435118640 1 --2- 172.21.15.7:0/3230683543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967eb5d0 0x5633967fd540 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f142c00bfd0 tx=0x7f142c0054d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66bd8da0324581e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.670+0000 7f1418ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:02.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.670+0000 7f1418ff9640 1 -- 172.21.15.7:0/3230683543 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142c004230 con 0x5633967eb5d0 2024-09-19T08:54:02.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.670+0000 7f1418ff9640 1 -- 172.21.15.7:0/3230683543 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7f142c0043d0 con 0x5633967eb5d0 2024-09-19T08:54:02.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.670+0000 7f1439755740 1 -- 172.21.15.7:0/3230683543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14200bce00 con 0x5633967eb5d0 2024-09-19T08:54:02.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.670+0000 7f1418ff9640 1 -- 172.21.15.7:0/3230683543 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f142c02c050 con 0x5633967eb5d0 2024-09-19T08:54:02.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.670+0000 7f1439755740 10 client.17364 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:02.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.670+0000 7f1439755740 1 -- 172.21.15.7:0/3230683543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5633968741c0 con 0x5633967eb5d0 2024-09-19T08:54:02.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.670+0000 7f1418ff9640 1 -- 172.21.15.7:0/3230683543 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14200bce00 con 0x5633967eb5d0 2024-09-19T08:54:02.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.670+0000 7f1418ff9640 1 -- 172.21.15.7:0/3230683543 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f142c01d770 con 0x5633967eb5d0 2024-09-19T08:54:02.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.671+0000 7f1439755740 10 client.17364 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:02.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.671+0000 7f1439755740 10 client.17364 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:54:02.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.671+0000 7f1439755740 20 client.17364 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:02.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.671+0000 7f1439755740 1 --2- 172.21.15.7:0/3230683543 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x563396874990 0x563396876db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.671+0000 7f1439755740 4 client.17364 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:54:02.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.671+0000 7f1439755740 1 -- 172.21.15.7:0/3230683543 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5633966d5170 con 0x563396874990 2024-09-19T08:54:02.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.671+0000 7f1434917640 1 --2- 172.21.15.7:0/3230683543 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x563396874990 0x563396876db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.671+0000 7f1434917640 1 --2- 172.21.15.7:0/3230683543 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x563396874990 0x563396876db0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b50a78d230dd6b3e server_cookie=8fa40bfdf790d04e in_seq=0 out_seq=0 2024-09-19T08:54:02.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.671+0000 7f1418ff9640 10 client.17364 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:54:02.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.671+0000 7f1418ff9640 1 -- 172.21.15.7:0/3230683543 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5633966d5170 con 0x563396874990 2024-09-19T08:54:02.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.672+0000 7f1418ff9640 10 client.17364 handle_command_reply: tid=0 2024-09-19T08:54:02.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.672+0000 7f1439755740 1 client.17364 shutdown 2024-09-19T08:54:02.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.672+0000 7f1439755740 1 -- 172.21.15.7:0/3230683543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967eb5d0 msgr2=0x5633967fd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:02.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.672+0000 7f1439755740 1 --2- 172.21.15.7:0/3230683543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967eb5d0 0x5633967fd540 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f142c00bfd0 tx=0x7f142c0054d0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.672+0000 7f1439755740 1 -- 172.21.15.7:0/3230683543 shutdown_connections 2024-09-19T08:54:02.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.672+0000 7f1439755740 1 --2- 172.21.15.7:0/3230683543 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x563396874990 0x563396876db0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.672+0000 7f1439755740 1 --2- 172.21.15.7:0/3230683543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633967fa780 0x5633967fdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.672+0000 7f1439755740 1 --2- 172.21.15.7:0/3230683543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5633967ecb40 0x5633967fda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.672+0000 7f1439755740 1 --2- 172.21.15.7:0/3230683543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5633967eb5d0 0x5633967fd540 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.672+0000 7f1439755740 1 -- 172.21.15.7:0/3230683543 >> 172.21.15.7:0/3230683543 conn(0x5633967b4310 msgr2=0x5633967f73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:02.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.672+0000 7f1418ff9640 0 client.17364 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:54:02.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.672+0000 7f1439755740 1 -- 172.21.15.7:0/3230683543 shutdown_connections 2024-09-19T08:54:02.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.672+0000 7f1439755740 1 -- 172.21.15.7:0/3230683543 wait complete. 2024-09-19T08:54:02.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.672+0000 7f1439755740 20 client.17364 trim_cache size 0 max 16384 2024-09-19T08:54:02.677 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:54:02.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.672+0000 7f143737c640 1 -- 172.21.15.7:0/2622791279 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f141c0a3430 msgr2=0x7f141c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:02.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.672+0000 7f143737c640 1 --2- 172.21.15.7:0/2622791279 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f141c0a3430 0x7f141c0a58f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1428009440 tx=0x7f1428009600 comp rx=0 tx=0).stop 2024-09-19T08:54:02.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.672+0000 7f143737c640 1 -- 172.21.15.7:0/2622791279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1430102790 msgr2=0x7f14301989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:02.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.672+0000 7f143737c640 1 --2- 172.21.15.7:0/2622791279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1430102790 0x7f14301989b0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f1420006010 tx=0x7f14200042f0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.673+0000 7f143737c640 1 -- 172.21.15.7:0/2622791279 shutdown_connections 2024-09-19T08:54:02.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.673+0000 7f143737c640 1 --2- 172.21.15.7:0/2622791279 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f141c0a3430 0x7f141c0a58f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.673+0000 7f143737c640 1 --2- 172.21.15.7:0/2622791279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1430106f10 0x7f143019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.673+0000 7f143737c640 1 --2- 172.21.15.7:0/2622791279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1430102790 0x7f14301989b0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.673+0000 7f143737c640 1 --2- 172.21.15.7:0/2622791279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1430101de0 0x7f1430198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.673+0000 7f143737c640 1 -- 172.21.15.7:0/2622791279 >> 172.21.15.7:0/2622791279 conn(0x7f14300fd8c0 msgr2=0x7f14300fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:02.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.673+0000 7f143737c640 1 -- 172.21.15.7:0/2622791279 shutdown_connections 2024-09-19T08:54:02.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:02.673+0000 7f143737c640 1 -- 172.21.15.7:0/2622791279 wait complete. 2024-09-19T08:54:03.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:03 smithi007 ceph-mon[31221]: pgmap v294: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:54:03.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:03 smithi044 ceph-mon[35072]: pgmap v294: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:54:03.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:03 smithi175 ceph-mon[35688]: pgmap v294: 97 pgs: 97 active+clean; 2.1 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T08:54:03.473 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:54:03.730 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:04.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.191+0000 7f847c5b1640 1 -- 172.21.15.7:0/3409440351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8474101420 msgr2=0x7f847410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:04.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.191+0000 7f847c5b1640 1 --2- 172.21.15.7:0/3409440351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8474101420 0x7f847410d950 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f846c009cd0 tx=0x7f846c02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.191+0000 7f847c5b1640 1 -- 172.21.15.7:0/3409440351 shutdown_connections 2024-09-19T08:54:04.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.191+0000 7f847c5b1640 1 --2- 172.21.15.7:0/3409440351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8474101420 0x7f847410d950 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.191+0000 7f847c5b1640 1 --2- 172.21.15.7:0/3409440351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8474100a80 0x7f8474100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.191+0000 7f847c5b1640 1 --2- 172.21.15.7:0/3409440351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8474106a80 0x7f8474106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.191+0000 7f847c5b1640 1 -- 172.21.15.7:0/3409440351 >> 172.21.15.7:0/3409440351 conn(0x7f84740fc7a0 msgr2=0x7f84740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:04.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.191+0000 7f847c5b1640 1 -- 172.21.15.7:0/3409440351 shutdown_connections 2024-09-19T08:54:04.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.191+0000 7f847c5b1640 1 -- 172.21.15.7:0/3409440351 wait complete. 2024-09-19T08:54:04.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.192+0000 7f847c5b1640 1 Processor -- start 2024-09-19T08:54:04.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.192+0000 7f847c5b1640 1 -- start start 2024-09-19T08:54:04.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.192+0000 7f847c5b1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8474100a80 0x7f84741992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:04.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.192+0000 7f847c5b1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8474101420 0x7f84741997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:04.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.192+0000 7f847c5b1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8474106a80 0x7f84741a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:04.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.192+0000 7f847c5b1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8474110ea0 con 0x7f8474106a80 2024-09-19T08:54:04.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.192+0000 7f847c5b1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8474110d20 con 0x7f8474100a80 2024-09-19T08:54:04.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.192+0000 7f847c5b1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8474111020 con 0x7f8474101420 2024-09-19T08:54:04.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.192+0000 7f847ab4e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8474106a80 0x7f84741a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:04.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.192+0000 7f847ab4e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8474106a80 0x7f84741a4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42986/0 (socket says 172.21.15.7:42986) 2024-09-19T08:54:04.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.192+0000 7f847ab4e640 1 -- 172.21.15.7:0/2814767484 learned_addr learned my addr 172.21.15.7:0/2814767484 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:04.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.192+0000 7f847a34d640 1 --2- 172.21.15.7:0/2814767484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8474100a80 0x7f84741992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:04.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.192+0000 7f8479b4c640 1 --2- 172.21.15.7:0/2814767484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8474101420 0x7f84741997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:04.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.193+0000 7f847ab4e640 1 -- 172.21.15.7:0/2814767484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8474101420 msgr2=0x7f84741997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:04.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.193+0000 7f847ab4e640 1 --2- 172.21.15.7:0/2814767484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8474101420 0x7f84741997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.193+0000 7f847ab4e640 1 -- 172.21.15.7:0/2814767484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8474100a80 msgr2=0x7f84741992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:04.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.193+0000 7f847ab4e640 1 --2- 172.21.15.7:0/2814767484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8474100a80 0x7f84741992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.193+0000 7f847ab4e640 1 -- 172.21.15.7:0/2814767484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84741a4870 con 0x7f8474106a80 2024-09-19T08:54:04.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.193+0000 7f847a34d640 1 --2- 172.21.15.7:0/2814767484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8474100a80 0x7f84741992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:04.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.193+0000 7f847ab4e640 1 --2- 172.21.15.7:0/2814767484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8474106a80 0x7f84741a4330 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f846c005cc0 tx=0x7f846c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:04.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.193+0000 7f846b7fe640 1 -- 172.21.15.7:0/2814767484 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c004040 con 0x7f8474106a80 2024-09-19T08:54:04.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.193+0000 7f846b7fe640 1 -- 172.21.15.7:0/2814767484 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f846c0046c0 con 0x7f8474106a80 2024-09-19T08:54:04.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.193+0000 7f846b7fe640 1 -- 172.21.15.7:0/2814767484 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c046480 con 0x7f8474106a80 2024-09-19T08:54:04.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.193+0000 7f847c5b1640 1 -- 172.21.15.7:0/2814767484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84741a4a40 con 0x7f8474106a80 2024-09-19T08:54:04.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.193+0000 7f847c5b1640 1 -- 172.21.15.7:0/2814767484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84741a4ea0 con 0x7f8474106a80 2024-09-19T08:54:04.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.195+0000 7f847e98a740 1 Processor -- start 2024-09-19T08:54:04.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.196+0000 7f846b7fe640 1 -- 172.21.15.7:0/2814767484 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f846c0305a0 con 0x7f8474106a80 2024-09-19T08:54:04.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.196+0000 7f847e98a740 1 -- start start 2024-09-19T08:54:04.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.196+0000 7f847e98a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b2b40 0x5619c78b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:04.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.196+0000 7f847e98a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619c78b15d0 0x5619c78b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:04.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.196+0000 7f847e98a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619c78bc370 0x5619c78be760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:04.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.196+0000 7f847e98a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5619c78172f0 con 0x5619c78b2b40 2024-09-19T08:54:04.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.196+0000 7f847e98a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5619c77becf0 con 0x5619c78b15d0 2024-09-19T08:54:04.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.196+0000 7f847e98a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5619c78132b0 con 0x5619c78bc370 2024-09-19T08:54:04.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.196+0000 7f8479b4c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b2b40 0x5619c78b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:04.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.196+0000 7f8479b4c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b2b40 0x5619c78b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42994/0 (socket says 172.21.15.7:42994) 2024-09-19T08:54:04.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.196+0000 7f8479b4c640 1 -- 172.21.15.7:0/1661747238 learned_addr learned my addr 172.21.15.7:0/1661747238 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:04.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.196+0000 7f847a34d640 1 --2- 172.21.15.7:0/1661747238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619c78b15d0 0x5619c78b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:04.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.196+0000 7f8479b4c640 1 --2- 172.21.15.7:0/1661747238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619c78bc370 0x5619c78be760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:04.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.197+0000 7f846b7fe640 1 --2- 172.21.15.7:0/2814767484 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f84600a3430 0x7f84600a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:04.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.197+0000 7f8479b4c640 1 -- 172.21.15.7:0/1661747238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619c78bc370 msgr2=0x5619c78be760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:04.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.197+0000 7f8479b4c640 1 --2- 172.21.15.7:0/1661747238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619c78bc370 0x5619c78be760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.197+0000 7f8479b4c640 1 -- 172.21.15.7:0/1661747238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619c78b15d0 msgr2=0x5619c78b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:04.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.197+0000 7f8479b4c640 1 --2- 172.21.15.7:0/1661747238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619c78b15d0 0x5619c78b1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.197+0000 7f8479b4c640 1 -- 172.21.15.7:0/1661747238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619c77a33a0 con 0x5619c78b2b40 2024-09-19T08:54:04.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.197+0000 7f847ab4e640 1 --2- 172.21.15.7:0/2814767484 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f84600a3430 0x7f84600a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:04.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.197+0000 7f846b7fe640 1 -- 172.21.15.7:0/2814767484 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7f846c02e030 con 0x7f8474106a80 2024-09-19T08:54:04.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.197+0000 7f8479b4c640 1 --2- 172.21.15.7:0/1661747238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b2b40 0x5619c78b1090 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f84640058a0 tx=0x7f846400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3193e8308492a5ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:04.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.197+0000 7f8468ff9640 1 -- 172.21.15.7:0/1661747238 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8464004030 con 0x5619c78b2b40 2024-09-19T08:54:04.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.197+0000 7f8468ff9640 1 -- 172.21.15.7:0/1661747238 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84640041d0 con 0x5619c78b2b40 2024-09-19T08:54:04.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.197+0000 7f8468ff9640 1 -- 172.21.15.7:0/1661747238 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8464010660 con 0x5619c78b2b40 2024-09-19T08:54:04.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.198+0000 7f847ab4e640 1 --2- 172.21.15.7:0/2814767484 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f84600a3430 0x7f84600a58f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f846c0ef100 tx=0x7f846c03d040 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:04.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.198+0000 7f847e98a740 1 -- 172.21.15.7:0/1661747238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b2b40 msgr2=0x5619c78b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:04.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.198+0000 7f847e98a740 1 --2- 172.21.15.7:0/1661747238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b2b40 0x5619c78b1090 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f84640058a0 tx=0x7f846400b840 comp rx=0 tx=0).stop 2024-09-19T08:54:04.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.198+0000 7f847e98a740 1 -- 172.21.15.7:0/1661747238 shutdown_connections 2024-09-19T08:54:04.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.198+0000 7f847e98a740 1 --2- 172.21.15.7:0/1661747238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619c78bc370 0x5619c78be760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.198+0000 7f847e98a740 1 --2- 172.21.15.7:0/1661747238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619c78b15d0 0x5619c78b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.198+0000 7f847e98a740 1 --2- 172.21.15.7:0/1661747238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b2b40 0x5619c78b1090 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.198+0000 7f847e98a740 1 -- 172.21.15.7:0/1661747238 >> 172.21.15.7:0/1661747238 conn(0x5619c787a310 msgr2=0x5619c78adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:04.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.198+0000 7f847e98a740 1 -- 172.21.15.7:0/1661747238 shutdown_connections 2024-09-19T08:54:04.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.198+0000 7f847e98a740 1 -- 172.21.15.7:0/1661747238 wait complete. 2024-09-19T08:54:04.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.198+0000 7f847e98a740 1 -- start start 2024-09-19T08:54:04.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.198+0000 7f847e98a740 1 Processor -- start 2024-09-19T08:54:04.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.199+0000 7f847e98a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b15d0 0x5619c78bbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:04.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.199+0000 7f847e98a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619c78b2b40 0x5619c78b8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:04.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.199+0000 7f847e98a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619c78bc370 0x5619c78b9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:04.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.199+0000 7f847e98a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5619c78bf070 con 0x5619c78b15d0 2024-09-19T08:54:04.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.199+0000 7f847e98a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5619c77d2060 con 0x5619c78b2b40 2024-09-19T08:54:04.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.199+0000 7f847e98a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5619c78bf1f0 con 0x5619c78bc370 2024-09-19T08:54:04.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.199+0000 7f847e98a740 10 client.0 _ll_register_callbacks cb 0x5619c75258c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:04.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.199+0000 7f8479b4c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b15d0 0x5619c78bbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:04.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.199+0000 7f8479b4c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b15d0 0x5619c78bbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42998/0 (socket says 172.21.15.7:42998) 2024-09-19T08:54:04.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.199+0000 7f8479b4c640 1 -- 172.21.15.7:0/1435079064 learned_addr learned my addr 172.21.15.7:0/1435079064 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:04.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.199+0000 7f847a34d640 1 --2- 172.21.15.7:0/1435079064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619c78b2b40 0x5619c78b8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:04.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.199+0000 7f8479b4c640 1 --2- 172.21.15.7:0/1435079064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619c78bc370 0x5619c78b9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:04.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.199+0000 7f8479b4c640 1 -- 172.21.15.7:0/1435079064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619c78bc370 msgr2=0x5619c78b9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:04.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.199+0000 7f8479b4c640 1 --2- 172.21.15.7:0/1435079064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619c78bc370 0x5619c78b9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.199+0000 7f8479b4c640 1 -- 172.21.15.7:0/1435079064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619c78b2b40 msgr2=0x5619c78b8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:04.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.199+0000 7f8479b4c640 1 --2- 172.21.15.7:0/1435079064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619c78b2b40 0x5619c78b8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.199+0000 7f8479b4c640 1 -- 172.21.15.7:0/1435079064 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619c75883c0 con 0x5619c78b15d0 2024-09-19T08:54:04.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.199+0000 7f847a34d640 1 --2- 172.21.15.7:0/1435079064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619c78b2b40 0x5619c78b8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:04.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.199+0000 7f8479b4c640 1 --2- 172.21.15.7:0/1435079064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b15d0 0x5619c78bbd00 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f8464003c40 tx=0x7f8464003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954b901e5299a900 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:04.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.199+0000 7f845dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:04.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.200+0000 7f845dffb640 1 -- 172.21.15.7:0/1435079064 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84640037f0 con 0x5619c78b15d0 2024-09-19T08:54:04.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.200+0000 7f845dffb640 1 -- 172.21.15.7:0/1435079064 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7f8464003990 con 0x5619c78b15d0 2024-09-19T08:54:04.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.200+0000 7f847e98a740 1 -- 172.21.15.7:0/1435079064 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84640041d0 con 0x5619c78b15d0 2024-09-19T08:54:04.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.200+0000 7f845dffb640 1 -- 172.21.15.7:0/1435079064 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8464035050 con 0x5619c78b15d0 2024-09-19T08:54:04.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.200+0000 7f847e98a740 10 client.17376 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:04.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.200+0000 7f847e98a740 1 -- 172.21.15.7:0/1435079064 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5619c78caaa0 con 0x5619c78b15d0 2024-09-19T08:54:04.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.200+0000 7f845dffb640 1 -- 172.21.15.7:0/1435079064 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84640041d0 con 0x5619c78b15d0 2024-09-19T08:54:04.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.200+0000 7f845dffb640 1 -- 172.21.15.7:0/1435079064 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f846402d020 con 0x5619c78b15d0 2024-09-19T08:54:04.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.200+0000 7f847e98a740 10 client.17376 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:04.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.200+0000 7f847e98a740 10 client.17376 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:54:04.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.200+0000 7f847e98a740 20 client.17376 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:04.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.200+0000 7f847e98a740 1 --2- 172.21.15.7:0/1435079064 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5619c78cbdf0 0x5619c78ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:04.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.200+0000 7f847e98a740 4 client.17376 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:04.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.200+0000 7f847e98a740 1 -- 172.21.15.7:0/1435079064 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619c7824860 con 0x5619c78cbdf0 2024-09-19T08:54:04.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.201+0000 7f847a34d640 1 --2- 172.21.15.7:0/1435079064 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5619c78cbdf0 0x5619c78ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:04.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.201+0000 7f847a34d640 1 --2- 172.21.15.7:0/1435079064 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5619c78cbdf0 0x5619c78ce1e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4f266db58b40eec0 server_cookie=26f98b0af6497d75 in_seq=0 out_seq=0 2024-09-19T08:54:04.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.201+0000 7f845dffb640 10 client.17376 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:54:04.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.202+0000 7f845dffb640 1 -- 172.21.15.7:0/1435079064 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5619c7824860 con 0x5619c78cbdf0 2024-09-19T08:54:04.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.202+0000 7f845dffb640 10 client.17376 handle_command_reply: tid=0 2024-09-19T08:54:04.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.202+0000 7f847e98a740 1 client.17376 shutdown 2024-09-19T08:54:04.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.202+0000 7f847e98a740 1 -- 172.21.15.7:0/1435079064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b15d0 msgr2=0x5619c78bbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:04.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.202+0000 7f847e98a740 1 --2- 172.21.15.7:0/1435079064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b15d0 0x5619c78bbd00 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f8464003c40 tx=0x7f8464003d60 comp rx=0 tx=0).stop 2024-09-19T08:54:04.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.202+0000 7f847e98a740 1 -- 172.21.15.7:0/1435079064 shutdown_connections 2024-09-19T08:54:04.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.202+0000 7f847e98a740 1 --2- 172.21.15.7:0/1435079064 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5619c78cbdf0 0x5619c78ce1e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.202+0000 7f847e98a740 1 --2- 172.21.15.7:0/1435079064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619c78bc370 0x5619c78b9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.202+0000 7f847e98a740 1 --2- 172.21.15.7:0/1435079064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619c78b2b40 0x5619c78b8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.202+0000 7f847e98a740 1 --2- 172.21.15.7:0/1435079064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b15d0 0x5619c78bbd00 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.202+0000 7f845dffb640 0 client.17376 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:54:04.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.202+0000 7f847e98a740 1 -- 172.21.15.7:0/1435079064 >> 172.21.15.7:0/1435079064 conn(0x5619c787a310 msgr2=0x5619c78b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:04.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.202+0000 7f847e98a740 1 -- 172.21.15.7:0/1435079064 shutdown_connections 2024-09-19T08:54:04.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.202+0000 7f847e98a740 1 -- 172.21.15.7:0/1435079064 wait complete. 2024-09-19T08:54:04.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.202+0000 7f847e98a740 20 client.17376 trim_cache size 0 max 16384 2024-09-19T08:54:04.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.215+0000 7f847e98a740 1 Processor -- start 2024-09-19T08:54:04.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.215+0000 7f847e98a740 1 -- start start 2024-09-19T08:54:04.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.215+0000 7f847e98a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b15d0 0x5619c78c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:04.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.215+0000 7f847e98a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619c78b2b40 0x5619c78d3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:04.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.215+0000 7f847e98a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619c78bc370 0x5619c78d3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:04.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.215+0000 7f847e98a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f84741b0210 con 0x5619c78b15d0 2024-09-19T08:54:04.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.215+0000 7f847e98a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f84741adae0 con 0x5619c78bc370 2024-09-19T08:54:04.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.215+0000 7f847e98a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f84741ab950 con 0x5619c78b2b40 2024-09-19T08:54:04.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.215+0000 7f8479b4c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b15d0 0x5619c78c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:04.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.216+0000 7f8479b4c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b15d0 0x5619c78c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43012/0 (socket says 172.21.15.7:43012) 2024-09-19T08:54:04.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.216+0000 7f8479b4c640 1 -- 172.21.15.7:0/418731139 learned_addr learned my addr 172.21.15.7:0/418731139 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:04.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.216+0000 7f8479b4c640 1 -- 172.21.15.7:0/418731139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619c78b2b40 msgr2=0x5619c78d3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:04.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.216+0000 7f8479b4c640 1 --2- 172.21.15.7:0/418731139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619c78b2b40 0x5619c78d3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.216+0000 7f8479b4c640 1 -- 172.21.15.7:0/418731139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619c78bc370 msgr2=0x5619c78d3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:04.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.216+0000 7f8479b4c640 1 --2- 172.21.15.7:0/418731139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619c78bc370 0x5619c78d3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.216+0000 7f8479b4c640 1 -- 172.21.15.7:0/418731139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619c78b7500 con 0x5619c78b15d0 2024-09-19T08:54:04.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.216+0000 7f8479b4c640 1 --2- 172.21.15.7:0/418731139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b15d0 0x5619c78c8310 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f8464003d10 tx=0x7f8464001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354214ceb5c0aac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:04.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.216+0000 7f845ffff640 1 -- 172.21.15.7:0/418731139 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846400b770 con 0x5619c78b15d0 2024-09-19T08:54:04.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.216+0000 7f845ffff640 1 -- 172.21.15.7:0/418731139 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f846402a040 con 0x5619c78b15d0 2024-09-19T08:54:04.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.216+0000 7f845ffff640 1 -- 172.21.15.7:0/418731139 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84640039e0 con 0x5619c78b15d0 2024-09-19T08:54:04.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.217+0000 7f847e98a740 1 -- 172.21.15.7:0/418731139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b15d0 msgr2=0x5619c78c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:04.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.217+0000 7f847e98a740 1 --2- 172.21.15.7:0/418731139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b15d0 0x5619c78c8310 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f8464003d10 tx=0x7f8464001e70 comp rx=0 tx=0).stop 2024-09-19T08:54:04.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.217+0000 7f847e98a740 1 -- 172.21.15.7:0/418731139 shutdown_connections 2024-09-19T08:54:04.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.217+0000 7f847e98a740 1 --2- 172.21.15.7:0/418731139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619c78bc370 0x5619c78d3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.217+0000 7f847e98a740 1 --2- 172.21.15.7:0/418731139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619c78b2b40 0x5619c78d3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.217+0000 7f847e98a740 1 --2- 172.21.15.7:0/418731139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b15d0 0x5619c78c8310 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.217+0000 7f847e98a740 1 -- 172.21.15.7:0/418731139 >> 172.21.15.7:0/418731139 conn(0x5619c787a310 msgr2=0x5619c78b80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:04.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.217+0000 7f847e98a740 1 -- 172.21.15.7:0/418731139 shutdown_connections 2024-09-19T08:54:04.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.217+0000 7f847e98a740 1 -- 172.21.15.7:0/418731139 wait complete. 2024-09-19T08:54:04.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.217+0000 7f847e98a740 1 -- start start 2024-09-19T08:54:04.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.217+0000 7f847e98a740 1 Processor -- start 2024-09-19T08:54:04.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.218+0000 7f847e98a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b15d0 0x5619c78c4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:04.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.218+0000 7f847e98a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619c78b2b40 0x5619c78c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:04.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.218+0000 7f847e98a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619c78bc370 0x5619c78bfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:04.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.218+0000 7f847e98a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f84741abfa0 con 0x5619c78b15d0 2024-09-19T08:54:04.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.218+0000 7f847e98a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f84741ad410 con 0x5619c78b2b40 2024-09-19T08:54:04.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.218+0000 7f847e98a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f84741ac670 con 0x5619c78bc370 2024-09-19T08:54:04.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.218+0000 7f847e98a740 10 client.0 _ll_register_callbacks cb 0x7f84700071a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:04.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.218+0000 7f8479b4c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b15d0 0x5619c78c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:04.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.218+0000 7f8479b4c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b15d0 0x5619c78c4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43026/0 (socket says 172.21.15.7:43026) 2024-09-19T08:54:04.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.218+0000 7f8479b4c640 1 -- 172.21.15.7:0/4049144206 learned_addr learned my addr 172.21.15.7:0/4049144206 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:04.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.218+0000 7f847a34d640 1 --2- 172.21.15.7:0/4049144206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619c78b2b40 0x5619c78c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:04.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.218+0000 7f8479b4c640 1 -- 172.21.15.7:0/4049144206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619c78bc370 msgr2=0x5619c78bfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:04.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.218+0000 7f8479b4c640 1 --2- 172.21.15.7:0/4049144206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619c78bc370 0x5619c78bfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.218+0000 7f8479b4c640 1 -- 172.21.15.7:0/4049144206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619c78b2b40 msgr2=0x5619c78c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:04.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.218+0000 7f8479b4c640 1 --2- 172.21.15.7:0/4049144206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619c78b2b40 0x5619c78c4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.218+0000 7f8479b4c640 1 -- 172.21.15.7:0/4049144206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619c78c0620 con 0x5619c78b15d0 2024-09-19T08:54:04.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.218+0000 7f847a34d640 1 --2- 172.21.15.7:0/4049144206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619c78b2b40 0x5619c78c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:04.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.218+0000 7f8479b4c640 1 --2- 172.21.15.7:0/4049144206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b15d0 0x5619c78c4870 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f8464005fe0 tx=0x7f8464003660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e2b1291c31ec4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:04.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.218+0000 7f845dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:04.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.218+0000 7f845dffb640 1 -- 172.21.15.7:0/4049144206 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8464003760 con 0x5619c78b15d0 2024-09-19T08:54:04.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.218+0000 7f845dffb640 1 -- 172.21.15.7:0/4049144206 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7f8464003900 con 0x5619c78b15d0 2024-09-19T08:54:04.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.218+0000 7f847e98a740 1 -- 172.21.15.7:0/4049144206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f846402a040 con 0x5619c78b15d0 2024-09-19T08:54:04.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.219+0000 7f845dffb640 1 -- 172.21.15.7:0/4049144206 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8464049050 con 0x5619c78b15d0 2024-09-19T08:54:04.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.219+0000 7f847e98a740 10 client.17382 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:04.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.219+0000 7f847e98a740 1 -- 172.21.15.7:0/4049144206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5619c79365f0 con 0x5619c78b15d0 2024-09-19T08:54:04.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.219+0000 7f845dffb640 1 -- 172.21.15.7:0/4049144206 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f846402a040 con 0x5619c78b15d0 2024-09-19T08:54:04.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.219+0000 7f845dffb640 1 -- 172.21.15.7:0/4049144206 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f846402d040 con 0x5619c78b15d0 2024-09-19T08:54:04.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.219+0000 7f847e98a740 10 client.17382 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:04.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.219+0000 7f847e98a740 10 client.17382 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:54:04.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.219+0000 7f847e98a740 20 client.17382 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:04.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.219+0000 7f847e98a740 1 --2- 172.21.15.7:0/4049144206 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5619c7936ba0 0x5619c7938f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:04.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.219+0000 7f847e98a740 4 client.17382 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:54:04.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.219+0000 7f847e98a740 1 -- 172.21.15.7:0/4049144206 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5619c781ed70 con 0x5619c7936ba0 2024-09-19T08:54:04.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.219+0000 7f847a34d640 1 --2- 172.21.15.7:0/4049144206 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5619c7936ba0 0x5619c7938f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:04.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.220+0000 7f845dffb640 10 client.17382 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:54:04.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.220+0000 7f847a34d640 1 --2- 172.21.15.7:0/4049144206 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5619c7936ba0 0x5619c7938f90 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e34530a119e62ccc server_cookie=cf2de5575fa376cc in_seq=0 out_seq=0 2024-09-19T08:54:04.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.220+0000 7f845dffb640 1 -- 172.21.15.7:0/4049144206 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5619c781ed70 con 0x5619c7936ba0 2024-09-19T08:54:04.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.220+0000 7f845dffb640 10 client.17382 handle_command_reply: tid=0 2024-09-19T08:54:04.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.220+0000 7f847e98a740 1 client.17382 shutdown 2024-09-19T08:54:04.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.220+0000 7f847e98a740 1 -- 172.21.15.7:0/4049144206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b15d0 msgr2=0x5619c78c4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:04.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.220+0000 7f847e98a740 1 --2- 172.21.15.7:0/4049144206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b15d0 0x5619c78c4870 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f8464005fe0 tx=0x7f8464003660 comp rx=0 tx=0).stop 2024-09-19T08:54:04.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.220+0000 7f847e98a740 1 -- 172.21.15.7:0/4049144206 shutdown_connections 2024-09-19T08:54:04.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.220+0000 7f847e98a740 1 --2- 172.21.15.7:0/4049144206 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x5619c7936ba0 0x5619c7938f90 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.220+0000 7f847e98a740 1 --2- 172.21.15.7:0/4049144206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619c78bc370 0x5619c78bfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.220+0000 7f847e98a740 1 --2- 172.21.15.7:0/4049144206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5619c78b2b40 0x5619c78c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.220+0000 7f845dffb640 0 client.17382 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:54:04.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.220+0000 7f847e98a740 1 --2- 172.21.15.7:0/4049144206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5619c78b15d0 0x5619c78c4870 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.220+0000 7f847e98a740 1 -- 172.21.15.7:0/4049144206 >> 172.21.15.7:0/4049144206 conn(0x5619c787a310 msgr2=0x5619c78ac4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:04.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.220+0000 7f847e98a740 1 -- 172.21.15.7:0/4049144206 shutdown_connections 2024-09-19T08:54:04.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.220+0000 7f847e98a740 1 -- 172.21.15.7:0/4049144206 wait complete. 2024-09-19T08:54:04.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.220+0000 7f847e98a740 20 client.17382 trim_cache size 0 max 16384 2024-09-19T08:54:04.226 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:54:04.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.221+0000 7f847c5b1640 1 -- 172.21.15.7:0/2814767484 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f84600a3430 msgr2=0x7f84600a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:04.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.221+0000 7f847c5b1640 1 --2- 172.21.15.7:0/2814767484 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f84600a3430 0x7f84600a58f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f846c0ef100 tx=0x7f846c03d040 comp rx=0 tx=0).stop 2024-09-19T08:54:04.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.221+0000 7f847c5b1640 1 -- 172.21.15.7:0/2814767484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8474106a80 msgr2=0x7f84741a4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:04.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.221+0000 7f847c5b1640 1 --2- 172.21.15.7:0/2814767484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8474106a80 0x7f84741a4330 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f846c005cc0 tx=0x7f846c003970 comp rx=0 tx=0).stop 2024-09-19T08:54:04.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.221+0000 7f847c5b1640 1 -- 172.21.15.7:0/2814767484 shutdown_connections 2024-09-19T08:54:04.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.221+0000 7f847c5b1640 1 --2- 172.21.15.7:0/2814767484 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f84600a3430 0x7f84600a58f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.221+0000 7f847c5b1640 1 --2- 172.21.15.7:0/2814767484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8474106a80 0x7f84741a4330 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.221+0000 7f847c5b1640 1 --2- 172.21.15.7:0/2814767484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8474101420 0x7f84741997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.221+0000 7f847c5b1640 1 --2- 172.21.15.7:0/2814767484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8474100a80 0x7f84741992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.221+0000 7f847c5b1640 1 -- 172.21.15.7:0/2814767484 >> 172.21.15.7:0/2814767484 conn(0x7f84740fc7a0 msgr2=0x7f84740fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:04.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.221+0000 7f847c5b1640 1 -- 172.21.15.7:0/2814767484 shutdown_connections 2024-09-19T08:54:04.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:04.221+0000 7f847c5b1640 1 -- 172.21.15.7:0/2814767484 wait complete. 2024-09-19T08:54:05.178 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:54:05.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:05 smithi007 ceph-mon[31221]: pgmap v295: 97 pgs: 97 active+clean; 2.1 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:54:05.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:05 smithi044 ceph-mon[35072]: pgmap v295: 97 pgs: 97 active+clean; 2.1 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:54:05.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:05 smithi175 ceph-mon[35688]: pgmap v295: 97 pgs: 97 active+clean; 2.1 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:54:05.439 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:05.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.888+0000 7ff03ca6c640 1 -- 172.21.15.7:0/274759536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff038103740 msgr2=0x7ff038107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:05.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.888+0000 7ff03ca6c640 1 --2- 172.21.15.7:0/274759536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff038103740 0x7ff038107b80 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7ff020009930 tx=0x7ff02002a420 comp rx=0 tx=0).stop 2024-09-19T08:54:05.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.889+0000 7ff03ca6c640 1 -- 172.21.15.7:0/274759536 shutdown_connections 2024-09-19T08:54:05.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.889+0000 7ff03ca6c640 1 --2- 172.21.15.7:0/274759536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff038108290 0x7ff03810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.889+0000 7ff03ca6c640 1 --2- 172.21.15.7:0/274759536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff038103740 0x7ff038107b80 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.889+0000 7ff03ca6c640 1 --2- 172.21.15.7:0/274759536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff038102d90 0x7ff038103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.889+0000 7ff03ca6c640 1 -- 172.21.15.7:0/274759536 >> 172.21.15.7:0/274759536 conn(0x7ff0380fc7d0 msgr2=0x7ff0380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:05.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.889+0000 7ff03ca6c640 1 -- 172.21.15.7:0/274759536 shutdown_connections 2024-09-19T08:54:05.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.889+0000 7ff03ca6c640 1 -- 172.21.15.7:0/274759536 wait complete. 2024-09-19T08:54:05.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.889+0000 7ff03ca6c640 1 Processor -- start 2024-09-19T08:54:05.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.889+0000 7ff03ca6c640 1 -- start start 2024-09-19T08:54:05.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.890+0000 7ff03ca6c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff038102d90 0x7ff038198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:05.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.890+0000 7ff03ca6c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff038103740 0x7ff038198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:05.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.890+0000 7ff03ca6c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff038108290 0x7ff03819cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:05.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.890+0000 7ff03ca6c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff038112090 con 0x7ff038103740 2024-09-19T08:54:05.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.890+0000 7ff03ca6c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff038111f10 con 0x7ff038108290 2024-09-19T08:54:05.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.890+0000 7ff03ca6c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff038112210 con 0x7ff038102d90 2024-09-19T08:54:05.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.890+0000 7ff02ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff038103740 0x7ff038198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:05.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.890+0000 7ff02ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff038103740 0x7ff038198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43048/0 (socket says 172.21.15.7:43048) 2024-09-19T08:54:05.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.890+0000 7ff02ffff640 1 -- 172.21.15.7:0/411900034 learned_addr learned my addr 172.21.15.7:0/411900034 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:05.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.890+0000 7ff036d9d640 1 --2- 172.21.15.7:0/411900034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff038108290 0x7ff03819cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:05.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.890+0000 7ff03659c640 1 --2- 172.21.15.7:0/411900034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff038102d90 0x7ff038198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:05.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.890+0000 7ff02ffff640 1 -- 172.21.15.7:0/411900034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff038102d90 msgr2=0x7ff038198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:05.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.890+0000 7ff02ffff640 1 --2- 172.21.15.7:0/411900034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff038102d90 0x7ff038198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.890+0000 7ff02ffff640 1 -- 172.21.15.7:0/411900034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff038108290 msgr2=0x7ff03819cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:05.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.890+0000 7ff02ffff640 1 --2- 172.21.15.7:0/411900034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff038108290 0x7ff03819cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.890+0000 7ff02ffff640 1 -- 172.21.15.7:0/411900034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff03819d5c0 con 0x7ff038103740 2024-09-19T08:54:05.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.890+0000 7ff02ffff640 1 --2- 172.21.15.7:0/411900034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff038103740 0x7ff038198b50 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7ff020005940 tx=0x7ff0200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:05.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.891+0000 7ff02f7fe640 1 -- 172.21.15.7:0/411900034 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02003f030 con 0x7ff038103740 2024-09-19T08:54:05.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.891+0000 7ff03ca6c640 1 -- 172.21.15.7:0/411900034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff03819d850 con 0x7ff038103740 2024-09-19T08:54:05.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.891+0000 7ff02f7fe640 1 -- 172.21.15.7:0/411900034 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff020003ce0 con 0x7ff038103740 2024-09-19T08:54:05.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.891+0000 7ff02f7fe640 1 -- 172.21.15.7:0/411900034 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff020035070 con 0x7ff038103740 2024-09-19T08:54:05.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.891+0000 7ff03ca6c640 1 -- 172.21.15.7:0/411900034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0381a5190 con 0x7ff038103740 2024-09-19T08:54:05.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.893+0000 7ff02f7fe640 1 -- 172.21.15.7:0/411900034 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff020042030 con 0x7ff038103740 2024-09-19T08:54:05.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.893+0000 7ff03ee45740 1 Processor -- start 2024-09-19T08:54:05.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.893+0000 7ff03ee45740 1 -- start start 2024-09-19T08:54:05.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.894+0000 7ff03ee45740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564045c5ab40 0x564045c59090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:05.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.894+0000 7ff03ee45740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c595d0 0x564045c59a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:05.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.894+0000 7ff03ee45740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564045c64370 0x564045c66760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:05.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.894+0000 7ff03ee45740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564045bbf2f0 con 0x564045c595d0 2024-09-19T08:54:05.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.894+0000 7ff03ee45740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564045b66cf0 con 0x564045c64370 2024-09-19T08:54:05.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.894+0000 7ff03ee45740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564045bbb2b0 con 0x564045c5ab40 2024-09-19T08:54:05.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.894+0000 7ff03659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c595d0 0x564045c59a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:05.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.894+0000 7ff03659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c595d0 0x564045c59a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43054/0 (socket says 172.21.15.7:43054) 2024-09-19T08:54:05.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.894+0000 7ff03659c640 1 -- 172.21.15.7:0/1424722851 learned_addr learned my addr 172.21.15.7:0/1424722851 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:05.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.894+0000 7ff036d9d640 1 --2- 172.21.15.7:0/1424722851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564045c5ab40 0x564045c59090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:05.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.894+0000 7ff02ffff640 1 --2- 172.21.15.7:0/1424722851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564045c64370 0x564045c66760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:05.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.894+0000 7ff02f7fe640 1 --2- 172.21.15.7:0/411900034 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff0240a33b0 0x7ff0240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:05.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.894+0000 7ff036d9d640 1 -- 172.21.15.7:0/1424722851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564045c64370 msgr2=0x564045c66760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:05.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.894+0000 7ff036d9d640 1 --2- 172.21.15.7:0/1424722851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564045c64370 0x564045c66760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.894+0000 7ff036d9d640 1 -- 172.21.15.7:0/1424722851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c595d0 msgr2=0x564045c59a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:05.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.894+0000 7ff036d9d640 1 --2- 172.21.15.7:0/1424722851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c595d0 0x564045c59a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.894+0000 7ff036d9d640 1 -- 172.21.15.7:0/1424722851 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564045b4b3a0 con 0x564045c5ab40 2024-09-19T08:54:05.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.894+0000 7ff02ffff640 1 --2- 172.21.15.7:0/1424722851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564045c64370 0x564045c66760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:05.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.894+0000 7ff03659c640 1 --2- 172.21.15.7:0/1424722851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c595d0 0x564045c59a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:05.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.894+0000 7ff036d9d640 1 --2- 172.21.15.7:0/411900034 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff0240a33b0 0x7ff0240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:05.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.894+0000 7ff02f7fe640 1 -- 172.21.15.7:0/411900034 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7ff0200f0280 con 0x7ff038103740 2024-09-19T08:54:05.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.895+0000 7ff036d9d640 1 --2- 172.21.15.7:0/1424722851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564045c5ab40 0x564045c59090 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff0300103f0 tx=0x7ff0300108b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9511bd912b5e999 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:05.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.895+0000 7ff02cff9640 1 -- 172.21.15.7:0/1424722851 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030024070 con 0x564045c5ab40 2024-09-19T08:54:05.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.895+0000 7ff036d9d640 1 --2- 172.21.15.7:0/411900034 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff0240a33b0 0x7ff0240a5870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff030021000 tx=0x7ff03001e000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:05.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.895+0000 7ff02cff9640 1 -- 172.21.15.7:0/1424722851 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff03001e960 con 0x564045c5ab40 2024-09-19T08:54:05.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.895+0000 7ff02cff9640 1 -- 172.21.15.7:0/1424722851 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03001c7b0 con 0x564045c5ab40 2024-09-19T08:54:05.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.896+0000 7ff03ee45740 1 -- 172.21.15.7:0/1424722851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564045c5ab40 msgr2=0x564045c59090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:05.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.896+0000 7ff03ee45740 1 --2- 172.21.15.7:0/1424722851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564045c5ab40 0x564045c59090 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff0300103f0 tx=0x7ff0300108b0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.896+0000 7ff03ee45740 1 -- 172.21.15.7:0/1424722851 shutdown_connections 2024-09-19T08:54:05.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.896+0000 7ff03ee45740 1 --2- 172.21.15.7:0/1424722851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564045c64370 0x564045c66760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.896+0000 7ff03ee45740 1 --2- 172.21.15.7:0/1424722851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c595d0 0x564045c59a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.896+0000 7ff03ee45740 1 --2- 172.21.15.7:0/1424722851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564045c5ab40 0x564045c59090 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.896+0000 7ff03ee45740 1 -- 172.21.15.7:0/1424722851 >> 172.21.15.7:0/1424722851 conn(0x564045c22310 msgr2=0x564045c55c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:05.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.896+0000 7ff03ee45740 1 -- 172.21.15.7:0/1424722851 shutdown_connections 2024-09-19T08:54:05.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.896+0000 7ff03ee45740 1 -- 172.21.15.7:0/1424722851 wait complete. 2024-09-19T08:54:05.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.896+0000 7ff03ee45740 1 -- start start 2024-09-19T08:54:05.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.896+0000 7ff03ee45740 1 Processor -- start 2024-09-19T08:54:05.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.896+0000 7ff03ee45740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c595d0 0x564045c63d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:05.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.896+0000 7ff03ee45740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564045c5ab40 0x564045c61000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:05.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.897+0000 7ff03ee45740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564045c64370 0x564045c615d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:05.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.897+0000 7ff03ee45740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564045c67070 con 0x564045c595d0 2024-09-19T08:54:05.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.897+0000 7ff03ee45740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564045b7a060 con 0x564045c64370 2024-09-19T08:54:05.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.897+0000 7ff03ee45740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564045c671f0 con 0x564045c5ab40 2024-09-19T08:54:05.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.897+0000 7ff03ee45740 10 client.0 _ll_register_callbacks cb 0x5640458cd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:05.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.897+0000 7ff03659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c595d0 0x564045c63d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:05.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.897+0000 7ff03659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c595d0 0x564045c63d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43068/0 (socket says 172.21.15.7:43068) 2024-09-19T08:54:05.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.897+0000 7ff03659c640 1 -- 172.21.15.7:0/767232929 learned_addr learned my addr 172.21.15.7:0/767232929 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:05.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.897+0000 7ff02ffff640 1 --2- 172.21.15.7:0/767232929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564045c5ab40 0x564045c61000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:05.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.897+0000 7ff036d9d640 1 --2- 172.21.15.7:0/767232929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564045c64370 0x564045c615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:05.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.897+0000 7ff03659c640 1 -- 172.21.15.7:0/767232929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564045c5ab40 msgr2=0x564045c61000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:05.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.897+0000 7ff03659c640 1 --2- 172.21.15.7:0/767232929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564045c5ab40 0x564045c61000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.897+0000 7ff03659c640 1 -- 172.21.15.7:0/767232929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564045c64370 msgr2=0x564045c615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:05.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.897+0000 7ff03659c640 1 --2- 172.21.15.7:0/767232929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564045c64370 0x564045c615d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.897+0000 7ff03659c640 1 -- 172.21.15.7:0/767232929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640459303c0 con 0x564045c595d0 2024-09-19T08:54:05.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.897+0000 7ff02ffff640 1 --2- 172.21.15.7:0/767232929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564045c5ab40 0x564045c61000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:05.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.897+0000 7ff03659c640 1 --2- 172.21.15.7:0/767232929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c595d0 0x564045c63d50 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7ff028012fd0 tx=0x7ff02800ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721e89e01d63380d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:05.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.897+0000 7ff01dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:05.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.897+0000 7ff01dffb640 1 -- 172.21.15.7:0/767232929 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028021020 con 0x564045c595d0 2024-09-19T08:54:05.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.897+0000 7ff01dffb640 1 -- 172.21.15.7:0/767232929 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7ff02800adc0 con 0x564045c595d0 2024-09-19T08:54:05.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.897+0000 7ff03ee45740 1 -- 172.21.15.7:0/767232929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff03001e960 con 0x564045c595d0 2024-09-19T08:54:05.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.898+0000 7ff01dffb640 1 -- 172.21.15.7:0/767232929 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff028029050 con 0x564045c595d0 2024-09-19T08:54:05.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.898+0000 7ff03ee45740 10 client.17394 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:05.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.898+0000 7ff03ee45740 1 -- 172.21.15.7:0/767232929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564045c72af0 con 0x564045c595d0 2024-09-19T08:54:05.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.898+0000 7ff01dffb640 1 -- 172.21.15.7:0/767232929 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff03001e960 con 0x564045c595d0 2024-09-19T08:54:05.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.898+0000 7ff01dffb640 1 -- 172.21.15.7:0/767232929 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff02801c070 con 0x564045c595d0 2024-09-19T08:54:05.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.898+0000 7ff03ee45740 10 client.17394 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:05.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.898+0000 7ff03ee45740 10 client.17394 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:05.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.898+0000 7ff03ee45740 20 client.17394 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:05.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.898+0000 7ff03ee45740 1 --2- 172.21.15.7:0/767232929 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564045c73fb0 0x564045c76410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:05.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.898+0000 7ff03ee45740 4 client.17394 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:05.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.898+0000 7ff03ee45740 1 -- 172.21.15.7:0/767232929 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564045bcc860 con 0x564045c73fb0 2024-09-19T08:54:05.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.898+0000 7ff02ffff640 1 --2- 172.21.15.7:0/767232929 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564045c73fb0 0x564045c76410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:05.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.899+0000 7ff02ffff640 1 --2- 172.21.15.7:0/767232929 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564045c73fb0 0x564045c76410 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=558cca6a464860a3 server_cookie=43e87c6a18df80e5 in_seq=0 out_seq=0 2024-09-19T08:54:05.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.899+0000 7ff01dffb640 10 client.17394 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:05.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.900+0000 7ff01dffb640 1 -- 172.21.15.7:0/767232929 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564045bcc860 con 0x564045c73fb0 2024-09-19T08:54:05.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.900+0000 7ff01dffb640 10 client.17394 handle_command_reply: tid=0 2024-09-19T08:54:05.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.900+0000 7ff03ee45740 1 client.17394 shutdown 2024-09-19T08:54:05.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.900+0000 7ff03ee45740 1 -- 172.21.15.7:0/767232929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c595d0 msgr2=0x564045c63d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:05.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.900+0000 7ff03ee45740 1 --2- 172.21.15.7:0/767232929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c595d0 0x564045c63d50 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7ff028012fd0 tx=0x7ff02800ce70 comp rx=0 tx=0).stop 2024-09-19T08:54:05.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.900+0000 7ff03ee45740 1 -- 172.21.15.7:0/767232929 shutdown_connections 2024-09-19T08:54:05.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.900+0000 7ff03ee45740 1 --2- 172.21.15.7:0/767232929 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564045c73fb0 0x564045c76410 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.900+0000 7ff03ee45740 1 --2- 172.21.15.7:0/767232929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564045c64370 0x564045c615d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.900+0000 7ff03ee45740 1 --2- 172.21.15.7:0/767232929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564045c5ab40 0x564045c61000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.900+0000 7ff01dffb640 0 client.17394 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:05.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.900+0000 7ff03ee45740 1 --2- 172.21.15.7:0/767232929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c595d0 0x564045c63d50 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.900+0000 7ff03ee45740 1 -- 172.21.15.7:0/767232929 >> 172.21.15.7:0/767232929 conn(0x564045c22310 msgr2=0x564045c5b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:05.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.900+0000 7ff03ee45740 1 -- 172.21.15.7:0/767232929 shutdown_connections 2024-09-19T08:54:05.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.900+0000 7ff03ee45740 1 -- 172.21.15.7:0/767232929 wait complete. 2024-09-19T08:54:05.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.900+0000 7ff03ee45740 20 client.17394 trim_cache size 0 max 16384 2024-09-19T08:54:05.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.913+0000 7ff03ee45740 1 Processor -- start 2024-09-19T08:54:05.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.913+0000 7ff03ee45740 1 -- start start 2024-09-19T08:54:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.913+0000 7ff03ee45740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564045c595d0 0x564045c70310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.913+0000 7ff03ee45740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564045c5ab40 0x564045c62f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.913+0000 7ff03ee45740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c64370 0x564045c634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.913+0000 7ff03ee45740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff0381ae080 con 0x564045c64370 2024-09-19T08:54:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.913+0000 7ff03ee45740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff0381ab950 con 0x564045c5ab40 2024-09-19T08:54:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.913+0000 7ff03ee45740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff0381a97c0 con 0x564045c595d0 2024-09-19T08:54:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.913+0000 7ff036d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c64370 0x564045c634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.913+0000 7ff036d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c64370 0x564045c634b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43080/0 (socket says 172.21.15.7:43080) 2024-09-19T08:54:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.913+0000 7ff036d9d640 1 -- 172.21.15.7:0/3779740305 learned_addr learned my addr 172.21.15.7:0/3779740305 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.913+0000 7ff03659c640 1 --2- 172.21.15.7:0/3779740305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564045c595d0 0x564045c70310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.914+0000 7ff02ffff640 1 --2- 172.21.15.7:0/3779740305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564045c5ab40 0x564045c62f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.914+0000 7ff036d9d640 1 -- 172.21.15.7:0/3779740305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564045c595d0 msgr2=0x564045c70310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:05.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.914+0000 7ff036d9d640 1 --2- 172.21.15.7:0/3779740305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564045c595d0 0x564045c70310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.914+0000 7ff036d9d640 1 -- 172.21.15.7:0/3779740305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564045c5ab40 msgr2=0x564045c62f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:05.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.914+0000 7ff036d9d640 1 --2- 172.21.15.7:0/3779740305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564045c5ab40 0x564045c62f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.914+0000 7ff036d9d640 1 -- 172.21.15.7:0/3779740305 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564045c56730 con 0x564045c64370 2024-09-19T08:54:05.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.914+0000 7ff02ffff640 1 --2- 172.21.15.7:0/3779740305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564045c5ab40 0x564045c62f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:05.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.914+0000 7ff036d9d640 1 --2- 172.21.15.7:0/3779740305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c64370 0x564045c634b0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7ff030003be0 tx=0x7ff030009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e7cf7d62303a4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:05.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.914+0000 7ff01ffff640 1 -- 172.21.15.7:0/3779740305 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030024070 con 0x564045c64370 2024-09-19T08:54:05.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.914+0000 7ff01ffff640 1 -- 172.21.15.7:0/3779740305 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff030013c60 con 0x564045c64370 2024-09-19T08:54:05.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.914+0000 7ff01ffff640 1 -- 172.21.15.7:0/3779740305 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03001ed20 con 0x564045c64370 2024-09-19T08:54:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.915+0000 7ff03ee45740 1 -- 172.21.15.7:0/3779740305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c64370 msgr2=0x564045c634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.915+0000 7ff03ee45740 1 --2- 172.21.15.7:0/3779740305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c64370 0x564045c634b0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7ff030003be0 tx=0x7ff030009600 comp rx=0 tx=0).stop 2024-09-19T08:54:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.915+0000 7ff03ee45740 1 -- 172.21.15.7:0/3779740305 shutdown_connections 2024-09-19T08:54:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.915+0000 7ff03ee45740 1 --2- 172.21.15.7:0/3779740305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c64370 0x564045c634b0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.915+0000 7ff03ee45740 1 --2- 172.21.15.7:0/3779740305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564045c5ab40 0x564045c62f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.915+0000 7ff03ee45740 1 --2- 172.21.15.7:0/3779740305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564045c595d0 0x564045c70310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.915+0000 7ff03ee45740 1 -- 172.21.15.7:0/3779740305 >> 172.21.15.7:0/3779740305 conn(0x564045c22310 msgr2=0x564045c62860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.915+0000 7ff03ee45740 1 -- 172.21.15.7:0/3779740305 shutdown_connections 2024-09-19T08:54:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.915+0000 7ff03ee45740 1 -- 172.21.15.7:0/3779740305 wait complete. 2024-09-19T08:54:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.915+0000 7ff03ee45740 1 -- start start 2024-09-19T08:54:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.915+0000 7ff03ee45740 1 Processor -- start 2024-09-19T08:54:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.915+0000 7ff03ee45740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564045c595d0 0x564045c68ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.915+0000 7ff03ee45740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c5ab40 0x564045c690e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.915+0000 7ff03ee45740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564045c64370 0x564045cd7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.915+0000 7ff03ee45740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff0381a9e10 con 0x564045c5ab40 2024-09-19T08:54:05.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.915+0000 7ff03ee45740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff0381ab280 con 0x564045c64370 2024-09-19T08:54:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.915+0000 7ff03ee45740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff0381aa4e0 con 0x564045c595d0 2024-09-19T08:54:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.915+0000 7ff02ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c5ab40 0x564045c690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.915+0000 7ff03ee45740 10 client.0 _ll_register_callbacks cb 0x7ff0280058a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.916+0000 7ff02ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c5ab40 0x564045c690e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43086/0 (socket says 172.21.15.7:43086) 2024-09-19T08:54:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.916+0000 7ff02ffff640 1 -- 172.21.15.7:0/3519722110 learned_addr learned my addr 172.21.15.7:0/3519722110 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.916+0000 7ff03659c640 1 --2- 172.21.15.7:0/3519722110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564045c595d0 0x564045c68ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.916+0000 7ff036d9d640 1 --2- 172.21.15.7:0/3519722110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564045c64370 0x564045cd7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.916+0000 7ff02ffff640 1 -- 172.21.15.7:0/3519722110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564045c595d0 msgr2=0x564045c68ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.916+0000 7ff02ffff640 1 --2- 172.21.15.7:0/3519722110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564045c595d0 0x564045c68ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.916+0000 7ff02ffff640 1 -- 172.21.15.7:0/3519722110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564045c64370 msgr2=0x564045cd7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.916+0000 7ff02ffff640 1 --2- 172.21.15.7:0/3519722110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564045c64370 0x564045cd7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.916+0000 7ff02ffff640 1 -- 172.21.15.7:0/3519722110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564045cd83e0 con 0x564045c5ab40 2024-09-19T08:54:05.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.916+0000 7ff02ffff640 1 --2- 172.21.15.7:0/3519722110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c5ab40 0x564045c690e0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7ff0200b8980 tx=0x7ff0200f0670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7b18146ee8d7dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.916+0000 7ff01dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.916+0000 7ff01dffb640 1 -- 172.21.15.7:0/3519722110 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff020049040 con 0x564045c5ab40 2024-09-19T08:54:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.916+0000 7ff01dffb640 1 -- 172.21.15.7:0/3519722110 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7ff02003b460 con 0x564045c5ab40 2024-09-19T08:54:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.916+0000 7ff03ee45740 1 -- 172.21.15.7:0/3519722110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff030013c60 con 0x564045c5ab40 2024-09-19T08:54:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.916+0000 7ff01dffb640 1 -- 172.21.15.7:0/3519722110 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff0200bbe80 con 0x564045c5ab40 2024-09-19T08:54:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.916+0000 7ff03ee45740 10 client.17400 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.916+0000 7ff03ee45740 1 -- 172.21.15.7:0/3519722110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564045cdf7b0 con 0x564045c5ab40 2024-09-19T08:54:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.917+0000 7ff01dffb640 1 -- 172.21.15.7:0/3519722110 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff030013c60 con 0x564045c5ab40 2024-09-19T08:54:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.917+0000 7ff01dffb640 1 -- 172.21.15.7:0/3519722110 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff0200edc10 con 0x564045c5ab40 2024-09-19T08:54:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.917+0000 7ff03ee45740 10 client.17400 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:05.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.917+0000 7ff03ee45740 10 client.17400 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.917+0000 7ff03ee45740 20 client.17400 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.917+0000 7ff03ee45740 1 --2- 172.21.15.7:0/3519722110 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564045cdfee0 0x564045ce22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.917+0000 7ff03ee45740 4 client.17400 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:54:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.917+0000 7ff03ee45740 1 -- 172.21.15.7:0/3519722110 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564045bc6d70 con 0x564045cdfee0 2024-09-19T08:54:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.917+0000 7ff03659c640 1 --2- 172.21.15.7:0/3519722110 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564045cdfee0 0x564045ce22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.917+0000 7ff01dffb640 10 client.17400 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.917+0000 7ff03659c640 1 --2- 172.21.15.7:0/3519722110 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564045cdfee0 0x564045ce22d0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fd380872de94270 server_cookie=a82dd6ed923e62da in_seq=0 out_seq=0 2024-09-19T08:54:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.918+0000 7ff01dffb640 1 -- 172.21.15.7:0/3519722110 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564045bc6d70 con 0x564045cdfee0 2024-09-19T08:54:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.918+0000 7ff01dffb640 10 client.17400 handle_command_reply: tid=0 2024-09-19T08:54:05.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.918+0000 7ff03ee45740 1 client.17400 shutdown 2024-09-19T08:54:05.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.918+0000 7ff03ee45740 1 -- 172.21.15.7:0/3519722110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c5ab40 msgr2=0x564045c690e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:05.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.918+0000 7ff03ee45740 1 --2- 172.21.15.7:0/3519722110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c5ab40 0x564045c690e0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7ff0200b8980 tx=0x7ff0200f0670 comp rx=0 tx=0).stop 2024-09-19T08:54:05.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.918+0000 7ff03ee45740 1 -- 172.21.15.7:0/3519722110 shutdown_connections 2024-09-19T08:54:05.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.918+0000 7ff03ee45740 1 --2- 172.21.15.7:0/3519722110 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x564045cdfee0 0x564045ce22d0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.918+0000 7ff03ee45740 1 --2- 172.21.15.7:0/3519722110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564045c64370 0x564045cd7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.918+0000 7ff03ee45740 1 --2- 172.21.15.7:0/3519722110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564045c5ab40 0x564045c690e0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.918+0000 7ff01dffb640 0 client.17400 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:05.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.918+0000 7ff03ee45740 1 --2- 172.21.15.7:0/3519722110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564045c595d0 0x564045c68ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.918+0000 7ff03ee45740 1 -- 172.21.15.7:0/3519722110 >> 172.21.15.7:0/3519722110 conn(0x564045c22310 msgr2=0x564045c63080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:05.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.918+0000 7ff03ee45740 1 -- 172.21.15.7:0/3519722110 shutdown_connections 2024-09-19T08:54:05.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.918+0000 7ff03ee45740 1 -- 172.21.15.7:0/3519722110 wait complete. 2024-09-19T08:54:05.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.918+0000 7ff03ee45740 20 client.17400 trim_cache size 0 max 16384 2024-09-19T08:54:05.926 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:54:05.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.918+0000 7ff03ca6c640 1 -- 172.21.15.7:0/411900034 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff0240a33b0 msgr2=0x7ff0240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:05.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.918+0000 7ff03ca6c640 1 --2- 172.21.15.7:0/411900034 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff0240a33b0 0x7ff0240a5870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff030021000 tx=0x7ff03001e000 comp rx=0 tx=0).stop 2024-09-19T08:54:05.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.918+0000 7ff03ca6c640 1 -- 172.21.15.7:0/411900034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff038103740 msgr2=0x7ff038198b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:05.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.918+0000 7ff03ca6c640 1 --2- 172.21.15.7:0/411900034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff038103740 0x7ff038198b50 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7ff020005940 tx=0x7ff0200042f0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.919+0000 7ff03ca6c640 1 -- 172.21.15.7:0/411900034 shutdown_connections 2024-09-19T08:54:05.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.919+0000 7ff03ca6c640 1 --2- 172.21.15.7:0/411900034 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff0240a33b0 0x7ff0240a5870 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.919+0000 7ff03ca6c640 1 --2- 172.21.15.7:0/411900034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff038108290 0x7ff03819cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.919+0000 7ff03ca6c640 1 --2- 172.21.15.7:0/411900034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff038103740 0x7ff038198b50 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.919+0000 7ff03ca6c640 1 --2- 172.21.15.7:0/411900034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff038102d90 0x7ff038198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:05.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.919+0000 7ff03ca6c640 1 -- 172.21.15.7:0/411900034 >> 172.21.15.7:0/411900034 conn(0x7ff0380fc7d0 msgr2=0x7ff038105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:05.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.919+0000 7ff03ca6c640 1 -- 172.21.15.7:0/411900034 shutdown_connections 2024-09-19T08:54:05.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:05.919+0000 7ff03ca6c640 1 -- 172.21.15.7:0/411900034 wait complete. 2024-09-19T08:54:07.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:07 smithi044 ceph-mon[35072]: pgmap v296: 97 pgs: 97 active+clean; 2.1 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:54:07.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:07 smithi175 ceph-mon[35688]: pgmap v296: 97 pgs: 97 active+clean; 2.1 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:54:07.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:07 smithi007 ceph-mon[31221]: pgmap v296: 97 pgs: 97 active+clean; 2.1 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:54:07.796 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:54:07.796 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:54:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:08.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.526+0000 7fb2eee7d640 1 -- 172.21.15.7:0/74905099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2e8106f10 msgr2=0x7fb2e810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:08.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.526+0000 7fb2eee7d640 1 --2- 172.21.15.7:0/74905099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2e8106f10 0x7fb2e810ea90 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0009ca0 tx=0x7fb2e002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.526+0000 7fb2eee7d640 1 -- 172.21.15.7:0/74905099 shutdown_connections 2024-09-19T08:54:08.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.526+0000 7fb2eee7d640 1 --2- 172.21.15.7:0/74905099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2e8106f10 0x7fb2e810ea90 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.526+0000 7fb2eee7d640 1 --2- 172.21.15.7:0/74905099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2e8102790 0x7fb2e81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.526+0000 7fb2eee7d640 1 --2- 172.21.15.7:0/74905099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2e8101de0 0x7fb2e81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.526+0000 7fb2eee7d640 1 -- 172.21.15.7:0/74905099 >> 172.21.15.7:0/74905099 conn(0x7fb2e80fd8c0 msgr2=0x7fb2e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:08.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.526+0000 7fb2eee7d640 1 -- 172.21.15.7:0/74905099 shutdown_connections 2024-09-19T08:54:08.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.526+0000 7fb2eee7d640 1 -- 172.21.15.7:0/74905099 wait complete. 2024-09-19T08:54:08.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.527+0000 7fb2eee7d640 1 Processor -- start 2024-09-19T08:54:08.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.527+0000 7fb2eee7d640 1 -- start start 2024-09-19T08:54:08.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.528+0000 7fb2eee7d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2e8101de0 0x7fb2e8198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.528+0000 7fb2eee7d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2e8102790 0x7fb2e8198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.528+0000 7fb2eee7d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2e8106f10 0x7fb2e819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.528+0000 7fb2eee7d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e8111f70 con 0x7fb2e8102790 2024-09-19T08:54:08.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.528+0000 7fb2eee7d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e8111df0 con 0x7fb2e8101de0 2024-09-19T08:54:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.528+0000 7fb2eee7d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e81120f0 con 0x7fb2e8106f10 2024-09-19T08:54:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.528+0000 7fb2e7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2e8102790 0x7fb2e8198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.528+0000 7fb2e7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2e8102790 0x7fb2e8198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43092/0 (socket says 172.21.15.7:43092) 2024-09-19T08:54:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.528+0000 7fb2e7fff640 1 -- 172.21.15.7:0/1997833954 learned_addr learned my addr 172.21.15.7:0/1997833954 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.528+0000 7fb2ecc19640 1 --2- 172.21.15.7:0/1997833954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2e8101de0 0x7fb2e8198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.528+0000 7fb2ed41a640 1 --2- 172.21.15.7:0/1997833954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2e8106f10 0x7fb2e819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.528+0000 7fb2e7fff640 1 -- 172.21.15.7:0/1997833954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2e8106f10 msgr2=0x7fb2e819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.528+0000 7fb2e7fff640 1 --2- 172.21.15.7:0/1997833954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2e8106f10 0x7fb2e819cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.528+0000 7fb2e7fff640 1 -- 172.21.15.7:0/1997833954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2e8101de0 msgr2=0x7fb2e8198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.528+0000 7fb2e7fff640 1 --2- 172.21.15.7:0/1997833954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2e8101de0 0x7fb2e8198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.528+0000 7fb2e7fff640 1 -- 172.21.15.7:0/1997833954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e819d2e0 con 0x7fb2e8102790 2024-09-19T08:54:08.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.528+0000 7fb2ecc19640 1 --2- 172.21.15.7:0/1997833954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2e8101de0 0x7fb2e8198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.528+0000 7fb2e7fff640 1 --2- 172.21.15.7:0/1997833954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2e8102790 0x7fb2e8198870 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc00c890 tx=0x7fb2dc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.528+0000 7fb2e5ffb640 1 -- 172.21.15.7:0/1997833954 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc004220 con 0x7fb2e8102790 2024-09-19T08:54:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.529+0000 7fb2e5ffb640 1 -- 172.21.15.7:0/1997833954 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2dc0043c0 con 0x7fb2e8102790 2024-09-19T08:54:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.529+0000 7fb2eee7d640 1 -- 172.21.15.7:0/1997833954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2e819d5d0 con 0x7fb2e8102790 2024-09-19T08:54:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.529+0000 7fb2e5ffb640 1 -- 172.21.15.7:0/1997833954 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc0049e0 con 0x7fb2e8102790 2024-09-19T08:54:08.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.529+0000 7fb2eee7d640 1 -- 172.21.15.7:0/1997833954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2e81a4eb0 con 0x7fb2e8102790 2024-09-19T08:54:08.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.531+0000 7fb2e5ffb640 1 -- 172.21.15.7:0/1997833954 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fb2dc0079b0 con 0x7fb2e8102790 2024-09-19T08:54:08.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.531+0000 7fb2f1256740 1 Processor -- start 2024-09-19T08:54:08.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.531+0000 7fb2f1256740 1 -- start start 2024-09-19T08:54:08.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.532+0000 7fb2f1256740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536487b60 0x55c536487f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.532+0000 7fb2f1256740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c536488480 0x55c536492800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.532+0000 7fb2f1256740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c536492d40 0x55c536495130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.532+0000 7fb2f1256740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c5363ed280 con 0x55c536487b60 2024-09-19T08:54:08.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.532+0000 7fb2f1256740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c536394b10 con 0x55c536492d40 2024-09-19T08:54:08.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.532+0000 7fb2f1256740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c5363e9240 con 0x55c536488480 2024-09-19T08:54:08.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.532+0000 7fb2ed41a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536487b60 0x55c536487f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.532+0000 7fb2ed41a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536487b60 0x55c536487f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43108/0 (socket says 172.21.15.7:43108) 2024-09-19T08:54:08.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.532+0000 7fb2ed41a640 1 -- 172.21.15.7:0/1314133021 learned_addr learned my addr 172.21.15.7:0/1314133021 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:08.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.532+0000 7fb2e5ffb640 1 --2- 172.21.15.7:0/1997833954 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb2d00a33b0 0x7fb2d00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.532+0000 7fb2e7fff640 1 --2- 172.21.15.7:0/1314133021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c536492d40 0x55c536495130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.532+0000 7fb2ecc19640 1 --2- 172.21.15.7:0/1314133021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c536488480 0x55c536492800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.532+0000 7fb2ed41a640 1 --2- 172.21.15.7:0/1997833954 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb2d00a33b0 0x7fb2d00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.532+0000 7fb2e5ffb640 1 -- 172.21.15.7:0/1997833954 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7fb2dc0cfe70 con 0x7fb2e8102790 2024-09-19T08:54:08.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.532+0000 7fb2ed41a640 1 -- 172.21.15.7:0/1314133021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c536488480 msgr2=0x55c536492800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:08.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.532+0000 7fb2ed41a640 1 --2- 172.21.15.7:0/1314133021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c536488480 0x55c536492800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.532+0000 7fb2ed41a640 1 -- 172.21.15.7:0/1314133021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c536492d40 msgr2=0x55c536495130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:08.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.532+0000 7fb2ed41a640 1 --2- 172.21.15.7:0/1314133021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c536492d40 0x55c536495130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.532+0000 7fb2ed41a640 1 -- 172.21.15.7:0/1314133021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5363a11f0 con 0x55c536487b60 2024-09-19T08:54:08.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.532+0000 7fb2e7fff640 1 --2- 172.21.15.7:0/1314133021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c536492d40 0x55c536495130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:08.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.533+0000 7fb2ed41a640 1 --2- 172.21.15.7:0/1314133021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536487b60 0x55c536487f40 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0005cc0 tx=0x7fb2e00039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12d59734be56d5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:08.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.533+0000 7fb2ceffd640 1 -- 172.21.15.7:0/1314133021 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e00319a0 con 0x55c536487b60 2024-09-19T08:54:08.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.533+0000 7fb2ceffd640 1 -- 172.21.15.7:0/1314133021 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2e004e070 con 0x55c536487b60 2024-09-19T08:54:08.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.533+0000 7fb2ed41a640 1 --2- 172.21.15.7:0/1997833954 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb2d00a33b0 0x7fb2d00a5870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb2e004d000 tx=0x7fb2e004b000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:08.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.533+0000 7fb2ceffd640 1 -- 172.21.15.7:0/1314133021 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e002fc60 con 0x55c536487b60 2024-09-19T08:54:08.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.533+0000 7fb2f1256740 1 -- 172.21.15.7:0/1314133021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536487b60 msgr2=0x55c536487f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:08.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.533+0000 7fb2f1256740 1 --2- 172.21.15.7:0/1314133021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536487b60 0x55c536487f40 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0005cc0 tx=0x7fb2e00039f0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.534+0000 7fb2f1256740 1 -- 172.21.15.7:0/1314133021 shutdown_connections 2024-09-19T08:54:08.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.534+0000 7fb2f1256740 1 --2- 172.21.15.7:0/1314133021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c536492d40 0x55c536495130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.534+0000 7fb2f1256740 1 --2- 172.21.15.7:0/1314133021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c536488480 0x55c536492800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.534+0000 7fb2f1256740 1 --2- 172.21.15.7:0/1314133021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536487b60 0x55c536487f40 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.534+0000 7fb2f1256740 1 -- 172.21.15.7:0/1314133021 >> 172.21.15.7:0/1314133021 conn(0x55c5364840f0 msgr2=0x55c5364844d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.534+0000 7fb2f1256740 1 -- 172.21.15.7:0/1314133021 shutdown_connections 2024-09-19T08:54:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.534+0000 7fb2f1256740 1 -- 172.21.15.7:0/1314133021 wait complete. 2024-09-19T08:54:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.534+0000 7fb2f1256740 1 -- start start 2024-09-19T08:54:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.534+0000 7fb2f1256740 1 Processor -- start 2024-09-19T08:54:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.534+0000 7fb2f1256740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536487b60 0x55c53648fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.534+0000 7fb2f1256740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c536488480 0x55c536490190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.534+0000 7fb2f1256740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c536492d40 0x55c5364906d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.534+0000 7fb2f1256740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c536499ba0 con 0x55c536487b60 2024-09-19T08:54:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.535+0000 7fb2f1256740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c5363a7f10 con 0x55c536488480 2024-09-19T08:54:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.535+0000 7fb2f1256740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c536499d20 con 0x55c536492d40 2024-09-19T08:54:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.535+0000 7fb2f1256740 10 client.0 _ll_register_callbacks cb 0x55c536370a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:08.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.535+0000 7fb2ecc19640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536487b60 0x55c53648fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.535+0000 7fb2ecc19640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536487b60 0x55c53648fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43120/0 (socket says 172.21.15.7:43120) 2024-09-19T08:54:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.535+0000 7fb2ecc19640 1 -- 172.21.15.7:0/346524103 learned_addr learned my addr 172.21.15.7:0/346524103 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.535+0000 7fb2e7fff640 1 --2- 172.21.15.7:0/346524103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c536488480 0x55c536490190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.535+0000 7fb2ed41a640 1 --2- 172.21.15.7:0/346524103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c536492d40 0x55c5364906d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.535+0000 7fb2ecc19640 1 -- 172.21.15.7:0/346524103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c536492d40 msgr2=0x55c5364906d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.535+0000 7fb2ecc19640 1 --2- 172.21.15.7:0/346524103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c536492d40 0x55c5364906d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.535+0000 7fb2ecc19640 1 -- 172.21.15.7:0/346524103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c536488480 msgr2=0x55c536490190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.535+0000 7fb2ecc19640 1 --2- 172.21.15.7:0/346524103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c536488480 0x55c536490190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.535+0000 7fb2ecc19640 1 -- 172.21.15.7:0/346524103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c53615e6a0 con 0x55c536487b60 2024-09-19T08:54:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.535+0000 7fb2ecc19640 1 --2- 172.21.15.7:0/346524103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536487b60 0x55c53648fc50 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8011880 tx=0x7fb2d8011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecaf4c921ededed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.535+0000 7fb2c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.535+0000 7fb2c7fff640 1 -- 172.21.15.7:0/346524103 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d800f9a0 con 0x55c536487b60 2024-09-19T08:54:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.535+0000 7fb2c7fff640 1 -- 172.21.15.7:0/346524103 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7fb2d800fb40 con 0x55c536487b60 2024-09-19T08:54:08.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.535+0000 7fb2f1256740 1 -- 172.21.15.7:0/346524103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2e004e070 con 0x55c536487b60 2024-09-19T08:54:08.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.536+0000 7fb2c7fff640 1 -- 172.21.15.7:0/346524103 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb2d800fd40 con 0x55c536487b60 2024-09-19T08:54:08.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.536+0000 7fb2f1256740 10 client.17412 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:08.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.536+0000 7fb2f1256740 1 -- 172.21.15.7:0/346524103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c5364a5830 con 0x55c536487b60 2024-09-19T08:54:08.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.536+0000 7fb2c7fff640 1 -- 172.21.15.7:0/346524103 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2e004e070 con 0x55c536487b60 2024-09-19T08:54:08.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.536+0000 7fb2c7fff640 1 -- 172.21.15.7:0/346524103 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb2d8018030 con 0x55c536487b60 2024-09-19T08:54:08.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.536+0000 7fb2f1256740 10 client.17412 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:08.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.536+0000 7fb2f1256740 10 client.17412 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:08.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.536+0000 7fb2f1256740 20 client.17412 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:08.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.536+0000 7fb2f1256740 1 --2- 172.21.15.7:0/346524103 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c5364a6cf0 0x55c5364a9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.536+0000 7fb2f1256740 4 client.17412 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:08.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.536+0000 7fb2f1256740 1 -- 172.21.15.7:0/346524103 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5363fa7f0 con 0x55c5364a6cf0 2024-09-19T08:54:08.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.536+0000 7fb2e7fff640 1 --2- 172.21.15.7:0/346524103 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c5364a6cf0 0x55c5364a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.537+0000 7fb2e7fff640 1 --2- 172.21.15.7:0/346524103 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c5364a6cf0 0x55c5364a9140 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=847e34c2e17d1b2b server_cookie=50fbaa8d3106cd6c in_seq=0 out_seq=0 2024-09-19T08:54:08.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.537+0000 7fb2c7fff640 10 client.17412 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:08.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.538+0000 7fb2c7fff640 1 -- 172.21.15.7:0/346524103 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c5363fa7f0 con 0x55c5364a6cf0 2024-09-19T08:54:08.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.538+0000 7fb2c7fff640 10 client.17412 handle_command_reply: tid=0 2024-09-19T08:54:08.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.538+0000 7fb2f1256740 1 client.17412 shutdown 2024-09-19T08:54:08.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.538+0000 7fb2f1256740 1 -- 172.21.15.7:0/346524103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536487b60 msgr2=0x55c53648fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:08.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.538+0000 7fb2f1256740 1 --2- 172.21.15.7:0/346524103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536487b60 0x55c53648fc50 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8011880 tx=0x7fb2d8011d40 comp rx=0 tx=0).stop 2024-09-19T08:54:08.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.538+0000 7fb2f1256740 1 -- 172.21.15.7:0/346524103 shutdown_connections 2024-09-19T08:54:08.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.538+0000 7fb2f1256740 1 --2- 172.21.15.7:0/346524103 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c5364a6cf0 0x55c5364a9140 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.538+0000 7fb2f1256740 1 --2- 172.21.15.7:0/346524103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c536492d40 0x55c5364906d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.538+0000 7fb2f1256740 1 --2- 172.21.15.7:0/346524103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c536488480 0x55c536490190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.538+0000 7fb2f1256740 1 --2- 172.21.15.7:0/346524103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536487b60 0x55c53648fc50 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.538+0000 7fb2c7fff640 0 client.17412 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:08.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.538+0000 7fb2f1256740 1 -- 172.21.15.7:0/346524103 >> 172.21.15.7:0/346524103 conn(0x55c5364840f0 msgr2=0x55c536483270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:08.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.538+0000 7fb2f1256740 1 -- 172.21.15.7:0/346524103 shutdown_connections 2024-09-19T08:54:08.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.538+0000 7fb2f1256740 1 -- 172.21.15.7:0/346524103 wait complete. 2024-09-19T08:54:08.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.538+0000 7fb2f1256740 20 client.17412 trim_cache size 0 max 16384 2024-09-19T08:54:08.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.555+0000 7fb2f1256740 1 Processor -- start 2024-09-19T08:54:08.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.555+0000 7fb2f1256740 1 -- start start 2024-09-19T08:54:08.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.556+0000 7fb2f1256740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c536487b60 0x55c53648a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.556+0000 7fb2f1256740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536488480 0x55c5364aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.556+0000 7fb2f1256740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c536492d40 0x55c5364aef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.556+0000 7fb2f1256740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e81adf80 con 0x55c536488480 2024-09-19T08:54:08.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.556+0000 7fb2f1256740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e81ab850 con 0x55c536487b60 2024-09-19T08:54:08.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.556+0000 7fb2f1256740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e81a96c0 con 0x55c536492d40 2024-09-19T08:54:08.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.556+0000 7fb2e7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536488480 0x55c5364aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.556+0000 7fb2e7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536488480 0x55c5364aea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43128/0 (socket says 172.21.15.7:43128) 2024-09-19T08:54:08.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.556+0000 7fb2e7fff640 1 -- 172.21.15.7:0/3703051239 learned_addr learned my addr 172.21.15.7:0/3703051239 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:08.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.556+0000 7fb2ecc19640 1 --2- 172.21.15.7:0/3703051239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c536487b60 0x55c53648a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.556+0000 7fb2ed41a640 1 --2- 172.21.15.7:0/3703051239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c536492d40 0x55c5364aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.556+0000 7fb2e7fff640 1 -- 172.21.15.7:0/3703051239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c536492d40 msgr2=0x55c5364aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:08.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.556+0000 7fb2e7fff640 1 --2- 172.21.15.7:0/3703051239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c536492d40 0x55c5364aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.556+0000 7fb2e7fff640 1 -- 172.21.15.7:0/3703051239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c536487b60 msgr2=0x55c53648a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:08.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.556+0000 7fb2e7fff640 1 --2- 172.21.15.7:0/3703051239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c536487b60 0x55c53648a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.556+0000 7fb2e7fff640 1 -- 172.21.15.7:0/3703051239 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c53647e660 con 0x55c536488480 2024-09-19T08:54:08.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.556+0000 7fb2ecc19640 1 --2- 172.21.15.7:0/3703051239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c536487b60 0x55c53648a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:08.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.556+0000 7fb2e7fff640 1 --2- 172.21.15.7:0/3703051239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536488480 0x55c5364aea10 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc007590 tx=0x7fb2dc06de30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677812c35a50e7be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:08.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.557+0000 7fb2ce7fc640 1 -- 172.21.15.7:0/3703051239 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc01d040 con 0x55c536488480 2024-09-19T08:54:08.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.557+0000 7fb2ce7fc640 1 -- 172.21.15.7:0/3703051239 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2dc0a0460 con 0x55c536488480 2024-09-19T08:54:08.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.557+0000 7fb2ce7fc640 1 -- 172.21.15.7:0/3703051239 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc098720 con 0x55c536488480 2024-09-19T08:54:08.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.557+0000 7fb2f1256740 1 -- 172.21.15.7:0/3703051239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536488480 msgr2=0x55c5364aea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:08.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.557+0000 7fb2f1256740 1 --2- 172.21.15.7:0/3703051239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536488480 0x55c5364aea10 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc007590 tx=0x7fb2dc06de30 comp rx=0 tx=0).stop 2024-09-19T08:54:08.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.557+0000 7fb2f1256740 1 -- 172.21.15.7:0/3703051239 shutdown_connections 2024-09-19T08:54:08.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.557+0000 7fb2f1256740 1 --2- 172.21.15.7:0/3703051239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c536492d40 0x55c5364aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.557+0000 7fb2f1256740 1 --2- 172.21.15.7:0/3703051239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536488480 0x55c5364aea10 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.557+0000 7fb2f1256740 1 --2- 172.21.15.7:0/3703051239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c536487b60 0x55c53648a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.557+0000 7fb2f1256740 1 -- 172.21.15.7:0/3703051239 >> 172.21.15.7:0/3703051239 conn(0x55c5364840f0 msgr2=0x55c536491bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:08.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.557+0000 7fb2f1256740 1 -- 172.21.15.7:0/3703051239 shutdown_connections 2024-09-19T08:54:08.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.557+0000 7fb2f1256740 1 -- 172.21.15.7:0/3703051239 wait complete. 2024-09-19T08:54:08.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.558+0000 7fb2f1256740 1 -- start start 2024-09-19T08:54:08.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.558+0000 7fb2f1256740 1 Processor -- start 2024-09-19T08:54:08.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.558+0000 7fb2f1256740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536487b60 0x55c53649f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.558+0000 7fb2f1256740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c536488480 0x55c53649f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.558+0000 7fb2f1256740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c536492d40 0x55c53649b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.558+0000 7fb2f1256740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e81a9d10 con 0x55c536487b60 2024-09-19T08:54:08.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.558+0000 7fb2f1256740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e81ab180 con 0x55c536488480 2024-09-19T08:54:08.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.558+0000 7fb2f1256740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e81aa3e0 con 0x55c536492d40 2024-09-19T08:54:08.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.558+0000 7fb2f1256740 10 client.0 _ll_register_callbacks cb 0x7fb2d8011460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:08.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.558+0000 7fb2ecc19640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536487b60 0x55c53649f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.558+0000 7fb2ecc19640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536487b60 0x55c53649f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43142/0 (socket says 172.21.15.7:43142) 2024-09-19T08:54:08.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.558+0000 7fb2ecc19640 1 -- 172.21.15.7:0/606655605 learned_addr learned my addr 172.21.15.7:0/606655605 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:08.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.558+0000 7fb2e7fff640 1 --2- 172.21.15.7:0/606655605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c536488480 0x55c53649f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.558+0000 7fb2ed41a640 1 --2- 172.21.15.7:0/606655605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c536492d40 0x55c53649b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.559+0000 7fb2ecc19640 1 -- 172.21.15.7:0/606655605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c536492d40 msgr2=0x55c53649b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:08.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.559+0000 7fb2ecc19640 1 --2- 172.21.15.7:0/606655605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c536492d40 0x55c53649b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.559+0000 7fb2ecc19640 1 -- 172.21.15.7:0/606655605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c536488480 msgr2=0x55c53649f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:08.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.559+0000 7fb2ecc19640 1 --2- 172.21.15.7:0/606655605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c536488480 0x55c53649f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.559+0000 7fb2ecc19640 1 -- 172.21.15.7:0/606655605 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c53649bcd0 con 0x55c536487b60 2024-09-19T08:54:08.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.559+0000 7fb2ecc19640 1 --2- 172.21.15.7:0/606655605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536487b60 0x55c53649f0d0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8011570 tx=0x7fb2d800fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386006756f10bb97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:08.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.559+0000 7fb2c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:08.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.559+0000 7fb2c7fff640 1 -- 172.21.15.7:0/606655605 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8031060 con 0x55c536487b60 2024-09-19T08:54:08.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.559+0000 7fb2c7fff640 1 -- 172.21.15.7:0/606655605 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8585+0+0 (secure 0 0 0) 0x7fb2d80055a0 con 0x55c536487b60 2024-09-19T08:54:08.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.559+0000 7fb2f1256740 1 -- 172.21.15.7:0/606655605 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2dc0a0460 con 0x55c536487b60 2024-09-19T08:54:08.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.559+0000 7fb2c7fff640 1 -- 172.21.15.7:0/606655605 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb2d8021b50 con 0x55c536487b60 2024-09-19T08:54:08.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.559+0000 7fb2f1256740 10 client.17418 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:08.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.559+0000 7fb2f1256740 1 -- 172.21.15.7:0/606655605 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c5365124d0 con 0x55c536487b60 2024-09-19T08:54:08.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.559+0000 7fb2c7fff640 1 -- 172.21.15.7:0/606655605 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2dc0a0460 con 0x55c536487b60 2024-09-19T08:54:08.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.560+0000 7fb2c7fff640 1 -- 172.21.15.7:0/606655605 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb2d8018040 con 0x55c536487b60 2024-09-19T08:54:08.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.560+0000 7fb2f1256740 10 client.17418 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:08.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.560+0000 7fb2f1256740 10 client.17418 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:08.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.560+0000 7fb2f1256740 20 client.17418 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:08.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.560+0000 7fb2f1256740 1 --2- 172.21.15.7:0/606655605 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c536512ba0 0x55c536514f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.560+0000 7fb2f1256740 4 client.17418 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:54:08.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.560+0000 7fb2f1256740 1 -- 172.21.15.7:0/606655605 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c5363f4d00 con 0x55c536512ba0 2024-09-19T08:54:08.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.560+0000 7fb2e7fff640 1 --2- 172.21.15.7:0/606655605 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c536512ba0 0x55c536514f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.560+0000 7fb2c7fff640 10 client.17418 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:08.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.560+0000 7fb2e7fff640 1 --2- 172.21.15.7:0/606655605 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c536512ba0 0x55c536514f90 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eac1a2da7252a599 server_cookie=45559c49d9ba1776 in_seq=0 out_seq=0 2024-09-19T08:54:08.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.561+0000 7fb2c7fff640 1 -- 172.21.15.7:0/606655605 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c5363f4d00 con 0x55c536512ba0 2024-09-19T08:54:08.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.561+0000 7fb2c7fff640 10 client.17418 handle_command_reply: tid=0 2024-09-19T08:54:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.561+0000 7fb2f1256740 1 client.17418 shutdown 2024-09-19T08:54:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.561+0000 7fb2f1256740 1 -- 172.21.15.7:0/606655605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536487b60 msgr2=0x55c53649f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.561+0000 7fb2f1256740 1 --2- 172.21.15.7:0/606655605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536487b60 0x55c53649f0d0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8011570 tx=0x7fb2d800fcb0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.561+0000 7fb2f1256740 1 -- 172.21.15.7:0/606655605 shutdown_connections 2024-09-19T08:54:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.561+0000 7fb2f1256740 1 --2- 172.21.15.7:0/606655605 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c536512ba0 0x55c536514f90 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.561+0000 7fb2f1256740 1 --2- 172.21.15.7:0/606655605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c536492d40 0x55c53649b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.562+0000 7fb2f1256740 1 --2- 172.21.15.7:0/606655605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c536488480 0x55c53649f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.562+0000 7fb2f1256740 1 --2- 172.21.15.7:0/606655605 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c536487b60 0x55c53649f0d0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.562+0000 7fb2f1256740 1 -- 172.21.15.7:0/606655605 >> 172.21.15.7:0/606655605 conn(0x55c5364840f0 msgr2=0x55c5364a1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.561+0000 7fb2c7fff640 0 client.17418 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.562+0000 7fb2f1256740 1 -- 172.21.15.7:0/606655605 shutdown_connections 2024-09-19T08:54:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.562+0000 7fb2f1256740 1 -- 172.21.15.7:0/606655605 wait complete. 2024-09-19T08:54:08.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.562+0000 7fb2f1256740 20 client.17418 trim_cache size 0 max 16384 2024-09-19T08:54:08.566 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:54:08.566 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-19T08:54:08.566 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "a6ad4496-f666-4c19-862c-3df04a9cfc98", 2024-09-19T08:54:08.566 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-19T08:54:08.566 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:54:08.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.562+0000 7fb2eee7d640 1 -- 172.21.15.7:0/1997833954 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb2d00a33b0 msgr2=0x7fb2d00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:08.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.562+0000 7fb2eee7d640 1 --2- 172.21.15.7:0/1997833954 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb2d00a33b0 0x7fb2d00a5870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb2e004d000 tx=0x7fb2e004b000 comp rx=0 tx=0).stop 2024-09-19T08:54:08.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.562+0000 7fb2eee7d640 1 -- 172.21.15.7:0/1997833954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2e8102790 msgr2=0x7fb2e8198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:08.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.562+0000 7fb2eee7d640 1 --2- 172.21.15.7:0/1997833954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2e8102790 0x7fb2e8198870 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc00c890 tx=0x7fb2dc00cd50 comp rx=0 tx=0).stop 2024-09-19T08:54:08.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.563+0000 7fb2eee7d640 1 -- 172.21.15.7:0/1997833954 shutdown_connections 2024-09-19T08:54:08.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.563+0000 7fb2eee7d640 1 --2- 172.21.15.7:0/1997833954 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb2d00a33b0 0x7fb2d00a5870 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.563+0000 7fb2eee7d640 1 --2- 172.21.15.7:0/1997833954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2e8106f10 0x7fb2e819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.563+0000 7fb2eee7d640 1 --2- 172.21.15.7:0/1997833954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2e8102790 0x7fb2e8198870 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.563+0000 7fb2eee7d640 1 --2- 172.21.15.7:0/1997833954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2e8101de0 0x7fb2e8198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.563+0000 7fb2eee7d640 1 -- 172.21.15.7:0/1997833954 >> 172.21.15.7:0/1997833954 conn(0x7fb2e80fd8c0 msgr2=0x7fb2e80febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:08.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.563+0000 7fb2eee7d640 1 -- 172.21.15.7:0/1997833954 shutdown_connections 2024-09-19T08:54:08.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:08.563+0000 7fb2eee7d640 1 -- 172.21.15.7:0/1997833954 wait complete. 2024-09-19T08:54:09.260 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:09 smithi007 ceph-mon[31221]: pgmap v297: 97 pgs: 97 active+clean; 2.1 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:54:09.260 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:09 smithi007 ceph-mon[31221]: scrub queued for path: / 2024-09-19T08:54:09.260 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:09 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:09.260 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:09 smithi007 ceph-mon[31221]: scrub summary: active paths [/] 2024-09-19T08:54:09.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:09 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:09.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:09 smithi007 ceph-mon[31221]: scrub summary: idle 2024-09-19T08:54:09.291 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:54:09.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:09 smithi044 ceph-mon[35072]: pgmap v297: 97 pgs: 97 active+clean; 2.1 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:54:09.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:09 smithi044 ceph-mon[35072]: scrub queued for path: / 2024-09-19T08:54:09.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:09 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:09.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:09 smithi044 ceph-mon[35072]: scrub summary: active paths [/] 2024-09-19T08:54:09.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:09 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:09.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:09 smithi044 ceph-mon[35072]: scrub summary: idle 2024-09-19T08:54:09.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:09 smithi175 ceph-mon[35688]: pgmap v297: 97 pgs: 97 active+clean; 2.1 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:54:09.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:09 smithi175 ceph-mon[35688]: scrub queued for path: / 2024-09-19T08:54:09.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:09 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:09.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:09 smithi175 ceph-mon[35688]: scrub summary: active paths [/] 2024-09-19T08:54:09.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:09 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:09.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:09 smithi175 ceph-mon[35688]: scrub summary: idle 2024-09-19T08:54:09.549 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.023+0000 7f471aad7640 1 -- 172.21.15.7:0/257071948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4714102790 msgr2=0x7f47141067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.023+0000 7f471aad7640 1 --2- 172.21.15.7:0/257071948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4714102790 0x7f47141067e0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f4700009900 tx=0x7f470002a410 comp rx=0 tx=0).stop 2024-09-19T08:54:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.023+0000 7f471aad7640 1 -- 172.21.15.7:0/257071948 shutdown_connections 2024-09-19T08:54:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.023+0000 7f471aad7640 1 --2- 172.21.15.7:0/257071948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4714106f10 0x7f471410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.023+0000 7f471aad7640 1 --2- 172.21.15.7:0/257071948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4714102790 0x7f47141067e0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.023+0000 7f471aad7640 1 --2- 172.21.15.7:0/257071948 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4714101de0 0x7f47141021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.023+0000 7f471aad7640 1 -- 172.21.15.7:0/257071948 >> 172.21.15.7:0/257071948 conn(0x7f47140fd8c0 msgr2=0x7f47140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.023+0000 7f471aad7640 1 -- 172.21.15.7:0/257071948 shutdown_connections 2024-09-19T08:54:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.023+0000 7f471aad7640 1 -- 172.21.15.7:0/257071948 wait complete. 2024-09-19T08:54:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.024+0000 7f471aad7640 1 Processor -- start 2024-09-19T08:54:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.024+0000 7f471aad7640 1 -- start start 2024-09-19T08:54:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.024+0000 7f471aad7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4714101de0 0x7f47140744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.024+0000 7f471aad7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4714102790 0x7f4714074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.024+0000 7f471aad7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4714106f10 0x7f4714074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.024+0000 7f471aad7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4714111f70 con 0x7f4714101de0 2024-09-19T08:54:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.024+0000 7f471aad7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4714111df0 con 0x7f4714106f10 2024-09-19T08:54:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.024+0000 7f471aad7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f47141120f0 con 0x7f4714102790 2024-09-19T08:54:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.024+0000 7f4718873640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4714101de0 0x7f47140744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.024+0000 7f4718873640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4714101de0 0x7f47140744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43170/0 (socket says 172.21.15.7:43170) 2024-09-19T08:54:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.024+0000 7f4718873640 1 -- 172.21.15.7:0/2878142436 learned_addr learned my addr 172.21.15.7:0/2878142436 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.024+0000 7f4719074640 1 --2- 172.21.15.7:0/2878142436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4714106f10 0x7f4714074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.024+0000 7f4713fff640 1 --2- 172.21.15.7:0/2878142436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4714102790 0x7f4714074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.024+0000 7f4718873640 1 -- 172.21.15.7:0/2878142436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4714102790 msgr2=0x7f4714074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.024+0000 7f4718873640 1 --2- 172.21.15.7:0/2878142436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4714102790 0x7f4714074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.024+0000 7f4718873640 1 -- 172.21.15.7:0/2878142436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4714106f10 msgr2=0x7f4714074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.024+0000 7f4718873640 1 --2- 172.21.15.7:0/2878142436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4714106f10 0x7f4714074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.024+0000 7f4718873640 1 -- 172.21.15.7:0/2878142436 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47141a68e0 con 0x7f4714101de0 2024-09-19T08:54:10.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.025+0000 7f4718873640 1 --2- 172.21.15.7:0/2878142436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4714101de0 0x7f47140744f0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f470800d950 tx=0x7f470800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:10.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.025+0000 7f4711ffb640 1 -- 172.21.15.7:0/2878142436 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4708017030 con 0x7f4714101de0 2024-09-19T08:54:10.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.025+0000 7f4711ffb640 1 -- 172.21.15.7:0/2878142436 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4708004020 con 0x7f4714101de0 2024-09-19T08:54:10.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.025+0000 7f471aad7640 1 -- 172.21.15.7:0/2878142436 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47141a6bd0 con 0x7f4714101de0 2024-09-19T08:54:10.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.025+0000 7f4711ffb640 1 -- 172.21.15.7:0/2878142436 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47080047a0 con 0x7f4714101de0 2024-09-19T08:54:10.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.025+0000 7f471aad7640 1 -- 172.21.15.7:0/2878142436 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47141a7110 con 0x7f4714101de0 2024-09-19T08:54:10.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.027+0000 7f4711ffb640 1 -- 172.21.15.7:0/2878142436 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f47080041d0 con 0x7f4714101de0 2024-09-19T08:54:10.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.028+0000 7f471ceb0740 1 Processor -- start 2024-09-19T08:54:10.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.028+0000 7f471ceb0740 1 -- start start 2024-09-19T08:54:10.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.028+0000 7f4711ffb640 1 --2- 172.21.15.7:0/2878142436 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f47040a33b0 0x7f47040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.028+0000 7f471ceb0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b75b4a0 0x55f10b75b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.028+0000 7f471ceb0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f10b75bdc0 0x55f10b766140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.028+0000 7f471ceb0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b766680 0x55f10b768a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.028+0000 7f471ceb0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f10b6c12e0 con 0x55f10b75b4a0 2024-09-19T08:54:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.028+0000 7f471ceb0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f10b668ce0 con 0x55f10b75bdc0 2024-09-19T08:54:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.028+0000 7f471ceb0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f10b6bd2a0 con 0x55f10b766680 2024-09-19T08:54:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.028+0000 7f4718873640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b75b4a0 0x55f10b75b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.028+0000 7f4719074640 1 --2- 172.21.15.7:0/2878142436 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f47040a33b0 0x7f47040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.028+0000 7f4718873640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b75b4a0 0x55f10b75b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43172/0 (socket says 172.21.15.7:43172) 2024-09-19T08:54:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.028+0000 7f4718873640 1 -- 172.21.15.7:0/488474285 learned_addr learned my addr 172.21.15.7:0/488474285 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.028+0000 7f4719074640 1 --2- 172.21.15.7:0/488474285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b766680 0x55f10b768a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.028+0000 7f4711ffb640 1 -- 172.21.15.7:0/2878142436 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8629+0+0 (secure 0 0 0) 0x7f47080cf7b0 con 0x7f4714101de0 2024-09-19T08:54:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.028+0000 7f4713fff640 1 --2- 172.21.15.7:0/488474285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f10b75bdc0 0x55f10b766140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.028+0000 7f4718873640 1 -- 172.21.15.7:0/488474285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b766680 msgr2=0x55f10b768a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:10.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.028+0000 7f4718873640 1 --2- 172.21.15.7:0/488474285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b766680 0x55f10b768a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.028+0000 7f4718873640 1 -- 172.21.15.7:0/488474285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f10b75bdc0 msgr2=0x55f10b766140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:10.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.028+0000 7f4718873640 1 --2- 172.21.15.7:0/488474285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f10b75bdc0 0x55f10b766140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.028+0000 7f4718873640 1 -- 172.21.15.7:0/488474285 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f10b64d440 con 0x55f10b75b4a0 2024-09-19T08:54:10.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.029+0000 7f4719074640 1 --2- 172.21.15.7:0/2878142436 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f47040a33b0 0x7f47040a5870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f470c005fd0 tx=0x7f470c014b70 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:10.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.029+0000 7f4718873640 1 --2- 172.21.15.7:0/488474285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b75b4a0 0x55f10b75b880 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f4708098390 tx=0x7f470809b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970521e347d59cb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:10.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.029+0000 7f46feffd640 1 -- 172.21.15.7:0/488474285 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47080a9040 con 0x55f10b75b4a0 2024-09-19T08:54:10.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.029+0000 7f46feffd640 1 -- 172.21.15.7:0/488474285 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47080a54f0 con 0x55f10b75b4a0 2024-09-19T08:54:10.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.029+0000 7f46feffd640 1 -- 172.21.15.7:0/488474285 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47080cd0b0 con 0x55f10b75b4a0 2024-09-19T08:54:10.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.029+0000 7f471ceb0740 1 -- 172.21.15.7:0/488474285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b75b4a0 msgr2=0x55f10b75b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:10.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.029+0000 7f471ceb0740 1 --2- 172.21.15.7:0/488474285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b75b4a0 0x55f10b75b880 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f4708098390 tx=0x7f470809b8c0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.030+0000 7f471ceb0740 1 -- 172.21.15.7:0/488474285 shutdown_connections 2024-09-19T08:54:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.030+0000 7f471ceb0740 1 --2- 172.21.15.7:0/488474285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b766680 0x55f10b768a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.030+0000 7f471ceb0740 1 --2- 172.21.15.7:0/488474285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f10b75bdc0 0x55f10b766140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.030+0000 7f471ceb0740 1 --2- 172.21.15.7:0/488474285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b75b4a0 0x55f10b75b880 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.030+0000 7f471ceb0740 1 -- 172.21.15.7:0/488474285 >> 172.21.15.7:0/488474285 conn(0x55f10b757a30 msgr2=0x55f10b757e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.030+0000 7f471ceb0740 1 -- 172.21.15.7:0/488474285 shutdown_connections 2024-09-19T08:54:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.030+0000 7f471ceb0740 1 -- 172.21.15.7:0/488474285 wait complete. 2024-09-19T08:54:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.030+0000 7f471ceb0740 1 -- start start 2024-09-19T08:54:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.030+0000 7f471ceb0740 1 Processor -- start 2024-09-19T08:54:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.030+0000 7f471ceb0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b75b4a0 0x55f10b765f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.030+0000 7f471ceb0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f10b75bdc0 0x55f10b763220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.030+0000 7f471ceb0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b766680 0x55f10b763760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.030+0000 7f471ceb0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f10b7691f0 con 0x55f10b766680 2024-09-19T08:54:10.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.030+0000 7f471ceb0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f10b67c050 con 0x55f10b75bdc0 2024-09-19T08:54:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.030+0000 7f471ceb0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f10b769370 con 0x55f10b75b4a0 2024-09-19T08:54:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.030+0000 7f471ceb0740 10 client.0 _ll_register_callbacks cb 0x55f10b6bc160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.031+0000 7f4719074640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b766680 0x55f10b763760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.031+0000 7f4719074640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b766680 0x55f10b763760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43182/0 (socket says 172.21.15.7:43182) 2024-09-19T08:54:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.031+0000 7f4719074640 1 -- 172.21.15.7:0/1713744258 learned_addr learned my addr 172.21.15.7:0/1713744258 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.031+0000 7f4713fff640 1 --2- 172.21.15.7:0/1713744258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f10b75bdc0 0x55f10b763220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.031+0000 7f4718873640 1 --2- 172.21.15.7:0/1713744258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b75b4a0 0x55f10b765f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.031+0000 7f4719074640 1 -- 172.21.15.7:0/1713744258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b75b4a0 msgr2=0x55f10b765f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.031+0000 7f4719074640 1 --2- 172.21.15.7:0/1713744258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b75b4a0 0x55f10b765f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.031+0000 7f4719074640 1 -- 172.21.15.7:0/1713744258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f10b75bdc0 msgr2=0x55f10b763220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.031+0000 7f4719074640 1 --2- 172.21.15.7:0/1713744258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f10b75bdc0 0x55f10b763220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.031+0000 7f4719074640 1 -- 172.21.15.7:0/1713744258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f10b4323c0 con 0x55f10b766680 2024-09-19T08:54:10.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.031+0000 7f4718873640 1 --2- 172.21.15.7:0/1713744258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b75b4a0 0x55f10b765f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:10.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.031+0000 7f4719074640 1 --2- 172.21.15.7:0/1713744258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b766680 0x55f10b763760 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f470c012f60 tx=0x7f470c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e1958d2ebdbe65 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:10.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.031+0000 7f46f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:10.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.031+0000 7f46f3fff640 1 -- 172.21.15.7:0/1713744258 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c025070 con 0x55f10b766680 2024-09-19T08:54:10.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.031+0000 7f46f3fff640 1 -- 172.21.15.7:0/1713744258 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8629+0+0 (secure 0 0 0) 0x7f470c021420 con 0x55f10b766680 2024-09-19T08:54:10.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.031+0000 7f471ceb0740 1 -- 172.21.15.7:0/1713744258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47080a54f0 con 0x55f10b766680 2024-09-19T08:54:10.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.032+0000 7f46f3fff640 1 -- 172.21.15.7:0/1713744258 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f470c031050 con 0x55f10b766680 2024-09-19T08:54:10.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.032+0000 7f471ceb0740 10 client.17430 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:10.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.032+0000 7f471ceb0740 1 -- 172.21.15.7:0/1713744258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f10b774b60 con 0x55f10b766680 2024-09-19T08:54:10.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.032+0000 7f46f3fff640 1 -- 172.21.15.7:0/1713744258 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47080a54f0 con 0x55f10b766680 2024-09-19T08:54:10.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.032+0000 7f46f3fff640 1 -- 172.21.15.7:0/1713744258 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f470c00f040 con 0x55f10b766680 2024-09-19T08:54:10.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.032+0000 7f471ceb0740 10 client.17430 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:10.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.032+0000 7f471ceb0740 10 client.17430 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:10.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.032+0000 7f471ceb0740 20 client.17430 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:10.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.032+0000 7f471ceb0740 1 --2- 172.21.15.7:0/1713744258 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f10b775f70 0x55f10b7783f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.032+0000 7f471ceb0740 4 client.17430 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:10.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.032+0000 7f471ceb0740 1 -- 172.21.15.7:0/1713744258 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f10b6ce850 con 0x55f10b775f70 2024-09-19T08:54:10.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.032+0000 7f4718873640 1 --2- 172.21.15.7:0/1713744258 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f10b775f70 0x55f10b7783f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.033+0000 7f46f3fff640 10 client.17430 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:10.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.033+0000 7f4718873640 1 --2- 172.21.15.7:0/1713744258 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f10b775f70 0x55f10b7783f0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c45e7f7c1e90a7c2 server_cookie=48f0693c1b5970c2 in_seq=0 out_seq=0 2024-09-19T08:54:10.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.033+0000 7f46f3fff640 1 -- 172.21.15.7:0/1713744258 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f10b6ce850 con 0x55f10b775f70 2024-09-19T08:54:10.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.033+0000 7f46f3fff640 10 client.17430 handle_command_reply: tid=0 2024-09-19T08:54:10.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.033+0000 7f471ceb0740 1 client.17430 shutdown 2024-09-19T08:54:10.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.033+0000 7f471ceb0740 1 -- 172.21.15.7:0/1713744258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b766680 msgr2=0x55f10b763760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:10.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.034+0000 7f471ceb0740 1 --2- 172.21.15.7:0/1713744258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b766680 0x55f10b763760 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f470c012f60 tx=0x7f470c004ab0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.034+0000 7f471ceb0740 1 -- 172.21.15.7:0/1713744258 shutdown_connections 2024-09-19T08:54:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.034+0000 7f471ceb0740 1 --2- 172.21.15.7:0/1713744258 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f10b775f70 0x55f10b7783f0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.034+0000 7f471ceb0740 1 --2- 172.21.15.7:0/1713744258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b766680 0x55f10b763760 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.034+0000 7f471ceb0740 1 --2- 172.21.15.7:0/1713744258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f10b75bdc0 0x55f10b763220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.034+0000 7f471ceb0740 1 --2- 172.21.15.7:0/1713744258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b75b4a0 0x55f10b765f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.034+0000 7f46f3fff640 0 client.17430 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.034+0000 7f471ceb0740 1 -- 172.21.15.7:0/1713744258 >> 172.21.15.7:0/1713744258 conn(0x55f10b757a30 msgr2=0x55f10b75d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.034+0000 7f471ceb0740 1 -- 172.21.15.7:0/1713744258 shutdown_connections 2024-09-19T08:54:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.034+0000 7f471ceb0740 1 -- 172.21.15.7:0/1713744258 wait complete. 2024-09-19T08:54:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.034+0000 7f471ceb0740 20 client.17430 trim_cache size 0 max 16384 2024-09-19T08:54:10.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.052+0000 7f471ceb0740 1 Processor -- start 2024-09-19T08:54:10.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.052+0000 7f471ceb0740 1 -- start start 2024-09-19T08:54:10.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.052+0000 7f471ceb0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f10b75b4a0 0x55f10b765190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.052+0000 7f471ceb0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b75bdc0 0x55f10b77dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.052+0000 7f471ceb0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b766680 0x55f10b77e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.052+0000 7f471ceb0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f47141b24d0 con 0x55f10b75bdc0 2024-09-19T08:54:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.052+0000 7f471ceb0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f47141afda0 con 0x55f10b75b4a0 2024-09-19T08:54:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.052+0000 7f471ceb0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f47141adc10 con 0x55f10b766680 2024-09-19T08:54:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.052+0000 7f4713fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b75bdc0 0x55f10b77dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.052+0000 7f4713fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b75bdc0 0x55f10b77dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43188/0 (socket says 172.21.15.7:43188) 2024-09-19T08:54:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.052+0000 7f4713fff640 1 -- 172.21.15.7:0/1486802179 learned_addr learned my addr 172.21.15.7:0/1486802179 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.052+0000 7f4718873640 1 --2- 172.21.15.7:0/1486802179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f10b75b4a0 0x55f10b765190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.052+0000 7f4719074640 1 --2- 172.21.15.7:0/1486802179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b766680 0x55f10b77e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.053+0000 7f4713fff640 1 -- 172.21.15.7:0/1486802179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b766680 msgr2=0x55f10b77e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.053+0000 7f4713fff640 1 --2- 172.21.15.7:0/1486802179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b766680 0x55f10b77e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.053+0000 7f4713fff640 1 -- 172.21.15.7:0/1486802179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f10b75b4a0 msgr2=0x55f10b765190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.053+0000 7f4713fff640 1 --2- 172.21.15.7:0/1486802179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f10b75b4a0 0x55f10b765190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.053+0000 7f4713fff640 1 -- 172.21.15.7:0/1486802179 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f10b758720 con 0x55f10b75bdc0 2024-09-19T08:54:10.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.053+0000 7f4713fff640 1 --2- 172.21.15.7:0/1486802179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b75bdc0 0x55f10b77dd10 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f4700009900 tx=0x7f4700032de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1adb2afdea5ac49f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:10.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.055+0000 7f46fe7fc640 1 -- 172.21.15.7:0/1486802179 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4700035040 con 0x55f10b75bdc0 2024-09-19T08:54:10.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.055+0000 7f46fe7fc640 1 -- 172.21.15.7:0/1486802179 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47000317b0 con 0x55f10b75bdc0 2024-09-19T08:54:10.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.055+0000 7f46fe7fc640 1 -- 172.21.15.7:0/1486802179 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47000046c0 con 0x55f10b75bdc0 2024-09-19T08:54:10.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.056+0000 7f471ceb0740 1 -- 172.21.15.7:0/1486802179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b75bdc0 msgr2=0x55f10b77dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:10.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.056+0000 7f471ceb0740 1 --2- 172.21.15.7:0/1486802179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b75bdc0 0x55f10b77dd10 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f4700009900 tx=0x7f4700032de0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.056+0000 7f471ceb0740 1 -- 172.21.15.7:0/1486802179 shutdown_connections 2024-09-19T08:54:10.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.056+0000 7f471ceb0740 1 --2- 172.21.15.7:0/1486802179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b766680 0x55f10b77e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.056+0000 7f471ceb0740 1 --2- 172.21.15.7:0/1486802179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b75bdc0 0x55f10b77dd10 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.056+0000 7f471ceb0740 1 --2- 172.21.15.7:0/1486802179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f10b75b4a0 0x55f10b765190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.056+0000 7f471ceb0740 1 -- 172.21.15.7:0/1486802179 >> 172.21.15.7:0/1486802179 conn(0x55f10b757a30 msgr2=0x55f10b764a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:10.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.056+0000 7f471ceb0740 1 -- 172.21.15.7:0/1486802179 shutdown_connections 2024-09-19T08:54:10.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.056+0000 7f471ceb0740 1 -- 172.21.15.7:0/1486802179 wait complete. 2024-09-19T08:54:10.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.056+0000 7f471ceb0740 1 -- start start 2024-09-19T08:54:10.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.056+0000 7f471ceb0740 1 Processor -- start 2024-09-19T08:54:10.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.057+0000 7f471ceb0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f10b75b4a0 0x55f10b76eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.057+0000 7f471ceb0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b75bdc0 0x55f10b76beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.057+0000 7f471ceb0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b766680 0x55f10b76c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.057+0000 7f471ceb0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f47141ae260 con 0x55f10b766680 2024-09-19T08:54:10.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.057+0000 7f471ceb0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f47141af6d0 con 0x55f10b75b4a0 2024-09-19T08:54:10.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.057+0000 7f471ceb0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f47141ae930 con 0x55f10b75bdc0 2024-09-19T08:54:10.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.057+0000 7f471ceb0740 10 client.0 _ll_register_callbacks cb 0x7f470c012df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:10.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.057+0000 7f4719074640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b766680 0x55f10b76c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.057+0000 7f4718873640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f10b75b4a0 0x55f10b76eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.057+0000 7f4719074640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b766680 0x55f10b76c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43204/0 (socket says 172.21.15.7:43204) 2024-09-19T08:54:10.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.057+0000 7f4718873640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f10b75b4a0 0x55f10b76eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:34946/0 (socket says 172.21.15.7:34946) 2024-09-19T08:54:10.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.057+0000 7f4719074640 1 -- 172.21.15.7:0/4278564436 learned_addr learned my addr 172.21.15.7:0/4278564436 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:10.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.057+0000 7f4713fff640 1 --2- 172.21.15.7:0/4278564436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b75bdc0 0x55f10b76beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.057+0000 7f4719074640 1 -- 172.21.15.7:0/4278564436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b75bdc0 msgr2=0x55f10b76beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:10.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.057+0000 7f4719074640 1 --2- 172.21.15.7:0/4278564436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b75bdc0 0x55f10b76beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.057+0000 7f4719074640 1 -- 172.21.15.7:0/4278564436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f10b75b4a0 msgr2=0x55f10b76eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:10.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.057+0000 7f4719074640 1 --2- 172.21.15.7:0/4278564436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f10b75b4a0 0x55f10b76eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.057+0000 7f4719074640 1 -- 172.21.15.7:0/4278564436 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f10b76c9e0 con 0x55f10b766680 2024-09-19T08:54:10.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.057+0000 7f4713fff640 1 --2- 172.21.15.7:0/4278564436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b75bdc0 0x55f10b76beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:10.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.058+0000 7f4719074640 1 --2- 172.21.15.7:0/4278564436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b766680 0x55f10b76c3f0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f470c005d70 tx=0x7f470c004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5832deeb86c853a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:10.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.058+0000 7f46f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:10.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.058+0000 7f46f3fff640 1 -- 172.21.15.7:0/4278564436 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c03a060 con 0x55f10b766680 2024-09-19T08:54:10.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.058+0000 7f46f3fff640 1 -- 172.21.15.7:0/4278564436 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8629+0+0 (secure 0 0 0) 0x7f470c020a80 con 0x55f10b766680 2024-09-19T08:54:10.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.058+0000 7f471ceb0740 1 -- 172.21.15.7:0/4278564436 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47000317b0 con 0x55f10b766680 2024-09-19T08:54:10.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.058+0000 7f46f3fff640 1 -- 172.21.15.7:0/4278564436 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f470c025040 con 0x55f10b766680 2024-09-19T08:54:10.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.058+0000 7f471ceb0740 10 client.17436 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:10.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.058+0000 7f471ceb0740 1 -- 172.21.15.7:0/4278564436 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f10b7e0b00 con 0x55f10b766680 2024-09-19T08:54:10.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.058+0000 7f46f3fff640 1 -- 172.21.15.7:0/4278564436 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47000317b0 con 0x55f10b766680 2024-09-19T08:54:10.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.058+0000 7f46f3fff640 1 -- 172.21.15.7:0/4278564436 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f470c00f040 con 0x55f10b766680 2024-09-19T08:54:10.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.058+0000 7f471ceb0740 10 client.17436 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:10.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.058+0000 7f471ceb0740 10 client.17436 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:10.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.058+0000 7f471ceb0740 20 client.17436 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:10.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.058+0000 7f471ceb0740 1 --2- 172.21.15.7:0/4278564436 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f10b7e1170 0x55f10b7e3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.058+0000 7f471ceb0740 4 client.17436 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:54:10.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.058+0000 7f471ceb0740 1 -- 172.21.15.7:0/4278564436 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f10b6c8d60 con 0x55f10b7e1170 2024-09-19T08:54:10.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.059+0000 7f4718873640 1 --2- 172.21.15.7:0/4278564436 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f10b7e1170 0x55f10b7e3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.059+0000 7f4718873640 1 --2- 172.21.15.7:0/4278564436 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f10b7e1170 0x55f10b7e3560 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60fb9f534b4532b7 server_cookie=cedd6b1719d32b9 in_seq=0 out_seq=0 2024-09-19T08:54:10.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.059+0000 7f46f3fff640 10 client.17436 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:10.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.059+0000 7f46f3fff640 1 -- 172.21.15.7:0/4278564436 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f10b6c8d60 con 0x55f10b7e1170 2024-09-19T08:54:10.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.059+0000 7f46f3fff640 10 client.17436 handle_command_reply: tid=0 2024-09-19T08:54:10.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.059+0000 7f471ceb0740 1 client.17436 shutdown 2024-09-19T08:54:10.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.059+0000 7f471ceb0740 1 -- 172.21.15.7:0/4278564436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b766680 msgr2=0x55f10b76c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:10.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.059+0000 7f471ceb0740 1 --2- 172.21.15.7:0/4278564436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b766680 0x55f10b76c3f0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f470c005d70 tx=0x7f470c004480 comp rx=0 tx=0).stop 2024-09-19T08:54:10.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.060+0000 7f471ceb0740 1 -- 172.21.15.7:0/4278564436 shutdown_connections 2024-09-19T08:54:10.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.060+0000 7f471ceb0740 1 --2- 172.21.15.7:0/4278564436 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55f10b7e1170 0x55f10b7e3560 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.060+0000 7f471ceb0740 1 --2- 172.21.15.7:0/4278564436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f10b766680 0x55f10b76c3f0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.060+0000 7f46f3fff640 0 client.17436 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:10.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.060+0000 7f471ceb0740 1 --2- 172.21.15.7:0/4278564436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f10b75bdc0 0x55f10b76beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.060+0000 7f471ceb0740 1 --2- 172.21.15.7:0/4278564436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f10b75b4a0 0x55f10b76eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.060+0000 7f471ceb0740 1 -- 172.21.15.7:0/4278564436 >> 172.21.15.7:0/4278564436 conn(0x55f10b757a30 msgr2=0x55f10b7616c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:10.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.060+0000 7f471ceb0740 1 -- 172.21.15.7:0/4278564436 shutdown_connections 2024-09-19T08:54:10.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.060+0000 7f471ceb0740 1 -- 172.21.15.7:0/4278564436 wait complete. 2024-09-19T08:54:10.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.060+0000 7f471ceb0740 20 client.17436 trim_cache size 0 max 16384 2024-09-19T08:54:10.069 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:54:10.069 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-19T08:54:10.069 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-09-19T08:54:10.069 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:54:10.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.060+0000 7f471aad7640 1 -- 172.21.15.7:0/2878142436 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f47040a33b0 msgr2=0x7f47040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:10.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.060+0000 7f471aad7640 1 --2- 172.21.15.7:0/2878142436 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f47040a33b0 0x7f47040a5870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f470c005fd0 tx=0x7f470c014b70 comp rx=0 tx=0).stop 2024-09-19T08:54:10.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.060+0000 7f471aad7640 1 -- 172.21.15.7:0/2878142436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4714101de0 msgr2=0x7f47140744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:10.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.060+0000 7f471aad7640 1 --2- 172.21.15.7:0/2878142436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4714101de0 0x7f47140744f0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f470800d950 tx=0x7f470800de10 comp rx=0 tx=0).stop 2024-09-19T08:54:10.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.061+0000 7f471aad7640 1 -- 172.21.15.7:0/2878142436 shutdown_connections 2024-09-19T08:54:10.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.061+0000 7f471aad7640 1 --2- 172.21.15.7:0/2878142436 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f47040a33b0 0x7f47040a5870 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.061+0000 7f471aad7640 1 --2- 172.21.15.7:0/2878142436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4714106f10 0x7f4714074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.061+0000 7f471aad7640 1 --2- 172.21.15.7:0/2878142436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4714102790 0x7f4714074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.061+0000 7f471aad7640 1 --2- 172.21.15.7:0/2878142436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4714101de0 0x7f47140744f0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.061+0000 7f471aad7640 1 -- 172.21.15.7:0/2878142436 >> 172.21.15.7:0/2878142436 conn(0x7f47140fd8c0 msgr2=0x7f47140feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:10.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.061+0000 7f471aad7640 1 -- 172.21.15.7:0/2878142436 shutdown_connections 2024-09-19T08:54:10.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:10.061+0000 7f471aad7640 1 -- 172.21.15.7:0/2878142436 wait complete. 2024-09-19T08:54:10.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:10 smithi007 ceph-mon[31221]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T08:54:10.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:10 smithi044 ceph-mon[35072]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T08:54:10.329 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:10 smithi175 ceph-mon[35688]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T08:54:10.712 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:54:10.713 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:54:10.970 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:11.362 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:11 smithi007 ceph-mon[31221]: pgmap v299: 97 pgs: 97 active+clean; 2.1 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:54:11.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:11 smithi175 ceph-mon[35688]: pgmap v299: 97 pgs: 97 active+clean; 2.1 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:54:11.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.443+0000 7f83de324640 1 -- 172.21.15.7:0/3146109668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83d81055b0 msgr2=0x7f83d810d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:11.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.443+0000 7f83de324640 1 --2- 172.21.15.7:0/3146109668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83d81055b0 0x7f83d810d130 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f83d0009ca0 tx=0x7f83d002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:54:11.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.443+0000 7f83de324640 1 -- 172.21.15.7:0/3146109668 shutdown_connections 2024-09-19T08:54:11.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.443+0000 7f83de324640 1 --2- 172.21.15.7:0/3146109668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83d81055b0 0x7f83d810d130 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:11.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.443+0000 7f83de324640 1 --2- 172.21.15.7:0/3146109668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83d8100e30 0x7f83d8104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:11.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.443+0000 7f83de324640 1 --2- 172.21.15.7:0/3146109668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83d8100480 0x7f83d8100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:11.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.443+0000 7f83de324640 1 -- 172.21.15.7:0/3146109668 >> 172.21.15.7:0/3146109668 conn(0x7f83d8077210 msgr2=0x7f83d80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:11.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.443+0000 7f83de324640 1 -- 172.21.15.7:0/3146109668 shutdown_connections 2024-09-19T08:54:11.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.443+0000 7f83de324640 1 -- 172.21.15.7:0/3146109668 wait complete. 2024-09-19T08:54:11.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.444+0000 7f83de324640 1 Processor -- start 2024-09-19T08:54:11.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.444+0000 7f83de324640 1 -- start start 2024-09-19T08:54:11.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.444+0000 7f83de324640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83d8100480 0x7f83d8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:11.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.444+0000 7f83de324640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83d8100e30 0x7f83d8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:11.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.444+0000 7f83de324640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83d81055b0 0x7f83d819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:11.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.444+0000 7f83de324640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f83d8111f90 con 0x7f83d8100480 2024-09-19T08:54:11.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.444+0000 7f83de324640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f83d8111e10 con 0x7f83d8100e30 2024-09-19T08:54:11.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.444+0000 7f83de324640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f83d8112110 con 0x7f83d81055b0 2024-09-19T08:54:11.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.444+0000 7f83d7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83d8100480 0x7f83d8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:11.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.444+0000 7f83d7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83d8100480 0x7f83d8198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43218/0 (socket says 172.21.15.7:43218) 2024-09-19T08:54:11.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.444+0000 7f83d7fff640 1 -- 172.21.15.7:0/1656943643 learned_addr learned my addr 172.21.15.7:0/1656943643 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:11.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.444+0000 7f83d77fe640 1 --2- 172.21.15.7:0/1656943643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83d8100e30 0x7f83d8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:11.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.444+0000 7f83dc8c1640 1 --2- 172.21.15.7:0/1656943643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83d81055b0 0x7f83d819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:11.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.445+0000 7f83d7fff640 1 -- 172.21.15.7:0/1656943643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83d81055b0 msgr2=0x7f83d819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:11.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.445+0000 7f83d7fff640 1 --2- 172.21.15.7:0/1656943643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83d81055b0 0x7f83d819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:11.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.445+0000 7f83d7fff640 1 -- 172.21.15.7:0/1656943643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83d8100e30 msgr2=0x7f83d8198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:11.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.445+0000 7f83d7fff640 1 --2- 172.21.15.7:0/1656943643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83d8100e30 0x7f83d8198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:11.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.445+0000 7f83d7fff640 1 -- 172.21.15.7:0/1656943643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d819d400 con 0x7f83d8100480 2024-09-19T08:54:11.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.445+0000 7f83dc8c1640 1 --2- 172.21.15.7:0/1656943643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83d81055b0 0x7f83d819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:11.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.445+0000 7f83d7fff640 1 --2- 172.21.15.7:0/1656943643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83d8100480 0x7f83d8198450 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f83c800d770 tx=0x7f83c800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:11.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.445+0000 7f83d57fa640 1 -- 172.21.15.7:0/1656943643 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c8017070 con 0x7f83d8100480 2024-09-19T08:54:11.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.445+0000 7f83de324640 1 -- 172.21.15.7:0/1656943643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d819d6f0 con 0x7f83d8100480 2024-09-19T08:54:11.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.445+0000 7f83d57fa640 1 -- 172.21.15.7:0/1656943643 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83c8005500 con 0x7f83d8100480 2024-09-19T08:54:11.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.445+0000 7f83d57fa640 1 -- 172.21.15.7:0/1656943643 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c8004e00 con 0x7f83d8100480 2024-09-19T08:54:11.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.445+0000 7f83de324640 1 -- 172.21.15.7:0/1656943643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d81a4fd0 con 0x7f83d8100480 2024-09-19T08:54:11.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.446+0000 7f83de324640 1 -- 172.21.15.7:0/1656943643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83d8100860 con 0x7f83d8100480 2024-09-19T08:54:11.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.447+0000 7f83d57fa640 1 -- 172.21.15.7:0/1656943643 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f83c8004fa0 con 0x7f83d8100480 2024-09-19T08:54:11.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.448+0000 7f83d57fa640 1 --2- 172.21.15.7:0/1656943643 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f83c00a33b0 0x7f83c00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:11.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.448+0000 7f83d57fa640 1 -- 172.21.15.7:0/1656943643 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8629+0+0 (secure 0 0 0) 0x7f83c80cfbc0 con 0x7f83d8100480 2024-09-19T08:54:11.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.448+0000 7f83d77fe640 1 --2- 172.21.15.7:0/1656943643 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f83c00a33b0 0x7f83c00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:11.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.449+0000 7f83d77fe640 1 --2- 172.21.15.7:0/1656943643 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f83c00a33b0 0x7f83c00a5870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f83d80ff6c0 tx=0x7f83cc00b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:11.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.451+0000 7f83d57fa640 1 -- 172.21.15.7:0/1656943643 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f83c809c530 con 0x7f83d8100480 2024-09-19T08:54:11.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:11 smithi044 ceph-mon[35072]: pgmap v299: 97 pgs: 97 active+clean; 2.1 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:54:11.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.661+0000 7f83de324640 1 -- 172.21.15.7:0/1656943643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83d81087f0 con 0x7f83d8100480 2024-09-19T08:54:11.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.662+0000 7f83d57fa640 1 -- 172.21.15.7:0/1656943643 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f83c809be30 con 0x7f83d8100480 2024-09-19T08:54:11.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:54:11.663 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:54:11.663 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:54:11.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.665+0000 7f83de324640 1 -- 172.21.15.7:0/1656943643 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f83c00a33b0 msgr2=0x7f83c00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:11.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.665+0000 7f83de324640 1 --2- 172.21.15.7:0/1656943643 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f83c00a33b0 0x7f83c00a5870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f83d80ff6c0 tx=0x7f83cc00b390 comp rx=0 tx=0).stop 2024-09-19T08:54:11.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.665+0000 7f83de324640 1 -- 172.21.15.7:0/1656943643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83d8100480 msgr2=0x7f83d8198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:11.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.665+0000 7f83de324640 1 --2- 172.21.15.7:0/1656943643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83d8100480 0x7f83d8198450 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f83c800d770 tx=0x7f83c800dc30 comp rx=0 tx=0).stop 2024-09-19T08:54:11.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.665+0000 7f83de324640 1 -- 172.21.15.7:0/1656943643 shutdown_connections 2024-09-19T08:54:11.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.665+0000 7f83de324640 1 --2- 172.21.15.7:0/1656943643 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f83c00a33b0 0x7f83c00a5870 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:11.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.665+0000 7f83de324640 1 --2- 172.21.15.7:0/1656943643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83d81055b0 0x7f83d819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:11.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.665+0000 7f83de324640 1 --2- 172.21.15.7:0/1656943643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83d8100e30 0x7f83d8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:11.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.665+0000 7f83de324640 1 --2- 172.21.15.7:0/1656943643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83d8100480 0x7f83d8198450 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:11.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.665+0000 7f83de324640 1 -- 172.21.15.7:0/1656943643 >> 172.21.15.7:0/1656943643 conn(0x7f83d8077210 msgr2=0x7f83d8103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:11.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.665+0000 7f83de324640 1 -- 172.21.15.7:0/1656943643 shutdown_connections 2024-09-19T08:54:11.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:11.665+0000 7f83de324640 1 -- 172.21.15.7:0/1656943643 wait complete. 2024-09-19T08:54:12.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:12 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1656943643' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:12.313 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:54:12.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:12 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1656943643' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:12.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:12 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1656943643' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:12.568 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:13.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.037+0000 7f980fd6d640 1 -- 172.21.15.7:0/3868584458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9808100a80 msgr2=0x7f9808100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:13.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.037+0000 7f980fd6d640 1 --2- 172.21.15.7:0/3868584458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9808100a80 0x7f9808100ee0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009930 tx=0x7f97f802a420 comp rx=0 tx=0).stop 2024-09-19T08:54:13.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.037+0000 7f980fd6d640 1 -- 172.21.15.7:0/3868584458 shutdown_connections 2024-09-19T08:54:13.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.037+0000 7f980fd6d640 1 --2- 172.21.15.7:0/3868584458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9808101420 0x7f980810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.037+0000 7f980fd6d640 1 --2- 172.21.15.7:0/3868584458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9808100a80 0x7f9808100ee0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.037+0000 7f980fd6d640 1 --2- 172.21.15.7:0/3868584458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9808106a80 0x7f9808106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.037+0000 7f980fd6d640 1 -- 172.21.15.7:0/3868584458 >> 172.21.15.7:0/3868584458 conn(0x7f98080fc7a0 msgr2=0x7f98080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:13.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.037+0000 7f980fd6d640 1 -- 172.21.15.7:0/3868584458 shutdown_connections 2024-09-19T08:54:13.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.037+0000 7f980fd6d640 1 -- 172.21.15.7:0/3868584458 wait complete. 2024-09-19T08:54:13.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.038+0000 7f980fd6d640 1 Processor -- start 2024-09-19T08:54:13.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.038+0000 7f980fd6d640 1 -- start start 2024-09-19T08:54:13.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.038+0000 7f980fd6d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9808100a80 0x7f9808197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:13.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.038+0000 7f980fd6d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9808101420 0x7f9808197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:13.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.038+0000 7f980fd6d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9808106a80 0x7f9808197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:13.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.038+0000 7f980fd6d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9808110ea0 con 0x7f9808101420 2024-09-19T08:54:13.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.038+0000 7f980fd6d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9808110d20 con 0x7f9808106a80 2024-09-19T08:54:13.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.038+0000 7f980fd6d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9808111020 con 0x7f9808100a80 2024-09-19T08:54:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.038+0000 7f980d308640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9808101420 0x7f9808197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.038+0000 7f980d308640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9808101420 0x7f9808197680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43236/0 (socket says 172.21.15.7:43236) 2024-09-19T08:54:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.038+0000 7f980d308640 1 -- 172.21.15.7:0/3824551159 learned_addr learned my addr 172.21.15.7:0/3824551159 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.038+0000 7f980e30a640 1 --2- 172.21.15.7:0/3824551159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9808106a80 0x7f9808197bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.038+0000 7f980db09640 1 --2- 172.21.15.7:0/3824551159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9808100a80 0x7f9808197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.038+0000 7f980d308640 1 -- 172.21.15.7:0/3824551159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9808100a80 msgr2=0x7f9808197140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.038+0000 7f980d308640 1 --2- 172.21.15.7:0/3824551159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9808100a80 0x7f9808197140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.038+0000 7f980d308640 1 -- 172.21.15.7:0/3824551159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9808106a80 msgr2=0x7f9808197bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.038+0000 7f980d308640 1 --2- 172.21.15.7:0/3824551159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9808106a80 0x7f9808197bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.038+0000 7f980d308640 1 -- 172.21.15.7:0/3824551159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98081a69b0 con 0x7f9808101420 2024-09-19T08:54:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.038+0000 7f980e30a640 1 --2- 172.21.15.7:0/3824551159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9808106a80 0x7f9808197bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.039+0000 7f980d308640 1 --2- 172.21.15.7:0/3824551159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9808101420 0x7f9808197680 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009a50 tx=0x7f97f8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.039+0000 7f97feffd640 1 -- 172.21.15.7:0/3824551159 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f803f030 con 0x7f9808101420 2024-09-19T08:54:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.039+0000 7f980fd6d640 1 -- 172.21.15.7:0/3824551159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98081a6c40 con 0x7f9808101420 2024-09-19T08:54:13.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.039+0000 7f97feffd640 1 -- 172.21.15.7:0/3824551159 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97f8003ce0 con 0x7f9808101420 2024-09-19T08:54:13.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.039+0000 7f97feffd640 1 -- 172.21.15.7:0/3824551159 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f8035070 con 0x7f9808101420 2024-09-19T08:54:13.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.039+0000 7f980fd6d640 1 -- 172.21.15.7:0/3824551159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98081a7170 con 0x7f9808101420 2024-09-19T08:54:13.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.041+0000 7f97feffd640 1 -- 172.21.15.7:0/3824551159 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f97f8042030 con 0x7f9808101420 2024-09-19T08:54:13.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.041+0000 7f9812146740 1 Processor -- start 2024-09-19T08:54:13.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.042+0000 7f9812146740 1 -- start start 2024-09-19T08:54:13.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.042+0000 7f9812146740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55790dcebb40 0x55790dcea090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:13.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.042+0000 7f9812146740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55790dcea5d0 0x55790dceaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:13.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.042+0000 7f9812146740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcf5370 0x55790dcf7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:13.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.042+0000 7f97feffd640 1 --2- 172.21.15.7:0/3824551159 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f97f40a33b0 0x7f97f40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:13.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.042+0000 7f9812146740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55790dc502f0 con 0x55790dcf5370 2024-09-19T08:54:13.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.042+0000 7f9812146740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55790dbf7cf0 con 0x55790dcea5d0 2024-09-19T08:54:13.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.042+0000 7f9812146740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55790dc4c2b0 con 0x55790dcebb40 2024-09-19T08:54:13.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.042+0000 7f980d308640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcf5370 0x55790dcf7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:13.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.042+0000 7f980e30a640 1 --2- 172.21.15.7:0/3824551159 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f97f40a33b0 0x7f97f40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:13.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.042+0000 7f980d308640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcf5370 0x55790dcf7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43242/0 (socket says 172.21.15.7:43242) 2024-09-19T08:54:13.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.042+0000 7f980d308640 1 -- 172.21.15.7:0/2727107990 learned_addr learned my addr 172.21.15.7:0/2727107990 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:13.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.042+0000 7f980db09640 1 --2- 172.21.15.7:0/2727107990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55790dcea5d0 0x55790dceaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:13.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.042+0000 7f980e30a640 1 --2- 172.21.15.7:0/2727107990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55790dcebb40 0x55790dcea090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:13.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.042+0000 7f97feffd640 1 -- 172.21.15.7:0/3824551159 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8629+0+0 (secure 0 0 0) 0x7f97f80f03c0 con 0x7f9808101420 2024-09-19T08:54:13.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.042+0000 7f980d308640 1 -- 172.21.15.7:0/2727107990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55790dcebb40 msgr2=0x55790dcea090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:13.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.042+0000 7f980d308640 1 --2- 172.21.15.7:0/2727107990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55790dcebb40 0x55790dcea090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.042+0000 7f980d308640 1 -- 172.21.15.7:0/2727107990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55790dcea5d0 msgr2=0x55790dceaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:13.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.042+0000 7f980d308640 1 --2- 172.21.15.7:0/2727107990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55790dcea5d0 0x55790dceaa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.042+0000 7f980d308640 1 -- 172.21.15.7:0/2727107990 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55790dbdc3a0 con 0x55790dcf5370 2024-09-19T08:54:13.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.043+0000 7f980e30a640 1 --2- 172.21.15.7:0/3824551159 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f97f40a33b0 0x7f97f40a5870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f980000afd0 tx=0x7f980000ad00 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:13.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.043+0000 7f980d308640 1 --2- 172.21.15.7:0/2727107990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcf5370 0x55790dcf7760 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009900 tx=0x7f97f80314b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70a32ee81068391 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:13.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.043+0000 7f97f3fff640 1 -- 172.21.15.7:0/2727107990 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f8049050 con 0x55790dcf5370 2024-09-19T08:54:13.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.043+0000 7f97f3fff640 1 -- 172.21.15.7:0/2727107990 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97f80bcd30 con 0x55790dcf5370 2024-09-19T08:54:13.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.043+0000 7f97f3fff640 1 -- 172.21.15.7:0/2727107990 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f803bd00 con 0x55790dcf5370 2024-09-19T08:54:13.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.044+0000 7f9812146740 1 -- 172.21.15.7:0/2727107990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcf5370 msgr2=0x55790dcf7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:13.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.044+0000 7f9812146740 1 --2- 172.21.15.7:0/2727107990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcf5370 0x55790dcf7760 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009900 tx=0x7f97f80314b0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.044+0000 7f9812146740 1 -- 172.21.15.7:0/2727107990 shutdown_connections 2024-09-19T08:54:13.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.044+0000 7f9812146740 1 --2- 172.21.15.7:0/2727107990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcf5370 0x55790dcf7760 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.044+0000 7f9812146740 1 --2- 172.21.15.7:0/2727107990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55790dcea5d0 0x55790dceaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.044+0000 7f9812146740 1 --2- 172.21.15.7:0/2727107990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55790dcebb40 0x55790dcea090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.044+0000 7f9812146740 1 -- 172.21.15.7:0/2727107990 >> 172.21.15.7:0/2727107990 conn(0x55790dcb3310 msgr2=0x55790dce6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:13.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.044+0000 7f9812146740 1 -- 172.21.15.7:0/2727107990 shutdown_connections 2024-09-19T08:54:13.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.044+0000 7f9812146740 1 -- 172.21.15.7:0/2727107990 wait complete. 2024-09-19T08:54:13.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.044+0000 7f9812146740 1 -- start start 2024-09-19T08:54:13.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.044+0000 7f9812146740 1 Processor -- start 2024-09-19T08:54:13.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.045+0000 7f9812146740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55790dcea5d0 0x55790dcf4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:13.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.045+0000 7f9812146740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55790dcebb40 0x55790dcf1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:13.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.045+0000 7f9812146740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcf5370 0x55790dcf2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:13.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.045+0000 7f9812146740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55790dcf7e30 con 0x55790dcf5370 2024-09-19T08:54:13.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.045+0000 7f9812146740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55790dc0b060 con 0x55790dcebb40 2024-09-19T08:54:13.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.045+0000 7f9812146740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55790dcf7fb0 con 0x55790dcea5d0 2024-09-19T08:54:13.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.045+0000 7f9812146740 10 client.0 _ll_register_callbacks cb 0x55790d95e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:13.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.045+0000 7f980e30a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcf5370 0x55790dcf2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:13.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.045+0000 7f980e30a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcf5370 0x55790dcf2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43248/0 (socket says 172.21.15.7:43248) 2024-09-19T08:54:13.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.045+0000 7f980e30a640 1 -- 172.21.15.7:0/2004437212 learned_addr learned my addr 172.21.15.7:0/2004437212 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:13.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.045+0000 7f980db09640 1 --2- 172.21.15.7:0/2004437212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55790dcea5d0 0x55790dcf4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:13.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.045+0000 7f980d308640 1 --2- 172.21.15.7:0/2004437212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55790dcebb40 0x55790dcf1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:13.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.045+0000 7f980e30a640 1 -- 172.21.15.7:0/2004437212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55790dcea5d0 msgr2=0x55790dcf4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:13.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.045+0000 7f980e30a640 1 --2- 172.21.15.7:0/2004437212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55790dcea5d0 0x55790dcf4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.045+0000 7f980e30a640 1 -- 172.21.15.7:0/2004437212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55790dcebb40 msgr2=0x55790dcf1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:13.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.045+0000 7f980e30a640 1 --2- 172.21.15.7:0/2004437212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55790dcebb40 0x55790dcf1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.045+0000 7f980e30a640 1 -- 172.21.15.7:0/2004437212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55790d9c13c0 con 0x55790dcf5370 2024-09-19T08:54:13.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.045+0000 7f980d308640 1 --2- 172.21.15.7:0/2004437212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55790dcebb40 0x55790dcf1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:13.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.045+0000 7f980e30a640 1 --2- 172.21.15.7:0/2004437212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcf5370 0x55790dcf2570 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f9800013930 tx=0x7f980000a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e45ea1887159c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:13.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.045+0000 7f97f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:13.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.046+0000 7f97f17fa640 1 -- 172.21.15.7:0/2004437212 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9800024070 con 0x55790dcf5370 2024-09-19T08:54:13.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.046+0000 7f97f17fa640 1 -- 172.21.15.7:0/2004437212 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8629+0+0 (secure 0 0 0) 0x7f9800004d20 con 0x55790dcf5370 2024-09-19T08:54:13.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.046+0000 7f9812146740 1 -- 172.21.15.7:0/2004437212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97f80bcd30 con 0x55790dcf5370 2024-09-19T08:54:13.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.046+0000 7f97f17fa640 1 -- 172.21.15.7:0/2004437212 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f980000a6a0 con 0x55790dcf5370 2024-09-19T08:54:13.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.046+0000 7f9812146740 10 client.17454 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:13.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.046+0000 7f9812146740 1 -- 172.21.15.7:0/2004437212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55790dd037b0 con 0x55790dcf5370 2024-09-19T08:54:13.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.046+0000 7f97f17fa640 1 -- 172.21.15.7:0/2004437212 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97f80bcd30 con 0x55790dcf5370 2024-09-19T08:54:13.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.046+0000 7f97f17fa640 1 -- 172.21.15.7:0/2004437212 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f98000052f0 con 0x55790dcf5370 2024-09-19T08:54:13.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.046+0000 7f9812146740 10 client.17454 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:13.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.046+0000 7f9812146740 10 client.17454 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:54:13.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.046+0000 7f9812146740 20 client.17454 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:13.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.046+0000 7f9812146740 1 --2- 172.21.15.7:0/2004437212 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55790dd04c70 0x55790dd070a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:13.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.046+0000 7f9812146740 4 client.17454 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:13.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.046+0000 7f9812146740 1 -- 172.21.15.7:0/2004437212 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55790dc5d860 con 0x55790dd04c70 2024-09-19T08:54:13.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.047+0000 7f980db09640 1 --2- 172.21.15.7:0/2004437212 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55790dd04c70 0x55790dd070a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:13.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.047+0000 7f980db09640 1 --2- 172.21.15.7:0/2004437212 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55790dd04c70 0x55790dd070a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6c0a09dc5df4664e server_cookie=4bbad6c5ffeabb83 in_seq=0 out_seq=0 2024-09-19T08:54:13.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.047+0000 7f97f17fa640 10 client.17454 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:54:13.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.048+0000 7f97f17fa640 1 -- 172.21.15.7:0/2004437212 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55790dc5d860 con 0x55790dd04c70 2024-09-19T08:54:13.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.048+0000 7f97f17fa640 10 client.17454 handle_command_reply: tid=0 2024-09-19T08:54:13.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.048+0000 7f9812146740 1 client.17454 shutdown 2024-09-19T08:54:13.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.048+0000 7f9812146740 1 -- 172.21.15.7:0/2004437212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcf5370 msgr2=0x55790dcf2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:13.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.048+0000 7f9812146740 1 --2- 172.21.15.7:0/2004437212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcf5370 0x55790dcf2570 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f9800013930 tx=0x7f980000a3c0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.048+0000 7f9812146740 1 -- 172.21.15.7:0/2004437212 shutdown_connections 2024-09-19T08:54:13.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.048+0000 7f9812146740 1 --2- 172.21.15.7:0/2004437212 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55790dd04c70 0x55790dd070a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.048+0000 7f9812146740 1 --2- 172.21.15.7:0/2004437212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcf5370 0x55790dcf2570 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.048+0000 7f9812146740 1 --2- 172.21.15.7:0/2004437212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55790dcebb40 0x55790dcf1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.048+0000 7f97f17fa640 0 client.17454 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:54:13.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.048+0000 7f9812146740 1 --2- 172.21.15.7:0/2004437212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55790dcea5d0 0x55790dcf4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.048+0000 7f9812146740 1 -- 172.21.15.7:0/2004437212 >> 172.21.15.7:0/2004437212 conn(0x55790dcb3310 msgr2=0x55790dcec990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:13.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.048+0000 7f9812146740 1 -- 172.21.15.7:0/2004437212 shutdown_connections 2024-09-19T08:54:13.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.048+0000 7f9812146740 1 -- 172.21.15.7:0/2004437212 wait complete. 2024-09-19T08:54:13.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.048+0000 7f9812146740 20 client.17454 trim_cache size 0 max 16384 2024-09-19T08:54:13.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.061+0000 7f9812146740 1 Processor -- start 2024-09-19T08:54:13.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.061+0000 7f9812146740 1 -- start start 2024-09-19T08:54:13.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.061+0000 7f9812146740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55790dcea5d0 0x55790dcf3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:13.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.061+0000 7f9812146740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55790dcebb40 0x55790dced180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:13.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.061+0000 7f9812146740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcf5370 0x55790dced6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:13.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.061+0000 7f9812146740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f98081b2510 con 0x55790dcf5370 2024-09-19T08:54:13.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.061+0000 7f9812146740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f98081afde0 con 0x55790dcebb40 2024-09-19T08:54:13.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.061+0000 7f9812146740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f98081adc50 con 0x55790dcea5d0 2024-09-19T08:54:13.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.062+0000 7f980e30a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcf5370 0x55790dced6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:13.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.062+0000 7f980d308640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55790dcebb40 0x55790dced180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:13.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.062+0000 7f980e30a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcf5370 0x55790dced6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43262/0 (socket says 172.21.15.7:43262) 2024-09-19T08:54:13.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.062+0000 7f980e30a640 1 -- 172.21.15.7:0/306984845 learned_addr learned my addr 172.21.15.7:0/306984845 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:13.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.062+0000 7f980db09640 1 --2- 172.21.15.7:0/306984845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55790dcea5d0 0x55790dcf3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:13.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.062+0000 7f980e30a640 1 -- 172.21.15.7:0/306984845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55790dcea5d0 msgr2=0x55790dcf3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:13.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.062+0000 7f980e30a640 1 --2- 172.21.15.7:0/306984845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55790dcea5d0 0x55790dcf3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.062+0000 7f980e30a640 1 -- 172.21.15.7:0/306984845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55790dcebb40 msgr2=0x55790dced180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:13.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.062+0000 7f980e30a640 1 --2- 172.21.15.7:0/306984845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55790dcebb40 0x55790dced180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.062+0000 7f980e30a640 1 -- 172.21.15.7:0/306984845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55790dcf0520 con 0x55790dcf5370 2024-09-19T08:54:13.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.062+0000 7f980e30a640 1 --2- 172.21.15.7:0/306984845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcf5370 0x55790dced6c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f9800005710 tx=0x7f980000a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f4448085ab3a57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:13.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.062+0000 7f97f37fe640 1 -- 172.21.15.7:0/306984845 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9800024050 con 0x55790dcf5370 2024-09-19T08:54:13.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.063+0000 7f97f37fe640 1 -- 172.21.15.7:0/306984845 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9800020ae0 con 0x55790dcf5370 2024-09-19T08:54:13.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.063+0000 7f97f37fe640 1 -- 172.21.15.7:0/306984845 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98000051a0 con 0x55790dcf5370 2024-09-19T08:54:13.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.063+0000 7f9812146740 1 -- 172.21.15.7:0/306984845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcf5370 msgr2=0x55790dced6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:13.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.063+0000 7f9812146740 1 --2- 172.21.15.7:0/306984845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcf5370 0x55790dced6c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f9800005710 tx=0x7f980000a840 comp rx=0 tx=0).stop 2024-09-19T08:54:13.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.063+0000 7f9812146740 1 -- 172.21.15.7:0/306984845 shutdown_connections 2024-09-19T08:54:13.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.063+0000 7f9812146740 1 --2- 172.21.15.7:0/306984845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcf5370 0x55790dced6c0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.063+0000 7f9812146740 1 --2- 172.21.15.7:0/306984845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55790dcebb40 0x55790dced180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.063+0000 7f9812146740 1 --2- 172.21.15.7:0/306984845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55790dcea5d0 0x55790dcf3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.063+0000 7f9812146740 1 -- 172.21.15.7:0/306984845 >> 172.21.15.7:0/306984845 conn(0x55790dcb3310 msgr2=0x55790dcf3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:13.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.063+0000 7f9812146740 1 -- 172.21.15.7:0/306984845 shutdown_connections 2024-09-19T08:54:13.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.063+0000 7f9812146740 1 -- 172.21.15.7:0/306984845 wait complete. 2024-09-19T08:54:13.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.064+0000 7f9812146740 1 -- start start 2024-09-19T08:54:13.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.064+0000 7f9812146740 1 Processor -- start 2024-09-19T08:54:13.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.064+0000 7f9812146740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55790dcea5d0 0x55790dcfd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:13.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.064+0000 7f9812146740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcebb40 0x55790dcfd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:13.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.064+0000 7f9812146740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55790dcf5370 0x55790dcfa140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:13.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.064+0000 7f9812146740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f98081ae2a0 con 0x55790dcebb40 2024-09-19T08:54:13.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.064+0000 7f9812146740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f98081af710 con 0x55790dcf5370 2024-09-19T08:54:13.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.064+0000 7f9812146740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f98081ae970 con 0x55790dcea5d0 2024-09-19T08:54:13.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.064+0000 7f9812146740 10 client.0 _ll_register_callbacks cb 0x7f9800010d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:13.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.065+0000 7f980d308640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcebb40 0x55790dcfd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:13.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.065+0000 7f980d308640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcebb40 0x55790dcfd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43264/0 (socket says 172.21.15.7:43264) 2024-09-19T08:54:13.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.065+0000 7f980d308640 1 -- 172.21.15.7:0/2012601765 learned_addr learned my addr 172.21.15.7:0/2012601765 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:13.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.065+0000 7f980db09640 1 --2- 172.21.15.7:0/2012601765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55790dcea5d0 0x55790dcfd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:13.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.065+0000 7f980e30a640 1 --2- 172.21.15.7:0/2012601765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55790dcf5370 0x55790dcfa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:13.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.065+0000 7f980d308640 1 -- 172.21.15.7:0/2012601765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55790dcea5d0 msgr2=0x55790dcfd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:13.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.065+0000 7f980d308640 1 --2- 172.21.15.7:0/2012601765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55790dcea5d0 0x55790dcfd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.065+0000 7f980d308640 1 -- 172.21.15.7:0/2012601765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55790dcf5370 msgr2=0x55790dcfa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:13.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.065+0000 7f980d308640 1 --2- 172.21.15.7:0/2012601765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55790dcf5370 0x55790dcfa140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.065+0000 7f980d308640 1 -- 172.21.15.7:0/2012601765 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55790dcfa680 con 0x55790dcebb40 2024-09-19T08:54:13.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.065+0000 7f980d308640 1 --2- 172.21.15.7:0/2012601765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcebb40 0x55790dcfd6b0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f97f80edb50 tx=0x7f97f8005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993eec3f7f19c22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:13.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.065+0000 7f97f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:13.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.065+0000 7f97f17fa640 1 -- 172.21.15.7:0/2012601765 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f8049040 con 0x55790dcebb40 2024-09-19T08:54:13.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.065+0000 7f97f17fa640 1 -- 172.21.15.7:0/2012601765 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8629+0+0 (secure 0 0 0) 0x7f97f80b8ca0 con 0x55790dcebb40 2024-09-19T08:54:13.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.065+0000 7f9812146740 1 -- 172.21.15.7:0/2012601765 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9800020ae0 con 0x55790dcebb40 2024-09-19T08:54:13.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.065+0000 7f97f17fa640 1 -- 172.21.15.7:0/2012601765 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f97f80bcd30 con 0x55790dcebb40 2024-09-19T08:54:13.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.065+0000 7f9812146740 10 client.17460 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:13.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.065+0000 7f9812146740 1 -- 172.21.15.7:0/2012601765 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55790dd700d0 con 0x55790dcebb40 2024-09-19T08:54:13.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.066+0000 7f97f17fa640 1 -- 172.21.15.7:0/2012601765 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9800020ae0 con 0x55790dcebb40 2024-09-19T08:54:13.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.066+0000 7f97f17fa640 1 -- 172.21.15.7:0/2012601765 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f97f803b460 con 0x55790dcebb40 2024-09-19T08:54:13.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.066+0000 7f9812146740 10 client.17460 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:13.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.066+0000 7f9812146740 10 client.17460 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:54:13.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.066+0000 7f9812146740 20 client.17460 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:13.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.066+0000 7f9812146740 1 --2- 172.21.15.7:0/2012601765 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55790dd70520 0x55790dd72940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:13.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.066+0000 7f9812146740 4 client.17460 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:54:13.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.066+0000 7f9812146740 1 -- 172.21.15.7:0/2012601765 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55790dc57d70 con 0x55790dd70520 2024-09-19T08:54:13.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.066+0000 7f980db09640 1 --2- 172.21.15.7:0/2012601765 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55790dd70520 0x55790dd72940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:13.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.067+0000 7f980db09640 1 --2- 172.21.15.7:0/2012601765 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55790dd70520 0x55790dd72940 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d6b2eb539e26ebc server_cookie=b12b5d5c67623e in_seq=0 out_seq=0 2024-09-19T08:54:13.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.067+0000 7f97f17fa640 10 client.17460 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:54:13.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.067+0000 7f97f17fa640 1 -- 172.21.15.7:0/2012601765 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55790dc57d70 con 0x55790dd70520 2024-09-19T08:54:13.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.067+0000 7f97f17fa640 10 client.17460 handle_command_reply: tid=0 2024-09-19T08:54:13.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.067+0000 7f9812146740 1 client.17460 shutdown 2024-09-19T08:54:13.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.067+0000 7f9812146740 1 -- 172.21.15.7:0/2012601765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcebb40 msgr2=0x55790dcfd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:13.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.067+0000 7f9812146740 1 --2- 172.21.15.7:0/2012601765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcebb40 0x55790dcfd6b0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f97f80edb50 tx=0x7f97f8005be0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.067+0000 7f9812146740 1 -- 172.21.15.7:0/2012601765 shutdown_connections 2024-09-19T08:54:13.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.067+0000 7f9812146740 1 --2- 172.21.15.7:0/2012601765 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55790dd70520 0x55790dd72940 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.067+0000 7f9812146740 1 --2- 172.21.15.7:0/2012601765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55790dcf5370 0x55790dcfa140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.067+0000 7f9812146740 1 --2- 172.21.15.7:0/2012601765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55790dcebb40 0x55790dcfd6b0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.067+0000 7f97f17fa640 0 client.17460 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:54:13.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.067+0000 7f9812146740 1 --2- 172.21.15.7:0/2012601765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55790dcea5d0 0x55790dcfd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.067+0000 7f9812146740 1 -- 172.21.15.7:0/2012601765 >> 172.21.15.7:0/2012601765 conn(0x55790dcb3310 msgr2=0x55790dcf4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:13.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.067+0000 7f9812146740 1 -- 172.21.15.7:0/2012601765 shutdown_connections 2024-09-19T08:54:13.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.067+0000 7f9812146740 1 -- 172.21.15.7:0/2012601765 wait complete. 2024-09-19T08:54:13.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.067+0000 7f9812146740 20 client.17460 trim_cache size 0 max 16384 2024-09-19T08:54:13.075 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:54:13.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.068+0000 7f980fd6d640 1 -- 172.21.15.7:0/3824551159 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f97f40a33b0 msgr2=0x7f97f40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:13.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.068+0000 7f980fd6d640 1 --2- 172.21.15.7:0/3824551159 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f97f40a33b0 0x7f97f40a5870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f980000afd0 tx=0x7f980000ad00 comp rx=0 tx=0).stop 2024-09-19T08:54:13.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.068+0000 7f980fd6d640 1 -- 172.21.15.7:0/3824551159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9808101420 msgr2=0x7f9808197680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:13.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.068+0000 7f980fd6d640 1 --2- 172.21.15.7:0/3824551159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9808101420 0x7f9808197680 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009a50 tx=0x7f97f8004270 comp rx=0 tx=0).stop 2024-09-19T08:54:13.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.068+0000 7f980fd6d640 1 -- 172.21.15.7:0/3824551159 shutdown_connections 2024-09-19T08:54:13.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.068+0000 7f980fd6d640 1 --2- 172.21.15.7:0/3824551159 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f97f40a33b0 0x7f97f40a5870 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.068+0000 7f980fd6d640 1 --2- 172.21.15.7:0/3824551159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9808106a80 0x7f9808197bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.068+0000 7f980fd6d640 1 --2- 172.21.15.7:0/3824551159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9808101420 0x7f9808197680 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.068+0000 7f980fd6d640 1 --2- 172.21.15.7:0/3824551159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9808100a80 0x7f9808197140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:13.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.068+0000 7f980fd6d640 1 -- 172.21.15.7:0/3824551159 >> 172.21.15.7:0/3824551159 conn(0x7f98080fc7a0 msgr2=0x7f98080fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:13.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.068+0000 7f980fd6d640 1 -- 172.21.15.7:0/3824551159 shutdown_connections 2024-09-19T08:54:13.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:13.068+0000 7f980fd6d640 1 -- 172.21.15.7:0/3824551159 wait complete. 2024-09-19T08:54:13.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:13 smithi007 ceph-mon[31221]: pgmap v300: 97 pgs: 97 active+clean; 2.1 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:54:13.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:13 smithi175 ceph-mon[35688]: pgmap v300: 97 pgs: 97 active+clean; 2.1 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:54:13.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:13 smithi044 ceph-mon[35072]: pgmap v300: 97 pgs: 97 active+clean; 2.1 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:54:13.763 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:54:14.018 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:14.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.478+0000 7fd5987a8640 1 -- 172.21.15.7:0/318356326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd590100e20 msgr2=0x7fd590101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:14.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.478+0000 7fd5987a8640 1 --2- 172.21.15.7:0/318356326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd590100e20 0x7fd590101200 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd588009900 tx=0x7fd58802a480 comp rx=0 tx=0).stop 2024-09-19T08:54:14.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.478+0000 7fd5987a8640 1 -- 172.21.15.7:0/318356326 shutdown_connections 2024-09-19T08:54:14.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.478+0000 7fd5987a8640 1 --2- 172.21.15.7:0/318356326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd590102ef0 0x7fd59010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.478+0000 7fd5987a8640 1 --2- 172.21.15.7:0/318356326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd590102570 0x7fd5901029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.478+0000 7fd5987a8640 1 --2- 172.21.15.7:0/318356326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd590100e20 0x7fd590101200 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.478+0000 7fd5987a8640 1 -- 172.21.15.7:0/318356326 >> 172.21.15.7:0/318356326 conn(0x7fd5900fc7d0 msgr2=0x7fd5900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:14.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.478+0000 7fd5987a8640 1 -- 172.21.15.7:0/318356326 shutdown_connections 2024-09-19T08:54:14.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.478+0000 7fd5987a8640 1 -- 172.21.15.7:0/318356326 wait complete. 2024-09-19T08:54:14.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.479+0000 7fd5987a8640 1 Processor -- start 2024-09-19T08:54:14.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.479+0000 7fd5987a8640 1 -- start start 2024-09-19T08:54:14.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.479+0000 7fd5987a8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd590100e20 0x7fd590197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:14.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.479+0000 7fd5987a8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd590102570 0x7fd5901978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:14.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.479+0000 7fd5987a8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd590102ef0 0x7fd59019bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:14.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.479+0000 7fd5987a8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd590110f80 con 0x7fd590100e20 2024-09-19T08:54:14.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.479+0000 7fd5987a8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd590110e00 con 0x7fd590102570 2024-09-19T08:54:14.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.479+0000 7fd5987a8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd590111100 con 0x7fd590102ef0 2024-09-19T08:54:14.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.479+0000 7fd596544640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd590100e20 0x7fd590197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:14.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.479+0000 7fd595d43640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd590102570 0x7fd5901978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:14.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.479+0000 7fd596d45640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd590102ef0 0x7fd59019bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:14.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.479+0000 7fd596544640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd590100e20 0x7fd590197360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39744/0 (socket says 172.21.15.7:39744) 2024-09-19T08:54:14.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.479+0000 7fd595d43640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd590102570 0x7fd5901978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:38878/0 (socket says 172.21.15.7:38878) 2024-09-19T08:54:14.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.479+0000 7fd596544640 1 -- 172.21.15.7:0/1126251480 learned_addr learned my addr 172.21.15.7:0/1126251480 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:14.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.479+0000 7fd596544640 1 -- 172.21.15.7:0/1126251480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd590102ef0 msgr2=0x7fd59019bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:14.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.479+0000 7fd596544640 1 --2- 172.21.15.7:0/1126251480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd590102ef0 0x7fd59019bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.479+0000 7fd596544640 1 -- 172.21.15.7:0/1126251480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd590102570 msgr2=0x7fd5901978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:14.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.479+0000 7fd596544640 1 --2- 172.21.15.7:0/1126251480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd590102570 0x7fd5901978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.479+0000 7fd596544640 1 -- 172.21.15.7:0/1126251480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59019c310 con 0x7fd590100e20 2024-09-19T08:54:14.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.479+0000 7fd595d43640 1 --2- 172.21.15.7:0/1126251480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd590102570 0x7fd5901978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:14.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.479+0000 7fd596d45640 1 --2- 172.21.15.7:0/1126251480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd590102ef0 0x7fd59019bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:14.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.480+0000 7fd596544640 1 --2- 172.21.15.7:0/1126251480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd590100e20 0x7fd590197360 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fd588006010 tx=0x7fd588003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:14.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.480+0000 7fd58f7fe640 1 -- 172.21.15.7:0/1126251480 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58803f070 con 0x7fd590100e20 2024-09-19T08:54:14.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.480+0000 7fd58f7fe640 1 -- 172.21.15.7:0/1126251480 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd588031c30 con 0x7fd590100e20 2024-09-19T08:54:14.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.480+0000 7fd5987a8640 1 -- 172.21.15.7:0/1126251480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd59019c5a0 con 0x7fd590100e20 2024-09-19T08:54:14.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.480+0000 7fd58f7fe640 1 -- 172.21.15.7:0/1126251480 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd588035030 con 0x7fd590100e20 2024-09-19T08:54:14.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.480+0000 7fd5987a8640 1 -- 172.21.15.7:0/1126251480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5901a3ee0 con 0x7fd590100e20 2024-09-19T08:54:14.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.482+0000 7fd58f7fe640 1 -- 172.21.15.7:0/1126251480 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fd588042070 con 0x7fd590100e20 2024-09-19T08:54:14.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.482+0000 7fd59ab81740 1 Processor -- start 2024-09-19T08:54:14.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.483+0000 7fd59ab81740 1 -- start start 2024-09-19T08:54:14.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.483+0000 7fd59ab81740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3fef2dc30 0x55f3fef2c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:14.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.483+0000 7fd59ab81740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef2c7e0 0x55f3fef2cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:14.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.483+0000 7fd59ab81740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef39970 0x55f3fef3bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:14.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.483+0000 7fd59ab81740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f3fee902f0 con 0x55f3fef2c7e0 2024-09-19T08:54:14.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.483+0000 7fd59ab81740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f3fee37cf0 con 0x55f3fef39970 2024-09-19T08:54:14.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.483+0000 7fd59ab81740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f3fee8c2b0 con 0x55f3fef2dc30 2024-09-19T08:54:14.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.483+0000 7fd596544640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef2c7e0 0x55f3fef2cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:14.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.483+0000 7fd596544640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef2c7e0 0x55f3fef2cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39748/0 (socket says 172.21.15.7:39748) 2024-09-19T08:54:14.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.483+0000 7fd596544640 1 -- 172.21.15.7:0/3443646564 learned_addr learned my addr 172.21.15.7:0/3443646564 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:14.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.483+0000 7fd596d45640 1 --2- 172.21.15.7:0/3443646564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3fef2dc30 0x55f3fef2c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:14.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.483+0000 7fd595d43640 1 --2- 172.21.15.7:0/3443646564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef39970 0x55f3fef3bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:14.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.483+0000 7fd58f7fe640 1 --2- 172.21.15.7:0/1126251480 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd5780a3430 0x7fd5780a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:14.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.483+0000 7fd596544640 1 -- 172.21.15.7:0/3443646564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3fef2dc30 msgr2=0x55f3fef2c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:14.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.483+0000 7fd596544640 1 --2- 172.21.15.7:0/3443646564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3fef2dc30 0x55f3fef2c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.483+0000 7fd596544640 1 -- 172.21.15.7:0/3443646564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef39970 msgr2=0x55f3fef3bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:14.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.483+0000 7fd596544640 1 --2- 172.21.15.7:0/3443646564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef39970 0x55f3fef3bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.483+0000 7fd596544640 1 -- 172.21.15.7:0/3443646564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3fee1c3a0 con 0x55f3fef2c7e0 2024-09-19T08:54:14.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.483+0000 7fd595d43640 1 --2- 172.21.15.7:0/3443646564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef39970 0x55f3fef3bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:14.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.483+0000 7fd596d45640 1 --2- 172.21.15.7:0/1126251480 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd5780a3430 0x7fd5780a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:14.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.484+0000 7fd58f7fe640 1 -- 172.21.15.7:0/1126251480 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8629+0+0 (secure 0 0 0) 0x7fd5880f0370 con 0x7fd590100e20 2024-09-19T08:54:14.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.484+0000 7fd596544640 1 --2- 172.21.15.7:0/3443646564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef2c7e0 0x55f3fef2cc20 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fd5880ed9c0 tx=0x7fd588087080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62acdca6fae2eabc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:14.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.484+0000 7fd58cff9640 1 -- 172.21.15.7:0/3443646564 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5880bbff0 con 0x55f3fef2c7e0 2024-09-19T08:54:14.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.484+0000 7fd596d45640 1 --2- 172.21.15.7:0/1126251480 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd5780a3430 0x7fd5780a58f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd58000f7c0 tx=0x7fd580004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:14.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.484+0000 7fd58cff9640 1 -- 172.21.15.7:0/3443646564 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5880ddf00 con 0x55f3fef2c7e0 2024-09-19T08:54:14.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.484+0000 7fd58cff9640 1 -- 172.21.15.7:0/3443646564 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5880db220 con 0x55f3fef2c7e0 2024-09-19T08:54:14.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.485+0000 7fd59ab81740 1 -- 172.21.15.7:0/3443646564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef2c7e0 msgr2=0x55f3fef2cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:14.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.485+0000 7fd59ab81740 1 --2- 172.21.15.7:0/3443646564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef2c7e0 0x55f3fef2cc20 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fd5880ed9c0 tx=0x7fd588087080 comp rx=0 tx=0).stop 2024-09-19T08:54:14.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.485+0000 7fd59ab81740 1 -- 172.21.15.7:0/3443646564 shutdown_connections 2024-09-19T08:54:14.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.485+0000 7fd59ab81740 1 --2- 172.21.15.7:0/3443646564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef39970 0x55f3fef3bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.485+0000 7fd59ab81740 1 --2- 172.21.15.7:0/3443646564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef2c7e0 0x55f3fef2cc20 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.485+0000 7fd59ab81740 1 --2- 172.21.15.7:0/3443646564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3fef2dc30 0x55f3fef2c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.485+0000 7fd59ab81740 1 -- 172.21.15.7:0/3443646564 >> 172.21.15.7:0/3443646564 conn(0x55f3feef3310 msgr2=0x55f3fef28e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:14.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.485+0000 7fd59ab81740 1 -- 172.21.15.7:0/3443646564 shutdown_connections 2024-09-19T08:54:14.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.485+0000 7fd59ab81740 1 -- 172.21.15.7:0/3443646564 wait complete. 2024-09-19T08:54:14.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.485+0000 7fd59ab81740 1 -- start start 2024-09-19T08:54:14.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.485+0000 7fd59ab81740 1 Processor -- start 2024-09-19T08:54:14.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.485+0000 7fd59ab81740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef2c7e0 0x55f3fef39360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:14.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.485+0000 7fd59ab81740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3fef2dc30 0x55f3fef36610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:14.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.486+0000 7fd59ab81740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef39970 0x55f3fef36c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:14.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.486+0000 7fd59ab81740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f3fef3c300 con 0x55f3fef39970 2024-09-19T08:54:14.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.486+0000 7fd59ab81740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f3fee4b060 con 0x55f3fef2c7e0 2024-09-19T08:54:14.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.486+0000 7fd59ab81740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f3fef3c480 con 0x55f3fef2dc30 2024-09-19T08:54:14.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.486+0000 7fd59ab81740 10 client.0 _ll_register_callbacks cb 0x55f3feb9e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:14.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.486+0000 7fd596d45640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef39970 0x55f3fef36c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:14.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.486+0000 7fd596d45640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef39970 0x55f3fef36c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39758/0 (socket says 172.21.15.7:39758) 2024-09-19T08:54:14.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.486+0000 7fd596d45640 1 -- 172.21.15.7:0/1992622325 learned_addr learned my addr 172.21.15.7:0/1992622325 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:14.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.486+0000 7fd596544640 1 --2- 172.21.15.7:0/1992622325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef2c7e0 0x55f3fef39360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:14.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.486+0000 7fd595d43640 1 --2- 172.21.15.7:0/1992622325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3fef2dc30 0x55f3fef36610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:14.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.486+0000 7fd596d45640 1 -- 172.21.15.7:0/1992622325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3fef2dc30 msgr2=0x55f3fef36610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:14.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.486+0000 7fd596d45640 1 --2- 172.21.15.7:0/1992622325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3fef2dc30 0x55f3fef36610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.486+0000 7fd596d45640 1 -- 172.21.15.7:0/1992622325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef2c7e0 msgr2=0x55f3fef39360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:14.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.486+0000 7fd596d45640 1 --2- 172.21.15.7:0/1992622325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef2c7e0 0x55f3fef39360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.486+0000 7fd596d45640 1 -- 172.21.15.7:0/1992622325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3fec013c0 con 0x55f3fef39970 2024-09-19T08:54:14.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.486+0000 7fd595d43640 1 --2- 172.21.15.7:0/1992622325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3fef2dc30 0x55f3fef36610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:14.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.486+0000 7fd596d45640 1 --2- 172.21.15.7:0/1992622325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef39970 0x55f3fef36c00 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fd58000ff60 tx=0x7fd580004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c949549bb5816668 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:14.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.486+0000 7fd575ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:14.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.486+0000 7fd575ffb640 1 -- 172.21.15.7:0/1992622325 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd580003d80 con 0x55f3fef39970 2024-09-19T08:54:14.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.486+0000 7fd59ab81740 1 -- 172.21.15.7:0/1992622325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5880ddf00 con 0x55f3fef39970 2024-09-19T08:54:14.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.486+0000 7fd575ffb640 1 -- 172.21.15.7:0/1992622325 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8629+0+0 (secure 0 0 0) 0x7fd580004050 con 0x55f3fef39970 2024-09-19T08:54:14.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.487+0000 7fd575ffb640 1 -- 172.21.15.7:0/1992622325 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd58002f050 con 0x55f3fef39970 2024-09-19T08:54:14.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.487+0000 7fd59ab81740 10 client.17472 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:14.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.487+0000 7fd59ab81740 1 -- 172.21.15.7:0/1992622325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f3fef47d40 con 0x55f3fef39970 2024-09-19T08:54:14.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.487+0000 7fd575ffb640 1 -- 172.21.15.7:0/1992622325 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5880ddf00 con 0x55f3fef39970 2024-09-19T08:54:14.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.487+0000 7fd575ffb640 1 -- 172.21.15.7:0/1992622325 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd58001b830 con 0x55f3fef39970 2024-09-19T08:54:14.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.487+0000 7fd59ab81740 10 client.17472 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:14.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.487+0000 7fd59ab81740 10 client.17472 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:54:14.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.487+0000 7fd59ab81740 20 client.17472 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:14.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.487+0000 7fd59ab81740 1 --2- 172.21.15.7:0/1992622325 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f3fef491a0 0x55f3fef4b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:14.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.487+0000 7fd59ab81740 4 client.17472 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:14.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.487+0000 7fd59ab81740 1 -- 172.21.15.7:0/1992622325 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3fee9d860 con 0x55f3fef491a0 2024-09-19T08:54:14.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.487+0000 7fd596544640 1 --2- 172.21.15.7:0/1992622325 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f3fef491a0 0x55f3fef4b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:14.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.488+0000 7fd596544640 1 --2- 172.21.15.7:0/1992622325 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f3fef491a0 0x55f3fef4b600 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9688d46f8844dcaf server_cookie=75acc8ce6eb57824 in_seq=0 out_seq=0 2024-09-19T08:54:14.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.488+0000 7fd575ffb640 10 client.17472 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:54:14.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.488+0000 7fd575ffb640 1 -- 172.21.15.7:0/1992622325 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f3fee9d860 con 0x55f3fef491a0 2024-09-19T08:54:14.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.488+0000 7fd575ffb640 10 client.17472 handle_command_reply: tid=0 2024-09-19T08:54:14.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.488+0000 7fd59ab81740 1 client.17472 shutdown 2024-09-19T08:54:14.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.489+0000 7fd59ab81740 1 -- 172.21.15.7:0/1992622325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef39970 msgr2=0x55f3fef36c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:14.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.489+0000 7fd59ab81740 1 --2- 172.21.15.7:0/1992622325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef39970 0x55f3fef36c00 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fd58000ff60 tx=0x7fd580004ab0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.489+0000 7fd59ab81740 1 -- 172.21.15.7:0/1992622325 shutdown_connections 2024-09-19T08:54:14.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.489+0000 7fd59ab81740 1 --2- 172.21.15.7:0/1992622325 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f3fef491a0 0x55f3fef4b600 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.489+0000 7fd59ab81740 1 --2- 172.21.15.7:0/1992622325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef39970 0x55f3fef36c00 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.489+0000 7fd59ab81740 1 --2- 172.21.15.7:0/1992622325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3fef2dc30 0x55f3fef36610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.489+0000 7fd59ab81740 1 --2- 172.21.15.7:0/1992622325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef2c7e0 0x55f3fef39360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.489+0000 7fd59ab81740 1 -- 172.21.15.7:0/1992622325 >> 172.21.15.7:0/1992622325 conn(0x55f3feef3310 msgr2=0x55f3fef2eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:14.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.489+0000 7fd575ffb640 0 client.17472 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:54:14.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.489+0000 7fd59ab81740 1 -- 172.21.15.7:0/1992622325 shutdown_connections 2024-09-19T08:54:14.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.489+0000 7fd59ab81740 1 -- 172.21.15.7:0/1992622325 wait complete. 2024-09-19T08:54:14.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.489+0000 7fd59ab81740 20 client.17472 trim_cache size 0 max 16384 2024-09-19T08:54:14.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.502+0000 7fd59ab81740 1 Processor -- start 2024-09-19T08:54:14.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.502+0000 7fd59ab81740 1 -- start start 2024-09-19T08:54:14.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.502+0000 7fd59ab81740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef2c7e0 0x55f3fef29020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:14.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.502+0000 7fd59ab81740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef2dc30 0x55f3fef45440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:14.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.502+0000 7fd59ab81740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3fef39970 0x55f3fef26320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:14.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.502+0000 7fd59ab81740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd5901adfc0 con 0x55f3fef2dc30 2024-09-19T08:54:14.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.502+0000 7fd59ab81740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd5901ab890 con 0x55f3fef2c7e0 2024-09-19T08:54:14.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.502+0000 7fd59ab81740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd5901a9700 con 0x55f3fef39970 2024-09-19T08:54:14.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.503+0000 7fd595d43640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef2dc30 0x55f3fef45440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:14.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.503+0000 7fd595d43640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef2dc30 0x55f3fef45440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39770/0 (socket says 172.21.15.7:39770) 2024-09-19T08:54:14.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.503+0000 7fd595d43640 1 -- 172.21.15.7:0/3495728103 learned_addr learned my addr 172.21.15.7:0/3495728103 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:14.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.503+0000 7fd596544640 1 --2- 172.21.15.7:0/3495728103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef2c7e0 0x55f3fef29020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:14.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.503+0000 7fd596d45640 1 --2- 172.21.15.7:0/3495728103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3fef39970 0x55f3fef26320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:14.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.503+0000 7fd595d43640 1 -- 172.21.15.7:0/3495728103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3fef39970 msgr2=0x55f3fef26320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:14.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.503+0000 7fd595d43640 1 --2- 172.21.15.7:0/3495728103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3fef39970 0x55f3fef26320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.503+0000 7fd595d43640 1 -- 172.21.15.7:0/3495728103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef2c7e0 msgr2=0x55f3fef29020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:14.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.503+0000 7fd595d43640 1 --2- 172.21.15.7:0/3495728103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef2c7e0 0x55f3fef29020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.503+0000 7fd595d43640 1 -- 172.21.15.7:0/3495728103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3fef34b60 con 0x55f3fef2dc30 2024-09-19T08:54:14.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.503+0000 7fd596544640 1 --2- 172.21.15.7:0/3495728103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef2c7e0 0x55f3fef29020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:14.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.503+0000 7fd595d43640 1 --2- 172.21.15.7:0/3495728103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef2dc30 0x55f3fef45440 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fd5901072a0 tx=0x7fd584010970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1005e74da73ef92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:14.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.504+0000 7fd577fff640 1 -- 172.21.15.7:0/3495728103 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd584020070 con 0x55f3fef2dc30 2024-09-19T08:54:14.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.504+0000 7fd577fff640 1 -- 172.21.15.7:0/3495728103 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5840042f0 con 0x55f3fef2dc30 2024-09-19T08:54:14.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.504+0000 7fd577fff640 1 -- 172.21.15.7:0/3495728103 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58400fa20 con 0x55f3fef2dc30 2024-09-19T08:54:14.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.504+0000 7fd59ab81740 1 -- 172.21.15.7:0/3495728103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef2dc30 msgr2=0x55f3fef45440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:14.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.504+0000 7fd59ab81740 1 --2- 172.21.15.7:0/3495728103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef2dc30 0x55f3fef45440 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fd5901072a0 tx=0x7fd584010970 comp rx=0 tx=0).stop 2024-09-19T08:54:14.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.504+0000 7fd59ab81740 1 -- 172.21.15.7:0/3495728103 shutdown_connections 2024-09-19T08:54:14.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.504+0000 7fd59ab81740 1 --2- 172.21.15.7:0/3495728103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3fef39970 0x55f3fef26320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.504+0000 7fd59ab81740 1 --2- 172.21.15.7:0/3495728103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef2dc30 0x55f3fef45440 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.504+0000 7fd59ab81740 1 --2- 172.21.15.7:0/3495728103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef2c7e0 0x55f3fef29020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.505+0000 7fd59ab81740 1 -- 172.21.15.7:0/3495728103 >> 172.21.15.7:0/3495728103 conn(0x55f3feef3310 msgr2=0x55f3fef28910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:14.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.505+0000 7fd59ab81740 1 -- 172.21.15.7:0/3495728103 shutdown_connections 2024-09-19T08:54:14.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.505+0000 7fd59ab81740 1 -- 172.21.15.7:0/3495728103 wait complete. 2024-09-19T08:54:14.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.505+0000 7fd59ab81740 1 -- start start 2024-09-19T08:54:14.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.505+0000 7fd59ab81740 1 Processor -- start 2024-09-19T08:54:14.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.505+0000 7fd59ab81740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3fef2c7e0 0x55f3fef50b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:14.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.505+0000 7fd59ab81740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef2dc30 0x55f3fef51070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:14.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.505+0000 7fd59ab81740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef39970 0x55f3fef515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:14.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.505+0000 7fd59ab81740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd5901a9d50 con 0x55f3fef39970 2024-09-19T08:54:14.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.505+0000 7fd59ab81740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd5901ab1c0 con 0x55f3fef2dc30 2024-09-19T08:54:14.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.505+0000 7fd59ab81740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd5901aa420 con 0x55f3fef2c7e0 2024-09-19T08:54:14.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.505+0000 7fd59ab81740 10 client.0 _ll_register_callbacks cb 0x7fd58000fd40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:14.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.505+0000 7fd596d45640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef39970 0x55f3fef515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:14.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.505+0000 7fd596d45640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef39970 0x55f3fef515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39776/0 (socket says 172.21.15.7:39776) 2024-09-19T08:54:14.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.505+0000 7fd596d45640 1 -- 172.21.15.7:0/2758034820 learned_addr learned my addr 172.21.15.7:0/2758034820 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:14.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.505+0000 7fd596544640 1 --2- 172.21.15.7:0/2758034820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3fef2c7e0 0x55f3fef50b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:14.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.506+0000 7fd595d43640 1 --2- 172.21.15.7:0/2758034820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef2dc30 0x55f3fef51070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:14.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.506+0000 7fd596d45640 1 -- 172.21.15.7:0/2758034820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3fef2c7e0 msgr2=0x55f3fef50b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:14.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.506+0000 7fd596d45640 1 --2- 172.21.15.7:0/2758034820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3fef2c7e0 0x55f3fef50b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.506+0000 7fd596d45640 1 -- 172.21.15.7:0/2758034820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef2dc30 msgr2=0x55f3fef51070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:14.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.506+0000 7fd596d45640 1 --2- 172.21.15.7:0/2758034820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef2dc30 0x55f3fef51070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.506+0000 7fd596d45640 1 -- 172.21.15.7:0/2758034820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3fefb2f20 con 0x55f3fef39970 2024-09-19T08:54:14.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.506+0000 7fd595d43640 1 --2- 172.21.15.7:0/2758034820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef2dc30 0x55f3fef51070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:14.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.506+0000 7fd596544640 1 --2- 172.21.15.7:0/2758034820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3fef2c7e0 0x55f3fef50b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:14.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.506+0000 7fd596d45640 1 --2- 172.21.15.7:0/2758034820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef39970 0x55f3fef515b0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fd580005ef0 tx=0x7fd580005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169f274d7b1e5dc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:14.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.506+0000 7fd575ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:14.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.506+0000 7fd575ffb640 1 -- 172.21.15.7:0/2758034820 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58001b860 con 0x55f3fef39970 2024-09-19T08:54:14.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.506+0000 7fd575ffb640 1 -- 172.21.15.7:0/2758034820 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8629+0+0 (secure 0 0 0) 0x7fd58001e420 con 0x55f3fef39970 2024-09-19T08:54:14.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.506+0000 7fd59ab81740 1 -- 172.21.15.7:0/2758034820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5840042f0 con 0x55f3fef39970 2024-09-19T08:54:14.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.506+0000 7fd575ffb640 1 -- 172.21.15.7:0/2758034820 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd580041050 con 0x55f3fef39970 2024-09-19T08:54:14.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.506+0000 7fd59ab81740 10 client.17478 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:14.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.506+0000 7fd59ab81740 1 -- 172.21.15.7:0/2758034820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f3fefb4200 con 0x55f3fef39970 2024-09-19T08:54:14.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.507+0000 7fd575ffb640 1 -- 172.21.15.7:0/2758034820 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5840042f0 con 0x55f3fef39970 2024-09-19T08:54:14.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.507+0000 7fd575ffb640 1 -- 172.21.15.7:0/2758034820 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd580028420 con 0x55f3fef39970 2024-09-19T08:54:14.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.507+0000 7fd59ab81740 10 client.17478 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:14.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.507+0000 7fd59ab81740 10 client.17478 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:54:14.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.507+0000 7fd59ab81740 20 client.17478 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:14.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.507+0000 7fd59ab81740 1 --2- 172.21.15.7:0/2758034820 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f3fefb49a0 0x55f3fefb6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:14.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.507+0000 7fd59ab81740 4 client.17478 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:54:14.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.507+0000 7fd59ab81740 1 -- 172.21.15.7:0/2758034820 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f3fee97d70 con 0x55f3fefb49a0 2024-09-19T08:54:14.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.507+0000 7fd596544640 1 --2- 172.21.15.7:0/2758034820 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f3fefb49a0 0x55f3fefb6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:14.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.508+0000 7fd575ffb640 10 client.17478 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:54:14.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.508+0000 7fd596544640 1 --2- 172.21.15.7:0/2758034820 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f3fefb49a0 0x55f3fefb6dc0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1dff60955a3ecc23 server_cookie=dcb417ae743096d1 in_seq=0 out_seq=0 2024-09-19T08:54:14.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.508+0000 7fd575ffb640 1 -- 172.21.15.7:0/2758034820 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f3fee97d70 con 0x55f3fefb49a0 2024-09-19T08:54:14.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.508+0000 7fd575ffb640 10 client.17478 handle_command_reply: tid=0 2024-09-19T08:54:14.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.508+0000 7fd59ab81740 1 client.17478 shutdown 2024-09-19T08:54:14.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.508+0000 7fd59ab81740 1 -- 172.21.15.7:0/2758034820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef39970 msgr2=0x55f3fef515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:14.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.508+0000 7fd59ab81740 1 --2- 172.21.15.7:0/2758034820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef39970 0x55f3fef515b0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fd580005ef0 tx=0x7fd580005b50 comp rx=0 tx=0).stop 2024-09-19T08:54:14.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.508+0000 7fd59ab81740 1 -- 172.21.15.7:0/2758034820 shutdown_connections 2024-09-19T08:54:14.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.508+0000 7fd59ab81740 1 --2- 172.21.15.7:0/2758034820 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55f3fefb49a0 0x55f3fefb6dc0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.508+0000 7fd59ab81740 1 --2- 172.21.15.7:0/2758034820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f3fef39970 0x55f3fef515b0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.508+0000 7fd59ab81740 1 --2- 172.21.15.7:0/2758034820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3fef2dc30 0x55f3fef51070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.508+0000 7fd59ab81740 1 --2- 172.21.15.7:0/2758034820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3fef2c7e0 0x55f3fef50b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.508+0000 7fd59ab81740 1 -- 172.21.15.7:0/2758034820 >> 172.21.15.7:0/2758034820 conn(0x55f3feef3310 msgr2=0x55f3fef33930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:14.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.508+0000 7fd575ffb640 0 client.17478 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:54:14.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.508+0000 7fd59ab81740 1 -- 172.21.15.7:0/2758034820 shutdown_connections 2024-09-19T08:54:14.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.508+0000 7fd59ab81740 1 -- 172.21.15.7:0/2758034820 wait complete. 2024-09-19T08:54:14.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.508+0000 7fd59ab81740 20 client.17478 trim_cache size 0 max 16384 2024-09-19T08:54:14.525 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:54:14.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.509+0000 7fd5987a8640 1 -- 172.21.15.7:0/1126251480 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd5780a3430 msgr2=0x7fd5780a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:14.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.509+0000 7fd5987a8640 1 --2- 172.21.15.7:0/1126251480 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd5780a3430 0x7fd5780a58f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd58000f7c0 tx=0x7fd580004a40 comp rx=0 tx=0).stop 2024-09-19T08:54:14.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.509+0000 7fd5987a8640 1 -- 172.21.15.7:0/1126251480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd590100e20 msgr2=0x7fd590197360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:14.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.509+0000 7fd5987a8640 1 --2- 172.21.15.7:0/1126251480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd590100e20 0x7fd590197360 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fd588006010 tx=0x7fd588003c10 comp rx=0 tx=0).stop 2024-09-19T08:54:14.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.509+0000 7fd5987a8640 1 -- 172.21.15.7:0/1126251480 shutdown_connections 2024-09-19T08:54:14.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.509+0000 7fd5987a8640 1 --2- 172.21.15.7:0/1126251480 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd5780a3430 0x7fd5780a58f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.509+0000 7fd5987a8640 1 --2- 172.21.15.7:0/1126251480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd590102ef0 0x7fd59019bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.509+0000 7fd5987a8640 1 --2- 172.21.15.7:0/1126251480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd590102570 0x7fd5901978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.509+0000 7fd5987a8640 1 --2- 172.21.15.7:0/1126251480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd590100e20 0x7fd590197360 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:14.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.509+0000 7fd5987a8640 1 -- 172.21.15.7:0/1126251480 >> 172.21.15.7:0/1126251480 conn(0x7fd5900fc7d0 msgr2=0x7fd5900fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:14.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.509+0000 7fd5987a8640 1 -- 172.21.15.7:0/1126251480 shutdown_connections 2024-09-19T08:54:14.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:14.509+0000 7fd5987a8640 1 -- 172.21.15.7:0/1126251480 wait complete. 2024-09-19T08:54:15.296 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:54:15.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:15 smithi007 ceph-mon[31221]: pgmap v301: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:54:15.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:15 smithi175 ceph-mon[35688]: pgmap v301: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:54:15.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:15 smithi044 ceph-mon[35072]: pgmap v301: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:54:15.552 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:16.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.018+0000 7f5335fe3640 1 -- 172.21.15.7:0/2211645215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5330103660 msgr2=0x7f533010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:16.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.018+0000 7f5335fe3640 1 --2- 172.21.15.7:0/2211645215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5330103660 0x7f533010bb50 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f5324009900 tx=0x7f532402a480 comp rx=0 tx=0).stop 2024-09-19T08:54:16.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.019+0000 7f5335fe3640 1 -- 172.21.15.7:0/2211645215 shutdown_connections 2024-09-19T08:54:16.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.019+0000 7f5335fe3640 1 --2- 172.21.15.7:0/2211645215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f533010c170 0x7f533010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.019+0000 7f5335fe3640 1 --2- 172.21.15.7:0/2211645215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5330103660 0x7f533010bb50 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.019+0000 7f5335fe3640 1 --2- 172.21.15.7:0/2211645215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5330102d40 0x7f5330103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.019+0000 7f5335fe3640 1 -- 172.21.15.7:0/2211645215 >> 172.21.15.7:0/2211645215 conn(0x7f53300fc7a0 msgr2=0x7f53300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.019+0000 7f5335fe3640 1 -- 172.21.15.7:0/2211645215 shutdown_connections 2024-09-19T08:54:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.019+0000 7f5335fe3640 1 -- 172.21.15.7:0/2211645215 wait complete. 2024-09-19T08:54:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.019+0000 7f5335fe3640 1 Processor -- start 2024-09-19T08:54:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.019+0000 7f5335fe3640 1 -- start start 2024-09-19T08:54:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.020+0000 7f5335fe3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5330102d40 0x7f53301009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.020+0000 7f5335fe3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5330103660 0x7f5330100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.020+0000 7f5335fe3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f533010c170 0x7f5330101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.020+0000 7f5335fe3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5330111fb0 con 0x7f5330103660 2024-09-19T08:54:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.020+0000 7f5335fe3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5330111e30 con 0x7f5330102d40 2024-09-19T08:54:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.020+0000 7f5335fe3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5330112130 con 0x7f533010c170 2024-09-19T08:54:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.020+0000 7f532effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5330103660 0x7f5330100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.020+0000 7f532effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5330103660 0x7f5330100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39788/0 (socket says 172.21.15.7:39788) 2024-09-19T08:54:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.020+0000 7f532effd640 1 -- 172.21.15.7:0/2087228012 learned_addr learned my addr 172.21.15.7:0/2087228012 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.020+0000 7f532f7fe640 1 --2- 172.21.15.7:0/2087228012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5330102d40 0x7f53301009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.020+0000 7f532ffff640 1 --2- 172.21.15.7:0/2087228012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f533010c170 0x7f5330101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.020+0000 7f532effd640 1 -- 172.21.15.7:0/2087228012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f533010c170 msgr2=0x7f5330101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.020+0000 7f532effd640 1 --2- 172.21.15.7:0/2087228012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f533010c170 0x7f5330101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.020+0000 7f532effd640 1 -- 172.21.15.7:0/2087228012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5330102d40 msgr2=0x7f53301009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.020+0000 7f532effd640 1 --2- 172.21.15.7:0/2087228012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5330102d40 0x7f53301009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.020+0000 7f532effd640 1 -- 172.21.15.7:0/2087228012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53301a6a20 con 0x7f5330103660 2024-09-19T08:54:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.020+0000 7f532effd640 1 --2- 172.21.15.7:0/2087228012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5330103660 0x7f5330100ee0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f5324006010 tx=0x7f53240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.021+0000 7f532cff9640 1 -- 172.21.15.7:0/2087228012 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532403f030 con 0x7f5330103660 2024-09-19T08:54:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.021+0000 7f532cff9640 1 -- 172.21.15.7:0/2087228012 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5324003ce0 con 0x7f5330103660 2024-09-19T08:54:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.021+0000 7f532cff9640 1 -- 172.21.15.7:0/2087228012 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5324035070 con 0x7f5330103660 2024-09-19T08:54:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.021+0000 7f5335fe3640 1 -- 172.21.15.7:0/2087228012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53301a6cb0 con 0x7f5330103660 2024-09-19T08:54:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.021+0000 7f5335fe3640 1 -- 172.21.15.7:0/2087228012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53301a7140 con 0x7f5330103660 2024-09-19T08:54:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.023+0000 7f532cff9640 1 -- 172.21.15.7:0/2087228012 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f5324042030 con 0x7f5330103660 2024-09-19T08:54:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.023+0000 7f53383bc740 1 Processor -- start 2024-09-19T08:54:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.023+0000 7f53383bc740 1 -- start start 2024-09-19T08:54:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.024+0000 7f53383bc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561813f8bb40 0x561813f8a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.024+0000 7f53383bc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f8a5d0 0x561813f8aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.024+0000 7f53383bc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f95370 0x561813f97760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.024+0000 7f53383bc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561813ef02f0 con 0x561813f95370 2024-09-19T08:54:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.024+0000 7f53383bc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561813e97cf0 con 0x561813f8bb40 2024-09-19T08:54:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.024+0000 7f53383bc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561813eec2b0 con 0x561813f8a5d0 2024-09-19T08:54:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.024+0000 7f532effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f95370 0x561813f97760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.024+0000 7f532f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f8a5d0 0x561813f8aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.024+0000 7f532effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f95370 0x561813f97760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39800/0 (socket says 172.21.15.7:39800) 2024-09-19T08:54:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.024+0000 7f532f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f8a5d0 0x561813f8aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.7:52558/0 (socket says 172.21.15.7:52558) 2024-09-19T08:54:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.024+0000 7f532effd640 1 -- 172.21.15.7:0/738469746 learned_addr learned my addr 172.21.15.7:0/738469746 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.024+0000 7f532cff9640 1 --2- 172.21.15.7:0/2087228012 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f53180a33b0 0x7f53180a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.024+0000 7f532ffff640 1 --2- 172.21.15.7:0/738469746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561813f8bb40 0x561813f8a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.024+0000 7f532ffff640 1 --2- 172.21.15.7:0/2087228012 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f53180a33b0 0x7f53180a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.024+0000 7f532cff9640 1 -- 172.21.15.7:0/2087228012 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8629+0+0 (secure 0 0 0) 0x7f53240f0520 con 0x7f5330103660 2024-09-19T08:54:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.024+0000 7f532f7fe640 1 -- 172.21.15.7:0/738469746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561813f8bb40 msgr2=0x561813f8a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.024+0000 7f532f7fe640 1 --2- 172.21.15.7:0/738469746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561813f8bb40 0x561813f8a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.024+0000 7f532f7fe640 1 -- 172.21.15.7:0/738469746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f95370 msgr2=0x561813f97760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.024+0000 7f532f7fe640 1 --2- 172.21.15.7:0/738469746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f95370 0x561813f97760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.024+0000 7f532f7fe640 1 -- 172.21.15.7:0/738469746 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561813e7c3a0 con 0x561813f8a5d0 2024-09-19T08:54:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.024+0000 7f532effd640 1 --2- 172.21.15.7:0/738469746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f95370 0x561813f97760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.025+0000 7f532f7fe640 1 --2- 172.21.15.7:0/738469746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f8a5d0 0x561813f8aa10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f53200099a0 tx=0x7f5320009e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1b56375f05789b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.025+0000 7f532ffff640 1 --2- 172.21.15.7:0/2087228012 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f53180a33b0 0x7f53180a5870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5328005c40 tx=0x7f5328004ab0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.025+0000 7f5315ffb640 1 -- 172.21.15.7:0/738469746 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5320017070 con 0x561813f8a5d0 2024-09-19T08:54:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.025+0000 7f5315ffb640 1 -- 172.21.15.7:0/738469746 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5320013470 con 0x561813f8a5d0 2024-09-19T08:54:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.025+0000 7f5315ffb640 1 -- 172.21.15.7:0/738469746 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5320012610 con 0x561813f8a5d0 2024-09-19T08:54:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.025+0000 7f53383bc740 1 -- 172.21.15.7:0/738469746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f8a5d0 msgr2=0x561813f8aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.025+0000 7f53383bc740 1 --2- 172.21.15.7:0/738469746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f8a5d0 0x561813f8aa10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f53200099a0 tx=0x7f5320009e60 comp rx=0 tx=0).stop 2024-09-19T08:54:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.026+0000 7f53383bc740 1 -- 172.21.15.7:0/738469746 shutdown_connections 2024-09-19T08:54:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.026+0000 7f53383bc740 1 --2- 172.21.15.7:0/738469746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f95370 0x561813f97760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.026+0000 7f53383bc740 1 --2- 172.21.15.7:0/738469746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f8a5d0 0x561813f8aa10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.026+0000 7f53383bc740 1 --2- 172.21.15.7:0/738469746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561813f8bb40 0x561813f8a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.026+0000 7f53383bc740 1 -- 172.21.15.7:0/738469746 >> 172.21.15.7:0/738469746 conn(0x561813f53310 msgr2=0x561813f86c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.026+0000 7f53383bc740 1 -- 172.21.15.7:0/738469746 shutdown_connections 2024-09-19T08:54:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.026+0000 7f53383bc740 1 -- 172.21.15.7:0/738469746 wait complete. 2024-09-19T08:54:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.026+0000 7f53383bc740 1 -- start start 2024-09-19T08:54:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.026+0000 7f53383bc740 1 Processor -- start 2024-09-19T08:54:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.026+0000 7f53383bc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561813f8a5d0 0x561813f94ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.026+0000 7f53383bc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f8bb40 0x561813f91f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.026+0000 7f53383bc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f95370 0x561813f924f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.026+0000 7f53383bc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561813f98070 con 0x561813f8bb40 2024-09-19T08:54:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.026+0000 7f53383bc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561813eab060 con 0x561813f8a5d0 2024-09-19T08:54:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.026+0000 7f53383bc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561813f981f0 con 0x561813f95370 2024-09-19T08:54:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.026+0000 7f53383bc740 10 client.0 _ll_register_callbacks cb 0x561813bfe8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.027+0000 7f532ffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f95370 0x561813f924f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.027+0000 7f532ffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f95370 0x561813f924f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.7:52574/0 (socket says 172.21.15.7:52574) 2024-09-19T08:54:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.027+0000 7f532ffff640 1 -- 172.21.15.7:0/1817638131 learned_addr learned my addr 172.21.15.7:0/1817638131 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.027+0000 7f532ffff640 1 -- 172.21.15.7:0/1817638131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561813f8a5d0 msgr2=0x561813f94ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:54:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.027+0000 7f532ffff640 1 --2- 172.21.15.7:0/1817638131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561813f8a5d0 0x561813f94ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.027+0000 7f532ffff640 1 -- 172.21.15.7:0/1817638131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f8bb40 msgr2=0x561813f91f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.027+0000 7f532ffff640 1 --2- 172.21.15.7:0/1817638131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f8bb40 0x561813f91f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.027+0000 7f532ffff640 1 -- 172.21.15.7:0/1817638131 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561813c613c0 con 0x561813f95370 2024-09-19T08:54:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.028+0000 7f532ffff640 1 --2- 172.21.15.7:0/1817638131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f95370 0x561813f924f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5328009d60 tx=0x7f5328004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59871e9e05bb161a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.028+0000 7f530effd640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-09-19T08:54:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.028+0000 7f530effd640 1 -- 172.21.15.7:0/1817638131 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5328027070 con 0x561813f95370 2024-09-19T08:54:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.028+0000 7f53383bc740 1 -- 172.21.15.7:0/1817638131 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5320013470 con 0x561813f95370 2024-09-19T08:54:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.028+0000 7f530effd640 1 -- 172.21.15.7:0/1817638131 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8629+0+0 (secure 0 0 0) 0x7f5328010da0 con 0x561813f95370 2024-09-19T08:54:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.028+0000 7f530effd640 1 -- 172.21.15.7:0/1817638131 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5328004b20 con 0x561813f95370 2024-09-19T08:54:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.028+0000 7f53383bc740 10 client.26638 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.028+0000 7f53383bc740 1 -- 172.21.15.7:0/1817638131 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561813fa3ad0 con 0x561813f95370 2024-09-19T08:54:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.029+0000 7f530effd640 1 -- 172.21.15.7:0/1817638131 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5320013470 con 0x561813f95370 2024-09-19T08:54:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.029+0000 7f530effd640 1 -- 172.21.15.7:0/1817638131 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f532800f070 con 0x561813f95370 2024-09-19T08:54:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.029+0000 7f53383bc740 10 client.26638 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.029+0000 7f53383bc740 10 client.26638 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.029+0000 7f53383bc740 20 client.26638 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.029+0000 7f53383bc740 1 --2- 172.21.15.7:0/1817638131 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561813fa4ee0 0x561813fa73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.029+0000 7f53383bc740 4 client.26638 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.029+0000 7f53383bc740 1 -- 172.21.15.7:0/1817638131 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561813efd860 con 0x561813fa4ee0 2024-09-19T08:54:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.029+0000 7f532f7fe640 1 --2- 172.21.15.7:0/1817638131 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561813fa4ee0 0x561813fa73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.029+0000 7f532f7fe640 1 --2- 172.21.15.7:0/1817638131 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561813fa4ee0 0x561813fa73a0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b7ec58d71bd3351 server_cookie=c4dd835fc2453287 in_seq=0 out_seq=0 2024-09-19T08:54:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.029+0000 7f530effd640 10 client.26638 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.030+0000 7f530effd640 1 -- 172.21.15.7:0/1817638131 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561813efd860 con 0x561813fa4ee0 2024-09-19T08:54:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.030+0000 7f530effd640 10 client.26638 handle_command_reply: tid=0 2024-09-19T08:54:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.030+0000 7f53383bc740 1 client.26638 shutdown 2024-09-19T08:54:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.030+0000 7f53383bc740 1 -- 172.21.15.7:0/1817638131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f95370 msgr2=0x561813f924f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.030+0000 7f53383bc740 1 --2- 172.21.15.7:0/1817638131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f95370 0x561813f924f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5328009d60 tx=0x7f5328004a40 comp rx=0 tx=0).stop 2024-09-19T08:54:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.030+0000 7f53383bc740 1 -- 172.21.15.7:0/1817638131 shutdown_connections 2024-09-19T08:54:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.030+0000 7f53383bc740 1 --2- 172.21.15.7:0/1817638131 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561813fa4ee0 0x561813fa73a0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.030+0000 7f53383bc740 1 --2- 172.21.15.7:0/1817638131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f95370 0x561813f924f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.030+0000 7f53383bc740 1 --2- 172.21.15.7:0/1817638131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f8bb40 0x561813f91f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.030+0000 7f530effd640 0 client.26638 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.030+0000 7f53383bc740 1 --2- 172.21.15.7:0/1817638131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561813f8a5d0 0x561813f94ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.030+0000 7f53383bc740 1 -- 172.21.15.7:0/1817638131 >> 172.21.15.7:0/1817638131 conn(0x561813f53310 msgr2=0x561813f8c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.031+0000 7f53383bc740 1 -- 172.21.15.7:0/1817638131 shutdown_connections 2024-09-19T08:54:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.031+0000 7f53383bc740 1 -- 172.21.15.7:0/1817638131 wait complete. 2024-09-19T08:54:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.031+0000 7f53383bc740 20 client.26638 trim_cache size 0 max 16384 2024-09-19T08:54:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.044+0000 7f53383bc740 1 Processor -- start 2024-09-19T08:54:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.044+0000 7f53383bc740 1 -- start start 2024-09-19T08:54:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.044+0000 7f53383bc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f8a5d0 0x561813f93f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.044+0000 7f53383bc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f8bb40 0x561813f8d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.044+0000 7f53383bc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561813f95370 0x561813f8d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.044+0000 7f53383bc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f53301b24d0 con 0x561813f8a5d0 2024-09-19T08:54:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.044+0000 7f53383bc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f53301afda0 con 0x561813f95370 2024-09-19T08:54:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.044+0000 7f53383bc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f53301adc10 con 0x561813f8bb40 2024-09-19T08:54:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.044+0000 7f532f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f8a5d0 0x561813f93f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.044+0000 7f532f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f8a5d0 0x561813f93f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39822/0 (socket says 172.21.15.7:39822) 2024-09-19T08:54:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.044+0000 7f532f7fe640 1 -- 172.21.15.7:0/2814129489 learned_addr learned my addr 172.21.15.7:0/2814129489 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.044+0000 7f532effd640 1 --2- 172.21.15.7:0/2814129489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f8bb40 0x561813f8d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.044+0000 7f532ffff640 1 --2- 172.21.15.7:0/2814129489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561813f95370 0x561813f8d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.044+0000 7f532f7fe640 1 -- 172.21.15.7:0/2814129489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f8bb40 msgr2=0x561813f8d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.044+0000 7f532f7fe640 1 --2- 172.21.15.7:0/2814129489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f8bb40 0x561813f8d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.044+0000 7f532f7fe640 1 -- 172.21.15.7:0/2814129489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561813f95370 msgr2=0x561813f8d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.044+0000 7f532f7fe640 1 --2- 172.21.15.7:0/2814129489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561813f95370 0x561813f8d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.044+0000 7f532f7fe640 1 -- 172.21.15.7:0/2814129489 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561813f8dba0 con 0x561813f8a5d0 2024-09-19T08:54:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.044+0000 7f532f7fe640 1 --2- 172.21.15.7:0/2814129489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f8a5d0 0x561813f93f00 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f53200099a0 tx=0x7f5320008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a93d643d594625 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.045+0000 7f53157fa640 1 -- 172.21.15.7:0/2814129489 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532002a070 con 0x561813f8a5d0 2024-09-19T08:54:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.045+0000 7f53157fa640 1 -- 172.21.15.7:0/2814129489 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5320013be0 con 0x561813f8a5d0 2024-09-19T08:54:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.045+0000 7f53157fa640 1 -- 172.21.15.7:0/2814129489 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5320017040 con 0x561813f8a5d0 2024-09-19T08:54:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.045+0000 7f53383bc740 1 -- 172.21.15.7:0/2814129489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f8a5d0 msgr2=0x561813f93f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.045+0000 7f53383bc740 1 --2- 172.21.15.7:0/2814129489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f8a5d0 0x561813f93f00 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f53200099a0 tx=0x7f5320008040 comp rx=0 tx=0).stop 2024-09-19T08:54:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.045+0000 7f53383bc740 1 -- 172.21.15.7:0/2814129489 shutdown_connections 2024-09-19T08:54:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.045+0000 7f53383bc740 1 --2- 172.21.15.7:0/2814129489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561813f95370 0x561813f8d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.045+0000 7f53383bc740 1 --2- 172.21.15.7:0/2814129489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f8bb40 0x561813f8d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.045+0000 7f53383bc740 1 --2- 172.21.15.7:0/2814129489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f8a5d0 0x561813f93f00 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.045+0000 7f53383bc740 1 -- 172.21.15.7:0/2814129489 >> 172.21.15.7:0/2814129489 conn(0x561813f53310 msgr2=0x561813f937f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:16.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.045+0000 7f53383bc740 1 -- 172.21.15.7:0/2814129489 shutdown_connections 2024-09-19T08:54:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.045+0000 7f53383bc740 1 -- 172.21.15.7:0/2814129489 wait complete. 2024-09-19T08:54:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.046+0000 7f53383bc740 1 -- start start 2024-09-19T08:54:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.046+0000 7f53383bc740 1 Processor -- start 2024-09-19T08:54:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.046+0000 7f53383bc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561813f8a5d0 0x561813f9dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.046+0000 7f53383bc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f8bb40 0x561813f8ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.046+0000 7f53383bc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f95370 0x561813f8f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.046+0000 7f53383bc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f53301ae260 con 0x561813f95370 2024-09-19T08:54:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.046+0000 7f53383bc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f53301af6d0 con 0x561813f8a5d0 2024-09-19T08:54:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.046+0000 7f53383bc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f53301ae930 con 0x561813f8bb40 2024-09-19T08:54:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.046+0000 7f532ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f95370 0x561813f8f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.046+0000 7f53383bc740 10 client.0 _ll_register_callbacks cb 0x7f5328009c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.046+0000 7f532ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f95370 0x561813f8f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39828/0 (socket says 172.21.15.7:39828) 2024-09-19T08:54:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.046+0000 7f532f7fe640 1 --2- 172.21.15.7:0/4177182038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561813f8a5d0 0x561813f9dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.046+0000 7f532ffff640 1 -- 172.21.15.7:0/4177182038 learned_addr learned my addr 172.21.15.7:0/4177182038 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.046+0000 7f532effd640 1 --2- 172.21.15.7:0/4177182038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f8bb40 0x561813f8ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.047+0000 7f532ffff640 1 -- 172.21.15.7:0/4177182038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f8bb40 msgr2=0x561813f8ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.047+0000 7f532ffff640 1 --2- 172.21.15.7:0/4177182038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f8bb40 0x561813f8ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.047+0000 7f532ffff640 1 -- 172.21.15.7:0/4177182038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561813f8a5d0 msgr2=0x561813f9dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.047+0000 7f532ffff640 1 --2- 172.21.15.7:0/4177182038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561813f8a5d0 0x561813f9dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.047+0000 7f532ffff640 1 -- 172.21.15.7:0/4177182038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561813f8fb40 con 0x561813f95370 2024-09-19T08:54:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.047+0000 7f532f7fe640 1 --2- 172.21.15.7:0/4177182038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561813f8a5d0 0x561813f9dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.047+0000 7f532ffff640 1 --2- 172.21.15.7:0/4177182038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f95370 0x561813f8f310 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f5328005c10 tx=0x7f5328020860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cfe870a00af830f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.047+0000 7f530effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.047+0000 7f530effd640 1 -- 172.21.15.7:0/4177182038 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5328027040 con 0x561813f95370 2024-09-19T08:54:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.047+0000 7f530effd640 1 -- 172.21.15.7:0/4177182038 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8629+0+0 (secure 0 0 0) 0x7f5328037440 con 0x561813f95370 2024-09-19T08:54:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.047+0000 7f53383bc740 1 -- 172.21.15.7:0/4177182038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5320013be0 con 0x561813f95370 2024-09-19T08:54:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.047+0000 7f530effd640 1 -- 172.21.15.7:0/4177182038 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5328044050 con 0x561813f95370 2024-09-19T08:54:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.047+0000 7f53383bc740 10 client.17493 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.047+0000 7f53383bc740 1 -- 172.21.15.7:0/4177182038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561814018520 con 0x561813f95370 2024-09-19T08:54:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.047+0000 7f530effd640 1 -- 172.21.15.7:0/4177182038 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5320013be0 con 0x561813f95370 2024-09-19T08:54:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.048+0000 7f530effd640 1 -- 172.21.15.7:0/4177182038 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f532803f030 con 0x561813f95370 2024-09-19T08:54:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.048+0000 7f53383bc740 10 client.17493 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.048+0000 7f53383bc740 10 client.17493 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.048+0000 7f53383bc740 20 client.17493 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.048+0000 7f53383bc740 1 --2- 172.21.15.7:0/4177182038 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561814018c60 0x56181401b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.048+0000 7f53383bc740 4 client.17493 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:54:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.048+0000 7f53383bc740 1 -- 172.21.15.7:0/4177182038 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561813ef7d70 con 0x561814018c60 2024-09-19T08:54:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.048+0000 7f532f7fe640 1 --2- 172.21.15.7:0/4177182038 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561814018c60 0x56181401b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.048+0000 7f532f7fe640 1 --2- 172.21.15.7:0/4177182038 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561814018c60 0x56181401b080 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e240ff3829672867 server_cookie=ef020a46a1dcd32d in_seq=0 out_seq=0 2024-09-19T08:54:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.048+0000 7f530effd640 10 client.17493 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.048+0000 7f530effd640 1 -- 172.21.15.7:0/4177182038 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561813ef7d70 con 0x561814018c60 2024-09-19T08:54:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.048+0000 7f530effd640 10 client.17493 handle_command_reply: tid=0 2024-09-19T08:54:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.048+0000 7f53383bc740 1 client.17493 shutdown 2024-09-19T08:54:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.049+0000 7f53383bc740 1 -- 172.21.15.7:0/4177182038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f95370 msgr2=0x561813f8f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.049+0000 7f53383bc740 1 --2- 172.21.15.7:0/4177182038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f95370 0x561813f8f310 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f5328005c10 tx=0x7f5328020860 comp rx=0 tx=0).stop 2024-09-19T08:54:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.049+0000 7f53383bc740 1 -- 172.21.15.7:0/4177182038 shutdown_connections 2024-09-19T08:54:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.049+0000 7f53383bc740 1 --2- 172.21.15.7:0/4177182038 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x561814018c60 0x56181401b080 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.049+0000 7f53383bc740 1 --2- 172.21.15.7:0/4177182038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561813f95370 0x561813f8f310 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.049+0000 7f53383bc740 1 --2- 172.21.15.7:0/4177182038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561813f8bb40 0x561813f8ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.049+0000 7f53383bc740 1 --2- 172.21.15.7:0/4177182038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561813f8a5d0 0x561813f9dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.049+0000 7f530effd640 0 client.17493 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.049+0000 7f53383bc740 1 -- 172.21.15.7:0/4177182038 >> 172.21.15.7:0/4177182038 conn(0x561813f53310 msgr2=0x561813f94010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.049+0000 7f53383bc740 1 -- 172.21.15.7:0/4177182038 shutdown_connections 2024-09-19T08:54:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.049+0000 7f53383bc740 1 -- 172.21.15.7:0/4177182038 wait complete. 2024-09-19T08:54:16.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.049+0000 7f53383bc740 20 client.17493 trim_cache size 0 max 16384 2024-09-19T08:54:16.055 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:54:16.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.049+0000 7f5335fe3640 1 -- 172.21.15.7:0/2087228012 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f53180a33b0 msgr2=0x7f53180a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:16.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.049+0000 7f5335fe3640 1 --2- 172.21.15.7:0/2087228012 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f53180a33b0 0x7f53180a5870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5328005c40 tx=0x7f5328004ab0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.049+0000 7f5335fe3640 1 -- 172.21.15.7:0/2087228012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5330103660 msgr2=0x7f5330100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:16.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.049+0000 7f5335fe3640 1 --2- 172.21.15.7:0/2087228012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5330103660 0x7f5330100ee0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f5324006010 tx=0x7f53240042f0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.049+0000 7f5335fe3640 1 -- 172.21.15.7:0/2087228012 shutdown_connections 2024-09-19T08:54:16.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.049+0000 7f5335fe3640 1 --2- 172.21.15.7:0/2087228012 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f53180a33b0 0x7f53180a5870 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.049+0000 7f5335fe3640 1 --2- 172.21.15.7:0/2087228012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f533010c170 0x7f5330101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.049+0000 7f5335fe3640 1 --2- 172.21.15.7:0/2087228012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5330103660 0x7f5330100ee0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.049+0000 7f5335fe3640 1 --2- 172.21.15.7:0/2087228012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5330102d40 0x7f53301009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.049+0000 7f5335fe3640 1 -- 172.21.15.7:0/2087228012 >> 172.21.15.7:0/2087228012 conn(0x7f53300fc7a0 msgr2=0x7f53300fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:16.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.050+0000 7f5335fe3640 1 -- 172.21.15.7:0/2087228012 shutdown_connections 2024-09-19T08:54:16.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:16.050+0000 7f5335fe3640 1 -- 172.21.15.7:0/2087228012 wait complete. 2024-09-19T08:54:17.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:17 smithi175 ceph-mon[35688]: pgmap v302: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:54:17.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:17 smithi007 ceph-mon[31221]: pgmap v302: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:54:17.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:17 smithi044 ceph-mon[35072]: pgmap v302: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:54:17.720 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:54:17.721 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:54:17.989 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:18.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.514+0000 7fe27788b640 1 -- 172.21.15.7:0/2270568269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2701002f0 msgr2=0x7fe2701006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:18.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.514+0000 7fe27788b640 1 --2- 172.21.15.7:0/2270568269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2701002f0 0x7fe2701006d0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fe268009930 tx=0x7fe26802a420 comp rx=0 tx=0).stop 2024-09-19T08:54:18.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.514+0000 7fe27788b640 1 -- 172.21.15.7:0/2270568269 shutdown_connections 2024-09-19T08:54:18.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.514+0000 7fe27788b640 1 --2- 172.21.15.7:0/2270568269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe270106f50 0x7fe27010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.514+0000 7fe27788b640 1 --2- 172.21.15.7:0/2270568269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe270100ca0 0x7fe270106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.514+0000 7fe27788b640 1 --2- 172.21.15.7:0/2270568269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2701002f0 0x7fe2701006d0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.514+0000 7fe27788b640 1 -- 172.21.15.7:0/2270568269 >> 172.21.15.7:0/2270568269 conn(0x7fe270077210 msgr2=0x7fe2700fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:18.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.514+0000 7fe27788b640 1 -- 172.21.15.7:0/2270568269 shutdown_connections 2024-09-19T08:54:18.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.514+0000 7fe27788b640 1 -- 172.21.15.7:0/2270568269 wait complete. 2024-09-19T08:54:18.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.515+0000 7fe27788b640 1 Processor -- start 2024-09-19T08:54:18.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.515+0000 7fe27788b640 1 -- start start 2024-09-19T08:54:18.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.515+0000 7fe27788b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2701002f0 0x7fe270198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:18.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.515+0000 7fe27788b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe270100ca0 0x7fe270198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:18.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.515+0000 7fe27788b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe270106f50 0x7fe27019ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:18.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.515+0000 7fe27788b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe270111fa0 con 0x7fe270100ca0 2024-09-19T08:54:18.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.515+0000 7fe27788b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe270111e20 con 0x7fe2701002f0 2024-09-19T08:54:18.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.515+0000 7fe27788b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe270112120 con 0x7fe270106f50 2024-09-19T08:54:18.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.515+0000 7fe274e26640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe270100ca0 0x7fe270198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:18.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.515+0000 7fe274e26640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe270100ca0 0x7fe270198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39840/0 (socket says 172.21.15.7:39840) 2024-09-19T08:54:18.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.515+0000 7fe274e26640 1 -- 172.21.15.7:0/374363579 learned_addr learned my addr 172.21.15.7:0/374363579 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:18.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.515+0000 7fe275627640 1 --2- 172.21.15.7:0/374363579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2701002f0 0x7fe270198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:18.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.515+0000 7fe275e28640 1 --2- 172.21.15.7:0/374363579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe270106f50 0x7fe27019ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:18.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.515+0000 7fe274e26640 1 -- 172.21.15.7:0/374363579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe270106f50 msgr2=0x7fe27019ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:18.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.515+0000 7fe274e26640 1 --2- 172.21.15.7:0/374363579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe270106f50 0x7fe27019ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.515+0000 7fe274e26640 1 -- 172.21.15.7:0/374363579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2701002f0 msgr2=0x7fe270198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:18.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.515+0000 7fe274e26640 1 --2- 172.21.15.7:0/374363579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2701002f0 0x7fe270198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.515+0000 7fe274e26640 1 -- 172.21.15.7:0/374363579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe27019d510 con 0x7fe270100ca0 2024-09-19T08:54:18.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.515+0000 7fe275e28640 1 --2- 172.21.15.7:0/374363579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe270106f50 0x7fe27019ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:18.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.516+0000 7fe274e26640 1 --2- 172.21.15.7:0/374363579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe270100ca0 0x7fe270198aa0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fe264005fd0 tx=0x7fe26400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:18.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.516+0000 7fe26e7fc640 1 -- 172.21.15.7:0/374363579 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe264017070 con 0x7fe270100ca0 2024-09-19T08:54:18.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.516+0000 7fe26e7fc640 1 -- 172.21.15.7:0/374363579 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe264009c30 con 0x7fe270100ca0 2024-09-19T08:54:18.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.516+0000 7fe27788b640 1 -- 172.21.15.7:0/374363579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe27019d800 con 0x7fe270100ca0 2024-09-19T08:54:18.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.516+0000 7fe26e7fc640 1 -- 172.21.15.7:0/374363579 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe264010460 con 0x7fe270100ca0 2024-09-19T08:54:18.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.516+0000 7fe27788b640 1 -- 172.21.15.7:0/374363579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2701a50e0 con 0x7fe270100ca0 2024-09-19T08:54:18.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.518+0000 7fe26e7fc640 1 -- 172.21.15.7:0/374363579 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fe264003e70 con 0x7fe270100ca0 2024-09-19T08:54:18.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.519+0000 7fe279c64740 1 Processor -- start 2024-09-19T08:54:18.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.519+0000 7fe279c64740 1 -- start start 2024-09-19T08:54:18.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.519+0000 7fe279c64740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc93b60 0x55691fc93f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:18.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.519+0000 7fe279c64740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55691fc94480 0x55691fc9e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:18.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.519+0000 7fe279c64740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc9ed40 0x55691fca1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:18.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.519+0000 7fe279c64740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55691fbf9280 con 0x55691fc9ed40 2024-09-19T08:54:18.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.519+0000 7fe279c64740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55691fba0b10 con 0x55691fc93b60 2024-09-19T08:54:18.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.519+0000 7fe279c64740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55691fbf5240 con 0x55691fc94480 2024-09-19T08:54:18.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.519+0000 7fe26e7fc640 1 --2- 172.21.15.7:0/374363579 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe2580a3430 0x7fe2580a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:18.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.519+0000 7fe274e26640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc9ed40 0x55691fca1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:18.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.519+0000 7fe274e26640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc9ed40 0x55691fca1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39848/0 (socket says 172.21.15.7:39848) 2024-09-19T08:54:18.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.519+0000 7fe274e26640 1 -- 172.21.15.7:0/4284404115 learned_addr learned my addr 172.21.15.7:0/4284404115 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:18.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.519+0000 7fe275627640 1 --2- 172.21.15.7:0/4284404115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55691fc94480 0x55691fc9e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:18.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.520+0000 7fe275e28640 1 --2- 172.21.15.7:0/4284404115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc93b60 0x55691fc93f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:18.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.520+0000 7fe275e28640 1 --2- 172.21.15.7:0/374363579 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe2580a3430 0x7fe2580a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:18.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.520+0000 7fe26e7fc640 1 -- 172.21.15.7:0/374363579 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7fe2640cf980 con 0x7fe270100ca0 2024-09-19T08:54:18.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.520+0000 7fe274e26640 1 -- 172.21.15.7:0/4284404115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55691fc94480 msgr2=0x55691fc9e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:18.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.520+0000 7fe274e26640 1 --2- 172.21.15.7:0/4284404115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55691fc94480 0x55691fc9e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.520+0000 7fe274e26640 1 -- 172.21.15.7:0/4284404115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc93b60 msgr2=0x55691fc93f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:18.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.520+0000 7fe274e26640 1 --2- 172.21.15.7:0/4284404115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc93b60 0x55691fc93f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.520+0000 7fe274e26640 1 -- 172.21.15.7:0/4284404115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55691fbad1f0 con 0x55691fc9ed40 2024-09-19T08:54:18.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.520+0000 7fe275e28640 1 --2- 172.21.15.7:0/4284404115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc93b60 0x55691fc93f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:18.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.520+0000 7fe274e26640 1 --2- 172.21.15.7:0/4284404115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc9ed40 0x55691fca1130 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fe264063fe0 tx=0x7fe26409b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1541a856be1f859b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:18.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.520+0000 7fe275e28640 1 --2- 172.21.15.7:0/374363579 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe2580a3430 0x7fe2580a58f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe260005c40 tx=0x7fe260009200 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:18.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.520+0000 7fe2577fe640 1 -- 172.21.15.7:0/4284404115 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26409ffd0 con 0x55691fc9ed40 2024-09-19T08:54:18.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.520+0000 7fe2577fe640 1 -- 172.21.15.7:0/4284404115 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2640a4890 con 0x55691fc9ed40 2024-09-19T08:54:18.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.520+0000 7fe2577fe640 1 -- 172.21.15.7:0/4284404115 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2640a4400 con 0x55691fc9ed40 2024-09-19T08:54:18.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.521+0000 7fe279c64740 1 -- 172.21.15.7:0/4284404115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc9ed40 msgr2=0x55691fca1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:18.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.521+0000 7fe279c64740 1 --2- 172.21.15.7:0/4284404115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc9ed40 0x55691fca1130 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fe264063fe0 tx=0x7fe26409b7e0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.521+0000 7fe279c64740 1 -- 172.21.15.7:0/4284404115 shutdown_connections 2024-09-19T08:54:18.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.521+0000 7fe279c64740 1 --2- 172.21.15.7:0/4284404115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc9ed40 0x55691fca1130 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.521+0000 7fe279c64740 1 --2- 172.21.15.7:0/4284404115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55691fc94480 0x55691fc9e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.521+0000 7fe279c64740 1 --2- 172.21.15.7:0/4284404115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc93b60 0x55691fc93f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.521+0000 7fe279c64740 1 -- 172.21.15.7:0/4284404115 >> 172.21.15.7:0/4284404115 conn(0x55691fc900f0 msgr2=0x55691fc904d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:18.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.521+0000 7fe279c64740 1 -- 172.21.15.7:0/4284404115 shutdown_connections 2024-09-19T08:54:18.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.521+0000 7fe279c64740 1 -- 172.21.15.7:0/4284404115 wait complete. 2024-09-19T08:54:18.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.521+0000 7fe279c64740 1 -- start start 2024-09-19T08:54:18.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.522+0000 7fe279c64740 1 Processor -- start 2024-09-19T08:54:18.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.522+0000 7fe279c64740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55691fc93b60 0x55691fc9bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:18.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.522+0000 7fe279c64740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc94480 0x55691fc9c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:18.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.522+0000 7fe279c64740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc9ed40 0x55691fc9c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:18.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.522+0000 7fe279c64740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55691fca1910 con 0x55691fc9ed40 2024-09-19T08:54:18.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.522+0000 7fe279c64740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55691fbb3f10 con 0x55691fc94480 2024-09-19T08:54:18.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.522+0000 7fe279c64740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55691fca1a90 con 0x55691fc93b60 2024-09-19T08:54:18.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.522+0000 7fe279c64740 10 client.0 _ll_register_callbacks cb 0x55691fb7ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:18.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.522+0000 7fe275e28640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc9ed40 0x55691fc9c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:18.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.522+0000 7fe274e26640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc94480 0x55691fc9c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:18.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.522+0000 7fe275627640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55691fc93b60 0x55691fc9bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:18.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.522+0000 7fe275627640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55691fc93b60 0x55691fc9bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.7:52628/0 (socket says 172.21.15.7:52628) 2024-09-19T08:54:18.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.522+0000 7fe275e28640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc9ed40 0x55691fc9c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39864/0 (socket says 172.21.15.7:39864) 2024-09-19T08:54:18.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.522+0000 7fe275627640 1 -- 172.21.15.7:0/991031975 learned_addr learned my addr 172.21.15.7:0/991031975 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:18.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.522+0000 7fe274e26640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc94480 0x55691fc9c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:38994/0 (socket says 172.21.15.7:38994) 2024-09-19T08:54:18.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.523+0000 7fe275e28640 1 -- 172.21.15.7:0/991031975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55691fc93b60 msgr2=0x55691fc9bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:18.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.523+0000 7fe275e28640 1 --2- 172.21.15.7:0/991031975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55691fc93b60 0x55691fc9bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.523+0000 7fe275e28640 1 -- 172.21.15.7:0/991031975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc94480 msgr2=0x55691fc9c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:18.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.523+0000 7fe275e28640 1 --2- 172.21.15.7:0/991031975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc94480 0x55691fc9c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.523+0000 7fe275e28640 1 -- 172.21.15.7:0/991031975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55691f96a6a0 con 0x55691fc9ed40 2024-09-19T08:54:18.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.523+0000 7fe274e26640 1 --2- 172.21.15.7:0/991031975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc94480 0x55691fc9c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:18.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.523+0000 7fe275e28640 1 --2- 172.21.15.7:0/991031975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc9ed40 0x55691fc9c6c0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fe260011f00 tx=0x7fe260004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432094f093a36a79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:18.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.523+0000 7fe254ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:18.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.523+0000 7fe254ff9640 1 -- 172.21.15.7:0/991031975 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe260025070 con 0x55691fc9ed40 2024-09-19T08:54:18.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.523+0000 7fe254ff9640 1 -- 172.21.15.7:0/991031975 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7fe260004d20 con 0x55691fc9ed40 2024-09-19T08:54:18.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.523+0000 7fe279c64740 1 -- 172.21.15.7:0/991031975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2640a4890 con 0x55691fc9ed40 2024-09-19T08:54:18.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.523+0000 7fe254ff9640 1 -- 172.21.15.7:0/991031975 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe260030050 con 0x55691fc9ed40 2024-09-19T08:54:18.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.523+0000 7fe279c64740 10 client.17505 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:18.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.523+0000 7fe279c64740 1 -- 172.21.15.7:0/991031975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55691fcb19b0 con 0x55691fc9ed40 2024-09-19T08:54:18.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.523+0000 7fe254ff9640 1 -- 172.21.15.7:0/991031975 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2640a4890 con 0x55691fc9ed40 2024-09-19T08:54:18.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.523+0000 7fe254ff9640 1 -- 172.21.15.7:0/991031975 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe260005620 con 0x55691fc9ed40 2024-09-19T08:54:18.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.524+0000 7fe279c64740 10 client.17505 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:18.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.524+0000 7fe279c64740 10 client.17505 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:18.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.524+0000 7fe279c64740 20 client.17505 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:18.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.524+0000 7fe279c64740 1 --2- 172.21.15.7:0/991031975 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55691fcb2eb0 0x55691fcb52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:18.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.524+0000 7fe279c64740 4 client.17505 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:18.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.524+0000 7fe279c64740 1 -- 172.21.15.7:0/991031975 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55691fc067f0 con 0x55691fcb2eb0 2024-09-19T08:54:18.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.524+0000 7fe275627640 1 --2- 172.21.15.7:0/991031975 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55691fcb2eb0 0x55691fcb52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:18.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.524+0000 7fe275627640 1 --2- 172.21.15.7:0/991031975 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55691fcb2eb0 0x55691fcb52f0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=401fe7b55ccbe1b1 server_cookie=c89249cad60f5242 in_seq=0 out_seq=0 2024-09-19T08:54:18.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.524+0000 7fe254ff9640 10 client.17505 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:18.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.525+0000 7fe254ff9640 1 -- 172.21.15.7:0/991031975 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55691fc067f0 con 0x55691fcb2eb0 2024-09-19T08:54:18.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.525+0000 7fe254ff9640 10 client.17505 handle_command_reply: tid=0 2024-09-19T08:54:18.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.525+0000 7fe279c64740 1 client.17505 shutdown 2024-09-19T08:54:18.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.525+0000 7fe279c64740 1 -- 172.21.15.7:0/991031975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc9ed40 msgr2=0x55691fc9c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:18.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.525+0000 7fe279c64740 1 --2- 172.21.15.7:0/991031975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc9ed40 0x55691fc9c6c0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fe260011f00 tx=0x7fe260004a40 comp rx=0 tx=0).stop 2024-09-19T08:54:18.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.525+0000 7fe279c64740 1 -- 172.21.15.7:0/991031975 shutdown_connections 2024-09-19T08:54:18.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.525+0000 7fe279c64740 1 --2- 172.21.15.7:0/991031975 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55691fcb2eb0 0x55691fcb52f0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.525+0000 7fe279c64740 1 --2- 172.21.15.7:0/991031975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc9ed40 0x55691fc9c6c0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.525+0000 7fe254ff9640 0 client.17505 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:18.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.525+0000 7fe279c64740 1 --2- 172.21.15.7:0/991031975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc94480 0x55691fc9c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.525+0000 7fe279c64740 1 --2- 172.21.15.7:0/991031975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55691fc93b60 0x55691fc9bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.525+0000 7fe279c64740 1 -- 172.21.15.7:0/991031975 >> 172.21.15.7:0/991031975 conn(0x55691fc900f0 msgr2=0x55691fc95dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:18.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.526+0000 7fe279c64740 1 -- 172.21.15.7:0/991031975 shutdown_connections 2024-09-19T08:54:18.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.526+0000 7fe279c64740 1 -- 172.21.15.7:0/991031975 wait complete. 2024-09-19T08:54:18.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.526+0000 7fe279c64740 20 client.17505 trim_cache size 0 max 16384 2024-09-19T08:54:18.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.543+0000 7fe279c64740 1 Processor -- start 2024-09-19T08:54:18.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.543+0000 7fe279c64740 1 -- start start 2024-09-19T08:54:18.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.543+0000 7fe279c64740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55691fc93b60 0x55691fc9daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:18.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.543+0000 7fe279c64740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc94480 0x55691fcbabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:18.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.543+0000 7fe279c64740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc9ed40 0x55691fcbb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:18.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.543+0000 7fe279c64740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2701ae0a0 con 0x55691fc94480 2024-09-19T08:54:18.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.543+0000 7fe279c64740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe2701ab970 con 0x55691fc9ed40 2024-09-19T08:54:18.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.543+0000 7fe279c64740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe2701a97e0 con 0x55691fc93b60 2024-09-19T08:54:18.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.543+0000 7fe274e26640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc94480 0x55691fcbabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:18.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.544+0000 7fe274e26640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc94480 0x55691fcbabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39876/0 (socket says 172.21.15.7:39876) 2024-09-19T08:54:18.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.544+0000 7fe274e26640 1 -- 172.21.15.7:0/567460679 learned_addr learned my addr 172.21.15.7:0/567460679 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:18.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.544+0000 7fe275627640 1 --2- 172.21.15.7:0/567460679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55691fc93b60 0x55691fc9daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:18.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.544+0000 7fe275e28640 1 --2- 172.21.15.7:0/567460679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc9ed40 0x55691fcbb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:18.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.544+0000 7fe274e26640 1 -- 172.21.15.7:0/567460679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55691fc93b60 msgr2=0x55691fc9daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:18.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.544+0000 7fe274e26640 1 --2- 172.21.15.7:0/567460679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55691fc93b60 0x55691fc9daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.544+0000 7fe274e26640 1 -- 172.21.15.7:0/567460679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc9ed40 msgr2=0x55691fcbb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:18.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.544+0000 7fe274e26640 1 --2- 172.21.15.7:0/567460679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc9ed40 0x55691fcbb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.544+0000 7fe274e26640 1 -- 172.21.15.7:0/567460679 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55691fc9e510 con 0x55691fc94480 2024-09-19T08:54:18.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.544+0000 7fe274e26640 1 --2- 172.21.15.7:0/567460679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc94480 0x55691fcbabc0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fe264098080 tx=0x7fe26409c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1bcb04c4ec9ae1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:18.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.544+0000 7fe256ffd640 1 -- 172.21.15.7:0/567460679 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26409ffd0 con 0x55691fc94480 2024-09-19T08:54:18.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.544+0000 7fe256ffd640 1 -- 172.21.15.7:0/567460679 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe26409bc20 con 0x55691fc94480 2024-09-19T08:54:18.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.544+0000 7fe256ffd640 1 -- 172.21.15.7:0/567460679 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26409b070 con 0x55691fc94480 2024-09-19T08:54:18.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.545+0000 7fe279c64740 1 -- 172.21.15.7:0/567460679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc94480 msgr2=0x55691fcbabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.545+0000 7fe279c64740 1 --2- 172.21.15.7:0/567460679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc94480 0x55691fcbabc0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fe264098080 tx=0x7fe26409c460 comp rx=0 tx=0).stop 2024-09-19T08:54:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.545+0000 7fe279c64740 1 -- 172.21.15.7:0/567460679 shutdown_connections 2024-09-19T08:54:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.545+0000 7fe279c64740 1 --2- 172.21.15.7:0/567460679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc9ed40 0x55691fcbb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.545+0000 7fe279c64740 1 --2- 172.21.15.7:0/567460679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc94480 0x55691fcbabc0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.545+0000 7fe279c64740 1 --2- 172.21.15.7:0/567460679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55691fc93b60 0x55691fc9daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.545+0000 7fe279c64740 1 -- 172.21.15.7:0/567460679 >> 172.21.15.7:0/567460679 conn(0x55691fc900f0 msgr2=0x55691fc9d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.545+0000 7fe279c64740 1 -- 172.21.15.7:0/567460679 shutdown_connections 2024-09-19T08:54:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.545+0000 7fe279c64740 1 -- 172.21.15.7:0/567460679 wait complete. 2024-09-19T08:54:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.545+0000 7fe279c64740 1 -- start start 2024-09-19T08:54:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.545+0000 7fe279c64740 1 Processor -- start 2024-09-19T08:54:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.546+0000 7fe279c64740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc93b60 0x55691fca3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.546+0000 7fe279c64740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc94480 0x55691fca37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.546+0000 7fe279c64740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55691fc9ed40 0x55691fd16b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.546+0000 7fe279c64740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2701a9e30 con 0x55691fc93b60 2024-09-19T08:54:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.546+0000 7fe279c64740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe2701ab2a0 con 0x55691fc94480 2024-09-19T08:54:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.546+0000 7fe279c64740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe2701aa500 con 0x55691fc9ed40 2024-09-19T08:54:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.546+0000 7fe279c64740 10 client.0 _ll_register_callbacks cb 0x7fe260009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.546+0000 7fe275627640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc93b60 0x55691fca3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.546+0000 7fe275627640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc93b60 0x55691fca3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39884/0 (socket says 172.21.15.7:39884) 2024-09-19T08:54:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.546+0000 7fe275627640 1 -- 172.21.15.7:0/930294220 learned_addr learned my addr 172.21.15.7:0/930294220 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.546+0000 7fe275e28640 1 --2- 172.21.15.7:0/930294220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55691fc9ed40 0x55691fd16b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.546+0000 7fe274e26640 1 --2- 172.21.15.7:0/930294220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc94480 0x55691fca37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.546+0000 7fe275627640 1 -- 172.21.15.7:0/930294220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55691fc9ed40 msgr2=0x55691fd16b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.546+0000 7fe275627640 1 --2- 172.21.15.7:0/930294220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55691fc9ed40 0x55691fd16b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.546+0000 7fe275627640 1 -- 172.21.15.7:0/930294220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc94480 msgr2=0x55691fca37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.546+0000 7fe275627640 1 --2- 172.21.15.7:0/930294220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc94480 0x55691fca37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.546+0000 7fe275627640 1 -- 172.21.15.7:0/930294220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55691fd17150 con 0x55691fc93b60 2024-09-19T08:54:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.546+0000 7fe274e26640 1 --2- 172.21.15.7:0/930294220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc94480 0x55691fca37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.547+0000 7fe275627640 1 --2- 172.21.15.7:0/930294220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc93b60 0x55691fca3280 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fe268009900 tx=0x7fe268031b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7c5496a53f399 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.547+0000 7fe254ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.547+0000 7fe254ff9640 1 -- 172.21.15.7:0/930294220 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe268035040 con 0x55691fc93b60 2024-09-19T08:54:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.547+0000 7fe279c64740 1 -- 172.21.15.7:0/930294220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe26409bc20 con 0x55691fc93b60 2024-09-19T08:54:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.547+0000 7fe254ff9640 1 -- 172.21.15.7:0/930294220 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7fe268005030 con 0x55691fc93b60 2024-09-19T08:54:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.547+0000 7fe254ff9640 1 -- 172.21.15.7:0/930294220 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe268058050 con 0x55691fc93b60 2024-09-19T08:54:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.547+0000 7fe279c64740 10 client.17511 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.547+0000 7fe279c64740 1 -- 172.21.15.7:0/930294220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55691fd1e570 con 0x55691fc93b60 2024-09-19T08:54:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.547+0000 7fe254ff9640 1 -- 172.21.15.7:0/930294220 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe26409bc20 con 0x55691fc93b60 2024-09-19T08:54:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.547+0000 7fe254ff9640 1 -- 172.21.15.7:0/930294220 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe2680035f0 con 0x55691fc93b60 2024-09-19T08:54:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.547+0000 7fe279c64740 10 client.17511 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.548+0000 7fe279c64740 10 client.17511 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.548+0000 7fe279c64740 20 client.17511 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.548+0000 7fe279c64740 1 --2- 172.21.15.7:0/930294220 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55691fd1ec40 0x55691fd21030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.548+0000 7fe279c64740 4 client.17511 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:54:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.548+0000 7fe279c64740 1 -- 172.21.15.7:0/930294220 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55691fc00d00 con 0x55691fd1ec40 2024-09-19T08:54:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.548+0000 7fe274e26640 1 --2- 172.21.15.7:0/930294220 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55691fd1ec40 0x55691fd21030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.548+0000 7fe274e26640 1 --2- 172.21.15.7:0/930294220 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55691fd1ec40 0x55691fd21030 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d29f98e50d62c9bb server_cookie=569feea061587b59 in_seq=0 out_seq=0 2024-09-19T08:54:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.548+0000 7fe254ff9640 10 client.17511 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.549+0000 7fe254ff9640 1 -- 172.21.15.7:0/930294220 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55691fc00d00 con 0x55691fd1ec40 2024-09-19T08:54:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.549+0000 7fe254ff9640 10 client.17511 handle_command_reply: tid=0 2024-09-19T08:54:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.549+0000 7fe279c64740 1 client.17511 shutdown 2024-09-19T08:54:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.549+0000 7fe279c64740 1 -- 172.21.15.7:0/930294220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc93b60 msgr2=0x55691fca3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.549+0000 7fe279c64740 1 --2- 172.21.15.7:0/930294220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc93b60 0x55691fca3280 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fe268009900 tx=0x7fe268031b50 comp rx=0 tx=0).stop 2024-09-19T08:54:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.549+0000 7fe279c64740 1 -- 172.21.15.7:0/930294220 shutdown_connections 2024-09-19T08:54:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.549+0000 7fe279c64740 1 --2- 172.21.15.7:0/930294220 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55691fd1ec40 0x55691fd21030 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.549+0000 7fe279c64740 1 --2- 172.21.15.7:0/930294220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55691fc9ed40 0x55691fd16b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.549+0000 7fe279c64740 1 --2- 172.21.15.7:0/930294220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55691fc94480 0x55691fca37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.549+0000 7fe279c64740 1 --2- 172.21.15.7:0/930294220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55691fc93b60 0x55691fca3280 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.550+0000 7fe279c64740 1 -- 172.21.15.7:0/930294220 >> 172.21.15.7:0/930294220 conn(0x55691fc900f0 msgr2=0x55691fc9c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.550+0000 7fe254ff9640 0 client.17511 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.550+0000 7fe279c64740 1 -- 172.21.15.7:0/930294220 shutdown_connections 2024-09-19T08:54:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.550+0000 7fe279c64740 1 -- 172.21.15.7:0/930294220 wait complete. 2024-09-19T08:54:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.550+0000 7fe279c64740 20 client.17511 trim_cache size 0 max 16384 2024-09-19T08:54:18.556 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:54:18.556 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-19T08:54:18.556 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "b999fd13-1064-4a1a-8310-e952aed7b53d", 2024-09-19T08:54:18.556 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-19T08:54:18.556 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:54:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.550+0000 7fe27788b640 1 -- 172.21.15.7:0/374363579 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe2580a3430 msgr2=0x7fe2580a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.550+0000 7fe27788b640 1 --2- 172.21.15.7:0/374363579 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe2580a3430 0x7fe2580a58f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe260005c40 tx=0x7fe260009200 comp rx=0 tx=0).stop 2024-09-19T08:54:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.550+0000 7fe27788b640 1 -- 172.21.15.7:0/374363579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe270100ca0 msgr2=0x7fe270198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.550+0000 7fe27788b640 1 --2- 172.21.15.7:0/374363579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe270100ca0 0x7fe270198aa0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fe264005fd0 tx=0x7fe26400dde0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.550+0000 7fe27788b640 1 -- 172.21.15.7:0/374363579 shutdown_connections 2024-09-19T08:54:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.550+0000 7fe27788b640 1 --2- 172.21.15.7:0/374363579 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fe2580a3430 0x7fe2580a58f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.550+0000 7fe27788b640 1 --2- 172.21.15.7:0/374363579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe270106f50 0x7fe27019ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.550+0000 7fe27788b640 1 --2- 172.21.15.7:0/374363579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe270100ca0 0x7fe270198aa0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.550+0000 7fe27788b640 1 --2- 172.21.15.7:0/374363579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2701002f0 0x7fe270198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.550+0000 7fe27788b640 1 -- 172.21.15.7:0/374363579 >> 172.21.15.7:0/374363579 conn(0x7fe270077210 msgr2=0x7fe2700fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.551+0000 7fe27788b640 1 -- 172.21.15.7:0/374363579 shutdown_connections 2024-09-19T08:54:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:18.551+0000 7fe27788b640 1 -- 172.21.15.7:0/374363579 wait complete. 2024-09-19T08:54:19.257 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:54:19.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:19 smithi175 ceph-mon[35688]: pgmap v303: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:54:19.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:19 smithi175 ceph-mon[35688]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T08:54:19.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:19 smithi175 ceph-mon[35688]: scrub queued for path: / 2024-09-19T08:54:19.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:19 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:19.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:19 smithi175 ceph-mon[35688]: scrub summary: active paths [/] 2024-09-19T08:54:19.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:19 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:19.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:19 smithi175 ceph-mon[35688]: scrub summary: idle 2024-09-19T08:54:19.516 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:19.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:19 smithi007 ceph-mon[31221]: pgmap v303: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:54:19.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:19 smithi007 ceph-mon[31221]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T08:54:19.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:19 smithi007 ceph-mon[31221]: scrub queued for path: / 2024-09-19T08:54:19.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:19 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:19.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:19 smithi007 ceph-mon[31221]: scrub summary: active paths [/] 2024-09-19T08:54:19.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:19 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:19.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:19 smithi007 ceph-mon[31221]: scrub summary: idle 2024-09-19T08:54:19.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:19 smithi044 ceph-mon[35072]: pgmap v303: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:54:19.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:19 smithi044 ceph-mon[35072]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T08:54:19.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:19 smithi044 ceph-mon[35072]: scrub queued for path: / 2024-09-19T08:54:19.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:19 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:19.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:19 smithi044 ceph-mon[35072]: scrub summary: active paths [/] 2024-09-19T08:54:19.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:19 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:19.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:19 smithi044 ceph-mon[35072]: scrub summary: idle 2024-09-19T08:54:19.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.950+0000 7f7f4164d640 1 -- 172.21.15.7:0/3160730195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f3c106f10 msgr2=0x7f7f3c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:19.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.950+0000 7f7f4164d640 1 --2- 172.21.15.7:0/3160730195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f3c106f10 0x7f7f3c10ea90 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009ca0 tx=0x7f7f3402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.950+0000 7f7f4164d640 1 -- 172.21.15.7:0/3160730195 shutdown_connections 2024-09-19T08:54:19.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.950+0000 7f7f4164d640 1 --2- 172.21.15.7:0/3160730195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f3c106f10 0x7f7f3c10ea90 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.950+0000 7f7f4164d640 1 --2- 172.21.15.7:0/3160730195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f3c102790 0x7f7f3c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.950+0000 7f7f4164d640 1 --2- 172.21.15.7:0/3160730195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f3c101de0 0x7f7f3c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.950+0000 7f7f4164d640 1 -- 172.21.15.7:0/3160730195 >> 172.21.15.7:0/3160730195 conn(0x7f7f3c0fd8c0 msgr2=0x7f7f3c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:19.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.950+0000 7f7f4164d640 1 -- 172.21.15.7:0/3160730195 shutdown_connections 2024-09-19T08:54:19.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.950+0000 7f7f4164d640 1 -- 172.21.15.7:0/3160730195 wait complete. 2024-09-19T08:54:19.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.951+0000 7f7f4164d640 1 Processor -- start 2024-09-19T08:54:19.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.951+0000 7f7f4164d640 1 -- start start 2024-09-19T08:54:19.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.951+0000 7f7f4164d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f3c101de0 0x7f7f3c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.951+0000 7f7f4164d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f3c102790 0x7f7f3c198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.951+0000 7f7f4164d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f3c106f10 0x7f7f3c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.951+0000 7f7f4164d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3c111f70 con 0x7f7f3c106f10 2024-09-19T08:54:19.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.951+0000 7f7f4164d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3c111df0 con 0x7f7f3c102790 2024-09-19T08:54:19.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.951+0000 7f7f4164d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3c1120f0 con 0x7f7f3c101de0 2024-09-19T08:54:19.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.951+0000 7f7f3b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f3c106f10 0x7f7f3c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.951+0000 7f7f3affd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f3c101de0 0x7f7f3c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.951+0000 7f7f3b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f3c106f10 0x7f7f3c19ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39902/0 (socket says 172.21.15.7:39902) 2024-09-19T08:54:19.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.951+0000 7f7f3b7fe640 1 -- 172.21.15.7:0/2834039812 learned_addr learned my addr 172.21.15.7:0/2834039812 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:19.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.951+0000 7f7f3a7fc640 1 --2- 172.21.15.7:0/2834039812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f3c102790 0x7f7f3c198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.952+0000 7f7f3b7fe640 1 -- 172.21.15.7:0/2834039812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f3c101de0 msgr2=0x7f7f3c1983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:19.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.952+0000 7f7f3b7fe640 1 --2- 172.21.15.7:0/2834039812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f3c101de0 0x7f7f3c1983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.952+0000 7f7f3b7fe640 1 -- 172.21.15.7:0/2834039812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f3c102790 msgr2=0x7f7f3c198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:19.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.952+0000 7f7f3b7fe640 1 --2- 172.21.15.7:0/2834039812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f3c102790 0x7f7f3c198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.952+0000 7f7f3b7fe640 1 -- 172.21.15.7:0/2834039812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f3c19d3a0 con 0x7f7f3c106f10 2024-09-19T08:54:19.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.952+0000 7f7f3b7fe640 1 --2- 172.21.15.7:0/2834039812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f3c106f10 0x7f7f3c19ccc0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f7f34031a20 tx=0x7f7f34031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:19.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.952+0000 7f7f23fff640 1 -- 172.21.15.7:0/2834039812 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f34003c30 con 0x7f7f3c106f10 2024-09-19T08:54:19.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.952+0000 7f7f23fff640 1 -- 172.21.15.7:0/2834039812 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f34003dd0 con 0x7f7f3c106f10 2024-09-19T08:54:19.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.952+0000 7f7f4164d640 1 -- 172.21.15.7:0/2834039812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f3c19d630 con 0x7f7f3c106f10 2024-09-19T08:54:19.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.952+0000 7f7f23fff640 1 -- 172.21.15.7:0/2834039812 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3402fc40 con 0x7f7f3c106f10 2024-09-19T08:54:19.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.952+0000 7f7f4164d640 1 -- 172.21.15.7:0/2834039812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f3c1a4f70 con 0x7f7f3c106f10 2024-09-19T08:54:19.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.954+0000 7f7f23fff640 1 -- 172.21.15.7:0/2834039812 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f7f34004050 con 0x7f7f3c106f10 2024-09-19T08:54:19.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.955+0000 7f7f43a26740 1 Processor -- start 2024-09-19T08:54:19.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.955+0000 7f7f43a26740 1 -- start start 2024-09-19T08:54:19.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.955+0000 7f7f43a26740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610f4e9a360 0x5610f4e9a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.955+0000 7f7f43a26740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610f4e9ac80 0x5610f4ea9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.955+0000 7f7f43a26740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4ea9a90 0x5610f4eabe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.955+0000 7f7f43a26740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5610f4e002e0 con 0x5610f4ea9a90 2024-09-19T08:54:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.955+0000 7f7f43a26740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5610f4da7ce0 con 0x5610f4e9a360 2024-09-19T08:54:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.955+0000 7f7f43a26740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5610f4dfc2a0 con 0x5610f4e9ac80 2024-09-19T08:54:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.955+0000 7f7f23fff640 1 --2- 172.21.15.7:0/2834039812 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7f240a33b0 0x7f7f240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.955+0000 7f7f3a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4ea9a90 0x5610f4eabe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.955+0000 7f7f3a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4ea9a90 0x5610f4eabe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39918/0 (socket says 172.21.15.7:39918) 2024-09-19T08:54:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.955+0000 7f7f3a7fc640 1 -- 172.21.15.7:0/320892422 learned_addr learned my addr 172.21.15.7:0/320892422 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.955+0000 7f7f3b7fe640 1 --2- 172.21.15.7:0/2834039812 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7f240a33b0 0x7f7f240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.955+0000 7f7f3a7fc640 1 --2- 172.21.15.7:0/320892422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610f4e9a360 0x5610f4e9a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.955+0000 7f7f3affd640 1 --2- 172.21.15.7:0/320892422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610f4e9ac80 0x5610f4ea9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.955+0000 7f7f23fff640 1 -- 172.21.15.7:0/2834039812 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f7f340f0fa0 con 0x7f7f3c106f10 2024-09-19T08:54:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.956+0000 7f7f3a7fc640 1 -- 172.21.15.7:0/320892422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610f4e9ac80 msgr2=0x5610f4ea9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.956+0000 7f7f3a7fc640 1 --2- 172.21.15.7:0/320892422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610f4e9ac80 0x5610f4ea9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.956+0000 7f7f3a7fc640 1 -- 172.21.15.7:0/320892422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610f4e9a360 msgr2=0x5610f4e9a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.956+0000 7f7f3a7fc640 1 --2- 172.21.15.7:0/320892422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610f4e9a360 0x5610f4e9a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.956+0000 7f7f3a7fc640 1 -- 172.21.15.7:0/320892422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610f4d8c440 con 0x5610f4ea9a90 2024-09-19T08:54:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.956+0000 7f7f3a7fc640 1 --2- 172.21.15.7:0/320892422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4ea9a90 0x5610f4eabe80 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f7f30011780 tx=0x7f7f30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5552fb7720abf384 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.956+0000 7f7f3b7fe640 1 --2- 172.21.15.7:0/2834039812 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7f240a33b0 0x7f7f240a5870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7f3404c000 tx=0x7f7f340dbf90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.956+0000 7f7f217fa640 1 -- 172.21.15.7:0/320892422 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f30004050 con 0x5610f4ea9a90 2024-09-19T08:54:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.956+0000 7f7f217fa640 1 -- 172.21.15.7:0/320892422 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f3000fca0 con 0x5610f4ea9a90 2024-09-19T08:54:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.956+0000 7f7f217fa640 1 -- 172.21.15.7:0/320892422 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f30003a50 con 0x5610f4ea9a90 2024-09-19T08:54:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.957+0000 7f7f43a26740 1 -- 172.21.15.7:0/320892422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4ea9a90 msgr2=0x5610f4eabe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.957+0000 7f7f43a26740 1 --2- 172.21.15.7:0/320892422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4ea9a90 0x5610f4eabe80 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f7f30011780 tx=0x7f7f30004730 comp rx=0 tx=0).stop 2024-09-19T08:54:19.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.957+0000 7f7f43a26740 1 -- 172.21.15.7:0/320892422 shutdown_connections 2024-09-19T08:54:19.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.957+0000 7f7f43a26740 1 --2- 172.21.15.7:0/320892422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4ea9a90 0x5610f4eabe80 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.957+0000 7f7f43a26740 1 --2- 172.21.15.7:0/320892422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610f4e9ac80 0x5610f4ea9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.957+0000 7f7f43a26740 1 --2- 172.21.15.7:0/320892422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610f4e9a360 0x5610f4e9a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.957+0000 7f7f43a26740 1 -- 172.21.15.7:0/320892422 >> 172.21.15.7:0/320892422 conn(0x5610f4e96a30 msgr2=0x5610f4e96e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:19.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.957+0000 7f7f43a26740 1 -- 172.21.15.7:0/320892422 shutdown_connections 2024-09-19T08:54:19.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.957+0000 7f7f43a26740 1 -- 172.21.15.7:0/320892422 wait complete. 2024-09-19T08:54:19.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.957+0000 7f7f43a26740 1 -- start start 2024-09-19T08:54:19.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.957+0000 7f7f43a26740 1 Processor -- start 2024-09-19T08:54:19.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.958+0000 7f7f43a26740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610f4e9a360 0x5610f4ea9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.958+0000 7f7f43a26740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610f4e9ac80 0x5610f4ea6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.958+0000 7f7f43a26740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4ea9a90 0x5610f4ea6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.958+0000 7f7f43a26740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5610f4eac660 con 0x5610f4ea9a90 2024-09-19T08:54:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.958+0000 7f7f43a26740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5610f4dbb050 con 0x5610f4e9ac80 2024-09-19T08:54:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.958+0000 7f7f43a26740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5610f4eac7e0 con 0x5610f4e9a360 2024-09-19T08:54:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.958+0000 7f7f43a26740 10 client.0 _ll_register_callbacks cb 0x5610f4dfb160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.958+0000 7f7f3a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4ea9a90 0x5610f4ea6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.958+0000 7f7f3a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4ea9a90 0x5610f4ea6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39930/0 (socket says 172.21.15.7:39930) 2024-09-19T08:54:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.958+0000 7f7f3a7fc640 1 -- 172.21.15.7:0/771379024 learned_addr learned my addr 172.21.15.7:0/771379024 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.958+0000 7f7f3a7fc640 1 --2- 172.21.15.7:0/771379024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610f4e9a360 0x5610f4ea9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.958+0000 7f7f3affd640 1 --2- 172.21.15.7:0/771379024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610f4e9ac80 0x5610f4ea6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.958+0000 7f7f3a7fc640 1 -- 172.21.15.7:0/771379024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610f4e9a360 msgr2=0x5610f4ea9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.958+0000 7f7f3a7fc640 1 --2- 172.21.15.7:0/771379024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610f4e9a360 0x5610f4ea9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.958+0000 7f7f3a7fc640 1 -- 172.21.15.7:0/771379024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610f4e9ac80 msgr2=0x5610f4ea6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.958+0000 7f7f3a7fc640 1 --2- 172.21.15.7:0/771379024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610f4e9ac80 0x5610f4ea6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.958+0000 7f7f3a7fc640 1 -- 172.21.15.7:0/771379024 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610f4b713c0 con 0x5610f4ea9a90 2024-09-19T08:54:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.958+0000 7f7f3a7fc640 1 --2- 172.21.15.7:0/771379024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4ea9a90 0x5610f4ea6cf0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f7f30001eb0 tx=0x7f7f30004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b3e3a62980761e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:19.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.958+0000 7f7f1eff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:19.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.958+0000 7f7f1eff5640 1 -- 172.21.15.7:0/771379024 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3000fe50 con 0x5610f4ea9a90 2024-09-19T08:54:19.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.958+0000 7f7f1eff5640 1 -- 172.21.15.7:0/771379024 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f7f30011050 con 0x5610f4ea9a90 2024-09-19T08:54:19.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.959+0000 7f7f43a26740 1 -- 172.21.15.7:0/771379024 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f3000fca0 con 0x5610f4ea9a90 2024-09-19T08:54:19.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.959+0000 7f7f1eff5640 1 -- 172.21.15.7:0/771379024 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7f30035050 con 0x5610f4ea9a90 2024-09-19T08:54:19.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.959+0000 7f7f43a26740 10 client.17523 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:19.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.959+0000 7f7f43a26740 1 -- 172.21.15.7:0/771379024 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5610f4eb80a0 con 0x5610f4ea9a90 2024-09-19T08:54:19.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.959+0000 7f7f1eff5640 1 -- 172.21.15.7:0/771379024 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f3000fca0 con 0x5610f4ea9a90 2024-09-19T08:54:19.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.959+0000 7f7f1eff5640 1 -- 172.21.15.7:0/771379024 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7f300037f0 con 0x5610f4ea9a90 2024-09-19T08:54:19.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.959+0000 7f7f43a26740 10 client.17523 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:19.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.959+0000 7f7f43a26740 10 client.17523 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:19.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.959+0000 7f7f43a26740 20 client.17523 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:19.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.959+0000 7f7f43a26740 1 --2- 172.21.15.7:0/771379024 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5610f4eb93f0 0x5610f4ebb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.959+0000 7f7f43a26740 4 client.17523 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:19.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.959+0000 7f7f43a26740 1 -- 172.21.15.7:0/771379024 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5610f4e0d850 con 0x5610f4eb93f0 2024-09-19T08:54:19.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.960+0000 7f7f3affd640 1 --2- 172.21.15.7:0/771379024 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5610f4eb93f0 0x5610f4ebb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.960+0000 7f7f3affd640 1 --2- 172.21.15.7:0/771379024 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5610f4eb93f0 0x5610f4ebb7e0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddd2faf6156c22c8 server_cookie=d60e742ec5a50ea5 in_seq=0 out_seq=0 2024-09-19T08:54:19.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.960+0000 7f7f1eff5640 10 client.17523 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:19.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.961+0000 7f7f1eff5640 1 -- 172.21.15.7:0/771379024 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5610f4e0d850 con 0x5610f4eb93f0 2024-09-19T08:54:19.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.961+0000 7f7f1eff5640 10 client.17523 handle_command_reply: tid=0 2024-09-19T08:54:19.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.961+0000 7f7f43a26740 1 client.17523 shutdown 2024-09-19T08:54:19.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.961+0000 7f7f43a26740 1 -- 172.21.15.7:0/771379024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4ea9a90 msgr2=0x5610f4ea6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:19.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.961+0000 7f7f43a26740 1 --2- 172.21.15.7:0/771379024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4ea9a90 0x5610f4ea6cf0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f7f30001eb0 tx=0x7f7f30004580 comp rx=0 tx=0).stop 2024-09-19T08:54:19.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.961+0000 7f7f43a26740 1 -- 172.21.15.7:0/771379024 shutdown_connections 2024-09-19T08:54:19.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.961+0000 7f7f43a26740 1 --2- 172.21.15.7:0/771379024 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5610f4eb93f0 0x5610f4ebb7e0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.961+0000 7f7f43a26740 1 --2- 172.21.15.7:0/771379024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4ea9a90 0x5610f4ea6cf0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.961+0000 7f7f43a26740 1 --2- 172.21.15.7:0/771379024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610f4e9ac80 0x5610f4ea6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.961+0000 7f7f43a26740 1 --2- 172.21.15.7:0/771379024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610f4e9a360 0x5610f4ea9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.961+0000 7f7f43a26740 1 -- 172.21.15.7:0/771379024 >> 172.21.15.7:0/771379024 conn(0x5610f4e96a30 msgr2=0x5610f4e95b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:19.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.961+0000 7f7f1eff5640 0 client.17523 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:19.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.961+0000 7f7f43a26740 1 -- 172.21.15.7:0/771379024 shutdown_connections 2024-09-19T08:54:19.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.961+0000 7f7f43a26740 1 -- 172.21.15.7:0/771379024 wait complete. 2024-09-19T08:54:19.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.961+0000 7f7f43a26740 20 client.17523 trim_cache size 0 max 16384 2024-09-19T08:54:19.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.978+0000 7f7f43a26740 1 Processor -- start 2024-09-19T08:54:19.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.978+0000 7f7f43a26740 1 -- start start 2024-09-19T08:54:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.978+0000 7f7f43a26740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610f4e9a360 0x5610f4eb5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.978+0000 7f7f43a26740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610f4e9ac80 0x5610f4ea4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.978+0000 7f7f43a26740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4ea9a90 0x5610f4ea8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.978+0000 7f7f43a26740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3c1ae020 con 0x5610f4ea9a90 2024-09-19T08:54:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.978+0000 7f7f43a26740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3c1ab8f0 con 0x5610f4e9ac80 2024-09-19T08:54:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.978+0000 7f7f43a26740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3c1a9760 con 0x5610f4e9a360 2024-09-19T08:54:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.978+0000 7f7f3a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4ea9a90 0x5610f4ea8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.978+0000 7f7f3a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4ea9a90 0x5610f4ea8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39944/0 (socket says 172.21.15.7:39944) 2024-09-19T08:54:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.978+0000 7f7f3a7fc640 1 -- 172.21.15.7:0/2008085550 learned_addr learned my addr 172.21.15.7:0/2008085550 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.979+0000 7f7f3affd640 1 --2- 172.21.15.7:0/2008085550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610f4e9ac80 0x5610f4ea4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.979+0000 7f7f3a7fc640 1 -- 172.21.15.7:0/2008085550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610f4e9a360 msgr2=0x5610f4eb5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.979+0000 7f7f3a7fc640 1 --2- 172.21.15.7:0/2008085550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610f4e9a360 0x5610f4eb5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.979+0000 7f7f3a7fc640 1 -- 172.21.15.7:0/2008085550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610f4e9ac80 msgr2=0x5610f4ea4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.979+0000 7f7f3a7fc640 1 --2- 172.21.15.7:0/2008085550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610f4e9ac80 0x5610f4ea4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.979+0000 7f7f3a7fc640 1 -- 172.21.15.7:0/2008085550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610f4ea97c0 con 0x5610f4ea9a90 2024-09-19T08:54:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.979+0000 7f7f3a7fc640 1 --2- 172.21.15.7:0/2008085550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4ea9a90 0x5610f4ea8670 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f7f30005d30 tx=0x7f7f30005d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e74cc8cb270bfa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.979+0000 7f7f20ff9640 1 -- 172.21.15.7:0/2008085550 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f300097a0 con 0x5610f4ea9a90 2024-09-19T08:54:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.979+0000 7f7f20ff9640 1 -- 172.21.15.7:0/2008085550 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f30003ec0 con 0x5610f4ea9a90 2024-09-19T08:54:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.979+0000 7f7f20ff9640 1 -- 172.21.15.7:0/2008085550 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f30005070 con 0x5610f4ea9a90 2024-09-19T08:54:19.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.980+0000 7f7f43a26740 1 -- 172.21.15.7:0/2008085550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4ea9a90 msgr2=0x5610f4ea8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:19.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.980+0000 7f7f43a26740 1 --2- 172.21.15.7:0/2008085550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4ea9a90 0x5610f4ea8670 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f7f30005d30 tx=0x7f7f30005d60 comp rx=0 tx=0).stop 2024-09-19T08:54:19.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.980+0000 7f7f43a26740 1 -- 172.21.15.7:0/2008085550 shutdown_connections 2024-09-19T08:54:19.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.980+0000 7f7f43a26740 1 --2- 172.21.15.7:0/2008085550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4ea9a90 0x5610f4ea8670 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.980+0000 7f7f43a26740 1 --2- 172.21.15.7:0/2008085550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610f4e9ac80 0x5610f4ea4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.980+0000 7f7f43a26740 1 --2- 172.21.15.7:0/2008085550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610f4e9a360 0x5610f4eb5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.980+0000 7f7f43a26740 1 -- 172.21.15.7:0/2008085550 >> 172.21.15.7:0/2008085550 conn(0x5610f4e96a30 msgr2=0x5610f4ea7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:19.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.980+0000 7f7f43a26740 1 -- 172.21.15.7:0/2008085550 shutdown_connections 2024-09-19T08:54:19.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.980+0000 7f7f43a26740 1 -- 172.21.15.7:0/2008085550 wait complete. 2024-09-19T08:54:19.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.980+0000 7f7f43a26740 1 -- start start 2024-09-19T08:54:19.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.980+0000 7f7f43a26740 1 Processor -- start 2024-09-19T08:54:19.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.981+0000 7f7f43a26740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4e9a360 0x5610f4eb2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.981+0000 7f7f43a26740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610f4e9ac80 0x5610f4ead580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.981+0000 7f7f43a26740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610f4ea9a90 0x5610f4eadae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.981+0000 7f7f43a26740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3c1a9db0 con 0x5610f4e9a360 2024-09-19T08:54:19.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.981+0000 7f7f43a26740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3c1ab220 con 0x5610f4e9ac80 2024-09-19T08:54:19.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.981+0000 7f7f43a26740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3c1aa480 con 0x5610f4ea9a90 2024-09-19T08:54:19.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.981+0000 7f7f43a26740 10 client.0 _ll_register_callbacks cb 0x7f7f30009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:19.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.981+0000 7f7f3a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4e9a360 0x5610f4eb2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.981+0000 7f7f3a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4e9a360 0x5610f4eb2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39952/0 (socket says 172.21.15.7:39952) 2024-09-19T08:54:19.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.981+0000 7f7f3a7fc640 1 -- 172.21.15.7:0/1436367367 learned_addr learned my addr 172.21.15.7:0/1436367367 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:19.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.981+0000 7f7f3a7fc640 1 --2- 172.21.15.7:0/1436367367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610f4ea9a90 0x5610f4eadae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.981+0000 7f7f3affd640 1 --2- 172.21.15.7:0/1436367367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610f4e9ac80 0x5610f4ead580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.981+0000 7f7f3a7fc640 1 -- 172.21.15.7:0/1436367367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610f4ea9a90 msgr2=0x5610f4eadae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:19.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.981+0000 7f7f3a7fc640 1 --2- 172.21.15.7:0/1436367367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610f4ea9a90 0x5610f4eadae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.981+0000 7f7f3a7fc640 1 -- 172.21.15.7:0/1436367367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610f4e9ac80 msgr2=0x5610f4ead580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:19.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.981+0000 7f7f3a7fc640 1 --2- 172.21.15.7:0/1436367367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610f4e9ac80 0x5610f4ead580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.981+0000 7f7f3a7fc640 1 -- 172.21.15.7:0/1436367367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610f4eae310 con 0x5610f4e9a360 2024-09-19T08:54:19.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.981+0000 7f7f3a7fc640 1 --2- 172.21.15.7:0/1436367367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4e9a360 0x5610f4eb2250 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f7f30011780 tx=0x7f7f300040b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83fb1be3a5ddcd2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:19.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.981+0000 7f7f1eff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:19.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.981+0000 7f7f1eff5640 1 -- 172.21.15.7:0/1436367367 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f30011020 con 0x5610f4e9a360 2024-09-19T08:54:19.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.981+0000 7f7f1eff5640 1 -- 172.21.15.7:0/1436367367 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f7f300111c0 con 0x5610f4e9a360 2024-09-19T08:54:19.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.981+0000 7f7f43a26740 1 -- 172.21.15.7:0/1436367367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f30003ec0 con 0x5610f4e9a360 2024-09-19T08:54:19.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.982+0000 7f7f1eff5640 1 -- 172.21.15.7:0/1436367367 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7f300035f0 con 0x5610f4e9a360 2024-09-19T08:54:19.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.982+0000 7f7f43a26740 10 client.17529 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:19.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.982+0000 7f7f43a26740 1 -- 172.21.15.7:0/1436367367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5610f4f24060 con 0x5610f4e9a360 2024-09-19T08:54:19.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.982+0000 7f7f1eff5640 1 -- 172.21.15.7:0/1436367367 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f30003ec0 con 0x5610f4e9a360 2024-09-19T08:54:19.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.982+0000 7f7f1eff5640 1 -- 172.21.15.7:0/1436367367 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7f30047070 con 0x5610f4e9a360 2024-09-19T08:54:19.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.982+0000 7f7f43a26740 10 client.17529 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:19.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.982+0000 7f7f43a26740 10 client.17529 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:19.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.982+0000 7f7f43a26740 20 client.17529 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:19.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.982+0000 7f7f43a26740 1 --2- 172.21.15.7:0/1436367367 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5610f4f246c0 0x5610f4f26ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.982+0000 7f7f43a26740 4 client.17529 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:54:19.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.982+0000 7f7f43a26740 1 -- 172.21.15.7:0/1436367367 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5610f4e07d60 con 0x5610f4f246c0 2024-09-19T08:54:19.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.982+0000 7f7f3affd640 1 --2- 172.21.15.7:0/1436367367 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5610f4f246c0 0x5610f4f26ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.983+0000 7f7f1eff5640 10 client.17529 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:19.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.983+0000 7f7f3affd640 1 --2- 172.21.15.7:0/1436367367 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5610f4f246c0 0x5610f4f26ab0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29dcc49a926c9266 server_cookie=1b3d70f3d08fe020 in_seq=0 out_seq=0 2024-09-19T08:54:19.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.983+0000 7f7f1eff5640 1 -- 172.21.15.7:0/1436367367 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5610f4e07d60 con 0x5610f4f246c0 2024-09-19T08:54:19.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.983+0000 7f7f1eff5640 10 client.17529 handle_command_reply: tid=0 2024-09-19T08:54:19.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.983+0000 7f7f43a26740 1 client.17529 shutdown 2024-09-19T08:54:19.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.983+0000 7f7f43a26740 1 -- 172.21.15.7:0/1436367367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4e9a360 msgr2=0x5610f4eb2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:19.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.983+0000 7f7f43a26740 1 --2- 172.21.15.7:0/1436367367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4e9a360 0x5610f4eb2250 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f7f30011780 tx=0x7f7f300040b0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.983+0000 7f7f43a26740 1 -- 172.21.15.7:0/1436367367 shutdown_connections 2024-09-19T08:54:19.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.983+0000 7f7f43a26740 1 --2- 172.21.15.7:0/1436367367 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5610f4f246c0 0x5610f4f26ab0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.983+0000 7f7f43a26740 1 --2- 172.21.15.7:0/1436367367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5610f4ea9a90 0x5610f4eadae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.983+0000 7f7f43a26740 1 --2- 172.21.15.7:0/1436367367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610f4e9ac80 0x5610f4ead580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.983+0000 7f7f43a26740 1 --2- 172.21.15.7:0/1436367367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5610f4e9a360 0x5610f4eb2250 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.983+0000 7f7f1eff5640 0 client.17529 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:19.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.983+0000 7f7f43a26740 1 -- 172.21.15.7:0/1436367367 >> 172.21.15.7:0/1436367367 conn(0x5610f4e96a30 msgr2=0x5610f4ea8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:19.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.983+0000 7f7f43a26740 1 -- 172.21.15.7:0/1436367367 shutdown_connections 2024-09-19T08:54:19.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.983+0000 7f7f43a26740 1 -- 172.21.15.7:0/1436367367 wait complete. 2024-09-19T08:54:19.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.983+0000 7f7f43a26740 20 client.17529 trim_cache size 0 max 16384 2024-09-19T08:54:19.998 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:54:19.998 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-19T08:54:19.998 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-09-19T08:54:19.998 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:54:19.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.984+0000 7f7f4164d640 1 -- 172.21.15.7:0/2834039812 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7f240a33b0 msgr2=0x7f7f240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:19.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.984+0000 7f7f4164d640 1 --2- 172.21.15.7:0/2834039812 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7f240a33b0 0x7f7f240a5870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7f3404c000 tx=0x7f7f340dbf90 comp rx=0 tx=0).stop 2024-09-19T08:54:19.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.984+0000 7f7f4164d640 1 -- 172.21.15.7:0/2834039812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f3c106f10 msgr2=0x7f7f3c19ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:20.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.984+0000 7f7f4164d640 1 --2- 172.21.15.7:0/2834039812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f3c106f10 0x7f7f3c19ccc0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f7f34031a20 tx=0x7f7f34031a50 comp rx=0 tx=0).stop 2024-09-19T08:54:20.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.984+0000 7f7f4164d640 1 -- 172.21.15.7:0/2834039812 shutdown_connections 2024-09-19T08:54:20.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.984+0000 7f7f4164d640 1 --2- 172.21.15.7:0/2834039812 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7f240a33b0 0x7f7f240a5870 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:20.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.984+0000 7f7f4164d640 1 --2- 172.21.15.7:0/2834039812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f3c106f10 0x7f7f3c19ccc0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:20.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.984+0000 7f7f4164d640 1 --2- 172.21.15.7:0/2834039812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f3c102790 0x7f7f3c198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:20.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.984+0000 7f7f4164d640 1 --2- 172.21.15.7:0/2834039812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f3c101de0 0x7f7f3c1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:20.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.984+0000 7f7f4164d640 1 -- 172.21.15.7:0/2834039812 >> 172.21.15.7:0/2834039812 conn(0x7f7f3c0fd8c0 msgr2=0x7f7f3c0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:20.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.984+0000 7f7f4164d640 1 -- 172.21.15.7:0/2834039812 shutdown_connections 2024-09-19T08:54:20.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:19.984+0000 7f7f4164d640 1 -- 172.21.15.7:0/2834039812 wait complete. 2024-09-19T08:54:20.696 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:54:20.696 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:54:20.955 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:21.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:21 smithi007 ceph-mon[31221]: pgmap v305: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:54:21.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:21 smithi175 ceph-mon[35688]: pgmap v305: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:54:21.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.425+0000 7fbd939e8640 1 -- 172.21.15.7:0/747711955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd8c1082a0 msgr2=0x7fbd8c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.425+0000 7fbd939e8640 1 --2- 172.21.15.7:0/747711955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd8c1082a0 0x7fbd8c10ec40 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009cd0 tx=0x7fbd8402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:54:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.425+0000 7fbd939e8640 1 -- 172.21.15.7:0/747711955 shutdown_connections 2024-09-19T08:54:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.425+0000 7fbd939e8640 1 --2- 172.21.15.7:0/747711955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd8c1082a0 0x7fbd8c10ec40 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.425+0000 7fbd939e8640 1 --2- 172.21.15.7:0/747711955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd8c1036e0 0x7fbd8c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.425+0000 7fbd939e8640 1 --2- 172.21.15.7:0/747711955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd8c102d30 0x7fbd8c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.425+0000 7fbd939e8640 1 -- 172.21.15.7:0/747711955 >> 172.21.15.7:0/747711955 conn(0x7fbd8c0fc7d0 msgr2=0x7fbd8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.425+0000 7fbd939e8640 1 -- 172.21.15.7:0/747711955 shutdown_connections 2024-09-19T08:54:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.425+0000 7fbd939e8640 1 -- 172.21.15.7:0/747711955 wait complete. 2024-09-19T08:54:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.425+0000 7fbd939e8640 1 Processor -- start 2024-09-19T08:54:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.425+0000 7fbd939e8640 1 -- start start 2024-09-19T08:54:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.426+0000 7fbd939e8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd8c102d30 0x7fbd8c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.426+0000 7fbd939e8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd8c1036e0 0x7fbd8c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:21.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.426+0000 7fbd939e8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd8c1082a0 0x7fbd8c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:21.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.426+0000 7fbd939e8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c1120a0 con 0x7fbd8c1082a0 2024-09-19T08:54:21.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.426+0000 7fbd939e8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c111f20 con 0x7fbd8c102d30 2024-09-19T08:54:21.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.426+0000 7fbd939e8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c112220 con 0x7fbd8c1036e0 2024-09-19T08:54:21.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.426+0000 7fbd91f85640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd8c1082a0 0x7fbd8c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:21.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.426+0000 7fbd91f85640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd8c1082a0 0x7fbd8c101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39970/0 (socket says 172.21.15.7:39970) 2024-09-19T08:54:21.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.426+0000 7fbd91f85640 1 -- 172.21.15.7:0/1860591189 learned_addr learned my addr 172.21.15.7:0/1860591189 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:21.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.426+0000 7fbd91784640 1 --2- 172.21.15.7:0/1860591189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd8c102d30 0x7fbd8c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:21.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.426+0000 7fbd90f83640 1 --2- 172.21.15.7:0/1860591189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd8c1036e0 0x7fbd8c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:21.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.426+0000 7fbd91f85640 1 -- 172.21.15.7:0/1860591189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd8c1036e0 msgr2=0x7fbd8c100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:21.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.426+0000 7fbd91f85640 1 --2- 172.21.15.7:0/1860591189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd8c1036e0 0x7fbd8c100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:21.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.426+0000 7fbd91f85640 1 -- 172.21.15.7:0/1860591189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd8c102d30 msgr2=0x7fbd8c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.426+0000 7fbd91f85640 1 --2- 172.21.15.7:0/1860591189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd8c102d30 0x7fbd8c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.426+0000 7fbd91f85640 1 -- 172.21.15.7:0/1860591189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c1a69f0 con 0x7fbd8c1082a0 2024-09-19T08:54:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.426+0000 7fbd90f83640 1 --2- 172.21.15.7:0/1860591189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd8c1036e0 0x7fbd8c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.426+0000 7fbd91f85640 1 --2- 172.21.15.7:0/1860591189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd8c1082a0 0x7fbd8c101410 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fbd84005cc0 tx=0x7fbd84003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.426+0000 7fbd827fc640 1 -- 172.21.15.7:0/1860591189 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84004040 con 0x7fbd8c1082a0 2024-09-19T08:54:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.426+0000 7fbd827fc640 1 -- 172.21.15.7:0/1860591189 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd840046c0 con 0x7fbd8c1082a0 2024-09-19T08:54:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.426+0000 7fbd939e8640 1 -- 172.21.15.7:0/1860591189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd8c1a6c80 con 0x7fbd8c1082a0 2024-09-19T08:54:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.427+0000 7fbd827fc640 1 -- 172.21.15.7:0/1860591189 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84046480 con 0x7fbd8c1082a0 2024-09-19T08:54:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.427+0000 7fbd939e8640 1 -- 172.21.15.7:0/1860591189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd8c1a71c0 con 0x7fbd8c1082a0 2024-09-19T08:54:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.428+0000 7fbd939e8640 1 -- 172.21.15.7:0/1860591189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd8c103110 con 0x7fbd8c1082a0 2024-09-19T08:54:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.429+0000 7fbd827fc640 1 -- 172.21.15.7:0/1860591189 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fbd840305a0 con 0x7fbd8c1082a0 2024-09-19T08:54:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.429+0000 7fbd827fc640 1 --2- 172.21.15.7:0/1860591189 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fbd780a33b0 0x7fbd780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:21.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.430+0000 7fbd827fc640 1 -- 172.21.15.7:0/1860591189 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7fbd8402e030 con 0x7fbd8c1082a0 2024-09-19T08:54:21.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.430+0000 7fbd91784640 1 --2- 172.21.15.7:0/1860591189 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fbd780a33b0 0x7fbd780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:21.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.430+0000 7fbd91784640 1 --2- 172.21.15.7:0/1860591189 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fbd780a33b0 0x7fbd780a5870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800bbe0 tx=0x7fbd8800b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:21.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.433+0000 7fbd827fc640 1 -- 172.21.15.7:0/1860591189 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbd8404b060 con 0x7fbd8c1082a0 2024-09-19T08:54:21.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:21 smithi044 ceph-mon[35072]: pgmap v305: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:54:21.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.648+0000 7fbd939e8640 1 -- 172.21.15.7:0/1860591189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd8c10a2b0 con 0x7fbd8c1082a0 2024-09-19T08:54:21.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.648+0000 7fbd827fc640 1 -- 172.21.15.7:0/1860591189 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7fbd840bdeb0 con 0x7fbd8c1082a0 2024-09-19T08:54:21.649 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:54:21.649 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:54:21.650 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:54:21.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.651+0000 7fbd939e8640 1 -- 172.21.15.7:0/1860591189 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fbd780a33b0 msgr2=0x7fbd780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:21.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.651+0000 7fbd939e8640 1 --2- 172.21.15.7:0/1860591189 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fbd780a33b0 0x7fbd780a5870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800bbe0 tx=0x7fbd8800b390 comp rx=0 tx=0).stop 2024-09-19T08:54:21.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.651+0000 7fbd939e8640 1 -- 172.21.15.7:0/1860591189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd8c1082a0 msgr2=0x7fbd8c101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:21.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.651+0000 7fbd939e8640 1 --2- 172.21.15.7:0/1860591189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd8c1082a0 0x7fbd8c101410 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fbd84005cc0 tx=0x7fbd84003970 comp rx=0 tx=0).stop 2024-09-19T08:54:21.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.651+0000 7fbd939e8640 1 -- 172.21.15.7:0/1860591189 shutdown_connections 2024-09-19T08:54:21.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.651+0000 7fbd939e8640 1 --2- 172.21.15.7:0/1860591189 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fbd780a33b0 0x7fbd780a5870 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:21.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.651+0000 7fbd939e8640 1 --2- 172.21.15.7:0/1860591189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd8c1082a0 0x7fbd8c101410 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:21.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.651+0000 7fbd939e8640 1 --2- 172.21.15.7:0/1860591189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd8c1036e0 0x7fbd8c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:21.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.651+0000 7fbd939e8640 1 --2- 172.21.15.7:0/1860591189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd8c102d30 0x7fbd8c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:21.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.651+0000 7fbd939e8640 1 -- 172.21.15.7:0/1860591189 >> 172.21.15.7:0/1860591189 conn(0x7fbd8c0fc7d0 msgr2=0x7fbd8c105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:21.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.651+0000 7fbd939e8640 1 -- 172.21.15.7:0/1860591189 shutdown_connections 2024-09-19T08:54:21.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:21.651+0000 7fbd939e8640 1 -- 172.21.15.7:0/1860591189 wait complete. 2024-09-19T08:54:22.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:22 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1860591189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:22.318 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:54:22.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:22 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1860591189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:22.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:22 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1860591189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:22.574 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:22.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.983+0000 7fd93db33640 1 -- 172.21.15.7:0/3091163805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd938105a90 msgr2=0x7fd938105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:22.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.983+0000 7fd93db33640 1 --2- 172.21.15.7:0/3091163805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd938105a90 0x7fd938105e70 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fd928009900 tx=0x7fd92802a410 comp rx=0 tx=0).stop 2024-09-19T08:54:22.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.983+0000 7fd93db33640 1 -- 172.21.15.7:0/3091163805 shutdown_connections 2024-09-19T08:54:22.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.983+0000 7fd93db33640 1 --2- 172.21.15.7:0/3091163805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd938101bc0 0x7fd93810d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.983+0000 7fd93db33640 1 --2- 172.21.15.7:0/3091163805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd938101240 0x7fd938101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.983+0000 7fd93db33640 1 --2- 172.21.15.7:0/3091163805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd938105a90 0x7fd938105e70 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.983+0000 7fd93db33640 1 -- 172.21.15.7:0/3091163805 >> 172.21.15.7:0/3091163805 conn(0x7fd938077210 msgr2=0x7fd9380fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:22.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.984+0000 7fd93db33640 1 -- 172.21.15.7:0/3091163805 shutdown_connections 2024-09-19T08:54:22.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.984+0000 7fd93db33640 1 -- 172.21.15.7:0/3091163805 wait complete. 2024-09-19T08:54:22.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.984+0000 7fd93db33640 1 Processor -- start 2024-09-19T08:54:22.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.984+0000 7fd93db33640 1 -- start start 2024-09-19T08:54:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.985+0000 7fd93db33640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd938101240 0x7fd9381993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.985+0000 7fd93db33640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd938101bc0 0x7fd938199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.985+0000 7fd93db33640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd938105a90 0x7fd9381a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.985+0000 7fd93db33640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd938110f70 con 0x7fd938101240 2024-09-19T08:54:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.985+0000 7fd93db33640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd938110df0 con 0x7fd938101bc0 2024-09-19T08:54:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.985+0000 7fd93db33640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd9381110f0 con 0x7fd938105a90 2024-09-19T08:54:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.985+0000 7fd9377fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd938101240 0x7fd9381993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:22.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.985+0000 7fd9377fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd938101240 0x7fd9381993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39988/0 (socket says 172.21.15.7:39988) 2024-09-19T08:54:22.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.985+0000 7fd9377fe640 1 -- 172.21.15.7:0/3891731242 learned_addr learned my addr 172.21.15.7:0/3891731242 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:22.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.985+0000 7fd936ffd640 1 --2- 172.21.15.7:0/3891731242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd938101bc0 0x7fd938199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:22.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.985+0000 7fd937fff640 1 --2- 172.21.15.7:0/3891731242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd938105a90 0x7fd9381a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:22.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.985+0000 7fd9377fe640 1 -- 172.21.15.7:0/3891731242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd938105a90 msgr2=0x7fd9381a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:22.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.985+0000 7fd9377fe640 1 --2- 172.21.15.7:0/3891731242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd938105a90 0x7fd9381a4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.985+0000 7fd9377fe640 1 -- 172.21.15.7:0/3891731242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd938101bc0 msgr2=0x7fd938199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:22.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.985+0000 7fd9377fe640 1 --2- 172.21.15.7:0/3891731242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd938101bc0 0x7fd938199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.985+0000 7fd9377fe640 1 -- 172.21.15.7:0/3891731242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9381a4980 con 0x7fd938101240 2024-09-19T08:54:22.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.985+0000 7fd9377fe640 1 --2- 172.21.15.7:0/3891731242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd938101240 0x7fd9381993c0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fd928006010 tx=0x7fd928003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:22.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.985+0000 7fd934ff9640 1 -- 172.21.15.7:0/3891731242 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92803f070 con 0x7fd938101240 2024-09-19T08:54:22.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.986+0000 7fd93db33640 1 -- 172.21.15.7:0/3891731242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9381a4b50 con 0x7fd938101240 2024-09-19T08:54:22.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.985+0000 7fd934ff9640 1 -- 172.21.15.7:0/3891731242 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd928031c30 con 0x7fd938101240 2024-09-19T08:54:22.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.986+0000 7fd93db33640 1 -- 172.21.15.7:0/3891731242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9381a4fa0 con 0x7fd938101240 2024-09-19T08:54:22.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.986+0000 7fd934ff9640 1 -- 172.21.15.7:0/3891731242 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928035030 con 0x7fd938101240 2024-09-19T08:54:22.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.989+0000 7fd934ff9640 1 -- 172.21.15.7:0/3891731242 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fd928042070 con 0x7fd938101240 2024-09-19T08:54:22.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.989+0000 7fd93ff0c740 1 Processor -- start 2024-09-19T08:54:22.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.989+0000 7fd93ff0c740 1 -- start start 2024-09-19T08:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.989+0000 7fd93ff0c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d2f9f50 0x55f08d2f84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.989+0000 7fd93ff0c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08d2f89e0 0x55f08d2f8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.989+0000 7fd93ff0c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d303780 0x55f08d305b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.989+0000 7fd93ff0c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f08d25a2f0 con 0x55f08d303780 2024-09-19T08:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.989+0000 7fd93ff0c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f08d201cf0 con 0x55f08d2f89e0 2024-09-19T08:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.989+0000 7fd93ff0c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f08d2562b0 con 0x55f08d2f9f50 2024-09-19T08:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.989+0000 7fd936ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d303780 0x55f08d305b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.989+0000 7fd936ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d303780 0x55f08d305b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39996/0 (socket says 172.21.15.7:39996) 2024-09-19T08:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.989+0000 7fd936ffd640 1 -- 172.21.15.7:0/2854476638 learned_addr learned my addr 172.21.15.7:0/2854476638 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:22.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.989+0000 7fd9377fe640 1 --2- 172.21.15.7:0/2854476638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08d2f89e0 0x55f08d2f8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:22.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.989+0000 7fd934ff9640 1 --2- 172.21.15.7:0/3891731242 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd9200a33b0 0x7fd9200a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:22.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.990+0000 7fd937fff640 1 --2- 172.21.15.7:0/2854476638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d2f9f50 0x55f08d2f84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:22.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.990+0000 7fd936ffd640 1 -- 172.21.15.7:0/2854476638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d2f9f50 msgr2=0x55f08d2f84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:22.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.990+0000 7fd936ffd640 1 --2- 172.21.15.7:0/2854476638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d2f9f50 0x55f08d2f84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.990+0000 7fd936ffd640 1 -- 172.21.15.7:0/2854476638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08d2f89e0 msgr2=0x55f08d2f8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:22.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.990+0000 7fd936ffd640 1 --2- 172.21.15.7:0/2854476638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08d2f89e0 0x55f08d2f8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.990+0000 7fd937fff640 1 --2- 172.21.15.7:0/3891731242 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd9200a33b0 0x7fd9200a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:22.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.990+0000 7fd934ff9640 1 -- 172.21.15.7:0/3891731242 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7fd9280f05c0 con 0x7fd938101240 2024-09-19T08:54:22.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.990+0000 7fd936ffd640 1 -- 172.21.15.7:0/2854476638 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f08d1e63a0 con 0x55f08d303780 2024-09-19T08:54:22.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.990+0000 7fd9377fe640 1 --2- 172.21.15.7:0/2854476638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08d2f89e0 0x55f08d2f8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:22.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.990+0000 7fd936ffd640 1 --2- 172.21.15.7:0/2854476638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d303780 0x55f08d305b70 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00bc90 tx=0x7fd92c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160230e37ba6e47d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:22.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.990+0000 7fd91dffb640 1 -- 172.21.15.7:0/2854476638 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c005220 con 0x55f08d303780 2024-09-19T08:54:22.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.990+0000 7fd937fff640 1 --2- 172.21.15.7:0/3891731242 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd9200a33b0 0x7fd9200a5870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd930005fd0 tx=0x7fd930004a40 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:22.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.990+0000 7fd91dffb640 1 -- 172.21.15.7:0/2854476638 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd92c00be40 con 0x55f08d303780 2024-09-19T08:54:22.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.990+0000 7fd91dffb640 1 -- 172.21.15.7:0/2854476638 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c011770 con 0x55f08d303780 2024-09-19T08:54:22.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.991+0000 7fd93ff0c740 1 -- 172.21.15.7:0/2854476638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d303780 msgr2=0x55f08d305b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:22.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.991+0000 7fd93ff0c740 1 --2- 172.21.15.7:0/2854476638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d303780 0x55f08d305b70 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00bc90 tx=0x7fd92c0107a0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.991+0000 7fd93ff0c740 1 -- 172.21.15.7:0/2854476638 shutdown_connections 2024-09-19T08:54:22.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.991+0000 7fd93ff0c740 1 --2- 172.21.15.7:0/2854476638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d303780 0x55f08d305b70 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.991+0000 7fd93ff0c740 1 --2- 172.21.15.7:0/2854476638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08d2f89e0 0x55f08d2f8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.991+0000 7fd93ff0c740 1 --2- 172.21.15.7:0/2854476638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d2f9f50 0x55f08d2f84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.991+0000 7fd93ff0c740 1 -- 172.21.15.7:0/2854476638 >> 172.21.15.7:0/2854476638 conn(0x55f08d2bd310 msgr2=0x55f08d2f5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.991+0000 7fd93ff0c740 1 -- 172.21.15.7:0/2854476638 shutdown_connections 2024-09-19T08:54:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.991+0000 7fd93ff0c740 1 -- 172.21.15.7:0/2854476638 wait complete. 2024-09-19T08:54:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.991+0000 7fd93ff0c740 1 -- start start 2024-09-19T08:54:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.992+0000 7fd93ff0c740 1 Processor -- start 2024-09-19T08:54:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.992+0000 7fd93ff0c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08d2f89e0 0x55f08d303150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.992+0000 7fd93ff0c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d2f9f50 0x55f08d300400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.992+0000 7fd93ff0c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d303780 0x55f08d3009f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.992+0000 7fd93ff0c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f08d306480 con 0x55f08d2f9f50 2024-09-19T08:54:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.992+0000 7fd93ff0c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f08d215060 con 0x55f08d2f89e0 2024-09-19T08:54:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.992+0000 7fd93ff0c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f08d306600 con 0x55f08d303780 2024-09-19T08:54:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.992+0000 7fd93ff0c740 10 client.0 _ll_register_callbacks cb 0x55f08cf688c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.992+0000 7fd936ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d2f9f50 0x55f08d300400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.992+0000 7fd936ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d2f9f50 0x55f08d300400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40008/0 (socket says 172.21.15.7:40008) 2024-09-19T08:54:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.992+0000 7fd936ffd640 1 -- 172.21.15.7:0/998468175 learned_addr learned my addr 172.21.15.7:0/998468175 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.992+0000 7fd9377fe640 1 --2- 172.21.15.7:0/998468175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08d2f89e0 0x55f08d303150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.992+0000 7fd937fff640 1 --2- 172.21.15.7:0/998468175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d303780 0x55f08d3009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.992+0000 7fd936ffd640 1 -- 172.21.15.7:0/998468175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d303780 msgr2=0x55f08d3009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.992+0000 7fd936ffd640 1 --2- 172.21.15.7:0/998468175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d303780 0x55f08d3009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.992+0000 7fd936ffd640 1 -- 172.21.15.7:0/998468175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08d2f89e0 msgr2=0x55f08d303150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.992+0000 7fd936ffd640 1 --2- 172.21.15.7:0/998468175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08d2f89e0 0x55f08d303150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.993+0000 7fd936ffd640 1 -- 172.21.15.7:0/998468175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f08cfcb3c0 con 0x55f08d2f9f50 2024-09-19T08:54:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.993+0000 7fd937fff640 1 --2- 172.21.15.7:0/998468175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d303780 0x55f08d3009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.993+0000 7fd936ffd640 1 --2- 172.21.15.7:0/998468175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d2f9f50 0x55f08d300400 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fd92c005720 tx=0x7fd92c005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc960b23eb25ed0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.993+0000 7fd916ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.993+0000 7fd916ffd640 1 -- 172.21.15.7:0/998468175 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c005460 con 0x55f08d2f9f50 2024-09-19T08:54:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.993+0000 7fd916ffd640 1 -- 172.21.15.7:0/998468175 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7fd92c004020 con 0x55f08d2f9f50 2024-09-19T08:54:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.993+0000 7fd93ff0c740 1 -- 172.21.15.7:0/998468175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f08d267860 con 0x55f08d2f9f50 2024-09-19T08:54:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.993+0000 7fd916ffd640 1 -- 172.21.15.7:0/998468175 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd92c004220 con 0x55f08d2f9f50 2024-09-19T08:54:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.993+0000 7fd93ff0c740 10 client.17547 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.993+0000 7fd93ff0c740 1 -- 172.21.15.7:0/998468175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f08d311ef0 con 0x55f08d2f9f50 2024-09-19T08:54:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.993+0000 7fd916ffd640 1 -- 172.21.15.7:0/998468175 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55f08d267860 con 0x55f08d2f9f50 2024-09-19T08:54:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.994+0000 7fd916ffd640 1 -- 172.21.15.7:0/998468175 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd92c003aa0 con 0x55f08d2f9f50 2024-09-19T08:54:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.994+0000 7fd93ff0c740 10 client.17547 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.994+0000 7fd93ff0c740 10 client.17547 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:54:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.994+0000 7fd93ff0c740 20 client.17547 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.994+0000 7fd93ff0c740 1 --2- 172.21.15.7:0/998468175 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f08d3132f0 0x55f08d3156e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:22.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.994+0000 7fd93ff0c740 4 client.17547 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:23.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.994+0000 7fd93ff0c740 1 -- 172.21.15.7:0/998468175 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f08d261d70 con 0x55f08d3132f0 2024-09-19T08:54:23.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.994+0000 7fd9377fe640 1 --2- 172.21.15.7:0/998468175 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f08d3132f0 0x55f08d3156e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:23.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.994+0000 7fd9377fe640 1 --2- 172.21.15.7:0/998468175 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f08d3132f0 0x55f08d3156e0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=54ac1a470b334af9 server_cookie=afacf2fd4858b72b in_seq=0 out_seq=0 2024-09-19T08:54:23.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.994+0000 7fd916ffd640 10 client.17547 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:54:23.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.995+0000 7fd916ffd640 1 -- 172.21.15.7:0/998468175 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f08d261d70 con 0x55f08d3132f0 2024-09-19T08:54:23.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.995+0000 7fd916ffd640 10 client.17547 handle_command_reply: tid=0 2024-09-19T08:54:23.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.995+0000 7fd93ff0c740 1 client.17547 shutdown 2024-09-19T08:54:23.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.995+0000 7fd93ff0c740 1 -- 172.21.15.7:0/998468175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d2f9f50 msgr2=0x55f08d300400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:23.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.995+0000 7fd93ff0c740 1 --2- 172.21.15.7:0/998468175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d2f9f50 0x55f08d300400 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fd92c005720 tx=0x7fd92c005230 comp rx=0 tx=0).stop 2024-09-19T08:54:23.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.995+0000 7fd93ff0c740 1 -- 172.21.15.7:0/998468175 shutdown_connections 2024-09-19T08:54:23.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.995+0000 7fd93ff0c740 1 --2- 172.21.15.7:0/998468175 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f08d3132f0 0x55f08d3156e0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.996+0000 7fd93ff0c740 1 --2- 172.21.15.7:0/998468175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d303780 0x55f08d3009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.996+0000 7fd93ff0c740 1 --2- 172.21.15.7:0/998468175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d2f9f50 0x55f08d300400 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.996+0000 7fd916ffd640 0 client.17547 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:54:23.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.996+0000 7fd93ff0c740 1 --2- 172.21.15.7:0/998468175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08d2f89e0 0x55f08d303150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.996+0000 7fd93ff0c740 1 -- 172.21.15.7:0/998468175 >> 172.21.15.7:0/998468175 conn(0x55f08d2bd310 msgr2=0x55f08d2fad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:23.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.996+0000 7fd93ff0c740 1 -- 172.21.15.7:0/998468175 shutdown_connections 2024-09-19T08:54:23.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.996+0000 7fd93ff0c740 1 -- 172.21.15.7:0/998468175 wait complete. 2024-09-19T08:54:23.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:22.996+0000 7fd93ff0c740 20 client.17547 trim_cache size 0 max 16384 2024-09-19T08:54:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.009+0000 7fd93ff0c740 1 Processor -- start 2024-09-19T08:54:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.009+0000 7fd93ff0c740 1 -- start start 2024-09-19T08:54:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.009+0000 7fd93ff0c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d2f89e0 0x55f08d30f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.009+0000 7fd93ff0c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08d2f9f50 0x55f08d2ff3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.009+0000 7fd93ff0c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d303780 0x55f08d31ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.009+0000 7fd93ff0c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9381ae060 con 0x55f08d303780 2024-09-19T08:54:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.009+0000 7fd93ff0c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd9381ab930 con 0x55f08d2f9f50 2024-09-19T08:54:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.009+0000 7fd93ff0c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd9381a97a0 con 0x55f08d2f89e0 2024-09-19T08:54:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.009+0000 7fd937fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d303780 0x55f08d31ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.009+0000 7fd937fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d303780 0x55f08d31ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40012/0 (socket says 172.21.15.7:40012) 2024-09-19T08:54:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.009+0000 7fd937fff640 1 -- 172.21.15.7:0/1108764283 learned_addr learned my addr 172.21.15.7:0/1108764283 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.009+0000 7fd936ffd640 1 --2- 172.21.15.7:0/1108764283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08d2f9f50 0x55f08d2ff3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.009+0000 7fd9377fe640 1 --2- 172.21.15.7:0/1108764283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d2f89e0 0x55f08d30f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.009+0000 7fd937fff640 1 -- 172.21.15.7:0/1108764283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d2f89e0 msgr2=0x55f08d30f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.009+0000 7fd937fff640 1 --2- 172.21.15.7:0/1108764283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d2f89e0 0x55f08d30f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.009+0000 7fd937fff640 1 -- 172.21.15.7:0/1108764283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08d2f9f50 msgr2=0x55f08d2ff3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.009+0000 7fd937fff640 1 --2- 172.21.15.7:0/1108764283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08d2f9f50 0x55f08d2ff3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.009+0000 7fd937fff640 1 -- 172.21.15.7:0/1108764283 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f08d2fe950 con 0x55f08d303780 2024-09-19T08:54:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.009+0000 7fd9377fe640 1 --2- 172.21.15.7:0/1108764283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d2f89e0 0x55f08d30f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:23.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.010+0000 7fd937fff640 1 --2- 172.21.15.7:0/1108764283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d303780 0x55f08d31ace0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fd930013a50 tx=0x7fd930015070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2564fc1ffc35eae8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:23.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.010+0000 7fd91d7fa640 1 -- 172.21.15.7:0/1108764283 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd930011be0 con 0x55f08d303780 2024-09-19T08:54:23.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.010+0000 7fd91d7fa640 1 -- 172.21.15.7:0/1108764283 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd930024030 con 0x55f08d303780 2024-09-19T08:54:23.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.010+0000 7fd91d7fa640 1 -- 172.21.15.7:0/1108764283 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93001f690 con 0x55f08d303780 2024-09-19T08:54:23.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.010+0000 7fd93ff0c740 1 -- 172.21.15.7:0/1108764283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d303780 msgr2=0x55f08d31ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:23.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.010+0000 7fd93ff0c740 1 --2- 172.21.15.7:0/1108764283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d303780 0x55f08d31ace0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fd930013a50 tx=0x7fd930015070 comp rx=0 tx=0).stop 2024-09-19T08:54:23.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.010+0000 7fd93ff0c740 1 -- 172.21.15.7:0/1108764283 shutdown_connections 2024-09-19T08:54:23.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.010+0000 7fd93ff0c740 1 --2- 172.21.15.7:0/1108764283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d303780 0x55f08d31ace0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.010+0000 7fd93ff0c740 1 --2- 172.21.15.7:0/1108764283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08d2f9f50 0x55f08d2ff3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.010+0000 7fd93ff0c740 1 --2- 172.21.15.7:0/1108764283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d2f89e0 0x55f08d30f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.010+0000 7fd93ff0c740 1 -- 172.21.15.7:0/1108764283 >> 172.21.15.7:0/1108764283 conn(0x55f08d2bd310 msgr2=0x55f08d2fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.010+0000 7fd93ff0c740 1 -- 172.21.15.7:0/1108764283 shutdown_connections 2024-09-19T08:54:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.011+0000 7fd93ff0c740 1 -- 172.21.15.7:0/1108764283 wait complete. 2024-09-19T08:54:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.011+0000 7fd93ff0c740 1 -- start start 2024-09-19T08:54:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.011+0000 7fd93ff0c740 1 Processor -- start 2024-09-19T08:54:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.011+0000 7fd93ff0c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d2f89e0 0x55f08d30be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.011+0000 7fd93ff0c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08d2f9f50 0x55f08d307160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.011+0000 7fd93ff0c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d303780 0x55f08d3076a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.011+0000 7fd93ff0c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9381a9df0 con 0x55f08d2f89e0 2024-09-19T08:54:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.011+0000 7fd93ff0c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd9381ab260 con 0x55f08d2f9f50 2024-09-19T08:54:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.011+0000 7fd93ff0c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd9381aa4c0 con 0x55f08d303780 2024-09-19T08:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.011+0000 7fd93ff0c740 10 client.0 _ll_register_callbacks cb 0x7fd930009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.011+0000 7fd9377fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d2f89e0 0x55f08d30be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.011+0000 7fd9377fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d2f89e0 0x55f08d30be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40014/0 (socket says 172.21.15.7:40014) 2024-09-19T08:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.011+0000 7fd9377fe640 1 -- 172.21.15.7:0/4258248470 learned_addr learned my addr 172.21.15.7:0/4258248470 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.011+0000 7fd936ffd640 1 --2- 172.21.15.7:0/4258248470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08d2f9f50 0x55f08d307160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.012+0000 7fd937fff640 1 --2- 172.21.15.7:0/4258248470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d303780 0x55f08d3076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.012+0000 7fd9377fe640 1 -- 172.21.15.7:0/4258248470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d303780 msgr2=0x55f08d3076a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.012+0000 7fd9377fe640 1 --2- 172.21.15.7:0/4258248470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d303780 0x55f08d3076a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.012+0000 7fd9377fe640 1 -- 172.21.15.7:0/4258248470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08d2f9f50 msgr2=0x55f08d307160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.012+0000 7fd9377fe640 1 --2- 172.21.15.7:0/4258248470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08d2f9f50 0x55f08d307160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.012+0000 7fd9377fe640 1 -- 172.21.15.7:0/4258248470 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f08d307ce0 con 0x55f08d2f89e0 2024-09-19T08:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.012+0000 7fd937fff640 1 --2- 172.21.15.7:0/4258248470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d303780 0x55f08d3076a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.012+0000 7fd9377fe640 1 --2- 172.21.15.7:0/4258248470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d2f89e0 0x55f08d30be30 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fd928005940 tx=0x7fd9280bc1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a116e18dc60b4dd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:23.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.012+0000 7fd916ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:23.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.012+0000 7fd916ffd640 1 -- 172.21.15.7:0/4258248470 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928049040 con 0x55f08d2f89e0 2024-09-19T08:54:23.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.012+0000 7fd916ffd640 1 -- 172.21.15.7:0/4258248470 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7fd9280b8ed0 con 0x55f08d2f89e0 2024-09-19T08:54:23.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.012+0000 7fd93ff0c740 1 -- 172.21.15.7:0/4258248470 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd930024030 con 0x55f08d2f89e0 2024-09-19T08:54:23.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.012+0000 7fd916ffd640 1 -- 172.21.15.7:0/4258248470 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd928031de0 con 0x55f08d2f89e0 2024-09-19T08:54:23.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.012+0000 7fd93ff0c740 10 client.17553 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:23.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.012+0000 7fd93ff0c740 1 -- 172.21.15.7:0/4258248470 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f08d37dbb0 con 0x55f08d2f89e0 2024-09-19T08:54:23.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.013+0000 7fd916ffd640 1 -- 172.21.15.7:0/4258248470 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd930024030 con 0x55f08d2f89e0 2024-09-19T08:54:23.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.013+0000 7fd916ffd640 1 -- 172.21.15.7:0/4258248470 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd92803b4f0 con 0x55f08d2f89e0 2024-09-19T08:54:23.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.013+0000 7fd93ff0c740 10 client.17553 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:23.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.013+0000 7fd93ff0c740 10 client.17553 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:54:23.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.013+0000 7fd93ff0c740 20 client.17553 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:23.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.013+0000 7fd93ff0c740 1 --2- 172.21.15.7:0/4258248470 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f08d3132f0 0x55f08d380270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.013+0000 7fd93ff0c740 4 client.17553 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.013+0000 7fd93ff0c740 1 -- 172.21.15.7:0/4258248470 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f08d1de170 con 0x55f08d3132f0 2024-09-19T08:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.013+0000 7fd936ffd640 1 --2- 172.21.15.7:0/4258248470 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f08d3132f0 0x55f08d380270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.013+0000 7fd936ffd640 1 --2- 172.21.15.7:0/4258248470 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f08d3132f0 0x55f08d380270 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c87a8ab6a86ada62 server_cookie=a7af4b002c0f6731 in_seq=0 out_seq=0 2024-09-19T08:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.013+0000 7fd916ffd640 10 client.17553 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.014+0000 7fd916ffd640 1 -- 172.21.15.7:0/4258248470 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f08d1de170 con 0x55f08d3132f0 2024-09-19T08:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.014+0000 7fd916ffd640 10 client.17553 handle_command_reply: tid=0 2024-09-19T08:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.014+0000 7fd93ff0c740 1 client.17553 shutdown 2024-09-19T08:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.014+0000 7fd93ff0c740 1 -- 172.21.15.7:0/4258248470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d2f89e0 msgr2=0x55f08d30be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.014+0000 7fd93ff0c740 1 --2- 172.21.15.7:0/4258248470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d2f89e0 0x55f08d30be30 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fd928005940 tx=0x7fd9280bc1c0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.014+0000 7fd93ff0c740 1 -- 172.21.15.7:0/4258248470 shutdown_connections 2024-09-19T08:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.014+0000 7fd93ff0c740 1 --2- 172.21.15.7:0/4258248470 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55f08d3132f0 0x55f08d380270 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.014+0000 7fd93ff0c740 1 --2- 172.21.15.7:0/4258248470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f08d303780 0x55f08d3076a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.014+0000 7fd93ff0c740 1 --2- 172.21.15.7:0/4258248470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08d2f9f50 0x55f08d307160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.014+0000 7fd916ffd640 0 client.17553 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:54:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.014+0000 7fd93ff0c740 1 --2- 172.21.15.7:0/4258248470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f08d2f89e0 0x55f08d30be30 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.014+0000 7fd93ff0c740 1 -- 172.21.15.7:0/4258248470 >> 172.21.15.7:0/4258248470 conn(0x55f08d2bd310 msgr2=0x55f08d2ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.014+0000 7fd93ff0c740 1 -- 172.21.15.7:0/4258248470 shutdown_connections 2024-09-19T08:54:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.014+0000 7fd93ff0c740 1 -- 172.21.15.7:0/4258248470 wait complete. 2024-09-19T08:54:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.014+0000 7fd93ff0c740 20 client.17553 trim_cache size 0 max 16384 2024-09-19T08:54:23.020 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:54:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.014+0000 7fd93db33640 1 -- 172.21.15.7:0/3891731242 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd9200a33b0 msgr2=0x7fd9200a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.014+0000 7fd93db33640 1 --2- 172.21.15.7:0/3891731242 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd9200a33b0 0x7fd9200a5870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd930005fd0 tx=0x7fd930004a40 comp rx=0 tx=0).stop 2024-09-19T08:54:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.015+0000 7fd93db33640 1 -- 172.21.15.7:0/3891731242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd938101240 msgr2=0x7fd9381993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.015+0000 7fd93db33640 1 --2- 172.21.15.7:0/3891731242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd938101240 0x7fd9381993c0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fd928006010 tx=0x7fd928003c10 comp rx=0 tx=0).stop 2024-09-19T08:54:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.015+0000 7fd93db33640 1 -- 172.21.15.7:0/3891731242 shutdown_connections 2024-09-19T08:54:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.015+0000 7fd93db33640 1 --2- 172.21.15.7:0/3891731242 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd9200a33b0 0x7fd9200a5870 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.015+0000 7fd93db33640 1 --2- 172.21.15.7:0/3891731242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd938105a90 0x7fd9381a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.015+0000 7fd93db33640 1 --2- 172.21.15.7:0/3891731242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd938101bc0 0x7fd938199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.015+0000 7fd93db33640 1 --2- 172.21.15.7:0/3891731242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd938101240 0x7fd9381993c0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.015+0000 7fd93db33640 1 -- 172.21.15.7:0/3891731242 >> 172.21.15.7:0/3891731242 conn(0x7fd938077210 msgr2=0x7fd938103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:23.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.015+0000 7fd93db33640 1 -- 172.21.15.7:0/3891731242 shutdown_connections 2024-09-19T08:54:23.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:23.015+0000 7fd93db33640 1 -- 172.21.15.7:0/3891731242 wait complete. 2024-09-19T08:54:23.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:23 smithi007 ceph-mon[31221]: pgmap v306: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:54:23.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:23 smithi175 ceph-mon[35688]: pgmap v306: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:54:23.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:23 smithi044 ceph-mon[35072]: pgmap v306: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T08:54:23.731 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:54:23.984 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:24.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.448+0000 7f917f572640 1 -- 172.21.15.7:0/800551377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917810c170 msgr2=0x7f917810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:24.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.448+0000 7f917f572640 1 --2- 172.21.15.7:0/800551377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917810c170 0x7f917810e610 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f9170009ca0 tx=0x7f917002a950 comp rx=0 tx=0).stop 2024-09-19T08:54:24.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.448+0000 7f917f572640 1 -- 172.21.15.7:0/800551377 shutdown_connections 2024-09-19T08:54:24.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.448+0000 7f917f572640 1 --2- 172.21.15.7:0/800551377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917810c170 0x7f917810e610 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.448+0000 7f917f572640 1 --2- 172.21.15.7:0/800551377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9178103660 0x7f917810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.448+0000 7f917f572640 1 --2- 172.21.15.7:0/800551377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9178102d40 0x7f9178103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.448+0000 7f917f572640 1 -- 172.21.15.7:0/800551377 >> 172.21.15.7:0/800551377 conn(0x7f91780fc7a0 msgr2=0x7f91780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:24.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.448+0000 7f917f572640 1 -- 172.21.15.7:0/800551377 shutdown_connections 2024-09-19T08:54:24.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.448+0000 7f917f572640 1 -- 172.21.15.7:0/800551377 wait complete. 2024-09-19T08:54:24.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.449+0000 7f917f572640 1 Processor -- start 2024-09-19T08:54:24.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.449+0000 7f917f572640 1 -- start start 2024-09-19T08:54:24.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.449+0000 7f917f572640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9178102d40 0x7f9178198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:24.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.449+0000 7f917f572640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9178103660 0x7f9178198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:24.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.449+0000 7f917f572640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917810c170 0x7f917819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:24.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.449+0000 7f917f572640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9178111f70 con 0x7f917810c170 2024-09-19T08:54:24.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.449+0000 7f917f572640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9178111df0 con 0x7f9178102d40 2024-09-19T08:54:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.449+0000 7f917f572640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f91781120f0 con 0x7f9178103660 2024-09-19T08:54:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.450+0000 7f917db0f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917810c170 0x7f917819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.450+0000 7f917d30e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9178102d40 0x7f9178198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.450+0000 7f917db0f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917810c170 0x7f917819cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53266/0 (socket says 172.21.15.7:53266) 2024-09-19T08:54:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.450+0000 7f917db0f640 1 -- 172.21.15.7:0/850741102 learned_addr learned my addr 172.21.15.7:0/850741102 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.450+0000 7f917cb0d640 1 --2- 172.21.15.7:0/850741102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9178103660 0x7f9178198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.450+0000 7f917db0f640 1 -- 172.21.15.7:0/850741102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9178103660 msgr2=0x7f9178198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.450+0000 7f917db0f640 1 --2- 172.21.15.7:0/850741102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9178103660 0x7f9178198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.450+0000 7f917db0f640 1 -- 172.21.15.7:0/850741102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9178102d40 msgr2=0x7f9178198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.450+0000 7f917db0f640 1 --2- 172.21.15.7:0/850741102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9178102d40 0x7f9178198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.450+0000 7f917db0f640 1 -- 172.21.15.7:0/850741102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917819d3c0 con 0x7f917810c170 2024-09-19T08:54:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.450+0000 7f917db0f640 1 --2- 172.21.15.7:0/850741102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917810c170 0x7f917819cce0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f917002ae70 tx=0x7f917002f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.450+0000 7f916e7fc640 1 -- 172.21.15.7:0/850741102 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9170034040 con 0x7f917810c170 2024-09-19T08:54:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.450+0000 7f916e7fc640 1 -- 172.21.15.7:0/850741102 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9170030920 con 0x7f917810c170 2024-09-19T08:54:24.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.450+0000 7f917f572640 1 -- 172.21.15.7:0/850741102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f917819d650 con 0x7f917810c170 2024-09-19T08:54:24.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.450+0000 7f916e7fc640 1 -- 172.21.15.7:0/850741102 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9170045480 con 0x7f917810c170 2024-09-19T08:54:24.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.450+0000 7f917f572640 1 -- 172.21.15.7:0/850741102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91781a4f90 con 0x7f917810c170 2024-09-19T08:54:24.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.453+0000 7f916e7fc640 1 -- 172.21.15.7:0/850741102 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f9170037020 con 0x7f917810c170 2024-09-19T08:54:24.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.453+0000 7f918194b740 1 Processor -- start 2024-09-19T08:54:24.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.453+0000 7f918194b740 1 -- start start 2024-09-19T08:54:24.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.453+0000 7f918194b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a4bb40 0x564252a4a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:24.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.453+0000 7f918194b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564252a4a5d0 0x564252a4aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:24.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.453+0000 7f918194b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564252a59780 0x564252a5bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:24.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.453+0000 7f918194b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5642529b02f0 con 0x564252a4bb40 2024-09-19T08:54:24.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.453+0000 7f918194b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564252957cf0 con 0x564252a59780 2024-09-19T08:54:24.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.453+0000 7f918194b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5642529ac2b0 con 0x564252a4a5d0 2024-09-19T08:54:24.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.453+0000 7f916e7fc640 1 --2- 172.21.15.7:0/850741102 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f91640a3430 0x7f91640a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:24.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.454+0000 7f917cb0d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a4bb40 0x564252a4a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:24.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.454+0000 7f917cb0d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a4bb40 0x564252a4a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53270/0 (socket says 172.21.15.7:53270) 2024-09-19T08:54:24.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.454+0000 7f917cb0d640 1 -- 172.21.15.7:0/342493412 learned_addr learned my addr 172.21.15.7:0/342493412 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:24.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.454+0000 7f917db0f640 1 --2- 172.21.15.7:0/850741102 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f91640a3430 0x7f91640a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:24.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.454+0000 7f916e7fc640 1 -- 172.21.15.7:0/850741102 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f91700f0aa0 con 0x7f917810c170 2024-09-19T08:54:24.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.454+0000 7f917cb0d640 1 --2- 172.21.15.7:0/342493412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564252a59780 0x564252a5bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:24.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.454+0000 7f917d30e640 1 --2- 172.21.15.7:0/342493412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564252a4a5d0 0x564252a4aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:24.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.454+0000 7f917cb0d640 1 -- 172.21.15.7:0/342493412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564252a4a5d0 msgr2=0x564252a4aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:24.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.454+0000 7f917cb0d640 1 --2- 172.21.15.7:0/342493412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564252a4a5d0 0x564252a4aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.454+0000 7f917cb0d640 1 -- 172.21.15.7:0/342493412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564252a59780 msgr2=0x564252a5bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.454+0000 7f917cb0d640 1 --2- 172.21.15.7:0/342493412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564252a59780 0x564252a5bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.454+0000 7f917cb0d640 1 -- 172.21.15.7:0/342493412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56425293c3a0 con 0x564252a4bb40 2024-09-19T08:54:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.454+0000 7f917cb0d640 1 --2- 172.21.15.7:0/342493412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a4bb40 0x564252a4a090 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f91680058a0 tx=0x7f916800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa6c5e69d7be2e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.454+0000 7f917db0f640 1 --2- 172.21.15.7:0/850741102 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f91640a3430 0x7f91640a58f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f91700ee7b0 tx=0x7f9170087840 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.454+0000 7f91637fe640 1 -- 172.21.15.7:0/342493412 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9168004030 con 0x564252a4bb40 2024-09-19T08:54:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.454+0000 7f91637fe640 1 -- 172.21.15.7:0/342493412 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91680041d0 con 0x564252a4bb40 2024-09-19T08:54:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.454+0000 7f91637fe640 1 -- 172.21.15.7:0/342493412 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916800f6e0 con 0x564252a4bb40 2024-09-19T08:54:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.455+0000 7f918194b740 1 -- 172.21.15.7:0/342493412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a4bb40 msgr2=0x564252a4a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.455+0000 7f918194b740 1 --2- 172.21.15.7:0/342493412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a4bb40 0x564252a4a090 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f91680058a0 tx=0x7f916800b7b0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.455+0000 7f918194b740 1 -- 172.21.15.7:0/342493412 shutdown_connections 2024-09-19T08:54:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.455+0000 7f918194b740 1 --2- 172.21.15.7:0/342493412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564252a59780 0x564252a5bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.455+0000 7f918194b740 1 --2- 172.21.15.7:0/342493412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564252a4a5d0 0x564252a4aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.455+0000 7f918194b740 1 --2- 172.21.15.7:0/342493412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a4bb40 0x564252a4a090 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.455+0000 7f918194b740 1 -- 172.21.15.7:0/342493412 >> 172.21.15.7:0/342493412 conn(0x564252a13310 msgr2=0x564252a46c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.455+0000 7f918194b740 1 -- 172.21.15.7:0/342493412 shutdown_connections 2024-09-19T08:54:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.455+0000 7f918194b740 1 -- 172.21.15.7:0/342493412 wait complete. 2024-09-19T08:54:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.456+0000 7f918194b740 1 -- start start 2024-09-19T08:54:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.456+0000 7f918194b740 1 Processor -- start 2024-09-19T08:54:24.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.456+0000 7f918194b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564252a4a5d0 0x564252a59180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:24.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.456+0000 7f918194b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564252a4bb40 0x564252a56430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:24.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.456+0000 7f918194b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a59780 0x564252a56a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:24.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.456+0000 7f918194b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564252a5c480 con 0x564252a59780 2024-09-19T08:54:24.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.456+0000 7f918194b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56425296b060 con 0x564252a4bb40 2024-09-19T08:54:24.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.456+0000 7f918194b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564252a5c600 con 0x564252a4a5d0 2024-09-19T08:54:24.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.456+0000 7f918194b740 10 client.0 _ll_register_callbacks cb 0x5642526be8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:24.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.456+0000 7f917cb0d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a59780 0x564252a56a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:24.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.456+0000 7f917cb0d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a59780 0x564252a56a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53280/0 (socket says 172.21.15.7:53280) 2024-09-19T08:54:24.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.456+0000 7f917cb0d640 1 -- 172.21.15.7:0/2508971593 learned_addr learned my addr 172.21.15.7:0/2508971593 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:24.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.456+0000 7f917cb0d640 1 --2- 172.21.15.7:0/2508971593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564252a4a5d0 0x564252a59180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:24.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.456+0000 7f917d30e640 1 --2- 172.21.15.7:0/2508971593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564252a4bb40 0x564252a56430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:24.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.457+0000 7f917cb0d640 1 -- 172.21.15.7:0/2508971593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564252a4a5d0 msgr2=0x564252a59180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:24.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.457+0000 7f917cb0d640 1 --2- 172.21.15.7:0/2508971593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564252a4a5d0 0x564252a59180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.457+0000 7f917cb0d640 1 -- 172.21.15.7:0/2508971593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564252a4bb40 msgr2=0x564252a56430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:24.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.457+0000 7f917cb0d640 1 --2- 172.21.15.7:0/2508971593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564252a4bb40 0x564252a56430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.457+0000 7f917cb0d640 1 -- 172.21.15.7:0/2508971593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642527213c0 con 0x564252a59780 2024-09-19T08:54:24.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.457+0000 7f917cb0d640 1 --2- 172.21.15.7:0/2508971593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a59780 0x564252a56a20 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f9168005870 tx=0x7f9168003d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65f67d949bbbdc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:24.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.457+0000 7f9160ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:24.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.457+0000 7f9160ff9640 1 -- 172.21.15.7:0/2508971593 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9168027040 con 0x564252a59780 2024-09-19T08:54:24.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.457+0000 7f9160ff9640 1 -- 172.21.15.7:0/2508971593 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f91680035f0 con 0x564252a59780 2024-09-19T08:54:24.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.457+0000 7f918194b740 1 -- 172.21.15.7:0/2508971593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91680041d0 con 0x564252a59780 2024-09-19T08:54:24.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.457+0000 7f9160ff9640 1 -- 172.21.15.7:0/2508971593 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f91680037f0 con 0x564252a59780 2024-09-19T08:54:24.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.457+0000 7f918194b740 10 client.17565 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:24.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.457+0000 7f918194b740 1 -- 172.21.15.7:0/2508971593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564252a67f20 con 0x564252a59780 2024-09-19T08:54:24.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.457+0000 7f9160ff9640 1 -- 172.21.15.7:0/2508971593 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91680041d0 con 0x564252a59780 2024-09-19T08:54:24.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.458+0000 7f9160ff9640 1 -- 172.21.15.7:0/2508971593 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9168010ce0 con 0x564252a59780 2024-09-19T08:54:24.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.458+0000 7f918194b740 10 client.17565 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:24.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.458+0000 7f918194b740 10 client.17565 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:54:24.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.458+0000 7f918194b740 20 client.17565 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:24.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.458+0000 7f918194b740 1 --2- 172.21.15.7:0/2508971593 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x564252a69270 0x564252a6b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:24.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.458+0000 7f918194b740 4 client.17565 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:24.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.458+0000 7f918194b740 1 -- 172.21.15.7:0/2508971593 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642529bd860 con 0x564252a69270 2024-09-19T08:54:24.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.458+0000 7f917d30e640 1 --2- 172.21.15.7:0/2508971593 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x564252a69270 0x564252a6b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:24.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.459+0000 7f917d30e640 1 --2- 172.21.15.7:0/2508971593 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x564252a69270 0x564252a6b660 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ee885116b4e9bad0 server_cookie=d2fd16deffe0225f in_seq=0 out_seq=0 2024-09-19T08:54:24.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.459+0000 7f9160ff9640 10 client.17565 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:54:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.459+0000 7f9160ff9640 1 -- 172.21.15.7:0/2508971593 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5642529bd860 con 0x564252a69270 2024-09-19T08:54:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.459+0000 7f9160ff9640 10 client.17565 handle_command_reply: tid=0 2024-09-19T08:54:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.459+0000 7f918194b740 1 client.17565 shutdown 2024-09-19T08:54:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.460+0000 7f918194b740 1 -- 172.21.15.7:0/2508971593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a59780 msgr2=0x564252a56a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.460+0000 7f918194b740 1 --2- 172.21.15.7:0/2508971593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a59780 0x564252a56a20 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f9168005870 tx=0x7f9168003d10 comp rx=0 tx=0).stop 2024-09-19T08:54:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.460+0000 7f918194b740 1 -- 172.21.15.7:0/2508971593 shutdown_connections 2024-09-19T08:54:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.460+0000 7f918194b740 1 --2- 172.21.15.7:0/2508971593 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x564252a69270 0x564252a6b660 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.460+0000 7f918194b740 1 --2- 172.21.15.7:0/2508971593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a59780 0x564252a56a20 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.460+0000 7f9160ff9640 0 client.17565 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:54:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.460+0000 7f918194b740 1 --2- 172.21.15.7:0/2508971593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564252a4bb40 0x564252a56430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.460+0000 7f918194b740 1 --2- 172.21.15.7:0/2508971593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564252a4a5d0 0x564252a59180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.460+0000 7f918194b740 1 -- 172.21.15.7:0/2508971593 >> 172.21.15.7:0/2508971593 conn(0x564252a13310 msgr2=0x564252a4c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.460+0000 7f918194b740 1 -- 172.21.15.7:0/2508971593 shutdown_connections 2024-09-19T08:54:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.460+0000 7f918194b740 1 -- 172.21.15.7:0/2508971593 wait complete. 2024-09-19T08:54:24.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.460+0000 7f918194b740 20 client.17565 trim_cache size 0 max 16384 2024-09-19T08:54:24.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.473+0000 7f918194b740 1 Processor -- start 2024-09-19T08:54:24.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.473+0000 7f918194b740 1 -- start start 2024-09-19T08:54:24.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.473+0000 7f918194b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564252a4a5d0 0x564252a65720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:24.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.473+0000 7f918194b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564252a4bb40 0x564252a49bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:24.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.473+0000 7f918194b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a59780 0x564252a55410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:24.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.473+0000 7f918194b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f91781adfa0 con 0x564252a59780 2024-09-19T08:54:24.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.473+0000 7f918194b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f91781ab870 con 0x564252a4a5d0 2024-09-19T08:54:24.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.473+0000 7f918194b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f91781a96e0 con 0x564252a4bb40 2024-09-19T08:54:24.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.473+0000 7f917cb0d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a59780 0x564252a55410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:24.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.473+0000 7f917cb0d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a59780 0x564252a55410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53292/0 (socket says 172.21.15.7:53292) 2024-09-19T08:54:24.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.473+0000 7f917cb0d640 1 -- 172.21.15.7:0/3425863988 learned_addr learned my addr 172.21.15.7:0/3425863988 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:24.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.473+0000 7f917cb0d640 1 --2- 172.21.15.7:0/3425863988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564252a4a5d0 0x564252a65720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:24.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.473+0000 7f917d30e640 1 --2- 172.21.15.7:0/3425863988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564252a4bb40 0x564252a49bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:24.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.474+0000 7f917cb0d640 1 -- 172.21.15.7:0/3425863988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564252a4bb40 msgr2=0x564252a49bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:24.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.474+0000 7f917cb0d640 1 --2- 172.21.15.7:0/3425863988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564252a4bb40 0x564252a49bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.474+0000 7f917cb0d640 1 -- 172.21.15.7:0/3425863988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564252a4a5d0 msgr2=0x564252a65720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:24.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.474+0000 7f917cb0d640 1 --2- 172.21.15.7:0/3425863988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564252a4a5d0 0x564252a65720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.474+0000 7f917cb0d640 1 -- 172.21.15.7:0/3425863988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564252a54980 con 0x564252a59780 2024-09-19T08:54:24.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.474+0000 7f917cb0d640 1 --2- 172.21.15.7:0/3425863988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a59780 0x564252a55410 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f9168003d80 tx=0x7f916800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e01276f0398bb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:24.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.474+0000 7f9162ffd640 1 -- 172.21.15.7:0/3425863988 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916800b770 con 0x564252a59780 2024-09-19T08:54:24.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.474+0000 7f9162ffd640 1 -- 172.21.15.7:0/3425863988 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9168012180 con 0x564252a59780 2024-09-19T08:54:24.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.474+0000 7f9162ffd640 1 -- 172.21.15.7:0/3425863988 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9168010460 con 0x564252a59780 2024-09-19T08:54:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.474+0000 7f918194b740 1 -- 172.21.15.7:0/3425863988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a59780 msgr2=0x564252a55410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.474+0000 7f918194b740 1 --2- 172.21.15.7:0/3425863988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a59780 0x564252a55410 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f9168003d80 tx=0x7f916800bf10 comp rx=0 tx=0).stop 2024-09-19T08:54:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.475+0000 7f918194b740 1 -- 172.21.15.7:0/3425863988 shutdown_connections 2024-09-19T08:54:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.475+0000 7f918194b740 1 --2- 172.21.15.7:0/3425863988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a59780 0x564252a55410 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.475+0000 7f918194b740 1 --2- 172.21.15.7:0/3425863988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564252a4bb40 0x564252a49bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.475+0000 7f918194b740 1 --2- 172.21.15.7:0/3425863988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564252a4a5d0 0x564252a65720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.475+0000 7f918194b740 1 -- 172.21.15.7:0/3425863988 >> 172.21.15.7:0/3425863988 conn(0x564252a13310 msgr2=0x564252a54d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.475+0000 7f918194b740 1 -- 172.21.15.7:0/3425863988 shutdown_connections 2024-09-19T08:54:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.475+0000 7f918194b740 1 -- 172.21.15.7:0/3425863988 wait complete. 2024-09-19T08:54:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.475+0000 7f918194b740 1 -- start start 2024-09-19T08:54:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.475+0000 7f918194b740 1 Processor -- start 2024-09-19T08:54:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.475+0000 7f918194b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564252a4a5d0 0x564252a5cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.475+0000 7f918194b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a4bb40 0x564252a5d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.475+0000 7f918194b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564252a59780 0x564252acbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.475+0000 7f918194b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f91781a9d30 con 0x564252a4bb40 2024-09-19T08:54:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.476+0000 7f918194b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f91781ab1a0 con 0x564252a4a5d0 2024-09-19T08:54:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.476+0000 7f918194b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f91781aa400 con 0x564252a59780 2024-09-19T08:54:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.476+0000 7f918194b740 10 client.0 _ll_register_callbacks cb 0x7f91680123f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.476+0000 7f917d30e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a4bb40 0x564252a5d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.476+0000 7f917d30e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a4bb40 0x564252a5d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53302/0 (socket says 172.21.15.7:53302) 2024-09-19T08:54:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.476+0000 7f917d30e640 1 -- 172.21.15.7:0/3893000589 learned_addr learned my addr 172.21.15.7:0/3893000589 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.476+0000 7f917cb0d640 1 --2- 172.21.15.7:0/3893000589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564252a4a5d0 0x564252a5cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.476+0000 7f917cb0d640 1 --2- 172.21.15.7:0/3893000589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564252a59780 0x564252acbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.476+0000 7f917d30e640 1 -- 172.21.15.7:0/3893000589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564252a59780 msgr2=0x564252acbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.476+0000 7f917d30e640 1 --2- 172.21.15.7:0/3893000589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564252a59780 0x564252acbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.476+0000 7f917d30e640 1 -- 172.21.15.7:0/3893000589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564252a4a5d0 msgr2=0x564252a5cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.476+0000 7f917d30e640 1 --2- 172.21.15.7:0/3893000589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564252a4a5d0 0x564252a5cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.476+0000 7f917d30e640 1 -- 172.21.15.7:0/3893000589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564252acc380 con 0x564252a4bb40 2024-09-19T08:54:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.476+0000 7f917cb0d640 1 --2- 172.21.15.7:0/3893000589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564252a59780 0x564252acbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.476+0000 7f917d30e640 1 --2- 172.21.15.7:0/3893000589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a4bb40 0x564252a5d510 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x564252a47ac0 tx=0x7f917400bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a73cdb667be370a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.476+0000 7f9160ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.476+0000 7f9160ff9640 1 -- 172.21.15.7:0/3893000589 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917401d3b0 con 0x564252a4bb40 2024-09-19T08:54:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.476+0000 7f9160ff9640 1 -- 172.21.15.7:0/3893000589 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f917401d550 con 0x564252a4bb40 2024-09-19T08:54:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.476+0000 7f918194b740 1 -- 172.21.15.7:0/3893000589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9168012180 con 0x564252a4bb40 2024-09-19T08:54:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.477+0000 7f9160ff9640 1 -- 172.21.15.7:0/3893000589 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f917401d750 con 0x564252a4bb40 2024-09-19T08:54:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.477+0000 7f918194b740 10 client.17571 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.477+0000 7f918194b740 1 -- 172.21.15.7:0/3893000589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564252ad3770 con 0x564252a4bb40 2024-09-19T08:54:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.477+0000 7f9160ff9640 1 -- 172.21.15.7:0/3893000589 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9168012180 con 0x564252a4bb40 2024-09-19T08:54:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.477+0000 7f9160ff9640 1 -- 172.21.15.7:0/3893000589 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9174024030 con 0x564252a4bb40 2024-09-19T08:54:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.477+0000 7f918194b740 10 client.17571 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.477+0000 7f918194b740 10 client.17571 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:54:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.477+0000 7f918194b740 20 client.17571 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.477+0000 7f918194b740 1 --2- 172.21.15.7:0/3893000589 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x564252a69270 0x564252ad5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.477+0000 7f918194b740 4 client.17571 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:54:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.477+0000 7f918194b740 1 -- 172.21.15.7:0/3893000589 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5642529b7d70 con 0x564252a69270 2024-09-19T08:54:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.477+0000 7f917cb0d640 1 --2- 172.21.15.7:0/3893000589 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x564252a69270 0x564252ad5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.478+0000 7f917cb0d640 1 --2- 172.21.15.7:0/3893000589 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x564252a69270 0x564252ad5f60 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8071d510e0f15790 server_cookie=f1ef03493dc95a0c in_seq=0 out_seq=0 2024-09-19T08:54:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.478+0000 7f9160ff9640 10 client.17571 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:54:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.478+0000 7f9160ff9640 1 -- 172.21.15.7:0/3893000589 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5642529b7d70 con 0x564252a69270 2024-09-19T08:54:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.478+0000 7f9160ff9640 10 client.17571 handle_command_reply: tid=0 2024-09-19T08:54:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.478+0000 7f918194b740 1 client.17571 shutdown 2024-09-19T08:54:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.478+0000 7f918194b740 1 -- 172.21.15.7:0/3893000589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a4bb40 msgr2=0x564252a5d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.478+0000 7f918194b740 1 --2- 172.21.15.7:0/3893000589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a4bb40 0x564252a5d510 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x564252a47ac0 tx=0x7f917400bdf0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.478+0000 7f918194b740 1 -- 172.21.15.7:0/3893000589 shutdown_connections 2024-09-19T08:54:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.478+0000 7f918194b740 1 --2- 172.21.15.7:0/3893000589 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x564252a69270 0x564252ad5f60 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.478+0000 7f918194b740 1 --2- 172.21.15.7:0/3893000589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564252a59780 0x564252acbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.478+0000 7f918194b740 1 --2- 172.21.15.7:0/3893000589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564252a4bb40 0x564252a5d510 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.478+0000 7f918194b740 1 --2- 172.21.15.7:0/3893000589 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564252a4a5d0 0x564252a5cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.478+0000 7f918194b740 1 -- 172.21.15.7:0/3893000589 >> 172.21.15.7:0/3893000589 conn(0x564252a13310 msgr2=0x564252a55520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.478+0000 7f9160ff9640 0 client.17571 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:54:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.478+0000 7f918194b740 1 -- 172.21.15.7:0/3893000589 shutdown_connections 2024-09-19T08:54:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.478+0000 7f918194b740 1 -- 172.21.15.7:0/3893000589 wait complete. 2024-09-19T08:54:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.478+0000 7f918194b740 20 client.17571 trim_cache size 0 max 16384 2024-09-19T08:54:24.486 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:54:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.479+0000 7f917f572640 1 -- 172.21.15.7:0/850741102 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f91640a3430 msgr2=0x7f91640a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.479+0000 7f917f572640 1 --2- 172.21.15.7:0/850741102 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f91640a3430 0x7f91640a58f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f91700ee7b0 tx=0x7f9170087840 comp rx=0 tx=0).stop 2024-09-19T08:54:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.479+0000 7f917f572640 1 -- 172.21.15.7:0/850741102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917810c170 msgr2=0x7f917819cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.479+0000 7f917f572640 1 --2- 172.21.15.7:0/850741102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917810c170 0x7f917819cce0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f917002ae70 tx=0x7f917002f5b0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.479+0000 7f917f572640 1 -- 172.21.15.7:0/850741102 shutdown_connections 2024-09-19T08:54:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.479+0000 7f917f572640 1 --2- 172.21.15.7:0/850741102 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f91640a3430 0x7f91640a58f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.479+0000 7f917f572640 1 --2- 172.21.15.7:0/850741102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f917810c170 0x7f917819cce0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.479+0000 7f917f572640 1 --2- 172.21.15.7:0/850741102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9178103660 0x7f9178198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.479+0000 7f917f572640 1 --2- 172.21.15.7:0/850741102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9178102d40 0x7f9178198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.479+0000 7f917f572640 1 -- 172.21.15.7:0/850741102 >> 172.21.15.7:0/850741102 conn(0x7f91780fc7a0 msgr2=0x7f91780fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.479+0000 7f917f572640 1 -- 172.21.15.7:0/850741102 shutdown_connections 2024-09-19T08:54:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:24.479+0000 7f917f572640 1 -- 172.21.15.7:0/850741102 wait complete. 2024-09-19T08:54:25.228 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:25 smithi007 ceph-mon[31221]: pgmap v307: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:54:25.264 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:54:25.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:25 smithi175 ceph-mon[35688]: pgmap v307: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:54:25.529 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:25.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:25 smithi044 ceph-mon[35072]: pgmap v307: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:54:25.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.965+0000 7f59c9a0f640 1 -- 172.21.15.7:0/1790415577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c4106a80 msgr2=0x7f59c4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:25.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.965+0000 7f59c9a0f640 1 --2- 172.21.15.7:0/1790415577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c4106a80 0x7f59c4106e60 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009930 tx=0x7f59b402a420 comp rx=0 tx=0).stop 2024-09-19T08:54:25.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.965+0000 7f59c9a0f640 1 -- 172.21.15.7:0/1790415577 shutdown_connections 2024-09-19T08:54:25.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.965+0000 7f59c9a0f640 1 --2- 172.21.15.7:0/1790415577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59c4101420 0x7f59c410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.965+0000 7f59c9a0f640 1 --2- 172.21.15.7:0/1790415577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59c4100a80 0x7f59c4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.965+0000 7f59c9a0f640 1 --2- 172.21.15.7:0/1790415577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c4106a80 0x7f59c4106e60 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.965+0000 7f59c9a0f640 1 -- 172.21.15.7:0/1790415577 >> 172.21.15.7:0/1790415577 conn(0x7f59c40fc7a0 msgr2=0x7f59c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:25.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.965+0000 7f59c9a0f640 1 -- 172.21.15.7:0/1790415577 shutdown_connections 2024-09-19T08:54:25.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.965+0000 7f59c9a0f640 1 -- 172.21.15.7:0/1790415577 wait complete. 2024-09-19T08:54:25.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.966+0000 7f59c9a0f640 1 Processor -- start 2024-09-19T08:54:25.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.966+0000 7f59c9a0f640 1 -- start start 2024-09-19T08:54:25.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.966+0000 7f59c9a0f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59c4100a80 0x7f59c4198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.966+0000 7f59c9a0f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c4101420 0x7f59c41989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.966+0000 7f59c9a0f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59c4106a80 0x7f59c419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.966+0000 7f59c9a0f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f59c4111fa0 con 0x7f59c4101420 2024-09-19T08:54:25.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.966+0000 7f59c9a0f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f59c4111e20 con 0x7f59c4100a80 2024-09-19T08:54:25.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.966+0000 7f59c9a0f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f59c4112120 con 0x7f59c4106a80 2024-09-19T08:54:25.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.966+0000 7f59ba7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c4101420 0x7f59c41989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.966+0000 7f59ba7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c4101420 0x7f59c41989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53316/0 (socket says 172.21.15.7:53316) 2024-09-19T08:54:25.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.966+0000 7f59ba7fc640 1 -- 172.21.15.7:0/799067807 learned_addr learned my addr 172.21.15.7:0/799067807 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:25.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.966+0000 7f59c37fe640 1 --2- 172.21.15.7:0/799067807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59c4106a80 0x7f59c419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.966+0000 7f59c2ffd640 1 --2- 172.21.15.7:0/799067807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59c4100a80 0x7f59c4198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.966+0000 7f59ba7fc640 1 -- 172.21.15.7:0/799067807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59c4106a80 msgr2=0x7f59c419cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:25.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.966+0000 7f59ba7fc640 1 --2- 172.21.15.7:0/799067807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59c4106a80 0x7f59c419cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.967+0000 7f59ba7fc640 1 -- 172.21.15.7:0/799067807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59c4100a80 msgr2=0x7f59c4198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:25.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.967+0000 7f59ba7fc640 1 --2- 172.21.15.7:0/799067807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59c4100a80 0x7f59c4198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.967+0000 7f59ba7fc640 1 -- 172.21.15.7:0/799067807 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c419d430 con 0x7f59c4101420 2024-09-19T08:54:25.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.967+0000 7f59c37fe640 1 --2- 172.21.15.7:0/799067807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59c4106a80 0x7f59c419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:25.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.967+0000 7f59ba7fc640 1 --2- 172.21.15.7:0/799067807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c4101420 0x7f59c41989c0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00e9f0 tx=0x7f59ac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:25.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.967+0000 7f59c8a0d640 1 -- 172.21.15.7:0/799067807 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac00cd80 con 0x7f59c4101420 2024-09-19T08:54:25.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.967+0000 7f59c9a0f640 1 -- 172.21.15.7:0/799067807 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c419d720 con 0x7f59c4101420 2024-09-19T08:54:25.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.967+0000 7f59c8a0d640 1 -- 172.21.15.7:0/799067807 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59ac010910 con 0x7f59c4101420 2024-09-19T08:54:25.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.967+0000 7f59c8a0d640 1 -- 172.21.15.7:0/799067807 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac018990 con 0x7f59c4101420 2024-09-19T08:54:25.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.967+0000 7f59c9a0f640 1 -- 172.21.15.7:0/799067807 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c41a5000 con 0x7f59c4101420 2024-09-19T08:54:25.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.969+0000 7f59c8a0d640 1 -- 172.21.15.7:0/799067807 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f59ac010ac0 con 0x7f59c4101420 2024-09-19T08:54:25.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.969+0000 7f59cbde8740 1 Processor -- start 2024-09-19T08:54:25.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.970+0000 7f59cbde8740 1 -- start start 2024-09-19T08:54:25.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.970+0000 7f59cbde8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e0f7b40 0x55b13e0f6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.970+0000 7f59cbde8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b13e0f65d0 0x55b13e0f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.970+0000 7f59cbde8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13e101370 0x55b13e103760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.970+0000 7f59cbde8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b13e05c2f0 con 0x55b13e0f7b40 2024-09-19T08:54:25.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.970+0000 7f59cbde8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b13e003cf0 con 0x55b13e101370 2024-09-19T08:54:25.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.970+0000 7f59cbde8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b13e0582b0 con 0x55b13e0f65d0 2024-09-19T08:54:25.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.970+0000 7f59c37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e0f7b40 0x55b13e0f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.970+0000 7f59c37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e0f7b40 0x55b13e0f6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53332/0 (socket says 172.21.15.7:53332) 2024-09-19T08:54:25.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.970+0000 7f59c37fe640 1 -- 172.21.15.7:0/3423346193 learned_addr learned my addr 172.21.15.7:0/3423346193 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:25.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.970+0000 7f59ba7fc640 1 --2- 172.21.15.7:0/3423346193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13e101370 0x55b13e103760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.970+0000 7f59c2ffd640 1 --2- 172.21.15.7:0/3423346193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b13e0f65d0 0x55b13e0f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.970+0000 7f59c8a0d640 1 --2- 172.21.15.7:0/799067807 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f59b00a33b0 0x7f59b00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.970+0000 7f59c37fe640 1 -- 172.21.15.7:0/3423346193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b13e0f65d0 msgr2=0x55b13e0f6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:25.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.970+0000 7f59c37fe640 1 --2- 172.21.15.7:0/3423346193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b13e0f65d0 0x55b13e0f6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.970+0000 7f59c37fe640 1 -- 172.21.15.7:0/3423346193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13e101370 msgr2=0x55b13e103760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:25.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.970+0000 7f59c37fe640 1 --2- 172.21.15.7:0/3423346193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13e101370 0x55b13e103760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.970+0000 7f59c37fe640 1 -- 172.21.15.7:0/3423346193 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b13dfe83a0 con 0x55b13e0f7b40 2024-09-19T08:54:25.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.970+0000 7f59c8a0d640 1 -- 172.21.15.7:0/799067807 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f59ac0d0150 con 0x7f59c4101420 2024-09-19T08:54:25.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.971+0000 7f59c37fe640 1 --2- 172.21.15.7:0/799067807 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f59b00a33b0 0x7f59b00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.971+0000 7f59c37fe640 1 --2- 172.21.15.7:0/3423346193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e0f7b40 0x55b13e0f6090 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00a2b0 tx=0x7f59bc00e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadb2aff0a5da728 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:25.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.971+0000 7f59b9ffb640 1 -- 172.21.15.7:0/3423346193 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc022070 con 0x55b13e0f7b40 2024-09-19T08:54:25.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.971+0000 7f59b9ffb640 1 -- 172.21.15.7:0/3423346193 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59bc018070 con 0x55b13e0f7b40 2024-09-19T08:54:25.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.971+0000 7f59b9ffb640 1 -- 172.21.15.7:0/3423346193 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc01b390 con 0x55b13e0f7b40 2024-09-19T08:54:25.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.972+0000 7f59cbde8740 1 -- 172.21.15.7:0/3423346193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e0f7b40 msgr2=0x55b13e0f6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:25.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.972+0000 7f59cbde8740 1 --2- 172.21.15.7:0/3423346193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e0f7b40 0x55b13e0f6090 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00a2b0 tx=0x7f59bc00e7e0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.972+0000 7f59c37fe640 1 --2- 172.21.15.7:0/799067807 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f59b00a33b0 0x7f59b00a5870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f59bc01f000 tx=0x7f59bc020000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:25.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.972+0000 7f59cbde8740 1 -- 172.21.15.7:0/3423346193 shutdown_connections 2024-09-19T08:54:25.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.972+0000 7f59cbde8740 1 --2- 172.21.15.7:0/3423346193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13e101370 0x55b13e103760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.972+0000 7f59cbde8740 1 --2- 172.21.15.7:0/3423346193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b13e0f65d0 0x55b13e0f6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.972+0000 7f59cbde8740 1 --2- 172.21.15.7:0/3423346193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e0f7b40 0x55b13e0f6090 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.972+0000 7f59cbde8740 1 -- 172.21.15.7:0/3423346193 >> 172.21.15.7:0/3423346193 conn(0x55b13e0bf310 msgr2=0x55b13e0f2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:25.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.972+0000 7f59cbde8740 1 -- 172.21.15.7:0/3423346193 shutdown_connections 2024-09-19T08:54:25.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.972+0000 7f59cbde8740 1 -- 172.21.15.7:0/3423346193 wait complete. 2024-09-19T08:54:25.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.972+0000 7f59cbde8740 1 -- start start 2024-09-19T08:54:25.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.972+0000 7f59cbde8740 1 Processor -- start 2024-09-19T08:54:25.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.973+0000 7f59cbde8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e0f65d0 0x55b13e100d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.973+0000 7f59cbde8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13e0f7b40 0x55b13e0fe000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.973+0000 7f59cbde8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b13e101370 0x55b13e0fe5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.973+0000 7f59cbde8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b13e104070 con 0x55b13e0f65d0 2024-09-19T08:54:25.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.973+0000 7f59cbde8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b13e017060 con 0x55b13e0f7b40 2024-09-19T08:54:25.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.973+0000 7f59cbde8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b13e1041f0 con 0x55b13e101370 2024-09-19T08:54:25.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.973+0000 7f59cbde8740 10 client.0 _ll_register_callbacks cb 0x55b13dd6a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:25.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.973+0000 7f59c2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e0f65d0 0x55b13e100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.973+0000 7f59c2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e0f65d0 0x55b13e100d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53348/0 (socket says 172.21.15.7:53348) 2024-09-19T08:54:25.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.973+0000 7f59c2ffd640 1 -- 172.21.15.7:0/2058509360 learned_addr learned my addr 172.21.15.7:0/2058509360 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:25.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.973+0000 7f59c37fe640 1 --2- 172.21.15.7:0/2058509360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b13e101370 0x55b13e0fe5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.973+0000 7f59ba7fc640 1 --2- 172.21.15.7:0/2058509360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13e0f7b40 0x55b13e0fe000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.973+0000 7f59c2ffd640 1 -- 172.21.15.7:0/2058509360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b13e101370 msgr2=0x55b13e0fe5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:25.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.973+0000 7f59c2ffd640 1 --2- 172.21.15.7:0/2058509360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b13e101370 0x55b13e0fe5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.973+0000 7f59c2ffd640 1 -- 172.21.15.7:0/2058509360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13e0f7b40 msgr2=0x55b13e0fe000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:25.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.973+0000 7f59c2ffd640 1 --2- 172.21.15.7:0/2058509360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13e0f7b40 0x55b13e0fe000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.973+0000 7f59c2ffd640 1 -- 172.21.15.7:0/2058509360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b13ddcd3c0 con 0x55b13e0f65d0 2024-09-19T08:54:25.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.973+0000 7f59c2ffd640 1 --2- 172.21.15.7:0/2058509360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e0f65d0 0x55b13e100d50 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009930 tx=0x7f59b4031920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7325f903b80889 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:25.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.973+0000 7f59a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:25.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.974+0000 7f59a2ffd640 1 -- 172.21.15.7:0/2058509360 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b4035040 con 0x55b13e0f65d0 2024-09-19T08:54:25.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.974+0000 7f59a2ffd640 1 -- 172.21.15.7:0/2058509360 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f59b4004240 con 0x55b13e0f65d0 2024-09-19T08:54:25.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.974+0000 7f59cbde8740 1 -- 172.21.15.7:0/2058509360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59bc018070 con 0x55b13e0f65d0 2024-09-19T08:54:25.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.974+0000 7f59a2ffd640 1 -- 172.21.15.7:0/2058509360 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f59b4004440 con 0x55b13e0f65d0 2024-09-19T08:54:25.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.974+0000 7f59cbde8740 10 client.17583 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:25.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.974+0000 7f59cbde8740 1 -- 172.21.15.7:0/2058509360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b13e10faf0 con 0x55b13e0f65d0 2024-09-19T08:54:25.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.974+0000 7f59a2ffd640 1 -- 172.21.15.7:0/2058509360 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59bc018070 con 0x55b13e0f65d0 2024-09-19T08:54:25.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.974+0000 7f59a2ffd640 1 -- 172.21.15.7:0/2058509360 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f59b4004bc0 con 0x55b13e0f65d0 2024-09-19T08:54:25.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.974+0000 7f59cbde8740 10 client.17583 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:25.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.974+0000 7f59cbde8740 10 client.17583 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:25.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.974+0000 7f59cbde8740 20 client.17583 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:25.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.974+0000 7f59cbde8740 1 --2- 172.21.15.7:0/2058509360 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b13e110fb0 0x55b13e1133a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.974+0000 7f59cbde8740 4 client.17583 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:25.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.974+0000 7f59cbde8740 1 -- 172.21.15.7:0/2058509360 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b13e069860 con 0x55b13e110fb0 2024-09-19T08:54:25.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.975+0000 7f59ba7fc640 1 --2- 172.21.15.7:0/2058509360 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b13e110fb0 0x55b13e1133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.975+0000 7f59ba7fc640 1 --2- 172.21.15.7:0/2058509360 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b13e110fb0 0x55b13e1133a0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=530acf95895add7e server_cookie=2255b0974622f72a in_seq=0 out_seq=0 2024-09-19T08:54:25.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.975+0000 7f59a2ffd640 10 client.17583 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:25.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.976+0000 7f59a2ffd640 1 -- 172.21.15.7:0/2058509360 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b13e069860 con 0x55b13e110fb0 2024-09-19T08:54:25.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.976+0000 7f59a2ffd640 10 client.17583 handle_command_reply: tid=0 2024-09-19T08:54:25.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.976+0000 7f59cbde8740 1 client.17583 shutdown 2024-09-19T08:54:25.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.976+0000 7f59cbde8740 1 -- 172.21.15.7:0/2058509360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e0f65d0 msgr2=0x55b13e100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:25.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.976+0000 7f59cbde8740 1 --2- 172.21.15.7:0/2058509360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e0f65d0 0x55b13e100d50 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009930 tx=0x7f59b4031920 comp rx=0 tx=0).stop 2024-09-19T08:54:25.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.976+0000 7f59cbde8740 1 -- 172.21.15.7:0/2058509360 shutdown_connections 2024-09-19T08:54:25.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.976+0000 7f59cbde8740 1 --2- 172.21.15.7:0/2058509360 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b13e110fb0 0x55b13e1133a0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.976+0000 7f59cbde8740 1 --2- 172.21.15.7:0/2058509360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b13e101370 0x55b13e0fe5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.976+0000 7f59cbde8740 1 --2- 172.21.15.7:0/2058509360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13e0f7b40 0x55b13e0fe000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.976+0000 7f59cbde8740 1 --2- 172.21.15.7:0/2058509360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e0f65d0 0x55b13e100d50 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.976+0000 7f59a2ffd640 0 client.17583 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:25.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.976+0000 7f59cbde8740 1 -- 172.21.15.7:0/2058509360 >> 172.21.15.7:0/2058509360 conn(0x55b13e0bf310 msgr2=0x55b13e0f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:25.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.976+0000 7f59cbde8740 1 -- 172.21.15.7:0/2058509360 shutdown_connections 2024-09-19T08:54:25.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.976+0000 7f59cbde8740 1 -- 172.21.15.7:0/2058509360 wait complete. 2024-09-19T08:54:25.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.976+0000 7f59cbde8740 20 client.17583 trim_cache size 0 max 16384 2024-09-19T08:54:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.989+0000 7f59cbde8740 1 Processor -- start 2024-09-19T08:54:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.989+0000 7f59cbde8740 1 -- start start 2024-09-19T08:54:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.989+0000 7f59cbde8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b13e0f65d0 0x55b13e0f1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.990+0000 7f59cbde8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13e0f7b40 0x55b13e109860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.990+0000 7f59cbde8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e101370 0x55b13e109da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.990+0000 7f59cbde8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f59c41b0340 con 0x55b13e101370 2024-09-19T08:54:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.990+0000 7f59cbde8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f59c41adc10 con 0x55b13e0f7b40 2024-09-19T08:54:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.990+0000 7f59cbde8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f59c41aba80 con 0x55b13e0f65d0 2024-09-19T08:54:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.990+0000 7f59c37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e101370 0x55b13e109da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.990+0000 7f59c37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e101370 0x55b13e109da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53358/0 (socket says 172.21.15.7:53358) 2024-09-19T08:54:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.990+0000 7f59c37fe640 1 -- 172.21.15.7:0/1868765647 learned_addr learned my addr 172.21.15.7:0/1868765647 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.990+0000 7f59ba7fc640 1 --2- 172.21.15.7:0/1868765647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13e0f7b40 0x55b13e109860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.990+0000 7f59c2ffd640 1 --2- 172.21.15.7:0/1868765647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b13e0f65d0 0x55b13e0f1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.990+0000 7f59c37fe640 1 -- 172.21.15.7:0/1868765647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b13e0f65d0 msgr2=0x55b13e0f1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.990+0000 7f59c37fe640 1 --2- 172.21.15.7:0/1868765647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b13e0f65d0 0x55b13e0f1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.990+0000 7f59c37fe640 1 -- 172.21.15.7:0/1868765647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13e0f7b40 msgr2=0x55b13e109860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.990+0000 7f59c37fe640 1 --2- 172.21.15.7:0/1868765647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13e0f7b40 0x55b13e109860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.990+0000 7f59c37fe640 1 -- 172.21.15.7:0/1868765647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b13e0fc550 con 0x55b13e101370 2024-09-19T08:54:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.990+0000 7f59c2ffd640 1 --2- 172.21.15.7:0/1868765647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b13e0f65d0 0x55b13e0f1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.990+0000 7f59ba7fc640 1 --2- 172.21.15.7:0/1868765647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13e0f7b40 0x55b13e109860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.990+0000 7f59c37fe640 1 --2- 172.21.15.7:0/1868765647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e101370 0x55b13e109da0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f59bc012fd0 tx=0x7f59bc026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3184ed27d5c8bba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:25.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.990+0000 7f59b97fa640 1 -- 172.21.15.7:0/1868765647 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc022050 con 0x55b13e101370 2024-09-19T08:54:25.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.990+0000 7f59b97fa640 1 -- 172.21.15.7:0/1868765647 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59bc035070 con 0x55b13e101370 2024-09-19T08:54:25.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.990+0000 7f59b97fa640 1 -- 172.21.15.7:0/1868765647 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc02c040 con 0x55b13e101370 2024-09-19T08:54:25.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.991+0000 7f59cbde8740 1 -- 172.21.15.7:0/1868765647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e101370 msgr2=0x55b13e109da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:25.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.991+0000 7f59cbde8740 1 --2- 172.21.15.7:0/1868765647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e101370 0x55b13e109da0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f59bc012fd0 tx=0x7f59bc026000 comp rx=0 tx=0).stop 2024-09-19T08:54:25.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.991+0000 7f59cbde8740 1 -- 172.21.15.7:0/1868765647 shutdown_connections 2024-09-19T08:54:25.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.991+0000 7f59cbde8740 1 --2- 172.21.15.7:0/1868765647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e101370 0x55b13e109da0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.991+0000 7f59cbde8740 1 --2- 172.21.15.7:0/1868765647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13e0f7b40 0x55b13e109860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.991+0000 7f59cbde8740 1 --2- 172.21.15.7:0/1868765647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b13e0f65d0 0x55b13e0f1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.991+0000 7f59cbde8740 1 -- 172.21.15.7:0/1868765647 >> 172.21.15.7:0/1868765647 conn(0x55b13e0bf310 msgr2=0x55b13e0f1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:25.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.991+0000 7f59cbde8740 1 -- 172.21.15.7:0/1868765647 shutdown_connections 2024-09-19T08:54:25.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.991+0000 7f59cbde8740 1 -- 172.21.15.7:0/1868765647 wait complete. 2024-09-19T08:54:25.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.991+0000 7f59cbde8740 1 -- start start 2024-09-19T08:54:25.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.992+0000 7f59cbde8740 1 Processor -- start 2024-09-19T08:54:25.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.992+0000 7f59cbde8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e0f65d0 0x55b13e173c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.992+0000 7f59cbde8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b13e0f7b40 0x55b13e174140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.992+0000 7f59cbde8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13e101370 0x55b13e17ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.992+0000 7f59cbde8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f59c41ac0d0 con 0x55b13e0f65d0 2024-09-19T08:54:25.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.992+0000 7f59cbde8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f59c41ad540 con 0x55b13e101370 2024-09-19T08:54:25.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.992+0000 7f59cbde8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f59c41ac7a0 con 0x55b13e0f7b40 2024-09-19T08:54:25.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.992+0000 7f59cbde8740 10 client.0 _ll_register_callbacks cb 0x7f59b4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:25.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.992+0000 7f59c2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e0f65d0 0x55b13e173c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.992+0000 7f59c2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e0f65d0 0x55b13e173c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53368/0 (socket says 172.21.15.7:53368) 2024-09-19T08:54:25.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.992+0000 7f59c2ffd640 1 -- 172.21.15.7:0/2641340944 learned_addr learned my addr 172.21.15.7:0/2641340944 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:25.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.992+0000 7f59c37fe640 1 --2- 172.21.15.7:0/2641340944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13e101370 0x55b13e17ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.992+0000 7f59ba7fc640 1 --2- 172.21.15.7:0/2641340944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b13e0f7b40 0x55b13e174140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.992+0000 7f59c2ffd640 1 -- 172.21.15.7:0/2641340944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b13e0f7b40 msgr2=0x55b13e174140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:25.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.992+0000 7f59c2ffd640 1 --2- 172.21.15.7:0/2641340944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b13e0f7b40 0x55b13e174140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.992+0000 7f59c2ffd640 1 -- 172.21.15.7:0/2641340944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13e101370 msgr2=0x55b13e17ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:25.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.992+0000 7f59c2ffd640 1 --2- 172.21.15.7:0/2641340944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13e101370 0x55b13e17ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.992+0000 7f59c2ffd640 1 -- 172.21.15.7:0/2641340944 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b13e17f1c0 con 0x55b13e0f65d0 2024-09-19T08:54:25.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.992+0000 7f59c37fe640 1 --2- 172.21.15.7:0/2641340944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13e101370 0x55b13e17ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:25.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.993+0000 7f59c2ffd640 1 --2- 172.21.15.7:0/2641340944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e0f65d0 0x55b13e173c00 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f59b4000c00 tx=0x7f59b4005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230b6ec47afd398c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:25.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.993+0000 7f59a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:25.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.993+0000 7f59a2ffd640 1 -- 172.21.15.7:0/2641340944 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b4035070 con 0x55b13e0f65d0 2024-09-19T08:54:25.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.993+0000 7f59a2ffd640 1 -- 172.21.15.7:0/2641340944 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f59b4005490 con 0x55b13e0f65d0 2024-09-19T08:54:25.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.993+0000 7f59cbde8740 1 -- 172.21.15.7:0/2641340944 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59bc035070 con 0x55b13e0f65d0 2024-09-19T08:54:25.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.993+0000 7f59a2ffd640 1 -- 172.21.15.7:0/2641340944 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f59b4051040 con 0x55b13e0f65d0 2024-09-19T08:54:25.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.993+0000 7f59cbde8740 10 client.17589 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:25.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.993+0000 7f59cbde8740 1 -- 172.21.15.7:0/2641340944 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b13e1802f0 con 0x55b13e0f65d0 2024-09-19T08:54:25.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.993+0000 7f59a2ffd640 1 -- 172.21.15.7:0/2641340944 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59bc035070 con 0x55b13e0f65d0 2024-09-19T08:54:25.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.993+0000 7f59a2ffd640 1 -- 172.21.15.7:0/2641340944 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f59b405c030 con 0x55b13e0f65d0 2024-09-19T08:54:25.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.993+0000 7f59cbde8740 10 client.17589 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:25.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.993+0000 7f59cbde8740 10 client.17589 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:25.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.993+0000 7f59cbde8740 20 client.17589 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:25.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.993+0000 7f59cbde8740 1 --2- 172.21.15.7:0/2641340944 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b13e180ac0 0x55b13e182ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.993+0000 7f59cbde8740 4 client.17589 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:54:25.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.993+0000 7f59cbde8740 1 -- 172.21.15.7:0/2641340944 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b13e063d70 con 0x55b13e180ac0 2024-09-19T08:54:26.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.994+0000 7f59ba7fc640 1 --2- 172.21.15.7:0/2641340944 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b13e180ac0 0x55b13e182ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:26.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.994+0000 7f59ba7fc640 1 --2- 172.21.15.7:0/2641340944 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b13e180ac0 0x55b13e182ee0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbaf86aed2abed6b server_cookie=83e25a257391922a in_seq=0 out_seq=0 2024-09-19T08:54:26.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.994+0000 7f59a2ffd640 10 client.17589 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:26.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.994+0000 7f59a2ffd640 1 -- 172.21.15.7:0/2641340944 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b13e063d70 con 0x55b13e180ac0 2024-09-19T08:54:26.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.994+0000 7f59a2ffd640 10 client.17589 handle_command_reply: tid=0 2024-09-19T08:54:26.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.994+0000 7f59cbde8740 1 client.17589 shutdown 2024-09-19T08:54:26.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.994+0000 7f59cbde8740 1 -- 172.21.15.7:0/2641340944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e0f65d0 msgr2=0x55b13e173c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:26.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.995+0000 7f59cbde8740 1 --2- 172.21.15.7:0/2641340944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e0f65d0 0x55b13e173c00 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f59b4000c00 tx=0x7f59b4005bc0 comp rx=0 tx=0).stop 2024-09-19T08:54:26.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.995+0000 7f59cbde8740 1 -- 172.21.15.7:0/2641340944 shutdown_connections 2024-09-19T08:54:26.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.995+0000 7f59cbde8740 1 --2- 172.21.15.7:0/2641340944 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55b13e180ac0 0x55b13e182ee0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:26.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.995+0000 7f59cbde8740 1 --2- 172.21.15.7:0/2641340944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b13e101370 0x55b13e17ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:26.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.995+0000 7f59cbde8740 1 --2- 172.21.15.7:0/2641340944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b13e0f7b40 0x55b13e174140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:26.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.995+0000 7f59cbde8740 1 --2- 172.21.15.7:0/2641340944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b13e0f65d0 0x55b13e173c00 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:26.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.995+0000 7f59a2ffd640 0 client.17589 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:26.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.995+0000 7f59cbde8740 1 -- 172.21.15.7:0/2641340944 >> 172.21.15.7:0/2641340944 conn(0x55b13e0bf310 msgr2=0x55b13e0f1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:26.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.995+0000 7f59cbde8740 1 -- 172.21.15.7:0/2641340944 shutdown_connections 2024-09-19T08:54:26.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.995+0000 7f59cbde8740 1 -- 172.21.15.7:0/2641340944 wait complete. 2024-09-19T08:54:26.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.995+0000 7f59cbde8740 20 client.17589 trim_cache size 0 max 16384 2024-09-19T08:54:26.001 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:54:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.995+0000 7f59c9a0f640 1 -- 172.21.15.7:0/799067807 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f59b00a33b0 msgr2=0x7f59b00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.995+0000 7f59c9a0f640 1 --2- 172.21.15.7:0/799067807 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f59b00a33b0 0x7f59b00a5870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f59bc01f000 tx=0x7f59bc020000 comp rx=0 tx=0).stop 2024-09-19T08:54:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.995+0000 7f59c9a0f640 1 -- 172.21.15.7:0/799067807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c4101420 msgr2=0x7f59c41989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.995+0000 7f59c9a0f640 1 --2- 172.21.15.7:0/799067807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c4101420 0x7f59c41989c0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00e9f0 tx=0x7f59ac00eeb0 comp rx=0 tx=0).stop 2024-09-19T08:54:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.995+0000 7f59c9a0f640 1 -- 172.21.15.7:0/799067807 shutdown_connections 2024-09-19T08:54:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.995+0000 7f59c9a0f640 1 --2- 172.21.15.7:0/799067807 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f59b00a33b0 0x7f59b00a5870 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.995+0000 7f59c9a0f640 1 --2- 172.21.15.7:0/799067807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59c4106a80 0x7f59c419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.995+0000 7f59c9a0f640 1 --2- 172.21.15.7:0/799067807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c4101420 0x7f59c41989c0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.995+0000 7f59c9a0f640 1 --2- 172.21.15.7:0/799067807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59c4100a80 0x7f59c4198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.995+0000 7f59c9a0f640 1 -- 172.21.15.7:0/799067807 >> 172.21.15.7:0/799067807 conn(0x7f59c40fc7a0 msgr2=0x7f59c40fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.996+0000 7f59c9a0f640 1 -- 172.21.15.7:0/799067807 shutdown_connections 2024-09-19T08:54:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:25.996+0000 7f59c9a0f640 1 -- 172.21.15.7:0/799067807 wait complete. 2024-09-19T08:54:27.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:27 smithi175 ceph-mon[35688]: pgmap v308: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:54:27.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:27 smithi007 ceph-mon[31221]: pgmap v308: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:54:27.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:27 smithi044 ceph-mon[35072]: pgmap v308: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T08:54:27.799 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:54:27.799 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:54:28.070 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.534+0000 7f36f46c1640 1 -- 172.21.15.7:0/2457141341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36ec100a80 msgr2=0x7f36ec100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.534+0000 7f36f46c1640 1 --2- 172.21.15.7:0/2457141341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36ec100a80 0x7f36ec100ee0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f36dc009930 tx=0x7f36dc02a420 comp rx=0 tx=0).stop 2024-09-19T08:54:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.535+0000 7f36f46c1640 1 -- 172.21.15.7:0/2457141341 shutdown_connections 2024-09-19T08:54:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.535+0000 7f36f46c1640 1 --2- 172.21.15.7:0/2457141341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36ec101420 0x7f36ec10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.535+0000 7f36f46c1640 1 --2- 172.21.15.7:0/2457141341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36ec100a80 0x7f36ec100ee0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.535+0000 7f36f46c1640 1 --2- 172.21.15.7:0/2457141341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ec106a80 0x7f36ec106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.535+0000 7f36f46c1640 1 -- 172.21.15.7:0/2457141341 >> 172.21.15.7:0/2457141341 conn(0x7f36ec0fc7a0 msgr2=0x7f36ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.535+0000 7f36f46c1640 1 -- 172.21.15.7:0/2457141341 shutdown_connections 2024-09-19T08:54:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.535+0000 7f36f46c1640 1 -- 172.21.15.7:0/2457141341 wait complete. 2024-09-19T08:54:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.535+0000 7f36f46c1640 1 Processor -- start 2024-09-19T08:54:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.535+0000 7f36f46c1640 1 -- start start 2024-09-19T08:54:28.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36f46c1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36ec100a80 0x7f36ec198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:28.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36f46c1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36ec101420 0x7f36ec198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:28.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36f46c1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ec106a80 0x7f36ec19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36f46c1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec110e80 con 0x7f36ec100a80 2024-09-19T08:54:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36f46c1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec110d00 con 0x7f36ec106a80 2024-09-19T08:54:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36f46c1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec111000 con 0x7f36ec101420 2024-09-19T08:54:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36f245d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36ec100a80 0x7f36ec198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36f245d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36ec100a80 0x7f36ec198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53398/0 (socket says 172.21.15.7:53398) 2024-09-19T08:54:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36f245d640 1 -- 172.21.15.7:0/2815267691 learned_addr learned my addr 172.21.15.7:0/2815267691 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36f2c5e640 1 --2- 172.21.15.7:0/2815267691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ec106a80 0x7f36ec19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36f1c5c640 1 --2- 172.21.15.7:0/2815267691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36ec101420 0x7f36ec198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36f245d640 1 -- 172.21.15.7:0/2815267691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36ec101420 msgr2=0x7f36ec198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36f245d640 1 --2- 172.21.15.7:0/2815267691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36ec101420 0x7f36ec198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36f245d640 1 -- 172.21.15.7:0/2815267691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ec106a80 msgr2=0x7f36ec19cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36f245d640 1 --2- 172.21.15.7:0/2815267691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ec106a80 0x7f36ec19cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36f245d640 1 -- 172.21.15.7:0/2815267691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ec19d3f0 con 0x7f36ec100a80 2024-09-19T08:54:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36f1c5c640 1 --2- 172.21.15.7:0/2815267691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36ec101420 0x7f36ec198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36f2c5e640 1 --2- 172.21.15.7:0/2815267691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ec106a80 0x7f36ec19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36f245d640 1 --2- 172.21.15.7:0/2815267691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36ec100a80 0x7f36ec198440 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f36e800d950 tx=0x7f36e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36e37fe640 1 -- 172.21.15.7:0/2815267691 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e8017070 con 0x7f36ec100a80 2024-09-19T08:54:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36e37fe640 1 -- 172.21.15.7:0/2815267691 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36e8009c30 con 0x7f36ec100a80 2024-09-19T08:54:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36f46c1640 1 -- 172.21.15.7:0/2815267691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36ec19d6e0 con 0x7f36ec100a80 2024-09-19T08:54:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.536+0000 7f36e37fe640 1 -- 172.21.15.7:0/2815267691 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e800f6b0 con 0x7f36ec100a80 2024-09-19T08:54:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.537+0000 7f36f46c1640 1 -- 172.21.15.7:0/2815267691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36ec1a4fc0 con 0x7f36ec100a80 2024-09-19T08:54:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.540+0000 7f36f6a9a740 1 Processor -- start 2024-09-19T08:54:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.540+0000 7f36e37fe640 1 -- 172.21.15.7:0/2815267691 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f36e80109d0 con 0x7f36ec100a80 2024-09-19T08:54:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.540+0000 7f36f6a9a740 1 -- start start 2024-09-19T08:54:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.540+0000 7f36f6a9a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd54076b60 0x55bd54076f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.540+0000 7f36f6a9a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd54077480 0x55bd54081800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.540+0000 7f36f6a9a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54081d40 0x55bd54084130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.540+0000 7f36f6a9a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bd53fdc280 con 0x55bd54081d40 2024-09-19T08:54:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.540+0000 7f36f6a9a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bd53f83b10 con 0x55bd54077480 2024-09-19T08:54:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.540+0000 7f36f6a9a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bd53fd8240 con 0x55bd54076b60 2024-09-19T08:54:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.540+0000 7f36f1c5c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54081d40 0x55bd54084130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:28.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.540+0000 7f36f1c5c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54081d40 0x55bd54084130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53404/0 (socket says 172.21.15.7:53404) 2024-09-19T08:54:28.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.540+0000 7f36f1c5c640 1 -- 172.21.15.7:0/1188621639 learned_addr learned my addr 172.21.15.7:0/1188621639 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:28.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.540+0000 7f36f2c5e640 1 --2- 172.21.15.7:0/1188621639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd54076b60 0x55bd54076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:28.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.540+0000 7f36f245d640 1 --2- 172.21.15.7:0/1188621639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd54077480 0x55bd54081800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:28.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.541+0000 7f36f1c5c640 1 -- 172.21.15.7:0/1188621639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd54076b60 msgr2=0x55bd54076f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:28.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.541+0000 7f36f1c5c640 1 --2- 172.21.15.7:0/1188621639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd54076b60 0x55bd54076f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.541+0000 7f36f1c5c640 1 -- 172.21.15.7:0/1188621639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd54077480 msgr2=0x55bd54081800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:28.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.541+0000 7f36f1c5c640 1 --2- 172.21.15.7:0/1188621639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd54077480 0x55bd54081800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.541+0000 7f36f1c5c640 1 -- 172.21.15.7:0/1188621639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd53f901f0 con 0x55bd54081d40 2024-09-19T08:54:28.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.541+0000 7f36e37fe640 1 --2- 172.21.15.7:0/2815267691 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f36d80a33b0 0x7f36d80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:28.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.541+0000 7f36f245d640 1 --2- 172.21.15.7:0/1188621639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd54077480 0x55bd54081800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:28.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.541+0000 7f36f2c5e640 1 --2- 172.21.15.7:0/2815267691 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f36d80a33b0 0x7f36d80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:28.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.541+0000 7f36e37fe640 1 -- 172.21.15.7:0/2815267691 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f36e80cf9b0 con 0x7f36ec100a80 2024-09-19T08:54:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.541+0000 7f36f1c5c640 1 --2- 172.21.15.7:0/1188621639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54081d40 0x55bd54084130 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f36dc006010 tx=0x7f36dc009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a95de2840030942 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.541+0000 7f36e0ff9640 1 -- 172.21.15.7:0/1188621639 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36dc03f070 con 0x55bd54081d40 2024-09-19T08:54:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.541+0000 7f36e0ff9640 1 -- 172.21.15.7:0/1188621639 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36dc0317b0 con 0x55bd54081d40 2024-09-19T08:54:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.541+0000 7f36e0ff9640 1 -- 172.21.15.7:0/1188621639 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36dc035070 con 0x55bd54081d40 2024-09-19T08:54:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.542+0000 7f36f6a9a740 1 -- 172.21.15.7:0/1188621639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54081d40 msgr2=0x55bd54084130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.542+0000 7f36f2c5e640 1 --2- 172.21.15.7:0/2815267691 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f36d80a33b0 0x7f36d80a5870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f36e4007f90 tx=0x7f36e4007720 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.542+0000 7f36f6a9a740 1 --2- 172.21.15.7:0/1188621639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54081d40 0x55bd54084130 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f36dc006010 tx=0x7f36dc009680 comp rx=0 tx=0).stop 2024-09-19T08:54:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.542+0000 7f36f6a9a740 1 -- 172.21.15.7:0/1188621639 shutdown_connections 2024-09-19T08:54:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.542+0000 7f36f6a9a740 1 --2- 172.21.15.7:0/1188621639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54081d40 0x55bd54084130 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.542+0000 7f36f6a9a740 1 --2- 172.21.15.7:0/1188621639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd54077480 0x55bd54081800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.542+0000 7f36f6a9a740 1 --2- 172.21.15.7:0/1188621639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd54076b60 0x55bd54076f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.542+0000 7f36f6a9a740 1 -- 172.21.15.7:0/1188621639 >> 172.21.15.7:0/1188621639 conn(0x55bd540730f0 msgr2=0x55bd540734d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.542+0000 7f36f6a9a740 1 -- 172.21.15.7:0/1188621639 shutdown_connections 2024-09-19T08:54:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.542+0000 7f36f6a9a740 1 -- 172.21.15.7:0/1188621639 wait complete. 2024-09-19T08:54:28.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.542+0000 7f36f6a9a740 1 -- start start 2024-09-19T08:54:28.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.543+0000 7f36f6a9a740 1 Processor -- start 2024-09-19T08:54:28.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.543+0000 7f36f6a9a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd54076b60 0x55bd540861e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:28.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.543+0000 7f36f6a9a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54077480 0x55bd54086720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:28.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.543+0000 7f36f6a9a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd54081d40 0x55bd5408a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:28.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.543+0000 7f36f6a9a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bd54084910 con 0x55bd54077480 2024-09-19T08:54:28.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.543+0000 7f36f6a9a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bd53f96f10 con 0x55bd54081d40 2024-09-19T08:54:28.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.543+0000 7f36f6a9a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bd54084a90 con 0x55bd54076b60 2024-09-19T08:54:28.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.543+0000 7f36f6a9a740 10 client.0 _ll_register_callbacks cb 0x55bd53f5fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:28.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.543+0000 7f36f1c5c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54077480 0x55bd54086720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:28.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.543+0000 7f36f1c5c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54077480 0x55bd54086720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53410/0 (socket says 172.21.15.7:53410) 2024-09-19T08:54:28.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.543+0000 7f36f1c5c640 1 -- 172.21.15.7:0/1962220923 learned_addr learned my addr 172.21.15.7:0/1962220923 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:28.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.543+0000 7f36f245d640 1 --2- 172.21.15.7:0/1962220923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd54076b60 0x55bd540861e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:28.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.543+0000 7f36f2c5e640 1 --2- 172.21.15.7:0/1962220923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd54081d40 0x55bd5408a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:28.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.543+0000 7f36f1c5c640 1 -- 172.21.15.7:0/1962220923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd54076b60 msgr2=0x55bd540861e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:28.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.543+0000 7f36f1c5c640 1 --2- 172.21.15.7:0/1962220923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd54076b60 0x55bd540861e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.543+0000 7f36f1c5c640 1 -- 172.21.15.7:0/1962220923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd54081d40 msgr2=0x55bd5408a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:28.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.543+0000 7f36f1c5c640 1 --2- 172.21.15.7:0/1962220923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd54081d40 0x55bd5408a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.543+0000 7f36f1c5c640 1 -- 172.21.15.7:0/1962220923 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd53d4d6a0 con 0x55bd54077480 2024-09-19T08:54:28.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.544+0000 7f36f1c5c640 1 --2- 172.21.15.7:0/1962220923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54077480 0x55bd54086720 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f36dc004620 tx=0x7f36dc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a3d1767d8cfb5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:28.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.544+0000 7f36d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:28.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.544+0000 7f36d5ffb640 1 -- 172.21.15.7:0/1962220923 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36dc035040 con 0x55bd54077480 2024-09-19T08:54:28.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.544+0000 7f36d5ffb640 1 -- 172.21.15.7:0/1962220923 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f36dc0046c0 con 0x55bd54077480 2024-09-19T08:54:28.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.544+0000 7f36f6a9a740 1 -- 172.21.15.7:0/1962220923 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36dc0317b0 con 0x55bd54077480 2024-09-19T08:54:28.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.544+0000 7f36d5ffb640 1 -- 172.21.15.7:0/1962220923 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f36dc03f040 con 0x55bd54077480 2024-09-19T08:54:28.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.544+0000 7f36f6a9a740 10 client.17601 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:28.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.544+0000 7f36f6a9a740 1 -- 172.21.15.7:0/1962220923 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bd540948f0 con 0x55bd54077480 2024-09-19T08:54:28.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.544+0000 7f36d5ffb640 1 -- 172.21.15.7:0/1962220923 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36dc0317b0 con 0x55bd54077480 2024-09-19T08:54:28.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.544+0000 7f36d5ffb640 1 -- 172.21.15.7:0/1962220923 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f36dc03b980 con 0x55bd54077480 2024-09-19T08:54:28.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.544+0000 7f36f6a9a740 10 client.17601 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:28.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.544+0000 7f36f6a9a740 10 client.17601 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:28.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.544+0000 7f36f6a9a740 20 client.17601 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:28.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.544+0000 7f36f6a9a740 1 --2- 172.21.15.7:0/1962220923 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55bd54095c40 0x55bd54098030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:28.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.544+0000 7f36f6a9a740 4 client.17601 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:28.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.544+0000 7f36f6a9a740 1 -- 172.21.15.7:0/1962220923 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd53fe97f0 con 0x55bd54095c40 2024-09-19T08:54:28.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.545+0000 7f36f245d640 1 --2- 172.21.15.7:0/1962220923 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55bd54095c40 0x55bd54098030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:28.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.545+0000 7f36f245d640 1 --2- 172.21.15.7:0/1962220923 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55bd54095c40 0x55bd54098030 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5a76bf1aea5d812 server_cookie=d667fc0e300db41c in_seq=0 out_seq=0 2024-09-19T08:54:28.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.545+0000 7f36d5ffb640 10 client.17601 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:28.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.546+0000 7f36d5ffb640 1 -- 172.21.15.7:0/1962220923 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bd53fe97f0 con 0x55bd54095c40 2024-09-19T08:54:28.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.546+0000 7f36d5ffb640 10 client.17601 handle_command_reply: tid=0 2024-09-19T08:54:28.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.546+0000 7f36f6a9a740 1 client.17601 shutdown 2024-09-19T08:54:28.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.546+0000 7f36f6a9a740 1 -- 172.21.15.7:0/1962220923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54077480 msgr2=0x55bd54086720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:28.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.546+0000 7f36f6a9a740 1 --2- 172.21.15.7:0/1962220923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54077480 0x55bd54086720 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f36dc004620 tx=0x7f36dc009260 comp rx=0 tx=0).stop 2024-09-19T08:54:28.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.546+0000 7f36f6a9a740 1 -- 172.21.15.7:0/1962220923 shutdown_connections 2024-09-19T08:54:28.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.546+0000 7f36f6a9a740 1 --2- 172.21.15.7:0/1962220923 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55bd54095c40 0x55bd54098030 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.546+0000 7f36f6a9a740 1 --2- 172.21.15.7:0/1962220923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd54081d40 0x55bd5408a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.546+0000 7f36f6a9a740 1 --2- 172.21.15.7:0/1962220923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54077480 0x55bd54086720 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.546+0000 7f36f6a9a740 1 --2- 172.21.15.7:0/1962220923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd54076b60 0x55bd540861e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.546+0000 7f36f6a9a740 1 -- 172.21.15.7:0/1962220923 >> 172.21.15.7:0/1962220923 conn(0x55bd540730f0 msgr2=0x55bd54078dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:28.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.546+0000 7f36d5ffb640 0 client.17601 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:28.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.546+0000 7f36f6a9a740 1 -- 172.21.15.7:0/1962220923 shutdown_connections 2024-09-19T08:54:28.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.546+0000 7f36f6a9a740 1 -- 172.21.15.7:0/1962220923 wait complete. 2024-09-19T08:54:28.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.547+0000 7f36f6a9a740 20 client.17601 trim_cache size 0 max 16384 2024-09-19T08:54:28.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.564+0000 7f36f6a9a740 1 Processor -- start 2024-09-19T08:54:28.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.564+0000 7f36f6a9a740 1 -- start start 2024-09-19T08:54:28.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.564+0000 7f36f6a9a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54076b60 0x55bd5408a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:28.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.564+0000 7f36f6a9a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd54077480 0x55bd54092680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:28.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.564+0000 7f36f6a9a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd54081d40 0x55bd540861e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.564+0000 7f36f6a9a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec1ae070 con 0x55bd54076b60 2024-09-19T08:54:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.564+0000 7f36f6a9a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec1ab940 con 0x55bd54077480 2024-09-19T08:54:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.564+0000 7f36f6a9a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec1a97b0 con 0x55bd54081d40 2024-09-19T08:54:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.564+0000 7f36f245d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54076b60 0x55bd5408a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.564+0000 7f36f245d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54076b60 0x55bd5408a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53414/0 (socket says 172.21.15.7:53414) 2024-09-19T08:54:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.564+0000 7f36f245d640 1 -- 172.21.15.7:0/3118174673 learned_addr learned my addr 172.21.15.7:0/3118174673 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.564+0000 7f36f1c5c640 1 --2- 172.21.15.7:0/3118174673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd54077480 0x55bd54092680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.564+0000 7f36f2c5e640 1 --2- 172.21.15.7:0/3118174673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd54081d40 0x55bd540861e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.564+0000 7f36f245d640 1 -- 172.21.15.7:0/3118174673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd54081d40 msgr2=0x55bd540861e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.564+0000 7f36f245d640 1 --2- 172.21.15.7:0/3118174673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd54081d40 0x55bd540861e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.564+0000 7f36f245d640 1 -- 172.21.15.7:0/3118174673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd54077480 msgr2=0x55bd54092680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.564+0000 7f36f245d640 1 --2- 172.21.15.7:0/3118174673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd54077480 0x55bd54092680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.564+0000 7f36f245d640 1 -- 172.21.15.7:0/3118174673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd54086f20 con 0x55bd54076b60 2024-09-19T08:54:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.565+0000 7f36f245d640 1 --2- 172.21.15.7:0/3118174673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54076b60 0x55bd5408a770 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009610 tx=0x7f36e8086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c53e3b1fdc53c58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.565+0000 7f36d7fff640 1 -- 172.21.15.7:0/3118174673 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e80b1070 con 0x55bd54076b60 2024-09-19T08:54:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.565+0000 7f36d7fff640 1 -- 172.21.15.7:0/3118174673 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36e809bc50 con 0x55bd54076b60 2024-09-19T08:54:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.565+0000 7f36d7fff640 1 -- 172.21.15.7:0/3118174673 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e80cfe60 con 0x55bd54076b60 2024-09-19T08:54:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.565+0000 7f36f6a9a740 1 -- 172.21.15.7:0/3118174673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54076b60 msgr2=0x55bd5408a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.565+0000 7f36f6a9a740 1 --2- 172.21.15.7:0/3118174673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54076b60 0x55bd5408a770 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009610 tx=0x7f36e8086040 comp rx=0 tx=0).stop 2024-09-19T08:54:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.565+0000 7f36f6a9a740 1 -- 172.21.15.7:0/3118174673 shutdown_connections 2024-09-19T08:54:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.565+0000 7f36f6a9a740 1 --2- 172.21.15.7:0/3118174673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd54081d40 0x55bd540861e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.565+0000 7f36f6a9a740 1 --2- 172.21.15.7:0/3118174673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd54077480 0x55bd54092680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.565+0000 7f36f6a9a740 1 --2- 172.21.15.7:0/3118174673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54076b60 0x55bd5408a770 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.565+0000 7f36f6a9a740 1 -- 172.21.15.7:0/3118174673 >> 172.21.15.7:0/3118174673 conn(0x55bd540730f0 msgr2=0x55bd5407e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.565+0000 7f36f6a9a740 1 -- 172.21.15.7:0/3118174673 shutdown_connections 2024-09-19T08:54:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.565+0000 7f36f6a9a740 1 -- 172.21.15.7:0/3118174673 wait complete. 2024-09-19T08:54:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.566+0000 7f36f6a9a740 1 -- start start 2024-09-19T08:54:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.566+0000 7f36f6a9a740 1 Processor -- start 2024-09-19T08:54:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.566+0000 7f36f6a9a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd54076b60 0x55bd54092310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.566+0000 7f36f6a9a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54077480 0x55bd5408d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.566+0000 7f36f6a9a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd54081d40 0x55bd5408dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.566+0000 7f36f6a9a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec1a9e00 con 0x55bd54077480 2024-09-19T08:54:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.566+0000 7f36f6a9a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec1ab270 con 0x55bd54076b60 2024-09-19T08:54:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.566+0000 7f36f6a9a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec1aa4d0 con 0x55bd54081d40 2024-09-19T08:54:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.566+0000 7f36f6a9a740 10 client.0 _ll_register_callbacks cb 0x7f36e40075c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.566+0000 7f36f1c5c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54077480 0x55bd5408d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.566+0000 7f36f1c5c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54077480 0x55bd5408d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53418/0 (socket says 172.21.15.7:53418) 2024-09-19T08:54:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.566+0000 7f36f1c5c640 1 -- 172.21.15.7:0/350727292 learned_addr learned my addr 172.21.15.7:0/350727292 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.566+0000 7f36f2c5e640 1 --2- 172.21.15.7:0/350727292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd54081d40 0x55bd5408dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.566+0000 7f36f245d640 1 --2- 172.21.15.7:0/350727292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd54076b60 0x55bd54092310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.566+0000 7f36f1c5c640 1 -- 172.21.15.7:0/350727292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd54081d40 msgr2=0x55bd5408dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.566+0000 7f36f1c5c640 1 --2- 172.21.15.7:0/350727292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd54081d40 0x55bd5408dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.566+0000 7f36f1c5c640 1 -- 172.21.15.7:0/350727292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd54076b60 msgr2=0x55bd54092310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.566+0000 7f36f1c5c640 1 --2- 172.21.15.7:0/350727292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd54076b60 0x55bd54092310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.566+0000 7f36f1c5c640 1 -- 172.21.15.7:0/350727292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd5408e240 con 0x55bd54077480 2024-09-19T08:54:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.567+0000 7f36f1c5c640 1 --2- 172.21.15.7:0/350727292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54077480 0x55bd5408d690 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f36dc03cfd0 tx=0x7f36dc031da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd31e1b87701ce0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.567+0000 7f36d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.567+0000 7f36d5ffb640 1 -- 172.21.15.7:0/350727292 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36dc035040 con 0x55bd54077480 2024-09-19T08:54:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.567+0000 7f36d5ffb640 1 -- 172.21.15.7:0/350727292 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f36dc03b870 con 0x55bd54077480 2024-09-19T08:54:28.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.567+0000 7f36f6a9a740 1 -- 172.21.15.7:0/350727292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36e809bc50 con 0x55bd54077480 2024-09-19T08:54:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.567+0000 7f36d5ffb640 1 -- 172.21.15.7:0/350727292 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f36dc02aa60 con 0x55bd54077480 2024-09-19T08:54:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.567+0000 7f36f6a9a740 10 client.17607 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.567+0000 7f36f6a9a740 1 -- 172.21.15.7:0/350727292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bd541004e0 con 0x55bd54077480 2024-09-19T08:54:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.567+0000 7f36d5ffb640 1 -- 172.21.15.7:0/350727292 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36e809bc50 con 0x55bd54077480 2024-09-19T08:54:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.567+0000 7f36d5ffb640 1 -- 172.21.15.7:0/350727292 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f36dc062070 con 0x55bd54077480 2024-09-19T08:54:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.567+0000 7f36f6a9a740 10 client.17607 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.567+0000 7f36f6a9a740 10 client.17607 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.567+0000 7f36f6a9a740 20 client.17607 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.568+0000 7f36f6a9a740 1 --2- 172.21.15.7:0/350727292 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55bd54100ba0 0x55bd54102fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.568+0000 7f36f6a9a740 4 client.17607 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:54:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.568+0000 7f36f6a9a740 1 -- 172.21.15.7:0/350727292 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55bd53fe3d00 con 0x55bd54100ba0 2024-09-19T08:54:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.568+0000 7f36f245d640 1 --2- 172.21.15.7:0/350727292 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55bd54100ba0 0x55bd54102fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:28.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.568+0000 7f36f245d640 1 --2- 172.21.15.7:0/350727292 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55bd54100ba0 0x55bd54102fc0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=887d83e62ec92a08 server_cookie=55f5f78036c1ab6b in_seq=0 out_seq=0 2024-09-19T08:54:28.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.568+0000 7f36d5ffb640 10 client.17607 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:28.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.569+0000 7f36d5ffb640 1 -- 172.21.15.7:0/350727292 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bd53fe3d00 con 0x55bd54100ba0 2024-09-19T08:54:28.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.569+0000 7f36d5ffb640 10 client.17607 handle_command_reply: tid=0 2024-09-19T08:54:28.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.569+0000 7f36f6a9a740 1 client.17607 shutdown 2024-09-19T08:54:28.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.569+0000 7f36f6a9a740 1 -- 172.21.15.7:0/350727292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54077480 msgr2=0x55bd5408d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:28.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.569+0000 7f36f6a9a740 1 --2- 172.21.15.7:0/350727292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54077480 0x55bd5408d690 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f36dc03cfd0 tx=0x7f36dc031da0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.569+0000 7f36f6a9a740 1 -- 172.21.15.7:0/350727292 shutdown_connections 2024-09-19T08:54:28.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.569+0000 7f36f6a9a740 1 --2- 172.21.15.7:0/350727292 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55bd54100ba0 0x55bd54102fc0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.569+0000 7f36f6a9a740 1 --2- 172.21.15.7:0/350727292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd54081d40 0x55bd5408dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.569+0000 7f36f6a9a740 1 --2- 172.21.15.7:0/350727292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bd54077480 0x55bd5408d690 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.569+0000 7f36f6a9a740 1 --2- 172.21.15.7:0/350727292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bd54076b60 0x55bd54092310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.569+0000 7f36f6a9a740 1 -- 172.21.15.7:0/350727292 >> 172.21.15.7:0/350727292 conn(0x55bd540730f0 msgr2=0x55bd540861e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:28.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.569+0000 7f36d5ffb640 0 client.17607 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:28.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.570+0000 7f36f6a9a740 1 -- 172.21.15.7:0/350727292 shutdown_connections 2024-09-19T08:54:28.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.570+0000 7f36f6a9a740 1 -- 172.21.15.7:0/350727292 wait complete. 2024-09-19T08:54:28.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.570+0000 7f36f6a9a740 20 client.17607 trim_cache size 0 max 16384 2024-09-19T08:54:28.575 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:54:28.575 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-19T08:54:28.575 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "0e5f59f9-769a-4c02-b6b5-a0f30802a35f", 2024-09-19T08:54:28.575 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-19T08:54:28.575 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:54:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.570+0000 7f36f46c1640 1 -- 172.21.15.7:0/2815267691 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f36d80a33b0 msgr2=0x7f36d80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.570+0000 7f36f46c1640 1 --2- 172.21.15.7:0/2815267691 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f36d80a33b0 0x7f36d80a5870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f36e4007f90 tx=0x7f36e4007720 comp rx=0 tx=0).stop 2024-09-19T08:54:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.570+0000 7f36f46c1640 1 -- 172.21.15.7:0/2815267691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36ec100a80 msgr2=0x7f36ec198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.570+0000 7f36f46c1640 1 --2- 172.21.15.7:0/2815267691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36ec100a80 0x7f36ec198440 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f36e800d950 tx=0x7f36e800de10 comp rx=0 tx=0).stop 2024-09-19T08:54:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.570+0000 7f36f46c1640 1 -- 172.21.15.7:0/2815267691 shutdown_connections 2024-09-19T08:54:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.570+0000 7f36f46c1640 1 --2- 172.21.15.7:0/2815267691 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f36d80a33b0 0x7f36d80a5870 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.570+0000 7f36f46c1640 1 --2- 172.21.15.7:0/2815267691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ec106a80 0x7f36ec19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.570+0000 7f36f46c1640 1 --2- 172.21.15.7:0/2815267691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36ec101420 0x7f36ec198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.570+0000 7f36f46c1640 1 --2- 172.21.15.7:0/2815267691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36ec100a80 0x7f36ec198440 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.570+0000 7f36f46c1640 1 -- 172.21.15.7:0/2815267691 >> 172.21.15.7:0/2815267691 conn(0x7f36ec0fc7a0 msgr2=0x7f36ec06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:28.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.571+0000 7f36f46c1640 1 -- 172.21.15.7:0/2815267691 shutdown_connections 2024-09-19T08:54:28.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:28.571+0000 7f36f46c1640 1 -- 172.21.15.7:0/2815267691 wait complete. 2024-09-19T08:54:29.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:29 smithi007 ceph-mon[31221]: pgmap v309: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T08:54:29.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:29 smithi007 ceph-mon[31221]: scrub queued for path: / 2024-09-19T08:54:29.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:29 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:29.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:29 smithi007 ceph-mon[31221]: scrub summary: active paths [/] 2024-09-19T08:54:29.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:29 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:29.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:29 smithi007 ceph-mon[31221]: scrub summary: idle 2024-09-19T08:54:29.231 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:54:29.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:29 smithi175 ceph-mon[35688]: pgmap v309: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T08:54:29.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:29 smithi175 ceph-mon[35688]: scrub queued for path: / 2024-09-19T08:54:29.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:29 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:29.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:29 smithi175 ceph-mon[35688]: scrub summary: active paths [/] 2024-09-19T08:54:29.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:29 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:29.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:29 smithi175 ceph-mon[35688]: scrub summary: idle 2024-09-19T08:54:29.489 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:29.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:29 smithi044 ceph-mon[35072]: pgmap v309: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T08:54:29.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:29 smithi044 ceph-mon[35072]: scrub queued for path: / 2024-09-19T08:54:29.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:29 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:29.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:29 smithi044 ceph-mon[35072]: scrub summary: active paths [/] 2024-09-19T08:54:29.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:29 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:29.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:29 smithi044 ceph-mon[35072]: scrub summary: idle 2024-09-19T08:54:29.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.970+0000 7f6d9dd1d640 1 -- 172.21.15.7:0/2930275000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d98102d40 msgr2=0x7f6d98103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:29.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.971+0000 7f6d9dd1d640 1 --2- 172.21.15.7:0/2930275000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d98102d40 0x7f6d98103120 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f6d88009900 tx=0x7f6d8802a480 comp rx=0 tx=0).stop 2024-09-19T08:54:29.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.971+0000 7f6d9dd1d640 1 -- 172.21.15.7:0/2930275000 shutdown_connections 2024-09-19T08:54:29.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.971+0000 7f6d9dd1d640 1 --2- 172.21.15.7:0/2930275000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d9810c170 0x7f6d9810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.971+0000 7f6d9dd1d640 1 --2- 172.21.15.7:0/2930275000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d98103660 0x7f6d9810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.971+0000 7f6d9dd1d640 1 --2- 172.21.15.7:0/2930275000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d98102d40 0x7f6d98103120 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.971+0000 7f6d9dd1d640 1 -- 172.21.15.7:0/2930275000 >> 172.21.15.7:0/2930275000 conn(0x7f6d980fc7a0 msgr2=0x7f6d980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:29.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.971+0000 7f6d9dd1d640 1 -- 172.21.15.7:0/2930275000 shutdown_connections 2024-09-19T08:54:29.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.971+0000 7f6d9dd1d640 1 -- 172.21.15.7:0/2930275000 wait complete. 2024-09-19T08:54:29.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.971+0000 7f6d9dd1d640 1 Processor -- start 2024-09-19T08:54:29.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.971+0000 7f6d9dd1d640 1 -- start start 2024-09-19T08:54:29.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.972+0000 7f6d9dd1d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d98102d40 0x7f6d981009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:29.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.972+0000 7f6d9dd1d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d98103660 0x7f6d98100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:29.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.972+0000 7f6d9dd1d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d9810c170 0x7f6d98101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:29.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.972+0000 7f6d9dd1d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6d98111f70 con 0x7f6d98103660 2024-09-19T08:54:29.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.972+0000 7f6d9dd1d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6d98111df0 con 0x7f6d9810c170 2024-09-19T08:54:29.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.972+0000 7f6d9dd1d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6d981120f0 con 0x7f6d98102d40 2024-09-19T08:54:29.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.972+0000 7f6d96ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d98103660 0x7f6d98100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:29.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.972+0000 7f6d96ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d98103660 0x7f6d98100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53440/0 (socket says 172.21.15.7:53440) 2024-09-19T08:54:29.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.972+0000 7f6d96ffd640 1 -- 172.21.15.7:0/4163966001 learned_addr learned my addr 172.21.15.7:0/4163966001 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:29.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.972+0000 7f6d977fe640 1 --2- 172.21.15.7:0/4163966001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d98102d40 0x7f6d981009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:29.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.972+0000 7f6d97fff640 1 --2- 172.21.15.7:0/4163966001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d9810c170 0x7f6d98101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:29.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.972+0000 7f6d96ffd640 1 -- 172.21.15.7:0/4163966001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d98102d40 msgr2=0x7f6d981009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:29.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.972+0000 7f6d96ffd640 1 --2- 172.21.15.7:0/4163966001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d98102d40 0x7f6d981009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.972+0000 7f6d96ffd640 1 -- 172.21.15.7:0/4163966001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d9810c170 msgr2=0x7f6d98101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:29.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.972+0000 7f6d96ffd640 1 --2- 172.21.15.7:0/4163966001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d9810c170 0x7f6d98101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.972+0000 7f6d96ffd640 1 -- 172.21.15.7:0/4163966001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d981a68e0 con 0x7f6d98103660 2024-09-19T08:54:29.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.972+0000 7f6d96ffd640 1 --2- 172.21.15.7:0/4163966001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d98103660 0x7f6d98100ee0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00e9f0 tx=0x7f6d8c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:29.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.973+0000 7f6d94ff9640 1 -- 172.21.15.7:0/4163966001 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c00ccc0 con 0x7f6d98103660 2024-09-19T08:54:29.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.973+0000 7f6d94ff9640 1 -- 172.21.15.7:0/4163966001 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d8c010910 con 0x7f6d98103660 2024-09-19T08:54:29.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.973+0000 7f6d94ff9640 1 -- 172.21.15.7:0/4163966001 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c018920 con 0x7f6d98103660 2024-09-19T08:54:29.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.973+0000 7f6d9dd1d640 1 -- 172.21.15.7:0/4163966001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d981a6bd0 con 0x7f6d98103660 2024-09-19T08:54:29.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.973+0000 7f6d9dd1d640 1 -- 172.21.15.7:0/4163966001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d981a70c0 con 0x7f6d98103660 2024-09-19T08:54:29.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.976+0000 7f6da00f6740 1 Processor -- start 2024-09-19T08:54:29.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.976+0000 7f6da00f6740 1 -- start start 2024-09-19T08:54:29.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.976+0000 7f6d94ff9640 1 -- 172.21.15.7:0/4163966001 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f6d8c010430 con 0x7f6d98103660 2024-09-19T08:54:29.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.976+0000 7f6da00f6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc894a0 0x56086fc89880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:29.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.976+0000 7f6da00f6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc89dc0 0x56086fc9c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:29.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.976+0000 7f6da00f6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56086fc9ceb0 0x56086fc9f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:29.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.976+0000 7f6da00f6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56086fbef2e0 con 0x56086fc89dc0 2024-09-19T08:54:29.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.976+0000 7f6da00f6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56086fb96ce0 con 0x56086fc894a0 2024-09-19T08:54:29.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.976+0000 7f6da00f6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56086fbeb2a0 con 0x56086fc9ceb0 2024-09-19T08:54:29.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.977+0000 7f6d977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc89dc0 0x56086fc9c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:29.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.977+0000 7f6d97fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc894a0 0x56086fc89880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:29.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.977+0000 7f6d977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc89dc0 0x56086fc9c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53444/0 (socket says 172.21.15.7:53444) 2024-09-19T08:54:29.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.977+0000 7f6d977fe640 1 -- 172.21.15.7:0/4102593190 learned_addr learned my addr 172.21.15.7:0/4102593190 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:29.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.977+0000 7f6d96ffd640 1 --2- 172.21.15.7:0/4102593190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56086fc9ceb0 0x56086fc9f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:29.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.977+0000 7f6d97fff640 1 -- 172.21.15.7:0/4102593190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56086fc9ceb0 msgr2=0x56086fc9f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:29.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.977+0000 7f6d97fff640 1 --2- 172.21.15.7:0/4102593190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56086fc9ceb0 0x56086fc9f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.977+0000 7f6d97fff640 1 -- 172.21.15.7:0/4102593190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc89dc0 msgr2=0x56086fc9c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:29.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.977+0000 7f6d97fff640 1 --2- 172.21.15.7:0/4102593190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc89dc0 0x56086fc9c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.977+0000 7f6d97fff640 1 -- 172.21.15.7:0/4102593190 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56086fb7b440 con 0x56086fc894a0 2024-09-19T08:54:29.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.977+0000 7f6d96ffd640 1 --2- 172.21.15.7:0/4102593190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56086fc9ceb0 0x56086fc9f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:29.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.977+0000 7f6d94ff9640 1 --2- 172.21.15.7:0/4163966001 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6d800a3500 0x7f6d800a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:29.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.977+0000 7f6d97fff640 1 --2- 172.21.15.7:0/4102593190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc894a0 0x56086fc89880 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6d90009eb0 tx=0x7f6d90010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e4dc9563084ee3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:29.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.977+0000 7f6d94ff9640 1 -- 172.21.15.7:0/4163966001 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f6d8c0cfe80 con 0x7f6d98103660 2024-09-19T08:54:29.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.978+0000 7f6d977fe640 1 --2- 172.21.15.7:0/4163966001 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6d800a3500 0x7f6d800a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:29.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.978+0000 7f6d7dffb640 1 -- 172.21.15.7:0/4102593190 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d90016070 con 0x56086fc894a0 2024-09-19T08:54:29.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.978+0000 7f6d7dffb640 1 -- 172.21.15.7:0/4102593190 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d90004d20 con 0x56086fc894a0 2024-09-19T08:54:29.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.978+0000 7f6d7dffb640 1 -- 172.21.15.7:0/4102593190 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d90012810 con 0x56086fc894a0 2024-09-19T08:54:29.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.979+0000 7f6da00f6740 1 -- 172.21.15.7:0/4102593190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc894a0 msgr2=0x56086fc89880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:29.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.979+0000 7f6da00f6740 1 --2- 172.21.15.7:0/4102593190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc894a0 0x56086fc89880 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6d90009eb0 tx=0x7f6d90010740 comp rx=0 tx=0).stop 2024-09-19T08:54:29.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.979+0000 7f6d977fe640 1 --2- 172.21.15.7:0/4163966001 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6d800a3500 0x7f6d800a59c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6d880096c0 tx=0x7f6d880058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:29.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.979+0000 7f6da00f6740 1 -- 172.21.15.7:0/4102593190 shutdown_connections 2024-09-19T08:54:29.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.979+0000 7f6da00f6740 1 --2- 172.21.15.7:0/4102593190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56086fc9ceb0 0x56086fc9f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.979+0000 7f6da00f6740 1 --2- 172.21.15.7:0/4102593190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc89dc0 0x56086fc9c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.979+0000 7f6da00f6740 1 --2- 172.21.15.7:0/4102593190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc894a0 0x56086fc89880 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.979+0000 7f6da00f6740 1 -- 172.21.15.7:0/4102593190 >> 172.21.15.7:0/4102593190 conn(0x56086fc85970 msgr2=0x56086fc85d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:29.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.979+0000 7f6da00f6740 1 -- 172.21.15.7:0/4102593190 shutdown_connections 2024-09-19T08:54:29.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.979+0000 7f6da00f6740 1 -- 172.21.15.7:0/4102593190 wait complete. 2024-09-19T08:54:29.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.979+0000 7f6da00f6740 1 -- start start 2024-09-19T08:54:29.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.979+0000 7f6da00f6740 1 Processor -- start 2024-09-19T08:54:29.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.980+0000 7f6da00f6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56086fc894a0 0x56086fc9c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:29.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.980+0000 7f6da00f6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc89dc0 0x56086fc99b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:29.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.980+0000 7f6da00f6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc9ceb0 0x56086fc9a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:29.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.980+0000 7f6da00f6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56086fc9fa20 con 0x56086fc9ceb0 2024-09-19T08:54:29.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.980+0000 7f6da00f6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56086fbaa050 con 0x56086fc89dc0 2024-09-19T08:54:29.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.980+0000 7f6da00f6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56086fc9fba0 con 0x56086fc894a0 2024-09-19T08:54:29.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.980+0000 7f6da00f6740 10 client.0 _ll_register_callbacks cb 0x56086fbea160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:29.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.980+0000 7f6d96ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc89dc0 0x56086fc99b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:29.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.980+0000 7f6d96ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc89dc0 0x56086fc99b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:59398/0 (socket says 172.21.15.7:59398) 2024-09-19T08:54:29.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.980+0000 7f6d96ffd640 1 -- 172.21.15.7:0/2580929730 learned_addr learned my addr 172.21.15.7:0/2580929730 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:29.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.980+0000 7f6d97fff640 1 --2- 172.21.15.7:0/2580929730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc9ceb0 0x56086fc9a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:29.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.980+0000 7f6d977fe640 1 --2- 172.21.15.7:0/2580929730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56086fc894a0 0x56086fc9c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:29.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.980+0000 7f6d96ffd640 1 -- 172.21.15.7:0/2580929730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56086fc894a0 msgr2=0x56086fc9c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:29.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.980+0000 7f6d96ffd640 1 --2- 172.21.15.7:0/2580929730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56086fc894a0 0x56086fc9c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.980+0000 7f6d96ffd640 1 -- 172.21.15.7:0/2580929730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc9ceb0 msgr2=0x56086fc9a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:29.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.980+0000 7f6d96ffd640 1 --2- 172.21.15.7:0/2580929730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc9ceb0 0x56086fc9a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.980+0000 7f6d96ffd640 1 -- 172.21.15.7:0/2580929730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56086f9603c0 con 0x56086fc89dc0 2024-09-19T08:54:29.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.981+0000 7f6d96ffd640 1 --2- 172.21.15.7:0/2580929730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc89dc0 0x56086fc99b40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00c6a0 tx=0x7f6d8c09bb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1b5b319792f290f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:29.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.981+0000 7f6d76ffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-19T08:54:29.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.981+0000 7f6d76ffd640 1 -- 172.21.15.7:0/2580929730 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c0a4d90 con 0x56086fc89dc0 2024-09-19T08:54:29.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.981+0000 7f6da00f6740 1 -- 172.21.15.7:0/2580929730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d90004d20 con 0x56086fc89dc0 2024-09-19T08:54:29.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.981+0000 7f6d76ffd640 1 -- 172.21.15.7:0/2580929730 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f6d8c098840 con 0x56086fc89dc0 2024-09-19T08:54:29.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.981+0000 7f6d76ffd640 1 -- 172.21.15.7:0/2580929730 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6d8c010720 con 0x56086fc89dc0 2024-09-19T08:54:29.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.981+0000 7f6da00f6740 10 client.27134 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:29.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.981+0000 7f6da00f6740 1 -- 172.21.15.7:0/2580929730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56086fcab460 con 0x56086fc89dc0 2024-09-19T08:54:29.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.981+0000 7f6d76ffd640 1 -- 172.21.15.7:0/2580929730 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d90004d20 con 0x56086fc89dc0 2024-09-19T08:54:29.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.981+0000 7f6d76ffd640 1 -- 172.21.15.7:0/2580929730 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6d8c0cdce0 con 0x56086fc89dc0 2024-09-19T08:54:29.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.981+0000 7f6da00f6740 10 client.27134 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:29.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.981+0000 7f6da00f6740 10 client.27134 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:29.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.981+0000 7f6da00f6740 20 client.27134 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:29.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.981+0000 7f6da00f6740 1 --2- 172.21.15.7:0/2580929730 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56086fcac920 0x56086fcaed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:29.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.982+0000 7f6da00f6740 4 client.27134 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:29.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.982+0000 7f6da00f6740 1 -- 172.21.15.7:0/2580929730 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56086fbfc850 con 0x56086fcac920 2024-09-19T08:54:29.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.982+0000 7f6d977fe640 1 --2- 172.21.15.7:0/2580929730 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56086fcac920 0x56086fcaed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:29.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.982+0000 7f6d977fe640 1 --2- 172.21.15.7:0/2580929730 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56086fcac920 0x56086fcaed10 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3844f6f58e86e2f server_cookie=3f07cefb372d4b27 in_seq=0 out_seq=0 2024-09-19T08:54:29.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.982+0000 7f6d76ffd640 10 client.27134 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:29.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.983+0000 7f6d76ffd640 1 -- 172.21.15.7:0/2580929730 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56086fbfc850 con 0x56086fcac920 2024-09-19T08:54:29.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.983+0000 7f6d76ffd640 10 client.27134 handle_command_reply: tid=0 2024-09-19T08:54:29.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.983+0000 7f6da00f6740 1 client.27134 shutdown 2024-09-19T08:54:29.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.983+0000 7f6da00f6740 1 -- 172.21.15.7:0/2580929730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc89dc0 msgr2=0x56086fc99b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:29.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.983+0000 7f6da00f6740 1 --2- 172.21.15.7:0/2580929730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc89dc0 0x56086fc99b40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00c6a0 tx=0x7f6d8c09bb30 comp rx=0 tx=0).stop 2024-09-19T08:54:29.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.983+0000 7f6da00f6740 1 -- 172.21.15.7:0/2580929730 shutdown_connections 2024-09-19T08:54:29.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.983+0000 7f6da00f6740 1 --2- 172.21.15.7:0/2580929730 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56086fcac920 0x56086fcaed10 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.983+0000 7f6da00f6740 1 --2- 172.21.15.7:0/2580929730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc9ceb0 0x56086fc9a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.983+0000 7f6da00f6740 1 --2- 172.21.15.7:0/2580929730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc89dc0 0x56086fc99b40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.983+0000 7f6d76ffd640 0 client.27134 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:29.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.983+0000 7f6da00f6740 1 --2- 172.21.15.7:0/2580929730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56086fc894a0 0x56086fc9c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.983+0000 7f6da00f6740 1 -- 172.21.15.7:0/2580929730 >> 172.21.15.7:0/2580929730 conn(0x56086fc85970 msgr2=0x56086fc8b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:29.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.983+0000 7f6da00f6740 1 -- 172.21.15.7:0/2580929730 shutdown_connections 2024-09-19T08:54:29.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.983+0000 7f6da00f6740 1 -- 172.21.15.7:0/2580929730 wait complete. 2024-09-19T08:54:29.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:29.983+0000 7f6da00f6740 20 client.27134 trim_cache size 0 max 16384 2024-09-19T08:54:30.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.000+0000 7f6da00f6740 1 Processor -- start 2024-09-19T08:54:30.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.000+0000 7f6da00f6740 1 -- start start 2024-09-19T08:54:30.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.001+0000 7f6da00f6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc894a0 0x56086fca8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:30.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.001+0000 7f6da00f6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56086fc89dc0 0x56086fcb45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:30.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.001+0000 7f6da00f6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc9ceb0 0x56086fcb4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:30.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.001+0000 7f6da00f6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6d981adf50 con 0x56086fc9ceb0 2024-09-19T08:54:30.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.001+0000 7f6da00f6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6d981ab820 con 0x56086fc894a0 2024-09-19T08:54:30.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.001+0000 7f6da00f6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6d981a9690 con 0x56086fc89dc0 2024-09-19T08:54:30.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.001+0000 7f6d97fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc9ceb0 0x56086fcb4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:30.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.001+0000 7f6d97fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc9ceb0 0x56086fcb4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53468/0 (socket says 172.21.15.7:53468) 2024-09-19T08:54:30.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.001+0000 7f6d97fff640 1 -- 172.21.15.7:0/2891793307 learned_addr learned my addr 172.21.15.7:0/2891793307 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:30.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.001+0000 7f6d977fe640 1 --2- 172.21.15.7:0/2891793307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc894a0 0x56086fca8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:30.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.001+0000 7f6d96ffd640 1 --2- 172.21.15.7:0/2891793307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56086fc89dc0 0x56086fcb45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:30.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.001+0000 7f6d977fe640 1 -- 172.21.15.7:0/2891793307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56086fc89dc0 msgr2=0x56086fcb45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:30.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.001+0000 7f6d977fe640 1 --2- 172.21.15.7:0/2891793307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56086fc89dc0 0x56086fcb45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.001+0000 7f6d977fe640 1 -- 172.21.15.7:0/2891793307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc9ceb0 msgr2=0x56086fcb4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:30.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.001+0000 7f6d977fe640 1 --2- 172.21.15.7:0/2891793307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc9ceb0 0x56086fcb4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.001+0000 7f6d977fe640 1 -- 172.21.15.7:0/2891793307 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56086fc9a480 con 0x56086fc894a0 2024-09-19T08:54:30.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.001+0000 7f6d97fff640 1 --2- 172.21.15.7:0/2891793307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc9ceb0 0x56086fcb4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:30.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.001+0000 7f6d977fe640 1 --2- 172.21.15.7:0/2891793307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc894a0 0x56086fca8cc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6d88000c00 tx=0x7f6d8803f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74128d1e0b94e3fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:30.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.002+0000 7f6d7d7fa640 1 -- 172.21.15.7:0/2891793307 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d88035040 con 0x56086fc894a0 2024-09-19T08:54:30.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.002+0000 7f6d7d7fa640 1 -- 172.21.15.7:0/2891793307 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d8805a070 con 0x56086fc894a0 2024-09-19T08:54:30.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.002+0000 7f6d7d7fa640 1 -- 172.21.15.7:0/2891793307 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8803d450 con 0x56086fc894a0 2024-09-19T08:54:30.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.002+0000 7f6da00f6740 1 -- 172.21.15.7:0/2891793307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc894a0 msgr2=0x56086fca8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:30.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.002+0000 7f6da00f6740 1 --2- 172.21.15.7:0/2891793307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc894a0 0x56086fca8cc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6d88000c00 tx=0x7f6d8803f000 comp rx=0 tx=0).stop 2024-09-19T08:54:30.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.003+0000 7f6da00f6740 1 -- 172.21.15.7:0/2891793307 shutdown_connections 2024-09-19T08:54:30.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.003+0000 7f6da00f6740 1 --2- 172.21.15.7:0/2891793307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc9ceb0 0x56086fcb4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.003+0000 7f6da00f6740 1 --2- 172.21.15.7:0/2891793307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56086fc89dc0 0x56086fcb45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.003+0000 7f6da00f6740 1 --2- 172.21.15.7:0/2891793307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc894a0 0x56086fca8cc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.003+0000 7f6da00f6740 1 -- 172.21.15.7:0/2891793307 >> 172.21.15.7:0/2891793307 conn(0x56086fc85970 msgr2=0x56086fc85d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.003+0000 7f6da00f6740 1 -- 172.21.15.7:0/2891793307 shutdown_connections 2024-09-19T08:54:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.003+0000 7f6da00f6740 1 -- 172.21.15.7:0/2891793307 wait complete. 2024-09-19T08:54:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.003+0000 7f6da00f6740 1 -- start start 2024-09-19T08:54:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.003+0000 7f6da00f6740 1 Processor -- start 2024-09-19T08:54:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.004+0000 7f6da00f6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56086fc894a0 0x56086fca4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.004+0000 7f6da00f6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc89dc0 0x56086fca5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.004+0000 7f6da00f6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc9ceb0 0x56086fca1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.004+0000 7f6da00f6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6d981a9ce0 con 0x56086fc9ceb0 2024-09-19T08:54:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.004+0000 7f6da00f6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6d981ab150 con 0x56086fc89dc0 2024-09-19T08:54:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.004+0000 7f6da00f6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6d981aa3b0 con 0x56086fc894a0 2024-09-19T08:54:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.004+0000 7f6da00f6740 10 client.0 _ll_register_callbacks cb 0x7f6d8c00ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.004+0000 7f6d96ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc89dc0 0x56086fca5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.004+0000 7f6d97fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc9ceb0 0x56086fca1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.004+0000 7f6d96ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc89dc0 0x56086fca5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.7:59420/0 (socket says 172.21.15.7:59420) 2024-09-19T08:54:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.004+0000 7f6d96ffd640 1 -- 172.21.15.7:0/4178928003 learned_addr learned my addr 172.21.15.7:0/4178928003 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.004+0000 7f6d977fe640 1 --2- 172.21.15.7:0/4178928003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56086fc894a0 0x56086fca4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.004+0000 7f6d96ffd640 1 -- 172.21.15.7:0/4178928003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56086fc894a0 msgr2=0x56086fca4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.004+0000 7f6d96ffd640 1 --2- 172.21.15.7:0/4178928003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56086fc894a0 0x56086fca4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.004+0000 7f6d96ffd640 1 -- 172.21.15.7:0/4178928003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc9ceb0 msgr2=0x56086fca1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.004+0000 7f6d96ffd640 1 --2- 172.21.15.7:0/4178928003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc9ceb0 0x56086fca1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.004+0000 7f6d96ffd640 1 -- 172.21.15.7:0/4178928003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56086fca5a60 con 0x56086fc89dc0 2024-09-19T08:54:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.004+0000 7f6d97fff640 1 --2- 172.21.15.7:0/4178928003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc9ceb0 0x56086fca1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:30.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.005+0000 7f6d96ffd640 1 --2- 172.21.15.7:0/4178928003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc89dc0 0x56086fca5370 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c000c00 tx=0x7f6d8c0a0330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56fa154a9d30a6d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:30.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.005+0000 7f6d76ffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-19T08:54:30.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.005+0000 7f6d76ffd640 1 -- 172.21.15.7:0/4178928003 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c09bfa0 con 0x56086fc89dc0 2024-09-19T08:54:30.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.005+0000 7f6d76ffd640 1 -- 172.21.15.7:0/4178928003 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f6d8c018d10 con 0x56086fc89dc0 2024-09-19T08:54:30.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.005+0000 7f6da00f6740 1 -- 172.21.15.7:0/4178928003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d8805a070 con 0x56086fc89dc0 2024-09-19T08:54:30.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.005+0000 7f6d76ffd640 1 -- 172.21.15.7:0/4178928003 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6d8c09b910 con 0x56086fc89dc0 2024-09-19T08:54:30.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.005+0000 7f6da00f6740 10 client.27140 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:30.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.005+0000 7f6da00f6740 1 -- 172.21.15.7:0/4178928003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56086fd17bd0 con 0x56086fc89dc0 2024-09-19T08:54:30.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.005+0000 7f6d76ffd640 1 -- 172.21.15.7:0/4178928003 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d8805a070 con 0x56086fc89dc0 2024-09-19T08:54:30.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.005+0000 7f6d76ffd640 1 -- 172.21.15.7:0/4178928003 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6d8c0cdce0 con 0x56086fc89dc0 2024-09-19T08:54:30.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.006+0000 7f6da00f6740 10 client.27140 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:30.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.006+0000 7f6da00f6740 10 client.27140 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:30.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.006+0000 7f6da00f6740 20 client.27140 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:30.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.006+0000 7f6da00f6740 1 --2- 172.21.15.7:0/4178928003 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56086fd18290 0x56086fd1a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:30.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.006+0000 7f6da00f6740 4 client.27140 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:54:30.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.006+0000 7f6da00f6740 1 -- 172.21.15.7:0/4178928003 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56086fbf6d60 con 0x56086fd18290 2024-09-19T08:54:30.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.006+0000 7f6d977fe640 1 --2- 172.21.15.7:0/4178928003 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56086fd18290 0x56086fd1a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:30.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.006+0000 7f6d977fe640 1 --2- 172.21.15.7:0/4178928003 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56086fd18290 0x56086fd1a6b0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70d9348344aa3483 server_cookie=c2cfe78733965a57 in_seq=0 out_seq=0 2024-09-19T08:54:30.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.006+0000 7f6d76ffd640 10 client.27140 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:30.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.006+0000 7f6d76ffd640 1 -- 172.21.15.7:0/4178928003 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56086fbf6d60 con 0x56086fd18290 2024-09-19T08:54:30.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.006+0000 7f6d76ffd640 10 client.27140 handle_command_reply: tid=0 2024-09-19T08:54:30.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.006+0000 7f6da00f6740 1 client.27140 shutdown 2024-09-19T08:54:30.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.007+0000 7f6da00f6740 1 -- 172.21.15.7:0/4178928003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc89dc0 msgr2=0x56086fca5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:30.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.007+0000 7f6da00f6740 1 --2- 172.21.15.7:0/4178928003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc89dc0 0x56086fca5370 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c000c00 tx=0x7f6d8c0a0330 comp rx=0 tx=0).stop 2024-09-19T08:54:30.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.007+0000 7f6da00f6740 1 -- 172.21.15.7:0/4178928003 shutdown_connections 2024-09-19T08:54:30.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.007+0000 7f6da00f6740 1 --2- 172.21.15.7:0/4178928003 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x56086fd18290 0x56086fd1a6b0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.007+0000 7f6da00f6740 1 --2- 172.21.15.7:0/4178928003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56086fc9ceb0 0x56086fca1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.007+0000 7f6da00f6740 1 --2- 172.21.15.7:0/4178928003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56086fc89dc0 0x56086fca5370 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.007+0000 7f6d76ffd640 0 client.27140 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:30.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.007+0000 7f6da00f6740 1 --2- 172.21.15.7:0/4178928003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56086fc894a0 0x56086fca4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.007+0000 7f6da00f6740 1 -- 172.21.15.7:0/4178928003 >> 172.21.15.7:0/4178928003 conn(0x56086fc85970 msgr2=0x56086fc9b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:30.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.007+0000 7f6da00f6740 1 -- 172.21.15.7:0/4178928003 shutdown_connections 2024-09-19T08:54:30.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.007+0000 7f6da00f6740 1 -- 172.21.15.7:0/4178928003 wait complete. 2024-09-19T08:54:30.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.007+0000 7f6da00f6740 20 client.27140 trim_cache size 0 max 16384 2024-09-19T08:54:30.015 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:54:30.015 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-19T08:54:30.015 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-09-19T08:54:30.015 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:54:30.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.008+0000 7f6d9dd1d640 1 -- 172.21.15.7:0/4163966001 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6d800a3500 msgr2=0x7f6d800a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:30.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.008+0000 7f6d9dd1d640 1 --2- 172.21.15.7:0/4163966001 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6d800a3500 0x7f6d800a59c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6d880096c0 tx=0x7f6d880058d0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.008+0000 7f6d9dd1d640 1 -- 172.21.15.7:0/4163966001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d98103660 msgr2=0x7f6d98100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:30.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.008+0000 7f6d9dd1d640 1 --2- 172.21.15.7:0/4163966001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d98103660 0x7f6d98100ee0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00e9f0 tx=0x7f6d8c00eeb0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.008+0000 7f6d9dd1d640 1 -- 172.21.15.7:0/4163966001 shutdown_connections 2024-09-19T08:54:30.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.008+0000 7f6d9dd1d640 1 --2- 172.21.15.7:0/4163966001 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f6d800a3500 0x7f6d800a59c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.008+0000 7f6d9dd1d640 1 --2- 172.21.15.7:0/4163966001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d9810c170 0x7f6d98101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.008+0000 7f6d9dd1d640 1 --2- 172.21.15.7:0/4163966001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d98103660 0x7f6d98100ee0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.008+0000 7f6d9dd1d640 1 --2- 172.21.15.7:0/4163966001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d98102d40 0x7f6d981009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.008+0000 7f6d9dd1d640 1 -- 172.21.15.7:0/4163966001 >> 172.21.15.7:0/4163966001 conn(0x7f6d980fc7a0 msgr2=0x7f6d980fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:30.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.008+0000 7f6d9dd1d640 1 -- 172.21.15.7:0/4163966001 shutdown_connections 2024-09-19T08:54:30.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:30.008+0000 7f6d9dd1d640 1 -- 172.21.15.7:0/4163966001 wait complete. 2024-09-19T08:54:30.740 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:54:30.740 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:54:30.997 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:31.403 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:31 smithi007 ceph-mon[31221]: pgmap v310: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:54:31.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:31 smithi175 ceph-mon[35688]: pgmap v310: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:54:31.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.487+0000 7f876046e640 1 -- 172.21.15.7:0/120223252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8758102ef0 msgr2=0x7f875810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:31.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.487+0000 7f876046e640 1 --2- 172.21.15.7:0/120223252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8758102ef0 0x7f875810da40 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f8750009900 tx=0x7f875002a480 comp rx=0 tx=0).stop 2024-09-19T08:54:31.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.487+0000 7f876046e640 1 -- 172.21.15.7:0/120223252 shutdown_connections 2024-09-19T08:54:31.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.487+0000 7f876046e640 1 --2- 172.21.15.7:0/120223252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8758102ef0 0x7f875810da40 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.487+0000 7f876046e640 1 --2- 172.21.15.7:0/120223252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8758102570 0x7f87581029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.487+0000 7f876046e640 1 --2- 172.21.15.7:0/120223252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8758100e20 0x7f8758101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.487+0000 7f876046e640 1 -- 172.21.15.7:0/120223252 >> 172.21.15.7:0/120223252 conn(0x7f87580fc7d0 msgr2=0x7f87580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:31.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.487+0000 7f876046e640 1 -- 172.21.15.7:0/120223252 shutdown_connections 2024-09-19T08:54:31.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.487+0000 7f876046e640 1 -- 172.21.15.7:0/120223252 wait complete. 2024-09-19T08:54:31.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.488+0000 7f876046e640 1 Processor -- start 2024-09-19T08:54:31.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.488+0000 7f876046e640 1 -- start start 2024-09-19T08:54:31.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.488+0000 7f876046e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8758100e20 0x7f875819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:31.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.488+0000 7f876046e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8758102570 0x7f875819ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:31.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.488+0000 7f876046e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8758102ef0 0x7f875819efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:31.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.488+0000 7f876046e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8758110f80 con 0x7f8758100e20 2024-09-19T08:54:31.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.488+0000 7f876046e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8758110e00 con 0x7f8758102570 2024-09-19T08:54:31.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.488+0000 7f876046e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8758111100 con 0x7f8758102ef0 2024-09-19T08:54:31.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.488+0000 7f875e20a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8758100e20 0x7f875819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:31.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.488+0000 7f875e20a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8758100e20 0x7f875819a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53502/0 (socket says 172.21.15.7:53502) 2024-09-19T08:54:31.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.488+0000 7f875e20a640 1 -- 172.21.15.7:0/2710869063 learned_addr learned my addr 172.21.15.7:0/2710869063 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:31.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.488+0000 7f875ea0b640 1 --2- 172.21.15.7:0/2710869063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8758102ef0 0x7f875819efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:31.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.488+0000 7f875da09640 1 --2- 172.21.15.7:0/2710869063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8758102570 0x7f875819ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:31.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.488+0000 7f875e20a640 1 -- 172.21.15.7:0/2710869063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8758102ef0 msgr2=0x7f875819efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:31.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.488+0000 7f875e20a640 1 --2- 172.21.15.7:0/2710869063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8758102ef0 0x7f875819efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.488+0000 7f875e20a640 1 -- 172.21.15.7:0/2710869063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8758102570 msgr2=0x7f875819ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:31.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.488+0000 7f875e20a640 1 --2- 172.21.15.7:0/2710869063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8758102570 0x7f875819ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.488+0000 7f875e20a640 1 -- 172.21.15.7:0/2710869063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f875819f6c0 con 0x7f8758100e20 2024-09-19T08:54:31.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.488+0000 7f875ea0b640 1 --2- 172.21.15.7:0/2710869063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8758102ef0 0x7f875819efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:31.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.488+0000 7f875e20a640 1 --2- 172.21.15.7:0/2710869063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8758100e20 0x7f875819a710 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f874800ea80 tx=0x7f874800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:31.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.489+0000 7f87577fe640 1 -- 172.21.15.7:0/2710869063 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874800ce40 con 0x7f8758100e20 2024-09-19T08:54:31.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.489+0000 7f87577fe640 1 -- 172.21.15.7:0/2710869063 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8748005020 con 0x7f8758100e20 2024-09-19T08:54:31.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.489+0000 7f876046e640 1 -- 172.21.15.7:0/2710869063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f875819f9b0 con 0x7f8758100e20 2024-09-19T08:54:31.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.489+0000 7f87577fe640 1 -- 172.21.15.7:0/2710869063 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748011760 con 0x7f8758100e20 2024-09-19T08:54:31.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.489+0000 7f876046e640 1 -- 172.21.15.7:0/2710869063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87581a7290 con 0x7f8758100e20 2024-09-19T08:54:31.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.490+0000 7f876046e640 1 -- 172.21.15.7:0/2710869063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8758101200 con 0x7f8758100e20 2024-09-19T08:54:31.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.491+0000 7f87577fe640 1 -- 172.21.15.7:0/2710869063 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f87480051d0 con 0x7f8758100e20 2024-09-19T08:54:31.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.492+0000 7f87577fe640 1 --2- 172.21.15.7:0/2710869063 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f87400a33b0 0x7f87400a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:31.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.492+0000 7f875da09640 1 --2- 172.21.15.7:0/2710869063 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f87400a33b0 0x7f87400a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:31.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.492+0000 7f87577fe640 1 -- 172.21.15.7:0/2710869063 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f87480d04a0 con 0x7f8758100e20 2024-09-19T08:54:31.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.492+0000 7f875da09640 1 --2- 172.21.15.7:0/2710869063 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f87400a33b0 0x7f87400a5870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f87580ff0c0 tx=0x7f874c005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:31.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.495+0000 7f87577fe640 1 -- 172.21.15.7:0/2710869063 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8748016030 con 0x7f8758100e20 2024-09-19T08:54:31.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:31 smithi044 ceph-mon[35072]: pgmap v310: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T08:54:31.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.706+0000 7f876046e640 1 -- 172.21.15.7:0/2710869063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f875819ba70 con 0x7f8758100e20 2024-09-19T08:54:31.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.707+0000 7f87577fe640 1 -- 172.21.15.7:0/2710869063 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f874809ce40 con 0x7f8758100e20 2024-09-19T08:54:31.707 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:54:31.707 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:54:31.707 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:54:31.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.709+0000 7f876046e640 1 -- 172.21.15.7:0/2710869063 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f87400a33b0 msgr2=0x7f87400a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:31.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.709+0000 7f876046e640 1 --2- 172.21.15.7:0/2710869063 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f87400a33b0 0x7f87400a5870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f87580ff0c0 tx=0x7f874c005f90 comp rx=0 tx=0).stop 2024-09-19T08:54:31.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.709+0000 7f876046e640 1 -- 172.21.15.7:0/2710869063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8758100e20 msgr2=0x7f875819a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:31.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.709+0000 7f876046e640 1 --2- 172.21.15.7:0/2710869063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8758100e20 0x7f875819a710 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f874800ea80 tx=0x7f874800ef40 comp rx=0 tx=0).stop 2024-09-19T08:54:31.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.710+0000 7f876046e640 1 -- 172.21.15.7:0/2710869063 shutdown_connections 2024-09-19T08:54:31.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.710+0000 7f876046e640 1 --2- 172.21.15.7:0/2710869063 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f87400a33b0 0x7f87400a5870 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.710+0000 7f876046e640 1 --2- 172.21.15.7:0/2710869063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8758102ef0 0x7f875819efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.710+0000 7f876046e640 1 --2- 172.21.15.7:0/2710869063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8758102570 0x7f875819ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.710+0000 7f876046e640 1 --2- 172.21.15.7:0/2710869063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8758100e20 0x7f875819a710 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.710+0000 7f876046e640 1 -- 172.21.15.7:0/2710869063 >> 172.21.15.7:0/2710869063 conn(0x7f87580fc7d0 msgr2=0x7f875806a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:31.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.710+0000 7f876046e640 1 -- 172.21.15.7:0/2710869063 shutdown_connections 2024-09-19T08:54:31.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:31.710+0000 7f876046e640 1 -- 172.21.15.7:0/2710869063 wait complete. 2024-09-19T08:54:32.392 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:32 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2710869063' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:32.420 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:54:32.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:32 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/2710869063' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:32.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:32 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/2710869063' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:32.673 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.112+0000 7f7c187c6640 1 -- 172.21.15.7:0/2425360980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c10102570 msgr2=0x7f7c101029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.112+0000 7f7c187c6640 1 --2- 172.21.15.7:0/2425360980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c10102570 0x7f7c101029b0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f7c04009900 tx=0x7f7c0402a480 comp rx=0 tx=0).stop 2024-09-19T08:54:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.112+0000 7f7c187c6640 1 -- 172.21.15.7:0/2425360980 shutdown_connections 2024-09-19T08:54:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.112+0000 7f7c187c6640 1 --2- 172.21.15.7:0/2425360980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c10102ef0 0x7f7c1010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.112+0000 7f7c187c6640 1 --2- 172.21.15.7:0/2425360980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c10102570 0x7f7c101029b0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.112+0000 7f7c187c6640 1 --2- 172.21.15.7:0/2425360980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c10100e20 0x7f7c10101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.112+0000 7f7c187c6640 1 -- 172.21.15.7:0/2425360980 >> 172.21.15.7:0/2425360980 conn(0x7f7c100fc7d0 msgr2=0x7f7c100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.112+0000 7f7c187c6640 1 -- 172.21.15.7:0/2425360980 shutdown_connections 2024-09-19T08:54:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.112+0000 7f7c187c6640 1 -- 172.21.15.7:0/2425360980 wait complete. 2024-09-19T08:54:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.112+0000 7f7c187c6640 1 Processor -- start 2024-09-19T08:54:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.113+0000 7f7c187c6640 1 -- start start 2024-09-19T08:54:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.113+0000 7f7c187c6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c10100e20 0x7f7c10197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.113+0000 7f7c187c6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c10102570 0x7f7c10197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.113+0000 7f7c187c6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c10102ef0 0x7f7c1019bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.113+0000 7f7c187c6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7c10110f80 con 0x7f7c10102570 2024-09-19T08:54:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.113+0000 7f7c187c6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7c10110e00 con 0x7f7c10102ef0 2024-09-19T08:54:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.113+0000 7f7c187c6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7c10111100 con 0x7f7c10100e20 2024-09-19T08:54:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.113+0000 7f7c15d61640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c10102570 0x7f7c10197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.113+0000 7f7c15d61640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c10102570 0x7f7c10197860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53526/0 (socket says 172.21.15.7:53526) 2024-09-19T08:54:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.113+0000 7f7c15d61640 1 -- 172.21.15.7:0/1675081745 learned_addr learned my addr 172.21.15.7:0/1675081745 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.113+0000 7f7c16562640 1 --2- 172.21.15.7:0/1675081745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c10100e20 0x7f7c10197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.113+0000 7f7c16d63640 1 --2- 172.21.15.7:0/1675081745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c10102ef0 0x7f7c1019bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.113+0000 7f7c15d61640 1 -- 172.21.15.7:0/1675081745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c10100e20 msgr2=0x7f7c10197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.113+0000 7f7c15d61640 1 --2- 172.21.15.7:0/1675081745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c10100e20 0x7f7c10197320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.113+0000 7f7c15d61640 1 -- 172.21.15.7:0/1675081745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c10102ef0 msgr2=0x7f7c1019bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.113+0000 7f7c15d61640 1 --2- 172.21.15.7:0/1675081745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c10102ef0 0x7f7c1019bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.113+0000 7f7c15d61640 1 -- 172.21.15.7:0/1675081745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c1019c2d0 con 0x7f7c10102570 2024-09-19T08:54:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.113+0000 7f7c15d61640 1 --2- 172.21.15.7:0/1675081745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c10102570 0x7f7c10197860 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f7c04006010 tx=0x7f7c04003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.114+0000 7f7c037fe640 1 -- 172.21.15.7:0/1675081745 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0403f070 con 0x7f7c10102570 2024-09-19T08:54:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.114+0000 7f7c187c6640 1 -- 172.21.15.7:0/1675081745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c1019c560 con 0x7f7c10102570 2024-09-19T08:54:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.114+0000 7f7c037fe640 1 -- 172.21.15.7:0/1675081745 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c04031c30 con 0x7f7c10102570 2024-09-19T08:54:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.114+0000 7f7c037fe640 1 -- 172.21.15.7:0/1675081745 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c04035030 con 0x7f7c10102570 2024-09-19T08:54:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.114+0000 7f7c187c6640 1 -- 172.21.15.7:0/1675081745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c101a3ea0 con 0x7f7c10102570 2024-09-19T08:54:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.116+0000 7f7c037fe640 1 -- 172.21.15.7:0/1675081745 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f7c04042070 con 0x7f7c10102570 2024-09-19T08:54:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.116+0000 7f7c1ab9f740 1 Processor -- start 2024-09-19T08:54:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.116+0000 7f7c1ab9f740 1 -- start start 2024-09-19T08:54:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.117+0000 7f7c1ab9f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d785b40 0x560c7d784090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.117+0000 7f7c1ab9f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c7d7845d0 0x560c7d784a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.117+0000 7f7c1ab9f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c7d78f370 0x560c7d791760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.117+0000 7f7c1ab9f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560c7d6ea2f0 con 0x560c7d785b40 2024-09-19T08:54:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.117+0000 7f7c1ab9f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560c7d691cf0 con 0x560c7d7845d0 2024-09-19T08:54:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.117+0000 7f7c1ab9f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560c7d6e62b0 con 0x560c7d78f370 2024-09-19T08:54:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.117+0000 7f7c037fe640 1 --2- 172.21.15.7:0/1675081745 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7bfc0a33b0 0x7f7bfc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.117+0000 7f7c16d63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d785b40 0x560c7d784090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.117+0000 7f7c16d63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d785b40 0x560c7d784090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53528/0 (socket says 172.21.15.7:53528) 2024-09-19T08:54:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.117+0000 7f7c16d63640 1 -- 172.21.15.7:0/2841012872 learned_addr learned my addr 172.21.15.7:0/2841012872 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.117+0000 7f7c16562640 1 --2- 172.21.15.7:0/2841012872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c7d7845d0 0x560c7d784a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.117+0000 7f7c16d63640 1 --2- 172.21.15.7:0/1675081745 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7bfc0a33b0 0x7f7bfc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.117+0000 7f7c15d61640 1 --2- 172.21.15.7:0/2841012872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c7d78f370 0x560c7d791760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.117+0000 7f7c037fe640 1 -- 172.21.15.7:0/1675081745 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f7c040f0570 con 0x7f7c10102570 2024-09-19T08:54:33.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.117+0000 7f7c16d63640 1 -- 172.21.15.7:0/2841012872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c7d78f370 msgr2=0x560c7d791760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:33.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.117+0000 7f7c16d63640 1 --2- 172.21.15.7:0/2841012872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c7d78f370 0x560c7d791760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.117+0000 7f7c16d63640 1 -- 172.21.15.7:0/2841012872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c7d7845d0 msgr2=0x560c7d784a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:33.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.117+0000 7f7c16d63640 1 --2- 172.21.15.7:0/2841012872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c7d7845d0 0x560c7d784a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.117+0000 7f7c16d63640 1 -- 172.21.15.7:0/2841012872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c7d6763a0 con 0x560c7d785b40 2024-09-19T08:54:33.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.117+0000 7f7c16d63640 1 --2- 172.21.15.7:0/2841012872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d785b40 0x560c7d784090 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f7c08013a50 tx=0x7f7c08013f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3206bc53ebdc65 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:33.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.118+0000 7f7c00ff9640 1 -- 172.21.15.7:0/2841012872 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c08013050 con 0x560c7d785b40 2024-09-19T08:54:33.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.118+0000 7f7c00ff9640 1 -- 172.21.15.7:0/2841012872 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c08022070 con 0x560c7d785b40 2024-09-19T08:54:33.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.118+0000 7f7c16d63640 1 --2- 172.21.15.7:0/1675081745 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7bfc0a33b0 0x7f7bfc0a5870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7c08021000 tx=0x7f7c0801f000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:33.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.118+0000 7f7c00ff9640 1 -- 172.21.15.7:0/2841012872 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c080126b0 con 0x560c7d785b40 2024-09-19T08:54:33.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.118+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/2841012872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d785b40 msgr2=0x560c7d784090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:33.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.118+0000 7f7c1ab9f740 1 --2- 172.21.15.7:0/2841012872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d785b40 0x560c7d784090 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f7c08013a50 tx=0x7f7c08013f10 comp rx=0 tx=0).stop 2024-09-19T08:54:33.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.118+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/2841012872 shutdown_connections 2024-09-19T08:54:33.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.118+0000 7f7c1ab9f740 1 --2- 172.21.15.7:0/2841012872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c7d78f370 0x560c7d791760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.118+0000 7f7c1ab9f740 1 --2- 172.21.15.7:0/2841012872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c7d7845d0 0x560c7d784a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.118+0000 7f7c1ab9f740 1 --2- 172.21.15.7:0/2841012872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d785b40 0x560c7d784090 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.118+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/2841012872 >> 172.21.15.7:0/2841012872 conn(0x560c7d74d310 msgr2=0x560c7d780c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:33.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.119+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/2841012872 shutdown_connections 2024-09-19T08:54:33.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.119+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/2841012872 wait complete. 2024-09-19T08:54:33.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.119+0000 7f7c1ab9f740 1 -- start start 2024-09-19T08:54:33.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.119+0000 7f7c1ab9f740 1 Processor -- start 2024-09-19T08:54:33.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.119+0000 7f7c1ab9f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c7d7845d0 0x560c7d78ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.119+0000 7f7c1ab9f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c7d785b40 0x560c7d78bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.119+0000 7f7c1ab9f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d78f370 0x560c7d78c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.119+0000 7f7c1ab9f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560c7d792070 con 0x560c7d78f370 2024-09-19T08:54:33.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.119+0000 7f7c1ab9f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560c7d6a5060 con 0x560c7d7845d0 2024-09-19T08:54:33.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.119+0000 7f7c1ab9f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560c7d7921f0 con 0x560c7d785b40 2024-09-19T08:54:33.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.119+0000 7f7c1ab9f740 10 client.0 _ll_register_callbacks cb 0x560c7d3f88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:33.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.119+0000 7f7c16d63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d78f370 0x560c7d78c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.119+0000 7f7c16d63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d78f370 0x560c7d78c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53540/0 (socket says 172.21.15.7:53540) 2024-09-19T08:54:33.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.119+0000 7f7c16d63640 1 -- 172.21.15.7:0/2159756153 learned_addr learned my addr 172.21.15.7:0/2159756153 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:33.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.119+0000 7f7c15d61640 1 --2- 172.21.15.7:0/2159756153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c7d785b40 0x560c7d78bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.120+0000 7f7c16562640 1 --2- 172.21.15.7:0/2159756153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c7d7845d0 0x560c7d78ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.120+0000 7f7c16d63640 1 -- 172.21.15.7:0/2159756153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c7d785b40 msgr2=0x560c7d78bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:33.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.120+0000 7f7c16d63640 1 --2- 172.21.15.7:0/2159756153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c7d785b40 0x560c7d78bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.120+0000 7f7c16d63640 1 -- 172.21.15.7:0/2159756153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c7d7845d0 msgr2=0x560c7d78ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:33.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.120+0000 7f7c16d63640 1 --2- 172.21.15.7:0/2159756153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c7d7845d0 0x560c7d78ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.120+0000 7f7c16d63640 1 -- 172.21.15.7:0/2159756153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c7d45b3c0 con 0x560c7d78f370 2024-09-19T08:54:33.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.120+0000 7f7c15d61640 1 --2- 172.21.15.7:0/2159756153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c7d785b40 0x560c7d78bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:33.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.120+0000 7f7c16d63640 1 --2- 172.21.15.7:0/2159756153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d78f370 0x560c7d78c5e0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f7c08013530 tx=0x7f7c0801eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dace34d9c4aa45f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:33.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.120+0000 7f7bf9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:33.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.120+0000 7f7bf9ffb640 1 -- 172.21.15.7:0/2159756153 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c08013690 con 0x560c7d78f370 2024-09-19T08:54:33.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.120+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/2159756153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c08022070 con 0x560c7d78f370 2024-09-19T08:54:33.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.120+0000 7f7bf9ffb640 1 -- 172.21.15.7:0/2159756153 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f7c08003b80 con 0x560c7d78f370 2024-09-19T08:54:33.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.120+0000 7f7bf9ffb640 1 -- 172.21.15.7:0/2159756153 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7c08003d80 con 0x560c7d78f370 2024-09-19T08:54:33.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.120+0000 7f7c1ab9f740 10 client.17643 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:33.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.120+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/2159756153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560c7d79dae0 con 0x560c7d78f370 2024-09-19T08:54:33.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.120+0000 7f7bf9ffb640 1 -- 172.21.15.7:0/2159756153 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c08022070 con 0x560c7d78f370 2024-09-19T08:54:33.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.121+0000 7f7bf9ffb640 1 -- 172.21.15.7:0/2159756153 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7c0803a030 con 0x560c7d78f370 2024-09-19T08:54:33.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.121+0000 7f7c1ab9f740 10 client.17643 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:33.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.121+0000 7f7c1ab9f740 10 client.17643 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:54:33.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.121+0000 7f7c1ab9f740 20 client.17643 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:33.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.121+0000 7f7c1ab9f740 1 --2- 172.21.15.7:0/2159756153 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x560c7d79ef40 0x560c7d7a1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.121+0000 7f7c1ab9f740 4 client.17643 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:33.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.121+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/2159756153 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c7d6f7860 con 0x560c7d79ef40 2024-09-19T08:54:33.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.121+0000 7f7c16562640 1 --2- 172.21.15.7:0/2159756153 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x560c7d79ef40 0x560c7d7a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.121+0000 7f7c16562640 1 --2- 172.21.15.7:0/2159756153 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x560c7d79ef40 0x560c7d7a1330 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e9f38940bfa57041 server_cookie=888d5db0cfd0be21 in_seq=0 out_seq=0 2024-09-19T08:54:33.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.121+0000 7f7bf9ffb640 10 client.17643 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:54:33.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.122+0000 7f7bf9ffb640 1 -- 172.21.15.7:0/2159756153 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560c7d6f7860 con 0x560c7d79ef40 2024-09-19T08:54:33.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.122+0000 7f7bf9ffb640 10 client.17643 handle_command_reply: tid=0 2024-09-19T08:54:33.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.122+0000 7f7c1ab9f740 1 client.17643 shutdown 2024-09-19T08:54:33.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.122+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/2159756153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d78f370 msgr2=0x560c7d78c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:33.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.122+0000 7f7c1ab9f740 1 --2- 172.21.15.7:0/2159756153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d78f370 0x560c7d78c5e0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f7c08013530 tx=0x7f7c0801eef0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.123+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/2159756153 shutdown_connections 2024-09-19T08:54:33.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.123+0000 7f7c1ab9f740 1 --2- 172.21.15.7:0/2159756153 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x560c7d79ef40 0x560c7d7a1330 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.123+0000 7f7c1ab9f740 1 --2- 172.21.15.7:0/2159756153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d78f370 0x560c7d78c5e0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.123+0000 7f7c1ab9f740 1 --2- 172.21.15.7:0/2159756153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c7d785b40 0x560c7d78bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.123+0000 7f7c1ab9f740 1 --2- 172.21.15.7:0/2159756153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c7d7845d0 0x560c7d78ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.123+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/2159756153 >> 172.21.15.7:0/2159756153 conn(0x560c7d74d310 msgr2=0x560c7d786960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:33.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.123+0000 7f7bf9ffb640 0 client.17643 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:54:33.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.123+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/2159756153 shutdown_connections 2024-09-19T08:54:33.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.123+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/2159756153 wait complete. 2024-09-19T08:54:33.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.123+0000 7f7c1ab9f740 20 client.17643 trim_cache size 0 max 16384 2024-09-19T08:54:33.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.135+0000 7f7c1ab9f740 1 Processor -- start 2024-09-19T08:54:33.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.135+0000 7f7c1ab9f740 1 -- start start 2024-09-19T08:54:33.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.136+0000 7f7c1ab9f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c7d7845d0 0x560c7d79b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.136+0000 7f7c1ab9f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c7d785b40 0x560c7d787120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.136+0000 7f7c1ab9f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d78f370 0x560c7d787660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.136+0000 7f7c1ab9f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7c101ade80 con 0x560c7d78f370 2024-09-19T08:54:33.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.136+0000 7f7c1ab9f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7c101ab750 con 0x560c7d7845d0 2024-09-19T08:54:33.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.136+0000 7f7c1ab9f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7c101a95c0 con 0x560c7d785b40 2024-09-19T08:54:33.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.136+0000 7f7c16d63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d78f370 0x560c7d787660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.136+0000 7f7c16d63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d78f370 0x560c7d787660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53554/0 (socket says 172.21.15.7:53554) 2024-09-19T08:54:33.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.136+0000 7f7c16d63640 1 -- 172.21.15.7:0/3304143980 learned_addr learned my addr 172.21.15.7:0/3304143980 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:33.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.136+0000 7f7c15d61640 1 --2- 172.21.15.7:0/3304143980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c7d785b40 0x560c7d787120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.136+0000 7f7c16562640 1 --2- 172.21.15.7:0/3304143980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c7d7845d0 0x560c7d79b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.136+0000 7f7c16d63640 1 -- 172.21.15.7:0/3304143980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c7d785b40 msgr2=0x560c7d787120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:33.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.136+0000 7f7c16d63640 1 --2- 172.21.15.7:0/3304143980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c7d785b40 0x560c7d787120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.136+0000 7f7c16d63640 1 -- 172.21.15.7:0/3304143980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c7d7845d0 msgr2=0x560c7d79b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:33.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.136+0000 7f7c16d63640 1 --2- 172.21.15.7:0/3304143980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c7d7845d0 0x560c7d79b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.136+0000 7f7c16d63640 1 -- 172.21.15.7:0/3304143980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c7d780ed0 con 0x560c7d78f370 2024-09-19T08:54:33.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.136+0000 7f7c16562640 1 --2- 172.21.15.7:0/3304143980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c7d7845d0 0x560c7d79b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:33.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.136+0000 7f7c16d63640 1 --2- 172.21.15.7:0/3304143980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d78f370 0x560c7d787660 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f7c08002230 tx=0x7f7c08007580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22795dc71212972f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:33.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.136+0000 7f7bfbfff640 1 -- 172.21.15.7:0/3304143980 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c08005e90 con 0x560c7d78f370 2024-09-19T08:54:33.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.136+0000 7f7bfbfff640 1 -- 172.21.15.7:0/3304143980 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c08022040 con 0x560c7d78f370 2024-09-19T08:54:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.136+0000 7f7bfbfff640 1 -- 172.21.15.7:0/3304143980 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0801da10 con 0x560c7d78f370 2024-09-19T08:54:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.137+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/3304143980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d78f370 msgr2=0x560c7d787660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.137+0000 7f7c1ab9f740 1 --2- 172.21.15.7:0/3304143980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d78f370 0x560c7d787660 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f7c08002230 tx=0x7f7c08007580 comp rx=0 tx=0).stop 2024-09-19T08:54:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.137+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/3304143980 shutdown_connections 2024-09-19T08:54:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.137+0000 7f7c1ab9f740 1 --2- 172.21.15.7:0/3304143980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d78f370 0x560c7d787660 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.137+0000 7f7c1ab9f740 1 --2- 172.21.15.7:0/3304143980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c7d785b40 0x560c7d787120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.137+0000 7f7c1ab9f740 1 --2- 172.21.15.7:0/3304143980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c7d7845d0 0x560c7d79b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.137+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/3304143980 >> 172.21.15.7:0/3304143980 conn(0x560c7d74d310 msgr2=0x560c7d78a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.137+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/3304143980 shutdown_connections 2024-09-19T08:54:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.137+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/3304143980 wait complete. 2024-09-19T08:54:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.137+0000 7f7c1ab9f740 1 -- start start 2024-09-19T08:54:33.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.137+0000 7f7c1ab9f740 1 Processor -- start 2024-09-19T08:54:33.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.138+0000 7f7c1ab9f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c7d7845d0 0x560c7d7924e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.138+0000 7f7c1ab9f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d785b40 0x560c7d792a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.138+0000 7f7c1ab9f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c7d78f370 0x560c7d807ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.138+0000 7f7c1ab9f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7c101a9c10 con 0x560c7d785b40 2024-09-19T08:54:33.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.138+0000 7f7c1ab9f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7c101ab080 con 0x560c7d7845d0 2024-09-19T08:54:33.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.138+0000 7f7c1ab9f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7c101aa2e0 con 0x560c7d78f370 2024-09-19T08:54:33.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.138+0000 7f7c1ab9f740 10 client.0 _ll_register_callbacks cb 0x7f7c0c00b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:33.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.138+0000 7f7c15d61640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d785b40 0x560c7d792a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.138+0000 7f7c15d61640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d785b40 0x560c7d792a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53570/0 (socket says 172.21.15.7:53570) 2024-09-19T08:54:33.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.138+0000 7f7c15d61640 1 -- 172.21.15.7:0/1115436422 learned_addr learned my addr 172.21.15.7:0/1115436422 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:33.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.138+0000 7f7c16562640 1 --2- 172.21.15.7:0/1115436422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c7d7845d0 0x560c7d7924e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.138+0000 7f7c16d63640 1 --2- 172.21.15.7:0/1115436422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c7d78f370 0x560c7d807ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.138+0000 7f7c15d61640 1 -- 172.21.15.7:0/1115436422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c7d78f370 msgr2=0x560c7d807ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:33.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.138+0000 7f7c15d61640 1 --2- 172.21.15.7:0/1115436422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c7d78f370 0x560c7d807ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.138+0000 7f7c15d61640 1 -- 172.21.15.7:0/1115436422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c7d7845d0 msgr2=0x560c7d7924e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:33.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.138+0000 7f7c15d61640 1 --2- 172.21.15.7:0/1115436422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c7d7845d0 0x560c7d7924e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.138+0000 7f7c15d61640 1 -- 172.21.15.7:0/1115436422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c7d793300 con 0x560c7d785b40 2024-09-19T08:54:33.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.138+0000 7f7c15d61640 1 --2- 172.21.15.7:0/1115436422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d785b40 0x560c7d792a20 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f7c040bc560 tx=0x7f7c040bc460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb3d894c7d2b4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:33.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.138+0000 7f7bf9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:33.167 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:54:33.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.138+0000 7f7bf9ffb640 1 -- 172.21.15.7:0/1115436422 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c040d4070 con 0x560c7d785b40 2024-09-19T08:54:33.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.138+0000 7f7bf9ffb640 1 -- 172.21.15.7:0/1115436422 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f7c040bccc0 con 0x560c7d785b40 2024-09-19T08:54:33.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.139+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/1115436422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c08022040 con 0x560c7d785b40 2024-09-19T08:54:33.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.139+0000 7f7bf9ffb640 1 -- 172.21.15.7:0/1115436422 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7c04049040 con 0x560c7d785b40 2024-09-19T08:54:33.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.139+0000 7f7c1ab9f740 10 client.17649 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:33.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.139+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/1115436422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560c7d8090d0 con 0x560c7d785b40 2024-09-19T08:54:33.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.139+0000 7f7bf9ffb640 1 -- 172.21.15.7:0/1115436422 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c08022040 con 0x560c7d785b40 2024-09-19T08:54:33.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.139+0000 7f7bf9ffb640 1 -- 172.21.15.7:0/1115436422 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7c040a5b60 con 0x560c7d785b40 2024-09-19T08:54:33.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.139+0000 7f7c1ab9f740 10 client.17649 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:33.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.139+0000 7f7c1ab9f740 10 client.17649 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:54:33.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.139+0000 7f7c1ab9f740 20 client.17649 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:33.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.139+0000 7f7c1ab9f740 1 --2- 172.21.15.7:0/1115436422 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x560c7d809840 0x560c7d80bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.139+0000 7f7c1ab9f740 4 client.17649 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:54:33.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.139+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/1115436422 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560c7d6f1d70 con 0x560c7d809840 2024-09-19T08:54:33.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.139+0000 7f7c16562640 1 --2- 172.21.15.7:0/1115436422 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x560c7d809840 0x560c7d80bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.140+0000 7f7bf9ffb640 10 client.17649 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:54:33.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.140+0000 7f7c16562640 1 --2- 172.21.15.7:0/1115436422 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x560c7d809840 0x560c7d80bc30 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5de5e9a44b061df7 server_cookie=6df9650f68cfde08 in_seq=0 out_seq=0 2024-09-19T08:54:33.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.140+0000 7f7bf9ffb640 1 -- 172.21.15.7:0/1115436422 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560c7d6f1d70 con 0x560c7d809840 2024-09-19T08:54:33.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.140+0000 7f7bf9ffb640 10 client.17649 handle_command_reply: tid=0 2024-09-19T08:54:33.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.140+0000 7f7c1ab9f740 1 client.17649 shutdown 2024-09-19T08:54:33.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.140+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/1115436422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d785b40 msgr2=0x560c7d792a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:33.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.140+0000 7f7c1ab9f740 1 --2- 172.21.15.7:0/1115436422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d785b40 0x560c7d792a20 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f7c040bc560 tx=0x7f7c040bc460 comp rx=0 tx=0).stop 2024-09-19T08:54:33.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.140+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/1115436422 shutdown_connections 2024-09-19T08:54:33.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.140+0000 7f7c1ab9f740 1 --2- 172.21.15.7:0/1115436422 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x560c7d809840 0x560c7d80bc30 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.140+0000 7f7c1ab9f740 1 --2- 172.21.15.7:0/1115436422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c7d78f370 0x560c7d807ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.140+0000 7f7c1ab9f740 1 --2- 172.21.15.7:0/1115436422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560c7d785b40 0x560c7d792a20 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.140+0000 7f7bf9ffb640 0 client.17649 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:54:33.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.140+0000 7f7c1ab9f740 1 --2- 172.21.15.7:0/1115436422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c7d7845d0 0x560c7d7924e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.140+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/1115436422 >> 172.21.15.7:0/1115436422 conn(0x560c7d74d310 msgr2=0x560c7d78d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:33.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.140+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/1115436422 shutdown_connections 2024-09-19T08:54:33.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.140+0000 7f7c1ab9f740 1 -- 172.21.15.7:0/1115436422 wait complete. 2024-09-19T08:54:33.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.140+0000 7f7c1ab9f740 20 client.17649 trim_cache size 0 max 16384 2024-09-19T08:54:33.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.141+0000 7f7c187c6640 1 -- 172.21.15.7:0/1675081745 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7bfc0a33b0 msgr2=0x7f7bfc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:33.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.141+0000 7f7c187c6640 1 --2- 172.21.15.7:0/1675081745 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7bfc0a33b0 0x7f7bfc0a5870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7c08021000 tx=0x7f7c0801f000 comp rx=0 tx=0).stop 2024-09-19T08:54:33.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.141+0000 7f7c187c6640 1 -- 172.21.15.7:0/1675081745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c10102570 msgr2=0x7f7c10197860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:33.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.141+0000 7f7c187c6640 1 --2- 172.21.15.7:0/1675081745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c10102570 0x7f7c10197860 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f7c04006010 tx=0x7f7c04003c10 comp rx=0 tx=0).stop 2024-09-19T08:54:33.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.141+0000 7f7c187c6640 1 -- 172.21.15.7:0/1675081745 shutdown_connections 2024-09-19T08:54:33.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.141+0000 7f7c187c6640 1 --2- 172.21.15.7:0/1675081745 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f7bfc0a33b0 0x7f7bfc0a5870 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.141+0000 7f7c187c6640 1 --2- 172.21.15.7:0/1675081745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c10102ef0 0x7f7c1019bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.141+0000 7f7c187c6640 1 --2- 172.21.15.7:0/1675081745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c10102570 0x7f7c10197860 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.141+0000 7f7c187c6640 1 --2- 172.21.15.7:0/1675081745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c10100e20 0x7f7c10197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.141+0000 7f7c187c6640 1 -- 172.21.15.7:0/1675081745 >> 172.21.15.7:0/1675081745 conn(0x7f7c100fc7d0 msgr2=0x7f7c10105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:33.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.141+0000 7f7c187c6640 1 -- 172.21.15.7:0/1675081745 shutdown_connections 2024-09-19T08:54:33.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:33.141+0000 7f7c187c6640 1 -- 172.21.15.7:0/1675081745 wait complete. 2024-09-19T08:54:33.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:33 smithi175 ceph-mon[35688]: pgmap v311: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:54:33.449 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:33 smithi007 ceph-mon[31221]: pgmap v311: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:54:33.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:33 smithi044 ceph-mon[35072]: pgmap v311: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:54:33.838 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:54:34.094 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:34.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.578+0000 7f5c06d82640 1 -- 172.21.15.7:0/1137940680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c00102dd0 msgr2=0x7f5c001031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:34.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.578+0000 7f5c06d82640 1 --2- 172.21.15.7:0/1137940680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c00102dd0 0x7f5c001031b0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8009930 tx=0x7f5bf802a420 comp rx=0 tx=0).stop 2024-09-19T08:54:34.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.578+0000 7f5c06d82640 1 -- 172.21.15.7:0/1137940680 shutdown_connections 2024-09-19T08:54:34.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.578+0000 7f5c06d82640 1 --2- 172.21.15.7:0/1137940680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c00108300 0x7f5c0010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.578+0000 7f5c06d82640 1 --2- 172.21.15.7:0/1137940680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c00103780 0x7f5c00107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.578+0000 7f5c06d82640 1 --2- 172.21.15.7:0/1137940680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c00102dd0 0x7f5c001031b0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.578+0000 7f5c06d82640 1 -- 172.21.15.7:0/1137940680 >> 172.21.15.7:0/1137940680 conn(0x7f5c000fc7d0 msgr2=0x7f5c000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:34.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.578+0000 7f5c06d82640 1 -- 172.21.15.7:0/1137940680 shutdown_connections 2024-09-19T08:54:34.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.578+0000 7f5c06d82640 1 -- 172.21.15.7:0/1137940680 wait complete. 2024-09-19T08:54:34.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.578+0000 7f5c06d82640 1 Processor -- start 2024-09-19T08:54:34.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.578+0000 7f5c06d82640 1 -- start start 2024-09-19T08:54:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.579+0000 7f5c06d82640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c00102dd0 0x7f5c001985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.579+0000 7f5c06d82640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c00103780 0x7f5c00198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.579+0000 7f5c06d82640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c00108300 0x7f5c0019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.579+0000 7f5c06d82640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5c001120b0 con 0x7f5c00102dd0 2024-09-19T08:54:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.579+0000 7f5c06d82640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5c00111f30 con 0x7f5c00108300 2024-09-19T08:54:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.579+0000 7f5c06d82640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5c00112230 con 0x7f5c00103780 2024-09-19T08:54:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.579+0000 7f5c04b1e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c00102dd0 0x7f5c001985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.579+0000 7f5c04b1e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c00102dd0 0x7f5c001985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57278/0 (socket says 172.21.15.7:57278) 2024-09-19T08:54:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.579+0000 7f5c04b1e640 1 -- 172.21.15.7:0/1752680318 learned_addr learned my addr 172.21.15.7:0/1752680318 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.579+0000 7f5c0531f640 1 --2- 172.21.15.7:0/1752680318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c00108300 0x7f5c0019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.579+0000 7f5bfffff640 1 --2- 172.21.15.7:0/1752680318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c00103780 0x7f5c00198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.579+0000 7f5c04b1e640 1 -- 172.21.15.7:0/1752680318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c00103780 msgr2=0x7f5c00198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.579+0000 7f5c04b1e640 1 --2- 172.21.15.7:0/1752680318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c00103780 0x7f5c00198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.579+0000 7f5c04b1e640 1 -- 172.21.15.7:0/1752680318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c00108300 msgr2=0x7f5c0019cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.579+0000 7f5c04b1e640 1 --2- 172.21.15.7:0/1752680318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c00108300 0x7f5c0019cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.579+0000 7f5c04b1e640 1 -- 172.21.15.7:0/1752680318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0019d5a0 con 0x7f5c00102dd0 2024-09-19T08:54:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.580+0000 7f5c04b1e640 1 --2- 172.21.15.7:0/1752680318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c00102dd0 0x7f5c001985f0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8009230 tx=0x7f5bf8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.580+0000 7f5bfdffb640 1 -- 172.21.15.7:0/1752680318 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf803f030 con 0x7f5c00102dd0 2024-09-19T08:54:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.580+0000 7f5bfdffb640 1 -- 172.21.15.7:0/1752680318 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bf8003ad0 con 0x7f5c00102dd0 2024-09-19T08:54:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.580+0000 7f5c06d82640 1 -- 172.21.15.7:0/1752680318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c0019d830 con 0x7f5c00102dd0 2024-09-19T08:54:34.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.580+0000 7f5bfdffb640 1 -- 172.21.15.7:0/1752680318 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8035070 con 0x7f5c00102dd0 2024-09-19T08:54:34.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.580+0000 7f5c06d82640 1 -- 172.21.15.7:0/1752680318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c001a5170 con 0x7f5c00102dd0 2024-09-19T08:54:34.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.582+0000 7f5bfdffb640 1 -- 172.21.15.7:0/1752680318 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f5bf8042030 con 0x7f5c00102dd0 2024-09-19T08:54:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.582+0000 7f5c0915b740 1 Processor -- start 2024-09-19T08:54:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.583+0000 7f5c0915b740 1 -- start start 2024-09-19T08:54:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.583+0000 7f5c0915b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55883fb58b40 0x55883fb57090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.583+0000 7f5c0915b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55883fb575d0 0x55883fb57a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.583+0000 7f5c0915b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb62370 0x55883fb64760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.583+0000 7f5c0915b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55883fabd2f0 con 0x55883fb62370 2024-09-19T08:54:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.583+0000 7f5c0915b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55883fa64cf0 con 0x55883fb575d0 2024-09-19T08:54:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.583+0000 7f5c0915b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55883fab92b0 con 0x55883fb58b40 2024-09-19T08:54:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.583+0000 7f5bfffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb62370 0x55883fb64760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.583+0000 7f5c04b1e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55883fb575d0 0x55883fb57a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.583+0000 7f5bfffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb62370 0x55883fb64760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57294/0 (socket says 172.21.15.7:57294) 2024-09-19T08:54:34.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.583+0000 7f5bfffff640 1 -- 172.21.15.7:0/3677205611 learned_addr learned my addr 172.21.15.7:0/3677205611 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:34.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.583+0000 7f5c0531f640 1 --2- 172.21.15.7:0/3677205611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55883fb58b40 0x55883fb57090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:34.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.583+0000 7f5bfffff640 1 -- 172.21.15.7:0/3677205611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55883fb58b40 msgr2=0x55883fb57090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:34.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.583+0000 7f5bfffff640 1 --2- 172.21.15.7:0/3677205611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55883fb58b40 0x55883fb57090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.583+0000 7f5bfffff640 1 -- 172.21.15.7:0/3677205611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55883fb575d0 msgr2=0x55883fb57a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:34.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.583+0000 7f5bfffff640 1 --2- 172.21.15.7:0/3677205611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55883fb575d0 0x55883fb57a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.583+0000 7f5bfffff640 1 -- 172.21.15.7:0/3677205611 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55883fa493a0 con 0x55883fb62370 2024-09-19T08:54:34.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.583+0000 7f5c04b1e640 1 --2- 172.21.15.7:0/3677205611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55883fb575d0 0x55883fb57a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:34.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.584+0000 7f5bfffff640 1 --2- 172.21.15.7:0/3677205611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb62370 0x55883fb64760 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f5be800b690 tx=0x7f5be800bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd97b0700d37a73 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:34.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.584+0000 7f5bfdffb640 1 --2- 172.21.15.7:0/1752680318 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5bec0a33b0 0x7f5bec0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:34.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.584+0000 7f5bf6ffd640 1 -- 172.21.15.7:0/3677205611 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be8003bd0 con 0x55883fb62370 2024-09-19T08:54:34.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.584+0000 7f5bf6ffd640 1 -- 172.21.15.7:0/3677205611 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5be8015070 con 0x55883fb62370 2024-09-19T08:54:34.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.584+0000 7f5bf6ffd640 1 -- 172.21.15.7:0/3677205611 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be8004e20 con 0x55883fb62370 2024-09-19T08:54:34.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.584+0000 7f5c0531f640 1 --2- 172.21.15.7:0/1752680318 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5bec0a33b0 0x7f5bec0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:34.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.584+0000 7f5bfdffb640 1 -- 172.21.15.7:0/1752680318 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f5bf80f0110 con 0x7f5c00102dd0 2024-09-19T08:54:34.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.585+0000 7f5c0915b740 1 -- 172.21.15.7:0/3677205611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb62370 msgr2=0x55883fb64760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:34.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.585+0000 7f5c0531f640 1 --2- 172.21.15.7:0/1752680318 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5bec0a33b0 0x7f5bec0a5870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0005fd0 tx=0x7f5bf00096a0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:34.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.585+0000 7f5c0915b740 1 --2- 172.21.15.7:0/3677205611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb62370 0x55883fb64760 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f5be800b690 tx=0x7f5be800bb50 comp rx=0 tx=0).stop 2024-09-19T08:54:34.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.585+0000 7f5c0915b740 1 -- 172.21.15.7:0/3677205611 shutdown_connections 2024-09-19T08:54:34.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.585+0000 7f5c0915b740 1 --2- 172.21.15.7:0/3677205611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb62370 0x55883fb64760 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.585+0000 7f5c0915b740 1 --2- 172.21.15.7:0/3677205611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55883fb575d0 0x55883fb57a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.585+0000 7f5c0915b740 1 --2- 172.21.15.7:0/3677205611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55883fb58b40 0x55883fb57090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.585+0000 7f5c0915b740 1 -- 172.21.15.7:0/3677205611 >> 172.21.15.7:0/3677205611 conn(0x55883fb20310 msgr2=0x55883fb53c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:34.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.585+0000 7f5c0915b740 1 -- 172.21.15.7:0/3677205611 shutdown_connections 2024-09-19T08:54:34.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.585+0000 7f5c0915b740 1 -- 172.21.15.7:0/3677205611 wait complete. 2024-09-19T08:54:34.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.585+0000 7f5c0915b740 1 -- start start 2024-09-19T08:54:34.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.585+0000 7f5c0915b740 1 Processor -- start 2024-09-19T08:54:34.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5c0915b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb575d0 0x55883fb61d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:34.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5c0915b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55883fb58b40 0x55883fb5efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:34.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5c0915b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55883fb62370 0x55883fb5f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:34.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5c0915b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55883fb65070 con 0x55883fb575d0 2024-09-19T08:54:34.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5c0915b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55883fa78060 con 0x55883fb58b40 2024-09-19T08:54:34.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5c0915b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55883fb651f0 con 0x55883fb62370 2024-09-19T08:54:34.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5c0915b740 10 client.0 _ll_register_callbacks cb 0x55883f7cb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:34.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5c04b1e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb575d0 0x55883fb61d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:34.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5c04b1e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb575d0 0x55883fb61d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57296/0 (socket says 172.21.15.7:57296) 2024-09-19T08:54:34.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5c04b1e640 1 -- 172.21.15.7:0/1669645381 learned_addr learned my addr 172.21.15.7:0/1669645381 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:34.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5c0531f640 1 --2- 172.21.15.7:0/1669645381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55883fb62370 0x55883fb5f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:34.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5bfffff640 1 --2- 172.21.15.7:0/1669645381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55883fb58b40 0x55883fb5efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:34.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5c04b1e640 1 -- 172.21.15.7:0/1669645381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55883fb62370 msgr2=0x55883fb5f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:34.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5c04b1e640 1 --2- 172.21.15.7:0/1669645381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55883fb62370 0x55883fb5f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5c04b1e640 1 -- 172.21.15.7:0/1669645381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55883fb58b40 msgr2=0x55883fb5efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:34.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5c04b1e640 1 --2- 172.21.15.7:0/1669645381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55883fb58b40 0x55883fb5efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5c04b1e640 1 -- 172.21.15.7:0/1669645381 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55883f82e3c0 con 0x55883fb575d0 2024-09-19T08:54:34.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5c0531f640 1 --2- 172.21.15.7:0/1669645381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55883fb62370 0x55883fb5f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:34.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5c04b1e640 1 --2- 172.21.15.7:0/1669645381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb575d0 0x55883fb61d20 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f5bf80bc200 tx=0x7f5bf80b81a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e4209fbca71a8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:34.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5bdffff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:34.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5bdffff640 1 -- 172.21.15.7:0/1669645381 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8049050 con 0x55883fb575d0 2024-09-19T08:54:34.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5bdffff640 1 -- 172.21.15.7:0/1669645381 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f5bf8003c80 con 0x55883fb575d0 2024-09-19T08:54:34.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.586+0000 7f5c0915b740 1 -- 172.21.15.7:0/1669645381 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5be8015070 con 0x55883fb575d0 2024-09-19T08:54:34.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.587+0000 7f5bdffff640 1 -- 172.21.15.7:0/1669645381 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5bf80b87a0 con 0x55883fb575d0 2024-09-19T08:54:34.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.587+0000 7f5c0915b740 10 client.17661 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:34.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.587+0000 7f5c0915b740 1 -- 172.21.15.7:0/1669645381 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55883fb70ac0 con 0x55883fb575d0 2024-09-19T08:54:34.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.587+0000 7f5bdffff640 1 -- 172.21.15.7:0/1669645381 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5be8015070 con 0x55883fb575d0 2024-09-19T08:54:34.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.587+0000 7f5bdffff640 1 -- 172.21.15.7:0/1669645381 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5bf80b8b70 con 0x55883fb575d0 2024-09-19T08:54:34.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.587+0000 7f5c0915b740 10 client.17661 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:34.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.587+0000 7f5c0915b740 10 client.17661 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:54:34.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.587+0000 7f5c0915b740 20 client.17661 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:34.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.587+0000 7f5c0915b740 1 --2- 172.21.15.7:0/1669645381 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55883fb71fc0 0x55883fb74410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:34.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.587+0000 7f5c0915b740 4 client.17661 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:34.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.587+0000 7f5c0915b740 1 -- 172.21.15.7:0/1669645381 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55883faca860 con 0x55883fb71fc0 2024-09-19T08:54:34.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.587+0000 7f5bfffff640 1 --2- 172.21.15.7:0/1669645381 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55883fb71fc0 0x55883fb74410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:34.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.588+0000 7f5bfffff640 1 --2- 172.21.15.7:0/1669645381 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55883fb71fc0 0x55883fb74410 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5083b99a2e0ecdb3 server_cookie=55c1193719b9cd75 in_seq=0 out_seq=0 2024-09-19T08:54:34.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.588+0000 7f5bdffff640 10 client.17661 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:54:34.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.588+0000 7f5bdffff640 1 -- 172.21.15.7:0/1669645381 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55883faca860 con 0x55883fb71fc0 2024-09-19T08:54:34.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.588+0000 7f5bdffff640 10 client.17661 handle_command_reply: tid=0 2024-09-19T08:54:34.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.589+0000 7f5c0915b740 1 client.17661 shutdown 2024-09-19T08:54:34.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.589+0000 7f5c0915b740 1 -- 172.21.15.7:0/1669645381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb575d0 msgr2=0x55883fb61d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:34.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.589+0000 7f5c0915b740 1 --2- 172.21.15.7:0/1669645381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb575d0 0x55883fb61d20 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f5bf80bc200 tx=0x7f5bf80b81a0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.589+0000 7f5c0915b740 1 -- 172.21.15.7:0/1669645381 shutdown_connections 2024-09-19T08:54:34.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.589+0000 7f5c0915b740 1 --2- 172.21.15.7:0/1669645381 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55883fb71fc0 0x55883fb74410 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.589+0000 7f5c0915b740 1 --2- 172.21.15.7:0/1669645381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55883fb62370 0x55883fb5f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.589+0000 7f5c0915b740 1 --2- 172.21.15.7:0/1669645381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55883fb58b40 0x55883fb5efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.589+0000 7f5c0915b740 1 --2- 172.21.15.7:0/1669645381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb575d0 0x55883fb61d20 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.589+0000 7f5c0915b740 1 -- 172.21.15.7:0/1669645381 >> 172.21.15.7:0/1669645381 conn(0x55883fb20310 msgr2=0x55883fb59960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:34.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.589+0000 7f5bdffff640 0 client.17661 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:54:34.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.589+0000 7f5c0915b740 1 -- 172.21.15.7:0/1669645381 shutdown_connections 2024-09-19T08:54:34.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.589+0000 7f5c0915b740 1 -- 172.21.15.7:0/1669645381 wait complete. 2024-09-19T08:54:34.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.589+0000 7f5c0915b740 20 client.17661 trim_cache size 0 max 16384 2024-09-19T08:54:34.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.602+0000 7f5c0915b740 1 Processor -- start 2024-09-19T08:54:34.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.602+0000 7f5c0915b740 1 -- start start 2024-09-19T08:54:34.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.602+0000 7f5c0915b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55883fb575d0 0x55883fb6e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:34.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.602+0000 7f5c0915b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55883fb58b40 0x55883fb52bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:34.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.602+0000 7f5c0915b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb62370 0x55883fb53130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:34.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.602+0000 7f5c0915b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5c001b01a0 con 0x55883fb62370 2024-09-19T08:54:34.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.602+0000 7f5c0915b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5c001ada70 con 0x55883fb575d0 2024-09-19T08:54:34.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.602+0000 7f5c0915b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5c001ab8e0 con 0x55883fb58b40 2024-09-19T08:54:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.602+0000 7f5c0531f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb62370 0x55883fb53130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.602+0000 7f5c0531f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb62370 0x55883fb53130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57310/0 (socket says 172.21.15.7:57310) 2024-09-19T08:54:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.602+0000 7f5c0531f640 1 -- 172.21.15.7:0/1707545945 learned_addr learned my addr 172.21.15.7:0/1707545945 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.603+0000 7f5c04b1e640 1 --2- 172.21.15.7:0/1707545945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55883fb575d0 0x55883fb6e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.603+0000 7f5bfffff640 1 --2- 172.21.15.7:0/1707545945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55883fb58b40 0x55883fb52bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.603+0000 7f5c0531f640 1 -- 172.21.15.7:0/1707545945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55883fb58b40 msgr2=0x55883fb52bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.603+0000 7f5c0531f640 1 --2- 172.21.15.7:0/1707545945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55883fb58b40 0x55883fb52bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.603+0000 7f5c0531f640 1 -- 172.21.15.7:0/1707545945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55883fb575d0 msgr2=0x55883fb6e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.603+0000 7f5c0531f640 1 --2- 172.21.15.7:0/1707545945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55883fb575d0 0x55883fb6e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.603+0000 7f5c0531f640 1 -- 172.21.15.7:0/1707545945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55883fb61940 con 0x55883fb62370 2024-09-19T08:54:34.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.603+0000 7f5c0531f640 1 --2- 172.21.15.7:0/1707545945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb62370 0x55883fb53130 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f5bf00109a0 tx=0x7f5bf0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5c0175b3593165 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:34.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.603+0000 7f5bf67fc640 1 -- 172.21.15.7:0/1707545945 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf002d070 con 0x55883fb62370 2024-09-19T08:54:34.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.603+0000 7f5bf67fc640 1 -- 172.21.15.7:0/1707545945 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bf0028410 con 0x55883fb62370 2024-09-19T08:54:34.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.603+0000 7f5bf67fc640 1 -- 172.21.15.7:0/1707545945 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf001c400 con 0x55883fb62370 2024-09-19T08:54:34.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.604+0000 7f5c0915b740 1 -- 172.21.15.7:0/1707545945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb62370 msgr2=0x55883fb53130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:34.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.604+0000 7f5c0915b740 1 --2- 172.21.15.7:0/1707545945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb62370 0x55883fb53130 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f5bf00109a0 tx=0x7f5bf0016000 comp rx=0 tx=0).stop 2024-09-19T08:54:34.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.604+0000 7f5c0915b740 1 -- 172.21.15.7:0/1707545945 shutdown_connections 2024-09-19T08:54:34.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.604+0000 7f5c0915b740 1 --2- 172.21.15.7:0/1707545945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb62370 0x55883fb53130 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.604+0000 7f5c0915b740 1 --2- 172.21.15.7:0/1707545945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55883fb58b40 0x55883fb52bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.604+0000 7f5c0915b740 1 --2- 172.21.15.7:0/1707545945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55883fb575d0 0x55883fb6e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.604+0000 7f5c0915b740 1 -- 172.21.15.7:0/1707545945 >> 172.21.15.7:0/1707545945 conn(0x55883fb20310 msgr2=0x55883fb524e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:34.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.604+0000 7f5c0915b740 1 -- 172.21.15.7:0/1707545945 shutdown_connections 2024-09-19T08:54:34.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.604+0000 7f5c0915b740 1 -- 172.21.15.7:0/1707545945 wait complete. 2024-09-19T08:54:34.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.604+0000 7f5c0915b740 1 -- start start 2024-09-19T08:54:34.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.604+0000 7f5c0915b740 1 Processor -- start 2024-09-19T08:54:34.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5c0915b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb575d0 0x55883fbd93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5c0915b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55883fb58b40 0x55883fbd9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5c0915b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55883fb62370 0x55883fbd4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5c0915b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5c001abf30 con 0x55883fb575d0 2024-09-19T08:54:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5c0915b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5c001ad3a0 con 0x55883fb58b40 2024-09-19T08:54:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5c0915b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5c001ac600 con 0x55883fb62370 2024-09-19T08:54:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5c0915b740 10 client.0 _ll_register_callbacks cb 0x7f5bf80f39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5c04b1e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb575d0 0x55883fbd93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5c04b1e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb575d0 0x55883fbd93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57312/0 (socket says 172.21.15.7:57312) 2024-09-19T08:54:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5c04b1e640 1 -- 172.21.15.7:0/3879359154 learned_addr learned my addr 172.21.15.7:0/3879359154 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5bfffff640 1 --2- 172.21.15.7:0/3879359154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55883fb58b40 0x55883fbd9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5c04b1e640 1 -- 172.21.15.7:0/3879359154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55883fb62370 msgr2=0x55883fbd4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5c0531f640 1 --2- 172.21.15.7:0/3879359154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55883fb62370 0x55883fbd4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:34.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5c04b1e640 1 --2- 172.21.15.7:0/3879359154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55883fb62370 0x55883fbd4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5c04b1e640 1 -- 172.21.15.7:0/3879359154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55883fb58b40 msgr2=0x55883fbd9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:34.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5c04b1e640 1 --2- 172.21.15.7:0/3879359154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55883fb58b40 0x55883fbd9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5c04b1e640 1 -- 172.21.15.7:0/3879359154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55883fbd5480 con 0x55883fb575d0 2024-09-19T08:54:34.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5bfffff640 1 --2- 172.21.15.7:0/3879359154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55883fb58b40 0x55883fbd9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:34.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5c0531f640 1 --2- 172.21.15.7:0/3879359154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55883fb62370 0x55883fbd4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:34.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5c04b1e640 1 --2- 172.21.15.7:0/3879359154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb575d0 0x55883fbd93d0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8005e90 tx=0x7f5bf80bc9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14e66fabf5ea68f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:34.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5bdffff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:34.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5bdffff640 1 -- 172.21.15.7:0/3879359154 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8049070 con 0x55883fb575d0 2024-09-19T08:54:34.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5bdffff640 1 -- 172.21.15.7:0/3879359154 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f5bf80edb40 con 0x55883fb575d0 2024-09-19T08:54:34.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.605+0000 7f5c0915b740 1 -- 172.21.15.7:0/3879359154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bf0028410 con 0x55883fb575d0 2024-09-19T08:54:34.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.606+0000 7f5bdffff640 1 -- 172.21.15.7:0/3879359154 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5bf80bbe60 con 0x55883fb575d0 2024-09-19T08:54:34.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.606+0000 7f5c0915b740 10 client.17667 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:34.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.606+0000 7f5c0915b740 1 -- 172.21.15.7:0/3879359154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55883fbe1cd0 con 0x55883fb575d0 2024-09-19T08:54:34.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.606+0000 7f5bdffff640 1 -- 172.21.15.7:0/3879359154 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bf0028410 con 0x55883fb575d0 2024-09-19T08:54:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.606+0000 7f5bdffff640 1 -- 172.21.15.7:0/3879359154 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5bf8031bd0 con 0x55883fb575d0 2024-09-19T08:54:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.606+0000 7f5c0915b740 10 client.17667 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.606+0000 7f5c0915b740 10 client.17667 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:54:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.606+0000 7f5c0915b740 20 client.17667 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.606+0000 7f5c0915b740 1 --2- 172.21.15.7:0/3879359154 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55883fbe2260 0x55883fbe4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.606+0000 7f5c0915b740 4 client.17667 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:54:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.606+0000 7f5c0915b740 1 -- 172.21.15.7:0/3879359154 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55883fac4d70 con 0x55883fbe2260 2024-09-19T08:54:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.606+0000 7f5bfffff640 1 --2- 172.21.15.7:0/3879359154 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55883fbe2260 0x55883fbe4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.607+0000 7f5bfffff640 1 --2- 172.21.15.7:0/3879359154 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55883fbe2260 0x55883fbe4650 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6bb7797b0634c54a server_cookie=d62b8e14324efb9a in_seq=0 out_seq=0 2024-09-19T08:54:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.607+0000 7f5bdffff640 10 client.17667 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:54:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.607+0000 7f5bdffff640 1 -- 172.21.15.7:0/3879359154 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55883fac4d70 con 0x55883fbe2260 2024-09-19T08:54:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.607+0000 7f5bdffff640 10 client.17667 handle_command_reply: tid=0 2024-09-19T08:54:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.607+0000 7f5c0915b740 1 client.17667 shutdown 2024-09-19T08:54:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.607+0000 7f5c0915b740 1 -- 172.21.15.7:0/3879359154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb575d0 msgr2=0x55883fbd93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.607+0000 7f5c0915b740 1 --2- 172.21.15.7:0/3879359154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb575d0 0x55883fbd93d0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8005e90 tx=0x7f5bf80bc9c0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.607+0000 7f5c0915b740 1 -- 172.21.15.7:0/3879359154 shutdown_connections 2024-09-19T08:54:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.607+0000 7f5c0915b740 1 --2- 172.21.15.7:0/3879359154 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55883fbe2260 0x55883fbe4650 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.607+0000 7f5bdffff640 0 client.17667 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:54:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.607+0000 7f5c0915b740 1 --2- 172.21.15.7:0/3879359154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55883fb62370 0x55883fbd4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.607+0000 7f5c0915b740 1 --2- 172.21.15.7:0/3879359154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55883fb58b40 0x55883fbd9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.607+0000 7f5c0915b740 1 --2- 172.21.15.7:0/3879359154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55883fb575d0 0x55883fbd93d0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.607+0000 7f5c0915b740 1 -- 172.21.15.7:0/3879359154 >> 172.21.15.7:0/3879359154 conn(0x55883fb20310 msgr2=0x55883fb52d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.607+0000 7f5c0915b740 1 -- 172.21.15.7:0/3879359154 shutdown_connections 2024-09-19T08:54:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.607+0000 7f5c0915b740 1 -- 172.21.15.7:0/3879359154 wait complete. 2024-09-19T08:54:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.607+0000 7f5c0915b740 20 client.17667 trim_cache size 0 max 16384 2024-09-19T08:54:34.613 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:54:34.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.608+0000 7f5c06d82640 1 -- 172.21.15.7:0/1752680318 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5bec0a33b0 msgr2=0x7f5bec0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:34.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.608+0000 7f5c06d82640 1 --2- 172.21.15.7:0/1752680318 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5bec0a33b0 0x7f5bec0a5870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0005fd0 tx=0x7f5bf00096a0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.608+0000 7f5c06d82640 1 -- 172.21.15.7:0/1752680318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c00102dd0 msgr2=0x7f5c001985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:34.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.608+0000 7f5c06d82640 1 --2- 172.21.15.7:0/1752680318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c00102dd0 0x7f5c001985f0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8009230 tx=0x7f5bf8004270 comp rx=0 tx=0).stop 2024-09-19T08:54:34.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.608+0000 7f5c06d82640 1 -- 172.21.15.7:0/1752680318 shutdown_connections 2024-09-19T08:54:34.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.608+0000 7f5c06d82640 1 --2- 172.21.15.7:0/1752680318 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5bec0a33b0 0x7f5bec0a5870 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.608+0000 7f5c06d82640 1 --2- 172.21.15.7:0/1752680318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c00108300 0x7f5c0019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.608+0000 7f5c06d82640 1 --2- 172.21.15.7:0/1752680318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c00103780 0x7f5c00198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.608+0000 7f5c06d82640 1 --2- 172.21.15.7:0/1752680318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c00102dd0 0x7f5c001985f0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.608+0000 7f5c06d82640 1 -- 172.21.15.7:0/1752680318 >> 172.21.15.7:0/1752680318 conn(0x7f5c000fc7d0 msgr2=0x7f5c00105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:34.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.608+0000 7f5c06d82640 1 -- 172.21.15.7:0/1752680318 shutdown_connections 2024-09-19T08:54:34.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:34.608+0000 7f5c06d82640 1 -- 172.21.15.7:0/1752680318 wait complete. 2024-09-19T08:54:35.215 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:35 smithi007 ceph-mon[31221]: pgmap v312: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T08:54:35.247 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:54:35.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:35 smithi175 ceph-mon[35688]: pgmap v312: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T08:54:35.506 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:35.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:35 smithi044 ceph-mon[35072]: pgmap v312: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T08:54:35.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.968+0000 7f736c88b640 1 -- 172.21.15.7:0/298595362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f736806a370 msgr2=0x7f73681009c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:35.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.968+0000 7f736c88b640 1 --2- 172.21.15.7:0/298595362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f736806a370 0x7f73681009c0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f735c009900 tx=0x7f735c02a410 comp rx=0 tx=0).stop 2024-09-19T08:54:35.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.969+0000 7f736c88b640 1 -- 172.21.15.7:0/298595362 shutdown_connections 2024-09-19T08:54:35.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.969+0000 7f736c88b640 1 --2- 172.21.15.7:0/298595362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7368104e80 0x7f7368105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.969+0000 7f736c88b640 1 --2- 172.21.15.7:0/298595362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f736806a370 0x7f73681009c0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.969+0000 7f736c88b640 1 --2- 172.21.15.7:0/298595362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7368069f00 0x7f7368100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.969+0000 7f736c88b640 1 -- 172.21.15.7:0/298595362 >> 172.21.15.7:0/298595362 conn(0x7f7368077210 msgr2=0x7f73680fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:35.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.969+0000 7f736c88b640 1 -- 172.21.15.7:0/298595362 shutdown_connections 2024-09-19T08:54:35.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.969+0000 7f736c88b640 1 -- 172.21.15.7:0/298595362 wait complete. 2024-09-19T08:54:35.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.970+0000 7f736c88b640 1 Processor -- start 2024-09-19T08:54:35.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.970+0000 7f736c88b640 1 -- start start 2024-09-19T08:54:35.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.970+0000 7f736c88b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7368069f00 0x7f7368197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:35.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.970+0000 7f736c88b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f736806a370 0x7f73681978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:35.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.970+0000 7f736c88b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7368104e80 0x7f736819bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:35.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.970+0000 7f736c88b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7368110eb0 con 0x7f736806a370 2024-09-19T08:54:35.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.970+0000 7f736c88b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7368110d30 con 0x7f7368069f00 2024-09-19T08:54:35.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.970+0000 7f736c88b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7368111030 con 0x7f7368104e80 2024-09-19T08:54:35.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.970+0000 7f7365d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f736806a370 0x7f73681978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:35.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.970+0000 7f7365d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f736806a370 0x7f73681978d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57322/0 (socket says 172.21.15.7:57322) 2024-09-19T08:54:35.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.970+0000 7f7365d9b640 1 -- 172.21.15.7:0/1953146433 learned_addr learned my addr 172.21.15.7:0/1953146433 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:35.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.970+0000 7f736659c640 1 --2- 172.21.15.7:0/1953146433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7368069f00 0x7f7368197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:35.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.970+0000 7f7366d9d640 1 --2- 172.21.15.7:0/1953146433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7368104e80 0x7f736819bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:35.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.971+0000 7f7365d9b640 1 -- 172.21.15.7:0/1953146433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7368104e80 msgr2=0x7f736819bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:35.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.971+0000 7f7365d9b640 1 --2- 172.21.15.7:0/1953146433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7368104e80 0x7f736819bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.971+0000 7f7365d9b640 1 -- 172.21.15.7:0/1953146433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7368069f00 msgr2=0x7f7368197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:35.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.971+0000 7f7365d9b640 1 --2- 172.21.15.7:0/1953146433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7368069f00 0x7f7368197390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.971+0000 7f7365d9b640 1 -- 172.21.15.7:0/1953146433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f736819c340 con 0x7f736806a370 2024-09-19T08:54:35.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.971+0000 7f7366d9d640 1 --2- 172.21.15.7:0/1953146433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7368104e80 0x7f736819bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:35.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.971+0000 7f7365d9b640 1 --2- 172.21.15.7:0/1953146433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f736806a370 0x7f73681978d0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f735c006010 tx=0x7f735c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:35.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.971+0000 7f73577fe640 1 -- 172.21.15.7:0/1953146433 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c03f030 con 0x7f736806a370 2024-09-19T08:54:35.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.971+0000 7f73577fe640 1 -- 172.21.15.7:0/1953146433 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f735c003ce0 con 0x7f736806a370 2024-09-19T08:54:35.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.971+0000 7f736c88b640 1 -- 172.21.15.7:0/1953146433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f736819c5d0 con 0x7f736806a370 2024-09-19T08:54:35.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.971+0000 7f73577fe640 1 -- 172.21.15.7:0/1953146433 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c035070 con 0x7f736806a370 2024-09-19T08:54:35.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.971+0000 7f736c88b640 1 -- 172.21.15.7:0/1953146433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73681a3f10 con 0x7f736806a370 2024-09-19T08:54:35.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.973+0000 7f73577fe640 1 -- 172.21.15.7:0/1953146433 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f735c042030 con 0x7f736806a370 2024-09-19T08:54:35.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.974+0000 7f736ec64740 1 Processor -- start 2024-09-19T08:54:35.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.974+0000 7f736ec64740 1 -- start start 2024-09-19T08:54:35.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.974+0000 7f736ec64740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a41effc30 0x559a41efe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:35.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.974+0000 7f736ec64740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41efe7e0 0x559a41efec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:35.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.974+0000 7f736ec64740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a41f0b970 0x559a41f0dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:35.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.974+0000 7f736ec64740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559a41e622f0 con 0x559a41efe7e0 2024-09-19T08:54:35.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.974+0000 7f73577fe640 1 --2- 172.21.15.7:0/1953146433 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f73500a33b0 0x7f73500a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:35.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.974+0000 7f736ec64740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559a41e09cf0 con 0x559a41effc30 2024-09-19T08:54:35.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.974+0000 7f736ec64740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559a41e5e2b0 con 0x559a41f0b970 2024-09-19T08:54:35.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.974+0000 7f736659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41efe7e0 0x559a41efec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.974+0000 7f736659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41efe7e0 0x559a41efec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57336/0 (socket says 172.21.15.7:57336) 2024-09-19T08:54:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.974+0000 7f736659c640 1 -- 172.21.15.7:0/3530920116 learned_addr learned my addr 172.21.15.7:0/3530920116 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.974+0000 7f7366d9d640 1 --2- 172.21.15.7:0/1953146433 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f73500a33b0 0x7f73500a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.975+0000 7f7366d9d640 1 --2- 172.21.15.7:0/3530920116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a41effc30 0x559a41efe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.975+0000 7f73577fe640 1 -- 172.21.15.7:0/1953146433 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f735c0f0390 con 0x7f736806a370 2024-09-19T08:54:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.975+0000 7f7365d9b640 1 --2- 172.21.15.7:0/3530920116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a41f0b970 0x559a41f0dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.975+0000 7f736659c640 1 -- 172.21.15.7:0/3530920116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a41f0b970 msgr2=0x559a41f0dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.975+0000 7f736659c640 1 --2- 172.21.15.7:0/3530920116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a41f0b970 0x559a41f0dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.975+0000 7f736659c640 1 -- 172.21.15.7:0/3530920116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a41effc30 msgr2=0x559a41efe2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.975+0000 7f736659c640 1 --2- 172.21.15.7:0/3530920116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a41effc30 0x559a41efe2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.975+0000 7f736659c640 1 -- 172.21.15.7:0/3530920116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a41dee3a0 con 0x559a41efe7e0 2024-09-19T08:54:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.975+0000 7f7366d9d640 1 --2- 172.21.15.7:0/1953146433 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f73500a33b0 0x7f73500a5870 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7360005e00 tx=0x7f7360005d50 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.975+0000 7f736659c640 1 --2- 172.21.15.7:0/3530920116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41efe7e0 0x559a41efec20 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f735800af40 tx=0x7f735800f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a69c10660852b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:35.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.975+0000 7f7354ff9640 1 -- 172.21.15.7:0/3530920116 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735801d070 con 0x559a41efe7e0 2024-09-19T08:54:35.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.975+0000 7f7354ff9640 1 -- 172.21.15.7:0/3530920116 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7358010de0 con 0x559a41efe7e0 2024-09-19T08:54:35.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.975+0000 7f7354ff9640 1 -- 172.21.15.7:0/3530920116 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358016340 con 0x559a41efe7e0 2024-09-19T08:54:35.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.976+0000 7f736ec64740 1 -- 172.21.15.7:0/3530920116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41efe7e0 msgr2=0x559a41efec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:35.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.976+0000 7f736ec64740 1 --2- 172.21.15.7:0/3530920116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41efe7e0 0x559a41efec20 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f735800af40 tx=0x7f735800f850 comp rx=0 tx=0).stop 2024-09-19T08:54:35.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.976+0000 7f736ec64740 1 -- 172.21.15.7:0/3530920116 shutdown_connections 2024-09-19T08:54:35.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.976+0000 7f736ec64740 1 --2- 172.21.15.7:0/3530920116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a41f0b970 0x559a41f0dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.976+0000 7f736ec64740 1 --2- 172.21.15.7:0/3530920116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41efe7e0 0x559a41efec20 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.976+0000 7f736ec64740 1 --2- 172.21.15.7:0/3530920116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a41effc30 0x559a41efe2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.976+0000 7f736ec64740 1 -- 172.21.15.7:0/3530920116 >> 172.21.15.7:0/3530920116 conn(0x559a41ec5310 msgr2=0x559a41efae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:35.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.976+0000 7f736ec64740 1 -- 172.21.15.7:0/3530920116 shutdown_connections 2024-09-19T08:54:35.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.976+0000 7f736ec64740 1 -- 172.21.15.7:0/3530920116 wait complete. 2024-09-19T08:54:35.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.976+0000 7f736ec64740 1 -- start start 2024-09-19T08:54:35.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.977+0000 7f736ec64740 1 Processor -- start 2024-09-19T08:54:35.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.977+0000 7f736ec64740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41efe7e0 0x559a41f0b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:35.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.977+0000 7f736ec64740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a41effc30 0x559a41f085e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:35.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.977+0000 7f736ec64740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a41f0b970 0x559a41f08bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:35.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.977+0000 7f736ec64740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559a41f0e540 con 0x559a41efe7e0 2024-09-19T08:54:35.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.977+0000 7f736ec64740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559a41e1d060 con 0x559a41f0b970 2024-09-19T08:54:35.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.977+0000 7f736ec64740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x559a41f0e6c0 con 0x559a41effc30 2024-09-19T08:54:35.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.977+0000 7f736ec64740 10 client.0 _ll_register_callbacks cb 0x559a41b708c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:35.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.977+0000 7f736659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41efe7e0 0x559a41f0b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:35.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.977+0000 7f736659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41efe7e0 0x559a41f0b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57346/0 (socket says 172.21.15.7:57346) 2024-09-19T08:54:35.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.977+0000 7f736659c640 1 -- 172.21.15.7:0/3877107669 learned_addr learned my addr 172.21.15.7:0/3877107669 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:35.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.977+0000 7f7366d9d640 1 --2- 172.21.15.7:0/3877107669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a41f0b970 0x559a41f08bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:35.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.977+0000 7f7365d9b640 1 --2- 172.21.15.7:0/3877107669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a41effc30 0x559a41f085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:35.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.977+0000 7f736659c640 1 -- 172.21.15.7:0/3877107669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a41effc30 msgr2=0x559a41f085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:35.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.977+0000 7f736659c640 1 --2- 172.21.15.7:0/3877107669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a41effc30 0x559a41f085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.977+0000 7f736659c640 1 -- 172.21.15.7:0/3877107669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a41f0b970 msgr2=0x559a41f08bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:35.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.977+0000 7f736659c640 1 --2- 172.21.15.7:0/3877107669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a41f0b970 0x559a41f08bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.977+0000 7f736659c640 1 -- 172.21.15.7:0/3877107669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a41bd33c0 con 0x559a41efe7e0 2024-09-19T08:54:35.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.978+0000 7f736659c640 1 --2- 172.21.15.7:0/3877107669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41efe7e0 0x559a41f0b330 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f7358018a10 tx=0x7f735800ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6852eb38a1b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:35.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.978+0000 7f734dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.978+0000 7f734dffb640 1 -- 172.21.15.7:0/3877107669 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358026030 con 0x559a41efe7e0 2024-09-19T08:54:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.978+0000 7f734dffb640 1 -- 172.21.15.7:0/3877107669 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f7358004c50 con 0x559a41efe7e0 2024-09-19T08:54:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.978+0000 7f736ec64740 1 -- 172.21.15.7:0/3877107669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7358010de0 con 0x559a41efe7e0 2024-09-19T08:54:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.978+0000 7f734dffb640 1 -- 172.21.15.7:0/3877107669 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7358030050 con 0x559a41efe7e0 2024-09-19T08:54:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.978+0000 7f736ec64740 10 client.17679 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.978+0000 7f736ec64740 1 -- 172.21.15.7:0/3877107669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559a41f19fa0 con 0x559a41efe7e0 2024-09-19T08:54:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.978+0000 7f734dffb640 1 -- 172.21.15.7:0/3877107669 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7358010de0 con 0x559a41efe7e0 2024-09-19T08:54:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.978+0000 7f734dffb640 1 -- 172.21.15.7:0/3877107669 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7358004020 con 0x559a41efe7e0 2024-09-19T08:54:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.978+0000 7f736ec64740 10 client.17679 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.978+0000 7f736ec64740 10 client.17679 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.978+0000 7f736ec64740 20 client.17679 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.978+0000 7f736ec64740 1 --2- 172.21.15.7:0/3877107669 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559a41f1b3a0 0x559a41f1d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.978+0000 7f736ec64740 4 client.17679 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.978+0000 7f736ec64740 1 -- 172.21.15.7:0/3877107669 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a41e6f860 con 0x559a41f1b3a0 2024-09-19T08:54:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.979+0000 7f7365d9b640 1 --2- 172.21.15.7:0/3877107669 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559a41f1b3a0 0x559a41f1d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.979+0000 7f734dffb640 10 client.17679 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.979+0000 7f7365d9b640 1 --2- 172.21.15.7:0/3877107669 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559a41f1b3a0 0x559a41f1d790 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0d81d17b55e31e1 server_cookie=ea14cf9dd0455e45 in_seq=0 out_seq=0 2024-09-19T08:54:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.980+0000 7f734dffb640 1 -- 172.21.15.7:0/3877107669 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559a41e6f860 con 0x559a41f1b3a0 2024-09-19T08:54:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.980+0000 7f734dffb640 10 client.17679 handle_command_reply: tid=0 2024-09-19T08:54:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.980+0000 7f736ec64740 1 client.17679 shutdown 2024-09-19T08:54:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.980+0000 7f736ec64740 1 -- 172.21.15.7:0/3877107669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41efe7e0 msgr2=0x559a41f0b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.980+0000 7f736ec64740 1 --2- 172.21.15.7:0/3877107669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41efe7e0 0x559a41f0b330 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f7358018a10 tx=0x7f735800ac70 comp rx=0 tx=0).stop 2024-09-19T08:54:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.980+0000 7f736ec64740 1 -- 172.21.15.7:0/3877107669 shutdown_connections 2024-09-19T08:54:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.980+0000 7f736ec64740 1 --2- 172.21.15.7:0/3877107669 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559a41f1b3a0 0x559a41f1d790 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.980+0000 7f736ec64740 1 --2- 172.21.15.7:0/3877107669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a41f0b970 0x559a41f08bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.980+0000 7f736ec64740 1 --2- 172.21.15.7:0/3877107669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a41effc30 0x559a41f085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.980+0000 7f736ec64740 1 --2- 172.21.15.7:0/3877107669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41efe7e0 0x559a41f0b330 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.980+0000 7f734dffb640 0 client.17679 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.980+0000 7f736ec64740 1 -- 172.21.15.7:0/3877107669 >> 172.21.15.7:0/3877107669 conn(0x559a41ec5310 msgr2=0x559a41f00bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.980+0000 7f736ec64740 1 -- 172.21.15.7:0/3877107669 shutdown_connections 2024-09-19T08:54:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.980+0000 7f736ec64740 1 -- 172.21.15.7:0/3877107669 wait complete. 2024-09-19T08:54:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.980+0000 7f736ec64740 20 client.17679 trim_cache size 0 max 16384 2024-09-19T08:54:35.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.993+0000 7f736ec64740 1 Processor -- start 2024-09-19T08:54:35.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.993+0000 7f736ec64740 1 -- start start 2024-09-19T08:54:35.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.993+0000 7f736ec64740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a41efe7e0 0x559a41f07f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:35.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.993+0000 7f736ec64740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a41effc30 0x559a41f177a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:35.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.993+0000 7f736ec64740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41f0b970 0x559a41ef9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:35.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.993+0000 7f736ec64740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f73681ae090 con 0x559a41f0b970 2024-09-19T08:54:35.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.993+0000 7f736ec64740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f73681ab960 con 0x559a41efe7e0 2024-09-19T08:54:35.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.993+0000 7f736ec64740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f73681a97d0 con 0x559a41effc30 2024-09-19T08:54:35.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.994+0000 7f7366d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41f0b970 0x559a41ef9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:35.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.994+0000 7f7366d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41f0b970 0x559a41ef9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57348/0 (socket says 172.21.15.7:57348) 2024-09-19T08:54:35.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.994+0000 7f7366d9d640 1 -- 172.21.15.7:0/4233026219 learned_addr learned my addr 172.21.15.7:0/4233026219 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:35.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.994+0000 7f7365d9b640 1 --2- 172.21.15.7:0/4233026219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a41effc30 0x559a41f177a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:35.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.994+0000 7f736659c640 1 --2- 172.21.15.7:0/4233026219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a41efe7e0 0x559a41f07f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:35.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.994+0000 7f7366d9d640 1 -- 172.21.15.7:0/4233026219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a41effc30 msgr2=0x559a41f177a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:35.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.994+0000 7f7366d9d640 1 --2- 172.21.15.7:0/4233026219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a41effc30 0x559a41f177a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.994+0000 7f7366d9d640 1 -- 172.21.15.7:0/4233026219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a41efe7e0 msgr2=0x559a41f07f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:35.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.994+0000 7f7366d9d640 1 --2- 172.21.15.7:0/4233026219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a41efe7e0 0x559a41f07f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.994+0000 7f7366d9d640 1 -- 172.21.15.7:0/4233026219 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a41f0af50 con 0x559a41f0b970 2024-09-19T08:54:35.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.994+0000 7f7366d9d640 1 --2- 172.21.15.7:0/4233026219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41f0b970 0x559a41ef9e60 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f736000ca30 tx=0x7f7360005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc1ba875076b7ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:35.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.994+0000 7f734ffff640 1 -- 172.21.15.7:0/4233026219 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7360025070 con 0x559a41f0b970 2024-09-19T08:54:35.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.994+0000 7f734ffff640 1 -- 172.21.15.7:0/4233026219 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7360005020 con 0x559a41f0b970 2024-09-19T08:54:35.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.994+0000 7f734ffff640 1 -- 172.21.15.7:0/4233026219 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7360004a00 con 0x559a41f0b970 2024-09-19T08:54:36.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.995+0000 7f736ec64740 1 -- 172.21.15.7:0/4233026219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41f0b970 msgr2=0x559a41ef9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:36.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.995+0000 7f736ec64740 1 --2- 172.21.15.7:0/4233026219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41f0b970 0x559a41ef9e60 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f736000ca30 tx=0x7f7360005ce0 comp rx=0 tx=0).stop 2024-09-19T08:54:36.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.995+0000 7f736ec64740 1 -- 172.21.15.7:0/4233026219 shutdown_connections 2024-09-19T08:54:36.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.995+0000 7f736ec64740 1 --2- 172.21.15.7:0/4233026219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41f0b970 0x559a41ef9e60 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:36.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.995+0000 7f736ec64740 1 --2- 172.21.15.7:0/4233026219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a41effc30 0x559a41f177a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:36.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.995+0000 7f736ec64740 1 --2- 172.21.15.7:0/4233026219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a41efe7e0 0x559a41f07f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:36.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.995+0000 7f736ec64740 1 -- 172.21.15.7:0/4233026219 >> 172.21.15.7:0/4233026219 conn(0x559a41ec5310 msgr2=0x559a41f09e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:36.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.995+0000 7f736ec64740 1 -- 172.21.15.7:0/4233026219 shutdown_connections 2024-09-19T08:54:36.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.995+0000 7f736ec64740 1 -- 172.21.15.7:0/4233026219 wait complete. 2024-09-19T08:54:36.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.995+0000 7f736ec64740 1 -- start start 2024-09-19T08:54:36.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.995+0000 7f736ec64740 1 Processor -- start 2024-09-19T08:54:36.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.996+0000 7f736ec64740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41efe7e0 0x559a41f229e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:36.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.996+0000 7f736ec64740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a41effc30 0x559a41f22f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:36.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.996+0000 7f736ec64740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a41f0b970 0x559a41f23460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:36.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.996+0000 7f736ec64740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f73681a9e20 con 0x559a41efe7e0 2024-09-19T08:54:36.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.996+0000 7f736ec64740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f73681ab290 con 0x559a41f0b970 2024-09-19T08:54:36.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.996+0000 7f736ec64740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f73681aa4f0 con 0x559a41effc30 2024-09-19T08:54:36.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.996+0000 7f736ec64740 10 client.0 _ll_register_callbacks cb 0x7f735801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:36.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.996+0000 7f736659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41efe7e0 0x559a41f229e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:36.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.996+0000 7f736659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41efe7e0 0x559a41f229e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57358/0 (socket says 172.21.15.7:57358) 2024-09-19T08:54:36.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.996+0000 7f736659c640 1 -- 172.21.15.7:0/2129462641 learned_addr learned my addr 172.21.15.7:0/2129462641 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:36.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.996+0000 7f7366d9d640 1 --2- 172.21.15.7:0/2129462641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a41f0b970 0x559a41f23460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:36.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.996+0000 7f7365d9b640 1 --2- 172.21.15.7:0/2129462641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a41effc30 0x559a41f22f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:36.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.996+0000 7f736659c640 1 -- 172.21.15.7:0/2129462641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a41effc30 msgr2=0x559a41f22f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:36.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.996+0000 7f736659c640 1 --2- 172.21.15.7:0/2129462641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a41effc30 0x559a41f22f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:36.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.996+0000 7f736659c640 1 -- 172.21.15.7:0/2129462641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a41f0b970 msgr2=0x559a41f23460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:36.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.996+0000 7f736659c640 1 --2- 172.21.15.7:0/2129462641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a41f0b970 0x559a41f23460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:36.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.996+0000 7f736659c640 1 -- 172.21.15.7:0/2129462641 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a41f84dd0 con 0x559a41efe7e0 2024-09-19T08:54:36.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.996+0000 7f736659c640 1 --2- 172.21.15.7:0/2129462641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41efe7e0 0x559a41f229e0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f73580043f0 tx=0x7f735800fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd84a856aa810455 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:36.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.996+0000 7f734dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:36.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.996+0000 7f734dffb640 1 -- 172.21.15.7:0/2129462641 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358026040 con 0x559a41efe7e0 2024-09-19T08:54:36.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.997+0000 7f734dffb640 1 -- 172.21.15.7:0/2129462641 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f7358004660 con 0x559a41efe7e0 2024-09-19T08:54:36.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.997+0000 7f736ec64740 1 -- 172.21.15.7:0/2129462641 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7360005020 con 0x559a41efe7e0 2024-09-19T08:54:36.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.997+0000 7f734dffb640 1 -- 172.21.15.7:0/2129462641 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7358043050 con 0x559a41efe7e0 2024-09-19T08:54:36.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.997+0000 7f736ec64740 10 client.17685 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:36.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.997+0000 7f736ec64740 1 -- 172.21.15.7:0/2129462641 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559a41f860b0 con 0x559a41efe7e0 2024-09-19T08:54:36.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.997+0000 7f734dffb640 1 -- 172.21.15.7:0/2129462641 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7360005020 con 0x559a41efe7e0 2024-09-19T08:54:36.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.997+0000 7f734dffb640 1 -- 172.21.15.7:0/2129462641 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7358003f10 con 0x559a41efe7e0 2024-09-19T08:54:36.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.997+0000 7f736ec64740 10 client.17685 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:36.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.997+0000 7f736ec64740 10 client.17685 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:36.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.997+0000 7f736ec64740 20 client.17685 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:36.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.997+0000 7f736ec64740 1 --2- 172.21.15.7:0/2129462641 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559a41f86820 0x559a41f88c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.997+0000 7f736ec64740 4 client.17685 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:54:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.997+0000 7f736ec64740 1 -- 172.21.15.7:0/2129462641 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559a41e69d70 con 0x559a41f86820 2024-09-19T08:54:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.997+0000 7f7365d9b640 1 --2- 172.21.15.7:0/2129462641 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559a41f86820 0x559a41f88c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.998+0000 7f734dffb640 10 client.17685 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.998+0000 7f7365d9b640 1 --2- 172.21.15.7:0/2129462641 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559a41f86820 0x559a41f88c40 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fde73f86baa1bb server_cookie=5e7efa464ac791d in_seq=0 out_seq=0 2024-09-19T08:54:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.998+0000 7f734dffb640 1 -- 172.21.15.7:0/2129462641 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559a41e69d70 con 0x559a41f86820 2024-09-19T08:54:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.998+0000 7f734dffb640 10 client.17685 handle_command_reply: tid=0 2024-09-19T08:54:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.998+0000 7f736ec64740 1 client.17685 shutdown 2024-09-19T08:54:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.998+0000 7f736ec64740 1 -- 172.21.15.7:0/2129462641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41efe7e0 msgr2=0x559a41f229e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.998+0000 7f736ec64740 1 --2- 172.21.15.7:0/2129462641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41efe7e0 0x559a41f229e0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f73580043f0 tx=0x7f735800fe10 comp rx=0 tx=0).stop 2024-09-19T08:54:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.998+0000 7f736ec64740 1 -- 172.21.15.7:0/2129462641 shutdown_connections 2024-09-19T08:54:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.998+0000 7f736ec64740 1 --2- 172.21.15.7:0/2129462641 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x559a41f86820 0x559a41f88c40 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.998+0000 7f734dffb640 0 client.17685 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.998+0000 7f736ec64740 1 --2- 172.21.15.7:0/2129462641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a41f0b970 0x559a41f23460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:36.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.998+0000 7f736ec64740 1 --2- 172.21.15.7:0/2129462641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a41effc30 0x559a41f22f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:36.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.998+0000 7f736ec64740 1 --2- 172.21.15.7:0/2129462641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41efe7e0 0x559a41f229e0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:36.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.998+0000 7f736ec64740 1 -- 172.21.15.7:0/2129462641 >> 172.21.15.7:0/2129462641 conn(0x559a41ec5310 msgr2=0x559a41f0a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:36.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.998+0000 7f736ec64740 1 -- 172.21.15.7:0/2129462641 shutdown_connections 2024-09-19T08:54:36.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.999+0000 7f736ec64740 1 -- 172.21.15.7:0/2129462641 wait complete. 2024-09-19T08:54:36.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.999+0000 7f736ec64740 20 client.17685 trim_cache size 0 max 16384 2024-09-19T08:54:36.009 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:54:36.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.999+0000 7f736c88b640 1 -- 172.21.15.7:0/1953146433 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f73500a33b0 msgr2=0x7f73500a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:36.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.999+0000 7f736c88b640 1 --2- 172.21.15.7:0/1953146433 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f73500a33b0 0x7f73500a5870 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7360005e00 tx=0x7f7360005d50 comp rx=0 tx=0).stop 2024-09-19T08:54:36.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.999+0000 7f736c88b640 1 -- 172.21.15.7:0/1953146433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f736806a370 msgr2=0x7f73681978d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:36.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.999+0000 7f736c88b640 1 --2- 172.21.15.7:0/1953146433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f736806a370 0x7f73681978d0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f735c006010 tx=0x7f735c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:54:36.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.999+0000 7f736c88b640 1 -- 172.21.15.7:0/1953146433 shutdown_connections 2024-09-19T08:54:36.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.999+0000 7f736c88b640 1 --2- 172.21.15.7:0/1953146433 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f73500a33b0 0x7f73500a5870 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:36.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.999+0000 7f736c88b640 1 --2- 172.21.15.7:0/1953146433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7368104e80 0x7f736819bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:36.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.999+0000 7f736c88b640 1 --2- 172.21.15.7:0/1953146433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f736806a370 0x7f73681978d0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:36.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.999+0000 7f736c88b640 1 --2- 172.21.15.7:0/1953146433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7368069f00 0x7f7368197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:36.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.999+0000 7f736c88b640 1 -- 172.21.15.7:0/1953146433 >> 172.21.15.7:0/1953146433 conn(0x7f7368077210 msgr2=0x7f7368102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:36.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.999+0000 7f736c88b640 1 -- 172.21.15.7:0/1953146433 shutdown_connections 2024-09-19T08:54:36.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:35.999+0000 7f736c88b640 1 -- 172.21.15.7:0/1953146433 wait complete. 2024-09-19T08:54:37.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:37 smithi175 ceph-mon[35688]: pgmap v313: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:54:37.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:37 smithi007 ceph-mon[31221]: pgmap v313: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:54:37.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:37 smithi044 ceph-mon[35072]: pgmap v313: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:54:37.707 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:54:37.708 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:54:37.975 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:38.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.423+0000 7ff304108640 1 -- 172.21.15.7:0/3752330077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2fc102ef0 msgr2=0x7ff2fc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:38.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.423+0000 7ff304108640 1 --2- 172.21.15.7:0/3752330077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2fc102ef0 0x7ff2fc10da40 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec009ca0 tx=0x7ff2ec02a950 comp rx=0 tx=0).stop 2024-09-19T08:54:38.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.423+0000 7ff304108640 1 -- 172.21.15.7:0/3752330077 shutdown_connections 2024-09-19T08:54:38.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.423+0000 7ff304108640 1 --2- 172.21.15.7:0/3752330077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2fc102ef0 0x7ff2fc10da40 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.423+0000 7ff304108640 1 --2- 172.21.15.7:0/3752330077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2fc102570 0x7ff2fc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.423+0000 7ff304108640 1 --2- 172.21.15.7:0/3752330077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2fc100e20 0x7ff2fc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.423+0000 7ff304108640 1 -- 172.21.15.7:0/3752330077 >> 172.21.15.7:0/3752330077 conn(0x7ff2fc0fc7d0 msgr2=0x7ff2fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:38.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.423+0000 7ff304108640 1 -- 172.21.15.7:0/3752330077 shutdown_connections 2024-09-19T08:54:38.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.423+0000 7ff304108640 1 -- 172.21.15.7:0/3752330077 wait complete. 2024-09-19T08:54:38.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.424+0000 7ff304108640 1 Processor -- start 2024-09-19T08:54:38.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.424+0000 7ff304108640 1 -- start start 2024-09-19T08:54:38.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.424+0000 7ff304108640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2fc100e20 0x7ff2fc0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.424+0000 7ff304108640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2fc102570 0x7ff2fc0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.424+0000 7ff304108640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2fc102ef0 0x7ff2fc0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.424+0000 7ff304108640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc110f80 con 0x7ff2fc102ef0 2024-09-19T08:54:38.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.424+0000 7ff304108640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc110e00 con 0x7ff2fc100e20 2024-09-19T08:54:38.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.424+0000 7ff304108640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc111100 con 0x7ff2fc102570 2024-09-19T08:54:38.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.424+0000 7ff3026a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2fc102ef0 0x7ff2fc0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.424+0000 7ff3026a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2fc102ef0 0x7ff2fc0fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57364/0 (socket says 172.21.15.7:57364) 2024-09-19T08:54:38.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.424+0000 7ff3026a5640 1 -- 172.21.15.7:0/3321905679 learned_addr learned my addr 172.21.15.7:0/3321905679 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:38.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.424+0000 7ff3016a3640 1 --2- 172.21.15.7:0/3321905679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2fc102570 0x7ff2fc0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.424+0000 7ff301ea4640 1 --2- 172.21.15.7:0/3321905679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2fc100e20 0x7ff2fc0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.424+0000 7ff3026a5640 1 -- 172.21.15.7:0/3321905679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2fc102570 msgr2=0x7ff2fc0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:38.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.424+0000 7ff3026a5640 1 --2- 172.21.15.7:0/3321905679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2fc102570 0x7ff2fc0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.424+0000 7ff3026a5640 1 -- 172.21.15.7:0/3321905679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2fc100e20 msgr2=0x7ff2fc0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:38.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.424+0000 7ff3026a5640 1 --2- 172.21.15.7:0/3321905679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2fc100e20 0x7ff2fc0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.424+0000 7ff3026a5640 1 -- 172.21.15.7:0/3321905679 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2fc1a6980 con 0x7ff2fc102ef0 2024-09-19T08:54:38.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.425+0000 7ff3026a5640 1 --2- 172.21.15.7:0/3321905679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2fc102ef0 0x7ff2fc0fd700 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec02ae70 tx=0x7ff2ec02f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:38.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.425+0000 7ff2faffd640 1 -- 172.21.15.7:0/3321905679 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec034040 con 0x7ff2fc102ef0 2024-09-19T08:54:38.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.425+0000 7ff2faffd640 1 -- 172.21.15.7:0/3321905679 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2ec030920 con 0x7ff2fc102ef0 2024-09-19T08:54:38.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.425+0000 7ff304108640 1 -- 172.21.15.7:0/3321905679 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2fc1a6c10 con 0x7ff2fc102ef0 2024-09-19T08:54:38.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.425+0000 7ff2faffd640 1 -- 172.21.15.7:0/3321905679 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec045480 con 0x7ff2fc102ef0 2024-09-19T08:54:38.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.425+0000 7ff304108640 1 -- 172.21.15.7:0/3321905679 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2fc1a7140 con 0x7ff2fc102ef0 2024-09-19T08:54:38.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.427+0000 7ff2faffd640 1 -- 172.21.15.7:0/3321905679 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff2ec037020 con 0x7ff2fc102ef0 2024-09-19T08:54:38.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.427+0000 7ff3064e1740 1 Processor -- start 2024-09-19T08:54:38.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.428+0000 7ff3064e1740 1 -- start start 2024-09-19T08:54:38.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.428+0000 7ff3064e1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fdcabbb60 0x558fdcabbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.428+0000 7ff3064e1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabc480 0x558fdcac6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.428+0000 7ff3064e1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fdcac6d40 0x558fdcac9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.428+0000 7ff3064e1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558fdca21280 con 0x558fdcabc480 2024-09-19T08:54:38.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.428+0000 7ff3064e1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558fdc9c8b10 con 0x558fdcabbb60 2024-09-19T08:54:38.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.428+0000 7ff3064e1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558fdca1d240 con 0x558fdcac6d40 2024-09-19T08:54:38.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.428+0000 7ff301ea4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabc480 0x558fdcac6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.428+0000 7ff301ea4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabc480 0x558fdcac6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57378/0 (socket says 172.21.15.7:57378) 2024-09-19T08:54:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.428+0000 7ff301ea4640 1 -- 172.21.15.7:0/2752092046 learned_addr learned my addr 172.21.15.7:0/2752092046 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.428+0000 7ff3016a3640 1 --2- 172.21.15.7:0/2752092046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fdcac6d40 0x558fdcac9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.428+0000 7ff2faffd640 1 --2- 172.21.15.7:0/3321905679 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff2e40a3430 0x7ff2e40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.428+0000 7ff3016a3640 1 --2- 172.21.15.7:0/2752092046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fdcabbb60 0x558fdcabbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.428+0000 7ff301ea4640 1 -- 172.21.15.7:0/2752092046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fdcac6d40 msgr2=0x558fdcac9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.428+0000 7ff301ea4640 1 --2- 172.21.15.7:0/2752092046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fdcac6d40 0x558fdcac9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.428+0000 7ff3026a5640 1 --2- 172.21.15.7:0/3321905679 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff2e40a3430 0x7ff2e40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.428+0000 7ff301ea4640 1 -- 172.21.15.7:0/2752092046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fdcabbb60 msgr2=0x558fdcabbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.428+0000 7ff301ea4640 1 --2- 172.21.15.7:0/2752092046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fdcabbb60 0x558fdcabbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.428+0000 7ff301ea4640 1 -- 172.21.15.7:0/2752092046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fdc9d51f0 con 0x558fdcabc480 2024-09-19T08:54:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.428+0000 7ff3016a3640 1 --2- 172.21.15.7:0/2752092046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fdcabbb60 0x558fdcabbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.429+0000 7ff2faffd640 1 -- 172.21.15.7:0/3321905679 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7ff2ec0f0a50 con 0x7ff2fc102ef0 2024-09-19T08:54:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.429+0000 7ff301ea4640 1 --2- 172.21.15.7:0/2752092046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabc480 0x558fdcac6800 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400bcd0 tx=0x7ff2f40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd19ef9c2f1f072 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.429+0000 7ff2e3fff640 1 -- 172.21.15.7:0/2752092046 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4005220 con 0x558fdcabc480 2024-09-19T08:54:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.429+0000 7ff3026a5640 1 --2- 172.21.15.7:0/3321905679 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff2e40a3430 0x7ff2e40a58f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec082b50 tx=0x7ff2ec08baf0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.429+0000 7ff2e3fff640 1 -- 172.21.15.7:0/2752092046 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2f4004c80 con 0x558fdcabc480 2024-09-19T08:54:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.429+0000 7ff2e3fff640 1 -- 172.21.15.7:0/2752092046 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f40117a0 con 0x558fdcabc480 2024-09-19T08:54:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.430+0000 7ff3064e1740 1 -- 172.21.15.7:0/2752092046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabc480 msgr2=0x558fdcac6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.430+0000 7ff3064e1740 1 --2- 172.21.15.7:0/2752092046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabc480 0x558fdcac6800 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400bcd0 tx=0x7ff2f40107a0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.430+0000 7ff3064e1740 1 -- 172.21.15.7:0/2752092046 shutdown_connections 2024-09-19T08:54:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.430+0000 7ff3064e1740 1 --2- 172.21.15.7:0/2752092046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fdcac6d40 0x558fdcac9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.430+0000 7ff3064e1740 1 --2- 172.21.15.7:0/2752092046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabc480 0x558fdcac6800 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.430+0000 7ff3064e1740 1 --2- 172.21.15.7:0/2752092046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fdcabbb60 0x558fdcabbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.430+0000 7ff3064e1740 1 -- 172.21.15.7:0/2752092046 >> 172.21.15.7:0/2752092046 conn(0x558fdcab80f0 msgr2=0x558fdcab84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:38.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.430+0000 7ff3064e1740 1 -- 172.21.15.7:0/2752092046 shutdown_connections 2024-09-19T08:54:38.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.430+0000 7ff3064e1740 1 -- 172.21.15.7:0/2752092046 wait complete. 2024-09-19T08:54:38.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.430+0000 7ff3064e1740 1 -- start start 2024-09-19T08:54:38.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.430+0000 7ff3064e1740 1 Processor -- start 2024-09-19T08:54:38.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.431+0000 7ff3064e1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabbb60 0x558fdcac3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.431+0000 7ff3064e1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fdcabc480 0x558fdcac40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.431+0000 7ff3064e1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fdcac6d40 0x558fdcac4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.431+0000 7ff3064e1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558fdcac9910 con 0x558fdcabbb60 2024-09-19T08:54:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.431+0000 7ff3064e1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558fdc9dbf10 con 0x558fdcac6d40 2024-09-19T08:54:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.431+0000 7ff3064e1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558fdcac9a90 con 0x558fdcabc480 2024-09-19T08:54:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.431+0000 7ff3064e1740 10 client.0 _ll_register_callbacks cb 0x558fdc9a4a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.431+0000 7ff3016a3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabbb60 0x558fdcac3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.431+0000 7ff3016a3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabbb60 0x558fdcac3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57382/0 (socket says 172.21.15.7:57382) 2024-09-19T08:54:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.431+0000 7ff3016a3640 1 -- 172.21.15.7:0/828692606 learned_addr learned my addr 172.21.15.7:0/828692606 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.431+0000 7ff301ea4640 1 --2- 172.21.15.7:0/828692606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fdcabc480 0x558fdcac40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.431+0000 7ff3016a3640 1 --2- 172.21.15.7:0/828692606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fdcac6d40 0x558fdcac4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.431+0000 7ff3016a3640 1 -- 172.21.15.7:0/828692606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fdcabc480 msgr2=0x558fdcac40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.431+0000 7ff3016a3640 1 --2- 172.21.15.7:0/828692606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fdcabc480 0x558fdcac40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.431+0000 7ff3016a3640 1 -- 172.21.15.7:0/828692606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fdcac6d40 msgr2=0x558fdcac4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.431+0000 7ff3016a3640 1 --2- 172.21.15.7:0/828692606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fdcac6d40 0x558fdcac4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.431+0000 7ff3016a3640 1 -- 172.21.15.7:0/828692606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fdc7926a0 con 0x558fdcabbb60 2024-09-19T08:54:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.431+0000 7ff3016a3640 1 --2- 172.21.15.7:0/828692606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabbb60 0x558fdcac3ba0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00043b0 tx=0x7ff2f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0748d6a2611e76c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.431+0000 7ff2e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.431+0000 7ff2e17fa640 1 -- 172.21.15.7:0/828692606 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0005220 con 0x558fdcabbb60 2024-09-19T08:54:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.431+0000 7ff2e17fa640 1 -- 172.21.15.7:0/828692606 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7ff2f00053c0 con 0x558fdcabbb60 2024-09-19T08:54:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.431+0000 7ff3064e1740 1 -- 172.21.15.7:0/828692606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2f4004c80 con 0x558fdcabbb60 2024-09-19T08:54:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.432+0000 7ff2e17fa640 1 -- 172.21.15.7:0/828692606 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff2f0027050 con 0x558fdcabbb60 2024-09-19T08:54:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.432+0000 7ff3064e1740 10 client.17697 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.432+0000 7ff3064e1740 1 -- 172.21.15.7:0/828692606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558fdcad5560 con 0x558fdcabbb60 2024-09-19T08:54:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.432+0000 7ff2e17fa640 1 -- 172.21.15.7:0/828692606 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2f4004c80 con 0x558fdcabbb60 2024-09-19T08:54:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.432+0000 7ff2e17fa640 1 -- 172.21.15.7:0/828692606 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff2f0010800 con 0x558fdcabbb60 2024-09-19T08:54:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.432+0000 7ff3064e1740 10 client.17697 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.432+0000 7ff3064e1740 10 client.17697 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:38.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.432+0000 7ff3064e1740 20 client.17697 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:38.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.432+0000 7ff3064e1740 1 --2- 172.21.15.7:0/828692606 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558fdcad6970 0x558fdcad8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.432+0000 7ff3064e1740 4 client.17697 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:38.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.432+0000 7ff3064e1740 1 -- 172.21.15.7:0/828692606 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558fdca2e7f0 con 0x558fdcad6970 2024-09-19T08:54:38.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.432+0000 7ff301ea4640 1 --2- 172.21.15.7:0/828692606 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558fdcad6970 0x558fdcad8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.433+0000 7ff2e17fa640 10 client.17697 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:38.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.433+0000 7ff301ea4640 1 --2- 172.21.15.7:0/828692606 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558fdcad6970 0x558fdcad8d80 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf9616efcf22d6cc server_cookie=5fb84b96f9f5876e in_seq=0 out_seq=0 2024-09-19T08:54:38.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.433+0000 7ff2e17fa640 1 -- 172.21.15.7:0/828692606 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558fdca2e7f0 con 0x558fdcad6970 2024-09-19T08:54:38.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.433+0000 7ff2e17fa640 10 client.17697 handle_command_reply: tid=0 2024-09-19T08:54:38.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.434+0000 7ff3064e1740 1 client.17697 shutdown 2024-09-19T08:54:38.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.434+0000 7ff3064e1740 1 -- 172.21.15.7:0/828692606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabbb60 msgr2=0x558fdcac3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:38.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.434+0000 7ff3064e1740 1 --2- 172.21.15.7:0/828692606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabbb60 0x558fdcac3ba0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00043b0 tx=0x7ff2f0004730 comp rx=0 tx=0).stop 2024-09-19T08:54:38.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.434+0000 7ff3064e1740 1 -- 172.21.15.7:0/828692606 shutdown_connections 2024-09-19T08:54:38.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.434+0000 7ff3064e1740 1 --2- 172.21.15.7:0/828692606 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558fdcad6970 0x558fdcad8d80 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.434+0000 7ff3064e1740 1 --2- 172.21.15.7:0/828692606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fdcac6d40 0x558fdcac4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.434+0000 7ff3064e1740 1 --2- 172.21.15.7:0/828692606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fdcabc480 0x558fdcac40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.434+0000 7ff3064e1740 1 --2- 172.21.15.7:0/828692606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabbb60 0x558fdcac3ba0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.434+0000 7ff2e17fa640 0 client.17697 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:38.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.434+0000 7ff3064e1740 1 -- 172.21.15.7:0/828692606 >> 172.21.15.7:0/828692606 conn(0x558fdcab80f0 msgr2=0x558fdcab7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:38.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.434+0000 7ff3064e1740 1 -- 172.21.15.7:0/828692606 shutdown_connections 2024-09-19T08:54:38.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.434+0000 7ff3064e1740 1 -- 172.21.15.7:0/828692606 wait complete. 2024-09-19T08:54:38.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.434+0000 7ff3064e1740 20 client.17697 trim_cache size 0 max 16384 2024-09-19T08:54:38.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.452+0000 7ff3064e1740 1 Processor -- start 2024-09-19T08:54:38.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.452+0000 7ff3064e1740 1 -- start start 2024-09-19T08:54:38.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.452+0000 7ff3064e1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabbb60 0x558fdcabdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.452+0000 7ff3064e1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fdcabc480 0x558fdcade650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.452+0000 7ff3064e1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fdcac6d40 0x558fdcadeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.452+0000 7ff3064e1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc1b23e0 con 0x558fdcabbb60 2024-09-19T08:54:38.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.452+0000 7ff3064e1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc1afcb0 con 0x558fdcac6d40 2024-09-19T08:54:38.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.452+0000 7ff3064e1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc1adb20 con 0x558fdcabc480 2024-09-19T08:54:38.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.452+0000 7ff3016a3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabbb60 0x558fdcabdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.452+0000 7ff3016a3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabbb60 0x558fdcabdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57384/0 (socket says 172.21.15.7:57384) 2024-09-19T08:54:38.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.452+0000 7ff3016a3640 1 -- 172.21.15.7:0/2344110660 learned_addr learned my addr 172.21.15.7:0/2344110660 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:38.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.452+0000 7ff3016a3640 1 --2- 172.21.15.7:0/2344110660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fdcac6d40 0x558fdcadeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.452+0000 7ff301ea4640 1 --2- 172.21.15.7:0/2344110660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fdcabc480 0x558fdcade650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.452+0000 7ff3016a3640 1 -- 172.21.15.7:0/2344110660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fdcabc480 msgr2=0x558fdcade650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:38.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.452+0000 7ff3016a3640 1 --2- 172.21.15.7:0/2344110660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fdcabc480 0x558fdcade650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.452+0000 7ff3016a3640 1 -- 172.21.15.7:0/2344110660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fdcac6d40 msgr2=0x558fdcadeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:38.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.452+0000 7ff3016a3640 1 --2- 172.21.15.7:0/2344110660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fdcac6d40 0x558fdcadeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.452+0000 7ff3016a3640 1 -- 172.21.15.7:0/2344110660 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fdcab3830 con 0x558fdcabbb60 2024-09-19T08:54:38.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.452+0000 7ff301ea4640 1 --2- 172.21.15.7:0/2344110660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fdcabc480 0x558fdcade650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:38.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.452+0000 7ff3016a3640 1 --2- 172.21.15.7:0/2344110660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabbb60 0x558fdcabdd10 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000b6f0 tx=0x7ff2f0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c2d17d1d85e737 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:38.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.453+0000 7ff2e37fe640 1 -- 172.21.15.7:0/2344110660 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0016020 con 0x558fdcabbb60 2024-09-19T08:54:38.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.453+0000 7ff2e37fe640 1 -- 172.21.15.7:0/2344110660 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2f0010840 con 0x558fdcabbb60 2024-09-19T08:54:38.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.453+0000 7ff2e37fe640 1 -- 172.21.15.7:0/2344110660 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0020690 con 0x558fdcabbb60 2024-09-19T08:54:38.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.453+0000 7ff3064e1740 1 -- 172.21.15.7:0/2344110660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabbb60 msgr2=0x558fdcabdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:38.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.453+0000 7ff3064e1740 1 --2- 172.21.15.7:0/2344110660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabbb60 0x558fdcabdd10 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000b6f0 tx=0x7ff2f0001e50 comp rx=0 tx=0).stop 2024-09-19T08:54:38.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.453+0000 7ff3064e1740 1 -- 172.21.15.7:0/2344110660 shutdown_connections 2024-09-19T08:54:38.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.453+0000 7ff3064e1740 1 --2- 172.21.15.7:0/2344110660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fdcac6d40 0x558fdcadeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.453+0000 7ff3064e1740 1 --2- 172.21.15.7:0/2344110660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fdcabc480 0x558fdcade650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.453+0000 7ff3064e1740 1 --2- 172.21.15.7:0/2344110660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabbb60 0x558fdcabdd10 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.453+0000 7ff3064e1740 1 -- 172.21.15.7:0/2344110660 >> 172.21.15.7:0/2344110660 conn(0x558fdcab80f0 msgr2=0x558fdcabd600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:38.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.454+0000 7ff3064e1740 1 -- 172.21.15.7:0/2344110660 shutdown_connections 2024-09-19T08:54:38.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.454+0000 7ff3064e1740 1 -- 172.21.15.7:0/2344110660 wait complete. 2024-09-19T08:54:38.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.454+0000 7ff3064e1740 1 -- start start 2024-09-19T08:54:38.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.454+0000 7ff3064e1740 1 Processor -- start 2024-09-19T08:54:38.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.454+0000 7ff3064e1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fdcabbb60 0x558fdcacaa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.454+0000 7ff3064e1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabc480 0x558fdcacafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.454+0000 7ff3064e1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fdcac6d40 0x558fdcacb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.454+0000 7ff3064e1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc1ae170 con 0x558fdcabc480 2024-09-19T08:54:38.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.454+0000 7ff3064e1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc1af5e0 con 0x558fdcabbb60 2024-09-19T08:54:38.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.454+0000 7ff3064e1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc1ae840 con 0x558fdcac6d40 2024-09-19T08:54:38.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.454+0000 7ff3064e1740 10 client.0 _ll_register_callbacks cb 0x7ff2f00041a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:38.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.455+0000 7ff301ea4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabc480 0x558fdcacafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.455+0000 7ff301ea4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabc480 0x558fdcacafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57392/0 (socket says 172.21.15.7:57392) 2024-09-19T08:54:38.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.455+0000 7ff301ea4640 1 -- 172.21.15.7:0/999158450 learned_addr learned my addr 172.21.15.7:0/999158450 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:38.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.455+0000 7ff3016a3640 1 --2- 172.21.15.7:0/999158450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fdcabbb60 0x558fdcacaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.455+0000 7ff301ea4640 1 -- 172.21.15.7:0/999158450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fdcac6d40 msgr2=0x558fdcacb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:38.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.455+0000 7ff301ea4640 1 --2- 172.21.15.7:0/999158450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fdcac6d40 0x558fdcacb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.455+0000 7ff301ea4640 1 -- 172.21.15.7:0/999158450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fdcabbb60 msgr2=0x558fdcacaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:38.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.455+0000 7ff301ea4640 1 --2- 172.21.15.7:0/999158450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fdcabbb60 0x558fdcacaa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.455+0000 7ff301ea4640 1 -- 172.21.15.7:0/999158450 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fdcabc2b0 con 0x558fdcabc480 2024-09-19T08:54:38.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.455+0000 7ff3016a3640 1 --2- 172.21.15.7:0/999158450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fdcabbb60 0x558fdcacaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:38.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.455+0000 7ff301ea4640 1 --2- 172.21.15.7:0/999158450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabc480 0x558fdcacafa0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400bcd0 tx=0x7ff2f4010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80008442c3d69190 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:38.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.455+0000 7ff2e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.455+0000 7ff2e17fa640 1 -- 172.21.15.7:0/999158450 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f402c030 con 0x558fdcabc480 2024-09-19T08:54:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.455+0000 7ff2e17fa640 1 -- 172.21.15.7:0/999158450 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7ff2f4004020 con 0x558fdcabc480 2024-09-19T08:54:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.455+0000 7ff3064e1740 1 -- 172.21.15.7:0/999158450 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2f0010840 con 0x558fdcabc480 2024-09-19T08:54:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.455+0000 7ff2e17fa640 1 -- 172.21.15.7:0/999158450 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff2f4036050 con 0x558fdcabc480 2024-09-19T08:54:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.455+0000 7ff3064e1740 10 client.17703 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.455+0000 7ff3064e1740 1 -- 172.21.15.7:0/999158450 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558fdcb41660 con 0x558fdcabc480 2024-09-19T08:54:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.456+0000 7ff2e17fa640 1 -- 172.21.15.7:0/999158450 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2f0010840 con 0x558fdcabc480 2024-09-19T08:54:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.456+0000 7ff2e17fa640 1 -- 172.21.15.7:0/999158450 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff2f40035f0 con 0x558fdcabc480 2024-09-19T08:54:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.456+0000 7ff3064e1740 10 client.17703 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.456+0000 7ff3064e1740 10 client.17703 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.456+0000 7ff3064e1740 20 client.17703 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.456+0000 7ff3064e1740 1 --2- 172.21.15.7:0/999158450 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558fdcb41b50 0x558fdcb43f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.456+0000 7ff3064e1740 4 client.17703 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:54:38.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.456+0000 7ff3064e1740 1 -- 172.21.15.7:0/999158450 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558fdca28d00 con 0x558fdcb41b50 2024-09-19T08:54:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.456+0000 7ff3016a3640 1 --2- 172.21.15.7:0/999158450 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558fdcb41b50 0x558fdcb43f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.457+0000 7ff3016a3640 1 --2- 172.21.15.7:0/999158450 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558fdcb41b50 0x558fdcb43f40 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2da621c2b54cfbd8 server_cookie=e8b5741b1ee121a4 in_seq=0 out_seq=0 2024-09-19T08:54:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.457+0000 7ff2e17fa640 10 client.17703 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.458+0000 7ff2e17fa640 1 -- 172.21.15.7:0/999158450 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558fdca28d00 con 0x558fdcb41b50 2024-09-19T08:54:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.458+0000 7ff2e17fa640 10 client.17703 handle_command_reply: tid=0 2024-09-19T08:54:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.458+0000 7ff3064e1740 1 client.17703 shutdown 2024-09-19T08:54:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.458+0000 7ff3064e1740 1 -- 172.21.15.7:0/999158450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabc480 msgr2=0x558fdcacafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.458+0000 7ff3064e1740 1 --2- 172.21.15.7:0/999158450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabc480 0x558fdcacafa0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400bcd0 tx=0x7ff2f4010d50 comp rx=0 tx=0).stop 2024-09-19T08:54:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.458+0000 7ff3064e1740 1 -- 172.21.15.7:0/999158450 shutdown_connections 2024-09-19T08:54:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.458+0000 7ff3064e1740 1 --2- 172.21.15.7:0/999158450 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x558fdcb41b50 0x558fdcb43f40 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.458+0000 7ff3064e1740 1 --2- 172.21.15.7:0/999158450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fdcac6d40 0x558fdcacb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.458+0000 7ff3064e1740 1 --2- 172.21.15.7:0/999158450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558fdcabc480 0x558fdcacafa0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.458+0000 7ff3064e1740 1 --2- 172.21.15.7:0/999158450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558fdcabbb60 0x558fdcacaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.458+0000 7ff2e17fa640 0 client.17703 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:38.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.458+0000 7ff3064e1740 1 -- 172.21.15.7:0/999158450 >> 172.21.15.7:0/999158450 conn(0x558fdcab80f0 msgr2=0x558fdcabde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:38.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.458+0000 7ff3064e1740 1 -- 172.21.15.7:0/999158450 shutdown_connections 2024-09-19T08:54:38.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.458+0000 7ff3064e1740 1 -- 172.21.15.7:0/999158450 wait complete. 2024-09-19T08:54:38.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.458+0000 7ff3064e1740 20 client.17703 trim_cache size 0 max 16384 2024-09-19T08:54:38.467 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:54:38.467 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-19T08:54:38.467 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "3491c83c-b3f4-40b6-92ca-3d8643c67982", 2024-09-19T08:54:38.467 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-19T08:54:38.467 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:54:38.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.459+0000 7ff304108640 1 -- 172.21.15.7:0/3321905679 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff2e40a3430 msgr2=0x7ff2e40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:38.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.459+0000 7ff304108640 1 --2- 172.21.15.7:0/3321905679 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff2e40a3430 0x7ff2e40a58f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec082b50 tx=0x7ff2ec08baf0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.459+0000 7ff304108640 1 -- 172.21.15.7:0/3321905679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2fc102ef0 msgr2=0x7ff2fc0fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:38.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.459+0000 7ff304108640 1 --2- 172.21.15.7:0/3321905679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2fc102ef0 0x7ff2fc0fd700 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec02ae70 tx=0x7ff2ec02f5d0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.459+0000 7ff304108640 1 -- 172.21.15.7:0/3321905679 shutdown_connections 2024-09-19T08:54:38.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.459+0000 7ff304108640 1 --2- 172.21.15.7:0/3321905679 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7ff2e40a3430 0x7ff2e40a58f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.459+0000 7ff304108640 1 --2- 172.21.15.7:0/3321905679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2fc102ef0 0x7ff2fc0fd700 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.459+0000 7ff304108640 1 --2- 172.21.15.7:0/3321905679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2fc102570 0x7ff2fc0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.459+0000 7ff304108640 1 --2- 172.21.15.7:0/3321905679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2fc100e20 0x7ff2fc0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.459+0000 7ff304108640 1 -- 172.21.15.7:0/3321905679 >> 172.21.15.7:0/3321905679 conn(0x7ff2fc0fc7d0 msgr2=0x7ff2fc06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:38.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.459+0000 7ff304108640 1 -- 172.21.15.7:0/3321905679 shutdown_connections 2024-09-19T08:54:38.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:38.459+0000 7ff304108640 1 -- 172.21.15.7:0/3321905679 wait complete. 2024-09-19T08:54:39.233 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:54:39.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:39 smithi175 ceph-mon[35688]: pgmap v314: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:54:39.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:39 smithi175 ceph-mon[35688]: scrub queued for path: / 2024-09-19T08:54:39.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:39 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:39.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:39 smithi175 ceph-mon[35688]: scrub summary: active paths [/] 2024-09-19T08:54:39.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:39 smithi175 ceph-mon[35688]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:39.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:39 smithi175 ceph-mon[35688]: scrub summary: idle 2024-09-19T08:54:39.492 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:39.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:39 smithi007 ceph-mon[31221]: pgmap v314: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:54:39.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:39 smithi007 ceph-mon[31221]: scrub queued for path: / 2024-09-19T08:54:39.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:39 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:39.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:39 smithi007 ceph-mon[31221]: scrub summary: active paths [/] 2024-09-19T08:54:39.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:39 smithi007 ceph-mon[31221]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:39.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:39 smithi007 ceph-mon[31221]: scrub summary: idle 2024-09-19T08:54:39.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:39 smithi044 ceph-mon[35072]: pgmap v314: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T08:54:39.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:39 smithi044 ceph-mon[35072]: scrub queued for path: / 2024-09-19T08:54:39.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:39 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:39.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:39 smithi044 ceph-mon[35072]: scrub summary: active paths [/] 2024-09-19T08:54:39.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:39 smithi044 ceph-mon[35072]: scrub summary: idle+waiting paths [/] 2024-09-19T08:54:39.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:39 smithi044 ceph-mon[35072]: scrub summary: idle 2024-09-19T08:54:39.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.962+0000 7f20a5287640 1 -- 172.21.15.7:0/1349213520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20a010c170 msgr2=0x7f20a010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:39.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.962+0000 7f20a5287640 1 --2- 172.21.15.7:0/1349213520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20a010c170 0x7f20a010e610 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f2098009ca0 tx=0x7f209802a950 comp rx=0 tx=0).stop 2024-09-19T08:54:39.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.963+0000 7f20a5287640 1 -- 172.21.15.7:0/1349213520 shutdown_connections 2024-09-19T08:54:39.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.963+0000 7f20a5287640 1 --2- 172.21.15.7:0/1349213520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20a010c170 0x7f20a010e610 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.963+0000 7f20a5287640 1 --2- 172.21.15.7:0/1349213520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20a0103660 0x7f20a010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.963+0000 7f20a5287640 1 --2- 172.21.15.7:0/1349213520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20a0102d40 0x7f20a0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.963+0000 7f20a5287640 1 -- 172.21.15.7:0/1349213520 >> 172.21.15.7:0/1349213520 conn(0x7f20a00fc7a0 msgr2=0x7f20a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:39.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.963+0000 7f20a5287640 1 -- 172.21.15.7:0/1349213520 shutdown_connections 2024-09-19T08:54:39.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.963+0000 7f20a5287640 1 -- 172.21.15.7:0/1349213520 wait complete. 2024-09-19T08:54:39.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.963+0000 7f20a5287640 1 Processor -- start 2024-09-19T08:54:39.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.963+0000 7f20a5287640 1 -- start start 2024-09-19T08:54:39.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.964+0000 7f20a5287640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20a0102d40 0x7f20a0198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.964+0000 7f20a5287640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20a0103660 0x7f20a01988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.964+0000 7f20a5287640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20a010c170 0x7f20a019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.964+0000 7f20a5287640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f20a0111f70 con 0x7f20a0102d40 2024-09-19T08:54:39.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.964+0000 7f20a5287640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f20a0111df0 con 0x7f20a0103660 2024-09-19T08:54:39.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.964+0000 7f20a5287640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f20a01120f0 con 0x7f20a010c170 2024-09-19T08:54:39.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.964+0000 7f209effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20a0102d40 0x7f20a0198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.964+0000 7f209effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20a0102d40 0x7f20a0198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57410/0 (socket says 172.21.15.7:57410) 2024-09-19T08:54:39.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.964+0000 7f209effd640 1 -- 172.21.15.7:0/3573442973 learned_addr learned my addr 172.21.15.7:0/3573442973 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:39.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.964+0000 7f209e7fc640 1 --2- 172.21.15.7:0/3573442973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20a0103660 0x7f20a01988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.964+0000 7f209f7fe640 1 --2- 172.21.15.7:0/3573442973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20a010c170 0x7f20a019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.964+0000 7f209effd640 1 -- 172.21.15.7:0/3573442973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20a010c170 msgr2=0x7f20a019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:39.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.964+0000 7f209effd640 1 --2- 172.21.15.7:0/3573442973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20a010c170 0x7f20a019cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.964+0000 7f209effd640 1 -- 172.21.15.7:0/3573442973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20a0103660 msgr2=0x7f20a01988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:39.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.964+0000 7f209effd640 1 --2- 172.21.15.7:0/3573442973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20a0103660 0x7f20a01988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.964+0000 7f209effd640 1 -- 172.21.15.7:0/3573442973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a019d320 con 0x7f20a0102d40 2024-09-19T08:54:39.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.964+0000 7f209effd640 1 --2- 172.21.15.7:0/3573442973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20a0102d40 0x7f20a0198370 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f209000c920 tx=0x7f209000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:39.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.964+0000 7f2087fff640 1 -- 172.21.15.7:0/3573442973 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2090007c70 con 0x7f20a0102d40 2024-09-19T08:54:39.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.964+0000 7f2087fff640 1 -- 172.21.15.7:0/3573442973 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2090007e10 con 0x7f20a0102d40 2024-09-19T08:54:39.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.965+0000 7f20a5287640 1 -- 172.21.15.7:0/3573442973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a019d610 con 0x7f20a0102d40 2024-09-19T08:54:39.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.965+0000 7f2087fff640 1 -- 172.21.15.7:0/3573442973 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2090018890 con 0x7f20a0102d40 2024-09-19T08:54:39.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.965+0000 7f20a5287640 1 -- 172.21.15.7:0/3573442973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a01a4ef0 con 0x7f20a0102d40 2024-09-19T08:54:39.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.967+0000 7f2087fff640 1 -- 172.21.15.7:0/3573442973 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f2090018a70 con 0x7f20a0102d40 2024-09-19T08:54:39.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.967+0000 7f20a7660740 1 Processor -- start 2024-09-19T08:54:39.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.967+0000 7f20a7660740 1 -- start start 2024-09-19T08:54:39.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.967+0000 7f20a7660740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638c61f64a0 0x5638c61f6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.967+0000 7f20a7660740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c61f6dc0 0x5638c6201140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.968+0000 7f20a7660740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c6201680 0x5638c6203a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.968+0000 7f20a7660740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5638c615c2e0 con 0x5638c61f6dc0 2024-09-19T08:54:39.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.968+0000 7f20a7660740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5638c6103ce0 con 0x5638c6201680 2024-09-19T08:54:39.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.968+0000 7f20a7660740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5638c61582a0 con 0x5638c61f64a0 2024-09-19T08:54:39.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.968+0000 7f209effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c61f6dc0 0x5638c6201140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.968+0000 7f209effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c61f6dc0 0x5638c6201140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57424/0 (socket says 172.21.15.7:57424) 2024-09-19T08:54:39.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.968+0000 7f209effd640 1 -- 172.21.15.7:0/2917333549 learned_addr learned my addr 172.21.15.7:0/2917333549 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:39.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.968+0000 7f2087fff640 1 --2- 172.21.15.7:0/3573442973 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f20880a33b0 0x7f20880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.968+0000 7f209e7fc640 1 --2- 172.21.15.7:0/2917333549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c6201680 0x5638c6203a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.968+0000 7f209f7fe640 1 --2- 172.21.15.7:0/3573442973 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f20880a33b0 0x7f20880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.968+0000 7f2087fff640 1 -- 172.21.15.7:0/3573442973 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f20900cfeb0 con 0x7f20a0102d40 2024-09-19T08:54:39.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.968+0000 7f209effd640 1 -- 172.21.15.7:0/2917333549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638c61f64a0 msgr2=0x5638c61f6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:39.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.968+0000 7f209effd640 1 --2- 172.21.15.7:0/2917333549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638c61f64a0 0x5638c61f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.968+0000 7f209effd640 1 -- 172.21.15.7:0/2917333549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c6201680 msgr2=0x5638c6203a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:39.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.968+0000 7f209effd640 1 --2- 172.21.15.7:0/2917333549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c6201680 0x5638c6203a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.968+0000 7f209effd640 1 -- 172.21.15.7:0/2917333549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638c60e8440 con 0x5638c61f6dc0 2024-09-19T08:54:39.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.968+0000 7f209effd640 1 --2- 172.21.15.7:0/2917333549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c61f6dc0 0x5638c6201140 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f20900a4890 tx=0x7f209000ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42816de574a73e02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:39.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.968+0000 7f20857fa640 1 -- 172.21.15.7:0/2917333549 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209009c150 con 0x5638c61f6dc0 2024-09-19T08:54:39.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.969+0000 7f20857fa640 1 -- 172.21.15.7:0/2917333549 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20900bae50 con 0x5638c61f6dc0 2024-09-19T08:54:39.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.969+0000 7f20857fa640 1 -- 172.21.15.7:0/2917333549 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20900cd840 con 0x5638c61f6dc0 2024-09-19T08:54:39.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.969+0000 7f209f7fe640 1 --2- 172.21.15.7:0/3573442973 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f20880a33b0 0x7f20880a5870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2098005e30 tx=0x7f2098005d80 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:39.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.969+0000 7f20a7660740 1 -- 172.21.15.7:0/2917333549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c61f6dc0 msgr2=0x5638c6201140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:39.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.969+0000 7f20a7660740 1 --2- 172.21.15.7:0/2917333549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c61f6dc0 0x5638c6201140 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f20900a4890 tx=0x7f209000ff30 comp rx=0 tx=0).stop 2024-09-19T08:54:39.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.969+0000 7f20a7660740 1 -- 172.21.15.7:0/2917333549 shutdown_connections 2024-09-19T08:54:39.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.969+0000 7f20a7660740 1 --2- 172.21.15.7:0/2917333549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c6201680 0x5638c6203a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.969+0000 7f20a7660740 1 --2- 172.21.15.7:0/2917333549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c61f6dc0 0x5638c6201140 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.969+0000 7f20a7660740 1 --2- 172.21.15.7:0/2917333549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638c61f64a0 0x5638c61f6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.969+0000 7f20a7660740 1 -- 172.21.15.7:0/2917333549 >> 172.21.15.7:0/2917333549 conn(0x5638c61f2a30 msgr2=0x5638c61f2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:39.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.969+0000 7f20a7660740 1 -- 172.21.15.7:0/2917333549 shutdown_connections 2024-09-19T08:54:39.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.969+0000 7f20a7660740 1 -- 172.21.15.7:0/2917333549 wait complete. 2024-09-19T08:54:39.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.970+0000 7f20a7660740 1 -- start start 2024-09-19T08:54:39.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.970+0000 7f20a7660740 1 Processor -- start 2024-09-19T08:54:39.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.970+0000 7f20a7660740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c61f64a0 0x5638c6200fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.970+0000 7f20a7660740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638c61f6dc0 0x5638c61fe250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.970+0000 7f20a7660740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c6201680 0x5638c61fe790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.970+0000 7f20a7660740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5638c6204250 con 0x5638c6201680 2024-09-19T08:54:39.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.970+0000 7f20a7660740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5638c6117050 con 0x5638c61f64a0 2024-09-19T08:54:39.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.970+0000 7f20a7660740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5638c62043d0 con 0x5638c61f6dc0 2024-09-19T08:54:39.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.970+0000 7f20a7660740 10 client.0 _ll_register_callbacks cb 0x5638c6157160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:39.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.970+0000 7f209f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c6201680 0x5638c61fe790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.970+0000 7f209f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c6201680 0x5638c61fe790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57430/0 (socket says 172.21.15.7:57430) 2024-09-19T08:54:39.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.970+0000 7f209f7fe640 1 -- 172.21.15.7:0/3669819400 learned_addr learned my addr 172.21.15.7:0/3669819400 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:39.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.970+0000 7f209effd640 1 --2- 172.21.15.7:0/3669819400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c61f64a0 0x5638c6200fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.970+0000 7f209e7fc640 1 --2- 172.21.15.7:0/3669819400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638c61f6dc0 0x5638c61fe250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.970+0000 7f209f7fe640 1 -- 172.21.15.7:0/3669819400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638c61f6dc0 msgr2=0x5638c61fe250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:39.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.970+0000 7f209f7fe640 1 --2- 172.21.15.7:0/3669819400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638c61f6dc0 0x5638c61fe250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.970+0000 7f209f7fe640 1 -- 172.21.15.7:0/3669819400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c61f64a0 msgr2=0x5638c6200fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:39.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.970+0000 7f209f7fe640 1 --2- 172.21.15.7:0/3669819400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c61f64a0 0x5638c6200fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.970+0000 7f209f7fe640 1 -- 172.21.15.7:0/3669819400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638c5ecd3c0 con 0x5638c6201680 2024-09-19T08:54:39.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.970+0000 7f209effd640 1 --2- 172.21.15.7:0/3669819400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c61f64a0 0x5638c6200fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:39.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.971+0000 7f209f7fe640 1 --2- 172.21.15.7:0/3669819400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c6201680 0x5638c61fe790 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f209802f650 tx=0x7f209802a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1d71369d7341ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:39.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.971+0000 7f2082ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:39.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.971+0000 7f2082ff5640 1 -- 172.21.15.7:0/3669819400 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2098034040 con 0x5638c6201680 2024-09-19T08:54:39.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.971+0000 7f2082ff5640 1 -- 172.21.15.7:0/3669819400 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f2098004040 con 0x5638c6201680 2024-09-19T08:54:39.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.971+0000 7f20a7660740 1 -- 172.21.15.7:0/3669819400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20900bae50 con 0x5638c6201680 2024-09-19T08:54:39.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.971+0000 7f2082ff5640 1 -- 172.21.15.7:0/3669819400 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2098003e40 con 0x5638c6201680 2024-09-19T08:54:39.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.971+0000 7f20a7660740 10 client.17715 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:39.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.971+0000 7f20a7660740 1 -- 172.21.15.7:0/3669819400 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5638c620fbd0 con 0x5638c6201680 2024-09-19T08:54:39.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.971+0000 7f2082ff5640 1 -- 172.21.15.7:0/3669819400 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20900bae50 con 0x5638c6201680 2024-09-19T08:54:39.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.971+0000 7f2082ff5640 1 -- 172.21.15.7:0/3669819400 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f209804f930 con 0x5638c6201680 2024-09-19T08:54:39.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.971+0000 7f20a7660740 10 client.17715 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:39.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.971+0000 7f20a7660740 10 client.17715 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:39.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.971+0000 7f20a7660740 20 client.17715 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:39.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.971+0000 7f20a7660740 1 --2- 172.21.15.7:0/3669819400 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5638c62110e0 0x5638c6213540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.971+0000 7f20a7660740 4 client.17715 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:39.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.971+0000 7f20a7660740 1 -- 172.21.15.7:0/3669819400 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638c6169850 con 0x5638c62110e0 2024-09-19T08:54:39.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.972+0000 7f209effd640 1 --2- 172.21.15.7:0/3669819400 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5638c62110e0 0x5638c6213540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.972+0000 7f2082ff5640 10 client.17715 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:39.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.972+0000 7f209effd640 1 --2- 172.21.15.7:0/3669819400 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5638c62110e0 0x5638c6213540 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52ae723daae3d9af server_cookie=cee6ca49e83dbc1c in_seq=0 out_seq=0 2024-09-19T08:54:39.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.973+0000 7f2082ff5640 1 -- 172.21.15.7:0/3669819400 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5638c6169850 con 0x5638c62110e0 2024-09-19T08:54:39.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.973+0000 7f2082ff5640 10 client.17715 handle_command_reply: tid=0 2024-09-19T08:54:39.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.973+0000 7f20a7660740 1 client.17715 shutdown 2024-09-19T08:54:39.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.973+0000 7f20a7660740 1 -- 172.21.15.7:0/3669819400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c6201680 msgr2=0x5638c61fe790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:39.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.973+0000 7f20a7660740 1 --2- 172.21.15.7:0/3669819400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c6201680 0x5638c61fe790 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f209802f650 tx=0x7f209802a950 comp rx=0 tx=0).stop 2024-09-19T08:54:39.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.973+0000 7f20a7660740 1 -- 172.21.15.7:0/3669819400 shutdown_connections 2024-09-19T08:54:39.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.973+0000 7f20a7660740 1 --2- 172.21.15.7:0/3669819400 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5638c62110e0 0x5638c6213540 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.973+0000 7f20a7660740 1 --2- 172.21.15.7:0/3669819400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c6201680 0x5638c61fe790 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.973+0000 7f20a7660740 1 --2- 172.21.15.7:0/3669819400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638c61f6dc0 0x5638c61fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.973+0000 7f20a7660740 1 --2- 172.21.15.7:0/3669819400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c61f64a0 0x5638c6200fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.973+0000 7f20a7660740 1 -- 172.21.15.7:0/3669819400 >> 172.21.15.7:0/3669819400 conn(0x5638c61f2a30 msgr2=0x5638c61f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:39.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.973+0000 7f2082ff5640 0 client.17715 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:39.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.973+0000 7f20a7660740 1 -- 172.21.15.7:0/3669819400 shutdown_connections 2024-09-19T08:54:39.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.973+0000 7f20a7660740 1 -- 172.21.15.7:0/3669819400 wait complete. 2024-09-19T08:54:39.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.973+0000 7f20a7660740 20 client.17715 trim_cache size 0 max 16384 2024-09-19T08:54:40.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.990+0000 7f20a7660740 1 Processor -- start 2024-09-19T08:54:40.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.990+0000 7f20a7660740 1 -- start start 2024-09-19T08:54:40.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.990+0000 7f20a7660740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638c61f64a0 0x5638c620d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.990+0000 7f20a7660740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c61f6dc0 0x5638c62130f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.991+0000 7f20a7660740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c6201680 0x5638c61f97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.991+0000 7f20a7660740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f20a01b0140 con 0x5638c61f6dc0 2024-09-19T08:54:40.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.991+0000 7f20a7660740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f20a01ada10 con 0x5638c6201680 2024-09-19T08:54:40.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.991+0000 7f20a7660740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f20a01ab880 con 0x5638c61f64a0 2024-09-19T08:54:40.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.991+0000 7f209e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c61f6dc0 0x5638c62130f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.991+0000 7f209e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c61f6dc0 0x5638c62130f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57444/0 (socket says 172.21.15.7:57444) 2024-09-19T08:54:40.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.991+0000 7f209e7fc640 1 -- 172.21.15.7:0/3914701585 learned_addr learned my addr 172.21.15.7:0/3914701585 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:40.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.991+0000 7f209effd640 1 --2- 172.21.15.7:0/3914701585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638c61f64a0 0x5638c620d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.991+0000 7f209f7fe640 1 --2- 172.21.15.7:0/3914701585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c6201680 0x5638c61f97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.991+0000 7f209e7fc640 1 -- 172.21.15.7:0/3914701585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638c61f64a0 msgr2=0x5638c620d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:40.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.991+0000 7f209e7fc640 1 --2- 172.21.15.7:0/3914701585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638c61f64a0 0x5638c620d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.991+0000 7f209e7fc640 1 -- 172.21.15.7:0/3914701585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c6201680 msgr2=0x5638c61f97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:40.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.991+0000 7f209e7fc640 1 --2- 172.21.15.7:0/3914701585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c6201680 0x5638c61f97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.991+0000 7f209e7fc640 1 -- 172.21.15.7:0/3914701585 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638c61fd200 con 0x5638c61f6dc0 2024-09-19T08:54:40.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.991+0000 7f209f7fe640 1 --2- 172.21.15.7:0/3914701585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c6201680 0x5638c61f97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:40.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.991+0000 7f209e7fc640 1 --2- 172.21.15.7:0/3914701585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c61f6dc0 0x5638c62130f0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f2094005d00 tx=0x7f2094011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6dbd630da2acc84 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:40.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.991+0000 7f2084ff9640 1 -- 172.21.15.7:0/3914701585 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209400bd10 con 0x5638c61f6dc0 2024-09-19T08:54:40.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.992+0000 7f2084ff9640 1 -- 172.21.15.7:0/3914701585 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2094005500 con 0x5638c61f6dc0 2024-09-19T08:54:40.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.992+0000 7f2084ff9640 1 -- 172.21.15.7:0/3914701585 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209401b650 con 0x5638c61f6dc0 2024-09-19T08:54:40.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.992+0000 7f20a7660740 1 -- 172.21.15.7:0/3914701585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c61f6dc0 msgr2=0x5638c62130f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:40.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.992+0000 7f20a7660740 1 --2- 172.21.15.7:0/3914701585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c61f6dc0 0x5638c62130f0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f2094005d00 tx=0x7f2094011810 comp rx=0 tx=0).stop 2024-09-19T08:54:40.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.992+0000 7f20a7660740 1 -- 172.21.15.7:0/3914701585 shutdown_connections 2024-09-19T08:54:40.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.992+0000 7f20a7660740 1 --2- 172.21.15.7:0/3914701585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c6201680 0x5638c61f97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.992+0000 7f20a7660740 1 --2- 172.21.15.7:0/3914701585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c61f6dc0 0x5638c62130f0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.992+0000 7f20a7660740 1 --2- 172.21.15.7:0/3914701585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638c61f64a0 0x5638c620d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.992+0000 7f20a7660740 1 -- 172.21.15.7:0/3914701585 >> 172.21.15.7:0/3914701585 conn(0x5638c61f2a30 msgr2=0x5638c61f9090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:40.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.992+0000 7f20a7660740 1 -- 172.21.15.7:0/3914701585 shutdown_connections 2024-09-19T08:54:40.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.992+0000 7f20a7660740 1 -- 172.21.15.7:0/3914701585 wait complete. 2024-09-19T08:54:40.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.992+0000 7f20a7660740 1 -- start start 2024-09-19T08:54:40.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.993+0000 7f20a7660740 1 Processor -- start 2024-09-19T08:54:40.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.993+0000 7f20a7660740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c61f64a0 0x5638c6273f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.993+0000 7f20a7660740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638c61f6dc0 0x5638c62744c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.993+0000 7f20a7660740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c6201680 0x5638c62092b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.993+0000 7f20a7660740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f20a01abed0 con 0x5638c6201680 2024-09-19T08:54:40.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.993+0000 7f20a7660740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f20a01ad340 con 0x5638c61f64a0 2024-09-19T08:54:40.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.993+0000 7f20a7660740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f20a01ac5a0 con 0x5638c61f6dc0 2024-09-19T08:54:40.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.993+0000 7f20a7660740 10 client.0 _ll_register_callbacks cb 0x7f2098009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:40.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.993+0000 7f209f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c6201680 0x5638c62092b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.993+0000 7f209f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c6201680 0x5638c62092b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57458/0 (socket says 172.21.15.7:57458) 2024-09-19T08:54:40.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.993+0000 7f209f7fe640 1 -- 172.21.15.7:0/829980272 learned_addr learned my addr 172.21.15.7:0/829980272 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:40.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.993+0000 7f209e7fc640 1 --2- 172.21.15.7:0/829980272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638c61f6dc0 0x5638c62744c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.993+0000 7f209effd640 1 --2- 172.21.15.7:0/829980272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c61f64a0 0x5638c6273f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.993+0000 7f209f7fe640 1 -- 172.21.15.7:0/829980272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638c61f6dc0 msgr2=0x5638c62744c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:40.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.993+0000 7f209f7fe640 1 --2- 172.21.15.7:0/829980272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638c61f6dc0 0x5638c62744c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.993+0000 7f209f7fe640 1 -- 172.21.15.7:0/829980272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c61f64a0 msgr2=0x5638c6273f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:40.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.993+0000 7f209f7fe640 1 --2- 172.21.15.7:0/829980272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c61f64a0 0x5638c6273f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.993+0000 7f209f7fe640 1 -- 172.21.15.7:0/829980272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638c61f6bf0 con 0x5638c6201680 2024-09-19T08:54:40.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.993+0000 7f209e7fc640 1 --2- 172.21.15.7:0/829980272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638c61f6dc0 0x5638c62744c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:40.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.994+0000 7f209effd640 1 --2- 172.21.15.7:0/829980272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c61f64a0 0x5638c6273f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:40.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.994+0000 7f209f7fe640 1 --2- 172.21.15.7:0/829980272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c6201680 0x5638c62092b0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f209804ff90 tx=0x7f2098009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707c42b19a0dd76f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:40.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.994+0000 7f2082ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:40.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.994+0000 7f2082ff5640 1 -- 172.21.15.7:0/829980272 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209805b070 con 0x5638c6201680 2024-09-19T08:54:40.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.994+0000 7f2082ff5640 1 -- 172.21.15.7:0/829980272 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f209803c030 con 0x5638c6201680 2024-09-19T08:54:40.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.994+0000 7f20a7660740 1 -- 172.21.15.7:0/829980272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2094005500 con 0x5638c6201680 2024-09-19T08:54:40.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.994+0000 7f2082ff5640 1 -- 172.21.15.7:0/829980272 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f209802f740 con 0x5638c6201680 2024-09-19T08:54:40.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.994+0000 7f20a7660740 10 client.17721 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:40.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.994+0000 7f20a7660740 1 -- 172.21.15.7:0/829980272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5638c627b600 con 0x5638c6201680 2024-09-19T08:54:40.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.994+0000 7f2082ff5640 1 -- 172.21.15.7:0/829980272 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2094005500 con 0x5638c6201680 2024-09-19T08:54:40.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.994+0000 7f2082ff5640 1 -- 172.21.15.7:0/829980272 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2098004040 con 0x5638c6201680 2024-09-19T08:54:40.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.994+0000 7f20a7660740 10 client.17721 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:40.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.994+0000 7f20a7660740 10 client.17721 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:40.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.994+0000 7f20a7660740 20 client.17721 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:40.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.994+0000 7f20a7660740 1 --2- 172.21.15.7:0/829980272 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5638c627bd80 0x5638c627e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.994+0000 7f20a7660740 4 client.17721 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:54:40.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.994+0000 7f20a7660740 1 -- 172.21.15.7:0/829980272 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5638c6163d60 con 0x5638c627bd80 2024-09-19T08:54:40.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.995+0000 7f209effd640 1 --2- 172.21.15.7:0/829980272 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5638c627bd80 0x5638c627e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.995+0000 7f209effd640 1 --2- 172.21.15.7:0/829980272 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5638c627bd80 0x5638c627e1a0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea12598e8d2590ed server_cookie=6f2b2d8f3acd129c in_seq=0 out_seq=0 2024-09-19T08:54:40.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.995+0000 7f2082ff5640 10 client.17721 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:40.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.995+0000 7f2082ff5640 1 -- 172.21.15.7:0/829980272 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5638c6163d60 con 0x5638c627bd80 2024-09-19T08:54:40.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.995+0000 7f2082ff5640 10 client.17721 handle_command_reply: tid=0 2024-09-19T08:54:40.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.995+0000 7f20a7660740 1 client.17721 shutdown 2024-09-19T08:54:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.995+0000 7f20a7660740 1 -- 172.21.15.7:0/829980272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c6201680 msgr2=0x5638c62092b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.996+0000 7f20a7660740 1 --2- 172.21.15.7:0/829980272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c6201680 0x5638c62092b0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f209804ff90 tx=0x7f2098009bd0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.996+0000 7f20a7660740 1 -- 172.21.15.7:0/829980272 shutdown_connections 2024-09-19T08:54:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.996+0000 7f20a7660740 1 --2- 172.21.15.7:0/829980272 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x5638c627bd80 0x5638c627e1a0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.996+0000 7f2082ff5640 0 client.17721 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.996+0000 7f20a7660740 1 --2- 172.21.15.7:0/829980272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638c6201680 0x5638c62092b0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.996+0000 7f20a7660740 1 --2- 172.21.15.7:0/829980272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638c61f6dc0 0x5638c62744c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.996+0000 7f20a7660740 1 --2- 172.21.15.7:0/829980272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5638c61f64a0 0x5638c6273f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.996+0000 7f20a7660740 1 -- 172.21.15.7:0/829980272 >> 172.21.15.7:0/829980272 conn(0x5638c61f2a30 msgr2=0x5638c61f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.996+0000 7f20a7660740 1 -- 172.21.15.7:0/829980272 shutdown_connections 2024-09-19T08:54:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.996+0000 7f20a7660740 1 -- 172.21.15.7:0/829980272 wait complete. 2024-09-19T08:54:40.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.996+0000 7f20a7660740 20 client.17721 trim_cache size 0 max 16384 2024-09-19T08:54:40.010 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:54:40.010 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-19T08:54:40.010 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-09-19T08:54:40.010 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:54:40.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.996+0000 7f20a5287640 1 -- 172.21.15.7:0/3573442973 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f20880a33b0 msgr2=0x7f20880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:40.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.996+0000 7f20a5287640 1 --2- 172.21.15.7:0/3573442973 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f20880a33b0 0x7f20880a5870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2098005e30 tx=0x7f2098005d80 comp rx=0 tx=0).stop 2024-09-19T08:54:40.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.996+0000 7f20a5287640 1 -- 172.21.15.7:0/3573442973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20a0102d40 msgr2=0x7f20a0198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:40.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.996+0000 7f20a5287640 1 --2- 172.21.15.7:0/3573442973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20a0102d40 0x7f20a0198370 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f209000c920 tx=0x7f209000cde0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.996+0000 7f20a5287640 1 -- 172.21.15.7:0/3573442973 shutdown_connections 2024-09-19T08:54:40.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.996+0000 7f20a5287640 1 --2- 172.21.15.7:0/3573442973 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f20880a33b0 0x7f20880a5870 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.996+0000 7f20a5287640 1 --2- 172.21.15.7:0/3573442973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20a010c170 0x7f20a019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.996+0000 7f20a5287640 1 --2- 172.21.15.7:0/3573442973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20a0103660 0x7f20a01988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.996+0000 7f20a5287640 1 --2- 172.21.15.7:0/3573442973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20a0102d40 0x7f20a0198370 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.996+0000 7f20a5287640 1 -- 172.21.15.7:0/3573442973 >> 172.21.15.7:0/3573442973 conn(0x7f20a00fc7a0 msgr2=0x7f20a00fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:40.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.996+0000 7f20a5287640 1 -- 172.21.15.7:0/3573442973 shutdown_connections 2024-09-19T08:54:40.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:39.997+0000 7f20a5287640 1 -- 172.21.15.7:0/3573442973 wait complete. 2024-09-19T08:54:40.711 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:54:40.711 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:54:40.973 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:41.411 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:41 smithi007 ceph-mon[31221]: pgmap v315: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:54:41.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.411+0000 7fb8ce10f640 1 -- 172.21.15.7:0/3050197654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8c8103780 msgr2=0x7fb8c8107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:41.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.411+0000 7fb8ce10f640 1 --2- 172.21.15.7:0/3050197654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8c8103780 0x7fb8c8107bc0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc009930 tx=0x7fb8bc02a420 comp rx=0 tx=0).stop 2024-09-19T08:54:41.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.411+0000 7fb8ce10f640 1 -- 172.21.15.7:0/3050197654 shutdown_connections 2024-09-19T08:54:41.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.411+0000 7fb8ce10f640 1 --2- 172.21.15.7:0/3050197654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8c8108300 0x7fb8c810ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.411+0000 7fb8ce10f640 1 --2- 172.21.15.7:0/3050197654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8c8103780 0x7fb8c8107bc0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.411+0000 7fb8ce10f640 1 --2- 172.21.15.7:0/3050197654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8c8102dd0 0x7fb8c81031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.411+0000 7fb8ce10f640 1 -- 172.21.15.7:0/3050197654 >> 172.21.15.7:0/3050197654 conn(0x7fb8c80fc7d0 msgr2=0x7fb8c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:41.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.411+0000 7fb8ce10f640 1 -- 172.21.15.7:0/3050197654 shutdown_connections 2024-09-19T08:54:41.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.411+0000 7fb8ce10f640 1 -- 172.21.15.7:0/3050197654 wait complete. 2024-09-19T08:54:41.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.411+0000 7fb8ce10f640 1 Processor -- start 2024-09-19T08:54:41.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.411+0000 7fb8ce10f640 1 -- start start 2024-09-19T08:54:41.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.412+0000 7fb8ce10f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8c8102dd0 0x7fb8c8100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:41.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.412+0000 7fb8ce10f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8c8103780 0x7fb8c8100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:41.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.412+0000 7fb8ce10f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8c8108300 0x7fb8c81014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:41.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.412+0000 7fb8ce10f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c8112050 con 0x7fb8c8108300 2024-09-19T08:54:41.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.412+0000 7fb8ce10f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c8111ed0 con 0x7fb8c8103780 2024-09-19T08:54:41.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.412+0000 7fb8ce10f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c81121d0 con 0x7fb8c8102dd0 2024-09-19T08:54:41.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.412+0000 7fb8c7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8c8108300 0x7fb8c81014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:41.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.412+0000 7fb8c7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8c8108300 0x7fb8c81014b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57484/0 (socket says 172.21.15.7:57484) 2024-09-19T08:54:41.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.412+0000 7fb8c7fff640 1 -- 172.21.15.7:0/1325266094 learned_addr learned my addr 172.21.15.7:0/1325266094 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:41.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.412+0000 7fb8c6ffd640 1 --2- 172.21.15.7:0/1325266094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8c8103780 0x7fb8c8100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:41.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.412+0000 7fb8c77fe640 1 --2- 172.21.15.7:0/1325266094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8c8102dd0 0x7fb8c8100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:41.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.412+0000 7fb8c7fff640 1 -- 172.21.15.7:0/1325266094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8c8102dd0 msgr2=0x7fb8c8100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:41.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.412+0000 7fb8c7fff640 1 --2- 172.21.15.7:0/1325266094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8c8102dd0 0x7fb8c8100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.412+0000 7fb8c7fff640 1 -- 172.21.15.7:0/1325266094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8c8103780 msgr2=0x7fb8c8100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:41.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.412+0000 7fb8c7fff640 1 --2- 172.21.15.7:0/1325266094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8c8103780 0x7fb8c8100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.412+0000 7fb8c7fff640 1 -- 172.21.15.7:0/1325266094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c81a6a90 con 0x7fb8c8108300 2024-09-19T08:54:41.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.412+0000 7fb8c7fff640 1 --2- 172.21.15.7:0/1325266094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8c8108300 0x7fb8c81014b0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000d750 tx=0x7fb8c000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:41.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.413+0000 7fb8c4ff9640 1 -- 172.21.15.7:0/1325266094 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0017070 con 0x7fb8c8108300 2024-09-19T08:54:41.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.413+0000 7fb8c4ff9640 1 -- 172.21.15.7:0/1325266094 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8c0005500 con 0x7fb8c8108300 2024-09-19T08:54:41.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.413+0000 7fb8ce10f640 1 -- 172.21.15.7:0/1325266094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8c81a6d80 con 0x7fb8c8108300 2024-09-19T08:54:41.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.413+0000 7fb8c4ff9640 1 -- 172.21.15.7:0/1325266094 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0004d90 con 0x7fb8c8108300 2024-09-19T08:54:41.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.413+0000 7fb8ce10f640 1 -- 172.21.15.7:0/1325266094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8c81a7240 con 0x7fb8c8108300 2024-09-19T08:54:41.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.414+0000 7fb8ce10f640 1 -- 172.21.15.7:0/1325266094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8c81031b0 con 0x7fb8c8108300 2024-09-19T08:54:41.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.415+0000 7fb8c4ff9640 1 -- 172.21.15.7:0/1325266094 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fb8c0004f30 con 0x7fb8c8108300 2024-09-19T08:54:41.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.416+0000 7fb8c4ff9640 1 --2- 172.21.15.7:0/1325266094 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb8b00a33b0 0x7fb8b00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:41.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.416+0000 7fb8c77fe640 1 --2- 172.21.15.7:0/1325266094 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb8b00a33b0 0x7fb8b00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:41.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.416+0000 7fb8c4ff9640 1 -- 172.21.15.7:0/1325266094 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7fb8c00cf620 con 0x7fb8c8108300 2024-09-19T08:54:41.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.416+0000 7fb8c77fe640 1 --2- 172.21.15.7:0/1325266094 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb8b00a33b0 0x7fb8b00a5870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8005fd0 tx=0x7fb8b8009680 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:41.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.420+0000 7fb8c4ff9640 1 -- 172.21.15.7:0/1325266094 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb8c009b970 con 0x7fb8c8108300 2024-09-19T08:54:41.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:41 smithi175 ceph-mon[35688]: pgmap v315: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:54:41.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:41 smithi044 ceph-mon[35072]: pgmap v315: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:54:41.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.636+0000 7fb8ce10f640 1 -- 172.21.15.7:0/1325266094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8c810a290 con 0x7fb8c8108300 2024-09-19T08:54:41.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.637+0000 7fb8c4ff9640 1 -- 172.21.15.7:0/1325266094 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7fb8c009fc70 con 0x7fb8c8108300 2024-09-19T08:54:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:54:41.637 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:54:41.637 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:54:41.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.639+0000 7fb8ce10f640 1 -- 172.21.15.7:0/1325266094 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb8b00a33b0 msgr2=0x7fb8b00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:41.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.639+0000 7fb8ce10f640 1 --2- 172.21.15.7:0/1325266094 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb8b00a33b0 0x7fb8b00a5870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8005fd0 tx=0x7fb8b8009680 comp rx=0 tx=0).stop 2024-09-19T08:54:41.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.639+0000 7fb8ce10f640 1 -- 172.21.15.7:0/1325266094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8c8108300 msgr2=0x7fb8c81014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:41.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.639+0000 7fb8ce10f640 1 --2- 172.21.15.7:0/1325266094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8c8108300 0x7fb8c81014b0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000d750 tx=0x7fb8c000dc10 comp rx=0 tx=0).stop 2024-09-19T08:54:41.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.639+0000 7fb8ce10f640 1 -- 172.21.15.7:0/1325266094 shutdown_connections 2024-09-19T08:54:41.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.639+0000 7fb8ce10f640 1 --2- 172.21.15.7:0/1325266094 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb8b00a33b0 0x7fb8b00a5870 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.639+0000 7fb8ce10f640 1 --2- 172.21.15.7:0/1325266094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8c8108300 0x7fb8c81014b0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.639+0000 7fb8ce10f640 1 --2- 172.21.15.7:0/1325266094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8c8103780 0x7fb8c8100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.639+0000 7fb8ce10f640 1 --2- 172.21.15.7:0/1325266094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8c8102dd0 0x7fb8c8100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.639+0000 7fb8ce10f640 1 -- 172.21.15.7:0/1325266094 >> 172.21.15.7:0/1325266094 conn(0x7fb8c80fc7d0 msgr2=0x7fb8c8105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:41.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.639+0000 7fb8ce10f640 1 -- 172.21.15.7:0/1325266094 shutdown_connections 2024-09-19T08:54:41.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:41.639+0000 7fb8ce10f640 1 -- 172.21.15.7:0/1325266094 wait complete. 2024-09-19T08:54:42.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:42 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1325266094' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:42.332 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:54:42.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:42 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1325266094' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:42.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:42 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1325266094' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:42.589 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:43.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.054+0000 7f93157ad640 1 -- 172.21.15.7:0/1433558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9310101de0 msgr2=0x7f93101021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:43.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.054+0000 7f93157ad640 1 --2- 172.21.15.7:0/1433558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9310101de0 0x7f93101021c0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f9308009ca0 tx=0x7f930802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.054+0000 7f93157ad640 1 -- 172.21.15.7:0/1433558 shutdown_connections 2024-09-19T08:54:43.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.054+0000 7f93157ad640 1 --2- 172.21.15.7:0/1433558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9310106f10 0x7f931010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.054+0000 7f93157ad640 1 --2- 172.21.15.7:0/1433558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9310102790 0x7f93101067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.054+0000 7f93157ad640 1 --2- 172.21.15.7:0/1433558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9310101de0 0x7f93101021c0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.054+0000 7f93157ad640 1 -- 172.21.15.7:0/1433558 >> 172.21.15.7:0/1433558 conn(0x7f93100fd8c0 msgr2=0x7f93100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:43.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.054+0000 7f93157ad640 1 -- 172.21.15.7:0/1433558 shutdown_connections 2024-09-19T08:54:43.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.054+0000 7f93157ad640 1 -- 172.21.15.7:0/1433558 wait complete. 2024-09-19T08:54:43.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.055+0000 7f93157ad640 1 Processor -- start 2024-09-19T08:54:43.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.055+0000 7f93157ad640 1 -- start start 2024-09-19T08:54:43.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.055+0000 7f93157ad640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9310101de0 0x7f93100744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.055+0000 7f93157ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9310102790 0x7f9310074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.055+0000 7f93157ad640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9310106f10 0x7f9310074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.055+0000 7f93157ad640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9310111fc0 con 0x7f9310101de0 2024-09-19T08:54:43.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.055+0000 7f93157ad640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9310111e40 con 0x7f9310102790 2024-09-19T08:54:43.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.055+0000 7f93157ad640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9310112140 con 0x7f9310106f10 2024-09-19T08:54:43.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.056+0000 7f930effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9310101de0 0x7f93100744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.056+0000 7f930effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9310101de0 0x7f93100744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57502/0 (socket says 172.21.15.7:57502) 2024-09-19T08:54:43.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.056+0000 7f930effd640 1 -- 172.21.15.7:0/2644853929 learned_addr learned my addr 172.21.15.7:0/2644853929 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:43.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.056+0000 7f930e7fc640 1 --2- 172.21.15.7:0/2644853929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9310102790 0x7f9310074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.056+0000 7f930f7fe640 1 --2- 172.21.15.7:0/2644853929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9310106f10 0x7f9310074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.056+0000 7f930effd640 1 -- 172.21.15.7:0/2644853929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9310106f10 msgr2=0x7f9310074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:43.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.056+0000 7f930effd640 1 --2- 172.21.15.7:0/2644853929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9310106f10 0x7f9310074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.056+0000 7f930effd640 1 -- 172.21.15.7:0/2644853929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9310102790 msgr2=0x7f9310074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:43.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.056+0000 7f930effd640 1 --2- 172.21.15.7:0/2644853929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9310102790 0x7f9310074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.056+0000 7f930effd640 1 -- 172.21.15.7:0/2644853929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93101a6960 con 0x7f9310101de0 2024-09-19T08:54:43.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.056+0000 7f930f7fe640 1 --2- 172.21.15.7:0/2644853929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9310106f10 0x7f9310074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:43.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.056+0000 7f930effd640 1 --2- 172.21.15.7:0/2644853929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9310101de0 0x7f93100744f0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f9308005e30 tx=0x7f9308003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:43.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.056+0000 7f9307fff640 1 -- 172.21.15.7:0/2644853929 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93080316d0 con 0x7f9310101de0 2024-09-19T08:54:43.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.056+0000 7f9307fff640 1 -- 172.21.15.7:0/2644853929 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9308031870 con 0x7f9310101de0 2024-09-19T08:54:43.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.056+0000 7f93157ad640 1 -- 172.21.15.7:0/2644853929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93101a6bf0 con 0x7f9310101de0 2024-09-19T08:54:43.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.056+0000 7f9307fff640 1 -- 172.21.15.7:0/2644853929 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930802fb90 con 0x7f9310101de0 2024-09-19T08:54:43.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.056+0000 7f93157ad640 1 -- 172.21.15.7:0/2644853929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93101a7130 con 0x7f9310101de0 2024-09-19T08:54:43.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.059+0000 7f9307fff640 1 -- 172.21.15.7:0/2644853929 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f930802fd50 con 0x7f9310101de0 2024-09-19T08:54:43.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.059+0000 7f9317b86740 1 Processor -- start 2024-09-19T08:54:43.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.059+0000 7f9317b86740 1 -- start start 2024-09-19T08:54:43.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.059+0000 7f9317b86740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c39daeab40 0x55c39dae9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.059+0000 7f9317b86740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39dae95d0 0x55c39dae9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.059+0000 7f9317b86740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c39daf4370 0x55c39daf6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.059+0000 7f9317b86740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c39da4f2f0 con 0x55c39dae95d0 2024-09-19T08:54:43.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.059+0000 7f9317b86740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c39d9f6cf0 con 0x55c39daf4370 2024-09-19T08:54:43.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.059+0000 7f9317b86740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c39da4b2b0 con 0x55c39daeab40 2024-09-19T08:54:43.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.059+0000 7f930effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39dae95d0 0x55c39dae9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.059+0000 7f930effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39dae95d0 0x55c39dae9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57512/0 (socket says 172.21.15.7:57512) 2024-09-19T08:54:43.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.060+0000 7f930effd640 1 -- 172.21.15.7:0/1958222136 learned_addr learned my addr 172.21.15.7:0/1958222136 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:43.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.060+0000 7f930f7fe640 1 --2- 172.21.15.7:0/1958222136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c39daeab40 0x55c39dae9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.060+0000 7f930e7fc640 1 --2- 172.21.15.7:0/1958222136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c39daf4370 0x55c39daf6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.060+0000 7f930effd640 1 -- 172.21.15.7:0/1958222136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c39daeab40 msgr2=0x55c39dae9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:43.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.060+0000 7f930effd640 1 --2- 172.21.15.7:0/1958222136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c39daeab40 0x55c39dae9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.060+0000 7f930effd640 1 -- 172.21.15.7:0/1958222136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c39daf4370 msgr2=0x55c39daf6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:43.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.060+0000 7f930effd640 1 --2- 172.21.15.7:0/1958222136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c39daf4370 0x55c39daf6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.060+0000 7f930effd640 1 -- 172.21.15.7:0/1958222136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c39d9db3a0 con 0x55c39dae95d0 2024-09-19T08:54:43.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.060+0000 7f9307fff640 1 --2- 172.21.15.7:0/2644853929 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f92fc0a33b0 0x7f92fc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.060+0000 7f930f7fe640 1 --2- 172.21.15.7:0/2644853929 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f92fc0a33b0 0x7f92fc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.060+0000 7f930effd640 1 --2- 172.21.15.7:0/1958222136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39dae95d0 0x55c39dae9a10 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f93080ee9d0 tx=0x7f93080f93d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aec3fef0d031b89 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:43.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.060+0000 7f9307fff640 1 -- 172.21.15.7:0/2644853929 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f93080f1240 con 0x7f9310101de0 2024-09-19T08:54:43.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.060+0000 7f93057fa640 1 -- 172.21.15.7:0/1958222136 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93080bd3c0 con 0x55c39dae95d0 2024-09-19T08:54:43.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.060+0000 7f93057fa640 1 -- 172.21.15.7:0/1958222136 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93080bdcf0 con 0x55c39dae95d0 2024-09-19T08:54:43.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.060+0000 7f93057fa640 1 -- 172.21.15.7:0/1958222136 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93080bcf50 con 0x55c39dae95d0 2024-09-19T08:54:43.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.061+0000 7f9317b86740 1 -- 172.21.15.7:0/1958222136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39dae95d0 msgr2=0x55c39dae9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:43.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.061+0000 7f930f7fe640 1 --2- 172.21.15.7:0/2644853929 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f92fc0a33b0 0x7f92fc0a5870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f930000cb20 tx=0x7f930000c500 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:43.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.061+0000 7f9317b86740 1 --2- 172.21.15.7:0/1958222136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39dae95d0 0x55c39dae9a10 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f93080ee9d0 tx=0x7f93080f93d0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.061+0000 7f9317b86740 1 -- 172.21.15.7:0/1958222136 shutdown_connections 2024-09-19T08:54:43.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.061+0000 7f9317b86740 1 --2- 172.21.15.7:0/1958222136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c39daf4370 0x55c39daf6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.061+0000 7f9317b86740 1 --2- 172.21.15.7:0/1958222136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39dae95d0 0x55c39dae9a10 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.061+0000 7f9317b86740 1 --2- 172.21.15.7:0/1958222136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c39daeab40 0x55c39dae9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.061+0000 7f9317b86740 1 -- 172.21.15.7:0/1958222136 >> 172.21.15.7:0/1958222136 conn(0x55c39dab2310 msgr2=0x55c39dae5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:43.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.061+0000 7f9317b86740 1 -- 172.21.15.7:0/1958222136 shutdown_connections 2024-09-19T08:54:43.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.061+0000 7f9317b86740 1 -- 172.21.15.7:0/1958222136 wait complete. 2024-09-19T08:54:43.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.062+0000 7f9317b86740 1 -- start start 2024-09-19T08:54:43.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.062+0000 7f9317b86740 1 Processor -- start 2024-09-19T08:54:43.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.062+0000 7f9317b86740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c39dae95d0 0x55c39daf3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.062+0000 7f9317b86740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39daeab40 0x55c39daf10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.062+0000 7f9317b86740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c39daf4370 0x55c39daf1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.062+0000 7f9317b86740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c39da4f2f0 con 0x55c39daeab40 2024-09-19T08:54:43.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.062+0000 7f9317b86740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c39da0a060 con 0x55c39dae95d0 2024-09-19T08:54:43.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.062+0000 7f9317b86740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c39daf6e30 con 0x55c39daf4370 2024-09-19T08:54:43.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.062+0000 7f9317b86740 10 client.0 _ll_register_callbacks cb 0x55c39d75d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.062+0000 7f930e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39daeab40 0x55c39daf10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.062+0000 7f930effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c39dae95d0 0x55c39daf3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.062+0000 7f930e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39daeab40 0x55c39daf10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57528/0 (socket says 172.21.15.7:57528) 2024-09-19T08:54:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.062+0000 7f930e7fc640 1 -- 172.21.15.7:0/311733057 learned_addr learned my addr 172.21.15.7:0/311733057 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.063+0000 7f930f7fe640 1 --2- 172.21.15.7:0/311733057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c39daf4370 0x55c39daf1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.063+0000 7f930effd640 1 -- 172.21.15.7:0/311733057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c39daf4370 msgr2=0x55c39daf1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.063+0000 7f930effd640 1 --2- 172.21.15.7:0/311733057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c39daf4370 0x55c39daf1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.063+0000 7f930effd640 1 -- 172.21.15.7:0/311733057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39daeab40 msgr2=0x55c39daf10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.063+0000 7f930effd640 1 --2- 172.21.15.7:0/311733057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39daeab40 0x55c39daf10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.063+0000 7f930effd640 1 -- 172.21.15.7:0/311733057 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c39d7c03c0 con 0x55c39dae95d0 2024-09-19T08:54:43.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.063+0000 7f930e7fc640 1 --2- 172.21.15.7:0/311733057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39daeab40 0x55c39daf10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:43.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.063+0000 7f930effd640 1 --2- 172.21.15.7:0/311733057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c39dae95d0 0x55c39daf3e00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f93080bdea0 tx=0x7f93080f15b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6312df644bc66cc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:43.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.063+0000 7f92f67fc640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-19T08:54:43.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.063+0000 7f92f67fc640 1 -- 172.21.15.7:0/311733057 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93080bd130 con 0x55c39dae95d0 2024-09-19T08:54:43.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.063+0000 7f92f67fc640 1 -- 172.21.15.7:0/311733057 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f93080bd850 con 0x55c39dae95d0 2024-09-19T08:54:43.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.063+0000 7f9317b86740 1 -- 172.21.15.7:0/311733057 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93080bdcf0 con 0x55c39dae95d0 2024-09-19T08:54:43.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.063+0000 7f92f67fc640 1 -- 172.21.15.7:0/311733057 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f93080bcf50 con 0x55c39dae95d0 2024-09-19T08:54:43.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.063+0000 7f9317b86740 10 client.27245 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:43.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.063+0000 7f9317b86740 1 -- 172.21.15.7:0/311733057 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c39db02780 con 0x55c39dae95d0 2024-09-19T08:54:43.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.064+0000 7f92f67fc640 1 -- 172.21.15.7:0/311733057 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93080bdcf0 con 0x55c39dae95d0 2024-09-19T08:54:43.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.064+0000 7f92f67fc640 1 -- 172.21.15.7:0/311733057 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f93080c5dd0 con 0x55c39dae95d0 2024-09-19T08:54:43.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.064+0000 7f9317b86740 10 client.27245 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:43.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.064+0000 7f9317b86740 10 client.27245 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:54:43.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.064+0000 7f9317b86740 20 client.27245 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:43.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.064+0000 7f9317b86740 1 --2- 172.21.15.7:0/311733057 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c39db03ad0 0x55c39db05f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.064+0000 7f9317b86740 4 client.27245 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:43.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.064+0000 7f9317b86740 1 -- 172.21.15.7:0/311733057 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c39da5c860 con 0x55c39db03ad0 2024-09-19T08:54:43.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.064+0000 7f930e7fc640 1 --2- 172.21.15.7:0/311733057 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c39db03ad0 0x55c39db05f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.064+0000 7f930e7fc640 1 --2- 172.21.15.7:0/311733057 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c39db03ad0 0x55c39db05f40 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=292091878de31527 server_cookie=989e41ab195be485 in_seq=0 out_seq=0 2024-09-19T08:54:43.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.064+0000 7f92f67fc640 10 client.27245 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:54:43.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.065+0000 7f92f67fc640 1 -- 172.21.15.7:0/311733057 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c39da5c860 con 0x55c39db03ad0 2024-09-19T08:54:43.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.065+0000 7f92f67fc640 10 client.27245 handle_command_reply: tid=0 2024-09-19T08:54:43.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.065+0000 7f9317b86740 1 client.27245 shutdown 2024-09-19T08:54:43.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.065+0000 7f9317b86740 1 -- 172.21.15.7:0/311733057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c39dae95d0 msgr2=0x55c39daf3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:43.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.065+0000 7f9317b86740 1 --2- 172.21.15.7:0/311733057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c39dae95d0 0x55c39daf3e00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f93080bdea0 tx=0x7f93080f15b0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.065+0000 7f9317b86740 1 -- 172.21.15.7:0/311733057 shutdown_connections 2024-09-19T08:54:43.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.065+0000 7f9317b86740 1 --2- 172.21.15.7:0/311733057 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c39db03ad0 0x55c39db05f40 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.065+0000 7f9317b86740 1 --2- 172.21.15.7:0/311733057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c39daf4370 0x55c39daf1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.065+0000 7f92f67fc640 0 client.27245 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:54:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.065+0000 7f9317b86740 1 --2- 172.21.15.7:0/311733057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39daeab40 0x55c39daf10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.065+0000 7f9317b86740 1 --2- 172.21.15.7:0/311733057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c39dae95d0 0x55c39daf3e00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.065+0000 7f9317b86740 1 -- 172.21.15.7:0/311733057 >> 172.21.15.7:0/311733057 conn(0x55c39dab2310 msgr2=0x55c39daeb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.066+0000 7f9317b86740 1 -- 172.21.15.7:0/311733057 shutdown_connections 2024-09-19T08:54:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.066+0000 7f9317b86740 1 -- 172.21.15.7:0/311733057 wait complete. 2024-09-19T08:54:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.066+0000 7f9317b86740 20 client.27245 trim_cache size 0 max 16384 2024-09-19T08:54:43.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.078+0000 7f9317b86740 1 Processor -- start 2024-09-19T08:54:43.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.079+0000 7f9317b86740 1 -- start start 2024-09-19T08:54:43.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.079+0000 7f9317b86740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c39dae95d0 0x55c39daf0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.079+0000 7f9317b86740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39daeab40 0x55c39db0b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.079+0000 7f9317b86740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c39daf4370 0x55c39db0bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.079+0000 7f9317b86740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f93101b23f0 con 0x55c39daeab40 2024-09-19T08:54:43.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.079+0000 7f9317b86740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f93101afcc0 con 0x55c39dae95d0 2024-09-19T08:54:43.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.079+0000 7f9317b86740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93101adb30 con 0x55c39daf4370 2024-09-19T08:54:43.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.079+0000 7f930e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39daeab40 0x55c39db0b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.079+0000 7f930e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39daeab40 0x55c39db0b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57544/0 (socket says 172.21.15.7:57544) 2024-09-19T08:54:43.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.079+0000 7f930e7fc640 1 -- 172.21.15.7:0/371256467 learned_addr learned my addr 172.21.15.7:0/371256467 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:43.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.079+0000 7f930effd640 1 --2- 172.21.15.7:0/371256467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c39dae95d0 0x55c39daf0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.079+0000 7f930e7fc640 1 -- 172.21.15.7:0/371256467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c39daf4370 msgr2=0x55c39db0bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:43.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.079+0000 7f930f7fe640 1 --2- 172.21.15.7:0/371256467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c39daf4370 0x55c39db0bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.079+0000 7f930e7fc640 1 --2- 172.21.15.7:0/371256467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c39daf4370 0x55c39db0bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.079+0000 7f930e7fc640 1 -- 172.21.15.7:0/371256467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c39dae95d0 msgr2=0x55c39daf0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:43.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.079+0000 7f930e7fc640 1 --2- 172.21.15.7:0/371256467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c39dae95d0 0x55c39daf0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.079+0000 7f930e7fc640 1 -- 172.21.15.7:0/371256467 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c39dafff10 con 0x55c39daeab40 2024-09-19T08:54:43.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.079+0000 7f930effd640 1 --2- 172.21.15.7:0/371256467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c39dae95d0 0x55c39daf0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:43.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.080+0000 7f930e7fc640 1 --2- 172.21.15.7:0/371256467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39daeab40 0x55c39db0b770 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f92f8000c00 tx=0x7f92f800bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd944346ab4b972d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:43.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.080+0000 7f9304ff9640 1 -- 172.21.15.7:0/371256467 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8022020 con 0x55c39daeab40 2024-09-19T08:54:43.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.080+0000 7f9304ff9640 1 -- 172.21.15.7:0/371256467 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92f8003d60 con 0x55c39daeab40 2024-09-19T08:54:43.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.080+0000 7f9304ff9640 1 -- 172.21.15.7:0/371256467 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8011840 con 0x55c39daeab40 2024-09-19T08:54:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.080+0000 7f9317b86740 1 -- 172.21.15.7:0/371256467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39daeab40 msgr2=0x55c39db0b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.080+0000 7f9317b86740 1 --2- 172.21.15.7:0/371256467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39daeab40 0x55c39db0b770 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f92f8000c00 tx=0x7f92f800bde0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.081+0000 7f9317b86740 1 -- 172.21.15.7:0/371256467 shutdown_connections 2024-09-19T08:54:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.081+0000 7f9317b86740 1 --2- 172.21.15.7:0/371256467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c39daf4370 0x55c39db0bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.081+0000 7f9317b86740 1 --2- 172.21.15.7:0/371256467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39daeab40 0x55c39db0b770 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.081+0000 7f9317b86740 1 --2- 172.21.15.7:0/371256467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c39dae95d0 0x55c39daf0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.081+0000 7f9317b86740 1 -- 172.21.15.7:0/371256467 >> 172.21.15.7:0/371256467 conn(0x55c39dab2310 msgr2=0x55c39daef980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.081+0000 7f9317b86740 1 -- 172.21.15.7:0/371256467 shutdown_connections 2024-09-19T08:54:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.081+0000 7f9317b86740 1 -- 172.21.15.7:0/371256467 wait complete. 2024-09-19T08:54:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.081+0000 7f9317b86740 1 -- start start 2024-09-19T08:54:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.081+0000 7f9317b86740 1 Processor -- start 2024-09-19T08:54:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.081+0000 7f9317b86740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c39dae95d0 0x55c39dafc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.081+0000 7f9317b86740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c39daeab40 0x55c39daf7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.081+0000 7f9317b86740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39daf4370 0x55c39daf7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.081+0000 7f9317b86740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f93101ae180 con 0x55c39daf4370 2024-09-19T08:54:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.081+0000 7f9317b86740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f93101af5f0 con 0x55c39daeab40 2024-09-19T08:54:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.081+0000 7f9317b86740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93101ae850 con 0x55c39dae95d0 2024-09-19T08:54:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.081+0000 7f9317b86740 10 client.0 _ll_register_callbacks cb 0x7f93080f9190 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.082+0000 7f930f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39daf4370 0x55c39daf7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.082+0000 7f930f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39daf4370 0x55c39daf7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57546/0 (socket says 172.21.15.7:57546) 2024-09-19T08:54:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.082+0000 7f930f7fe640 1 -- 172.21.15.7:0/3310680049 learned_addr learned my addr 172.21.15.7:0/3310680049 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.082+0000 7f930e7fc640 1 --2- 172.21.15.7:0/3310680049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c39daeab40 0x55c39daf7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.082+0000 7f930effd640 1 --2- 172.21.15.7:0/3310680049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c39dae95d0 0x55c39dafc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.082+0000 7f930f7fe640 1 -- 172.21.15.7:0/3310680049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c39dae95d0 msgr2=0x55c39dafc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:43.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.082+0000 7f930f7fe640 1 --2- 172.21.15.7:0/3310680049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c39dae95d0 0x55c39dafc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.082+0000 7f930f7fe640 1 -- 172.21.15.7:0/3310680049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c39daeab40 msgr2=0x55c39daf7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:43.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.082+0000 7f930f7fe640 1 --2- 172.21.15.7:0/3310680049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c39daeab40 0x55c39daf7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.082+0000 7f930f7fe640 1 -- 172.21.15.7:0/3310680049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c39daf8670 con 0x55c39daf4370 2024-09-19T08:54:43.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.082+0000 7f930f7fe640 1 --2- 172.21.15.7:0/3310680049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39daf4370 0x55c39daf7f80 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f9300005e00 tx=0x7f9300004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27ea02404900e66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:43.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.082+0000 7f92f67fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:43.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.082+0000 7f92f67fc640 1 -- 172.21.15.7:0/3310680049 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300021910 con 0x55c39daf4370 2024-09-19T08:54:43.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.082+0000 7f92f67fc640 1 -- 172.21.15.7:0/3310680049 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f9300021ab0 con 0x55c39daf4370 2024-09-19T08:54:43.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.082+0000 7f9317b86740 1 -- 172.21.15.7:0/3310680049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92f8003d60 con 0x55c39daf4370 2024-09-19T08:54:43.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.082+0000 7f92f67fc640 1 -- 172.21.15.7:0/3310680049 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9300021cb0 con 0x55c39daf4370 2024-09-19T08:54:43.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.082+0000 7f9317b86740 10 client.17745 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:43.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.082+0000 7f9317b86740 1 -- 172.21.15.7:0/3310680049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c39db6e680 con 0x55c39daf4370 2024-09-19T08:54:43.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.083+0000 7f92f67fc640 1 -- 172.21.15.7:0/3310680049 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92f8003d60 con 0x55c39daf4370 2024-09-19T08:54:43.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.083+0000 7f92f67fc640 1 -- 172.21.15.7:0/3310680049 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f930000f040 con 0x55c39daf4370 2024-09-19T08:54:43.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.083+0000 7f9317b86740 10 client.17745 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:43.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.083+0000 7f9317b86740 10 client.17745 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T08:54:43.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.083+0000 7f9317b86740 20 client.17745 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:43.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.083+0000 7f9317b86740 1 --2- 172.21.15.7:0/3310680049 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c39db6eda0 0x55c39db71190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.083+0000 7f9317b86740 4 client.17745 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:54:43.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.083+0000 7f9317b86740 1 -- 172.21.15.7:0/3310680049 --> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c39da56d70 con 0x55c39db6eda0 2024-09-19T08:54:43.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.083+0000 7f930effd640 1 --2- 172.21.15.7:0/3310680049 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c39db6eda0 0x55c39db71190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.084+0000 7f930effd640 1 --2- 172.21.15.7:0/3310680049 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c39db6eda0 0x55c39db71190 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7f86b7c84cfe8483 server_cookie=c9561c81437d9f4c in_seq=0 out_seq=0 2024-09-19T08:54:43.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.084+0000 7f92f67fc640 10 client.17745 ms_handle_connect on v2:172.21.15.44:6836/1232834466 2024-09-19T08:54:43.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.084+0000 7f92f67fc640 1 -- 172.21.15.7:0/3310680049 <== mds.2 v2:172.21.15.44:6836/1232834466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c39da56d70 con 0x55c39db6eda0 2024-09-19T08:54:43.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.084+0000 7f92f67fc640 10 client.17745 handle_command_reply: tid=0 2024-09-19T08:54:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.084+0000 7f9317b86740 1 client.17745 shutdown 2024-09-19T08:54:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.084+0000 7f9317b86740 1 -- 172.21.15.7:0/3310680049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39daf4370 msgr2=0x55c39daf7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.084+0000 7f9317b86740 1 --2- 172.21.15.7:0/3310680049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39daf4370 0x55c39daf7f80 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f9300005e00 tx=0x7f9300004730 comp rx=0 tx=0).stop 2024-09-19T08:54:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.084+0000 7f9317b86740 1 -- 172.21.15.7:0/3310680049 shutdown_connections 2024-09-19T08:54:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.084+0000 7f9317b86740 1 --2- 172.21.15.7:0/3310680049 >> [v2:172.21.15.44:6836/1232834466,v1:172.21.15.44:6837/1232834466] conn(0x55c39db6eda0 0x55c39db71190 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.084+0000 7f9317b86740 1 --2- 172.21.15.7:0/3310680049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c39daf4370 0x55c39daf7f80 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.084+0000 7f9317b86740 1 --2- 172.21.15.7:0/3310680049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c39daeab40 0x55c39daf7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.084+0000 7f92f67fc640 0 client.17745 ms_handle_reset on v2:172.21.15.44:6836/1232834466 2024-09-19T08:54:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.084+0000 7f9317b86740 1 --2- 172.21.15.7:0/3310680049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c39dae95d0 0x55c39dafc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.084+0000 7f9317b86740 1 -- 172.21.15.7:0/3310680049 >> 172.21.15.7:0/3310680049 conn(0x55c39dab2310 msgr2=0x55c39dafef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.084+0000 7f9317b86740 1 -- 172.21.15.7:0/3310680049 shutdown_connections 2024-09-19T08:54:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.084+0000 7f9317b86740 1 -- 172.21.15.7:0/3310680049 wait complete. 2024-09-19T08:54:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.084+0000 7f9317b86740 20 client.17745 trim_cache size 0 max 16384 2024-09-19T08:54:43.090 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:54:43.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.085+0000 7f93157ad640 1 -- 172.21.15.7:0/2644853929 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f92fc0a33b0 msgr2=0x7f92fc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:43.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.085+0000 7f93157ad640 1 --2- 172.21.15.7:0/2644853929 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f92fc0a33b0 0x7f92fc0a5870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f930000cb20 tx=0x7f930000c500 comp rx=0 tx=0).stop 2024-09-19T08:54:43.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.085+0000 7f93157ad640 1 -- 172.21.15.7:0/2644853929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9310101de0 msgr2=0x7f93100744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:43.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.085+0000 7f93157ad640 1 --2- 172.21.15.7:0/2644853929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9310101de0 0x7f93100744f0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f9308005e30 tx=0x7f9308003f90 comp rx=0 tx=0).stop 2024-09-19T08:54:43.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.085+0000 7f93157ad640 1 -- 172.21.15.7:0/2644853929 shutdown_connections 2024-09-19T08:54:43.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.085+0000 7f93157ad640 1 --2- 172.21.15.7:0/2644853929 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f92fc0a33b0 0x7f92fc0a5870 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.085+0000 7f93157ad640 1 --2- 172.21.15.7:0/2644853929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9310106f10 0x7f9310074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.085+0000 7f93157ad640 1 --2- 172.21.15.7:0/2644853929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9310102790 0x7f9310074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.085+0000 7f93157ad640 1 --2- 172.21.15.7:0/2644853929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9310101de0 0x7f93100744f0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.085+0000 7f93157ad640 1 -- 172.21.15.7:0/2644853929 >> 172.21.15.7:0/2644853929 conn(0x7f93100fd8c0 msgr2=0x7f93100fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:43.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.085+0000 7f93157ad640 1 -- 172.21.15.7:0/2644853929 shutdown_connections 2024-09-19T08:54:43.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.085+0000 7f93157ad640 1 -- 172.21.15.7:0/2644853929 wait complete. 2024-09-19T08:54:43.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:43 smithi007 ceph-mon[31221]: pgmap v316: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:54:43.325 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T08:54:43.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:43 smithi175 ceph-mon[35688]: pgmap v316: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:54:43.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.432+0000 7f1f1e8a5640 1 -- 172.21.15.7:0/1110876817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f18101250 msgr2=0x7f1f18107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:43.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.432+0000 7f1f1e8a5640 1 --2- 172.21.15.7:0/1110876817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f18101250 0x7f1f18107990 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c009900 tx=0x7f1f0c02a410 comp rx=0 tx=0).stop 2024-09-19T08:54:43.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.432+0000 7f1f1e8a5640 1 -- 172.21.15.7:0/1110876817 shutdown_connections 2024-09-19T08:54:43.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.432+0000 7f1f1e8a5640 1 --2- 172.21.15.7:0/1110876817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f181080f0 0x7f1f1810e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.432+0000 7f1f1e8a5640 1 --2- 172.21.15.7:0/1110876817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f18101250 0x7f1f18107990 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.432+0000 7f1f1e8a5640 1 --2- 172.21.15.7:0/1110876817 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f181008a0 0x7f1f18100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.432+0000 7f1f1e8a5640 1 -- 172.21.15.7:0/1110876817 >> 172.21.15.7:0/1110876817 conn(0x7f1f18075e20 msgr2=0x7f1f18076230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:43.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.432+0000 7f1f1e8a5640 1 -- 172.21.15.7:0/1110876817 shutdown_connections 2024-09-19T08:54:43.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.432+0000 7f1f1e8a5640 1 -- 172.21.15.7:0/1110876817 wait complete. 2024-09-19T08:54:43.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.433+0000 7f1f1e8a5640 1 Processor -- start 2024-09-19T08:54:43.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.433+0000 7f1f1e8a5640 1 -- start start 2024-09-19T08:54:43.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.433+0000 7f1f1e8a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f181008a0 0x7f1f18198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.433+0000 7f1f1e8a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f181080f0 0x7f1f181989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.433+0000 7f1f1e8a5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f1819cd50 0x7f1f1819d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.433+0000 7f1f1e8a5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1f18111f00 con 0x7f1f181080f0 2024-09-19T08:54:43.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.433+0000 7f1f1e8a5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1f18111d80 con 0x7f1f181008a0 2024-09-19T08:54:43.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.433+0000 7f1f1e8a5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1f18112080 con 0x7f1f1819cd50 2024-09-19T08:54:43.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.433+0000 7f1f177fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f181080f0 0x7f1f181989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.433+0000 7f1f177fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f181080f0 0x7f1f181989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38444/0 (socket says 172.21.15.7:38444) 2024-09-19T08:54:43.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.433+0000 7f1f177fe640 1 -- 172.21.15.7:0/4212207572 learned_addr learned my addr 172.21.15.7:0/4212207572 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:43.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.434+0000 7f1f1ce42640 1 --2- 172.21.15.7:0/4212207572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f1819cd50 0x7f1f1819d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.434+0000 7f1f17fff640 1 --2- 172.21.15.7:0/4212207572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f181008a0 0x7f1f18198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.434+0000 7f1f177fe640 1 -- 172.21.15.7:0/4212207572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f1819cd50 msgr2=0x7f1f1819d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:43.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.434+0000 7f1f177fe640 1 --2- 172.21.15.7:0/4212207572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f1819cd50 0x7f1f1819d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.434+0000 7f1f177fe640 1 -- 172.21.15.7:0/4212207572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f181008a0 msgr2=0x7f1f18198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:43.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.434+0000 7f1f177fe640 1 --2- 172.21.15.7:0/4212207572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f181008a0 0x7f1f18198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.434+0000 7f1f177fe640 1 -- 172.21.15.7:0/4212207572 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1819d840 con 0x7f1f181080f0 2024-09-19T08:54:43.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.434+0000 7f1f177fe640 1 --2- 172.21.15.7:0/4212207572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f181080f0 0x7f1f181989d0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c005940 tx=0x7f1f0c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:43.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.434+0000 7f1f157fa640 1 -- 172.21.15.7:0/4212207572 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c03f030 con 0x7f1f181080f0 2024-09-19T08:54:43.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.434+0000 7f1f157fa640 1 -- 172.21.15.7:0/4212207572 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f0c003ad0 con 0x7f1f181080f0 2024-09-19T08:54:43.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.434+0000 7f1f1e8a5640 1 -- 172.21.15.7:0/4212207572 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1819dad0 con 0x7f1f181080f0 2024-09-19T08:54:43.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.434+0000 7f1f157fa640 1 -- 172.21.15.7:0/4212207572 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c035070 con 0x7f1f181080f0 2024-09-19T08:54:43.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.434+0000 7f1f1e8a5640 1 -- 172.21.15.7:0/4212207572 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f181a5290 con 0x7f1f181080f0 2024-09-19T08:54:43.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.435+0000 7f1f1e8a5640 1 -- 172.21.15.7:0/4212207572 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f18100c80 con 0x7f1f181080f0 2024-09-19T08:54:43.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.436+0000 7f1f157fa640 1 -- 172.21.15.7:0/4212207572 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f1f0c042030 con 0x7f1f181080f0 2024-09-19T08:54:43.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.437+0000 7f1f157fa640 1 --2- 172.21.15.7:0/4212207572 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1f000a33b0 0x7f1f000a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.437+0000 7f1f157fa640 1 -- 172.21.15.7:0/4212207572 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f1f0c0f0490 con 0x7f1f181080f0 2024-09-19T08:54:43.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.437+0000 7f1f17fff640 1 --2- 172.21.15.7:0/4212207572 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1f000a33b0 0x7f1f000a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.438+0000 7f1f17fff640 1 --2- 172.21.15.7:0/4212207572 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1f000a33b0 0x7f1f000a5870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1f08005fd0 tx=0x7f1f08005850 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:43.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.441+0000 7f1f157fa640 1 -- 172.21.15.7:0/4212207572 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1f0c0bce30 con 0x7f1f181080f0 2024-09-19T08:54:43.553 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:43 smithi044 ceph-mon[35072]: pgmap v316: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:54:43.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.639+0000 7f1f1e8a5640 1 -- 172.21.15.7:0/4212207572 --> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f1f18101250 con 0x7f1f000a33b0 2024-09-19T08:54:43.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.646+0000 7f1f157fa640 1 -- 172.21.15.7:0/4212207572 <== mgr.15132 v2:172.21.15.7:6800/3061932294 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f1f18101250 con 0x7f1f000a33b0 2024-09-19T08:54:43.645 INFO:teuthology.orchestra.run.smithi007.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T08:44:41", "first": "2024-09-19T08:45:00", "last": "2024-09-19T08:54:00", "last_pruned": "2024-09-19T08:54:01", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-19T08:54:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.648+0000 7f1f1e8a5640 1 -- 172.21.15.7:0/4212207572 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1f000a33b0 msgr2=0x7f1f000a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.648+0000 7f1f1e8a5640 1 --2- 172.21.15.7:0/4212207572 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1f000a33b0 0x7f1f000a5870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1f08005fd0 tx=0x7f1f08005850 comp rx=0 tx=0).stop 2024-09-19T08:54:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.648+0000 7f1f1e8a5640 1 -- 172.21.15.7:0/4212207572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f181080f0 msgr2=0x7f1f181989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.648+0000 7f1f1e8a5640 1 --2- 172.21.15.7:0/4212207572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f181080f0 0x7f1f181989d0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c005940 tx=0x7f1f0c004270 comp rx=0 tx=0).stop 2024-09-19T08:54:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.648+0000 7f1f1e8a5640 1 -- 172.21.15.7:0/4212207572 shutdown_connections 2024-09-19T08:54:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.648+0000 7f1f1e8a5640 1 --2- 172.21.15.7:0/4212207572 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f1f000a33b0 0x7f1f000a5870 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.648+0000 7f1f1e8a5640 1 --2- 172.21.15.7:0/4212207572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f1819cd50 0x7f1f1819d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.648+0000 7f1f1e8a5640 1 --2- 172.21.15.7:0/4212207572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f181080f0 0x7f1f181989d0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.648+0000 7f1f1e8a5640 1 --2- 172.21.15.7:0/4212207572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f181008a0 0x7f1f18198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.648+0000 7f1f1e8a5640 1 -- 172.21.15.7:0/4212207572 >> 172.21.15.7:0/4212207572 conn(0x7f1f18075e20 msgr2=0x7f1f18105ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.648+0000 7f1f1e8a5640 1 -- 172.21.15.7:0/4212207572 shutdown_connections 2024-09-19T08:54:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.648+0000 7f1f1e8a5640 1 -- 172.21.15.7:0/4212207572 wait complete. 2024-09-19T08:54:43.659 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T08:54:43.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.765+0000 7fb69b4ba640 1 -- 172.21.15.7:0/227529893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb694101370 msgr2=0x7fb69410d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:43.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.765+0000 7fb69b4ba640 1 --2- 172.21.15.7:0/227529893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb694101370 0x7fb69410d8a0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fb68c009cd0 tx=0x7fb68c02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.765+0000 7fb69b4ba640 1 -- 172.21.15.7:0/227529893 shutdown_connections 2024-09-19T08:54:43.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.765+0000 7fb69b4ba640 1 --2- 172.21.15.7:0/227529893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb694101370 0x7fb69410d8a0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.765+0000 7fb69b4ba640 1 --2- 172.21.15.7:0/227529893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6941009d0 0x7fb694100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.765+0000 7fb69b4ba640 1 --2- 172.21.15.7:0/227529893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6941069e0 0x7fb694106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.765+0000 7fb69b4ba640 1 -- 172.21.15.7:0/227529893 >> 172.21.15.7:0/227529893 conn(0x7fb6940fc6b0 msgr2=0x7fb6940fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:43.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.765+0000 7fb69b4ba640 1 -- 172.21.15.7:0/227529893 shutdown_connections 2024-09-19T08:54:43.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.765+0000 7fb69b4ba640 1 -- 172.21.15.7:0/227529893 wait complete. 2024-09-19T08:54:43.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.766+0000 7fb69b4ba640 1 Processor -- start 2024-09-19T08:54:43.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.766+0000 7fb69b4ba640 1 -- start start 2024-09-19T08:54:43.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.766+0000 7fb69b4ba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6941009d0 0x7fb6941025a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.766+0000 7fb69b4ba640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb694101370 0x7fb694102ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.766+0000 7fb69b4ba640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6941069e0 0x7fb694103020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.766+0000 7fb69b4ba640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb694110e20 con 0x7fb6941069e0 2024-09-19T08:54:43.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.766+0000 7fb69b4ba640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb694110ca0 con 0x7fb6941009d0 2024-09-19T08:54:43.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.766+0000 7fb69b4ba640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb694110fa0 con 0x7fb694101370 2024-09-19T08:54:43.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.766+0000 7fb699a57640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6941069e0 0x7fb694103020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.766+0000 7fb699a57640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6941069e0 0x7fb694103020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38464/0 (socket says 172.21.15.7:38464) 2024-09-19T08:54:43.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.766+0000 7fb699a57640 1 -- 172.21.15.7:0/2762517058 learned_addr learned my addr 172.21.15.7:0/2762517058 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:43.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.766+0000 7fb698a55640 1 --2- 172.21.15.7:0/2762517058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb694101370 0x7fb694102ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.766+0000 7fb699256640 1 --2- 172.21.15.7:0/2762517058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6941009d0 0x7fb6941025a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.766+0000 7fb699a57640 1 -- 172.21.15.7:0/2762517058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb694101370 msgr2=0x7fb694102ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:43.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.766+0000 7fb699a57640 1 --2- 172.21.15.7:0/2762517058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb694101370 0x7fb694102ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.766+0000 7fb699a57640 1 -- 172.21.15.7:0/2762517058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6941009d0 msgr2=0x7fb6941025a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:43.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.766+0000 7fb699a57640 1 --2- 172.21.15.7:0/2762517058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6941009d0 0x7fb6941025a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.766+0000 7fb699a57640 1 -- 172.21.15.7:0/2762517058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6941a68d0 con 0x7fb6941069e0 2024-09-19T08:54:43.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.766+0000 7fb699256640 1 --2- 172.21.15.7:0/2762517058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6941009d0 0x7fb6941025a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:43.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.767+0000 7fb699a57640 1 --2- 172.21.15.7:0/2762517058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6941069e0 0x7fb694103020 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fb68c005cc0 tx=0x7fb68c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:43.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.767+0000 7fb68a7fc640 1 -- 172.21.15.7:0/2762517058 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c004040 con 0x7fb6941069e0 2024-09-19T08:54:43.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.767+0000 7fb68a7fc640 1 -- 172.21.15.7:0/2762517058 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb68c0046c0 con 0x7fb6941069e0 2024-09-19T08:54:43.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.767+0000 7fb69b4ba640 1 -- 172.21.15.7:0/2762517058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6941a6b60 con 0x7fb6941069e0 2024-09-19T08:54:43.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.767+0000 7fb68a7fc640 1 -- 172.21.15.7:0/2762517058 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c046480 con 0x7fb6941069e0 2024-09-19T08:54:43.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.767+0000 7fb69b4ba640 1 -- 172.21.15.7:0/2762517058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6941a70b0 con 0x7fb6941069e0 2024-09-19T08:54:43.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.768+0000 7fb69b4ba640 1 -- 172.21.15.7:0/2762517058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb694100e30 con 0x7fb6941069e0 2024-09-19T08:54:43.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.769+0000 7fb68a7fc640 1 -- 172.21.15.7:0/2762517058 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fb68c0305a0 con 0x7fb6941069e0 2024-09-19T08:54:43.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.770+0000 7fb68a7fc640 1 --2- 172.21.15.7:0/2762517058 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb6800a33b0 0x7fb6800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:43.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.770+0000 7fb699256640 1 --2- 172.21.15.7:0/2762517058 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb6800a33b0 0x7fb6800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:43.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.770+0000 7fb68a7fc640 1 -- 172.21.15.7:0/2762517058 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7fb68c02e030 con 0x7fb6941069e0 2024-09-19T08:54:43.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.770+0000 7fb699256640 1 --2- 172.21.15.7:0/2762517058 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb6800a33b0 0x7fb6800a5870 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb6900058c0 tx=0x7fb690005cb0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:43.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.773+0000 7fb68a7fc640 1 -- 172.21.15.7:0/2762517058 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb68c04b060 con 0x7fb6941069e0 2024-09-19T08:54:43.885 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:54:43.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.971+0000 7fb69b4ba640 1 -- 172.21.15.7:0/2762517058 --> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fb69406a320 con 0x7fb6800a33b0 2024-09-19T08:54:43.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.978+0000 7fb68a7fc640 1 -- 172.21.15.7:0/2762517058 <== mgr.15132 v2:172.21.15.7:6800/3061932294 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fb69406a320 con 0x7fb6800a33b0 2024-09-19T08:54:43.978 INFO:teuthology.orchestra.run.smithi007.stdout:/ 1m 6m3h 2024-09-19T08:54:43.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.980+0000 7fb69b4ba640 1 -- 172.21.15.7:0/2762517058 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb6800a33b0 msgr2=0x7fb6800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:43.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.980+0000 7fb69b4ba640 1 --2- 172.21.15.7:0/2762517058 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb6800a33b0 0x7fb6800a5870 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb6900058c0 tx=0x7fb690005cb0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.980+0000 7fb69b4ba640 1 -- 172.21.15.7:0/2762517058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6941069e0 msgr2=0x7fb694103020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:43.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.980+0000 7fb69b4ba640 1 --2- 172.21.15.7:0/2762517058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6941069e0 0x7fb694103020 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fb68c005cc0 tx=0x7fb68c003970 comp rx=0 tx=0).stop 2024-09-19T08:54:43.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.980+0000 7fb69b4ba640 1 -- 172.21.15.7:0/2762517058 shutdown_connections 2024-09-19T08:54:43.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.980+0000 7fb69b4ba640 1 --2- 172.21.15.7:0/2762517058 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb6800a33b0 0x7fb6800a5870 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.980+0000 7fb69b4ba640 1 --2- 172.21.15.7:0/2762517058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6941069e0 0x7fb694103020 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.980+0000 7fb69b4ba640 1 --2- 172.21.15.7:0/2762517058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb694101370 0x7fb694102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.980+0000 7fb69b4ba640 1 --2- 172.21.15.7:0/2762517058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6941009d0 0x7fb6941025a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:43.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.980+0000 7fb69b4ba640 1 -- 172.21.15.7:0/2762517058 >> 172.21.15.7:0/2762517058 conn(0x7fb6940fc6b0 msgr2=0x7fb694104780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:43.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.980+0000 7fb69b4ba640 1 -- 172.21.15.7:0/2762517058 shutdown_connections 2024-09-19T08:54:43.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:43.981+0000 7fb69b4ba640 1 -- 172.21.15.7:0/2762517058 wait complete. 2024-09-19T08:54:43.991 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-19T08:54:44.003 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-19T08:54:44.142 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:44.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.596+0000 7f035e821640 1 -- 172.21.15.7:0/384284996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0358100a80 msgr2=0x7f0358100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:44.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.597+0000 7f035e821640 1 --2- 172.21.15.7:0/384284996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0358100a80 0x7f0358100ee0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f034c009930 tx=0x7f034c02a420 comp rx=0 tx=0).stop 2024-09-19T08:54:44.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.597+0000 7f035e821640 1 -- 172.21.15.7:0/384284996 shutdown_connections 2024-09-19T08:54:44.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.597+0000 7f035e821640 1 --2- 172.21.15.7:0/384284996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0358101420 0x7f035810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.597+0000 7f035e821640 1 --2- 172.21.15.7:0/384284996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0358100a80 0x7f0358100ee0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.597+0000 7f035e821640 1 --2- 172.21.15.7:0/384284996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0358106a80 0x7f0358106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.597+0000 7f035e821640 1 -- 172.21.15.7:0/384284996 >> 172.21.15.7:0/384284996 conn(0x7f03580fc7a0 msgr2=0x7f03580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:44.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.597+0000 7f035e821640 1 -- 172.21.15.7:0/384284996 shutdown_connections 2024-09-19T08:54:44.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.597+0000 7f035e821640 1 -- 172.21.15.7:0/384284996 wait complete. 2024-09-19T08:54:44.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.597+0000 7f035e821640 1 Processor -- start 2024-09-19T08:54:44.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.597+0000 7f035e821640 1 -- start start 2024-09-19T08:54:44.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.598+0000 7f035e821640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0358100a80 0x7f03580fcda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:44.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.598+0000 7f035e821640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0358101420 0x7f03580fd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:44.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.598+0000 7f035e821640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0358106a80 0x7f03580fd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.598+0000 7f035e821640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0358110e80 con 0x7f0358100a80 2024-09-19T08:54:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.598+0000 7f035e821640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0358110d00 con 0x7f0358106a80 2024-09-19T08:54:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.598+0000 7f035e821640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0358111000 con 0x7f0358101420 2024-09-19T08:54:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.598+0000 7f0357fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0358100a80 0x7f03580fcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.598+0000 7f0357fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0358100a80 0x7f03580fcda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38486/0 (socket says 172.21.15.7:38486) 2024-09-19T08:54:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.598+0000 7f0357fff640 1 -- 172.21.15.7:0/3615643332 learned_addr learned my addr 172.21.15.7:0/3615643332 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.598+0000 7f035cdbe640 1 --2- 172.21.15.7:0/3615643332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0358106a80 0x7f03580fd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.598+0000 7f03577fe640 1 --2- 172.21.15.7:0/3615643332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0358101420 0x7f03580fd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.598+0000 7f0357fff640 1 -- 172.21.15.7:0/3615643332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0358101420 msgr2=0x7f03580fd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.598+0000 7f0357fff640 1 --2- 172.21.15.7:0/3615643332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0358101420 0x7f03580fd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.598+0000 7f0357fff640 1 -- 172.21.15.7:0/3615643332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0358106a80 msgr2=0x7f03580fd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.598+0000 7f0357fff640 1 --2- 172.21.15.7:0/3615643332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0358106a80 0x7f03580fd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.598+0000 7f0357fff640 1 -- 172.21.15.7:0/3615643332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03581a68f0 con 0x7f0358100a80 2024-09-19T08:54:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.598+0000 7f0357fff640 1 --2- 172.21.15.7:0/3615643332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0358100a80 0x7f03580fcda0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f034800d950 tx=0x7f034800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.598+0000 7f03557fa640 1 -- 172.21.15.7:0/3615643332 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0348017030 con 0x7f0358100a80 2024-09-19T08:54:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.598+0000 7f035e821640 1 -- 172.21.15.7:0/3615643332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03581a6be0 con 0x7f0358100a80 2024-09-19T08:54:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.598+0000 7f03557fa640 1 -- 172.21.15.7:0/3615643332 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0348004020 con 0x7f0358100a80 2024-09-19T08:54:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.598+0000 7f03557fa640 1 -- 172.21.15.7:0/3615643332 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03480047a0 con 0x7f0358100a80 2024-09-19T08:54:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.599+0000 7f035e821640 1 -- 172.21.15.7:0/3615643332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03581a7120 con 0x7f0358100a80 2024-09-19T08:54:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.601+0000 7f03557fa640 1 -- 172.21.15.7:0/3615643332 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f03480041d0 con 0x7f0358100a80 2024-09-19T08:54:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.601+0000 7f0360bfa740 1 Processor -- start 2024-09-19T08:54:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.601+0000 7f0360bfa740 1 -- start start 2024-09-19T08:54:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.601+0000 7f0360bfa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d41bb40 0x55603d41a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.601+0000 7f0360bfa740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55603d41a5d0 0x55603d41aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.601+0000 7f0360bfa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55603d425370 0x55603d427760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.601+0000 7f0360bfa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55603d3802f0 con 0x55603d41bb40 2024-09-19T08:54:44.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.601+0000 7f0360bfa740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55603d327cf0 con 0x55603d41a5d0 2024-09-19T08:54:44.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.601+0000 7f0360bfa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55603d37c2b0 con 0x55603d425370 2024-09-19T08:54:44.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.602+0000 7f035cdbe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d41bb40 0x55603d41a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:44.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.602+0000 7f035cdbe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d41bb40 0x55603d41a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38496/0 (socket says 172.21.15.7:38496) 2024-09-19T08:54:44.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.602+0000 7f035cdbe640 1 -- 172.21.15.7:0/1384468321 learned_addr learned my addr 172.21.15.7:0/1384468321 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:44.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.602+0000 7f0357fff640 1 --2- 172.21.15.7:0/1384468321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55603d41a5d0 0x55603d41aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:44.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.602+0000 7f03557fa640 1 --2- 172.21.15.7:0/3615643332 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f03400a33b0 0x7f03400a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:44.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.602+0000 7f03577fe640 1 --2- 172.21.15.7:0/1384468321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55603d425370 0x55603d427760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:44.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.602+0000 7f035cdbe640 1 -- 172.21.15.7:0/1384468321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55603d425370 msgr2=0x55603d427760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:44.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.602+0000 7f035cdbe640 1 --2- 172.21.15.7:0/1384468321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55603d425370 0x55603d427760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.602+0000 7f035cdbe640 1 -- 172.21.15.7:0/1384468321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55603d41a5d0 msgr2=0x55603d41aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:44.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.602+0000 7f035cdbe640 1 --2- 172.21.15.7:0/1384468321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55603d41a5d0 0x55603d41aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.602+0000 7f035cdbe640 1 -- 172.21.15.7:0/1384468321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55603d30c3a0 con 0x55603d41bb40 2024-09-19T08:54:44.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.602+0000 7f035cdbe640 1 --2- 172.21.15.7:0/3615643332 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f03400a33b0 0x7f03400a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:44.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.602+0000 7f03557fa640 1 -- 172.21.15.7:0/3615643332 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f03480cf6f0 con 0x7f0358100a80 2024-09-19T08:54:44.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.602+0000 7f035cdbe640 1 --2- 172.21.15.7:0/1384468321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d41bb40 0x55603d41a090 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f0350010510 tx=0x7f0350009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89fc9dc4a7c38162 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:44.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.602+0000 7f033e7fc640 1 -- 172.21.15.7:0/1384468321 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0350023070 con 0x55603d41bb40 2024-09-19T08:54:44.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.602+0000 7f033e7fc640 1 -- 172.21.15.7:0/1384468321 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03500134c0 con 0x55603d41bb40 2024-09-19T08:54:44.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.602+0000 7f033e7fc640 1 -- 172.21.15.7:0/1384468321 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0350011940 con 0x55603d41bb40 2024-09-19T08:54:44.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.603+0000 7f0360bfa740 1 -- 172.21.15.7:0/1384468321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d41bb40 msgr2=0x55603d41a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:44.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.603+0000 7f035cdbe640 1 --2- 172.21.15.7:0/3615643332 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f03400a33b0 0x7f03400a5870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0350020000 tx=0x7f035001b000 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:44.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.603+0000 7f0360bfa740 1 --2- 172.21.15.7:0/1384468321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d41bb40 0x55603d41a090 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f0350010510 tx=0x7f0350009f90 comp rx=0 tx=0).stop 2024-09-19T08:54:44.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.603+0000 7f0360bfa740 1 -- 172.21.15.7:0/1384468321 shutdown_connections 2024-09-19T08:54:44.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.603+0000 7f0360bfa740 1 --2- 172.21.15.7:0/1384468321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55603d425370 0x55603d427760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.603+0000 7f0360bfa740 1 --2- 172.21.15.7:0/1384468321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55603d41a5d0 0x55603d41aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.603+0000 7f0360bfa740 1 --2- 172.21.15.7:0/1384468321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d41bb40 0x55603d41a090 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.603+0000 7f0360bfa740 1 -- 172.21.15.7:0/1384468321 >> 172.21.15.7:0/1384468321 conn(0x55603d3e3310 msgr2=0x55603d416c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:44.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.603+0000 7f0360bfa740 1 -- 172.21.15.7:0/1384468321 shutdown_connections 2024-09-19T08:54:44.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.603+0000 7f0360bfa740 1 -- 172.21.15.7:0/1384468321 wait complete. 2024-09-19T08:54:44.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.603+0000 7f0360bfa740 1 -- start start 2024-09-19T08:54:44.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.604+0000 7f0360bfa740 1 Processor -- start 2024-09-19T08:54:44.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.604+0000 7f0360bfa740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55603d41a5d0 0x55603d424d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:44.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.604+0000 7f0360bfa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d41bb40 0x55603d421fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:44.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.604+0000 7f0360bfa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55603d425370 0x55603d422530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:44.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.604+0000 7f0360bfa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55603d428070 con 0x55603d41bb40 2024-09-19T08:54:44.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.604+0000 7f0360bfa740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55603d33b060 con 0x55603d41a5d0 2024-09-19T08:54:44.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.604+0000 7f0360bfa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55603d4281f0 con 0x55603d425370 2024-09-19T08:54:44.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.604+0000 7f0360bfa740 10 client.0 _ll_register_callbacks cb 0x55603d08e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:44.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.604+0000 7f03577fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d41bb40 0x55603d421fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:44.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.604+0000 7f03577fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d41bb40 0x55603d421fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38500/0 (socket says 172.21.15.7:38500) 2024-09-19T08:54:44.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.604+0000 7f03577fe640 1 -- 172.21.15.7:0/2677506334 learned_addr learned my addr 172.21.15.7:0/2677506334 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:44.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.604+0000 7f0357fff640 1 --2- 172.21.15.7:0/2677506334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55603d41a5d0 0x55603d424d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:44.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.604+0000 7f035cdbe640 1 --2- 172.21.15.7:0/2677506334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55603d425370 0x55603d422530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:44.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.604+0000 7f03577fe640 1 -- 172.21.15.7:0/2677506334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55603d425370 msgr2=0x55603d422530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:44.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.604+0000 7f03577fe640 1 --2- 172.21.15.7:0/2677506334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55603d425370 0x55603d422530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.604+0000 7f03577fe640 1 -- 172.21.15.7:0/2677506334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55603d41a5d0 msgr2=0x55603d424d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:44.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.604+0000 7f03577fe640 1 --2- 172.21.15.7:0/2677506334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55603d41a5d0 0x55603d424d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.605+0000 7f03577fe640 1 -- 172.21.15.7:0/2677506334 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55603d0f13c0 con 0x55603d41bb40 2024-09-19T08:54:44.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.605+0000 7f03577fe640 1 --2- 172.21.15.7:0/2677506334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d41bb40 0x55603d421fb0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f034c005ab0 tx=0x7f034c031860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2cbc22453413e95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:44.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.605+0000 7f03377fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:44.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.605+0000 7f03377fe640 1 -- 172.21.15.7:0/2677506334 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f034c03f070 con 0x55603d41bb40 2024-09-19T08:54:44.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.605+0000 7f03377fe640 1 -- 172.21.15.7:0/2677506334 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f034c004450 con 0x55603d41bb40 2024-09-19T08:54:44.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.605+0000 7f0360bfa740 1 -- 172.21.15.7:0/2677506334 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03500134c0 con 0x55603d41bb40 2024-09-19T08:54:44.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.605+0000 7f03377fe640 1 -- 172.21.15.7:0/2677506334 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f034c035070 con 0x55603d41bb40 2024-09-19T08:54:44.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.605+0000 7f0360bfa740 10 client.17769 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:44.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.605+0000 7f0360bfa740 1 -- 172.21.15.7:0/2677506334 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55603d433aa0 con 0x55603d41bb40 2024-09-19T08:54:44.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.605+0000 7f03377fe640 1 -- 172.21.15.7:0/2677506334 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03500134c0 con 0x55603d41bb40 2024-09-19T08:54:44.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.606+0000 7f03377fe640 1 -- 172.21.15.7:0/2677506334 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f034c004a60 con 0x55603d41bb40 2024-09-19T08:54:44.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.606+0000 7f0360bfa740 10 client.17769 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:44.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.606+0000 7f0360bfa740 10 client.17769 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:54:44.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.606+0000 7f0360bfa740 20 client.17769 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:44.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.606+0000 7f0360bfa740 1 --2- 172.21.15.7:0/2677506334 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55603d434f60 0x55603d4373c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:44.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.606+0000 7f0360bfa740 4 client.17769 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:44.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.606+0000 7f0360bfa740 1 -- 172.21.15.7:0/2677506334 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55603d38d860 con 0x55603d434f60 2024-09-19T08:54:44.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.606+0000 7f0357fff640 1 --2- 172.21.15.7:0/2677506334 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55603d434f60 0x55603d4373c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:44.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.607+0000 7f03377fe640 10 client.17769 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:54:44.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.607+0000 7f0357fff640 1 --2- 172.21.15.7:0/2677506334 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55603d434f60 0x55603d4373c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8ae5a0fea7c51f15 server_cookie=4fae36a72e54999a in_seq=0 out_seq=0 2024-09-19T08:54:44.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.608+0000 7f03377fe640 1 -- 172.21.15.7:0/2677506334 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55603d38d860 con 0x55603d434f60 2024-09-19T08:54:44.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.608+0000 7f03377fe640 10 client.17769 handle_command_reply: tid=0 2024-09-19T08:54:44.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.608+0000 7f0360bfa740 1 client.17769 shutdown 2024-09-19T08:54:44.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.608+0000 7f0360bfa740 1 -- 172.21.15.7:0/2677506334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d41bb40 msgr2=0x55603d421fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:44.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.608+0000 7f0360bfa740 1 --2- 172.21.15.7:0/2677506334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d41bb40 0x55603d421fb0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f034c005ab0 tx=0x7f034c031860 comp rx=0 tx=0).stop 2024-09-19T08:54:44.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.608+0000 7f0360bfa740 1 -- 172.21.15.7:0/2677506334 shutdown_connections 2024-09-19T08:54:44.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.608+0000 7f0360bfa740 1 --2- 172.21.15.7:0/2677506334 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55603d434f60 0x55603d4373c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.608+0000 7f0360bfa740 1 --2- 172.21.15.7:0/2677506334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55603d425370 0x55603d422530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.608+0000 7f0360bfa740 1 --2- 172.21.15.7:0/2677506334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d41bb40 0x55603d421fb0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.608+0000 7f0360bfa740 1 --2- 172.21.15.7:0/2677506334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55603d41a5d0 0x55603d424d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.608+0000 7f03377fe640 0 client.17769 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:54:44.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.608+0000 7f0360bfa740 1 -- 172.21.15.7:0/2677506334 >> 172.21.15.7:0/2677506334 conn(0x55603d3e3310 msgr2=0x55603d41c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:44.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.609+0000 7f0360bfa740 1 -- 172.21.15.7:0/2677506334 shutdown_connections 2024-09-19T08:54:44.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.609+0000 7f0360bfa740 1 -- 172.21.15.7:0/2677506334 wait complete. 2024-09-19T08:54:44.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.609+0000 7f0360bfa740 20 client.17769 trim_cache size 0 max 16384 2024-09-19T08:54:44.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.622+0000 7f0360bfa740 1 Processor -- start 2024-09-19T08:54:44.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.622+0000 7f0360bfa740 1 -- start start 2024-09-19T08:54:44.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.622+0000 7f0360bfa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55603d41a5d0 0x55603d41d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:44.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.622+0000 7f0360bfa740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55603d41bb40 0x55603d41d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:44.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.622+0000 7f0360bfa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d425370 0x55603d43cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:44.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.622+0000 7f0360bfa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f03581b2450 con 0x55603d425370 2024-09-19T08:54:44.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.622+0000 7f0360bfa740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f03581afd20 con 0x55603d41bb40 2024-09-19T08:54:44.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.622+0000 7f0360bfa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f03581adb70 con 0x55603d41a5d0 2024-09-19T08:54:44.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.623+0000 7f035cdbe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d425370 0x55603d43cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:44.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.623+0000 7f035cdbe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d425370 0x55603d43cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38512/0 (socket says 172.21.15.7:38512) 2024-09-19T08:54:44.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.623+0000 7f035cdbe640 1 -- 172.21.15.7:0/1342733539 learned_addr learned my addr 172.21.15.7:0/1342733539 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:44.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.623+0000 7f03577fe640 1 --2- 172.21.15.7:0/1342733539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55603d41bb40 0x55603d41d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:44.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.623+0000 7f035cdbe640 1 -- 172.21.15.7:0/1342733539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55603d41a5d0 msgr2=0x55603d41d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:44.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.623+0000 7f035cdbe640 1 --2- 172.21.15.7:0/1342733539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55603d41a5d0 0x55603d41d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.623+0000 7f035cdbe640 1 -- 172.21.15.7:0/1342733539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55603d41bb40 msgr2=0x55603d41d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:44.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.623+0000 7f035cdbe640 1 --2- 172.21.15.7:0/1342733539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55603d41bb40 0x55603d41d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.623+0000 7f035cdbe640 1 -- 172.21.15.7:0/1342733539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55603d417960 con 0x55603d425370 2024-09-19T08:54:44.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.623+0000 7f03577fe640 1 --2- 172.21.15.7:0/1342733539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55603d41bb40 0x55603d41d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:44.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.623+0000 7f035cdbe640 1 --2- 172.21.15.7:0/1342733539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d425370 0x55603d43cc90 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f0350009aa0 tx=0x7f0350013f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9e3a743da6e22f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:44.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.623+0000 7f033dffb640 1 -- 172.21.15.7:0/1342733539 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0350023050 con 0x55603d425370 2024-09-19T08:54:44.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.623+0000 7f033dffb640 1 -- 172.21.15.7:0/1342733539 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0350003e50 con 0x55603d425370 2024-09-19T08:54:44.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.623+0000 7f033dffb640 1 -- 172.21.15.7:0/1342733539 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03500116d0 con 0x55603d425370 2024-09-19T08:54:44.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.624+0000 7f0360bfa740 1 -- 172.21.15.7:0/1342733539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d425370 msgr2=0x55603d43cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:44.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.624+0000 7f0360bfa740 1 --2- 172.21.15.7:0/1342733539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d425370 0x55603d43cc90 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f0350009aa0 tx=0x7f0350013f90 comp rx=0 tx=0).stop 2024-09-19T08:54:44.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.624+0000 7f0360bfa740 1 -- 172.21.15.7:0/1342733539 shutdown_connections 2024-09-19T08:54:44.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.624+0000 7f0360bfa740 1 --2- 172.21.15.7:0/1342733539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d425370 0x55603d43cc90 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.624+0000 7f0360bfa740 1 --2- 172.21.15.7:0/1342733539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55603d41bb40 0x55603d41d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.624+0000 7f0360bfa740 1 --2- 172.21.15.7:0/1342733539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55603d41a5d0 0x55603d41d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.624+0000 7f0360bfa740 1 -- 172.21.15.7:0/1342733539 >> 172.21.15.7:0/1342733539 conn(0x55603d3e3310 msgr2=0x55603d415d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:44.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.624+0000 7f0360bfa740 1 -- 172.21.15.7:0/1342733539 shutdown_connections 2024-09-19T08:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.624+0000 7f0360bfa740 1 -- 172.21.15.7:0/1342733539 wait complete. 2024-09-19T08:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.624+0000 7f0360bfa740 1 -- start start 2024-09-19T08:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.625+0000 7f0360bfa740 1 Processor -- start 2024-09-19T08:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.625+0000 7f0360bfa740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55603d41a5d0 0x55603d429ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.625+0000 7f0360bfa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d41bb40 0x55603d42a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.625+0000 7f0360bfa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55603d425370 0x55603d498d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.625+0000 7f0360bfa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f03581ae1e0 con 0x55603d41bb40 2024-09-19T08:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.625+0000 7f0360bfa740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f03581af650 con 0x55603d41a5d0 2024-09-19T08:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.625+0000 7f0360bfa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f03581ae8b0 con 0x55603d425370 2024-09-19T08:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.625+0000 7f0360bfa740 10 client.0 _ll_register_callbacks cb 0x7f034c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.625+0000 7f03577fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d41bb40 0x55603d42a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.625+0000 7f03577fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d41bb40 0x55603d42a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38520/0 (socket says 172.21.15.7:38520) 2024-09-19T08:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.625+0000 7f03577fe640 1 -- 172.21.15.7:0/196186060 learned_addr learned my addr 172.21.15.7:0/196186060 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.625+0000 7f0357fff640 1 --2- 172.21.15.7:0/196186060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55603d41a5d0 0x55603d429ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.625+0000 7f035cdbe640 1 --2- 172.21.15.7:0/196186060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55603d425370 0x55603d498d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.625+0000 7f03577fe640 1 -- 172.21.15.7:0/196186060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55603d425370 msgr2=0x55603d498d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.625+0000 7f03577fe640 1 --2- 172.21.15.7:0/196186060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55603d425370 0x55603d498d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.625+0000 7f03577fe640 1 -- 172.21.15.7:0/196186060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55603d41a5d0 msgr2=0x55603d429ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.625+0000 7f03577fe640 1 --2- 172.21.15.7:0/196186060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55603d41a5d0 0x55603d429ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.625+0000 7f03577fe640 1 -- 172.21.15.7:0/196186060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55603d499350 con 0x55603d41bb40 2024-09-19T08:54:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.625+0000 7f0357fff640 1 --2- 172.21.15.7:0/196186060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55603d41a5d0 0x55603d429ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.626+0000 7f03577fe640 1 --2- 172.21.15.7:0/196186060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d41bb40 0x55603d42a010 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x55603d4235f0 tx=0x7f034c005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4a3f5cebe5b636 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.626+0000 7f03377fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.626+0000 7f03377fe640 1 -- 172.21.15.7:0/196186060 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f034c059060 con 0x55603d41bb40 2024-09-19T08:54:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.626+0000 7f03377fe640 1 -- 172.21.15.7:0/196186060 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f034c0039c0 con 0x55603d41bb40 2024-09-19T08:54:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.626+0000 7f0360bfa740 1 -- 172.21.15.7:0/196186060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0350003e50 con 0x55603d41bb40 2024-09-19T08:54:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.626+0000 7f03377fe640 1 -- 172.21.15.7:0/196186060 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f034c03f030 con 0x55603d41bb40 2024-09-19T08:54:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.626+0000 7f0360bfa740 10 client.17775 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.626+0000 7f0360bfa740 1 -- 172.21.15.7:0/196186060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55603d4a0710 con 0x55603d41bb40 2024-09-19T08:54:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.626+0000 7f03377fe640 1 -- 172.21.15.7:0/196186060 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0350003e50 con 0x55603d41bb40 2024-09-19T08:54:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.626+0000 7f03377fe640 1 -- 172.21.15.7:0/196186060 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f034c0051d0 con 0x55603d41bb40 2024-09-19T08:54:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.626+0000 7f0360bfa740 10 client.17775 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.626+0000 7f0360bfa740 10 client.17775 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:54:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.626+0000 7f0360bfa740 20 client.17775 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.627+0000 7f0360bfa740 1 --2- 172.21.15.7:0/196186060 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55603d4a0ec0 0x55603d4a32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.627+0000 7f0360bfa740 4 client.17775 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:54:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.627+0000 7f0360bfa740 1 -- 172.21.15.7:0/196186060 --> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55603d387d70 con 0x55603d4a0ec0 2024-09-19T08:54:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.627+0000 7f0357fff640 1 --2- 172.21.15.7:0/196186060 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55603d4a0ec0 0x55603d4a32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.627+0000 7f0357fff640 1 --2- 172.21.15.7:0/196186060 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55603d4a0ec0 0x55603d4a32e0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=46345b4e15dc9d28 server_cookie=669e0eb08b38d29 in_seq=0 out_seq=0 2024-09-19T08:54:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.627+0000 7f03377fe640 10 client.17775 ms_handle_connect on v2:172.21.15.175:6838/3928264317 2024-09-19T08:54:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.627+0000 7f03377fe640 1 -- 172.21.15.7:0/196186060 <== mds.1 v2:172.21.15.175:6838/3928264317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55603d387d70 con 0x55603d4a0ec0 2024-09-19T08:54:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.627+0000 7f03377fe640 10 client.17775 handle_command_reply: tid=0 2024-09-19T08:54:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.627+0000 7f0360bfa740 1 client.17775 shutdown 2024-09-19T08:54:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.628+0000 7f0360bfa740 1 -- 172.21.15.7:0/196186060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d41bb40 msgr2=0x55603d42a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.628+0000 7f0360bfa740 1 --2- 172.21.15.7:0/196186060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d41bb40 0x55603d42a010 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x55603d4235f0 tx=0x7f034c005e50 comp rx=0 tx=0).stop 2024-09-19T08:54:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.628+0000 7f0360bfa740 1 -- 172.21.15.7:0/196186060 shutdown_connections 2024-09-19T08:54:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.628+0000 7f0360bfa740 1 --2- 172.21.15.7:0/196186060 >> [v2:172.21.15.175:6838/3928264317,v1:172.21.15.175:6839/3928264317] conn(0x55603d4a0ec0 0x55603d4a32e0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.628+0000 7f0360bfa740 1 --2- 172.21.15.7:0/196186060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55603d425370 0x55603d498d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.628+0000 7f0360bfa740 1 --2- 172.21.15.7:0/196186060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55603d41bb40 0x55603d42a010 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.628+0000 7f03377fe640 0 client.17775 ms_handle_reset on v2:172.21.15.175:6838/3928264317 2024-09-19T08:54:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.628+0000 7f0360bfa740 1 --2- 172.21.15.7:0/196186060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55603d41a5d0 0x55603d429ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.628+0000 7f0360bfa740 1 -- 172.21.15.7:0/196186060 >> 172.21.15.7:0/196186060 conn(0x55603d3e3310 msgr2=0x55603d423810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:44.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.628+0000 7f0360bfa740 1 -- 172.21.15.7:0/196186060 shutdown_connections 2024-09-19T08:54:44.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.628+0000 7f0360bfa740 1 -- 172.21.15.7:0/196186060 wait complete. 2024-09-19T08:54:44.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.628+0000 7f0360bfa740 20 client.17775 trim_cache size 0 max 16384 2024-09-19T08:54:44.651 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:54:44.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.628+0000 7f035e821640 1 -- 172.21.15.7:0/3615643332 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f03400a33b0 msgr2=0x7f03400a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:44.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.628+0000 7f035e821640 1 --2- 172.21.15.7:0/3615643332 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f03400a33b0 0x7f03400a5870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0350020000 tx=0x7f035001b000 comp rx=0 tx=0).stop 2024-09-19T08:54:44.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.628+0000 7f035e821640 1 -- 172.21.15.7:0/3615643332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0358100a80 msgr2=0x7f03580fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:44.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.628+0000 7f035e821640 1 --2- 172.21.15.7:0/3615643332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0358100a80 0x7f03580fcda0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f034800d950 tx=0x7f034800de10 comp rx=0 tx=0).stop 2024-09-19T08:54:44.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.629+0000 7f035e821640 1 -- 172.21.15.7:0/3615643332 shutdown_connections 2024-09-19T08:54:44.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.629+0000 7f035e821640 1 --2- 172.21.15.7:0/3615643332 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f03400a33b0 0x7f03400a5870 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.629+0000 7f035e821640 1 --2- 172.21.15.7:0/3615643332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0358106a80 0x7f03580fd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.629+0000 7f035e821640 1 --2- 172.21.15.7:0/3615643332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0358101420 0x7f03580fd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.629+0000 7f035e821640 1 --2- 172.21.15.7:0/3615643332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0358100a80 0x7f03580fcda0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.629+0000 7f035e821640 1 -- 172.21.15.7:0/3615643332 >> 172.21.15.7:0/3615643332 conn(0x7f03580fc7a0 msgr2=0x7f035806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:44.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.629+0000 7f035e821640 1 -- 172.21.15.7:0/3615643332 shutdown_connections 2024-09-19T08:54:44.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:44.629+0000 7f035e821640 1 -- 172.21.15.7:0/3615643332 wait complete. 2024-09-19T08:54:45.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:45 smithi007 ceph-mon[31221]: pgmap v317: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T08:54:45.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:45 smithi007 ceph-mon[31221]: from='client.17751 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:45.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:45 smithi007 ceph-mon[31221]: from='client.17757 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:45.263 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:54:45.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:45 smithi175 ceph-mon[35688]: pgmap v317: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T08:54:45.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:45 smithi175 ceph-mon[35688]: from='client.17751 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:45.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:45 smithi175 ceph-mon[35688]: from='client.17757 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:45.518 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:45.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:45 smithi044 ceph-mon[35072]: pgmap v317: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T08:54:45.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:45 smithi044 ceph-mon[35072]: from='client.17751 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:45.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:45 smithi044 ceph-mon[35072]: from='client.17757 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:45.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.963+0000 7f16e31c4640 1 -- 172.21.15.7:0/1897729028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16dc102da0 msgr2=0x7f16dc103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:45.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.963+0000 7f16e31c4640 1 --2- 172.21.15.7:0/1897729028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16dc102da0 0x7f16dc103180 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f16d0009900 tx=0x7f16d002a480 comp rx=0 tx=0).stop 2024-09-19T08:54:45.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.963+0000 7f16e31c4640 1 -- 172.21.15.7:0/1897729028 shutdown_connections 2024-09-19T08:54:45.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.963+0000 7f16e31c4640 1 --2- 172.21.15.7:0/1897729028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16dc10c180 0x7f16dc10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.963+0000 7f16e31c4640 1 --2- 172.21.15.7:0/1897729028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16dc1036c0 0x7f16dc10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.963+0000 7f16e31c4640 1 --2- 172.21.15.7:0/1897729028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16dc102da0 0x7f16dc103180 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.963+0000 7f16e31c4640 1 -- 172.21.15.7:0/1897729028 >> 172.21.15.7:0/1897729028 conn(0x7f16dc0fc7a0 msgr2=0x7f16dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:45.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.963+0000 7f16e31c4640 1 -- 172.21.15.7:0/1897729028 shutdown_connections 2024-09-19T08:54:45.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.963+0000 7f16e31c4640 1 -- 172.21.15.7:0/1897729028 wait complete. 2024-09-19T08:54:45.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.964+0000 7f16e31c4640 1 Processor -- start 2024-09-19T08:54:45.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.964+0000 7f16e31c4640 1 -- start start 2024-09-19T08:54:45.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.964+0000 7f16e31c4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16dc102da0 0x7f16dc198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:45.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.964+0000 7f16e31c4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16dc1036c0 0x7f16dc1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:45.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.964+0000 7f16e31c4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16dc10c180 0x7f16dc19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:45.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.964+0000 7f16e31c4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16dc111fa0 con 0x7f16dc10c180 2024-09-19T08:54:45.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.964+0000 7f16e31c4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f16dc111e20 con 0x7f16dc1036c0 2024-09-19T08:54:45.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.964+0000 7f16e31c4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f16dc112120 con 0x7f16dc102da0 2024-09-19T08:54:45.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.965+0000 7f16e1761640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16dc10c180 0x7f16dc19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:45.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.965+0000 7f16e1761640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16dc10c180 0x7f16dc19cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38546/0 (socket says 172.21.15.7:38546) 2024-09-19T08:54:45.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.965+0000 7f16e1761640 1 -- 172.21.15.7:0/658692081 learned_addr learned my addr 172.21.15.7:0/658692081 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:45.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.965+0000 7f16dbfff640 1 --2- 172.21.15.7:0/658692081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16dc1036c0 0x7f16dc1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:45.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.965+0000 7f16e0f60640 1 --2- 172.21.15.7:0/658692081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16dc102da0 0x7f16dc198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:45.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.965+0000 7f16e1761640 1 -- 172.21.15.7:0/658692081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16dc102da0 msgr2=0x7f16dc198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:45.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.965+0000 7f16e1761640 1 --2- 172.21.15.7:0/658692081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16dc102da0 0x7f16dc198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.965+0000 7f16e1761640 1 -- 172.21.15.7:0/658692081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16dc1036c0 msgr2=0x7f16dc1989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:45.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.965+0000 7f16e1761640 1 --2- 172.21.15.7:0/658692081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16dc1036c0 0x7f16dc1989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.965+0000 7f16e1761640 1 -- 172.21.15.7:0/658692081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16dc19d430 con 0x7f16dc10c180 2024-09-19T08:54:45.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.965+0000 7f16e0f60640 1 --2- 172.21.15.7:0/658692081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16dc102da0 0x7f16dc198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:45.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.965+0000 7f16e1761640 1 --2- 172.21.15.7:0/658692081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16dc10c180 0x7f16dc19cd50 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f16d400b970 tx=0x7f16d400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:45.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.965+0000 7f16d9ffb640 1 -- 172.21.15.7:0/658692081 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d4019070 con 0x7f16dc10c180 2024-09-19T08:54:45.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.965+0000 7f16d9ffb640 1 -- 172.21.15.7:0/658692081 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16d400cb40 con 0x7f16dc10c180 2024-09-19T08:54:45.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.965+0000 7f16e31c4640 1 -- 172.21.15.7:0/658692081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16dc19d720 con 0x7f16dc10c180 2024-09-19T08:54:45.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.965+0000 7f16d9ffb640 1 -- 172.21.15.7:0/658692081 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d4007650 con 0x7f16dc10c180 2024-09-19T08:54:45.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.966+0000 7f16e31c4640 1 -- 172.21.15.7:0/658692081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16dc1a5000 con 0x7f16dc10c180 2024-09-19T08:54:45.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.968+0000 7f16d9ffb640 1 -- 172.21.15.7:0/658692081 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f16d401c070 con 0x7f16dc10c180 2024-09-19T08:54:45.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.968+0000 7f16e559d740 1 Processor -- start 2024-09-19T08:54:45.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.968+0000 7f16e559d740 1 -- start start 2024-09-19T08:54:45.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.968+0000 7f16e559d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9b1ad0b40 0x55c9b1acf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:45.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.968+0000 7f16e559d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1acf5d0 0x55c9b1acfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:45.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.968+0000 7f16e559d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9b1ade780 0x55c9b1ae0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:45.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.968+0000 7f16e559d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c9b1a352f0 con 0x55c9b1acf5d0 2024-09-19T08:54:45.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.968+0000 7f16e559d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c9b19dccf0 con 0x55c9b1ad0b40 2024-09-19T08:54:45.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.968+0000 7f16e559d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c9b1a312b0 con 0x55c9b1ade780 2024-09-19T08:54:45.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.969+0000 7f16d9ffb640 1 --2- 172.21.15.7:0/658692081 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f16cc0a3430 0x7f16cc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:45.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.969+0000 7f16e0f60640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1acf5d0 0x55c9b1acfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:45.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.969+0000 7f16e0f60640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1acf5d0 0x55c9b1acfa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38556/0 (socket says 172.21.15.7:38556) 2024-09-19T08:54:45.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.969+0000 7f16e0f60640 1 -- 172.21.15.7:0/3240848361 learned_addr learned my addr 172.21.15.7:0/3240848361 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:45.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.969+0000 7f16dbfff640 1 --2- 172.21.15.7:0/3240848361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9b1ad0b40 0x55c9b1acf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:45.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.969+0000 7f16e1761640 1 --2- 172.21.15.7:0/658692081 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f16cc0a3430 0x7f16cc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:45.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.969+0000 7f16d9ffb640 1 -- 172.21.15.7:0/658692081 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f16d40cf230 con 0x7f16dc10c180 2024-09-19T08:54:45.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.969+0000 7f16dbfff640 1 --2- 172.21.15.7:0/3240848361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9b1ade780 0x55c9b1ae0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:45.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.969+0000 7f16e0f60640 1 -- 172.21.15.7:0/3240848361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9b1ade780 msgr2=0x55c9b1ae0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:45.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.969+0000 7f16e0f60640 1 --2- 172.21.15.7:0/3240848361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9b1ade780 0x55c9b1ae0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.969+0000 7f16e0f60640 1 -- 172.21.15.7:0/3240848361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9b1ad0b40 msgr2=0x55c9b1acf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:45.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.969+0000 7f16e0f60640 1 --2- 172.21.15.7:0/3240848361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9b1ad0b40 0x55c9b1acf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.969+0000 7f16e0f60640 1 -- 172.21.15.7:0/3240848361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9b19c13a0 con 0x55c9b1acf5d0 2024-09-19T08:54:45.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.969+0000 7f16dbfff640 1 --2- 172.21.15.7:0/3240848361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9b1ade780 0x55c9b1ae0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:45.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.969+0000 7f16e0f60640 1 --2- 172.21.15.7:0/3240848361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1acf5d0 0x55c9b1acfa10 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f16d0031550 tx=0x7f16d0032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eebf2118d154bb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:45.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.969+0000 7f16e1761640 1 --2- 172.21.15.7:0/658692081 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f16cc0a3430 0x7f16cc0a58f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f16d409b5c0 tx=0x7f16d406d3b0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:45.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.969+0000 7f16c6ffd640 1 -- 172.21.15.7:0/3240848361 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d003f020 con 0x55c9b1acf5d0 2024-09-19T08:54:45.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.969+0000 7f16c6ffd640 1 -- 172.21.15.7:0/3240848361 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16d00317b0 con 0x55c9b1acf5d0 2024-09-19T08:54:45.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.970+0000 7f16c6ffd640 1 -- 172.21.15.7:0/3240848361 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d0035070 con 0x55c9b1acf5d0 2024-09-19T08:54:45.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.970+0000 7f16e559d740 1 -- 172.21.15.7:0/3240848361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1acf5d0 msgr2=0x55c9b1acfa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:45.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.970+0000 7f16e559d740 1 --2- 172.21.15.7:0/3240848361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1acf5d0 0x55c9b1acfa10 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f16d0031550 tx=0x7f16d0032cd0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.970+0000 7f16e559d740 1 -- 172.21.15.7:0/3240848361 shutdown_connections 2024-09-19T08:54:45.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.970+0000 7f16e559d740 1 --2- 172.21.15.7:0/3240848361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9b1ade780 0x55c9b1ae0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.970+0000 7f16e559d740 1 --2- 172.21.15.7:0/3240848361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1acf5d0 0x55c9b1acfa10 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.970+0000 7f16e559d740 1 --2- 172.21.15.7:0/3240848361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9b1ad0b40 0x55c9b1acf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.970+0000 7f16e559d740 1 -- 172.21.15.7:0/3240848361 >> 172.21.15.7:0/3240848361 conn(0x55c9b1a98310 msgr2=0x55c9b1acbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.970+0000 7f16e559d740 1 -- 172.21.15.7:0/3240848361 shutdown_connections 2024-09-19T08:54:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.970+0000 7f16e559d740 1 -- 172.21.15.7:0/3240848361 wait complete. 2024-09-19T08:54:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.971+0000 7f16e559d740 1 -- start start 2024-09-19T08:54:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.971+0000 7f16e559d740 1 Processor -- start 2024-09-19T08:54:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.971+0000 7f16e559d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9b1acf5d0 0x55c9b1ade0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.971+0000 7f16e559d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9b1ad0b40 0x55c9b1adb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.971+0000 7f16e559d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1ade780 0x55c9b1adb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.971+0000 7f16e559d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c9b1ae1420 con 0x55c9b1ade780 2024-09-19T08:54:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.971+0000 7f16e559d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c9b19f0060 con 0x55c9b1ad0b40 2024-09-19T08:54:45.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.971+0000 7f16e559d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c9b1ae15a0 con 0x55c9b1acf5d0 2024-09-19T08:54:45.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.971+0000 7f16e559d740 10 client.0 _ll_register_callbacks cb 0x55c9b17438c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:45.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.971+0000 7f16dbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1ade780 0x55c9b1adb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:45.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.971+0000 7f16dbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1ade780 0x55c9b1adb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38572/0 (socket says 172.21.15.7:38572) 2024-09-19T08:54:45.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.971+0000 7f16dbfff640 1 -- 172.21.15.7:0/365540254 learned_addr learned my addr 172.21.15.7:0/365540254 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:45.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.971+0000 7f16e0f60640 1 --2- 172.21.15.7:0/365540254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9b1ad0b40 0x55c9b1adb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:45.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.971+0000 7f16dbfff640 1 --2- 172.21.15.7:0/365540254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9b1acf5d0 0x55c9b1ade0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:45.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.972+0000 7f16dbfff640 1 -- 172.21.15.7:0/365540254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9b1acf5d0 msgr2=0x55c9b1ade0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:45.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.972+0000 7f16dbfff640 1 --2- 172.21.15.7:0/365540254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9b1acf5d0 0x55c9b1ade0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.972+0000 7f16dbfff640 1 -- 172.21.15.7:0/365540254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9b1ad0b40 msgr2=0x55c9b1adb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:45.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.972+0000 7f16dbfff640 1 --2- 172.21.15.7:0/365540254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9b1ad0b40 0x55c9b1adb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.972+0000 7f16dbfff640 1 -- 172.21.15.7:0/365540254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9b17a63c0 con 0x55c9b1ade780 2024-09-19T08:54:45.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.972+0000 7f16dbfff640 1 --2- 172.21.15.7:0/365540254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1ade780 0x55c9b1adb900 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f16c8012950 tx=0x7f16c8014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbe0abf046f98ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.972+0000 7f16bbfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T08:54:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.972+0000 7f16bbfff640 1 -- 172.21.15.7:0/365540254 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c8010a80 con 0x55c9b1ade780 2024-09-19T08:54:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.972+0000 7f16bbfff640 1 -- 172.21.15.7:0/365540254 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f16c8010c20 con 0x55c9b1ade780 2024-09-19T08:54:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.972+0000 7f16e559d740 1 -- 172.21.15.7:0/365540254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16d00317b0 con 0x55c9b1ade780 2024-09-19T08:54:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.972+0000 7f16bbfff640 1 -- 172.21.15.7:0/365540254 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f16c8010e20 con 0x55c9b1ade780 2024-09-19T08:54:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.972+0000 7f16e559d740 10 client.17787 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.972+0000 7f16e559d740 1 -- 172.21.15.7:0/365540254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c9b1aece50 con 0x55c9b1ade780 2024-09-19T08:54:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.972+0000 7f16bbfff640 1 -- 172.21.15.7:0/365540254 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16d00317b0 con 0x55c9b1ade780 2024-09-19T08:54:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.973+0000 7f16bbfff640 1 -- 172.21.15.7:0/365540254 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f16c8024400 con 0x55c9b1ade780 2024-09-19T08:54:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.973+0000 7f16e559d740 10 client.17787 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.973+0000 7f16e559d740 10 client.17787 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.973+0000 7f16e559d740 20 client.17787 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.973+0000 7f16e559d740 1 --2- 172.21.15.7:0/365540254 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c9b1aee310 0x55c9b1af0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:45.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.973+0000 7f16e559d740 4 client.17787 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:45.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.973+0000 7f16e559d740 1 -- 172.21.15.7:0/365540254 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9b1a42860 con 0x55c9b1aee310 2024-09-19T08:54:45.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.973+0000 7f16e0f60640 1 --2- 172.21.15.7:0/365540254 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c9b1aee310 0x55c9b1af0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:45.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.973+0000 7f16bbfff640 10 client.17787 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:45.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.973+0000 7f16e0f60640 1 --2- 172.21.15.7:0/365540254 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c9b1aee310 0x55c9b1af0720 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cacaa276cfb8fa41 server_cookie=f539ca5575420ae4 in_seq=0 out_seq=0 2024-09-19T08:54:45.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.974+0000 7f16bbfff640 1 -- 172.21.15.7:0/365540254 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c9b1a42860 con 0x55c9b1aee310 2024-09-19T08:54:45.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.974+0000 7f16bbfff640 10 client.17787 handle_command_reply: tid=0 2024-09-19T08:54:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.974+0000 7f16e559d740 1 client.17787 shutdown 2024-09-19T08:54:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.974+0000 7f16e559d740 1 -- 172.21.15.7:0/365540254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1ade780 msgr2=0x55c9b1adb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.974+0000 7f16e559d740 1 --2- 172.21.15.7:0/365540254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1ade780 0x55c9b1adb900 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f16c8012950 tx=0x7f16c8014040 comp rx=0 tx=0).stop 2024-09-19T08:54:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.974+0000 7f16e559d740 1 -- 172.21.15.7:0/365540254 shutdown_connections 2024-09-19T08:54:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.974+0000 7f16e559d740 1 --2- 172.21.15.7:0/365540254 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c9b1aee310 0x55c9b1af0720 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.974+0000 7f16e559d740 1 --2- 172.21.15.7:0/365540254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1ade780 0x55c9b1adb900 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.974+0000 7f16e559d740 1 --2- 172.21.15.7:0/365540254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9b1ad0b40 0x55c9b1adb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.974+0000 7f16bbfff640 0 client.17787 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.974+0000 7f16e559d740 1 --2- 172.21.15.7:0/365540254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9b1acf5d0 0x55c9b1ade0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.974+0000 7f16e559d740 1 -- 172.21.15.7:0/365540254 >> 172.21.15.7:0/365540254 conn(0x55c9b1a98310 msgr2=0x55c9b1ad1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.975+0000 7f16e559d740 1 -- 172.21.15.7:0/365540254 shutdown_connections 2024-09-19T08:54:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.975+0000 7f16e559d740 1 -- 172.21.15.7:0/365540254 wait complete. 2024-09-19T08:54:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.975+0000 7f16e559d740 20 client.17787 trim_cache size 0 max 16384 2024-09-19T08:54:45.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.988+0000 7f16e559d740 1 Processor -- start 2024-09-19T08:54:45.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.988+0000 7f16e559d740 1 -- start start 2024-09-19T08:54:45.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.988+0000 7f16e559d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1acf5d0 0x55c9b1acbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:45.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.988+0000 7f16e559d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9b1ad0b40 0x55c9b1aea6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:45.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.988+0000 7f16e559d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9b1ade780 0x55c9b1adac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:45.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.988+0000 7f16e559d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16dc1adff0 con 0x55c9b1acf5d0 2024-09-19T08:54:45.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.988+0000 7f16e559d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f16dc1ab8c0 con 0x55c9b1ad0b40 2024-09-19T08:54:45.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.988+0000 7f16e559d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f16dc1a9730 con 0x55c9b1ade780 2024-09-19T08:54:45.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.988+0000 7f16dbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1acf5d0 0x55c9b1acbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:45.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.988+0000 7f16dbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1acf5d0 0x55c9b1acbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38574/0 (socket says 172.21.15.7:38574) 2024-09-19T08:54:45.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.988+0000 7f16dbfff640 1 -- 172.21.15.7:0/1761902475 learned_addr learned my addr 172.21.15.7:0/1761902475 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:45.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.988+0000 7f16e0f60640 1 --2- 172.21.15.7:0/1761902475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9b1ad0b40 0x55c9b1aea6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:45.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.988+0000 7f16dbfff640 1 -- 172.21.15.7:0/1761902475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9b1ade780 msgr2=0x55c9b1adac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:45.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.988+0000 7f16dbfff640 1 --2- 172.21.15.7:0/1761902475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9b1ade780 0x55c9b1adac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.988+0000 7f16dbfff640 1 -- 172.21.15.7:0/1761902475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9b1ad0b40 msgr2=0x55c9b1aea6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:45.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.988+0000 7f16dbfff640 1 --2- 172.21.15.7:0/1761902475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9b1ad0b40 0x55c9b1aea6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.988+0000 7f16dbfff640 1 -- 172.21.15.7:0/1761902475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9b1ad98f0 con 0x55c9b1acf5d0 2024-09-19T08:54:45.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.989+0000 7f16dbfff640 1 --2- 172.21.15.7:0/1761902475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1acf5d0 0x55c9b1acbe10 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f16c800b750 tx=0x7f16c8005c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f34ab5ad8eb77be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:45.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.989+0000 7f16c67fc640 1 -- 172.21.15.7:0/1761902475 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c8010a80 con 0x55c9b1acf5d0 2024-09-19T08:54:45.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.989+0000 7f16c67fc640 1 -- 172.21.15.7:0/1761902475 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16c8010c20 con 0x55c9b1acf5d0 2024-09-19T08:54:45.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.989+0000 7f16c67fc640 1 -- 172.21.15.7:0/1761902475 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c8026450 con 0x55c9b1acf5d0 2024-09-19T08:54:45.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.989+0000 7f16e559d740 1 -- 172.21.15.7:0/1761902475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1acf5d0 msgr2=0x55c9b1acbe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.989+0000 7f16e559d740 1 --2- 172.21.15.7:0/1761902475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1acf5d0 0x55c9b1acbe10 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f16c800b750 tx=0x7f16c8005c60 comp rx=0 tx=0).stop 2024-09-19T08:54:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.989+0000 7f16e559d740 1 -- 172.21.15.7:0/1761902475 shutdown_connections 2024-09-19T08:54:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.989+0000 7f16e559d740 1 --2- 172.21.15.7:0/1761902475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9b1ade780 0x55c9b1adac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.989+0000 7f16e559d740 1 --2- 172.21.15.7:0/1761902475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9b1ad0b40 0x55c9b1aea6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.989+0000 7f16e559d740 1 --2- 172.21.15.7:0/1761902475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1acf5d0 0x55c9b1acbe10 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.989+0000 7f16e559d740 1 -- 172.21.15.7:0/1761902475 >> 172.21.15.7:0/1761902475 conn(0x55c9b1a98310 msgr2=0x55c9b1acb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.989+0000 7f16e559d740 1 -- 172.21.15.7:0/1761902475 shutdown_connections 2024-09-19T08:54:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.989+0000 7f16e559d740 1 -- 172.21.15.7:0/1761902475 wait complete. 2024-09-19T08:54:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.990+0000 7f16e559d740 1 -- start start 2024-09-19T08:54:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.990+0000 7f16e559d740 1 Processor -- start 2024-09-19T08:54:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.990+0000 7f16e559d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9b1acf5d0 0x55c9b1ae6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:45.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.990+0000 7f16e559d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1ad0b40 0x55c9b1ad7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:45.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.990+0000 7f16e559d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9b1ade780 0x55c9b1ad8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:45.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.990+0000 7f16e559d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16dc1a9d80 con 0x55c9b1ad0b40 2024-09-19T08:54:45.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.990+0000 7f16e559d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f16dc1ab1f0 con 0x55c9b1acf5d0 2024-09-19T08:54:45.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.990+0000 7f16e559d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f16dc1aa450 con 0x55c9b1ade780 2024-09-19T08:54:45.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.990+0000 7f16e559d740 10 client.0 _ll_register_callbacks cb 0x7f16c8012590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:45.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.990+0000 7f16e0f60640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1ad0b40 0x55c9b1ad7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:45.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.990+0000 7f16dbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9b1acf5d0 0x55c9b1ae6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:45.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.990+0000 7f16e0f60640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1ad0b40 0x55c9b1ad7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38580/0 (socket says 172.21.15.7:38580) 2024-09-19T08:54:45.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.990+0000 7f16e0f60640 1 -- 172.21.15.7:0/1117926015 learned_addr learned my addr 172.21.15.7:0/1117926015 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:45.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.991+0000 7f16dbfff640 1 --2- 172.21.15.7:0/1117926015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9b1ade780 0x55c9b1ad8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:45.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.991+0000 7f16dbfff640 1 -- 172.21.15.7:0/1117926015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9b1ade780 msgr2=0x55c9b1ad8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:45.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.991+0000 7f16dbfff640 1 --2- 172.21.15.7:0/1117926015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9b1ade780 0x55c9b1ad8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.991+0000 7f16dbfff640 1 -- 172.21.15.7:0/1117926015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1ad0b40 msgr2=0x55c9b1ad7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.991+0000 7f16dbfff640 1 --2- 172.21.15.7:0/1117926015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1ad0b40 0x55c9b1ad7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.991+0000 7f16dbfff640 1 -- 172.21.15.7:0/1117926015 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9b1ad8bd0 con 0x55c9b1acf5d0 2024-09-19T08:54:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.991+0000 7f16e0f60640 1 --2- 172.21.15.7:0/1117926015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1ad0b40 0x55c9b1ad7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.991+0000 7f16dbfff640 1 --2- 172.21.15.7:0/1117926015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9b1acf5d0 0x55c9b1ae6e40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f16c8024850 tx=0x7f16c8028040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c087ccaf2525f46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.991+0000 7f16bbfff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-19T08:54:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.991+0000 7f16bbfff640 1 -- 172.21.15.7:0/1117926015 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c800b490 con 0x55c9b1acf5d0 2024-09-19T08:54:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.991+0000 7f16e559d740 1 -- 172.21.15.7:0/1117926015 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16c8010c20 con 0x55c9b1acf5d0 2024-09-19T08:54:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.991+0000 7f16bbfff640 1 -- 172.21.15.7:0/1117926015 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f16c80120d0 con 0x55c9b1acf5d0 2024-09-19T08:54:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.991+0000 7f16bbfff640 1 -- 172.21.15.7:0/1117926015 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f16c80122d0 con 0x55c9b1acf5d0 2024-09-19T08:54:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.991+0000 7f16e559d740 10 client.27296 fetch_fsmap learned FSMap version 25 2024-09-19T08:54:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.991+0000 7f16e559d740 1 -- 172.21.15.7:0/1117926015 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c9b1b58e90 con 0x55c9b1acf5d0 2024-09-19T08:54:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.992+0000 7f16bbfff640 1 -- 172.21.15.7:0/1117926015 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16c8010c20 con 0x55c9b1acf5d0 2024-09-19T08:54:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.992+0000 7f16bbfff640 1 -- 172.21.15.7:0/1117926015 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f16c802d020 con 0x55c9b1acf5d0 2024-09-19T08:54:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.992+0000 7f16e559d740 10 client.27296 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T08:54:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.992+0000 7f16e559d740 10 client.27296 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.992+0000 7f16e559d740 20 client.27296 populate_metadata read hostname 'smithi007' 2024-09-19T08:54:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.992+0000 7f16e559d740 1 --2- 172.21.15.7:0/1117926015 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c9b1b595e0 0x55c9b1b5ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.992+0000 7f16e559d740 4 client.27296 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:54:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.992+0000 7f16e559d740 1 -- 172.21.15.7:0/1117926015 --> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c9b1a3cd70 con 0x55c9b1b595e0 2024-09-19T08:54:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.992+0000 7f16e0f60640 1 --2- 172.21.15.7:0/1117926015 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c9b1b595e0 0x55c9b1b5ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.992+0000 7f16bbfff640 10 client.27296 ms_handle_connect on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.992+0000 7f16e0f60640 1 --2- 172.21.15.7:0/1117926015 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c9b1b595e0 0x55c9b1b5ba00 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a097a76886838fa0 server_cookie=f249e6a5da6768a6 in_seq=0 out_seq=0 2024-09-19T08:54:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.993+0000 7f16bbfff640 1 -- 172.21.15.7:0/1117926015 <== mds.0 v2:172.21.15.44:6838/1737549475 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c9b1a3cd70 con 0x55c9b1b595e0 2024-09-19T08:54:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.993+0000 7f16bbfff640 10 client.27296 handle_command_reply: tid=0 2024-09-19T08:54:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.993+0000 7f16e559d740 1 client.27296 shutdown 2024-09-19T08:54:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.993+0000 7f16e559d740 1 -- 172.21.15.7:0/1117926015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9b1acf5d0 msgr2=0x55c9b1ae6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.993+0000 7f16e559d740 1 --2- 172.21.15.7:0/1117926015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9b1acf5d0 0x55c9b1ae6e40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f16c8024850 tx=0x7f16c8028040 comp rx=0 tx=0).stop 2024-09-19T08:54:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.993+0000 7f16e559d740 1 -- 172.21.15.7:0/1117926015 shutdown_connections 2024-09-19T08:54:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.993+0000 7f16e559d740 1 --2- 172.21.15.7:0/1117926015 >> [v2:172.21.15.44:6838/1737549475,v1:172.21.15.44:6839/1737549475] conn(0x55c9b1b595e0 0x55c9b1b5ba00 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.993+0000 7f16e559d740 1 --2- 172.21.15.7:0/1117926015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9b1ade780 0x55c9b1ad8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.993+0000 7f16e559d740 1 --2- 172.21.15.7:0/1117926015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c9b1ad0b40 0x55c9b1ad7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.993+0000 7f16e559d740 1 --2- 172.21.15.7:0/1117926015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9b1acf5d0 0x55c9b1ae6e40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.993+0000 7f16bbfff640 0 client.27296 ms_handle_reset on v2:172.21.15.44:6838/1737549475 2024-09-19T08:54:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.993+0000 7f16e559d740 1 -- 172.21.15.7:0/1117926015 >> 172.21.15.7:0/1117926015 conn(0x55c9b1a98310 msgr2=0x55c9b1adcc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.993+0000 7f16e559d740 1 -- 172.21.15.7:0/1117926015 shutdown_connections 2024-09-19T08:54:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.993+0000 7f16e559d740 1 -- 172.21.15.7:0/1117926015 wait complete. 2024-09-19T08:54:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.993+0000 7f16e559d740 20 client.27296 trim_cache size 0 max 16384 2024-09-19T08:54:45.999 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-19T08:54:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.994+0000 7f16e31c4640 1 -- 172.21.15.7:0/658692081 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f16cc0a3430 msgr2=0x7f16cc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.994+0000 7f16e31c4640 1 --2- 172.21.15.7:0/658692081 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f16cc0a3430 0x7f16cc0a58f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f16d409b5c0 tx=0x7f16d406d3b0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.994+0000 7f16e31c4640 1 -- 172.21.15.7:0/658692081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16dc10c180 msgr2=0x7f16dc19cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.994+0000 7f16e31c4640 1 --2- 172.21.15.7:0/658692081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16dc10c180 0x7f16dc19cd50 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f16d400b970 tx=0x7f16d400be30 comp rx=0 tx=0).stop 2024-09-19T08:54:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.994+0000 7f16e31c4640 1 -- 172.21.15.7:0/658692081 shutdown_connections 2024-09-19T08:54:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.994+0000 7f16e31c4640 1 --2- 172.21.15.7:0/658692081 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f16cc0a3430 0x7f16cc0a58f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.994+0000 7f16e31c4640 1 --2- 172.21.15.7:0/658692081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16dc10c180 0x7f16dc19cd50 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.994+0000 7f16e31c4640 1 --2- 172.21.15.7:0/658692081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16dc1036c0 0x7f16dc1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.994+0000 7f16e31c4640 1 --2- 172.21.15.7:0/658692081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16dc102da0 0x7f16dc198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.994+0000 7f16e31c4640 1 -- 172.21.15.7:0/658692081 >> 172.21.15.7:0/658692081 conn(0x7f16dc0fc7a0 msgr2=0x7f16dc0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.994+0000 7f16e31c4640 1 -- 172.21.15.7:0/658692081 shutdown_connections 2024-09-19T08:54:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:45.994+0000 7f16e31c4640 1 -- 172.21.15.7:0/658692081 wait complete. 2024-09-19T08:54:46.843 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-19T08:54:46.844 INFO:tasks.fwd_scrub:done joining 2024-09-19T08:54:46.845 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T08:54:46.856 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:54:46.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.967+0000 7fd44de5e640 1 -- 172.21.15.7:0/3699951935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd448102450 msgr2=0x7fd44810e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.967+0000 7fd44de5e640 1 --2- 172.21.15.7:0/3699951935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd448102450 0x7fd44810e980 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fd440009cd0 tx=0x7fd44002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.967+0000 7fd44de5e640 1 -- 172.21.15.7:0/3699951935 shutdown_connections 2024-09-19T08:54:46.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.967+0000 7fd44de5e640 1 --2- 172.21.15.7:0/3699951935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd448102450 0x7fd44810e980 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.967+0000 7fd44de5e640 1 --2- 172.21.15.7:0/3699951935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd448101ab0 0x7fd448101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.967+0000 7fd44de5e640 1 --2- 172.21.15.7:0/3699951935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd448107ac0 0x7fd448107ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.967+0000 7fd44de5e640 1 -- 172.21.15.7:0/3699951935 >> 172.21.15.7:0/3699951935 conn(0x7fd4480fd7d0 msgr2=0x7fd4480ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:46.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.967+0000 7fd44de5e640 1 -- 172.21.15.7:0/3699951935 shutdown_connections 2024-09-19T08:54:46.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.967+0000 7fd44de5e640 1 -- 172.21.15.7:0/3699951935 wait complete. 2024-09-19T08:54:46.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.968+0000 7fd44de5e640 1 Processor -- start 2024-09-19T08:54:46.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.968+0000 7fd44de5e640 1 -- start start 2024-09-19T08:54:46.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.968+0000 7fd44de5e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd448101ab0 0x7fd44819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.968+0000 7fd44de5e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd448102450 0x7fd44819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.968+0000 7fd44de5e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd448107ac0 0x7fd44819ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.968+0000 7fd44de5e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd448111f00 con 0x7fd448107ac0 2024-09-19T08:54:46.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.968+0000 7fd44de5e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd448111d80 con 0x7fd448102450 2024-09-19T08:54:46.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.968+0000 7fd44de5e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd448112080 con 0x7fd448101ab0 2024-09-19T08:54:46.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.968+0000 7fd447fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd448107ac0 0x7fd44819ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.968+0000 7fd447fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd448107ac0 0x7fd44819ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38604/0 (socket says 172.21.15.7:38604) 2024-09-19T08:54:46.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.968+0000 7fd447fff640 1 -- 172.21.15.7:0/3618500652 learned_addr learned my addr 172.21.15.7:0/3618500652 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:46.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.969+0000 7fd4477fe640 1 --2- 172.21.15.7:0/3618500652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd448101ab0 0x7fd44819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.969+0000 7fd43effd640 1 --2- 172.21.15.7:0/3618500652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd448102450 0x7fd44819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.969+0000 7fd447fff640 1 -- 172.21.15.7:0/3618500652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd448101ab0 msgr2=0x7fd44819a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.969+0000 7fd447fff640 1 --2- 172.21.15.7:0/3618500652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd448101ab0 0x7fd44819a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.969+0000 7fd447fff640 1 -- 172.21.15.7:0/3618500652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd448102450 msgr2=0x7fd44819aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.969+0000 7fd447fff640 1 --2- 172.21.15.7:0/3618500652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd448102450 0x7fd44819aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.969+0000 7fd447fff640 1 -- 172.21.15.7:0/3618500652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44819f580 con 0x7fd448107ac0 2024-09-19T08:54:46.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.969+0000 7fd4477fe640 1 --2- 172.21.15.7:0/3618500652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd448101ab0 0x7fd44819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:46.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.969+0000 7fd447fff640 1 --2- 172.21.15.7:0/3618500652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd448107ac0 0x7fd44819ee50 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fd440005cc0 tx=0x7fd440003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:46.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.969+0000 7fd4457fa640 1 -- 172.21.15.7:0/3618500652 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440004040 con 0x7fd448107ac0 2024-09-19T08:54:46.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.969+0000 7fd44de5e640 1 -- 172.21.15.7:0/3618500652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd44819f810 con 0x7fd448107ac0 2024-09-19T08:54:46.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.969+0000 7fd4457fa640 1 -- 172.21.15.7:0/3618500652 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4400046c0 con 0x7fd448107ac0 2024-09-19T08:54:46.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.969+0000 7fd4457fa640 1 -- 172.21.15.7:0/3618500652 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440046480 con 0x7fd448107ac0 2024-09-19T08:54:46.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.969+0000 7fd44de5e640 1 -- 172.21.15.7:0/3618500652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4481a7100 con 0x7fd448107ac0 2024-09-19T08:54:46.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.970+0000 7fd44de5e640 1 -- 172.21.15.7:0/3618500652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd448101f10 con 0x7fd448107ac0 2024-09-19T08:54:46.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.971+0000 7fd4457fa640 1 -- 172.21.15.7:0/3618500652 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fd4400305a0 con 0x7fd448107ac0 2024-09-19T08:54:46.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.972+0000 7fd4457fa640 1 --2- 172.21.15.7:0/3618500652 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd4340a33c0 0x7fd4340a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.972+0000 7fd4457fa640 1 -- 172.21.15.7:0/3618500652 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7fd44002e030 con 0x7fd448107ac0 2024-09-19T08:54:46.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.972+0000 7fd4477fe640 1 --2- 172.21.15.7:0/3618500652 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd4340a33c0 0x7fd4340a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.973+0000 7fd4477fe640 1 --2- 172.21.15.7:0/3618500652 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd4340a33c0 0x7fd4340a5880 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd438005fd0 tx=0x7fd4380094d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:46.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:46.975+0000 7fd4457fa640 1 -- 172.21.15.7:0/3618500652 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd44004b060 con 0x7fd448107ac0 2024-09-19T08:54:47.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.156+0000 7fd44de5e640 1 -- 172.21.15.7:0/3618500652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4481a73a0 con 0x7fd448107ac0 2024-09-19T08:54:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.158+0000 7fd4457fa640 1 -- 172.21.15.7:0/3618500652 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+23155 (secure 0 0 0) 0x7fd4400be170 con 0x7fd448107ac0 2024-09-19T08:54:47.157 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:54:47.158 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":91,"fsid":"ebd23124-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:02.287380+0000","modified":"2024-09-19T08:54:18.170249+0000","last_up_change":"2024-09-19T08:41:54.742978+0000","last_in_change":"2024-09-19T08:41:31.685622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:13.285118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:42:40.425852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:42:43.006548+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":90,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"837e6267-71c7-4f48-9e0b-4e3f124682b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6803","nonce":402668717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6805","nonce":402668717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6809","nonce":402668717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6807","nonce":402668717}]},"public_addr":"172.21.15.7:6803/402668717","cluster_addr":"172.21.15.7:6805/402668717","heartbeat_back_addr":"172.21.15.7:6809/402668717","heartbeat_front_addr":"172.21.15.7:6807/402668717","state":["exists","up"]},{"osd":1,"uuid":"67865372-ac22-4b30-bd02-498e118d6701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6801","nonce":2213694259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6803","nonce":2213694259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6807","nonce":2213694259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6805","nonce":2213694259}]},"public_addr":"172.21.15.44:6801/2213694259","cluster_addr":"172.21.15.44:6803/2213694259","heartbeat_back_addr":"172.21.15.44:6807/2213694259","heartbeat_front_addr":"172.21.15.44:6805/2213694259","state":["exists","up"]},{"osd":2,"uuid":"37c1cc2b-60ea-449f-baa7-c65d96c3559c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6801","nonce":3413002145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6803","nonce":3413002145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6807","nonce":3413002145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6805","nonce":3413002145}]},"public_addr":"172.21.15.175:6801/3413002145","cluster_addr":"172.21.15.175:6803/3413002145","heartbeat_back_addr":"172.21.15.175:6807/3413002145","heartbeat_front_addr":"172.21.15.175:6805/3413002145","state":["exists","up"]},{"osd":3,"uuid":"a8ffd2ae-4211-492a-a8ac-d4d6cbb4a03d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6811","nonce":2528867083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6813","nonce":2528867083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6817","nonce":2528867083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6815","nonce":2528867083}]},"public_addr":"172.21.15.7:6811/2528867083","cluster_addr":"172.21.15.7:6813/2528867083","heartbeat_back_addr":"172.21.15.7:6817/2528867083","heartbeat_front_addr":"172.21.15.7:6815/2528867083","state":["exists","up"]},{"osd":4,"uuid":"9a67b2ec-1a0a-413e-bd13-9532f24a0155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6809","nonce":3537143774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537143774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537143774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537143774}]},"public_addr":"172.21.15.44:6809/3537143774","cluster_addr":"172.21.15.44:6811/3537143774","heartbeat_back_addr":"172.21.15.44:6815/3537143774","heartbeat_front_addr":"172.21.15.44:6813/3537143774","state":["exists","up"]},{"osd":5,"uuid":"436cd596-710b-48e2-8255-8427c93cee1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6809","nonce":4001214751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6811","nonce":4001214751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6815","nonce":4001214751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6813","nonce":4001214751}]},"public_addr":"172.21.15.175:6809/4001214751","cluster_addr":"172.21.15.175:6811/4001214751","heartbeat_back_addr":"172.21.15.175:6815/4001214751","heartbeat_front_addr":"172.21.15.175:6813/4001214751","state":["exists","up"]},{"osd":6,"uuid":"f5a7ad2b-6b44-4b5a-8af7-f7fb00e7ca68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6819","nonce":1261079202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6821","nonce":1261079202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6825","nonce":1261079202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6823","nonce":1261079202}]},"public_addr":"172.21.15.7:6819/1261079202","cluster_addr":"172.21.15.7:6821/1261079202","heartbeat_back_addr":"172.21.15.7:6825/1261079202","heartbeat_front_addr":"172.21.15.7:6823/1261079202","state":["exists","up"]},{"osd":7,"uuid":"aa24aee5-6449-4842-8831-1c8e06cde75b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6817","nonce":3120822957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6819","nonce":3120822957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6823","nonce":3120822957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6821","nonce":3120822957}]},"public_addr":"172.21.15.44:6817/3120822957","cluster_addr":"172.21.15.44:6819/3120822957","heartbeat_back_addr":"172.21.15.44:6823/3120822957","heartbeat_front_addr":"172.21.15.44:6821/3120822957","state":["exists","up"]},{"osd":8,"uuid":"d912501a-bb7a-489e-b6ab-e451fb22210d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6817","nonce":2080374927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6819","nonce":2080374927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6823","nonce":2080374927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6821","nonce":2080374927}]},"public_addr":"172.21.15.175:6817/2080374927","cluster_addr":"172.21.15.175:6819/2080374927","heartbeat_back_addr":"172.21.15.175:6823/2080374927","heartbeat_front_addr":"172.21.15.175:6821/2080374927","state":["exists","up"]},{"osd":9,"uuid":"d132f5b2-75b9-4d6c-89ec-f52c303e0fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6827","nonce":3808356432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6829","nonce":3808356432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6833","nonce":3808356432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6831","nonce":3808356432}]},"public_addr":"172.21.15.7:6827/3808356432","cluster_addr":"172.21.15.7:6829/3808356432","heartbeat_back_addr":"172.21.15.7:6833/3808356432","heartbeat_front_addr":"172.21.15.7:6831/3808356432","state":["exists","up"]},{"osd":10,"uuid":"f6c405d6-a255-4e0e-8528-7bbc16d5e434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6825","nonce":4009464689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6827","nonce":4009464689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6831","nonce":4009464689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6829","nonce":4009464689}]},"public_addr":"172.21.15.44:6825/4009464689","cluster_addr":"172.21.15.44:6827/4009464689","heartbeat_back_addr":"172.21.15.44:6831/4009464689","heartbeat_front_addr":"172.21.15.44:6829/4009464689","state":["exists","up"]},{"osd":11,"uuid":"a2a046cd-9939-473a-988b-6e0ad28a0233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6825","nonce":4173951310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6827","nonce":4173951310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6831","nonce":4173951310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6829","nonce":4173951310}]},"public_addr":"172.21.15.175:6825/4173951310","cluster_addr":"172.21.15.175:6827/4173951310","heartbeat_back_addr":"172.21.15.175:6831/4173951310","heartbeat_front_addr":"172.21.15.175:6829/4173951310","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:20.015497+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:44.967046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:09.682080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:35.516899+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:00.705686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:25.276387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:49.927456+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:14.786755+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:38.553913+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.962825+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.812976+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:52.837744+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/973276283":"2024-09-20T08:44:31.163626+0000","172.21.15.7:0/2695884066":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/816886708":"2024-09-20T08:35:31.711540+0000","172.21.15.7:6800/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:6800/3577760109":"2024-09-20T08:44:31.163626+0000","172.21.15.7:0/1429582340":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/4277640815":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/499611189":"2024-09-20T08:44:31.163626+0000","172.21.15.7:6801/3577760109":"2024-09-20T08:44:31.163626+0000","172.21.15.7:0/4058698573":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/1800852158":"2024-09-20T08:44:31.163626+0000","172.21.15.7:0/2884903597":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/2457209252":"2024-09-20T08:44:31.163626+0000","172.21.15.7:6800/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/2008302629":"2024-09-20T08:44:31.163626+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:54:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.160+0000 7fd44de5e640 1 -- 172.21.15.7:0/3618500652 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd4340a33c0 msgr2=0x7fd4340a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.160+0000 7fd44de5e640 1 --2- 172.21.15.7:0/3618500652 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd4340a33c0 0x7fd4340a5880 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd438005fd0 tx=0x7fd4380094d0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.160+0000 7fd44de5e640 1 -- 172.21.15.7:0/3618500652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd448107ac0 msgr2=0x7fd44819ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.160+0000 7fd44de5e640 1 --2- 172.21.15.7:0/3618500652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd448107ac0 0x7fd44819ee50 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fd440005cc0 tx=0x7fd440003970 comp rx=0 tx=0).stop 2024-09-19T08:54:47.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.160+0000 7fd44de5e640 1 -- 172.21.15.7:0/3618500652 shutdown_connections 2024-09-19T08:54:47.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.160+0000 7fd44de5e640 1 --2- 172.21.15.7:0/3618500652 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd4340a33c0 0x7fd4340a5880 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.160+0000 7fd44de5e640 1 --2- 172.21.15.7:0/3618500652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd448107ac0 0x7fd44819ee50 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.160+0000 7fd44de5e640 1 --2- 172.21.15.7:0/3618500652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd448102450 0x7fd44819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.160+0000 7fd44de5e640 1 --2- 172.21.15.7:0/3618500652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd448101ab0 0x7fd44819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.160+0000 7fd44de5e640 1 -- 172.21.15.7:0/3618500652 >> 172.21.15.7:0/3618500652 conn(0x7fd4480fd7d0 msgr2=0x7fd44810d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:47.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.160+0000 7fd44de5e640 1 -- 172.21.15.7:0/3618500652 shutdown_connections 2024-09-19T08:54:47.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.160+0000 7fd44de5e640 1 -- 172.21.15.7:0/3618500652 wait complete. 2024-09-19T08:54:47.172 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T08:38:13.285118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T08:42:40.425852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T08:42:43.006548+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 90, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T08:54:47.172 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T08:54:47.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.283+0000 7f8dae8af640 1 -- 172.21.15.7:0/104465432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da8106e70 msgr2=0x7f8da810e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.283+0000 7f8dae8af640 1 --2- 172.21.15.7:0/104465432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da8106e70 0x7f8da810e9f0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f8da0009ca0 tx=0x7f8da002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.283+0000 7f8dae8af640 1 -- 172.21.15.7:0/104465432 shutdown_connections 2024-09-19T08:54:47.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.283+0000 7f8dae8af640 1 --2- 172.21.15.7:0/104465432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da8106e70 0x7f8da810e9f0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.283+0000 7f8dae8af640 1 --2- 172.21.15.7:0/104465432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8da806a110 0x7f8da8106740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.283+0000 7f8dae8af640 1 --2- 172.21.15.7:0/104465432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da8069760 0x7f8da8069b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.283+0000 7f8dae8af640 1 -- 172.21.15.7:0/104465432 >> 172.21.15.7:0/104465432 conn(0x7f8da80766f0 msgr2=0x7f8da8076b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:47.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.283+0000 7f8dae8af640 1 -- 172.21.15.7:0/104465432 shutdown_connections 2024-09-19T08:54:47.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.283+0000 7f8dae8af640 1 -- 172.21.15.7:0/104465432 wait complete. 2024-09-19T08:54:47.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.283+0000 7f8dae8af640 1 Processor -- start 2024-09-19T08:54:47.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.283+0000 7f8dae8af640 1 -- start start 2024-09-19T08:54:47.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.284+0000 7f8dae8af640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da8069760 0x7f8da8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:47.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.284+0000 7f8dae8af640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da8106e70 0x7f8da8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:47.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.284+0000 7f8dae8af640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8da8101950 0x7f8da81a6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:47.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.284+0000 7f8dae8af640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8da8111ed0 con 0x7f8da8069760 2024-09-19T08:54:47.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.284+0000 7f8dae8af640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8da8111d50 con 0x7f8da8106e70 2024-09-19T08:54:47.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.284+0000 7f8dae8af640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8da8112050 con 0x7f8da8101950 2024-09-19T08:54:47.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.284+0000 7f8da7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da8069760 0x7f8da8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:47.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.284+0000 7f8da7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da8069760 0x7f8da8100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38628/0 (socket says 172.21.15.7:38628) 2024-09-19T08:54:47.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.284+0000 7f8da7fff640 1 -- 172.21.15.7:0/1249264576 learned_addr learned my addr 172.21.15.7:0/1249264576 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:47.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.284+0000 7f8dace4c640 1 --2- 172.21.15.7:0/1249264576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8da8101950 0x7f8da81a6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:47.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.284+0000 7f8d9ffff640 1 --2- 172.21.15.7:0/1249264576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da8106e70 0x7f8da8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:47.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.284+0000 7f8da7fff640 1 -- 172.21.15.7:0/1249264576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8da8101950 msgr2=0x7f8da81a6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.284+0000 7f8da7fff640 1 --2- 172.21.15.7:0/1249264576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8da8101950 0x7f8da81a6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.284+0000 7f8da7fff640 1 -- 172.21.15.7:0/1249264576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da8106e70 msgr2=0x7f8da8101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.284+0000 7f8da7fff640 1 --2- 172.21.15.7:0/1249264576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da8106e70 0x7f8da8101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.284+0000 7f8da7fff640 1 -- 172.21.15.7:0/1249264576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da81a6c60 con 0x7f8da8069760 2024-09-19T08:54:47.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.284+0000 7f8da7fff640 1 --2- 172.21.15.7:0/1249264576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da8069760 0x7f8da8100ed0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800ea60 tx=0x7f8d9800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:47.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.284+0000 7f8da5ffb640 1 -- 172.21.15.7:0/1249264576 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9800cde0 con 0x7f8da8069760 2024-09-19T08:54:47.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.284+0000 7f8dae8af640 1 -- 172.21.15.7:0/1249264576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da81a6f50 con 0x7f8da8069760 2024-09-19T08:54:47.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.284+0000 7f8da5ffb640 1 -- 172.21.15.7:0/1249264576 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d980035f0 con 0x7f8da8069760 2024-09-19T08:54:47.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.284+0000 7f8da5ffb640 1 -- 172.21.15.7:0/1249264576 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d98010670 con 0x7f8da8069760 2024-09-19T08:54:47.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.284+0000 7f8dae8af640 1 -- 172.21.15.7:0/1249264576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da81a7410 con 0x7f8da8069760 2024-09-19T08:54:47.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.285+0000 7f8dae8af640 1 -- 172.21.15.7:0/1249264576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8da8069b40 con 0x7f8da8069760 2024-09-19T08:54:47.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.287+0000 7f8da5ffb640 1 -- 172.21.15.7:0/1249264576 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8d980037a0 con 0x7f8da8069760 2024-09-19T08:54:47.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.287+0000 7f8da5ffb640 1 --2- 172.21.15.7:0/1249264576 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8d940a33f0 0x7f8d940a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:47.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.288+0000 7f8da5ffb640 1 -- 172.21.15.7:0/1249264576 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f8d980d0080 con 0x7f8da8069760 2024-09-19T08:54:47.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.288+0000 7f8d9ffff640 1 --2- 172.21.15.7:0/1249264576 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8d940a33f0 0x7f8d940a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:47.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.288+0000 7f8d9ffff640 1 --2- 172.21.15.7:0/1249264576 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8d940a33f0 0x7f8d940a58b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8da8102960 tx=0x7f8d90005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:47.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.291+0000 7f8da5ffb640 1 -- 172.21.15.7:0/1249264576 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8d9809cab0 con 0x7f8da8069760 2024-09-19T08:54:47.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:47 smithi175 ceph-mon[35688]: pgmap v318: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:54:47.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:47 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:47.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.497+0000 7f8dae8af640 1 -- 172.21.15.7:0/1249264576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8da806a110 con 0x7f8da8069760 2024-09-19T08:54:47.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.498+0000 7f8da5ffb640 1 -- 172.21.15.7:0/1249264576 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7f8d9809c3b0 con 0x7f8da8069760 2024-09-19T08:54:47.497 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-19T08:54:47.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.500+0000 7f8dae8af640 1 -- 172.21.15.7:0/1249264576 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8d940a33f0 msgr2=0x7f8d940a58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.500+0000 7f8dae8af640 1 --2- 172.21.15.7:0/1249264576 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8d940a33f0 0x7f8d940a58b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8da8102960 tx=0x7f8d90005f90 comp rx=0 tx=0).stop 2024-09-19T08:54:47.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.500+0000 7f8dae8af640 1 -- 172.21.15.7:0/1249264576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da8069760 msgr2=0x7f8da8100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.500+0000 7f8dae8af640 1 --2- 172.21.15.7:0/1249264576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da8069760 0x7f8da8100ed0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800ea60 tx=0x7f8d9800ef20 comp rx=0 tx=0).stop 2024-09-19T08:54:47.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.500+0000 7f8dae8af640 1 -- 172.21.15.7:0/1249264576 shutdown_connections 2024-09-19T08:54:47.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.500+0000 7f8dae8af640 1 --2- 172.21.15.7:0/1249264576 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8d940a33f0 0x7f8d940a58b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.500+0000 7f8dae8af640 1 --2- 172.21.15.7:0/1249264576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8da8101950 0x7f8da81a6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.500+0000 7f8dae8af640 1 --2- 172.21.15.7:0/1249264576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8da8106e70 0x7f8da8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.500+0000 7f8dae8af640 1 --2- 172.21.15.7:0/1249264576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8da8069760 0x7f8da8100ed0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.500+0000 7f8dae8af640 1 -- 172.21.15.7:0/1249264576 >> 172.21.15.7:0/1249264576 conn(0x7f8da80766f0 msgr2=0x7f8da80ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:47.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.500+0000 7f8dae8af640 1 -- 172.21.15.7:0/1249264576 shutdown_connections 2024-09-19T08:54:47.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.500+0000 7f8dae8af640 1 -- 172.21.15.7:0/1249264576 wait complete. 2024-09-19T08:54:47.511 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:47 smithi007 ceph-mon[31221]: pgmap v318: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:54:47.511 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:47 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:47.513 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T08:54:47.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:47 smithi044 ceph-mon[35072]: pgmap v318: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T08:54:47.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:47 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.622+0000 7f2a04f0c640 1 -- 172.21.15.7:0/2676404392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a001069b0 msgr2=0x7f2a00106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.622+0000 7f2a04f0c640 1 --2- 172.21.15.7:0/2676404392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a001069b0 0x7f2a00106d90 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f29f8009930 tx=0x7f29f802a420 comp rx=0 tx=0).stop 2024-09-19T08:54:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.622+0000 7f2a04f0c640 1 -- 172.21.15.7:0/2676404392 shutdown_connections 2024-09-19T08:54:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.622+0000 7f2a04f0c640 1 --2- 172.21.15.7:0/2676404392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a001017a0 0x7f2a0010d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.622+0000 7f2a04f0c640 1 --2- 172.21.15.7:0/2676404392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a00100e00 0x7f2a00101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.622+0000 7f2a04f0c640 1 --2- 172.21.15.7:0/2676404392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a001069b0 0x7f2a00106d90 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.622+0000 7f2a04f0c640 1 -- 172.21.15.7:0/2676404392 >> 172.21.15.7:0/2676404392 conn(0x7f2a000766f0 msgr2=0x7f2a00076b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.622+0000 7f2a04f0c640 1 -- 172.21.15.7:0/2676404392 shutdown_connections 2024-09-19T08:54:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.622+0000 7f2a04f0c640 1 -- 172.21.15.7:0/2676404392 wait complete. 2024-09-19T08:54:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.622+0000 7f2a04f0c640 1 Processor -- start 2024-09-19T08:54:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.623+0000 7f2a04f0c640 1 -- start start 2024-09-19T08:54:47.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.623+0000 7f2a04f0c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a00100e00 0x7f2a00199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.623+0000 7f2a04f0c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a001017a0 0x7f2a001997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.623+0000 7f2a04f0c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a001069b0 0x7f2a001a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.623+0000 7f2a04f0c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2a00110e00 con 0x7f2a001017a0 2024-09-19T08:54:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.623+0000 7f2a04f0c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2a00110c80 con 0x7f2a001069b0 2024-09-19T08:54:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.623+0000 7f2a04f0c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2a00110f80 con 0x7f2a00100e00 2024-09-19T08:54:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.623+0000 7f29fdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a001017a0 0x7f2a001997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.623+0000 7f29fdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a001017a0 0x7f2a001997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38648/0 (socket says 172.21.15.7:38648) 2024-09-19T08:54:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.623+0000 7f29fdd9b640 1 -- 172.21.15.7:0/1304128545 learned_addr learned my addr 172.21.15.7:0/1304128545 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.623+0000 7f29fed9d640 1 --2- 172.21.15.7:0/1304128545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a001069b0 0x7f2a001a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.623+0000 7f29fe59c640 1 --2- 172.21.15.7:0/1304128545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a00100e00 0x7f2a00199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.623+0000 7f29fdd9b640 1 -- 172.21.15.7:0/1304128545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a00100e00 msgr2=0x7f2a00199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.623+0000 7f29fdd9b640 1 --2- 172.21.15.7:0/1304128545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a00100e00 0x7f2a00199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.623+0000 7f29fdd9b640 1 -- 172.21.15.7:0/1304128545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a001069b0 msgr2=0x7f2a001a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.623+0000 7f29fdd9b640 1 --2- 172.21.15.7:0/1304128545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a001069b0 0x7f2a001a4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.623+0000 7f29fdd9b640 1 -- 172.21.15.7:0/1304128545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a001a4840 con 0x7f2a001017a0 2024-09-19T08:54:47.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.623+0000 7f29fdd9b640 1 --2- 172.21.15.7:0/1304128545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a001017a0 0x7f2a001997c0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f29e800c920 tx=0x7f29e800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:47.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.624+0000 7f29f77fe640 1 -- 172.21.15.7:0/1304128545 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8007c70 con 0x7f2a001017a0 2024-09-19T08:54:47.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.624+0000 7f29f77fe640 1 -- 172.21.15.7:0/1304128545 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29e8007e10 con 0x7f2a001017a0 2024-09-19T08:54:47.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.624+0000 7f29f77fe640 1 -- 172.21.15.7:0/1304128545 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8018890 con 0x7f2a001017a0 2024-09-19T08:54:47.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.624+0000 7f2a04f0c640 1 -- 172.21.15.7:0/1304128545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a001a4a10 con 0x7f2a001017a0 2024-09-19T08:54:47.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.624+0000 7f2a04f0c640 1 -- 172.21.15.7:0/1304128545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a001a4ee0 con 0x7f2a001017a0 2024-09-19T08:54:47.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.625+0000 7f2a04f0c640 1 -- 172.21.15.7:0/1304128545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a00101260 con 0x7f2a001017a0 2024-09-19T08:54:47.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.626+0000 7f29f77fe640 1 -- 172.21.15.7:0/1304128545 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f29e8018a70 con 0x7f2a001017a0 2024-09-19T08:54:47.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.627+0000 7f29f77fe640 1 --2- 172.21.15.7:0/1304128545 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f29ec0a33c0 0x7f29ec0a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:47.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.627+0000 7f29f77fe640 1 -- 172.21.15.7:0/1304128545 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f29e80cff10 con 0x7f2a001017a0 2024-09-19T08:54:47.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.627+0000 7f29fe59c640 1 --2- 172.21.15.7:0/1304128545 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f29ec0a33c0 0x7f29ec0a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:47.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.627+0000 7f29fe59c640 1 --2- 172.21.15.7:0/1304128545 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f29ec0a33c0 0x7f29ec0a5880 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f29f8006010 tx=0x7f29f8000bc0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:47.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.631+0000 7f29f77fe640 1 -- 172.21.15.7:0/1304128545 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f29e8014030 con 0x7f2a001017a0 2024-09-19T08:54:47.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.811+0000 7f2a04f0c640 1 -- 172.21.15.7:0/1304128545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2a00108f10 con 0x7f2a001017a0 2024-09-19T08:54:47.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.811+0000 7f29f77fe640 1 -- 172.21.15.7:0/1304128545 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7f29e809c850 con 0x7f2a001017a0 2024-09-19T08:54:47.811 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-19T08:54:47.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.814+0000 7f2a04f0c640 1 -- 172.21.15.7:0/1304128545 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f29ec0a33c0 msgr2=0x7f29ec0a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.814+0000 7f2a04f0c640 1 --2- 172.21.15.7:0/1304128545 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f29ec0a33c0 0x7f29ec0a5880 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f29f8006010 tx=0x7f29f8000bc0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.814+0000 7f2a04f0c640 1 -- 172.21.15.7:0/1304128545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a001017a0 msgr2=0x7f2a001997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.814+0000 7f2a04f0c640 1 --2- 172.21.15.7:0/1304128545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a001017a0 0x7f2a001997c0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f29e800c920 tx=0x7f29e800cde0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.814+0000 7f2a04f0c640 1 -- 172.21.15.7:0/1304128545 shutdown_connections 2024-09-19T08:54:47.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.814+0000 7f2a04f0c640 1 --2- 172.21.15.7:0/1304128545 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f29ec0a33c0 0x7f29ec0a5880 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.814+0000 7f2a04f0c640 1 --2- 172.21.15.7:0/1304128545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a001069b0 0x7f2a001a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.814+0000 7f2a04f0c640 1 --2- 172.21.15.7:0/1304128545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a001017a0 0x7f2a001997c0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.814+0000 7f2a04f0c640 1 --2- 172.21.15.7:0/1304128545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a00100e00 0x7f2a00199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.814+0000 7f2a04f0c640 1 -- 172.21.15.7:0/1304128545 >> 172.21.15.7:0/1304128545 conn(0x7f2a000766f0 msgr2=0x7f2a000feef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:47.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.814+0000 7f2a04f0c640 1 -- 172.21.15.7:0/1304128545 shutdown_connections 2024-09-19T08:54:47.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.814+0000 7f2a04f0c640 1 -- 172.21.15.7:0/1304128545 wait complete. 2024-09-19T08:54:47.825 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T08:54:47.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.933+0000 7fdb24366640 1 -- 172.21.15.7:0/4233753832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb1c103620 msgr2=0x7fdb1c10bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.933+0000 7fdb24366640 1 --2- 172.21.15.7:0/4233753832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb1c103620 0x7fdb1c10bb00 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c009900 tx=0x7fdb0c02a480 comp rx=0 tx=0).stop 2024-09-19T08:54:47.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.933+0000 7fdb24366640 1 -- 172.21.15.7:0/4233753832 shutdown_connections 2024-09-19T08:54:47.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.933+0000 7fdb24366640 1 --2- 172.21.15.7:0/4233753832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb1c10c090 0x7fdb1c10e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.933+0000 7fdb24366640 1 --2- 172.21.15.7:0/4233753832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb1c103620 0x7fdb1c10bb00 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.933+0000 7fdb24366640 1 --2- 172.21.15.7:0/4233753832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb1c102d00 0x7fdb1c1030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.933+0000 7fdb24366640 1 -- 172.21.15.7:0/4233753832 >> 172.21.15.7:0/4233753832 conn(0x7fdb1c0fc690 msgr2=0x7fdb1c0feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:47.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.933+0000 7fdb24366640 1 -- 172.21.15.7:0/4233753832 shutdown_connections 2024-09-19T08:54:47.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.933+0000 7fdb24366640 1 -- 172.21.15.7:0/4233753832 wait complete. 2024-09-19T08:54:47.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.934+0000 7fdb24366640 1 Processor -- start 2024-09-19T08:54:47.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.934+0000 7fdb24366640 1 -- start start 2024-09-19T08:54:47.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.934+0000 7fdb24366640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb1c102d00 0x7fdb1c100950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:47.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.934+0000 7fdb24366640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb1c103620 0x7fdb1c100e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:47.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.934+0000 7fdb24366640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb1c10c090 0x7fdb1c1013d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:47.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.934+0000 7fdb24366640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c111e90 con 0x7fdb1c10c090 2024-09-19T08:54:47.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.934+0000 7fdb24366640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c111d10 con 0x7fdb1c102d00 2024-09-19T08:54:47.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.934+0000 7fdb24366640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c112010 con 0x7fdb1c103620 2024-09-19T08:54:47.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.934+0000 7fdb22903640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb1c10c090 0x7fdb1c1013d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:47.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.934+0000 7fdb22903640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb1c10c090 0x7fdb1c1013d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38672/0 (socket says 172.21.15.7:38672) 2024-09-19T08:54:47.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.934+0000 7fdb22903640 1 -- 172.21.15.7:0/2696278921 learned_addr learned my addr 172.21.15.7:0/2696278921 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:47.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.934+0000 7fdb22102640 1 --2- 172.21.15.7:0/2696278921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb1c102d00 0x7fdb1c100950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:47.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.934+0000 7fdb21901640 1 --2- 172.21.15.7:0/2696278921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb1c103620 0x7fdb1c100e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:47.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.935+0000 7fdb22903640 1 -- 172.21.15.7:0/2696278921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb1c103620 msgr2=0x7fdb1c100e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.935+0000 7fdb22903640 1 --2- 172.21.15.7:0/2696278921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb1c103620 0x7fdb1c100e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.935+0000 7fdb22903640 1 -- 172.21.15.7:0/2696278921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb1c102d00 msgr2=0x7fdb1c100950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.935+0000 7fdb22903640 1 --2- 172.21.15.7:0/2696278921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb1c102d00 0x7fdb1c100950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.935+0000 7fdb22903640 1 -- 172.21.15.7:0/2696278921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1c1a6910 con 0x7fdb1c10c090 2024-09-19T08:54:47.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.935+0000 7fdb22102640 1 --2- 172.21.15.7:0/2696278921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb1c102d00 0x7fdb1c100950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:47.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.935+0000 7fdb22903640 1 --2- 172.21.15.7:0/2696278921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb1c10c090 0x7fdb1c1013d0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400eb10 tx=0x7fdb1400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:47.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.935+0000 7fdb137fe640 1 -- 172.21.15.7:0/2696278921 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb14004b20 con 0x7fdb1c10c090 2024-09-19T08:54:47.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.935+0000 7fdb137fe640 1 -- 172.21.15.7:0/2696278921 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb14004cc0 con 0x7fdb1c10c090 2024-09-19T08:54:47.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.935+0000 7fdb24366640 1 -- 172.21.15.7:0/2696278921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb1c1a6c00 con 0x7fdb1c10c090 2024-09-19T08:54:47.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.935+0000 7fdb137fe640 1 -- 172.21.15.7:0/2696278921 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb14010760 con 0x7fdb1c10c090 2024-09-19T08:54:47.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.935+0000 7fdb24366640 1 -- 172.21.15.7:0/2696278921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb1c1a7150 con 0x7fdb1c10c090 2024-09-19T08:54:47.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.936+0000 7fdb24366640 1 -- 172.21.15.7:0/2696278921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb1c1030e0 con 0x7fdb1c10c090 2024-09-19T08:54:47.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.937+0000 7fdb137fe640 1 -- 172.21.15.7:0/2696278921 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fdb14005020 con 0x7fdb1c10c090 2024-09-19T08:54:47.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.938+0000 7fdb137fe640 1 --2- 172.21.15.7:0/2696278921 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdb080a3440 0x7fdb080a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:47.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.938+0000 7fdb22102640 1 --2- 172.21.15.7:0/2696278921 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdb080a3440 0x7fdb080a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:47.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.938+0000 7fdb137fe640 1 -- 172.21.15.7:0/2696278921 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7fdb140d0370 con 0x7fdb1c10c090 2024-09-19T08:54:47.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.938+0000 7fdb22102640 1 --2- 172.21.15.7:0/2696278921 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdb080a3440 0x7fdb080a5900 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009c20 tx=0x7fdb18005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:47.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:47.942+0000 7fdb137fe640 1 -- 172.21.15.7:0/2696278921 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb1409cd10 con 0x7fdb1c10c090 2024-09-19T08:54:48.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.121+0000 7fdb24366640 1 -- 172.21.15.7:0/2696278921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdb1c02d7c0 con 0x7fdb1c10c090 2024-09-19T08:54:48.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.121+0000 7fdb137fe640 1 -- 172.21.15.7:0/2696278921 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7fdb1409c610 con 0x7fdb1c10c090 2024-09-19T08:54:48.121 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-09-19T08:54:48.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.124+0000 7fdb24366640 1 -- 172.21.15.7:0/2696278921 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdb080a3440 msgr2=0x7fdb080a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:48.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.124+0000 7fdb24366640 1 --2- 172.21.15.7:0/2696278921 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdb080a3440 0x7fdb080a5900 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009c20 tx=0x7fdb18005f90 comp rx=0 tx=0).stop 2024-09-19T08:54:48.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.124+0000 7fdb24366640 1 -- 172.21.15.7:0/2696278921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb1c10c090 msgr2=0x7fdb1c1013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:48.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.124+0000 7fdb24366640 1 --2- 172.21.15.7:0/2696278921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb1c10c090 0x7fdb1c1013d0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400eb10 tx=0x7fdb1400c2d0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.124+0000 7fdb24366640 1 -- 172.21.15.7:0/2696278921 shutdown_connections 2024-09-19T08:54:48.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.124+0000 7fdb24366640 1 --2- 172.21.15.7:0/2696278921 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fdb080a3440 0x7fdb080a5900 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.124+0000 7fdb24366640 1 --2- 172.21.15.7:0/2696278921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb1c10c090 0x7fdb1c1013d0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.124+0000 7fdb24366640 1 --2- 172.21.15.7:0/2696278921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb1c103620 0x7fdb1c100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.124+0000 7fdb24366640 1 --2- 172.21.15.7:0/2696278921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb1c102d00 0x7fdb1c100950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.124+0000 7fdb24366640 1 -- 172.21.15.7:0/2696278921 >> 172.21.15.7:0/2696278921 conn(0x7fdb1c0fc690 msgr2=0x7fdb1c0fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:48.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.124+0000 7fdb24366640 1 -- 172.21.15.7:0/2696278921 shutdown_connections 2024-09-19T08:54:48.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.124+0000 7fdb24366640 1 -- 172.21.15.7:0/2696278921 wait complete. 2024-09-19T08:54:48.135 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T08:54:48.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.250+0000 7fb99472a640 1 -- 172.21.15.7:0/1585633612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb98c102cf0 msgr2=0x7fb98c1030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:48.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.250+0000 7fb99472a640 1 --2- 172.21.15.7:0/1585633612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb98c102cf0 0x7fb98c1030d0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fb988009900 tx=0x7fb98802a480 comp rx=0 tx=0).stop 2024-09-19T08:54:48.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.250+0000 7fb99472a640 1 -- 172.21.15.7:0/1585633612 shutdown_connections 2024-09-19T08:54:48.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.250+0000 7fb99472a640 1 --2- 172.21.15.7:0/1585633612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb98c10c0c0 0x7fb98c10e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.250+0000 7fb99472a640 1 --2- 172.21.15.7:0/1585633612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb98c103610 0x7fb98c10baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.250+0000 7fb99472a640 1 --2- 172.21.15.7:0/1585633612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb98c102cf0 0x7fb98c1030d0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.250+0000 7fb99472a640 1 -- 172.21.15.7:0/1585633612 >> 172.21.15.7:0/1585633612 conn(0x7fb98c077a10 msgr2=0x7fb98c0fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:48.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.250+0000 7fb99472a640 1 -- 172.21.15.7:0/1585633612 shutdown_connections 2024-09-19T08:54:48.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.250+0000 7fb99472a640 1 -- 172.21.15.7:0/1585633612 wait complete. 2024-09-19T08:54:48.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.251+0000 7fb99472a640 1 Processor -- start 2024-09-19T08:54:48.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.251+0000 7fb99472a640 1 -- start start 2024-09-19T08:54:48.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.251+0000 7fb99472a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb98c102cf0 0x7fb98c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.252+0000 7fb99472a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb98c103610 0x7fb98c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.252+0000 7fb99472a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb98c10c0c0 0x7fb98c19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.252+0000 7fb99472a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c111ec0 con 0x7fb98c102cf0 2024-09-19T08:54:48.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.252+0000 7fb99472a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c111d40 con 0x7fb98c103610 2024-09-19T08:54:48.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.252+0000 7fb99472a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c112040 con 0x7fb98c10c0c0 2024-09-19T08:54:48.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.252+0000 7fb9924c6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb98c102cf0 0x7fb98c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.252+0000 7fb9924c6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb98c102cf0 0x7fb98c198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38684/0 (socket says 172.21.15.7:38684) 2024-09-19T08:54:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.252+0000 7fb9924c6640 1 -- 172.21.15.7:0/25164941 learned_addr learned my addr 172.21.15.7:0/25164941 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:54:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.252+0000 7fb991cc5640 1 --2- 172.21.15.7:0/25164941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb98c103610 0x7fb98c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.252+0000 7fb9924c6640 1 -- 172.21.15.7:0/25164941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb98c10c0c0 msgr2=0x7fb98c19ccd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T08:54:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.252+0000 7fb9924c6640 1 --2- 172.21.15.7:0/25164941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb98c10c0c0 0x7fb98c19ccd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.252+0000 7fb9924c6640 1 -- 172.21.15.7:0/25164941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb98c103610 msgr2=0x7fb98c198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.252+0000 7fb9924c6640 1 --2- 172.21.15.7:0/25164941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb98c103610 0x7fb98c198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.252+0000 7fb9924c6640 1 -- 172.21.15.7:0/25164941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb98c19d400 con 0x7fb98c102cf0 2024-09-19T08:54:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.252+0000 7fb991cc5640 1 --2- 172.21.15.7:0/25164941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb98c103610 0x7fb98c198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.252+0000 7fb9924c6640 1 --2- 172.21.15.7:0/25164941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb98c102cf0 0x7fb98c198410 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fb988006010 tx=0x7fb9880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.252+0000 7fb9837fe640 1 -- 172.21.15.7:0/25164941 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98803f030 con 0x7fb98c102cf0 2024-09-19T08:54:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.252+0000 7fb9837fe640 1 -- 172.21.15.7:0/25164941 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb988031990 con 0x7fb98c102cf0 2024-09-19T08:54:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.252+0000 7fb99472a640 1 -- 172.21.15.7:0/25164941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb98c19d690 con 0x7fb98c102cf0 2024-09-19T08:54:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.253+0000 7fb9837fe640 1 -- 172.21.15.7:0/25164941 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb988035070 con 0x7fb98c102cf0 2024-09-19T08:54:48.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.253+0000 7fb99472a640 1 -- 172.21.15.7:0/25164941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb98c1a4f80 con 0x7fb98c102cf0 2024-09-19T08:54:48.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.254+0000 7fb99472a640 1 -- 172.21.15.7:0/25164941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb98c069d70 con 0x7fb98c102cf0 2024-09-19T08:54:48.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.255+0000 7fb9837fe640 1 -- 172.21.15.7:0/25164941 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fb988042030 con 0x7fb98c102cf0 2024-09-19T08:54:48.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.256+0000 7fb9837fe640 1 --2- 172.21.15.7:0/25164941 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb9780a33c0 0x7fb9780a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.256+0000 7fb9837fe640 1 -- 172.21.15.7:0/25164941 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7fb9880efde0 con 0x7fb98c102cf0 2024-09-19T08:54:48.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.256+0000 7fb991cc5640 1 --2- 172.21.15.7:0/25164941 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb9780a33c0 0x7fb9780a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.256+0000 7fb991cc5640 1 --2- 172.21.15.7:0/25164941 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb9780a33c0 0x7fb9780a5880 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb98c10e560 tx=0x7fb97c005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:48.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.261+0000 7fb9837fe640 1 -- 172.21.15.7:0/25164941 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb9880bc840 con 0x7fb98c102cf0 2024-09-19T08:54:48.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:48 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3618500652' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:54:48.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:48 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1249264576' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:54:48.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:48 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1304128545' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:54:48.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:48 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/2696278921' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:54:48.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:48 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3618500652' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:54:48.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:48 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1249264576' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:54:48.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:48 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1304128545' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:54:48.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:48 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/2696278921' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:54:48.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.525+0000 7fb99472a640 1 -- 172.21.15.7:0/25164941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fb98c107170 con 0x7fb98c102cf0 2024-09-19T08:54:48.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.532+0000 7fb9837fe640 1 -- 172.21.15.7:0/25164941 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+742860 (secure 0 0 0) 0x7fb9880bc140 con 0x7fb98c102cf0 2024-09-19T08:54:48.533 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:54:48.533 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:54:48.533 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 25, 2024-09-19T08:54:48.533 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.534 INFO:teuthology.orchestra.run.smithi007.stdout: "active_gid": 15132, 2024-09-19T08:54:48.534 INFO:teuthology.orchestra.run.smithi007.stdout: "active_name": "x", 2024-09-19T08:54:48.534 INFO:teuthology.orchestra.run.smithi007.stdout: "active_addrs": { 2024-09-19T08:54:48.534 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-19T08:54:48.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.534 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-19T08:54:48.534 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6800", 2024-09-19T08:54:48.534 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3061932294 2024-09-19T08:54:48.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.534 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2024-09-19T08:54:48.535 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6801", 2024-09-19T08:54:48.535 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3061932294 2024-09-19T08:54:48.535 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.535 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-19T08:54:48.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.535 INFO:teuthology.orchestra.run.smithi007.stdout: "active_addr": "172.21.15.7:6801/3061932294", 2024-09-19T08:54:48.535 INFO:teuthology.orchestra.run.smithi007.stdout: "active_change": "2024-09-19T08:44:31.163850+0000", 2024-09-19T08:54:48.535 INFO:teuthology.orchestra.run.smithi007.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T08:54:48.535 INFO:teuthology.orchestra.run.smithi007.stdout: "available": true, 2024-09-19T08:54:48.535 INFO:teuthology.orchestra.run.smithi007.stdout: "standbys": [ 2024-09-19T08:54:48.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.536 INFO:teuthology.orchestra.run.smithi007.stdout: "gid": 24787, 2024-09-19T08:54:48.536 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "z", 2024-09-19T08:54:48.536 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_features": 4540701547738038271, 2024-09-19T08:54:48.536 INFO:teuthology.orchestra.run.smithi007.stdout: "available_modules": [ 2024-09-19T08:54:48.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.536 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "alerts", 2024-09-19T08:54:48.536 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.536 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.536 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.536 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T08:54:48.536 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T08:54:48.537 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:48.537 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.537 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.537 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T08:54:48.537 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.537 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.537 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.537 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T08:54:48.537 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.537 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.537 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.538 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.538 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.538 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.538 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.538 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.538 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.538 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.538 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.538 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.538 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.538 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.539 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.539 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.539 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.539 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.539 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.539 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.539 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.539 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.539 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.539 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.539 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.540 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.540 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.540 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.540 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.540 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.540 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.540 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.540 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.540 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.540 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.540 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.541 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.541 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.541 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.541 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.541 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.541 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.541 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.541 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.541 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.541 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.541 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.541 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.542 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.542 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.542 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.542 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.542 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.542 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.542 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.543 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.543 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.543 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.543 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.543 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.543 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.543 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.543 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.543 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.543 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.544 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.544 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.544 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.544 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.544 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_destination": { 2024-09-19T08:54:48.544 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_destination", 2024-09-19T08:54:48.544 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.544 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.544 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.544 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.544 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.545 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.545 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.545 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email address to send alerts to", 2024-09-19T08:54:48.545 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.545 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.545 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.545 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_from_name": { 2024-09-19T08:54:48.545 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_from_name", 2024-09-19T08:54:48.545 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.545 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.545 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.546 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "Ceph", 2024-09-19T08:54:48.546 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.546 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.546 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.546 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email From: name", 2024-09-19T08:54:48.546 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.546 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.546 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.546 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_host": { 2024-09-19T08:54:48.546 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_host", 2024-09-19T08:54:48.547 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.547 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.547 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.547 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.547 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.547 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.547 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.547 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP server", 2024-09-19T08:54:48.547 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.547 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.547 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.548 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_password": { 2024-09-19T08:54:48.548 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_password", 2024-09-19T08:54:48.548 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.548 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.548 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.548 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.548 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.548 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.548 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.548 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Password to authenticate with", 2024-09-19T08:54:48.548 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.549 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.549 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.549 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_port": { 2024-09-19T08:54:48.549 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_port", 2024-09-19T08:54:48.549 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.549 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.549 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.549 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "465", 2024-09-19T08:54:48.549 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.549 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.549 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.550 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP port", 2024-09-19T08:54:48.550 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.550 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.550 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.550 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_sender": { 2024-09-19T08:54:48.550 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_sender", 2024-09-19T08:54:48.550 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.550 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.550 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.550 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.550 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.551 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.551 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.551 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP envelope sender", 2024-09-19T08:54:48.551 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.551 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.551 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.551 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_ssl": { 2024-09-19T08:54:48.551 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_ssl", 2024-09-19T08:54:48.551 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.552 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.552 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.552 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.552 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.552 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.552 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.552 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T08:54:48.552 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.552 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.552 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.552 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_user": { 2024-09-19T08:54:48.553 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_user", 2024-09-19T08:54:48.553 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.553 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.553 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.553 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.553 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.553 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.553 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.553 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "User to authenticate as", 2024-09-19T08:54:48.553 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.553 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.554 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.554 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.554 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.554 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "balancer", 2024-09-19T08:54:48.554 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.554 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.554 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.554 INFO:teuthology.orchestra.run.smithi007.stdout: "active": { 2024-09-19T08:54:48.554 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "active", 2024-09-19T08:54:48.555 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.555 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.555 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.555 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.555 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.555 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.555 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.555 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T08:54:48.555 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.555 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.555 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.556 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_time": { 2024-09-19T08:54:48.556 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_time", 2024-09-19T08:54:48.556 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.556 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.556 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.556 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0000", 2024-09-19T08:54:48.556 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.556 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.556 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.557 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T08:54:48.557 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:54:48.557 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.557 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.557 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_weekday": { 2024-09-19T08:54:48.557 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_weekday", 2024-09-19T08:54:48.557 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T08:54:48.557 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.557 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.557 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T08:54:48.557 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-19T08:54:48.558 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-19T08:54:48.558 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.558 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T08:54:48.558 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:54:48.558 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.558 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.558 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_max_iterations": { 2024-09-19T08:54:48.558 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_max_iterations", 2024-09-19T08:54:48.558 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T08:54:48.558 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.558 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.559 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "25", 2024-09-19T08:54:48.559 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T08:54:48.559 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "250", 2024-09-19T08:54:48.559 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.559 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T08:54:48.559 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.559 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.559 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.559 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_metrics": { 2024-09-19T08:54:48.559 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_metrics", 2024-09-19T08:54:48.559 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.560 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.560 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.560 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T08:54:48.560 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.560 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.560 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.560 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T08:54:48.560 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T08:54:48.560 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.560 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.560 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_step": { 2024-09-19T08:54:48.561 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_step", 2024-09-19T08:54:48.561 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T08:54:48.561 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.561 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.561 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.5", 2024-09-19T08:54:48.561 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0.001", 2024-09-19T08:54:48.561 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "0.999", 2024-09-19T08:54:48.561 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.561 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "aggressiveness of optimization", 2024-09-19T08:54:48.561 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T08:54:48.561 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.561 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.562 INFO:teuthology.orchestra.run.smithi007.stdout: "end_time": { 2024-09-19T08:54:48.562 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_time", 2024-09-19T08:54:48.562 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.562 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.562 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.562 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2359", 2024-09-19T08:54:48.562 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.562 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.562 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.562 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T08:54:48.562 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:54:48.562 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.563 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.563 INFO:teuthology.orchestra.run.smithi007.stdout: "end_weekday": { 2024-09-19T08:54:48.563 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_weekday", 2024-09-19T08:54:48.563 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T08:54:48.563 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.563 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.563 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T08:54:48.563 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-19T08:54:48.563 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-19T08:54:48.563 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.563 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T08:54:48.564 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:54:48.564 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.564 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.564 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.564 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.564 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.564 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.564 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.564 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.564 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.564 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.565 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.565 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.565 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.565 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.565 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.565 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.565 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.565 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.565 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.565 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.565 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.565 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.566 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.566 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.566 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.566 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.566 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.566 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.566 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.566 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.566 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.567 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.567 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.567 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.567 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.567 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.567 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.567 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.567 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.567 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.567 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.567 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.568 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.568 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.568 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.568 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.568 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.568 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.568 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.568 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.568 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.568 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.568 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.569 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.569 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.569 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.569 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.569 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.569 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.569 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.569 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.569 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.569 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.570 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.570 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.570 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.570 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.570 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.570 INFO:teuthology.orchestra.run.smithi007.stdout: "min_score": { 2024-09-19T08:54:48.571 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_score", 2024-09-19T08:54:48.571 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T08:54:48.571 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.571 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.571 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T08:54:48.571 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.571 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.571 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.571 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T08:54:48.571 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.571 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.572 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.572 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-19T08:54:48.572 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-19T08:54:48.572 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.572 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.572 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.572 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "upmap", 2024-09-19T08:54:48.572 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.572 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.572 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.572 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-compat", 2024-09-19T08:54:48.573 INFO:teuthology.orchestra.run.smithi007.stdout: "none", 2024-09-19T08:54:48.573 INFO:teuthology.orchestra.run.smithi007.stdout: "read", 2024-09-19T08:54:48.573 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap", 2024-09-19T08:54:48.573 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap-read" 2024-09-19T08:54:48.573 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.573 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Balancer mode", 2024-09-19T08:54:48.573 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.573 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.573 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.573 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_ids": { 2024-09-19T08:54:48.574 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_ids", 2024-09-19T08:54:48.574 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.574 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.574 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.574 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.574 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.574 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.574 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.574 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T08:54:48.574 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.574 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.574 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.575 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T08:54:48.575 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T08:54:48.575 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:48.575 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.575 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.575 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T08:54:48.575 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.575 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.575 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.575 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T08:54:48.576 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.576 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.576 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.576 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_deviation": { 2024-09-19T08:54:48.576 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_deviation", 2024-09-19T08:54:48.576 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.576 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.577 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.577 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T08:54:48.577 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T08:54:48.577 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.577 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.577 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T08:54:48.577 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T08:54:48.577 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.577 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.578 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_optimizations": { 2024-09-19T08:54:48.578 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_optimizations", 2024-09-19T08:54:48.578 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T08:54:48.578 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.578 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.578 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:48.578 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.578 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.578 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.578 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T08:54:48.578 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.579 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.579 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.579 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.579 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.579 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm", 2024-09-19T08:54:48.579 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.579 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.579 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.579 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_down_multiplier": { 2024-09-19T08:54:48.579 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_down_multiplier", 2024-09-19T08:54:48.580 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T08:54:48.580 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.580 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.580 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-19T08:54:48.580 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.580 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.580 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.580 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T08:54:48.580 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.580 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.580 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.581 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_refresh_rate": { 2024-09-19T08:54:48.581 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_refresh_rate", 2024-09-19T08:54:48.581 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:48.581 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.581 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.581 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "20", 2024-09-19T08:54:48.581 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.581 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.581 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.581 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T08:54:48.581 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.581 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.582 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.582 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_starting_port": { 2024-09-19T08:54:48.582 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_starting_port", 2024-09-19T08:54:48.582 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.582 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.582 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.582 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4721", 2024-09-19T08:54:48.582 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.582 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.582 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.582 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T08:54:48.583 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.583 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.583 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.583 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_ptrace": { 2024-09-19T08:54:48.583 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_ptrace", 2024-09-19T08:54:48.583 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.583 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.583 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.583 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.584 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.584 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.584 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.584 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T08:54:48.584 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T08:54:48.584 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.584 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.584 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_interval": { 2024-09-19T08:54:48.584 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_interval", 2024-09-19T08:54:48.584 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:48.585 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.585 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.585 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T08:54:48.585 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.585 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.585 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.585 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T08:54:48.585 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.585 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.585 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.586 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_memory_target_ratio": { 2024-09-19T08:54:48.586 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T08:54:48.586 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T08:54:48.586 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.586 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.586 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.7", 2024-09-19T08:54:48.586 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.586 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.586 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.586 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T08:54:48.587 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.587 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.587 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.587 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm_log_destination": { 2024-09-19T08:54:48.587 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm_log_destination", 2024-09-19T08:54:48.587 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.587 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.587 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.587 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.588 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.588 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.588 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.588 INFO:teuthology.orchestra.run.smithi007.stdout: "file", 2024-09-19T08:54:48.588 INFO:teuthology.orchestra.run.smithi007.stdout: "file,syslog", 2024-09-19T08:54:48.588 INFO:teuthology.orchestra.run.smithi007.stdout: "syslog" 2024-09-19T08:54:48.588 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.588 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T08:54:48.588 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.588 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.588 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.589 INFO:teuthology.orchestra.run.smithi007.stdout: "cgroups_split": { 2024-09-19T08:54:48.589 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cgroups_split", 2024-09-19T08:54:48.589 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.589 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.589 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.589 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.589 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.590 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.590 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.590 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T08:54:48.590 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.590 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.590 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.590 INFO:teuthology.orchestra.run.smithi007.stdout: "config_checks_enabled": { 2024-09-19T08:54:48.590 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_checks_enabled", 2024-09-19T08:54:48.590 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.590 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.590 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.591 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.591 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.591 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.591 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.591 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T08:54:48.591 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.591 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.591 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.591 INFO:teuthology.orchestra.run.smithi007.stdout: "config_dashboard": { 2024-09-19T08:54:48.591 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_dashboard", 2024-09-19T08:54:48.591 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.591 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.591 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.592 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.592 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.592 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.592 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.592 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T08:54:48.592 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.592 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.592 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.592 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_alertmanager": { 2024-09-19T08:54:48.592 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_alertmanager", 2024-09-19T08:54:48.592 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.593 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.593 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.593 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T08:54:48.593 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.593 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.593 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.593 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T08:54:48.593 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.593 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.593 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.593 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_base": { 2024-09-19T08:54:48.594 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_base", 2024-09-19T08:54:48.594 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.594 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.594 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.594 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T08:54:48.594 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.594 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.594 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.594 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Container image name, without the tag", 2024-09-19T08:54:48.594 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.594 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.594 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.595 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_elasticsearch": { 2024-09-19T08:54:48.595 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_elasticsearch", 2024-09-19T08:54:48.595 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.595 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.595 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.595 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T08:54:48.595 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.595 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.595 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.595 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "elasticsearch container image", 2024-09-19T08:54:48.595 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.595 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.596 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.596 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_grafana": { 2024-09-19T08:54:48.596 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_grafana", 2024-09-19T08:54:48.596 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.596 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.596 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.596 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T08:54:48.596 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.596 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.596 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.596 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T08:54:48.596 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.597 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.597 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.597 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_haproxy": { 2024-09-19T08:54:48.597 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_haproxy", 2024-09-19T08:54:48.597 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.597 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.597 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.597 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T08:54:48.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:48 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3618500652' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:54:48.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:48 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1249264576' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:54:48.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:48 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1304128545' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:54:48.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:48 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2696278921' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:54:48.605 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.605 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.605 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.606 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "HAproxy container image", 2024-09-19T08:54:48.606 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.606 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.606 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.606 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_agent": { 2024-09-19T08:54:48.606 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_agent", 2024-09-19T08:54:48.606 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.606 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.606 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.606 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T08:54:48.606 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.606 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.606 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.607 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger agent container image", 2024-09-19T08:54:48.607 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.607 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.607 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.607 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_collector": { 2024-09-19T08:54:48.607 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_collector", 2024-09-19T08:54:48.607 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.607 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.607 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.607 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T08:54:48.607 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.608 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.608 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.608 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger collector container image", 2024-09-19T08:54:48.608 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.608 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.608 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.608 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_query": { 2024-09-19T08:54:48.608 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_query", 2024-09-19T08:54:48.608 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.608 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.608 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.608 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T08:54:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger query container image", 2024-09-19T08:54:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_keepalived": { 2024-09-19T08:54:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_keepalived", 2024-09-19T08:54:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T08:54:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Keepalived container image", 2024-09-19T08:54:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_loki": { 2024-09-19T08:54:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_loki", 2024-09-19T08:54:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T08:54:48.611 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.611 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.611 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.611 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Loki container image", 2024-09-19T08:54:48.611 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.611 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.611 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.611 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_node_exporter": { 2024-09-19T08:54:48.611 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_node_exporter", 2024-09-19T08:54:48.611 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.611 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T08:54:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T08:54:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nvmeof": { 2024-09-19T08:54:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nvmeof", 2024-09-19T08:54:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.613 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.613 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.613 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T08:54:48.613 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.613 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.613 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.613 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nvme-of container image", 2024-09-19T08:54:48.613 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.613 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.613 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.613 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_prometheus": { 2024-09-19T08:54:48.614 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_prometheus", 2024-09-19T08:54:48.614 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.614 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.614 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.614 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T08:54:48.614 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.614 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.614 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.614 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T08:54:48.614 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.614 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.614 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.615 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_promtail": { 2024-09-19T08:54:48.615 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_promtail", 2024-09-19T08:54:48.615 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.615 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.615 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.615 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T08:54:48.615 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.615 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.615 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.615 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Promtail container image", 2024-09-19T08:54:48.615 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.615 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.615 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.616 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_samba": { 2024-09-19T08:54:48.616 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_samba", 2024-09-19T08:54:48.616 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.616 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.616 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.616 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T08:54:48.616 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.616 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.616 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.616 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Samba/SMB container image", 2024-09-19T08:54:48.616 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.616 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_snmp_gateway": { 2024-09-19T08:54:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_snmp_gateway", 2024-09-19T08:54:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T08:54:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SNMP Gateway container image", 2024-09-19T08:54:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: "container_init": { 2024-09-19T08:54:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_init", 2024-09-19T08:54:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T08:54:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "daemon_cache_timeout": { 2024-09-19T08:54:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "daemon_cache_timeout", 2024-09-19T08:54:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T08:54:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T08:54:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: "default_cephadm_command_timeout": { 2024-09-19T08:54:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T08:54:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "900", 2024-09-19T08:54:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T08:54:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "default_registry": { 2024-09-19T08:54:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_registry", 2024-09-19T08:54:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io", 2024-09-19T08:54:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T08:54:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "device_cache_timeout": { 2024-09-19T08:54:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_cache_timeout", 2024-09-19T08:54:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1800", 2024-09-19T08:54:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache device inventory", 2024-09-19T08:54:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "device_enhanced_scan": { 2024-09-19T08:54:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_enhanced_scan", 2024-09-19T08:54:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T08:54:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "facts_cache_timeout": { 2024-09-19T08:54:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "facts_cache_timeout", 2024-09-19T08:54:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T08:54:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache host facts data", 2024-09-19T08:54:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "grafana_dashboards_path": { 2024-09-19T08:54:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "grafana_dashboards_path", 2024-09-19T08:54:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T08:54:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T08:54:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "host_check_interval": { 2024-09-19T08:54:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "host_check_interval", 2024-09-19T08:54:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T08:54:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to perform a host check", 2024-09-19T08:54:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: "hw_monitoring": { 2024-09-19T08:54:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hw_monitoring", 2024-09-19T08:54:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T08:54:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "inventory_list_all": { 2024-09-19T08:54:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "inventory_list_all", 2024-09-19T08:54:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T08:54:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "log_refresh_metadata": { 2024-09-19T08:54:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_refresh_metadata", 2024-09-19T08:54:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T08:54:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T08:54:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T08:54:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T08:54:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T08:54:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T08:54:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T08:54:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "*", 2024-09-19T08:54:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T08:54:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "max_count_per_host": { 2024-09-19T08:54:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_count_per_host", 2024-09-19T08:54:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of daemons per service per host", 2024-09-19T08:54:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd_draining_count": { 2024-09-19T08:54:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_osd_draining_count", 2024-09-19T08:54:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T08:54:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "migration_current": { 2024-09-19T08:54:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "migration_current", 2024-09-19T08:54:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "internal - do not modify", 2024-09-19T08:54:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-19T08:54:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-19T08:54:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "root", 2024-09-19T08:54:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm-package", 2024-09-19T08:54:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: "root" 2024-09-19T08:54:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T08:54:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: "oob_default_addr": { 2024-09-19T08:54:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "oob_default_addr", 2024-09-19T08:54:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "169.254.1.1", 2024-09-19T08:54:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T08:54:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "prometheus_alerts_path": { 2024-09-19T08:54:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus_alerts_path", 2024-09-19T08:54:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T08:54:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T08:54:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_insecure": { 2024-09-19T08:54:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_insecure", 2024-09-19T08:54:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T08:54:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_password": { 2024-09-19T08:54:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_password", 2024-09-19T08:54:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T08:54:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_url": { 2024-09-19T08:54:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_url", 2024-09-19T08:54:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T08:54:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_username": { 2024-09-19T08:54:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_username", 2024-09-19T08:54:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T08:54:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: "secure_monitoring_stack": { 2024-09-19T08:54:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secure_monitoring_stack", 2024-09-19T08:54:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T08:54:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: "service_discovery_port": { 2024-09-19T08:54:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "service_discovery_port", 2024-09-19T08:54:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8765", 2024-09-19T08:54:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "cephadm service discovery port", 2024-09-19T08:54:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_config_file": { 2024-09-19T08:54:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_config_file", 2024-09-19T08:54:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T08:54:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: "use_agent": { 2024-09-19T08:54:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_agent", 2024-09-19T08:54:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T08:54:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "use_repo_digest": { 2024-09-19T08:54:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_repo_digest", 2024-09-19T08:54:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T08:54:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_failed_host_check": { 2024-09-19T08:54:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_failed_host_check", 2024-09-19T08:54:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T08:54:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_daemons": { 2024-09-19T08:54:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_daemons", 2024-09-19T08:54:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T08:54:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_hosts": { 2024-09-19T08:54:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_hosts", 2024-09-19T08:54:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T08:54:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crash", 2024-09-19T08:54:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: "retain_interval": { 2024-09-19T08:54:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retain_interval", 2024-09-19T08:54:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "31536000", 2024-09-19T08:54:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T08:54:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_recent_interval": { 2024-09-19T08:54:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_recent_interval", 2024-09-19T08:54:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1209600", 2024-09-19T08:54:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dashboard", 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T08:54:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T08:54:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T08:54:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_ENABLED": { 2024-09-19T08:54:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T08:54:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T08:54:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T08:54:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T08:54:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T08:54:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T08:54:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T08:54:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T08:54:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T08:54:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T08:54:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T08:54:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T08:54:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T08:54:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T08:54:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T08:54:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-19T08:54:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T08:54:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T08:54:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_URL": { 2024-09-19T08:54:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_URL", 2024-09-19T08:54:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T08:54:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T08:54:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-19T08:54:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T08:54:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T08:54:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T08:54:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T08:54:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T08:54:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T08:54:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T08:54:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T08:54:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T08:54:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T08:54:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T08:54:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T08:54:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T08:54:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T08:54:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T08:54:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T08:54:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T08:54:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T08:54:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T08:54:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T08:54:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T08:54:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T08:54:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T08:54:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T08:54:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T08:54:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T08:54:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T08:54:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8", 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "45", 2024-09-19T08:54:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T08:54:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T08:54:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T08:54:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T08:54:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-19T08:54:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T08:54:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T08:54:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T08:54:48.708 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T08:54:48.708 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.708 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.708 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.708 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.708 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.708 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.708 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.708 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.708 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.708 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.708 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T08:54:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T08:54:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T08:54:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T08:54:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T08:54:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T08:54:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T08:54:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T08:54:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: "cross_origin_url": { 2024-09-19T08:54:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cross_origin_url", 2024-09-19T08:54:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "crt_file": { 2024-09-19T08:54:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crt_file", 2024-09-19T08:54:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "debug": { 2024-09-19T08:54:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "debug", 2024-09-19T08:54:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable/disable debug options", 2024-09-19T08:54:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "jwt_token_ttl": { 2024-09-19T08:54:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "jwt_token_ttl", 2024-09-19T08:54:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "28800", 2024-09-19T08:54:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-19T08:54:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-19T08:54:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "motd": { 2024-09-19T08:54:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "motd", 2024-09-19T08:54:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "The message of the day", 2024-09-19T08:54:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect_resolve_ip_addr": { 2024-09-19T08:54:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T08:54:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-19T08:54:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-19T08:54:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-19T08:54:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-19T08:54:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-19T08:54:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8080", 2024-09-19T08:54:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-19T08:54:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-19T08:54:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl_server_port": { 2024-09-19T08:54:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl_server_port", 2024-09-19T08:54:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8443", 2024-09-19T08:54:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-19T08:54:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-19T08:54:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "redirect", 2024-09-19T08:54:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect" 2024-09-19T08:54:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-19T08:54:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-19T08:54:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-19T08:54:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-19T08:54:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-19T08:54:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: "url_prefix": { 2024-09-19T08:54:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url_prefix", 2024-09-19T08:54:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-09-19T08:54:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_monitoring": { 2024-09-19T08:54:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_monitoring", 2024-09-19T08:54:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "monitor device health metrics", 2024-09-19T08:54:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "mark_out_threshold": { 2024-09-19T08:54:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mark_out_threshold", 2024-09-19T08:54:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2419200", 2024-09-19T08:54:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T08:54:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": { 2024-09-19T08:54:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_name", 2024-09-19T08:54:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "device_health_metrics", 2024-09-19T08:54:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T08:54:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "retention_period": { 2024-09-19T08:54:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retention_period", 2024-09-19T08:54:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15552000", 2024-09-19T08:54:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain device health metrics", 2024-09-19T08:54:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_frequency": { 2024-09-19T08:54:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_frequency", 2024-09-19T08:54:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-19T08:54:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T08:54:48.743 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.743 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.743 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.743 INFO:teuthology.orchestra.run.smithi007.stdout: "self_heal": { 2024-09-19T08:54:48.743 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "self_heal", 2024-09-19T08:54:48.743 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.743 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.743 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.743 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.743 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.743 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.743 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.743 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T08:54:48.744 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.744 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.744 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.744 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T08:54:48.744 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T08:54:48.744 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:48.744 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.744 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.744 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T08:54:48.744 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.744 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.745 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.745 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T08:54:48.745 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.745 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.745 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.745 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_threshold": { 2024-09-19T08:54:48.745 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_threshold", 2024-09-19T08:54:48.745 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:48.745 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.745 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.745 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7257600", 2024-09-19T08:54:48.745 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.746 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.746 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.746 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T08:54:48.746 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.746 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.746 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.746 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.746 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.746 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "diskprediction_local", 2024-09-19T08:54:48.746 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.746 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.746 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.747 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.747 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.747 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.747 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.747 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.747 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.747 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.747 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.747 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.747 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.747 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.747 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.747 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.747 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.747 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.748 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.748 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.748 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.748 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.748 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.748 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.748 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.748 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.748 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.748 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.748 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.748 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.749 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.749 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.749 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.749 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.749 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.749 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.749 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.749 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.749 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.749 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.749 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.750 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.750 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.750 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.750 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.750 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.750 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.750 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.750 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.750 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.750 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.750 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.750 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.750 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.750 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.751 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.751 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.751 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.751 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.751 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.751 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.751 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.751 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.751 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.751 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.751 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.752 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.752 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.752 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.752 INFO:teuthology.orchestra.run.smithi007.stdout: "predict_interval": { 2024-09-19T08:54:48.752 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predict_interval", 2024-09-19T08:54:48.752 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.752 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.752 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.752 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-19T08:54:48.752 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.752 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.752 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.752 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.753 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.753 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.753 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.753 INFO:teuthology.orchestra.run.smithi007.stdout: "predictor_model": { 2024-09-19T08:54:48.753 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predictor_model", 2024-09-19T08:54:48.753 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.753 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.753 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.753 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "prophetstor", 2024-09-19T08:54:48.753 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.753 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.753 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.753 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.754 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.754 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.754 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.754 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T08:54:48.754 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T08:54:48.754 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.754 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.754 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.754 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T08:54:48.754 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.754 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.754 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.754 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.755 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.755 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.755 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.755 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.755 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.755 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "influx", 2024-09-19T08:54:48.755 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": false, 2024-09-19T08:54:48.755 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "influxdb python module not found", 2024-09-19T08:54:48.755 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.755 INFO:teuthology.orchestra.run.smithi007.stdout: "batch_size": { 2024-09-19T08:54:48.755 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "batch_size", 2024-09-19T08:54:48.755 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.756 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.756 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.756 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5000", 2024-09-19T08:54:48.756 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.756 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.756 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.756 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T08:54:48.756 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.756 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.756 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.756 INFO:teuthology.orchestra.run.smithi007.stdout: "database": { 2024-09-19T08:54:48.756 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "database", 2024-09-19T08:54:48.756 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.757 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.757 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.757 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "ceph", 2024-09-19T08:54:48.757 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.757 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.757 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.757 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T08:54:48.757 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.757 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.757 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.757 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": { 2024-09-19T08:54:48.757 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hostname", 2024-09-19T08:54:48.758 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.758 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.758 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.758 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.758 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.758 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.758 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.758 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server hostname", 2024-09-19T08:54:48.758 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.758 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.758 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.758 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T08:54:48.758 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T08:54:48.759 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:48.759 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.759 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.759 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "30", 2024-09-19T08:54:48.759 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "5", 2024-09-19T08:54:48.759 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.759 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.759 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T08:54:48.759 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.759 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.759 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.759 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.759 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.760 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.760 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.760 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.760 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.760 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.760 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.760 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.760 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.760 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.760 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.760 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.760 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.760 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.761 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.761 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.761 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.761 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.761 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.761 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.761 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.761 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.761 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.761 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.761 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.761 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.762 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.762 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.762 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.762 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.762 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.762 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.762 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.762 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.762 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.762 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.762 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.762 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.762 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.763 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.763 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.763 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.763 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.763 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.763 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.763 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.763 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.763 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.763 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.763 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.763 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.763 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.764 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.764 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.764 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.764 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.764 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.764 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.764 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.764 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.764 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.764 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.764 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.764 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.764 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.765 INFO:teuthology.orchestra.run.smithi007.stdout: "password": { 2024-09-19T08:54:48.765 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "password", 2024-09-19T08:54:48.765 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.765 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.765 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.765 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.765 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.765 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.765 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.765 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "password of InfluxDB server user", 2024-09-19T08:54:48.765 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.765 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.765 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.766 INFO:teuthology.orchestra.run.smithi007.stdout: "port": { 2024-09-19T08:54:48.766 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "port", 2024-09-19T08:54:48.766 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.766 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.766 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.766 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8086", 2024-09-19T08:54:48.766 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.766 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.766 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.766 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server port", 2024-09-19T08:54:48.766 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.766 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.766 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.767 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-19T08:54:48.767 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-19T08:54:48.767 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.767 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.767 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.767 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "false", 2024-09-19T08:54:48.767 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.767 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.767 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.767 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:54:48.767 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.767 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.768 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.768 INFO:teuthology.orchestra.run.smithi007.stdout: "threads": { 2024-09-19T08:54:48.768 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threads", 2024-09-19T08:54:48.768 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.768 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.768 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.768 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T08:54:48.768 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T08:54:48.768 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "32", 2024-09-19T08:54:48.768 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.768 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T08:54:48.768 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.769 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.769 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.769 INFO:teuthology.orchestra.run.smithi007.stdout: "username": { 2024-09-19T08:54:48.769 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "username", 2024-09-19T08:54:48.769 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.769 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.769 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.769 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.769 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.769 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.769 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.769 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "username of InfluxDB server user", 2024-09-19T08:54:48.769 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.770 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.770 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.770 INFO:teuthology.orchestra.run.smithi007.stdout: "verify_ssl": { 2024-09-19T08:54:48.770 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "verify_ssl", 2024-09-19T08:54:48.770 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.770 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.770 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.770 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "true", 2024-09-19T08:54:48.770 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.770 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.770 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.770 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:54:48.771 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.771 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.771 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.771 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.771 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.771 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "insights", 2024-09-19T08:54:48.771 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.771 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.771 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.771 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.771 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.772 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.772 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.772 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.772 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.772 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.772 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.772 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.772 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.772 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.772 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.772 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.772 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.772 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.773 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.773 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.773 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.773 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.773 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.773 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.773 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.773 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.773 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.773 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.773 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.773 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.774 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.774 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.774 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.774 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.774 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.774 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.774 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.774 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.774 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.774 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.774 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.774 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.775 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.775 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.775 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.775 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.775 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.775 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.775 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.775 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.775 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.775 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.775 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.775 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.775 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.776 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.776 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.776 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.776 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.776 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.776 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.776 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.776 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.776 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.776 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.776 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.776 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.777 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.777 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.777 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.777 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.777 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "iostat", 2024-09-19T08:54:48.777 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.777 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.777 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.777 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.777 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.777 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.778 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.778 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.778 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.778 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.778 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.778 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.778 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.778 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.778 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.778 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.778 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.778 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.778 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.779 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.779 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.779 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.779 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.779 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.779 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.779 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.779 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.779 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.779 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.779 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.779 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.780 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.780 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.780 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.780 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.780 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.780 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.780 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.780 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.780 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.780 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.780 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.780 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.780 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.781 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.781 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.781 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.781 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.781 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.781 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.781 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.781 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.781 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.781 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.781 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.781 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.782 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.782 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.782 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.782 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.782 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.782 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.782 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.782 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.782 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.782 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.782 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.782 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.782 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.782 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.783 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.783 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "k8sevents", 2024-09-19T08:54:48.783 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.783 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.783 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.783 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_event_retention_days": { 2024-09-19T08:54:48.783 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ceph_event_retention_days", 2024-09-19T08:54:48.783 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.783 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.783 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.783 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-09-19T08:54:48.783 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.784 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.784 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.784 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T08:54:48.784 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.784 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.784 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.784 INFO:teuthology.orchestra.run.smithi007.stdout: "config_check_secs": { 2024-09-19T08:54:48.784 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_check_secs", 2024-09-19T08:54:48.784 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.784 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.784 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.784 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:48.784 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "10", 2024-09-19T08:54:48.785 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.785 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.785 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T08:54:48.785 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.785 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.785 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.785 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.785 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.785 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.785 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.785 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.785 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.786 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.786 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.786 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.786 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.786 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.786 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.786 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.786 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.786 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.786 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.786 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.786 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.786 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.787 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.787 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.787 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.787 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.787 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.787 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.787 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.787 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.787 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.787 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.787 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.787 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.788 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.788 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.788 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.788 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.788 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.788 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.788 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.788 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.788 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.788 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.788 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.788 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.789 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.789 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.789 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.789 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.789 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.789 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.789 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.789 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.789 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.789 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.789 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.789 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.790 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.790 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.790 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.790 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.790 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.790 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.790 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.790 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.790 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.791 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.791 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.791 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.791 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.791 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "localpool", 2024-09-19T08:54:48.791 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.791 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.791 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.791 INFO:teuthology.orchestra.run.smithi007.stdout: "failure_domain": { 2024-09-19T08:54:48.791 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "failure_domain", 2024-09-19T08:54:48.791 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.791 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.792 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.792 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "host", 2024-09-19T08:54:48.792 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.792 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.792 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.792 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "failure domain for any created local pool", 2024-09-19T08:54:48.792 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T08:54:48.792 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.792 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.792 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.792 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.792 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.792 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.793 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.793 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.793 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.793 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.793 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.793 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.793 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.793 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.793 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.793 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.793 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.793 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.793 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.794 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.794 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.794 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.794 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.794 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.794 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.794 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.794 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.794 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.794 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.794 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.794 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.794 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.795 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.795 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.795 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.795 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.795 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.795 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.795 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.795 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.795 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.795 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.795 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.795 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.795 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.796 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.796 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.796 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.796 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.796 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.796 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.796 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.796 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.796 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.796 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.796 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.797 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.797 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.797 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.797 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.797 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.797 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.797 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.797 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.797 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.797 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.797 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.797 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.798 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": { 2024-09-19T08:54:48.798 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_size", 2024-09-19T08:54:48.798 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.798 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.798 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.798 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.798 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.798 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.798 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.798 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default min_size for any created local pool", 2024-09-19T08:54:48.798 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T08:54:48.798 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.798 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.799 INFO:teuthology.orchestra.run.smithi007.stdout: "num_rep": { 2024-09-19T08:54:48.799 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "num_rep", 2024-09-19T08:54:48.799 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.799 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.799 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.799 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-09-19T08:54:48.799 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.799 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.799 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.799 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default replica count for any created local pool", 2024-09-19T08:54:48.799 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.799 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.800 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.800 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": { 2024-09-19T08:54:48.800 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_num", 2024-09-19T08:54:48.800 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.800 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.800 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.800 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "128", 2024-09-19T08:54:48.800 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.800 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.800 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.800 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T08:54:48.800 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.801 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.801 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.801 INFO:teuthology.orchestra.run.smithi007.stdout: "prefix": { 2024-09-19T08:54:48.801 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prefix", 2024-09-19T08:54:48.801 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.801 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.801 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.801 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.801 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.801 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.801 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.802 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name prefix for any created local pool", 2024-09-19T08:54:48.802 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.802 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.802 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.802 INFO:teuthology.orchestra.run.smithi007.stdout: "subtree": { 2024-09-19T08:54:48.802 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "subtree", 2024-09-19T08:54:48.802 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.802 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.802 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.802 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "rack", 2024-09-19T08:54:48.802 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.803 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.803 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.803 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T08:54:48.803 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T08:54:48.803 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.803 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.803 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.803 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.803 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mds_autoscaler", 2024-09-19T08:54:48.803 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.803 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.804 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.804 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.804 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.804 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.804 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.804 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.804 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.804 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.804 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.804 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.804 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.804 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.804 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.805 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.805 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.805 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.805 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.805 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.805 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.805 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.805 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.805 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.805 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.805 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.805 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.806 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.806 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.806 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.806 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.806 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.806 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.806 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.806 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.806 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.806 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.806 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.806 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.807 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.807 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.807 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.807 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.807 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.807 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.807 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.807 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.807 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.807 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.807 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.807 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.807 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.807 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.808 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.808 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.808 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.808 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.808 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.808 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.808 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.808 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.808 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.808 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.808 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.808 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.809 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.809 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.809 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.809 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.809 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.809 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.809 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirroring", 2024-09-19T08:54:48.809 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.809 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.809 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.809 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.809 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.810 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.810 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.810 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.810 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.810 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.810 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.810 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.810 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.810 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.810 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.810 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.810 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.810 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.810 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.811 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.811 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.811 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.811 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.811 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.811 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.811 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.811 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.811 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.811 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.811 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.811 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.812 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.812 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.812 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.812 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.812 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.812 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.812 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.812 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.812 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.812 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.812 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.813 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.813 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.813 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.813 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.813 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.813 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.813 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.813 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.813 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.813 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.813 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.814 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.814 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.814 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.814 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.814 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.814 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.814 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.814 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.814 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.814 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.814 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.814 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.815 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.815 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.815 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.815 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.815 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.815 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.815 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "nfs", 2024-09-19T08:54:48.815 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.815 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.815 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.816 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.816 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.816 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.816 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.816 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.816 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.816 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.816 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.816 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.816 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.816 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.816 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.816 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.817 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.817 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.817 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.817 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.817 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.817 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.817 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.817 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.817 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.817 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.817 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.817 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.818 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.818 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.818 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.818 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.818 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.818 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.818 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.818 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.818 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.818 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.818 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.818 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.819 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.819 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.819 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.819 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.819 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.819 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.819 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.819 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.819 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.819 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.819 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.819 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.819 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.820 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.820 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.820 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.820 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.820 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.820 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.820 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.820 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.820 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.820 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.820 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.820 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.821 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.821 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.821 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.821 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.821 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.821 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.821 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-19T08:54:48.821 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.821 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.821 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.821 INFO:teuthology.orchestra.run.smithi007.stdout: "fail_fs": { 2024-09-19T08:54:48.822 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "fail_fs", 2024-09-19T08:54:48.822 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.822 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.822 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.822 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.822 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.822 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.822 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.822 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T08:54:48.822 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.822 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.822 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.822 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.823 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.823 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.823 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.823 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.823 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.823 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.823 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.823 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.823 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.823 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.823 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.823 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.823 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.823 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.824 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.824 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.824 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.824 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.824 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.824 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.824 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.824 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.824 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.824 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.824 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.825 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.825 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.825 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.825 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.825 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.825 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.825 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.825 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.825 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.825 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.825 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.825 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.825 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.826 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.826 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.826 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.826 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.826 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.826 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.826 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.826 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.826 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.826 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.826 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.826 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.826 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.827 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.827 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.827 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.827 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.827 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.827 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.827 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.827 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.827 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.827 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.827 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.827 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.828 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.828 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.828 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator": { 2024-09-19T08:54:48.828 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-19T08:54:48.828 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.828 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.828 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.828 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.828 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.828 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.828 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.828 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-09-19T08:54:48.829 INFO:teuthology.orchestra.run.smithi007.stdout: "rook", 2024-09-19T08:54:48.829 INFO:teuthology.orchestra.run.smithi007.stdout: "test_orchestrator" 2024-09-19T08:54:48.829 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.829 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Orchestrator backend", 2024-09-19T08:54:48.829 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.829 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.829 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.829 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.829 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.829 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_perf_query", 2024-09-19T08:54:48.830 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.830 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.830 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.830 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.830 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.830 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.830 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.830 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.830 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.830 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.830 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.830 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.830 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.831 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.831 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.831 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.831 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.831 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.831 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.831 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.831 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.831 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.831 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.831 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.831 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.832 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.832 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.832 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.832 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.832 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.832 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.832 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.832 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.832 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.832 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.832 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.832 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.834 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.834 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.834 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.834 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.834 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.834 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.834 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.834 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.834 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.834 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.834 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.834 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.834 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.835 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.835 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.835 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.835 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.835 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.835 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.835 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.835 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.835 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_support", 2024-09-19T08:54:48.835 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.835 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.836 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.836 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.836 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.836 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.836 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.836 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.836 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.836 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.836 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.836 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.836 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.836 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.836 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.837 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.837 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.837 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.837 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.837 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.837 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.837 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.837 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.837 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.837 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.837 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.837 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.838 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.838 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.838 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.838 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.838 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.838 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.838 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.838 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.838 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.838 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.838 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.838 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.839 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.839 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.839 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.839 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.839 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.839 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.839 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.839 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.839 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.839 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.839 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.839 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.839 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.840 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.840 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.840 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.840 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.840 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.840 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.840 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.840 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.840 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.840 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.840 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.841 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.841 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.841 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.841 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.841 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.841 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.841 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.841 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.841 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_autoscaler", 2024-09-19T08:54:48.841 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.841 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.841 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.842 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.842 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.842 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.842 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.842 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.842 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.842 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.842 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.842 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.842 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.842 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.842 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.842 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.843 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.843 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.843 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.843 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.843 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.843 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.843 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.843 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.843 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.843 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.843 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.843 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.844 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.844 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.844 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.844 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.844 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.844 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.844 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.844 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.844 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.844 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.844 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.844 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.845 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.845 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.845 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.845 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.845 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.845 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.845 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.845 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.845 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.845 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.845 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.845 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.846 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.846 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.846 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.846 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.846 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.846 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.846 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.846 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.846 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.846 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.846 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.846 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.846 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.847 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.847 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.847 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.847 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.847 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T08:54:48.847 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T08:54:48.847 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:48.847 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.847 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.847 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T08:54:48.847 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.847 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.847 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.848 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.848 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.848 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.848 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.848 INFO:teuthology.orchestra.run.smithi007.stdout: "threshold": { 2024-09-19T08:54:48.848 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threshold", 2024-09-19T08:54:48.848 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T08:54:48.848 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.848 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.848 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-19T08:54:48.848 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1.0", 2024-09-19T08:54:48.848 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.849 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.849 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "scaling threshold", 2024-09-19T08:54:48.849 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T08:54:48.849 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.849 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.849 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.849 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.849 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "progress", 2024-09-19T08:54:48.849 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.849 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.849 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.850 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_pg_recovery_event": { 2024-09-19T08:54:48.850 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_pg_recovery_event", 2024-09-19T08:54:48.850 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.850 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.850 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.850 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.850 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.850 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.850 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.850 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T08:54:48.850 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.850 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.850 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.851 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-19T08:54:48.851 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-19T08:54:48.851 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.851 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.851 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.851 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.851 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.851 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.851 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.851 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.851 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.851 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.852 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.852 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.852 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.852 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.852 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.852 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.852 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.852 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.852 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.852 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.852 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.852 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.853 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.853 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.853 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.853 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.853 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.853 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.853 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.853 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.853 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.853 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.853 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.853 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.853 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.854 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.854 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.854 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.854 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.854 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.854 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.854 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.854 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.854 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.854 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.854 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.854 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.854 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.855 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.855 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.855 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.855 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.855 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.855 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.855 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.855 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.855 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.855 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.855 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.855 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.855 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.856 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.856 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.856 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.856 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.856 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.856 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.856 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.856 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.856 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.856 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.856 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.857 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.857 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.857 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.857 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.857 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.857 INFO:teuthology.orchestra.run.smithi007.stdout: "max_completed_events": { 2024-09-19T08:54:48.857 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_completed_events", 2024-09-19T08:54:48.857 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.857 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.857 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.857 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "50", 2024-09-19T08:54:48.857 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.858 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.858 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.858 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "number of past completed events to remember", 2024-09-19T08:54:48.858 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.858 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.858 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.858 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T08:54:48.858 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T08:54:48.858 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:48.858 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.858 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.858 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T08:54:48.858 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.859 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.859 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.859 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long the module is going to sleep", 2024-09-19T08:54:48.859 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.859 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.859 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.859 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.859 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.859 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus", 2024-09-19T08:54:48.859 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.859 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.860 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.860 INFO:teuthology.orchestra.run.smithi007.stdout: "cache": { 2024-09-19T08:54:48.860 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cache", 2024-09-19T08:54:48.860 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.860 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.860 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.860 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.860 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.860 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.860 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.860 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.861 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.861 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.861 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.861 INFO:teuthology.orchestra.run.smithi007.stdout: "exclude_perf_counters": { 2024-09-19T08:54:48.861 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "exclude_perf_counters", 2024-09-19T08:54:48.861 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.861 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.861 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.862 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.862 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.862 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.862 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.862 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T08:54:48.862 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T08:54:48.862 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.862 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.862 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.863 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.863 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.863 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.863 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.863 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.863 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.863 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.863 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.863 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.863 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.863 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.863 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.863 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.864 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.864 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.864 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.864 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.864 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.864 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.864 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.864 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.864 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.864 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.864 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.864 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.865 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.865 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.865 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.865 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.865 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.865 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.865 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.865 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.865 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.865 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.865 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.865 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.866 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.866 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.866 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.866 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.866 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.866 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.866 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.866 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.866 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.866 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.866 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.866 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.866 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.866 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.867 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.867 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.867 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.867 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.867 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.867 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.867 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.867 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.867 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.867 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.867 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.867 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.868 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.868 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.868 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools": { 2024-09-19T08:54:48.868 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools", 2024-09-19T08:54:48.868 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.868 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.868 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.868 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.868 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.868 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.868 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.868 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.868 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.869 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.869 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.869 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T08:54:48.869 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T08:54:48.869 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.869 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.869 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.869 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "300", 2024-09-19T08:54:48.869 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.869 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.869 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.869 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.869 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.870 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.870 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.870 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_interval": { 2024-09-19T08:54:48.870 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_interval", 2024-09-19T08:54:48.870 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T08:54:48.870 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.870 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.870 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15.0", 2024-09-19T08:54:48.870 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.870 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.870 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.870 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.871 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.871 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.871 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.871 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-19T08:54:48.871 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-19T08:54:48.871 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.871 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.871 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.871 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-19T08:54:48.871 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.871 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.871 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.871 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T08:54:48.872 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.872 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.872 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.872 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-19T08:54:48.872 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-19T08:54:48.872 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.872 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.872 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.872 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "9283", 2024-09-19T08:54:48.872 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.872 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.872 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.873 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T08:54:48.873 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.873 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.873 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.873 INFO:teuthology.orchestra.run.smithi007.stdout: "stale_cache_strategy": { 2024-09-19T08:54:48.873 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stale_cache_strategy", 2024-09-19T08:54:48.873 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.873 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.873 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.873 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "log", 2024-09-19T08:54:48.873 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.873 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.874 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.874 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.874 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.874 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.874 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.874 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-19T08:54:48.874 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-19T08:54:48.874 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.874 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.874 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.874 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "default", 2024-09-19T08:54:48.874 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.875 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.875 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.875 INFO:teuthology.orchestra.run.smithi007.stdout: "default", 2024-09-19T08:54:48.875 INFO:teuthology.orchestra.run.smithi007.stdout: "error" 2024-09-19T08:54:48.875 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.875 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.875 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.875 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.875 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.875 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-19T08:54:48.875 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-19T08:54:48.875 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.875 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.876 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.876 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-19T08:54:48.876 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-19T08:54:48.876 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-19T08:54:48.876 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.876 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.876 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.876 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.876 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.876 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.877 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.877 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-09-19T08:54:48.877 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.877 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.877 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.877 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.877 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.877 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.877 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.877 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.877 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.878 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.878 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.878 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.878 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.878 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.878 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.878 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.878 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.878 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.878 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.878 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.878 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.879 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.879 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.879 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.879 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.879 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.879 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.879 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.879 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.879 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.879 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.879 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.879 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.880 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.880 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.880 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.880 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.880 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.880 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.880 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.880 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.880 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.880 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.880 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.880 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.881 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.881 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.881 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.881 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.881 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.881 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.881 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.881 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.881 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.881 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.881 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.881 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.882 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.882 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.882 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.882 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.882 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.882 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.882 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.882 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.882 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.882 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.882 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.882 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.882 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_snap_create": { 2024-09-19T08:54:48.883 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_snap_create", 2024-09-19T08:54:48.883 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.883 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.883 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.883 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:48.883 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.883 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.883 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.883 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.883 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.883 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.883 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.883 INFO:teuthology.orchestra.run.smithi007.stdout: "mirror_snapshot_schedule": { 2024-09-19T08:54:48.884 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T08:54:48.884 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.884 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.884 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.884 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.884 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.884 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.884 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.884 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.884 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.884 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.884 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.884 INFO:teuthology.orchestra.run.smithi007.stdout: "trash_purge_schedule": { 2024-09-19T08:54:48.885 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "trash_purge_schedule", 2024-09-19T08:54:48.885 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.885 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.885 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.885 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.885 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.885 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.885 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.885 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.885 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.885 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.886 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.886 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.886 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.886 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "restful", 2024-09-19T08:54:48.886 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.886 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.886 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.886 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_auth": { 2024-09-19T08:54:48.886 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_auth", 2024-09-19T08:54:48.887 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.887 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.887 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.887 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.887 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.887 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.887 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.887 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.887 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.887 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.887 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.887 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-19T08:54:48.888 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-19T08:54:48.888 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.888 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.888 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.888 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.888 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.888 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.888 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.888 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.888 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.889 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.889 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.889 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.889 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.889 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.889 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.889 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.889 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.889 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.889 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.889 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.889 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.890 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.890 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.890 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.890 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.890 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.890 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.890 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.890 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.890 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.890 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.890 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.890 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.891 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.891 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.891 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.891 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.891 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.891 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.891 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.891 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.891 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.891 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.891 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.891 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.892 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.892 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.892 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.892 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.892 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.892 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.892 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.892 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.892 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.892 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.892 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.892 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.892 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.893 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.893 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.893 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.893 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.893 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.893 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.894 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.894 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.894 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.894 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.894 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.894 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.894 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.894 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.894 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.894 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.894 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.894 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.895 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.895 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-19T08:54:48.895 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-19T08:54:48.895 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.895 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.895 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.895 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.895 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.895 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.895 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.895 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.896 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.896 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.896 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.896 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-19T08:54:48.896 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-19T08:54:48.896 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.896 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.896 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.896 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.896 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.896 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.897 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.897 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.897 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.897 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.897 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.897 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.897 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.897 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rgw", 2024-09-19T08:54:48.898 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.898 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.898 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.898 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.898 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.898 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.898 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.898 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.898 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.898 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.898 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.898 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.898 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.898 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.899 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.899 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.899 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.899 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.899 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.899 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.899 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.899 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.899 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.899 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.899 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.899 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.900 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.900 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.900 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.900 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.900 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.900 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.900 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.900 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.900 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.900 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.900 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.900 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.901 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.901 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.901 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.901 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.901 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.901 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.901 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.901 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.901 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.901 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.901 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.901 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.901 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.902 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.902 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.902 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.902 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.902 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.902 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.902 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.902 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.902 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.902 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.902 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.902 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.903 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.903 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.903 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.903 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.903 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.903 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.903 INFO:teuthology.orchestra.run.smithi007.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T08:54:48.903 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T08:54:48.903 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.903 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.903 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.903 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T08:54:48.903 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.903 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.904 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.904 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T08:54:48.904 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.904 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.904 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.904 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.904 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.904 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rook", 2024-09-19T08:54:48.904 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.904 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.905 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.905 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.905 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.905 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.905 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.905 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.905 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.905 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.905 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.905 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.905 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.905 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.905 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.906 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.906 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.906 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.906 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.906 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.906 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.906 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.906 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.906 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.906 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.906 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.906 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.906 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.907 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.907 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.907 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.907 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.907 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.907 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.907 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.907 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.907 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.907 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.907 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.907 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.907 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.908 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.908 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.908 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.908 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.908 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.908 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.908 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.908 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.908 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.908 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.908 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.908 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.908 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.909 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.909 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.909 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.909 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.909 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.909 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.909 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.909 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.909 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.909 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.909 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.909 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.910 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.910 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.910 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.910 INFO:teuthology.orchestra.run.smithi007.stdout: "storage_class": { 2024-09-19T08:54:48.910 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "storage_class", 2024-09-19T08:54:48.910 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.910 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.910 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.910 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "local", 2024-09-19T08:54:48.910 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.910 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.910 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.911 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T08:54:48.911 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.911 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.911 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.911 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.911 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.911 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "selftest", 2024-09-19T08:54:48.911 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.911 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.911 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.911 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.911 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.912 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.912 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.912 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.912 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.912 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.912 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.912 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.912 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.912 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.912 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.912 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.912 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.913 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.913 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.913 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.913 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.913 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.913 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.913 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.913 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.913 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.913 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.913 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.913 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.914 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.914 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.914 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.914 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.914 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.914 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.914 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.914 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.914 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.914 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.914 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.914 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.914 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.915 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.915 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.915 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.915 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.915 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.915 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.915 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.915 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.915 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.915 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.915 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.915 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.915 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.916 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.916 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.916 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.916 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.916 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.916 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.916 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.916 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.916 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.916 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.916 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.916 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.917 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.917 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.917 INFO:teuthology.orchestra.run.smithi007.stdout: "roption1": { 2024-09-19T08:54:48.917 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption1", 2024-09-19T08:54:48.917 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.917 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.917 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.917 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.917 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.917 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.917 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.917 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.917 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.918 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.918 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.918 INFO:teuthology.orchestra.run.smithi007.stdout: "roption2": { 2024-09-19T08:54:48.918 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption2", 2024-09-19T08:54:48.918 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.918 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.918 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.918 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "xyz", 2024-09-19T08:54:48.918 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.918 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.918 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.918 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.918 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.919 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.919 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.919 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption1": { 2024-09-19T08:54:48.919 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption1", 2024-09-19T08:54:48.919 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.919 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.919 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.919 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.919 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.919 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.919 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.919 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.919 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.920 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.920 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.920 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption2": { 2024-09-19T08:54:48.920 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption2", 2024-09-19T08:54:48.920 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.920 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.920 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.920 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.920 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.920 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.920 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.920 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.920 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.921 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.921 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.921 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption3": { 2024-09-19T08:54:48.921 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption3", 2024-09-19T08:54:48.921 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T08:54:48.921 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.921 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.921 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.921 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.921 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.921 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.921 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.921 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.922 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.922 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.922 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption4": { 2024-09-19T08:54:48.922 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption4", 2024-09-19T08:54:48.922 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.922 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.922 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.922 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.922 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.922 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.922 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.922 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.922 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.922 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.923 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.923 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption5": { 2024-09-19T08:54:48.923 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption5", 2024-09-19T08:54:48.923 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.923 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.923 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.923 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.923 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.923 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.923 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.923 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.923 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.924 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.924 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.924 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption6": { 2024-09-19T08:54:48.924 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption6", 2024-09-19T08:54:48.924 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.924 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.924 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.924 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.924 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.924 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.924 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.924 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.925 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.925 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.925 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.925 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption7": { 2024-09-19T08:54:48.925 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption7", 2024-09-19T08:54:48.925 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.925 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.925 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.925 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.925 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T08:54:48.925 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "42", 2024-09-19T08:54:48.925 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.926 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.926 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.926 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.926 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.926 INFO:teuthology.orchestra.run.smithi007.stdout: "testkey": { 2024-09-19T08:54:48.926 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testkey", 2024-09-19T08:54:48.926 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.926 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.926 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.926 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.926 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.926 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.926 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.927 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.927 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.927 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.927 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.927 INFO:teuthology.orchestra.run.smithi007.stdout: "testlkey": { 2024-09-19T08:54:48.927 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testlkey", 2024-09-19T08:54:48.927 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.927 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.927 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.927 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.927 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.927 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.927 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.927 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.928 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.928 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.928 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.928 INFO:teuthology.orchestra.run.smithi007.stdout: "testnewline": { 2024-09-19T08:54:48.928 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testnewline", 2024-09-19T08:54:48.928 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.928 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.928 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.928 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.928 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.928 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.928 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.928 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.929 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.929 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.929 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.929 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.929 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.929 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-09-19T08:54:48.929 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.929 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.929 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.929 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_m_granularity": { 2024-09-19T08:54:48.929 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_m_granularity", 2024-09-19T08:54:48.929 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.929 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.930 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.930 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.930 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.930 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.930 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.930 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T08:54:48.930 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.930 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.930 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.930 INFO:teuthology.orchestra.run.smithi007.stdout: "dump_on_update": { 2024-09-19T08:54:48.930 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dump_on_update", 2024-09-19T08:54:48.930 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.931 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.931 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.931 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.931 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.931 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.931 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.931 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "dump database to debug log on update", 2024-09-19T08:54:48.931 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.931 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.931 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.931 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.931 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.931 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.932 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.932 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.932 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.932 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.932 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.932 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.932 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.932 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.932 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.932 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.932 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.932 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.932 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.933 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.933 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.933 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.933 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.933 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.933 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.933 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.933 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.933 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.933 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.933 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.933 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.934 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.934 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.934 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.934 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.934 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.934 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.934 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.934 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.934 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.934 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.934 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.934 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.934 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.935 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.935 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.935 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.935 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.935 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.935 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.935 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.935 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.935 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.935 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.935 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.935 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.935 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.936 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.936 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.936 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.936 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.936 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.936 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.936 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.936 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.936 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.936 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.936 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.936 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.937 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.937 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.937 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stats", 2024-09-19T08:54:48.937 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.937 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.937 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.937 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.937 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.937 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.937 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.937 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.937 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.938 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.938 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.938 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.938 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.938 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.938 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.938 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.938 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.938 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.938 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.938 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.938 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.938 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.939 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.939 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.939 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.939 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.939 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.939 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.939 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.939 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.939 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.939 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.939 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.939 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.940 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.940 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.940 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.940 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.940 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.940 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.940 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.940 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.940 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.940 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.940 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.940 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.941 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.941 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.941 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.941 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.941 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.941 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.941 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.941 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.941 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.941 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.941 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.941 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.941 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.942 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.942 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.942 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.942 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.942 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.942 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.942 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.942 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.942 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.942 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.942 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.942 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.943 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "status", 2024-09-19T08:54:48.943 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.943 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.943 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.943 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.943 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.943 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.943 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.943 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.943 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.943 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.943 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.943 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.944 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.944 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.944 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.944 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.944 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.944 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.944 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.944 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.944 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.944 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.944 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.945 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.945 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.945 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.945 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.945 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.945 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.945 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.945 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.945 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.945 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.945 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.945 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.945 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.946 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.946 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.946 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.946 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.946 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.946 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.946 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.946 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.946 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.946 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.946 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.946 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.946 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.947 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.947 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.947 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.947 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.947 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.947 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.947 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.947 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.947 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.947 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.947 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.947 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.948 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.948 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.948 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.948 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.948 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.948 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.948 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.948 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.948 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.948 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.948 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telegraf", 2024-09-19T08:54:48.949 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.949 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.949 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.949 INFO:teuthology.orchestra.run.smithi007.stdout: "address": { 2024-09-19T08:54:48.949 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "address", 2024-09-19T08:54:48.949 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.949 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.949 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.949 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T08:54:48.949 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.949 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.949 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.949 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.950 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.950 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.950 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.950 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T08:54:48.950 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T08:54:48.950 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:48.950 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.950 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.950 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15", 2024-09-19T08:54:48.950 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.950 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.950 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.951 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.951 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.951 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.951 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.951 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.951 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.951 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.951 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.951 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.951 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.951 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.951 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.951 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.952 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.952 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.952 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.952 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.952 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.952 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.952 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.952 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.952 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.952 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.952 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.952 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.953 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.953 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.953 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.953 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.953 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.953 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.953 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.953 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.953 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.953 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.953 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.953 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.953 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.954 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.954 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.954 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.954 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.954 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.954 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.954 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.954 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.954 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.954 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.954 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.954 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.954 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.955 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.955 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.955 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.955 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.955 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.955 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.955 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.955 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.955 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.955 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.955 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.955 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.956 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.956 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.956 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.956 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.956 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.956 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.956 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.956 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.956 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.956 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telemetry", 2024-09-19T08:54:48.956 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.957 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.957 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.957 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_basic": { 2024-09-19T08:54:48.957 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_basic", 2024-09-19T08:54:48.957 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.957 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.957 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.957 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.957 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.957 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.957 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.957 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T08:54:48.957 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.958 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.958 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.958 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_crash": { 2024-09-19T08:54:48.958 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_crash", 2024-09-19T08:54:48.958 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.958 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.958 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.958 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.958 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.958 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.958 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.958 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T08:54:48.958 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.959 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.959 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.959 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_device": { 2024-09-19T08:54:48.959 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_device", 2024-09-19T08:54:48.959 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.959 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.959 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.959 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.959 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.959 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.959 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.959 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T08:54:48.960 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.960 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.960 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.960 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_ident": { 2024-09-19T08:54:48.960 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_ident", 2024-09-19T08:54:48.960 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.960 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.960 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.960 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.960 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.960 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.960 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.961 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T08:54:48.961 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.961 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.961 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.961 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_perf": { 2024-09-19T08:54:48.961 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_perf", 2024-09-19T08:54:48.961 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.961 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.961 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.961 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.961 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.961 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.962 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.962 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T08:54:48.962 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.962 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.962 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.962 INFO:teuthology.orchestra.run.smithi007.stdout: "contact": { 2024-09-19T08:54:48.962 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "contact", 2024-09-19T08:54:48.962 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.962 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.962 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.962 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.962 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.962 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.963 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.963 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.963 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.963 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.963 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.963 INFO:teuthology.orchestra.run.smithi007.stdout: "description": { 2024-09-19T08:54:48.963 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "description", 2024-09-19T08:54:48.963 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.963 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.963 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.963 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.963 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.963 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.964 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.964 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.964 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.964 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.964 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.964 INFO:teuthology.orchestra.run.smithi007.stdout: "device_url": { 2024-09-19T08:54:48.964 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_url", 2024-09-19T08:54:48.964 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.964 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.964 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.964 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T08:54:48.964 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.965 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.965 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.965 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.965 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.965 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.965 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.965 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-19T08:54:48.965 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-19T08:54:48.965 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.965 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.965 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.965 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.965 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.966 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.966 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.966 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.966 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.966 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.966 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.966 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T08:54:48.966 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T08:54:48.966 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.966 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.966 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.966 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "24", 2024-09-19T08:54:48.966 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "8", 2024-09-19T08:54:48.967 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.967 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.967 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.967 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.967 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.967 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.967 INFO:teuthology.orchestra.run.smithi007.stdout: "last_opt_revision": { 2024-09-19T08:54:48.967 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "last_opt_revision", 2024-09-19T08:54:48.967 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.967 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.967 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.967 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1", 2024-09-19T08:54:48.968 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.968 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.968 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.968 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.968 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.968 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.968 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.968 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard": { 2024-09-19T08:54:48.968 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard", 2024-09-19T08:54:48.968 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.968 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.968 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.969 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.969 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.969 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.969 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.969 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.969 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.969 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.969 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.969 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard_description": { 2024-09-19T08:54:48.969 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard_description", 2024-09-19T08:54:48.969 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.969 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.969 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.970 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.970 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.970 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.970 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.970 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.970 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.970 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.970 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.970 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.970 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.970 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.970 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.970 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.971 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.971 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.971 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.971 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.971 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.971 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.971 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.971 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.971 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.971 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.971 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.971 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.971 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.971 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.972 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.972 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.972 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.972 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.972 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.972 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.972 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.972 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.972 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.972 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.972 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.972 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.973 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.973 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.973 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.973 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.973 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.973 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.973 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.973 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.973 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.973 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.973 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.973 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.973 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.974 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.974 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.974 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.974 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.974 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.974 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.974 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.974 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.974 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.974 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.974 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.974 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.974 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.975 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.975 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.975 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.975 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.975 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.975 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.975 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.975 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.975 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.975 INFO:teuthology.orchestra.run.smithi007.stdout: "organization": { 2024-09-19T08:54:48.975 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "organization", 2024-09-19T08:54:48.975 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.976 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.976 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.976 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.976 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.976 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.976 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.976 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.976 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.976 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.976 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.976 INFO:teuthology.orchestra.run.smithi007.stdout: "proxy": { 2024-09-19T08:54:48.976 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "proxy", 2024-09-19T08:54:48.977 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.977 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.977 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.977 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.977 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.977 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.977 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.977 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.977 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.977 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.977 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.977 INFO:teuthology.orchestra.run.smithi007.stdout: "url": { 2024-09-19T08:54:48.978 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url", 2024-09-19T08:54:48.978 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.978 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.978 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.978 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T08:54:48.978 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.978 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.978 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.978 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.978 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.978 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.978 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.978 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.978 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.979 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "test_orchestrator", 2024-09-19T08:54:48.979 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.979 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.979 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.979 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.979 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.979 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.979 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.979 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.979 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.979 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.979 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.980 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.980 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.980 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.980 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.980 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.980 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.980 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.980 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.980 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.980 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.980 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.980 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.981 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.981 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.981 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.981 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.981 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.981 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.981 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.981 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.981 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.981 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.981 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.981 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.981 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.982 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.982 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.982 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.982 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.982 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.982 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.982 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.982 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.982 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.982 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.982 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.982 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.982 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.983 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.983 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.983 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.983 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.983 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.983 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.983 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.983 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.983 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.983 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.983 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.983 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.984 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.984 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.984 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.984 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.984 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.984 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.984 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.984 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.984 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.984 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.984 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-09-19T08:54:48.984 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.985 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.985 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.985 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.985 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.985 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.985 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.985 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.985 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.985 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.985 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.985 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.985 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.985 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.986 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.986 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.986 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.986 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.986 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.986 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.986 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.986 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.986 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.987 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:48.987 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:48.987 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.987 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.987 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.987 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.987 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.987 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.987 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.987 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.987 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.987 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.987 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.988 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:48.988 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:48.988 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.988 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.988 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.988 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:48.988 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.988 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.988 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.988 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.988 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.988 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.989 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.989 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.989 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.989 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.989 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.989 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.989 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.989 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.989 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:48.989 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:48.989 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.989 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.989 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.990 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.990 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.990 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.990 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.990 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.990 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.990 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.990 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.990 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_clones": { 2024-09-19T08:54:48.990 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_clones", 2024-09-19T08:54:48.990 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.990 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.990 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.991 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4", 2024-09-19T08:54:48.991 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.991 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.991 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.991 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T08:54:48.991 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.991 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.991 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.991 INFO:teuthology.orchestra.run.smithi007.stdout: "periodic_async_work": { 2024-09-19T08:54:48.991 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "periodic_async_work", 2024-09-19T08:54:48.991 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.991 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.992 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.992 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:48.992 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.992 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.992 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.992 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Periodically check for async work", 2024-09-19T08:54:48.992 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.992 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.992 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.992 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_delay": { 2024-09-19T08:54:48.992 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_delay", 2024-09-19T08:54:48.992 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:48.992 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.993 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.993 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T08:54:48.993 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.993 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.993 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.993 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T08:54:48.993 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.993 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.993 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.993 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_no_wait": { 2024-09-19T08:54:48.993 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T08:54:48.993 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix", 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi007.stdout: "discovery_interval": { 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "discovery_interval", 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "100", 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi007.stdout: "identifier": { 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "identifier", 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.997 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.997 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.997 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.997 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.997 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.997 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T08:54:48.997 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T08:54:48.997 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:48.997 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.997 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:48.998 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T08:54:48.998 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.998 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.998 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:48.998 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:48.998 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:48.998 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:48.998 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:48.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:48.998 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:48.998 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:48.998 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:48.999 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:48.999 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:48.999 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:48.999 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:48.999 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:48.999 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:48.999 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:48.999 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:48.999 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:48.999 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:48.999 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:48.999 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:48.999 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:48.999 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.000 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.000 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.000 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.000 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.000 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.000 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.000 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.000 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.000 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.000 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.000 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.000 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.001 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.001 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.001 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.001 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.001 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.001 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.001 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.001 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.001 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.001 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.001 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.001 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.002 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.002 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.002 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.002 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.002 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.002 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.002 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.002 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.002 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.002 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.002 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.002 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.002 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_host": { 2024-09-19T08:54:49.004 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_host", 2024-09-19T08:54:49.004 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.004 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.004 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.004 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.004 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.004 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.004 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.004 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.004 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.004 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.004 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.005 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_port": { 2024-09-19T08:54:49.005 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_port", 2024-09-19T08:54:49.005 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.005 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.005 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.005 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10051", 2024-09-19T08:54:49.005 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.005 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.005 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.005 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.005 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.005 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.005 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.006 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_sender": { 2024-09-19T08:54:49.006 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_sender", 2024-09-19T08:54:49.006 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.006 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.006 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.006 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T08:54:49.006 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.006 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.006 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.006 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.006 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.006 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.007 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.007 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.007 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.007 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.007 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-19T08:54:49.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.007 INFO:teuthology.orchestra.run.smithi007.stdout: "gid": 24793, 2024-09-19T08:54:49.007 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "y", 2024-09-19T08:54:49.007 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_features": 4540701547738038271, 2024-09-19T08:54:49.007 INFO:teuthology.orchestra.run.smithi007.stdout: "available_modules": [ 2024-09-19T08:54:49.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.007 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "alerts", 2024-09-19T08:54:49.007 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.008 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.008 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.008 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T08:54:49.008 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T08:54:49.008 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.008 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.008 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.008 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T08:54:49.008 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.008 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.008 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.008 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T08:54:49.009 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.009 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.009 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.009 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.009 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.009 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.009 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.009 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.009 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.009 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.009 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.009 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.010 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.010 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.010 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.010 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.010 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.010 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.010 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.010 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.010 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.010 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.010 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.010 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.010 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.011 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.011 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.011 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.011 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.011 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.011 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.011 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.011 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.011 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.011 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.011 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.011 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.012 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.012 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.012 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.012 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.012 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.012 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.012 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.012 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.012 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.012 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.012 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.012 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.012 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.012 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.013 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.013 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.013 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.013 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.013 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.013 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.013 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.013 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.013 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.013 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.013 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.013 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.014 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.014 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.014 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.014 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.014 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.014 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.014 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_destination": { 2024-09-19T08:54:49.014 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_destination", 2024-09-19T08:54:49.014 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.014 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.014 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.014 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.015 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.015 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.015 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.015 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email address to send alerts to", 2024-09-19T08:54:49.015 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.015 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.015 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.015 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_from_name": { 2024-09-19T08:54:49.015 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_from_name", 2024-09-19T08:54:49.015 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.015 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.015 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.015 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "Ceph", 2024-09-19T08:54:49.016 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.016 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.016 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.016 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email From: name", 2024-09-19T08:54:49.016 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.016 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.016 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.016 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_host": { 2024-09-19T08:54:49.016 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_host", 2024-09-19T08:54:49.016 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.016 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.016 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.017 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.017 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.017 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.017 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.017 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP server", 2024-09-19T08:54:49.017 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.017 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.017 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.017 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_password": { 2024-09-19T08:54:49.017 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_password", 2024-09-19T08:54:49.017 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.017 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.018 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.018 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.018 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.018 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.018 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.018 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Password to authenticate with", 2024-09-19T08:54:49.018 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.018 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.018 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.018 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_port": { 2024-09-19T08:54:49.018 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_port", 2024-09-19T08:54:49.018 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.018 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.019 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.019 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "465", 2024-09-19T08:54:49.019 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.019 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.019 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.019 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP port", 2024-09-19T08:54:49.019 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.019 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.019 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.019 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_sender": { 2024-09-19T08:54:49.019 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_sender", 2024-09-19T08:54:49.019 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.019 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.020 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.020 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.020 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.020 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.020 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.020 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP envelope sender", 2024-09-19T08:54:49.020 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.020 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.020 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.020 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_ssl": { 2024-09-19T08:54:49.020 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_ssl", 2024-09-19T08:54:49.020 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.021 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.021 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.021 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.021 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.021 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.021 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.021 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T08:54:49.021 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.021 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.021 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.021 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_user": { 2024-09-19T08:54:49.021 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_user", 2024-09-19T08:54:49.022 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.022 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.022 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.022 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.022 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.022 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.022 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.022 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "User to authenticate as", 2024-09-19T08:54:49.022 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.022 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.022 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.022 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.022 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.023 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "balancer", 2024-09-19T08:54:49.023 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.023 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.023 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.023 INFO:teuthology.orchestra.run.smithi007.stdout: "active": { 2024-09-19T08:54:49.023 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "active", 2024-09-19T08:54:49.023 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.023 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.023 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.023 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.023 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.024 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.024 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.024 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T08:54:49.024 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.024 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.024 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.024 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_time": { 2024-09-19T08:54:49.024 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_time", 2024-09-19T08:54:49.024 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.024 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.024 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.024 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0000", 2024-09-19T08:54:49.024 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.025 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.025 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.025 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T08:54:49.025 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:54:49.025 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.025 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.025 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_weekday": { 2024-09-19T08:54:49.025 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_weekday", 2024-09-19T08:54:49.025 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T08:54:49.025 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.025 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.025 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T08:54:49.026 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-19T08:54:49.026 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-19T08:54:49.026 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.026 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T08:54:49.026 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:54:49.026 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.026 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.026 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_max_iterations": { 2024-09-19T08:54:49.026 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_max_iterations", 2024-09-19T08:54:49.026 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T08:54:49.026 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.026 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.026 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "25", 2024-09-19T08:54:49.027 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T08:54:49.027 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "250", 2024-09-19T08:54:49.027 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.027 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T08:54:49.027 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.027 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.027 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.027 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_metrics": { 2024-09-19T08:54:49.027 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_metrics", 2024-09-19T08:54:49.027 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.027 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.027 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.028 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T08:54:49.028 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.028 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.028 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.028 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T08:54:49.028 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T08:54:49.028 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.028 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.028 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_step": { 2024-09-19T08:54:49.028 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_step", 2024-09-19T08:54:49.028 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T08:54:49.028 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.028 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.029 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.5", 2024-09-19T08:54:49.029 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0.001", 2024-09-19T08:54:49.029 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "0.999", 2024-09-19T08:54:49.029 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.029 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "aggressiveness of optimization", 2024-09-19T08:54:49.029 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T08:54:49.029 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.029 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.029 INFO:teuthology.orchestra.run.smithi007.stdout: "end_time": { 2024-09-19T08:54:49.029 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_time", 2024-09-19T08:54:49.029 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.029 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.030 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.030 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2359", 2024-09-19T08:54:49.030 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.030 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.030 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.030 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T08:54:49.030 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:54:49.030 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.030 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.030 INFO:teuthology.orchestra.run.smithi007.stdout: "end_weekday": { 2024-09-19T08:54:49.030 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_weekday", 2024-09-19T08:54:49.030 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T08:54:49.030 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.031 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.031 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T08:54:49.031 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-19T08:54:49.031 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-19T08:54:49.031 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.031 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T08:54:49.031 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:54:49.031 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.031 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.031 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.031 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.031 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.031 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.032 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.032 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.032 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.032 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.032 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.032 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.032 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.032 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.032 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.032 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.032 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.032 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.032 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.033 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.033 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.033 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.033 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.033 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.033 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.033 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.033 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.033 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.033 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.033 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.033 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.034 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.034 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.034 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.034 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.034 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.034 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.034 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.034 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.034 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.034 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.034 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.034 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.035 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.035 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.035 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.035 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.035 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.035 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.035 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.035 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.035 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.035 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.035 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.035 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.036 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.036 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.036 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.036 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.036 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.036 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.036 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.036 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.036 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.036 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.036 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.036 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.037 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.037 INFO:teuthology.orchestra.run.smithi007.stdout: "min_score": { 2024-09-19T08:54:49.037 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_score", 2024-09-19T08:54:49.037 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T08:54:49.037 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.037 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.037 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T08:54:49.037 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.037 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.037 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.037 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T08:54:49.037 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.038 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.038 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.038 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-19T08:54:49.038 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-19T08:54:49.038 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.038 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.038 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.038 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "upmap", 2024-09-19T08:54:49.038 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.038 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.038 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.038 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-compat", 2024-09-19T08:54:49.038 INFO:teuthology.orchestra.run.smithi007.stdout: "none", 2024-09-19T08:54:49.039 INFO:teuthology.orchestra.run.smithi007.stdout: "read", 2024-09-19T08:54:49.039 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap", 2024-09-19T08:54:49.039 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap-read" 2024-09-19T08:54:49.039 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.039 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Balancer mode", 2024-09-19T08:54:49.039 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.039 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.039 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.039 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_ids": { 2024-09-19T08:54:49.039 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_ids", 2024-09-19T08:54:49.039 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.039 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.040 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.040 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.040 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.040 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.040 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.040 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T08:54:49.040 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.040 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.040 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.040 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T08:54:49.040 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T08:54:49.040 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.040 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.041 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.041 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T08:54:49.041 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.041 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.041 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.041 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T08:54:49.041 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.041 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.041 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.041 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_deviation": { 2024-09-19T08:54:49.041 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_deviation", 2024-09-19T08:54:49.041 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.042 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.042 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.042 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T08:54:49.042 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T08:54:49.042 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.042 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.042 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T08:54:49.042 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T08:54:49.042 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.042 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.042 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_optimizations": { 2024-09-19T08:54:49.042 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_optimizations", 2024-09-19T08:54:49.043 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T08:54:49.043 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.043 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.043 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:49.043 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.043 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.043 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.043 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T08:54:49.043 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.043 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.043 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.043 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.043 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.044 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm", 2024-09-19T08:54:49.044 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.044 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.044 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.044 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_down_multiplier": { 2024-09-19T08:54:49.044 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_down_multiplier", 2024-09-19T08:54:49.044 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T08:54:49.044 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.044 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.044 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-19T08:54:49.044 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.045 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.045 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.045 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T08:54:49.045 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.045 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.045 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.045 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_refresh_rate": { 2024-09-19T08:54:49.045 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_refresh_rate", 2024-09-19T08:54:49.045 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.045 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.045 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.045 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "20", 2024-09-19T08:54:49.045 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.046 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.046 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.046 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T08:54:49.046 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.046 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.046 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.046 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_starting_port": { 2024-09-19T08:54:49.046 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_starting_port", 2024-09-19T08:54:49.046 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.046 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.046 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.046 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4721", 2024-09-19T08:54:49.046 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.047 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.047 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.047 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T08:54:49.047 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.047 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.047 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.047 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_ptrace": { 2024-09-19T08:54:49.047 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_ptrace", 2024-09-19T08:54:49.047 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.047 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.047 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.048 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.048 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.048 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.048 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.048 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T08:54:49.048 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T08:54:49.048 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.048 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.048 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_interval": { 2024-09-19T08:54:49.048 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_interval", 2024-09-19T08:54:49.048 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.048 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.049 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.049 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T08:54:49.049 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.049 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.049 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.049 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T08:54:49.049 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.049 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.049 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.049 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_memory_target_ratio": { 2024-09-19T08:54:49.049 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T08:54:49.050 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T08:54:49.050 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.050 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.050 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.7", 2024-09-19T08:54:49.050 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.050 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.050 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.050 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T08:54:49.050 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.050 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.050 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.050 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm_log_destination": { 2024-09-19T08:54:49.051 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm_log_destination", 2024-09-19T08:54:49.051 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.051 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.051 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.051 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.051 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.051 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.051 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.051 INFO:teuthology.orchestra.run.smithi007.stdout: "file", 2024-09-19T08:54:49.051 INFO:teuthology.orchestra.run.smithi007.stdout: "file,syslog", 2024-09-19T08:54:49.051 INFO:teuthology.orchestra.run.smithi007.stdout: "syslog" 2024-09-19T08:54:49.051 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.051 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T08:54:49.051 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.052 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.052 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.052 INFO:teuthology.orchestra.run.smithi007.stdout: "cgroups_split": { 2024-09-19T08:54:49.052 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cgroups_split", 2024-09-19T08:54:49.052 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.052 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.052 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.052 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.052 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.052 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.052 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.053 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T08:54:49.053 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.053 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.053 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.053 INFO:teuthology.orchestra.run.smithi007.stdout: "config_checks_enabled": { 2024-09-19T08:54:49.053 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_checks_enabled", 2024-09-19T08:54:49.053 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.053 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.053 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.053 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.053 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.053 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.053 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.054 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T08:54:49.054 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.054 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.054 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.054 INFO:teuthology.orchestra.run.smithi007.stdout: "config_dashboard": { 2024-09-19T08:54:49.054 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_dashboard", 2024-09-19T08:54:49.054 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.054 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.054 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.054 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.054 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.055 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.055 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.055 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T08:54:49.055 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.055 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.055 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.055 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_alertmanager": { 2024-09-19T08:54:49.055 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_alertmanager", 2024-09-19T08:54:49.055 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.055 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.055 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.056 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T08:54:49.056 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.056 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.056 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.056 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T08:54:49.056 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.056 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.056 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.056 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_base": { 2024-09-19T08:54:49.056 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_base", 2024-09-19T08:54:49.056 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.056 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.057 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.057 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T08:54:49.057 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.057 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.057 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.057 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Container image name, without the tag", 2024-09-19T08:54:49.057 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.057 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.057 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.057 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_elasticsearch": { 2024-09-19T08:54:49.057 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_elasticsearch", 2024-09-19T08:54:49.057 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.057 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.058 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.058 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T08:54:49.058 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.058 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.058 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.058 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "elasticsearch container image", 2024-09-19T08:54:49.058 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.058 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.058 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.058 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_grafana": { 2024-09-19T08:54:49.058 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_grafana", 2024-09-19T08:54:49.058 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.059 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.059 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.059 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T08:54:49.059 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.059 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.059 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.059 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T08:54:49.059 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.059 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.059 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.059 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_haproxy": { 2024-09-19T08:54:49.059 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_haproxy", 2024-09-19T08:54:49.059 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.060 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.060 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.060 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T08:54:49.060 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.060 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.060 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.060 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "HAproxy container image", 2024-09-19T08:54:49.060 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.060 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.060 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.060 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_agent": { 2024-09-19T08:54:49.061 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_agent", 2024-09-19T08:54:49.061 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.061 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.061 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.061 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T08:54:49.061 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.061 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.061 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.061 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger agent container image", 2024-09-19T08:54:49.061 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.061 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.061 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.061 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_collector": { 2024-09-19T08:54:49.062 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_collector", 2024-09-19T08:54:49.062 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.062 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.062 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.062 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T08:54:49.062 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.062 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.062 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.062 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger collector container image", 2024-09-19T08:54:49.062 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.062 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.062 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.062 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_query": { 2024-09-19T08:54:49.063 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_query", 2024-09-19T08:54:49.063 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.063 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.063 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.064 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T08:54:49.064 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.064 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.064 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.064 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger query container image", 2024-09-19T08:54:49.065 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.065 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.065 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.065 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_keepalived": { 2024-09-19T08:54:49.065 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_keepalived", 2024-09-19T08:54:49.065 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.065 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.065 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.065 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T08:54:49.065 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.065 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.065 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.065 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Keepalived container image", 2024-09-19T08:54:49.066 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.066 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.066 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.066 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_loki": { 2024-09-19T08:54:49.066 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_loki", 2024-09-19T08:54:49.066 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.066 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.066 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.066 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T08:54:49.066 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.066 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.066 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.067 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Loki container image", 2024-09-19T08:54:49.067 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.067 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.067 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.067 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_node_exporter": { 2024-09-19T08:54:49.067 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_node_exporter", 2024-09-19T08:54:49.067 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.067 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.067 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.067 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T08:54:49.067 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.067 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.067 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.068 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T08:54:49.068 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.068 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.068 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.068 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nvmeof": { 2024-09-19T08:54:49.068 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nvmeof", 2024-09-19T08:54:49.068 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.068 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.068 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.069 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T08:54:49.069 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.069 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.069 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.069 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nvme-of container image", 2024-09-19T08:54:49.069 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.069 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.069 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.069 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_prometheus": { 2024-09-19T08:54:49.069 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_prometheus", 2024-09-19T08:54:49.069 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.070 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.070 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.070 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T08:54:49.070 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.070 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.070 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.070 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T08:54:49.070 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.070 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.070 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.071 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_promtail": { 2024-09-19T08:54:49.071 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_promtail", 2024-09-19T08:54:49.071 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.071 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.071 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.071 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T08:54:49.071 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.071 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.071 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.071 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Promtail container image", 2024-09-19T08:54:49.071 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.072 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.072 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.072 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_samba": { 2024-09-19T08:54:49.072 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_samba", 2024-09-19T08:54:49.072 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.072 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.072 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.072 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T08:54:49.072 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.072 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.073 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.073 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Samba/SMB container image", 2024-09-19T08:54:49.073 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.073 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.073 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.073 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_snmp_gateway": { 2024-09-19T08:54:49.073 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_snmp_gateway", 2024-09-19T08:54:49.073 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.073 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.074 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.074 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T08:54:49.074 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.074 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.074 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.074 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SNMP Gateway container image", 2024-09-19T08:54:49.074 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.074 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.074 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.074 INFO:teuthology.orchestra.run.smithi007.stdout: "container_init": { 2024-09-19T08:54:49.074 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_init", 2024-09-19T08:54:49.075 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.075 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.075 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.075 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.075 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.075 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.075 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.075 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T08:54:49.075 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.075 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.076 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.076 INFO:teuthology.orchestra.run.smithi007.stdout: "daemon_cache_timeout": { 2024-09-19T08:54:49.076 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "daemon_cache_timeout", 2024-09-19T08:54:49.076 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.076 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.076 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.076 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T08:54:49.076 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.076 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.077 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.077 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T08:54:49.077 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.077 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.077 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.077 INFO:teuthology.orchestra.run.smithi007.stdout: "default_cephadm_command_timeout": { 2024-09-19T08:54:49.077 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T08:54:49.077 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.077 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.077 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.078 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "900", 2024-09-19T08:54:49.078 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.078 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.078 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.078 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T08:54:49.078 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.078 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.078 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.078 INFO:teuthology.orchestra.run.smithi007.stdout: "default_registry": { 2024-09-19T08:54:49.078 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_registry", 2024-09-19T08:54:49.078 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.079 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.079 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.079 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io", 2024-09-19T08:54:49.079 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.079 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.079 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.079 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T08:54:49.079 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.079 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.079 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.079 INFO:teuthology.orchestra.run.smithi007.stdout: "device_cache_timeout": { 2024-09-19T08:54:49.080 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_cache_timeout", 2024-09-19T08:54:49.080 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.080 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.080 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.080 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1800", 2024-09-19T08:54:49.080 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.080 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.080 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.080 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache device inventory", 2024-09-19T08:54:49.080 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.080 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.081 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.081 INFO:teuthology.orchestra.run.smithi007.stdout: "device_enhanced_scan": { 2024-09-19T08:54:49.081 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_enhanced_scan", 2024-09-19T08:54:49.081 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.081 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.081 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.081 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.081 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.081 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.081 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.081 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T08:54:49.082 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.082 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.082 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.082 INFO:teuthology.orchestra.run.smithi007.stdout: "facts_cache_timeout": { 2024-09-19T08:54:49.082 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "facts_cache_timeout", 2024-09-19T08:54:49.082 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.082 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.082 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.082 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T08:54:49.082 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.082 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.083 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.083 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache host facts data", 2024-09-19T08:54:49.083 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.083 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.083 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.083 INFO:teuthology.orchestra.run.smithi007.stdout: "grafana_dashboards_path": { 2024-09-19T08:54:49.083 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "grafana_dashboards_path", 2024-09-19T08:54:49.083 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.083 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.083 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.083 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T08:54:49.083 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.084 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.084 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.084 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T08:54:49.084 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.084 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.084 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.084 INFO:teuthology.orchestra.run.smithi007.stdout: "host_check_interval": { 2024-09-19T08:54:49.084 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "host_check_interval", 2024-09-19T08:54:49.084 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.084 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.085 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.085 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T08:54:49.085 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.085 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.085 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.085 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to perform a host check", 2024-09-19T08:54:49.085 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.085 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.085 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.085 INFO:teuthology.orchestra.run.smithi007.stdout: "hw_monitoring": { 2024-09-19T08:54:49.086 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hw_monitoring", 2024-09-19T08:54:49.086 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.086 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.086 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.086 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.086 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.086 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.086 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.087 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T08:54:49.087 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.087 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.087 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.087 INFO:teuthology.orchestra.run.smithi007.stdout: "inventory_list_all": { 2024-09-19T08:54:49.087 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "inventory_list_all", 2024-09-19T08:54:49.087 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.087 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.087 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.087 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.087 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.088 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.088 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.088 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T08:54:49.088 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.088 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.088 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.088 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.088 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.088 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.088 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.089 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.089 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.089 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.089 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.089 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.089 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.089 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.089 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.089 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.089 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.089 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.089 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.089 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.090 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.090 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.090 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.090 INFO:teuthology.orchestra.run.smithi007.stdout: "log_refresh_metadata": { 2024-09-19T08:54:49.090 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_refresh_metadata", 2024-09-19T08:54:49.090 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.090 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.090 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.090 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.090 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.090 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.090 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.091 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T08:54:49.091 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.091 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.091 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.091 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.091 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.091 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.091 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.091 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.091 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.091 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.092 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.092 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.092 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T08:54:49.092 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.092 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.092 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.092 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.092 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.092 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.092 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.092 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.093 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.093 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.093 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.093 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.093 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.093 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.093 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.093 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.093 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.093 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.093 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.093 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.094 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.094 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.094 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.094 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.094 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.094 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.094 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.094 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.094 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.094 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.095 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.095 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.095 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.095 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.095 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.095 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.095 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T08:54:49.095 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T08:54:49.095 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.095 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.095 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.096 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.096 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.096 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.096 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.096 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T08:54:49.096 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.096 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.096 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.096 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T08:54:49.096 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T08:54:49.097 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.097 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.097 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.097 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "*", 2024-09-19T08:54:49.097 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.097 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.097 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.097 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T08:54:49.097 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.097 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.098 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.098 INFO:teuthology.orchestra.run.smithi007.stdout: "max_count_per_host": { 2024-09-19T08:54:49.098 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_count_per_host", 2024-09-19T08:54:49.098 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.098 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.098 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.098 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:49.098 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.098 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.098 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.098 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of daemons per service per host", 2024-09-19T08:54:49.099 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.099 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.099 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.099 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd_draining_count": { 2024-09-19T08:54:49.099 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_osd_draining_count", 2024-09-19T08:54:49.099 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.099 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.099 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.099 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:49.099 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.099 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.100 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.100 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T08:54:49.100 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.100 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.100 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.100 INFO:teuthology.orchestra.run.smithi007.stdout: "migration_current": { 2024-09-19T08:54:49.100 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "migration_current", 2024-09-19T08:54:49.100 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.100 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.100 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.100 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.101 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.101 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.101 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.101 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "internal - do not modify", 2024-09-19T08:54:49.101 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.101 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.101 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.101 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-19T08:54:49.101 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-19T08:54:49.101 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.101 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.102 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.102 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "root", 2024-09-19T08:54:49.102 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.102 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.102 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.102 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm-package", 2024-09-19T08:54:49.102 INFO:teuthology.orchestra.run.smithi007.stdout: "root" 2024-09-19T08:54:49.102 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.102 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T08:54:49.102 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.102 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.102 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.103 INFO:teuthology.orchestra.run.smithi007.stdout: "oob_default_addr": { 2024-09-19T08:54:49.103 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "oob_default_addr", 2024-09-19T08:54:49.103 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.103 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.103 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.103 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "169.254.1.1", 2024-09-19T08:54:49.103 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.103 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.103 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.103 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T08:54:49.103 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.104 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.104 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.104 INFO:teuthology.orchestra.run.smithi007.stdout: "prometheus_alerts_path": { 2024-09-19T08:54:49.104 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus_alerts_path", 2024-09-19T08:54:49.104 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.104 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.104 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.104 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T08:54:49.104 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.104 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.104 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.105 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T08:54:49.105 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.105 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.105 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.105 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_insecure": { 2024-09-19T08:54:49.105 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_insecure", 2024-09-19T08:54:49.105 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.105 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.105 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.105 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.106 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.106 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.106 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.106 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T08:54:49.106 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.106 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.106 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.106 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_password": { 2024-09-19T08:54:49.106 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_password", 2024-09-19T08:54:49.106 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.106 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.107 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.107 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.107 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.107 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.107 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.107 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T08:54:49.107 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.107 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.107 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.107 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_url": { 2024-09-19T08:54:49.107 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_url", 2024-09-19T08:54:49.108 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.108 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.108 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.108 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.108 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.108 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.108 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.108 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T08:54:49.108 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.108 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.108 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.109 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_username": { 2024-09-19T08:54:49.109 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_username", 2024-09-19T08:54:49.109 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.109 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.109 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.109 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.109 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.109 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.109 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.110 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T08:54:49.110 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.110 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.110 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.110 INFO:teuthology.orchestra.run.smithi007.stdout: "secure_monitoring_stack": { 2024-09-19T08:54:49.110 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secure_monitoring_stack", 2024-09-19T08:54:49.110 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.110 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.110 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.110 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.110 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.110 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.111 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.111 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T08:54:49.111 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.111 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.111 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.111 INFO:teuthology.orchestra.run.smithi007.stdout: "service_discovery_port": { 2024-09-19T08:54:49.111 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "service_discovery_port", 2024-09-19T08:54:49.111 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.111 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.111 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.111 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8765", 2024-09-19T08:54:49.112 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.112 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.112 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.112 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "cephadm service discovery port", 2024-09-19T08:54:49.112 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.112 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.112 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.112 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_config_file": { 2024-09-19T08:54:49.112 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_config_file", 2024-09-19T08:54:49.112 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.113 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.113 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.113 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.113 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.113 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.113 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.113 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T08:54:49.113 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.113 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.113 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.113 INFO:teuthology.orchestra.run.smithi007.stdout: "use_agent": { 2024-09-19T08:54:49.114 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_agent", 2024-09-19T08:54:49.114 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.114 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.114 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.114 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.114 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.114 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.114 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.114 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T08:54:49.114 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.114 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.114 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.115 INFO:teuthology.orchestra.run.smithi007.stdout: "use_repo_digest": { 2024-09-19T08:54:49.115 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_repo_digest", 2024-09-19T08:54:49.115 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.115 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.115 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.115 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.115 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.115 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.115 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.115 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T08:54:49.115 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.116 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.116 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.116 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_failed_host_check": { 2024-09-19T08:54:49.116 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_failed_host_check", 2024-09-19T08:54:49.116 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.116 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.116 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.116 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.116 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.116 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.117 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.117 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T08:54:49.117 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.117 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.117 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.117 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_daemons": { 2024-09-19T08:54:49.117 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_daemons", 2024-09-19T08:54:49.117 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.117 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.117 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.118 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.118 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.118 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.118 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.118 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T08:54:49.118 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.118 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.118 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.118 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_hosts": { 2024-09-19T08:54:49.118 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_hosts", 2024-09-19T08:54:49.119 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.119 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.119 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.119 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.119 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.119 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.119 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.119 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T08:54:49.119 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.119 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.119 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.120 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.120 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.120 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crash", 2024-09-19T08:54:49.120 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.120 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.120 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.120 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.120 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.120 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.120 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.120 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.121 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.121 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.121 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.121 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.121 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.121 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.121 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.121 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.121 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.121 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.121 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.121 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.122 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.122 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.122 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.122 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.122 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.122 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.122 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.122 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.122 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.122 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.122 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.123 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.123 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.123 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.123 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.123 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.123 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.123 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.123 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.123 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.123 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.123 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.123 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.124 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.124 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.124 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.124 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.124 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.124 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.124 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.124 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.124 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.124 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.124 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.124 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.125 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.125 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.125 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.125 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.125 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.125 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.125 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.125 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.125 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.125 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.125 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.126 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.126 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.126 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.126 INFO:teuthology.orchestra.run.smithi007.stdout: "retain_interval": { 2024-09-19T08:54:49.126 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retain_interval", 2024-09-19T08:54:49.126 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.126 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.126 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.126 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "31536000", 2024-09-19T08:54:49.126 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.126 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.127 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.127 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T08:54:49.127 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.127 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.127 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.127 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_recent_interval": { 2024-09-19T08:54:49.127 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_recent_interval", 2024-09-19T08:54:49.127 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.127 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.127 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.127 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1209600", 2024-09-19T08:54:49.127 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.128 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.128 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.128 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T08:54:49.128 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.128 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.128 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.128 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.128 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.128 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dashboard", 2024-09-19T08:54:49.129 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.129 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.129 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.129 INFO:teuthology.orchestra.run.smithi007.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T08:54:49.129 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T08:54:49.129 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.129 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.129 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.129 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:49.129 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.129 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.129 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.130 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.130 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.130 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.130 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.130 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T08:54:49.130 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T08:54:49.130 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.130 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.130 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.130 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.130 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.131 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.131 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.131 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.131 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.131 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.131 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.131 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T08:54:49.131 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T08:54:49.131 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.131 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.131 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.131 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.132 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.132 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.132 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.132 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.132 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.132 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.132 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.132 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_ENABLED": { 2024-09-19T08:54:49.132 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T08:54:49.132 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.132 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.133 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.133 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.133 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.133 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.133 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.133 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.133 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.133 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.133 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.133 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T08:54:49.134 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T08:54:49.134 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.134 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.134 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.134 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.134 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.134 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.134 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.134 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.134 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.135 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.135 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.135 INFO:teuthology.orchestra.run.smithi007.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T08:54:49.135 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T08:54:49.135 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.135 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.135 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.135 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.135 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.135 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.136 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.136 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.136 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.136 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.136 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.136 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T08:54:49.136 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T08:54:49.136 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.136 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.136 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.137 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.137 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.137 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.137 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.137 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.137 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.137 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.137 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.137 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T08:54:49.137 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T08:54:49.137 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.137 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.138 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.138 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.138 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.138 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.138 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.138 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.138 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.138 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.138 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.138 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T08:54:49.138 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T08:54:49.139 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.139 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.139 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.139 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.139 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.139 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.139 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.139 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.139 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.139 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.139 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.140 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T08:54:49.140 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T08:54:49.140 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.140 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.140 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.140 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.140 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.140 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.140 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.140 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.140 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.140 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.140 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.141 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T08:54:49.141 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T08:54:49.141 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.141 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.141 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.141 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.141 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.141 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.141 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.141 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.141 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.142 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.142 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.142 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T08:54:49.142 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T08:54:49.142 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.142 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.142 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.142 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.142 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.142 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.142 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.142 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.143 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.143 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.143 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.143 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T08:54:49.143 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T08:54:49.143 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.143 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.143 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.143 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.143 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.143 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.144 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.144 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.144 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.144 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.144 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.144 INFO:teuthology.orchestra.run.smithi007.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T08:54:49.144 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T08:54:49.144 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.144 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.144 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.144 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.145 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.145 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.145 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.145 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.145 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.145 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.145 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.145 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T08:54:49.145 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T08:54:49.145 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.146 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.146 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.146 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-19T08:54:49.146 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.146 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.146 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.146 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.146 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.146 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.146 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.147 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T08:54:49.147 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T08:54:49.147 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.147 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.147 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.147 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.147 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.147 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.147 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.147 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.147 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.147 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.148 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.148 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_URL": { 2024-09-19T08:54:49.148 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_URL", 2024-09-19T08:54:49.148 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.148 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.148 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.148 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.148 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.148 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.148 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.149 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.149 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.149 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.149 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.149 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T08:54:49.149 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T08:54:49.149 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.149 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.149 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.149 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-19T08:54:49.150 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.150 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.150 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.150 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.150 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.150 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.150 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.150 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T08:54:49.150 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T08:54:49.150 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.151 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.151 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.151 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.151 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.151 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.151 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.151 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.151 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.151 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.151 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.151 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T08:54:49.152 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T08:54:49.152 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.152 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.152 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.152 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.152 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.152 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.152 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.152 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.152 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.152 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.153 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.153 INFO:teuthology.orchestra.run.smithi007.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T08:54:49.153 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T08:54:49.153 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.153 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.153 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.153 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.153 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.153 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.153 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.153 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.154 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.154 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.154 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.154 INFO:teuthology.orchestra.run.smithi007.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T08:54:49.154 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T08:54:49.154 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.154 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.154 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.154 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.154 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.155 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.155 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.155 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.155 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.155 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.155 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.155 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T08:54:49.155 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T08:54:49.155 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.155 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.155 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.156 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.156 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.156 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.156 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.156 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.156 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.156 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.156 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.156 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T08:54:49.156 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T08:54:49.157 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.157 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.157 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.157 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.157 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.157 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.157 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.157 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.157 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.157 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.157 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.158 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T08:54:49.158 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T08:54:49.158 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.158 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.158 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.158 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.158 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.158 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.158 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.158 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.158 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.159 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.159 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.159 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T08:54:49.159 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T08:54:49.159 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.159 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.159 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.159 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.159 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.159 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.160 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.160 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.160 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.160 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.160 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.160 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T08:54:49.160 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T08:54:49.160 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.160 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.160 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.161 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.161 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.161 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.161 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.161 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.161 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.161 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.161 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.161 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T08:54:49.162 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T08:54:49.162 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.162 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.162 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.162 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.162 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.162 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.162 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.162 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.162 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.162 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.162 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.163 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T08:54:49.163 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T08:54:49.163 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.163 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.163 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.163 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.163 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.163 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.163 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.163 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.164 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.164 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.164 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.164 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T08:54:49.164 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T08:54:49.164 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.164 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.164 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.164 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.165 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.165 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.165 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.165 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.165 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.165 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.165 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.165 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T08:54:49.165 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T08:54:49.165 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.166 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.166 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.166 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.166 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.166 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.166 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.166 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.166 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.166 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.166 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.167 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T08:54:49.167 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T08:54:49.167 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.167 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.167 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.167 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.167 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.167 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.167 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.167 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.168 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.168 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.168 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.168 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T08:54:49.168 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T08:54:49.168 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.168 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.168 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.168 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T08:54:49.168 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.168 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.169 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.169 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.169 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.169 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.169 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.169 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T08:54:49.169 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T08:54:49.169 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.169 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.169 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.170 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:49.170 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.170 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.170 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.170 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.170 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.170 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.170 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.170 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T08:54:49.170 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T08:54:49.170 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.171 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.171 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.171 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8", 2024-09-19T08:54:49.171 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.171 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.171 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.171 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.171 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.171 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.171 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.172 INFO:teuthology.orchestra.run.smithi007.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T08:54:49.172 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T08:54:49.172 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.172 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.172 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.172 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "45", 2024-09-19T08:54:49.172 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.172 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.172 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.172 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.172 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.173 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.173 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.173 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T08:54:49.173 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T08:54:49.173 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.173 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.173 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.173 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.173 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.173 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.174 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.174 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.174 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.174 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.174 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.174 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T08:54:49.174 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T08:54:49.174 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.174 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.174 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.175 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-19T08:54:49.175 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.175 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.175 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.175 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.175 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.175 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.175 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.175 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T08:54:49.175 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T08:54:49.176 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.176 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.176 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.176 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.176 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.176 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.176 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.176 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.176 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.176 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.176 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.177 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T08:54:49.177 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T08:54:49.177 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.177 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.177 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.177 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.177 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.177 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.177 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.177 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.177 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.178 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.178 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.178 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T08:54:49.178 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T08:54:49.178 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.178 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.178 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.178 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T08:54:49.178 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.178 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.178 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.178 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.179 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.179 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.179 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.179 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T08:54:49.179 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T08:54:49.179 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.179 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.179 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.179 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:49.179 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.179 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.180 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.180 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.180 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.180 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.180 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.180 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T08:54:49.180 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T08:54:49.180 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.180 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.180 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.180 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T08:54:49.181 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.181 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.181 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.181 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.181 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.181 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.181 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.181 INFO:teuthology.orchestra.run.smithi007.stdout: "cross_origin_url": { 2024-09-19T08:54:49.181 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cross_origin_url", 2024-09-19T08:54:49.181 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.181 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.181 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.182 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.182 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.182 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.182 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.182 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.182 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.182 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.182 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.182 INFO:teuthology.orchestra.run.smithi007.stdout: "crt_file": { 2024-09-19T08:54:49.182 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crt_file", 2024-09-19T08:54:49.182 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.183 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.183 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.183 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.183 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.183 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.183 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.183 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.183 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.183 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.183 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.184 INFO:teuthology.orchestra.run.smithi007.stdout: "debug": { 2024-09-19T08:54:49.184 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "debug", 2024-09-19T08:54:49.184 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.184 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.184 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.184 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.184 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.184 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.184 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.184 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable/disable debug options", 2024-09-19T08:54:49.184 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.185 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.185 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.185 INFO:teuthology.orchestra.run.smithi007.stdout: "jwt_token_ttl": { 2024-09-19T08:54:49.185 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "jwt_token_ttl", 2024-09-19T08:54:49.185 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.185 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.185 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.185 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "28800", 2024-09-19T08:54:49.185 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.185 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.186 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.186 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.186 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.186 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.186 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.186 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-19T08:54:49.186 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-19T08:54:49.186 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.186 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.187 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.187 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.187 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.187 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.187 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.187 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.187 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.187 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.187 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.187 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.188 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.188 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.188 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.188 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.188 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.188 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.188 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.188 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.188 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.188 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.188 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.188 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.189 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.189 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.189 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.189 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.189 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.189 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.189 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.189 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.189 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.190 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.190 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.190 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.190 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.190 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.190 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.190 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.190 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.190 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.190 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.190 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.191 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.191 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.191 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.191 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.191 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.191 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.191 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.191 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.191 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.191 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.191 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.192 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.192 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.192 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.192 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.192 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.192 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.192 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.192 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.192 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.192 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.193 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.193 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.193 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.193 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.193 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.193 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.193 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.193 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.193 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.193 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.193 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.193 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.194 INFO:teuthology.orchestra.run.smithi007.stdout: "motd": { 2024-09-19T08:54:49.194 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "motd", 2024-09-19T08:54:49.194 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.194 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.194 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.194 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.194 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.194 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.194 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.194 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "The message of the day", 2024-09-19T08:54:49.194 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.195 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.195 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.195 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect_resolve_ip_addr": { 2024-09-19T08:54:49.195 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T08:54:49.195 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.195 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.195 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.195 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.195 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.195 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.195 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.196 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.196 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.196 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.196 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.196 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-19T08:54:49.196 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-19T08:54:49.196 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.196 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.196 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.196 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-19T08:54:49.197 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.197 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.197 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.197 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.197 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.197 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.197 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.197 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-19T08:54:49.197 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-19T08:54:49.197 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.197 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.198 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.198 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8080", 2024-09-19T08:54:49.198 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.198 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.198 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.198 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.198 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.198 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.198 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.198 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-19T08:54:49.199 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-19T08:54:49.199 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.199 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.199 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.199 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.199 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.199 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.199 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.199 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.199 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.199 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.199 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.200 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl_server_port": { 2024-09-19T08:54:49.200 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl_server_port", 2024-09-19T08:54:49.200 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.200 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.200 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.200 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8443", 2024-09-19T08:54:49.200 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.200 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.200 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.200 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.201 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.201 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.201 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.201 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-19T08:54:49.201 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-19T08:54:49.201 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.201 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.201 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.201 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "redirect", 2024-09-19T08:54:49.201 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect" 2024-09-19T08:54:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-19T08:54:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-19T08:54:49.203 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.203 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.203 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.203 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-19T08:54:49.203 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-19T08:54:49.203 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-19T08:54:49.203 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.203 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.203 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.203 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.203 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.204 INFO:teuthology.orchestra.run.smithi007.stdout: "url_prefix": { 2024-09-19T08:54:49.204 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url_prefix", 2024-09-19T08:54:49.204 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.204 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.204 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.204 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.204 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.204 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.204 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.204 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.204 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.205 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.205 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.205 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.205 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.205 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-09-19T08:54:49.205 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.205 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.205 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.205 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_monitoring": { 2024-09-19T08:54:49.205 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_monitoring", 2024-09-19T08:54:49.206 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.206 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.206 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.206 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.206 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.206 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.206 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.206 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "monitor device health metrics", 2024-09-19T08:54:49.206 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.206 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.206 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.207 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.207 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.207 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.207 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.207 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.207 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.207 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.207 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.207 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.207 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.207 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.207 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.208 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.208 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.208 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.208 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.208 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.208 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.208 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.208 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.208 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.208 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.208 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.209 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.209 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.209 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.209 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.209 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.209 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.209 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.209 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.209 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.209 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.209 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.210 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.210 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.210 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.210 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.210 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.210 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.210 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.210 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.210 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.210 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.210 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.211 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.211 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.211 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.211 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.211 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.211 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.211 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.211 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.211 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.211 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.211 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.212 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.212 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.212 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.212 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.212 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.212 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.212 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.212 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.212 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.212 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.212 INFO:teuthology.orchestra.run.smithi007.stdout: "mark_out_threshold": { 2024-09-19T08:54:49.213 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mark_out_threshold", 2024-09-19T08:54:49.213 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.213 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.213 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.213 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2419200", 2024-09-19T08:54:49.213 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.213 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.213 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.213 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T08:54:49.213 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.213 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.214 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.214 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": { 2024-09-19T08:54:49.214 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_name", 2024-09-19T08:54:49.214 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.214 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.214 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.214 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "device_health_metrics", 2024-09-19T08:54:49.214 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.214 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.214 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.214 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T08:54:49.215 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.215 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.215 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.215 INFO:teuthology.orchestra.run.smithi007.stdout: "retention_period": { 2024-09-19T08:54:49.215 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retention_period", 2024-09-19T08:54:49.215 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.215 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.215 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.215 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15552000", 2024-09-19T08:54:49.215 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.216 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.216 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.216 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain device health metrics", 2024-09-19T08:54:49.216 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.216 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.216 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.216 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_frequency": { 2024-09-19T08:54:49.216 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_frequency", 2024-09-19T08:54:49.216 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.216 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.217 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.217 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-19T08:54:49.217 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.217 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.217 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.217 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T08:54:49.217 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.217 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.217 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.217 INFO:teuthology.orchestra.run.smithi007.stdout: "self_heal": { 2024-09-19T08:54:49.217 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "self_heal", 2024-09-19T08:54:49.218 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.218 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.218 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.218 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.218 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.218 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.218 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.218 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T08:54:49.218 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.218 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.218 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.219 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T08:54:49.219 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T08:54:49.219 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.219 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.219 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.219 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T08:54:49.219 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.219 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.219 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.219 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T08:54:49.219 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.220 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.220 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.220 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_threshold": { 2024-09-19T08:54:49.220 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_threshold", 2024-09-19T08:54:49.220 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.220 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.220 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.220 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7257600", 2024-09-19T08:54:49.220 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.220 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.221 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.221 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T08:54:49.221 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.221 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.221 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.221 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.221 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.221 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "diskprediction_local", 2024-09-19T08:54:49.221 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.221 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.222 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.222 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.222 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.222 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.222 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.222 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.222 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.222 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.222 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.222 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.222 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.222 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.223 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.223 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.223 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.223 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.223 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.223 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.223 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.223 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.223 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.223 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.223 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.224 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.224 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.224 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.224 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.224 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.224 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.224 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.224 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.224 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.224 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.224 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.225 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.226 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.227 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.227 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.227 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.227 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.227 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.227 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.227 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.227 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.227 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.227 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.227 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.228 INFO:teuthology.orchestra.run.smithi007.stdout: "predict_interval": { 2024-09-19T08:54:49.228 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predict_interval", 2024-09-19T08:54:49.228 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.228 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.228 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.228 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-19T08:54:49.228 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.228 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.228 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.228 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.229 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.229 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.229 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.229 INFO:teuthology.orchestra.run.smithi007.stdout: "predictor_model": { 2024-09-19T08:54:49.229 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predictor_model", 2024-09-19T08:54:49.229 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.229 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.229 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.229 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "prophetstor", 2024-09-19T08:54:49.229 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.229 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.230 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.230 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.230 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.230 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.230 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.230 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T08:54:49.230 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T08:54:49.230 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.230 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.230 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.230 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T08:54:49.231 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.231 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.231 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.231 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.231 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.231 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.231 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.231 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.231 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.231 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "influx", 2024-09-19T08:54:49.232 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": false, 2024-09-19T08:54:49.232 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "influxdb python module not found", 2024-09-19T08:54:49.232 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.232 INFO:teuthology.orchestra.run.smithi007.stdout: "batch_size": { 2024-09-19T08:54:49.232 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "batch_size", 2024-09-19T08:54:49.232 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.232 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.232 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.232 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5000", 2024-09-19T08:54:49.232 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.232 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.232 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.233 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T08:54:49.233 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.233 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.233 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.233 INFO:teuthology.orchestra.run.smithi007.stdout: "database": { 2024-09-19T08:54:49.233 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "database", 2024-09-19T08:54:49.233 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.233 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.233 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.233 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "ceph", 2024-09-19T08:54:49.234 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.234 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.234 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.234 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T08:54:49.234 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.234 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.234 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.234 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": { 2024-09-19T08:54:49.234 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hostname", 2024-09-19T08:54:49.234 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.235 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.235 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.235 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.235 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.235 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.235 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.235 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server hostname", 2024-09-19T08:54:49.235 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.235 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.235 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.236 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T08:54:49.236 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T08:54:49.236 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.236 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.236 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.236 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "30", 2024-09-19T08:54:49.236 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "5", 2024-09-19T08:54:49.236 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.236 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.236 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T08:54:49.236 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.236 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.237 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.237 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.237 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.237 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.237 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.237 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.237 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.237 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.237 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.237 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.238 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.239 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.240 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.242 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: "password": { 2024-09-19T08:54:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "password", 2024-09-19T08:54:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "password of InfluxDB server user", 2024-09-19T08:54:49.243 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: "port": { 2024-09-19T08:54:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "port", 2024-09-19T08:54:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8086", 2024-09-19T08:54:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.244 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server port", 2024-09-19T08:54:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-19T08:54:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-19T08:54:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.245 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "false", 2024-09-19T08:54:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:54:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: "threads": { 2024-09-19T08:54:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threads", 2024-09-19T08:54:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.246 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T08:54:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T08:54:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "32", 2024-09-19T08:54:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T08:54:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: "username": { 2024-09-19T08:54:49.247 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "username", 2024-09-19T08:54:49.248 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.248 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.248 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.248 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.248 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.248 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.248 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.248 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "username of InfluxDB server user", 2024-09-19T08:54:49.248 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.248 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.248 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.249 INFO:teuthology.orchestra.run.smithi007.stdout: "verify_ssl": { 2024-09-19T08:54:49.249 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "verify_ssl", 2024-09-19T08:54:49.249 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.249 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.249 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.249 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "true", 2024-09-19T08:54:49.249 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.249 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.249 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.249 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:54:49.250 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.250 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.250 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.250 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.250 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.250 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "insights", 2024-09-19T08:54:49.250 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.250 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.250 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.251 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.251 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.251 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.251 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.251 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.251 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.251 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.251 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.251 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.251 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.251 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.251 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.252 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.252 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.252 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.252 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.252 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.252 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.252 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.252 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.252 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.253 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.253 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.253 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.253 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.253 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.253 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.253 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.253 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.253 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.253 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.253 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.253 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.254 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.254 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.254 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.254 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.254 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.254 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.254 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.254 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.254 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.254 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.255 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.255 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.255 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.255 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.255 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.255 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.255 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.255 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.255 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.255 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.256 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.256 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.256 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.256 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.256 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.256 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.256 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.256 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.256 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.256 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.256 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.257 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.257 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.257 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.257 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.257 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "iostat", 2024-09-19T08:54:49.257 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.257 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.257 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.257 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.257 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.258 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.258 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.258 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.258 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.258 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.258 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.258 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.258 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.258 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.258 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.258 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.259 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.259 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.259 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.259 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.259 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.259 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.259 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.259 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.259 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.259 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.260 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.260 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.260 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.260 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.260 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.260 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.260 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.260 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.260 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.260 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.261 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.261 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.261 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.261 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.261 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.261 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.261 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.261 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.261 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.261 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.261 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.261 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.262 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.262 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.262 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.262 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.262 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.262 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.262 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.262 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.262 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.262 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.262 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.263 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.263 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.263 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.263 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.263 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.263 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.263 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.263 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.263 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.263 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.263 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.263 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.264 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "k8sevents", 2024-09-19T08:54:49.264 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.264 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.264 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.264 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_event_retention_days": { 2024-09-19T08:54:49.264 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ceph_event_retention_days", 2024-09-19T08:54:49.264 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.264 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.265 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.265 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-09-19T08:54:49.265 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.265 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.265 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.265 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T08:54:49.265 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.265 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.265 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.265 INFO:teuthology.orchestra.run.smithi007.stdout: "config_check_secs": { 2024-09-19T08:54:49.265 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_check_secs", 2024-09-19T08:54:49.266 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.266 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.266 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.266 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:49.266 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "10", 2024-09-19T08:54:49.266 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.266 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.266 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T08:54:49.266 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.266 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.266 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.267 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.267 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.268 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.268 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.268 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.268 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.268 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.268 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.268 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.269 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.269 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.269 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.269 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.269 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.269 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.269 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.269 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.269 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.269 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.269 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.270 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.270 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.270 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.270 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.270 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.270 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.270 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.270 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.270 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.270 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.270 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.270 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.271 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.271 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.271 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.271 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.271 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.271 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.271 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.271 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.271 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.271 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.272 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.272 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.272 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.272 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.272 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.272 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.272 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.272 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.272 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.272 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.272 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.273 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.273 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.273 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.273 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.273 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.273 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.273 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.273 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.273 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.273 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.274 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.274 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.274 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.274 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.274 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.274 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "localpool", 2024-09-19T08:54:49.274 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.274 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.274 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.275 INFO:teuthology.orchestra.run.smithi007.stdout: "failure_domain": { 2024-09-19T08:54:49.275 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "failure_domain", 2024-09-19T08:54:49.275 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.275 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.275 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.275 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "host", 2024-09-19T08:54:49.275 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.275 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.275 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.275 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "failure domain for any created local pool", 2024-09-19T08:54:49.275 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T08:54:49.276 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.276 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.276 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.276 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.276 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.276 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.276 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.276 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.276 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.276 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.277 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.277 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.277 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.277 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.277 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.277 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.277 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.277 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.277 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.277 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.277 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.278 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.278 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.278 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.278 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.278 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.278 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.278 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.278 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.278 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.278 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.279 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.279 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.279 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.279 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.279 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.279 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.279 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.279 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.279 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.279 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.280 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.280 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.280 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.280 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.280 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.280 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.280 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.280 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.280 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.280 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.280 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.281 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.281 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.281 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.281 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.281 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.281 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.281 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.281 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.281 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.281 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.281 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.282 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.282 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.282 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.282 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.282 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.282 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": { 2024-09-19T08:54:49.282 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_size", 2024-09-19T08:54:49.282 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.282 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.282 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.282 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.283 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.283 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.283 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.283 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default min_size for any created local pool", 2024-09-19T08:54:49.283 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T08:54:49.283 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.283 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.283 INFO:teuthology.orchestra.run.smithi007.stdout: "num_rep": { 2024-09-19T08:54:49.283 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "num_rep", 2024-09-19T08:54:49.283 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.284 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.284 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.284 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-09-19T08:54:49.284 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.284 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.284 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.284 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default replica count for any created local pool", 2024-09-19T08:54:49.284 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.284 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.285 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.285 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": { 2024-09-19T08:54:49.285 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_num", 2024-09-19T08:54:49.285 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.285 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.285 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.285 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "128", 2024-09-19T08:54:49.285 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.285 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.286 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.286 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T08:54:49.286 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.286 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.286 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.286 INFO:teuthology.orchestra.run.smithi007.stdout: "prefix": { 2024-09-19T08:54:49.286 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prefix", 2024-09-19T08:54:49.286 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.286 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.286 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.286 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.287 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.287 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.287 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.287 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name prefix for any created local pool", 2024-09-19T08:54:49.287 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.287 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.287 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.287 INFO:teuthology.orchestra.run.smithi007.stdout: "subtree": { 2024-09-19T08:54:49.287 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "subtree", 2024-09-19T08:54:49.287 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.288 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.288 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.288 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "rack", 2024-09-19T08:54:49.288 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.288 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.288 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.288 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T08:54:49.288 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T08:54:49.288 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.288 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.288 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.288 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.289 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mds_autoscaler", 2024-09-19T08:54:49.289 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.289 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.289 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.289 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.289 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.289 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.289 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.289 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.290 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.290 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.290 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.290 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.290 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.290 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.290 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.290 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.290 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.290 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.290 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.291 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.291 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.291 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.291 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.291 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.291 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.291 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.291 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.291 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.291 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.291 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.292 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.292 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.292 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.292 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.292 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.292 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.292 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.292 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.292 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.292 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.293 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.293 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.293 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.293 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.293 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.293 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.293 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.293 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.293 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.293 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.293 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.294 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.294 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.294 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.294 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.294 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.294 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.294 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.294 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.294 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.294 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.294 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.295 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.295 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.295 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.295 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.295 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.295 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.295 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.295 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.295 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.296 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirroring", 2024-09-19T08:54:49.296 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.296 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.296 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.296 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.296 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.296 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.296 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.296 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.296 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.296 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.297 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.297 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.297 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.297 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.297 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.297 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.297 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.297 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.297 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.297 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.297 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.298 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.298 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.298 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.298 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.298 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.298 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.298 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.298 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.298 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.298 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.298 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.299 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.299 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.299 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.299 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.299 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.299 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.299 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.299 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.299 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.299 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.299 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.300 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.300 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.300 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.300 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.300 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.300 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.300 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.300 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.300 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.300 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.300 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.301 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.301 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.301 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.301 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.301 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.301 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.301 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.301 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.301 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.301 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.302 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.302 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.302 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.302 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.302 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.302 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.302 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.302 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "nfs", 2024-09-19T08:54:49.302 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.302 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.303 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.303 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.303 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.303 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.303 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.303 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.303 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.303 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.303 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.303 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.303 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.304 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.304 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.304 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.304 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.304 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.304 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.304 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.304 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.304 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.304 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.304 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.305 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.305 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.305 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.305 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.305 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.305 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.305 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.305 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.305 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.305 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.305 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.306 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.306 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.306 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.306 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.306 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.306 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.306 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.306 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.306 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.306 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.306 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.307 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.307 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.307 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.307 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.307 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.307 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.307 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.307 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.307 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.307 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.307 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.308 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.308 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.308 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.308 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.308 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.308 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.308 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.308 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.308 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.308 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.308 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.309 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.309 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.309 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.309 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-19T08:54:49.309 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.309 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.309 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.309 INFO:teuthology.orchestra.run.smithi007.stdout: "fail_fs": { 2024-09-19T08:54:49.309 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "fail_fs", 2024-09-19T08:54:49.309 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.310 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.310 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.310 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.310 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.310 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.310 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.310 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T08:54:49.310 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.310 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.310 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.310 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.311 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.311 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.311 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.311 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.311 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.311 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.311 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.311 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.311 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.311 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.311 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.311 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.311 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.312 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.312 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.312 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.312 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.312 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.312 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.312 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.312 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.312 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.312 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.313 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.313 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.313 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.313 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.313 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.313 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.313 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.313 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.313 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.313 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.313 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.314 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.314 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.314 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.314 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.314 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.314 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.314 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.314 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.314 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.314 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.314 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.314 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.315 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.315 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.315 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.315 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.315 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.315 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.315 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.315 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.315 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.315 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.316 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.316 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.316 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.316 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.316 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.316 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.316 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.316 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.316 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.316 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator": { 2024-09-19T08:54:49.317 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-19T08:54:49.317 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.317 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.317 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.317 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.317 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.317 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.317 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.317 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-09-19T08:54:49.317 INFO:teuthology.orchestra.run.smithi007.stdout: "rook", 2024-09-19T08:54:49.317 INFO:teuthology.orchestra.run.smithi007.stdout: "test_orchestrator" 2024-09-19T08:54:49.318 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.318 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Orchestrator backend", 2024-09-19T08:54:49.318 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.318 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.318 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.318 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.318 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.318 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_perf_query", 2024-09-19T08:54:49.319 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.319 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.319 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.319 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.319 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.319 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.319 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.319 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.319 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.319 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.319 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.320 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.320 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.320 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.320 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.320 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.320 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.320 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.320 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.320 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.320 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.321 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.321 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.321 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.321 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.321 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.321 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.321 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.321 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.321 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.321 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.321 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.322 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.322 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.322 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.322 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.322 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.322 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.322 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.322 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.322 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.322 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.323 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.323 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.323 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.323 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.323 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.323 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.323 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.323 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.323 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.323 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.323 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.323 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.324 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.324 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.324 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.324 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.324 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.324 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.324 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.324 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.324 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.324 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.324 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.325 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.325 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.325 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.325 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.325 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.325 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.325 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_support", 2024-09-19T08:54:49.325 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.325 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.326 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.326 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.326 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.326 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.326 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.326 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.326 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.326 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.326 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.326 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.326 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.326 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.327 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.327 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.327 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.327 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.327 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.327 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.327 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.327 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.327 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.327 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.327 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.327 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_autoscaler", 2024-09-19T08:54:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T08:54:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T08:54:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T08:54:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "threshold": { 2024-09-19T08:54:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threshold", 2024-09-19T08:54:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T08:54:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-19T08:54:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1.0", 2024-09-19T08:54:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "scaling threshold", 2024-09-19T08:54:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T08:54:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "progress", 2024-09-19T08:54:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_pg_recovery_event": { 2024-09-19T08:54:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_pg_recovery_event", 2024-09-19T08:54:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T08:54:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-19T08:54:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-19T08:54:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "max_completed_events": { 2024-09-19T08:54:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_completed_events", 2024-09-19T08:54:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "50", 2024-09-19T08:54:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "number of past completed events to remember", 2024-09-19T08:54:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T08:54:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T08:54:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T08:54:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long the module is going to sleep", 2024-09-19T08:54:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus", 2024-09-19T08:54:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "cache": { 2024-09-19T08:54:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cache", 2024-09-19T08:54:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: "exclude_perf_counters": { 2024-09-19T08:54:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "exclude_perf_counters", 2024-09-19T08:54:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T08:54:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T08:54:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools": { 2024-09-19T08:54:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools", 2024-09-19T08:54:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T08:54:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T08:54:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "300", 2024-09-19T08:54:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_interval": { 2024-09-19T08:54:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_interval", 2024-09-19T08:54:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T08:54:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15.0", 2024-09-19T08:54:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-19T08:54:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-19T08:54:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-19T08:54:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T08:54:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-19T08:54:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-19T08:54:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "9283", 2024-09-19T08:54:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T08:54:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "stale_cache_strategy": { 2024-09-19T08:54:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stale_cache_strategy", 2024-09-19T08:54:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "log", 2024-09-19T08:54:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-19T08:54:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-19T08:54:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "default", 2024-09-19T08:54:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "default", 2024-09-19T08:54:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "error" 2024-09-19T08:54:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-19T08:54:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-19T08:54:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-19T08:54:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-19T08:54:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-19T08:54:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-09-19T08:54:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.378 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.378 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.378 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.378 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.378 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.378 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_snap_create": { 2024-09-19T08:54:49.378 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_snap_create", 2024-09-19T08:54:49.378 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.378 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.378 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.378 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:49.379 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.379 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.379 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.379 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.379 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.379 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.379 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.379 INFO:teuthology.orchestra.run.smithi007.stdout: "mirror_snapshot_schedule": { 2024-09-19T08:54:49.379 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T08:54:49.379 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.379 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.380 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.380 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.380 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.380 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.380 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.380 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.380 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.380 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.380 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.381 INFO:teuthology.orchestra.run.smithi007.stdout: "trash_purge_schedule": { 2024-09-19T08:54:49.381 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "trash_purge_schedule", 2024-09-19T08:54:49.381 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.381 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.381 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.381 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.381 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.381 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.381 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.381 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.381 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.381 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.382 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.382 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.382 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.382 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "restful", 2024-09-19T08:54:49.382 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.382 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.382 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.382 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_auth": { 2024-09-19T08:54:49.382 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_auth", 2024-09-19T08:54:49.382 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.383 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.383 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.383 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.383 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.383 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.383 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.383 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.383 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.383 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.383 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.383 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-19T08:54:49.384 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-19T08:54:49.384 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.384 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.384 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.384 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.384 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.384 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.384 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.384 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.384 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.385 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.385 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.385 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.385 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.385 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.385 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.385 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.385 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.385 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.385 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.386 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.386 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.386 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.386 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.386 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.386 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.386 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.386 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.386 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.386 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.386 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.387 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.387 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.387 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.387 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.387 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.387 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.387 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.387 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.387 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.387 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.388 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.388 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.388 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.388 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.388 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.388 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.388 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.388 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.388 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.388 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.389 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.389 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.389 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.389 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.389 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.389 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.389 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.389 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.389 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.389 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.389 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.389 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.390 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.390 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.390 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.390 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.390 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.390 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.390 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.390 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.390 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.390 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.391 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.391 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.391 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.391 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.391 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.391 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-19T08:54:49.391 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-19T08:54:49.391 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.391 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.391 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.392 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.392 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.392 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.392 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.392 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.392 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.392 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.392 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.392 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-19T08:54:49.392 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-19T08:54:49.393 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.393 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.393 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.393 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.393 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.393 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.393 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.393 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.393 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.393 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.393 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.393 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.394 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.394 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rgw", 2024-09-19T08:54:49.394 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.394 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.394 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.394 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.394 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.394 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.394 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.394 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.394 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.395 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.395 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.395 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.395 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.395 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.395 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.395 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.395 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.395 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.395 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.395 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.395 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.396 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.396 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.396 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.396 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.396 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.396 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.396 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.396 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.396 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.397 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.397 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.397 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.397 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.397 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.397 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.397 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.397 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.397 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.397 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.397 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.398 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.398 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.398 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.398 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.398 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.398 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.398 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.398 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.398 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.398 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.398 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.398 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.399 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.399 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.399 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.399 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.399 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.399 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.399 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.399 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.399 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.399 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.399 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.400 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.400 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.400 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.400 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.400 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.400 INFO:teuthology.orchestra.run.smithi007.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T08:54:49.400 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T08:54:49.400 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.400 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.401 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.401 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T08:54:49.401 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.401 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.401 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.401 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T08:54:49.401 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.401 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.401 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.401 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.401 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.402 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rook", 2024-09-19T08:54:49.402 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.402 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.402 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.402 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.402 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.402 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.402 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.402 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.402 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.403 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.403 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.403 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.403 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.403 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.403 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.403 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.403 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.403 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.403 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.403 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.403 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.404 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.404 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.404 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.404 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.404 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.404 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.404 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.404 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.404 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.404 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.404 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.405 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.405 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.405 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.405 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.405 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.405 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.405 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.405 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.405 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.405 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.406 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.406 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.406 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.406 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.406 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.406 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.406 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.406 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.406 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.406 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.406 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.406 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.407 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.407 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.407 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.407 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.407 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.407 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.407 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.407 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.407 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.407 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.407 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.408 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.408 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.408 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.408 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.408 INFO:teuthology.orchestra.run.smithi007.stdout: "storage_class": { 2024-09-19T08:54:49.408 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "storage_class", 2024-09-19T08:54:49.408 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.408 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.408 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.408 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "local", 2024-09-19T08:54:49.408 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.409 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.409 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.409 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T08:54:49.409 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.409 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.409 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.409 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.409 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.409 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "selftest", 2024-09-19T08:54:49.410 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.410 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.410 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.410 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.410 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.410 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.410 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.410 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.410 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.410 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.410 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.410 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.410 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.411 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.411 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.411 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.411 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.411 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.411 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.411 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.411 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.411 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.411 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.411 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.412 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.412 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.412 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.412 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.412 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.412 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.412 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.412 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.412 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.412 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.412 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.412 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.413 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.413 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.413 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.413 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.413 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.413 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.413 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.413 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.413 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.413 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.414 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.414 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.414 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.414 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.414 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.414 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.414 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.414 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.414 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.414 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.414 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.415 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.415 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.415 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.415 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.415 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.415 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.415 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.415 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.415 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.415 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.415 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.416 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.416 INFO:teuthology.orchestra.run.smithi007.stdout: "roption1": { 2024-09-19T08:54:49.416 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption1", 2024-09-19T08:54:49.416 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.416 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.416 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.416 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.416 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.416 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.416 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.417 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.417 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.417 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.417 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.417 INFO:teuthology.orchestra.run.smithi007.stdout: "roption2": { 2024-09-19T08:54:49.417 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption2", 2024-09-19T08:54:49.417 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.417 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.417 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.417 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "xyz", 2024-09-19T08:54:49.417 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.418 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.418 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.418 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.418 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.418 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.418 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.418 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption1": { 2024-09-19T08:54:49.418 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption1", 2024-09-19T08:54:49.418 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.418 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.419 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.419 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.419 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.419 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.419 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.419 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.419 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.419 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.419 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.419 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption2": { 2024-09-19T08:54:49.419 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption2", 2024-09-19T08:54:49.420 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.420 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.420 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.420 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.420 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.420 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.420 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.420 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.420 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.420 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.420 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.421 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption3": { 2024-09-19T08:54:49.421 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption3", 2024-09-19T08:54:49.421 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T08:54:49.421 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.421 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.421 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.421 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.421 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.421 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.421 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.421 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.422 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.422 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.422 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption4": { 2024-09-19T08:54:49.422 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption4", 2024-09-19T08:54:49.422 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.422 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.422 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.422 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.422 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.423 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.423 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.423 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.423 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.423 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.423 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.423 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption5": { 2024-09-19T08:54:49.423 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption5", 2024-09-19T08:54:49.423 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.423 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.423 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.424 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.424 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.424 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.424 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.424 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.424 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.424 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.424 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.424 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption6": { 2024-09-19T08:54:49.425 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption6", 2024-09-19T08:54:49.425 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.425 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.425 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.425 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.425 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.425 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.425 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.425 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.425 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.425 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.426 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.426 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption7": { 2024-09-19T08:54:49.426 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption7", 2024-09-19T08:54:49.426 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.426 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.426 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.426 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.426 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T08:54:49.426 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "42", 2024-09-19T08:54:49.426 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.427 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.427 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.427 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.427 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.427 INFO:teuthology.orchestra.run.smithi007.stdout: "testkey": { 2024-09-19T08:54:49.427 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testkey", 2024-09-19T08:54:49.427 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.427 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.427 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.427 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.428 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.428 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.428 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.428 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.428 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.428 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.428 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.428 INFO:teuthology.orchestra.run.smithi007.stdout: "testlkey": { 2024-09-19T08:54:49.428 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testlkey", 2024-09-19T08:54:49.429 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.429 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.429 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.429 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.429 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.429 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.429 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.429 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.429 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.429 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.429 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.430 INFO:teuthology.orchestra.run.smithi007.stdout: "testnewline": { 2024-09-19T08:54:49.430 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testnewline", 2024-09-19T08:54:49.430 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.430 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.430 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.430 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.430 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.430 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.430 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.430 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.430 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.430 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.431 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.431 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.431 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.431 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-09-19T08:54:49.431 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.431 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.431 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.431 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_m_granularity": { 2024-09-19T08:54:49.431 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_m_granularity", 2024-09-19T08:54:49.432 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.432 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.432 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.432 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.432 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.432 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.432 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.432 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T08:54:49.432 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.432 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.432 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.433 INFO:teuthology.orchestra.run.smithi007.stdout: "dump_on_update": { 2024-09-19T08:54:49.433 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dump_on_update", 2024-09-19T08:54:49.433 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.433 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.433 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.433 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.433 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.433 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.433 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.433 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "dump database to debug log on update", 2024-09-19T08:54:49.433 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.434 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.434 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.434 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.434 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.434 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.434 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.434 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.434 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.434 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.434 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.435 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.435 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.435 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.435 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.435 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.435 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.435 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.435 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.435 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.435 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.435 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.436 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.436 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.436 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.436 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.436 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.436 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.436 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.436 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.436 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.436 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.437 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.437 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.437 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.437 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.437 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.437 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.437 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.437 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.437 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.437 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.437 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.438 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.438 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.438 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.438 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.438 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.438 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.438 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.438 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.438 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.438 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.438 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.438 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.439 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.439 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.439 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.439 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.439 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.439 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.439 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.439 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.439 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.439 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.440 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.440 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.440 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.440 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.440 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.440 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.440 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stats", 2024-09-19T08:54:49.440 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.440 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.441 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.441 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.441 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.441 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.441 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.441 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.441 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.441 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.441 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.441 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.441 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.442 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.442 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.442 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.442 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.442 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.442 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.442 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.442 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.442 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.442 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.443 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.443 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.443 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.443 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.443 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.443 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.443 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.443 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.443 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.443 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.443 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.444 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.444 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.444 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.444 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.444 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.444 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.444 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.444 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.444 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.444 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.444 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.445 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.445 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.445 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.445 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.445 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.445 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.445 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.445 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.445 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.445 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.445 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.446 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.446 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.446 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.446 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.446 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.446 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.446 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.446 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.446 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.446 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.447 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.447 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.447 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.447 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.447 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.447 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "status", 2024-09-19T08:54:49.447 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.447 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.447 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.448 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.448 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.448 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.448 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.448 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.448 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.448 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.448 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.448 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.448 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.448 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.448 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.449 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.449 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.449 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.449 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.449 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.449 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.449 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.449 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.449 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.449 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.449 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.450 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.450 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.450 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.450 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.450 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.450 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.450 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.450 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.450 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.450 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.451 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.451 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.451 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.451 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.451 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.451 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.451 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.451 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.451 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.451 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.451 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.451 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.452 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.452 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.452 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.452 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.452 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.452 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.452 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.452 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.452 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.452 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.452 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.453 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.453 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.453 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.453 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.453 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.453 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.453 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.453 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.453 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.453 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.453 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.454 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.454 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telegraf", 2024-09-19T08:54:49.454 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.454 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.454 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.454 INFO:teuthology.orchestra.run.smithi007.stdout: "address": { 2024-09-19T08:54:49.454 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "address", 2024-09-19T08:54:49.454 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.454 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.455 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.455 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T08:54:49.455 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.455 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.455 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.455 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.455 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.455 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.455 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.455 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T08:54:49.456 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T08:54:49.456 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.456 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.456 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.456 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15", 2024-09-19T08:54:49.456 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.456 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.456 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.456 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.456 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.456 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.457 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.457 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.457 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.457 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.457 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.457 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.457 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.457 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.457 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.457 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.458 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.458 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.458 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.458 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.458 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.458 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.458 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.458 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.458 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.458 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.458 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.459 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.459 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.459 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.459 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.459 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.459 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.459 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.459 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.459 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.459 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.459 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.461 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.461 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.461 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.461 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.461 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.461 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.461 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.461 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.461 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.461 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.461 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.461 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.462 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.462 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.462 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.462 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.462 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.462 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.462 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.462 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.462 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.462 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.462 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.463 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.463 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.463 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.463 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.463 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telemetry", 2024-09-19T08:54:49.463 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.463 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.463 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.463 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_basic": { 2024-09-19T08:54:49.463 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_basic", 2024-09-19T08:54:49.464 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.464 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.464 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.464 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.464 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.464 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.464 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.464 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T08:54:49.464 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.464 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.464 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.465 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_crash": { 2024-09-19T08:54:49.465 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_crash", 2024-09-19T08:54:49.465 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.465 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.465 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.465 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.465 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.465 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.465 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.465 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T08:54:49.465 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.466 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.466 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.466 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_device": { 2024-09-19T08:54:49.466 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_device", 2024-09-19T08:54:49.466 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.466 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.466 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.466 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.466 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.466 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.466 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.467 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T08:54:49.467 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.467 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.467 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.467 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_ident": { 2024-09-19T08:54:49.467 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_ident", 2024-09-19T08:54:49.467 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.467 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.467 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.467 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.467 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.468 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.468 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.468 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T08:54:49.468 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.468 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.468 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.468 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_perf": { 2024-09-19T08:54:49.468 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_perf", 2024-09-19T08:54:49.468 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.468 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.469 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.469 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.469 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.469 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.469 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.469 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T08:54:49.469 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.469 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.472 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.472 INFO:teuthology.orchestra.run.smithi007.stdout: "contact": { 2024-09-19T08:54:49.472 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "contact", 2024-09-19T08:54:49.472 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.473 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.473 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.473 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.473 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.473 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.473 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.473 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.473 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.473 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.473 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.473 INFO:teuthology.orchestra.run.smithi007.stdout: "description": { 2024-09-19T08:54:49.474 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "description", 2024-09-19T08:54:49.474 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.474 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.474 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.474 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.474 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.474 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.474 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.474 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.474 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.474 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.474 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.475 INFO:teuthology.orchestra.run.smithi007.stdout: "device_url": { 2024-09-19T08:54:49.475 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_url", 2024-09-19T08:54:49.475 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.475 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.475 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.475 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T08:54:49.475 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.475 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.475 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.475 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.475 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.476 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.476 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.476 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-19T08:54:49.476 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-19T08:54:49.476 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.476 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.476 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.476 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.476 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.476 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.477 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.477 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.477 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.477 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.477 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.477 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T08:54:49.477 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T08:54:49.477 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.477 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.477 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.477 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "24", 2024-09-19T08:54:49.478 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "8", 2024-09-19T08:54:49.478 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.478 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.478 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.478 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.478 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.478 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.478 INFO:teuthology.orchestra.run.smithi007.stdout: "last_opt_revision": { 2024-09-19T08:54:49.478 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "last_opt_revision", 2024-09-19T08:54:49.478 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.479 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.479 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.479 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1", 2024-09-19T08:54:49.479 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.479 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.479 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.479 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.479 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.479 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.479 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.479 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard": { 2024-09-19T08:54:49.480 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard", 2024-09-19T08:54:49.480 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.480 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.480 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.480 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.480 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.480 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.480 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.480 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.480 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.480 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.480 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.481 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard_description": { 2024-09-19T08:54:49.481 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard_description", 2024-09-19T08:54:49.481 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.481 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.481 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.481 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.481 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.481 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.481 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.481 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.482 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.482 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.482 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.482 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.482 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.482 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.482 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.482 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.482 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.482 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.482 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.483 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.483 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.483 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.483 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.483 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.483 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.483 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.483 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.483 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.483 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.483 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.483 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.484 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.484 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.484 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.484 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.484 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.484 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.484 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.484 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.484 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.484 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.485 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.485 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.485 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.485 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.485 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.485 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.485 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.485 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.485 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.485 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.485 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.485 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.486 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.486 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.486 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.486 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.486 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.486 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.486 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.486 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.486 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.486 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.486 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.487 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.487 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.487 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.487 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.487 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.487 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.487 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.487 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.487 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.487 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.487 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.487 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.488 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.488 INFO:teuthology.orchestra.run.smithi007.stdout: "organization": { 2024-09-19T08:54:49.488 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "organization", 2024-09-19T08:54:49.488 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.488 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.488 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.488 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.488 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.488 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.488 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.489 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.489 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.489 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.489 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.489 INFO:teuthology.orchestra.run.smithi007.stdout: "proxy": { 2024-09-19T08:54:49.489 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "proxy", 2024-09-19T08:54:49.489 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.489 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.489 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.490 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.490 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.490 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.490 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.490 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.490 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.490 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.490 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.490 INFO:teuthology.orchestra.run.smithi007.stdout: "url": { 2024-09-19T08:54:49.491 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url", 2024-09-19T08:54:49.491 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.491 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.491 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.491 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T08:54:49.491 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.491 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.491 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.491 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.491 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.492 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.492 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.492 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.492 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.492 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "test_orchestrator", 2024-09-19T08:54:49.492 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.492 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.492 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.493 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.493 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.493 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.493 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.493 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.493 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.493 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.493 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.493 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.493 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.493 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.494 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.494 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.494 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.494 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.494 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.494 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.494 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.494 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.494 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.494 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.495 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.495 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.495 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.495 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.495 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.495 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.495 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.495 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.495 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.495 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.495 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.496 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.496 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.496 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.496 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.496 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.496 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.496 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.496 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.496 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.496 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.497 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.497 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.497 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.497 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.497 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.497 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.497 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.497 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.497 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.497 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.497 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.498 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.498 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.498 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.498 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.498 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.498 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.498 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.498 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.498 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.498 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.498 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.499 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.499 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.499 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.499 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.499 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-09-19T08:54:49.499 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.499 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.499 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.499 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.500 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.500 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.500 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.500 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.500 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.500 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.500 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.500 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.500 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.500 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.500 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.500 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.501 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.501 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.501 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.501 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.501 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.501 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.501 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.501 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.501 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.501 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.501 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.502 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.502 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.502 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.502 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.502 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.502 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.502 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.502 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.502 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.502 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.503 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.503 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.503 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.503 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.503 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.503 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.503 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.503 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.503 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.503 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.503 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.503 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.504 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.504 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.504 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.504 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.504 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.504 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.504 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.504 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.504 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.504 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.504 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.505 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.505 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.505 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.505 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.505 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.505 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.505 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.505 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.505 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.505 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_clones": { 2024-09-19T08:54:49.505 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_clones", 2024-09-19T08:54:49.506 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.506 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.506 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.506 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4", 2024-09-19T08:54:49.506 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.506 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.506 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.506 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T08:54:49.506 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.506 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.506 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.507 INFO:teuthology.orchestra.run.smithi007.stdout: "periodic_async_work": { 2024-09-19T08:54:49.507 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "periodic_async_work", 2024-09-19T08:54:49.507 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.507 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.507 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.507 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.507 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.507 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.507 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.507 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Periodically check for async work", 2024-09-19T08:54:49.507 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.507 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.508 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.508 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_delay": { 2024-09-19T08:54:49.508 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_delay", 2024-09-19T08:54:49.508 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.508 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.508 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.508 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T08:54:49.508 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.508 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.508 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.509 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T08:54:49.509 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.509 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.509 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.509 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_no_wait": { 2024-09-19T08:54:49.509 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T08:54:49.509 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.509 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.509 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.509 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.510 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.510 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.510 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.510 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T08:54:49.510 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.510 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.510 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.510 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.510 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.511 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix", 2024-09-19T08:54:49.511 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.511 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.511 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.511 INFO:teuthology.orchestra.run.smithi007.stdout: "discovery_interval": { 2024-09-19T08:54:49.511 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "discovery_interval", 2024-09-19T08:54:49.511 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T08:54:49.511 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.511 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.511 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "100", 2024-09-19T08:54:49.511 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.512 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.512 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.512 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.512 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.512 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.512 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.512 INFO:teuthology.orchestra.run.smithi007.stdout: "identifier": { 2024-09-19T08:54:49.512 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "identifier", 2024-09-19T08:54:49.512 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.512 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.513 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.513 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.513 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.513 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.513 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.513 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.513 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.513 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.513 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.513 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T08:54:49.514 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T08:54:49.514 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.514 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.514 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.514 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T08:54:49.514 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.514 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.514 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.514 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.514 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.514 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.515 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.515 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.515 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.515 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.515 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.515 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.515 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.515 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.515 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.515 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.516 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.516 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.516 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.516 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.516 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.516 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.516 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.516 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.516 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.516 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.516 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.517 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.517 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.517 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.517 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.517 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.517 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.517 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.517 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.517 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.517 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.518 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.518 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.518 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.518 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.518 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.518 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.518 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.518 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.518 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.518 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.518 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.519 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.519 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.519 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.519 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.519 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.519 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.519 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.519 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.519 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.519 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.519 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.520 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.520 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.520 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.520 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.520 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.520 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.520 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.520 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.520 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.520 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.521 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.521 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.521 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.521 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.521 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_host": { 2024-09-19T08:54:49.521 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_host", 2024-09-19T08:54:49.521 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.521 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.521 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.521 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.521 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.522 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.522 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.522 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.522 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.522 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.522 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.522 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_port": { 2024-09-19T08:54:49.522 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_port", 2024-09-19T08:54:49.522 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.522 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.522 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.523 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10051", 2024-09-19T08:54:49.523 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.523 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.523 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.523 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.523 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.523 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.523 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.523 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_sender": { 2024-09-19T08:54:49.523 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_sender", 2024-09-19T08:54:49.524 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.524 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.524 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.524 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T08:54:49.524 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.524 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.524 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.524 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.524 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.524 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.524 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.525 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.525 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.525 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.525 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-19T08:54:49.525 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.525 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.525 INFO:teuthology.orchestra.run.smithi007.stdout: "modules": [ 2024-09-19T08:54:49.525 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-09-19T08:54:49.525 INFO:teuthology.orchestra.run.smithi007.stdout: "dashboard", 2024-09-19T08:54:49.526 INFO:teuthology.orchestra.run.smithi007.stdout: "iostat", 2024-09-19T08:54:49.526 INFO:teuthology.orchestra.run.smithi007.stdout: "nfs", 2024-09-19T08:54:49.526 INFO:teuthology.orchestra.run.smithi007.stdout: "restful", 2024-09-19T08:54:49.526 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_schedule" 2024-09-19T08:54:49.526 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.526 INFO:teuthology.orchestra.run.smithi007.stdout: "available_modules": [ 2024-09-19T08:54:49.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.526 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "alerts", 2024-09-19T08:54:49.526 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.526 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.526 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.526 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T08:54:49.527 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T08:54:49.527 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.527 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.527 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.527 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T08:54:49.527 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.527 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.527 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.527 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T08:54:49.527 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.527 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.527 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.528 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.528 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.528 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.528 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.528 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.528 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.528 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.528 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.528 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.528 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.529 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.529 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.529 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.529 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.529 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.529 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.529 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.529 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.529 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.529 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.529 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.530 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.530 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.530 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.530 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.530 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.530 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.530 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.530 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.530 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.530 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.530 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.531 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.531 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.531 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.531 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.531 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.531 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.531 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.531 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.531 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.531 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.532 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.532 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.532 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.532 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.532 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.532 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.532 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.532 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.532 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.532 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.532 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.533 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.533 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.533 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.533 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.533 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.533 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.533 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.533 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.533 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.533 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.533 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.534 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.534 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.534 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_destination": { 2024-09-19T08:54:49.534 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_destination", 2024-09-19T08:54:49.534 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.534 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.534 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.534 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.534 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.534 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.534 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.535 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email address to send alerts to", 2024-09-19T08:54:49.535 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.535 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.535 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.535 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_from_name": { 2024-09-19T08:54:49.535 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_from_name", 2024-09-19T08:54:49.535 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.535 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.535 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.535 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "Ceph", 2024-09-19T08:54:49.535 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.536 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.536 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.536 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email From: name", 2024-09-19T08:54:49.536 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.536 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.536 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.536 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_host": { 2024-09-19T08:54:49.536 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_host", 2024-09-19T08:54:49.536 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.536 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.537 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.537 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.537 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.537 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.537 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.537 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP server", 2024-09-19T08:54:49.537 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.537 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.537 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.537 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_password": { 2024-09-19T08:54:49.537 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_password", 2024-09-19T08:54:49.538 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.538 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.538 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.538 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.538 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.538 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.538 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.538 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Password to authenticate with", 2024-09-19T08:54:49.538 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.538 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.538 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.539 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_port": { 2024-09-19T08:54:49.539 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_port", 2024-09-19T08:54:49.539 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.539 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.539 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.539 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "465", 2024-09-19T08:54:49.539 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.539 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.539 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.539 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP port", 2024-09-19T08:54:49.539 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.539 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.540 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.540 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_sender": { 2024-09-19T08:54:49.540 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_sender", 2024-09-19T08:54:49.540 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.540 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.540 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.540 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.540 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.540 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.540 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.541 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP envelope sender", 2024-09-19T08:54:49.541 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.541 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.541 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.541 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_ssl": { 2024-09-19T08:54:49.541 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_ssl", 2024-09-19T08:54:49.541 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.541 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.541 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.541 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.542 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.542 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.542 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.542 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T08:54:49.542 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.542 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.542 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.542 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_user": { 2024-09-19T08:54:49.542 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_user", 2024-09-19T08:54:49.542 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.542 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.542 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.543 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.543 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.543 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.543 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.543 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "User to authenticate as", 2024-09-19T08:54:49.543 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.543 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.543 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.543 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.543 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.544 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "balancer", 2024-09-19T08:54:49.544 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.544 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.544 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.544 INFO:teuthology.orchestra.run.smithi007.stdout: "active": { 2024-09-19T08:54:49.544 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "active", 2024-09-19T08:54:49.544 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.544 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.544 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.544 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.544 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.545 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.545 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.545 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T08:54:49.545 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.545 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.545 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.545 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_time": { 2024-09-19T08:54:49.545 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_time", 2024-09-19T08:54:49.545 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.545 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.546 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.546 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0000", 2024-09-19T08:54:49.546 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.546 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.546 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.546 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T08:54:49.546 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:54:49.546 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.546 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.546 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_weekday": { 2024-09-19T08:54:49.547 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_weekday", 2024-09-19T08:54:49.547 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T08:54:49.547 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.547 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.547 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T08:54:49.547 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-19T08:54:49.547 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-19T08:54:49.547 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.547 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T08:54:49.547 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:54:49.547 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.547 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.548 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_max_iterations": { 2024-09-19T08:54:49.548 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_max_iterations", 2024-09-19T08:54:49.548 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T08:54:49.548 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.548 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.548 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "25", 2024-09-19T08:54:49.548 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T08:54:49.548 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "250", 2024-09-19T08:54:49.548 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.548 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T08:54:49.548 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.549 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.549 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.549 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_metrics": { 2024-09-19T08:54:49.549 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_metrics", 2024-09-19T08:54:49.549 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.549 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.549 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.549 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T08:54:49.549 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.549 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.549 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.550 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T08:54:49.550 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T08:54:49.550 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.550 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.550 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_step": { 2024-09-19T08:54:49.550 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_step", 2024-09-19T08:54:49.550 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T08:54:49.550 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.550 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.551 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.5", 2024-09-19T08:54:49.551 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0.001", 2024-09-19T08:54:49.551 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "0.999", 2024-09-19T08:54:49.551 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.551 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "aggressiveness of optimization", 2024-09-19T08:54:49.551 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T08:54:49.551 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.551 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.551 INFO:teuthology.orchestra.run.smithi007.stdout: "end_time": { 2024-09-19T08:54:49.551 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_time", 2024-09-19T08:54:49.552 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.552 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.552 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.552 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2359", 2024-09-19T08:54:49.552 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.552 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.552 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.552 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T08:54:49.552 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T08:54:49.552 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.552 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.553 INFO:teuthology.orchestra.run.smithi007.stdout: "end_weekday": { 2024-09-19T08:54:49.553 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_weekday", 2024-09-19T08:54:49.553 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T08:54:49.553 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.553 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.553 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T08:54:49.553 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-19T08:54:49.553 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-19T08:54:49.553 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.553 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T08:54:49.553 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T08:54:49.554 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.554 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.554 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.554 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.554 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.554 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.554 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.554 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.554 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.554 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.554 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.555 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.555 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.555 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.555 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.555 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.555 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.555 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.555 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.555 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.555 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.555 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.556 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.556 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.556 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.556 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.556 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.556 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.556 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.556 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.556 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.556 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.556 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.557 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.557 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.557 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.557 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.557 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.557 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.557 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.557 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.557 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.557 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.557 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.558 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.558 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.558 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.558 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.558 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.558 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.558 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.558 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.558 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.558 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.558 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.558 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.559 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.559 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.559 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.559 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.559 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.559 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.559 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.559 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.559 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.559 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.559 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.560 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.560 INFO:teuthology.orchestra.run.smithi007.stdout: "min_score": { 2024-09-19T08:54:49.560 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_score", 2024-09-19T08:54:49.560 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T08:54:49.560 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.560 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.560 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T08:54:49.560 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.560 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.560 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.560 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T08:54:49.561 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.561 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.561 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.561 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-19T08:54:49.561 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-19T08:54:49.561 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.561 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.561 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.561 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "upmap", 2024-09-19T08:54:49.561 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.561 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.562 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.562 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-compat", 2024-09-19T08:54:49.562 INFO:teuthology.orchestra.run.smithi007.stdout: "none", 2024-09-19T08:54:49.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.540+0000 7fb99472a640 1 -- 172.21.15.7:0/25164941 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb9780a33c0 msgr2=0x7fb9780a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:49.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.540+0000 7fb99472a640 1 --2- 172.21.15.7:0/25164941 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb9780a33c0 0x7fb9780a5880 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb98c10e560 tx=0x7fb97c005f90 comp rx=0 tx=0).stop 2024-09-19T08:54:49.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.540+0000 7fb99472a640 1 -- 172.21.15.7:0/25164941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb98c102cf0 msgr2=0x7fb98c198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:49.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.540+0000 7fb99472a640 1 --2- 172.21.15.7:0/25164941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb98c102cf0 0x7fb98c198410 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fb988006010 tx=0x7fb9880042f0 comp rx=0 tx=0).stop 2024-09-19T08:54:49.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.540+0000 7fb99472a640 1 -- 172.21.15.7:0/25164941 shutdown_connections 2024-09-19T08:54:49.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.540+0000 7fb99472a640 1 --2- 172.21.15.7:0/25164941 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fb9780a33c0 0x7fb9780a5880 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:49.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.540+0000 7fb99472a640 1 --2- 172.21.15.7:0/25164941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb98c10c0c0 0x7fb98c19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:49.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.540+0000 7fb99472a640 1 --2- 172.21.15.7:0/25164941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb98c103610 0x7fb98c198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:49.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.540+0000 7fb99472a640 1 --2- 172.21.15.7:0/25164941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb98c102cf0 0x7fb98c198410 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:49.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.540+0000 7fb99472a640 1 -- 172.21.15.7:0/25164941 >> 172.21.15.7:0/25164941 conn(0x7fb98c077a10 msgr2=0x7fb98c0fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:49.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.540+0000 7fb99472a640 1 -- 172.21.15.7:0/25164941 shutdown_connections 2024-09-19T08:54:49.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:54:48.540+0000 7fb99472a640 1 -- 172.21.15.7:0/25164941 wait complete. 2024-09-19T08:54:49.566 INFO:teuthology.orchestra.run.smithi007.stdout: "read", 2024-09-19T08:54:49.566 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap", 2024-09-19T08:54:49.566 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap-read" 2024-09-19T08:54:49.566 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.566 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Balancer mode", 2024-09-19T08:54:49.566 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.566 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.566 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.567 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_ids": { 2024-09-19T08:54:49.567 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_ids", 2024-09-19T08:54:49.567 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.567 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.567 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.567 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.567 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.567 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.567 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.567 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T08:54:49.567 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.568 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.568 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.568 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T08:54:49.568 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T08:54:49.568 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.568 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.568 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.568 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T08:54:49.568 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.568 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.568 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.569 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T08:54:49.569 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.569 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.569 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.569 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_deviation": { 2024-09-19T08:54:49.569 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_deviation", 2024-09-19T08:54:49.569 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.569 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.569 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.569 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T08:54:49.570 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T08:54:49.570 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.570 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.570 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T08:54:49.570 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T08:54:49.570 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.570 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.570 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_optimizations": { 2024-09-19T08:54:49.570 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_optimizations", 2024-09-19T08:54:49.570 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T08:54:49.571 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.571 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.571 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:49.571 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.571 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.571 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.571 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T08:54:49.571 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.571 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.571 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.571 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.571 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.572 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm", 2024-09-19T08:54:49.572 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.572 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.572 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.572 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_down_multiplier": { 2024-09-19T08:54:49.572 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_down_multiplier", 2024-09-19T08:54:49.572 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T08:54:49.572 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.572 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.572 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-19T08:54:49.573 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.573 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.573 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.573 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T08:54:49.573 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.573 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.573 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.573 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_refresh_rate": { 2024-09-19T08:54:49.573 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_refresh_rate", 2024-09-19T08:54:49.573 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.574 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.574 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.574 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "20", 2024-09-19T08:54:49.574 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.574 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.574 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.574 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T08:54:49.574 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.574 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.574 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.574 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_starting_port": { 2024-09-19T08:54:49.575 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_starting_port", 2024-09-19T08:54:49.575 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.575 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.575 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.575 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4721", 2024-09-19T08:54:49.575 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.575 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.575 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.575 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T08:54:49.575 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.575 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.576 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.576 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_ptrace": { 2024-09-19T08:54:49.576 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_ptrace", 2024-09-19T08:54:49.576 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.576 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.576 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.576 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.576 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.576 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.576 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.577 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T08:54:49.577 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T08:54:49.577 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.577 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.577 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_interval": { 2024-09-19T08:54:49.577 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_interval", 2024-09-19T08:54:49.577 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.577 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.577 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.578 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T08:54:49.578 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.578 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.578 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.578 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T08:54:49.578 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.578 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.578 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.578 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_memory_target_ratio": { 2024-09-19T08:54:49.578 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T08:54:49.579 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T08:54:49.579 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.579 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.579 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.7", 2024-09-19T08:54:49.579 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.579 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.579 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.579 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T08:54:49.579 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.579 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.580 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.580 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm_log_destination": { 2024-09-19T08:54:49.580 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm_log_destination", 2024-09-19T08:54:49.580 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.580 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.580 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.580 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.580 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.580 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.580 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.581 INFO:teuthology.orchestra.run.smithi007.stdout: "file", 2024-09-19T08:54:49.581 INFO:teuthology.orchestra.run.smithi007.stdout: "file,syslog", 2024-09-19T08:54:49.581 INFO:teuthology.orchestra.run.smithi007.stdout: "syslog" 2024-09-19T08:54:49.581 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.581 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T08:54:49.581 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.581 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.581 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.581 INFO:teuthology.orchestra.run.smithi007.stdout: "cgroups_split": { 2024-09-19T08:54:49.582 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cgroups_split", 2024-09-19T08:54:49.582 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.582 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.582 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.582 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.582 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.582 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.582 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.582 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T08:54:49.582 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.582 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.582 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.583 INFO:teuthology.orchestra.run.smithi007.stdout: "config_checks_enabled": { 2024-09-19T08:54:49.583 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_checks_enabled", 2024-09-19T08:54:49.583 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.583 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.583 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.583 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.583 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.583 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.583 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.583 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T08:54:49.583 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.584 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.584 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.584 INFO:teuthology.orchestra.run.smithi007.stdout: "config_dashboard": { 2024-09-19T08:54:49.584 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_dashboard", 2024-09-19T08:54:49.584 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.584 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.584 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.584 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.584 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.585 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.585 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.585 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T08:54:49.585 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.585 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.585 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.585 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_alertmanager": { 2024-09-19T08:54:49.585 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_alertmanager", 2024-09-19T08:54:49.585 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.586 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.586 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.586 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T08:54:49.586 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.586 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.586 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.586 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T08:54:49.586 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.586 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.586 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.587 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_base": { 2024-09-19T08:54:49.587 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_base", 2024-09-19T08:54:49.587 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.587 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.587 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.587 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T08:54:49.587 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.587 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.587 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.587 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Container image name, without the tag", 2024-09-19T08:54:49.588 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.588 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.588 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.588 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_elasticsearch": { 2024-09-19T08:54:49.588 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_elasticsearch", 2024-09-19T08:54:49.588 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.588 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.588 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.588 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T08:54:49.588 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.589 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.589 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.589 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "elasticsearch container image", 2024-09-19T08:54:49.589 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.589 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.589 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.589 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_grafana": { 2024-09-19T08:54:49.589 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_grafana", 2024-09-19T08:54:49.589 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.589 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.590 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.590 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T08:54:49.590 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.590 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.590 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.590 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T08:54:49.590 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.590 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.590 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.590 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_haproxy": { 2024-09-19T08:54:49.590 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_haproxy", 2024-09-19T08:54:49.591 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.591 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.591 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.591 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T08:54:49.591 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.591 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.591 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.591 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "HAproxy container image", 2024-09-19T08:54:49.591 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.591 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.591 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.592 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_agent": { 2024-09-19T08:54:49.592 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_agent", 2024-09-19T08:54:49.592 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.592 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.592 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.592 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T08:54:49.592 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.592 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.592 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.592 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger agent container image", 2024-09-19T08:54:49.592 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.593 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.593 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.593 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_collector": { 2024-09-19T08:54:49.593 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_collector", 2024-09-19T08:54:49.593 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.593 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.593 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.593 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T08:54:49.593 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.593 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.594 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.594 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger collector container image", 2024-09-19T08:54:49.594 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.594 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.594 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.594 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_query": { 2024-09-19T08:54:49.594 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_query", 2024-09-19T08:54:49.594 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.594 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.594 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.594 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T08:54:49.595 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.595 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.595 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.595 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger query container image", 2024-09-19T08:54:49.595 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.595 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.595 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.595 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_keepalived": { 2024-09-19T08:54:49.595 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_keepalived", 2024-09-19T08:54:49.595 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.595 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.596 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.596 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T08:54:49.596 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.596 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.596 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.596 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Keepalived container image", 2024-09-19T08:54:49.596 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.596 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.596 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.596 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_loki": { 2024-09-19T08:54:49.597 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_loki", 2024-09-19T08:54:49.597 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.597 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.597 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.597 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T08:54:49.597 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.597 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.597 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.597 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Loki container image", 2024-09-19T08:54:49.597 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.597 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.598 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.598 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_node_exporter": { 2024-09-19T08:54:49.598 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_node_exporter", 2024-09-19T08:54:49.598 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.598 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.598 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.598 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T08:54:49.598 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.598 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.598 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.598 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T08:54:49.598 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.599 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.599 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.599 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nvmeof": { 2024-09-19T08:54:49.599 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nvmeof", 2024-09-19T08:54:49.599 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.599 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.599 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.599 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T08:54:49.599 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.599 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.599 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.600 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nvme-of container image", 2024-09-19T08:54:49.600 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.600 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.600 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.600 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_prometheus": { 2024-09-19T08:54:49.600 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_prometheus", 2024-09-19T08:54:49.600 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.600 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.600 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.600 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T08:54:49.601 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.601 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.601 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.601 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T08:54:49.601 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.601 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.601 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.601 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_promtail": { 2024-09-19T08:54:49.601 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_promtail", 2024-09-19T08:54:49.601 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.601 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.602 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.602 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T08:54:49.602 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.602 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.602 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.602 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Promtail container image", 2024-09-19T08:54:49.602 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.602 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.602 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.602 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_samba": { 2024-09-19T08:54:49.602 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_samba", 2024-09-19T08:54:49.603 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.603 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.603 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.603 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T08:54:49.603 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.603 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.603 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.603 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Samba/SMB container image", 2024-09-19T08:54:49.603 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.603 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.603 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.604 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_snmp_gateway": { 2024-09-19T08:54:49.604 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_snmp_gateway", 2024-09-19T08:54:49.604 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.604 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.604 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.604 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T08:54:49.604 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.604 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.604 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.604 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SNMP Gateway container image", 2024-09-19T08:54:49.604 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.605 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.605 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.605 INFO:teuthology.orchestra.run.smithi007.stdout: "container_init": { 2024-09-19T08:54:49.605 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_init", 2024-09-19T08:54:49.605 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.605 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.605 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.605 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.605 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.605 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.605 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.606 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T08:54:49.606 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.606 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.606 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.606 INFO:teuthology.orchestra.run.smithi007.stdout: "daemon_cache_timeout": { 2024-09-19T08:54:49.606 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "daemon_cache_timeout", 2024-09-19T08:54:49.606 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.606 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.606 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.606 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T08:54:49.607 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.607 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.607 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.607 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T08:54:49.607 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.607 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.607 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.607 INFO:teuthology.orchestra.run.smithi007.stdout: "default_cephadm_command_timeout": { 2024-09-19T08:54:49.607 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T08:54:49.607 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.607 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.608 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.608 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "900", 2024-09-19T08:54:49.608 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.608 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.608 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.608 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T08:54:49.608 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.608 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.608 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.608 INFO:teuthology.orchestra.run.smithi007.stdout: "default_registry": { 2024-09-19T08:54:49.608 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_registry", 2024-09-19T08:54:49.608 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.609 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.609 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.609 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io", 2024-09-19T08:54:49.609 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.609 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.609 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.609 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T08:54:49.609 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.609 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.609 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.610 INFO:teuthology.orchestra.run.smithi007.stdout: "device_cache_timeout": { 2024-09-19T08:54:49.610 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_cache_timeout", 2024-09-19T08:54:49.610 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.610 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.610 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.610 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1800", 2024-09-19T08:54:49.610 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.610 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.610 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.610 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache device inventory", 2024-09-19T08:54:49.610 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.611 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.611 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.611 INFO:teuthology.orchestra.run.smithi007.stdout: "device_enhanced_scan": { 2024-09-19T08:54:49.611 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_enhanced_scan", 2024-09-19T08:54:49.611 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.611 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.611 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.611 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.611 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.611 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.612 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.612 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T08:54:49.612 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.612 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.612 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.612 INFO:teuthology.orchestra.run.smithi007.stdout: "facts_cache_timeout": { 2024-09-19T08:54:49.612 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "facts_cache_timeout", 2024-09-19T08:54:49.612 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.612 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.612 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.612 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T08:54:49.613 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.613 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.613 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.613 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache host facts data", 2024-09-19T08:54:49.613 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.613 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.613 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.613 INFO:teuthology.orchestra.run.smithi007.stdout: "grafana_dashboards_path": { 2024-09-19T08:54:49.613 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "grafana_dashboards_path", 2024-09-19T08:54:49.613 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.614 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.614 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.614 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T08:54:49.614 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.614 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.614 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.614 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T08:54:49.614 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.614 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.614 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.614 INFO:teuthology.orchestra.run.smithi007.stdout: "host_check_interval": { 2024-09-19T08:54:49.615 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "host_check_interval", 2024-09-19T08:54:49.615 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.615 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.615 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.615 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T08:54:49.615 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.615 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.615 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.615 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to perform a host check", 2024-09-19T08:54:49.615 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.615 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.616 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.616 INFO:teuthology.orchestra.run.smithi007.stdout: "hw_monitoring": { 2024-09-19T08:54:49.616 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hw_monitoring", 2024-09-19T08:54:49.616 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.616 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.616 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.616 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.616 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.616 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.616 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.617 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T08:54:49.617 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.617 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.617 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.617 INFO:teuthology.orchestra.run.smithi007.stdout: "inventory_list_all": { 2024-09-19T08:54:49.617 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "inventory_list_all", 2024-09-19T08:54:49.617 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.617 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.617 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.617 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.618 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.618 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.618 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.618 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T08:54:49.618 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.618 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.618 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.618 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.618 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.618 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.618 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.619 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.619 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.619 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.619 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.619 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.619 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.619 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.619 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.619 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.619 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.619 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.619 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.620 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.620 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.620 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.620 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.620 INFO:teuthology.orchestra.run.smithi007.stdout: "log_refresh_metadata": { 2024-09-19T08:54:49.620 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_refresh_metadata", 2024-09-19T08:54:49.620 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.620 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.620 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.620 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.621 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.621 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.621 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.621 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T08:54:49.621 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.621 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.621 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.621 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.621 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.621 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.621 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.622 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.622 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.622 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.622 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.622 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.622 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T08:54:49.622 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.622 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.622 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.622 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.622 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.623 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.623 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.623 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.623 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.623 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.623 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.623 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.623 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.623 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.623 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.623 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.624 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.624 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.624 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.624 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.624 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.624 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.624 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.624 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.624 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.624 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.625 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.625 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.625 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.625 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.625 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.625 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.625 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.625 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.625 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.625 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.625 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T08:54:49.626 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T08:54:49.626 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.626 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.626 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.626 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.626 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.626 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.626 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.626 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T08:54:49.626 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.626 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.627 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.627 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T08:54:49.627 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T08:54:49.627 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.627 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.627 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.627 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "*", 2024-09-19T08:54:49.627 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.627 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.627 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.627 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T08:54:49.628 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.628 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.628 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.628 INFO:teuthology.orchestra.run.smithi007.stdout: "max_count_per_host": { 2024-09-19T08:54:49.628 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_count_per_host", 2024-09-19T08:54:49.628 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.628 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.628 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.628 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:49.628 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.629 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.629 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.629 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of daemons per service per host", 2024-09-19T08:54:49.629 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.629 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.629 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.629 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd_draining_count": { 2024-09-19T08:54:49.629 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_osd_draining_count", 2024-09-19T08:54:49.629 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.629 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.629 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.630 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:49.630 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.630 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.630 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.630 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T08:54:49.630 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.630 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.630 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.630 INFO:teuthology.orchestra.run.smithi007.stdout: "migration_current": { 2024-09-19T08:54:49.630 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "migration_current", 2024-09-19T08:54:49.630 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.630 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.631 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.631 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.631 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.631 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.631 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.631 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "internal - do not modify", 2024-09-19T08:54:49.631 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.631 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.631 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.631 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-19T08:54:49.631 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-19T08:54:49.631 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.632 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.632 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.632 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "root", 2024-09-19T08:54:49.632 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.632 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.632 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.632 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm-package", 2024-09-19T08:54:49.632 INFO:teuthology.orchestra.run.smithi007.stdout: "root" 2024-09-19T08:54:49.632 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.632 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T08:54:49.632 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.632 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.633 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.633 INFO:teuthology.orchestra.run.smithi007.stdout: "oob_default_addr": { 2024-09-19T08:54:49.633 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "oob_default_addr", 2024-09-19T08:54:49.633 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.633 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.633 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.633 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "169.254.1.1", 2024-09-19T08:54:49.633 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.633 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.633 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.634 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T08:54:49.634 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.634 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.634 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.634 INFO:teuthology.orchestra.run.smithi007.stdout: "prometheus_alerts_path": { 2024-09-19T08:54:49.634 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus_alerts_path", 2024-09-19T08:54:49.634 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.634 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.634 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.634 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T08:54:49.634 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.634 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.635 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.635 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T08:54:49.635 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.635 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.635 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.635 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_insecure": { 2024-09-19T08:54:49.635 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_insecure", 2024-09-19T08:54:49.635 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.635 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.635 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.636 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.636 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.636 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.636 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.636 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T08:54:49.636 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.636 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.636 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.636 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_password": { 2024-09-19T08:54:49.636 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_password", 2024-09-19T08:54:49.637 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.637 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.637 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.637 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.637 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.637 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.637 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.637 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T08:54:49.637 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.637 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.637 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.638 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_url": { 2024-09-19T08:54:49.638 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_url", 2024-09-19T08:54:49.638 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.638 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.638 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.638 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.638 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.638 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.638 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.638 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T08:54:49.638 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.638 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.639 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.639 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_username": { 2024-09-19T08:54:49.639 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_username", 2024-09-19T08:54:49.639 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.639 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.639 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.639 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.639 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.639 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.639 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.639 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T08:54:49.640 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.640 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.640 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.640 INFO:teuthology.orchestra.run.smithi007.stdout: "secure_monitoring_stack": { 2024-09-19T08:54:49.640 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secure_monitoring_stack", 2024-09-19T08:54:49.640 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.640 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.640 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.640 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.640 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.640 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.641 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.641 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T08:54:49.641 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.641 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.641 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.641 INFO:teuthology.orchestra.run.smithi007.stdout: "service_discovery_port": { 2024-09-19T08:54:49.641 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "service_discovery_port", 2024-09-19T08:54:49.641 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.641 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.641 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.641 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8765", 2024-09-19T08:54:49.642 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.642 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.642 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.642 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "cephadm service discovery port", 2024-09-19T08:54:49.642 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.642 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.642 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.642 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_config_file": { 2024-09-19T08:54:49.642 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_config_file", 2024-09-19T08:54:49.642 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.642 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.643 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.643 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.643 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.643 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.643 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.643 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T08:54:49.643 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.643 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.643 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.643 INFO:teuthology.orchestra.run.smithi007.stdout: "use_agent": { 2024-09-19T08:54:49.643 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_agent", 2024-09-19T08:54:49.644 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.644 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.644 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.644 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.644 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.644 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.644 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.644 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T08:54:49.644 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.644 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.644 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.645 INFO:teuthology.orchestra.run.smithi007.stdout: "use_repo_digest": { 2024-09-19T08:54:49.645 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_repo_digest", 2024-09-19T08:54:49.645 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.645 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.645 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.645 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.645 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.645 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.645 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.645 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T08:54:49.645 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.646 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.646 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.646 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_failed_host_check": { 2024-09-19T08:54:49.646 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_failed_host_check", 2024-09-19T08:54:49.646 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.646 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.646 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.646 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.646 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.646 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.646 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.647 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T08:54:49.647 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.647 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.647 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.647 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_daemons": { 2024-09-19T08:54:49.647 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_daemons", 2024-09-19T08:54:49.647 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.647 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.647 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.647 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.647 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.647 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.648 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.648 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T08:54:49.648 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.648 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.648 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.648 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_hosts": { 2024-09-19T08:54:49.648 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_hosts", 2024-09-19T08:54:49.648 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.648 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.648 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.648 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.649 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.649 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.649 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.649 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T08:54:49.649 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.649 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.649 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.649 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.649 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.649 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crash", 2024-09-19T08:54:49.649 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.650 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.650 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.650 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.650 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.650 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.650 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.650 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.650 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.650 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.650 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.650 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.651 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.651 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.651 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.651 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.651 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.651 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.651 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.651 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.651 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.651 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.651 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.652 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.652 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.652 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.652 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.652 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.652 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.652 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.652 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.652 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.652 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.652 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.653 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.653 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.653 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.653 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.653 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.653 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.653 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.653 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.653 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.653 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.654 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.654 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.654 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.654 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.654 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.654 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.654 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.654 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.654 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.654 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.654 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.654 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.655 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.655 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.655 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.655 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.655 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.655 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.655 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.655 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.655 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.655 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.655 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.656 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.656 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.656 INFO:teuthology.orchestra.run.smithi007.stdout: "retain_interval": { 2024-09-19T08:54:49.656 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retain_interval", 2024-09-19T08:54:49.656 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.656 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.656 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.656 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "31536000", 2024-09-19T08:54:49.656 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.657 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.657 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.657 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T08:54:49.657 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.657 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.657 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.657 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_recent_interval": { 2024-09-19T08:54:49.657 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_recent_interval", 2024-09-19T08:54:49.657 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.657 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.657 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.658 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1209600", 2024-09-19T08:54:49.658 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.658 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.658 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.658 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T08:54:49.658 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.658 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.658 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.658 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.658 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.659 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dashboard", 2024-09-19T08:54:49.659 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.659 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.659 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.659 INFO:teuthology.orchestra.run.smithi007.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T08:54:49.659 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T08:54:49.659 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.659 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.659 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.659 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:49.659 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.660 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.660 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.660 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.660 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.660 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.660 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.660 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T08:54:49.660 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T08:54:49.660 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.660 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.661 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.661 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.661 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.661 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.661 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.661 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.661 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.661 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.661 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.661 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T08:54:49.662 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T08:54:49.662 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.662 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.662 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.662 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.662 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.662 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.662 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.662 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.662 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.662 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.663 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.663 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_ENABLED": { 2024-09-19T08:54:49.663 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T08:54:49.663 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.663 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.663 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.663 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.663 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.663 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.663 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.664 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.664 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.664 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.664 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.664 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T08:54:49.664 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T08:54:49.664 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.664 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.664 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.664 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.665 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.665 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.665 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.665 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.665 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.665 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.665 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.665 INFO:teuthology.orchestra.run.smithi007.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T08:54:49.665 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T08:54:49.666 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.666 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.666 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.666 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.666 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.666 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.666 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.666 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.666 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.666 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.667 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.667 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T08:54:49.667 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T08:54:49.667 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.667 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.667 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.667 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.667 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.668 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.668 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.668 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.668 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.668 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.668 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.668 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T08:54:49.668 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T08:54:49.668 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.669 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.669 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.669 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.669 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.669 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.669 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.669 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.669 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.669 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.669 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.670 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T08:54:49.670 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T08:54:49.670 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.670 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.670 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.670 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.670 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.670 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.670 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.670 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.670 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.671 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.671 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.671 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T08:54:49.671 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T08:54:49.671 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.671 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.671 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.671 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.671 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.671 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.671 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.672 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.672 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.672 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.672 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.672 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T08:54:49.672 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T08:54:49.672 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.672 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.672 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.672 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.673 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.673 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.673 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.673 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.673 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.673 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.673 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.676 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.679 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.679 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.679 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.679 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.679 INFO:teuthology.orchestra.run.smithi007.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T08:54:49.679 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T08:54:49.679 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.679 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.679 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.679 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.679 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.680 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.680 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.680 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.680 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.680 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.680 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.680 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T08:54:49.680 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T08:54:49.680 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.680 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.681 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.681 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-19T08:54:49.681 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.681 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.681 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.681 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.681 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.681 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.681 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.681 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T08:54:49.682 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T08:54:49.682 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.682 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.682 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.682 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.682 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.682 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.682 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.682 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.682 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.682 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.683 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.683 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_URL": { 2024-09-19T08:54:49.683 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_URL", 2024-09-19T08:54:49.683 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.683 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.683 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.683 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.683 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.683 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.683 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.684 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.684 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.684 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.684 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.684 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T08:54:49.684 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T08:54:49.684 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.684 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.684 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.684 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-19T08:54:49.685 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.685 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.685 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.685 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.685 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.685 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.685 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.685 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T08:54:49.685 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T08:54:49.685 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.685 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.686 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.686 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.686 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.686 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.686 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.686 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.686 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.686 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.686 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.686 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T08:54:49.687 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T08:54:49.687 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.687 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.687 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.687 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.687 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.687 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.687 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.687 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.687 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.687 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.687 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.688 INFO:teuthology.orchestra.run.smithi007.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T08:54:49.688 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T08:54:49.688 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.688 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.688 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.688 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.688 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.688 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.688 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.688 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.689 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.689 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.689 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.689 INFO:teuthology.orchestra.run.smithi007.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T08:54:49.689 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T08:54:49.689 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.689 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.689 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.689 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.689 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.690 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.690 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.690 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.690 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.690 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.690 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.690 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T08:54:49.690 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T08:54:49.690 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.690 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.690 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.691 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.691 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.691 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.691 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.691 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.691 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.691 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.691 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.691 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T08:54:49.691 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T08:54:49.691 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.692 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.692 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.692 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.692 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.692 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.692 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.692 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.692 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.692 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.692 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.693 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T08:54:49.693 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T08:54:49.693 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.693 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.693 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.693 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.693 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.693 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.693 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.693 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.693 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.693 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.694 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.694 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T08:54:49.694 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T08:54:49.694 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.694 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.694 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.694 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.694 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.694 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.694 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.694 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.695 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.695 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.695 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.695 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T08:54:49.695 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T08:54:49.695 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.695 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.695 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.695 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.695 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.696 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.696 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.696 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.696 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.696 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.696 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.696 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T08:54:49.696 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T08:54:49.696 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.696 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.697 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.697 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.697 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.697 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.697 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.697 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.697 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.697 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.697 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.697 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T08:54:49.698 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T08:54:49.698 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.698 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.698 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.698 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.698 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.698 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.698 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.698 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.698 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.698 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.698 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.699 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T08:54:49.699 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T08:54:49.699 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.699 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.699 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.699 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.699 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.699 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.699 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.699 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.699 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.699 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.700 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.700 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T08:54:49.700 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T08:54:49.700 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.700 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.700 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.700 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.700 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.700 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.700 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.700 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.701 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.701 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.701 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.701 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T08:54:49.701 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T08:54:49.701 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.701 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.701 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.701 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.701 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.701 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.702 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.702 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.702 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.702 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.702 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.702 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T08:54:49.702 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T08:54:49.702 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.702 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.702 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.702 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T08:54:49.702 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.703 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.703 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.703 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.703 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.703 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.703 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.703 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T08:54:49.703 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T08:54:49.703 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.703 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.704 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.704 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:49.704 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.704 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.704 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.704 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.704 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.704 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.704 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.704 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T08:54:49.704 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T08:54:49.704 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.705 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.705 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.705 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8", 2024-09-19T08:54:49.705 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.705 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.705 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.705 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.705 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.705 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.705 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.706 INFO:teuthology.orchestra.run.smithi007.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T08:54:49.706 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T08:54:49.706 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.706 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.706 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.706 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "45", 2024-09-19T08:54:49.706 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.706 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.706 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.706 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.706 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.706 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.706 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.707 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T08:54:49.707 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T08:54:49.707 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.707 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.707 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.707 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.707 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.707 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.707 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.707 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.708 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.708 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.708 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.708 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T08:54:49.708 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T08:54:49.708 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.708 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.708 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.708 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-19T08:54:49.708 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.708 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.709 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.709 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.709 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.709 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.709 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.709 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T08:54:49.709 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T08:54:49.709 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.709 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.709 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.710 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.710 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.710 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.710 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.710 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.710 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.710 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.710 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.710 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T08:54:49.710 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T08:54:49.710 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.711 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.711 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.711 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.711 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.711 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.711 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.711 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.711 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.711 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.711 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.711 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T08:54:49.712 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T08:54:49.712 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.712 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.712 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.712 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T08:54:49.712 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.712 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.712 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.712 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.712 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.712 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.712 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.713 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T08:54:49.713 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T08:54:49.713 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.713 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.713 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.713 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:49.713 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.713 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.713 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.713 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.714 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.714 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.714 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.714 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T08:54:49.714 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T08:54:49.714 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.714 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.714 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.714 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T08:54:49.714 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.714 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.715 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.715 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.715 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.715 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.715 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.715 INFO:teuthology.orchestra.run.smithi007.stdout: "cross_origin_url": { 2024-09-19T08:54:49.715 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cross_origin_url", 2024-09-19T08:54:49.715 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.715 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.715 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.716 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.716 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.716 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.716 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.716 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.716 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.716 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.716 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.716 INFO:teuthology.orchestra.run.smithi007.stdout: "crt_file": { 2024-09-19T08:54:49.716 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crt_file", 2024-09-19T08:54:49.717 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.717 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.717 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.717 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.717 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.717 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.717 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.717 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.717 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.717 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.718 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.718 INFO:teuthology.orchestra.run.smithi007.stdout: "debug": { 2024-09-19T08:54:49.718 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "debug", 2024-09-19T08:54:49.718 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.718 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.718 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.718 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.718 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.718 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.719 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.719 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable/disable debug options", 2024-09-19T08:54:49.719 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.719 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.719 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.719 INFO:teuthology.orchestra.run.smithi007.stdout: "jwt_token_ttl": { 2024-09-19T08:54:49.719 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "jwt_token_ttl", 2024-09-19T08:54:49.719 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.719 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.719 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.720 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "28800", 2024-09-19T08:54:49.720 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.720 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.720 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.720 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.720 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.720 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.720 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.720 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-19T08:54:49.720 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-19T08:54:49.721 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.721 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.721 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.721 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.721 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.721 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.721 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.721 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.721 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.721 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.722 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.722 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.722 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.722 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.722 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.722 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.722 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.722 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.722 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.722 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.723 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.723 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.723 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.723 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.723 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.723 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.723 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.723 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.723 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.723 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.723 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.724 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.724 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.724 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.724 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.724 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.724 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.724 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.724 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.724 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.724 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.725 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.725 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.725 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.725 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.725 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.725 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.725 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.725 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.725 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.725 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.726 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.726 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.726 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.726 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.726 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.726 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.726 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.726 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.726 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.726 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.726 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.726 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.727 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.727 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.727 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.727 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.727 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.727 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.727 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.727 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.727 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.727 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.728 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.728 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.728 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.728 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.728 INFO:teuthology.orchestra.run.smithi007.stdout: "motd": { 2024-09-19T08:54:49.728 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "motd", 2024-09-19T08:54:49.728 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.728 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.728 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.728 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.728 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.729 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.729 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.729 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "The message of the day", 2024-09-19T08:54:49.729 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.729 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.729 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.729 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect_resolve_ip_addr": { 2024-09-19T08:54:49.729 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T08:54:49.729 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.729 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.730 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.730 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.730 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.730 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.730 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.730 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.730 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.730 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.730 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.730 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-19T08:54:49.730 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-19T08:54:49.730 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.731 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.731 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.731 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-19T08:54:49.731 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.731 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.731 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.731 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.731 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.731 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.731 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.731 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-19T08:54:49.732 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-19T08:54:49.732 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.732 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.732 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.732 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8080", 2024-09-19T08:54:49.732 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.732 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.732 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.732 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.732 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.732 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.733 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.733 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-19T08:54:49.733 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-19T08:54:49.733 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.733 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.733 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.733 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.733 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.733 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.733 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.733 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.734 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.734 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.734 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.734 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl_server_port": { 2024-09-19T08:54:49.734 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl_server_port", 2024-09-19T08:54:49.734 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.734 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.734 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.734 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8443", 2024-09-19T08:54:49.734 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.734 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.735 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.735 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.735 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.735 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.735 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.735 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-19T08:54:49.735 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-19T08:54:49.735 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.735 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.735 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.735 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "redirect", 2024-09-19T08:54:49.736 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.736 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.736 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.736 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.736 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect" 2024-09-19T08:54:49.736 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.736 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.736 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.736 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.736 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.736 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-19T08:54:49.737 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-19T08:54:49.737 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.737 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.737 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.737 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-19T08:54:49.737 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-19T08:54:49.737 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-19T08:54:49.737 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.737 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.737 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.737 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.737 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.738 INFO:teuthology.orchestra.run.smithi007.stdout: "url_prefix": { 2024-09-19T08:54:49.738 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url_prefix", 2024-09-19T08:54:49.738 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.738 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.738 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.738 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.738 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.738 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.738 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.738 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.738 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.739 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.739 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.739 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.739 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.739 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-09-19T08:54:49.739 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.739 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.739 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.739 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_monitoring": { 2024-09-19T08:54:49.740 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_monitoring", 2024-09-19T08:54:49.740 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.740 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.740 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.740 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.740 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.740 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.740 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.740 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "monitor device health metrics", 2024-09-19T08:54:49.740 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.740 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.741 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.741 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.741 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.741 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.741 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.741 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.741 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.741 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.741 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.741 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.741 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.742 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.742 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.742 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.742 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.742 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.742 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.742 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.742 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.742 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.742 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.742 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.743 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.743 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.743 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.743 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.743 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.743 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.743 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.743 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.743 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.743 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.743 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.743 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.744 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.744 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.744 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.744 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.744 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.744 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.744 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.744 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.744 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.744 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.745 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.745 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.745 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.745 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.745 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.745 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.745 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.745 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.745 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.745 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.746 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.746 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.746 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.746 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.746 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.746 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.746 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.746 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.746 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.746 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.746 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.746 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.747 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.747 INFO:teuthology.orchestra.run.smithi007.stdout: "mark_out_threshold": { 2024-09-19T08:54:49.747 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mark_out_threshold", 2024-09-19T08:54:49.747 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.747 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.747 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.747 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2419200", 2024-09-19T08:54:49.747 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.747 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.747 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.747 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T08:54:49.748 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.748 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.748 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.748 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": { 2024-09-19T08:54:49.748 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_name", 2024-09-19T08:54:49.748 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.748 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.748 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.748 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "device_health_metrics", 2024-09-19T08:54:49.748 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.748 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.749 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.749 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T08:54:49.749 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.749 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.749 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.749 INFO:teuthology.orchestra.run.smithi007.stdout: "retention_period": { 2024-09-19T08:54:49.749 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retention_period", 2024-09-19T08:54:49.749 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.749 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.749 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.749 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15552000", 2024-09-19T08:54:49.749 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.750 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.750 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.750 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain device health metrics", 2024-09-19T08:54:49.750 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.750 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.750 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.750 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_frequency": { 2024-09-19T08:54:49.750 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_frequency", 2024-09-19T08:54:49.750 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.750 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.751 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.751 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-19T08:54:49.751 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.751 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.751 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.751 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T08:54:49.751 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.751 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.751 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.751 INFO:teuthology.orchestra.run.smithi007.stdout: "self_heal": { 2024-09-19T08:54:49.751 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "self_heal", 2024-09-19T08:54:49.751 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.752 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.752 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.752 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.752 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.752 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.752 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.752 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T08:54:49.752 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.752 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.752 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.752 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T08:54:49.753 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T08:54:49.753 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.753 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.753 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.753 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T08:54:49.753 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.753 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.753 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.753 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T08:54:49.753 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.753 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.753 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.754 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_threshold": { 2024-09-19T08:54:49.754 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_threshold", 2024-09-19T08:54:49.754 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.754 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.754 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.754 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7257600", 2024-09-19T08:54:49.754 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.754 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.754 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.754 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T08:54:49.755 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.755 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.755 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.755 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.755 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.755 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "diskprediction_local", 2024-09-19T08:54:49.755 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.755 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.755 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.756 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.756 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.756 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.756 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.756 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.756 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.756 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.756 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.756 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.756 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.756 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.756 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.757 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.757 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.757 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.757 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.757 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.757 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.757 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.757 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.757 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.757 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.757 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.758 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.758 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.758 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.758 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.758 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.758 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.758 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.758 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.758 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.758 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.758 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.758 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.759 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.759 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.759 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.759 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.759 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.759 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.759 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.759 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.759 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.759 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.759 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.759 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.760 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.760 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.760 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.760 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.760 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.760 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.760 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.760 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.760 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.760 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.761 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.761 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.761 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.761 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.761 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.761 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.761 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.761 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.761 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.762 INFO:teuthology.orchestra.run.smithi007.stdout: "predict_interval": { 2024-09-19T08:54:49.762 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predict_interval", 2024-09-19T08:54:49.762 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.762 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.762 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.762 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-19T08:54:49.762 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.762 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.762 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.762 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.762 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.762 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.763 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.763 INFO:teuthology.orchestra.run.smithi007.stdout: "predictor_model": { 2024-09-19T08:54:49.763 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predictor_model", 2024-09-19T08:54:49.763 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.763 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.763 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.763 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "prophetstor", 2024-09-19T08:54:49.763 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.763 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.763 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.763 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.764 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.764 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.764 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.764 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T08:54:49.764 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T08:54:49.764 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.764 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.764 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.764 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T08:54:49.764 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.764 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.764 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.765 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.765 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.765 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.765 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.765 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.765 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.765 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "influx", 2024-09-19T08:54:49.765 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": false, 2024-09-19T08:54:49.765 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "influxdb python module not found", 2024-09-19T08:54:49.766 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.766 INFO:teuthology.orchestra.run.smithi007.stdout: "batch_size": { 2024-09-19T08:54:49.766 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "batch_size", 2024-09-19T08:54:49.766 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.766 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.766 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.766 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5000", 2024-09-19T08:54:49.766 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.766 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.766 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.766 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T08:54:49.766 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.767 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.767 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.767 INFO:teuthology.orchestra.run.smithi007.stdout: "database": { 2024-09-19T08:54:49.767 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "database", 2024-09-19T08:54:49.767 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.767 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.767 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.767 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "ceph", 2024-09-19T08:54:49.767 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.767 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.767 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.767 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T08:54:49.768 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.768 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.768 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.768 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": { 2024-09-19T08:54:49.768 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hostname", 2024-09-19T08:54:49.768 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.768 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.768 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.768 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.768 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.768 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.769 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.769 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server hostname", 2024-09-19T08:54:49.769 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.769 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.769 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.769 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T08:54:49.769 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T08:54:49.769 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.769 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.769 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.769 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "30", 2024-09-19T08:54:49.769 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "5", 2024-09-19T08:54:49.770 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.770 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.770 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T08:54:49.770 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.770 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.770 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.770 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.770 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.770 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.770 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.771 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.771 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.771 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.771 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.771 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.771 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.771 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.771 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.771 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.771 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.771 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.771 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.772 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.772 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.772 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.772 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.772 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.772 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.772 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.772 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.772 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.772 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.772 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.773 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.773 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.773 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.773 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.773 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.773 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.773 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.773 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.773 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.773 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.773 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.774 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.774 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.774 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.774 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.774 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.774 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.774 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.774 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.774 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.774 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.774 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.774 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.775 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.775 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.775 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.775 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.775 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.775 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.775 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.775 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.775 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.775 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.775 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.776 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.776 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.776 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.776 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.776 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.776 INFO:teuthology.orchestra.run.smithi007.stdout: "password": { 2024-09-19T08:54:49.776 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "password", 2024-09-19T08:54:49.776 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.776 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.776 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.777 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.777 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.777 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.777 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.777 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "password of InfluxDB server user", 2024-09-19T08:54:49.777 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.777 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.777 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.777 INFO:teuthology.orchestra.run.smithi007.stdout: "port": { 2024-09-19T08:54:49.777 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "port", 2024-09-19T08:54:49.778 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.778 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.778 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.778 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8086", 2024-09-19T08:54:49.778 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.778 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.778 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.778 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server port", 2024-09-19T08:54:49.778 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.778 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.778 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.779 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-19T08:54:49.779 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-19T08:54:49.779 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.779 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.779 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.779 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "false", 2024-09-19T08:54:49.779 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.779 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.779 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.779 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:54:49.780 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.780 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.780 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.780 INFO:teuthology.orchestra.run.smithi007.stdout: "threads": { 2024-09-19T08:54:49.780 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threads", 2024-09-19T08:54:49.780 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.780 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.780 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.780 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T08:54:49.780 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T08:54:49.780 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "32", 2024-09-19T08:54:49.781 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.781 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T08:54:49.781 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.781 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.781 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.781 INFO:teuthology.orchestra.run.smithi007.stdout: "username": { 2024-09-19T08:54:49.781 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "username", 2024-09-19T08:54:49.781 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.781 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.781 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.782 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.782 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.782 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.782 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.782 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "username of InfluxDB server user", 2024-09-19T08:54:49.782 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.782 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.782 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.782 INFO:teuthology.orchestra.run.smithi007.stdout: "verify_ssl": { 2024-09-19T08:54:49.782 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "verify_ssl", 2024-09-19T08:54:49.782 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.783 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.783 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.783 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "true", 2024-09-19T08:54:49.783 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.783 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.783 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.783 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T08:54:49.783 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.783 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.783 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.783 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.783 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.784 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "insights", 2024-09-19T08:54:49.784 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.784 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.784 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.784 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.784 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.784 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.784 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.784 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.784 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.785 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.785 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.785 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.785 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.785 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.785 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.785 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.785 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.785 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.785 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.785 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.785 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.786 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.786 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.786 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.786 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.786 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.786 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.786 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.786 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.786 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.786 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.787 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.787 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.787 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.787 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.787 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.787 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.787 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.787 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.787 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.787 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.787 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.787 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.788 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.788 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.788 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.788 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.788 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.788 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.788 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.788 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.788 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.788 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.788 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.788 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.789 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.789 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.789 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.789 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.789 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.789 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.789 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.789 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.789 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.789 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.789 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.790 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.790 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.790 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.790 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.790 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.790 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "iostat", 2024-09-19T08:54:49.790 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.790 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.790 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.790 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.791 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.791 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.791 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.791 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.791 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.791 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.791 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.791 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.791 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.791 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.791 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.791 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.791 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.792 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.792 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.792 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.792 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.792 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.792 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.792 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.792 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.792 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.792 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.793 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.793 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.793 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.793 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.793 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.793 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.793 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.793 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.793 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.793 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.793 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.794 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.794 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.794 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.794 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.794 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.794 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.794 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.794 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.794 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.794 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.794 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.794 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.795 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.795 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.795 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.795 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.795 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.795 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.795 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.795 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.795 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.795 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.796 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.796 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.796 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.796 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.796 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.796 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.796 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.796 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.796 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.796 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.797 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.797 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "k8sevents", 2024-09-19T08:54:49.797 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.797 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.797 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.797 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_event_retention_days": { 2024-09-19T08:54:49.797 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ceph_event_retention_days", 2024-09-19T08:54:49.797 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.797 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.798 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.798 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-09-19T08:54:49.798 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.798 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.798 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.798 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T08:54:49.798 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.798 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.798 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.798 INFO:teuthology.orchestra.run.smithi007.stdout: "config_check_secs": { 2024-09-19T08:54:49.798 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_check_secs", 2024-09-19T08:54:49.799 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.799 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.799 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.799 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:49.799 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "10", 2024-09-19T08:54:49.799 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.799 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.799 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T08:54:49.799 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.799 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.799 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.800 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.800 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.800 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.800 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.800 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.800 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.800 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.800 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.800 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.800 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.801 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.801 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.801 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.801 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.801 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.801 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.801 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.801 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.801 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.801 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.802 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.802 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.802 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.802 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.802 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.802 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.802 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.802 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.802 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.802 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.803 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.803 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.803 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.803 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.803 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.803 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.803 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.803 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.803 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.803 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.804 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.804 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.804 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.804 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.804 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.804 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.804 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.804 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.804 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.804 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.805 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.805 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.805 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.805 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.805 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.805 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.805 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.805 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.805 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.805 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.805 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.806 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.806 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.806 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.806 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.806 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.806 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.806 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.806 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "localpool", 2024-09-19T08:54:49.806 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.806 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.807 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.807 INFO:teuthology.orchestra.run.smithi007.stdout: "failure_domain": { 2024-09-19T08:54:49.807 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "failure_domain", 2024-09-19T08:54:49.807 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.807 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.807 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.807 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "host", 2024-09-19T08:54:49.807 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.807 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.807 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.807 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "failure domain for any created local pool", 2024-09-19T08:54:49.808 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T08:54:49.808 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.808 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.808 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.808 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.808 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.808 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.808 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.808 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.808 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.808 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.809 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.809 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.809 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.809 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.809 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.809 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.809 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.809 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.809 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.809 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.809 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.809 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.810 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.810 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.810 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.810 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.810 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.810 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.810 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.810 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.810 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.810 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.810 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.811 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.811 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.811 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.811 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.811 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.811 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.811 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.811 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.811 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.811 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.811 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.812 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.812 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.812 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.812 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.812 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.812 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.812 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.812 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.812 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.812 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.812 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.813 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.813 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.813 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.813 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.813 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.813 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.813 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.813 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.813 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.813 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.813 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.814 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.814 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.814 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": { 2024-09-19T08:54:49.814 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_size", 2024-09-19T08:54:49.814 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.814 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.814 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.814 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.814 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.814 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.815 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.815 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default min_size for any created local pool", 2024-09-19T08:54:49.815 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T08:54:49.815 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.815 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.815 INFO:teuthology.orchestra.run.smithi007.stdout: "num_rep": { 2024-09-19T08:54:49.815 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "num_rep", 2024-09-19T08:54:49.815 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.815 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.815 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.816 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-09-19T08:54:49.816 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.816 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.816 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.816 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default replica count for any created local pool", 2024-09-19T08:54:49.816 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.816 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.816 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.816 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": { 2024-09-19T08:54:49.816 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_num", 2024-09-19T08:54:49.817 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.817 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.817 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.817 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "128", 2024-09-19T08:54:49.817 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.817 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.817 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.817 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T08:54:49.817 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.817 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.817 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.818 INFO:teuthology.orchestra.run.smithi007.stdout: "prefix": { 2024-09-19T08:54:49.818 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prefix", 2024-09-19T08:54:49.818 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.818 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.818 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.818 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.818 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.818 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.818 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.818 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name prefix for any created local pool", 2024-09-19T08:54:49.818 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.818 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.819 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.819 INFO:teuthology.orchestra.run.smithi007.stdout: "subtree": { 2024-09-19T08:54:49.819 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "subtree", 2024-09-19T08:54:49.819 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.819 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.819 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.819 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "rack", 2024-09-19T08:54:49.819 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.819 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.819 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.819 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T08:54:49.819 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T08:54:49.820 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.820 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.820 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.820 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.820 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mds_autoscaler", 2024-09-19T08:54:49.820 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.820 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.820 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.820 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.820 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.821 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.821 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.821 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.821 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.821 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.821 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.821 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.821 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.821 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.821 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.821 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.822 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.822 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.822 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.822 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.822 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.822 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.822 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.822 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.822 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.822 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.822 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.822 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.823 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.823 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.823 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.823 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.823 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.823 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.823 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.823 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.823 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.823 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.824 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.824 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.824 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.824 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.824 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.824 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.824 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.824 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.824 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.824 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.824 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.825 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.825 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.825 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.825 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.825 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.825 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.825 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.825 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.825 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.825 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.825 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.825 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.826 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.826 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.826 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.826 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.826 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.826 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.826 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.826 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.826 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.826 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.827 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirroring", 2024-09-19T08:54:49.827 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.827 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.827 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.827 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.827 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.827 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.827 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.827 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.827 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.827 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.827 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.828 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.828 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.828 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.828 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.828 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.828 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.828 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.828 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.828 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.828 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.828 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.828 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.829 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.829 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.829 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.829 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.829 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.829 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.829 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.829 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.829 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.829 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.829 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.830 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.830 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.830 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.830 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.830 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.830 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.830 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.830 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.830 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.830 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.830 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.831 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.831 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.831 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.831 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.831 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.831 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.831 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.831 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.831 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.831 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.831 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.832 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.832 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.832 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.832 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.832 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.832 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.832 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.832 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.832 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.832 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.832 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.832 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.833 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.833 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.833 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.833 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "nfs", 2024-09-19T08:54:49.833 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.833 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.833 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.833 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.833 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.834 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.834 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.834 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.834 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.834 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.834 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.834 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.834 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.834 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.834 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.835 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.835 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.835 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.835 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.835 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.835 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.835 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.835 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.835 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.835 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.835 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.836 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.836 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.836 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.836 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.836 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.836 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.836 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.836 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.836 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.836 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.837 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.837 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.837 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.837 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.837 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.837 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.837 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.837 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.837 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.837 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.837 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.838 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.838 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.838 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.838 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.838 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.838 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.838 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.838 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.838 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.838 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.838 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.839 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.839 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.839 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.839 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.839 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.839 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.839 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.839 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.839 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.839 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.839 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.840 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.840 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.840 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-19T08:54:49.840 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.840 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.840 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.840 INFO:teuthology.orchestra.run.smithi007.stdout: "fail_fs": { 2024-09-19T08:54:49.840 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "fail_fs", 2024-09-19T08:54:49.840 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.840 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.841 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.841 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.841 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.841 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.841 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.841 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T08:54:49.841 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.841 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.841 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.841 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.842 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.842 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.842 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.842 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.842 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.842 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.842 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.842 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.842 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.842 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.842 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.842 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.843 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.843 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.843 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.843 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.843 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.843 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.843 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.843 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.843 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.843 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.843 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.843 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.844 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.844 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.844 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.844 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.844 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.844 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.844 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.844 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.844 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.844 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.845 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.845 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.845 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.845 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.845 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.845 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.845 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.845 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.845 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.845 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.846 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.846 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.846 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.846 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.846 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.846 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.846 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.846 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.846 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.846 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.847 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.847 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.847 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.847 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.847 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.847 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.847 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.847 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.847 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.847 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.847 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.848 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator": { 2024-09-19T08:54:49.848 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-19T08:54:49.848 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.848 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.848 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.848 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.848 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.848 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.848 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.848 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-09-19T08:54:49.848 INFO:teuthology.orchestra.run.smithi007.stdout: "rook", 2024-09-19T08:54:49.849 INFO:teuthology.orchestra.run.smithi007.stdout: "test_orchestrator" 2024-09-19T08:54:49.849 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.849 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Orchestrator backend", 2024-09-19T08:54:49.849 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.849 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.849 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.849 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.849 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.849 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_perf_query", 2024-09-19T08:54:49.850 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.850 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.850 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.850 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.850 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.850 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.850 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.850 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.850 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.850 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.851 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.851 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.851 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.851 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.851 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.851 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.851 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.851 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.851 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.851 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.851 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.851 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.852 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.852 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.852 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.852 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.852 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.852 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.852 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.852 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.852 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.852 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.853 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.853 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.853 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.853 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.853 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.853 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.853 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.853 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.853 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.853 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.854 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.854 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.854 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.854 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.854 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.854 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.854 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.854 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.854 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.854 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.854 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.855 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.855 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.855 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.855 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.855 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.855 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.855 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.855 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.855 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.855 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.856 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.856 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.856 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.856 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.856 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.856 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.856 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.856 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.856 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_support", 2024-09-19T08:54:49.856 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.857 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.857 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.857 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.857 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.857 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.857 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.857 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.857 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.857 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.857 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.857 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.857 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.858 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.858 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.858 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.858 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.858 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.858 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.858 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.858 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.858 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.858 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.859 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.859 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.859 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.859 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.859 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.859 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.859 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.859 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.859 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.859 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.859 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.859 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.860 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.860 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.860 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.860 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.860 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.860 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.860 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.860 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.860 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.860 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.861 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.861 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.861 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.861 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.861 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.861 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.861 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.861 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.861 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.861 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.861 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.862 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.862 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.862 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.862 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.862 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.862 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.862 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.862 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.862 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.862 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.862 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.863 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.863 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.863 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.863 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.863 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_autoscaler", 2024-09-19T08:54:49.863 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.863 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.863 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.863 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.864 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.864 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.864 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.864 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.864 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.864 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.864 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.864 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.864 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.864 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.864 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.864 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.865 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.865 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.865 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.865 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.865 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.865 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.865 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.865 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.865 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.865 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.866 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.866 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.866 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.866 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.866 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.866 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.866 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.866 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.866 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.866 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.867 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.867 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.867 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.867 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.867 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.867 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.867 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.867 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.867 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.867 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.867 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.867 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.868 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.868 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.868 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.868 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.868 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.868 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.868 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.868 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.868 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.869 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.869 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.869 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.869 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.869 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.869 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.869 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.869 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.869 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.869 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.869 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.870 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.870 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T08:54:49.870 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T08:54:49.870 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.870 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.870 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.870 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T08:54:49.870 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.870 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.870 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.870 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.871 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.871 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.871 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.871 INFO:teuthology.orchestra.run.smithi007.stdout: "threshold": { 2024-09-19T08:54:49.871 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threshold", 2024-09-19T08:54:49.871 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T08:54:49.871 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.871 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.871 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-19T08:54:49.871 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1.0", 2024-09-19T08:54:49.871 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.871 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.872 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "scaling threshold", 2024-09-19T08:54:49.872 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T08:54:49.872 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.872 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.872 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.872 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.872 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "progress", 2024-09-19T08:54:49.872 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.872 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.872 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.873 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_pg_recovery_event": { 2024-09-19T08:54:49.873 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_pg_recovery_event", 2024-09-19T08:54:49.873 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.873 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.873 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.873 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.873 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.873 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.873 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.873 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T08:54:49.873 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.874 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.874 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.874 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-19T08:54:49.874 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-19T08:54:49.874 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.874 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.874 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.874 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.874 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.874 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.874 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.874 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.875 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.875 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.875 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.875 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.875 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.875 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.875 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.875 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.875 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.876 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.876 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.876 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.876 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.876 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.876 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.876 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.876 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.876 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.876 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.876 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.876 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.877 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.877 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.877 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.877 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.877 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.877 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.877 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.877 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.877 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.877 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.877 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.878 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.878 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.878 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.878 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.878 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.878 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.880 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.880 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.880 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.880 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.881 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.881 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.881 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.881 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.881 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.881 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.881 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.881 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.881 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.881 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.881 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.882 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.882 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.882 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.882 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.882 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.882 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.882 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.882 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.882 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.883 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.883 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.883 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.883 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.883 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.883 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.883 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.883 INFO:teuthology.orchestra.run.smithi007.stdout: "max_completed_events": { 2024-09-19T08:54:49.883 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_completed_events", 2024-09-19T08:54:49.883 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.883 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.883 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.884 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "50", 2024-09-19T08:54:49.884 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.884 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.884 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.884 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "number of past completed events to remember", 2024-09-19T08:54:49.884 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.884 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.884 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.884 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T08:54:49.885 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T08:54:49.885 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.885 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.885 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.885 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T08:54:49.885 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.885 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.885 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.885 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long the module is going to sleep", 2024-09-19T08:54:49.885 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.885 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.885 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.886 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.886 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.886 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus", 2024-09-19T08:54:49.886 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.886 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.886 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.886 INFO:teuthology.orchestra.run.smithi007.stdout: "cache": { 2024-09-19T08:54:49.886 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cache", 2024-09-19T08:54:49.886 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.886 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.887 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.887 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.887 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.887 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.887 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.887 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.887 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.887 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.887 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.887 INFO:teuthology.orchestra.run.smithi007.stdout: "exclude_perf_counters": { 2024-09-19T08:54:49.887 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "exclude_perf_counters", 2024-09-19T08:54:49.887 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.888 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.888 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.888 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.888 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.888 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.888 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.888 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T08:54:49.888 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T08:54:49.888 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.888 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.889 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.889 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.889 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.889 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.889 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.889 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.889 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.889 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.889 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.889 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.889 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.889 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.890 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.890 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.890 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.890 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.890 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.890 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.890 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.890 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.890 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.890 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.891 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.891 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.891 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.891 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.891 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.891 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.891 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.891 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.891 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.891 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.891 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.892 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.892 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.892 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.892 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.892 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.892 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.892 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.892 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.892 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.892 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.893 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.893 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.893 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.893 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.893 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.893 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.893 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.893 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.893 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.893 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.893 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.894 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.894 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.894 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.894 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.894 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.894 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.894 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.894 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.894 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.894 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.894 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.895 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.895 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools": { 2024-09-19T08:54:49.895 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools", 2024-09-19T08:54:49.895 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.895 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.895 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.895 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.895 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.895 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.895 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.896 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.896 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.896 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.896 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.896 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T08:54:49.896 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T08:54:49.896 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.896 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.896 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.896 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "300", 2024-09-19T08:54:49.897 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.897 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.897 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.897 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.897 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.897 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.897 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.897 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_interval": { 2024-09-19T08:54:49.897 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_interval", 2024-09-19T08:54:49.897 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T08:54:49.898 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.898 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.898 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15.0", 2024-09-19T08:54:49.898 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.898 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.898 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.898 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.898 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.898 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.898 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.898 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-19T08:54:49.899 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-19T08:54:49.899 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.899 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.899 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.899 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-19T08:54:49.899 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.899 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.899 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.899 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T08:54:49.899 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.899 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.899 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.900 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-19T08:54:49.900 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-19T08:54:49.900 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.900 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.900 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.900 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "9283", 2024-09-19T08:54:49.900 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.900 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.900 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.900 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T08:54:49.900 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.901 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.901 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.901 INFO:teuthology.orchestra.run.smithi007.stdout: "stale_cache_strategy": { 2024-09-19T08:54:49.901 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stale_cache_strategy", 2024-09-19T08:54:49.901 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.901 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.901 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.901 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "log", 2024-09-19T08:54:49.901 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.901 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.901 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.902 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.902 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.902 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.902 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.902 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-19T08:54:49.902 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-19T08:54:49.902 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.902 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.902 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.902 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "default", 2024-09-19T08:54:49.902 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.902 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.903 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.903 INFO:teuthology.orchestra.run.smithi007.stdout: "default", 2024-09-19T08:54:49.903 INFO:teuthology.orchestra.run.smithi007.stdout: "error" 2024-09-19T08:54:49.903 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.903 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.903 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.903 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.903 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.903 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-19T08:54:49.903 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-19T08:54:49.903 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.904 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.904 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.904 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-19T08:54:49.904 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-19T08:54:49.904 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-19T08:54:49.904 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.904 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.904 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.904 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.904 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.905 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.905 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.905 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-09-19T08:54:49.905 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.905 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.905 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.905 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.905 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.905 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.905 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.906 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.906 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.906 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.906 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.906 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.906 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.906 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.906 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.906 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.906 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.906 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.906 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.906 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.907 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.907 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.907 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.907 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.907 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.907 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.907 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.907 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.907 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.907 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.908 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.908 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.908 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.908 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.908 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.908 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.908 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.908 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.908 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.909 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.909 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.909 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.909 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.909 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.909 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.909 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.909 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.909 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.909 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.909 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.910 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.910 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.910 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.910 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.910 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.910 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.910 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.910 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.910 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.910 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.910 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.911 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.911 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.911 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.911 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.911 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.911 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.911 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.911 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.911 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_snap_create": { 2024-09-19T08:54:49.911 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_snap_create", 2024-09-19T08:54:49.911 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.912 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.912 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.912 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T08:54:49.912 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.912 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.912 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.912 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.912 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.912 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.912 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.912 INFO:teuthology.orchestra.run.smithi007.stdout: "mirror_snapshot_schedule": { 2024-09-19T08:54:49.913 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T08:54:49.913 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.913 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.913 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.913 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.913 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.913 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.913 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.913 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.913 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.913 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.914 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.914 INFO:teuthology.orchestra.run.smithi007.stdout: "trash_purge_schedule": { 2024-09-19T08:54:49.914 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "trash_purge_schedule", 2024-09-19T08:54:49.914 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.914 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.914 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.914 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.914 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.914 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.914 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.915 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.915 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.915 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.915 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.915 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.915 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.915 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.915 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "restful", 2024-09-19T08:54:49.915 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.915 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.915 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.916 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_auth": { 2024-09-19T08:54:49.916 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_auth", 2024-09-19T08:54:49.916 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.916 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.916 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.916 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.916 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.916 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.916 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.916 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.916 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.917 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.917 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.917 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-19T08:54:49.917 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-19T08:54:49.917 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.917 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.917 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.917 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.917 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.917 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.917 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.918 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.918 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.918 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.918 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.918 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.918 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.918 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.918 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.918 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.918 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.918 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.918 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.919 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.919 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.919 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.919 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.919 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.919 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.919 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.919 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.919 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.919 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.919 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.919 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.920 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.920 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.920 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.920 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.920 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.920 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.920 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.920 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.920 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.920 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.921 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.921 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.921 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.921 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.921 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.921 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.921 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.921 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.921 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.921 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.922 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.922 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.922 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.922 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.922 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.922 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.923 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.923 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.923 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.923 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.923 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.923 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.923 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.923 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.923 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.924 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.924 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.924 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.924 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.924 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.924 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.924 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.924 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.924 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.924 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.925 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.925 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-19T08:54:49.925 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-19T08:54:49.925 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.925 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.925 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.925 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.925 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.925 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.925 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.925 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.926 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.926 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.926 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.926 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-19T08:54:49.926 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-19T08:54:49.926 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.926 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.926 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.926 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.926 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.927 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.927 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.927 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.927 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.927 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.927 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.927 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.927 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.927 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rgw", 2024-09-19T08:54:49.928 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.928 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.928 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.928 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.928 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.928 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.928 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.928 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.928 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.928 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.928 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.929 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.929 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.929 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.929 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.929 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.929 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.929 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.929 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.929 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.929 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.929 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.929 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.930 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.930 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.930 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.930 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.930 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.930 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.930 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.930 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.930 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.931 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.931 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.931 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.931 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.931 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.931 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.931 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.931 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.931 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.931 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.932 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.932 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.932 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.932 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.932 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.932 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.932 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.932 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.932 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.932 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.932 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.933 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.933 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.933 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.933 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.933 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.933 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.933 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.933 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.933 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.933 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.934 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.934 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.934 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.934 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.934 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.934 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.934 INFO:teuthology.orchestra.run.smithi007.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T08:54:49.934 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T08:54:49.934 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.935 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.935 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.935 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T08:54:49.935 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.935 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.935 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.935 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T08:54:49.935 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.935 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.935 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.935 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.936 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.936 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rook", 2024-09-19T08:54:49.936 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.936 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.936 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.936 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.936 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.936 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.937 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.937 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.937 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.937 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.937 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.937 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.937 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.937 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.937 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.937 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.937 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.938 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.938 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.938 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.938 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.938 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.938 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.938 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.938 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.938 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.938 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.938 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.939 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.939 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.939 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.939 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.939 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.939 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.939 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.939 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.939 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.939 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.940 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.940 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.940 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.940 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.940 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.940 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.940 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.940 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.940 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.940 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.940 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.941 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.941 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.941 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.941 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.941 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.941 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.941 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.941 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.941 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.941 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.941 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.942 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.942 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.942 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.942 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.942 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.942 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.942 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.942 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.942 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.942 INFO:teuthology.orchestra.run.smithi007.stdout: "storage_class": { 2024-09-19T08:54:49.943 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "storage_class", 2024-09-19T08:54:49.943 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.943 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.943 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.943 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "local", 2024-09-19T08:54:49.943 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.943 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.943 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.943 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T08:54:49.943 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.943 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.943 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.944 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.944 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.944 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "selftest", 2024-09-19T08:54:49.944 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.944 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.944 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.944 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.944 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.945 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.945 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.945 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.945 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.945 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.945 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.945 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.945 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.945 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.945 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.946 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.946 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.946 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.946 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.946 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.946 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.946 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.946 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.946 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.946 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.947 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.947 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.947 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.947 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.947 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.947 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.947 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.947 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.947 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.947 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.947 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.948 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.948 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.948 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.948 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.948 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.948 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.948 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.948 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.948 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.948 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.948 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.949 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.949 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.949 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.949 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.949 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.949 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.949 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.949 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.949 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.949 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.950 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.950 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.950 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.950 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.950 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.950 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.950 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.950 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.950 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.950 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.950 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.951 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.951 INFO:teuthology.orchestra.run.smithi007.stdout: "roption1": { 2024-09-19T08:54:49.951 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption1", 2024-09-19T08:54:49.951 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.951 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.951 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.951 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.951 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.951 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.951 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.951 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.952 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.952 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.952 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.952 INFO:teuthology.orchestra.run.smithi007.stdout: "roption2": { 2024-09-19T08:54:49.952 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption2", 2024-09-19T08:54:49.952 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.952 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.952 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.952 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "xyz", 2024-09-19T08:54:49.952 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.953 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.953 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.953 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.953 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.953 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.953 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.953 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption1": { 2024-09-19T08:54:49.953 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption1", 2024-09-19T08:54:49.953 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.953 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.953 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.954 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.954 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.954 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.954 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.954 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.954 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.954 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.954 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.954 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption2": { 2024-09-19T08:54:49.954 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption2", 2024-09-19T08:54:49.955 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.955 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.955 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.955 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.955 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.955 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.955 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.955 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.955 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.955 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.955 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.956 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption3": { 2024-09-19T08:54:49.956 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption3", 2024-09-19T08:54:49.956 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T08:54:49.956 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.956 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.956 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.956 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.956 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.956 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.956 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.957 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.957 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.957 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.957 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption4": { 2024-09-19T08:54:49.957 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption4", 2024-09-19T08:54:49.957 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.957 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.957 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.957 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.957 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.957 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.958 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.958 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.958 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.958 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.958 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.958 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption5": { 2024-09-19T08:54:49.958 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption5", 2024-09-19T08:54:49.958 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.958 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.958 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.958 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.958 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.959 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.959 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.959 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.959 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.959 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.959 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.959 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption6": { 2024-09-19T08:54:49.959 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption6", 2024-09-19T08:54:49.959 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.960 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.960 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.960 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.960 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.960 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.960 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.960 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.960 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.960 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.960 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.961 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption7": { 2024-09-19T08:54:49.961 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption7", 2024-09-19T08:54:49.961 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:49.961 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.961 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.961 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.961 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T08:54:49.961 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "42", 2024-09-19T08:54:49.961 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.961 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.961 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.962 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.962 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.962 INFO:teuthology.orchestra.run.smithi007.stdout: "testkey": { 2024-09-19T08:54:49.962 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testkey", 2024-09-19T08:54:49.962 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.962 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.962 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.962 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.962 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.962 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.962 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.963 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.963 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.963 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.963 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.963 INFO:teuthology.orchestra.run.smithi007.stdout: "testlkey": { 2024-09-19T08:54:49.963 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testlkey", 2024-09-19T08:54:49.963 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.963 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.963 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.963 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.964 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.964 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.964 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.964 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.964 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.964 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.964 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.964 INFO:teuthology.orchestra.run.smithi007.stdout: "testnewline": { 2024-09-19T08:54:49.964 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testnewline", 2024-09-19T08:54:49.964 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.965 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.965 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.965 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.965 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.965 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.965 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.965 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.965 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.965 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.965 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.965 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.965 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.966 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-09-19T08:54:49.966 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.966 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.966 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.966 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_m_granularity": { 2024-09-19T08:54:49.966 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_m_granularity", 2024-09-19T08:54:49.966 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.966 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.966 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.966 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.967 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.967 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.967 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.967 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T08:54:49.967 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.967 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.967 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.967 INFO:teuthology.orchestra.run.smithi007.stdout: "dump_on_update": { 2024-09-19T08:54:49.967 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dump_on_update", 2024-09-19T08:54:49.967 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.967 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.967 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.968 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.968 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.968 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.968 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.968 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "dump database to debug log on update", 2024-09-19T08:54:49.968 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.968 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.968 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.968 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.968 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.969 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.969 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.969 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.969 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.969 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.969 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.969 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.969 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.969 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.969 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.969 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.970 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.970 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.970 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.970 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.970 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.970 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.970 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.970 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.970 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.971 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.971 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.971 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.971 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.971 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.971 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.971 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.971 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.971 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.971 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.971 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.972 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.972 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.972 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.972 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.972 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.972 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.972 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.972 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.972 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.972 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.973 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.973 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.973 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.973 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.973 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.973 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.973 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.973 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.973 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.973 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.974 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.974 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.974 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.974 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.974 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.974 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.974 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.974 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.974 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.974 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.974 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.974 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.975 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.975 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.975 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.975 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stats", 2024-09-19T08:54:49.975 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.975 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.975 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.975 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.975 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.975 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.976 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.976 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.976 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.976 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.976 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.976 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.976 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.976 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.976 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.976 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.976 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.977 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.977 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.977 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.977 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.977 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.977 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.977 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.977 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.977 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.978 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.978 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.978 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.978 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.978 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.978 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.978 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.978 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.978 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.978 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.978 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.979 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.979 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.979 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.979 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.979 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.979 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.979 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.979 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.979 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.979 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.979 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.980 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.980 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.980 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.980 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.980 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.980 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.980 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.980 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.980 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.980 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.980 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.981 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.981 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.981 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.981 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.981 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.981 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.981 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.981 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.981 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.981 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.982 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.982 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.982 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "status", 2024-09-19T08:54:49.982 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.982 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.982 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.982 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.982 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.982 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.982 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.982 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.983 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.983 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.983 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.983 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.983 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.983 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.983 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.983 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.983 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.983 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.983 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.983 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.984 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.984 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.984 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.984 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.984 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.984 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.984 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.984 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.984 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.984 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.984 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.985 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.985 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.985 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.985 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.985 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.985 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.985 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.985 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.985 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.985 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.985 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.985 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.986 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.986 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.986 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.986 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.986 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.986 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.986 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.986 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.986 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.986 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.986 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.987 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.987 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.987 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.987 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.987 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.987 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.987 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.987 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.987 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.987 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.987 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.987 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.988 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.988 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.988 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.988 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.988 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.988 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telegraf", 2024-09-19T08:54:49.988 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.988 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.988 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.989 INFO:teuthology.orchestra.run.smithi007.stdout: "address": { 2024-09-19T08:54:49.989 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "address", 2024-09-19T08:54:49.989 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.989 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.989 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.989 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T08:54:49.989 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.989 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.989 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.989 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.990 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.990 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.990 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.990 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T08:54:49.990 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T08:54:49.990 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:49.990 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.990 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.990 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15", 2024-09-19T08:54:49.990 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.991 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.991 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.991 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.991 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.991 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.991 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.991 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:49.991 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:49.991 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.991 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.992 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.992 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:49.992 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.992 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.992 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.992 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.992 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.992 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.992 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.992 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.992 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.993 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.993 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.993 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.993 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.993 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.993 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:49.993 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:49.993 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.993 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.993 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.993 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.994 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.994 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.994 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.994 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.994 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.994 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.994 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.994 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:49.994 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:49.994 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:49.995 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.995 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.995 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:49.995 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.995 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.995 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:49.995 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:49.995 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:49.995 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:49.995 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:49.995 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:49.996 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:49.996 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:49.996 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.996 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.996 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.996 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.996 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:49.996 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:49.996 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.996 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.997 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:49.997 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:49.997 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.997 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.997 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.997 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:49.997 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.997 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.997 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.997 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.997 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:49.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:49.998 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telemetry", 2024-09-19T08:54:49.998 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:49.998 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:49.998 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:49.998 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_basic": { 2024-09-19T08:54:49.998 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_basic", 2024-09-19T08:54:49.998 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.998 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:49.998 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:49.998 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:49.999 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:49.999 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:49.999 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:49.999 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T08:54:49.999 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:49.999 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:49.999 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:49.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:49.999 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_crash": { 2024-09-19T08:54:49.999 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_crash", 2024-09-19T08:54:49.999 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:49.999 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.000 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.000 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:50.000 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.000 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.000 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.000 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T08:54:50.000 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.000 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.000 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.000 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_device": { 2024-09-19T08:54:50.000 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_device", 2024-09-19T08:54:50.001 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:50.001 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.001 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.001 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:50.001 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.001 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.001 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.001 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T08:54:50.001 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.001 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.001 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.002 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_ident": { 2024-09-19T08:54:50.002 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_ident", 2024-09-19T08:54:50.002 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:50.002 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.002 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.002 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:50.002 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.002 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.002 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.002 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T08:54:50.002 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.003 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.003 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.003 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_perf": { 2024-09-19T08:54:50.003 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_perf", 2024-09-19T08:54:50.003 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:50.003 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.003 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.003 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:50.003 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.003 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.003 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.004 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T08:54:50.004 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.004 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.004 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.004 INFO:teuthology.orchestra.run.smithi007.stdout: "contact": { 2024-09-19T08:54:50.004 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "contact", 2024-09-19T08:54:50.004 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:50.004 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.004 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.004 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:50.004 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.005 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.005 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.005 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.005 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.005 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.005 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.005 INFO:teuthology.orchestra.run.smithi007.stdout: "description": { 2024-09-19T08:54:50.005 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "description", 2024-09-19T08:54:50.005 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:50.005 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.005 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.006 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:50.006 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.006 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.006 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.006 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.006 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.006 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.006 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.006 INFO:teuthology.orchestra.run.smithi007.stdout: "device_url": { 2024-09-19T08:54:50.006 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_url", 2024-09-19T08:54:50.007 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:50.007 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.007 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.007 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T08:54:50.007 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.007 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.007 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.007 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.007 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.007 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.007 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.007 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-19T08:54:50.008 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-19T08:54:50.008 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:50.008 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.008 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.008 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:50.008 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.008 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.008 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.008 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.008 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.009 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.009 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.009 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T08:54:50.009 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T08:54:50.009 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:50.009 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.009 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.009 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "24", 2024-09-19T08:54:50.009 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "8", 2024-09-19T08:54:50.009 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.009 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.009 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.010 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.010 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.010 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.010 INFO:teuthology.orchestra.run.smithi007.stdout: "last_opt_revision": { 2024-09-19T08:54:50.010 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "last_opt_revision", 2024-09-19T08:54:50.010 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:50.010 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.010 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.010 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1", 2024-09-19T08:54:50.010 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.011 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.011 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.011 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.011 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.011 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.011 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.011 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard": { 2024-09-19T08:54:50.011 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard", 2024-09-19T08:54:50.011 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:50.012 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.012 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.012 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:50.012 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.012 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.012 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.012 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.012 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.012 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.012 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.013 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard_description": { 2024-09-19T08:54:50.013 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard_description", 2024-09-19T08:54:50.013 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:50.013 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.013 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.013 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:50.013 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.013 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.013 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.013 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.014 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.014 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.014 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.014 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:50.014 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:50.014 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:50.014 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.014 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:50.014 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:50.014 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.015 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.015 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:50.015 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:50.015 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:50.015 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:50.015 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:50.015 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:50.015 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:50.015 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:50.015 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.016 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.016 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.016 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.016 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:50.016 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:50.016 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:50.016 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.016 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:50.016 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:50.017 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.017 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.017 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.017 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.017 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.017 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.017 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.017 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:50.017 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:50.018 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:50.018 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.018 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:50.018 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:50.018 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.018 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.018 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:50.018 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:50.018 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:50.018 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:50.018 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:50.019 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:50.019 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:50.019 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:50.019 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.019 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.019 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.019 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.019 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:50.019 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:50.019 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:50.020 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.020 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:50.020 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:50.020 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.020 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.020 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.020 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.020 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.020 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.020 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.021 INFO:teuthology.orchestra.run.smithi007.stdout: "organization": { 2024-09-19T08:54:50.021 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "organization", 2024-09-19T08:54:50.021 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:50.021 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.021 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.021 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:50.021 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.021 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.021 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.021 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.022 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.022 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.022 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.022 INFO:teuthology.orchestra.run.smithi007.stdout: "proxy": { 2024-09-19T08:54:50.022 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "proxy", 2024-09-19T08:54:50.022 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:50.022 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.022 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.022 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:50.022 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.022 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.023 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.023 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.023 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.023 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.023 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.023 INFO:teuthology.orchestra.run.smithi007.stdout: "url": { 2024-09-19T08:54:50.023 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url", 2024-09-19T08:54:50.023 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:50.023 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.023 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.023 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T08:54:50.024 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.024 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.024 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.024 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.024 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.024 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.024 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.024 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:50.024 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:50.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:50.025 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "test_orchestrator", 2024-09-19T08:54:50.025 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:50.025 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:50.025 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:50.025 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:50.025 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:50.025 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:50.025 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.025 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:50.025 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:50.025 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.025 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.026 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:50.026 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:50.026 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:50.026 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:50.026 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:50.026 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:50.026 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:50.026 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:50.026 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.026 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.026 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.026 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.027 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:50.027 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:50.027 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:50.027 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.027 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:50.027 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:50.027 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.027 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.027 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.027 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.028 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.028 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.028 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.028 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:50.028 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:50.028 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:50.028 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.028 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:50.028 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:50.029 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.029 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.029 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:50.029 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:50.029 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:50.029 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:50.029 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:50.029 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:50.029 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:50.029 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:50.029 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.030 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.030 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.030 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.030 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:50.030 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:50.030 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:50.030 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.030 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:50.030 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:50.031 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.031 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.031 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.031 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.031 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.031 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.031 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.031 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:50.031 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:50.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:50.032 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-09-19T08:54:50.032 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:50.032 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:50.032 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:50.032 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:50.032 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:50.032 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:50.032 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.032 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:50.032 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:50.033 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.033 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.033 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:50.033 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:50.033 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:50.033 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:50.033 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:50.033 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:50.033 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:50.033 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:50.034 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.034 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.034 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.034 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.034 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:50.034 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:50.034 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:50.034 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.034 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:50.034 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:50.035 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.035 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.035 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.035 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.035 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.035 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.035 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.035 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:50.035 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:50.035 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:50.036 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.036 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:50.036 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:50.036 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.036 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.036 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:50.036 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:50.036 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:50.036 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:50.036 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:50.036 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:50.036 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:50.037 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:50.037 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.037 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.037 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.037 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.037 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:50.037 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:50.037 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:50.037 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.037 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:50.038 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:50.038 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.038 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.038 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.038 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.038 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.038 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.038 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.038 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_clones": { 2024-09-19T08:54:50.038 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_clones", 2024-09-19T08:54:50.038 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:50.039 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.039 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.039 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4", 2024-09-19T08:54:50.039 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.039 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.039 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.039 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T08:54:50.039 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.039 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.039 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.040 INFO:teuthology.orchestra.run.smithi007.stdout: "periodic_async_work": { 2024-09-19T08:54:50.040 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "periodic_async_work", 2024-09-19T08:54:50.040 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:50.040 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.040 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.040 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:50.040 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.040 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.040 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.040 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Periodically check for async work", 2024-09-19T08:54:50.041 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.041 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.041 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.041 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_delay": { 2024-09-19T08:54:50.041 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_delay", 2024-09-19T08:54:50.041 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:50.041 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.041 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.041 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T08:54:50.041 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.041 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.042 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.042 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T08:54:50.042 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.042 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.042 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.042 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_no_wait": { 2024-09-19T08:54:50.042 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T08:54:50.042 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:50.042 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.042 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.042 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T08:54:50.043 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.043 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.043 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.043 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T08:54:50.043 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.043 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.043 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.043 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:50.043 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:50.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:50.043 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix", 2024-09-19T08:54:50.044 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T08:54:50.044 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T08:54:50.044 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T08:54:50.044 INFO:teuthology.orchestra.run.smithi007.stdout: "discovery_interval": { 2024-09-19T08:54:50.044 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "discovery_interval", 2024-09-19T08:54:50.044 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T08:54:50.044 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.044 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.044 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "100", 2024-09-19T08:54:50.044 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.044 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.044 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.045 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.045 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.045 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.045 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.045 INFO:teuthology.orchestra.run.smithi007.stdout: "identifier": { 2024-09-19T08:54:50.045 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "identifier", 2024-09-19T08:54:50.045 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:50.045 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.045 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.045 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:50.045 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.046 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.046 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.046 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.046 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.046 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.046 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.046 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T08:54:50.046 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T08:54:50.046 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T08:54:50.046 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.046 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.047 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T08:54:50.047 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.047 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.047 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.047 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.047 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.047 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.047 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.047 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T08:54:50.047 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T08:54:50.047 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:50.048 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.048 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:50.048 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:50.048 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.048 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.048 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:50.048 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:50.048 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:50.048 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:50.048 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:50.048 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:50.048 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:50.049 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:50.049 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.049 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.049 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.049 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.049 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T08:54:50.049 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T08:54:50.049 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:50.049 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.049 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:50.049 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:50.050 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.050 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.050 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.050 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.050 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.050 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.050 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.050 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T08:54:50.050 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T08:54:50.050 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:50.050 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.051 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:50.051 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T08:54:50.051 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.051 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.051 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T08:54:50.051 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T08:54:50.051 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T08:54:50.051 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T08:54:50.051 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T08:54:50.051 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T08:54:50.052 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T08:54:50.052 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:50.052 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.052 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.052 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.052 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.052 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T08:54:50.052 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T08:54:50.052 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T08:54:50.052 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.052 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T08:54:50.053 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T08:54:50.053 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.053 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.053 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.053 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.053 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.053 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.053 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.053 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_host": { 2024-09-19T08:54:50.053 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_host", 2024-09-19T08:54:50.053 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:50.054 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.054 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.054 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T08:54:50.054 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.054 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.054 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.054 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.054 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.054 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.054 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.054 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_port": { 2024-09-19T08:54:50.055 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_port", 2024-09-19T08:54:50.055 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T08:54:50.055 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.055 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.055 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10051", 2024-09-19T08:54:50.055 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.055 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.055 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.055 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.055 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.056 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.056 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.056 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_sender": { 2024-09-19T08:54:50.056 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_sender", 2024-09-19T08:54:50.056 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T08:54:50.056 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T08:54:50.056 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T08:54:50.056 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T08:54:50.056 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T08:54:50.056 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T08:54:50.057 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T08:54:50.057 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T08:54:50.057 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T08:54:50.057 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T08:54:50.057 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T08:54:50.057 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:50.057 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:50.057 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:50.057 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:50.057 INFO:teuthology.orchestra.run.smithi007.stdout: "services": { 2024-09-19T08:54:50.057 INFO:teuthology.orchestra.run.smithi007.stdout: "dashboard": "https://172.21.15.7:8443/" 2024-09-19T08:54:50.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.058 INFO:teuthology.orchestra.run.smithi007.stdout: "always_on_modules": { 2024-09-19T08:54:50.058 INFO:teuthology.orchestra.run.smithi007.stdout: "octopus": [ 2024-09-19T08:54:50.058 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-19T08:54:50.058 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-19T08:54:50.058 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-19T08:54:50.058 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-19T08:54:50.058 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-19T08:54:50.058 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-19T08:54:50.058 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-19T08:54:50.058 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-19T08:54:50.058 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-19T08:54:50.059 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-19T08:54:50.059 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:50.059 INFO:teuthology.orchestra.run.smithi007.stdout: "pacific": [ 2024-09-19T08:54:50.059 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-19T08:54:50.059 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-19T08:54:50.059 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-19T08:54:50.059 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-19T08:54:50.059 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-19T08:54:50.059 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-19T08:54:50.059 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-19T08:54:50.059 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-19T08:54:50.059 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-19T08:54:50.060 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-19T08:54:50.060 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:50.060 INFO:teuthology.orchestra.run.smithi007.stdout: "quincy": [ 2024-09-19T08:54:50.060 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-19T08:54:50.060 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-19T08:54:50.060 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-19T08:54:50.060 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-19T08:54:50.060 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-19T08:54:50.060 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-19T08:54:50.060 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-19T08:54:50.060 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-19T08:54:50.060 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-19T08:54:50.061 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-19T08:54:50.061 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:50.061 INFO:teuthology.orchestra.run.smithi007.stdout: "reef": [ 2024-09-19T08:54:50.061 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-19T08:54:50.061 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-19T08:54:50.061 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-19T08:54:50.061 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-19T08:54:50.061 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-19T08:54:50.061 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-19T08:54:50.061 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-19T08:54:50.061 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-19T08:54:50.061 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-19T08:54:50.061 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-19T08:54:50.062 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T08:54:50.062 INFO:teuthology.orchestra.run.smithi007.stdout: "squid": [ 2024-09-19T08:54:50.062 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-19T08:54:50.062 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-19T08:54:50.062 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-19T08:54:50.062 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-19T08:54:50.062 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-19T08:54:50.062 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-19T08:54:50.062 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-19T08:54:50.062 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-19T08:54:50.062 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-19T08:54:50.063 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-19T08:54:50.063 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-19T08:54:50.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.063 INFO:teuthology.orchestra.run.smithi007.stdout: "last_failure_osd_epoch": 83, 2024-09-19T08:54:50.063 INFO:teuthology.orchestra.run.smithi007.stdout: "active_clients": [ 2024-09-19T08:54:50.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:50.063 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-09-19T08:54:50.063 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-19T08:54:50.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:50.063 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-19T08:54:50.064 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-19T08:54:50.064 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3204252030 2024-09-19T08:54:50.064 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:50.064 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-19T08:54:50.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:50.064 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "libcephsqlite", 2024-09-19T08:54:50.064 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-19T08:54:50.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:50.064 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-19T08:54:50.064 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-19T08:54:50.065 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 71314009 2024-09-19T08:54:50.065 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:50.065 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-19T08:54:50.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:50.065 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-09-19T08:54:50.065 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-19T08:54:50.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:50.065 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-19T08:54:50.065 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-19T08:54:50.065 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2502838351 2024-09-19T08:54:50.066 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:50.066 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-19T08:54:50.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:50.066 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-09-19T08:54:50.066 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-19T08:54:50.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:50.066 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-19T08:54:50.066 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-19T08:54:50.066 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3794028661 2024-09-19T08:54:50.066 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:50.066 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-19T08:54:50.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:50.067 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-09-19T08:54:50.067 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-19T08:54:50.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:50.067 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-19T08:54:50.067 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-19T08:54:50.067 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 128425023 2024-09-19T08:54:50.067 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:50.067 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-19T08:54:50.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:50.067 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-09-19T08:54:50.067 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-19T08:54:50.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T08:54:50.068 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-19T08:54:50.068 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-19T08:54:50.068 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1510664809 2024-09-19T08:54:50.068 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:50.068 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-19T08:54:50.068 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:50.068 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-19T08:54:50.068 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:54:50.133 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T08:54:50.133 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T08:54:50.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: pgmap v319: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-19T08:54:50.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/25164941' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T08:54:50.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:54:50.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:54:50.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:54:50.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:54:50.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:54:50.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:54:50.135 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.135 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.135 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.135 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.135 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.135 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.135 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.135 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.135 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.135 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.135 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.135 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.135 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.136 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.136 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.136 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.136 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.136 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.136 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.136 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.136 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.136 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.136 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.136 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.136 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:50.136 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:50.136 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:49 smithi007 ceph-mon[31221]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:54:50.137 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: pgmap v319: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-19T08:54:50.137 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/25164941' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T08:54:50.137 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:54:50.137 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:54:50.137 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:54:50.137 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:54:50.137 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:54:50.137 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:54:50.137 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.137 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.138 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.138 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.138 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.138 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.138 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.138 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.138 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.138 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.138 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.138 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.138 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.138 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.138 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.138 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.139 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.139 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.139 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.139 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.139 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.139 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.139 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.139 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.139 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:50.139 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:50.139 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:49 smithi044 ceph-mon[35072]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:54:50.139 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: pgmap v319: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-19T08:54:50.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/25164941' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T08:54:50.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:54:50.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:54:50.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:54:50.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:54:50.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:54:50.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:54:50.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.140 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.141 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.142 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.142 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.142 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.142 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.142 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.142 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:50.142 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:50.142 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:50.142 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:49 smithi175 ceph-mon[35688]: from='mgr.15132 ' entity='mgr.x' 2024-09-19T08:54:50.406 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:50.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:50 smithi175 ceph-mon[35688]: Adjusting osd_memory_target on smithi175 to 176.0M 2024-09-19T08:54:50.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:50 smithi175 ceph-mon[35688]: Unable to set osd_memory_target on smithi175 to 184573132: error parsing value: Value '184573132' is below minimum 939524096 2024-09-19T08:54:50.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:50 smithi175 ceph-mon[35688]: Adjusting osd_memory_target on smithi044 to 177.0M 2024-09-19T08:54:50.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:50 smithi175 ceph-mon[35688]: Unable to set osd_memory_target on smithi044 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-19T08:54:50.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:50 smithi175 ceph-mon[35688]: Adjusting osd_memory_target on smithi007 to 177.0M 2024-09-19T08:54:50.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:50 smithi175 ceph-mon[35688]: Unable to set osd_memory_target on smithi007 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-19T08:54:50.527 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:50 smithi007 ceph-mon[31221]: Adjusting osd_memory_target on smithi175 to 176.0M 2024-09-19T08:54:50.527 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:50 smithi007 ceph-mon[31221]: Unable to set osd_memory_target on smithi175 to 184573132: error parsing value: Value '184573132' is below minimum 939524096 2024-09-19T08:54:50.527 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:50 smithi007 ceph-mon[31221]: Adjusting osd_memory_target on smithi044 to 177.0M 2024-09-19T08:54:50.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:50 smithi007 ceph-mon[31221]: Unable to set osd_memory_target on smithi044 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-19T08:54:50.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:50 smithi007 ceph-mon[31221]: Adjusting osd_memory_target on smithi007 to 177.0M 2024-09-19T08:54:50.528 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:50 smithi007 ceph-mon[31221]: Unable to set osd_memory_target on smithi007 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-19T08:54:50.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:50 smithi044 ceph-mon[35072]: Adjusting osd_memory_target on smithi175 to 176.0M 2024-09-19T08:54:50.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:50 smithi044 ceph-mon[35072]: Unable to set osd_memory_target on smithi175 to 184573132: error parsing value: Value '184573132' is below minimum 939524096 2024-09-19T08:54:50.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:50 smithi044 ceph-mon[35072]: Adjusting osd_memory_target on smithi044 to 177.0M 2024-09-19T08:54:50.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:50 smithi044 ceph-mon[35072]: Unable to set osd_memory_target on smithi044 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-19T08:54:50.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:50 smithi044 ceph-mon[35072]: Adjusting osd_memory_target on smithi007 to 177.0M 2024-09-19T08:54:50.551 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:50 smithi044 ceph-mon[35072]: Unable to set osd_memory_target on smithi007 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-19T08:54:50.919 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:54:50.919 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:54:50.919 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 0, 2024-09-19T08:54:50.919 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 2, 2024-09-19T08:54:50.919 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:54:50.920 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 0, 2024-09-19T08:54:50.920 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-09-19T08:54:50.920 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 0, 2024-09-19T08:54:50.920 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.001425284, 2024-09-19T08:54:50.920 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:54:50.920 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.000278992, 2024-09-19T08:54:50.920 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:54:50.920 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:54:50.920 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T08:54:50.920 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T08:54:50.920 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T08:54:50.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.921 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:54:50.921 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T08:54:50.921 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T08:54:50.921 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T08:54:50.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.921 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:54:50.921 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:54:50.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.921 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:54:50.921 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 2, 2024-09-19T08:54:50.921 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 152, 2024-09-19T08:54:50.921 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 320, 2024-09-19T08:54:50.921 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 183984, 2024-09-19T08:54:50.922 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 5, 2024-09-19T08:54:50.922 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 3, 2024-09-19T08:54:50.922 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.013636605, 2024-09-19T08:54:50.922 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.009251915, 2024-09-19T08:54:50.922 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.001988876, 2024-09-19T08:54:50.922 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:54:50.922 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:54:50.922 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 149, 2024-09-19T08:54:50.922 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.013604668, 2024-09-19T08:54:50.922 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000091306 2024-09-19T08:54:50.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.922 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:54:50.922 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T08:54:50.923 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T08:54:50.923 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T08:54:50.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.923 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T08:54:50.923 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 183984 2024-09-19T08:54:50.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.923 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:54:50.923 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 213, 2024-09-19T08:54:50.923 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 201, 2024-09-19T08:54:50.923 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 1447920, 2024-09-19T08:54:50.923 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 122592, 2024-09-19T08:54:50.923 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 2, 2024-09-19T08:54:50.923 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 1, 2024-09-19T08:54:50.923 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.038825025, 2024-09-19T08:54:50.923 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.013719582, 2024-09-19T08:54:50.924 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.036311165, 2024-09-19T08:54:50.924 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:54:50.924 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:54:50.924 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 201, 2024-09-19T08:54:50.924 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.014307245, 2024-09-19T08:54:50.924 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000071180 2024-09-19T08:54:50.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.924 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:54:50.924 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T08:54:50.924 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T08:54:50.924 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T08:54:50.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.924 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 1447920, 2024-09-19T08:54:50.924 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 122592 2024-09-19T08:54:50.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.925 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-09-19T08:54:50.925 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 0, 2024-09-19T08:54:50.925 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-09-19T08:54:50.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.925 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-09-19T08:54:50.925 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:54:50.925 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-09-19T08:54:50.925 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:54:50.925 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:54:50.925 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:54:50.925 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:54:50.926 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:54:50.926 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:54:50.926 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:54:50.926 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:54:50.926 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:54:50.926 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:54:50.926 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:54:50.926 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:54:50.926 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:54:50.926 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-09-19T08:54:50.926 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:54:50.926 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-09-19T08:54:50.926 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:54:50.926 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:54:50.927 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:54:50.927 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:54:50.927 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:54:50.927 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:54:50.927 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:54:50.927 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-09-19T08:54:50.927 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:54:50.927 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:54:50.927 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:54:50.927 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-09-19T08:54:50.927 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-09-19T08:54:50.927 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-09-19T08:54:50.927 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:54:50.927 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:54:50.927 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:54:50.928 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:54:50.928 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 148977, 2024-09-19T08:54:50.928 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 30, 2024-09-19T08:54:50.928 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:54:50.928 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-09-19T08:54:50.928 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-09-19T08:54:50.928 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-09-19T08:54:50.928 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:54:50.928 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-09-19T08:54:50.928 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:54:50.928 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-09-19T08:54:50.928 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 0, 2024-09-19T08:54:50.929 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 0, 2024-09-19T08:54:50.929 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:54:50.929 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:54:50.929 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-09-19T08:54:50.929 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-09-19T08:54:50.929 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 928, 2024-09-19T08:54:50.929 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 2, 2024-09-19T08:54:50.929 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-09-19T08:54:50.929 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-09-19T08:54:50.929 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-09-19T08:54:50.929 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-09-19T08:54:50.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:50.929 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:54:50.930 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-19T08:54:50.930 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-19T08:54:50.930 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-19T08:54:50.930 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 211, 2024-09-19T08:54:50.930 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 1415420, 2024-09-19T08:54:50.930 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-19T08:54:50.930 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 211, 2024-09-19T08:54:50.930 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-19T08:54:50.930 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-19T08:54:50.930 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 211, 2024-09-19T08:54:50.930 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 1415420, 2024-09-19T08:54:50.930 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-19T08:54:50.931 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T08:54:50.931 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T08:54:50.931 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T08:54:50.931 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:50.931 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:50.931 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:54:51.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:51 smithi175 ceph-mon[35688]: pgmap v320: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:54:51.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:51 smithi007 ceph-mon[31221]: pgmap v320: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:54:51.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:51 smithi044 ceph-mon[35072]: pgmap v320: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:54:51.693 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-19T08:54:51.693 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-19T08:54:51.694 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-19T08:54:51.694 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-19T08:54:51.694 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-19T08:54:51.694 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-19T08:54:51.694 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-19T08:54:51.694 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T08:54:51.694 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T08:54:51.951 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:52.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:52 smithi007 ceph-mon[31221]: pgmap v321: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:54:52.431 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:54:52.431 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:54:52.431 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 4, 2024-09-19T08:54:52.431 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 4, 2024-09-19T08:54:52.431 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 3024, 2024-09-19T08:54:52.431 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 448, 2024-09-19T08:54:52.431 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-09-19T08:54:52.431 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 0, 2024-09-19T08:54:52.431 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.003738091, 2024-09-19T08:54:52.432 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.000063626, 2024-09-19T08:54:52.432 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.002599697, 2024-09-19T08:54:52.432 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:54:52.432 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:54:52.432 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 3, 2024-09-19T08:54:52.432 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.004657914, 2024-09-19T08:54:52.432 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.001552638 2024-09-19T08:54:52.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:52.432 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:54:52.432 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T08:54:52.432 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T08:54:52.433 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T08:54:52.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:52.433 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T08:54:52.433 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T08:54:52.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:52.433 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:54:52.433 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 2, 2024-09-19T08:54:52.433 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 157, 2024-09-19T08:54:52.433 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 320, 2024-09-19T08:54:52.433 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 184864, 2024-09-19T08:54:52.433 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 5, 2024-09-19T08:54:52.433 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 3, 2024-09-19T08:54:52.433 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.014410211, 2024-09-19T08:54:52.434 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.009782323, 2024-09-19T08:54:52.434 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.002094765, 2024-09-19T08:54:52.434 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:54:52.434 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:54:52.434 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 154, 2024-09-19T08:54:52.434 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.016758030, 2024-09-19T08:54:52.434 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000108818 2024-09-19T08:54:52.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:52.434 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:54:52.434 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T08:54:52.434 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T08:54:52.434 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T08:54:52.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:52.434 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T08:54:52.435 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 184864 2024-09-19T08:54:52.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:52.435 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:54:52.435 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 214, 2024-09-19T08:54:52.435 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 204, 2024-09-19T08:54:52.435 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 1446256, 2024-09-19T08:54:52.435 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 125344, 2024-09-19T08:54:52.435 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 2, 2024-09-19T08:54:52.435 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 1, 2024-09-19T08:54:52.435 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.040688999, 2024-09-19T08:54:52.435 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.014685954, 2024-09-19T08:54:52.435 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.037985078, 2024-09-19T08:54:52.436 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:54:52.436 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:54:52.436 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 203, 2024-09-19T08:54:52.436 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.011191176, 2024-09-19T08:54:52.436 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000055128 2024-09-19T08:54:52.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:52.436 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:54:52.436 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T08:54:52.436 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T08:54:52.436 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T08:54:52.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:52.436 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 1446256, 2024-09-19T08:54:52.436 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 125344 2024-09-19T08:54:52.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:52.437 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-09-19T08:54:52.437 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 0, 2024-09-19T08:54:52.437 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-09-19T08:54:52.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:52.437 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-09-19T08:54:52.437 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:54:52.437 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-09-19T08:54:52.437 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:54:52.437 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:54:52.437 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:54:52.437 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:54:52.437 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:54:52.437 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:54:52.438 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:54:52.438 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:54:52.438 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:54:52.438 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:54:52.438 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:54:52.438 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:54:52.438 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:54:52.438 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-09-19T08:54:52.438 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:54:52.438 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-09-19T08:54:52.438 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:54:52.438 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:54:52.438 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:54:52.439 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:54:52.439 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:54:52.439 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:54:52.439 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:54:52.439 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-09-19T08:54:52.439 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:54:52.439 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:54:52.439 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:54:52.439 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-09-19T08:54:52.439 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-09-19T08:54:52.439 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-09-19T08:54:52.439 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:54:52.439 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:54:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:54:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:54:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 148977, 2024-09-19T08:54:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 30, 2024-09-19T08:54:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:54:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-09-19T08:54:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-09-19T08:54:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-09-19T08:54:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:54:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-09-19T08:54:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:54:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-09-19T08:54:52.440 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 0, 2024-09-19T08:54:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 0, 2024-09-19T08:54:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:54:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:54:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-09-19T08:54:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-09-19T08:54:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 928, 2024-09-19T08:54:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 2, 2024-09-19T08:54:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-09-19T08:54:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-09-19T08:54:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-09-19T08:54:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-09-19T08:54:52.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:54:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-19T08:54:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-19T08:54:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-19T08:54:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 216, 2024-09-19T08:54:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 1416070, 2024-09-19T08:54:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-19T08:54:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 216, 2024-09-19T08:54:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-19T08:54:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-19T08:54:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 216, 2024-09-19T08:54:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 1416070, 2024-09-19T08:54:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-19T08:54:52.442 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T08:54:52.443 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T08:54:52.443 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T08:54:52.443 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:52.443 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:52.443 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:54:52.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:52 smithi044 ceph-mon[35072]: pgmap v321: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:54:52.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:52 smithi175 ceph-mon[35688]: pgmap v321: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:54:53.114 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-19T08:54:53.114 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-19T08:54:53.114 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-19T08:54:53.114 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-19T08:54:53.114 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-19T08:54:53.114 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-19T08:54:53.114 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-19T08:54:53.114 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T08:54:53.114 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T08:54:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:53.864 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:54:53.864 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:54:53.865 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 211, 2024-09-19T08:54:53.865 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 201, 2024-09-19T08:54:53.865 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 1445440, 2024-09-19T08:54:53.865 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 123424, 2024-09-19T08:54:53.865 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-09-19T08:54:53.865 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 0, 2024-09-19T08:54:53.865 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.041026927, 2024-09-19T08:54:53.865 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.014651255, 2024-09-19T08:54:53.865 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.036341624, 2024-09-19T08:54:53.865 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:54:53.866 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:54:53.866 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 200, 2024-09-19T08:54:53.866 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.011037953, 2024-09-19T08:54:53.866 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000055189 2024-09-19T08:54:53.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:53.866 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:54:53.866 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T08:54:53.866 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T08:54:53.866 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T08:54:53.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:53.866 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 1445440, 2024-09-19T08:54:53.867 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 123424 2024-09-19T08:54:53.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:53.867 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:54:53.867 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 6, 2024-09-19T08:54:53.867 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 156, 2024-09-19T08:54:53.867 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 3344, 2024-09-19T08:54:53.867 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 184784, 2024-09-19T08:54:53.867 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 5, 2024-09-19T08:54:53.867 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 3, 2024-09-19T08:54:53.867 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.016610623, 2024-09-19T08:54:53.867 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.010037359, 2024-09-19T08:54:53.867 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.004491270, 2024-09-19T08:54:53.868 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:54:53.868 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:54:53.868 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 154, 2024-09-19T08:54:53.868 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.018103252, 2024-09-19T08:54:53.868 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000117553 2024-09-19T08:54:53.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:53.868 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:54:53.868 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T08:54:53.868 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T08:54:53.868 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T08:54:53.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:53.868 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-09-19T08:54:53.868 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 184784 2024-09-19T08:54:53.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:53.869 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:54:53.869 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 0, 2024-09-19T08:54:53.869 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 2, 2024-09-19T08:54:53.869 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:54:53.869 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 0, 2024-09-19T08:54:53.869 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 2, 2024-09-19T08:54:53.869 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 1, 2024-09-19T08:54:53.869 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.000357975, 2024-09-19T08:54:53.869 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:54:53.869 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.000252857, 2024-09-19T08:54:53.869 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:54:53.869 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:54:53.869 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T08:54:53.870 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T08:54:53.870 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T08:54:53.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:53.870 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:54:53.870 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T08:54:53.870 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T08:54:53.870 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T08:54:53.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:53.870 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:54:53.870 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:54:53.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:53.870 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-09-19T08:54:53.870 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 0, 2024-09-19T08:54:53.871 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-09-19T08:54:53.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:53.871 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-09-19T08:54:53.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:54:53.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-09-19T08:54:53.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:54:53.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:54:53.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:54:53.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:54:53.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:54:53.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:54:53.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:54:53.871 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:54:53.872 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:54:53.872 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:54:53.872 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:54:53.872 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:54:53.872 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:54:53.872 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-09-19T08:54:53.872 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:54:53.872 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-09-19T08:54:53.872 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:54:53.872 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:54:53.872 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:54:53.872 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:54:53.872 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:54:53.873 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:54:53.873 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:54:53.873 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-09-19T08:54:53.873 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:54:53.873 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:54:53.873 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:54:53.873 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-09-19T08:54:53.873 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-09-19T08:54:53.873 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-09-19T08:54:53.873 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:54:53.873 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:54:53.873 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:54:53.873 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:54:53.873 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 148977, 2024-09-19T08:54:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 30, 2024-09-19T08:54:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:54:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-09-19T08:54:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-09-19T08:54:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-09-19T08:54:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:54:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-09-19T08:54:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:54:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-09-19T08:54:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 0, 2024-09-19T08:54:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 0, 2024-09-19T08:54:53.874 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:54:53.875 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:54:53.875 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-09-19T08:54:53.875 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-09-19T08:54:53.875 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 928, 2024-09-19T08:54:53.875 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 2, 2024-09-19T08:54:53.875 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-09-19T08:54:53.875 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-09-19T08:54:53.875 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-09-19T08:54:53.875 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-09-19T08:54:53.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:53.875 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:54:53.875 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-19T08:54:53.875 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-19T08:54:53.875 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-19T08:54:53.876 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 213, 2024-09-19T08:54:53.876 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 1415680, 2024-09-19T08:54:53.876 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-19T08:54:53.876 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 213, 2024-09-19T08:54:53.876 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-19T08:54:53.876 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-19T08:54:53.876 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 213, 2024-09-19T08:54:53.876 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 1415680, 2024-09-19T08:54:53.876 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-19T08:54:53.876 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T08:54:53.876 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T08:54:53.876 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T08:54:53.876 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:53.876 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:53.877 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:54:54.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:54 smithi007 ceph-mon[31221]: pgmap v322: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T08:54:54.466 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-19T08:54:54.466 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-19T08:54:54.466 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-19T08:54:54.467 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-19T08:54:54.467 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-19T08:54:54.467 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-19T08:54:54.467 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-19T08:54:54.467 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T08:54:54.467 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T08:54:54.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:54 smithi175 ceph-mon[35688]: pgmap v322: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T08:54:54.722 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:54.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:54 smithi044 ceph-mon[35072]: pgmap v322: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T08:54:55.216 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T08:54:55.216 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:54:55.216 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 0, 2024-09-19T08:54:55.216 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 2, 2024-09-19T08:54:55.216 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:54:55.216 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 0, 2024-09-19T08:54:55.216 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-09-19T08:54:55.216 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 0, 2024-09-19T08:54:55.216 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.001437544, 2024-09-19T08:54:55.216 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:54:55.217 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.000420129, 2024-09-19T08:54:55.217 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:54:55.217 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:54:55.217 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T08:54:55.217 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T08:54:55.217 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T08:54:55.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:55.217 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:54:55.217 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T08:54:55.217 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T08:54:55.217 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T08:54:55.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:55.217 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:54:55.218 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:54:55.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:55.218 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:54:55.218 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 2, 2024-09-19T08:54:55.218 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 158, 2024-09-19T08:54:55.218 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 320, 2024-09-19T08:54:55.218 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 185040, 2024-09-19T08:54:55.218 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 5, 2024-09-19T08:54:55.218 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 3, 2024-09-19T08:54:55.218 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.016458769, 2024-09-19T08:54:55.218 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.009277061, 2024-09-19T08:54:55.218 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.002176280, 2024-09-19T08:54:55.219 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:54:55.219 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:54:55.219 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 155, 2024-09-19T08:54:55.219 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.015599210, 2024-09-19T08:54:55.219 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000100640 2024-09-19T08:54:55.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:55.219 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:54:55.219 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T08:54:55.219 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T08:54:55.220 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T08:54:55.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:55.220 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T08:54:55.220 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 185040 2024-09-19T08:54:55.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:55.220 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:54:55.220 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 220, 2024-09-19T08:54:55.220 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 208, 2024-09-19T08:54:55.220 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 1449824, 2024-09-19T08:54:55.221 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 127072, 2024-09-19T08:54:55.221 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 2, 2024-09-19T08:54:55.221 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 1, 2024-09-19T08:54:55.221 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.041729740, 2024-09-19T08:54:55.221 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.014936059, 2024-09-19T08:54:55.221 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.038591076, 2024-09-19T08:54:55.221 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:54:55.221 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:54:55.221 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 208, 2024-09-19T08:54:55.221 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.015818966, 2024-09-19T08:54:55.221 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000076052 2024-09-19T08:54:55.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:55.221 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:54:55.222 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T08:54:55.222 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T08:54:55.222 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T08:54:55.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:55.222 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 1449824, 2024-09-19T08:54:55.222 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 127072 2024-09-19T08:54:55.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:55.222 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-09-19T08:54:55.222 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 0, 2024-09-19T08:54:55.222 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-09-19T08:54:55.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:55.222 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-09-19T08:54:55.222 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:54:55.222 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-09-19T08:54:55.222 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:54:55.223 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:54:55.223 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:54:55.223 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:54:55.223 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:54:55.223 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:54:55.223 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:54:55.223 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:54:55.223 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:54:55.223 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:54:55.223 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:54:55.223 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:54:55.223 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:54:55.223 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-09-19T08:54:55.223 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:54:55.223 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-09-19T08:54:55.223 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:54:55.224 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:54:55.224 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:54:55.224 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:54:55.224 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:54:55.224 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:54:55.224 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:54:55.224 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-09-19T08:54:55.224 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:54:55.224 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:54:55.224 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:54:55.224 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-09-19T08:54:55.224 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-09-19T08:54:55.224 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-09-19T08:54:55.224 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:54:55.224 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:54:55.225 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:54:55.225 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:54:55.225 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 148994, 2024-09-19T08:54:55.225 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 31, 2024-09-19T08:54:55.225 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:54:55.225 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-09-19T08:54:55.225 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-09-19T08:54:55.225 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-09-19T08:54:55.225 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:54:55.225 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-09-19T08:54:55.225 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:54:55.225 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-09-19T08:54:55.225 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 0, 2024-09-19T08:54:55.226 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 0, 2024-09-19T08:54:55.226 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:54:55.226 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:54:55.226 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-09-19T08:54:55.226 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-09-19T08:54:55.226 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 928, 2024-09-19T08:54:55.226 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 2, 2024-09-19T08:54:55.226 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-09-19T08:54:55.226 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-09-19T08:54:55.226 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-09-19T08:54:55.227 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-09-19T08:54:55.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T08:54:55.227 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:54:55.227 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-19T08:54:55.227 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-19T08:54:55.227 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-19T08:54:55.227 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 218, 2024-09-19T08:54:55.227 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 1416330, 2024-09-19T08:54:55.228 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-19T08:54:55.228 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 218, 2024-09-19T08:54:55.228 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-19T08:54:55.228 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-19T08:54:55.228 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 218, 2024-09-19T08:54:55.228 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 1416330, 2024-09-19T08:54:55.228 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-19T08:54:55.228 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T08:54:55.228 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T08:54:55.228 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T08:54:55.228 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:55.228 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T08:54:55.228 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T08:54:55.926 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-19T08:54:55.926 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-19T08:54:55.926 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-19T08:54:55.926 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-19T08:54:55.926 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-19T08:54:55.926 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-19T08:54:55.926 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-19T08:54:55.926 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T08:54:55.927 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T08:54:56.191 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:54:56.628 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:56 smithi044 ceph-mon[35072]: pgmap v323: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:54:56.650 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-19T08:54:56.650 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:54:56.651 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 1418, 2024-09-19T08:54:56.651 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 1243, 2024-09-19T08:54:56.651 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 1880127, 2024-09-19T08:54:56.651 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 2361354, 2024-09-19T08:54:56.651 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 169, 2024-09-19T08:54:56.651 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 6, 2024-09-19T08:54:56.651 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.195149218, 2024-09-19T08:54:56.651 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.050233812, 2024-09-19T08:54:56.651 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.142624026, 2024-09-19T08:54:56.651 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.012507199, 2024-09-19T08:54:56.651 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:54:56.651 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1245, 2024-09-19T08:54:56.652 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.503223895, 2024-09-19T08:54:56.652 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000404195 2024-09-19T08:54:56.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.652 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:54:56.652 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1369, 2024-09-19T08:54:56.652 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000296805, 2024-09-19T08:54:56.652 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000216 2024-09-19T08:54:56.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.652 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 1541824, 2024-09-19T08:54:56.652 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 155600 2024-09-19T08:54:56.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.652 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:54:56.653 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 920, 2024-09-19T08:54:56.653 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 998, 2024-09-19T08:54:56.653 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 308305, 2024-09-19T08:54:56.653 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 702795, 2024-09-19T08:54:56.653 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 11, 2024-09-19T08:54:56.653 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 6, 2024-09-19T08:54:56.653 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.087338494, 2024-09-19T08:54:56.653 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.040457807, 2024-09-19T08:54:56.653 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.046806910, 2024-09-19T08:54:56.653 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.006743469, 2024-09-19T08:54:56.653 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:54:56.653 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 998, 2024-09-19T08:54:56.653 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.328421761, 2024-09-19T08:54:56.654 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000329079 2024-09-19T08:54:56.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.654 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:54:56.654 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1103, 2024-09-19T08:54:56.654 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000221728, 2024-09-19T08:54:56.654 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000201 2024-09-19T08:54:56.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.654 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T08:54:56.654 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 439872 2024-09-19T08:54:56.654 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.654 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:54:56.654 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 2213, 2024-09-19T08:54:56.655 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 940, 2024-09-19T08:54:56.655 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 859012, 2024-09-19T08:54:56.655 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 1366195, 2024-09-19T08:54:56.655 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 22, 2024-09-19T08:54:56.655 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 8, 2024-09-19T08:54:56.655 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.253214674, 2024-09-19T08:54:56.655 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.060073928, 2024-09-19T08:54:56.655 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.096042192, 2024-09-19T08:54:56.655 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.092871604, 2024-09-19T08:54:56.655 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:54:56.655 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 932, 2024-09-19T08:54:56.655 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.534756257, 2024-09-19T08:54:56.655 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000573772 2024-09-19T08:54:56.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.656 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:54:56.656 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2078, 2024-09-19T08:54:56.656 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000365722, 2024-09-19T08:54:56.656 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000175 2024-09-19T08:54:56.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.656 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 416240, 2024-09-19T08:54:56.656 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 119792 2024-09-19T08:54:56.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.656 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2024-09-19T08:54:56.656 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 1, 2024-09-19T08:54:56.656 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2024-09-19T08:54:56.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.657 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-MDSRank": { 2024-09-19T08:54:56.657 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-19T08:54:56.657 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-19T08:54:56.657 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 536, 2024-09-19T08:54:56.657 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.149227061, 2024-09-19T08:54:56.657 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000278408 2024-09-19T08:54:56.657 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:56.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.657 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-PurgeQueue": { 2024-09-19T08:54:56.657 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-19T08:54:56.657 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-19T08:54:56.657 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 86, 2024-09-19T08:54:56.658 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.002727617, 2024-09-19T08:54:56.658 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000031716 2024-09-19T08:54:56.658 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:56.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.658 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": { 2024-09-19T08:54:56.658 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 171, 2024-09-19T08:54:56.658 INFO:teuthology.orchestra.run.smithi044.stdout: "reply": 171, 2024-09-19T08:54:56.658 INFO:teuthology.orchestra.run.smithi044.stdout: "reply_latency": { 2024-09-19T08:54:56.658 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 171, 2024-09-19T08:54:56.658 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 20.770062067, 2024-09-19T08:54:56.658 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.121462351 2024-09-19T08:54:56.658 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.658 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_reply": 0, 2024-09-19T08:54:56.658 INFO:teuthology.orchestra.run.smithi044.stdout: "forward": 0, 2024-09-19T08:54:56.659 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_complete": 0, 2024-09-19T08:54:56.659 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_keys": 0, 2024-09-19T08:54:56.659 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_commit": 12, 2024-09-19T08:54:56.659 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_split": 0, 2024-09-19T08:54:56.659 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_merge": 0, 2024-09-19T08:54:56.659 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes": 39, 2024-09-19T08:54:56.659 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_top": 2, 2024-09-19T08:54:56.659 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_bottom": 37, 2024-09-19T08:54:56.659 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pin_tail": 0, 2024-09-19T08:54:56.659 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pinned": 36, 2024-09-19T08:54:56.659 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_expired": 0, 2024-09-19T08:54:56.659 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_with_caps": 3, 2024-09-19T08:54:56.659 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 3, 2024-09-19T08:54:56.660 INFO:teuthology.orchestra.run.smithi044.stdout: "subtrees": 2, 2024-09-19T08:54:56.660 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse": 248, 2024-09-19T08:54:56.660 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_hit": 233, 2024-09-19T08:54:56.660 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_forward": 0, 2024-09-19T08:54:56.660 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_discover": 0, 2024-09-19T08:54:56.660 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_dir_fetch": 0, 2024-09-19T08:54:56.660 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_remote_ino": 0, 2024-09-19T08:54:56.660 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_lock": 0, 2024-09-19T08:54:56.660 INFO:teuthology.orchestra.run.smithi044.stdout: "load_cent": 0, 2024-09-19T08:54:56.660 INFO:teuthology.orchestra.run.smithi044.stdout: "q": 0, 2024-09-19T08:54:56.660 INFO:teuthology.orchestra.run.smithi044.stdout: "exported": 0, 2024-09-19T08:54:56.660 INFO:teuthology.orchestra.run.smithi044.stdout: "exported_inodes": 0, 2024-09-19T08:54:56.661 INFO:teuthology.orchestra.run.smithi044.stdout: "imported": 0, 2024-09-19T08:54:56.661 INFO:teuthology.orchestra.run.smithi044.stdout: "imported_inodes": 0, 2024-09-19T08:54:56.661 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_dir_fetch": 0, 2024-09-19T08:54:56.661 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_backtrace_fetch": 239, 2024-09-19T08:54:56.661 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_peer_discover": 0, 2024-09-19T08:54:56.661 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rfiles": 4, 2024-09-19T08:54:56.661 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rbytes": 234, 2024-09-19T08:54:56.661 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rsnaps": 6, 2024-09-19T08:54:56.661 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_fetch": 239, 2024-09-19T08:54:56.661 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_set_tag": 0, 2024-09-19T08:54:56.661 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T08:54:56.661 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_inotable_repaired": 0, 2024-09-19T08:54:56.661 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_inodes": 151, 2024-09-19T08:54:56.662 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_base_inodes": 21, 2024-09-19T08:54:56.662 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dirfrag_rstats": 130, 2024-09-19T08:54:56.662 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_file_inodes": 88, 2024-09-19T08:54:56.662 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_inode_file_caps": 0, 2024-09-19T08:54:56.662 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_revoke": 28, 2024-09-19T08:54:56.662 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_grant": 46, 2024-09-19T08:54:56.662 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T08:54:56.662 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T08:54:56.662 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T08:54:56.662 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps": 93, 2024-09-19T08:54:56.662 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps_dirty": 64, 2024-09-19T08:54:56.662 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_cap_release": 4, 2024-09-19T08:54:56.662 INFO:teuthology.orchestra.run.smithi044.stdout: "process_request_cap_release": 30 2024-09-19T08:54:56.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.663 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache": { 2024-09-19T08:54:56.663 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update": 11, 2024-09-19T08:54:56.663 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update_receipt": 0, 2024-09-19T08:54:56.663 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_try_discover": 0, 2024-09-19T08:54:56.663 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_send_discover": 0, 2024-09-19T08:54:56.663 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_handle_discover": 24, 2024-09-19T08:54:56.663 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays": 2, 2024-09-19T08:54:56.663 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_delayed": 0, 2024-09-19T08:54:56.663 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_enqueuing": 0, 2024-09-19T08:54:56.663 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_created": 6, 2024-09-19T08:54:56.663 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_enqueued": 4, 2024-09-19T08:54:56.663 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_reintegrated": 0, 2024-09-19T08:54:56.664 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_migrated": 0, 2024-09-19T08:54:56.664 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_processing": 0, 2024-09-19T08:54:56.664 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_enqueued": 0, 2024-09-19T08:54:56.664 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_prioritized": 0, 2024-09-19T08:54:56.664 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_started": 0, 2024-09-19T08:54:56.664 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_completed": 0, 2024-09-19T08:54:56.664 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_path": 3, 2024-09-19T08:54:56.664 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_inode": 41, 2024-09-19T08:54:56.664 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_enqueue_scrub": 21, 2024-09-19T08:54:56.664 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_exportdir": 0, 2024-09-19T08:54:56.664 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_flush": 0, 2024-09-19T08:54:56.664 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragmentdir": 0, 2024-09-19T08:54:56.664 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragstats": 0, 2024-09-19T08:54:56.665 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_inodestats": 0 2024-09-19T08:54:56.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.665 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log": { 2024-09-19T08:54:56.665 INFO:teuthology.orchestra.run.smithi044.stdout: "evlrg": 0, 2024-09-19T08:54:56.665 INFO:teuthology.orchestra.run.smithi044.stdout: "evadd": 185, 2024-09-19T08:54:56.665 INFO:teuthology.orchestra.run.smithi044.stdout: "evex": 0, 2024-09-19T08:54:56.665 INFO:teuthology.orchestra.run.smithi044.stdout: "evtrm": 0, 2024-09-19T08:54:56.665 INFO:teuthology.orchestra.run.smithi044.stdout: "ev": 185, 2024-09-19T08:54:56.665 INFO:teuthology.orchestra.run.smithi044.stdout: "evexg": 0, 2024-09-19T08:54:56.665 INFO:teuthology.orchestra.run.smithi044.stdout: "evexd": 0, 2024-09-19T08:54:56.665 INFO:teuthology.orchestra.run.smithi044.stdout: "segadd": 2, 2024-09-19T08:54:56.665 INFO:teuthology.orchestra.run.smithi044.stdout: "segex": 0, 2024-09-19T08:54:56.666 INFO:teuthology.orchestra.run.smithi044.stdout: "segtrm": 0, 2024-09-19T08:54:56.666 INFO:teuthology.orchestra.run.smithi044.stdout: "seg": 2, 2024-09-19T08:54:56.666 INFO:teuthology.orchestra.run.smithi044.stdout: "segmjr": 2, 2024-09-19T08:54:56.666 INFO:teuthology.orchestra.run.smithi044.stdout: "segexg": 0, 2024-09-19T08:54:56.666 INFO:teuthology.orchestra.run.smithi044.stdout: "segexd": 0, 2024-09-19T08:54:56.666 INFO:teuthology.orchestra.run.smithi044.stdout: "expos": 4194304, 2024-09-19T08:54:56.666 INFO:teuthology.orchestra.run.smithi044.stdout: "wrpos": 5066704, 2024-09-19T08:54:56.666 INFO:teuthology.orchestra.run.smithi044.stdout: "rdpos": 0, 2024-09-19T08:54:56.666 INFO:teuthology.orchestra.run.smithi044.stdout: "jlat": { 2024-09-19T08:54:56.666 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 150, 2024-09-19T08:54:56.666 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.320081974, 2024-09-19T08:54:56.666 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.002133879 2024-09-19T08:54:56.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.666 INFO:teuthology.orchestra.run.smithi044.stdout: "replayed": 0 2024-09-19T08:54:56.667 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.667 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mem": { 2024-09-19T08:54:56.667 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 29, 2024-09-19T08:54:56.667 INFO:teuthology.orchestra.run.smithi044.stdout: "ino+": 54, 2024-09-19T08:54:56.667 INFO:teuthology.orchestra.run.smithi044.stdout: "ino-": 25, 2024-09-19T08:54:56.667 INFO:teuthology.orchestra.run.smithi044.stdout: "dir": 20, 2024-09-19T08:54:56.667 INFO:teuthology.orchestra.run.smithi044.stdout: "dir+": 20, 2024-09-19T08:54:56.667 INFO:teuthology.orchestra.run.smithi044.stdout: "dir-": 0, 2024-09-19T08:54:56.667 INFO:teuthology.orchestra.run.smithi044.stdout: "dn": 39, 2024-09-19T08:54:56.667 INFO:teuthology.orchestra.run.smithi044.stdout: "dn+": 43, 2024-09-19T08:54:56.667 INFO:teuthology.orchestra.run.smithi044.stdout: "dn-": 4, 2024-09-19T08:54:56.667 INFO:teuthology.orchestra.run.smithi044.stdout: "cap": 3, 2024-09-19T08:54:56.667 INFO:teuthology.orchestra.run.smithi044.stdout: "cap+": 22, 2024-09-19T08:54:56.668 INFO:teuthology.orchestra.run.smithi044.stdout: "cap-": 19, 2024-09-19T08:54:56.668 INFO:teuthology.orchestra.run.smithi044.stdout: "rss": 54756, 2024-09-19T08:54:56.668 INFO:teuthology.orchestra.run.smithi044.stdout: "heap": 231712 2024-09-19T08:54:56.668 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.668 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_server": { 2024-09-19T08:54:56.668 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_client_request": 225, 2024-09-19T08:54:56.668 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_server_request": 1, 2024-09-19T08:54:56.668 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_request": 171, 2024-09-19T08:54:56.668 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_session": 31, 2024-09-19T08:54:56.668 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_peer_request": 2, 2024-09-19T08:54:56.668 INFO:teuthology.orchestra.run.smithi044.stdout: "req_create_latency": { 2024-09-19T08:54:56.668 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 8, 2024-09-19T08:54:56.668 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.007325487, 2024-09-19T08:54:56.669 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000915685 2024-09-19T08:54:56.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.669 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getattr_latency": { 2024-09-19T08:54:56.669 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 101, 2024-09-19T08:54:56.669 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 1.955924253, 2024-09-19T08:54:56.669 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.019365586 2024-09-19T08:54:56.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.669 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getfilelock_latency": { 2024-09-19T08:54:56.669 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:56.669 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:56.669 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:56.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.669 INFO:teuthology.orchestra.run.smithi044.stdout: "req_link_latency": { 2024-09-19T08:54:56.670 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:56.670 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:56.670 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:56.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.670 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookup_latency": { 2024-09-19T08:54:56.670 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 9, 2024-09-19T08:54:56.670 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.002297518, 2024-09-19T08:54:56.670 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000255279 2024-09-19T08:54:56.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.670 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookuphash_latency": { 2024-09-19T08:54:56.670 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:56.670 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:56.670 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:56.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.671 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupino_latency": { 2024-09-19T08:54:56.671 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1, 2024-09-19T08:54:56.671 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000236613, 2024-09-19T08:54:56.671 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000236613 2024-09-19T08:54:56.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.671 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupname_latency": { 2024-09-19T08:54:56.671 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:56.671 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:56.671 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:56.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.671 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupparent_latency": { 2024-09-19T08:54:56.671 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:56.672 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:56.672 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:56.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.672 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupsnap_latency": { 2024-09-19T08:54:56.672 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:56.672 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:56.672 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:56.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.672 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lssnap_latency": { 2024-09-19T08:54:56.672 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 10, 2024-09-19T08:54:56.672 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.001495295, 2024-09-19T08:54:56.672 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000149529 2024-09-19T08:54:56.673 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.673 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mkdir_latency": { 2024-09-19T08:54:56.673 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 8, 2024-09-19T08:54:56.673 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 18.685732900, 2024-09-19T08:54:56.673 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 2.335716612 2024-09-19T08:54:56.673 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.673 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mknod_latency": { 2024-09-19T08:54:56.674 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:56.674 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:56.674 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:56.674 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.674 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mksnap_latency": { 2024-09-19T08:54:56.674 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 10, 2024-09-19T08:54:56.674 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.049120123, 2024-09-19T08:54:56.674 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.004912012 2024-09-19T08:54:56.674 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.674 INFO:teuthology.orchestra.run.smithi044.stdout: "req_open_latency": { 2024-09-19T08:54:56.674 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1, 2024-09-19T08:54:56.674 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000193172, 2024-09-19T08:54:56.674 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000193172 2024-09-19T08:54:56.674 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.675 INFO:teuthology.orchestra.run.smithi044.stdout: "req_readdir_latency": { 2024-09-19T08:54:56.675 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3, 2024-09-19T08:54:56.675 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.003961725, 2024-09-19T08:54:56.675 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001320575 2024-09-19T08:54:56.675 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.675 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rename_latency": { 2024-09-19T08:54:56.675 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2, 2024-09-19T08:54:56.675 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.002084390, 2024-09-19T08:54:56.675 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001042195 2024-09-19T08:54:56.675 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.675 INFO:teuthology.orchestra.run.smithi044.stdout: "req_renamesnap_latency": { 2024-09-19T08:54:56.675 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:56.675 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:56.676 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:56.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.676 INFO:teuthology.orchestra.run.smithi044.stdout: "req_snapdiff_latency": { 2024-09-19T08:54:56.676 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:56.676 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:56.676 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:56.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.676 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmdir_latency": { 2024-09-19T08:54:56.676 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2, 2024-09-19T08:54:56.676 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.011746312, 2024-09-19T08:54:56.676 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.005873156 2024-09-19T08:54:56.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.676 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmsnap_latency": { 2024-09-19T08:54:56.677 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 4, 2024-09-19T08:54:56.677 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.017261279, 2024-09-19T08:54:56.677 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.004315319 2024-09-19T08:54:56.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.677 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmxattr_latency": { 2024-09-19T08:54:56.677 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:56.677 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:56.677 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:56.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.677 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setattr_latency": { 2024-09-19T08:54:56.677 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1, 2024-09-19T08:54:56.677 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.007406831, 2024-09-19T08:54:56.677 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.007406831 2024-09-19T08:54:56.678 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.678 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setdirlayout_latency": { 2024-09-19T08:54:56.678 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:56.678 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:56.678 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:56.678 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.678 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setfilelock_latency": { 2024-09-19T08:54:56.678 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:56.678 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:56.678 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:56.678 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.678 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setlayout_latency": { 2024-09-19T08:54:56.678 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:56.679 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:56.679 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:56.679 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.679 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setxattr_latency": { 2024-09-19T08:54:56.679 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 7, 2024-09-19T08:54:56.679 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.020903530, 2024-09-19T08:54:56.679 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.002986218 2024-09-19T08:54:56.679 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.679 INFO:teuthology.orchestra.run.smithi044.stdout: "req_symlink_latency": { 2024-09-19T08:54:56.679 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:56.679 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:56.679 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:56.679 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.680 INFO:teuthology.orchestra.run.smithi044.stdout: "req_unlink_latency": { 2024-09-19T08:54:56.680 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 4, 2024-09-19T08:54:56.680 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.004372639, 2024-09-19T08:54:56.680 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001093159 2024-09-19T08:54:56.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.680 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_revoke_eviction": 0, 2024-09-19T08:54:56.680 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition_throttle": 0, 2024-09-19T08:54:56.680 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getvxattr_latency": { 2024-09-19T08:54:56.680 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:56.680 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:56.680 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:56.680 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:56.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.681 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessions": { 2024-09-19T08:54:56.681 INFO:teuthology.orchestra.run.smithi044.stdout: "session_count": 2, 2024-09-19T08:54:56.681 INFO:teuthology.orchestra.run.smithi044.stdout: "session_add": 5, 2024-09-19T08:54:56.681 INFO:teuthology.orchestra.run.smithi044.stdout: "session_remove": 3, 2024-09-19T08:54:56.681 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_open": 2, 2024-09-19T08:54:56.681 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_stale": 0, 2024-09-19T08:54:56.681 INFO:teuthology.orchestra.run.smithi044.stdout: "total_load": 27, 2024-09-19T08:54:56.681 INFO:teuthology.orchestra.run.smithi044.stdout: "average_load": 13, 2024-09-19T08:54:56.681 INFO:teuthology.orchestra.run.smithi044.stdout: "avg_session_uptime": 609, 2024-09-19T08:54:56.681 INFO:teuthology.orchestra.run.smithi044.stdout: "mdthresh_evicted": 0 2024-09-19T08:54:56.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.681 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2024-09-19T08:54:56.682 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:54:56.682 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2024-09-19T08:54:56.682 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:54:56.682 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:54:56.682 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:54:56.682 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:54:56.682 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:54:56.682 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:54:56.682 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:54:56.682 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:54:56.682 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:54:56.682 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:54:56.682 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:54:56.682 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:54:56.683 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:54:56.683 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_items": 0, 2024-09-19T08:54:56.683 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:54:56.683 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_items": 0, 2024-09-19T08:54:56.683 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:54:56.683 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:54:56.683 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:54:56.683 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:54:56.683 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:54:56.683 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:54:56.683 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:54:56.683 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2024-09-19T08:54:56.683 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:54:56.684 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:54:56.684 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:54:56.684 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2024-09-19T08:54:56.684 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2024-09-19T08:54:56.684 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2024-09-19T08:54:56.684 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:54:56.684 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:54:56.684 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:54:56.684 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:54:56.684 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 303385, 2024-09-19T08:54:56.684 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 112, 2024-09-19T08:54:56.684 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 88, 2024-09-19T08:54:56.685 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 1, 2024-09-19T08:54:56.685 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2024-09-19T08:54:56.685 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2024-09-19T08:54:56.685 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:54:56.685 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2024-09-19T08:54:56.685 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:54:56.685 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2024-09-19T08:54:56.685 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 8288, 2024-09-19T08:54:56.685 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 182, 2024-09-19T08:54:56.685 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:54:56.685 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:54:56.685 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2024-09-19T08:54:56.685 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2024-09-19T08:54:56.686 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 139094, 2024-09-19T08:54:56.686 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 1273, 2024-09-19T08:54:56.686 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2024-09-19T08:54:56.686 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2024-09-19T08:54:56.686 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2024-09-19T08:54:56.686 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2024-09-19T08:54:56.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.686 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter": { 2024-09-19T08:54:56.686 INFO:teuthology.orchestra.run.smithi044.stdout: "op_active": 0, 2024-09-19T08:54:56.686 INFO:teuthology.orchestra.run.smithi044.stdout: "op_laggy": 0, 2024-09-19T08:54:56.686 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send": 1090, 2024-09-19T08:54:56.686 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send_bytes": 891364, 2024-09-19T08:54:56.687 INFO:teuthology.orchestra.run.smithi044.stdout: "op_resend": 31, 2024-09-19T08:54:56.687 INFO:teuthology.orchestra.run.smithi044.stdout: "op_reply": 1090, 2024-09-19T08:54:56.687 INFO:teuthology.orchestra.run.smithi044.stdout: "op_latency": { 2024-09-19T08:54:56.687 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1090, 2024-09-19T08:54:56.687 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 18.552709301, 2024-09-19T08:54:56.687 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.017020834 2024-09-19T08:54:56.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.687 INFO:teuthology.orchestra.run.smithi044.stdout: "op_inflight": 0, 2024-09-19T08:54:56.687 INFO:teuthology.orchestra.run.smithi044.stdout: "oplen_avg": { 2024-09-19T08:54:56.687 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1090, 2024-09-19T08:54:56.687 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 1138 2024-09-19T08:54:56.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.687 INFO:teuthology.orchestra.run.smithi044.stdout: "op": 1090, 2024-09-19T08:54:56.687 INFO:teuthology.orchestra.run.smithi044.stdout: "op_r": 283, 2024-09-19T08:54:56.688 INFO:teuthology.orchestra.run.smithi044.stdout: "op_w": 807, 2024-09-19T08:54:56.688 INFO:teuthology.orchestra.run.smithi044.stdout: "op_rmw": 0, 2024-09-19T08:54:56.688 INFO:teuthology.orchestra.run.smithi044.stdout: "op_pg": 0, 2024-09-19T08:54:56.688 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_stat": 0, 2024-09-19T08:54:56.688 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_create": 11, 2024-09-19T08:54:56.688 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_read": 23, 2024-09-19T08:54:56.688 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_write": 152, 2024-09-19T08:54:56.688 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writefull": 28, 2024-09-19T08:54:56.688 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writesame": 0, 2024-09-19T08:54:56.688 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_append": 0, 2024-09-19T08:54:56.688 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_zero": 0, 2024-09-19T08:54:56.688 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_truncate": 0, 2024-09-19T08:54:56.688 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_delete": 579, 2024-09-19T08:54:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_mapext": 0, 2024-09-19T08:54:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_sparse_read": 0, 2024-09-19T08:54:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_clonerange": 0, 2024-09-19T08:54:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_getxattr": 260, 2024-09-19T08:54:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_setxattr": 22, 2024-09-19T08:54:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_cmpxattr": 0, 2024-09-19T08:54:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_rmxattr": 0, 2024-09-19T08:54:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_resetxattrs": 0, 2024-09-19T08:54:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_call": 0, 2024-09-19T08:54:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_watch": 0, 2024-09-19T08:54:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_notify": 0, 2024-09-19T08:54:56.689 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T08:54:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls": 0, 2024-09-19T08:54:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls_filter": 0, 2024-09-19T08:54:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_other": 0, 2024-09-19T08:54:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_active": 0, 2024-09-19T08:54:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_send": 0, 2024-09-19T08:54:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_resend": 0, 2024-09-19T08:54:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_ping": 0, 2024-09-19T08:54:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_active": 0, 2024-09-19T08:54:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_send": 0, 2024-09-19T08:54:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_resend": 0, 2024-09-19T08:54:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_active": 0, 2024-09-19T08:54:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_send": 0, 2024-09-19T08:54:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_resend": 0, 2024-09-19T08:54:56.690 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_active": 0, 2024-09-19T08:54:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_send": 0, 2024-09-19T08:54:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_resend": 0, 2024-09-19T08:54:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: "command_active": 0, 2024-09-19T08:54:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: "command_send": 0, 2024-09-19T08:54:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: "command_resend": 0, 2024-09-19T08:54:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: "map_epoch": 91, 2024-09-19T08:54:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: "map_full": 0, 2024-09-19T08:54:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: "map_inc": 11, 2024-09-19T08:54:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_sessions": 12, 2024-09-19T08:54:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_open": 12, 2024-09-19T08:54:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_close": 0, 2024-09-19T08:54:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_laggy": 0, 2024-09-19T08:54:56.691 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_wr": 50, 2024-09-19T08:54:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_rd": 0, 2024-09-19T08:54:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_del": 13 2024-09-19T08:54:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: "oft": { 2024-09-19T08:54:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_objs": 1, 2024-09-19T08:54:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_kv_pairs": 0, 2024-09-19T08:54:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_updates": 0, 2024-09-19T08:54:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_removes": 0 2024-09-19T08:54:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: "osd-slow-ops": { 2024-09-19T08:54:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_ops_count": 32 2024-09-19T08:54:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.692 INFO:teuthology.orchestra.run.smithi044.stdout: "purge_queue": { 2024-09-19T08:54:56.693 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops": 0, 2024-09-19T08:54:56.693 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops_high_water": 64, 2024-09-19T08:54:56.693 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing": 0, 2024-09-19T08:54:56.693 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_high_water": 3, 2024-09-19T08:54:56.693 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed_ops": 67, 2024-09-19T08:54:56.693 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed": 4, 2024-09-19T08:54:56.693 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_item_in_journal": 0 2024-09-19T08:54:56.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.693 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:54:56.693 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-19T08:54:56.693 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-19T08:54:56.693 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-19T08:54:56.693 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 4547, 2024-09-19T08:54:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 2572551, 2024-09-19T08:54:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-19T08:54:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 4547, 2024-09-19T08:54:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-19T08:54:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-19T08:54:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 4547, 2024-09-19T08:54:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 2572551, 2024-09-19T08:54:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-19T08:54:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.694 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_bytes": { 2024-09-19T08:54:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-19T08:54:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-19T08:54:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-19T08:54:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-19T08:54:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-19T08:54:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-19T08:54:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-19T08:54:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 1090, 2024-09-19T08:54:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 891800, 2024-09-19T08:54:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 1090, 2024-09-19T08:54:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 891800, 2024-09-19T08:54:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-19T08:54:56.695 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_ops": { 2024-09-19T08:54:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-19T08:54:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 1024, 2024-09-19T08:54:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-19T08:54:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-19T08:54:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-19T08:54:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-19T08:54:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-19T08:54:56.696 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 1090, 2024-09-19T08:54:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 1090, 2024-09-19T08:54:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 1090, 2024-09-19T08:54:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 1090, 2024-09-19T08:54:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-19T08:54:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle": { 2024-09-19T08:54:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-19T08:54:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-19T08:54:56.697 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-19T08:54:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 4, 2024-09-19T08:54:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 436, 2024-09-19T08:54:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-19T08:54:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 4, 2024-09-19T08:54:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-19T08:54:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-19T08:54:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 2, 2024-09-19T08:54:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 436, 2024-09-19T08:54:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-19T08:54:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:56.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:56.699 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle-0x55fe90508500": { 2024-09-19T08:54:56.699 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-19T08:54:56.699 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-19T08:54:56.699 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-19T08:54:56.699 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 185, 2024-09-19T08:54:56.699 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 872400, 2024-09-19T08:54:56.699 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-19T08:54:56.699 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 185, 2024-09-19T08:54:56.699 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-19T08:54:56.699 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-19T08:54:56.699 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 150, 2024-09-19T08:54:56.699 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 872400, 2024-09-19T08:54:56.699 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-19T08:54:56.699 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:56.699 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:56.700 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:56.700 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:56.700 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:56.700 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-19T08:54:56.700 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:56 smithi175 ceph-mon[35688]: pgmap v323: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:54:56.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:56 smithi007 ceph-mon[31221]: pgmap v323: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T08:54:57.556 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-19T08:54:57.556 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-19T08:54:57.556 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=11 2024-09-19T08:54:57.556 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-09-19T08:54:57.557 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-19T08:54:57.557 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-09-19T08:54:57.557 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-09-19T08:54:57.557 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T08:54:57.557 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T08:54:57.818 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:54:58.347 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-19T08:54:58.347 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:54:58.347 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 238, 2024-09-19T08:54:58.347 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 224, 2024-09-19T08:54:58.347 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 1479234, 2024-09-19T08:54:58.347 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 129524, 2024-09-19T08:54:58.347 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 5, 2024-09-19T08:54:58.347 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 1, 2024-09-19T08:54:58.348 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.044029729, 2024-09-19T08:54:58.348 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.014800105, 2024-09-19T08:54:58.348 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.041335259, 2024-09-19T08:54:58.348 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.000018643, 2024-09-19T08:54:58.348 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:54:58.348 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 224, 2024-09-19T08:54:58.348 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.018395856, 2024-09-19T08:54:58.348 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000082124 2024-09-19T08:54:58.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.348 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:54:58.348 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.349 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.349 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.349 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 1478400, 2024-09-19T08:54:58.349 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 129200 2024-09-19T08:54:58.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.349 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:54:58.349 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 631, 2024-09-19T08:54:58.349 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 786, 2024-09-19T08:54:58.349 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 155076, 2024-09-19T08:54:58.349 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 636155, 2024-09-19T08:54:58.349 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 7, 2024-09-19T08:54:58.349 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 5, 2024-09-19T08:54:58.349 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.070486781, 2024-09-19T08:54:58.350 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.025752247, 2024-09-19T08:54:58.350 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.015371118, 2024-09-19T08:54:58.350 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.021447421, 2024-09-19T08:54:58.350 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:54:58.350 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 783, 2024-09-19T08:54:58.350 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.040412967, 2024-09-19T08:54:58.350 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000051612 2024-09-19T08:54:58.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.350 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:54:58.350 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.350 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.350 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.351 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T08:54:58.351 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 436128 2024-09-19T08:54:58.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.351 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:54:58.351 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 1456, 2024-09-19T08:54:58.351 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 1458, 2024-09-19T08:54:58.351 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 436983, 2024-09-19T08:54:58.351 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 463066, 2024-09-19T08:54:58.351 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 4, 2024-09-19T08:54:58.351 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 3, 2024-09-19T08:54:58.351 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.153005534, 2024-09-19T08:54:58.351 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.055345825, 2024-09-19T08:54:58.351 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.038935116, 2024-09-19T08:54:58.352 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.044212207, 2024-09-19T08:54:58.352 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:54:58.352 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1456, 2024-09-19T08:54:58.352 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.063518407, 2024-09-19T08:54:58.352 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000043625 2024-09-19T08:54:58.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.352 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:54:58.352 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.352 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.352 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.352 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:54:58.352 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:54:58.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.353 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2024-09-19T08:54:58.353 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 1, 2024-09-19T08:54:58.353 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2024-09-19T08:54:58.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.353 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-MDSRank": { 2024-09-19T08:54:58.353 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-19T08:54:58.353 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-19T08:54:58.353 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3453, 2024-09-19T08:54:58.353 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.104022612, 2024-09-19T08:54:58.353 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000030125 2024-09-19T08:54:58.353 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:58.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.353 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-PurgeQueue": { 2024-09-19T08:54:58.353 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-19T08:54:58.354 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-19T08:54:58.354 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.354 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.354 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.354 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:58.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.354 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": { 2024-09-19T08:54:58.354 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-09-19T08:54:58.354 INFO:teuthology.orchestra.run.smithi044.stdout: "reply": 0, 2024-09-19T08:54:58.354 INFO:teuthology.orchestra.run.smithi044.stdout: "reply_latency": { 2024-09-19T08:54:58.354 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.354 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.354 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.355 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_reply": 0, 2024-09-19T08:54:58.355 INFO:teuthology.orchestra.run.smithi044.stdout: "forward": 0, 2024-09-19T08:54:58.355 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_complete": 0, 2024-09-19T08:54:58.355 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_keys": 0, 2024-09-19T08:54:58.355 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_commit": 0, 2024-09-19T08:54:58.355 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_split": 0, 2024-09-19T08:54:58.355 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_merge": 0, 2024-09-19T08:54:58.355 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes": 0, 2024-09-19T08:54:58.355 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_top": 0, 2024-09-19T08:54:58.355 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_bottom": 0, 2024-09-19T08:54:58.355 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pin_tail": 0, 2024-09-19T08:54:58.355 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pinned": 0, 2024-09-19T08:54:58.355 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_expired": 0, 2024-09-19T08:54:58.355 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_with_caps": 0, 2024-09-19T08:54:58.356 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 0, 2024-09-19T08:54:58.356 INFO:teuthology.orchestra.run.smithi044.stdout: "subtrees": 1, 2024-09-19T08:54:58.356 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse": 0, 2024-09-19T08:54:58.356 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_hit": 0, 2024-09-19T08:54:58.356 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_forward": 0, 2024-09-19T08:54:58.356 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_discover": 0, 2024-09-19T08:54:58.356 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_dir_fetch": 0, 2024-09-19T08:54:58.356 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_remote_ino": 0, 2024-09-19T08:54:58.356 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_lock": 0, 2024-09-19T08:54:58.356 INFO:teuthology.orchestra.run.smithi044.stdout: "load_cent": 0, 2024-09-19T08:54:58.356 INFO:teuthology.orchestra.run.smithi044.stdout: "q": 0, 2024-09-19T08:54:58.356 INFO:teuthology.orchestra.run.smithi044.stdout: "exported": 0, 2024-09-19T08:54:58.356 INFO:teuthology.orchestra.run.smithi044.stdout: "exported_inodes": 0, 2024-09-19T08:54:58.357 INFO:teuthology.orchestra.run.smithi044.stdout: "imported": 0, 2024-09-19T08:54:58.357 INFO:teuthology.orchestra.run.smithi044.stdout: "imported_inodes": 0, 2024-09-19T08:54:58.357 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_dir_fetch": 0, 2024-09-19T08:54:58.357 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_backtrace_fetch": 0, 2024-09-19T08:54:58.357 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_peer_discover": 0, 2024-09-19T08:54:58.357 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rfiles": 0, 2024-09-19T08:54:58.357 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rbytes": 0, 2024-09-19T08:54:58.357 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rsnaps": 0, 2024-09-19T08:54:58.357 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T08:54:58.357 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_set_tag": 0, 2024-09-19T08:54:58.357 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T08:54:58.357 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_inotable_repaired": 0, 2024-09-19T08:54:58.358 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_inodes": 0, 2024-09-19T08:54:58.358 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T08:54:58.358 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T08:54:58.358 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_file_inodes": 0, 2024-09-19T08:54:58.358 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_inode_file_caps": 0, 2024-09-19T08:54:58.358 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T08:54:58.358 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_grant": 0, 2024-09-19T08:54:58.358 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T08:54:58.358 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T08:54:58.358 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T08:54:58.358 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps": 0, 2024-09-19T08:54:58.358 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps_dirty": 0, 2024-09-19T08:54:58.358 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_cap_release": 0, 2024-09-19T08:54:58.358 INFO:teuthology.orchestra.run.smithi044.stdout: "process_request_cap_release": 0 2024-09-19T08:54:58.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.359 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache": { 2024-09-19T08:54:58.359 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update": 0, 2024-09-19T08:54:58.359 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update_receipt": 0, 2024-09-19T08:54:58.359 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_try_discover": 0, 2024-09-19T08:54:58.359 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_send_discover": 0, 2024-09-19T08:54:58.359 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_handle_discover": 0, 2024-09-19T08:54:58.359 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays": 0, 2024-09-19T08:54:58.359 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_delayed": 0, 2024-09-19T08:54:58.359 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_enqueuing": 0, 2024-09-19T08:54:58.359 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_created": 0, 2024-09-19T08:54:58.359 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_enqueued": 0, 2024-09-19T08:54:58.359 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_reintegrated": 0, 2024-09-19T08:54:58.359 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_migrated": 0, 2024-09-19T08:54:58.360 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_processing": 0, 2024-09-19T08:54:58.360 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_enqueued": 0, 2024-09-19T08:54:58.360 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_prioritized": 0, 2024-09-19T08:54:58.360 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_started": 0, 2024-09-19T08:54:58.360 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_completed": 0, 2024-09-19T08:54:58.360 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_path": 0, 2024-09-19T08:54:58.360 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_inode": 0, 2024-09-19T08:54:58.360 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T08:54:58.360 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_exportdir": 0, 2024-09-19T08:54:58.360 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_flush": 0, 2024-09-19T08:54:58.360 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragmentdir": 0, 2024-09-19T08:54:58.360 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragstats": 0, 2024-09-19T08:54:58.360 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_inodestats": 0 2024-09-19T08:54:58.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.361 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log": { 2024-09-19T08:54:58.361 INFO:teuthology.orchestra.run.smithi044.stdout: "evlrg": 0, 2024-09-19T08:54:58.361 INFO:teuthology.orchestra.run.smithi044.stdout: "evadd": 0, 2024-09-19T08:54:58.361 INFO:teuthology.orchestra.run.smithi044.stdout: "evex": 0, 2024-09-19T08:54:58.361 INFO:teuthology.orchestra.run.smithi044.stdout: "evtrm": 0, 2024-09-19T08:54:58.361 INFO:teuthology.orchestra.run.smithi044.stdout: "ev": 7, 2024-09-19T08:54:58.361 INFO:teuthology.orchestra.run.smithi044.stdout: "evexg": 0, 2024-09-19T08:54:58.361 INFO:teuthology.orchestra.run.smithi044.stdout: "evexd": 0, 2024-09-19T08:54:58.361 INFO:teuthology.orchestra.run.smithi044.stdout: "segadd": 0, 2024-09-19T08:54:58.361 INFO:teuthology.orchestra.run.smithi044.stdout: "segex": 0, 2024-09-19T08:54:58.361 INFO:teuthology.orchestra.run.smithi044.stdout: "segtrm": 0, 2024-09-19T08:54:58.361 INFO:teuthology.orchestra.run.smithi044.stdout: "seg": 2, 2024-09-19T08:54:58.361 INFO:teuthology.orchestra.run.smithi044.stdout: "segmjr": 2, 2024-09-19T08:54:58.361 INFO:teuthology.orchestra.run.smithi044.stdout: "segexg": 0, 2024-09-19T08:54:58.361 INFO:teuthology.orchestra.run.smithi044.stdout: "segexd": 0, 2024-09-19T08:54:58.361 INFO:teuthology.orchestra.run.smithi044.stdout: "expos": 4194304, 2024-09-19T08:54:58.362 INFO:teuthology.orchestra.run.smithi044.stdout: "wrpos": 4196268, 2024-09-19T08:54:58.362 INFO:teuthology.orchestra.run.smithi044.stdout: "rdpos": 4196127, 2024-09-19T08:54:58.362 INFO:teuthology.orchestra.run.smithi044.stdout: "jlat": { 2024-09-19T08:54:58.362 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.362 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.362 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.362 INFO:teuthology.orchestra.run.smithi044.stdout: "replayed": 7 2024-09-19T08:54:58.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.362 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mem": { 2024-09-19T08:54:58.362 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 3, 2024-09-19T08:54:58.362 INFO:teuthology.orchestra.run.smithi044.stdout: "ino+": 3, 2024-09-19T08:54:58.362 INFO:teuthology.orchestra.run.smithi044.stdout: "ino-": 0, 2024-09-19T08:54:58.362 INFO:teuthology.orchestra.run.smithi044.stdout: "dir": 1, 2024-09-19T08:54:58.362 INFO:teuthology.orchestra.run.smithi044.stdout: "dir+": 1, 2024-09-19T08:54:58.362 INFO:teuthology.orchestra.run.smithi044.stdout: "dir-": 0, 2024-09-19T08:54:58.363 INFO:teuthology.orchestra.run.smithi044.stdout: "dn": 0, 2024-09-19T08:54:58.363 INFO:teuthology.orchestra.run.smithi044.stdout: "dn+": 0, 2024-09-19T08:54:58.363 INFO:teuthology.orchestra.run.smithi044.stdout: "dn-": 0, 2024-09-19T08:54:58.363 INFO:teuthology.orchestra.run.smithi044.stdout: "cap": 0, 2024-09-19T08:54:58.364 INFO:teuthology.orchestra.run.smithi044.stdout: "cap+": 0, 2024-09-19T08:54:58.364 INFO:teuthology.orchestra.run.smithi044.stdout: "cap-": 0, 2024-09-19T08:54:58.364 INFO:teuthology.orchestra.run.smithi044.stdout: "rss": 47800, 2024-09-19T08:54:58.364 INFO:teuthology.orchestra.run.smithi044.stdout: "heap": 215328 2024-09-19T08:54:58.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.364 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_server": { 2024-09-19T08:54:58.364 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_client_request": 0, 2024-09-19T08:54:58.364 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_server_request": 0, 2024-09-19T08:54:58.364 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_request": 0, 2024-09-19T08:54:58.365 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_session": 0, 2024-09-19T08:54:58.365 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_peer_request": 0, 2024-09-19T08:54:58.365 INFO:teuthology.orchestra.run.smithi044.stdout: "req_create_latency": { 2024-09-19T08:54:58.365 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.365 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.365 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.365 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getattr_latency": { 2024-09-19T08:54:58.365 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.365 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.365 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.366 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getfilelock_latency": { 2024-09-19T08:54:58.366 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.366 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.366 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.366 INFO:teuthology.orchestra.run.smithi044.stdout: "req_link_latency": { 2024-09-19T08:54:58.366 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.366 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.366 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.366 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookup_latency": { 2024-09-19T08:54:58.366 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.366 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.366 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.367 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookuphash_latency": { 2024-09-19T08:54:58.367 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.367 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.367 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.367 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupino_latency": { 2024-09-19T08:54:58.367 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.367 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.367 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.367 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupname_latency": { 2024-09-19T08:54:58.367 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.367 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.367 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.368 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupparent_latency": { 2024-09-19T08:54:58.368 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.368 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.368 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.368 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupsnap_latency": { 2024-09-19T08:54:58.368 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.368 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.368 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.368 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lssnap_latency": { 2024-09-19T08:54:58.368 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.368 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.369 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.369 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mkdir_latency": { 2024-09-19T08:54:58.369 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.369 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.369 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.370 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mknod_latency": { 2024-09-19T08:54:58.370 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.370 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.370 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.370 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mksnap_latency": { 2024-09-19T08:54:58.370 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.370 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.370 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.370 INFO:teuthology.orchestra.run.smithi044.stdout: "req_open_latency": { 2024-09-19T08:54:58.370 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.371 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.371 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.371 INFO:teuthology.orchestra.run.smithi044.stdout: "req_readdir_latency": { 2024-09-19T08:54:58.371 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.371 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.371 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.371 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rename_latency": { 2024-09-19T08:54:58.371 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.371 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.371 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.371 INFO:teuthology.orchestra.run.smithi044.stdout: "req_renamesnap_latency": { 2024-09-19T08:54:58.372 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.372 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.372 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.372 INFO:teuthology.orchestra.run.smithi044.stdout: "req_snapdiff_latency": { 2024-09-19T08:54:58.372 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.372 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.372 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.372 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmdir_latency": { 2024-09-19T08:54:58.372 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.372 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.372 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.373 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmsnap_latency": { 2024-09-19T08:54:58.373 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.373 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.373 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.373 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmxattr_latency": { 2024-09-19T08:54:58.373 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.373 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.373 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.373 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setattr_latency": { 2024-09-19T08:54:58.373 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.374 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.374 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.374 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setdirlayout_latency": { 2024-09-19T08:54:58.374 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.374 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.374 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.374 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setfilelock_latency": { 2024-09-19T08:54:58.374 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.374 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.374 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.374 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setlayout_latency": { 2024-09-19T08:54:58.375 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.375 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.375 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.375 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.375 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setxattr_latency": { 2024-09-19T08:54:58.375 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.375 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.375 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.375 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.375 INFO:teuthology.orchestra.run.smithi044.stdout: "req_symlink_latency": { 2024-09-19T08:54:58.375 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.375 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.375 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.376 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.376 INFO:teuthology.orchestra.run.smithi044.stdout: "req_unlink_latency": { 2024-09-19T08:54:58.376 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.376 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.376 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.376 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.376 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_revoke_eviction": 0, 2024-09-19T08:54:58.376 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition_throttle": 0, 2024-09-19T08:54:58.376 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getvxattr_latency": { 2024-09-19T08:54:58.376 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.376 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.376 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.377 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:58.377 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.377 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessions": { 2024-09-19T08:54:58.377 INFO:teuthology.orchestra.run.smithi044.stdout: "session_count": 1, 2024-09-19T08:54:58.377 INFO:teuthology.orchestra.run.smithi044.stdout: "session_add": 3, 2024-09-19T08:54:58.377 INFO:teuthology.orchestra.run.smithi044.stdout: "session_remove": 2, 2024-09-19T08:54:58.377 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_open": 2, 2024-09-19T08:54:58.377 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_stale": 0, 2024-09-19T08:54:58.377 INFO:teuthology.orchestra.run.smithi044.stdout: "total_load": 0, 2024-09-19T08:54:58.377 INFO:teuthology.orchestra.run.smithi044.stdout: "average_load": 0, 2024-09-19T08:54:58.377 INFO:teuthology.orchestra.run.smithi044.stdout: "avg_session_uptime": 3181, 2024-09-19T08:54:58.377 INFO:teuthology.orchestra.run.smithi044.stdout: "mdthresh_evicted": 0 2024-09-19T08:54:58.377 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.377 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2024-09-19T08:54:58.378 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:54:58.378 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2024-09-19T08:54:58.378 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:54:58.378 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:54:58.378 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:54:58.378 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:54:58.378 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:54:58.378 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:54:58.378 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:54:58.378 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:54:58.378 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:54:58.378 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:54:58.378 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:54:58.378 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:54:58.379 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:54:58.379 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_items": 0, 2024-09-19T08:54:58.379 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:54:58.379 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_items": 0, 2024-09-19T08:54:58.379 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:54:58.379 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:54:58.379 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:54:58.379 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:54:58.379 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:54:58.379 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:54:58.379 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:54:58.379 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2024-09-19T08:54:58.379 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:54:58.379 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:54:58.380 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:54:58.380 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2024-09-19T08:54:58.380 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2024-09-19T08:54:58.380 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2024-09-19T08:54:58.380 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:54:58.380 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:54:58.380 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:54:58.380 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:54:58.380 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 189393, 2024-09-19T08:54:58.380 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 51, 2024-09-19T08:54:58.380 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:54:58.380 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 0, 2024-09-19T08:54:58.380 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2024-09-19T08:54:58.381 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2024-09-19T08:54:58.381 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:54:58.381 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2024-09-19T08:54:58.381 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:54:58.381 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2024-09-19T08:54:58.381 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 8288, 2024-09-19T08:54:58.381 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 182, 2024-09-19T08:54:58.381 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:54:58.381 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:54:58.381 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2024-09-19T08:54:58.381 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2024-09-19T08:54:58.381 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 8512, 2024-09-19T08:54:58.381 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 13, 2024-09-19T08:54:58.381 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2024-09-19T08:54:58.382 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2024-09-19T08:54:58.382 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2024-09-19T08:54:58.382 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2024-09-19T08:54:58.382 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.382 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter": { 2024-09-19T08:54:58.382 INFO:teuthology.orchestra.run.smithi044.stdout: "op_active": 0, 2024-09-19T08:54:58.382 INFO:teuthology.orchestra.run.smithi044.stdout: "op_laggy": 0, 2024-09-19T08:54:58.382 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send": 2086, 2024-09-19T08:54:58.382 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send_bytes": 21, 2024-09-19T08:54:58.382 INFO:teuthology.orchestra.run.smithi044.stdout: "op_resend": 3, 2024-09-19T08:54:58.382 INFO:teuthology.orchestra.run.smithi044.stdout: "op_reply": 2086, 2024-09-19T08:54:58.382 INFO:teuthology.orchestra.run.smithi044.stdout: "op_latency": { 2024-09-19T08:54:58.382 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2086, 2024-09-19T08:54:58.382 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.946985163, 2024-09-19T08:54:58.383 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000453971 2024-09-19T08:54:58.383 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.383 INFO:teuthology.orchestra.run.smithi044.stdout: "op_inflight": 0, 2024-09-19T08:54:58.383 INFO:teuthology.orchestra.run.smithi044.stdout: "oplen_avg": { 2024-09-19T08:54:58.383 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2086, 2024-09-19T08:54:58.383 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 2087 2024-09-19T08:54:58.383 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.383 INFO:teuthology.orchestra.run.smithi044.stdout: "op": 2086, 2024-09-19T08:54:58.383 INFO:teuthology.orchestra.run.smithi044.stdout: "op_r": 2086, 2024-09-19T08:54:58.383 INFO:teuthology.orchestra.run.smithi044.stdout: "op_w": 0, 2024-09-19T08:54:58.383 INFO:teuthology.orchestra.run.smithi044.stdout: "op_rmw": 0, 2024-09-19T08:54:58.383 INFO:teuthology.orchestra.run.smithi044.stdout: "op_pg": 0, 2024-09-19T08:54:58.383 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_stat": 1351, 2024-09-19T08:54:58.383 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_create": 0, 2024-09-19T08:54:58.384 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_read": 733, 2024-09-19T08:54:58.384 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_write": 0, 2024-09-19T08:54:58.384 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writefull": 0, 2024-09-19T08:54:58.384 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writesame": 0, 2024-09-19T08:54:58.384 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_append": 0, 2024-09-19T08:54:58.384 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_zero": 0, 2024-09-19T08:54:58.384 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_truncate": 0, 2024-09-19T08:54:58.384 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_delete": 0, 2024-09-19T08:54:58.384 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_mapext": 0, 2024-09-19T08:54:58.384 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_sparse_read": 0, 2024-09-19T08:54:58.384 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_clonerange": 0, 2024-09-19T08:54:58.384 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_getxattr": 1, 2024-09-19T08:54:58.384 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_setxattr": 0, 2024-09-19T08:54:58.384 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_cmpxattr": 0, 2024-09-19T08:54:58.384 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_rmxattr": 0, 2024-09-19T08:54:58.385 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_resetxattrs": 0, 2024-09-19T08:54:58.385 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_call": 0, 2024-09-19T08:54:58.385 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_watch": 0, 2024-09-19T08:54:58.385 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_notify": 0, 2024-09-19T08:54:58.385 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T08:54:58.385 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls": 0, 2024-09-19T08:54:58.385 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls_filter": 0, 2024-09-19T08:54:58.385 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_other": 0, 2024-09-19T08:54:58.385 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_active": 0, 2024-09-19T08:54:58.385 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_send": 0, 2024-09-19T08:54:58.385 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_resend": 0, 2024-09-19T08:54:58.385 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_ping": 0, 2024-09-19T08:54:58.385 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_active": 0, 2024-09-19T08:54:58.385 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_send": 0, 2024-09-19T08:54:58.386 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_resend": 0, 2024-09-19T08:54:58.386 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_active": 0, 2024-09-19T08:54:58.386 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_send": 0, 2024-09-19T08:54:58.386 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_resend": 0, 2024-09-19T08:54:58.386 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_active": 0, 2024-09-19T08:54:58.386 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_send": 0, 2024-09-19T08:54:58.386 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_resend": 0, 2024-09-19T08:54:58.386 INFO:teuthology.orchestra.run.smithi044.stdout: "command_active": 0, 2024-09-19T08:54:58.386 INFO:teuthology.orchestra.run.smithi044.stdout: "command_send": 0, 2024-09-19T08:54:58.386 INFO:teuthology.orchestra.run.smithi044.stdout: "command_resend": 0, 2024-09-19T08:54:58.386 INFO:teuthology.orchestra.run.smithi044.stdout: "map_epoch": 91, 2024-09-19T08:54:58.386 INFO:teuthology.orchestra.run.smithi044.stdout: "map_full": 0, 2024-09-19T08:54:58.386 INFO:teuthology.orchestra.run.smithi044.stdout: "map_inc": 11, 2024-09-19T08:54:58.387 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_sessions": 5, 2024-09-19T08:54:58.387 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_open": 5, 2024-09-19T08:54:58.387 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_close": 0, 2024-09-19T08:54:58.387 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_laggy": 0, 2024-09-19T08:54:58.387 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_wr": 0, 2024-09-19T08:54:58.387 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_rd": 2, 2024-09-19T08:54:58.387 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_del": 0 2024-09-19T08:54:58.387 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.387 INFO:teuthology.orchestra.run.smithi044.stdout: "oft": { 2024-09-19T08:54:58.387 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_objs": 0, 2024-09-19T08:54:58.387 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_kv_pairs": 0, 2024-09-19T08:54:58.387 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_updates": 0, 2024-09-19T08:54:58.387 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_removes": 0 2024-09-19T08:54:58.387 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.388 INFO:teuthology.orchestra.run.smithi044.stdout: "osd-slow-ops": { 2024-09-19T08:54:58.388 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_ops_count": 0 2024-09-19T08:54:58.388 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.388 INFO:teuthology.orchestra.run.smithi044.stdout: "purge_queue": { 2024-09-19T08:54:58.388 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops": 0, 2024-09-19T08:54:58.388 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T08:54:58.388 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing": 0, 2024-09-19T08:54:58.388 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_high_water": 0, 2024-09-19T08:54:58.388 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed_ops": 0, 2024-09-19T08:54:58.388 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed": 0, 2024-09-19T08:54:58.388 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_item_in_journal": 0 2024-09-19T08:54:58.388 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.388 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:54:58.389 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-19T08:54:58.389 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-19T08:54:58.389 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-19T08:54:58.389 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 2321, 2024-09-19T08:54:58.389 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 1847413, 2024-09-19T08:54:58.389 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-19T08:54:58.389 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 2321, 2024-09-19T08:54:58.389 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-19T08:54:58.389 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-19T08:54:58.389 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 2321, 2024-09-19T08:54:58.389 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 1847413, 2024-09-19T08:54:58.389 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-19T08:54:58.389 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.389 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.390 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.390 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:58.390 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.390 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_bytes": { 2024-09-19T08:54:58.390 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-19T08:54:58.390 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-19T08:54:58.390 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-19T08:54:58.390 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-19T08:54:58.390 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-19T08:54:58.390 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-19T08:54:58.390 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-19T08:54:58.390 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 2086, 2024-09-19T08:54:58.390 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 1969, 2024-09-19T08:54:58.391 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 2086, 2024-09-19T08:54:58.391 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 1969, 2024-09-19T08:54:58.391 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-19T08:54:58.391 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.391 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.391 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.391 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:58.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.391 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_ops": { 2024-09-19T08:54:58.391 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-19T08:54:58.391 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 1024, 2024-09-19T08:54:58.391 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-19T08:54:58.391 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-19T08:54:58.391 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-19T08:54:58.392 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-19T08:54:58.392 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-19T08:54:58.392 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 2086, 2024-09-19T08:54:58.392 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 2086, 2024-09-19T08:54:58.392 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 2086, 2024-09-19T08:54:58.392 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 2086, 2024-09-19T08:54:58.392 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-19T08:54:58.392 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.392 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.392 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.392 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:58.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.392 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle": { 2024-09-19T08:54:58.392 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-19T08:54:58.393 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-19T08:54:58.393 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-19T08:54:58.393 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-19T08:54:58.393 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-19T08:54:58.393 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-19T08:54:58.393 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-19T08:54:58.393 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-19T08:54:58.393 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-19T08:54:58.393 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2024-09-19T08:54:58.393 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2024-09-19T08:54:58.393 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-19T08:54:58.393 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.393 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.393 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.394 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:58.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:58.394 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle-0x55fcf2c5e6e0": { 2024-09-19T08:54:58.394 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-19T08:54:58.394 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-19T08:54:58.394 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-19T08:54:58.394 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-19T08:54:58.394 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-19T08:54:58.394 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-19T08:54:58.394 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-19T08:54:58.394 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-19T08:54:58.394 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-19T08:54:58.394 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2024-09-19T08:54:58.395 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2024-09-19T08:54:58.395 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-19T08:54:58.395 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:58.395 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:58.395 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:58.395 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:58.395 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:58.395 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-19T08:54:58.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:54:58 smithi044 ceph-mon[35072]: pgmap v324: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T08:54:58.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:54:58 smithi175 ceph-mon[35688]: pgmap v324: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T08:54:58.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:54:58 smithi007 ceph-mon[31221]: pgmap v324: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T08:54:59.097 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-19T08:54:59.097 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-19T08:54:59.097 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-19T08:54:59.097 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-19T08:54:59.097 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-09-19T08:54:59.097 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-19T08:54:59.097 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T08:54:59.098 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T08:54:59.098 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T08:54:59.347 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:54:59.819 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-19T08:54:59.819 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:54:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 32, 2024-09-19T08:54:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 160, 2024-09-19T08:54:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 7831, 2024-09-19T08:54:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 376046, 2024-09-19T08:54:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 14, 2024-09-19T08:54:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 2, 2024-09-19T08:54:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.016703373, 2024-09-19T08:54:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.005631070, 2024-09-19T08:54:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.004533372, 2024-09-19T08:54:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.000569673, 2024-09-19T08:54:59.820 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:54:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 158, 2024-09-19T08:54:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.034115067, 2024-09-19T08:54:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000215918 2024-09-19T08:54:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:54:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 10, 2024-09-19T08:54:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000001067, 2024-09-19T08:54:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000106 2024-09-19T08:54:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 928, 2024-09-19T08:54:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 314704 2024-09-19T08:54:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.821 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:54:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 295, 2024-09-19T08:54:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 311, 2024-09-19T08:54:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 1491893, 2024-09-19T08:54:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 202974, 2024-09-19T08:54:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 11, 2024-09-19T08:54:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 6, 2024-09-19T08:54:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.054993018, 2024-09-19T08:54:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.019010994, 2024-09-19T08:54:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.049184485, 2024-09-19T08:54:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.000361616, 2024-09-19T08:54:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:54:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 308, 2024-09-19T08:54:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.028537710, 2024-09-19T08:54:59.822 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000092654 2024-09-19T08:54:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:54:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 49, 2024-09-19T08:54:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000026284, 2024-09-19T08:54:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000536 2024-09-19T08:54:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 1485104, 2024-09-19T08:54:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 132912 2024-09-19T08:54:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:54:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 634, 2024-09-19T08:54:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 733, 2024-09-19T08:54:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 185063, 2024-09-19T08:54:59.823 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 861900, 2024-09-19T08:54:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 49, 2024-09-19T08:54:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 3, 2024-09-19T08:54:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.090651556, 2024-09-19T08:54:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.035317019, 2024-09-19T08:54:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.051374036, 2024-09-19T08:54:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.003968830, 2024-09-19T08:54:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:54:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 733, 2024-09-19T08:54:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.041175522, 2024-09-19T08:54:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000056173 2024-09-19T08:54:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:54:59.824 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1259, 2024-09-19T08:54:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000284901, 2024-09-19T08:54:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000226 2024-09-19T08:54:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 5840, 2024-09-19T08:54:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 128032 2024-09-19T08:54:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2024-09-19T08:54:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 1, 2024-09-19T08:54:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2024-09-19T08:54:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-MDSRank": { 2024-09-19T08:54:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-19T08:54:59.825 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-19T08:54:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 52, 2024-09-19T08:54:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.001808988, 2024-09-19T08:54:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000034788 2024-09-19T08:54:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-PurgeQueue": { 2024-09-19T08:54:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-19T08:54:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-19T08:54:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2, 2024-09-19T08:54:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000014307, 2024-09-19T08:54:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000007153 2024-09-19T08:54:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.826 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": { 2024-09-19T08:54:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 4, 2024-09-19T08:54:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: "reply": 3, 2024-09-19T08:54:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: "reply_latency": { 2024-09-19T08:54:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3, 2024-09-19T08:54:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000436926, 2024-09-19T08:54:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000145642 2024-09-19T08:54:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_reply": 0, 2024-09-19T08:54:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: "forward": 1, 2024-09-19T08:54:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_complete": 0, 2024-09-19T08:54:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_keys": 0, 2024-09-19T08:54:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_commit": 11, 2024-09-19T08:54:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_split": 0, 2024-09-19T08:54:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_merge": 0, 2024-09-19T08:54:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes": 16, 2024-09-19T08:54:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_top": 0, 2024-09-19T08:54:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_bottom": 16, 2024-09-19T08:54:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pin_tail": 0, 2024-09-19T08:54:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pinned": 13, 2024-09-19T08:54:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_expired": 4, 2024-09-19T08:54:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_with_caps": 1, 2024-09-19T08:54:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-09-19T08:54:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: "subtrees": 3, 2024-09-19T08:54:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse": 23, 2024-09-19T08:54:59.828 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_hit": 16, 2024-09-19T08:54:59.829 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_forward": 1, 2024-09-19T08:54:59.829 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_discover": 6, 2024-09-19T08:54:59.829 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_dir_fetch": 0, 2024-09-19T08:54:59.829 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_remote_ino": 0, 2024-09-19T08:54:59.829 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_lock": 0, 2024-09-19T08:54:59.829 INFO:teuthology.orchestra.run.smithi044.stdout: "load_cent": 0, 2024-09-19T08:54:59.829 INFO:teuthology.orchestra.run.smithi044.stdout: "q": 0, 2024-09-19T08:54:59.830 INFO:teuthology.orchestra.run.smithi044.stdout: "exported": 0, 2024-09-19T08:54:59.830 INFO:teuthology.orchestra.run.smithi044.stdout: "exported_inodes": 0, 2024-09-19T08:54:59.830 INFO:teuthology.orchestra.run.smithi044.stdout: "imported": 0, 2024-09-19T08:54:59.830 INFO:teuthology.orchestra.run.smithi044.stdout: "imported_inodes": 0, 2024-09-19T08:54:59.830 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_dir_fetch": 0, 2024-09-19T08:54:59.830 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_backtrace_fetch": 0, 2024-09-19T08:54:59.830 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_peer_discover": 0, 2024-09-19T08:54:59.830 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rfiles": 4, 2024-09-19T08:54:59.830 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rbytes": 234, 2024-09-19T08:54:59.830 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rsnaps": 6, 2024-09-19T08:54:59.830 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T08:54:59.830 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_set_tag": 0, 2024-09-19T08:54:59.830 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T08:54:59.831 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_inotable_repaired": 0, 2024-09-19T08:54:59.831 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_inodes": 0, 2024-09-19T08:54:59.831 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T08:54:59.831 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T08:54:59.831 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_file_inodes": 0, 2024-09-19T08:54:59.831 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_inode_file_caps": 0, 2024-09-19T08:54:59.831 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_revoke": 3, 2024-09-19T08:54:59.831 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_grant": 0, 2024-09-19T08:54:59.831 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T08:54:59.831 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T08:54:59.831 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T08:54:59.831 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps": 3, 2024-09-19T08:54:59.831 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps_dirty": 0, 2024-09-19T08:54:59.832 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_cap_release": 0, 2024-09-19T08:54:59.832 INFO:teuthology.orchestra.run.smithi044.stdout: "process_request_cap_release": 0 2024-09-19T08:54:59.832 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.832 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache": { 2024-09-19T08:54:59.832 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update": 0, 2024-09-19T08:54:59.832 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update_receipt": 18, 2024-09-19T08:54:59.832 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_try_discover": 12, 2024-09-19T08:54:59.832 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_send_discover": 12, 2024-09-19T08:54:59.832 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_handle_discover": 0, 2024-09-19T08:54:59.832 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays": 0, 2024-09-19T08:54:59.832 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_delayed": 0, 2024-09-19T08:54:59.832 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_enqueuing": 0, 2024-09-19T08:54:59.832 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_created": 0, 2024-09-19T08:54:59.833 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_enqueued": 0, 2024-09-19T08:54:59.833 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_reintegrated": 0, 2024-09-19T08:54:59.833 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_migrated": 0, 2024-09-19T08:54:59.833 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_processing": 0, 2024-09-19T08:54:59.833 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_enqueued": 0, 2024-09-19T08:54:59.833 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_prioritized": 0, 2024-09-19T08:54:59.833 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_started": 0, 2024-09-19T08:54:59.833 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_completed": 0, 2024-09-19T08:54:59.833 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_path": 3, 2024-09-19T08:54:59.834 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_inode": 17, 2024-09-19T08:54:59.834 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T08:54:59.834 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_exportdir": 0, 2024-09-19T08:54:59.834 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_flush": 0, 2024-09-19T08:54:59.834 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragmentdir": 0, 2024-09-19T08:54:59.834 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragstats": 0, 2024-09-19T08:54:59.834 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_inodestats": 0 2024-09-19T08:54:59.834 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.834 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log": { 2024-09-19T08:54:59.834 INFO:teuthology.orchestra.run.smithi044.stdout: "evlrg": 0, 2024-09-19T08:54:59.834 INFO:teuthology.orchestra.run.smithi044.stdout: "evadd": 7, 2024-09-19T08:54:59.834 INFO:teuthology.orchestra.run.smithi044.stdout: "evex": 0, 2024-09-19T08:54:59.834 INFO:teuthology.orchestra.run.smithi044.stdout: "evtrm": 0, 2024-09-19T08:54:59.834 INFO:teuthology.orchestra.run.smithi044.stdout: "ev": 7, 2024-09-19T08:54:59.835 INFO:teuthology.orchestra.run.smithi044.stdout: "evexg": 0, 2024-09-19T08:54:59.835 INFO:teuthology.orchestra.run.smithi044.stdout: "evexd": 0, 2024-09-19T08:54:59.835 INFO:teuthology.orchestra.run.smithi044.stdout: "segadd": 2, 2024-09-19T08:54:59.835 INFO:teuthology.orchestra.run.smithi044.stdout: "segex": 0, 2024-09-19T08:54:59.835 INFO:teuthology.orchestra.run.smithi044.stdout: "segtrm": 0, 2024-09-19T08:54:59.835 INFO:teuthology.orchestra.run.smithi044.stdout: "seg": 2, 2024-09-19T08:54:59.835 INFO:teuthology.orchestra.run.smithi044.stdout: "segmjr": 2, 2024-09-19T08:54:59.835 INFO:teuthology.orchestra.run.smithi044.stdout: "segexg": 0, 2024-09-19T08:54:59.835 INFO:teuthology.orchestra.run.smithi044.stdout: "segexd": 0, 2024-09-19T08:54:59.835 INFO:teuthology.orchestra.run.smithi044.stdout: "expos": 4194304, 2024-09-19T08:54:59.835 INFO:teuthology.orchestra.run.smithi044.stdout: "wrpos": 4196268, 2024-09-19T08:54:59.835 INFO:teuthology.orchestra.run.smithi044.stdout: "rdpos": 0, 2024-09-19T08:54:59.835 INFO:teuthology.orchestra.run.smithi044.stdout: "jlat": { 2024-09-19T08:54:59.835 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 6, 2024-09-19T08:54:59.836 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.019171040, 2024-09-19T08:54:59.836 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.003195173 2024-09-19T08:54:59.836 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.836 INFO:teuthology.orchestra.run.smithi044.stdout: "replayed": 0 2024-09-19T08:54:59.836 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.836 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mem": { 2024-09-19T08:54:59.836 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 20, 2024-09-19T08:54:59.836 INFO:teuthology.orchestra.run.smithi044.stdout: "ino+": 22, 2024-09-19T08:54:59.836 INFO:teuthology.orchestra.run.smithi044.stdout: "ino-": 2, 2024-09-19T08:54:59.836 INFO:teuthology.orchestra.run.smithi044.stdout: "dir": 19, 2024-09-19T08:54:59.836 INFO:teuthology.orchestra.run.smithi044.stdout: "dir+": 23, 2024-09-19T08:54:59.836 INFO:teuthology.orchestra.run.smithi044.stdout: "dir-": 4, 2024-09-19T08:54:59.836 INFO:teuthology.orchestra.run.smithi044.stdout: "dn": 16, 2024-09-19T08:54:59.837 INFO:teuthology.orchestra.run.smithi044.stdout: "dn+": 20, 2024-09-19T08:54:59.837 INFO:teuthology.orchestra.run.smithi044.stdout: "dn-": 4, 2024-09-19T08:54:59.837 INFO:teuthology.orchestra.run.smithi044.stdout: "cap": 1, 2024-09-19T08:54:59.837 INFO:teuthology.orchestra.run.smithi044.stdout: "cap+": 3, 2024-09-19T08:54:59.837 INFO:teuthology.orchestra.run.smithi044.stdout: "cap-": 2, 2024-09-19T08:54:59.837 INFO:teuthology.orchestra.run.smithi044.stdout: "rss": 50828, 2024-09-19T08:54:59.837 INFO:teuthology.orchestra.run.smithi044.stdout: "heap": 223520 2024-09-19T08:54:59.837 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.837 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_server": { 2024-09-19T08:54:59.837 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_client_request": 4, 2024-09-19T08:54:59.837 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_server_request": 0, 2024-09-19T08:54:59.837 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_request": 4, 2024-09-19T08:54:59.837 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_session": 16, 2024-09-19T08:54:59.837 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_peer_request": 0, 2024-09-19T08:54:59.838 INFO:teuthology.orchestra.run.smithi044.stdout: "req_create_latency": { 2024-09-19T08:54:59.838 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.838 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.838 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.838 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.838 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getattr_latency": { 2024-09-19T08:54:59.838 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1, 2024-09-19T08:54:59.838 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000178270, 2024-09-19T08:54:59.838 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000178270 2024-09-19T08:54:59.838 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.838 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getfilelock_latency": { 2024-09-19T08:54:59.838 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.838 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.838 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.839 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.839 INFO:teuthology.orchestra.run.smithi044.stdout: "req_link_latency": { 2024-09-19T08:54:59.839 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.839 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.839 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.839 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.839 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookup_latency": { 2024-09-19T08:54:59.839 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1, 2024-09-19T08:54:59.839 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000151532, 2024-09-19T08:54:59.839 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000151532 2024-09-19T08:54:59.839 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.839 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookuphash_latency": { 2024-09-19T08:54:59.839 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.839 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.839 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.840 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.840 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupino_latency": { 2024-09-19T08:54:59.840 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1, 2024-09-19T08:54:59.840 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000107124, 2024-09-19T08:54:59.840 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000107124 2024-09-19T08:54:59.840 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.840 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupname_latency": { 2024-09-19T08:54:59.840 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.840 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.840 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.840 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.840 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupparent_latency": { 2024-09-19T08:54:59.840 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.840 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.841 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.841 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.841 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupsnap_latency": { 2024-09-19T08:54:59.841 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.841 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.841 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.841 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.841 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lssnap_latency": { 2024-09-19T08:54:59.841 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.841 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.841 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.841 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.841 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mkdir_latency": { 2024-09-19T08:54:59.842 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.842 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.842 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.842 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.842 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mknod_latency": { 2024-09-19T08:54:59.842 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.842 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.843 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.843 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.843 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mksnap_latency": { 2024-09-19T08:54:59.843 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.843 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.843 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.843 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.843 INFO:teuthology.orchestra.run.smithi044.stdout: "req_open_latency": { 2024-09-19T08:54:59.843 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.843 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.843 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.843 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.843 INFO:teuthology.orchestra.run.smithi044.stdout: "req_readdir_latency": { 2024-09-19T08:54:59.844 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.844 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.844 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.844 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.844 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rename_latency": { 2024-09-19T08:54:59.844 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.844 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.844 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.844 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.844 INFO:teuthology.orchestra.run.smithi044.stdout: "req_renamesnap_latency": { 2024-09-19T08:54:59.844 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.844 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.844 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.845 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.845 INFO:teuthology.orchestra.run.smithi044.stdout: "req_snapdiff_latency": { 2024-09-19T08:54:59.845 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.845 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.845 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.845 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.845 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmdir_latency": { 2024-09-19T08:54:59.845 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.845 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.845 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.845 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.845 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmsnap_latency": { 2024-09-19T08:54:59.845 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.845 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.846 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.846 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.846 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmxattr_latency": { 2024-09-19T08:54:59.846 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.846 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.846 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.846 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.846 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setattr_latency": { 2024-09-19T08:54:59.846 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.846 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.846 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.846 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.846 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setdirlayout_latency": { 2024-09-19T08:54:59.846 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.847 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.847 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.847 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.847 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setfilelock_latency": { 2024-09-19T08:54:59.847 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.847 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.847 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.847 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.847 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setlayout_latency": { 2024-09-19T08:54:59.847 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.847 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.847 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.847 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.848 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setxattr_latency": { 2024-09-19T08:54:59.848 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.848 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.848 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.848 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.848 INFO:teuthology.orchestra.run.smithi044.stdout: "req_symlink_latency": { 2024-09-19T08:54:59.848 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.848 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.848 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.848 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.848 INFO:teuthology.orchestra.run.smithi044.stdout: "req_unlink_latency": { 2024-09-19T08:54:59.848 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.849 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.849 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.849 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.849 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_revoke_eviction": 0, 2024-09-19T08:54:59.849 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition_throttle": 0, 2024-09-19T08:54:59.849 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getvxattr_latency": { 2024-09-19T08:54:59.849 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.849 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.849 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.849 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:59.849 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.849 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessions": { 2024-09-19T08:54:59.849 INFO:teuthology.orchestra.run.smithi044.stdout: "session_count": 1, 2024-09-19T08:54:59.849 INFO:teuthology.orchestra.run.smithi044.stdout: "session_add": 3, 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi044.stdout: "session_remove": 2, 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_open": 1, 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_stale": 0, 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi044.stdout: "total_load": 2, 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi044.stdout: "average_load": 1, 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi044.stdout: "avg_session_uptime": 603, 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi044.stdout: "mdthresh_evicted": 0 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_items": 0, 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_items": 0, 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:54:59.852 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:54:59.852 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:54:59.852 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:54:59.852 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:54:59.852 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:54:59.852 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:54:59.852 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2024-09-19T08:54:59.852 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:54:59.852 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:54:59.852 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:54:59.852 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2024-09-19T08:54:59.852 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2024-09-19T08:54:59.852 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2024-09-19T08:54:59.853 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:54:59.853 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:54:59.853 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:54:59.853 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:54:59.853 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 245895, 2024-09-19T08:54:59.853 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 75, 2024-09-19T08:54:59.853 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:54:59.853 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 0, 2024-09-19T08:54:59.853 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2024-09-19T08:54:59.853 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2024-09-19T08:54:59.853 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:54:59.853 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2024-09-19T08:54:59.853 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:54:59.854 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2024-09-19T08:54:59.854 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 8288, 2024-09-19T08:54:59.854 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 182, 2024-09-19T08:54:59.854 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:54:59.854 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:54:59.854 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2024-09-19T08:54:59.854 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2024-09-19T08:54:59.854 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 83029, 2024-09-19T08:54:59.854 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 335, 2024-09-19T08:54:59.854 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2024-09-19T08:54:59.854 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2024-09-19T08:54:59.854 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2024-09-19T08:54:59.854 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2024-09-19T08:54:59.854 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.855 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter": { 2024-09-19T08:54:59.855 INFO:teuthology.orchestra.run.smithi044.stdout: "op_active": 0, 2024-09-19T08:54:59.855 INFO:teuthology.orchestra.run.smithi044.stdout: "op_laggy": 0, 2024-09-19T08:54:59.855 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send": 45, 2024-09-19T08:54:59.855 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send_bytes": 12501, 2024-09-19T08:54:59.855 INFO:teuthology.orchestra.run.smithi044.stdout: "op_resend": 33, 2024-09-19T08:54:59.855 INFO:teuthology.orchestra.run.smithi044.stdout: "op_reply": 45, 2024-09-19T08:54:59.855 INFO:teuthology.orchestra.run.smithi044.stdout: "op_latency": { 2024-09-19T08:54:59.855 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 45, 2024-09-19T08:54:59.855 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.227996432, 2024-09-19T08:54:59.855 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.005066587 2024-09-19T08:54:59.855 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.855 INFO:teuthology.orchestra.run.smithi044.stdout: "op_inflight": 0, 2024-09-19T08:54:59.856 INFO:teuthology.orchestra.run.smithi044.stdout: "oplen_avg": { 2024-09-19T08:54:59.856 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 45, 2024-09-19T08:54:59.856 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 69 2024-09-19T08:54:59.856 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.856 INFO:teuthology.orchestra.run.smithi044.stdout: "op": 45, 2024-09-19T08:54:59.856 INFO:teuthology.orchestra.run.smithi044.stdout: "op_r": 0, 2024-09-19T08:54:59.856 INFO:teuthology.orchestra.run.smithi044.stdout: "op_w": 45, 2024-09-19T08:54:59.856 INFO:teuthology.orchestra.run.smithi044.stdout: "op_rmw": 0, 2024-09-19T08:54:59.856 INFO:teuthology.orchestra.run.smithi044.stdout: "op_pg": 0, 2024-09-19T08:54:59.856 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_stat": 0, 2024-09-19T08:54:59.856 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_create": 10, 2024-09-19T08:54:59.856 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_read": 0, 2024-09-19T08:54:59.856 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_write": 6, 2024-09-19T08:54:59.856 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writefull": 8, 2024-09-19T08:54:59.857 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writesame": 0, 2024-09-19T08:54:59.857 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_append": 0, 2024-09-19T08:54:59.857 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_zero": 0, 2024-09-19T08:54:59.857 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_truncate": 0, 2024-09-19T08:54:59.857 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_delete": 6, 2024-09-19T08:54:59.857 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_mapext": 0, 2024-09-19T08:54:59.857 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_sparse_read": 0, 2024-09-19T08:54:59.857 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_clonerange": 0, 2024-09-19T08:54:59.857 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_getxattr": 0, 2024-09-19T08:54:59.857 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_setxattr": 20, 2024-09-19T08:54:59.857 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_cmpxattr": 0, 2024-09-19T08:54:59.857 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_rmxattr": 0, 2024-09-19T08:54:59.857 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_resetxattrs": 0, 2024-09-19T08:54:59.857 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_call": 0, 2024-09-19T08:54:59.858 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_watch": 0, 2024-09-19T08:54:59.858 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_notify": 0, 2024-09-19T08:54:59.858 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T08:54:59.858 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls": 0, 2024-09-19T08:54:59.858 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls_filter": 0, 2024-09-19T08:54:59.858 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_other": 0, 2024-09-19T08:54:59.858 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_active": 0, 2024-09-19T08:54:59.858 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_send": 0, 2024-09-19T08:54:59.858 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_resend": 0, 2024-09-19T08:54:59.858 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_ping": 0, 2024-09-19T08:54:59.858 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_active": 0, 2024-09-19T08:54:59.858 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_send": 0, 2024-09-19T08:54:59.858 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_resend": 0, 2024-09-19T08:54:59.858 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_active": 0, 2024-09-19T08:54:59.859 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_send": 0, 2024-09-19T08:54:59.859 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_resend": 0, 2024-09-19T08:54:59.859 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_active": 0, 2024-09-19T08:54:59.859 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_send": 0, 2024-09-19T08:54:59.859 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_resend": 0, 2024-09-19T08:54:59.859 INFO:teuthology.orchestra.run.smithi044.stdout: "command_active": 0, 2024-09-19T08:54:59.859 INFO:teuthology.orchestra.run.smithi044.stdout: "command_send": 0, 2024-09-19T08:54:59.859 INFO:teuthology.orchestra.run.smithi044.stdout: "command_resend": 0, 2024-09-19T08:54:59.859 INFO:teuthology.orchestra.run.smithi044.stdout: "map_epoch": 91, 2024-09-19T08:54:59.859 INFO:teuthology.orchestra.run.smithi044.stdout: "map_full": 0, 2024-09-19T08:54:59.859 INFO:teuthology.orchestra.run.smithi044.stdout: "map_inc": 11, 2024-09-19T08:54:59.859 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_sessions": 8, 2024-09-19T08:54:59.859 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_open": 8, 2024-09-19T08:54:59.859 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_close": 0, 2024-09-19T08:54:59.860 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_laggy": 0, 2024-09-19T08:54:59.860 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_wr": 17, 2024-09-19T08:54:59.860 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_rd": 0, 2024-09-19T08:54:59.860 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_del": 2 2024-09-19T08:54:59.860 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.860 INFO:teuthology.orchestra.run.smithi044.stdout: "oft": { 2024-09-19T08:54:59.860 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_objs": 1, 2024-09-19T08:54:59.860 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_kv_pairs": 0, 2024-09-19T08:54:59.860 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_updates": 0, 2024-09-19T08:54:59.860 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_removes": 0 2024-09-19T08:54:59.860 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.860 INFO:teuthology.orchestra.run.smithi044.stdout: "osd-slow-ops": { 2024-09-19T08:54:59.860 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_ops_count": 14 2024-09-19T08:54:59.860 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.861 INFO:teuthology.orchestra.run.smithi044.stdout: "purge_queue": { 2024-09-19T08:54:59.861 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops": 0, 2024-09-19T08:54:59.861 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T08:54:59.861 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing": 0, 2024-09-19T08:54:59.861 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_high_water": 0, 2024-09-19T08:54:59.861 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed_ops": 0, 2024-09-19T08:54:59.861 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed": 0, 2024-09-19T08:54:59.861 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_item_in_journal": 0 2024-09-19T08:54:59.861 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.861 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:54:59.861 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-19T08:54:59.861 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-19T08:54:59.861 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-19T08:54:59.862 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 957, 2024-09-19T08:54:59.862 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 1581707, 2024-09-19T08:54:59.862 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-19T08:54:59.862 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 957, 2024-09-19T08:54:59.862 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-19T08:54:59.862 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-19T08:54:59.862 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 957, 2024-09-19T08:54:59.862 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 1581707, 2024-09-19T08:54:59.862 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-19T08:54:59.862 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.862 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.862 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.862 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:59.863 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.863 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_bytes": { 2024-09-19T08:54:59.863 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-19T08:54:59.863 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-19T08:54:59.863 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-19T08:54:59.863 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-19T08:54:59.863 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-19T08:54:59.863 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-19T08:54:59.863 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-19T08:54:59.863 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 45, 2024-09-19T08:54:59.863 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 12501, 2024-09-19T08:54:59.863 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 45, 2024-09-19T08:54:59.863 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 12501, 2024-09-19T08:54:59.863 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-19T08:54:59.863 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.864 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.864 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.864 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:59.864 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.864 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_ops": { 2024-09-19T08:54:59.864 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-19T08:54:59.864 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 1024, 2024-09-19T08:54:59.864 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-19T08:54:59.864 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-19T08:54:59.864 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-19T08:54:59.864 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-19T08:54:59.864 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-19T08:54:59.865 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 45, 2024-09-19T08:54:59.865 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 45, 2024-09-19T08:54:59.865 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 45, 2024-09-19T08:54:59.865 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 45, 2024-09-19T08:54:59.865 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-19T08:54:59.865 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.865 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.865 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.865 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:59.865 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.865 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle": { 2024-09-19T08:54:59.865 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-19T08:54:59.865 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-19T08:54:59.866 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-19T08:54:59.866 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-19T08:54:59.866 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-19T08:54:59.866 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-19T08:54:59.866 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-19T08:54:59.866 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-19T08:54:59.866 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-19T08:54:59.866 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2024-09-19T08:54:59.866 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2024-09-19T08:54:59.866 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-19T08:54:59.866 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.866 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.866 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.867 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:59.867 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:54:59.867 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle-0x556dcf5f6500": { 2024-09-19T08:54:59.867 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-19T08:54:59.867 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-19T08:54:59.867 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-19T08:54:59.867 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 7, 2024-09-19T08:54:59.867 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 1964, 2024-09-19T08:54:59.867 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-19T08:54:59.867 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 7, 2024-09-19T08:54:59.867 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-19T08:54:59.867 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-19T08:54:59.867 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 6, 2024-09-19T08:54:59.868 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 1964, 2024-09-19T08:54:59.868 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-19T08:54:59.868 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:54:59.868 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:54:59.868 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:54:59.868 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:59.868 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:54:59.868 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-19T08:55:00.568 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-19T08:55:00.568 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-19T08:55:00.568 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-19T08:55:00.568 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=18 2024-09-19T08:55:00.568 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-19T08:55:00.568 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-19T08:55:00.569 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T08:55:00.569 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T08:55:00.569 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T08:55:00.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:00 smithi175 ceph-mon[35688]: pgmap v325: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-19T08:55:00.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:00 smithi007 ceph-mon[31221]: pgmap v325: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-19T08:55:00.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:00 smithi044 ceph-mon[35072]: pgmap v325: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-19T08:55:00.818 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:55:01.314 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-19T08:55:01.314 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:55:01.314 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 0, 2024-09-19T08:55:01.314 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 2, 2024-09-19T08:55:01.314 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:55:01.315 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 0, 2024-09-19T08:55:01.315 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 4, 2024-09-19T08:55:01.315 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 0, 2024-09-19T08:55:01.315 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.001022087, 2024-09-19T08:55:01.315 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:55:01.315 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.000226053, 2024-09-19T08:55:01.315 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:55:01.315 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:55:01.315 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:55:01.315 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:55:01.315 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:55:01.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:55:01.315 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:55:01.316 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:55:01.316 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:55:01.316 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:55:01.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:55:01.316 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:55:01.316 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:55:01.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:55:01.316 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:55:01.316 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 218, 2024-09-19T08:55:01.316 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 208, 2024-09-19T08:55:01.316 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 1447344, 2024-09-19T08:55:01.316 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 127904, 2024-09-19T08:55:01.317 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 2, 2024-09-19T08:55:01.317 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 1, 2024-09-19T08:55:01.317 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.043217287, 2024-09-19T08:55:01.317 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.015545101, 2024-09-19T08:55:01.317 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.040137599, 2024-09-19T08:55:01.317 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:55:01.317 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:55:01.317 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 207, 2024-09-19T08:55:01.317 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.011493982, 2024-09-19T08:55:01.317 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000055526 2024-09-19T08:55:01.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:55:01.317 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:55:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:55:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:55:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:55:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:55:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 1447344, 2024-09-19T08:55:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 127904 2024-09-19T08:55:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:55:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:55:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 6, 2024-09-19T08:55:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 161, 2024-09-19T08:55:01.318 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 3344, 2024-09-19T08:55:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 185664, 2024-09-19T08:55:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 5, 2024-09-19T08:55:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 3, 2024-09-19T08:55:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.013315543, 2024-09-19T08:55:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.007631047, 2024-09-19T08:55:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.003575285, 2024-09-19T08:55:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:55:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:55:01.319 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 159, 2024-09-19T08:55:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.023914690, 2024-09-19T08:55:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000150406 2024-09-19T08:55:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:55:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:55:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:55:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:55:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:55:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:55:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-09-19T08:55:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 185664 2024-09-19T08:55:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:55:01.320 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2024-09-19T08:55:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 0, 2024-09-19T08:55:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2024-09-19T08:55:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:55:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2024-09-19T08:55:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:55:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2024-09-19T08:55:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:55:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:55:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:55:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:55:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:55:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:55:01.321 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:55:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:55:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:55:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:55:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:55:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:55:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:55:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_items": 0, 2024-09-19T08:55:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:55:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_items": 0, 2024-09-19T08:55:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:55:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:55:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:55:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:55:01.322 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:55:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:55:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:55:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2024-09-19T08:55:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:55:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:55:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:55:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2024-09-19T08:55:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2024-09-19T08:55:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2024-09-19T08:55:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:55:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:55:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:55:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:55:01.323 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 149007, 2024-09-19T08:55:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 30, 2024-09-19T08:55:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:55:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 0, 2024-09-19T08:55:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2024-09-19T08:55:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2024-09-19T08:55:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:55:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2024-09-19T08:55:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:55:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2024-09-19T08:55:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 0, 2024-09-19T08:55:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 0, 2024-09-19T08:55:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:55:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:55:01.324 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2024-09-19T08:55:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2024-09-19T08:55:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 928, 2024-09-19T08:55:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 2, 2024-09-19T08:55:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2024-09-19T08:55:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2024-09-19T08:55:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2024-09-19T08:55:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2024-09-19T08:55:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-19T08:55:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:55:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-19T08:55:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-19T08:55:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-19T08:55:01.325 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 220, 2024-09-19T08:55:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 1416590, 2024-09-19T08:55:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-19T08:55:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 220, 2024-09-19T08:55:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-19T08:55:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-19T08:55:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 220, 2024-09-19T08:55:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 1416590, 2024-09-19T08:55:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-19T08:55:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-19T08:55:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-19T08:55:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-19T08:55:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:55:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-19T08:55:01.326 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-19T08:55:02.036 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-19T08:55:02.036 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-19T08:55:02.036 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-19T08:55:02.036 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-19T08:55:02.036 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-19T08:55:02.036 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-19T08:55:02.036 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-19T08:55:02.036 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T08:55:02.037 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T08:55:02.295 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:55:02.672 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:02 smithi175 ceph-mon[35688]: pgmap v326: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-19T08:55:02.778 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-19T08:55:02.779 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:55:02.779 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 1554, 2024-09-19T08:55:02.779 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 1556, 2024-09-19T08:55:02.779 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1335587, 2024-09-19T08:55:02.779 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 494182, 2024-09-19T08:55:02.779 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 6, 2024-09-19T08:55:02.779 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 2, 2024-09-19T08:55:02.779 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.146527560, 2024-09-19T08:55:02.779 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.046428503, 2024-09-19T08:55:02.779 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.039504006, 2024-09-19T08:55:02.779 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.046174016, 2024-09-19T08:55:02.780 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:55:02.780 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1554, 2024-09-19T08:55:02.780 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.061888789, 2024-09-19T08:55:02.780 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000039825 2024-09-19T08:55:02.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.780 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:55:02.780 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.780 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.780 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.780 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:55:02.780 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:55:02.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.781 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:55:02.781 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 238, 2024-09-19T08:55:02.781 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 226, 2024-09-19T08:55:02.781 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1477192, 2024-09-19T08:55:02.781 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 130250, 2024-09-19T08:55:02.781 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 4, 2024-09-19T08:55:02.781 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 3, 2024-09-19T08:55:02.781 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.042582000, 2024-09-19T08:55:02.781 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.015175842, 2024-09-19T08:55:02.781 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.041423480, 2024-09-19T08:55:02.781 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000090635, 2024-09-19T08:55:02.781 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:55:02.782 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 225, 2024-09-19T08:55:02.782 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.017421702, 2024-09-19T08:55:02.782 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000077429 2024-09-19T08:55:02.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.782 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:55:02.782 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.782 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.782 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.782 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1475536, 2024-09-19T08:55:02.782 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 128912 2024-09-19T08:55:02.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.782 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:55:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 726, 2024-09-19T08:55:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 879, 2024-09-19T08:55:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 180535, 2024-09-19T08:55:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 667153, 2024-09-19T08:55:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 6, 2024-09-19T08:55:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 4, 2024-09-19T08:55:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.081952445, 2024-09-19T08:55:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.031789373, 2024-09-19T08:55:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.018989310, 2024-09-19T08:55:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.022835406, 2024-09-19T08:55:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:55:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 877, 2024-09-19T08:55:02.783 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.051170201, 2024-09-19T08:55:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000058346 2024-09-19T08:55:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:55:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-09-19T08:55:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 438192 2024-09-19T08:55:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-09-19T08:55:02.784 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-09-19T08:55:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-09-19T08:55:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-09-19T08:55:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-19T08:55:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-19T08:55:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3734, 2024-09-19T08:55:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.101680060, 2024-09-19T08:55:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000027230 2024-09-19T08:55:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:02.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-09-19T08:55:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-19T08:55:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-19T08:55:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-09-19T08:55:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 0, 2024-09-19T08:55:02.786 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 0, 2024-09-19T08:55:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-09-19T08:55:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-09-19T08:55:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 0, 2024-09-19T08:55:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-09-19T08:55:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-09-19T08:55:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 0, 2024-09-19T08:55:02.787 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-09-19T08:55:02.788 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-09-19T08:55:02.788 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 31, 2024-09-19T08:55:02.788 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 0, 2024-09-19T08:55:02.788 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 31, 2024-09-19T08:55:02.788 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 0, 2024-09-19T08:55:02.788 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 31, 2024-09-19T08:55:02.788 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 0, 2024-09-19T08:55:02.788 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 0, 2024-09-19T08:55:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 0, 2024-09-19T08:55:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 2, 2024-09-19T08:55:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 0, 2024-09-19T08:55:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 0, 2024-09-19T08:55:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 0, 2024-09-19T08:55:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 0, 2024-09-19T08:55:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-09-19T08:55:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-09-19T08:55:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-09-19T08:55:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-09-19T08:55:02.789 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-09-19T08:55:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 0, 2024-09-19T08:55:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 0, 2024-09-19T08:55:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 0, 2024-09-19T08:55:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 0, 2024-09-19T08:55:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-09-19T08:55:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 0, 2024-09-19T08:55:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-09-19T08:55:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 4, 2024-09-19T08:55:02.790 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 234, 2024-09-19T08:55:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 6, 2024-09-19T08:55:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T08:55:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-09-19T08:55:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T08:55:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-09-19T08:55:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 0, 2024-09-19T08:55:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T08:55:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T08:55:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 0, 2024-09-19T08:55:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 0, 2024-09-19T08:55:02.791 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T08:55:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 0, 2024-09-19T08:55:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T08:55:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T08:55:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T08:55:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 0, 2024-09-19T08:55:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 0, 2024-09-19T08:55:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 0, 2024-09-19T08:55:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 0 2024-09-19T08:55:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-09-19T08:55:02.792 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-09-19T08:55:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 0, 2024-09-19T08:55:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 0, 2024-09-19T08:55:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 0, 2024-09-19T08:55:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 0, 2024-09-19T08:55:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-09-19T08:55:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-09-19T08:55:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-09-19T08:55:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 0, 2024-09-19T08:55:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 0, 2024-09-19T08:55:02.793 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-09-19T08:55:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-09-19T08:55:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-09-19T08:55:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-09-19T08:55:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-09-19T08:55:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-09-19T08:55:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-09-19T08:55:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-09-19T08:55:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-09-19T08:55:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T08:55:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 0, 2024-09-19T08:55:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-09-19T08:55:02.794 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-09-19T08:55:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-09-19T08:55:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2024-09-19T08:55:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-09-19T08:55:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-09-19T08:55:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 0, 2024-09-19T08:55:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-09-19T08:55:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-09-19T08:55:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 191, 2024-09-19T08:55:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-09-19T08:55:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-09-19T08:55:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 0, 2024-09-19T08:55:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-09-19T08:55:02.795 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-09-19T08:55:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 2, 2024-09-19T08:55:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-09-19T08:55:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-09-19T08:55:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-09-19T08:55:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-09-19T08:55:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 5069818, 2024-09-19T08:55:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 5068497, 2024-09-19T08:55:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-09-19T08:55:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.796 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 191 2024-09-19T08:55:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-09-19T08:55:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 20, 2024-09-19T08:55:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 24, 2024-09-19T08:55:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 4, 2024-09-19T08:55:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 11, 2024-09-19T08:55:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 11, 2024-09-19T08:55:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 0, 2024-09-19T08:55:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 31, 2024-09-19T08:55:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 31, 2024-09-19T08:55:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 0, 2024-09-19T08:55:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 0, 2024-09-19T08:55:02.797 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 0, 2024-09-19T08:55:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 0, 2024-09-19T08:55:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 51184, 2024-09-19T08:55:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 215328 2024-09-19T08:55:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-09-19T08:55:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 0, 2024-09-19T08:55:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 0, 2024-09-19T08:55:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 0, 2024-09-19T08:55:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 0, 2024-09-19T08:55:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 0, 2024-09-19T08:55:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-09-19T08:55:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.798 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.799 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-09-19T08:55:02.799 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.799 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.799 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.799 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-09-19T08:55:02.799 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.799 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.799 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.800 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-09-19T08:55:02.800 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.800 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.800 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.800 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-09-19T08:55:02.800 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.800 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-09-19T08:55:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-09-19T08:55:02.801 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-09-19T08:55:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-09-19T08:55:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.802 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-09-19T08:55:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-09-19T08:55:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-09-19T08:55:02.803 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.804 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:02 smithi044 ceph-mon[35072]: pgmap v326: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-19T08:55:02.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:02 smithi007 ceph-mon[31221]: pgmap v326: 97 pgs: 97 active+clean; 2.1 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-19T08:55:02.805 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.805 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.805 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-09-19T08:55:02.805 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.805 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.805 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.805 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-09-19T08:55:02.805 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.805 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.806 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.806 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-09-19T08:55:02.806 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.806 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.806 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.806 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-09-19T08:55:02.806 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.806 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.806 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.806 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-09-19T08:55:02.807 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.807 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.807 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.807 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-09-19T08:55:02.807 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.807 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.807 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.807 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-09-19T08:55:02.807 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.807 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.807 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.808 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-09-19T08:55:02.808 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.808 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.808 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.808 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-09-19T08:55:02.808 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.808 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.808 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.808 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-09-19T08:55:02.808 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.808 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.809 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.809 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-09-19T08:55:02.809 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.809 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.809 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.809 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-09-19T08:55:02.809 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.809 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.809 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.809 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-09-19T08:55:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-09-19T08:55:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-09-19T08:55:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.810 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-09-19T08:55:02.811 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.811 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.811 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.811 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-09-19T08:55:02.811 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.811 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.811 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.811 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-09-19T08:55:02.811 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-09-19T08:55:02.811 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-09-19T08:55:02.811 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.811 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.812 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.812 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:02.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.812 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-09-19T08:55:02.812 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 2, 2024-09-19T08:55:02.812 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 5, 2024-09-19T08:55:02.812 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 3, 2024-09-19T08:55:02.812 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 4, 2024-09-19T08:55:02.812 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-09-19T08:55:02.812 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 0, 2024-09-19T08:55:02.812 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 0, 2024-09-19T08:55:02.812 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 5508, 2024-09-19T08:55:02.812 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-09-19T08:55:02.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.813 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-09-19T08:55:02.813 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:55:02.813 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-09-19T08:55:02.813 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:55:02.813 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:55:02.813 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:55:02.813 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:55:02.813 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:55:02.813 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:55:02.813 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:55:02.813 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:55:02.813 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:55:02.813 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:55:02.813 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:55:02.814 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:55:02.814 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:55:02.814 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-09-19T08:55:02.814 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:55:02.814 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-09-19T08:55:02.814 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:55:02.814 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:55:02.814 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:55:02.814 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:55:02.814 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:55:02.814 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:55:02.814 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:55:02.814 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-09-19T08:55:02.815 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:55:02.815 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:55:02.815 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:55:02.815 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-09-19T08:55:02.815 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-09-19T08:55:02.815 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-09-19T08:55:02.815 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:55:02.815 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:55:02.815 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:55:02.815 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:55:02.816 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 189820, 2024-09-19T08:55:02.816 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 63, 2024-09-19T08:55:02.816 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:55:02.816 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-09-19T08:55:02.816 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-09-19T08:55:02.816 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-09-19T08:55:02.816 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:55:02.816 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-09-19T08:55:02.816 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:55:02.816 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-09-19T08:55:02.816 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 8288, 2024-09-19T08:55:02.816 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 182, 2024-09-19T08:55:02.816 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:55:02.817 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:55:02.817 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-09-19T08:55:02.817 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-09-19T08:55:02.817 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 96062, 2024-09-19T08:55:02.817 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 775, 2024-09-19T08:55:02.817 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-09-19T08:55:02.817 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-09-19T08:55:02.817 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-09-19T08:55:02.817 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-09-19T08:55:02.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.818 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-09-19T08:55:02.818 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-09-19T08:55:02.818 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-09-19T08:55:02.818 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 2278, 2024-09-19T08:55:02.818 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 26, 2024-09-19T08:55:02.818 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 4, 2024-09-19T08:55:02.818 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 2278, 2024-09-19T08:55:02.818 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-09-19T08:55:02.818 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2278, 2024-09-19T08:55:02.818 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.022984577, 2024-09-19T08:55:02.818 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000449071 2024-09-19T08:55:02.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.818 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-09-19T08:55:02.818 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-09-19T08:55:02.819 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2278, 2024-09-19T08:55:02.819 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 2279 2024-09-19T08:55:02.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.819 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 2278, 2024-09-19T08:55:02.819 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 2278, 2024-09-19T08:55:02.819 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 0, 2024-09-19T08:55:02.819 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-09-19T08:55:02.819 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-09-19T08:55:02.819 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 1447, 2024-09-19T08:55:02.819 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 0, 2024-09-19T08:55:02.819 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 828, 2024-09-19T08:55:02.819 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 0, 2024-09-19T08:55:02.819 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 0, 2024-09-19T08:55:02.820 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-09-19T08:55:02.820 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-09-19T08:55:02.820 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-09-19T08:55:02.820 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-09-19T08:55:02.820 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 0, 2024-09-19T08:55:02.820 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-09-19T08:55:02.820 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-09-19T08:55:02.820 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-09-19T08:55:02.820 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 2, 2024-09-19T08:55:02.820 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 0, 2024-09-19T08:55:02.820 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-09-19T08:55:02.820 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-09-19T08:55:02.820 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-09-19T08:55:02.820 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-09-19T08:55:02.821 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-09-19T08:55:02.821 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-09-19T08:55:02.821 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T08:55:02.821 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-09-19T08:55:02.821 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-09-19T08:55:02.821 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-09-19T08:55:02.821 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-09-19T08:55:02.821 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-09-19T08:55:02.821 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-09-19T08:55:02.821 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-09-19T08:55:02.821 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-09-19T08:55:02.821 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-09-19T08:55:02.821 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-09-19T08:55:02.821 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-09-19T08:55:02.822 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-09-19T08:55:02.822 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-09-19T08:55:02.822 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-09-19T08:55:02.822 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-09-19T08:55:02.822 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-09-19T08:55:02.822 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-09-19T08:55:02.822 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-09-19T08:55:02.822 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-09-19T08:55:02.822 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 91, 2024-09-19T08:55:02.822 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-09-19T08:55:02.822 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 11, 2024-09-19T08:55:02.822 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 5, 2024-09-19T08:55:02.822 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 5, 2024-09-19T08:55:02.822 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-09-19T08:55:02.823 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-09-19T08:55:02.823 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 0, 2024-09-19T08:55:02.823 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 2, 2024-09-19T08:55:02.823 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 0 2024-09-19T08:55:02.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.823 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-09-19T08:55:02.823 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 0, 2024-09-19T08:55:02.823 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-09-19T08:55:02.823 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-09-19T08:55:02.823 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-09-19T08:55:02.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.823 INFO:teuthology.orchestra.run.smithi175.stdout: "osd-slow-ops": { 2024-09-19T08:55:02.823 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 0 2024-09-19T08:55:02.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.824 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-09-19T08:55:02.824 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-09-19T08:55:02.824 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T08:55:02.824 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-09-19T08:55:02.824 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 0, 2024-09-19T08:55:02.824 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 0, 2024-09-19T08:55:02.824 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 0, 2024-09-19T08:55:02.824 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-09-19T08:55:02.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.824 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:55:02.824 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-19T08:55:02.824 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-19T08:55:02.824 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-19T08:55:02.825 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 2514, 2024-09-19T08:55:02.825 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 2752018, 2024-09-19T08:55:02.825 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-19T08:55:02.825 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 2514, 2024-09-19T08:55:02.825 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-19T08:55:02.825 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-19T08:55:02.825 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 2514, 2024-09-19T08:55:02.825 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 2752018, 2024-09-19T08:55:02.825 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-19T08:55:02.825 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.825 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.825 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.825 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:02.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.826 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-09-19T08:55:02.826 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-19T08:55:02.826 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-19T08:55:02.826 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-19T08:55:02.826 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-19T08:55:02.826 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-19T08:55:02.826 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-19T08:55:02.826 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-19T08:55:02.826 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 2278, 2024-09-19T08:55:02.826 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 875524, 2024-09-19T08:55:02.826 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 2278, 2024-09-19T08:55:02.826 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 875524, 2024-09-19T08:55:02.827 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-19T08:55:02.827 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.827 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.827 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.827 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:02.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.827 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-09-19T08:55:02.827 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-19T08:55:02.827 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-09-19T08:55:02.827 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-19T08:55:02.827 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-19T08:55:02.827 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-19T08:55:02.827 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-19T08:55:02.828 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-19T08:55:02.828 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 2278, 2024-09-19T08:55:02.828 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 2278, 2024-09-19T08:55:02.828 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 2278, 2024-09-19T08:55:02.828 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 2278, 2024-09-19T08:55:02.828 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-19T08:55:02.828 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.828 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.828 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.828 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:02.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.828 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-09-19T08:55:02.828 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-19T08:55:02.828 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-19T08:55:02.829 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-19T08:55:02.829 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-19T08:55:02.829 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-19T08:55:02.829 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-19T08:55:02.829 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-19T08:55:02.829 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-19T08:55:02.829 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-19T08:55:02.829 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-09-19T08:55:02.829 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-09-19T08:55:02.829 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-19T08:55:02.829 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.829 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.829 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.830 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:02.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:02.830 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x560ffdf646e0": { 2024-09-19T08:55:02.830 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-19T08:55:02.830 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-19T08:55:02.830 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-19T08:55:02.830 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-19T08:55:02.830 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-19T08:55:02.830 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-19T08:55:02.830 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-19T08:55:02.830 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-19T08:55:02.830 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-19T08:55:02.830 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-09-19T08:55:02.830 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-09-19T08:55:02.830 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-19T08:55:02.831 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:02.831 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:02.831 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:02.831 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:02.831 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:02.831 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-19T08:55:03.632 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-19T08:55:03.632 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-19T08:55:03.632 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-19T08:55:03.632 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-09-19T08:55:03.632 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-19T08:55:03.633 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-19T08:55:03.633 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T08:55:03.633 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T08:55:03.633 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T08:55:03.882 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:55:04.372 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-19T08:55:04.372 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:55:04.372 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 2103, 2024-09-19T08:55:04.372 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 2105, 2024-09-19T08:55:04.372 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 597839, 2024-09-19T08:55:04.372 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 668761, 2024-09-19T08:55:04.372 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 6, 2024-09-19T08:55:04.372 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 2, 2024-09-19T08:55:04.373 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.188082718, 2024-09-19T08:55:04.373 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.063047858, 2024-09-19T08:55:04.373 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.047117935, 2024-09-19T08:55:04.373 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.063134777, 2024-09-19T08:55:04.373 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:55:04.373 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2103, 2024-09-19T08:55:04.373 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.083811189, 2024-09-19T08:55:04.373 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000039853 2024-09-19T08:55:04.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.373 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:55:04.373 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.373 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.374 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.374 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:55:04.374 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:55:04.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.374 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:55:04.374 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 8, 2024-09-19T08:55:04.374 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 162, 2024-09-19T08:55:04.374 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 3900, 2024-09-19T08:55:04.374 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 439066, 2024-09-19T08:55:04.374 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 6, 2024-09-19T08:55:04.374 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 4, 2024-09-19T08:55:04.374 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.012090138, 2024-09-19T08:55:04.375 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.006627797, 2024-09-19T08:55:04.375 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.003480692, 2024-09-19T08:55:04.375 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000079058, 2024-09-19T08:55:04.375 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:55:04.375 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 160, 2024-09-19T08:55:04.375 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.018338741, 2024-09-19T08:55:04.375 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000114617 2024-09-19T08:55:04.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.375 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:55:04.375 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.375 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.375 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.376 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-09-19T08:55:04.376 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 438368 2024-09-19T08:55:04.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.376 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:55:04.376 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 235, 2024-09-19T08:55:04.376 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 223, 2024-09-19T08:55:04.376 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1475916, 2024-09-19T08:55:04.376 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 129710, 2024-09-19T08:55:04.376 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 3, 2024-09-19T08:55:04.376 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 2, 2024-09-19T08:55:04.376 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.042496334, 2024-09-19T08:55:04.376 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.014705476, 2024-09-19T08:55:04.376 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.041575833, 2024-09-19T08:55:04.377 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000031288, 2024-09-19T08:55:04.377 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:55:04.377 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 222, 2024-09-19T08:55:04.377 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.013879372, 2024-09-19T08:55:04.377 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000062519 2024-09-19T08:55:04.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.377 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:55:04.377 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.377 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.377 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.377 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1475648, 2024-09-19T08:55:04.377 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 129392 2024-09-19T08:55:04.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.378 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-09-19T08:55:04.378 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-09-19T08:55:04.378 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-09-19T08:55:04.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.378 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-09-19T08:55:04.378 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-19T08:55:04.378 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-19T08:55:04.378 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3570, 2024-09-19T08:55:04.378 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.099783703, 2024-09-19T08:55:04.378 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000027950 2024-09-19T08:55:04.378 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:04.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.378 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-09-19T08:55:04.379 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-19T08:55:04.379 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-19T08:55:04.379 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.379 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.379 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.379 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:04.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.379 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-09-19T08:55:04.379 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 0, 2024-09-19T08:55:04.379 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 0, 2024-09-19T08:55:04.379 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-09-19T08:55:04.379 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.379 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.380 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.380 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-09-19T08:55:04.380 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 0, 2024-09-19T08:55:04.380 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-09-19T08:55:04.380 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-09-19T08:55:04.380 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 0, 2024-09-19T08:55:04.380 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-09-19T08:55:04.380 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-09-19T08:55:04.380 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 0, 2024-09-19T08:55:04.380 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 0, 2024-09-19T08:55:04.380 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 0, 2024-09-19T08:55:04.381 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 0, 2024-09-19T08:55:04.381 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 0, 2024-09-19T08:55:04.381 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 0, 2024-09-19T08:55:04.381 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 0, 2024-09-19T08:55:04.381 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 0, 2024-09-19T08:55:04.381 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 1, 2024-09-19T08:55:04.381 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 0, 2024-09-19T08:55:04.381 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 0, 2024-09-19T08:55:04.381 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 0, 2024-09-19T08:55:04.381 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 0, 2024-09-19T08:55:04.381 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-09-19T08:55:04.381 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-09-19T08:55:04.381 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-09-19T08:55:04.381 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-09-19T08:55:04.382 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-09-19T08:55:04.382 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 0, 2024-09-19T08:55:04.382 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 0, 2024-09-19T08:55:04.382 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 0, 2024-09-19T08:55:04.382 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 0, 2024-09-19T08:55:04.382 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-09-19T08:55:04.382 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 0, 2024-09-19T08:55:04.382 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-09-19T08:55:04.382 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 0, 2024-09-19T08:55:04.382 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 0, 2024-09-19T08:55:04.382 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 0, 2024-09-19T08:55:04.382 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T08:55:04.382 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-09-19T08:55:04.383 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T08:55:04.383 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-09-19T08:55:04.383 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 0, 2024-09-19T08:55:04.383 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T08:55:04.383 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T08:55:04.383 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 0, 2024-09-19T08:55:04.383 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 0, 2024-09-19T08:55:04.383 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T08:55:04.383 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 0, 2024-09-19T08:55:04.383 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T08:55:04.383 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T08:55:04.383 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T08:55:04.383 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 0, 2024-09-19T08:55:04.384 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 0, 2024-09-19T08:55:04.384 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 0, 2024-09-19T08:55:04.384 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 0 2024-09-19T08:55:04.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.384 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-09-19T08:55:04.384 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-09-19T08:55:04.384 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 0, 2024-09-19T08:55:04.384 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 0, 2024-09-19T08:55:04.384 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 0, 2024-09-19T08:55:04.384 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 0, 2024-09-19T08:55:04.384 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-09-19T08:55:04.384 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-09-19T08:55:04.384 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-09-19T08:55:04.385 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 0, 2024-09-19T08:55:04.385 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 0, 2024-09-19T08:55:04.385 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-09-19T08:55:04.385 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-09-19T08:55:04.385 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-09-19T08:55:04.385 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-09-19T08:55:04.385 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-09-19T08:55:04.385 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-09-19T08:55:04.385 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-09-19T08:55:04.385 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-09-19T08:55:04.385 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-09-19T08:55:04.385 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T08:55:04.385 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 0, 2024-09-19T08:55:04.385 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-09-19T08:55:04.386 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-09-19T08:55:04.386 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-09-19T08:55:04.386 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2024-09-19T08:55:04.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.386 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-09-19T08:55:04.386 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-09-19T08:55:04.386 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 0, 2024-09-19T08:55:04.387 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-09-19T08:55:04.387 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-09-19T08:55:04.388 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 9, 2024-09-19T08:55:04.388 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-09-19T08:55:04.388 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-09-19T08:55:04.388 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 0, 2024-09-19T08:55:04.388 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-09-19T08:55:04.388 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-09-19T08:55:04.388 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 2, 2024-09-19T08:55:04.388 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-09-19T08:55:04.388 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-09-19T08:55:04.388 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-09-19T08:55:04.388 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-09-19T08:55:04.388 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 4196802, 2024-09-19T08:55:04.388 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 4196661, 2024-09-19T08:55:04.389 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-09-19T08:55:04.389 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.389 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.389 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.389 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 9 2024-09-19T08:55:04.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.389 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-09-19T08:55:04.389 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 3, 2024-09-19T08:55:04.389 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 3, 2024-09-19T08:55:04.389 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 0, 2024-09-19T08:55:04.389 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 1, 2024-09-19T08:55:04.389 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 1, 2024-09-19T08:55:04.390 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 0, 2024-09-19T08:55:04.390 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 0, 2024-09-19T08:55:04.390 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 0, 2024-09-19T08:55:04.390 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 0, 2024-09-19T08:55:04.390 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 0, 2024-09-19T08:55:04.390 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 0, 2024-09-19T08:55:04.390 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 0, 2024-09-19T08:55:04.390 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 48856, 2024-09-19T08:55:04.390 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 215328 2024-09-19T08:55:04.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.390 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-09-19T08:55:04.390 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 0, 2024-09-19T08:55:04.390 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 0, 2024-09-19T08:55:04.390 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 0, 2024-09-19T08:55:04.391 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 0, 2024-09-19T08:55:04.391 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 0, 2024-09-19T08:55:04.391 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-09-19T08:55:04.391 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.391 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.391 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.391 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-09-19T08:55:04.391 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.391 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.391 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.391 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-09-19T08:55:04.392 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.392 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.392 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.392 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-09-19T08:55:04.392 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.392 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.392 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.392 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-09-19T08:55:04.392 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.392 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.392 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.393 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-09-19T08:55:04.393 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.393 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.393 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.393 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-09-19T08:55:04.393 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.393 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.393 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.393 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-09-19T08:55:04.393 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.393 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.394 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.394 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-09-19T08:55:04.394 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.394 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.394 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.394 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-09-19T08:55:04.394 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.394 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.394 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.394 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-09-19T08:55:04.394 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.395 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.395 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.395 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-09-19T08:55:04.395 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.395 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.396 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.396 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-09-19T08:55:04.396 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.396 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.396 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.397 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-09-19T08:55:04.397 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.397 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.397 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.397 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-09-19T08:55:04.397 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.397 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.397 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.397 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-09-19T08:55:04.397 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.397 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.398 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.398 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-09-19T08:55:04.398 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.398 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.398 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.398 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-09-19T08:55:04.398 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.398 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.398 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.398 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-09-19T08:55:04.399 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.399 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.399 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.399 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-09-19T08:55:04.399 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.399 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.399 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.399 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-09-19T08:55:04.399 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.399 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.399 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.400 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-09-19T08:55:04.400 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.400 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.400 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.400 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-09-19T08:55:04.400 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.400 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.400 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.400 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-09-19T08:55:04.400 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.401 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.401 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.401 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-09-19T08:55:04.401 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.401 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.401 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.401 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-09-19T08:55:04.401 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.401 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.401 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.402 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-09-19T08:55:04.402 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.402 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.402 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.402 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-09-19T08:55:04.402 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.402 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.402 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.402 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-09-19T08:55:04.402 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.402 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.403 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.403 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-09-19T08:55:04.403 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-09-19T08:55:04.403 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-09-19T08:55:04.403 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.403 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.403 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.403 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:04.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.403 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-09-19T08:55:04.403 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 1, 2024-09-19T08:55:04.403 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 4, 2024-09-19T08:55:04.404 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 3, 2024-09-19T08:55:04.404 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 3, 2024-09-19T08:55:04.404 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-09-19T08:55:04.404 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 0, 2024-09-19T08:55:04.404 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 0, 2024-09-19T08:55:04.404 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 7951, 2024-09-19T08:55:04.404 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-09-19T08:55:04.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.404 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-09-19T08:55:04.404 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:55:04.404 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-09-19T08:55:04.404 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:55:04.405 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:55:04.405 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:55:04.405 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:55:04.405 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:55:04.405 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:55:04.405 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:55:04.405 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:55:04.405 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:55:04.405 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:55:04.405 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:55:04.405 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:55:04.405 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:55:04.406 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-09-19T08:55:04.406 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:55:04.406 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-09-19T08:55:04.406 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:55:04.406 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:55:04.406 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:55:04.406 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:55:04.406 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:55:04.406 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:55:04.406 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:55:04.406 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-09-19T08:55:04.406 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:55:04.406 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:55:04.407 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:55:04.407 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-09-19T08:55:04.407 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-09-19T08:55:04.407 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-09-19T08:55:04.407 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:55:04.407 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:55:04.407 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:55:04.407 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:55:04.407 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 181303, 2024-09-19T08:55:04.407 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 46, 2024-09-19T08:55:04.407 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:55:04.407 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-09-19T08:55:04.407 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-09-19T08:55:04.408 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-09-19T08:55:04.408 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:55:04.408 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-09-19T08:55:04.408 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:55:04.408 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-09-19T08:55:04.408 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 8288, 2024-09-19T08:55:04.408 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 182, 2024-09-19T08:55:04.408 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:55:04.408 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:55:04.408 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-09-19T08:55:04.408 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-09-19T08:55:04.408 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 8512, 2024-09-19T08:55:04.408 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 13, 2024-09-19T08:55:04.409 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-09-19T08:55:04.409 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-09-19T08:55:04.409 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-09-19T08:55:04.409 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-09-19T08:55:04.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.409 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-09-19T08:55:04.409 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-09-19T08:55:04.409 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-09-19T08:55:04.409 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 2106, 2024-09-19T08:55:04.409 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 21, 2024-09-19T08:55:04.409 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 3, 2024-09-19T08:55:04.409 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 2106, 2024-09-19T08:55:04.409 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-09-19T08:55:04.410 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2106, 2024-09-19T08:55:04.410 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.090983541, 2024-09-19T08:55:04.410 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000518035 2024-09-19T08:55:04.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.410 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-09-19T08:55:04.410 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-09-19T08:55:04.410 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2106, 2024-09-19T08:55:04.410 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 2107 2024-09-19T08:55:04.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.410 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 2106, 2024-09-19T08:55:04.410 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 2106, 2024-09-19T08:55:04.410 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 0, 2024-09-19T08:55:04.410 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-09-19T08:55:04.411 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-09-19T08:55:04.411 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 1365, 2024-09-19T08:55:04.411 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 0, 2024-09-19T08:55:04.411 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 739, 2024-09-19T08:55:04.411 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 0, 2024-09-19T08:55:04.411 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 0, 2024-09-19T08:55:04.411 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-09-19T08:55:04.411 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-09-19T08:55:04.411 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-09-19T08:55:04.411 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-09-19T08:55:04.411 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 0, 2024-09-19T08:55:04.411 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-09-19T08:55:04.411 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-09-19T08:55:04.411 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-09-19T08:55:04.412 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 1, 2024-09-19T08:55:04.412 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 0, 2024-09-19T08:55:04.412 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-09-19T08:55:04.412 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-09-19T08:55:04.412 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-09-19T08:55:04.412 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-09-19T08:55:04.412 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-09-19T08:55:04.412 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-09-19T08:55:04.412 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T08:55:04.412 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-09-19T08:55:04.412 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-09-19T08:55:04.412 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-09-19T08:55:04.412 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-09-19T08:55:04.413 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-09-19T08:55:04.413 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-09-19T08:55:04.413 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-09-19T08:55:04.413 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-09-19T08:55:04.413 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-09-19T08:55:04.413 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-09-19T08:55:04.413 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-09-19T08:55:04.413 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-09-19T08:55:04.413 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-09-19T08:55:04.413 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-09-19T08:55:04.413 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-09-19T08:55:04.413 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-09-19T08:55:04.413 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-09-19T08:55:04.414 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-09-19T08:55:04.414 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-09-19T08:55:04.414 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 91, 2024-09-19T08:55:04.414 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-09-19T08:55:04.414 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 11, 2024-09-19T08:55:04.414 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 4, 2024-09-19T08:55:04.414 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 4, 2024-09-19T08:55:04.414 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-09-19T08:55:04.414 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-09-19T08:55:04.414 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 0, 2024-09-19T08:55:04.414 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 2, 2024-09-19T08:55:04.414 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 0 2024-09-19T08:55:04.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.415 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-09-19T08:55:04.415 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 0, 2024-09-19T08:55:04.415 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-09-19T08:55:04.415 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-09-19T08:55:04.415 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-09-19T08:55:04.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.415 INFO:teuthology.orchestra.run.smithi175.stdout: "osd-slow-ops": { 2024-09-19T08:55:04.415 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 0 2024-09-19T08:55:04.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.415 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-09-19T08:55:04.415 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-09-19T08:55:04.415 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T08:55:04.415 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-09-19T08:55:04.415 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 0, 2024-09-19T08:55:04.416 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 0, 2024-09-19T08:55:04.416 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 0, 2024-09-19T08:55:04.416 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-09-19T08:55:04.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.416 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:55:04.416 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-19T08:55:04.416 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-19T08:55:04.416 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-19T08:55:04.416 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 2342, 2024-09-19T08:55:04.416 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 1851833, 2024-09-19T08:55:04.416 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-19T08:55:04.416 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 2342, 2024-09-19T08:55:04.416 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-19T08:55:04.417 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-19T08:55:04.417 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 2342, 2024-09-19T08:55:04.417 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 1851833, 2024-09-19T08:55:04.417 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-19T08:55:04.417 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.417 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.417 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.417 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:04.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.417 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-09-19T08:55:04.417 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-19T08:55:04.417 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-19T08:55:04.417 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-19T08:55:04.417 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-19T08:55:04.418 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-19T08:55:04.418 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-19T08:55:04.418 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-19T08:55:04.418 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 2106, 2024-09-19T08:55:04.418 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 2503, 2024-09-19T08:55:04.418 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 2106, 2024-09-19T08:55:04.418 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 2503, 2024-09-19T08:55:04.418 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-19T08:55:04.418 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.418 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.418 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.418 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:04.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.419 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-09-19T08:55:04.419 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-19T08:55:04.419 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-09-19T08:55:04.419 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-19T08:55:04.419 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-19T08:55:04.419 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-19T08:55:04.419 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-19T08:55:04.419 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-19T08:55:04.419 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 2106, 2024-09-19T08:55:04.420 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 2106, 2024-09-19T08:55:04.420 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 2106, 2024-09-19T08:55:04.420 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 2106, 2024-09-19T08:55:04.420 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-19T08:55:04.420 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.420 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.420 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.420 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:04.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.420 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-09-19T08:55:04.420 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-19T08:55:04.420 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-19T08:55:04.420 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-19T08:55:04.421 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-19T08:55:04.421 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-19T08:55:04.421 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-19T08:55:04.421 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-19T08:55:04.421 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-19T08:55:04.421 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-19T08:55:04.421 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-09-19T08:55:04.421 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-09-19T08:55:04.421 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-19T08:55:04.421 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.421 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.421 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.421 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:04.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:04.422 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x5566f76e46e0": { 2024-09-19T08:55:04.422 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-19T08:55:04.422 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-19T08:55:04.422 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-19T08:55:04.422 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-19T08:55:04.422 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-19T08:55:04.422 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-19T08:55:04.422 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-19T08:55:04.422 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-19T08:55:04.422 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-19T08:55:04.422 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-09-19T08:55:04.422 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-09-19T08:55:04.423 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-19T08:55:04.423 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:04.423 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:04.423 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:04.423 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:04.423 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:04.423 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-19T08:55:04.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:04 smithi007 ceph-mon[31221]: pgmap v327: 97 pgs: 97 active+clean; 2.1 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:55:04.550 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:04 smithi044 ceph-mon[35072]: pgmap v327: 97 pgs: 97 active+clean; 2.1 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:55:04.661 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:04 smithi175 ceph-mon[35688]: pgmap v327: 97 pgs: 97 active+clean; 2.1 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:55:05.060 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-19T08:55:05.061 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-19T08:55:05.061 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-19T08:55:05.061 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-19T08:55:05.061 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-09-19T08:55:05.061 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-19T08:55:05.061 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T08:55:05.061 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T08:55:05.061 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T08:55:05.307 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:55:05.819 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-19T08:55:05.819 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:55:05.819 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 45, 2024-09-19T08:55:05.819 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 176, 2024-09-19T08:55:05.819 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 13987, 2024-09-19T08:55:05.819 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 335357, 2024-09-19T08:55:05.819 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 11, 2024-09-19T08:55:05.819 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 2, 2024-09-19T08:55:05.820 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.018648773, 2024-09-19T08:55:05.820 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.006327370, 2024-09-19T08:55:05.820 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.005424166, 2024-09-19T08:55:05.820 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000822218, 2024-09-19T08:55:05.820 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:55:05.820 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 175, 2024-09-19T08:55:05.820 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.028837998, 2024-09-19T08:55:05.820 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000164788 2024-09-19T08:55:05.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.820 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:55:05.820 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 31, 2024-09-19T08:55:05.820 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000004674, 2024-09-19T08:55:05.821 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000150 2024-09-19T08:55:05.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.821 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 7248, 2024-09-19T08:55:05.821 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 321792 2024-09-19T08:55:05.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.821 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:55:05.821 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 600, 2024-09-19T08:55:05.821 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 698, 2024-09-19T08:55:05.821 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 169432, 2024-09-19T08:55:05.821 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 914431, 2024-09-19T08:55:05.821 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 54, 2024-09-19T08:55:05.821 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 4, 2024-09-19T08:55:05.821 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.082793589, 2024-09-19T08:55:05.822 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.027475027, 2024-09-19T08:55:05.822 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.048859234, 2024-09-19T08:55:05.822 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.005617035, 2024-09-19T08:55:05.822 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:55:05.822 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 695, 2024-09-19T08:55:05.822 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.041039043, 2024-09-19T08:55:05.822 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000059048 2024-09-19T08:55:05.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.822 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:55:05.822 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1190, 2024-09-19T08:55:05.822 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000305072, 2024-09-19T08:55:05.822 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000256 2024-09-19T08:55:05.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.823 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1088, 2024-09-19T08:55:05.823 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 122864 2024-09-19T08:55:05.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.823 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:55:05.823 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 335, 2024-09-19T08:55:05.823 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 335, 2024-09-19T08:55:05.823 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1511595, 2024-09-19T08:55:05.823 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 214723, 2024-09-19T08:55:05.823 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 11, 2024-09-19T08:55:05.823 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 6, 2024-09-19T08:55:05.823 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.057988047, 2024-09-19T08:55:05.823 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.019193139, 2024-09-19T08:55:05.823 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.051694998, 2024-09-19T08:55:05.824 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000299992, 2024-09-19T08:55:05.824 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:55:05.824 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 334, 2024-09-19T08:55:05.824 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.025504033, 2024-09-19T08:55:05.824 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000076359 2024-09-19T08:55:05.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.824 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:55:05.824 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 135, 2024-09-19T08:55:05.824 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000029876, 2024-09-19T08:55:05.824 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000221 2024-09-19T08:55:05.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.824 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1488544, 2024-09-19T08:55:05.824 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 132752 2024-09-19T08:55:05.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.825 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-09-19T08:55:05.825 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-09-19T08:55:05.825 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-09-19T08:55:05.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.825 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-09-19T08:55:05.825 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-19T08:55:05.825 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-19T08:55:05.825 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 52, 2024-09-19T08:55:05.825 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.002299666, 2024-09-19T08:55:05.825 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000044224 2024-09-19T08:55:05.825 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:05.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.826 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-09-19T08:55:05.826 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-09-19T08:55:05.826 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-09-19T08:55:05.826 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2, 2024-09-19T08:55:05.826 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000006063, 2024-09-19T08:55:05.826 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000003031 2024-09-19T08:55:05.826 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:05.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.826 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-09-19T08:55:05.826 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 6, 2024-09-19T08:55:05.826 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 3, 2024-09-19T08:55:05.826 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-09-19T08:55:05.826 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3, 2024-09-19T08:55:05.827 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.001464672, 2024-09-19T08:55:05.827 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000488224 2024-09-19T08:55:05.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.827 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-09-19T08:55:05.827 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 3, 2024-09-19T08:55:05.827 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-09-19T08:55:05.827 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-09-19T08:55:05.827 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 11, 2024-09-19T08:55:05.827 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-09-19T08:55:05.827 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-09-19T08:55:05.827 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 16, 2024-09-19T08:55:05.827 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 0, 2024-09-19T08:55:05.827 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 16, 2024-09-19T08:55:05.827 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 0, 2024-09-19T08:55:05.827 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 13, 2024-09-19T08:55:05.828 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 4, 2024-09-19T08:55:05.828 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 0, 2024-09-19T08:55:05.828 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 0, 2024-09-19T08:55:05.828 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 3, 2024-09-19T08:55:05.828 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 28, 2024-09-19T08:55:05.828 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 17, 2024-09-19T08:55:05.828 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 2, 2024-09-19T08:55:05.828 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 8, 2024-09-19T08:55:05.828 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-09-19T08:55:05.828 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-09-19T08:55:05.828 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-09-19T08:55:05.828 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 1000, 2024-09-19T08:55:05.828 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 1, 2024-09-19T08:55:05.829 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 0, 2024-09-19T08:55:05.829 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 0, 2024-09-19T08:55:05.829 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 0, 2024-09-19T08:55:05.829 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 0, 2024-09-19T08:55:05.829 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-09-19T08:55:05.829 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 0, 2024-09-19T08:55:05.829 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-09-19T08:55:05.829 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 4, 2024-09-19T08:55:05.829 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 234, 2024-09-19T08:55:05.829 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 6, 2024-09-19T08:55:05.829 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T08:55:05.829 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-09-19T08:55:05.829 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T08:55:05.830 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-09-19T08:55:05.830 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 0, 2024-09-19T08:55:05.830 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T08:55:05.830 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T08:55:05.830 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 0, 2024-09-19T08:55:05.830 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 0, 2024-09-19T08:55:05.830 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 2, 2024-09-19T08:55:05.830 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 0, 2024-09-19T08:55:05.830 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T08:55:05.830 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T08:55:05.830 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T08:55:05.830 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 2, 2024-09-19T08:55:05.830 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 0, 2024-09-19T08:55:05.831 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 0, 2024-09-19T08:55:05.831 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 1 2024-09-19T08:55:05.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.831 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-09-19T08:55:05.831 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-09-19T08:55:05.831 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 17, 2024-09-19T08:55:05.831 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 12, 2024-09-19T08:55:05.831 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 12, 2024-09-19T08:55:05.831 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 0, 2024-09-19T08:55:05.831 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-09-19T08:55:05.831 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-09-19T08:55:05.831 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-09-19T08:55:05.831 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 0, 2024-09-19T08:55:05.831 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 0, 2024-09-19T08:55:05.832 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-09-19T08:55:05.832 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-09-19T08:55:05.832 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-09-19T08:55:05.832 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-09-19T08:55:05.832 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-09-19T08:55:05.832 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-09-19T08:55:05.832 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-09-19T08:55:05.832 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 3, 2024-09-19T08:55:05.832 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 17, 2024-09-19T08:55:05.832 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T08:55:05.832 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 0, 2024-09-19T08:55:05.832 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-09-19T08:55:05.832 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-09-19T08:55:05.833 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-09-19T08:55:05.833 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2024-09-19T08:55:05.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.833 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-09-19T08:55:05.833 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-09-19T08:55:05.833 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 9, 2024-09-19T08:55:05.833 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-09-19T08:55:05.833 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-09-19T08:55:05.833 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 9, 2024-09-19T08:55:05.833 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-09-19T08:55:05.833 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-09-19T08:55:05.833 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 2, 2024-09-19T08:55:05.833 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-09-19T08:55:05.834 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-09-19T08:55:05.834 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 2, 2024-09-19T08:55:05.834 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-09-19T08:55:05.834 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-09-19T08:55:05.834 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-09-19T08:55:05.834 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-09-19T08:55:05.834 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 4196802, 2024-09-19T08:55:05.834 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 0, 2024-09-19T08:55:05.834 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-09-19T08:55:05.834 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 8, 2024-09-19T08:55:05.834 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.025323587, 2024-09-19T08:55:05.834 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.003165448 2024-09-19T08:55:05.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.834 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 0 2024-09-19T08:55:05.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.835 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-09-19T08:55:05.835 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 20, 2024-09-19T08:55:05.835 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 22, 2024-09-19T08:55:05.835 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 2, 2024-09-19T08:55:05.835 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 19, 2024-09-19T08:55:05.835 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 22, 2024-09-19T08:55:05.835 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 3, 2024-09-19T08:55:05.835 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 16, 2024-09-19T08:55:05.835 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 20, 2024-09-19T08:55:05.835 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 4, 2024-09-19T08:55:05.835 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 0, 2024-09-19T08:55:05.835 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 3, 2024-09-19T08:55:05.835 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 3, 2024-09-19T08:55:05.836 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 53568, 2024-09-19T08:55:05.836 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 223520 2024-09-19T08:55:05.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.836 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-09-19T08:55:05.836 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 10, 2024-09-19T08:55:05.836 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 0, 2024-09-19T08:55:05.836 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 6, 2024-09-19T08:55:05.836 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 20, 2024-09-19T08:55:05.836 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 1, 2024-09-19T08:55:05.836 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-09-19T08:55:05.836 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.836 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.836 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.836 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-09-19T08:55:05.837 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2, 2024-09-19T08:55:05.837 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.001249501, 2024-09-19T08:55:05.837 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000624750 2024-09-19T08:55:05.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.837 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-09-19T08:55:05.837 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.837 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.837 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.837 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-09-19T08:55:05.837 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.837 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.837 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.837 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-09-19T08:55:05.838 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1, 2024-09-19T08:55:05.838 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000215171, 2024-09-19T08:55:05.838 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000215171 2024-09-19T08:55:05.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.838 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-09-19T08:55:05.838 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.838 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.838 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.838 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-09-19T08:55:05.838 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.838 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.838 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.838 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-09-19T08:55:05.839 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.839 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.839 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.839 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-09-19T08:55:05.839 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.839 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.839 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.839 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-09-19T08:55:05.839 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.839 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.839 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.840 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-09-19T08:55:05.840 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.840 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.840 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.840 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-09-19T08:55:05.840 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.841 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.841 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.841 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-09-19T08:55:05.841 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.841 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.841 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.841 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-09-19T08:55:05.841 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.841 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.841 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.841 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-09-19T08:55:05.841 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.842 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.842 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.842 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-09-19T08:55:05.842 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.842 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.842 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.842 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-09-19T08:55:05.842 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.842 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.842 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.842 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-09-19T08:55:05.843 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.843 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.843 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.843 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-09-19T08:55:05.843 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.843 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.843 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.843 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-09-19T08:55:05.843 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.843 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.843 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.844 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-09-19T08:55:05.844 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.844 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.844 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.844 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-09-19T08:55:05.844 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.844 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.844 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.844 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-09-19T08:55:05.844 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.844 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.844 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.845 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-09-19T08:55:05.845 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.845 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.845 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.845 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-09-19T08:55:05.845 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.845 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.845 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.845 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-09-19T08:55:05.845 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.846 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.846 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.846 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-09-19T08:55:05.846 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.846 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.846 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.846 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-09-19T08:55:05.846 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.846 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.846 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.846 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-09-19T08:55:05.847 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.847 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.847 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.847 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-09-19T08:55:05.847 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-09-19T08:55:05.847 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-09-19T08:55:05.847 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.847 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.847 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.847 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:05.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.847 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-09-19T08:55:05.847 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 1, 2024-09-19T08:55:05.848 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 4, 2024-09-19T08:55:05.848 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 3, 2024-09-19T08:55:05.848 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 1, 2024-09-19T08:55:05.848 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-09-19T08:55:05.848 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 2, 2024-09-19T08:55:05.848 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 0, 2024-09-19T08:55:05.848 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 636, 2024-09-19T08:55:05.848 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-09-19T08:55:05.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.848 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-09-19T08:55:05.848 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:55:05.849 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-09-19T08:55:05.849 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:55:05.849 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:55:05.849 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:55:05.849 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:55:05.849 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:55:05.849 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:55:05.849 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:55:05.849 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:55:05.849 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:55:05.849 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:55:05.849 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:55:05.849 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:55:05.850 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:55:05.850 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-09-19T08:55:05.850 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:55:05.850 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-09-19T08:55:05.850 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:55:05.850 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:55:05.850 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:55:05.850 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:55:05.850 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:55:05.850 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:55:05.850 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:55:05.850 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-09-19T08:55:05.850 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:55:05.851 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:55:05.851 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:55:05.851 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-09-19T08:55:05.851 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-09-19T08:55:05.851 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-09-19T08:55:05.851 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:55:05.851 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:55:05.851 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:55:05.851 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:55:05.851 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 262167, 2024-09-19T08:55:05.851 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 84, 2024-09-19T08:55:05.851 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:55:05.851 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-09-19T08:55:05.851 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-09-19T08:55:05.852 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-09-19T08:55:05.852 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:55:05.852 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-09-19T08:55:05.852 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:55:05.852 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-09-19T08:55:05.852 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 8288, 2024-09-19T08:55:05.852 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 182, 2024-09-19T08:55:05.852 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:55:05.852 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:55:05.852 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-09-19T08:55:05.852 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-09-19T08:55:05.852 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 82725, 2024-09-19T08:55:05.853 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 341, 2024-09-19T08:55:05.853 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-09-19T08:55:05.853 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-09-19T08:55:05.853 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-09-19T08:55:05.853 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-09-19T08:55:05.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.853 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-09-19T08:55:05.853 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-09-19T08:55:05.853 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-09-19T08:55:05.853 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 46, 2024-09-19T08:55:05.853 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 12945, 2024-09-19T08:55:05.853 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 28, 2024-09-19T08:55:05.853 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 46, 2024-09-19T08:55:05.854 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-09-19T08:55:05.854 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 46, 2024-09-19T08:55:05.854 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.225996642, 2024-09-19T08:55:05.854 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.004912970 2024-09-19T08:55:05.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.854 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-09-19T08:55:05.854 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-09-19T08:55:05.854 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 46, 2024-09-19T08:55:05.854 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 70 2024-09-19T08:55:05.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.854 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 46, 2024-09-19T08:55:05.854 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 0, 2024-09-19T08:55:05.855 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 46, 2024-09-19T08:55:05.855 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-09-19T08:55:05.855 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-09-19T08:55:05.855 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 0, 2024-09-19T08:55:05.855 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 10, 2024-09-19T08:55:05.855 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 0, 2024-09-19T08:55:05.855 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 8, 2024-09-19T08:55:05.855 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 7, 2024-09-19T08:55:05.855 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-09-19T08:55:05.855 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-09-19T08:55:05.855 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-09-19T08:55:05.855 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-09-19T08:55:05.855 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 6, 2024-09-19T08:55:05.855 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-09-19T08:55:05.855 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-09-19T08:55:05.856 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-09-19T08:55:05.856 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 0, 2024-09-19T08:55:05.856 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 20, 2024-09-19T08:55:05.856 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-09-19T08:55:05.856 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-09-19T08:55:05.856 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-09-19T08:55:05.856 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-09-19T08:55:05.856 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-09-19T08:55:05.856 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-09-19T08:55:05.856 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T08:55:05.856 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-09-19T08:55:05.856 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-09-19T08:55:05.856 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-09-19T08:55:05.856 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-09-19T08:55:05.857 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-09-19T08:55:05.857 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-09-19T08:55:05.857 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-09-19T08:55:05.857 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-09-19T08:55:05.857 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-09-19T08:55:05.857 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-09-19T08:55:05.857 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-09-19T08:55:05.857 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-09-19T08:55:05.857 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-09-19T08:55:05.857 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-09-19T08:55:05.858 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-09-19T08:55:05.858 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-09-19T08:55:05.858 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-09-19T08:55:05.858 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-09-19T08:55:05.858 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-09-19T08:55:05.858 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 91, 2024-09-19T08:55:05.858 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-09-19T08:55:05.859 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 11, 2024-09-19T08:55:05.859 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 9, 2024-09-19T08:55:05.859 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 9, 2024-09-19T08:55:05.859 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-09-19T08:55:05.859 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-09-19T08:55:05.859 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 17, 2024-09-19T08:55:05.859 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 0, 2024-09-19T08:55:05.859 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 2 2024-09-19T08:55:05.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.859 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-09-19T08:55:05.859 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 1, 2024-09-19T08:55:05.859 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-09-19T08:55:05.859 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-09-19T08:55:05.860 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-09-19T08:55:05.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.860 INFO:teuthology.orchestra.run.smithi175.stdout: "osd-slow-ops": { 2024-09-19T08:55:05.860 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 14 2024-09-19T08:55:05.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.860 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-09-19T08:55:05.860 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-09-19T08:55:05.860 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T08:55:05.860 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-09-19T08:55:05.860 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 0, 2024-09-19T08:55:05.860 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 0, 2024-09-19T08:55:05.860 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 0, 2024-09-19T08:55:05.860 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-09-19T08:55:05.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.861 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:55:05.861 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-19T08:55:05.861 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-19T08:55:05.861 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-19T08:55:05.861 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 976, 2024-09-19T08:55:05.861 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 1590066, 2024-09-19T08:55:05.861 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-19T08:55:05.861 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 976, 2024-09-19T08:55:05.861 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-19T08:55:05.861 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-19T08:55:05.861 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 976, 2024-09-19T08:55:05.861 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 1590066, 2024-09-19T08:55:05.861 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-19T08:55:05.862 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.862 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.862 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.862 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:05.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.862 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-09-19T08:55:05.862 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-19T08:55:05.862 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-19T08:55:05.862 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-19T08:55:05.862 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-19T08:55:05.862 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-19T08:55:05.863 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-19T08:55:05.863 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-19T08:55:05.863 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 46, 2024-09-19T08:55:05.863 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 12945, 2024-09-19T08:55:05.863 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 46, 2024-09-19T08:55:05.863 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 12945, 2024-09-19T08:55:05.863 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-19T08:55:05.863 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.863 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.863 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.863 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:05.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.863 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-09-19T08:55:05.864 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-19T08:55:05.864 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-09-19T08:55:05.864 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-19T08:55:05.864 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-19T08:55:05.864 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-19T08:55:05.864 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-19T08:55:05.864 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-19T08:55:05.864 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 46, 2024-09-19T08:55:05.864 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 46, 2024-09-19T08:55:05.864 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 46, 2024-09-19T08:55:05.864 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 46, 2024-09-19T08:55:05.864 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-19T08:55:05.864 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.864 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.865 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.865 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:05.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.865 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-09-19T08:55:05.865 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-19T08:55:05.865 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-19T08:55:05.865 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-19T08:55:05.865 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-09-19T08:55:05.865 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-09-19T08:55:05.865 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-19T08:55:05.865 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-09-19T08:55:05.865 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-19T08:55:05.866 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-19T08:55:05.866 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-09-19T08:55:05.866 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-09-19T08:55:05.866 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-19T08:55:05.866 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.866 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.866 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.866 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:05.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:05.866 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x555f6017c500": { 2024-09-19T08:55:05.866 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-19T08:55:05.867 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-09-19T08:55:05.867 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-19T08:55:05.867 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 9, 2024-09-19T08:55:05.867 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 2498, 2024-09-19T08:55:05.867 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-19T08:55:05.867 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 9, 2024-09-19T08:55:05.867 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-19T08:55:05.867 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-19T08:55:05.867 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 8, 2024-09-19T08:55:05.867 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 2498, 2024-09-19T08:55:05.867 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-19T08:55:05.867 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:05.867 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:05.867 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:05.868 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:05.868 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:05.868 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-19T08:55:06.540 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:06 smithi175 ceph-mon[35688]: pgmap v328: 97 pgs: 97 active+clean; 2.1 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:55:06.541 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-19T08:55:06.541 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-19T08:55:06.541 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-09-19T08:55:06.541 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=17 2024-09-19T08:55:06.542 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-19T08:55:06.542 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-19T08:55:06.542 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T08:55:06.542 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T08:55:06.542 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T08:55:06.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:06 smithi007 ceph-mon[31221]: pgmap v328: 97 pgs: 97 active+clean; 2.1 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:55:06.784 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:55:06.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:06 smithi044 ceph-mon[35072]: pgmap v328: 97 pgs: 97 active+clean; 2.1 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:55:07.268 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-09-19T08:55:07.268 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T08:55:07.268 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 220, 2024-09-19T08:55:07.268 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 210, 2024-09-19T08:55:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1447888, 2024-09-19T08:55:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 129184, 2024-09-19T08:55:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 4, 2024-09-19T08:55:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 0, 2024-09-19T08:55:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.043028741, 2024-09-19T08:55:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.014234373, 2024-09-19T08:55:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.041818047, 2024-09-19T08:55:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:55:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:55:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 209, 2024-09-19T08:55:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.013997335, 2024-09-19T08:55:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000066972 2024-09-19T08:55:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:07.270 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:55:07.270 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:07.270 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:07.270 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:07.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:07.270 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1447888, 2024-09-19T08:55:07.270 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 129184 2024-09-19T08:55:07.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:07.270 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T08:55:07.270 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 6, 2024-09-19T08:55:07.270 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 164, 2024-09-19T08:55:07.270 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 3344, 2024-09-19T08:55:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 186192, 2024-09-19T08:55:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 5, 2024-09-19T08:55:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 3, 2024-09-19T08:55:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.013172676, 2024-09-19T08:55:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.007661174, 2024-09-19T08:55:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.003357593, 2024-09-19T08:55:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:55:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:55:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 162, 2024-09-19T08:55:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.017853026, 2024-09-19T08:55:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000110203 2024-09-19T08:55:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:55:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-09-19T08:55:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 186192 2024-09-19T08:55:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T08:55:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 0, 2024-09-19T08:55:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 2, 2024-09-19T08:55:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 0, 2024-09-19T08:55:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 0, 2024-09-19T08:55:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 2, 2024-09-19T08:55:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 1, 2024-09-19T08:55:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.000330008, 2024-09-19T08:55:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T08:55:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.000253957, 2024-09-19T08:55:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T08:55:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T08:55:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-09-19T08:55:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T08:55:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T08:55:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-09-19T08:55:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 0, 2024-09-19T08:55:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-09-19T08:55:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-09-19T08:55:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-09-19T08:55:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-09-19T08:55:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T08:55:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-09-19T08:55:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T08:55:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-09-19T08:55:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T08:55:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T08:55:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T08:55:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T08:55:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T08:55:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-09-19T08:55:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T08:55:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T08:55:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-09-19T08:55:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-09-19T08:55:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-09-19T08:55:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-09-19T08:55:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T08:55:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T08:55:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T08:55:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T08:55:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T08:55:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-09-19T08:55:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-09-19T08:55:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-09-19T08:55:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T08:55:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T08:55:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-09-19T08:55:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-09-19T08:55:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-09-19T08:55:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-09-19T08:55:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T08:55:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-09-19T08:55:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T08:55:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-09-19T08:55:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 148967, 2024-09-19T08:55:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 29, 2024-09-19T08:55:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-09-19T08:55:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-09-19T08:55:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-09-19T08:55:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-09-19T08:55:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-09-19T08:55:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-09-19T08:55:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-09-19T08:55:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-09-19T08:55:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 0, 2024-09-19T08:55:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 0, 2024-09-19T08:55:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T08:55:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-09-19T08:55:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-09-19T08:55:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-09-19T08:55:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 928, 2024-09-19T08:55:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 2, 2024-09-19T08:55:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-09-19T08:55:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-09-19T08:55:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-09-19T08:55:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-09-19T08:55:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-09-19T08:55:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T08:55:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-09-19T08:55:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-09-19T08:55:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-09-19T08:55:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 222, 2024-09-19T08:55:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 1416850, 2024-09-19T08:55:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-09-19T08:55:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 222, 2024-09-19T08:55:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-09-19T08:55:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-09-19T08:55:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 222, 2024-09-19T08:55:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 1416850, 2024-09-19T08:55:07.280 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-09-19T08:55:07.280 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-09-19T08:55:07.280 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-09-19T08:55:07.280 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-09-19T08:55:07.280 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:07.280 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-09-19T08:55:07.280 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-09-19T08:55:08.081 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-19T08:55:08.081 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-19T08:55:08.081 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-19T08:55:08.081 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-19T08:55:08.081 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-19T08:55:08.081 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-19T08:55:08.081 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-19T08:55:08.081 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T08:55:08.092 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T08:55:08.092 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T08:55:08.092 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:55:08.114 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T08:55:08.114 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:55:08.174 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T08:55:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:08.532 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:08 smithi007 ceph-mon[31221]: pgmap v329: 97 pgs: 97 active+clean; 2.1 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:55:08.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:08 smithi175 ceph-mon[35688]: pgmap v329: 97 pgs: 97 active+clean; 2.1 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:55:08.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:08 smithi044 ceph-mon[35072]: pgmap v329: 97 pgs: 97 active+clean; 2.1 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T08:55:08.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.966+0000 7f43d1141640 1 -- 172.21.15.7:0/3167219948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43cc102570 msgr2=0x7f43cc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.966+0000 7f43d1141640 1 --2- 172.21.15.7:0/3167219948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43cc102570 0x7f43cc1029b0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009900 tx=0x7f43c002a480 comp rx=0 tx=0).stop 2024-09-19T08:55:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.966+0000 7f43d1141640 1 -- 172.21.15.7:0/3167219948 shutdown_connections 2024-09-19T08:55:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.966+0000 7f43d1141640 1 --2- 172.21.15.7:0/3167219948 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43cc102ef0 0x7f43cc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.966+0000 7f43d1141640 1 --2- 172.21.15.7:0/3167219948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43cc102570 0x7f43cc1029b0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.966+0000 7f43d1141640 1 --2- 172.21.15.7:0/3167219948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43cc100e20 0x7f43cc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.966+0000 7f43d1141640 1 -- 172.21.15.7:0/3167219948 >> 172.21.15.7:0/3167219948 conn(0x7f43cc0fc7d0 msgr2=0x7f43cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.966+0000 7f43d1141640 1 -- 172.21.15.7:0/3167219948 shutdown_connections 2024-09-19T08:55:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.966+0000 7f43d1141640 1 -- 172.21.15.7:0/3167219948 wait complete. 2024-09-19T08:55:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.967+0000 7f43d1141640 1 Processor -- start 2024-09-19T08:55:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.967+0000 7f43d1141640 1 -- start start 2024-09-19T08:55:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.967+0000 7f43d1141640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43cc100e20 0x7f43cc1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.967+0000 7f43d1141640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43cc102570 0x7f43cc198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:08.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.967+0000 7f43d1141640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43cc102ef0 0x7f43cc19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:08.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.967+0000 7f43d1141640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc110f80 con 0x7f43cc102ef0 2024-09-19T08:55:08.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.967+0000 7f43d1141640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc110e00 con 0x7f43cc100e20 2024-09-19T08:55:08.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.967+0000 7f43d1141640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc111100 con 0x7f43cc102570 2024-09-19T08:55:08.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.967+0000 7f43cb59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43cc102ef0 0x7f43cc19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:08.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.967+0000 7f43cb59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43cc102ef0 0x7f43cc19ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47228/0 (socket says 172.21.15.7:47228) 2024-09-19T08:55:08.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.967+0000 7f43cb59e640 1 -- 172.21.15.7:0/2156632837 learned_addr learned my addr 172.21.15.7:0/2156632837 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:55:08.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.967+0000 7f43cad9d640 1 --2- 172.21.15.7:0/2156632837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43cc100e20 0x7f43cc1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:08.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.968+0000 7f43ca59c640 1 --2- 172.21.15.7:0/2156632837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43cc102570 0x7f43cc198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:08.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.968+0000 7f43cb59e640 1 -- 172.21.15.7:0/2156632837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43cc102570 msgr2=0x7f43cc198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:08.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.968+0000 7f43cb59e640 1 --2- 172.21.15.7:0/2156632837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43cc102570 0x7f43cc198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:08.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.968+0000 7f43cb59e640 1 -- 172.21.15.7:0/2156632837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43cc100e20 msgr2=0x7f43cc1985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:08.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.968+0000 7f43cb59e640 1 --2- 172.21.15.7:0/2156632837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43cc100e20 0x7f43cc1985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.968+0000 7f43cb59e640 1 -- 172.21.15.7:0/2156632837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43cc19d560 con 0x7f43cc102ef0 2024-09-19T08:55:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.968+0000 7f43cad9d640 1 --2- 172.21.15.7:0/2156632837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43cc100e20 0x7f43cc1985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:55:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.968+0000 7f43cb59e640 1 --2- 172.21.15.7:0/2156632837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43cc102ef0 0x7f43cc19ce80 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f43c400eb10 tx=0x7f43c400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.968+0000 7f43b3fff640 1 -- 172.21.15.7:0/2156632837 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c4004b20 con 0x7f43cc102ef0 2024-09-19T08:55:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.968+0000 7f43b3fff640 1 -- 172.21.15.7:0/2156632837 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43c4004cc0 con 0x7f43cc102ef0 2024-09-19T08:55:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.968+0000 7f43d1141640 1 -- 172.21.15.7:0/2156632837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43cc19d850 con 0x7f43cc102ef0 2024-09-19T08:55:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.968+0000 7f43b3fff640 1 -- 172.21.15.7:0/2156632837 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c4010760 con 0x7f43cc102ef0 2024-09-19T08:55:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.968+0000 7f43d1141640 1 -- 172.21.15.7:0/2156632837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43cc1a5130 con 0x7f43cc102ef0 2024-09-19T08:55:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.969+0000 7f43d1141640 1 -- 172.21.15.7:0/2156632837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43cc101200 con 0x7f43cc102ef0 2024-09-19T08:55:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.970+0000 7f43b3fff640 1 -- 172.21.15.7:0/2156632837 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f43c4005020 con 0x7f43cc102ef0 2024-09-19T08:55:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.971+0000 7f43b3fff640 1 --2- 172.21.15.7:0/2156632837 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f43b40a33b0 0x7f43b40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.971+0000 7f43cad9d640 1 --2- 172.21.15.7:0/2156632837 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f43b40a33b0 0x7f43b40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.971+0000 7f43b3fff640 1 -- 172.21.15.7:0/2156632837 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8585+0+0 (secure 0 0 0) 0x7f43c40d0360 con 0x7f43cc102ef0 2024-09-19T08:55:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.971+0000 7f43cad9d640 1 --2- 172.21.15.7:0/2156632837 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f43b40a33b0 0x7f43b40a5870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0058c0 tx=0x7f43bc00a250 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:08.975+0000 7f43b3fff640 1 -- 172.21.15.7:0/2156632837 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f43c409cca0 con 0x7f43cc102ef0 2024-09-19T08:55:09.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:09.162+0000 7f43d1141640 1 -- 172.21.15.7:0/2156632837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f43cc10a0a0 con 0x7f43cc102ef0 2024-09-19T08:55:09.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:09.162+0000 7f43b3fff640 1 -- 172.21.15.7:0/2156632837 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v91) ==== 81+0+984 (secure 0 0 0) 0x7f43c409c5a0 con 0x7f43cc102ef0 2024-09-19T08:55:09.162 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/973276283 2024-09-20T08:44:31.163626+0000 2024-09-19T08:55:09.162 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/2695884066 2024-09-20T08:35:31.711540+0000 2024-09-19T08:55:09.162 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/816886708 2024-09-20T08:35:31.711540+0000 2024-09-19T08:55:09.162 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/1689067491 2024-09-20T08:35:31.711540+0000 2024-09-19T08:55:09.162 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/3577760109 2024-09-20T08:44:31.163626+0000 2024-09-19T08:55:09.163 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1429582340 2024-09-20T08:35:56.784361+0000 2024-09-19T08:55:09.163 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/1689067491 2024-09-20T08:35:31.711540+0000 2024-09-19T08:55:09.163 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/4277640815 2024-09-20T08:35:31.711540+0000 2024-09-19T08:55:09.163 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/499611189 2024-09-20T08:44:31.163626+0000 2024-09-19T08:55:09.163 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/3577760109 2024-09-20T08:44:31.163626+0000 2024-09-19T08:55:09.163 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/4058698573 2024-09-20T08:35:56.784361+0000 2024-09-19T08:55:09.163 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1800852158 2024-09-20T08:44:31.163626+0000 2024-09-19T08:55:09.163 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/2884903597 2024-09-20T08:35:56.784361+0000 2024-09-19T08:55:09.163 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/3071389382 2024-09-20T08:35:56.784361+0000 2024-09-19T08:55:09.163 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/2457209252 2024-09-20T08:44:31.163626+0000 2024-09-19T08:55:09.163 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/3071389382 2024-09-20T08:35:56.784361+0000 2024-09-19T08:55:09.163 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/2008302629 2024-09-20T08:44:31.163626+0000 2024-09-19T08:55:09.164 INFO:teuthology.orchestra.run.smithi007.stderr:listed 17 entries 2024-09-19T08:55:09.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:09.165+0000 7f43d1141640 1 -- 172.21.15.7:0/2156632837 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f43b40a33b0 msgr2=0x7f43b40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:09.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:09.165+0000 7f43d1141640 1 --2- 172.21.15.7:0/2156632837 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f43b40a33b0 0x7f43b40a5870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0058c0 tx=0x7f43bc00a250 comp rx=0 tx=0).stop 2024-09-19T08:55:09.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:09.165+0000 7f43d1141640 1 -- 172.21.15.7:0/2156632837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43cc102ef0 msgr2=0x7f43cc19ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:09.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:09.165+0000 7f43d1141640 1 --2- 172.21.15.7:0/2156632837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43cc102ef0 0x7f43cc19ce80 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f43c400eb10 tx=0x7f43c400c2d0 comp rx=0 tx=0).stop 2024-09-19T08:55:09.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:09.165+0000 7f43d1141640 1 -- 172.21.15.7:0/2156632837 shutdown_connections 2024-09-19T08:55:09.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:09.165+0000 7f43d1141640 1 --2- 172.21.15.7:0/2156632837 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f43b40a33b0 0x7f43b40a5870 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:09.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:09.165+0000 7f43d1141640 1 --2- 172.21.15.7:0/2156632837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43cc102ef0 0x7f43cc19ce80 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:09.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:09.165+0000 7f43d1141640 1 --2- 172.21.15.7:0/2156632837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43cc102570 0x7f43cc198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:09.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:09.165+0000 7f43d1141640 1 --2- 172.21.15.7:0/2156632837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43cc100e20 0x7f43cc1985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:09.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:09.165+0000 7f43d1141640 1 -- 172.21.15.7:0/2156632837 >> 172.21.15.7:0/2156632837 conn(0x7f43cc0fc7d0 msgr2=0x7f43cc06a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:09.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:09.165+0000 7f43d1141640 1 -- 172.21.15.7:0/2156632837 shutdown_connections 2024-09-19T08:55:09.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:09.165+0000 7f43d1141640 1 -- 172.21.15.7:0/2156632837 wait complete. 2024-09-19T08:55:09.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:09 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/2156632837' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T08:55:09.702 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:09 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/2156632837' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T08:55:09.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:09 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/2156632837' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T08:55:09.800 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T08:55:09.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:55:09.800 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T08:55:09.850 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-09-19T08:55:09.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:55:09.851 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T08:55:09.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:55:09.895 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-09-19T08:55:09.911 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T08:55:09.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:55:09.911 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:55:09.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:55:09.978 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2024-09-19T08:55:10.080 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T08:55:10.092 INFO:tasks.cephadm:Teardown begin 2024-09-19T08:55:10.092 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T08:55:10.092 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:55:10.350 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:10.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:10 smithi175 ceph-mon[35688]: pgmap v330: 97 pgs: 97 active+clean; 2.1 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:55:10.678 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:10 smithi175 ceph-mon[35688]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T08:55:10.749 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:10 smithi007 ceph-mon[31221]: pgmap v330: 97 pgs: 97 active+clean; 2.1 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:55:10.749 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:10 smithi007 ceph-mon[31221]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T08:55:10.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:10 smithi044 ceph-mon[35072]: pgmap v330: 97 pgs: 97 active+clean; 2.1 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T08:55:10.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:10 smithi044 ceph-mon[35072]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T08:55:10.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.834+0000 7f8c83869640 1 -- 172.21.15.7:0/4275721349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c7c10e480 msgr2=0x7f8c7c110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:10.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.834+0000 7f8c83869640 1 --2- 172.21.15.7:0/4275721349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c7c10e480 0x7f8c7c110870 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009ca0 tx=0x7f8c7402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:55:10.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.834+0000 7f8c83869640 1 -- 172.21.15.7:0/4275721349 shutdown_connections 2024-09-19T08:55:10.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.834+0000 7f8c83869640 1 --2- 172.21.15.7:0/4275721349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c7c10e480 0x7f8c7c110870 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:10.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.834+0000 7f8c83869640 1 --2- 172.21.15.7:0/4275721349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c7c101280 0x7f8c7c10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:10.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.834+0000 7f8c83869640 1 --2- 172.21.15.7:0/4275721349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c7c1008d0 0x7f8c7c100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:10.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.834+0000 7f8c83869640 1 -- 172.21.15.7:0/4275721349 >> 172.21.15.7:0/4275721349 conn(0x7f8c7c0fc7a0 msgr2=0x7f8c7c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:10.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.834+0000 7f8c83869640 1 -- 172.21.15.7:0/4275721349 shutdown_connections 2024-09-19T08:55:10.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.834+0000 7f8c83869640 1 -- 172.21.15.7:0/4275721349 wait complete. 2024-09-19T08:55:10.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.835+0000 7f8c83869640 1 Processor -- start 2024-09-19T08:55:10.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.835+0000 7f8c83869640 1 -- start start 2024-09-19T08:55:10.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.835+0000 7f8c83869640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c7c1008d0 0x7f8c7c19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:10.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.835+0000 7f8c83869640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c7c101280 0x7f8c7c19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:10.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.835+0000 7f8c83869640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c7c10e480 0x7f8c7c19ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:10.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.835+0000 7f8c83869640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c114180 con 0x7f8c7c101280 2024-09-19T08:55:10.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.835+0000 7f8c83869640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c114000 con 0x7f8c7c1008d0 2024-09-19T08:55:10.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.835+0000 7f8c83869640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c114300 con 0x7f8c7c10e480 2024-09-19T08:55:10.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.835+0000 7f8c80e04640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c7c101280 0x7f8c7c19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:10.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.835+0000 7f8c81605640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c7c1008d0 0x7f8c7c19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:10.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.835+0000 7f8c80e04640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c7c101280 0x7f8c7c19abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47256/0 (socket says 172.21.15.7:47256) 2024-09-19T08:55:10.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.835+0000 7f8c80e04640 1 -- 172.21.15.7:0/939828950 learned_addr learned my addr 172.21.15.7:0/939828950 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:55:10.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.835+0000 7f8c81e06640 1 --2- 172.21.15.7:0/939828950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c7c10e480 0x7f8c7c19ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:10.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.835+0000 7f8c81605640 1 -- 172.21.15.7:0/939828950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c7c10e480 msgr2=0x7f8c7c19ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:10.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.835+0000 7f8c81605640 1 --2- 172.21.15.7:0/939828950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c7c10e480 0x7f8c7c19ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:10.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.835+0000 7f8c81605640 1 -- 172.21.15.7:0/939828950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c7c101280 msgr2=0x7f8c7c19abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:10.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.835+0000 7f8c81605640 1 --2- 172.21.15.7:0/939828950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c7c101280 0x7f8c7c19abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:10.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.836+0000 7f8c81605640 1 -- 172.21.15.7:0/939828950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7c19f650 con 0x7f8c7c1008d0 2024-09-19T08:55:10.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.836+0000 7f8c80e04640 1 --2- 172.21.15.7:0/939828950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c7c101280 0x7f8c7c19abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:55:10.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.836+0000 7f8c81605640 1 --2- 172.21.15.7:0/939828950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c7c1008d0 0x7f8c7c19a6a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800e9f0 tx=0x7f8c7800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:10.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.836+0000 7f8c727fc640 1 -- 172.21.15.7:0/939828950 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7800ccc0 con 0x7f8c7c1008d0 2024-09-19T08:55:10.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.836+0000 7f8c83869640 1 -- 172.21.15.7:0/939828950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c7c19f940 con 0x7f8c7c1008d0 2024-09-19T08:55:10.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.836+0000 7f8c727fc640 1 -- 172.21.15.7:0/939828950 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c78010910 con 0x7f8c7c1008d0 2024-09-19T08:55:10.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.836+0000 7f8c727fc640 1 -- 172.21.15.7:0/939828950 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c78018960 con 0x7f8c7c1008d0 2024-09-19T08:55:10.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.836+0000 7f8c83869640 1 -- 172.21.15.7:0/939828950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c7c1a7220 con 0x7f8c7c1008d0 2024-09-19T08:55:10.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.837+0000 7f8c83869640 1 -- 172.21.15.7:0/939828950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c7c100cb0 con 0x7f8c7c1008d0 2024-09-19T08:55:10.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.838+0000 7f8c727fc640 1 -- 172.21.15.7:0/939828950 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8c78010ac0 con 0x7f8c7c1008d0 2024-09-19T08:55:10.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.839+0000 7f8c727fc640 1 --2- 172.21.15.7:0/939828950 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8c680a33b0 0x7f8c680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:10.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.839+0000 7f8c80e04640 1 --2- 172.21.15.7:0/939828950 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8c680a33b0 0x7f8c680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:10.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.839+0000 7f8c727fc640 1 -- 172.21.15.7:0/939828950 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8629+0+0 (secure 0 0 0) 0x7f8c780d01b0 con 0x7f8c7c1008d0 2024-09-19T08:55:10.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.839+0000 7f8c80e04640 1 --2- 172.21.15.7:0/939828950 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8c680a33b0 0x7f8c680a5870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c1102c0 tx=0x7f8c6c005f90 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:10.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:10.843+0000 7f8c727fc640 1 -- 172.21.15.7:0/939828950 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8c7809cb40 con 0x7f8c7c1008d0 2024-09-19T08:55:11.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:11.057+0000 7f8c83869640 1 -- 172.21.15.7:0/939828950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c7c109640 con 0x7f8c7c1008d0 2024-09-19T08:55:11.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:11.058+0000 7f8c727fc640 1 -- 172.21.15.7:0/939828950 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f8c7809c440 con 0x7f8c7c1008d0 2024-09-19T08:55:11.058 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:55:11.058 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:55:11.058 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:55:11.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:11.060+0000 7f8c83869640 1 -- 172.21.15.7:0/939828950 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8c680a33b0 msgr2=0x7f8c680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:11.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:11.060+0000 7f8c83869640 1 --2- 172.21.15.7:0/939828950 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8c680a33b0 0x7f8c680a5870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c1102c0 tx=0x7f8c6c005f90 comp rx=0 tx=0).stop 2024-09-19T08:55:11.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:11.060+0000 7f8c83869640 1 -- 172.21.15.7:0/939828950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c7c1008d0 msgr2=0x7f8c7c19a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:11.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:11.060+0000 7f8c83869640 1 --2- 172.21.15.7:0/939828950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c7c1008d0 0x7f8c7c19a6a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800e9f0 tx=0x7f8c7800eeb0 comp rx=0 tx=0).stop 2024-09-19T08:55:11.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:11.060+0000 7f8c83869640 1 -- 172.21.15.7:0/939828950 shutdown_connections 2024-09-19T08:55:11.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:11.060+0000 7f8c83869640 1 --2- 172.21.15.7:0/939828950 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f8c680a33b0 0x7f8c680a5870 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:11.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:11.060+0000 7f8c83869640 1 --2- 172.21.15.7:0/939828950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c7c10e480 0x7f8c7c19ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:11.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:11.060+0000 7f8c83869640 1 --2- 172.21.15.7:0/939828950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c7c101280 0x7f8c7c19abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:11.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:11.060+0000 7f8c83869640 1 --2- 172.21.15.7:0/939828950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c7c1008d0 0x7f8c7c19a6a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:11.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:11.060+0000 7f8c83869640 1 -- 172.21.15.7:0/939828950 >> 172.21.15.7:0/939828950 conn(0x7f8c7c0fc7a0 msgr2=0x7f8c7c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:11.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:11.061+0000 7f8c83869640 1 -- 172.21.15.7:0/939828950 shutdown_connections 2024-09-19T08:55:11.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:11.061+0000 7f8c83869640 1 -- 172.21.15.7:0/939828950 wait complete. 2024-09-19T08:55:11.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:11 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/939828950' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:55:11.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:11 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/939828950' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:55:11.861 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:55:11.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:11 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/939828950' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:55:12.121 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:12.507 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:12 smithi007 ceph-mon[31221]: pgmap v332: 97 pgs: 97 active+clean; 2.1 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:55:12.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.589+0000 7f914f6c5640 1 -- 172.21.15.7:0/3705383942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9148106a80 msgr2=0x7f9148106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:12.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.589+0000 7f914f6c5640 1 --2- 172.21.15.7:0/3705383942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9148106a80 0x7f9148106e60 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f9144009cd0 tx=0x7f914402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.590+0000 7f914f6c5640 1 -- 172.21.15.7:0/3705383942 shutdown_connections 2024-09-19T08:55:12.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.590+0000 7f914f6c5640 1 --2- 172.21.15.7:0/3705383942 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9148101420 0x7f914810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.590+0000 7f914f6c5640 1 --2- 172.21.15.7:0/3705383942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9148100a80 0x7f9148100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.590+0000 7f914f6c5640 1 --2- 172.21.15.7:0/3705383942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9148106a80 0x7f9148106e60 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.590+0000 7f914f6c5640 1 -- 172.21.15.7:0/3705383942 >> 172.21.15.7:0/3705383942 conn(0x7f91480fc7a0 msgr2=0x7f91480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:12.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.590+0000 7f914f6c5640 1 -- 172.21.15.7:0/3705383942 shutdown_connections 2024-09-19T08:55:12.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.590+0000 7f914f6c5640 1 -- 172.21.15.7:0/3705383942 wait complete. 2024-09-19T08:55:12.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.590+0000 7f914f6c5640 1 Processor -- start 2024-09-19T08:55:12.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.590+0000 7f914f6c5640 1 -- start start 2024-09-19T08:55:12.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.590+0000 7f914f6c5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9148100a80 0x7f9148102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:12.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.590+0000 7f914f6c5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9148101420 0x7f9148102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:12.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.590+0000 7f914f6c5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9148106a80 0x7f91481030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:12.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.590+0000 7f914f6c5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9148110e80 con 0x7f9148101420 2024-09-19T08:55:12.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.590+0000 7f914f6c5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9148110d00 con 0x7f9148100a80 2024-09-19T08:55:12.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.590+0000 7f914f6c5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9148111000 con 0x7f9148106a80 2024-09-19T08:55:12.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.591+0000 7f914cc60640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9148101420 0x7f9148102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:12.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.591+0000 7f914cc60640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9148101420 0x7f9148102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47282/0 (socket says 172.21.15.7:47282) 2024-09-19T08:55:12.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.591+0000 7f914cc60640 1 -- 172.21.15.7:0/3951373504 learned_addr learned my addr 172.21.15.7:0/3951373504 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:55:12.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.591+0000 7f914dc62640 1 --2- 172.21.15.7:0/3951373504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9148106a80 0x7f91481030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:12.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.591+0000 7f914d461640 1 --2- 172.21.15.7:0/3951373504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9148100a80 0x7f9148102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:12.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.591+0000 7f914cc60640 1 -- 172.21.15.7:0/3951373504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9148106a80 msgr2=0x7f91481030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:12.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.591+0000 7f914cc60640 1 --2- 172.21.15.7:0/3951373504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9148106a80 0x7f91481030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.591+0000 7f914cc60640 1 -- 172.21.15.7:0/3951373504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9148100a80 msgr2=0x7f9148102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:12.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.591+0000 7f914cc60640 1 --2- 172.21.15.7:0/3951373504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9148100a80 0x7f9148102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.591+0000 7f914cc60640 1 -- 172.21.15.7:0/3951373504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91481a68d0 con 0x7f9148101420 2024-09-19T08:55:12.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.591+0000 7f914cc60640 1 --2- 172.21.15.7:0/3951373504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9148101420 0x7f9148102b90 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f913800c890 tx=0x7f913800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:12.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.591+0000 7f913e7fc640 1 -- 172.21.15.7:0/3951373504 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9138004220 con 0x7f9148101420 2024-09-19T08:55:12.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.591+0000 7f913e7fc640 1 -- 172.21.15.7:0/3951373504 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91380043c0 con 0x7f9148101420 2024-09-19T08:55:12.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.591+0000 7f914f6c5640 1 -- 172.21.15.7:0/3951373504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91481a6bc0 con 0x7f9148101420 2024-09-19T08:55:12.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.591+0000 7f913e7fc640 1 -- 172.21.15.7:0/3951373504 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91380049e0 con 0x7f9148101420 2024-09-19T08:55:12.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.592+0000 7f914f6c5640 1 -- 172.21.15.7:0/3951373504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91481a7150 con 0x7f9148101420 2024-09-19T08:55:12.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.592+0000 7f914f6c5640 1 -- 172.21.15.7:0/3951373504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9148100ee0 con 0x7f9148101420 2024-09-19T08:55:12.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.594+0000 7f913e7fc640 1 -- 172.21.15.7:0/3951373504 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f91380079b0 con 0x7f9148101420 2024-09-19T08:55:12.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.594+0000 7f913e7fc640 1 --2- 172.21.15.7:0/3951373504 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f91340a3430 0x7f91340a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:12.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.594+0000 7f914d461640 1 --2- 172.21.15.7:0/3951373504 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f91340a3430 0x7f91340a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:12.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.594+0000 7f913e7fc640 1 -- 172.21.15.7:0/3951373504 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8629+0+0 (secure 0 0 0) 0x7f91380cfea0 con 0x7f9148101420 2024-09-19T08:55:12.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.595+0000 7f914d461640 1 --2- 172.21.15.7:0/3951373504 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f91340a3430 0x7f91340a58f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9144006010 tx=0x7f9144009900 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:12.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.597+0000 7f913e7fc640 1 -- 172.21.15.7:0/3951373504 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9138014030 con 0x7f9148101420 2024-09-19T08:55:12.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:12 smithi044 ceph-mon[35072]: pgmap v332: 97 pgs: 97 active+clean; 2.1 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:55:12.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.808+0000 7f914f6c5640 1 -- 172.21.15.7:0/3951373504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9148103b80 con 0x7f9148101420 2024-09-19T08:55:12.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.809+0000 7f913e7fc640 1 -- 172.21.15.7:0/3951373504 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f9148103b80 con 0x7f9148101420 2024-09-19T08:55:12.808 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:55:12.809 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-19T08:44:32:841093+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1124869309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1124869309},{"type":"v1","addr":"172.21.15.7:6835","nonce":1124869309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1936828409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1936828409},{"type":"v1","addr":"172.21.15.7:6837","nonce":1936828409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2793016476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2793016476},{"type":"v1","addr":"172.21.15.7:6839","nonce":2793016476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/1259465331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":1259465331},{"type":"v1","addr":"172.21.15.7:6841","nonce":1259465331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/344689321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":344689321},{"type":"v1","addr":"172.21.15.175:6833","nonce":344689321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1773724086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1773724086},{"type":"v1","addr":"172.21.15.44:6833","nonce":1773724086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:42:44.586692+0000","modified":"2024-09-19T08:44:31.939950+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24491,"mds_1":24472,"mds_2":24458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24443":{"gid":24443,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2261554115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2261554115},{"type":"v1","addr":"172.21.15.44:6835","nonce":2261554115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6835/1285566250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1285566250},{"type":"v1","addr":"172.21.15.175:6835","nonce":1285566250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/2128553811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2128553811},{"type":"v1","addr":"172.21.15.175:6837","nonce":2128553811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/1232834466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1232834466},{"type":"v1","addr":"172.21.15.44:6837","nonce":1232834466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6839/3928264317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":3928264317},{"type":"v1","addr":"172.21.15.175:6839","nonce":3928264317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/1737549475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1737549475},{"type":"v1","addr":"172.21.15.44:6839","nonce":1737549475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24472,24458]},"id":1}]} 2024-09-19T08:55:12.809 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-19T08:55:12.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.811+0000 7f914f6c5640 1 -- 172.21.15.7:0/3951373504 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f91340a3430 msgr2=0x7f91340a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:12.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.811+0000 7f914f6c5640 1 --2- 172.21.15.7:0/3951373504 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f91340a3430 0x7f91340a58f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9144006010 tx=0x7f9144009900 comp rx=0 tx=0).stop 2024-09-19T08:55:12.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.811+0000 7f914f6c5640 1 -- 172.21.15.7:0/3951373504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9148101420 msgr2=0x7f9148102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:12.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.811+0000 7f914f6c5640 1 --2- 172.21.15.7:0/3951373504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9148101420 0x7f9148102b90 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f913800c890 tx=0x7f913800cd50 comp rx=0 tx=0).stop 2024-09-19T08:55:12.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.811+0000 7f914f6c5640 1 -- 172.21.15.7:0/3951373504 shutdown_connections 2024-09-19T08:55:12.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.811+0000 7f914f6c5640 1 --2- 172.21.15.7:0/3951373504 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f91340a3430 0x7f91340a58f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.811+0000 7f914f6c5640 1 --2- 172.21.15.7:0/3951373504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9148106a80 0x7f91481030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.811+0000 7f914f6c5640 1 --2- 172.21.15.7:0/3951373504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9148101420 0x7f9148102b90 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.811+0000 7f914f6c5640 1 --2- 172.21.15.7:0/3951373504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9148100a80 0x7f9148102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.811+0000 7f914f6c5640 1 -- 172.21.15.7:0/3951373504 >> 172.21.15.7:0/3951373504 conn(0x7f91480fc7a0 msgr2=0x7f914806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:12.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.811+0000 7f914f6c5640 1 -- 172.21.15.7:0/3951373504 shutdown_connections 2024-09-19T08:55:12.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:12.811+0000 7f914f6c5640 1 -- 172.21.15.7:0/3951373504 wait complete. 2024-09-19T08:55:12.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:12 smithi175 ceph-mon[35688]: pgmap v332: 97 pgs: 97 active+clean; 2.1 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T08:55:13.386 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:55:13.533 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:13 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/3951373504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:55:13.645 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:13.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:13 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/3951373504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:55:13.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:13 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/3951373504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:55:14.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.114+0000 7fd2b6b0b640 1 -- 172.21.15.7:0/2785133168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2b0102e00 msgr2=0x7fd2b01031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.114+0000 7fd2b6b0b640 1 --2- 172.21.15.7:0/2785133168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2b0102e00 0x7fd2b01031e0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009900 tx=0x7fd2a402a480 comp rx=0 tx=0).stop 2024-09-19T08:55:14.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.114+0000 7fd2b6b0b640 1 -- 172.21.15.7:0/2785133168 shutdown_connections 2024-09-19T08:55:14.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.114+0000 7fd2b6b0b640 1 --2- 172.21.15.7:0/2785133168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2b010c1a0 0x7fd2b010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.114+0000 7fd2b6b0b640 1 --2- 172.21.15.7:0/2785133168 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2b0103720 0x7fd2b010bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.114+0000 7fd2b6b0b640 1 --2- 172.21.15.7:0/2785133168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2b0102e00 0x7fd2b01031e0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.114+0000 7fd2b6b0b640 1 -- 172.21.15.7:0/2785133168 >> 172.21.15.7:0/2785133168 conn(0x7fd2b00fc7a0 msgr2=0x7fd2b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:14.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.114+0000 7fd2b6b0b640 1 -- 172.21.15.7:0/2785133168 shutdown_connections 2024-09-19T08:55:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.114+0000 7fd2b6b0b640 1 -- 172.21.15.7:0/2785133168 wait complete. 2024-09-19T08:55:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.115+0000 7fd2b6b0b640 1 Processor -- start 2024-09-19T08:55:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.115+0000 7fd2b6b0b640 1 -- start start 2024-09-19T08:55:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.115+0000 7fd2b6b0b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2b0102e00 0x7fd2b0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.115+0000 7fd2b6b0b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2b0103720 0x7fd2b0198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.115+0000 7fd2b6b0b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2b010c1a0 0x7fd2b019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.115+0000 7fd2b6b0b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b0111f70 con 0x7fd2b0102e00 2024-09-19T08:55:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.115+0000 7fd2b6b0b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b0111df0 con 0x7fd2b010c1a0 2024-09-19T08:55:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.115+0000 7fd2b6b0b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b01120f0 con 0x7fd2b0103720 2024-09-19T08:55:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.115+0000 7fd2b48a7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2b0102e00 0x7fd2b0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.115+0000 7fd2b48a7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2b0102e00 0x7fd2b0198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56478/0 (socket says 172.21.15.7:56478) 2024-09-19T08:55:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.115+0000 7fd2b48a7640 1 -- 172.21.15.7:0/305074266 learned_addr learned my addr 172.21.15.7:0/305074266 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:55:14.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.115+0000 7fd2affff640 1 --2- 172.21.15.7:0/305074266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2b0103720 0x7fd2b0198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.115+0000 7fd2b50a8640 1 --2- 172.21.15.7:0/305074266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2b010c1a0 0x7fd2b019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.115+0000 7fd2b48a7640 1 -- 172.21.15.7:0/305074266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2b0103720 msgr2=0x7fd2b0198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.115+0000 7fd2b48a7640 1 --2- 172.21.15.7:0/305074266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2b0103720 0x7fd2b0198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.115+0000 7fd2b48a7640 1 -- 172.21.15.7:0/305074266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2b010c1a0 msgr2=0x7fd2b019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.115+0000 7fd2b48a7640 1 --2- 172.21.15.7:0/305074266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2b010c1a0 0x7fd2b019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.115+0000 7fd2b48a7640 1 -- 172.21.15.7:0/305074266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b019d3e0 con 0x7fd2b0102e00 2024-09-19T08:55:14.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.116+0000 7fd2affff640 1 --2- 172.21.15.7:0/305074266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2b0103720 0x7fd2b0198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:14.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.116+0000 7fd2b48a7640 1 --2- 172.21.15.7:0/305074266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2b0102e00 0x7fd2b0198430 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4006010 tx=0x7fd2a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:14.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.116+0000 7fd2adffb640 1 -- 172.21.15.7:0/305074266 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a403f030 con 0x7fd2b0102e00 2024-09-19T08:55:14.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.116+0000 7fd2adffb640 1 -- 172.21.15.7:0/305074266 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2a4003ce0 con 0x7fd2b0102e00 2024-09-19T08:55:14.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.116+0000 7fd2b6b0b640 1 -- 172.21.15.7:0/305074266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b019d670 con 0x7fd2b0102e00 2024-09-19T08:55:14.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.116+0000 7fd2adffb640 1 -- 172.21.15.7:0/305074266 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4035070 con 0x7fd2b0102e00 2024-09-19T08:55:14.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.116+0000 7fd2b6b0b640 1 -- 172.21.15.7:0/305074266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b01a4fb0 con 0x7fd2b0102e00 2024-09-19T08:55:14.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.117+0000 7fd2b6b0b640 1 -- 172.21.15.7:0/305074266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b006afb0 con 0x7fd2b0102e00 2024-09-19T08:55:14.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.119+0000 7fd2adffb640 1 -- 172.21.15.7:0/305074266 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fd2a4042030 con 0x7fd2b0102e00 2024-09-19T08:55:14.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.119+0000 7fd2adffb640 1 --2- 172.21.15.7:0/305074266 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd2a00a3430 0x7fd2a00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.119+0000 7fd2adffb640 1 -- 172.21.15.7:0/305074266 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8629+0+0 (secure 0 0 0) 0x7fd2a40f0710 con 0x7fd2b0102e00 2024-09-19T08:55:14.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.119+0000 7fd2affff640 1 --2- 172.21.15.7:0/305074266 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd2a00a3430 0x7fd2a00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.120+0000 7fd2affff640 1 --2- 172.21.15.7:0/305074266 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd2a00a3430 0x7fd2a00a58f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd2b010d4d0 tx=0x7fd29c005e50 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:14.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.123+0000 7fd2adffb640 1 -- 172.21.15.7:0/305074266 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd2a40bd140 con 0x7fd2b0102e00 2024-09-19T08:55:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.302+0000 7fd2b6b0b640 1 -- 172.21.15.7:0/305074266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2b0107280 con 0x7fd2b0102e00 2024-09-19T08:55:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.303+0000 7fd2adffb640 1 -- 172.21.15.7:0/305074266 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+23222 (secure 0 0 0) 0x7fd2a40bca40 con 0x7fd2b0102e00 2024-09-19T08:55:14.303 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T08:55:14.303 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":92,"fsid":"ebd23124-7661-11ef-bceb-c7b262605968","created":"2024-09-19T08:35:02.287380+0000","modified":"2024-09-19T08:55:09.418874+0000","last_up_change":"2024-09-19T08:41:54.742978+0000","last_in_change":"2024-09-19T08:41:31.685622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:38:13.285118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:42:40.425852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:42:43.006548+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":92,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"837e6267-71c7-4f48-9e0b-4e3f124682b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6803","nonce":402668717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6805","nonce":402668717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6809","nonce":402668717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":402668717},{"type":"v1","addr":"172.21.15.7:6807","nonce":402668717}]},"public_addr":"172.21.15.7:6803/402668717","cluster_addr":"172.21.15.7:6805/402668717","heartbeat_back_addr":"172.21.15.7:6809/402668717","heartbeat_front_addr":"172.21.15.7:6807/402668717","state":["exists","up"]},{"osd":1,"uuid":"67865372-ac22-4b30-bd02-498e118d6701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6801","nonce":2213694259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6803","nonce":2213694259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6807","nonce":2213694259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2213694259},{"type":"v1","addr":"172.21.15.44:6805","nonce":2213694259}]},"public_addr":"172.21.15.44:6801/2213694259","cluster_addr":"172.21.15.44:6803/2213694259","heartbeat_back_addr":"172.21.15.44:6807/2213694259","heartbeat_front_addr":"172.21.15.44:6805/2213694259","state":["exists","up"]},{"osd":2,"uuid":"37c1cc2b-60ea-449f-baa7-c65d96c3559c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6801","nonce":3413002145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6803","nonce":3413002145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6807","nonce":3413002145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3413002145},{"type":"v1","addr":"172.21.15.175:6805","nonce":3413002145}]},"public_addr":"172.21.15.175:6801/3413002145","cluster_addr":"172.21.15.175:6803/3413002145","heartbeat_back_addr":"172.21.15.175:6807/3413002145","heartbeat_front_addr":"172.21.15.175:6805/3413002145","state":["exists","up"]},{"osd":3,"uuid":"a8ffd2ae-4211-492a-a8ac-d4d6cbb4a03d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6811","nonce":2528867083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6813","nonce":2528867083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6817","nonce":2528867083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2528867083},{"type":"v1","addr":"172.21.15.7:6815","nonce":2528867083}]},"public_addr":"172.21.15.7:6811/2528867083","cluster_addr":"172.21.15.7:6813/2528867083","heartbeat_back_addr":"172.21.15.7:6817/2528867083","heartbeat_front_addr":"172.21.15.7:6815/2528867083","state":["exists","up"]},{"osd":4,"uuid":"9a67b2ec-1a0a-413e-bd13-9532f24a0155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6809","nonce":3537143774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537143774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537143774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537143774},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537143774}]},"public_addr":"172.21.15.44:6809/3537143774","cluster_addr":"172.21.15.44:6811/3537143774","heartbeat_back_addr":"172.21.15.44:6815/3537143774","heartbeat_front_addr":"172.21.15.44:6813/3537143774","state":["exists","up"]},{"osd":5,"uuid":"436cd596-710b-48e2-8255-8427c93cee1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6809","nonce":4001214751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6811","nonce":4001214751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6815","nonce":4001214751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":4001214751},{"type":"v1","addr":"172.21.15.175:6813","nonce":4001214751}]},"public_addr":"172.21.15.175:6809/4001214751","cluster_addr":"172.21.15.175:6811/4001214751","heartbeat_back_addr":"172.21.15.175:6815/4001214751","heartbeat_front_addr":"172.21.15.175:6813/4001214751","state":["exists","up"]},{"osd":6,"uuid":"f5a7ad2b-6b44-4b5a-8af7-f7fb00e7ca68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6819","nonce":1261079202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6821","nonce":1261079202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6825","nonce":1261079202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1261079202},{"type":"v1","addr":"172.21.15.7:6823","nonce":1261079202}]},"public_addr":"172.21.15.7:6819/1261079202","cluster_addr":"172.21.15.7:6821/1261079202","heartbeat_back_addr":"172.21.15.7:6825/1261079202","heartbeat_front_addr":"172.21.15.7:6823/1261079202","state":["exists","up"]},{"osd":7,"uuid":"aa24aee5-6449-4842-8831-1c8e06cde75b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6817","nonce":3120822957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6819","nonce":3120822957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6823","nonce":3120822957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3120822957},{"type":"v1","addr":"172.21.15.44:6821","nonce":3120822957}]},"public_addr":"172.21.15.44:6817/3120822957","cluster_addr":"172.21.15.44:6819/3120822957","heartbeat_back_addr":"172.21.15.44:6823/3120822957","heartbeat_front_addr":"172.21.15.44:6821/3120822957","state":["exists","up"]},{"osd":8,"uuid":"d912501a-bb7a-489e-b6ab-e451fb22210d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6817","nonce":2080374927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6819","nonce":2080374927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6823","nonce":2080374927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2080374927},{"type":"v1","addr":"172.21.15.175:6821","nonce":2080374927}]},"public_addr":"172.21.15.175:6817/2080374927","cluster_addr":"172.21.15.175:6819/2080374927","heartbeat_back_addr":"172.21.15.175:6823/2080374927","heartbeat_front_addr":"172.21.15.175:6821/2080374927","state":["exists","up"]},{"osd":9,"uuid":"d132f5b2-75b9-4d6c-89ec-f52c303e0fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6827","nonce":3808356432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6829","nonce":3808356432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6833","nonce":3808356432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3808356432},{"type":"v1","addr":"172.21.15.7:6831","nonce":3808356432}]},"public_addr":"172.21.15.7:6827/3808356432","cluster_addr":"172.21.15.7:6829/3808356432","heartbeat_back_addr":"172.21.15.7:6833/3808356432","heartbeat_front_addr":"172.21.15.7:6831/3808356432","state":["exists","up"]},{"osd":10,"uuid":"f6c405d6-a255-4e0e-8528-7bbc16d5e434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6825","nonce":4009464689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6827","nonce":4009464689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6831","nonce":4009464689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":4009464689},{"type":"v1","addr":"172.21.15.44:6829","nonce":4009464689}]},"public_addr":"172.21.15.44:6825/4009464689","cluster_addr":"172.21.15.44:6827/4009464689","heartbeat_back_addr":"172.21.15.44:6831/4009464689","heartbeat_front_addr":"172.21.15.44:6829/4009464689","state":["exists","up"]},{"osd":11,"uuid":"a2a046cd-9939-473a-988b-6e0ad28a0233","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6825","nonce":4173951310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6827","nonce":4173951310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6831","nonce":4173951310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":4173951310},{"type":"v1","addr":"172.21.15.175:6829","nonce":4173951310}]},"public_addr":"172.21.15.175:6825/4173951310","cluster_addr":"172.21.15.175:6827/4173951310","heartbeat_back_addr":"172.21.15.175:6831/4173951310","heartbeat_front_addr":"172.21.15.175:6829/4173951310","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:20.015497+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:37:44.967046+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:09.682080+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:38:35.516899+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:00.705686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:25.276387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:39:49.927456+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:14.786755+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:40:38.553913+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:03.962825+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:28.812976+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:41:52.837744+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/973276283":"2024-09-20T08:44:31.163626+0000","172.21.15.7:0/2695884066":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/816886708":"2024-09-20T08:35:31.711540+0000","172.21.15.7:6800/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:6800/3577760109":"2024-09-20T08:44:31.163626+0000","172.21.15.7:0/1429582340":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/1689067491":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/4277640815":"2024-09-20T08:35:31.711540+0000","172.21.15.7:0/499611189":"2024-09-20T08:44:31.163626+0000","172.21.15.7:6801/3577760109":"2024-09-20T08:44:31.163626+0000","172.21.15.7:0/4058698573":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/1800852158":"2024-09-20T08:44:31.163626+0000","172.21.15.7:0/2884903597":"2024-09-20T08:35:56.784361+0000","172.21.15.7:6801/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/2457209252":"2024-09-20T08:44:31.163626+0000","172.21.15.7:6800/3071389382":"2024-09-20T08:35:56.784361+0000","172.21.15.7:0/2008302629":"2024-09-20T08:44:31.163626+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:55:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.306+0000 7fd2b6b0b640 1 -- 172.21.15.7:0/305074266 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd2a00a3430 msgr2=0x7fd2a00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.306+0000 7fd2b6b0b640 1 --2- 172.21.15.7:0/305074266 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd2a00a3430 0x7fd2a00a58f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd2b010d4d0 tx=0x7fd29c005e50 comp rx=0 tx=0).stop 2024-09-19T08:55:14.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.306+0000 7fd2b6b0b640 1 -- 172.21.15.7:0/305074266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2b0102e00 msgr2=0x7fd2b0198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.306+0000 7fd2b6b0b640 1 --2- 172.21.15.7:0/305074266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2b0102e00 0x7fd2b0198430 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4006010 tx=0x7fd2a40042f0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.306+0000 7fd2b6b0b640 1 -- 172.21.15.7:0/305074266 shutdown_connections 2024-09-19T08:55:14.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.306+0000 7fd2b6b0b640 1 --2- 172.21.15.7:0/305074266 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7fd2a00a3430 0x7fd2a00a58f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.306+0000 7fd2b6b0b640 1 --2- 172.21.15.7:0/305074266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2b010c1a0 0x7fd2b019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.306+0000 7fd2b6b0b640 1 --2- 172.21.15.7:0/305074266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2b0103720 0x7fd2b0198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.306+0000 7fd2b6b0b640 1 --2- 172.21.15.7:0/305074266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2b0102e00 0x7fd2b0198430 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.306+0000 7fd2b6b0b640 1 -- 172.21.15.7:0/305074266 >> 172.21.15.7:0/305074266 conn(0x7fd2b00fc7a0 msgr2=0x7fd2b00fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:14.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.306+0000 7fd2b6b0b640 1 -- 172.21.15.7:0/305074266 shutdown_connections 2024-09-19T08:55:14.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:14.306+0000 7fd2b6b0b640 1 -- 172.21.15.7:0/305074266 wait complete. 2024-09-19T08:55:14.677 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:14 smithi007 ceph-mon[31221]: pgmap v333: 97 pgs: 97 active+clean; 2.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-19T08:55:14.677 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:14 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/305074266' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:55:14.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:14 smithi044 ceph-mon[35072]: pgmap v333: 97 pgs: 97 active+clean; 2.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-19T08:55:14.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:14 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/305074266' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:55:14.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:14 smithi175 ceph-mon[35688]: pgmap v333: 97 pgs: 97 active+clean; 2.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-19T08:55:14.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:14 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/305074266' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:55:15.010 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T08:55:15.269 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:15.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.716+0000 7f4eb968d640 1 -- 172.21.15.7:0/4261957128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb41036c0 msgr2=0x7f4eb410bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:15.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.716+0000 7f4eb968d640 1 --2- 172.21.15.7:0/4261957128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb41036c0 0x7f4eb410bbb0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009ca0 tx=0x7f4ea802a950 comp rx=0 tx=0).stop 2024-09-19T08:55:15.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.716+0000 7f4eb968d640 1 -- 172.21.15.7:0/4261957128 shutdown_connections 2024-09-19T08:55:15.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.716+0000 7f4eb968d640 1 --2- 172.21.15.7:0/4261957128 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4eb410c180 0x7f4eb410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:15.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.716+0000 7f4eb968d640 1 --2- 172.21.15.7:0/4261957128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb41036c0 0x7f4eb410bbb0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:15.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.716+0000 7f4eb968d640 1 --2- 172.21.15.7:0/4261957128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eb4102da0 0x7f4eb4103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:15.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.716+0000 7f4eb968d640 1 -- 172.21.15.7:0/4261957128 >> 172.21.15.7:0/4261957128 conn(0x7f4eb40fc7a0 msgr2=0x7f4eb40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:15.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.716+0000 7f4eb968d640 1 -- 172.21.15.7:0/4261957128 shutdown_connections 2024-09-19T08:55:15.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.716+0000 7f4eb968d640 1 -- 172.21.15.7:0/4261957128 wait complete. 2024-09-19T08:55:15.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.716+0000 7f4eb968d640 1 Processor -- start 2024-09-19T08:55:15.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.717+0000 7f4eb968d640 1 -- start start 2024-09-19T08:55:15.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.717+0000 7f4eb968d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eb4102da0 0x7f4eb4100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:15.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.717+0000 7f4eb968d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb41036c0 0x7f4eb4100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:15.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.717+0000 7f4eb968d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4eb410c180 0x7f4eb4101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:15.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.717+0000 7f4eb968d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb4111f60 con 0x7f4eb41036c0 2024-09-19T08:55:15.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.717+0000 7f4eb968d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb4111de0 con 0x7f4eb410c180 2024-09-19T08:55:15.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.717+0000 7f4eb968d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb41120e0 con 0x7f4eb4102da0 2024-09-19T08:55:15.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.717+0000 7f4eb27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb41036c0 0x7f4eb4100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:15.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.717+0000 7f4eb27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb41036c0 0x7f4eb4100f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56502/0 (socket says 172.21.15.7:56502) 2024-09-19T08:55:15.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.717+0000 7f4eb27fc640 1 -- 172.21.15.7:0/1801772920 learned_addr learned my addr 172.21.15.7:0/1801772920 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:55:15.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.717+0000 7f4eb2ffd640 1 --2- 172.21.15.7:0/1801772920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eb4102da0 0x7f4eb4100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:15.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.717+0000 7f4eb37fe640 1 --2- 172.21.15.7:0/1801772920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4eb410c180 0x7f4eb4101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:15.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.717+0000 7f4eb27fc640 1 -- 172.21.15.7:0/1801772920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eb4102da0 msgr2=0x7f4eb4100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:15.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.717+0000 7f4eb27fc640 1 --2- 172.21.15.7:0/1801772920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eb4102da0 0x7f4eb4100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:15.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.717+0000 7f4eb27fc640 1 -- 172.21.15.7:0/1801772920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4eb410c180 msgr2=0x7f4eb4101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:15.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.717+0000 7f4eb27fc640 1 --2- 172.21.15.7:0/1801772920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4eb410c180 0x7f4eb4101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:15.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.717+0000 7f4eb27fc640 1 -- 172.21.15.7:0/1801772920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb41a68f0 con 0x7f4eb41036c0 2024-09-19T08:55:15.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.718+0000 7f4eb27fc640 1 --2- 172.21.15.7:0/1801772920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb41036c0 0x7f4eb4100f40 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8005cc0 tx=0x7f4ea802f630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:15.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.718+0000 7f4e9bfff640 1 -- 172.21.15.7:0/1801772920 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8034040 con 0x7f4eb41036c0 2024-09-19T08:55:15.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.718+0000 7f4e9bfff640 1 -- 172.21.15.7:0/1801772920 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ea8030920 con 0x7f4eb41036c0 2024-09-19T08:55:15.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.718+0000 7f4eb968d640 1 -- 172.21.15.7:0/1801772920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb41a6b80 con 0x7f4eb41036c0 2024-09-19T08:55:15.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.718+0000 7f4e9bfff640 1 -- 172.21.15.7:0/1801772920 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8004830 con 0x7f4eb41036c0 2024-09-19T08:55:15.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.718+0000 7f4eb968d640 1 -- 172.21.15.7:0/1801772920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb41a7060 con 0x7f4eb41036c0 2024-09-19T08:55:15.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.719+0000 7f4eb968d640 1 -- 172.21.15.7:0/1801772920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eb4103180 con 0x7f4eb41036c0 2024-09-19T08:55:15.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.720+0000 7f4e9bfff640 1 -- 172.21.15.7:0/1801772920 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f4ea8037020 con 0x7f4eb41036c0 2024-09-19T08:55:15.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.721+0000 7f4e9bfff640 1 --2- 172.21.15.7:0/1801772920 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4e9c0a33b0 0x7f4e9c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:15.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.721+0000 7f4eb2ffd640 1 --2- 172.21.15.7:0/1801772920 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4e9c0a33b0 0x7f4e9c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:15.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.721+0000 7f4e9bfff640 1 -- 172.21.15.7:0/1801772920 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8629+0+0 (secure 0 0 0) 0x7f4ea80f0c70 con 0x7f4eb41036c0 2024-09-19T08:55:15.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.722+0000 7f4eb2ffd640 1 --2- 172.21.15.7:0/1801772920 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4e9c0a33b0 0x7f4e9c0a5870 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4ea400bbe0 tx=0x7f4ea400b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:15.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.724+0000 7f4e9bfff640 1 -- 172.21.15.7:0/1801772920 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4ea80bd690 con 0x7f4eb41036c0 2024-09-19T08:55:15.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.934+0000 7f4eb968d640 1 -- 172.21.15.7:0/1801772920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4eb41071c0 con 0x7f4eb41036c0 2024-09-19T08:55:15.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.937+0000 7f4e9bfff640 1 -- 172.21.15.7:0/1801772920 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) ==== 161+0+0 (secure 0 0 0) 0x7f4ea80bcf90 con 0x7f4eb41036c0 2024-09-19T08:55:15.936 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T08:55:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.939+0000 7f4eb968d640 1 -- 172.21.15.7:0/1801772920 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4e9c0a33b0 msgr2=0x7f4e9c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.939+0000 7f4eb968d640 1 --2- 172.21.15.7:0/1801772920 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4e9c0a33b0 0x7f4e9c0a5870 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4ea400bbe0 tx=0x7f4ea400b390 comp rx=0 tx=0).stop 2024-09-19T08:55:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.939+0000 7f4eb968d640 1 -- 172.21.15.7:0/1801772920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb41036c0 msgr2=0x7f4eb4100f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.939+0000 7f4eb968d640 1 --2- 172.21.15.7:0/1801772920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb41036c0 0x7f4eb4100f40 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8005cc0 tx=0x7f4ea802f630 comp rx=0 tx=0).stop 2024-09-19T08:55:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.939+0000 7f4eb968d640 1 -- 172.21.15.7:0/1801772920 shutdown_connections 2024-09-19T08:55:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.939+0000 7f4eb968d640 1 --2- 172.21.15.7:0/1801772920 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f4e9c0a33b0 0x7f4e9c0a5870 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.939+0000 7f4eb968d640 1 --2- 172.21.15.7:0/1801772920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4eb410c180 0x7f4eb4101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.939+0000 7f4eb968d640 1 --2- 172.21.15.7:0/1801772920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb41036c0 0x7f4eb4100f40 secure :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8005cc0 tx=0x7f4ea802f630 comp rx=0 tx=0).stop 2024-09-19T08:55:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.939+0000 7f4eb968d640 1 --2- 172.21.15.7:0/1801772920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eb4102da0 0x7f4eb4100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.939+0000 7f4eb968d640 1 -- 172.21.15.7:0/1801772920 >> 172.21.15.7:0/1801772920 conn(0x7f4eb40fc7a0 msgr2=0x7f4eb40fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:15.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.939+0000 7f4eb968d640 1 -- 172.21.15.7:0/1801772920 shutdown_connections 2024-09-19T08:55:15.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:15.939+0000 7f4eb968d640 1 -- 172.21.15.7:0/1801772920 wait complete. 2024-09-19T08:55:16.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:15 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-a[31217]: 2024-09-19T08:55:15.935+0000 7f451b930640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T08:55:16.301 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 19 08:55:15 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-h[64584]: ignoring --setuser ceph since I am not root 2024-09-19T08:55:16.301 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 19 08:55:15 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-h[64584]: ignoring --setgroup ceph since I am not root 2024-09-19T08:55:16.301 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 19 08:55:15 smithi044 ceph-mds[64588]: -- 172.21.15.44:0/3534117625 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bd6efbb860 con 0x55bd6ef99400 2024-09-19T08:55:16.301 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 19 08:55:15 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-h[64584]: starting mds.h at 2024-09-19T08:55:16.301 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 19 08:55:15 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-b[64891]: ignoring --setuser ceph since I am not root 2024-09-19T08:55:16.301 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 19 08:55:15 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-b[64891]: ignoring --setgroup ceph since I am not root 2024-09-19T08:55:16.301 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 19 08:55:15 smithi044 ceph-mds[64895]: -- 172.21.15.44:0/3233437738 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55800ecc1860 con 0x55800ec9f000 2024-09-19T08:55:16.302 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 19 08:55:15 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-b[64891]: starting mds.b at 2024-09-19T08:55:16.302 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 19 08:55:15 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-e[64280]: ignoring --setuser ceph since I am not root 2024-09-19T08:55:16.302 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 19 08:55:15 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-e[64280]: ignoring --setgroup ceph since I am not root 2024-09-19T08:55:16.302 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 19 08:55:15 smithi044 ceph-mds[64284]: -- 172.21.15.44:0/3264526240 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55efbc229860 con 0x55efbc207400 2024-09-19T08:55:16.302 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 19 08:55:15 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-e[64280]: starting mds.e at 2024-09-19T08:55:16.428 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 19 08:55:15 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-c[66211]: ignoring --setuser ceph since I am not root 2024-09-19T08:55:16.428 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 19 08:55:15 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-c[66211]: ignoring --setgroup ceph since I am not root 2024-09-19T08:55:16.428 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 19 08:55:15 smithi175 ceph-mds[66215]: -- 172.21.15.175:0/1722749399 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556c91375c20 con 0x556c91352800 2024-09-19T08:55:16.428 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 19 08:55:15 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-c[66211]: starting mds.c at 2024-09-19T08:55:16.429 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 19 08:55:15 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-f[65906]: ignoring --setuser ceph since I am not root 2024-09-19T08:55:16.429 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 19 08:55:15 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-f[65906]: ignoring --setgroup ceph since I am not root 2024-09-19T08:55:16.429 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 19 08:55:15 smithi175 ceph-mds[65910]: -- 172.21.15.175:0/1251366700 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56067d8ff860 con 0x56067d8dd000 2024-09-19T08:55:16.429 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 19 08:55:15 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-f[65906]: starting mds.f at 2024-09-19T08:55:16.429 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 19 08:55:15 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-i[66517]: ignoring --setuser ceph since I am not root 2024-09-19T08:55:16.429 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 19 08:55:15 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-i[66517]: ignoring --setgroup ceph since I am not root 2024-09-19T08:55:16.429 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 19 08:55:15 smithi175 ceph-mds[66521]: -- 172.21.15.175:0/3550031381 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562bfb53b860 con 0x562bfb519000 2024-09-19T08:55:16.429 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 19 08:55:15 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-i[66517]: starting mds.i at 2024-09-19T08:55:16.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:16 smithi007 ceph-mon[31221]: pgmap v334: 97 pgs: 97 active+clean; 2.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-19T08:55:16.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:16 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1801772920' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T08:55:16.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:16 smithi007 ceph-mon[31221]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T08:55:16.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:16 smithi007 ceph-mon[31221]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T08:55:16.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:16 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1801772920' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T08:55:16.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:16 smithi007 ceph-mon[31221]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T08:55:16.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:16 smithi007 ceph-mon[31221]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T08:55:16.621 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T08:55:16.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:16 smithi044 ceph-mon[35072]: pgmap v334: 97 pgs: 97 active+clean; 2.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-19T08:55:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:16 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1801772920' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T08:55:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:16 smithi044 ceph-mon[35072]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T08:55:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:16 smithi044 ceph-mon[35072]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T08:55:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:16 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1801772920' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T08:55:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:16 smithi044 ceph-mon[35072]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T08:55:16.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:16 smithi044 ceph-mon[35072]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T08:55:16.879 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:16.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:16 smithi175 ceph-mon[35688]: pgmap v334: 97 pgs: 97 active+clean; 2.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-19T08:55:16.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:16 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1801772920' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T08:55:16.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:16 smithi175 ceph-mon[35688]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T08:55:16.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:16 smithi175 ceph-mon[35688]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T08:55:16.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:16 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1801772920' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T08:55:16.928 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:16 smithi175 ceph-mon[35688]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T08:55:16.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:16 smithi175 ceph-mon[35688]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T08:55:17.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.332+0000 7f3e657ee640 1 -- 172.21.15.7:0/1205177710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e60100a80 msgr2=0x7f3e60100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:17.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.332+0000 7f3e657ee640 1 --2- 172.21.15.7:0/1205177710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e60100a80 0x7f3e60100ee0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009930 tx=0x7f3e4802a420 comp rx=0 tx=0).stop 2024-09-19T08:55:17.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.332+0000 7f3e657ee640 1 -- 172.21.15.7:0/1205177710 shutdown_connections 2024-09-19T08:55:17.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.332+0000 7f3e657ee640 1 --2- 172.21.15.7:0/1205177710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e60101420 0x7f3e6010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:17.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.332+0000 7f3e657ee640 1 --2- 172.21.15.7:0/1205177710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e60100a80 0x7f3e60100ee0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:17.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.332+0000 7f3e657ee640 1 --2- 172.21.15.7:0/1205177710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e60106a80 0x7f3e60106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:17.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.332+0000 7f3e657ee640 1 -- 172.21.15.7:0/1205177710 >> 172.21.15.7:0/1205177710 conn(0x7f3e600fc7a0 msgr2=0x7f3e600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:17.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.332+0000 7f3e657ee640 1 -- 172.21.15.7:0/1205177710 shutdown_connections 2024-09-19T08:55:17.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.332+0000 7f3e657ee640 1 -- 172.21.15.7:0/1205177710 wait complete. 2024-09-19T08:55:17.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.333+0000 7f3e657ee640 1 Processor -- start 2024-09-19T08:55:17.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.333+0000 7f3e657ee640 1 -- start start 2024-09-19T08:55:17.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.333+0000 7f3e657ee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e60100a80 0x7f3e6019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:17.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.333+0000 7f3e657ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e60101420 0x7f3e6019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:17.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.333+0000 7f3e657ee640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e60106a80 0x7f3e6019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:17.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.333+0000 7f3e657ee640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3e60110e80 con 0x7f3e60100a80 2024-09-19T08:55:17.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.333+0000 7f3e657ee640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3e60110d00 con 0x7f3e60101420 2024-09-19T08:55:17.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.333+0000 7f3e657ee640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3e60111000 con 0x7f3e60106a80 2024-09-19T08:55:17.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.333+0000 7f3e5effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e60100a80 0x7f3e6019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:17.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.333+0000 7f3e5effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e60100a80 0x7f3e6019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56522/0 (socket says 172.21.15.7:56522) 2024-09-19T08:55:17.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.333+0000 7f3e5effd640 1 -- 172.21.15.7:0/1288503839 learned_addr learned my addr 172.21.15.7:0/1288503839 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:55:17.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.333+0000 7f3e57fff640 1 --2- 172.21.15.7:0/1288503839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e60101420 0x7f3e6019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:17.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.333+0000 7f3e5f7fe640 1 --2- 172.21.15.7:0/1288503839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e60106a80 0x7f3e6019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:17.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.334+0000 7f3e5effd640 1 -- 172.21.15.7:0/1288503839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e60106a80 msgr2=0x7f3e6019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:17.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.334+0000 7f3e5effd640 1 --2- 172.21.15.7:0/1288503839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e60106a80 0x7f3e6019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:17.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.334+0000 7f3e5effd640 1 -- 172.21.15.7:0/1288503839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e60101420 msgr2=0x7f3e6019aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:17.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.334+0000 7f3e5effd640 1 --2- 172.21.15.7:0/1288503839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e60101420 0x7f3e6019aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:17.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.334+0000 7f3e5effd640 1 -- 172.21.15.7:0/1288503839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6019f610 con 0x7f3e60100a80 2024-09-19T08:55:17.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.334+0000 7f3e5effd640 1 --2- 172.21.15.7:0/1288503839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e60100a80 0x7f3e6019a660 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000d770 tx=0x7f3e5000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:17.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.334+0000 7f3e5cff9640 1 -- 172.21.15.7:0/1288503839 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e50017070 con 0x7f3e60100a80 2024-09-19T08:55:17.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.334+0000 7f3e657ee640 1 -- 172.21.15.7:0/1288503839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e6019f900 con 0x7f3e60100a80 2024-09-19T08:55:17.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.334+0000 7f3e5cff9640 1 -- 172.21.15.7:0/1288503839 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e50005500 con 0x7f3e60100a80 2024-09-19T08:55:17.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.334+0000 7f3e5cff9640 1 -- 172.21.15.7:0/1288503839 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e50004e00 con 0x7f3e60100a80 2024-09-19T08:55:17.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.334+0000 7f3e657ee640 1 -- 172.21.15.7:0/1288503839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e601a71e0 con 0x7f3e60100a80 2024-09-19T08:55:17.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.335+0000 7f3e657ee640 1 -- 172.21.15.7:0/1288503839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e601021c0 con 0x7f3e60100a80 2024-09-19T08:55:17.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.336+0000 7f3e5cff9640 1 -- 172.21.15.7:0/1288503839 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f3e50004fa0 con 0x7f3e60100a80 2024-09-19T08:55:17.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.337+0000 7f3e5cff9640 1 --2- 172.21.15.7:0/1288503839 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3e4c0a33b0 0x7f3e4c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:17.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.337+0000 7f3e57fff640 1 --2- 172.21.15.7:0/1288503839 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3e4c0a33b0 0x7f3e4c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:17.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.337+0000 7f3e5cff9640 1 -- 172.21.15.7:0/1288503839 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8843+0+0 (secure 0 0 0) 0x7f3e500cf880 con 0x7f3e60100a80 2024-09-19T08:55:17.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.338+0000 7f3e57fff640 1 --2- 172.21.15.7:0/1288503839 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3e4c0a33b0 0x7f3e4c0a5870 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009900 tx=0x7f3e480058d0 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:17.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.341+0000 7f3e5cff9640 1 -- 172.21.15.7:0/1288503839 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3e5009c120 con 0x7f3e60100a80 2024-09-19T08:55:17.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.552+0000 7f3e657ee640 1 -- 172.21.15.7:0/1288503839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3e601a7410 con 0x7f3e60100a80 2024-09-19T08:55:17.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.944+0000 7f3e5cff9640 1 -- 172.21.15.7:0/1288503839 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) ==== 104+0+0 (secure 0 0 0) 0x7f3e5009ba20 con 0x7f3e60100a80 2024-09-19T08:55:17.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.945+0000 7f3e657ee640 1 -- 172.21.15.7:0/1288503839 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3e4c0a33b0 msgr2=0x7f3e4c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:17.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.945+0000 7f3e657ee640 1 --2- 172.21.15.7:0/1288503839 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3e4c0a33b0 0x7f3e4c0a5870 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009900 tx=0x7f3e480058d0 comp rx=0 tx=0).stop 2024-09-19T08:55:17.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.945+0000 7f3e657ee640 1 -- 172.21.15.7:0/1288503839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e60100a80 msgr2=0x7f3e6019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:17.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.945+0000 7f3e657ee640 1 --2- 172.21.15.7:0/1288503839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e60100a80 0x7f3e6019a660 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000d770 tx=0x7f3e5000dc30 comp rx=0 tx=0).stop 2024-09-19T08:55:17.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.945+0000 7f3e657ee640 1 -- 172.21.15.7:0/1288503839 shutdown_connections 2024-09-19T08:55:17.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.945+0000 7f3e657ee640 1 --2- 172.21.15.7:0/1288503839 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f3e4c0a33b0 0x7f3e4c0a5870 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:17.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.945+0000 7f3e657ee640 1 --2- 172.21.15.7:0/1288503839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e60106a80 0x7f3e6019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:17.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.945+0000 7f3e657ee640 1 --2- 172.21.15.7:0/1288503839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e60101420 0x7f3e6019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:17.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.945+0000 7f3e657ee640 1 --2- 172.21.15.7:0/1288503839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e60100a80 0x7f3e6019a660 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:17.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.945+0000 7f3e657ee640 1 -- 172.21.15.7:0/1288503839 >> 172.21.15.7:0/1288503839 conn(0x7f3e600fc7a0 msgr2=0x7f3e6006a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:17.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.946+0000 7f3e657ee640 1 -- 172.21.15.7:0/1288503839 shutdown_connections 2024-09-19T08:55:17.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:17.946+0000 7f3e657ee640 1 -- 172.21.15.7:0/1288503839 wait complete. 2024-09-19T08:55:18.260 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:17 smithi007 ceph-mon[31221]: mds.? [v2:172.21.15.44:6835/3810123174,v1:172.21.15.44:6838/3810123174] up:boot 2024-09-19T08:55:18.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:17 smithi007 ceph-mon[31221]: mds.? [v2:172.21.15.44:6834/643504683,v1:172.21.15.44:6837/643504683] up:boot 2024-09-19T08:55:18.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:17 smithi007 ceph-mon[31221]: mds.? [v2:172.21.15.44:6836/3582921934,v1:172.21.15.44:6839/3582921934] up:boot 2024-09-19T08:55:18.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:17 smithi007 ceph-mon[31221]: mds.? [v2:172.21.15.175:6836/2429502400,v1:172.21.15.175:6838/2429502400] up:boot 2024-09-19T08:55:18.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:17 smithi007 ceph-mon[31221]: mds.? [v2:172.21.15.175:6834/1964235103,v1:172.21.15.175:6837/1964235103] up:boot 2024-09-19T08:55:18.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:17 smithi007 ceph-mon[31221]: mds.? [v2:172.21.15.175:6835/2632765437,v1:172.21.15.175:6839/2632765437] up:boot 2024-09-19T08:55:18.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:17 smithi007 ceph-mon[31221]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T08:55:18.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:17 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:55:18.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:17 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:55:18.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:17 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:55:18.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:17 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:55:18.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:17 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:55:18.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:17 smithi007 ceph-mon[31221]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:55:18.262 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:17 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1288503839' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:55:18.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:17 smithi044 ceph-mon[35072]: mds.? [v2:172.21.15.44:6835/3810123174,v1:172.21.15.44:6838/3810123174] up:boot 2024-09-19T08:55:18.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:17 smithi044 ceph-mon[35072]: mds.? [v2:172.21.15.44:6834/643504683,v1:172.21.15.44:6837/643504683] up:boot 2024-09-19T08:55:18.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:17 smithi044 ceph-mon[35072]: mds.? [v2:172.21.15.44:6836/3582921934,v1:172.21.15.44:6839/3582921934] up:boot 2024-09-19T08:55:18.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:17 smithi044 ceph-mon[35072]: mds.? [v2:172.21.15.175:6836/2429502400,v1:172.21.15.175:6838/2429502400] up:boot 2024-09-19T08:55:18.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:17 smithi044 ceph-mon[35072]: mds.? [v2:172.21.15.175:6834/1964235103,v1:172.21.15.175:6837/1964235103] up:boot 2024-09-19T08:55:18.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:17 smithi044 ceph-mon[35072]: mds.? [v2:172.21.15.175:6835/2632765437,v1:172.21.15.175:6839/2632765437] up:boot 2024-09-19T08:55:18.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:17 smithi044 ceph-mon[35072]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T08:55:18.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:17 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:55:18.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:17 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:55:18.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:17 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:55:18.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:17 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:55:18.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:17 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:55:18.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:17 smithi044 ceph-mon[35072]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:55:18.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:17 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1288503839' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:55:18.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:17 smithi175 ceph-mon[35688]: mds.? [v2:172.21.15.44:6835/3810123174,v1:172.21.15.44:6838/3810123174] up:boot 2024-09-19T08:55:18.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:17 smithi175 ceph-mon[35688]: mds.? [v2:172.21.15.44:6834/643504683,v1:172.21.15.44:6837/643504683] up:boot 2024-09-19T08:55:18.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:17 smithi175 ceph-mon[35688]: mds.? [v2:172.21.15.44:6836/3582921934,v1:172.21.15.44:6839/3582921934] up:boot 2024-09-19T08:55:18.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:17 smithi175 ceph-mon[35688]: mds.? [v2:172.21.15.175:6836/2429502400,v1:172.21.15.175:6838/2429502400] up:boot 2024-09-19T08:55:18.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:17 smithi175 ceph-mon[35688]: mds.? [v2:172.21.15.175:6834/1964235103,v1:172.21.15.175:6837/1964235103] up:boot 2024-09-19T08:55:18.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:17 smithi175 ceph-mon[35688]: mds.? [v2:172.21.15.175:6835/2632765437,v1:172.21.15.175:6839/2632765437] up:boot 2024-09-19T08:55:18.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:17 smithi175 ceph-mon[35688]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T08:55:18.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:17 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:55:18.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:17 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:55:18.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:17 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:55:18.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:17 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:55:18.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:17 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:55:18.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:17 smithi175 ceph-mon[35688]: from='mgr.15132 172.21.15.7:0/2527293981' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:55:18.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:17 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1288503839' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:55:18.581 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T08:55:18.844 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:19.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:18 smithi007 ceph-mon[31221]: pgmap v336: 97 pgs: 97 active+clean; 2.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-19T08:55:19.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:18 smithi007 ceph-mon[31221]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T08:55:19.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:18 smithi007 ceph-mon[31221]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T08:55:19.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:18 smithi007 ceph-mon[31221]: Cluster is now healthy 2024-09-19T08:55:19.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:18 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1288503839' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:55:19.249 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:18 smithi007 ceph-mon[31221]: fsmap 12 up:standby 2024-09-19T08:55:19.249 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:18 smithi007 ceph-mon[31221]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T08:55:19.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:18 smithi044 ceph-mon[35072]: pgmap v336: 97 pgs: 97 active+clean; 2.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-19T08:55:19.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:18 smithi044 ceph-mon[35072]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T08:55:19.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:18 smithi044 ceph-mon[35072]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T08:55:19.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:18 smithi044 ceph-mon[35072]: Cluster is now healthy 2024-09-19T08:55:19.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:18 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1288503839' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:55:19.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:18 smithi044 ceph-mon[35072]: fsmap 12 up:standby 2024-09-19T08:55:19.301 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:18 smithi044 ceph-mon[35072]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T08:55:19.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.335+0000 7f5f71b62640 1 -- 172.21.15.7:0/946392434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f6c103780 msgr2=0x7f5f6c107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:19.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.335+0000 7f5f71b62640 1 --2- 172.21.15.7:0/946392434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f6c103780 0x7f5f6c107bc0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f5f60009930 tx=0x7f5f6002a420 comp rx=0 tx=0).stop 2024-09-19T08:55:19.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.335+0000 7f5f71b62640 1 -- 172.21.15.7:0/946392434 shutdown_connections 2024-09-19T08:55:19.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.335+0000 7f5f71b62640 1 --2- 172.21.15.7:0/946392434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f6c108300 0x7f5f6c10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.335+0000 7f5f71b62640 1 --2- 172.21.15.7:0/946392434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f6c103780 0x7f5f6c107bc0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.335+0000 7f5f71b62640 1 --2- 172.21.15.7:0/946392434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f6c102dd0 0x7f5f6c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.335+0000 7f5f71b62640 1 -- 172.21.15.7:0/946392434 >> 172.21.15.7:0/946392434 conn(0x7f5f6c0fc7d0 msgr2=0x7f5f6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:19.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.335+0000 7f5f71b62640 1 -- 172.21.15.7:0/946392434 shutdown_connections 2024-09-19T08:55:19.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.335+0000 7f5f71b62640 1 -- 172.21.15.7:0/946392434 wait complete. 2024-09-19T08:55:19.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.335+0000 7f5f71b62640 1 Processor -- start 2024-09-19T08:55:19.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.335+0000 7f5f71b62640 1 -- start start 2024-09-19T08:55:19.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.336+0000 7f5f71b62640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f6c102dd0 0x7f5f6c100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:19.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.336+0000 7f5f71b62640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f6c103780 0x7f5f6c100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:19.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.336+0000 7f5f71b62640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f6c108300 0x7f5f6c1014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:19.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.336+0000 7f5f71b62640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6c112050 con 0x7f5f6c103780 2024-09-19T08:55:19.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.336+0000 7f5f71b62640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6c111ed0 con 0x7f5f6c108300 2024-09-19T08:55:19.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.336+0000 7f5f71b62640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6c1121d0 con 0x7f5f6c102dd0 2024-09-19T08:55:19.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.336+0000 7f5f6affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f6c103780 0x7f5f6c100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:19.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.336+0000 7f5f6affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f6c103780 0x7f5f6c100f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56540/0 (socket says 172.21.15.7:56540) 2024-09-19T08:55:19.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.336+0000 7f5f6affd640 1 -- 172.21.15.7:0/1242212198 learned_addr learned my addr 172.21.15.7:0/1242212198 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:55:19.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.336+0000 7f5f6bfff640 1 --2- 172.21.15.7:0/1242212198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f6c108300 0x7f5f6c1014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:19.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.336+0000 7f5f6b7fe640 1 --2- 172.21.15.7:0/1242212198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f6c102dd0 0x7f5f6c100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.336+0000 7f5f6affd640 1 -- 172.21.15.7:0/1242212198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f6c102dd0 msgr2=0x7f5f6c100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.336+0000 7f5f6affd640 1 --2- 172.21.15.7:0/1242212198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f6c102dd0 0x7f5f6c100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.336+0000 7f5f6affd640 1 -- 172.21.15.7:0/1242212198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f6c108300 msgr2=0x7f5f6c1014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.336+0000 7f5f6affd640 1 --2- 172.21.15.7:0/1242212198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f6c108300 0x7f5f6c1014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.336+0000 7f5f6affd640 1 -- 172.21.15.7:0/1242212198 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f6c1a6a10 con 0x7f5f6c103780 2024-09-19T08:55:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.336+0000 7f5f6affd640 1 --2- 172.21.15.7:0/1242212198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f6c103780 0x7f5f6c100f70 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f5f60005940 tx=0x7f5f600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.337+0000 7f5f68ff9640 1 -- 172.21.15.7:0/1242212198 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6003f030 con 0x7f5f6c103780 2024-09-19T08:55:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.337+0000 7f5f71b62640 1 -- 172.21.15.7:0/1242212198 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f6c1a6ca0 con 0x7f5f6c103780 2024-09-19T08:55:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.337+0000 7f5f68ff9640 1 -- 172.21.15.7:0/1242212198 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f60003ce0 con 0x7f5f6c103780 2024-09-19T08:55:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.337+0000 7f5f68ff9640 1 -- 172.21.15.7:0/1242212198 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f60035070 con 0x7f5f6c103780 2024-09-19T08:55:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.337+0000 7f5f71b62640 1 -- 172.21.15.7:0/1242212198 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f6c1a7180 con 0x7f5f6c103780 2024-09-19T08:55:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.338+0000 7f5f71b62640 1 -- 172.21.15.7:0/1242212198 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f6c1031b0 con 0x7f5f6c103780 2024-09-19T08:55:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.339+0000 7f5f68ff9640 1 -- 172.21.15.7:0/1242212198 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f5f60042030 con 0x7f5f6c103780 2024-09-19T08:55:19.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.340+0000 7f5f68ff9640 1 --2- 172.21.15.7:0/1242212198 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5f540a33b0 0x7f5f540a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:19.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.340+0000 7f5f6b7fe640 1 --2- 172.21.15.7:0/1242212198 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5f540a33b0 0x7f5f540a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:19.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.340+0000 7f5f68ff9640 1 -- 172.21.15.7:0/1242212198 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8843+0+0 (secure 0 0 0) 0x7f5f600f0260 con 0x7f5f6c103780 2024-09-19T08:55:19.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.340+0000 7f5f6b7fe640 1 --2- 172.21.15.7:0/1242212198 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5f540a33b0 0x7f5f540a5870 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c00bbe0 tx=0x7f5f5c00b390 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:19.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.344+0000 7f5f68ff9640 1 -- 172.21.15.7:0/1242212198 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5f600bc4b0 con 0x7f5f6c103780 2024-09-19T08:55:19.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:18 smithi175 ceph-mon[35688]: pgmap v336: 97 pgs: 97 active+clean; 2.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-19T08:55:19.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:18 smithi175 ceph-mon[35688]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T08:55:19.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:18 smithi175 ceph-mon[35688]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T08:55:19.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:18 smithi175 ceph-mon[35688]: Cluster is now healthy 2024-09-19T08:55:19.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:18 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1288503839' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:55:19.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:18 smithi175 ceph-mon[35688]: fsmap 12 up:standby 2024-09-19T08:55:19.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:18 smithi175 ceph-mon[35688]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T08:55:19.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.520+0000 7f5f71b62640 1 -- 172.21.15.7:0/1242212198 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5f6c10a290 con 0x7f5f6c103780 2024-09-19T08:55:19.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.950+0000 7f5f68ff9640 1 -- 172.21.15.7:0/1242212198 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v95) ==== 181+0+0 (secure 0 0 0) 0x7f5f600c07b0 con 0x7f5f6c103780 2024-09-19T08:55:19.951 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-09-19T08:55:19.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.953+0000 7f5f71b62640 1 -- 172.21.15.7:0/1242212198 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5f540a33b0 msgr2=0x7f5f540a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:19.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.953+0000 7f5f71b62640 1 --2- 172.21.15.7:0/1242212198 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5f540a33b0 0x7f5f540a5870 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c00bbe0 tx=0x7f5f5c00b390 comp rx=0 tx=0).stop 2024-09-19T08:55:19.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.953+0000 7f5f71b62640 1 -- 172.21.15.7:0/1242212198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f6c103780 msgr2=0x7f5f6c100f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:19.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.953+0000 7f5f71b62640 1 --2- 172.21.15.7:0/1242212198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f6c103780 0x7f5f6c100f70 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f5f60005940 tx=0x7f5f600042f0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.953+0000 7f5f71b62640 1 -- 172.21.15.7:0/1242212198 shutdown_connections 2024-09-19T08:55:19.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.953+0000 7f5f71b62640 1 --2- 172.21.15.7:0/1242212198 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f5f540a33b0 0x7f5f540a5870 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.953+0000 7f5f71b62640 1 --2- 172.21.15.7:0/1242212198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f6c108300 0x7f5f6c1014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.953+0000 7f5f71b62640 1 --2- 172.21.15.7:0/1242212198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f6c103780 0x7f5f6c100f70 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.953+0000 7f5f71b62640 1 --2- 172.21.15.7:0/1242212198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f6c102dd0 0x7f5f6c100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.953+0000 7f5f71b62640 1 -- 172.21.15.7:0/1242212198 >> 172.21.15.7:0/1242212198 conn(0x7f5f6c0fc7d0 msgr2=0x7f5f6c105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:19.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.953+0000 7f5f71b62640 1 -- 172.21.15.7:0/1242212198 shutdown_connections 2024-09-19T08:55:19.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:19.954+0000 7f5f71b62640 1 -- 172.21.15.7:0/1242212198 wait complete. 2024-09-19T08:55:20.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:19 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1242212198' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:55:20.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:19 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1242212198' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:55:20.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:19 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1242212198' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:55:20.652 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid ebd23124-7661-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T08:55:20.913 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:21.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:20 smithi007 ceph-mon[31221]: pgmap v338: 97 pgs: 97 active+clean; 2.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-19T08:55:21.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:20 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/1242212198' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:55:21.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:20 smithi007 ceph-mon[31221]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T08:55:21.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:20 smithi044 ceph-mon[35072]: pgmap v338: 97 pgs: 97 active+clean; 2.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-19T08:55:21.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:20 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/1242212198' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:55:21.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:20 smithi044 ceph-mon[35072]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T08:55:21.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.376+0000 7f48d2354640 1 -- 172.21.15.7:0/673136801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48cc102d40 msgr2=0x7f48cc103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:21.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.376+0000 7f48d2354640 1 --2- 172.21.15.7:0/673136801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48cc102d40 0x7f48cc103120 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f48bc009900 tx=0x7f48bc02a480 comp rx=0 tx=0).stop 2024-09-19T08:55:21.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.376+0000 7f48d2354640 1 -- 172.21.15.7:0/673136801 shutdown_connections 2024-09-19T08:55:21.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.376+0000 7f48d2354640 1 --2- 172.21.15.7:0/673136801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48cc10c170 0x7f48cc10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.376+0000 7f48d2354640 1 --2- 172.21.15.7:0/673136801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48cc103660 0x7f48cc10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.376+0000 7f48d2354640 1 --2- 172.21.15.7:0/673136801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48cc102d40 0x7f48cc103120 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.376+0000 7f48d2354640 1 -- 172.21.15.7:0/673136801 >> 172.21.15.7:0/673136801 conn(0x7f48cc0fc7a0 msgr2=0x7f48cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:21.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.376+0000 7f48d2354640 1 -- 172.21.15.7:0/673136801 shutdown_connections 2024-09-19T08:55:21.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.376+0000 7f48d2354640 1 -- 172.21.15.7:0/673136801 wait complete. 2024-09-19T08:55:21.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.377+0000 7f48d2354640 1 Processor -- start 2024-09-19T08:55:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.377+0000 7f48d2354640 1 -- start start 2024-09-19T08:55:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.377+0000 7f48d2354640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48cc102d40 0x7f48cc198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.377+0000 7f48d2354640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48cc103660 0x7f48cc198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.377+0000 7f48d2354640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48cc10c170 0x7f48cc19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.377+0000 7f48d2354640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc111f70 con 0x7f48cc10c170 2024-09-19T08:55:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.377+0000 7f48d2354640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc111df0 con 0x7f48cc102d40 2024-09-19T08:55:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.377+0000 7f48d2354640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc1120f0 con 0x7f48cc103660 2024-09-19T08:55:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.377+0000 7f48d08f1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48cc10c170 0x7f48cc19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.377+0000 7f48d08f1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48cc10c170 0x7f48cc19ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56548/0 (socket says 172.21.15.7:56548) 2024-09-19T08:55:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.377+0000 7f48d08f1640 1 -- 172.21.15.7:0/288026959 learned_addr learned my addr 172.21.15.7:0/288026959 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T08:55:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.377+0000 7f48cbfff640 1 --2- 172.21.15.7:0/288026959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48cc102d40 0x7f48cc198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.378+0000 7f48cb7fe640 1 --2- 172.21.15.7:0/288026959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48cc103660 0x7f48cc198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.378+0000 7f48d08f1640 1 -- 172.21.15.7:0/288026959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48cc103660 msgr2=0x7f48cc198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:21.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.378+0000 7f48d08f1640 1 --2- 172.21.15.7:0/288026959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48cc103660 0x7f48cc198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.378+0000 7f48d08f1640 1 -- 172.21.15.7:0/288026959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48cc102d40 msgr2=0x7f48cc198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:21.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.378+0000 7f48d08f1640 1 --2- 172.21.15.7:0/288026959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48cc102d40 0x7f48cc198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.378+0000 7f48d08f1640 1 -- 172.21.15.7:0/288026959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48cc19d3b0 con 0x7f48cc10c170 2024-09-19T08:55:21.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.378+0000 7f48cb7fe640 1 --2- 172.21.15.7:0/288026959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48cc103660 0x7f48cc198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:21.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.378+0000 7f48d08f1640 1 --2- 172.21.15.7:0/288026959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48cc10c170 0x7f48cc19ccd0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009fd0 tx=0x7f48c400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:21.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.378+0000 7f48c97fa640 1 -- 172.21.15.7:0/288026959 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4017070 con 0x7f48cc10c170 2024-09-19T08:55:21.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.378+0000 7f48d2354640 1 -- 172.21.15.7:0/288026959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48cc19d6a0 con 0x7f48cc10c170 2024-09-19T08:55:21.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.378+0000 7f48c97fa640 1 -- 172.21.15.7:0/288026959 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48c4003e50 con 0x7f48cc10c170 2024-09-19T08:55:21.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.378+0000 7f48c97fa640 1 -- 172.21.15.7:0/288026959 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c40106c0 con 0x7f48cc10c170 2024-09-19T08:55:21.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.378+0000 7f48d2354640 1 -- 172.21.15.7:0/288026959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48cc1a4f80 con 0x7f48cc10c170 2024-09-19T08:55:21.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.379+0000 7f48d2354640 1 -- 172.21.15.7:0/288026959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48cc103120 con 0x7f48cc10c170 2024-09-19T08:55:21.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.381+0000 7f48c97fa640 1 -- 172.21.15.7:0/288026959 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f48c4003970 con 0x7f48cc10c170 2024-09-19T08:55:21.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.381+0000 7f48c97fa640 1 --2- 172.21.15.7:0/288026959 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f48b40a33b0 0x7f48b40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:21.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.381+0000 7f48cbfff640 1 --2- 172.21.15.7:0/288026959 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f48b40a33b0 0x7f48b40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:21.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.381+0000 7f48c97fa640 1 -- 172.21.15.7:0/288026959 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8245+0+0 (secure 0 0 0) 0x7f48c40cf9d0 con 0x7f48cc10c170 2024-09-19T08:55:21.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.382+0000 7f48cbfff640 1 --2- 172.21.15.7:0/288026959 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f48b40a33b0 0x7f48b40a5870 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f48bc005ab0 tx=0x7f48bc005a20 comp rx=0 tx=0).ready entity=mgr.15132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:21.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.384+0000 7f48c97fa640 1 -- 172.21.15.7:0/288026959 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f48c409c4c0 con 0x7f48cc10c170 2024-09-19T08:55:21.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:20 smithi175 ceph-mon[35688]: pgmap v338: 97 pgs: 97 active+clean; 2.1 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-19T08:55:21.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:20 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/1242212198' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:55:21.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:20 smithi175 ceph-mon[35688]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T08:55:21.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.561+0000 7f48d2354640 1 -- 172.21.15.7:0/288026959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f48cc02d7c0 con 0x7f48cc10c170 2024-09-19T08:55:21.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.957+0000 7f48c97fa640 1 -- 172.21.15.7:0/288026959 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v96) ==== 169+0+0 (secure 0 0 0) 0x7f48c409bdc0 con 0x7f48cc10c170 2024-09-19T08:55:21.958 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-09-19T08:55:21.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.961+0000 7f48d2354640 1 -- 172.21.15.7:0/288026959 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f48b40a33b0 msgr2=0x7f48b40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:21.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.961+0000 7f48d2354640 1 --2- 172.21.15.7:0/288026959 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f48b40a33b0 0x7f48b40a5870 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f48bc005ab0 tx=0x7f48bc005a20 comp rx=0 tx=0).stop 2024-09-19T08:55:21.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.962+0000 7f48d2354640 1 -- 172.21.15.7:0/288026959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48cc10c170 msgr2=0x7f48cc19ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:21.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.962+0000 7f48d2354640 1 --2- 172.21.15.7:0/288026959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48cc10c170 0x7f48cc19ccd0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009fd0 tx=0x7f48c400b260 comp rx=0 tx=0).stop 2024-09-19T08:55:21.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.962+0000 7f48d2354640 1 -- 172.21.15.7:0/288026959 shutdown_connections 2024-09-19T08:55:21.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.962+0000 7f48d2354640 1 --2- 172.21.15.7:0/288026959 >> [v2:172.21.15.7:6800/3061932294,v1:172.21.15.7:6801/3061932294] conn(0x7f48b40a33b0 0x7f48b40a5870 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.962+0000 7f48d2354640 1 --2- 172.21.15.7:0/288026959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48cc10c170 0x7f48cc19ccd0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.962+0000 7f48d2354640 1 --2- 172.21.15.7:0/288026959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48cc103660 0x7f48cc198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.962+0000 7f48d2354640 1 --2- 172.21.15.7:0/288026959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48cc102d40 0x7f48cc198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.962+0000 7f48d2354640 1 -- 172.21.15.7:0/288026959 >> 172.21.15.7:0/288026959 conn(0x7f48cc0fc7a0 msgr2=0x7f48cc0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:21.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.962+0000 7f48d2354640 1 -- 172.21.15.7:0/288026959 shutdown_connections 2024-09-19T08:55:21.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T08:55:21.962+0000 7f48d2354640 1 -- 172.21.15.7:0/288026959 wait complete. 2024-09-19T08:55:22.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:21 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/288026959' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:55:22.300 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:21 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/288026959' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:55:22.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:21 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/288026959' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:55:22.677 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:55:22.707 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:55:22.741 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:55:22.773 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T08:55:22.774 DEBUG:teuthology.orchestra.run.smithi007:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T08:55:22.791 DEBUG:teuthology.orchestra.run.smithi044:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T08:55:22.808 DEBUG:teuthology.orchestra.run.smithi175:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T08:55:22.831 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T08:55:22.831 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T08:55:22.831 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@mon.a 2024-09-19T08:55:22.959 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:22 smithi007 systemd[1]: Stopping Ceph mon.a for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:23.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:22 smithi044 ceph-mon[35072]: pgmap v340: 65 pgs: 65 active+clean; 577 KiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:55:23.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:22 smithi044 ceph-mon[35072]: from='client.? 172.21.15.7:0/288026959' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:55:23.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:22 smithi044 ceph-mon[35072]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T08:55:23.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:22 smithi175 ceph-mon[35688]: pgmap v340: 65 pgs: 65 active+clean; 577 KiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:55:23.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:22 smithi175 ceph-mon[35688]: from='client.? 172.21.15.7:0/288026959' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:55:23.178 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:22 smithi175 ceph-mon[35688]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T08:55:23.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:22 smithi007 ceph-mon[31221]: pgmap v340: 65 pgs: 65 active+clean; 577 KiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:55:23.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:22 smithi007 ceph-mon[31221]: from='client.? 172.21.15.7:0/288026959' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:55:23.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:22 smithi007 ceph-mon[31221]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T08:55:23.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:23 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-a[31217]: 2024-09-19T08:55:23.139+0000 7f452113b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:55:23.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:23 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-a[31217]: 2024-09-19T08:55:23.139+0000 7f452113b640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T08:55:23.649 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:23 smithi007 podman[111364]: 2024-09-19 08:55:23.366417441 +0000 UTC m=+0.339648871 container died 282f2e2cd87e7551748477398a68993698d50d8a5eb9305974418709d71535f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:55:24.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:23 smithi007 podman[111364]: 2024-09-19 08:55:23.816318038 +0000 UTC m=+0.789549526 container cleanup 282f2e2cd87e7551748477398a68993698d50d8a5eb9305974418709d71535f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T08:55:24.033 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 08:55:23 smithi007 bash[111364]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-a 2024-09-19T08:55:24.254 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T08:55:24.302 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:55:24.302 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T08:55:24.302 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T08:55:24.302 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@mon.b 2024-09-19T08:55:24.594 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:24 smithi044 systemd[1]: Stopping Ceph mon.b for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:25.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:24 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-b[35068]: 2024-09-19T08:55:24.594+0000 7f4b1a77b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:55:25.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:24 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-b[35068]: 2024-09-19T08:55:24.594+0000 7f4b1a77b640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T08:55:25.051 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:24 smithi044 podman[70045]: 2024-09-19 08:55:24.830301504 +0000 UTC m=+0.325717539 container died 03cb4d59dff28013f947335bb6da51736e8c9d32ed7cb2cda0e4cb064832d362 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:55:25.453 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:25 smithi044 podman[70045]: 2024-09-19 08:55:25.278288784 +0000 UTC m=+0.773704813 container cleanup 03cb4d59dff28013f947335bb6da51736e8c9d32ed7cb2cda0e4cb064832d362 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T08:55:25.453 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:25 smithi044 bash[70045]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-b 2024-09-19T08:55:25.710 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 19 08:55:25 smithi044 podman[70057]: 2024-09-19 08:55:25.454312906 +0000 UTC m=+0.616206529 container remove 03cb4d59dff28013f947335bb6da51736e8c9d32ed7cb2cda0e4cb064832d362 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-b, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:55:25.715 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T08:55:25.758 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:55:25.759 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T08:55:25.759 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T08:55:25.759 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@mon.c 2024-09-19T08:55:26.075 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:25 smithi175 systemd[1]: Stopping Ceph mon.c for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:26.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:26 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-c[35684]: 2024-09-19T08:55:26.074+0000 7fe77ca0c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:55:26.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:26 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-c[35684]: 2024-09-19T08:55:26.074+0000 7fe77ca0c640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T08:55:26.428 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:26 smithi175 podman[71858]: 2024-09-19 08:55:26.248763603 +0000 UTC m=+0.290058362 container died 80c98532c4cd9974bf48ca01a9df595ac1e7dbdfa21c736074d6ddb21a7d69bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T08:55:26.909 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:26 smithi175 podman[71858]: 2024-09-19 08:55:26.608980289 +0000 UTC m=+0.650275037 container cleanup 80c98532c4cd9974bf48ca01a9df595ac1e7dbdfa21c736074d6ddb21a7d69bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-c, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T08:55:26.909 INFO:journalctl@ceph.mon.c.smithi175.stdout:Sep 19 08:55:26 smithi175 bash[71858]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-mon-c 2024-09-19T08:55:27.044 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T08:55:27.096 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:55:27.096 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T08:55:27.097 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T08:55:27.097 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@mgr.x 2024-09-19T08:55:27.487 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:55:27 smithi007 systemd[1]: Stopping Ceph mgr.x for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:27.783 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:55:27 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x[31445]: 2024-09-19T08:55:27.485+0000 7fccb33c3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:55:27.783 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:55:27 smithi007 podman[111487]: 2024-09-19 08:55:27.518149045 +0000 UTC m=+0.223332232 container died f5f679817b5bd4e3ff971b1477158dae3f3204c2f12f419db0ed359a64ff8d95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T08:55:28.283 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:55:27 smithi007 podman[111487]: 2024-09-19 08:55:27.995912304 +0000 UTC m=+0.701095520 container cleanup f5f679817b5bd4e3ff971b1477158dae3f3204c2f12f419db0ed359a64ff8d95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T08:55:28.283 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 08:55:27 smithi007 bash[111487]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-x 2024-09-19T08:55:28.585 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T08:55:28.621 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:55:28.621 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T08:55:28.621 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T08:55:28.621 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@mgr.y 2024-09-19T08:55:29.013 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:55:28 smithi044 systemd[1]: Stopping Ceph mgr.y for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:29.274 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:55:29 smithi044 podman[70168]: 2024-09-19 08:55:29.01411565 +0000 UTC m=+0.191388456 container died eff015c1c817d66d72b19bdc328cb71ef4bd1be93f3f3e5557a16b1daec6ebdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T08:55:29.550 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:55:29 smithi044 podman[70168]: 2024-09-19 08:55:29.35755485 +0000 UTC m=+0.534827654 container cleanup eff015c1c817d66d72b19bdc328cb71ef4bd1be93f3f3e5557a16b1daec6ebdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T08:55:29.551 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 19 08:55:29 smithi044 bash[70168]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-y 2024-09-19T08:55:29.795 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T08:55:29.829 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:55:29.830 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T08:55:29.830 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T08:55:29.830 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@mgr.z 2024-09-19T08:55:30.168 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:55:29 smithi175 systemd[1]: Stopping Ceph mgr.z for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:30.428 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:55:30 smithi175 podman[71984]: 2024-09-19 08:55:30.169228671 +0000 UTC m=+0.146684716 container died fb7cd1055273ca0975b7a459cc14009da5249fb7be33f8066e930be22c33f1b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T08:55:30.805 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:55:30 smithi175 podman[71984]: 2024-09-19 08:55:30.512838522 +0000 UTC m=+0.490294564 container cleanup fb7cd1055273ca0975b7a459cc14009da5249fb7be33f8066e930be22c33f1b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:55:30.805 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Sep 19 08:55:30 smithi175 bash[71984]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-mgr-z 2024-09-19T08:55:30.948 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T08:55:30.987 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:55:30.988 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T08:55:30.988 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T08:55:30.988 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.0 2024-09-19T08:55:31.283 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:55:31 smithi007 systemd[1]: Stopping Ceph osd.0 for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:31.783 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:55:31 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-0[44953]: 2024-09-19T08:55:31.291+0000 7efd9e0a8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:55:31.783 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:55:31 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-0[44953]: 2024-09-19T08:55:31.291+0000 7efd9e0a8640 -1 osd.0 96 *** Got signal Terminated *** 2024-09-19T08:55:31.783 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:55:31 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-0[44953]: 2024-09-19T08:55:31.291+0000 7efd9e0a8640 -1 osd.0 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:55:37.110 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:55:36 smithi007 podman[111609]: 2024-09-19 08:55:36.815328305 +0000 UTC m=+5.616586113 container died a0a4f44768a9f1b556733f0b192df254c6ed3eec7f1580305a448e9d1f7478ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T08:55:37.443 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:55:37 smithi007 podman[111609]: 2024-09-19 08:55:37.284254578 +0000 UTC m=+6.085512444 container cleanup a0a4f44768a9f1b556733f0b192df254c6ed3eec7f1580305a448e9d1f7478ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T08:55:37.443 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:55:37 smithi007 bash[111609]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-0 2024-09-19T08:55:37.783 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:55:37 smithi007 podman[111625]: 2024-09-19 08:55:37.443834919 +0000 UTC m=+0.619700974 container remove a0a4f44768a9f1b556733f0b192df254c6ed3eec7f1580305a448e9d1f7478ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:55:38.113 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:55:37 smithi007 podman[111717]: 2024-09-19 08:55:37.759153532 +0000 UTC m=+0.016007655 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:55:38.114 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:55:37 smithi007 podman[111717]: 2024-09-19 08:55:37.895306632 +0000 UTC m=+0.152160730 container create e0bc9aa1e0aa7f57d91af43ab81aedfd25ac248c3371480db99d79ebd4727f8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T08:55:38.114 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:55:38 smithi007 podman[111717]: 2024-09-19 08:55:38.114527114 +0000 UTC m=+0.371381235 container init e0bc9aa1e0aa7f57d91af43ab81aedfd25ac248c3371480db99d79ebd4727f8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T08:55:38.533 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:55:38 smithi007 podman[111717]: 2024-09-19 08:55:38.11811044 +0000 UTC m=+0.374964547 container start e0bc9aa1e0aa7f57d91af43ab81aedfd25ac248c3371480db99d79ebd4727f8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T08:55:38.533 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:55:38 smithi007 podman[111717]: 2024-09-19 08:55:38.189436547 +0000 UTC m=+0.446290656 container attach e0bc9aa1e0aa7f57d91af43ab81aedfd25ac248c3371480db99d79ebd4727f8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T08:55:38.533 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 08:55:38 smithi007 podman[111717]: 2024-09-19 08:55:38.318909264 +0000 UTC m=+0.575763381 container died e0bc9aa1e0aa7f57d91af43ab81aedfd25ac248c3371480db99d79ebd4727f8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T08:55:38.948 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T08:55:38.994 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:55:38.994 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T08:55:38.995 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T08:55:38.995 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.1 2024-09-19T08:55:39.300 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:55:39 smithi044 systemd[1]: Stopping Ceph osd.1 for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:39.800 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:55:39 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-1[39565]: 2024-09-19T08:55:39.311+0000 7f592287c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:55:39.801 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:55:39 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-1[39565]: 2024-09-19T08:55:39.311+0000 7f592287c640 -1 osd.1 96 *** Got signal Terminated *** 2024-09-19T08:55:39.801 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:55:39 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-1[39565]: 2024-09-19T08:55:39.311+0000 7f592287c640 -1 osd.1 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:55:45.029 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:55:44 smithi044 podman[70292]: 2024-09-19 08:55:44.771638187 +0000 UTC m=+5.565419982 container died a516a1e2185600e5701d9a43af3029ca67d4c30a6f64b7d36c7b9f826b2e4cf3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-1, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T08:55:45.300 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:55:45 smithi044 podman[70292]: 2024-09-19 08:55:45.128781206 +0000 UTC m=+5.922563011 container cleanup a516a1e2185600e5701d9a43af3029ca67d4c30a6f64b7d36c7b9f826b2e4cf3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-1, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:55:45.301 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:55:45 smithi044 bash[70292]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-1 2024-09-19T08:55:45.800 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:55:45 smithi044 podman[70307]: 2024-09-19 08:55:45.488428108 +0000 UTC m=+0.714033593 container remove a516a1e2185600e5701d9a43af3029ca67d4c30a6f64b7d36c7b9f826b2e4cf3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T08:55:46.182 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:55:45 smithi044 podman[70399]: 2024-09-19 08:55:45.810505507 +0000 UTC m=+0.016466596 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:55:46.183 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:55:45 smithi044 podman[70399]: 2024-09-19 08:55:45.930946437 +0000 UTC m=+0.136907525 container create d9c5e150af5a6a887f1c64e88b8feedfc8d81bc799f50955d7d2f02072c14a09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:55:46.463 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:55:46 smithi044 podman[70399]: 2024-09-19 08:55:46.183457162 +0000 UTC m=+0.389418240 container init d9c5e150af5a6a887f1c64e88b8feedfc8d81bc799f50955d7d2f02072c14a09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T08:55:46.464 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:55:46 smithi044 podman[70399]: 2024-09-19 08:55:46.187013219 +0000 UTC m=+0.392974297 container start d9c5e150af5a6a887f1c64e88b8feedfc8d81bc799f50955d7d2f02072c14a09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T08:55:46.464 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:55:46 smithi044 podman[70399]: 2024-09-19 08:55:46.266728699 +0000 UTC m=+0.472689777 container attach d9c5e150af5a6a887f1c64e88b8feedfc8d81bc799f50955d7d2f02072c14a09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T08:55:46.464 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 19 08:55:46 smithi044 podman[70399]: 2024-09-19 08:55:46.382840534 +0000 UTC m=+0.588801619 container died d9c5e150af5a6a887f1c64e88b8feedfc8d81bc799f50955d7d2f02072c14a09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:55:47.086 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T08:55:47.124 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:55:47.124 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T08:55:47.124 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T08:55:47.124 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.2 2024-09-19T08:55:47.424 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:55:47 smithi175 systemd[1]: Stopping Ceph osd.2 for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:47.678 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:55:47 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-2[40655]: 2024-09-19T08:55:47.424+0000 7f48a483d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:55:47.678 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:55:47 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-2[40655]: 2024-09-19T08:55:47.424+0000 7f48a483d640 -1 osd.2 96 *** Got signal Terminated *** 2024-09-19T08:55:47.678 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:55:47 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-2[40655]: 2024-09-19T08:55:47.424+0000 7f48a483d640 -1 osd.2 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:55:53.178 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:55:52 smithi175 podman[72110]: 2024-09-19 08:55:52.926039597 +0000 UTC m=+5.607216311 container died f556c6382f8b1cff73b807f838ee957da058c830ad9d0e2ea86044d8c8d4f044 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T08:55:53.541 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:55:53 smithi175 podman[72110]: 2024-09-19 08:55:53.291042622 +0000 UTC m=+5.972219335 container cleanup f556c6382f8b1cff73b807f838ee957da058c830ad9d0e2ea86044d8c8d4f044 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T08:55:53.541 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:55:53 smithi175 bash[72110]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-2 2024-09-19T08:55:53.855 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:55:53 smithi175 podman[72137]: 2024-09-19 08:55:53.542126057 +0000 UTC m=+0.616163497 container remove f556c6382f8b1cff73b807f838ee957da058c830ad9d0e2ea86044d8c8d4f044 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T08:55:54.144 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:55:53 smithi175 podman[72231]: 2024-09-19 08:55:53.758699441 +0000 UTC m=+0.015702182 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:55:54.145 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:55:53 smithi175 podman[72231]: 2024-09-19 08:55:53.859645097 +0000 UTC m=+0.116647829 container create a9851c58e569ce81efa50fd891f9f558b86924c66cebb2308b51fd858e18632a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T08:55:54.145 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:55:54 smithi175 podman[72231]: 2024-09-19 08:55:54.0705458 +0000 UTC m=+0.327548532 container init a9851c58e569ce81efa50fd891f9f558b86924c66cebb2308b51fd858e18632a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T08:55:54.145 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:55:54 smithi175 podman[72231]: 2024-09-19 08:55:54.074565558 +0000 UTC m=+0.331568298 container start a9851c58e569ce81efa50fd891f9f558b86924c66cebb2308b51fd858e18632a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T08:55:54.145 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:55:54 smithi175 podman[72231]: 2024-09-19 08:55:54.145440172 +0000 UTC m=+0.402442920 container attach a9851c58e569ce81efa50fd891f9f558b86924c66cebb2308b51fd858e18632a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T08:55:54.428 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:55:54 smithi175 podman[72231]: 2024-09-19 08:55:54.261127026 +0000 UTC m=+0.518129776 container died a9851c58e569ce81efa50fd891f9f558b86924c66cebb2308b51fd858e18632a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T08:55:54.798 INFO:journalctl@ceph.osd.2.smithi175.stdout:Sep 19 08:55:54 smithi175 podman[72254]: 2024-09-19 08:55:54.782206958 +0000 UTC m=+0.515018716 container remove a9851c58e569ce81efa50fd891f9f558b86924c66cebb2308b51fd858e18632a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T08:55:54.803 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T08:55:54.843 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:55:54.844 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T08:55:54.844 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T08:55:54.844 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.3 2024-09-19T08:55:55.161 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 08:55:54 smithi007 systemd[1]: Stopping Ceph osd.3 for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:55:55.533 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 08:55:55 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-3[51872]: 2024-09-19T08:55:55.161+0000 7f3e36077640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:55:55.533 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 08:55:55 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-3[51872]: 2024-09-19T08:55:55.161+0000 7f3e36077640 -1 osd.3 96 *** Got signal Terminated *** 2024-09-19T08:55:55.533 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 08:55:55 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-3[51872]: 2024-09-19T08:55:55.161+0000 7f3e36077640 -1 osd.3 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:55:58.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:55:58 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:55:58.080+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:55:58.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:55:58 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:55:58.171+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:55:58.928 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:55:58 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:55:58.634+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:35.657503+0000 front 2024-09-19T08:55:35.657362+0000 (oldest deadline 2024-09-19T08:55:58.458212+0000) 2024-09-19T08:55:59.173 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 08:55:58 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-3[51872]: 2024-09-19T08:55:58.922+0000 7f3e2e674640 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.986923+0000 front 2024-09-19T08:55:33.986986+0000 (oldest deadline 2024-09-19T08:55:58.087075+0000) 2024-09-19T08:55:59.301 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:55:58 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4[46079]: 2024-09-19T08:55:58.928+0000 7fac1c2aa640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.356884+0000 front 2024-09-19T08:55:33.356809+0000 (oldest deadline 2024-09-19T08:55:58.056822+0000) 2024-09-19T08:55:59.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:55:59 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:55:59.103+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:55:59.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:55:59 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:55:59.174+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:55:59.800 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:55:59 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:55:59.469+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:00.096 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:55:59 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:55:59.679+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:35.657503+0000 front 2024-09-19T08:55:35.657362+0000 (oldest deadline 2024-09-19T08:55:58.458212+0000) 2024-09-19T08:56:00.155 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 08:55:59 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-3[51872]: 2024-09-19T08:55:59.883+0000 7f3e2e674640 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.986923+0000 front 2024-09-19T08:55:33.986986+0000 (oldest deadline 2024-09-19T08:55:58.087075+0000) 2024-09-19T08:56:00.300 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:55:59 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4[46079]: 2024-09-19T08:55:59.911+0000 7fac1c2aa640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.356884+0000 front 2024-09-19T08:55:33.356809+0000 (oldest deadline 2024-09-19T08:55:58.056822+0000) 2024-09-19T08:56:00.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:00 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:00.096+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:00.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:00 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:00.156+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:00.800 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:00 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:00.452+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:00.947 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 08:56:00 smithi007 podman[111820]: 2024-09-19 08:56:00.56935512 +0000 UTC m=+5.517451188 container died 20a9fc83f59153f430a70e0acfda285cc43170bbcd64e33728cb88e2cf34b848 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:56:01.085 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:00 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:00.719+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:35.657503+0000 front 2024-09-19T08:55:35.657362+0000 (oldest deadline 2024-09-19T08:55:58.458212+0000) 2024-09-19T08:56:01.283 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:01 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:01.189+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:01.284 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:00 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:00.947+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:01.284 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 08:56:00 smithi007 podman[111820]: 2024-09-19 08:56:00.97776123 +0000 UTC m=+5.925857297 container cleanup 20a9fc83f59153f430a70e0acfda285cc43170bbcd64e33728cb88e2cf34b848 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T08:56:01.284 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 08:56:00 smithi007 bash[111820]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-3 2024-09-19T08:56:01.285 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 08:56:01 smithi007 podman[111837]: 2024-09-19 08:56:01.195910858 +0000 UTC m=+0.625031513 container remove 20a9fc83f59153f430a70e0acfda285cc43170bbcd64e33728cb88e2cf34b848 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T08:56:01.300 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:56:00 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4[46079]: 2024-09-19T08:56:00.956+0000 7fac1c2aa640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.356884+0000 front 2024-09-19T08:55:33.356809+0000 (oldest deadline 2024-09-19T08:55:58.056822+0000) 2024-09-19T08:56:01.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:01 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:01.086+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:01.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:01 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:01.467+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:01.881 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 08:56:01 smithi007 podman[111925]: 2024-09-19 08:56:01.506959567 +0000 UTC m=+0.016082280 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:56:01.882 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 08:56:01 smithi007 podman[111925]: 2024-09-19 08:56:01.621959559 +0000 UTC m=+0.131082301 container create 6c1c67c77d5a3ae62fefdce896dbb4215f22433a583be9a2c2c9b20f3ca08423 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T08:56:01.882 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 08:56:01 smithi007 podman[111925]: 2024-09-19 08:56:01.882808714 +0000 UTC m=+0.391931420 container init 6c1c67c77d5a3ae62fefdce896dbb4215f22433a583be9a2c2c9b20f3ca08423 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T08:56:02.059 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:01 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:01.716+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:35.657503+0000 front 2024-09-19T08:55:35.657362+0000 (oldest deadline 2024-09-19T08:55:58.458212+0000) 2024-09-19T08:56:02.237 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:01 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:01.945+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:02.238 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 08:56:01 smithi007 podman[111925]: 2024-09-19 08:56:01.886461669 +0000 UTC m=+0.395584370 container start 6c1c67c77d5a3ae62fefdce896dbb4215f22433a583be9a2c2c9b20f3ca08423 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-19T08:56:02.238 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 08:56:01 smithi007 podman[111925]: 2024-09-19 08:56:01.982810783 +0000 UTC m=+0.491933483 container attach 6c1c67c77d5a3ae62fefdce896dbb4215f22433a583be9a2c2c9b20f3ca08423 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T08:56:02.238 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 08:56:02 smithi007 podman[111925]: 2024-09-19 08:56:02.080035422 +0000 UTC m=+0.589158130 container died 6c1c67c77d5a3ae62fefdce896dbb4215f22433a583be9a2c2c9b20f3ca08423 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:56:02.300 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:56:01 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4[46079]: 2024-09-19T08:56:01.962+0000 7fac1c2aa640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.356884+0000 front 2024-09-19T08:55:33.356809+0000 (oldest deadline 2024-09-19T08:55:58.056822+0000) 2024-09-19T08:56:02.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:02 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:02.060+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:02.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:02 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:02.237+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:02.643 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T08:56:02.685 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:56:02.685 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T08:56:02.685 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T08:56:02.686 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.4 2024-09-19T08:56:02.713 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:02 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:02.443+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:02.971 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:56:02 smithi044 systemd[1]: Stopping Ceph osd.4 for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:56:03.085 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:02 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:02.695+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:35.657503+0000 front 2024-09-19T08:55:35.657362+0000 (oldest deadline 2024-09-19T08:55:58.458212+0000) 2024-09-19T08:56:03.203 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:02 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:02.908+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:03.301 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:56:02 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4[46079]: 2024-09-19T08:56:02.971+0000 7fac1c2aa640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.356884+0000 front 2024-09-19T08:55:33.356809+0000 (oldest deadline 2024-09-19T08:55:58.056822+0000) 2024-09-19T08:56:03.301 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:56:02 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4[46079]: 2024-09-19T08:56:02.981+0000 7fac1fca5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:56:03.301 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:56:02 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4[46079]: 2024-09-19T08:56:02.981+0000 7fac1fca5640 -1 osd.4 96 *** Got signal Terminated *** 2024-09-19T08:56:03.301 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:56:02 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4[46079]: 2024-09-19T08:56:02.981+0000 7fac1fca5640 -1 osd.4 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:56:03.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:03 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:03.085+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:03.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:03 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:03.204+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:03.800 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:03 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:03.419+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:03.928 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:03 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:03.647+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:35.657503+0000 front 2024-09-19T08:55:35.657362+0000 (oldest deadline 2024-09-19T08:55:58.458212+0000) 2024-09-19T08:56:04.207 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:03 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:03.901+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:04.300 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:56:03 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4[46079]: 2024-09-19T08:56:03.981+0000 7fac1c2aa640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.356884+0000 front 2024-09-19T08:55:33.356809+0000 (oldest deadline 2024-09-19T08:55:58.056822+0000) 2024-09-19T08:56:04.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:04 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:04.050+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:04.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:04 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:04.207+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:04.800 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:04 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:04.452+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:04.928 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:04 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:04.676+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:35.657503+0000 front 2024-09-19T08:55:35.657362+0000 (oldest deadline 2024-09-19T08:55:58.458212+0000) 2024-09-19T08:56:05.283 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:05 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:05.179+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:05.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:04 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:04.945+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:05.300 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:56:05 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4[46079]: 2024-09-19T08:56:05.024+0000 7fac1c2aa640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.356884+0000 front 2024-09-19T08:55:33.356809+0000 (oldest deadline 2024-09-19T08:55:58.056822+0000) 2024-09-19T08:56:05.300 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:05 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:05.267+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:05.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:05 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:05.042+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:05.800 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:05 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:05.439+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:05.984 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:05 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:05.720+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:35.657503+0000 front 2024-09-19T08:55:35.657362+0000 (oldest deadline 2024-09-19T08:55:58.458212+0000) 2024-09-19T08:56:06.272 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:56:06 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4[46079]: 2024-09-19T08:56:06.009+0000 7fac1c2aa640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.356884+0000 front 2024-09-19T08:55:33.356809+0000 (oldest deadline 2024-09-19T08:55:58.056822+0000) 2024-09-19T08:56:06.283 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:06 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:06.142+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:06.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:05 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:05.990+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:06.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:05 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:05.990+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:06.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:06 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:06.088+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:06.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:06 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:06.272+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:06.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:06 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:06.426+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:07.057 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:06 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:06.700+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:35.657503+0000 front 2024-09-19T08:55:35.657362+0000 (oldest deadline 2024-09-19T08:55:58.458212+0000) 2024-09-19T08:56:07.283 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:07 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:07.161+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:07.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:06 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:06.998+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:07.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:06 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:06.998+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:07.300 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:56:07 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4[46079]: 2024-09-19T08:56:07.009+0000 7fac1c2aa640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.356884+0000 front 2024-09-19T08:55:33.356809+0000 (oldest deadline 2024-09-19T08:55:58.056822+0000) 2024-09-19T08:56:07.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:07 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:07.057+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:07.800 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:07 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:07.311+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:07.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:07 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:07.390+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:08.029 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:07 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:07.691+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:35.657503+0000 front 2024-09-19T08:55:35.657362+0000 (oldest deadline 2024-09-19T08:55:58.458212+0000) 2024-09-19T08:56:08.029 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:07 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:07.691+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.359356+0000 front 2024-09-19T08:55:41.359227+0000 (oldest deadline 2024-09-19T08:56:07.259066+0000) 2024-09-19T08:56:08.283 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:08 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:08.185+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:08.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:08 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:08.019+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:08.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:08 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:08.019+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:08.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:08 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:08.029+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:08.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:08 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:08.029+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:08.600 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:56:08 smithi044 podman[70514]: 2024-09-19 08:56:08.319394012 +0000 UTC m=+5.430913981 container died ef37d3632926225b442bd52168062768eac7b39b689208fe40e08cf266a428f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4) 2024-09-19T08:56:08.600 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:08 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:08.435+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:08.600 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:08 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:08.307+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:08.940 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:56:08 smithi044 podman[70514]: 2024-09-19 08:56:08.697991293 +0000 UTC m=+5.809511250 container cleanup ef37d3632926225b442bd52168062768eac7b39b689208fe40e08cf266a428f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T08:56:08.940 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:56:08 smithi044 bash[70514]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4 2024-09-19T08:56:09.015 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:08 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:08.734+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:35.657503+0000 front 2024-09-19T08:55:35.657362+0000 (oldest deadline 2024-09-19T08:55:58.458212+0000) 2024-09-19T08:56:09.015 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:08 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:08.734+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.359356+0000 front 2024-09-19T08:55:41.359227+0000 (oldest deadline 2024-09-19T08:56:07.259066+0000) 2024-09-19T08:56:09.015 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:08 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:08.730+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:09.257 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:56:08 smithi044 podman[70529]: 2024-09-19 08:56:08.940924369 +0000 UTC m=+0.613194629 container remove ef37d3632926225b442bd52168062768eac7b39b689208fe40e08cf266a428f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:56:09.259 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:56:09 smithi044 podman[70621]: 2024-09-19 08:56:09.258707283 +0000 UTC m=+0.101548928 container create 2fcca01dfa0e4076ee29185fc4364e9ac16a384f0c580e3f8fa431837070cfd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:56:09.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:09 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:09.015+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:09.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:09 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:09.015+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:09.510 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:56:09 smithi044 podman[70621]: 2024-09-19 08:56:09.172954706 +0000 UTC m=+0.015796315 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:56:09.510 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:09 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:09.279+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:09.511 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:09 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:09.421+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:09.511 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:09 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:09.421+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:09.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:09 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:09.158+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:09.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:09 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:09.158+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.125767+0000 front 2024-09-19T08:55:44.125784+0000 (oldest deadline 2024-09-19T08:56:08.225914+0000) 2024-09-19T08:56:09.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:09 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:09.058+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:09.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:09 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:09.058+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:09.801 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:56:09 smithi044 podman[70621]: 2024-09-19 08:56:09.511424979 +0000 UTC m=+0.354266587 container init 2fcca01dfa0e4076ee29185fc4364e9ac16a384f0c580e3f8fa431837070cfd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T08:56:09.801 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:56:09 smithi044 podman[70621]: 2024-09-19 08:56:09.514742329 +0000 UTC m=+0.357583941 container start 2fcca01dfa0e4076ee29185fc4364e9ac16a384f0c580e3f8fa431837070cfd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:56:09.801 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:56:09 smithi044 podman[70621]: 2024-09-19 08:56:09.602919228 +0000 UTC m=+0.445760832 container attach 2fcca01dfa0e4076ee29185fc4364e9ac16a384f0c580e3f8fa431837070cfd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T08:56:09.801 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 19 08:56:09 smithi044 podman[70621]: 2024-09-19 08:56:09.711629304 +0000 UTC m=+0.554470915 container died 2fcca01dfa0e4076ee29185fc4364e9ac16a384f0c580e3f8fa431837070cfd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T08:56:10.018 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:09 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:09.749+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:10.019 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:09 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:09.765+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:35.657503+0000 front 2024-09-19T08:55:35.657362+0000 (oldest deadline 2024-09-19T08:55:58.458212+0000) 2024-09-19T08:56:10.019 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:09 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:09.765+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.359356+0000 front 2024-09-19T08:55:41.359227+0000 (oldest deadline 2024-09-19T08:56:07.259066+0000) 2024-09-19T08:56:10.310 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T08:56:10.394 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:56:10.394 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T08:56:10.394 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T08:56:10.395 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.5 2024-09-19T08:56:10.422 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:10 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:10.018+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:10.422 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:10 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:10.018+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:10.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:10 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:10.140+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:10.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:10 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:10.140+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.125767+0000 front 2024-09-19T08:55:44.125784+0000 (oldest deadline 2024-09-19T08:56:08.225914+0000) 2024-09-19T08:56:10.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:10 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:10.093+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:10.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:10 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:10.093+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:10.550 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:10 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:10.274+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:10.550 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:10 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:10.384+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:10.550 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:10 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:10.384+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:10.678 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:10 smithi175 systemd[1]: Stopping Ceph osd.5 for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:56:11.026 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:10 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:10.737+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:11.026 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:10 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:10.683+0000 7fbaee1fc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:56:11.026 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:10 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:10.683+0000 7fbaee1fc640 -1 osd.5 96 *** Got signal Terminated *** 2024-09-19T08:56:11.026 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:10 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:10.683+0000 7fbaee1fc640 -1 osd.5 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:56:11.026 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:10 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:10.718+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:35.657503+0000 front 2024-09-19T08:55:35.657362+0000 (oldest deadline 2024-09-19T08:55:58.458212+0000) 2024-09-19T08:56:11.027 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:10 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:10.718+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.359356+0000 front 2024-09-19T08:55:41.359227+0000 (oldest deadline 2024-09-19T08:56:07.259066+0000) 2024-09-19T08:56:11.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:11 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:11.026+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:11.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:11 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:11.026+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:11.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:11 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:11.123+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:11.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:11 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:11.123+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.125767+0000 front 2024-09-19T08:55:44.125784+0000 (oldest deadline 2024-09-19T08:56:08.225914+0000) 2024-09-19T08:56:11.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:11 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:11.101+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:11.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:11 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:11.101+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:11.566 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:11 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:11.311+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:11.566 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:11 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:11.421+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:11.566 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:11 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:11.421+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:12.011 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:11 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:11.703+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:12.012 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:11 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:11.688+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:35.657503+0000 front 2024-09-19T08:55:35.657362+0000 (oldest deadline 2024-09-19T08:55:58.458212+0000) 2024-09-19T08:56:12.012 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:11 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:11.688+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.359356+0000 front 2024-09-19T08:55:41.359227+0000 (oldest deadline 2024-09-19T08:56:07.259066+0000) 2024-09-19T08:56:12.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:12 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:12.011+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:12.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:12 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:12.011+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:12.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:12 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:12.093+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:12.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:12 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:12.093+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.125767+0000 front 2024-09-19T08:55:44.125784+0000 (oldest deadline 2024-09-19T08:56:08.225914+0000) 2024-09-19T08:56:12.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:12 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:12.150+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:12.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:12 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:12.150+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:12.550 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:12 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:12.261+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:12.550 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:12 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:12.427+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:12.550 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:12 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:12.427+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:12.928 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:12 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:12.658+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:35.657503+0000 front 2024-09-19T08:55:35.657362+0000 (oldest deadline 2024-09-19T08:55:58.458212+0000) 2024-09-19T08:56:12.928 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:12 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:12.658+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.359356+0000 front 2024-09-19T08:55:41.359227+0000 (oldest deadline 2024-09-19T08:56:07.259066+0000) 2024-09-19T08:56:12.928 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:12 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:12.741+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:13.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:13 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:13.059+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:13.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:13 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:13.059+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:13.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:13 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:13.066+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:13.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:13 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:13.066+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.125767+0000 front 2024-09-19T08:55:44.125784+0000 (oldest deadline 2024-09-19T08:56:08.225914+0000) 2024-09-19T08:56:13.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:13 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:13.121+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:13.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:13 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:13.121+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:13.550 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:13 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:13.282+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:13.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:13 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:13.404+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:13.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:13 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:13.404+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:14.054 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:13 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:13.711+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:14.054 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:13 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:13.684+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:35.657503+0000 front 2024-09-19T08:55:35.657362+0000 (oldest deadline 2024-09-19T08:55:58.458212+0000) 2024-09-19T08:56:14.055 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:13 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:13.684+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.359356+0000 front 2024-09-19T08:55:41.359227+0000 (oldest deadline 2024-09-19T08:56:07.259066+0000) 2024-09-19T08:56:14.055 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:13 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:13.684+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:50.759792+0000 front 2024-09-19T08:55:50.759858+0000 (oldest deadline 2024-09-19T08:56:13.060155+0000) 2024-09-19T08:56:14.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:14 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:14.054+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:14.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:14 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:14.054+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:14.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:14 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:14.052+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:14.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:14 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:14.052+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.125767+0000 front 2024-09-19T08:55:44.125784+0000 (oldest deadline 2024-09-19T08:56:08.225914+0000) 2024-09-19T08:56:14.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:14 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:14.052+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.126934+0000 front 2024-09-19T08:55:51.127002+0000 (oldest deadline 2024-09-19T08:56:13.427144+0000) 2024-09-19T08:56:14.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:14 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:14.092+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:14.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:14 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:14.092+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:14.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:14 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:14.092+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:14.550 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:14 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:14.285+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:14.550 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:14 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:14.285+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:50.103135+0000 front 2024-09-19T08:55:50.103117+0000 (oldest deadline 2024-09-19T08:56:14.202941+0000) 2024-09-19T08:56:14.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:14 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:14.403+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:14.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:14 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:14.403+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:14.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:14 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:14.403+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:15.007 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:14 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:14.687+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:35.657503+0000 front 2024-09-19T08:55:35.657362+0000 (oldest deadline 2024-09-19T08:55:58.458212+0000) 2024-09-19T08:56:15.007 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:14 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:14.687+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.359356+0000 front 2024-09-19T08:55:41.359227+0000 (oldest deadline 2024-09-19T08:56:07.259066+0000) 2024-09-19T08:56:15.007 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:14 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:14.687+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:50.759792+0000 front 2024-09-19T08:55:50.759858+0000 (oldest deadline 2024-09-19T08:56:13.060155+0000) 2024-09-19T08:56:15.008 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:14 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:14.736+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:15.008 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:14 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:14.736+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:15.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:15 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:15.007+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:15.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:15 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:15.007+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:15.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:15 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:15.101+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:15.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:15 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:15.101+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.125767+0000 front 2024-09-19T08:55:44.125784+0000 (oldest deadline 2024-09-19T08:56:08.225914+0000) 2024-09-19T08:56:15.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:15 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:15.101+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.126934+0000 front 2024-09-19T08:55:51.127002+0000 (oldest deadline 2024-09-19T08:56:13.427144+0000) 2024-09-19T08:56:15.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:15 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:15.131+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:15.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:15 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:15.131+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:15.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:15 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:15.131+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:15.550 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:15 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:15.240+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:15.550 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:15 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:15.240+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:50.103135+0000 front 2024-09-19T08:55:50.103117+0000 (oldest deadline 2024-09-19T08:56:14.202941+0000) 2024-09-19T08:56:15.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:15 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:15.372+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:15.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:15 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:15.372+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:15.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:15 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:15.372+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:16.028 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:15 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:15.720+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:16.028 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:15 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:15.720+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:16.028 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:15 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:15.679+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:35.657503+0000 front 2024-09-19T08:55:35.657362+0000 (oldest deadline 2024-09-19T08:55:58.458212+0000) 2024-09-19T08:56:16.029 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:15 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:15.679+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.359356+0000 front 2024-09-19T08:55:41.359227+0000 (oldest deadline 2024-09-19T08:56:07.259066+0000) 2024-09-19T08:56:16.029 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:15 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5[47159]: 2024-09-19T08:56:15.679+0000 7fbaea801640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:50.759792+0000 front 2024-09-19T08:55:50.759858+0000 (oldest deadline 2024-09-19T08:56:13.060155+0000) 2024-09-19T08:56:16.325 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:16 smithi175 podman[72337]: 2024-09-19 08:56:16.087807885 +0000 UTC m=+5.494799849 container died 23ead13e058e906b1347f7bf7efaf58908c57932feb3288dc62ac48517aebaf0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T08:56:16.325 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:16 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:16.028+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:16.325 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:16 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:16.028+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:16.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:16 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:16.104+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:16.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:16 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:16.104+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.125767+0000 front 2024-09-19T08:55:44.125784+0000 (oldest deadline 2024-09-19T08:56:08.225914+0000) 2024-09-19T08:56:16.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:16 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:16.104+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.126934+0000 front 2024-09-19T08:55:51.127002+0000 (oldest deadline 2024-09-19T08:56:13.427144+0000) 2024-09-19T08:56:16.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:16 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:16.178+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:16.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:16 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:16.178+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:16.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:16 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:16.178+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:16.550 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:16 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:16.217+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:16.550 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:16 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:16.217+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:50.103135+0000 front 2024-09-19T08:55:50.103117+0000 (oldest deadline 2024-09-19T08:56:14.202941+0000) 2024-09-19T08:56:16.550 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:16 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:16.340+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:16.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:16 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:16.340+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:16.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:16 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:16.340+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:16.600 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:16 smithi175 podman[72337]: 2024-09-19 08:56:16.41669508 +0000 UTC m=+5.823687043 container cleanup 23ead13e058e906b1347f7bf7efaf58908c57932feb3288dc62ac48517aebaf0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T08:56:16.600 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:16 smithi175 bash[72337]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5 2024-09-19T08:56:16.928 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:16 smithi175 podman[72353]: 2024-09-19 08:56:16.601366598 +0000 UTC m=+0.510437737 container remove 23ead13e058e906b1347f7bf7efaf58908c57932feb3288dc62ac48517aebaf0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T08:56:16.928 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:16 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:16.762+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:16.928 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:16 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:16.762+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:17.329 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:17 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:17.077+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:17.329 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:17 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:17.077+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:17.329 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:17 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:17.077+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:17.329 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:17 smithi175 podman[72440]: 2024-09-19 08:56:17.010454887 +0000 UTC m=+0.095571445 container create 90a80c161eb41fc7395acaf4d6acefbf4cf7e3ef8fc7265261cac9991f786b48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T08:56:17.329 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:17 smithi175 podman[72440]: 2024-09-19 08:56:16.930822808 +0000 UTC m=+0.015939372 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:56:17.329 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:17 smithi175 podman[72440]: 2024-09-19 08:56:17.254540131 +0000 UTC m=+0.339656690 container init 90a80c161eb41fc7395acaf4d6acefbf4cf7e3ef8fc7265261cac9991f786b48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T08:56:17.329 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:17 smithi175 podman[72440]: 2024-09-19 08:56:17.257900478 +0000 UTC m=+0.343017036 container start 90a80c161eb41fc7395acaf4d6acefbf4cf7e3ef8fc7265261cac9991f786b48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T08:56:17.329 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:17 smithi175 podman[72440]: 2024-09-19 08:56:17.329524374 +0000 UTC m=+0.414640947 container attach 90a80c161eb41fc7395acaf4d6acefbf4cf7e3ef8fc7265261cac9991f786b48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:56:17.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:17 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:17.177+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:17.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:17 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:17.177+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:17.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:17 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:17.177+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:17.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:17 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:17.055+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:17.534 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:17 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:17.055+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.125767+0000 front 2024-09-19T08:55:44.125784+0000 (oldest deadline 2024-09-19T08:56:08.225914+0000) 2024-09-19T08:56:17.534 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:17 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:17.055+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.126934+0000 front 2024-09-19T08:55:51.127002+0000 (oldest deadline 2024-09-19T08:56:13.427144+0000) 2024-09-19T08:56:17.550 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:17 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:17.205+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:17.550 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:17 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:17.205+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:50.103135+0000 front 2024-09-19T08:55:50.103117+0000 (oldest deadline 2024-09-19T08:56:14.202941+0000) 2024-09-19T08:56:17.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:17 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:17.387+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:17.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:17 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:17.387+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:17.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:17 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:17.387+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:17.678 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:17 smithi175 podman[72440]: 2024-09-19 08:56:17.450433791 +0000 UTC m=+0.535550353 container died 90a80c161eb41fc7395acaf4d6acefbf4cf7e3ef8fc7265261cac9991f786b48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T08:56:18.000 INFO:journalctl@ceph.osd.5.smithi175.stdout:Sep 19 08:56:17 smithi175 podman[72463]: 2024-09-19 08:56:17.974878862 +0000 UTC m=+0.518607110 container remove 90a80c161eb41fc7395acaf4d6acefbf4cf7e3ef8fc7265261cac9991f786b48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T08:56:18.000 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:17 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:17.740+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:18.000 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:17 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:17.740+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:18.005 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T08:56:18.085 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:56:18.086 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T08:56:18.086 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T08:56:18.086 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.6 2024-09-19T08:56:18.256 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:18 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:18.119+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:18.257 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:18 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:18.119+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:18.257 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:18 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:18.119+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:18.397 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:18 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:18.151+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:18.397 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:18 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:18.151+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:18.397 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:18 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:18.151+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:18.397 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:18 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:18.059+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:18.397 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:18 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:18.059+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.125767+0000 front 2024-09-19T08:55:44.125784+0000 (oldest deadline 2024-09-19T08:56:08.225914+0000) 2024-09-19T08:56:18.397 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:18 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:18.059+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.126934+0000 front 2024-09-19T08:55:51.127002+0000 (oldest deadline 2024-09-19T08:56:13.427144+0000) 2024-09-19T08:56:18.397 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:18 smithi007 systemd[1]: Stopping Ceph osd.6 for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:56:18.397 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:18 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:18.397+0000 7fddb66bd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:56:18.398 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:18 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:18.397+0000 7fddb66bd640 -1 osd.6 96 *** Got signal Terminated *** 2024-09-19T08:56:18.398 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:18 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:18.397+0000 7fddb66bd640 -1 osd.6 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:56:18.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:18 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:18.185+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:18.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:18 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:18.185+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:50.103135+0000 front 2024-09-19T08:55:50.103117+0000 (oldest deadline 2024-09-19T08:56:14.202941+0000) 2024-09-19T08:56:18.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:18 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:18.341+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:18.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:18 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:18.341+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:18.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:18 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:18.341+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:19.086 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:18 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:18.757+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:19.086 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:18 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:18.757+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:19.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:19 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:19.168+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:19.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:19 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:19.168+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:19.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:19 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:19.168+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:19.283 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:19 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:19.018+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:19.284 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:19 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:19.018+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.125767+0000 front 2024-09-19T08:55:44.125784+0000 (oldest deadline 2024-09-19T08:56:08.225914+0000) 2024-09-19T08:56:19.284 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:19 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:19.018+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.126934+0000 front 2024-09-19T08:55:51.127002+0000 (oldest deadline 2024-09-19T08:56:13.427144+0000) 2024-09-19T08:56:19.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:19 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:19.086+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:19.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:19 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:19.086+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:19.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:19 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:19.086+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:19.550 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:19 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:19.186+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:19.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:19 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:19.186+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:50.103135+0000 front 2024-09-19T08:55:50.103117+0000 (oldest deadline 2024-09-19T08:56:14.202941+0000) 2024-09-19T08:56:19.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:19 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:19.308+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:19.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:19 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:19.308+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:19.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:19 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:19.308+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:20.041 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:19 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:19.746+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:20.041 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:19 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:19.746+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:20.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:20 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:20.138+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:20.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:20 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:20.138+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:20.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:20 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:20.138+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:20.283 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:19 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:19.999+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:20.284 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:19 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:19.999+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.125767+0000 front 2024-09-19T08:55:44.125784+0000 (oldest deadline 2024-09-19T08:56:08.225914+0000) 2024-09-19T08:56:20.284 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:19 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:19.999+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.126934+0000 front 2024-09-19T08:55:51.127002+0000 (oldest deadline 2024-09-19T08:56:13.427144+0000) 2024-09-19T08:56:20.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:20 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:20.041+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:20.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:20 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:20.041+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:20.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:20 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:20.041+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:20.550 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:20 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:20.219+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:20.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:20 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:20.219+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:50.103135+0000 front 2024-09-19T08:55:50.103117+0000 (oldest deadline 2024-09-19T08:56:14.202941+0000) 2024-09-19T08:56:20.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:20 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:20.331+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:20.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:20 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:20.331+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:20.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:20 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:20.331+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:21.071 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:20 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:20.724+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:21.071 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:20 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:20.724+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:21.283 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:20 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:20.956+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:21.283 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:20 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:20.956+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.125767+0000 front 2024-09-19T08:55:44.125784+0000 (oldest deadline 2024-09-19T08:56:08.225914+0000) 2024-09-19T08:56:21.283 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:20 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:20.956+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.126934+0000 front 2024-09-19T08:55:51.127002+0000 (oldest deadline 2024-09-19T08:56:13.427144+0000) 2024-09-19T08:56:21.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:21 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:21.132+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:21.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:21 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:21.132+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:21.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:21 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:21.132+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:21.368 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:21 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:21.190+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:21.368 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:21 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:21.190+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:50.103135+0000 front 2024-09-19T08:55:50.103117+0000 (oldest deadline 2024-09-19T08:56:14.202941+0000) 2024-09-19T08:56:21.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:21 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:21.071+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:21.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:21 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:21.071+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:21.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:21 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:21.071+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:21.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:21 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:21.071+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:21.640 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:21 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:21.368+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:21.640 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:21 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:21.368+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:21.641 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:21 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:21.368+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:22.063 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:21 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:21.704+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:22.063 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:21 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:21.704+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:22.063 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:21 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:21.704+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:58.700018+0000 front 2024-09-19T08:55:58.700189+0000 (oldest deadline 2024-09-19T08:56:21.599825+0000) 2024-09-19T08:56:22.283 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:22 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:22.003+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:22.283 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:22 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:22.003+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.125767+0000 front 2024-09-19T08:55:44.125784+0000 (oldest deadline 2024-09-19T08:56:08.225914+0000) 2024-09-19T08:56:22.283 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:22 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:22.003+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.126934+0000 front 2024-09-19T08:55:51.127002+0000 (oldest deadline 2024-09-19T08:56:13.427144+0000) 2024-09-19T08:56:22.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:22 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:22.129+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:22.284 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:22 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:22.129+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:22.284 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:22 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:22.129+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:22.284 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:22 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:22.129+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:22.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:22 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:22.063+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:22.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:22 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:22.063+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:22.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:22 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:22.063+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:22.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:22 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:22.063+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:22.550 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:22 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:22.183+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:22.550 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:22 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:22.183+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:50.103135+0000 front 2024-09-19T08:55:50.103117+0000 (oldest deadline 2024-09-19T08:56:14.202941+0000) 2024-09-19T08:56:22.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:22 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:22.354+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:22.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:22 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:22.354+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:22.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:22 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:22.354+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:23.081 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:22 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:22.753+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:23.082 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:22 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:22.753+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:23.082 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:22 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:22.753+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:58.700018+0000 front 2024-09-19T08:55:58.700189+0000 (oldest deadline 2024-09-19T08:56:21.599825+0000) 2024-09-19T08:56:23.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:23 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:23.082+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:23.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:23 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:23.082+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:23.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:23 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:23.082+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:23.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:23 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:23.082+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:23.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:23 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:23.046+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.224066+0000 front 2024-09-19T08:55:34.224260+0000 (oldest deadline 2024-09-19T08:55:57.724182+0000) 2024-09-19T08:56:23.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:23 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:23.046+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.125767+0000 front 2024-09-19T08:55:44.125784+0000 (oldest deadline 2024-09-19T08:56:08.225914+0000) 2024-09-19T08:56:23.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:23 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6[58834]: 2024-09-19T08:56:23.046+0000 7fddb2cc2640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.126934+0000 front 2024-09-19T08:55:51.127002+0000 (oldest deadline 2024-09-19T08:56:13.427144+0000) 2024-09-19T08:56:23.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:23 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:23.178+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:23.534 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:23 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:23.178+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:23.534 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:23 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:23.178+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:23.534 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:23 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:23.178+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:23.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:23 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:23.204+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:23.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:23 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:23.204+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:50.103135+0000 front 2024-09-19T08:55:50.103117+0000 (oldest deadline 2024-09-19T08:56:14.202941+0000) 2024-09-19T08:56:23.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:23 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:23.204+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:57.704221+0000 front 2024-09-19T08:55:57.704052+0000 (oldest deadline 2024-09-19T08:56:23.003997+0000) 2024-09-19T08:56:23.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:23 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:23.333+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:23.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:23 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:23.333+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:23.552 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:23 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:23.333+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:24.033 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:23 smithi007 podman[112027]: 2024-09-19 08:56:23.744565735 +0000 UTC m=+5.456684568 container died b1015be946fa6becd8b63f660e76c68435542b6ce6c02160af34e627344ca950 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T08:56:24.100 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:23 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:23.783+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:24.100 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:23 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:23.783+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:24.101 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:23 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:23.783+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:58.700018+0000 front 2024-09-19T08:55:58.700189+0000 (oldest deadline 2024-09-19T08:56:21.599825+0000) 2024-09-19T08:56:24.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:24 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:24.100+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:24.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:24 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:24.100+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:24.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:24 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:24.100+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:24.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:24 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:24.100+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:24.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:24 smithi007 podman[112027]: 2024-09-19 08:56:24.171977386 +0000 UTC m=+5.884096207 container cleanup b1015be946fa6becd8b63f660e76c68435542b6ce6c02160af34e627344ca950 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T08:56:24.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:24 smithi007 bash[112027]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6 2024-09-19T08:56:24.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:24 smithi007 podman[112043]: 2024-09-19 08:56:24.398546758 +0000 UTC m=+0.644888548 container remove b1015be946fa6becd8b63f660e76c68435542b6ce6c02160af34e627344ca950 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T08:56:24.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:24 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:24.154+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:24.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:24 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:24.154+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:24.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:24 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:24.154+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:24.534 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:24 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:24.154+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:24.550 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:24 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:24.220+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:24.550 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:24 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:24.220+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:50.103135+0000 front 2024-09-19T08:55:50.103117+0000 (oldest deadline 2024-09-19T08:56:14.202941+0000) 2024-09-19T08:56:24.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:24 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:24.220+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:57.704221+0000 front 2024-09-19T08:55:57.704052+0000 (oldest deadline 2024-09-19T08:56:23.003997+0000) 2024-09-19T08:56:24.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:24 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:24.338+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:24.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:24 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:24.338+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:24.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:24 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:24.338+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:25.142 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:24 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:24.797+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:25.142 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:24 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:24.797+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:25.142 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:24 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:24.797+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:58.700018+0000 front 2024-09-19T08:55:58.700189+0000 (oldest deadline 2024-09-19T08:56:21.599825+0000) 2024-09-19T08:56:25.143 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:24 smithi007 podman[112133]: 2024-09-19 08:56:24.749750095 +0000 UTC m=+0.016073775 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:56:25.143 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:24 smithi007 podman[112133]: 2024-09-19 08:56:24.849393715 +0000 UTC m=+0.115717393 container create 0d06bc93e20cc85b6a2812a3d7113e179abbd1d69ef0141e759518c5e63b0634 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T08:56:25.143 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:25 smithi007 podman[112133]: 2024-09-19 08:56:25.060132596 +0000 UTC m=+0.326456282 container init 0d06bc93e20cc85b6a2812a3d7113e179abbd1d69ef0141e759518c5e63b0634 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T08:56:25.143 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:25 smithi007 podman[112133]: 2024-09-19 08:56:25.063627692 +0000 UTC m=+0.329951363 container start 0d06bc93e20cc85b6a2812a3d7113e179abbd1d69ef0141e759518c5e63b0634 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:56:25.143 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:25 smithi007 podman[112133]: 2024-09-19 08:56:25.143445656 +0000 UTC m=+0.409769336 container attach 0d06bc93e20cc85b6a2812a3d7113e179abbd1d69ef0141e759518c5e63b0634 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T08:56:25.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:25 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:25.142+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:25.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:25 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:25.142+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:25.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:25 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:25.142+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:25.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:25 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:25.142+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:25.533 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 08:56:25 smithi007 podman[112133]: 2024-09-19 08:56:25.261517349 +0000 UTC m=+0.527841020 container died 0d06bc93e20cc85b6a2812a3d7113e179abbd1d69ef0141e759518c5e63b0634 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:56:25.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:25 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:25.188+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:25.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:25 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:25.188+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:25.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:25 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:25.188+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:25.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:25 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:25.188+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:25.550 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:25 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:25.248+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:25.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:25 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:25.248+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:50.103135+0000 front 2024-09-19T08:55:50.103117+0000 (oldest deadline 2024-09-19T08:56:14.202941+0000) 2024-09-19T08:56:25.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:25 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:25.248+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:57.704221+0000 front 2024-09-19T08:55:57.704052+0000 (oldest deadline 2024-09-19T08:56:23.003997+0000) 2024-09-19T08:56:25.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:25 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:25.320+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:25.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:25 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:25.320+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:25.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:25 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:25.320+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:25.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:25 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:25.320+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:25.930 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T08:56:25.974 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:56:25.974 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T08:56:25.974 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T08:56:25.974 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.7 2024-09-19T08:56:26.178 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:25 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:25.752+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:26.178 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:25 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:25.752+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:26.178 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:25 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:25.752+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:58.700018+0000 front 2024-09-19T08:55:58.700189+0000 (oldest deadline 2024-09-19T08:56:21.599825+0000) 2024-09-19T08:56:26.256 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:26 smithi044 systemd[1]: Stopping Ceph osd.7 for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:56:26.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:26 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:26.226+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:26.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:26 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:26.226+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:26.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:26 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:26.226+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:26.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:26 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:26.226+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:26.550 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:26 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:26.271+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:26.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:26 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:26.271+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:26.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:26 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:26.271+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:26.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:26 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:26.271+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:26.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:26 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:26.256+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:26.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:26 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:26.256+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:50.103135+0000 front 2024-09-19T08:55:50.103117+0000 (oldest deadline 2024-09-19T08:56:14.202941+0000) 2024-09-19T08:56:26.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:26 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:26.256+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:57.704221+0000 front 2024-09-19T08:55:57.704052+0000 (oldest deadline 2024-09-19T08:56:23.003997+0000) 2024-09-19T08:56:26.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:26 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:26.267+0000 7fc00627d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:56:26.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:26 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:26.267+0000 7fc00627d640 -1 osd.7 96 *** Got signal Terminated *** 2024-09-19T08:56:26.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:26 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:26.267+0000 7fc00627d640 -1 osd.7 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:56:26.678 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:26 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:26.179+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:26.678 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:26 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:26.179+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:26.678 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:26 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:26.179+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:26.678 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:26 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:26.179+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:27.147 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:26 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:26.784+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:27.147 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:26 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:26.784+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:27.147 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:26 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:26.784+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:58.700018+0000 front 2024-09-19T08:55:58.700189+0000 (oldest deadline 2024-09-19T08:56:21.599825+0000) 2024-09-19T08:56:27.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:27 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:27.147+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:27.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:27 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:27.147+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:27.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:27 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:27.147+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:27.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:27 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:27.147+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:27.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:27 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:27.266+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:27.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:27 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:27.266+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:27.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:27 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:27.266+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:27.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:27 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:27.266+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:27.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:27 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:27.232+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:27.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:27 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:27.232+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:50.103135+0000 front 2024-09-19T08:55:50.103117+0000 (oldest deadline 2024-09-19T08:56:14.202941+0000) 2024-09-19T08:56:27.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:27 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:27.232+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:57.704221+0000 front 2024-09-19T08:55:57.704052+0000 (oldest deadline 2024-09-19T08:56:23.003997+0000) 2024-09-19T08:56:27.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:27 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:27.223+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:27.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:27 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:27.223+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:27.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:27 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:27.223+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:27.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:27 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:27.223+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:28.115 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:27 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:27.754+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:28.115 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:27 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:27.754+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:28.115 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:27 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:27.754+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:58.700018+0000 front 2024-09-19T08:55:58.700189+0000 (oldest deadline 2024-09-19T08:56:21.599825+0000) 2024-09-19T08:56:28.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:28 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:28.115+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:28.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:28 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:28.115+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:28.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:28 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:28.115+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:28.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:28 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:28.115+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:28.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:28 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:28.241+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:28.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:28 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:28.241+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:28.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:28 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:28.241+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:28.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:28 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:28.241+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:28.550 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:28 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:28.237+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:28.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:28 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:28.237+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:28.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:28 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:28.237+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:28.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:28 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:28.237+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:28.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:28 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:28.197+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:28.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:28 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:28.197+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:50.103135+0000 front 2024-09-19T08:55:50.103117+0000 (oldest deadline 2024-09-19T08:56:14.202941+0000) 2024-09-19T08:56:28.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:28 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:28.197+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:57.704221+0000 front 2024-09-19T08:55:57.704052+0000 (oldest deadline 2024-09-19T08:56:23.003997+0000) 2024-09-19T08:56:29.152 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:28 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:28.786+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:29.152 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:28 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:28.786+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:29.153 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:28 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:28.787+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:58.700018+0000 front 2024-09-19T08:55:58.700189+0000 (oldest deadline 2024-09-19T08:56:21.599825+0000) 2024-09-19T08:56:29.153 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:28 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:28.787+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:06.900739+0000 front 2024-09-19T08:56:06.900865+0000 (oldest deadline 2024-09-19T08:56:28.600496+0000) 2024-09-19T08:56:29.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:29 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:29.152+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:29.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:29 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:29.152+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:29.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:29 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:29.152+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:29.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:29 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:29.152+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:29.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:29 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:29.247+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:29.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:29 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:29.247+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:29.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:29 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:29.247+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:29.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:29 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:29.247+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:29.550 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:29 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:29.242+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:29.550 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:29 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:29.242+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:29.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:29 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:29.242+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:29.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:29 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:29.242+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:29.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:29 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:29.206+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:29.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:29 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:29.206+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:50.103135+0000 front 2024-09-19T08:55:50.103117+0000 (oldest deadline 2024-09-19T08:56:14.202941+0000) 2024-09-19T08:56:29.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:29 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:29.206+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:57.704221+0000 front 2024-09-19T08:55:57.704052+0000 (oldest deadline 2024-09-19T08:56:23.003997+0000) 2024-09-19T08:56:29.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:29 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:29.206+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:03.004556+0000 front 2024-09-19T08:56:03.004571+0000 (oldest deadline 2024-09-19T08:56:28.904629+0000) 2024-09-19T08:56:30.117 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:29 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:29.766+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:30.117 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:29 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:29.766+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:30.118 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:29 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:29.766+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:58.700018+0000 front 2024-09-19T08:55:58.700189+0000 (oldest deadline 2024-09-19T08:56:21.599825+0000) 2024-09-19T08:56:30.118 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:29 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:29.766+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:06.900739+0000 front 2024-09-19T08:56:06.900865+0000 (oldest deadline 2024-09-19T08:56:28.600496+0000) 2024-09-19T08:56:30.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:30 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:30.118+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:30.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:30 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:30.118+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:30.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:30 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:30.118+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:30.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:30 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:30.118+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:30.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:30 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:30.215+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:30.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:30 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:30.215+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:30.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:30 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:30.215+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:30.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:30 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:30.215+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:30.550 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:30 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:30.239+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:30.550 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:30 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:30.239+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:50.103135+0000 front 2024-09-19T08:55:50.103117+0000 (oldest deadline 2024-09-19T08:56:14.202941+0000) 2024-09-19T08:56:30.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:30 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:30.239+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:57.704221+0000 front 2024-09-19T08:55:57.704052+0000 (oldest deadline 2024-09-19T08:56:23.003997+0000) 2024-09-19T08:56:30.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:30 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:30.239+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:03.004556+0000 front 2024-09-19T08:56:03.004571+0000 (oldest deadline 2024-09-19T08:56:28.904629+0000) 2024-09-19T08:56:30.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:30 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:30.222+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:30.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:30 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:30.222+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:30.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:30 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:30.222+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:30.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:30 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:30.222+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:30.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:30 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:30.222+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:31.141 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:30 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:30.751+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:31.141 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:30 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:30.751+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:31.141 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:30 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:30.751+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:58.700018+0000 front 2024-09-19T08:55:58.700189+0000 (oldest deadline 2024-09-19T08:56:21.599825+0000) 2024-09-19T08:56:31.141 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:30 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:30.751+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:06.900739+0000 front 2024-09-19T08:56:06.900865+0000 (oldest deadline 2024-09-19T08:56:28.600496+0000) 2024-09-19T08:56:31.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:31 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:31.141+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:31.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:31 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:31.141+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:31.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:31 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:31.141+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:31.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:31 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:31.141+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:31.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:31 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:31.186+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:31.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:31 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:31.186+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:31.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:31 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:31.186+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:31.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:31 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:31.186+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:31.550 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:31 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:31.215+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.101594+0000 front 2024-09-19T08:55:43.101623+0000 (oldest deadline 2024-09-19T08:56:04.801830+0000) 2024-09-19T08:56:31.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:31 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:31.215+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:50.103135+0000 front 2024-09-19T08:55:50.103117+0000 (oldest deadline 2024-09-19T08:56:14.202941+0000) 2024-09-19T08:56:31.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:31 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:31.215+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:57.704221+0000 front 2024-09-19T08:55:57.704052+0000 (oldest deadline 2024-09-19T08:56:23.003997+0000) 2024-09-19T08:56:31.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:31 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7[52653]: 2024-09-19T08:56:31.215+0000 7fc002882640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:03.004556+0000 front 2024-09-19T08:56:03.004571+0000 (oldest deadline 2024-09-19T08:56:28.904629+0000) 2024-09-19T08:56:31.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:31 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:31.201+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:31.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:31 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:31.201+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:31.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:31 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:31.201+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:31.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:31 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:31.201+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:31.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:31 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:31.201+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:32.050 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:31 smithi044 podman[70736]: 2024-09-19 08:56:31.786400743 +0000 UTC m=+5.610691630 container died d3762a5e1b2b2950233e42e4b2e9121b4c4ac100fb682d458ba6c2b9d78f2f20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T08:56:32.122 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:31 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:31.747+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:32.122 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:31 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:31.747+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:32.123 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:31 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:31.747+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:58.700018+0000 front 2024-09-19T08:55:58.700189+0000 (oldest deadline 2024-09-19T08:56:21.599825+0000) 2024-09-19T08:56:32.123 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:31 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:31.747+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:06.900739+0000 front 2024-09-19T08:56:06.900865+0000 (oldest deadline 2024-09-19T08:56:28.600496+0000) 2024-09-19T08:56:32.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:32 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:32.123+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:32.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:32 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:32.123+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:32.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:32 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:32.123+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:32.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:32 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:32.123+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:32.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:32 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:32.212+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:32.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:32 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:32.212+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:32.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:32 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:32.212+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:32.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:32 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:32.212+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:32.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:32 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:32.223+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:32.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:32 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:32.223+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:32.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:32 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:32.223+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:32.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:32 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:32.223+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:32.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:32 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:32.223+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:32.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:32 smithi044 podman[70736]: 2024-09-19 08:56:32.125668283 +0000 UTC m=+5.949959161 container cleanup d3762a5e1b2b2950233e42e4b2e9121b4c4ac100fb682d458ba6c2b9d78f2f20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T08:56:32.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:32 smithi044 bash[70736]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7 2024-09-19T08:56:32.551 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:32 smithi044 podman[70752]: 2024-09-19 08:56:32.318422041 +0000 UTC m=+0.527913893 container remove d3762a5e1b2b2950233e42e4b2e9121b4c4ac100fb682d458ba6c2b9d78f2f20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T08:56:33.004 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:32 smithi044 podman[70841]: 2024-09-19 08:56:32.65355263 +0000 UTC m=+0.015854690 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:56:33.004 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:32 smithi044 podman[70841]: 2024-09-19 08:56:32.760975532 +0000 UTC m=+0.123277638 container create e92215d588ac60d8b24bd643f1500ebc4138c45ce1186869f6d4c0e6e763cb71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7-deactivate, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T08:56:33.004 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:33 smithi044 podman[70841]: 2024-09-19 08:56:33.005082645 +0000 UTC m=+0.367384706 container init e92215d588ac60d8b24bd643f1500ebc4138c45ce1186869f6d4c0e6e763cb71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T08:56:33.130 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:32 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:32.744+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:33.130 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:32 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:32.744+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:33.130 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:32 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:32.744+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:58.700018+0000 front 2024-09-19T08:55:58.700189+0000 (oldest deadline 2024-09-19T08:56:21.599825+0000) 2024-09-19T08:56:33.130 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:32 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:32.744+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:06.900739+0000 front 2024-09-19T08:56:06.900865+0000 (oldest deadline 2024-09-19T08:56:28.600496+0000) 2024-09-19T08:56:33.284 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:33 smithi044 podman[70841]: 2024-09-19 08:56:33.009141998 +0000 UTC m=+0.371444061 container start e92215d588ac60d8b24bd643f1500ebc4138c45ce1186869f6d4c0e6e763cb71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T08:56:33.285 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:33 smithi044 podman[70841]: 2024-09-19 08:56:33.079944653 +0000 UTC m=+0.442246725 container attach e92215d588ac60d8b24bd643f1500ebc4138c45ce1186869f6d4c0e6e763cb71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T08:56:33.285 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 19 08:56:33 smithi044 podman[70841]: 2024-09-19 08:56:33.198103027 +0000 UTC m=+0.560405105 container died e92215d588ac60d8b24bd643f1500ebc4138c45ce1186869f6d4c0e6e763cb71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T08:56:33.285 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:33 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:33.250+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:33.285 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:33 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:33.250+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:33.285 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:33 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:33.250+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:33.285 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:33 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:33.250+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:33.285 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:33 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:33.250+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:33.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:33 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:33.130+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:33.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:33 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:33.130+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:33.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:33 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:33.130+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:33.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:33 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:33.130+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:33.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:33 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:33.130+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:33.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:33.184+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:33.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:33.184+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:33.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:33.184+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:33.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:33 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:33.184+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:33.842 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T08:56:33.881 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:56:33.881 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T08:56:33.881 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T08:56:33.881 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.8 2024-09-19T08:56:34.092 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:33 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:33.791+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:34.092 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:33 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:33.791+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:34.092 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:33 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:33.791+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:58.700018+0000 front 2024-09-19T08:55:58.700189+0000 (oldest deadline 2024-09-19T08:56:21.599825+0000) 2024-09-19T08:56:34.092 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:33 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:33.791+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:06.900739+0000 front 2024-09-19T08:56:06.900865+0000 (oldest deadline 2024-09-19T08:56:28.600496+0000) 2024-09-19T08:56:34.092 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:33 smithi175 systemd[1]: Stopping Ceph osd.8 for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:56:34.428 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:34 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:34.184+0000 7fe185131640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:56:34.428 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:34 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:34.184+0000 7fe185131640 -1 osd.8 96 *** Got signal Terminated *** 2024-09-19T08:56:34.428 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:34 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:34.184+0000 7fe185131640 -1 osd.8 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:56:34.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:34 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:34.091+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:34.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:34 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:34.091+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:34.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:34 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:34.091+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:34.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:34 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:34.091+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:34.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:34 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:34.091+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:34.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:34 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:34.191+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:34.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:34 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:34.191+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:34.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:34 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:34.191+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:34.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:34 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:34.191+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:34.550 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:34 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:34.263+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:34.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:34 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:34.263+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:34.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:34 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:34.263+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:34.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:34 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:34.263+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:34.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:34 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:34.263+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:35.069 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:34 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:34.765+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:35.069 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:34 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:34.765+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:35.069 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:34 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:34.765+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:58.700018+0000 front 2024-09-19T08:55:58.700189+0000 (oldest deadline 2024-09-19T08:56:21.599825+0000) 2024-09-19T08:56:35.069 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:34 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:34.765+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:06.900739+0000 front 2024-09-19T08:56:06.900865+0000 (oldest deadline 2024-09-19T08:56:28.600496+0000) 2024-09-19T08:56:35.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:35 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:35.069+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:35.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:35 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:35.069+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:35.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:35 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:35.069+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:35.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:35 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:35.069+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:35.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:35 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:35.069+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:35.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:35.233+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:35.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:35.233+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:35.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:35.233+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:35.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:35 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:35.233+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:35.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:35 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:35.312+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:35.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:35 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:35.312+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:35.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:35 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:35.312+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:35.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:35 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:35.312+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:35.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:35 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:35.312+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:36.178 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:36 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:36.025+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:36.178 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:36 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:36.025+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:36.178 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:36 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:36.025+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:36.178 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:36 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:36.025+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:36.178 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:36 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:36.025+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:36.179 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:35 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:35.802+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:36.179 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:35 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:35.802+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:36.179 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:35 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:35.802+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:58.700018+0000 front 2024-09-19T08:55:58.700189+0000 (oldest deadline 2024-09-19T08:56:21.599825+0000) 2024-09-19T08:56:36.179 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:35 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:35.802+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:06.900739+0000 front 2024-09-19T08:56:06.900865+0000 (oldest deadline 2024-09-19T08:56:28.600496+0000) 2024-09-19T08:56:36.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:36 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:36.195+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:36.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:36 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:36.195+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:36.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:36 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:36.195+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:36.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:36 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:36.195+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:36.800 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:36 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:36.360+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:36.800 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:36 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:36.360+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:36.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:36 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:36.360+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:36.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:36 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:36.360+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:36.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:36 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:36.360+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:37.063 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:36 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:36.766+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:37.063 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:36 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:36.766+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:37.063 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:36 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:36.766+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:58.700018+0000 front 2024-09-19T08:55:58.700189+0000 (oldest deadline 2024-09-19T08:56:21.599825+0000) 2024-09-19T08:56:37.063 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:36 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:36.766+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:06.900739+0000 front 2024-09-19T08:56:06.900865+0000 (oldest deadline 2024-09-19T08:56:28.600496+0000) 2024-09-19T08:56:37.063 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:36 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:36.766+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:10.901142+0000 front 2024-09-19T08:56:10.901105+0000 (oldest deadline 2024-09-19T08:56:36.201263+0000) 2024-09-19T08:56:37.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:37 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:37.063+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:37.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:37 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:37.063+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:37.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:37 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:37.063+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:37.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:37 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:37.063+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:37.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:37 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:37.063+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:37.534 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:37 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:37.197+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:37.534 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:37 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:37.197+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:37.534 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:37 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:37.197+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:37.534 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:37 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:37.197+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:37.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:37 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:37.394+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:37.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:37 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:37.394+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:37.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:37 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:37.394+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:37.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:37 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:37.394+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:37.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:37 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:37.394+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:38.178 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:38 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:38.015+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:38.179 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:38 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:38.015+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:38.179 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:38 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:38.015+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:38.179 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:38 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:38.015+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:38.179 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:38 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:38.015+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:38.180 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:37 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:37.814+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:38.180 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:37 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:37.814+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:38.180 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:37 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:37.814+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:58.700018+0000 front 2024-09-19T08:55:58.700189+0000 (oldest deadline 2024-09-19T08:56:21.599825+0000) 2024-09-19T08:56:38.180 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:37 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:37.814+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:06.900739+0000 front 2024-09-19T08:56:06.900865+0000 (oldest deadline 2024-09-19T08:56:28.600496+0000) 2024-09-19T08:56:38.181 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:37 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:37.814+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:10.901142+0000 front 2024-09-19T08:56:10.901105+0000 (oldest deadline 2024-09-19T08:56:36.201263+0000) 2024-09-19T08:56:38.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:38 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:38.192+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:38.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:38 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:38.192+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:38.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:38 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:38.192+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:38.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:38 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:38.192+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:38.800 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:38 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:38.424+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:38.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:38 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:38.424+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:38.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:38 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:38.424+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:38.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:38 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:38.424+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:38.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:38 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:38.424+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:38.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:38 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:38.424+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:13.442625+0000 front 2024-09-19T08:56:13.442746+0000 (oldest deadline 2024-09-19T08:56:38.142484+0000) 2024-09-19T08:56:39.178 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:39 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:39.009+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:39.178 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:39 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:39.009+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:39.178 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:39 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:39.009+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:39.178 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:39 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:39.009+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:39.179 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:39 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:39.009+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:39.179 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:39 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:39.009+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:56:39.179 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:38 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:38.776+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:44.297245+0000 front 2024-09-19T08:55:44.297317+0000 (oldest deadline 2024-09-19T08:56:07.797304+0000) 2024-09-19T08:56:39.179 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:38 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:38.776+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:48.298101+0000 front 2024-09-19T08:55:48.298143+0000 (oldest deadline 2024-09-19T08:56:14.198078+0000) 2024-09-19T08:56:39.179 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:38 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:38.776+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:58.700018+0000 front 2024-09-19T08:55:58.700189+0000 (oldest deadline 2024-09-19T08:56:21.599825+0000) 2024-09-19T08:56:39.179 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:38 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:38.776+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:06.900739+0000 front 2024-09-19T08:56:06.900865+0000 (oldest deadline 2024-09-19T08:56:28.600496+0000) 2024-09-19T08:56:39.179 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:38 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8[54159]: 2024-09-19T08:56:38.776+0000 7fe181736640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:10.901142+0000 front 2024-09-19T08:56:10.901105+0000 (oldest deadline 2024-09-19T08:56:36.201263+0000) 2024-09-19T08:56:39.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:39 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:39.214+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:39.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:39 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:39.214+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:39.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:39 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:39.214+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:39.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:39 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:39.214+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:39.702 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:39 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:39.392+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:39.702 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:39 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:39.392+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:39.702 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:39 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:39.392+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:39.702 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:39 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:39.392+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:39.702 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:39 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:39.392+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:39.702 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:39 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:39.392+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:13.442625+0000 front 2024-09-19T08:56:13.442746+0000 (oldest deadline 2024-09-19T08:56:38.142484+0000) 2024-09-19T08:56:39.851 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:39 smithi175 podman[72554]: 2024-09-19 08:56:39.573781721 +0000 UTC m=+5.501199583 container died 77296f38292795a74f445631a6ade384887f09a16ffd1eb8257e528ffdb59a01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T08:56:40.178 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:39 smithi175 podman[72554]: 2024-09-19 08:56:39.959347576 +0000 UTC m=+5.886765429 container cleanup 77296f38292795a74f445631a6ade384887f09a16ffd1eb8257e528ffdb59a01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T08:56:40.178 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:39 smithi175 bash[72554]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8 2024-09-19T08:56:40.178 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:40 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:40.054+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:40.179 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:40 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:40.054+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:40.179 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:40 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:40.054+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:40.179 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:40 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:40.054+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:40.179 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:40 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:40.054+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:40.179 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:40 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:40.054+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:56:40.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:40 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:40.244+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:40.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:40 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:40.244+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:40.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:40 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:40.244+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:40.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:40 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:40.244+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:40.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:40 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:40.244+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.243327+0000 front 2024-09-19T08:56:15.243307+0000 (oldest deadline 2024-09-19T08:56:39.943282+0000) 2024-09-19T08:56:40.577 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:40 smithi175 podman[72571]: 2024-09-19 08:56:40.25288975 +0000 UTC m=+0.669110926 container remove 77296f38292795a74f445631a6ade384887f09a16ffd1eb8257e528ffdb59a01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:56:40.714 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:40 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:40.406+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:40.714 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:40 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:40.406+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:40.714 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:40 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:40.406+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:40.714 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:40 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:40.406+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:40.714 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:40 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:40.406+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:40.714 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:40 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:40.406+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:13.442625+0000 front 2024-09-19T08:56:13.442746+0000 (oldest deadline 2024-09-19T08:56:38.142484+0000) 2024-09-19T08:56:40.871 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:40 smithi175 podman[72662]: 2024-09-19 08:56:40.480858686 +0000 UTC m=+0.015626368 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:56:40.872 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:40 smithi175 podman[72662]: 2024-09-19 08:56:40.611984798 +0000 UTC m=+0.146752473 container create 6addf4f88800465c2039a3ab6f39ab0139d17552c0806aeabfb7c22cee3dea46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T08:56:40.872 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:40 smithi175 podman[72662]: 2024-09-19 08:56:40.814214103 +0000 UTC m=+0.348981775 container init 6addf4f88800465c2039a3ab6f39ab0139d17552c0806aeabfb7c22cee3dea46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T08:56:40.872 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:40 smithi175 podman[72662]: 2024-09-19 08:56:40.817523401 +0000 UTC m=+0.352291075 container start 6addf4f88800465c2039a3ab6f39ab0139d17552c0806aeabfb7c22cee3dea46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8-deactivate, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T08:56:40.872 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:40 smithi175 podman[72662]: 2024-09-19 08:56:40.872419074 +0000 UTC m=+0.407186756 container attach 6addf4f88800465c2039a3ab6f39ab0139d17552c0806aeabfb7c22cee3dea46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T08:56:41.178 INFO:journalctl@ceph.osd.8.smithi175.stdout:Sep 19 08:56:41 smithi175 podman[72662]: 2024-09-19 08:56:41.011490108 +0000 UTC m=+0.546257806 container died 6addf4f88800465c2039a3ab6f39ab0139d17552c0806aeabfb7c22cee3dea46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T08:56:41.178 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:41 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:41.055+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:41.178 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:41 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:41.055+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:41.178 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:41 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:41.055+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:41.178 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:41 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:41.055+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:41.179 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:41 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:41.055+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:41.179 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:41 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:41.055+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:56:41.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:41 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:41.258+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:41.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:41 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:41.258+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:41.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:41 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:41.258+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:41.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:41 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:41.258+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:41.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:41 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:41.258+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.243327+0000 front 2024-09-19T08:56:15.243307+0000 (oldest deadline 2024-09-19T08:56:39.943282+0000) 2024-09-19T08:56:41.648 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T08:56:41.691 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:56:41.691 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T08:56:41.692 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T08:56:41.692 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.9 2024-09-19T08:56:41.800 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:41 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:41.454+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:41.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:41 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:41.454+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:41.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:41 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:41.454+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:41.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:41 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:41.454+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:41.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:41 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:41.454+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:41.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:41 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:41.454+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:13.442625+0000 front 2024-09-19T08:56:13.442746+0000 (oldest deadline 2024-09-19T08:56:38.142484+0000) 2024-09-19T08:56:41.982 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:41 smithi007 systemd[1]: Stopping Ceph osd.9 for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:56:41.982 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:41 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:41.982+0000 7f5718fd7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:56:41.982 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:41 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:41.982+0000 7f5718fd7640 -1 osd.9 96 *** Got signal Terminated *** 2024-09-19T08:56:41.982 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:41 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:41.982+0000 7f5718fd7640 -1 osd.9 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:56:42.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:42 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:42.210+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:42.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:42 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:42.210+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:42.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:42 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:42.210+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:42.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:42 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:42.210+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:42.283 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:42 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:42.210+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.243327+0000 front 2024-09-19T08:56:15.243307+0000 (oldest deadline 2024-09-19T08:56:39.943282+0000) 2024-09-19T08:56:42.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:42 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:42.086+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:42.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:42 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:42.086+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:42.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:42 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:42.086+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:42.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:42 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:42.086+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:42.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:42 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:42.086+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:42.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:42 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:42.086+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:56:42.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:42 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:42.472+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:42.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:42 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:42.472+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:42.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:42 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:42.472+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:42.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:42 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:42.472+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:42.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:42 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:42.472+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:42.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:42 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:42.472+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:13.442625+0000 front 2024-09-19T08:56:13.442746+0000 (oldest deadline 2024-09-19T08:56:38.142484+0000) 2024-09-19T08:56:43.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:43 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:43.132+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:43.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:43 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:43.132+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:43.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:43 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:43.132+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:43.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:43 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:43.132+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:43.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:43 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:43.132+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:43.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:43 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:43.132+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:56:43.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:43 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:43.161+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:43.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:43 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:43.161+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:43.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:43 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:43.161+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:43.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:43 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:43.161+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:43.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:43 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:43.161+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.243327+0000 front 2024-09-19T08:56:15.243307+0000 (oldest deadline 2024-09-19T08:56:39.943282+0000) 2024-09-19T08:56:43.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:43 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:43.500+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:43.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:43 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:43.500+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:43.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:43 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:43.500+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:43.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:43 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:43.500+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:43.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:43 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:43.500+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:43.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:43 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:43.500+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:13.442625+0000 front 2024-09-19T08:56:13.442746+0000 (oldest deadline 2024-09-19T08:56:38.142484+0000) 2024-09-19T08:56:44.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:44 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:44.119+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:44.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:44 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:44.119+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:44.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:44 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:44.119+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:44.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:44 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:44.119+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:44.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:44 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:44.119+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:44.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:44 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:44.119+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:56:44.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:44 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:44.173+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:44.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:44 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:44.173+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:44.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:44 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:44.174+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:44.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:44 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:44.174+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:44.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:44 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:44.174+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.243327+0000 front 2024-09-19T08:56:15.243307+0000 (oldest deadline 2024-09-19T08:56:39.943282+0000) 2024-09-19T08:56:44.800 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:44 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:44.456+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:44.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:44 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:44.456+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:44.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:44 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:44.456+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:44.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:44 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:44.456+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:44.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:44 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:44.456+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:44.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:44 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:44.456+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:13.442625+0000 front 2024-09-19T08:56:13.442746+0000 (oldest deadline 2024-09-19T08:56:38.142484+0000) 2024-09-19T08:56:45.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:45 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:45.104+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:45.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:45 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:45.104+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:45.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:45 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:45.104+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:45.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:45 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:45.104+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:45.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:45 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:45.104+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:45.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:45 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:45.104+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:56:45.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:45 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:45.175+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:45.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:45 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:45.175+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:45.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:45 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:45.175+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:45.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:45 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:45.175+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:45.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:45 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:45.175+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.243327+0000 front 2024-09-19T08:56:15.243307+0000 (oldest deadline 2024-09-19T08:56:39.943282+0000) 2024-09-19T08:56:45.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:45 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:45.466+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:45.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:45 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:45.466+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:45.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:45 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:45.466+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:45.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:45 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:45.466+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:45.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:45 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:45.466+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:45.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:45 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:45.466+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:13.442625+0000 front 2024-09-19T08:56:13.442746+0000 (oldest deadline 2024-09-19T08:56:38.142484+0000) 2024-09-19T08:56:46.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:46 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:46.138+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:46.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:46 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:46.138+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:46.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:46 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:46.138+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:46.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:46 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:46.138+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:46.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:46 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:46.138+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:46.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:46 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:46.138+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:56:46.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:46 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:46.156+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.536784+0000 front 2024-09-19T08:55:34.536895+0000 (oldest deadline 2024-09-19T08:56:00.436893+0000) 2024-09-19T08:56:46.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:46 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:46.156+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.238383+0000 front 2024-09-19T08:55:43.238428+0000 (oldest deadline 2024-09-19T08:56:05.538223+0000) 2024-09-19T08:56:46.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:46 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:46.156+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:49.639377+0000 front 2024-09-19T08:55:49.639203+0000 (oldest deadline 2024-09-19T08:56:13.139296+0000) 2024-09-19T08:56:46.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:46 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:46.156+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:59.040217+0000 front 2024-09-19T08:55:59.040299+0000 (oldest deadline 2024-09-19T08:56:21.940351+0000) 2024-09-19T08:56:46.533 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:46 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9[65852]: 2024-09-19T08:56:46.156+0000 7f57115d4640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.243327+0000 front 2024-09-19T08:56:15.243307+0000 (oldest deadline 2024-09-19T08:56:39.943282+0000) 2024-09-19T08:56:46.800 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:46 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:46.448+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:46.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:46 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:46.448+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:46.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:46 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:46.448+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:46.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:46 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:46.448+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:46.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:46 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:46.448+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:46.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:46 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:46.448+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:13.442625+0000 front 2024-09-19T08:56:13.442746+0000 (oldest deadline 2024-09-19T08:56:38.142484+0000) 2024-09-19T08:56:47.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:47 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:47.176+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:47.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:47 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:47.176+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:47.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:47 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:47.176+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:47.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:47 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:47.176+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:47.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:47 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:47.176+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:47.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:47 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:47.176+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:56:47.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:47 smithi007 podman[112236]: 2024-09-19 08:56:47.307735167 +0000 UTC m=+5.406412457 container died 91c64266f7831b00db16c094242da30e3b24513d9ccfac830ce63d28b30c289a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T08:56:47.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:47 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:47.477+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:47.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:47 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:47.477+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:47.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:47 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:47.477+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:47.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:47 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:47.477+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:47.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:47 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:47.477+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:47.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:47 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:47.477+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:13.442625+0000 front 2024-09-19T08:56:13.442746+0000 (oldest deadline 2024-09-19T08:56:38.142484+0000) 2024-09-19T08:56:47.906 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:47 smithi007 podman[112236]: 2024-09-19 08:56:47.664680709 +0000 UTC m=+5.763357984 container cleanup 91c64266f7831b00db16c094242da30e3b24513d9ccfac830ce63d28b30c289a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T08:56:47.906 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:47 smithi007 bash[112236]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9 2024-09-19T08:56:48.232 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:47 smithi007 podman[112253]: 2024-09-19 08:56:47.90758442 +0000 UTC m=+0.598451689 container remove 91c64266f7831b00db16c094242da30e3b24513d9ccfac830ce63d28b30c289a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-19T08:56:48.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:48 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:48.133+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:48.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:48 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:48.133+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:48.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:48 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:48.133+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:48.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:48 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:48.133+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:48.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:48 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:48.133+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:48.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:48 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:48.133+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:56:48.510 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:48 smithi007 podman[112342]: 2024-09-19 08:56:48.233432408 +0000 UTC m=+0.111400629 container create 5c9d7657562740a919b4e8e580e24bbc648ec31a948f2555e5028cf4fd93ffde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T08:56:48.510 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:48 smithi007 podman[112342]: 2024-09-19 08:56:48.138493682 +0000 UTC m=+0.016461923 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:56:48.510 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:48 smithi007 podman[112342]: 2024-09-19 08:56:48.436005607 +0000 UTC m=+0.313973833 container init 5c9d7657562740a919b4e8e580e24bbc648ec31a948f2555e5028cf4fd93ffde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T08:56:48.510 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:48 smithi007 podman[112342]: 2024-09-19 08:56:48.439605863 +0000 UTC m=+0.317574085 container start 5c9d7657562740a919b4e8e580e24bbc648ec31a948f2555e5028cf4fd93ffde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:56:48.510 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:48 smithi007 podman[112342]: 2024-09-19 08:56:48.511107553 +0000 UTC m=+0.389075788 container attach 5c9d7657562740a919b4e8e580e24bbc648ec31a948f2555e5028cf4fd93ffde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:56:48.783 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 08:56:48 smithi007 podman[112342]: 2024-09-19 08:56:48.635336867 +0000 UTC m=+0.513305098 container died 5c9d7657562740a919b4e8e580e24bbc648ec31a948f2555e5028cf4fd93ffde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T08:56:48.800 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:48 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:48.493+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:48.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:48 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:48.493+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:48.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:48 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:48.493+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:48.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:48 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:48.493+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:48.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:48 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:48.493+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:48.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:48 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:48.493+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:13.442625+0000 front 2024-09-19T08:56:13.442746+0000 (oldest deadline 2024-09-19T08:56:38.142484+0000) 2024-09-19T08:56:48.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:48 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:48.493+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T08:56:22.843443+0000 front 2024-09-19T08:56:22.843395+0000 (oldest deadline 2024-09-19T08:56:48.143263+0000) 2024-09-19T08:56:49.205 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T08:56:49.247 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:56:49.247 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T08:56:49.247 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T08:56:49.247 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.10 2024-09-19T08:56:49.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:49 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:49.089+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:49.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:49 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:49.089+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:49.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:49 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:49.089+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:49.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:49 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:49.090+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:49.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:49 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:49.090+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:49.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:49 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:49.090+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:56:49.550 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:49 smithi044 systemd[1]: Stopping Ceph osd.10 for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:56:49.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:49 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:49.474+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:49.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:49 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:49.474+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:49.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:49 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:49.474+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:49.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:49 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:49.474+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:49.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:49 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:49.474+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:49.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:49 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:49.474+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:13.442625+0000 front 2024-09-19T08:56:13.442746+0000 (oldest deadline 2024-09-19T08:56:38.142484+0000) 2024-09-19T08:56:49.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:49 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:49.474+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T08:56:22.843443+0000 front 2024-09-19T08:56:22.843395+0000 (oldest deadline 2024-09-19T08:56:48.143263+0000) 2024-09-19T08:56:50.050 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:49 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:49.605+0000 7effb3828640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:56:50.050 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:49 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:49.605+0000 7effb3828640 -1 osd.10 96 *** Got signal Terminated *** 2024-09-19T08:56:50.051 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:49 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:49.605+0000 7effb3828640 -1 osd.10 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:56:50.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:50 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:50.055+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:50.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:50 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:50.055+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:50.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:50 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:50.055+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:50.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:50 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:50.055+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:50.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:50 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:50.055+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:50.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:50 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:50.055+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:56:50.757 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:50 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:50.440+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:50.757 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:50 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:50.440+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:50.757 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:50 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:50.440+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:50.757 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:50 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:50.440+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:50.757 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:50 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:50.440+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:50.757 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:50 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:50.440+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:13.442625+0000 front 2024-09-19T08:56:13.442746+0000 (oldest deadline 2024-09-19T08:56:38.142484+0000) 2024-09-19T08:56:50.757 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:50 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:50.440+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T08:56:22.843443+0000 front 2024-09-19T08:56:22.843395+0000 (oldest deadline 2024-09-19T08:56:48.143263+0000) 2024-09-19T08:56:51.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:51 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:51.095+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:51.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:51 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:51.095+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:51.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:51 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:51.095+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:51.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:51 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:51.095+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:51.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:51 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:51.095+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:51.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:51 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:51.095+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:56:51.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:51 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:51.434+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:51.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:51 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:51.434+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:51.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:51 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:51.434+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:51.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:51 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:51.434+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:51.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:51 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:51.434+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:51.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:51 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:51.434+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:13.442625+0000 front 2024-09-19T08:56:13.442746+0000 (oldest deadline 2024-09-19T08:56:38.142484+0000) 2024-09-19T08:56:51.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:51 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:51.434+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T08:56:22.843443+0000 front 2024-09-19T08:56:22.843395+0000 (oldest deadline 2024-09-19T08:56:48.143263+0000) 2024-09-19T08:56:52.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:52 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:52.062+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:52.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:52 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:52.062+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:52.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:52 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:52.062+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:52.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:52 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:52.062+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:52.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:52 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:52.062+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:52.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:52 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:52.062+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:56:52.800 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:52 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:52.415+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:52.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:52 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:52.415+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:52.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:52 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:52.415+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:52.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:52 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:52.415+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:52.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:52 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:52.415+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:52.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:52 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:52.415+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:13.442625+0000 front 2024-09-19T08:56:13.442746+0000 (oldest deadline 2024-09-19T08:56:38.142484+0000) 2024-09-19T08:56:52.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:52 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:52.415+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T08:56:22.843443+0000 front 2024-09-19T08:56:22.843395+0000 (oldest deadline 2024-09-19T08:56:48.143263+0000) 2024-09-19T08:56:53.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:53 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:53.048+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:53.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:53 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:53.048+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:53.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:53 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:53.048+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:53.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:53 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:53.048+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:53.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:53 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:53.048+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:53.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:53 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:53.048+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:56:53.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:53 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:53.402+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:53.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:53 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:53.402+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:53.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:53 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:53.402+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:53.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:53 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:53.402+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:53.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:53 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:53.402+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:53.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:53 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:53.402+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:13.442625+0000 front 2024-09-19T08:56:13.442746+0000 (oldest deadline 2024-09-19T08:56:38.142484+0000) 2024-09-19T08:56:53.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:53 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:53.402+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T08:56:22.843443+0000 front 2024-09-19T08:56:22.843395+0000 (oldest deadline 2024-09-19T08:56:48.143263+0000) 2024-09-19T08:56:54.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:54 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:54.025+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:54.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:54 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:54.025+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:54.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:54 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:54.025+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:54.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:54 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:54.025+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:54.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:54 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:54.025+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:54.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:54 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:54.025+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:56:54.800 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:54 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:54.401+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:33.237293+0000 front 2024-09-19T08:55:33.237381+0000 (oldest deadline 2024-09-19T08:55:58.537040+0000) 2024-09-19T08:56:54.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:54 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:54.401+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:43.738537+0000 front 2024-09-19T08:55:43.738445+0000 (oldest deadline 2024-09-19T08:56:09.038639+0000) 2024-09-19T08:56:54.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:54 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:54.401+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:51.339723+0000 front 2024-09-19T08:55:51.339661+0000 (oldest deadline 2024-09-19T08:56:14.239578+0000) 2024-09-19T08:56:54.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:54 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:54.401+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:56:00.140486+0000 front 2024-09-19T08:56:00.140472+0000 (oldest deadline 2024-09-19T08:56:24.840341+0000) 2024-09-19T08:56:54.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:54 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:54.401+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:07.141155+0000 front 2024-09-19T08:56:07.141209+0000 (oldest deadline 2024-09-19T08:56:29.441270+0000) 2024-09-19T08:56:54.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:54 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:54.401+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:13.442625+0000 front 2024-09-19T08:56:13.442746+0000 (oldest deadline 2024-09-19T08:56:38.142484+0000) 2024-09-19T08:56:54.801 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:54 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10[59513]: 2024-09-19T08:56:54.401+0000 7effabe25640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T08:56:22.843443+0000 front 2024-09-19T08:56:22.843395+0000 (oldest deadline 2024-09-19T08:56:48.143263+0000) 2024-09-19T08:56:55.294 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:55 smithi044 podman[70960]: 2024-09-19 08:56:55.028108599 +0000 UTC m=+5.575490050 container died 69faeb31908594480473b5058d22142d1fbe4813179826b4ada752d21088d442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:56:55.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:55 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:55.031+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:55.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:55 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:55.031+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:55.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:55 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:55.031+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:55.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:55 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:55.031+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:55.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:55 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:55.031+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:55.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:55 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:55.031+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:56:55.550 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:55 smithi044 podman[70960]: 2024-09-19 08:56:55.394234349 +0000 UTC m=+5.941615789 container cleanup 69faeb31908594480473b5058d22142d1fbe4813179826b4ada752d21088d442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T08:56:55.550 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:55 smithi044 bash[70960]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10 2024-09-19T08:56:55.961 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:55 smithi044 podman[70975]: 2024-09-19 08:56:55.645687916 +0000 UTC m=+0.610555662 container remove 69faeb31908594480473b5058d22142d1fbe4813179826b4ada752d21088d442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T08:56:56.264 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:55 smithi044 podman[71063]: 2024-09-19 08:56:55.865187004 +0000 UTC m=+0.015528689 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:56:56.264 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:55 smithi044 podman[71063]: 2024-09-19 08:56:55.97130068 +0000 UTC m=+0.121642419 container create 9f2b902fe13b6ee3c6ae3256941ab0e2afde202016409073e1da3b5fc63fd4f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10-deactivate, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T08:56:56.264 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:56 smithi044 podman[71063]: 2024-09-19 08:56:56.181940769 +0000 UTC m=+0.332282441 container init 9f2b902fe13b6ee3c6ae3256941ab0e2afde202016409073e1da3b5fc63fd4f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:56:56.264 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:56 smithi044 podman[71063]: 2024-09-19 08:56:56.185264891 +0000 UTC m=+0.335606562 container start 9f2b902fe13b6ee3c6ae3256941ab0e2afde202016409073e1da3b5fc63fd4f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T08:56:56.265 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:56 smithi044 podman[71063]: 2024-09-19 08:56:56.2652241 +0000 UTC m=+0.415565783 container attach 9f2b902fe13b6ee3c6ae3256941ab0e2afde202016409073e1da3b5fc63fd4f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10-deactivate, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:56:56.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:56 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:56.023+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:56.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:56 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:56.023+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:56.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:56 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:56.023+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:56.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:56 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:56.023+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:56.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:56 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:56.023+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:56.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:56 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:56.023+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:56:56.551 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 19 08:56:56 smithi044 podman[71063]: 2024-09-19 08:56:56.371936491 +0000 UTC m=+0.522278170 container died 9f2b902fe13b6ee3c6ae3256941ab0e2afde202016409073e1da3b5fc63fd4f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T08:56:57.057 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T08:56:57.095 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:56:57.096 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T08:56:57.096 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T08:56:57.096 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.11 2024-09-19T08:56:57.371 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:56 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:56.981+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:57.372 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:56 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:56.981+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:57.372 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:56 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:56.981+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:57.372 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:56 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:56.981+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:57.372 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:56 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:56.981+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:57.372 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:56 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:56.981+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:56:57.372 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:56 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:56.981+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-19T08:56:31.197074+0000 front 2024-09-19T08:56:31.197133+0000 (oldest deadline 2024-09-19T08:56:56.496933+0000) 2024-09-19T08:56:57.372 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:57 smithi175 systemd[1]: Stopping Ceph osd.11 for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:56:57.678 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:57 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:57.418+0000 7fef1ec44640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:56:57.678 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:57 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:57.419+0000 7fef1ec44640 -1 osd.11 96 *** Got signal Terminated *** 2024-09-19T08:56:57.678 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:57 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:57.419+0000 7fef1ec44640 -1 osd.11 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T08:56:58.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:57 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:57.970+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:58.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:57 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:57.970+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:58.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:57 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:57.970+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:58.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:57 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:57.970+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:58.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:57 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:57.970+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:58.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:57 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:57.970+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:56:58.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:57 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:57.970+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-19T08:56:31.197074+0000 front 2024-09-19T08:56:31.197133+0000 (oldest deadline 2024-09-19T08:56:56.496933+0000) 2024-09-19T08:56:59.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:58 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:58.989+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:56:59.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:58 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:58.989+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:56:59.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:58 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:58.989+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:56:59.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:58 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:58.989+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:56:59.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:58 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:58.989+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:56:59.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:58 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:58.989+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:56:59.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:58 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:58.989+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-19T08:56:31.197074+0000 front 2024-09-19T08:56:31.197133+0000 (oldest deadline 2024-09-19T08:56:56.496933+0000) 2024-09-19T08:57:00.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:59 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:59.970+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:57:00.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:59 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:59.970+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:57:00.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:59 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:59.970+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:57:00.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:59 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:59.970+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:57:00.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:59 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:59.970+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:57:00.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:59 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:59.970+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:57:00.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:56:59 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:56:59.970+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-19T08:56:31.197074+0000 front 2024-09-19T08:56:31.197133+0000 (oldest deadline 2024-09-19T08:56:56.496933+0000) 2024-09-19T08:57:01.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:01 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:57:01.005+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:57:01.552 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:01 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:57:01.005+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:57:01.552 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:01 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:57:01.005+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:57:01.552 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:01 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:57:01.005+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:57:01.552 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:01 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:57:01.005+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:57:01.552 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:01 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:57:01.005+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:57:01.552 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:01 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:57:01.005+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-19T08:56:31.197074+0000 front 2024-09-19T08:56:31.197133+0000 (oldest deadline 2024-09-19T08:56:56.496933+0000) 2024-09-19T08:57:02.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:01 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:57:01.968+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T08:55:34.589199+0000 front 2024-09-19T08:55:34.589231+0000 (oldest deadline 2024-09-19T08:55:57.489084+0000) 2024-09-19T08:57:02.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:01 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:57:01.968+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-19T08:55:41.590323+0000 front 2024-09-19T08:55:41.590375+0000 (oldest deadline 2024-09-19T08:56:07.490408+0000) 2024-09-19T08:57:02.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:01 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:57:01.968+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-09-19T08:55:52.191320+0000 front 2024-09-19T08:55:52.191295+0000 (oldest deadline 2024-09-19T08:56:16.291432+0000) 2024-09-19T08:57:02.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:01 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:57:01.968+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T08:55:56.292070+0000 front 2024-09-19T08:55:56.292047+0000 (oldest deadline 2024-09-19T08:56:20.992066+0000) 2024-09-19T08:57:02.428 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:01 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:57:01.968+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-19T08:56:04.493014+0000 front 2024-09-19T08:56:04.493050+0000 (oldest deadline 2024-09-19T08:56:32.693625+0000) 2024-09-19T08:57:02.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:01 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:57:01.968+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-09-19T08:56:15.494758+0000 front 2024-09-19T08:56:15.494737+0000 (oldest deadline 2024-09-19T08:56:38.394850+0000) 2024-09-19T08:57:02.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:01 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:57:01.968+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-19T08:56:31.197074+0000 front 2024-09-19T08:56:31.197133+0000 (oldest deadline 2024-09-19T08:56:56.496933+0000) 2024-09-19T08:57:02.429 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:01 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11[60912]: 2024-09-19T08:57:01.968+0000 7fef1b249640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.175:6820 osd.8 since back 2024-09-19T08:56:38.197845+0000 front 2024-09-19T08:56:38.197801+0000 (oldest deadline 2024-09-19T08:57:01.697895+0000) 2024-09-19T08:57:03.011 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:02 smithi175 podman[72776]: 2024-09-19 08:57:02.743163218 +0000 UTC m=+5.450238374 container died ba03899e44af1870e9060fb1216bf0f529475cebec7a921221c07c65c5502aa8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T08:57:03.327 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:03 smithi175 podman[72776]: 2024-09-19 08:57:03.118662281 +0000 UTC m=+5.825737435 container cleanup ba03899e44af1870e9060fb1216bf0f529475cebec7a921221c07c65c5502aa8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:57:03.327 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:03 smithi175 bash[72776]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11 2024-09-19T08:57:03.636 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:03 smithi175 podman[72790]: 2024-09-19 08:57:03.328232616 +0000 UTC m=+0.581093478 container remove ba03899e44af1870e9060fb1216bf0f529475cebec7a921221c07c65c5502aa8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T08:57:03.928 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:03 smithi175 podman[72881]: 2024-09-19 08:57:03.637229704 +0000 UTC m=+0.095856758 container create 66ed2b98dd0a3858f1b5b0ba2cdeb7f2e00c568fd2760a244b61162f2e5f4264 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T08:57:03.928 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:03 smithi175 podman[72881]: 2024-09-19 08:57:03.556942723 +0000 UTC m=+0.015569787 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:57:03.928 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:03 smithi175 podman[72881]: 2024-09-19 08:57:03.872861132 +0000 UTC m=+0.331488186 container init 66ed2b98dd0a3858f1b5b0ba2cdeb7f2e00c568fd2760a244b61162f2e5f4264 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True) 2024-09-19T08:57:03.928 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:03 smithi175 podman[72881]: 2024-09-19 08:57:03.876097919 +0000 UTC m=+0.334724974 container start 66ed2b98dd0a3858f1b5b0ba2cdeb7f2e00c568fd2760a244b61162f2e5f4264 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11-deactivate, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:57:04.341 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:03 smithi175 podman[72881]: 2024-09-19 08:57:03.96484172 +0000 UTC m=+0.423468782 container attach 66ed2b98dd0a3858f1b5b0ba2cdeb7f2e00c568fd2760a244b61162f2e5f4264 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11-deactivate, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:57:04.341 INFO:journalctl@ceph.osd.11.smithi175.stdout:Sep 19 08:57:04 smithi175 podman[72881]: 2024-09-19 08:57:04.061911073 +0000 UTC m=+0.520538128 container died 66ed2b98dd0a3858f1b5b0ba2cdeb7f2e00c568fd2760a244b61162f2e5f4264 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T08:57:04.564 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T08:57:04.601 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:57:04.602 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T08:57:04.602 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T08:57:04.602 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.a 2024-09-19T08:57:04.907 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 08:57:04 smithi007 systemd[1]: Stopping Ceph mds.a for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:57:05.283 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 08:57:04 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-a[72780]: 2024-09-19T08:57:04.907+0000 7fd5b1175640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:57:05.283 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 08:57:04 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-a[72780]: 2024-09-19T08:57:04.907+0000 7fd5b1175640 -1 mds.a *** got signal Terminated *** 2024-09-19T08:57:07.682 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 08:57:07 smithi007 podman[112445]: 2024-09-19 08:57:07.400703503 +0000 UTC m=+2.602578426 container died 7e66f5d7bf70d18608f137c7582a11074f59182c6a7e4fbaf1df71f7eec7e44f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:57:08.032 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 08:57:07 smithi007 podman[112445]: 2024-09-19 08:57:07.849152539 +0000 UTC m=+3.051018229 container cleanup 7e66f5d7bf70d18608f137c7582a11074f59182c6a7e4fbaf1df71f7eec7e44f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T08:57:08.033 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 08:57:07 smithi007 bash[112445]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-a 2024-09-19T08:57:08.279 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T08:57:08.282 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 08:57:08 smithi007 podman[112458]: 2024-09-19 08:57:08.033735834 +0000 UTC m=+0.623481911 container remove 7e66f5d7bf70d18608f137c7582a11074f59182c6a7e4fbaf1df71f7eec7e44f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:57:08.283 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 08:57:08 smithi007 systemd[1]: ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.a.service: Deactivated successfully. 2024-09-19T08:57:08.283 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 08:57:08 smithi007 systemd[1]: Stopped Ceph mds.a for ebd23124-7661-11ef-bceb-c7b262605968. 2024-09-19T08:57:08.283 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 08:57:08 smithi007 systemd[1]: ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.a.service: Consumed 1.097s CPU time. 2024-09-19T08:57:08.314 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:57:08.314 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T08:57:08.314 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T08:57:08.314 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.d 2024-09-19T08:57:08.644 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 08:57:08 smithi007 systemd[1]: Stopping Ceph mds.d for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:57:09.033 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 08:57:08 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-d[71662]: 2024-09-19T08:57:08.644+0000 7eff38ce3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:57:09.033 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 08:57:08 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-d[71662]: 2024-09-19T08:57:08.644+0000 7eff38ce3640 -1 mds.d *** got signal Terminated *** 2024-09-19T08:57:12.919 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 08:57:12 smithi007 podman[112566]: 2024-09-19 08:57:12.652924962 +0000 UTC m=+4.112505407 container died 38b4260d1883a6f62b460b157dc6f0cfb612ca7757daaa478ed10d107551f27a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T08:57:13.270 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 08:57:13 smithi007 podman[112566]: 2024-09-19 08:57:13.086162181 +0000 UTC m=+4.545742665 container cleanup 38b4260d1883a6f62b460b157dc6f0cfb612ca7757daaa478ed10d107551f27a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T08:57:13.270 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 08:57:13 smithi007 bash[112566]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-d 2024-09-19T08:57:13.497 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T08:57:13.520 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 08:57:13 smithi007 podman[112579]: 2024-09-19 08:57:13.270802617 +0000 UTC m=+0.613621652 container remove 38b4260d1883a6f62b460b157dc6f0cfb612ca7757daaa478ed10d107551f27a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-d, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-19T08:57:13.520 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 08:57:13 smithi007 systemd[1]: ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.d.service: Deactivated successfully. 2024-09-19T08:57:13.520 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 08:57:13 smithi007 systemd[1]: Stopped Ceph mds.d for ebd23124-7661-11ef-bceb-c7b262605968. 2024-09-19T08:57:13.520 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 08:57:13 smithi007 systemd[1]: ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.d.service: Consumed 1.087s CPU time. 2024-09-19T08:57:13.531 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:57:13.531 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T08:57:13.532 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T08:57:13.532 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.g 2024-09-19T08:57:13.783 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 08:57:13 smithi007 systemd[1]: Stopping Ceph mds.g for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:57:14.283 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 08:57:13 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-g[72440]: 2024-09-19T08:57:13.865+0000 7f1736a14640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:57:14.283 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 08:57:13 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-g[72440]: 2024-09-19T08:57:13.865+0000 7f1736a14640 -1 mds.g *** got signal Terminated *** 2024-09-19T08:57:17.090 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 08:57:16 smithi007 podman[112685]: 2024-09-19 08:57:16.799957213 +0000 UTC m=+3.045526209 container died cbae8757562b671826fa9698eff78b348ce337b9399a46b3a58835387d644678 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-g, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T08:57:17.533 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 08:57:17 smithi007 podman[112685]: 2024-09-19 08:57:17.265310235 +0000 UTC m=+3.510879205 container cleanup cbae8757562b671826fa9698eff78b348ce337b9399a46b3a58835387d644678 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T08:57:17.533 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 08:57:17 smithi007 bash[112685]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-g 2024-09-19T08:57:17.701 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T08:57:17.735 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:57:17.736 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T08:57:17.736 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T08:57:17.736 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.j 2024-09-19T08:57:18.094 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 08:57:17 smithi007 systemd[1]: Stopping Ceph mds.j for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:57:18.533 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 08:57:18 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-j[71249]: 2024-09-19T08:57:18.094+0000 7f4bfef3f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:57:18.533 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 08:57:18 smithi007 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-j[71249]: 2024-09-19T08:57:18.094+0000 7f4bfef3f640 -1 mds.j *** got signal Terminated *** 2024-09-19T08:57:21.920 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 08:57:21 smithi007 podman[112806]: 2024-09-19 08:57:21.659751934 +0000 UTC m=+3.702866540 container died a98b391b1177ab20c379c98925c9290a37b5f169e1d75580bea98e8424805254 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:57:22.286 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 08:57:22 smithi007 podman[112806]: 2024-09-19 08:57:22.086108165 +0000 UTC m=+4.129222802 container cleanup a98b391b1177ab20c379c98925c9290a37b5f169e1d75580bea98e8424805254 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-j, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T08:57:22.286 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 08:57:22 smithi007 bash[112806]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-j 2024-09-19T08:57:22.509 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T08:57:22.556 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 08:57:22 smithi007 podman[112817]: 2024-09-19 08:57:22.28727491 +0000 UTC m=+0.622979792 container remove a98b391b1177ab20c379c98925c9290a37b5f169e1d75580bea98e8424805254 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-j, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T08:57:22.556 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 08:57:22 smithi007 systemd[1]: ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.j.service: Deactivated successfully. 2024-09-19T08:57:22.556 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 08:57:22 smithi007 systemd[1]: Stopped Ceph mds.j for ebd23124-7661-11ef-bceb-c7b262605968. 2024-09-19T08:57:22.557 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 08:57:22 smithi007 systemd[1]: ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.j.service: Consumed 1.061s CPU time. 2024-09-19T08:57:22.572 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:57:22.572 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T08:57:22.572 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T08:57:22.573 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.b 2024-09-19T08:57:22.886 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 19 08:57:22 smithi044 systemd[1]: Stopping Ceph mds.b for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:57:23.159 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 19 08:57:22 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-b[64891]: 2024-09-19T08:57:22.886+0000 7f0d7a69c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:57:23.159 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 19 08:57:22 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-b[64891]: 2024-09-19T08:57:22.886+0000 7f0d7a69c640 -1 mds.b *** got signal Terminated *** 2024-09-19T08:57:24.252 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 19 08:57:24 smithi044 podman[71166]: 2024-09-19 08:57:24.002825141 +0000 UTC m=+1.218238007 container died 322e2a45ab0fcdcd93a1ada7d039594b4f94cd5d880817bff26bd8a8cd39c79a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-b, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T08:57:24.550 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 19 08:57:24 smithi044 podman[71166]: 2024-09-19 08:57:24.35270274 +0000 UTC m=+1.568115592 container cleanup 322e2a45ab0fcdcd93a1ada7d039594b4f94cd5d880817bff26bd8a8cd39c79a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T08:57:24.550 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 19 08:57:24 smithi044 bash[71166]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-b 2024-09-19T08:57:24.785 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T08:57:24.821 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:57:24.821 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T08:57:24.821 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T08:57:24.822 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.e 2024-09-19T08:57:25.301 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 19 08:57:24 smithi044 systemd[1]: Stopping Ceph mds.e for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:57:25.301 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 19 08:57:25 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-e[64280]: 2024-09-19T08:57:25.148+0000 7f690d1bc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:57:25.301 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 19 08:57:25 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-e[64280]: 2024-09-19T08:57:25.148+0000 7f690d1bc640 -1 mds.e *** got signal Terminated *** 2024-09-19T08:57:28.265 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 19 08:57:28 smithi044 podman[71300]: 2024-09-19 08:57:28.00727434 +0000 UTC m=+2.960080722 container died afff7b1a98923ce756b8593edeb0b1e19cdedd8a8b153c3de6f635597095adf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T08:57:28.550 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 19 08:57:28 smithi044 podman[71300]: 2024-09-19 08:57:28.364766429 +0000 UTC m=+3.317572795 container cleanup afff7b1a98923ce756b8593edeb0b1e19cdedd8a8b153c3de6f635597095adf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-e, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T08:57:28.551 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 19 08:57:28 smithi044 bash[71300]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-e 2024-09-19T08:57:28.753 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T08:57:28.785 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:57:28.786 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T08:57:28.786 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T08:57:28.786 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.h 2024-09-19T08:57:29.301 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 19 08:57:28 smithi044 systemd[1]: Stopping Ceph mds.h for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:57:29.301 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 19 08:57:29 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-h[64584]: 2024-09-19T08:57:29.110+0000 7f13f28e0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:57:29.301 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 19 08:57:29 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-h[64584]: 2024-09-19T08:57:29.110+0000 7f13f28e0640 -1 mds.h *** got signal Terminated *** 2024-09-19T08:57:32.268 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 19 08:57:32 smithi044 podman[71420]: 2024-09-19 08:57:32.000896958 +0000 UTC m=+2.997972304 container died 970b838a85c0af10dca20048d27e240f6a071fb67a00e0c794f8283a569ba094 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-h, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T08:57:32.550 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 19 08:57:32 smithi044 podman[71420]: 2024-09-19 08:57:32.368438781 +0000 UTC m=+3.365514119 container cleanup 970b838a85c0af10dca20048d27e240f6a071fb67a00e0c794f8283a569ba094 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T08:57:32.551 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 19 08:57:32 smithi044 bash[71420]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-h 2024-09-19T08:57:32.946 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T08:57:32.978 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:57:32.979 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T08:57:32.979 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T08:57:32.979 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.k 2024-09-19T08:57:33.300 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 19 08:57:33 smithi044 systemd[1]: Stopping Ceph mds.k for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:57:33.636 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 19 08:57:33 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-k[63964]: 2024-09-19T08:57:33.313+0000 7f5ea9fed640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:57:33.636 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 19 08:57:33 smithi044 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-k[63964]: 2024-09-19T08:57:33.313+0000 7f5ea9fed640 -1 mds.k *** got signal Terminated *** 2024-09-19T08:57:35.038 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 19 08:57:34 smithi044 podman[71542]: 2024-09-19 08:57:34.675360595 +0000 UTC m=+1.472351791 container died b90e1c6dae336dd6a4cf892c3d9dcab1030b611982ce1a29c19f95cd6bc997d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-k, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:57:35.300 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 19 08:57:35 smithi044 podman[71542]: 2024-09-19 08:57:35.13047822 +0000 UTC m=+1.927469414 container cleanup b90e1c6dae336dd6a4cf892c3d9dcab1030b611982ce1a29c19f95cd6bc997d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-k, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T08:57:35.301 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 19 08:57:35 smithi044 bash[71542]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-k 2024-09-19T08:57:35.564 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T08:57:35.596 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:57:35.596 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T08:57:35.596 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T08:57:35.597 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.c 2024-09-19T08:57:35.891 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 19 08:57:35 smithi175 systemd[1]: Stopping Ceph mds.c for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:57:36.144 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 19 08:57:35 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-c[66211]: 2024-09-19T08:57:35.891+0000 7f3642a09640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:57:36.144 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 19 08:57:35 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-c[66211]: 2024-09-19T08:57:35.891+0000 7f3642a09640 -1 mds.c *** got signal Terminated *** 2024-09-19T08:57:40.178 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 19 08:57:39 smithi175 podman[72985]: 2024-09-19 08:57:39.899384303 +0000 UTC m=+4.101101222 container died 29ba581350ccc6448b9776e90bedbc182362e5f7f75cd6a7a97a929939745d6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T08:57:40.683 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 19 08:57:40 smithi175 podman[72985]: 2024-09-19 08:57:40.47434587 +0000 UTC m=+4.676062792 container cleanup 29ba581350ccc6448b9776e90bedbc182362e5f7f75cd6a7a97a929939745d6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:57:40.683 INFO:journalctl@ceph.mds.c.smithi175.stdout:Sep 19 08:57:40 smithi175 bash[72985]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-c 2024-09-19T08:57:40.868 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T08:57:40.905 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:57:40.905 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T08:57:40.906 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T08:57:40.906 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.f 2024-09-19T08:57:41.428 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 19 08:57:40 smithi175 systemd[1]: Stopping Ceph mds.f for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:57:41.428 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 19 08:57:41 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-f[65906]: 2024-09-19T08:57:41.228+0000 7f23b7d15640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:57:41.428 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 19 08:57:41 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-f[65906]: 2024-09-19T08:57:41.228+0000 7f23b7d15640 -1 mds.f *** got signal Terminated *** 2024-09-19T08:57:44.344 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 19 08:57:44 smithi175 podman[73118]: 2024-09-19 08:57:44.002416663 +0000 UTC m=+2.879144254 container died 8fec6e9e61e055600ae82b2960260498e1c92d3391169f2f2e28dbdc5fc9cbec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T08:57:44.619 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 19 08:57:44 smithi175 podman[73118]: 2024-09-19 08:57:44.402749944 +0000 UTC m=+3.279477525 container cleanup 8fec6e9e61e055600ae82b2960260498e1c92d3391169f2f2e28dbdc5fc9cbec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T08:57:44.619 INFO:journalctl@ceph.mds.f.smithi175.stdout:Sep 19 08:57:44 smithi175 bash[73118]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-f 2024-09-19T08:57:44.753 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T08:57:44.786 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:57:44.786 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T08:57:44.787 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T08:57:44.787 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.i 2024-09-19T08:57:44.928 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 19 08:57:44 smithi175 systemd[1]: Stopping Ceph mds.i for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:57:45.428 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 19 08:57:45 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-i[66517]: 2024-09-19T08:57:45.089+0000 7f201fdca640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:57:45.428 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 19 08:57:45 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-i[66517]: 2024-09-19T08:57:45.089+0000 7f201fdca640 -1 mds.i *** got signal Terminated *** 2024-09-19T08:57:48.272 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 19 08:57:48 smithi175 podman[73241]: 2024-09-19 08:57:48.006605531 +0000 UTC m=+3.003950745 container died ce369a8c0e5e5f0b42e5b820a60dc59626ff364c693e9c1778a6dc40f4583e82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-i, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:57:48.614 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 19 08:57:48 smithi175 podman[73241]: 2024-09-19 08:57:48.364382726 +0000 UTC m=+3.361727939 container cleanup ce369a8c0e5e5f0b42e5b820a60dc59626ff364c693e9c1778a6dc40f4583e82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-i, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T08:57:48.614 INFO:journalctl@ceph.mds.i.smithi175.stdout:Sep 19 08:57:48 smithi175 bash[73241]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-i 2024-09-19T08:57:48.795 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T08:57:48.827 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:57:48.827 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T08:57:48.827 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T08:57:48.827 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.l 2024-09-19T08:57:49.142 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 19 08:57:48 smithi175 systemd[1]: Stopping Ceph mds.l for ebd23124-7661-11ef-bceb-c7b262605968... 2024-09-19T08:57:49.428 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 19 08:57:49 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-l[65608]: 2024-09-19T08:57:49.142+0000 7f4089973640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:57:49.428 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 19 08:57:49 smithi175 ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-l[65608]: 2024-09-19T08:57:49.142+0000 7f4089973640 -1 mds.l *** got signal Terminated *** 2024-09-19T08:57:52.393 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 19 08:57:52 smithi175 podman[73360]: 2024-09-19 08:57:52.142130694 +0000 UTC m=+3.100536542 container died c9abc295bb7ec78c5c7f9a2d8301e17d3fe9acbaad9a3c88f36a9aa0426fc712 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-l, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T08:57:52.659 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 19 08:57:52 smithi175 podman[73360]: 2024-09-19 08:57:52.484377858 +0000 UTC m=+3.442783704 container cleanup c9abc295bb7ec78c5c7f9a2d8301e17d3fe9acbaad9a3c88f36a9aa0426fc712 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:57:52.659 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 19 08:57:52 smithi175 bash[73360]: ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-l 2024-09-19T08:57:52.895 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T08:57:52.916 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 19 08:57:52 smithi175 podman[73372]: 2024-09-19 08:57:52.66016196 +0000 UTC m=+0.516623350 container remove c9abc295bb7ec78c5c7f9a2d8301e17d3fe9acbaad9a3c88f36a9aa0426fc712 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-ebd23124-7661-11ef-bceb-c7b262605968-mds-l, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:57:52.916 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 19 08:57:52 smithi175 systemd[1]: ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.l.service: Deactivated successfully. 2024-09-19T08:57:52.916 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 19 08:57:52 smithi175 systemd[1]: Stopped Ceph mds.l for ebd23124-7661-11ef-bceb-c7b262605968. 2024-09-19T08:57:52.916 INFO:journalctl@ceph.mds.l.smithi175.stdout:Sep 19 08:57:52 smithi175 systemd[1]: ceph-ebd23124-7661-11ef-bceb-c7b262605968@mds.l.service: Consumed 1.055s CPU time. 2024-09-19T08:57:52.926 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T08:57:52.926 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T08:57:52.926 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ebd23124-7661-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T08:57:53.137 INFO:teuthology.orchestra.run.smithi007.stdout:Deleting cluster with fsid: ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:57:55.722 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ebd23124-7661-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T08:57:55.930 INFO:teuthology.orchestra.run.smithi044.stdout:Deleting cluster with fsid: ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:57:58.368 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ebd23124-7661-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T08:57:58.567 INFO:teuthology.orchestra.run.smithi175.stdout:Deleting cluster with fsid: ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:58:00.960 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:58:00.996 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:58:01.029 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:58:01.057 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T08:58:01.059 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911855/remote/smithi007/crash 2024-09-19T08:58:01.060 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/crash -- . 2024-09-19T08:58:01.096 INFO:teuthology.orchestra.run.smithi007.stderr:tar: /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T08:58:01.096 INFO:teuthology.orchestra.run.smithi007.stderr:tar: Error is not recoverable: exiting now 2024-09-19T08:58:01.098 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911855/remote/smithi044/crash 2024-09-19T08:58:01.099 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/crash -- . 2024-09-19T08:58:01.136 INFO:teuthology.orchestra.run.smithi044.stderr:tar: /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T08:58:01.136 INFO:teuthology.orchestra.run.smithi044.stderr:tar: Error is not recoverable: exiting now 2024-09-19T08:58:01.140 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911855/remote/smithi175/crash 2024-09-19T08:58:01.141 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/crash -- . 2024-09-19T08:58:01.211 INFO:teuthology.orchestra.run.smithi175.stderr:tar: /var/lib/ceph/ebd23124-7661-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T08:58:01.211 INFO:teuthology.orchestra.run.smithi175.stderr:tar: Error is not recoverable: exiting now 2024-09-19T08:58:01.212 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T08:58:01.212 DEBUG:teuthology.orchestra.run.smithi007:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T08:58:01.256 INFO:tasks.cephadm:Compressing logs... 2024-09-19T08:58:01.256 DEBUG:teuthology.orchestra.run.smithi007:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T08:58:01.299 DEBUG:teuthology.orchestra.run.smithi044:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T08:58:01.302 DEBUG:teuthology.orchestra.run.smithi175:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T08:58:01.326 INFO:teuthology.orchestra.run.smithi007.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T08:58:01.326 INFO:teuthology.orchestra.run.smithi007.stderr:: No such file or directory 2024-09-19T08:58:01.327 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T08:58:01.327 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T08:58:01.327 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T08:58:01.329 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T08:58:01.329 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T08:58:01.329 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T08:58:01.329 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T08:58:01.329 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T08:58:01.329 INFO:teuthology.orchestra.run.smithi007.stderr: 84.4% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T08:58:01.334 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.g.log: 90.2% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T08:58:01.334 INFO:teuthology.orchestra.run.smithi007.stderr: 94.5% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T08:58:01.334 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.log 2024-09-19T08:58:01.334 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T08:58:01.337 INFO:teuthology.orchestra.run.smithi175.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T08:58:01.337 INFO:teuthology.orchestra.run.smithi175.stderr:: No such file or directory 2024-09-19T08:58:01.337 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T08:58:01.337 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T08:58:01.337 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T08:58:01.338 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T08:58:01.338 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose --/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T08:58:01.338 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T08:58:01.338 INFO:teuthology.orchestra.run.smithi175.stderr: 81.9% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T08:58:01.338 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T08:58:01.338 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.log 2024-09-19T08:58:01.338 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T08:58:01.338 INFO:teuthology.orchestra.run.smithi175.stderr: 90.4% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T08:58:01.338 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T08:58:01.339 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.l.log: 87.6% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T08:58:01.339 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T08:58:01.339 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.8.log: 94.6% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T08:58:01.339 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T08:58:01.347 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T08:58:01.347 INFO:teuthology.orchestra.run.smithi007.stderr: 94.6% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T08:58:01.347 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T08:58:01.347 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mgr.x.log: 87.6% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T08:58:01.347 INFO:teuthology.orchestra.run.smithi007.stderr: 94.6% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T08:58:01.347 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T08:58:01.347 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T08:58:01.347 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.3.log: 90.9% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T08:58:01.347 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/cephadm.log: 94.6% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T08:58:01.349 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mgr.z.log: 90.9% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T08:58:01.350 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T08:58:01.350 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.c.log: 91.9% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T08:58:01.350 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T08:58:01.351 INFO:teuthology.orchestra.run.smithi044.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T08:58:01.351 INFO:teuthology.orchestra.run.smithi044.stderr:: No such file or directory 2024-09-19T08:58:01.351 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T08:58:01.351 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T08:58:01.351 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.10.log: /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T08:58:01.351 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T08:58:01.351 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T08:58:01.351 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T08:58:01.352 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T08:58:01.352 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T08:58:01.352 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T08:58:01.352 INFO:teuthology.orchestra.run.smithi044.stderr: 94.4% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T08:58:01.352 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 91.0% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T08:58:01.352 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T08:58:01.352 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 81.9% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T08:58:01.352 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.log 2024-09-19T08:58:01.352 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T08:58:01.352 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T08:58:01.352 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.h.log: 87.6% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T08:58:01.353 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T08:58:01.354 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mon.b.log: 91.8% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T08:58:01.354 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T08:58:01.354 INFO:teuthology.orchestra.run.smithi007.stderr: 94.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T08:58:01.359 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T08:58:01.377 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T08:58:01.402 INFO:teuthology.orchestra.run.smithi175.stderr: 92.3% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T08:58:01.408 INFO:teuthology.orchestra.run.smithi175.stderr: 94.5% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T08:58:01.421 INFO:teuthology.orchestra.run.smithi175.stderr: 93.9% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T08:58:01.424 INFO:teuthology.orchestra.run.smithi044.stderr: 92.3% 94.3% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T08:58:01.424 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T08:58:01.661 INFO:teuthology.orchestra.run.smithi044.stderr: 91.9% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T08:58:01.700 INFO:teuthology.orchestra.run.smithi007.stderr: 90.2% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T08:58:01.701 INFO:teuthology.orchestra.run.smithi175.stderr: 91.6% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T08:58:01.765 INFO:teuthology.orchestra.run.smithi044.stderr: 92.9% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T08:58:01.993 INFO:teuthology.orchestra.run.smithi175.stderr: 93.2% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T08:58:02.107 INFO:teuthology.orchestra.run.smithi007.stderr: 93.2% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T08:58:02.156 INFO:teuthology.orchestra.run.smithi007.stderr: 90.5% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T08:58:02.222 INFO:teuthology.orchestra.run.smithi044.stderr: 93.2% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T08:58:02.241 INFO:teuthology.orchestra.run.smithi007.stderr: 93.4% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T08:58:02.256 INFO:teuthology.orchestra.run.smithi175.stderr: 93.2% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T08:58:02.272 INFO:teuthology.orchestra.run.smithi044.stderr: 93.6% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T08:58:02.374 INFO:teuthology.orchestra.run.smithi044.stderr: 93.2% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T08:58:02.375 INFO:teuthology.orchestra.run.smithi175.stderr: 94.3% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T08:58:02.406 INFO:teuthology.orchestra.run.smithi007.stderr: 93.1% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T08:58:02.686 INFO:teuthology.orchestra.run.smithi175.stderr: 93.4% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T08:58:02.688 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-09-19T08:58:02.688 INFO:teuthology.orchestra.run.smithi175.stderr:real 0m1.372s 2024-09-19T08:58:02.688 INFO:teuthology.orchestra.run.smithi175.stderr:user 0m4.472s 2024-09-19T08:58:02.688 INFO:teuthology.orchestra.run.smithi175.stderr:sys 0m0.168s 2024-09-19T08:58:02.711 INFO:teuthology.orchestra.run.smithi044.stderr: 93.6% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T08:58:02.713 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-19T08:58:02.713 INFO:teuthology.orchestra.run.smithi044.stderr:real 0m1.397s 2024-09-19T08:58:02.713 INFO:teuthology.orchestra.run.smithi044.stderr:user 0m5.011s 2024-09-19T08:58:02.713 INFO:teuthology.orchestra.run.smithi044.stderr:sys 0m0.208s 2024-09-19T08:58:02.838 INFO:teuthology.orchestra.run.smithi007.stderr: 93.6% -- replaced with /var/log/ceph/ebd23124-7661-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T08:58:02.840 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-19T08:58:02.840 INFO:teuthology.orchestra.run.smithi007.stderr:real 0m1.526s 2024-09-19T08:58:02.840 INFO:teuthology.orchestra.run.smithi007.stderr:user 0m5.351s 2024-09-19T08:58:02.840 INFO:teuthology.orchestra.run.smithi007.stderr:sys 0m0.188s 2024-09-19T08:58:02.840 INFO:tasks.cephadm:Archiving logs... 2024-09-19T08:58:02.840 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911855/remote/smithi007/log 2024-09-19T08:58:02.842 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T08:58:03.647 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911855/remote/smithi044/log 2024-09-19T08:58:03.648 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T08:58:04.379 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911855/remote/smithi175/log 2024-09-19T08:58:04.380 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T08:58:05.028 INFO:tasks.cephadm:Removing cluster... 2024-09-19T08:58:05.028 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ebd23124-7661-11ef-bceb-c7b262605968 --force 2024-09-19T08:58:05.232 INFO:teuthology.orchestra.run.smithi007.stdout:Deleting cluster with fsid: ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:58:05.499 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ebd23124-7661-11ef-bceb-c7b262605968 --force 2024-09-19T08:58:05.709 INFO:teuthology.orchestra.run.smithi044.stdout:Deleting cluster with fsid: ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:58:05.964 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ebd23124-7661-11ef-bceb-c7b262605968 --force 2024-09-19T08:58:06.159 INFO:teuthology.orchestra.run.smithi175.stdout:Deleting cluster with fsid: ebd23124-7661-11ef-bceb-c7b262605968 2024-09-19T08:58:06.438 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T08:58:06.438 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T08:58:06.457 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T08:58:06.474 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T08:58:06.492 INFO:tasks.cephadm:Teardown complete 2024-09-19T08:58:06.492 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T08:58:06.503 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T08:58:06.504 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T08:58:06.508 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T08:58:06.517 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T08:58:06.626 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T08:58:06.638 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T08:58:06.638 DEBUG:teuthology.orchestra.run.smithi007:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:58:06.641 DEBUG:teuthology.orchestra.run.smithi044:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:58:06.644 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:58:06.656 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:58:06.656 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:58:06.660 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:58:06.662 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:58:06.662 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2024-09-19T08:58:06.662 INFO:teuthology.orchestra.run.smithi044.stdout:^* hv01.front.sepia.ceph.com 3 6 377 19 +1278us[+1282us] +/- 38ms 2024-09-19T08:58:06.662 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 21 -3798us[-3794us] +/- 63ms 2024-09-19T08:58:06.662 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 +1722us[+1726us] +/- 61ms 2024-09-19T08:58:06.663 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:58:06.663 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:58:06.663 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2024-09-19T08:58:06.663 INFO:teuthology.orchestra.run.smithi007.stdout:^* hv01.front.sepia.ceph.com 3 6 377 16 +1280us[+1306us] +/- 38ms 2024-09-19T08:58:06.663 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 19 -3783us[-3758us] +/- 63ms 2024-09-19T08:58:06.663 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 +1697us[+1723us] +/- 61ms 2024-09-19T08:58:06.663 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:58:06.664 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:58:06.664 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-09-19T08:58:06.664 INFO:teuthology.orchestra.run.smithi175.stdout:^* hv01.front.sepia.ceph.com 3 6 377 19 +1286us[+1297us] +/- 38ms 2024-09-19T08:58:06.664 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 -3796us[-3785us] +/- 63ms 2024-09-19T08:58:06.664 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 +1685us[+1685us] +/- 61ms 2024-09-19T08:58:06.664 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:58:06.665 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T08:58:06.676 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T08:58:06.676 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T08:58:06.699 DEBUG:teuthology.orchestra.run.smithi007:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T08:58:06.792 DEBUG:teuthology.orchestra.run.smithi044:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T08:58:06.862 DEBUG:teuthology.orchestra.run.smithi175:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T08:58:06.932 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:58:06.963 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:58:06.964 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:58:06.992 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:58:06.992 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:58:07.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:58:07.021 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T08:58:07.032 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T08:58:07.066 INFO:teuthology.task.internal:Duration was 1829.461631 seconds 2024-09-19T08:58:07.067 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T08:58:07.100 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T08:58:07.100 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T08:58:07.102 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T08:58:07.105 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T08:58:07.142 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:58:07.143 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:58:07.143 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:58:07.590 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T08:58:07.590 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi007.front.sepia.ceph.com 2024-09-19T08:58:07.591 DEBUG:teuthology.orchestra.run.smithi007:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T08:58:07.614 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi044.front.sepia.ceph.com 2024-09-19T08:58:07.614 DEBUG:teuthology.orchestra.run.smithi044:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T08:58:07.657 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2024-09-19T08:58:07.657 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T08:58:07.679 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T08:58:07.679 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T08:58:07.682 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T08:58:07.701 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T08:58:07.746 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T08:58:07.747 DEBUG:teuthology.orchestra.run.smithi007:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T08:58:07.753 DEBUG:teuthology.orchestra.run.smithi044:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T08:58:07.767 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T08:58:08.975 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T08:58:08.986 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T08:58:08.986 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T08:58:09.012 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T08:58:09.042 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T08:58:09.073 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T08:58:09.085 DEBUG:teuthology.orchestra.run.smithi007:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:58:09.088 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:58:09.090 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:58:09.112 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = core 2024-09-19T08:58:09.115 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = core 2024-09-19T08:58:09.138 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2024-09-19T08:58:09.162 DEBUG:teuthology.orchestra.run.smithi007:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:58:09.178 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:58:09.179 DEBUG:teuthology.orchestra.run.smithi044:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:58:09.195 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:58:09.195 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:58:09.218 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:58:09.218 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T08:58:09.231 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T08:58:09.232 DEBUG:teuthology.misc:Transferring archived files from smithi007:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911855/remote/smithi007 2024-09-19T08:58:09.232 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T08:58:09.296 DEBUG:teuthology.misc:Transferring archived files from smithi044:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911855/remote/smithi044 2024-09-19T08:58:09.296 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T08:58:09.335 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911855/remote/smithi175 2024-09-19T08:58:09.335 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T08:58:09.373 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T08:58:09.374 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T08:58:09.376 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T08:58:09.379 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T08:58:09.422 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T08:58:09.436 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T08:58:09.436 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T08:58:09.459 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T08:58:09.459 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T08:58:09.461 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T08:58:09.463 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T08:58:09.474 INFO:teuthology.orchestra.run.smithi007.stdout: 265613 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 08:58 /home/ubuntu/cephtest 2024-09-19T08:58:09.477 INFO:teuthology.orchestra.run.smithi044.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 08:58 /home/ubuntu/cephtest 2024-09-19T08:58:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 08:58 /home/ubuntu/cephtest 2024-09-19T08:58:09.480 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T08:58:09.492 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T08:58:09.562 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/fsync-tester}} duration: 1829.4616312980652 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T08:58:09.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T08:58:09.646 INFO:teuthology.run:pass